2024-09-12T17:17:25.378 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T17:17:25.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T17:17:25.483 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902730 branch: wip-rgw-meta-handlers description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_latest}} email: null first_in_suite: false job_id: '7902730' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rgw-meta-handlers ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b rgw: ec-data-pool: false frontend: beast thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rgw-meta-handlers sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b owner: scheduled_cbodley@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 6279 sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b sleep_before_teardown: 0 suite: rgw suite_branch: wip-rgw-meta-handlers suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b targets: smithi047.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNpt94jTAvk548Qv10Wlrp3QvdwDRVGL2ul6gNFCbwq3Ga6+1KB0RXg1V/d+9AMTLFj6DBuLFkKpWn9HWry8+ss= smithi170.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDvm+GbliKohzBizMJXShp03WXLAIU3nzVHNQ/YdHGTx5Aw3m1tKCV7pbulbUIbx/ZNUfzee9yBy+s2dRZehzJI= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-12_15:39:52 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T17:17:25.483 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa; will attempt to use it 2024-09-12T17:17:25.484 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa/tasks 2024-09-12T17:17:25.484 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T17:17:25.486 INFO:teuthology.task.internal:Checking packages... 2024-09-12T17:17:25.507 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'bad475c18c96ec20c5778159aa33ba72b84e9c1b' 2024-09-12T17:17:25.507 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T17:17:25.507 INFO:teuthology.packaging:ref: None 2024-09-12T17:17:25.507 INFO:teuthology.packaging:tag: None 2024-09-12T17:17:25.507 INFO:teuthology.packaging:branch: wip-rgw-meta-handlers 2024-09-12T17:17:25.507 INFO:teuthology.packaging:sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:17:25.507 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rgw-meta-handlers 2024-09-12T17:17:25.657 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4762.gbad475c1 2024-09-12T17:17:25.658 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T17:17:25.664 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T17:17:25.664 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T17:17:25.771 INFO:teuthology.task.internal:Saving configuration 2024-09-12T17:17:25.782 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T17:17:25.810 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T17:17:25.834 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi047.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902730', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 17:12:00.486971', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNpt94jTAvk548Qv10Wlrp3QvdwDRVGL2ul6gNFCbwq3Ga6+1KB0RXg1V/d+9AMTLFj6DBuLFkKpWn9HWry8+ss='} 2024-09-12T17:17:25.855 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi170.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902730', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 17:12:00.488356', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDvm+GbliKohzBizMJXShp03WXLAIU3nzVHNQ/YdHGTx5Aw3m1tKCV7pbulbUIbx/ZNUfzee9yBy+s2dRZehzJI='} 2024-09-12T17:17:25.855 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T17:17:25.862 INFO:teuthology.task.internal:roles: ubuntu@smithi047.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-09-12T17:17:25.862 INFO:teuthology.task.internal:roles: ubuntu@smithi170.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-09-12T17:17:25.863 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T17:17:25.938 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd9169ebac0>, signals=[15]) 2024-09-12T17:17:25.938 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T17:17:25.945 INFO:teuthology.task.internal:Opening connections... 2024-09-12T17:17:25.945 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi047.front.sepia.ceph.com 2024-09-12T17:17:25.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:17:26.026 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi170.front.sepia.ceph.com 2024-09-12T17:17:26.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:17:26.107 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T17:17:26.113 DEBUG:teuthology.orchestra.run.smithi047:> uname -m 2024-09-12T17:17:26.131 INFO:teuthology.orchestra.run.smithi047.stdout:x86_64 2024-09-12T17:17:26.131 DEBUG:teuthology.orchestra.run.smithi047:> cat /etc/os-release 2024-09-12T17:17:26.190 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="CentOS Stream" 2024-09-12T17:17:26.190 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="9" 2024-09-12T17:17:26.191 INFO:teuthology.orchestra.run.smithi047.stdout:ID="centos" 2024-09-12T17:17:26.191 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE="rhel fedora" 2024-09-12T17:17:26.191 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="9" 2024-09-12T17:17:26.191 INFO:teuthology.orchestra.run.smithi047.stdout:PLATFORM_ID="platform:el9" 2024-09-12T17:17:26.191 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T17:17:26.191 INFO:teuthology.orchestra.run.smithi047.stdout:ANSI_COLOR="0;31" 2024-09-12T17:17:26.191 INFO:teuthology.orchestra.run.smithi047.stdout:LOGO="fedora-logo-icon" 2024-09-12T17:17:26.191 INFO:teuthology.orchestra.run.smithi047.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T17:17:26.191 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://centos.org/" 2024-09-12T17:17:26.191 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T17:17:26.192 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T17:17:26.192 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T17:17:26.192 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server 2024-09-12T17:17:26.218 DEBUG:teuthology.orchestra.run.smithi170:> uname -m 2024-09-12T17:17:26.237 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64 2024-09-12T17:17:26.237 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2024-09-12T17:17:26.295 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="CentOS Stream" 2024-09-12T17:17:26.295 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="9" 2024-09-12T17:17:26.295 INFO:teuthology.orchestra.run.smithi170.stdout:ID="centos" 2024-09-12T17:17:26.296 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="rhel fedora" 2024-09-12T17:17:26.296 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="9" 2024-09-12T17:17:26.296 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el9" 2024-09-12T17:17:26.296 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T17:17:26.296 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31" 2024-09-12T17:17:26.296 INFO:teuthology.orchestra.run.smithi170.stdout:LOGO="fedora-logo-icon" 2024-09-12T17:17:26.296 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T17:17:26.296 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://centos.org/" 2024-09-12T17:17:26.296 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T17:17:26.296 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T17:17:26.296 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T17:17:26.297 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2024-09-12T17:17:26.318 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T17:17:26.328 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T17:17:26.390 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T17:17:26.390 DEBUG:teuthology.orchestra.run.smithi047:> test '!' -e /home/ubuntu/cephtest 2024-09-12T17:17:26.393 DEBUG:teuthology.orchestra.run.smithi170:> test '!' -e /home/ubuntu/cephtest 2024-09-12T17:17:26.409 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T17:17:26.441 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T17:17:26.441 DEBUG:teuthology.orchestra.run.smithi047:> test -z $(ls -A /var/lib/ceph) 2024-09-12T17:17:26.450 DEBUG:teuthology.orchestra.run.smithi170:> test -z $(ls -A /var/lib/ceph) 2024-09-12T17:17:26.566 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T17:17:26.619 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T17:17:26.636 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-12T17:17:26.636 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-12T17:17:26.636 DEBUG:teuthology.orchestra.run.smithi047:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T17:17:26.637 DEBUG:teuthology.orchestra.run.smithi170:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T17:17:26.653 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:17:26.654 DEBUG:teuthology.orchestra.run.smithi047:> uname -r 2024-09-12T17:17:26.654 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:17:26.655 DEBUG:teuthology.orchestra.run.smithi170:> uname -r 2024-09-12T17:17:26.711 INFO:teuthology.orchestra.run.smithi047.stdout:5.14.0-503.el9.x86_64 2024-09-12T17:17:26.712 INFO:teuthology.task.kernel:Running kernel on smithi047: 5.14.0-503.el9.x86_64 2024-09-12T17:17:26.712 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum install -y kernel 2024-09-12T17:17:26.713 INFO:teuthology.orchestra.run.smithi170.stdout:5.14.0-503.el9.x86_64 2024-09-12T17:17:26.713 INFO:teuthology.task.kernel:Running kernel on smithi170: 5.14.0-503.el9.x86_64 2024-09-12T17:17:26.713 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum install -y kernel 2024-09-12T17:17:30.263 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - BaseOS 4.5 MB/s | 8.2 MB 00:01 2024-09-12T17:17:30.335 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.2 MB 00:01 2024-09-12T17:17:33.260 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - AppStream 11 MB/s | 20 MB 00:01 2024-09-12T17:17:37.811 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-12T17:17:40.012 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 19 kB 00:00 2024-09-12T17:17:40.774 INFO:teuthology.orchestra.run.smithi170.stdout:Extra Packages for Enterprise Linux 36 MB/s | 23 MB 00:00 2024-09-12T17:17:46.189 INFO:teuthology.orchestra.run.smithi170.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-12T17:17:48.229 INFO:teuthology.orchestra.run.smithi170.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T17:17:48.229 INFO:teuthology.orchestra.run.smithi170.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T17:17:48.317 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-12T17:17:48.329 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:17:48.330 INFO:teuthology.orchestra.run.smithi170.stdout: Package Architecture Version Repository Size 2024-09-12T17:17:48.330 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:17:48.330 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-12T17:17:48.330 INFO:teuthology.orchestra.run.smithi170.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T17:17:48.330 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-09-12T17:17:48.330 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T17:17:48.330 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T17:17:48.330 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T17:17:48.331 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:17:48.331 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-12T17:17:48.331 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:17:48.331 INFO:teuthology.orchestra.run.smithi170.stdout:Install 4 Packages 2024-09-12T17:17:48.331 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:17:48.331 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 79 M 2024-09-12T17:17:48.331 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 126 M 2024-09-12T17:17:48.332 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-12T17:17:48.732 INFO:teuthology.orchestra.run.smithi170.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 188 kB/s | 23 kB 00:00 2024-09-12T17:17:50.323 INFO:teuthology.orchestra.run.smithi170.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 9.1 MB/s | 16 MB 00:01 2024-09-12T17:17:51.445 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - AppStream 1.0 MB/s | 20 MB 00:20 2024-09-12T17:17:56.146 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-12T17:17:57.613 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - Extras packages 82 kB/s | 19 kB 00:00 2024-09-12T17:17:58.517 INFO:teuthology.orchestra.run.smithi047.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-12T17:18:01.422 INFO:teuthology.orchestra.run.smithi170.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 2.2 MB/s | 29 MB 00:12 2024-09-12T17:18:04.182 INFO:teuthology.orchestra.run.smithi047.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-12T17:18:04.297 INFO:teuthology.orchestra.run.smithi170.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 2.2 MB/s | 35 MB 00:15 2024-09-12T17:18:04.297 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:18:04.297 INFO:teuthology.orchestra.run.smithi170.stdout:Total 4.9 MB/s | 79 MB 00:15 2024-09-12T17:18:04.985 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-12T17:18:05.334 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-12T17:18:05.335 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-12T17:18:06.246 INFO:teuthology.orchestra.run.smithi047.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T17:18:06.247 INFO:teuthology.orchestra.run.smithi047.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T17:18:06.284 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-12T17:18:06.284 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-12T17:18:06.331 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T17:18:06.349 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:18:06.349 INFO:teuthology.orchestra.run.smithi047.stdout: Package Architecture Version Repository Size 2024-09-12T17:18:06.349 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:18:06.349 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-12T17:18:06.349 INFO:teuthology.orchestra.run.smithi047.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T17:18:06.349 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-09-12T17:18:06.349 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T17:18:06.349 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T17:18:06.349 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T17:18:06.349 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:18:06.349 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-12T17:18:06.350 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:18:06.350 INFO:teuthology.orchestra.run.smithi047.stdout:Install 4 Packages 2024-09-12T17:18:06.350 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:18:06.350 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 79 M 2024-09-12T17:18:06.350 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 126 M 2024-09-12T17:18:06.350 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-12T17:18:06.466 INFO:teuthology.orchestra.run.smithi047.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 339 kB/s | 23 kB 00:00 2024-09-12T17:18:07.300 INFO:teuthology.orchestra.run.smithi047.stdout:(2/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 38 MB/s | 35 MB 00:00 2024-09-12T17:18:07.492 INFO:teuthology.orchestra.run.smithi047.stdout:(3/4): kernel-core-5.14.0-505.el9.x86_64.rpm 14 MB/s | 16 MB 00:01 2024-09-12T17:18:08.159 INFO:teuthology.orchestra.run.smithi047.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 17 MB/s | 29 MB 00:01 2024-09-12T17:18:08.159 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:18:08.159 INFO:teuthology.orchestra.run.smithi047.stdout:Total 44 MB/s | 79 MB 00:01 2024-09-12T17:18:08.751 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-12T17:18:08.866 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-12T17:18:09.240 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-12T17:18:09.240 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-12T17:18:09.606 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T17:18:09.698 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T17:18:10.217 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-12T17:18:10.218 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-12T17:18:12.498 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T17:18:12.678 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T17:18:12.773 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-12T17:18:13.428 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T17:18:13.544 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T17:18:16.331 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T17:18:16.462 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T17:18:17.495 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T17:18:17.611 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:18:21.584 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T17:18:21.629 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:18:22.441 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:18:26.766 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:19:00.294 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:19:00.333 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:19:00.664 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:19:00.664 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T17:19:00.664 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T17:19:00.664 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T17:19:01.551 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:19:01.552 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:19:01.552 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-12T17:19:01.552 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T17:19:01.552 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T17:19:01.552 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T17:19:01.552 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T17:19:01.552 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:19:01.552 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-12T17:19:01.924 DEBUG:teuthology.orchestra.run.smithi170:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T17:19:02.016 INFO:teuthology.orchestra.run.smithi170.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T17:19:02.016 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T17:19:02.016 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T17:19:02.016 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T17:19:02.016 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T17:19:02.017 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-12T17:19:02.017 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi170.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T17:19:02.017 DEBUG:teuthology.orchestra.run.smithi170:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T17:19:02.076 INFO:teuthology.orchestra.run.smithi170.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T17:19:02.076 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T17:19:02.077 DEBUG:teuthology.orchestra.run.smithi170:> sudo rpm -qi grub2-tools 2024-09-12T17:19:02.111 INFO:teuthology.orchestra.run.smithi170.stdout:Name : grub2-tools 2024-09-12T17:19:02.112 INFO:teuthology.orchestra.run.smithi170.stdout:Epoch : 1 2024-09-12T17:19:02.112 INFO:teuthology.orchestra.run.smithi170.stdout:Version : 2.06 2024-09-12T17:19:02.112 INFO:teuthology.orchestra.run.smithi170.stdout:Release : 82.el9 2024-09-12T17:19:02.112 INFO:teuthology.orchestra.run.smithi170.stdout:Architecture: x86_64 2024-09-12T17:19:02.112 INFO:teuthology.orchestra.run.smithi170.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T17:19:02.112 INFO:teuthology.orchestra.run.smithi170.stdout:Group : Unspecified 2024-09-12T17:19:02.112 INFO:teuthology.orchestra.run.smithi170.stdout:Size : 8274670 2024-09-12T17:19:02.112 INFO:teuthology.orchestra.run.smithi170.stdout:License : GPLv3+ 2024-09-12T17:19:02.112 INFO:teuthology.orchestra.run.smithi170.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T17:19:02.112 INFO:teuthology.orchestra.run.smithi170.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T17:19:02.112 INFO:teuthology.orchestra.run.smithi170.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T17:19:02.112 INFO:teuthology.orchestra.run.smithi170.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T17:19:02.113 INFO:teuthology.orchestra.run.smithi170.stdout:Packager : builder@centos.org 2024-09-12T17:19:02.113 INFO:teuthology.orchestra.run.smithi170.stdout:Vendor : CentOS 2024-09-12T17:19:02.113 INFO:teuthology.orchestra.run.smithi170.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T17:19:02.113 INFO:teuthology.orchestra.run.smithi170.stdout:Summary : Support tools for GRUB. 2024-09-12T17:19:02.113 INFO:teuthology.orchestra.run.smithi170.stdout:Description : 2024-09-12T17:19:02.113 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:19:02.113 INFO:teuthology.orchestra.run.smithi170.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T17:19:02.113 INFO:teuthology.orchestra.run.smithi170.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T17:19:02.113 INFO:teuthology.orchestra.run.smithi170.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T17:19:02.113 INFO:teuthology.orchestra.run.smithi170.stdout:hardware devices. 2024-09-12T17:19:02.114 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:19:02.114 INFO:teuthology.orchestra.run.smithi170.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T17:19:02.114 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T17:19:02.115 INFO:teuthology.task.kernel:Updating grub on smithi170 to boot 5.14.0-505.el9.x86_64 2024-09-12T17:19:02.115 DEBUG:teuthology.orchestra.run.smithi170:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T17:19:02.800 INFO:teuthology.orchestra.run.smithi170.stderr:Generating grub configuration file ... 2024-09-12T17:19:04.169 INFO:teuthology.orchestra.run.smithi170.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T17:19:04.194 INFO:teuthology.orchestra.run.smithi170.stderr:done 2024-09-12T17:19:04.205 DEBUG:teuthology.orchestra.run.smithi170:> mktemp 2024-09-12T17:19:04.220 INFO:teuthology.orchestra.run.smithi170.stdout:/tmp/tmp.Jo9TczQgTS 2024-09-12T17:19:04.220 DEBUG:teuthology.orchestra.run.smithi170:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Jo9TczQgTS 2024-09-12T17:19:04.298 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 0666 /tmp/tmp.Jo9TczQgTS 2024-09-12T17:19:04.445 DEBUG:teuthology.orchestra.remote:smithi170:/tmp/tmp.Jo9TczQgTS is 6KB 2024-09-12T17:19:04.494 DEBUG:teuthology.orchestra.run.smithi170:> rm -fr /tmp/tmp.Jo9TczQgTS 2024-09-12T17:19:04.508 DEBUG:teuthology.orchestra.run.smithi170:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T17:19:04.571 INFO:teuthology.orchestra.run.smithi170.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T17:19:04.571 INFO:teuthology.orchestra.run.smithi170.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T17:19:04.571 INFO:teuthology.orchestra.run.smithi170.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T17:19:04.571 INFO:teuthology.orchestra.run.smithi170.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T17:19:04.573 DEBUG:teuthology.orchestra.run.smithi170:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T17:19:04.719 DEBUG:teuthology.orchestra.run.smithi170:> sudo shutdown -r now 2024-09-12T17:19:05.494 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:19:05.535 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:19:05.864 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:19:05.864 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T17:19:05.864 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T17:19:05.864 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T17:19:06.680 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:19:06.680 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:19:06.680 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-12T17:19:06.681 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T17:19:06.681 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T17:19:06.681 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T17:19:06.681 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T17:19:06.681 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:19:06.681 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T17:19:07.061 DEBUG:teuthology.orchestra.run.smithi047:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T17:19:07.146 INFO:teuthology.orchestra.run.smithi047.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T17:19:07.146 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T17:19:07.146 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T17:19:07.147 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T17:19:07.147 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T17:19:07.147 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-12T17:19:07.147 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi047.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T17:19:07.147 DEBUG:teuthology.orchestra.run.smithi047:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T17:19:07.206 INFO:teuthology.orchestra.run.smithi047.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T17:19:07.206 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T17:19:07.206 DEBUG:teuthology.orchestra.run.smithi047:> sudo rpm -qi grub2-tools 2024-09-12T17:19:07.237 INFO:teuthology.orchestra.run.smithi047.stdout:Name : grub2-tools 2024-09-12T17:19:07.237 INFO:teuthology.orchestra.run.smithi047.stdout:Epoch : 1 2024-09-12T17:19:07.238 INFO:teuthology.orchestra.run.smithi047.stdout:Version : 2.06 2024-09-12T17:19:07.238 INFO:teuthology.orchestra.run.smithi047.stdout:Release : 82.el9 2024-09-12T17:19:07.238 INFO:teuthology.orchestra.run.smithi047.stdout:Architecture: x86_64 2024-09-12T17:19:07.238 INFO:teuthology.orchestra.run.smithi047.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T17:19:07.238 INFO:teuthology.orchestra.run.smithi047.stdout:Group : Unspecified 2024-09-12T17:19:07.238 INFO:teuthology.orchestra.run.smithi047.stdout:Size : 8274670 2024-09-12T17:19:07.238 INFO:teuthology.orchestra.run.smithi047.stdout:License : GPLv3+ 2024-09-12T17:19:07.238 INFO:teuthology.orchestra.run.smithi047.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T17:19:07.238 INFO:teuthology.orchestra.run.smithi047.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T17:19:07.238 INFO:teuthology.orchestra.run.smithi047.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T17:19:07.238 INFO:teuthology.orchestra.run.smithi047.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T17:19:07.238 INFO:teuthology.orchestra.run.smithi047.stdout:Packager : builder@centos.org 2024-09-12T17:19:07.238 INFO:teuthology.orchestra.run.smithi047.stdout:Vendor : CentOS 2024-09-12T17:19:07.239 INFO:teuthology.orchestra.run.smithi047.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T17:19:07.239 INFO:teuthology.orchestra.run.smithi047.stdout:Summary : Support tools for GRUB. 2024-09-12T17:19:07.239 INFO:teuthology.orchestra.run.smithi047.stdout:Description : 2024-09-12T17:19:07.239 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:19:07.239 INFO:teuthology.orchestra.run.smithi047.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T17:19:07.239 INFO:teuthology.orchestra.run.smithi047.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T17:19:07.239 INFO:teuthology.orchestra.run.smithi047.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T17:19:07.239 INFO:teuthology.orchestra.run.smithi047.stdout:hardware devices. 2024-09-12T17:19:07.239 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:19:07.239 INFO:teuthology.orchestra.run.smithi047.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T17:19:07.240 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T17:19:07.240 INFO:teuthology.task.kernel:Updating grub on smithi047 to boot 5.14.0-505.el9.x86_64 2024-09-12T17:19:07.240 DEBUG:teuthology.orchestra.run.smithi047:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T17:19:08.029 INFO:teuthology.orchestra.run.smithi047.stderr:Generating grub configuration file ... 2024-09-12T17:19:09.344 INFO:teuthology.orchestra.run.smithi047.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T17:19:09.381 INFO:teuthology.orchestra.run.smithi047.stderr:done 2024-09-12T17:19:09.383 DEBUG:teuthology.orchestra.run.smithi047:> mktemp 2024-09-12T17:19:09.438 INFO:teuthology.orchestra.run.smithi047.stdout:/tmp/tmp.v7t7aIYoBv 2024-09-12T17:19:09.438 DEBUG:teuthology.orchestra.run.smithi047:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.v7t7aIYoBv 2024-09-12T17:19:09.512 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0666 /tmp/tmp.v7t7aIYoBv 2024-09-12T17:19:09.648 DEBUG:teuthology.orchestra.remote:smithi047:/tmp/tmp.v7t7aIYoBv is 6KB 2024-09-12T17:19:09.696 DEBUG:teuthology.orchestra.run.smithi047:> rm -fr /tmp/tmp.v7t7aIYoBv 2024-09-12T17:19:09.710 DEBUG:teuthology.orchestra.run.smithi047:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T17:19:09.773 INFO:teuthology.orchestra.run.smithi047.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T17:19:09.773 INFO:teuthology.orchestra.run.smithi047.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T17:19:09.773 INFO:teuthology.orchestra.run.smithi047.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T17:19:09.773 INFO:teuthology.orchestra.run.smithi047.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T17:19:09.774 DEBUG:teuthology.orchestra.run.smithi047:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T17:19:09.929 DEBUG:teuthology.orchestra.run.smithi047:> sudo shutdown -r now 2024-09-12T17:19:34.734 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-12T17:19:34.735 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-09-12T17:19:34.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:19:39.936 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-12T17:19:39.937 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-12T17:19:39.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:20:34.794 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T17:20:39.943 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T17:20:43.799 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-09-12T17:20:43.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:20:44.267 DEBUG:teuthology.orchestra.run.smithi170:> true 2024-09-12T17:20:44.648 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-09-12T17:20:44.648 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-505.el9.x86_64"... 2024-09-12T17:20:44.648 DEBUG:teuthology.orchestra.run.smithi170:> uname -r 2024-09-12T17:20:44.663 INFO:teuthology.orchestra.run.smithi170.stdout:5.14.0-505.el9.x86_64 2024-09-12T17:20:44.663 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T17:20:44.663 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T17:20:44.663 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T17:20:45.664 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-12T17:20:45.664 DEBUG:teuthology.orchestra.run.smithi170:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T17:20:45.734 INFO:teuthology.orchestra.run.smithi170.stdout:ttyS1 2024-09-12T17:20:45.761 DEBUG:teuthology.parallel:result is None 2024-09-12T17:20:48.944 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-12T17:20:48.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:20:49.307 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-09-12T17:20:49.643 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-12T17:20:49.643 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-12T17:20:49.643 DEBUG:teuthology.orchestra.run.smithi047:> uname -r 2024-09-12T17:20:49.658 INFO:teuthology.orchestra.run.smithi047.stdout:5.14.0-505.el9.x86_64 2024-09-12T17:20:49.658 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T17:20:49.658 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T17:20:49.659 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T17:20:50.659 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-12T17:20:50.660 DEBUG:teuthology.orchestra.run.smithi047:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T17:20:50.761 INFO:teuthology.orchestra.run.smithi047.stdout:ttyS1 2024-09-12T17:20:50.793 DEBUG:teuthology.parallel:result is None 2024-09-12T17:20:50.793 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T17:20:50.799 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T17:20:50.799 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T17:20:50.802 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T17:20:50.823 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T17:20:50.842 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T17:20:50.913 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T17:20:50.913 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T17:20:50.916 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T17:20:50.987 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T17:20:50.998 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T17:20:50.998 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T17:20:51.000 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T17:20:51.026 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:20:51.036 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:20:51.321 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:20:51.333 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:20:51.335 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T17:20:51.342 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T17:20:51.342 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T17:20:51.345 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T17:20:51.370 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T17:20:51.379 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T17:20:51.380 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T17:20:51.412 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T17:20:51.426 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T17:20:51.539 DEBUG:teuthology.orchestra.run.smithi047:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T17:20:51.606 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T17:20:51.694 DEBUG:teuthology.orchestra.run.smithi047:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T17:20:51.773 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T17:20:51.773 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T17:20:51.829 DEBUG:teuthology.orchestra.run.smithi170:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T17:20:51.872 DEBUG:teuthology.orchestra.run.smithi170:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T17:20:51.925 DEBUG:teuthology.orchestra.run.smithi170:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T17:20:52.006 DEBUG:teuthology.orchestra.run.smithi170:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T17:20:52.047 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-12T17:20:52.047 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T17:20:52.112 DEBUG:teuthology.orchestra.run.smithi047:> sudo service rsyslog restart 2024-09-12T17:20:52.118 DEBUG:teuthology.orchestra.run.smithi170:> sudo service rsyslog restart 2024-09-12T17:20:52.198 INFO:teuthology.orchestra.run.smithi170.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T17:20:52.219 INFO:teuthology.orchestra.run.smithi047.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T17:20:52.660 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T17:20:52.668 INFO:teuthology.task.internal:Starting timer... 2024-09-12T17:20:52.669 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T17:20:52.714 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T17:20:52.778 DEBUG:teuthology.orchestra.run.smithi047:> sudo service auditd rotate 2024-09-12T17:20:52.936 INFO:teuthology.orchestra.run.smithi047.stdout:Rotating logs: 2024-09-12T17:20:52.938 DEBUG:teuthology.orchestra.run.smithi170:> sudo service auditd rotate 2024-09-12T17:20:52.992 INFO:teuthology.orchestra.run.smithi170.stdout:Rotating logs: 2024-09-12T17:20:52.994 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T17:20:52.994 DEBUG:teuthology.orchestra.run.smithi047:> /usr/sbin/getenforce 2024-09-12T17:20:53.054 INFO:teuthology.orchestra.run.smithi047.stdout:Permissive 2024-09-12T17:20:53.054 DEBUG:teuthology.orchestra.run.smithi170:> /usr/sbin/getenforce 2024-09-12T17:20:53.086 INFO:teuthology.orchestra.run.smithi170.stdout:Permissive 2024-09-12T17:20:53.086 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi047.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi170.front.sepia.ceph.com': 'permissive'} 2024-09-12T17:20:53.086 DEBUG:teuthology.orchestra.run.smithi047:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T17:20:53.112 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:20:53.113 DEBUG:teuthology.orchestra.run.smithi170:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T17:20:53.151 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:20:53.152 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T17:20:53.152 DEBUG:teuthology.orchestra.run.smithi047:> sudo /usr/sbin/setenforce permissive 2024-09-12T17:20:53.196 DEBUG:teuthology.orchestra.run.smithi170:> sudo /usr/sbin/setenforce permissive 2024-09-12T17:20:53.227 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T17:20:53.237 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-12T17:20:53.240 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-12T17:20:53.351 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T17:20:53.362 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T17:20:53.363 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi047.front.sepia.ceph.com,smithi170.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T17:24:42.034 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi047.front.sepia.ceph.com'), Remote(name='ubuntu@smithi170.front.sepia.ceph.com')] 2024-09-12T17:24:42.036 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-12T17:24:42.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:24:42.114 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-09-12T17:24:42.193 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-12T17:24:42.193 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-09-12T17:24:42.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:24:42.270 DEBUG:teuthology.orchestra.run.smithi170:> true 2024-09-12T17:24:42.343 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-09-12T17:24:42.344 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T17:24:42.354 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T17:24:42.354 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T17:24:42.355 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T17:24:42.357 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T17:24:42.357 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T17:24:42.387 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T17:24:42.402 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T17:24:42.413 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T17:24:42.427 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T17:24:42.428 INFO:teuthology.orchestra.run.smithi047.stderr:sudo: ntpd: command not found 2024-09-12T17:24:42.439 INFO:teuthology.orchestra.run.smithi047.stdout:506 Cannot talk to daemon 2024-09-12T17:24:42.451 INFO:teuthology.orchestra.run.smithi170.stderr:sudo: ntpd: command not found 2024-09-12T17:24:42.455 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T17:24:42.461 INFO:teuthology.orchestra.run.smithi170.stdout:506 Cannot talk to daemon 2024-09-12T17:24:42.469 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T17:24:42.476 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T17:24:42.490 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T17:24:42.526 INFO:teuthology.orchestra.run.smithi047.stderr:bash: line 1: ntpq: command not found 2024-09-12T17:24:42.529 INFO:teuthology.orchestra.run.smithi047.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T17:24:42.529 INFO:teuthology.orchestra.run.smithi047.stdout:=============================================================================== 2024-09-12T17:24:42.529 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:24:42.530 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:24:42.530 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:24:42.530 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:24:42.553 INFO:teuthology.orchestra.run.smithi170.stderr:bash: line 1: ntpq: command not found 2024-09-12T17:24:42.557 INFO:teuthology.orchestra.run.smithi170.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T17:24:42.557 INFO:teuthology.orchestra.run.smithi170.stdout:=============================================================================== 2024-09-12T17:24:42.557 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:24:42.557 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:24:42.557 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:24:42.557 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:24:42.558 INFO:teuthology.run_tasks:Running task install... 2024-09-12T17:24:42.566 DEBUG:teuthology.task.install:project ceph 2024-09-12T17:24:42.566 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}} 2024-09-12T17:24:42.566 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'} 2024-09-12T17:24:42.567 INFO:teuthology.task.install:Using flavor: default 2024-09-12T17:24:42.572 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T17:24:42.572 INFO:teuthology.task.install:extra packages: [] 2024-09-12T17:24:42.572 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'tag': None, 'wait_for_package': False} 2024-09-12T17:24:42.573 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:24:42.575 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'tag': None, 'wait_for_package': False} 2024-09-12T17:24:42.575 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:24:42.712 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/ 2024-09-12T17:24:42.712 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4762.gbad475c1 2024-09-12T17:24:42.721 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/ 2024-09-12T17:24:42.721 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4762.gbad475c1 2024-09-12T17:24:42.822 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T17:24:42.823 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T17:24:42.823 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T17:24:42.829 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T17:24:42.829 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-12T17:24:42.829 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T17:24:42.850 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-12T17:24:42.850 DEBUG:teuthology.orchestra.run.smithi047:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bad475c18c96ec20c5778159aa33ba72b84e9c1b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T17:24:42.856 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-12T17:24:42.856 DEBUG:teuthology.orchestra.run.smithi170:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bad475c18c96ec20c5778159aa33ba72b84e9c1b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T17:24:42.917 DEBUG:teuthology.orchestra.run.smithi047:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T17:24:42.921 DEBUG:teuthology.orchestra.run.smithi170:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T17:24:42.993 DEBUG:teuthology.orchestra.run.smithi047:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T17:24:42.996 DEBUG:teuthology.orchestra.run.smithi170:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T17:24:43.059 INFO:teuthology.orchestra.run.smithi047.stdout:check_obsoletes = 1 2024-09-12T17:24:43.060 INFO:teuthology.orchestra.run.smithi170.stdout:check_obsoletes = 1 2024-09-12T17:24:43.061 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum clean all 2024-09-12T17:24:43.062 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum clean all 2024-09-12T17:24:43.297 INFO:teuthology.orchestra.run.smithi047.stdout:45 files removed 2024-09-12T17:24:43.304 INFO:teuthology.orchestra.run.smithi170.stdout:45 files removed 2024-09-12T17:24:43.324 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-radosgw 2024-09-12T17:24:43.330 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-radosgw 2024-09-12T17:24:43.885 INFO:teuthology.orchestra.run.smithi170.stdout:ceph packages for x86_64 312 kB/s | 84 kB 00:00 2024-09-12T17:24:43.900 INFO:teuthology.orchestra.run.smithi047.stdout:ceph packages for x86_64 303 kB/s | 84 kB 00:00 2024-09-12T17:24:44.169 INFO:teuthology.orchestra.run.smithi170.stdout:ceph noarch packages 100 kB/s | 24 kB 00:00 2024-09-12T17:24:44.201 INFO:teuthology.orchestra.run.smithi047.stdout:ceph noarch packages 95 kB/s | 24 kB 00:00 2024-09-12T17:24:44.444 INFO:teuthology.orchestra.run.smithi170.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-12T17:24:44.476 INFO:teuthology.orchestra.run.smithi047.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-12T17:24:45.260 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-12T17:24:46.544 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - BaseOS 4.0 MB/s | 8.2 MB 00:02 2024-09-12T17:24:47.303 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-12T17:24:48.587 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-12T17:24:51.870 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-12T17:24:53.371 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - Extras packages 85 kB/s | 19 kB 00:00 2024-09-12T17:24:54.542 INFO:teuthology.orchestra.run.smithi047.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-12T17:24:54.773 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - CRB 2.7 MB/s | 6.5 MB 00:02 2024-09-12T17:24:57.299 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - Extras packages 15 kB/s | 19 kB 00:01 2024-09-12T17:24:58.445 INFO:teuthology.orchestra.run.smithi170.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-12T17:25:00.290 INFO:teuthology.orchestra.run.smithi047.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-12T17:25:02.702 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T17:25:02.720 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:25:02.720 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-09-12T17:25:02.720 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:25:02.720 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-12T17:25:02.720 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-radosgw x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 11 M 2024-09-12T17:25:02.720 INFO:teuthology.orchestra.run.smithi047.stdout:Upgrading: 2024-09-12T17:25:02.721 INFO:teuthology.orchestra.run.smithi047.stdout: librados2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.5 M 2024-09-12T17:25:02.721 INFO:teuthology.orchestra.run.smithi047.stdout: librbd1 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.2 M 2024-09-12T17:25:02.721 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-09-12T17:25:02.721 INFO:teuthology.orchestra.run.smithi047.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T17:25:02.721 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-base x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 5.5 M 2024-09-12T17:25:02.721 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-common x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 22 M 2024-09-12T17:25:02.721 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-selinux x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 25 k 2024-09-12T17:25:02.721 INFO:teuthology.orchestra.run.smithi047.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T17:25:02.721 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T17:25:02.721 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T17:25:02.721 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 756 k 2024-09-12T17:25:02.722 INFO:teuthology.orchestra.run.smithi047.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T17:25:02.722 INFO:teuthology.orchestra.run.smithi047.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T17:25:02.722 INFO:teuthology.orchestra.run.smithi047.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T17:25:02.722 INFO:teuthology.orchestra.run.smithi047.stdout: libradosstriper1 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 508 k 2024-09-12T17:25:02.722 INFO:teuthology.orchestra.run.smithi047.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T17:25:02.722 INFO:teuthology.orchestra.run.smithi047.stdout: librgw2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 5.5 M 2024-09-12T17:25:02.722 INFO:teuthology.orchestra.run.smithi047.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T17:25:02.722 INFO:teuthology.orchestra.run.smithi047.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T17:25:02.722 INFO:teuthology.orchestra.run.smithi047.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T17:25:02.722 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-argparse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 45 k 2024-09-12T17:25:02.722 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-common x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 143 k 2024-09-12T17:25:02.722 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cephfs x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 161 k 2024-09-12T17:25:02.722 INFO:teuthology.orchestra.run.smithi047.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T17:25:02.723 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rados x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 321 k 2024-09-12T17:25:02.723 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rbd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 305 k 2024-09-12T17:25:02.723 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rgw x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 99 k 2024-09-12T17:25:02.723 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T17:25:02.723 INFO:teuthology.orchestra.run.smithi047.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T17:25:02.723 INFO:teuthology.orchestra.run.smithi047.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T17:25:02.723 INFO:teuthology.orchestra.run.smithi047.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T17:25:02.723 INFO:teuthology.orchestra.run.smithi047.stdout:Installing weak dependencies: 2024-09-12T17:25:02.723 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T17:25:02.723 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:25:02.723 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-12T17:25:02.723 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:25:02.724 INFO:teuthology.orchestra.run.smithi047.stdout:Install 30 Packages 2024-09-12T17:25:02.724 INFO:teuthology.orchestra.run.smithi047.stdout:Upgrade 2 Packages 2024-09-12T17:25:02.724 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:25:02.724 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 61 M 2024-09-12T17:25:02.724 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-12T17:25:03.391 INFO:teuthology.orchestra.run.smithi047.stdout:(1/32): ceph-base-19.3.0-4762.gbad475c1.el9.x86 9.0 MB/s | 5.5 MB 00:00 2024-09-12T17:25:03.441 INFO:teuthology.orchestra.run.smithi047.stdout:(2/32): ceph-selinux-19.3.0-4762.gbad475c1.el9. 506 kB/s | 25 kB 00:00 2024-09-12T17:25:03.566 INFO:teuthology.orchestra.run.smithi047.stdout:(3/32): ceph-radosgw-19.3.0-4762.gbad475c1.el9. 14 MB/s | 11 MB 00:00 2024-09-12T17:25:03.608 INFO:teuthology.orchestra.run.smithi047.stdout:(4/32): libcephfs2-19.3.0-4762.gbad475c1.el9.x8 4.4 MB/s | 756 kB 00:00 2024-09-12T17:25:03.642 INFO:teuthology.orchestra.run.smithi047.stdout:(5/32): libradosstriper1-19.3.0-4762.gbad475c1. 6.6 MB/s | 508 kB 00:00 2024-09-12T17:25:03.692 INFO:teuthology.orchestra.run.smithi047.stdout:(6/32): python3-ceph-argparse-19.3.0-4762.gbad4 905 kB/s | 45 kB 00:00 2024-09-12T17:25:03.759 INFO:teuthology.orchestra.run.smithi047.stdout:(7/32): python3-ceph-common-19.3.0-4762.gbad475 2.1 MB/s | 143 kB 00:00 2024-09-12T17:25:03.826 INFO:teuthology.orchestra.run.smithi047.stdout:(8/32): python3-cephfs-19.3.0-4762.gbad475c1.el 2.4 MB/s | 161 kB 00:00 2024-09-12T17:25:03.884 INFO:teuthology.orchestra.run.smithi170.stdout:lab-extras 23 kB/s | 1.7 kB 00:00 2024-09-12T17:25:03.910 INFO:teuthology.orchestra.run.smithi047.stdout:(9/32): librgw2-19.3.0-4762.gbad475c1.el9.x86_6 18 MB/s | 5.5 MB 00:00 2024-09-12T17:25:03.935 INFO:teuthology.orchestra.run.smithi047.stdout:(10/32): python3-rados-19.3.0-4762.gbad475c1.el 2.9 MB/s | 321 kB 00:00 2024-09-12T17:25:03.968 INFO:teuthology.orchestra.run.smithi047.stdout:(11/32): python3-rbd-19.3.0-4762.gbad475c1.el9. 5.1 MB/s | 305 kB 00:00 2024-09-12T17:25:03.994 INFO:teuthology.orchestra.run.smithi047.stdout:(12/32): python3-rgw-19.3.0-4762.gbad475c1.el9. 1.7 MB/s | 99 kB 00:00 2024-09-12T17:25:04.202 INFO:teuthology.orchestra.run.smithi047.stdout:(13/32): ceph-common-19.3.0-4762.gbad475c1.el9. 15 MB/s | 22 MB 00:01 2024-09-12T17:25:04.286 INFO:teuthology.orchestra.run.smithi047.stdout:(14/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 545 kB/s | 45 kB 00:00 2024-09-12T17:25:04.336 INFO:teuthology.orchestra.run.smithi047.stdout:(15/32): boost-program-options-1.75.0-8.el9.x86 291 kB/s | 107 kB 00:00 2024-09-12T17:25:04.387 INFO:teuthology.orchestra.run.smithi047.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 408 kB/s | 160 kB 00:00 2024-09-12T17:25:04.420 INFO:teuthology.orchestra.run.smithi047.stdout:(17/32): librdkafka-1.6.1-102.el9.x86_64.rpm 4.8 MB/s | 662 kB 00:00 2024-09-12T17:25:04.454 INFO:teuthology.orchestra.run.smithi047.stdout:(18/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-12T17:25:04.504 INFO:teuthology.orchestra.run.smithi047.stdout:(19/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-09-12T17:25:04.529 INFO:teuthology.orchestra.run.smithi047.stdout:(20/32): python3-prettytable-0.7.2-27.el9.noarc 387 kB/s | 42 kB 00:00 2024-09-12T17:25:04.555 INFO:teuthology.orchestra.run.smithi047.stdout:(21/32): qatlib-service-24.02.0-1.el9.x86_64.rp 356 kB/s | 36 kB 00:00 2024-09-12T17:25:04.580 INFO:teuthology.orchestra.run.smithi047.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 628 kB/s | 47 kB 00:00 2024-09-12T17:25:04.639 INFO:teuthology.orchestra.run.smithi047.stdout:(23/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.8 MB/s | 308 kB 00:00 2024-09-12T17:25:04.664 INFO:teuthology.orchestra.run.smithi047.stdout:(24/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 386 kB/s | 26 kB 00:00 2024-09-12T17:25:04.689 INFO:teuthology.orchestra.run.smithi047.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 973 kB/s | 49 kB 00:00 2024-09-12T17:25:04.714 INFO:teuthology.orchestra.run.smithi047.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-12T17:25:04.748 INFO:teuthology.orchestra.run.smithi047.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-12T17:25:04.798 INFO:teuthology.orchestra.run.smithi047.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.5 MB/s | 839 kB 00:00 2024-09-12T17:25:04.857 INFO:teuthology.orchestra.run.smithi047.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-12T17:25:04.949 INFO:teuthology.orchestra.run.smithi047.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-12T17:25:05.024 INFO:teuthology.orchestra.run.smithi047.stdout:(31/32): librados2-19.3.0-4762.gbad475c1.el9.x8 15 MB/s | 3.5 MB 00:00 2024-09-12T17:25:05.178 INFO:teuthology.orchestra.run.smithi047.stdout:(32/32): librbd1-19.3.0-4762.gbad475c1.el9.x86_ 10 MB/s | 3.2 MB 00:00 2024-09-12T17:25:05.184 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:25:05.184 INFO:teuthology.orchestra.run.smithi047.stdout:Total 25 MB/s | 61 MB 00:02 2024-09-12T17:25:05.292 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-12T17:25:05.331 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-12T17:25:05.331 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-12T17:25:06.058 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-12T17:25:06.058 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-12T17:25:06.243 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-12T17:25:06.258 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:25:06.258 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-09-12T17:25:06.258 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:25:06.258 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-12T17:25:06.259 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-radosgw x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 11 M 2024-09-12T17:25:06.259 INFO:teuthology.orchestra.run.smithi170.stdout:Upgrading: 2024-09-12T17:25:06.259 INFO:teuthology.orchestra.run.smithi170.stdout: librados2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.5 M 2024-09-12T17:25:06.259 INFO:teuthology.orchestra.run.smithi170.stdout: librbd1 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.2 M 2024-09-12T17:25:06.259 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-09-12T17:25:06.259 INFO:teuthology.orchestra.run.smithi170.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T17:25:06.259 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-base x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 5.5 M 2024-09-12T17:25:06.259 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-common x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 22 M 2024-09-12T17:25:06.259 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-selinux x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 25 k 2024-09-12T17:25:06.259 INFO:teuthology.orchestra.run.smithi170.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T17:25:06.259 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T17:25:06.259 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T17:25:06.260 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 756 k 2024-09-12T17:25:06.260 INFO:teuthology.orchestra.run.smithi170.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T17:25:06.260 INFO:teuthology.orchestra.run.smithi170.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T17:25:06.260 INFO:teuthology.orchestra.run.smithi170.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T17:25:06.260 INFO:teuthology.orchestra.run.smithi170.stdout: libradosstriper1 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 508 k 2024-09-12T17:25:06.260 INFO:teuthology.orchestra.run.smithi170.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T17:25:06.260 INFO:teuthology.orchestra.run.smithi170.stdout: librgw2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 5.5 M 2024-09-12T17:25:06.260 INFO:teuthology.orchestra.run.smithi170.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T17:25:06.260 INFO:teuthology.orchestra.run.smithi170.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T17:25:06.260 INFO:teuthology.orchestra.run.smithi170.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T17:25:06.260 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-argparse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 45 k 2024-09-12T17:25:06.260 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-common x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 143 k 2024-09-12T17:25:06.260 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cephfs x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 161 k 2024-09-12T17:25:06.261 INFO:teuthology.orchestra.run.smithi170.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T17:25:06.261 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rados x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 321 k 2024-09-12T17:25:06.261 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rbd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 305 k 2024-09-12T17:25:06.261 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rgw x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 99 k 2024-09-12T17:25:06.261 INFO:teuthology.orchestra.run.smithi170.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T17:25:06.261 INFO:teuthology.orchestra.run.smithi170.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T17:25:06.261 INFO:teuthology.orchestra.run.smithi170.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T17:25:06.261 INFO:teuthology.orchestra.run.smithi170.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T17:25:06.261 INFO:teuthology.orchestra.run.smithi170.stdout:Installing weak dependencies: 2024-09-12T17:25:06.261 INFO:teuthology.orchestra.run.smithi170.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T17:25:06.261 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:25:06.261 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-12T17:25:06.261 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:25:06.262 INFO:teuthology.orchestra.run.smithi170.stdout:Install 30 Packages 2024-09-12T17:25:06.262 INFO:teuthology.orchestra.run.smithi170.stdout:Upgrade 2 Packages 2024-09-12T17:25:06.262 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:25:06.262 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 61 M 2024-09-12T17:25:06.262 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-12T17:25:07.002 INFO:teuthology.orchestra.run.smithi170.stdout:(1/32): ceph-base-19.3.0-4762.gbad475c1.el9.x86 11 MB/s | 5.5 MB 00:00 2024-09-12T17:25:07.060 INFO:teuthology.orchestra.run.smithi170.stdout:(2/32): ceph-selinux-19.3.0-4762.gbad475c1.el9. 432 kB/s | 25 kB 00:00 2024-09-12T17:25:07.144 INFO:teuthology.orchestra.run.smithi170.stdout:(3/32): libcephfs2-19.3.0-4762.gbad475c1.el9.x8 8.9 MB/s | 756 kB 00:00 2024-09-12T17:25:07.219 INFO:teuthology.orchestra.run.smithi170.stdout:(4/32): libradosstriper1-19.3.0-4762.gbad475c1. 6.6 MB/s | 508 kB 00:00 2024-09-12T17:25:07.378 INFO:teuthology.orchestra.run.smithi170.stdout:(5/32): ceph-radosgw-19.3.0-4762.gbad475c1.el9. 13 MB/s | 11 MB 00:00 2024-09-12T17:25:07.437 INFO:teuthology.orchestra.run.smithi170.stdout:(6/32): python3-ceph-argparse-19.3.0-4762.gbad4 775 kB/s | 45 kB 00:00 2024-09-12T17:25:07.545 INFO:teuthology.orchestra.run.smithi170.stdout:(7/32): librgw2-19.3.0-4762.gbad475c1.el9.x86_6 17 MB/s | 5.5 MB 00:00 2024-09-12T17:25:07.548 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-12T17:25:07.570 INFO:teuthology.orchestra.run.smithi170.stdout:(8/32): python3-ceph-common-19.3.0-4762.gbad475 1.0 MB/s | 143 kB 00:00 2024-09-12T17:25:07.595 INFO:teuthology.orchestra.run.smithi170.stdout:(9/32): python3-cephfs-19.3.0-4762.gbad475c1.el 3.1 MB/s | 161 kB 00:00 2024-09-12T17:25:07.621 INFO:teuthology.orchestra.run.smithi170.stdout:(10/32): python3-rados-19.3.0-4762.gbad475c1.el 6.2 MB/s | 321 kB 00:00 2024-09-12T17:25:07.626 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-12T17:25:07.654 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-12T17:25:07.654 INFO:teuthology.orchestra.run.smithi170.stdout:(11/32): python3-rbd-19.3.0-4762.gbad475c1.el9. 5.1 MB/s | 305 kB 00:00 2024-09-12T17:25:07.679 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-12T17:25:07.680 INFO:teuthology.orchestra.run.smithi170.stdout:(12/32): python3-rgw-19.3.0-4762.gbad475c1.el9. 1.7 MB/s | 99 kB 00:00 2024-09-12T17:25:07.702 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-12T17:25:07.732 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-12T17:25:07.880 INFO:teuthology.orchestra.run.smithi170.stdout:(13/32): ceph-common-19.3.0-4762.gbad475c1.el9. 16 MB/s | 22 MB 00:01 2024-09-12T17:25:07.957 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-12T17:25:08.009 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-12T17:25:08.255 INFO:teuthology.orchestra.run.smithi170.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 178 kB/s | 107 kB 00:00 2024-09-12T17:25:08.281 INFO:teuthology.orchestra.run.smithi170.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 113 kB/s | 45 kB 00:00 2024-09-12T17:25:08.348 INFO:teuthology.orchestra.run.smithi170.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 240 kB/s | 160 kB 00:00 2024-09-12T17:25:08.426 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-12T17:25:08.464 INFO:teuthology.orchestra.run.smithi170.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 362 kB/s | 42 kB 00:00 2024-09-12T17:25:08.489 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 7/34 2024-09-12T17:25:08.583 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 7/34 2024-09-12T17:25:08.682 INFO:teuthology.orchestra.run.smithi170.stdout:(18/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 730 kB/s | 292 kB 00:00 2024-09-12T17:25:08.686 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 8/34 2024-09-12T17:25:08.716 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 9/34 2024-09-12T17:25:08.740 INFO:teuthology.orchestra.run.smithi170.stdout:(19/32): librdkafka-1.6.1-102.el9.x86_64.rpm 1.3 MB/s | 662 kB 00:00 2024-09-12T17:25:08.765 INFO:teuthology.orchestra.run.smithi170.stdout:(20/32): qatlib-24.02.0-1.el9.x86_64.rpm 734 kB/s | 221 kB 00:00 2024-09-12T17:25:08.779 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 9/34 2024-09-12T17:25:08.799 INFO:teuthology.orchestra.run.smithi170.stdout:(21/32): qatlib-service-24.02.0-1.el9.x86_64.rp 306 kB/s | 36 kB 00:00 2024-09-12T17:25:08.816 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-12T17:25:08.841 INFO:teuthology.orchestra.run.smithi170.stdout:(22/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 4.0 MB/s | 308 kB 00:00 2024-09-12T17:25:08.860 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el9. 11/34 2024-09-12T17:25:08.866 INFO:teuthology.orchestra.run.smithi170.stdout:(23/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 376 kB/s | 47 kB 00:00 2024-09-12T17:25:08.891 INFO:teuthology.orchestra.run.smithi170.stdout:(24/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 537 kB/s | 26 kB 00:00 2024-09-12T17:25:08.925 INFO:teuthology.orchestra.run.smithi170.stdout:(25/32): libunwind-1.6.2-1.el9.x86_64.rpm 2.5 MB/s | 67 kB 00:00 2024-09-12T17:25:08.931 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_64 12/34 2024-09-12T17:25:08.959 INFO:teuthology.orchestra.run.smithi170.stdout:(26/32): liboath-2.6.7-2.el9.x86_64.rpm 528 kB/s | 49 kB 00:00 2024-09-12T17:25:08.959 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86_6 13/34 2024-09-12T17:25:09.001 INFO:teuthology.orchestra.run.smithi170.stdout:(27/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-12T17:25:09.016 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86_6 13/34 2024-09-12T17:25:09.026 INFO:teuthology.orchestra.run.smithi170.stdout:(28/32): re2-20211101-20.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-12T17:25:09.050 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-12T17:25:09.093 INFO:teuthology.orchestra.run.smithi170.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-12T17:25:09.162 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-12T17:25:09.176 INFO:teuthology.orchestra.run.smithi170.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-12T17:25:09.201 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-12T17:25:09.242 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-12T17:25:09.274 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-12T17:25:09.304 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-12T17:25:09.319 INFO:teuthology.orchestra.run.smithi170.stdout:(31/32): librados2-19.3.0-4762.gbad475c1.el9.x8 12 MB/s | 3.5 MB 00:00 2024-09-12T17:25:09.337 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-12T17:25:09.377 INFO:teuthology.orchestra.run.smithi170.stdout:(32/32): librbd1-19.3.0-4762.gbad475c1.el9.x86_ 11 MB/s | 3.2 MB 00:00 2024-09-12T17:25:09.383 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:25:09.383 INFO:teuthology.orchestra.run.smithi170.stdout:Total 20 MB/s | 61 MB 00:03 2024-09-12T17:25:09.488 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-12T17:25:09.525 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-12T17:25:09.525 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-12T17:25:09.675 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-12T17:25:09.716 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 22/34 2024-09-12T17:25:09.808 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 22/34 2024-09-12T17:25:09.838 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 23/34 2024-09-12T17:25:09.882 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-12T17:25:10.222 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-12T17:25:10.222 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-12T17:25:10.401 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-12T17:25:10.543 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 26/34 2024-09-12T17:25:10.615 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 26/34 2024-09-12T17:25:10.697 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 27/34 2024-09-12T17:25:10.720 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ceph-common-2:19.3.0-4762.gbad475c1.el9.x8 28/34 2024-09-12T17:25:11.670 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-12T17:25:11.805 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-12T17:25:12.007 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-12T17:25:12.033 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-12T17:25:12.055 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-12T17:25:12.082 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-12T17:25:12.275 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-12T17:25:12.327 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-12T17:25:12.663 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-12T17:25:12.776 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 7/34 2024-09-12T17:25:12.869 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 7/34 2024-09-12T17:25:12.963 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 8/34 2024-09-12T17:25:12.994 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 9/34 2024-09-12T17:25:13.057 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 9/34 2024-09-12T17:25:13.098 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-12T17:25:13.137 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el9. 11/34 2024-09-12T17:25:13.147 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 29/34 2024-09-12T17:25:13.192 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 29/34 2024-09-12T17:25:13.207 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_64 12/34 2024-09-12T17:25:13.238 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86_6 13/34 2024-09-12T17:25:13.302 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86_6 13/34 2024-09-12T17:25:13.345 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-12T17:25:13.462 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-12T17:25:13.496 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-12T17:25:13.548 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-12T17:25:13.578 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-12T17:25:13.607 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-12T17:25:13.641 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-12T17:25:13.800 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 29/34 2024-09-12T17:25:13.845 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 30/34 2024-09-12T17:25:13.939 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 30/34 2024-09-12T17:25:13.939 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T17:25:13.939 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T17:25:13.939 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:25:13.973 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-12T17:25:13.980 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 31/34 2024-09-12T17:25:14.030 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 22/34 2024-09-12T17:25:14.128 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 22/34 2024-09-12T17:25:14.167 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 23/34 2024-09-12T17:25:14.220 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-12T17:25:14.732 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-12T17:25:14.764 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 26/34 2024-09-12T17:25:14.838 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 26/34 2024-09-12T17:25:14.913 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 27/34 2024-09-12T17:25:14.941 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-ceph-common-2:19.3.0-4762.gbad475c1.el9.x8 28/34 2024-09-12T17:25:17.230 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 29/34 2024-09-12T17:25:17.263 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 29/34 2024-09-12T17:25:17.840 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 29/34 2024-09-12T17:25:17.875 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 30/34 2024-09-12T17:25:17.987 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 30/34 2024-09-12T17:25:17.988 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T17:25:17.988 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T17:25:17.988 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:25:18.026 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 31/34 2024-09-12T17:25:24.418 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 31/34 2024-09-12T17:25:24.418 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /sys 2024-09-12T17:25:24.418 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /proc 2024-09-12T17:25:24.418 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /mnt 2024-09-12T17:25:24.418 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /var/tmp 2024-09-12T17:25:24.418 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /home 2024-09-12T17:25:24.419 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /root 2024-09-12T17:25:24.419 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /tmp 2024-09-12T17:25:24.419 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:25:25.448 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 32/34 2024-09-12T17:25:25.475 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 32/34 2024-09-12T17:25:25.475 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:25:25.475 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T17:25:25.475 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:25:25.475 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:25:25.476 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:25:25.477 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-12T17:25:25.569 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-12T17:25:25.569 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-12T17:25:26.768 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-12T17:25:26.768 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 1/34 2024-09-12T17:25:26.768 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 2/34 2024-09-12T17:25:26.768 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 3/34 2024-09-12T17:25:26.768 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 4/34 2024-09-12T17:25:26.768 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 5/34 2024-09-12T17:25:26.768 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86_6 6/34 2024-09-12T17:25:26.768 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 7/34 2024-09-12T17:25:26.769 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el9. 8/34 2024-09-12T17:25:26.769 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ceph-common-2:19.3.0-4762.gbad475c1.el9.x8 9/34 2024-09-12T17:25:26.769 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_64 10/34 2024-09-12T17:25:26.769 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 11/34 2024-09-12T17:25:26.769 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 12/34 2024-09-12T17:25:26.769 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 13/34 2024-09-12T17:25:26.769 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-12T17:25:26.769 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-12T17:25:26.769 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-12T17:25:26.769 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-12T17:25:26.769 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-12T17:25:26.770 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-12T17:25:26.770 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-12T17:25:26.770 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-12T17:25:26.770 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-12T17:25:26.770 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-12T17:25:26.770 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-12T17:25:26.770 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-12T17:25:26.770 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-12T17:25:26.770 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-12T17:25:26.770 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-12T17:25:26.770 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-12T17:25:26.771 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-12T17:25:26.771 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 31/34 2024-09-12T17:25:26.771 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-12T17:25:26.771 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 33/34 2024-09-12T17:25:27.726 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-12T17:25:27.726 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:25:27.726 INFO:teuthology.orchestra.run.smithi047.stdout:Upgraded: 2024-09-12T17:25:27.726 INFO:teuthology.orchestra.run.smithi047.stdout: librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:25:27.726 INFO:teuthology.orchestra.run.smithi047.stdout: librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:25:27.726 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-12T17:25:27.726 INFO:teuthology.orchestra.run.smithi047.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T17:25:27.726 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:25:27.726 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:25:27.726 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:25:27.727 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:25:27.727 INFO:teuthology.orchestra.run.smithi047.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T17:25:27.727 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T17:25:27.727 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T17:25:27.727 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:25:27.727 INFO:teuthology.orchestra.run.smithi047.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T17:25:27.727 INFO:teuthology.orchestra.run.smithi047.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T17:25:27.727 INFO:teuthology.orchestra.run.smithi047.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T17:25:27.727 INFO:teuthology.orchestra.run.smithi047.stdout: libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:25:27.727 INFO:teuthology.orchestra.run.smithi047.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T17:25:27.727 INFO:teuthology.orchestra.run.smithi047.stdout: librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:25:27.727 INFO:teuthology.orchestra.run.smithi047.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T17:25:27.728 INFO:teuthology.orchestra.run.smithi047.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T17:25:27.728 INFO:teuthology.orchestra.run.smithi047.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T17:25:27.728 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:25:27.728 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:25:27.728 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:25:27.728 INFO:teuthology.orchestra.run.smithi047.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T17:25:27.728 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:25:27.728 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:25:27.728 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:25:27.728 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T17:25:27.728 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T17:25:27.728 INFO:teuthology.orchestra.run.smithi047.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T17:25:27.728 INFO:teuthology.orchestra.run.smithi047.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T17:25:27.728 INFO:teuthology.orchestra.run.smithi047.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T17:25:27.729 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:25:27.729 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T17:25:28.093 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-test 2024-09-12T17:25:28.126 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 31/34 2024-09-12T17:25:28.126 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /sys 2024-09-12T17:25:28.126 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /proc 2024-09-12T17:25:28.126 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /mnt 2024-09-12T17:25:28.126 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /var/tmp 2024-09-12T17:25:28.126 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /home 2024-09-12T17:25:28.126 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /root 2024-09-12T17:25:28.127 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /tmp 2024-09-12T17:25:28.127 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:25:28.677 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:00:28 ago on Thu 12 Sep 2024 05:25:00 PM UTC. 2024-09-12T17:25:28.815 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T17:25:28.815 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:25:28.815 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-09-12T17:25:28.816 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:25:28.816 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-12T17:25:28.816 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-test x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 45 M 2024-09-12T17:25:28.816 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-09-12T17:25:28.816 INFO:teuthology.orchestra.run.smithi047.stdout: libcephsqlite x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 161 k 2024-09-12T17:25:28.816 INFO:teuthology.orchestra.run.smithi047.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T17:25:28.816 INFO:teuthology.orchestra.run.smithi047.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T17:25:28.816 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:25:28.816 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-12T17:25:28.816 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:25:28.816 INFO:teuthology.orchestra.run.smithi047.stdout:Install 4 Packages 2024-09-12T17:25:28.816 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:25:28.817 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 46 M 2024-09-12T17:25:28.817 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 201 M 2024-09-12T17:25:28.817 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-12T17:25:29.164 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 32/34 2024-09-12T17:25:29.189 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 32/34 2024-09-12T17:25:29.189 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:25:29.189 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T17:25:29.189 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:25:29.189 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:25:29.189 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:25:29.191 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-12T17:25:29.274 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-12T17:25:29.275 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-12T17:25:29.289 INFO:teuthology.orchestra.run.smithi047.stdout:(1/4): libcephsqlite-19.3.0-4762.gbad475c1.el9. 757 kB/s | 161 kB 00:00 2024-09-12T17:25:29.315 INFO:teuthology.orchestra.run.smithi047.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.2 MB/s | 304 kB 00:00 2024-09-12T17:25:29.423 INFO:teuthology.orchestra.run.smithi047.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 477 kB/s | 64 kB 00:00 2024-09-12T17:25:30.489 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-12T17:25:30.489 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 1/34 2024-09-12T17:25:30.490 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 2/34 2024-09-12T17:25:30.490 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 3/34 2024-09-12T17:25:30.490 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 4/34 2024-09-12T17:25:30.490 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 5/34 2024-09-12T17:25:30.490 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86_6 6/34 2024-09-12T17:25:30.490 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 7/34 2024-09-12T17:25:30.490 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el9. 8/34 2024-09-12T17:25:30.490 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-ceph-common-2:19.3.0-4762.gbad475c1.el9.x8 9/34 2024-09-12T17:25:30.490 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_64 10/34 2024-09-12T17:25:30.490 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 11/34 2024-09-12T17:25:30.490 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 12/34 2024-09-12T17:25:30.490 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 13/34 2024-09-12T17:25:30.491 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-12T17:25:30.491 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-12T17:25:30.491 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-12T17:25:30.491 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-12T17:25:30.491 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-12T17:25:30.491 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-12T17:25:30.491 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-12T17:25:30.491 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-12T17:25:30.491 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-12T17:25:30.491 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-12T17:25:30.491 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-12T17:25:30.491 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-12T17:25:30.491 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-12T17:25:30.491 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-12T17:25:30.492 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-12T17:25:30.492 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-12T17:25:30.492 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-12T17:25:30.493 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 31/34 2024-09-12T17:25:30.493 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-12T17:25:30.493 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 33/34 2024-09-12T17:25:30.532 INFO:teuthology.orchestra.run.smithi047.stdout:(4/4): ceph-test-19.3.0-4762.gbad475c1.el9.x86_ 31 MB/s | 45 MB 00:01 2024-09-12T17:25:30.534 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:25:30.534 INFO:teuthology.orchestra.run.smithi047.stdout:Total 27 MB/s | 46 MB 00:01 2024-09-12T17:25:30.562 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-12T17:25:30.585 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-12T17:25:30.585 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-12T17:25:30.958 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-12T17:25:30.958 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-12T17:25:31.492 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-12T17:25:31.498 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-12T17:25:31.498 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:25:31.498 INFO:teuthology.orchestra.run.smithi170.stdout:Upgraded: 2024-09-12T17:25:31.498 INFO:teuthology.orchestra.run.smithi170.stdout: librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:25:31.498 INFO:teuthology.orchestra.run.smithi170.stdout: librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:25:31.498 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-12T17:25:31.498 INFO:teuthology.orchestra.run.smithi170.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T17:25:31.498 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:25:31.498 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:25:31.498 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:25:31.498 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:25:31.498 INFO:teuthology.orchestra.run.smithi170.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T17:25:31.499 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T17:25:31.499 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T17:25:31.499 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:25:31.499 INFO:teuthology.orchestra.run.smithi170.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T17:25:31.499 INFO:teuthology.orchestra.run.smithi170.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T17:25:31.499 INFO:teuthology.orchestra.run.smithi170.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T17:25:31.499 INFO:teuthology.orchestra.run.smithi170.stdout: libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:25:31.499 INFO:teuthology.orchestra.run.smithi170.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T17:25:31.499 INFO:teuthology.orchestra.run.smithi170.stdout: librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:25:31.499 INFO:teuthology.orchestra.run.smithi170.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T17:25:31.499 INFO:teuthology.orchestra.run.smithi170.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T17:25:31.499 INFO:teuthology.orchestra.run.smithi170.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T17:25:31.499 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:25:31.500 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:25:31.500 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:25:31.500 INFO:teuthology.orchestra.run.smithi170.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T17:25:31.500 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:25:31.500 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:25:31.500 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:25:31.500 INFO:teuthology.orchestra.run.smithi170.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T17:25:31.500 INFO:teuthology.orchestra.run.smithi170.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T17:25:31.500 INFO:teuthology.orchestra.run.smithi170.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T17:25:31.500 INFO:teuthology.orchestra.run.smithi170.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T17:25:31.500 INFO:teuthology.orchestra.run.smithi170.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T17:25:31.500 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:25:31.500 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-12T17:25:31.575 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-12T17:25:31.623 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-12T17:25:31.650 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 3/4 2024-09-12T17:25:31.904 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-test 2024-09-12T17:25:32.473 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:00:29 ago on Thu 12 Sep 2024 05:25:03 PM UTC. 2024-09-12T17:25:32.608 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-12T17:25:32.609 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:25:32.609 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-09-12T17:25:32.609 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:25:32.609 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-12T17:25:32.609 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-test x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 45 M 2024-09-12T17:25:32.609 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-09-12T17:25:32.610 INFO:teuthology.orchestra.run.smithi170.stdout: libcephsqlite x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 161 k 2024-09-12T17:25:32.610 INFO:teuthology.orchestra.run.smithi170.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T17:25:32.610 INFO:teuthology.orchestra.run.smithi170.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T17:25:32.610 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:25:32.610 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-12T17:25:32.610 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:25:32.610 INFO:teuthology.orchestra.run.smithi170.stdout:Install 4 Packages 2024-09-12T17:25:32.610 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:25:32.611 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 46 M 2024-09-12T17:25:32.611 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 201 M 2024-09-12T17:25:32.611 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-12T17:25:32.888 INFO:teuthology.orchestra.run.smithi170.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.9 MB/s | 304 kB 00:00 2024-09-12T17:25:32.929 INFO:teuthology.orchestra.run.smithi170.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-12T17:25:32.971 INFO:teuthology.orchestra.run.smithi170.stdout:(3/4): libcephsqlite-19.3.0-4762.gbad475c1.el9. 660 kB/s | 161 kB 00:00 2024-09-12T17:25:34.188 INFO:teuthology.orchestra.run.smithi170.stdout:(4/4): ceph-test-19.3.0-4762.gbad475c1.el9.x86_ 31 MB/s | 45 MB 00:01 2024-09-12T17:25:34.190 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:25:34.191 INFO:teuthology.orchestra.run.smithi170.stdout:Total 29 MB/s | 46 MB 00:01 2024-09-12T17:25:34.218 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-12T17:25:34.238 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-12T17:25:34.239 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-12T17:25:34.593 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-12T17:25:34.593 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-12T17:25:35.105 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-12T17:25:35.173 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-12T17:25:35.229 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-12T17:25:35.257 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 3/4 2024-09-12T17:25:36.248 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 3/4 2024-09-12T17:25:36.327 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 4/4 2024-09-12T17:25:38.607 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 4/4 2024-09-12T17:25:38.608 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 1/4 2024-09-12T17:25:38.608 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 2/4 2024-09-12T17:25:38.608 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-12T17:25:38.909 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-12T17:25:38.910 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:25:38.910 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-12T17:25:38.910 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:25:38.910 INFO:teuthology.orchestra.run.smithi047.stdout: libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:25:38.910 INFO:teuthology.orchestra.run.smithi047.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T17:25:38.910 INFO:teuthology.orchestra.run.smithi047.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T17:25:38.910 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:25:38.910 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T17:25:39.177 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph 2024-09-12T17:25:39.647 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 3/4 2024-09-12T17:25:39.729 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 4/4 2024-09-12T17:25:39.764 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:00:39 ago on Thu 12 Sep 2024 05:25:00 PM UTC. 2024-09-12T17:25:39.921 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T17:25:39.924 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:25:39.924 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-09-12T17:25:39.924 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:25:39.924 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-12T17:25:39.924 INFO:teuthology.orchestra.run.smithi047.stdout: ceph x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 6.6 k 2024-09-12T17:25:39.924 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-09-12T17:25:39.924 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mds x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 2.4 M 2024-09-12T17:25:39.925 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 1.5 M 2024-09-12T17:25:39.925 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 291 k 2024-09-12T17:25:39.925 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mon x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 4.8 M 2024-09-12T17:25:39.925 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-osd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 17 M 2024-09-12T17:25:39.925 INFO:teuthology.orchestra.run.smithi047.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T17:25:39.925 INFO:teuthology.orchestra.run.smithi047.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T17:25:39.925 INFO:teuthology.orchestra.run.smithi047.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T17:25:39.925 INFO:teuthology.orchestra.run.smithi047.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T17:25:39.925 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T17:25:39.925 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T17:25:39.925 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T17:25:39.925 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T17:25:39.925 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T17:25:39.926 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T17:25:39.926 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-collections 2024-09-12T17:25:39.926 INFO:teuthology.orchestra.run.smithi047.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-12T17:25:39.926 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T17:25:39.926 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T17:25:39.926 INFO:teuthology.orchestra.run.smithi047.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T17:25:39.926 INFO:teuthology.orchestra.run.smithi047.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T17:25:39.926 INFO:teuthology.orchestra.run.smithi047.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T17:25:39.926 INFO:teuthology.orchestra.run.smithi047.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T17:25:39.926 INFO:teuthology.orchestra.run.smithi047.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T17:25:39.926 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T17:25:39.927 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T17:25:39.927 INFO:teuthology.orchestra.run.smithi047.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T17:25:39.927 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T17:25:39.927 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T17:25:39.927 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T17:25:39.927 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T17:25:39.927 INFO:teuthology.orchestra.run.smithi047.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T17:25:39.927 INFO:teuthology.orchestra.run.smithi047.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T17:25:39.927 INFO:teuthology.orchestra.run.smithi047.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T17:25:39.927 INFO:teuthology.orchestra.run.smithi047.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T17:25:39.927 INFO:teuthology.orchestra.run.smithi047.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T17:25:39.927 INFO:teuthology.orchestra.run.smithi047.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T17:25:39.927 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:25:39.927 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-12T17:25:39.928 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:25:39.928 INFO:teuthology.orchestra.run.smithi047.stdout:Install 37 Packages 2024-09-12T17:25:39.928 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:25:39.928 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 31 M 2024-09-12T17:25:39.928 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 109 M 2024-09-12T17:25:39.928 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-12T17:25:40.491 INFO:teuthology.orchestra.run.smithi047.stdout:(1/37): ceph-19.3.0-4762.gbad475c1.el9.x86_64.r 57 kB/s | 6.6 kB 00:00 2024-09-12T17:25:40.716 INFO:teuthology.orchestra.run.smithi047.stdout:(2/37): ceph-mds-19.3.0-4762.gbad475c1.el9.x86_ 7.0 MB/s | 2.4 MB 00:00 2024-09-12T17:25:40.758 INFO:teuthology.orchestra.run.smithi047.stdout:(3/37): ceph-mgr-19.3.0-4762.gbad475c1.el9.x86_ 4.0 MB/s | 1.5 MB 00:00 2024-09-12T17:25:40.859 INFO:teuthology.orchestra.run.smithi047.stdout:(4/37): ceph-mon-19.3.0-4762.gbad475c1.el9.x86_ 13 MB/s | 4.8 MB 00:00 2024-09-12T17:25:40.884 INFO:teuthology.orchestra.run.smithi047.stdout:(5/37): ceph-mgr-modules-core-19.3.0-4762.gbad4 2.3 MB/s | 291 kB 00:00 2024-09-12T17:25:41.010 INFO:teuthology.orchestra.run.smithi047.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.6 MB/s | 253 kB 00:00 2024-09-12T17:25:41.051 INFO:teuthology.orchestra.run.smithi047.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-12T17:25:41.093 INFO:teuthology.orchestra.run.smithi047.stdout:(8/37): python3-cryptography-36.0.1-4.el9.x86_6 5.9 MB/s | 1.2 MB 00:00 2024-09-12T17:25:41.118 INFO:teuthology.orchestra.run.smithi047.stdout:(9/37): python3-pycparser-2.20-6.el9.noarch.rpm 2.0 MB/s | 135 kB 00:00 2024-09-12T17:25:41.144 INFO:teuthology.orchestra.run.smithi047.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 2.4 MB/s | 125 kB 00:00 2024-09-12T17:25:41.169 INFO:teuthology.orchestra.run.smithi047.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 4.2 MB/s | 215 kB 00:00 2024-09-12T17:25:41.336 INFO:teuthology.orchestra.run.smithi047.stdout:(12/37): ceph-osd-19.3.0-4762.gbad475c1.el9.x86 28 MB/s | 17 MB 00:00 2024-09-12T17:25:41.437 INFO:teuthology.orchestra.run.smithi047.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 347 kB/s | 35 kB 00:00 2024-09-12T17:25:41.462 INFO:teuthology.orchestra.run.smithi047.stdout:(14/37): lua-5.4.4-4.el9.x86_64.rpm 593 kB/s | 188 kB 00:00 2024-09-12T17:25:41.487 INFO:teuthology.orchestra.run.smithi047.stdout:(15/37): python3-mako-1.1.4-6.el9.noarch.rpm 542 kB/s | 172 kB 00:00 2024-09-12T17:25:41.521 INFO:teuthology.orchestra.run.smithi047.stdout:(16/37): python3-packaging-20.9-5.el9.noarch.rp 922 kB/s | 77 kB 00:00 2024-09-12T17:25:41.538 INFO:teuthology.orchestra.run.smithi047.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 674 kB/s | 51 kB 00:00 2024-09-12T17:25:41.555 INFO:teuthology.orchestra.run.smithi047.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 622 kB/s | 42 kB 00:00 2024-09-12T17:25:41.605 INFO:teuthology.orchestra.run.smithi047.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-09-12T17:25:41.622 INFO:teuthology.orchestra.run.smithi047.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 648 kB/s | 43 kB 00:00 2024-09-12T17:25:41.647 INFO:teuthology.orchestra.run.smithi047.stdout:(21/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 4.2 MB/s | 172 kB 00:00 2024-09-12T17:25:41.664 INFO:teuthology.orchestra.run.smithi047.stdout:(22/37): lua-devel-5.4.4-4.el9.x86_64.rpm 156 kB/s | 22 kB 00:00 2024-09-12T17:25:41.681 INFO:teuthology.orchestra.run.smithi047.stdout:(23/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 319 kB/s | 11 kB 00:00 2024-09-12T17:25:41.718 INFO:teuthology.orchestra.run.smithi047.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 795 kB/s | 23 kB 00:00 2024-09-12T17:25:41.743 INFO:teuthology.orchestra.run.smithi047.stdout:(25/37): python3-jaraco-functools-3.5.0-2.el9.n 855 kB/s | 19 kB 00:00 2024-09-12T17:25:41.768 INFO:teuthology.orchestra.run.smithi047.stdout:(26/37): python3-jaraco-classes-3.2.1-5.el9.noa 170 kB/s | 18 kB 00:00 2024-09-12T17:25:41.794 INFO:teuthology.orchestra.run.smithi047.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2024-09-12T17:25:41.811 INFO:teuthology.orchestra.run.smithi047.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 1.1 MB/s | 46 kB 00:00 2024-09-12T17:25:41.836 INFO:teuthology.orchestra.run.smithi047.stdout:(29/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.6 MB/s | 358 kB 00:00 2024-09-12T17:25:41.861 INFO:teuthology.orchestra.run.smithi047.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.1 MB/s | 79 kB 00:00 2024-09-12T17:25:41.878 INFO:teuthology.orchestra.run.smithi047.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 391 kB/s | 16 kB 00:00 2024-09-12T17:25:41.904 INFO:teuthology.orchestra.run.smithi047.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.1 MB/s | 90 kB 00:00 2024-09-12T17:25:41.921 INFO:teuthology.orchestra.run.smithi047.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 852 kB/s | 36 kB 00:00 2024-09-12T17:25:41.946 INFO:teuthology.orchestra.run.smithi047.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-09-12T17:25:41.963 INFO:teuthology.orchestra.run.smithi047.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 1.2 MB/s | 20 kB 00:00 2024-09-12T17:25:41.988 INFO:teuthology.orchestra.run.smithi047.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-12T17:25:42.013 INFO:teuthology.orchestra.run.smithi047.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.5 MB/s | 427 kB 00:00 2024-09-12T17:25:42.017 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:25:42.018 INFO:teuthology.orchestra.run.smithi047.stdout:Total 15 MB/s | 31 MB 00:02 2024-09-12T17:25:42.166 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 4/4 2024-09-12T17:25:42.166 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 1/4 2024-09-12T17:25:42.166 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 2/4 2024-09-12T17:25:42.166 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-12T17:25:42.173 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-12T17:25:42.217 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-12T17:25:42.217 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-12T17:25:42.486 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-12T17:25:42.487 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:25:42.487 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-12T17:25:42.487 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:25:42.487 INFO:teuthology.orchestra.run.smithi170.stdout: libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:25:42.487 INFO:teuthology.orchestra.run.smithi170.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T17:25:42.487 INFO:teuthology.orchestra.run.smithi170.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T17:25:42.487 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:25:42.487 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-12T17:25:42.756 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-12T17:25:42.756 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-12T17:25:42.787 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph 2024-09-12T17:25:43.375 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:00:40 ago on Thu 12 Sep 2024 05:25:03 PM UTC. 2024-09-12T17:25:43.518 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-12T17:25:43.520 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:25:43.520 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-09-12T17:25:43.520 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:25:43.520 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-12T17:25:43.521 INFO:teuthology.orchestra.run.smithi170.stdout: ceph x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 6.6 k 2024-09-12T17:25:43.521 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-09-12T17:25:43.521 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mds x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 2.4 M 2024-09-12T17:25:43.521 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 1.5 M 2024-09-12T17:25:43.521 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 291 k 2024-09-12T17:25:43.521 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mon x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 4.8 M 2024-09-12T17:25:43.521 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-osd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 17 M 2024-09-12T17:25:43.521 INFO:teuthology.orchestra.run.smithi170.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T17:25:43.521 INFO:teuthology.orchestra.run.smithi170.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T17:25:43.521 INFO:teuthology.orchestra.run.smithi170.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T17:25:43.521 INFO:teuthology.orchestra.run.smithi170.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T17:25:43.521 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T17:25:43.521 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T17:25:43.522 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T17:25:43.522 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T17:25:43.522 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T17:25:43.522 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T17:25:43.522 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-collections 2024-09-12T17:25:43.522 INFO:teuthology.orchestra.run.smithi170.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-12T17:25:43.522 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T17:25:43.522 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T17:25:43.522 INFO:teuthology.orchestra.run.smithi170.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T17:25:43.522 INFO:teuthology.orchestra.run.smithi170.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T17:25:43.522 INFO:teuthology.orchestra.run.smithi170.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T17:25:43.522 INFO:teuthology.orchestra.run.smithi170.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T17:25:43.522 INFO:teuthology.orchestra.run.smithi170.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T17:25:43.522 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T17:25:43.523 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T17:25:43.523 INFO:teuthology.orchestra.run.smithi170.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T17:25:43.523 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T17:25:43.523 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T17:25:43.523 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T17:25:43.523 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T17:25:43.523 INFO:teuthology.orchestra.run.smithi170.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T17:25:43.523 INFO:teuthology.orchestra.run.smithi170.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T17:25:43.523 INFO:teuthology.orchestra.run.smithi170.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T17:25:43.523 INFO:teuthology.orchestra.run.smithi170.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T17:25:43.523 INFO:teuthology.orchestra.run.smithi170.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T17:25:43.523 INFO:teuthology.orchestra.run.smithi170.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T17:25:43.523 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:25:43.523 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-12T17:25:43.523 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:25:43.523 INFO:teuthology.orchestra.run.smithi170.stdout:Install 37 Packages 2024-09-12T17:25:43.524 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:25:43.524 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 31 M 2024-09-12T17:25:43.524 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 109 M 2024-09-12T17:25:43.524 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-12T17:25:44.064 INFO:teuthology.orchestra.run.smithi170.stdout:(1/37): ceph-19.3.0-4762.gbad475c1.el9.x86_64.r 55 kB/s | 6.6 kB 00:00 2024-09-12T17:25:44.190 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-12T17:25:44.249 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-12T17:25:44.293 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-12T17:25:44.298 INFO:teuthology.orchestra.run.smithi170.stdout:(2/37): ceph-mds-19.3.0-4762.gbad475c1.el9.x86_ 6.7 MB/s | 2.4 MB 00:00 2024-09-12T17:25:44.327 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-12T17:25:44.340 INFO:teuthology.orchestra.run.smithi170.stdout:(3/37): ceph-mgr-19.3.0-4762.gbad475c1.el9.x86_ 3.9 MB/s | 1.5 MB 00:00 2024-09-12T17:25:44.403 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-12T17:25:44.432 INFO:teuthology.orchestra.run.smithi170.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4762.gbad4 3.1 MB/s | 291 kB 00:00 2024-09-12T17:25:44.443 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-12T17:25:44.476 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-12T17:25:44.507 INFO:teuthology.orchestra.run.smithi170.stdout:(5/37): ceph-mon-19.3.0-4762.gbad475c1.el9.x86_ 11 MB/s | 4.8 MB 00:00 2024-09-12T17:25:44.572 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-12T17:25:44.625 INFO:teuthology.orchestra.run.smithi170.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.3 MB/s | 253 kB 00:00 2024-09-12T17:25:44.649 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-12T17:25:44.666 INFO:teuthology.orchestra.run.smithi170.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-12T17:25:44.696 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-12T17:25:44.720 INFO:teuthology.orchestra.run.smithi170.stdout:(8/37): python3-cryptography-36.0.1-4.el9.x86_6 5.8 MB/s | 1.2 MB 00:00 2024-09-12T17:25:44.745 INFO:teuthology.orchestra.run.smithi170.stdout:(9/37): python3-pycparser-2.20-6.el9.noarch.rpm 1.7 MB/s | 135 kB 00:00 2024-09-12T17:25:44.747 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-12T17:25:44.771 INFO:teuthology.orchestra.run.smithi170.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 2.4 MB/s | 125 kB 00:00 2024-09-12T17:25:44.776 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-12T17:25:44.811 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-12T17:25:44.844 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-12T17:25:44.885 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-12T17:25:44.929 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-12T17:25:44.938 INFO:teuthology.orchestra.run.smithi170.stdout:(11/37): ceph-osd-19.3.0-4762.gbad475c1.el9.x86 27 MB/s | 17 MB 00:00 2024-09-12T17:25:44.963 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-12T17:25:44.963 INFO:teuthology.orchestra.run.smithi170.stdout:(12/37): python3-urllib3-1.26.5-6.el9.noarch.rp 987 kB/s | 215 kB 00:00 2024-09-12T17:25:44.988 INFO:teuthology.orchestra.run.smithi170.stdout:(13/37): lua-5.4.4-4.el9.x86_64.rpm 867 kB/s | 188 kB 00:00 2024-09-12T17:25:45.003 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-12T17:25:45.014 INFO:teuthology.orchestra.run.smithi170.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 692 kB/s | 35 kB 00:00 2024-09-12T17:25:45.039 INFO:teuthology.orchestra.run.smithi170.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 1.5 MB/s | 77 kB 00:00 2024-09-12T17:25:45.043 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-12T17:25:45.064 INFO:teuthology.orchestra.run.smithi170.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-12T17:25:45.089 INFO:teuthology.orchestra.run.smithi170.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 827 kB/s | 42 kB 00:00 2024-09-12T17:25:45.115 INFO:teuthology.orchestra.run.smithi170.stdout:(18/37): python3-mako-1.1.4-6.el9.noarch.rpm 975 kB/s | 172 kB 00:00 2024-09-12T17:25:45.129 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-12T17:25:45.165 INFO:teuthology.orchestra.run.smithi170.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 2.0 MB/s | 151 kB 00:00 2024-09-12T17:25:45.190 INFO:teuthology.orchestra.run.smithi170.stdout:(20/37): lua-devel-5.4.4-4.el9.x86_64.rpm 177 kB/s | 22 kB 00:00 2024-09-12T17:25:45.216 INFO:teuthology.orchestra.run.smithi170.stdout:(21/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 433 kB/s | 43 kB 00:00 2024-09-12T17:25:45.249 INFO:teuthology.orchestra.run.smithi170.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 403 kB/s | 11 kB 00:00 2024-09-12T17:25:45.274 INFO:teuthology.orchestra.run.smithi170.stdout:(23/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.5 MB/s | 172 kB 00:00 2024-09-12T17:25:45.280 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-12T17:25:45.300 INFO:teuthology.orchestra.run.smithi170.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 364 kB/s | 18 kB 00:00 2024-09-12T17:25:45.325 INFO:teuthology.orchestra.run.smithi170.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 460 kB/s | 23 kB 00:00 2024-09-12T17:25:45.342 INFO:teuthology.orchestra.run.smithi170.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 464 kB/s | 19 kB 00:00 2024-09-12T17:25:45.359 INFO:teuthology.orchestra.run.smithi170.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 587 kB/s | 20 kB 00:00 2024-09-12T17:25:45.362 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-12T17:25:45.376 INFO:teuthology.orchestra.run.smithi170.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 1.3 MB/s | 46 kB 00:00 2024-09-12T17:25:45.402 INFO:teuthology.orchestra.run.smithi170.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.8 MB/s | 79 kB 00:00 2024-09-12T17:25:45.416 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-12T17:25:45.418 INFO:teuthology.orchestra.run.smithi170.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 987 kB/s | 16 kB 00:00 2024-09-12T17:25:45.444 INFO:teuthology.orchestra.run.smithi170.stdout:(31/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.4 MB/s | 358 kB 00:00 2024-09-12T17:25:45.454 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-12T17:25:45.469 INFO:teuthology.orchestra.run.smithi170.stdout:(32/37): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-12T17:25:45.494 INFO:teuthology.orchestra.run.smithi170.stdout:(33/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-09-12T17:25:45.513 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-12T17:25:45.520 INFO:teuthology.orchestra.run.smithi170.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2024-09-12T17:25:45.545 INFO:teuthology.orchestra.run.smithi170.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 793 kB/s | 20 kB 00:00 2024-09-12T17:25:45.571 INFO:teuthology.orchestra.run.smithi170.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-12T17:25:45.576 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-12T17:25:45.604 INFO:teuthology.orchestra.run.smithi170.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-09-12T17:25:45.608 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:25:45.608 INFO:teuthology.orchestra.run.smithi170.stdout:Total 15 MB/s | 31 MB 00:02 2024-09-12T17:25:45.755 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-12T17:25:45.773 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-12T17:25:45.796 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-12T17:25:45.796 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-12T17:25:45.825 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-12T17:25:45.914 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-12T17:25:46.004 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-12T17:25:46.040 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-12T17:25:46.177 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-12T17:25:46.343 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-12T17:25:46.344 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-12T17:25:46.361 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el9. 32/37 2024-09-12T17:25:46.392 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 33/37 2024-09-12T17:25:46.420 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 33/37 2024-09-12T17:25:46.420 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:25:46.420 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T17:25:46.420 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T17:25:46.420 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T17:25:46.420 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:25:47.738 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-12T17:25:47.807 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-12T17:25:47.848 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-12T17:25:47.876 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-12T17:25:47.947 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-12T17:25:47.976 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 34/37 2024-09-12T17:25:48.005 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 34/37 2024-09-12T17:25:48.005 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:25:48.005 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T17:25:48.005 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T17:25:48.005 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T17:25:48.005 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:25:48.017 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-12T17:25:48.050 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-12T17:25:48.141 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-12T17:25:48.220 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-12T17:25:48.261 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-12T17:25:48.295 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-12T17:25:48.326 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-12T17:25:48.410 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-12T17:25:48.452 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-12T17:25:48.477 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 35/37 2024-09-12T17:25:48.492 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-12T17:25:48.504 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 35/37 2024-09-12T17:25:48.504 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:25:48.504 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T17:25:48.504 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T17:25:48.504 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T17:25:48.504 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:25:48.527 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-12T17:25:48.562 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-12T17:25:48.604 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-12T17:25:48.636 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-12T17:25:48.712 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-12T17:25:48.736 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 36/37 2024-09-12T17:25:48.761 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 36/37 2024-09-12T17:25:48.761 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:25:48.761 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T17:25:48.761 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T17:25:48.761 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T17:25:48.761 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:25:48.828 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 37/37 2024-09-12T17:25:48.847 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-12T17:25:48.928 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-12T17:25:48.981 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-12T17:25:49.028 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-12T17:25:49.086 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-12T17:25:49.141 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-12T17:25:49.328 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-12T17:25:49.382 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-12T17:25:49.459 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-12T17:25:49.548 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-12T17:25:49.589 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-12T17:25:49.717 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-12T17:25:49.880 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el9. 32/37 2024-09-12T17:25:49.908 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 33/37 2024-09-12T17:25:49.935 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 33/37 2024-09-12T17:25:49.935 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:25:49.935 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T17:25:49.935 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T17:25:49.935 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T17:25:49.936 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:25:50.527 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 37/37 2024-09-12T17:25:50.527 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 1/37 2024-09-12T17:25:50.527 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 2/37 2024-09-12T17:25:50.527 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 3/37 2024-09-12T17:25:50.528 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 4/37 2024-09-12T17:25:50.528 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 5/37 2024-09-12T17:25:50.528 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el9. 6/37 2024-09-12T17:25:50.528 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-12T17:25:50.528 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-12T17:25:50.528 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-12T17:25:50.528 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-12T17:25:50.528 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-12T17:25:50.528 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-12T17:25:50.528 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-12T17:25:50.528 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-12T17:25:50.528 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-12T17:25:50.528 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-12T17:25:50.529 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-12T17:25:50.529 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-12T17:25:50.529 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-12T17:25:50.529 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-12T17:25:50.529 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-12T17:25:50.529 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-12T17:25:50.529 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-12T17:25:50.529 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-12T17:25:50.529 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-12T17:25:50.529 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-12T17:25:50.529 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-12T17:25:50.529 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-12T17:25:50.530 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-12T17:25:50.530 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-12T17:25:50.531 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-12T17:25:50.531 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-12T17:25:50.531 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-12T17:25:50.531 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-12T17:25:50.531 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-12T17:25:50.531 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-12T17:25:51.401 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 34/37 2024-09-12T17:25:51.428 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 34/37 2024-09-12T17:25:51.428 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:25:51.429 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T17:25:51.429 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T17:25:51.429 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T17:25:51.429 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:25:51.524 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-12T17:25:51.524 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:25:51.524 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-12T17:25:51.524 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:25:51.524 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:25:51.524 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:25:51.525 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:25:51.525 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:25:51.525 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:25:51.525 INFO:teuthology.orchestra.run.smithi047.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T17:25:51.525 INFO:teuthology.orchestra.run.smithi047.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T17:25:51.525 INFO:teuthology.orchestra.run.smithi047.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T17:25:51.525 INFO:teuthology.orchestra.run.smithi047.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T17:25:51.525 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T17:25:51.525 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T17:25:51.525 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T17:25:51.525 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T17:25:51.526 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T17:25:51.526 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T17:25:51.526 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T17:25:51.526 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T17:25:51.526 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T17:25:51.526 INFO:teuthology.orchestra.run.smithi047.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T17:25:51.526 INFO:teuthology.orchestra.run.smithi047.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T17:25:51.526 INFO:teuthology.orchestra.run.smithi047.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T17:25:51.526 INFO:teuthology.orchestra.run.smithi047.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T17:25:51.526 INFO:teuthology.orchestra.run.smithi047.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T17:25:51.526 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T17:25:51.526 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T17:25:51.526 INFO:teuthology.orchestra.run.smithi047.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T17:25:51.527 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T17:25:51.527 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T17:25:51.527 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T17:25:51.527 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T17:25:51.527 INFO:teuthology.orchestra.run.smithi047.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T17:25:51.527 INFO:teuthology.orchestra.run.smithi047.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T17:25:51.527 INFO:teuthology.orchestra.run.smithi047.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T17:25:51.527 INFO:teuthology.orchestra.run.smithi047.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T17:25:51.527 INFO:teuthology.orchestra.run.smithi047.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T17:25:51.527 INFO:teuthology.orchestra.run.smithi047.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T17:25:51.527 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:25:51.527 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T17:25:51.876 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 35/37 2024-09-12T17:25:51.900 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 35/37 2024-09-12T17:25:51.900 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:25:51.900 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T17:25:51.900 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T17:25:51.900 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T17:25:51.901 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:25:51.903 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-base 2024-09-12T17:25:52.127 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 36/37 2024-09-12T17:25:52.150 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 36/37 2024-09-12T17:25:52.151 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:25:52.151 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T17:25:52.151 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T17:25:52.151 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T17:25:52.151 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:25:52.223 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 37/37 2024-09-12T17:25:52.494 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:00:52 ago on Thu 12 Sep 2024 05:25:00 PM UTC. 2024-09-12T17:25:52.587 INFO:teuthology.orchestra.run.smithi047.stdout:Package ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-12T17:25:52.631 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T17:25:52.632 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-09-12T17:25:52.633 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T17:25:52.693 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install cephadm 2024-09-12T17:25:53.277 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:00:53 ago on Thu 12 Sep 2024 05:25:00 PM UTC. 2024-09-12T17:25:53.415 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T17:25:53.415 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:25:53.416 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-09-12T17:25:53.416 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:25:53.416 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-12T17:25:53.416 INFO:teuthology.orchestra.run.smithi047.stdout: cephadm noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 783 k 2024-09-12T17:25:53.416 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:25:53.416 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-12T17:25:53.416 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:25:53.416 INFO:teuthology.orchestra.run.smithi047.stdout:Install 1 Package 2024-09-12T17:25:53.416 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:25:53.416 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 783 k 2024-09-12T17:25:53.416 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 789 k 2024-09-12T17:25:53.416 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-12T17:25:53.677 INFO:teuthology.orchestra.run.smithi047.stdout:cephadm-19.3.0-4762.gbad475c1.el9.noarch.rpm 2.9 MB/s | 783 kB 00:00 2024-09-12T17:25:53.677 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:25:53.677 INFO:teuthology.orchestra.run.smithi047.stdout:Total 2.9 MB/s | 783 kB 00:00 2024-09-12T17:25:53.677 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-12T17:25:53.683 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-12T17:25:53.683 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-12T17:25:53.689 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-12T17:25:53.690 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-12T17:25:53.763 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-12T17:25:54.050 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 37/37 2024-09-12T17:25:54.050 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 1/37 2024-09-12T17:25:54.050 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 2/37 2024-09-12T17:25:54.050 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 3/37 2024-09-12T17:25:54.050 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 4/37 2024-09-12T17:25:54.050 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 5/37 2024-09-12T17:25:54.050 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el9. 6/37 2024-09-12T17:25:54.050 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-12T17:25:54.051 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-12T17:25:54.051 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-12T17:25:54.051 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-12T17:25:54.051 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-12T17:25:54.051 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-12T17:25:54.051 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-12T17:25:54.051 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-12T17:25:54.051 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-12T17:25:54.051 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-12T17:25:54.051 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-12T17:25:54.051 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-12T17:25:54.051 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-12T17:25:54.051 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-12T17:25:54.052 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-12T17:25:54.052 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-12T17:25:54.052 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-12T17:25:54.052 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-12T17:25:54.052 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-12T17:25:54.052 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-12T17:25:54.052 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-12T17:25:54.052 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-12T17:25:54.053 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-12T17:25:54.054 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-12T17:25:54.054 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-12T17:25:54.054 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-12T17:25:54.054 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-12T17:25:54.054 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-12T17:25:54.054 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-12T17:25:54.054 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-12T17:25:54.157 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 1/1 2024-09-12T17:25:54.258 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 1/1 2024-09-12T17:25:54.677 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 1/1 2024-09-12T17:25:54.949 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 1/1 2024-09-12T17:25:54.949 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:25:54.949 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-12T17:25:54.949 INFO:teuthology.orchestra.run.smithi047.stdout: cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:25:54.949 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:25:54.949 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T17:25:55.130 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-12T17:25:55.131 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:25:55.131 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-12T17:25:55.131 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:25:55.131 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:25:55.131 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:25:55.131 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:25:55.131 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:25:55.131 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:25:55.131 INFO:teuthology.orchestra.run.smithi170.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T17:25:55.131 INFO:teuthology.orchestra.run.smithi170.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T17:25:55.131 INFO:teuthology.orchestra.run.smithi170.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T17:25:55.132 INFO:teuthology.orchestra.run.smithi170.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T17:25:55.132 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T17:25:55.132 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T17:25:55.132 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T17:25:55.132 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T17:25:55.132 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T17:25:55.132 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T17:25:55.132 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T17:25:55.132 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T17:25:55.132 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T17:25:55.132 INFO:teuthology.orchestra.run.smithi170.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T17:25:55.132 INFO:teuthology.orchestra.run.smithi170.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T17:25:55.132 INFO:teuthology.orchestra.run.smithi170.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T17:25:55.133 INFO:teuthology.orchestra.run.smithi170.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T17:25:55.133 INFO:teuthology.orchestra.run.smithi170.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T17:25:55.133 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T17:25:55.133 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T17:25:55.133 INFO:teuthology.orchestra.run.smithi170.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T17:25:55.133 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T17:25:55.133 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T17:25:55.133 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T17:25:55.133 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T17:25:55.133 INFO:teuthology.orchestra.run.smithi170.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T17:25:55.133 INFO:teuthology.orchestra.run.smithi170.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T17:25:55.133 INFO:teuthology.orchestra.run.smithi170.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T17:25:55.134 INFO:teuthology.orchestra.run.smithi170.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T17:25:55.134 INFO:teuthology.orchestra.run.smithi170.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T17:25:55.134 INFO:teuthology.orchestra.run.smithi170.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T17:25:55.134 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:25:55.134 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-12T17:25:55.140 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-immutable-object-cache 2024-09-12T17:25:55.525 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-base 2024-09-12T17:25:55.735 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:00:55 ago on Thu 12 Sep 2024 05:25:00 PM UTC. 2024-09-12T17:25:55.874 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T17:25:55.875 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:25:55.875 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repo Size 2024-09-12T17:25:55.875 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:25:55.875 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-12T17:25:55.875 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 145 k 2024-09-12T17:25:55.876 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:25:55.876 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-12T17:25:55.876 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:25:55.876 INFO:teuthology.orchestra.run.smithi047.stdout:Install 1 Package 2024-09-12T17:25:55.876 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:25:55.876 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 145 k 2024-09-12T17:25:55.876 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 432 k 2024-09-12T17:25:55.876 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-12T17:25:56.084 INFO:teuthology.orchestra.run.smithi047.stdout:ceph-immutable-object-cache-19.3.0-4762.gbad475 702 kB/s | 145 kB 00:00 2024-09-12T17:25:56.084 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:25:56.084 INFO:teuthology.orchestra.run.smithi047.stdout:Total 696 kB/s | 145 kB 00:00 2024-09-12T17:25:56.084 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-12T17:25:56.092 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:00:53 ago on Thu 12 Sep 2024 05:25:03 PM UTC. 2024-09-12T17:25:56.093 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-12T17:25:56.093 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-12T17:25:56.153 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-12T17:25:56.153 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-12T17:25:56.185 INFO:teuthology.orchestra.run.smithi170.stdout:Package ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-12T17:25:56.226 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-12T17:25:56.227 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-09-12T17:25:56.228 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-12T17:25:56.301 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install cephadm 2024-09-12T17:25:56.302 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-12T17:25:56.367 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4762.gbad475c1. 1/1 2024-09-12T17:25:56.394 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4762.gbad475c1. 1/1 2024-09-12T17:25:56.395 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:25:56.395 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T17:25:56.395 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:25:56.867 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:00:53 ago on Thu 12 Sep 2024 05:25:03 PM UTC. 2024-09-12T17:25:56.999 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-12T17:25:56.999 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:25:57.000 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-09-12T17:25:57.000 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:25:57.000 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-12T17:25:57.000 INFO:teuthology.orchestra.run.smithi170.stdout: cephadm noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 783 k 2024-09-12T17:25:57.000 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:25:57.000 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-12T17:25:57.000 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:25:57.000 INFO:teuthology.orchestra.run.smithi170.stdout:Install 1 Package 2024-09-12T17:25:57.000 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:25:57.000 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 783 k 2024-09-12T17:25:57.000 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 789 k 2024-09-12T17:25:57.000 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-12T17:25:57.293 INFO:teuthology.orchestra.run.smithi170.stdout:cephadm-19.3.0-4762.gbad475c1.el9.noarch.rpm 2.6 MB/s | 783 kB 00:00 2024-09-12T17:25:57.294 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:25:57.294 INFO:teuthology.orchestra.run.smithi170.stdout:Total 2.6 MB/s | 783 kB 00:00 2024-09-12T17:25:57.294 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-12T17:25:57.299 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-12T17:25:57.299 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-12T17:25:57.300 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4762.gbad475c1. 1/1 2024-09-12T17:25:57.300 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:25:57.300 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-12T17:25:57.300 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-immutable-object-cache-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:25:57.300 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:25:57.301 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T17:25:57.305 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-12T17:25:57.306 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-12T17:25:57.376 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-12T17:25:57.521 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-mgr 2024-09-12T17:25:57.839 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 1/1 2024-09-12T17:25:57.914 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 1/1 2024-09-12T17:25:58.116 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:00:58 ago on Thu 12 Sep 2024 05:25:00 PM UTC. 2024-09-12T17:25:58.209 INFO:teuthology.orchestra.run.smithi047.stdout:Package ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-12T17:25:58.255 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T17:25:58.256 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-09-12T17:25:58.256 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T17:25:58.264 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 1/1 2024-09-12T17:25:58.319 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-mgr-dashboard 2024-09-12T17:25:58.476 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 1/1 2024-09-12T17:25:58.476 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:25:58.476 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-12T17:25:58.476 INFO:teuthology.orchestra.run.smithi170.stdout: cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:25:58.476 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:25:58.476 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-12T17:25:58.742 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-immutable-object-cache 2024-09-12T17:25:58.907 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:00:58 ago on Thu 12 Sep 2024 05:25:00 PM UTC. 2024-09-12T17:25:59.047 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T17:25:59.047 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:25:59.048 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-09-12T17:25:59.048 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:25:59.048 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-12T17:25:59.048 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 14 M 2024-09-12T17:25:59.048 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-09-12T17:25:59.048 INFO:teuthology.orchestra.run.smithi047.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T17:25:59.048 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 34 k 2024-09-12T17:25:59.048 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 16 k 2024-09-12T17:25:59.048 INFO:teuthology.orchestra.run.smithi047.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T17:25:59.048 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T17:25:59.048 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T17:25:59.049 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T17:25:59.049 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T17:25:59.049 INFO:teuthology.orchestra.run.smithi047.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T17:25:59.049 INFO:teuthology.orchestra.run.smithi047.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T17:25:59.049 INFO:teuthology.orchestra.run.smithi047.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T17:25:59.049 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:25:59.049 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-12T17:25:59.049 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:25:59.049 INFO:teuthology.orchestra.run.smithi047.stdout:Install 12 Packages 2024-09-12T17:25:59.049 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:25:59.050 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 19 M 2024-09-12T17:25:59.050 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 159 M 2024-09-12T17:25:59.050 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-12T17:25:59.303 INFO:teuthology.orchestra.run.smithi047.stdout:(1/12): ceph-grafana-dashboards-19.3.0-4762.gba 223 kB/s | 34 kB 00:00 2024-09-12T17:25:59.318 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:00:56 ago on Thu 12 Sep 2024 05:25:03 PM UTC. 2024-09-12T17:25:59.328 INFO:teuthology.orchestra.run.smithi047.stdout:(2/12): ceph-prometheus-alerts-19.3.0-4762.gbad 92 kB/s | 16 kB 00:00 2024-09-12T17:25:59.445 INFO:teuthology.orchestra.run.smithi047.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 2.3 MB/s | 269 kB 00:00 2024-09-12T17:25:59.453 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-12T17:25:59.454 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:25:59.454 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repo Size 2024-09-12T17:25:59.454 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:25:59.454 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-12T17:25:59.454 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 145 k 2024-09-12T17:25:59.454 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:25:59.454 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-12T17:25:59.454 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:25:59.454 INFO:teuthology.orchestra.run.smithi170.stdout:Install 1 Package 2024-09-12T17:25:59.454 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:25:59.455 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 145 k 2024-09-12T17:25:59.455 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 432 k 2024-09-12T17:25:59.455 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-12T17:25:59.521 INFO:teuthology.orchestra.run.smithi047.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 4.7 MB/s | 1.0 MB 00:00 2024-09-12T17:25:59.580 INFO:teuthology.orchestra.run.smithi047.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 9.2 MB/s | 548 kB 00:00 2024-09-12T17:25:59.596 INFO:teuthology.orchestra.run.smithi047.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 1.2 MB/s | 19 kB 00:00 2024-09-12T17:25:59.680 INFO:teuthology.orchestra.run.smithi047.stdout:(7/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 24 MB/s | 2.0 MB 00:00 2024-09-12T17:25:59.705 INFO:teuthology.orchestra.run.smithi047.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.7 MB/s | 144 kB 00:00 2024-09-12T17:25:59.717 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-immutable-object-cache-19.3.0-4762.gbad475 554 kB/s | 145 kB 00:00 2024-09-12T17:25:59.718 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:25:59.718 INFO:teuthology.orchestra.run.smithi170.stdout:Total 550 kB/s | 145 kB 00:00 2024-09-12T17:25:59.718 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-12T17:25:59.722 INFO:teuthology.orchestra.run.smithi047.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.8 MB/s | 31 kB 00:00 2024-09-12T17:25:59.726 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-12T17:25:59.726 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-12T17:25:59.748 INFO:teuthology.orchestra.run.smithi047.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 7.4 MB/s | 188 kB 00:00 2024-09-12T17:25:59.773 INFO:teuthology.orchestra.run.smithi047.stdout:(11/12): protobuf-compiler-3.14.0-13.el9.x86_64 2.6 MB/s | 863 kB 00:00 2024-09-12T17:25:59.785 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-12T17:25:59.785 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-12T17:25:59.929 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-12T17:25:59.948 INFO:teuthology.orchestra.run.smithi047.stdout:(12/12): ceph-mgr-dashboard-19.3.0-4762.gbad475 18 MB/s | 14 MB 00:00 2024-09-12T17:25:59.951 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:25:59.951 INFO:teuthology.orchestra.run.smithi047.stdout:Total 21 MB/s | 19 MB 00:00 2024-09-12T17:25:59.993 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4762.gbad475c1. 1/1 2024-09-12T17:26:00.001 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-12T17:26:00.019 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4762.gbad475c1. 1/1 2024-09-12T17:26:00.019 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:26:00.019 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T17:26:00.019 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:00.021 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-12T17:26:00.021 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-12T17:26:00.310 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-12T17:26:00.311 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-12T17:26:00.939 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-12T17:26:01.000 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4762.gbad475c1. 1/1 2024-09-12T17:26:01.000 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:01.000 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-12T17:26:01.000 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-immutable-object-cache-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:26:01.000 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:01.000 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-12T17:26:01.025 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-12T17:26:01.068 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-12T17:26:01.116 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-12T17:26:01.144 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-12T17:26:01.249 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-12T17:26:01.253 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-mgr 2024-09-12T17:26:01.386 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-12T17:26:01.479 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-12T17:26:01.526 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-12T17:26:01.553 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-12T17:26:01.577 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.el9 10/12 2024-09-12T17:26:01.828 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:00:58 ago on Thu 12 Sep 2024 05:25:03 PM UTC. 2024-09-12T17:26:01.920 INFO:teuthology.orchestra.run.smithi170.stdout:Package ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-12T17:26:01.962 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-12T17:26:01.962 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-09-12T17:26:01.962 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-12T17:26:02.041 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-mgr-dashboard 2024-09-12T17:26:02.608 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:00:59 ago on Thu 12 Sep 2024 05:25:03 PM UTC. 2024-09-12T17:26:02.740 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-12T17:26:02.741 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:26:02.741 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-09-12T17:26:02.741 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:26:02.741 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-12T17:26:02.742 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 14 M 2024-09-12T17:26:02.742 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-09-12T17:26:02.742 INFO:teuthology.orchestra.run.smithi170.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T17:26:02.742 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 34 k 2024-09-12T17:26:02.742 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 16 k 2024-09-12T17:26:02.742 INFO:teuthology.orchestra.run.smithi170.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T17:26:02.742 INFO:teuthology.orchestra.run.smithi170.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T17:26:02.742 INFO:teuthology.orchestra.run.smithi170.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T17:26:02.742 INFO:teuthology.orchestra.run.smithi170.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T17:26:02.742 INFO:teuthology.orchestra.run.smithi170.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T17:26:02.742 INFO:teuthology.orchestra.run.smithi170.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T17:26:02.742 INFO:teuthology.orchestra.run.smithi170.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T17:26:02.742 INFO:teuthology.orchestra.run.smithi170.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T17:26:02.743 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:02.743 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-12T17:26:02.743 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:26:02.743 INFO:teuthology.orchestra.run.smithi170.stdout:Install 12 Packages 2024-09-12T17:26:02.743 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:02.743 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 19 M 2024-09-12T17:26:02.743 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 159 M 2024-09-12T17:26:02.744 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-12T17:26:02.987 INFO:teuthology.orchestra.run.smithi170.stdout:(1/12): ceph-prometheus-alerts-19.3.0-4762.gbad 120 kB/s | 16 kB 00:00 2024-09-12T17:26:03.004 INFO:teuthology.orchestra.run.smithi170.stdout:(2/12): ceph-grafana-dashboards-19.3.0-4762.gba 222 kB/s | 34 kB 00:00 2024-09-12T17:26:03.480 INFO:teuthology.orchestra.run.smithi170.stdout:(3/12): ceph-mgr-dashboard-19.3.0-4762.gbad475c 23 MB/s | 14 MB 00:00 2024-09-12T17:26:03.647 INFO:teuthology.orchestra.run.smithi170.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 419 kB/s | 269 kB 00:00 2024-09-12T17:26:03.697 INFO:teuthology.orchestra.run.smithi170.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-12T17:26:03.722 INFO:teuthology.orchestra.run.smithi170.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 785 kB/s | 19 kB 00:00 2024-09-12T17:26:03.798 INFO:teuthology.orchestra.run.smithi170.stdout:(7/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 27 MB/s | 2.0 MB 00:00 2024-09-12T17:26:03.823 INFO:teuthology.orchestra.run.smithi170.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.7 MB/s | 144 kB 00:00 2024-09-12T17:26:03.848 INFO:teuthology.orchestra.run.smithi170.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-12T17:26:03.890 INFO:teuthology.orchestra.run.smithi170.stdout:(10/12): protobuf-3.14.0-13.el9.x86_64.rpm 1.1 MB/s | 1.0 MB 00:00 2024-09-12T17:26:03.915 INFO:teuthology.orchestra.run.smithi170.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 2.7 MB/s | 188 kB 00:00 2024-09-12T17:26:04.257 INFO:teuthology.orchestra.run.smithi170.stdout:(12/12): protobuf-compiler-3.14.0-13.el9.x86_64 1.1 MB/s | 863 kB 00:00 2024-09-12T17:26:04.260 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:26:04.260 INFO:teuthology.orchestra.run.smithi170.stdout:Total 13 MB/s | 19 MB 00:01 2024-09-12T17:26:04.308 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-12T17:26:04.327 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-12T17:26:04.327 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-12T17:26:04.614 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-12T17:26:04.615 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-12T17:26:04.975 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1.el 11/12 2024-09-12T17:26:05.031 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.noa 12/12 2024-09-12T17:26:05.212 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-12T17:26:05.300 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-12T17:26:05.334 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-12T17:26:05.381 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-12T17:26:05.412 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-12T17:26:05.510 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-12T17:26:05.637 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-12T17:26:05.740 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-12T17:26:05.783 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-12T17:26:05.820 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-12T17:26:05.861 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.el9 10/12 2024-09-12T17:26:06.937 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.noa 12/12 2024-09-12T17:26:06.938 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1.el 1/12 2024-09-12T17:26:06.938 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.noa 2/12 2024-09-12T17:26:06.938 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.el9 3/12 2024-09-12T17:26:06.938 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-12T17:26:06.938 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-12T17:26:06.938 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-12T17:26:06.938 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-12T17:26:06.938 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-12T17:26:06.938 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-12T17:26:06.938 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-12T17:26:06.938 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-12T17:26:07.258 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-12T17:26:07.258 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:07.258 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-12T17:26:07.259 INFO:teuthology.orchestra.run.smithi047.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T17:26:07.259 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:26:07.259 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:26:07.259 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:26:07.259 INFO:teuthology.orchestra.run.smithi047.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T17:26:07.259 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T17:26:07.259 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T17:26:07.259 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T17:26:07.259 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T17:26:07.259 INFO:teuthology.orchestra.run.smithi047.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T17:26:07.259 INFO:teuthology.orchestra.run.smithi047.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T17:26:07.259 INFO:teuthology.orchestra.run.smithi047.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T17:26:07.259 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:07.260 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T17:26:07.510 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-12T17:26:08.099 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:08 ago on Thu 12 Sep 2024 05:25:00 PM UTC. 2024-09-12T17:26:08.237 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T17:26:08.238 INFO:teuthology.orchestra.run.smithi047.stdout:======================================================================================= 2024-09-12T17:26:08.238 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-09-12T17:26:08.238 INFO:teuthology.orchestra.run.smithi047.stdout:======================================================================================= 2024-09-12T17:26:08.238 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-12T17:26:08.238 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 7.4 M 2024-09-12T17:26:08.238 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-09-12T17:26:08.239 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T17:26:08.239 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T17:26:08.239 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T17:26:08.239 INFO:teuthology.orchestra.run.smithi047.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T17:26:08.239 INFO:teuthology.orchestra.run.smithi047.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T17:26:08.239 INFO:teuthology.orchestra.run.smithi047.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T17:26:08.239 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T17:26:08.239 INFO:teuthology.orchestra.run.smithi047.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T17:26:08.239 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T17:26:08.239 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T17:26:08.239 INFO:teuthology.orchestra.run.smithi047.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T17:26:08.239 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:08.239 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-12T17:26:08.240 INFO:teuthology.orchestra.run.smithi047.stdout:======================================================================================= 2024-09-12T17:26:08.240 INFO:teuthology.orchestra.run.smithi047.stdout:Install 12 Packages 2024-09-12T17:26:08.240 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:08.240 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 38 M 2024-09-12T17:26:08.240 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 212 M 2024-09-12T17:26:08.240 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-12T17:26:08.738 INFO:teuthology.orchestra.run.smithi047.stdout:(1/12): ceph-mgr-diskprediction-local-19.3.0-47 17 MB/s | 7.4 MB 00:00 2024-09-12T17:26:08.863 INFO:teuthology.orchestra.run.smithi047.stdout:(2/12): libquadmath-11.5.0-2.el9.x86_64.rpm 345 kB/s | 191 kB 00:00 2024-09-12T17:26:08.880 INFO:teuthology.orchestra.run.smithi047.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 231 kB/s | 33 kB 00:00 2024-09-12T17:26:08.997 INFO:teuthology.orchestra.run.smithi047.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 156 kB/s | 18 kB 00:00 2024-09-12T17:26:09.039 INFO:teuthology.orchestra.run.smithi047.stdout:(5/12): libgfortran-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 801 kB 00:00 2024-09-12T17:26:09.056 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1.el 11/12 2024-09-12T17:26:09.097 INFO:teuthology.orchestra.run.smithi047.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 384 kB/s | 38 kB 00:00 2024-09-12T17:26:09.124 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.noa 12/12 2024-09-12T17:26:09.223 INFO:teuthology.orchestra.run.smithi047.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-09-12T17:26:09.332 INFO:teuthology.orchestra.run.smithi047.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 6.4 MB/s | 3.0 MB 00:00 2024-09-12T17:26:09.407 INFO:teuthology.orchestra.run.smithi047.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 13 MB/s | 4.9 MB 00:00 2024-09-12T17:26:09.432 INFO:teuthology.orchestra.run.smithi047.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.4 MB/s | 250 kB 00:00 2024-09-12T17:26:09.507 INFO:teuthology.orchestra.run.smithi047.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 18 MB/s | 5.1 MB 00:00 2024-09-12T17:26:09.991 INFO:teuthology.orchestra.run.smithi047.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 28 MB/s | 16 MB 00:00 2024-09-12T17:26:09.991 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:26:09.992 INFO:teuthology.orchestra.run.smithi047.stdout:Total 22 MB/s | 38 MB 00:01 2024-09-12T17:26:10.364 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-12T17:26:10.392 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-12T17:26:10.392 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-12T17:26:10.844 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-12T17:26:10.845 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-12T17:26:11.168 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.noa 12/12 2024-09-12T17:26:11.168 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1.el 1/12 2024-09-12T17:26:11.168 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.noa 2/12 2024-09-12T17:26:11.168 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.el9 3/12 2024-09-12T17:26:11.168 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-12T17:26:11.168 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-12T17:26:11.168 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-12T17:26:11.168 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-12T17:26:11.168 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-12T17:26:11.168 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-12T17:26:11.169 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-12T17:26:11.169 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-12T17:26:11.492 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-12T17:26:11.493 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:11.493 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-12T17:26:11.493 INFO:teuthology.orchestra.run.smithi170.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T17:26:11.493 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:26:11.493 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:26:11.493 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:26:11.493 INFO:teuthology.orchestra.run.smithi170.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T17:26:11.493 INFO:teuthology.orchestra.run.smithi170.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T17:26:11.493 INFO:teuthology.orchestra.run.smithi170.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T17:26:11.493 INFO:teuthology.orchestra.run.smithi170.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T17:26:11.493 INFO:teuthology.orchestra.run.smithi170.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T17:26:11.493 INFO:teuthology.orchestra.run.smithi170.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T17:26:11.494 INFO:teuthology.orchestra.run.smithi170.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T17:26:11.494 INFO:teuthology.orchestra.run.smithi170.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T17:26:11.494 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:11.494 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-12T17:26:11.648 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-12T17:26:11.722 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-12T17:26:11.738 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-12T17:26:11.765 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-12T17:26:11.869 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-12T17:26:11.907 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-12T17:26:12.100 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-12T17:26:12.130 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-12T17:26:12.210 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-12T17:26:12.323 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:09 ago on Thu 12 Sep 2024 05:25:03 PM UTC. 2024-09-12T17:26:12.463 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-12T17:26:12.464 INFO:teuthology.orchestra.run.smithi170.stdout:======================================================================================= 2024-09-12T17:26:12.465 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-09-12T17:26:12.465 INFO:teuthology.orchestra.run.smithi170.stdout:======================================================================================= 2024-09-12T17:26:12.465 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-12T17:26:12.465 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 7.4 M 2024-09-12T17:26:12.465 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-09-12T17:26:12.465 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T17:26:12.465 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T17:26:12.465 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T17:26:12.465 INFO:teuthology.orchestra.run.smithi170.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T17:26:12.465 INFO:teuthology.orchestra.run.smithi170.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T17:26:12.465 INFO:teuthology.orchestra.run.smithi170.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T17:26:12.465 INFO:teuthology.orchestra.run.smithi170.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T17:26:12.466 INFO:teuthology.orchestra.run.smithi170.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T17:26:12.466 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T17:26:12.466 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T17:26:12.466 INFO:teuthology.orchestra.run.smithi170.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T17:26:12.466 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:12.466 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-12T17:26:12.466 INFO:teuthology.orchestra.run.smithi170.stdout:======================================================================================= 2024-09-12T17:26:12.466 INFO:teuthology.orchestra.run.smithi170.stdout:Install 12 Packages 2024-09-12T17:26:12.466 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:12.467 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 38 M 2024-09-12T17:26:12.467 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 212 M 2024-09-12T17:26:12.467 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-12T17:26:12.909 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-12T17:26:12.990 INFO:teuthology.orchestra.run.smithi170.stdout:(1/12): ceph-mgr-diskprediction-local-19.3.0-47 16 MB/s | 7.4 MB 00:00 2024-09-12T17:26:13.041 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-12T17:26:13.091 INFO:teuthology.orchestra.run.smithi170.stdout:(2/12): libquadmath-11.5.0-2.el9.x86_64.rpm 344 kB/s | 191 kB 00:00 2024-09-12T17:26:13.116 INFO:teuthology.orchestra.run.smithi170.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 261 kB/s | 33 kB 00:00 2024-09-12T17:26:13.166 INFO:teuthology.orchestra.run.smithi170.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 363 kB/s | 18 kB 00:00 2024-09-12T17:26:13.233 INFO:teuthology.orchestra.run.smithi170.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 578 kB/s | 38 kB 00:00 2024-09-12T17:26:13.350 INFO:teuthology.orchestra.run.smithi170.stdout:(6/12): libgfortran-11.5.0-2.el9.x86_64.rpm 982 kB/s | 801 kB 00:00 2024-09-12T17:26:13.417 INFO:teuthology.orchestra.run.smithi170.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 9.2 MB/s | 3.0 MB 00:00 2024-09-12T17:26:13.550 INFO:teuthology.orchestra.run.smithi170.stdout:(8/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 38 MB/s | 5.1 MB 00:00 2024-09-12T17:26:13.634 INFO:teuthology.orchestra.run.smithi170.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 12 MB/s | 4.9 MB 00:00 2024-09-12T17:26:13.668 INFO:teuthology.orchestra.run.smithi170.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.1 MB/s | 250 kB 00:00 2024-09-12T17:26:13.701 INFO:teuthology.orchestra.run.smithi170.stdout:(11/12): python3-devel-3.9.19-8.el9.x86_64.rpm 698 kB/s | 245 kB 00:00 2024-09-12T17:26:14.068 INFO:teuthology.orchestra.run.smithi170.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 37 MB/s | 16 MB 00:00 2024-09-12T17:26:14.068 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:26:14.069 INFO:teuthology.orchestra.run.smithi170.stdout:Total 24 MB/s | 38 MB 00:01 2024-09-12T17:26:14.395 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-12T17:26:14.426 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-12T17:26:14.452 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-12T17:26:14.452 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-12T17:26:14.878 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-12T17:26:14.878 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-12T17:26:15.475 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-12T17:26:15.497 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad47 12/12 2024-09-12T17:26:15.650 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-12T17:26:15.733 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-12T17:26:15.791 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-12T17:26:15.906 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-12T17:26:15.942 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-12T17:26:16.125 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-12T17:26:16.158 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-12T17:26:16.245 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-12T17:26:16.903 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-12T17:26:17.021 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-12T17:26:18.239 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad47 12/12 2024-09-12T17:26:18.239 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad47 1/12 2024-09-12T17:26:18.239 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-12T17:26:18.240 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-12T17:26:18.240 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-12T17:26:18.240 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-12T17:26:18.240 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-12T17:26:18.240 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-12T17:26:18.240 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-12T17:26:18.240 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-12T17:26:18.240 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-12T17:26:18.240 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-12T17:26:18.267 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-12T17:26:18.690 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-12T17:26:18.690 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:18.690 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-12T17:26:18.690 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:26:18.690 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T17:26:18.691 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T17:26:18.691 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T17:26:18.691 INFO:teuthology.orchestra.run.smithi047.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T17:26:18.691 INFO:teuthology.orchestra.run.smithi047.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T17:26:18.691 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T17:26:18.691 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T17:26:18.691 INFO:teuthology.orchestra.run.smithi047.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T17:26:18.691 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T17:26:18.691 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T17:26:18.691 INFO:teuthology.orchestra.run.smithi047.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T17:26:18.691 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:18.691 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T17:26:19.075 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-mgr-rook 2024-09-12T17:26:19.301 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-12T17:26:19.325 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad47 12/12 2024-09-12T17:26:19.667 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:19 ago on Thu 12 Sep 2024 05:25:00 PM UTC. 2024-09-12T17:26:19.806 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T17:26:19.807 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:26:19.807 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-09-12T17:26:19.807 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:26:19.807 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-12T17:26:19.807 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-rook noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 49 k 2024-09-12T17:26:19.807 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-09-12T17:26:19.807 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T17:26:19.807 INFO:teuthology.orchestra.run.smithi047.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T17:26:19.807 INFO:teuthology.orchestra.run.smithi047.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T17:26:19.808 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T17:26:19.808 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T17:26:19.808 INFO:teuthology.orchestra.run.smithi047.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T17:26:19.808 INFO:teuthology.orchestra.run.smithi047.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T17:26:19.808 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T17:26:19.808 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T17:26:19.808 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T17:26:19.808 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T17:26:19.808 INFO:teuthology.orchestra.run.smithi047.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T17:26:19.808 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:19.808 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-12T17:26:19.808 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:26:19.809 INFO:teuthology.orchestra.run.smithi047.stdout:Install 13 Packages 2024-09-12T17:26:19.809 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:19.809 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 2.2 M 2024-09-12T17:26:19.809 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 26 M 2024-09-12T17:26:19.809 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-12T17:26:19.982 INFO:teuthology.orchestra.run.smithi047.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 213 kB/s | 19 kB 00:00 2024-09-12T17:26:20.007 INFO:teuthology.orchestra.run.smithi047.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 222 kB/s | 26 kB 00:00 2024-09-12T17:26:20.066 INFO:teuthology.orchestra.run.smithi047.stdout:(3/13): ceph-mgr-rook-19.3.0-4762.gbad475c1.el9 284 kB/s | 49 kB 00:00 2024-09-12T17:26:20.091 INFO:teuthology.orchestra.run.smithi047.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.0 MB/s | 222 kB 00:00 2024-09-12T17:26:20.116 INFO:teuthology.orchestra.run.smithi047.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-12T17:26:20.142 INFO:teuthology.orchestra.run.smithi047.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-12T17:26:20.183 INFO:teuthology.orchestra.run.smithi047.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 480 kB/s | 32 kB 00:00 2024-09-12T17:26:20.209 INFO:teuthology.orchestra.run.smithi047.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 211 kB/s | 14 kB 00:00 2024-09-12T17:26:20.235 INFO:teuthology.orchestra.run.smithi047.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.6 MB/s | 279 kB 00:00 2024-09-12T17:26:20.268 INFO:teuthology.orchestra.run.smithi047.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.6 MB/s | 220 kB 00:00 2024-09-12T17:26:20.293 INFO:teuthology.orchestra.run.smithi047.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.8 MB/s | 90 kB 00:00 2024-09-12T17:26:20.318 INFO:teuthology.orchestra.run.smithi047.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 708 kB/s | 59 kB 00:00 2024-09-12T17:26:20.352 INFO:teuthology.orchestra.run.smithi047.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.2 MB/s | 1.0 MB 00:00 2024-09-12T17:26:20.354 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:26:20.355 INFO:teuthology.orchestra.run.smithi047.stdout:Total 4.1 MB/s | 2.2 MB 00:00 2024-09-12T17:26:20.422 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-12T17:26:20.438 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-12T17:26:20.439 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-12T17:26:20.536 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-12T17:26:20.537 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-12T17:26:21.208 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-12T17:26:21.391 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-12T17:26:21.452 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-12T17:26:21.519 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-12T17:26:21.554 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-12T17:26:21.596 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-12T17:26:21.702 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-12T17:26:21.814 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-12T17:26:21.866 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-12T17:26:22.005 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad47 12/12 2024-09-12T17:26:22.005 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad47 1/12 2024-09-12T17:26:22.005 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-12T17:26:22.005 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-12T17:26:22.005 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-12T17:26:22.006 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-12T17:26:22.006 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-12T17:26:22.006 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-12T17:26:22.006 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-12T17:26:22.006 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-12T17:26:22.006 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-12T17:26:22.006 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-12T17:26:22.424 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-12T17:26:22.424 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:22.424 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-12T17:26:22.424 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:26:22.424 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T17:26:22.424 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T17:26:22.424 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T17:26:22.424 INFO:teuthology.orchestra.run.smithi170.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T17:26:22.424 INFO:teuthology.orchestra.run.smithi170.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T17:26:22.425 INFO:teuthology.orchestra.run.smithi170.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T17:26:22.425 INFO:teuthology.orchestra.run.smithi170.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T17:26:22.425 INFO:teuthology.orchestra.run.smithi170.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T17:26:22.425 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T17:26:22.425 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T17:26:22.425 INFO:teuthology.orchestra.run.smithi170.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T17:26:22.425 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:22.425 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-12T17:26:22.625 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-12T17:26:22.670 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-12T17:26:22.705 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-12T17:26:22.753 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-12T17:26:22.781 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 13/13 2024-09-12T17:26:22.842 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-mgr-rook 2024-09-12T17:26:23.422 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:20 ago on Thu 12 Sep 2024 05:25:03 PM UTC. 2024-09-12T17:26:23.556 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-12T17:26:23.557 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:26:23.557 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-09-12T17:26:23.557 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:26:23.557 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-12T17:26:23.557 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-rook noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 49 k 2024-09-12T17:26:23.557 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-09-12T17:26:23.558 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T17:26:23.558 INFO:teuthology.orchestra.run.smithi170.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T17:26:23.558 INFO:teuthology.orchestra.run.smithi170.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T17:26:23.558 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T17:26:23.558 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T17:26:23.558 INFO:teuthology.orchestra.run.smithi170.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T17:26:23.558 INFO:teuthology.orchestra.run.smithi170.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T17:26:23.558 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T17:26:23.558 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T17:26:23.558 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T17:26:23.558 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T17:26:23.558 INFO:teuthology.orchestra.run.smithi170.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T17:26:23.559 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:23.559 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-12T17:26:23.559 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:26:23.559 INFO:teuthology.orchestra.run.smithi170.stdout:Install 13 Packages 2024-09-12T17:26:23.559 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:23.559 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 2.2 M 2024-09-12T17:26:23.559 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 26 M 2024-09-12T17:26:23.560 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-12T17:26:23.713 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 13/13 2024-09-12T17:26:23.713 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 1/13 2024-09-12T17:26:23.714 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-12T17:26:23.714 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-12T17:26:23.714 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-12T17:26:23.714 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-12T17:26:23.714 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-12T17:26:23.714 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-12T17:26:23.714 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-12T17:26:23.714 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-12T17:26:23.714 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-12T17:26:23.714 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-12T17:26:23.715 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-12T17:26:23.934 INFO:teuthology.orchestra.run.smithi170.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 278 kB/s | 26 kB 00:00 2024-09-12T17:26:23.967 INFO:teuthology.orchestra.run.smithi170.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 153 kB/s | 19 kB 00:00 2024-09-12T17:26:24.009 INFO:teuthology.orchestra.run.smithi170.stdout:(3/13): ceph-mgr-rook-19.3.0-4762.gbad475c1.el9 294 kB/s | 49 kB 00:00 2024-09-12T17:26:24.047 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-12T17:26:24.048 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:24.048 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-12T17:26:24.048 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:26:24.048 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T17:26:24.048 INFO:teuthology.orchestra.run.smithi047.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T17:26:24.048 INFO:teuthology.orchestra.run.smithi047.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T17:26:24.048 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T17:26:24.048 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T17:26:24.048 INFO:teuthology.orchestra.run.smithi047.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T17:26:24.048 INFO:teuthology.orchestra.run.smithi047.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T17:26:24.048 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T17:26:24.049 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T17:26:24.049 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T17:26:24.049 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T17:26:24.049 INFO:teuthology.orchestra.run.smithi047.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T17:26:24.049 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:24.049 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T17:26:24.060 INFO:teuthology.orchestra.run.smithi170.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.7 MB/s | 222 kB 00:00 2024-09-12T17:26:24.102 INFO:teuthology.orchestra.run.smithi170.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-12T17:26:24.144 INFO:teuthology.orchestra.run.smithi170.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 771 kB/s | 32 kB 00:00 2024-09-12T17:26:24.169 INFO:teuthology.orchestra.run.smithi170.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 493 kB/s | 54 kB 00:00 2024-09-12T17:26:24.194 INFO:teuthology.orchestra.run.smithi170.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 280 kB/s | 14 kB 00:00 2024-09-12T17:26:24.228 INFO:teuthology.orchestra.run.smithi170.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.2 MB/s | 279 kB 00:00 2024-09-12T17:26:24.270 INFO:teuthology.orchestra.run.smithi170.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.1 MB/s | 220 kB 00:00 2024-09-12T17:26:24.295 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-mgr-cephadm 2024-09-12T17:26:24.295 INFO:teuthology.orchestra.run.smithi170.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 909 kB/s | 59 kB 00:00 2024-09-12T17:26:24.320 INFO:teuthology.orchestra.run.smithi170.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.8 MB/s | 90 kB 00:00 2024-09-12T17:26:24.362 INFO:teuthology.orchestra.run.smithi170.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.4 MB/s | 1.0 MB 00:00 2024-09-12T17:26:24.365 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:26:24.365 INFO:teuthology.orchestra.run.smithi170.stdout:Total 2.7 MB/s | 2.2 MB 00:00 2024-09-12T17:26:24.431 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-12T17:26:24.450 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-12T17:26:24.450 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-12T17:26:24.537 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-12T17:26:24.542 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-12T17:26:24.888 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:24 ago on Thu 12 Sep 2024 05:25:00 PM UTC. 2024-09-12T17:26:25.027 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T17:26:25.028 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:26:25.028 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-09-12T17:26:25.028 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:26:25.028 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-12T17:26:25.029 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 154 k 2024-09-12T17:26:25.029 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-09-12T17:26:25.029 INFO:teuthology.orchestra.run.smithi047.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T17:26:25.029 INFO:teuthology.orchestra.run.smithi047.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T17:26:25.029 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T17:26:25.029 INFO:teuthology.orchestra.run.smithi047.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T17:26:25.029 INFO:teuthology.orchestra.run.smithi047.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T17:26:25.029 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:25.029 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-12T17:26:25.029 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:26:25.029 INFO:teuthology.orchestra.run.smithi047.stdout:Install 6 Packages 2024-09-12T17:26:25.029 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:25.030 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 7.0 M 2024-09-12T17:26:25.030 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 33 M 2024-09-12T17:26:25.030 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-12T17:26:25.049 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-12T17:26:25.218 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-12T17:26:25.272 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-12T17:26:25.327 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-12T17:26:25.364 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-12T17:26:25.406 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-12T17:26:25.507 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-12T17:26:25.553 INFO:teuthology.orchestra.run.smithi047.stdout:(1/6): ceph-mgr-cephadm-19.3.0-4762.gbad475c1.e 737 kB/s | 154 kB 00:00 2024-09-12T17:26:25.587 INFO:teuthology.orchestra.run.smithi047.stdout:(2/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.0 MB/s | 248 kB 00:00 2024-09-12T17:26:25.609 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-12T17:26:25.629 INFO:teuthology.orchestra.run.smithi047.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 7.1 MB/s | 548 kB 00:00 2024-09-12T17:26:25.654 INFO:teuthology.orchestra.run.smithi047.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 3.2 MB/s | 74 kB 00:00 2024-09-12T17:26:25.657 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-12T17:26:25.679 INFO:teuthology.orchestra.run.smithi047.stdout:(5/6): python3-natsort-7.1.1-5.el9.noarch.rpm 639 kB/s | 58 kB 00:00 2024-09-12T17:26:26.365 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-12T17:26:26.414 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-12T17:26:26.447 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-12T17:26:26.495 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-12T17:26:26.517 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 13/13 2024-09-12T17:26:26.713 INFO:teuthology.orchestra.run.smithi047.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 4.4 MB/s | 6.0 MB 00:01 2024-09-12T17:26:26.715 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:26:26.715 INFO:teuthology.orchestra.run.smithi047.stdout:Total 4.2 MB/s | 7.0 MB 00:01 2024-09-12T17:26:26.789 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-12T17:26:26.801 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-12T17:26:26.801 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-12T17:26:26.907 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-12T17:26:26.908 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-12T17:26:27.228 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-12T17:26:27.292 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 13/13 2024-09-12T17:26:27.292 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 1/13 2024-09-12T17:26:27.292 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-12T17:26:27.292 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-12T17:26:27.292 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-12T17:26:27.293 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-12T17:26:27.293 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-12T17:26:27.293 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-12T17:26:27.293 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-12T17:26:27.293 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-12T17:26:27.293 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-12T17:26:27.293 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-12T17:26:27.293 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-12T17:26:27.397 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-12T17:26:27.466 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-12T17:26:27.631 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-12T17:26:27.631 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:27.631 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-12T17:26:27.631 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:26:27.631 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T17:26:27.632 INFO:teuthology.orchestra.run.smithi170.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T17:26:27.632 INFO:teuthology.orchestra.run.smithi170.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T17:26:27.632 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T17:26:27.632 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T17:26:27.632 INFO:teuthology.orchestra.run.smithi170.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T17:26:27.632 INFO:teuthology.orchestra.run.smithi170.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T17:26:27.632 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T17:26:27.632 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T17:26:27.632 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T17:26:27.632 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T17:26:27.632 INFO:teuthology.orchestra.run.smithi170.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T17:26:27.632 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:27.632 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-12T17:26:27.878 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-mgr-cephadm 2024-09-12T17:26:28.030 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-12T17:26:28.122 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-12T17:26:28.198 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-12T17:26:28.227 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 6/6 2024-09-12T17:26:28.444 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:25 ago on Thu 12 Sep 2024 05:25:03 PM UTC. 2024-09-12T17:26:28.578 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-12T17:26:28.578 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:26:28.579 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-09-12T17:26:28.579 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:26:28.579 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-12T17:26:28.579 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 154 k 2024-09-12T17:26:28.579 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-09-12T17:26:28.579 INFO:teuthology.orchestra.run.smithi170.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T17:26:28.579 INFO:teuthology.orchestra.run.smithi170.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T17:26:28.579 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T17:26:28.579 INFO:teuthology.orchestra.run.smithi170.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T17:26:28.579 INFO:teuthology.orchestra.run.smithi170.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T17:26:28.579 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:28.579 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-12T17:26:28.579 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:26:28.580 INFO:teuthology.orchestra.run.smithi170.stdout:Install 6 Packages 2024-09-12T17:26:28.580 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:28.580 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 7.0 M 2024-09-12T17:26:28.580 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 33 M 2024-09-12T17:26:28.580 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-12T17:26:29.006 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 6/6 2024-09-12T17:26:29.006 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 1/6 2024-09-12T17:26:29.007 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-12T17:26:29.007 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-12T17:26:29.007 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-12T17:26:29.007 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-12T17:26:29.278 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-12T17:26:29.278 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:29.278 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-12T17:26:29.278 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:26:29.278 INFO:teuthology.orchestra.run.smithi047.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T17:26:29.279 INFO:teuthology.orchestra.run.smithi047.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T17:26:29.279 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T17:26:29.279 INFO:teuthology.orchestra.run.smithi047.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T17:26:29.279 INFO:teuthology.orchestra.run.smithi047.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T17:26:29.279 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:29.279 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T17:26:29.490 INFO:teuthology.orchestra.run.smithi170.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.3 MB/s | 248 kB 00:00 2024-09-12T17:26:29.519 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-fuse 2024-09-12T17:26:29.565 INFO:teuthology.orchestra.run.smithi170.stdout:(2/6): ceph-mgr-cephadm-19.3.0-4762.gbad475c1.e 602 kB/s | 154 kB 00:00 2024-09-12T17:26:29.657 INFO:teuthology.orchestra.run.smithi170.stdout:(3/6): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-09-12T17:26:29.691 INFO:teuthology.orchestra.run.smithi170.stdout:(4/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 2.7 MB/s | 548 kB 00:00 2024-09-12T17:26:29.724 INFO:teuthology.orchestra.run.smithi170.stdout:(5/6): python3-natsort-7.1.1-5.el9.noarch.rpm 364 kB/s | 58 kB 00:00 2024-09-12T17:26:29.758 INFO:teuthology.orchestra.run.smithi170.stdout:(6/6): python3-typing-extensions-4.12.2-2.el9.n 804 kB/s | 74 kB 00:00 2024-09-12T17:26:29.761 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:26:29.761 INFO:teuthology.orchestra.run.smithi170.stdout:Total 5.9 MB/s | 7.0 MB 00:01 2024-09-12T17:26:29.835 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-12T17:26:29.847 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-12T17:26:29.847 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-12T17:26:29.949 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-12T17:26:29.949 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-12T17:26:30.109 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:30 ago on Thu 12 Sep 2024 05:25:00 PM UTC. 2024-09-12T17:26:30.249 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T17:26:30.249 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:26:30.249 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-09-12T17:26:30.249 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:26:30.249 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-12T17:26:30.250 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-fuse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 900 k 2024-09-12T17:26:30.250 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-09-12T17:26:30.250 INFO:teuthology.orchestra.run.smithi047.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T17:26:30.250 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:30.250 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-12T17:26:30.250 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:26:30.250 INFO:teuthology.orchestra.run.smithi047.stdout:Install 2 Packages 2024-09-12T17:26:30.250 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:30.251 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 980 k 2024-09-12T17:26:30.251 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 2.9 M 2024-09-12T17:26:30.251 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-12T17:26:30.267 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-12T17:26:30.431 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-12T17:26:30.440 INFO:teuthology.orchestra.run.smithi047.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 557 kB/s | 80 kB 00:00 2024-09-12T17:26:30.476 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-12T17:26:30.574 INFO:teuthology.orchestra.run.smithi047.stdout:(2/2): ceph-fuse-19.3.0-4762.gbad475c1.el9.x86_ 3.2 MB/s | 900 kB 00:00 2024-09-12T17:26:30.574 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:26:30.574 INFO:teuthology.orchestra.run.smithi047.stdout:Total 2.9 MB/s | 980 kB 00:00 2024-09-12T17:26:30.586 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-12T17:26:30.608 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-12T17:26:30.608 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-12T17:26:30.694 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-12T17:26:30.695 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-12T17:26:30.893 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-12T17:26:31.000 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-12T17:26:31.040 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-12T17:26:31.095 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-12T17:26:31.110 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 2/2 2024-09-12T17:26:31.172 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-12T17:26:31.213 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 6/6 2024-09-12T17:26:31.836 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 2/2 2024-09-12T17:26:31.836 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 1/2 2024-09-12T17:26:32.056 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 6/6 2024-09-12T17:26:32.056 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 1/6 2024-09-12T17:26:32.056 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-12T17:26:32.056 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-12T17:26:32.056 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-12T17:26:32.056 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-12T17:26:32.120 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-12T17:26:32.120 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:32.120 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-12T17:26:32.121 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-12T17:26:32.121 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:32.121 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T17:26:32.338 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-12T17:26:32.338 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:32.338 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-12T17:26:32.338 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:26:32.338 INFO:teuthology.orchestra.run.smithi170.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T17:26:32.338 INFO:teuthology.orchestra.run.smithi170.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T17:26:32.338 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T17:26:32.339 INFO:teuthology.orchestra.run.smithi170.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T17:26:32.339 INFO:teuthology.orchestra.run.smithi170.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T17:26:32.339 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:32.339 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-12T17:26:32.362 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-volume 2024-09-12T17:26:32.597 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-fuse 2024-09-12T17:26:32.959 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:32 ago on Thu 12 Sep 2024 05:25:00 PM UTC. 2024-09-12T17:26:33.100 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T17:26:33.101 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:26:33.101 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-09-12T17:26:33.101 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:26:33.102 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-12T17:26:33.102 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-volume noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 285 k 2024-09-12T17:26:33.102 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:33.102 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-12T17:26:33.103 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:26:33.103 INFO:teuthology.orchestra.run.smithi047.stdout:Install 1 Package 2024-09-12T17:26:33.103 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:33.103 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 285 k 2024-09-12T17:26:33.103 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 1.3 M 2024-09-12T17:26:33.104 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-12T17:26:33.156 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:30 ago on Thu 12 Sep 2024 05:25:03 PM UTC. 2024-09-12T17:26:33.291 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-12T17:26:33.292 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:26:33.292 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-09-12T17:26:33.292 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:26:33.292 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-12T17:26:33.292 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-fuse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 900 k 2024-09-12T17:26:33.292 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-09-12T17:26:33.292 INFO:teuthology.orchestra.run.smithi170.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T17:26:33.292 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:33.292 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-12T17:26:33.292 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:26:33.293 INFO:teuthology.orchestra.run.smithi170.stdout:Install 2 Packages 2024-09-12T17:26:33.293 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:33.293 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 980 k 2024-09-12T17:26:33.293 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 2.9 M 2024-09-12T17:26:33.293 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-12T17:26:33.337 INFO:teuthology.orchestra.run.smithi047.stdout:ceph-volume-19.3.0-4762.gbad475c1.el9.noarch.rp 1.2 MB/s | 285 kB 00:00 2024-09-12T17:26:33.338 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:26:33.338 INFO:teuthology.orchestra.run.smithi047.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-12T17:26:33.338 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-12T17:26:33.347 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-12T17:26:33.347 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-12T17:26:33.379 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-12T17:26:33.380 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-12T17:26:33.568 INFO:teuthology.orchestra.run.smithi170.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 519 kB/s | 80 kB 00:00 2024-09-12T17:26:33.623 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-12T17:26:33.680 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 1/1 2024-09-12T17:26:33.698 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 1/1 2024-09-12T17:26:33.698 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:26:33.699 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T17:26:33.699 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:33.726 INFO:teuthology.orchestra.run.smithi170.stdout:(2/2): ceph-fuse-19.3.0-4762.gbad475c1.el9.x86_ 2.8 MB/s | 900 kB 00:00 2024-09-12T17:26:33.727 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:26:33.727 INFO:teuthology.orchestra.run.smithi170.stdout:Total 2.2 MB/s | 980 kB 00:00 2024-09-12T17:26:33.739 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-12T17:26:33.760 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-12T17:26:33.760 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-12T17:26:33.842 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-12T17:26:33.843 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-12T17:26:34.036 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-12T17:26:34.179 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-12T17:26:34.243 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 2/2 2024-09-12T17:26:34.747 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 1/1 2024-09-12T17:26:34.747 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:34.747 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-12T17:26:34.748 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:26:34.748 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:34.748 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T17:26:34.933 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 2/2 2024-09-12T17:26:34.933 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 1/2 2024-09-12T17:26:35.036 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install librados-devel 2024-09-12T17:26:35.197 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-12T17:26:35.197 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:35.197 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-12T17:26:35.197 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-12T17:26:35.197 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:35.197 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-12T17:26:35.500 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-volume 2024-09-12T17:26:35.640 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:35 ago on Thu 12 Sep 2024 05:25:00 PM UTC. 2024-09-12T17:26:35.779 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T17:26:35.780 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:26:35.781 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repo Size 2024-09-12T17:26:35.781 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:26:35.781 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-12T17:26:35.781 INFO:teuthology.orchestra.run.smithi047.stdout: librados-devel x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 126 k 2024-09-12T17:26:35.781 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:35.781 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-12T17:26:35.781 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:26:35.781 INFO:teuthology.orchestra.run.smithi047.stdout:Install 1 Package 2024-09-12T17:26:35.781 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:35.782 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 126 k 2024-09-12T17:26:35.782 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 456 k 2024-09-12T17:26:35.782 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-12T17:26:35.968 INFO:teuthology.orchestra.run.smithi047.stdout:librados-devel-19.3.0-4762.gbad475c1.el9.x86_64 679 kB/s | 126 kB 00:00 2024-09-12T17:26:35.969 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:26:35.969 INFO:teuthology.orchestra.run.smithi047.stdout:Total 673 kB/s | 126 kB 00:00 2024-09-12T17:26:35.969 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-12T17:26:35.975 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-12T17:26:35.975 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-12T17:26:36.043 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-12T17:26:36.043 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-12T17:26:36.081 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:33 ago on Thu 12 Sep 2024 05:25:03 PM UTC. 2024-09-12T17:26:36.206 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-12T17:26:36.219 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-12T17:26:36.219 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:26:36.219 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-09-12T17:26:36.219 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:26:36.219 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-12T17:26:36.220 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-volume noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 285 k 2024-09-12T17:26:36.220 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:36.220 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-12T17:26:36.220 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:26:36.220 INFO:teuthology.orchestra.run.smithi170.stdout:Install 1 Package 2024-09-12T17:26:36.220 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:36.220 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 285 k 2024-09-12T17:26:36.221 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 1.3 M 2024-09-12T17:26:36.221 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-12T17:26:36.301 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-12T17:26:36.424 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-volume-19.3.0-4762.gbad475c1.el9.noarch.rp 1.4 MB/s | 285 kB 00:00 2024-09-12T17:26:36.425 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:26:36.425 INFO:teuthology.orchestra.run.smithi170.stdout:Total 1.4 MB/s | 285 kB 00:00 2024-09-12T17:26:36.425 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-12T17:26:36.433 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-12T17:26:36.434 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-12T17:26:36.458 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-12T17:26:36.459 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-12T17:26:36.693 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-12T17:26:36.736 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-12T17:26:36.818 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 1/1 2024-09-12T17:26:36.834 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 1/1 2024-09-12T17:26:36.835 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:26:36.835 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T17:26:36.835 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:37.011 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-12T17:26:37.011 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:37.011 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-12T17:26:37.011 INFO:teuthology.orchestra.run.smithi047.stdout: librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:26:37.011 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:37.012 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T17:26:37.255 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install libcephfs2 2024-09-12T17:26:37.823 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 1/1 2024-09-12T17:26:37.823 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:37.823 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-12T17:26:37.823 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:26:37.823 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:37.823 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-12T17:26:37.849 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:37 ago on Thu 12 Sep 2024 05:25:00 PM UTC. 2024-09-12T17:26:37.942 INFO:teuthology.orchestra.run.smithi047.stdout:Package libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-12T17:26:37.988 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T17:26:37.989 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-09-12T17:26:37.989 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T17:26:38.048 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install libcephfs-devel 2024-09-12T17:26:38.122 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install librados-devel 2024-09-12T17:26:38.638 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:38 ago on Thu 12 Sep 2024 05:25:00 PM UTC. 2024-09-12T17:26:38.704 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:35 ago on Thu 12 Sep 2024 05:25:03 PM UTC. 2024-09-12T17:26:38.778 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T17:26:38.779 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:26:38.779 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repo Size 2024-09-12T17:26:38.779 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:26:38.779 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-12T17:26:38.779 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs-devel x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 32 k 2024-09-12T17:26:38.779 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:38.780 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-12T17:26:38.780 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:26:38.780 INFO:teuthology.orchestra.run.smithi047.stdout:Install 1 Package 2024-09-12T17:26:38.780 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:38.780 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 32 k 2024-09-12T17:26:38.780 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 142 k 2024-09-12T17:26:38.780 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-12T17:26:38.843 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-12T17:26:38.843 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:26:38.844 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repo Size 2024-09-12T17:26:38.844 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:26:38.844 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-12T17:26:38.844 INFO:teuthology.orchestra.run.smithi170.stdout: librados-devel x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 126 k 2024-09-12T17:26:38.844 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:38.844 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-12T17:26:38.844 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:26:38.844 INFO:teuthology.orchestra.run.smithi170.stdout:Install 1 Package 2024-09-12T17:26:38.844 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:38.844 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 126 k 2024-09-12T17:26:38.844 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 456 k 2024-09-12T17:26:38.844 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-12T17:26:38.947 INFO:teuthology.orchestra.run.smithi047.stdout:libcephfs-devel-19.3.0-4762.gbad475c1.el9.x86_6 191 kB/s | 32 kB 00:00 2024-09-12T17:26:38.947 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:26:38.947 INFO:teuthology.orchestra.run.smithi047.stdout:Total 189 kB/s | 32 kB 00:00 2024-09-12T17:26:38.948 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-12T17:26:38.951 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-12T17:26:38.951 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-12T17:26:38.972 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-12T17:26:38.973 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-12T17:26:39.056 INFO:teuthology.orchestra.run.smithi170.stdout:librados-devel-19.3.0-4762.gbad475c1.el9.x86_64 602 kB/s | 126 kB 00:00 2024-09-12T17:26:39.056 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:26:39.057 INFO:teuthology.orchestra.run.smithi170.stdout:Total 598 kB/s | 126 kB 00:00 2024-09-12T17:26:39.057 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-12T17:26:39.061 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-12T17:26:39.061 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-12T17:26:39.066 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-12T17:26:39.126 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-12T17:26:39.126 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-12T17:26:39.198 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-12T17:26:39.275 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-12T17:26:39.394 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-12T17:26:39.580 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-12T17:26:39.810 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-12T17:26:39.811 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:39.811 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-12T17:26:39.811 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:26:39.811 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:39.811 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T17:26:39.862 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-12T17:26:39.994 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install librados2 2024-09-12T17:26:40.112 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-12T17:26:40.112 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:40.112 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-12T17:26:40.112 INFO:teuthology.orchestra.run.smithi170.stdout: librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:26:40.112 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:40.112 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-12T17:26:40.400 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install libcephfs2 2024-09-12T17:26:40.581 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:40 ago on Thu 12 Sep 2024 05:25:00 PM UTC. 2024-09-12T17:26:40.675 INFO:teuthology.orchestra.run.smithi047.stdout:Package librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-12T17:26:40.721 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T17:26:40.723 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-09-12T17:26:40.723 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T17:26:40.780 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install librbd1 2024-09-12T17:26:40.969 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:37 ago on Thu 12 Sep 2024 05:25:03 PM UTC. 2024-09-12T17:26:41.059 INFO:teuthology.orchestra.run.smithi170.stdout:Package libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-12T17:26:41.104 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-12T17:26:41.104 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-09-12T17:26:41.105 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-12T17:26:41.171 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install libcephfs-devel 2024-09-12T17:26:41.371 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:41 ago on Thu 12 Sep 2024 05:25:00 PM UTC. 2024-09-12T17:26:41.464 INFO:teuthology.orchestra.run.smithi047.stdout:Package librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-12T17:26:41.509 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T17:26:41.510 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-09-12T17:26:41.510 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T17:26:41.580 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install python3-rados 2024-09-12T17:26:41.740 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:38 ago on Thu 12 Sep 2024 05:25:03 PM UTC. 2024-09-12T17:26:41.874 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-12T17:26:41.875 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:26:41.875 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repo Size 2024-09-12T17:26:41.875 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:26:41.876 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-12T17:26:41.876 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs-devel x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 32 k 2024-09-12T17:26:41.876 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:41.876 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-12T17:26:41.876 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:26:41.876 INFO:teuthology.orchestra.run.smithi170.stdout:Install 1 Package 2024-09-12T17:26:41.876 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:41.876 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 32 k 2024-09-12T17:26:41.876 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 142 k 2024-09-12T17:26:41.876 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-12T17:26:42.034 INFO:teuthology.orchestra.run.smithi170.stdout:libcephfs-devel-19.3.0-4762.gbad475c1.el9.x86_6 201 kB/s | 32 kB 00:00 2024-09-12T17:26:42.034 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:26:42.035 INFO:teuthology.orchestra.run.smithi170.stdout:Total 199 kB/s | 32 kB 00:00 2024-09-12T17:26:42.035 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-12T17:26:42.038 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-12T17:26:42.038 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-12T17:26:42.058 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-12T17:26:42.058 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-12T17:26:42.147 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-12T17:26:42.161 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:42 ago on Thu 12 Sep 2024 05:25:00 PM UTC. 2024-09-12T17:26:42.253 INFO:teuthology.orchestra.run.smithi047.stdout:Package python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-12T17:26:42.256 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-12T17:26:42.299 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T17:26:42.301 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-09-12T17:26:42.301 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T17:26:42.360 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install python3-rgw 2024-09-12T17:26:42.649 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-12T17:26:42.893 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-12T17:26:42.893 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:42.893 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-12T17:26:42.893 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:26:42.893 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:42.894 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-12T17:26:42.947 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:42 ago on Thu 12 Sep 2024 05:25:00 PM UTC. 2024-09-12T17:26:43.039 INFO:teuthology.orchestra.run.smithi047.stdout:Package python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-12T17:26:43.082 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install librados2 2024-09-12T17:26:43.086 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T17:26:43.087 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-09-12T17:26:43.087 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T17:26:43.146 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install python3-cephfs 2024-09-12T17:26:43.649 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:40 ago on Thu 12 Sep 2024 05:25:03 PM UTC. 2024-09-12T17:26:43.737 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:43 ago on Thu 12 Sep 2024 05:25:00 PM UTC. 2024-09-12T17:26:43.739 INFO:teuthology.orchestra.run.smithi170.stdout:Package librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-12T17:26:43.782 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-12T17:26:43.783 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-09-12T17:26:43.783 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-12T17:26:43.830 INFO:teuthology.orchestra.run.smithi047.stdout:Package python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-12T17:26:43.846 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install librbd1 2024-09-12T17:26:43.875 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T17:26:43.876 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-09-12T17:26:43.876 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T17:26:43.935 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install python3-rbd 2024-09-12T17:26:44.448 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:41 ago on Thu 12 Sep 2024 05:25:03 PM UTC. 2024-09-12T17:26:44.526 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:44 ago on Thu 12 Sep 2024 05:25:00 PM UTC. 2024-09-12T17:26:44.542 INFO:teuthology.orchestra.run.smithi170.stdout:Package librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-12T17:26:44.589 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-12T17:26:44.590 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-09-12T17:26:44.590 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-12T17:26:44.619 INFO:teuthology.orchestra.run.smithi047.stdout:Package python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-12T17:26:44.666 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install python3-rados 2024-09-12T17:26:44.667 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T17:26:44.668 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-09-12T17:26:44.668 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T17:26:44.730 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install rbd-fuse 2024-09-12T17:26:45.250 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:42 ago on Thu 12 Sep 2024 05:25:03 PM UTC. 2024-09-12T17:26:45.327 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:45 ago on Thu 12 Sep 2024 05:25:00 PM UTC. 2024-09-12T17:26:45.340 INFO:teuthology.orchestra.run.smithi170.stdout:Package python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-12T17:26:45.384 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-12T17:26:45.385 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-09-12T17:26:45.385 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-12T17:26:45.452 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install python3-rgw 2024-09-12T17:26:45.470 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T17:26:45.470 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:26:45.470 INFO:teuthology.orchestra.run.smithi047.stdout: Package Architecture Version Repository Size 2024-09-12T17:26:45.470 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:26:45.470 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-12T17:26:45.470 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-fuse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 85 k 2024-09-12T17:26:45.470 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:45.470 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-12T17:26:45.471 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:26:45.471 INFO:teuthology.orchestra.run.smithi047.stdout:Install 1 Package 2024-09-12T17:26:45.471 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:45.471 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 85 k 2024-09-12T17:26:45.471 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 231 k 2024-09-12T17:26:45.471 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-12T17:26:45.709 INFO:teuthology.orchestra.run.smithi047.stdout:rbd-fuse-19.3.0-4762.gbad475c1.el9.x86_64.rpm 359 kB/s | 85 kB 00:00 2024-09-12T17:26:45.709 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:26:45.710 INFO:teuthology.orchestra.run.smithi047.stdout:Total 357 kB/s | 85 kB 00:00 2024-09-12T17:26:45.710 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-12T17:26:45.718 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-12T17:26:45.718 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-12T17:26:45.786 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-12T17:26:45.786 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-12T17:26:45.935 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-12T17:26:46.012 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:43 ago on Thu 12 Sep 2024 05:25:03 PM UTC. 2024-09-12T17:26:46.044 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-12T17:26:46.101 INFO:teuthology.orchestra.run.smithi170.stdout:Package python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-12T17:26:46.145 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-12T17:26:46.146 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-09-12T17:26:46.146 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-12T17:26:46.222 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install python3-cephfs 2024-09-12T17:26:46.449 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-12T17:26:46.668 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-12T17:26:46.668 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:46.668 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-12T17:26:46.668 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:26:46.668 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:46.668 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T17:26:46.784 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:43 ago on Thu 12 Sep 2024 05:25:03 PM UTC. 2024-09-12T17:26:46.875 INFO:teuthology.orchestra.run.smithi170.stdout:Package python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-12T17:26:46.918 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-12T17:26:46.919 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-09-12T17:26:46.919 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-12T17:26:46.954 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install rbd-mirror 2024-09-12T17:26:46.984 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install python3-rbd 2024-09-12T17:26:47.544 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:44 ago on Thu 12 Sep 2024 05:25:03 PM UTC. 2024-09-12T17:26:47.554 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:47 ago on Thu 12 Sep 2024 05:25:00 PM UTC. 2024-09-12T17:26:47.633 INFO:teuthology.orchestra.run.smithi170.stdout:Package python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-12T17:26:47.676 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-12T17:26:47.677 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-09-12T17:26:47.677 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-12T17:26:47.697 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T17:26:47.697 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:26:47.698 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repo Size 2024-09-12T17:26:47.698 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:26:47.698 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-12T17:26:47.698 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-mirror x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.2 M 2024-09-12T17:26:47.698 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:47.698 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-12T17:26:47.698 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:26:47.698 INFO:teuthology.orchestra.run.smithi047.stdout:Install 1 Package 2024-09-12T17:26:47.698 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:47.699 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 3.2 M 2024-09-12T17:26:47.699 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 14 M 2024-09-12T17:26:47.699 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-12T17:26:47.742 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install rbd-fuse 2024-09-12T17:26:48.308 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:45 ago on Thu 12 Sep 2024 05:25:03 PM UTC. 2024-09-12T17:26:48.442 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-12T17:26:48.443 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:26:48.443 INFO:teuthology.orchestra.run.smithi170.stdout: Package Architecture Version Repository Size 2024-09-12T17:26:48.443 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:26:48.443 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-12T17:26:48.444 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-fuse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 85 k 2024-09-12T17:26:48.444 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:48.444 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-12T17:26:48.444 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:26:48.444 INFO:teuthology.orchestra.run.smithi170.stdout:Install 1 Package 2024-09-12T17:26:48.444 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:48.444 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 85 k 2024-09-12T17:26:48.444 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 231 k 2024-09-12T17:26:48.444 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-12T17:26:48.688 INFO:teuthology.orchestra.run.smithi170.stdout:rbd-fuse-19.3.0-4762.gbad475c1.el9.x86_64.rpm 350 kB/s | 85 kB 00:00 2024-09-12T17:26:48.688 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:26:48.689 INFO:teuthology.orchestra.run.smithi170.stdout:Total 348 kB/s | 85 kB 00:00 2024-09-12T17:26:48.689 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-12T17:26:48.695 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-12T17:26:48.696 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-12T17:26:48.758 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-12T17:26:48.759 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-12T17:26:48.900 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-12T17:26:48.945 INFO:teuthology.orchestra.run.smithi047.stdout:rbd-mirror-19.3.0-4762.gbad475c1.el9.x86_64.rpm 2.5 MB/s | 3.2 MB 00:01 2024-09-12T17:26:48.946 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:26:48.947 INFO:teuthology.orchestra.run.smithi047.stdout:Total 2.5 MB/s | 3.2 MB 00:01 2024-09-12T17:26:48.947 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-12T17:26:48.958 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-12T17:26:48.958 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-12T17:26:49.001 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-12T17:26:49.046 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-12T17:26:49.047 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-12T17:26:49.438 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-12T17:26:49.513 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-12T17:26:49.571 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-12T17:26:49.599 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-12T17:26:49.599 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:26:49.599 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T17:26:49.599 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T17:26:49.599 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T17:26:49.599 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:49.719 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-12T17:26:49.719 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:49.719 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-12T17:26:49.719 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:26:49.720 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:49.720 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-12T17:26:49.982 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install rbd-mirror 2024-09-12T17:26:50.565 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:47 ago on Thu 12 Sep 2024 05:25:03 PM UTC. 2024-09-12T17:26:50.705 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-12T17:26:50.706 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:26:50.706 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repo Size 2024-09-12T17:26:50.706 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:26:50.706 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-12T17:26:50.706 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-mirror x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.2 M 2024-09-12T17:26:50.706 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:50.706 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-12T17:26:50.706 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:26:50.706 INFO:teuthology.orchestra.run.smithi170.stdout:Install 1 Package 2024-09-12T17:26:50.706 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:50.706 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 3.2 M 2024-09-12T17:26:50.706 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 14 M 2024-09-12T17:26:50.707 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-12T17:26:50.796 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-12T17:26:50.796 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:50.796 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-12T17:26:50.796 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:26:50.796 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:50.796 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T17:26:51.000 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install rbd-nbd 2024-09-12T17:26:51.525 INFO:teuthology.orchestra.run.smithi170.stdout:rbd-mirror-19.3.0-4762.gbad475c1.el9.x86_64.rpm 3.9 MB/s | 3.2 MB 00:00 2024-09-12T17:26:51.525 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:26:51.526 INFO:teuthology.orchestra.run.smithi170.stdout:Total 3.9 MB/s | 3.2 MB 00:00 2024-09-12T17:26:51.526 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-12T17:26:51.534 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-12T17:26:51.535 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-12T17:26:51.604 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:51 ago on Thu 12 Sep 2024 05:25:00 PM UTC. 2024-09-12T17:26:51.616 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-12T17:26:51.616 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-12T17:26:51.745 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-12T17:26:51.745 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:26:51.746 INFO:teuthology.orchestra.run.smithi047.stdout: Package Architecture Version Repository Size 2024-09-12T17:26:51.746 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:26:51.746 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-12T17:26:51.746 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-nbd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 170 k 2024-09-12T17:26:51.746 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:51.746 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-12T17:26:51.746 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-12T17:26:51.746 INFO:teuthology.orchestra.run.smithi047.stdout:Install 1 Package 2024-09-12T17:26:51.746 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:51.746 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 170 k 2024-09-12T17:26:51.746 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 490 k 2024-09-12T17:26:51.746 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-12T17:26:51.958 INFO:teuthology.orchestra.run.smithi047.stdout:rbd-nbd-19.3.0-4762.gbad475c1.el9.x86_64.rpm 807 kB/s | 170 kB 00:00 2024-09-12T17:26:51.958 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:26:51.958 INFO:teuthology.orchestra.run.smithi047.stdout:Total 801 kB/s | 170 kB 00:00 2024-09-12T17:26:51.959 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-12T17:26:51.967 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-12T17:26:51.967 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-12T17:26:52.034 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-12T17:26:52.035 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-12T17:26:52.054 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-12T17:26:52.109 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-12T17:26:52.135 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-12T17:26:52.135 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:26:52.135 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T17:26:52.135 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T17:26:52.135 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T17:26:52.136 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:52.192 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-12T17:26:52.300 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-12T17:26:52.694 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-12T17:26:52.976 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-12T17:26:52.976 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:52.977 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-12T17:26:52.977 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:26:52.977 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:52.977 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-12T17:26:53.277 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-12T17:26:53.277 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:53.277 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-12T17:26:53.277 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:26:53.277 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:53.277 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-12T17:26:53.349 DEBUG:teuthology.parallel:result is None 2024-09-12T17:26:53.487 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install rbd-nbd 2024-09-12T17:26:54.075 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:51 ago on Thu 12 Sep 2024 05:25:03 PM UTC. 2024-09-12T17:26:54.210 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-12T17:26:54.211 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:26:54.211 INFO:teuthology.orchestra.run.smithi170.stdout: Package Architecture Version Repository Size 2024-09-12T17:26:54.211 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:26:54.211 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-12T17:26:54.211 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-nbd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 170 k 2024-09-12T17:26:54.211 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:54.211 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-12T17:26:54.211 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-12T17:26:54.211 INFO:teuthology.orchestra.run.smithi170.stdout:Install 1 Package 2024-09-12T17:26:54.211 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:54.211 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 170 k 2024-09-12T17:26:54.211 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 490 k 2024-09-12T17:26:54.212 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-12T17:26:54.429 INFO:teuthology.orchestra.run.smithi170.stdout:rbd-nbd-19.3.0-4762.gbad475c1.el9.x86_64.rpm 785 kB/s | 170 kB 00:00 2024-09-12T17:26:54.430 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:26:54.430 INFO:teuthology.orchestra.run.smithi170.stdout:Total 779 kB/s | 170 kB 00:00 2024-09-12T17:26:54.430 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-12T17:26:54.438 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-12T17:26:54.438 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-12T17:26:54.501 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-12T17:26:54.501 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-12T17:26:54.651 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-12T17:26:54.751 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-12T17:26:55.253 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-12T17:26:55.506 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-12T17:26:55.506 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:55.506 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-12T17:26:55.506 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:26:55.506 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:55.506 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-12T17:26:55.760 DEBUG:teuthology.parallel:result is None 2024-09-12T17:26:55.761 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:26:55.909 DEBUG:teuthology.orchestra.run.smithi047:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T17:26:55.935 INFO:teuthology.orchestra.run.smithi047.stdout:19.3.0-4762.gbad475c1.el9 2024-09-12T17:26:55.935 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4762.gbad475c1.el9 2024-09-12T17:26:55.935 INFO:teuthology.task.install:The correct ceph version 19.3.0-4762.gbad475c1 is installed. 2024-09-12T17:26:55.937 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:26:56.080 DEBUG:teuthology.orchestra.run.smithi170:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T17:26:56.102 INFO:teuthology.orchestra.run.smithi170.stdout:19.3.0-4762.gbad475c1.el9 2024-09-12T17:26:56.102 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4762.gbad475c1.el9 2024-09-12T17:26:56.102 INFO:teuthology.task.install:The correct ceph version 19.3.0-4762.gbad475c1 is installed. 2024-09-12T17:26:56.104 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T17:26:56.105 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T17:26:56.105 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T17:26:56.137 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-12T17:26:56.137 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T17:26:56.173 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T17:26:56.173 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T17:26:56.173 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T17:26:56.207 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T17:26:56.276 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-12T17:26:56.276 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T17:26:56.301 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T17:26:56.366 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T17:26:56.366 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T17:26:56.366 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T17:26:56.395 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T17:26:56.465 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-12T17:26:56.465 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T17:26:56.489 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T17:26:56.555 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T17:26:56.555 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T17:26:56.555 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T17:26:56.582 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T17:26:56.649 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-12T17:26:56.649 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T17:26:56.674 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T17:26:56.738 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T17:26:56.822 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T17:26:56.822 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 777 /var/log/ceph 2024-09-12T17:26:56.824 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 777 /var/log/ceph 2024-09-12T17:26:56.853 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T17:26:56.853 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T17:26:56.896 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T17:26:56.921 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T17:26:56.922 DEBUG:teuthology.orchestra.run.smithi047:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T17:26:56.964 DEBUG:teuthology.orchestra.run.smithi170:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T17:26:56.999 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T17:26:56.999 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T17:26:56.999 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902730', 'branch': 'wip-rgw-meta-handlers', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_latest}}', 'email': None, 'first_in_suite': False, 'job_id': '7902730', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-rgw-meta-handlers'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, 'rgw': {'ec-data-pool': False, 'frontend': 'beast'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rgw-meta-handlers', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 6279, 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-rgw-meta-handlers', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'targets': {'smithi047.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNpt94jTAvk548Qv10Wlrp3QvdwDRVGL2ul6gNFCbwq3Ga6+1KB0RXg1V/d+9AMTLFj6DBuLFkKpWn9HWry8+ss=', 'smithi170.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDvm+GbliKohzBizMJXShp03WXLAIU3nzVHNQ/YdHGTx5Aw3m1tKCV7pbulbUIbx/ZNUfzee9yBy+s2dRZehzJI='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-12_15:39:52', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T17:26:57.000 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T17:26:57.033 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T17:26:57.049 DEBUG:teuthology.orchestra.run.smithi047:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T17:26:57.092 DEBUG:teuthology.orchestra.run.smithi170:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T17:26:57.117 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T17:26:57.118 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T17:26:57.176 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T17:26:57.176 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_1 2024-09-12T17:26:57.234 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T17:26:57.234 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:26:57.234 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-12T17:26:57.234 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:26:57.234 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:26:57.234 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-09-12 17:26:49.853269022 +0000 2024-09-12T17:26:57.234 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-09-12 17:24:22.924368160 +0000 2024-09-12T17:26:57.234 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-09-12 17:24:22.924368160 +0000 2024-09-12T17:26:57.234 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-09-12 17:24:22.924368160 +0000 2024-09-12T17:26:57.235 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T17:26:57.301 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-09-12T17:26:57.302 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-09-12T17:26:57.302 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000117039 s, 4.4 MB/s 2024-09-12T17:26:57.303 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T17:26:57.362 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_2 2024-09-12T17:26:57.419 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T17:26:57.420 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:26:57.420 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-12T17:26:57.420 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:26:57.420 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:26:57.420 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-09-12 17:26:49.854269000 +0000 2024-09-12T17:26:57.420 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-09-12 17:24:23.247361039 +0000 2024-09-12T17:26:57.420 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-09-12 17:24:23.247361039 +0000 2024-09-12T17:26:57.420 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-09-12 17:24:23.247361039 +0000 2024-09-12T17:26:57.420 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T17:26:57.486 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-09-12T17:26:57.487 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-09-12T17:26:57.487 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000111136 s, 4.6 MB/s 2024-09-12T17:26:57.488 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T17:26:57.547 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_3 2024-09-12T17:26:57.605 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T17:26:57.605 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:26:57.605 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-12T17:26:57.606 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:26:57.606 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:26:57.606 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-09-12 17:26:49.854269000 +0000 2024-09-12T17:26:57.606 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-09-12 17:24:23.567353983 +0000 2024-09-12T17:26:57.606 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-09-12 17:24:23.567353983 +0000 2024-09-12T17:26:57.606 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-09-12 17:24:23.567353983 +0000 2024-09-12T17:26:57.606 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T17:26:57.672 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-09-12T17:26:57.672 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-09-12T17:26:57.673 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000111859 s, 4.6 MB/s 2024-09-12T17:26:57.674 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T17:26:57.732 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_4 2024-09-12T17:26:57.790 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T17:26:57.791 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:26:57.791 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-12T17:26:57.791 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:26:57.791 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:26:57.791 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-09-12 17:26:49.854269000 +0000 2024-09-12T17:26:57.791 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-09-12 17:24:23.893346795 +0000 2024-09-12T17:26:57.791 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-09-12 17:24:23.893346795 +0000 2024-09-12T17:26:57.791 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-09-12 17:24:23.893346795 +0000 2024-09-12T17:26:57.791 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T17:26:57.857 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-09-12T17:26:57.857 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-09-12T17:26:57.857 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000109249 s, 4.7 MB/s 2024-09-12T17:26:57.859 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T17:26:57.917 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-12T17:26:57.918 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-12T17:26:57.918 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T17:26:57.936 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T17:26:57.936 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_1 2024-09-12T17:26:57.993 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T17:26:57.993 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:26:57.993 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-12T17:26:57.993 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:26:57.993 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:26:57.994 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-09-12 17:26:52.381624300 +0000 2024-09-12T17:26:57.994 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-09-12 17:24:14.649607530 +0000 2024-09-12T17:26:57.994 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-09-12 17:24:14.649607530 +0000 2024-09-12T17:26:57.994 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-09-12 17:24:14.649607530 +0000 2024-09-12T17:26:57.994 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T17:26:58.058 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-09-12T17:26:58.058 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-09-12T17:26:58.058 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000115918 s, 4.4 MB/s 2024-09-12T17:26:58.060 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T17:26:58.118 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_2 2024-09-12T17:26:58.174 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T17:26:58.174 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:26:58.174 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-12T17:26:58.174 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:26:58.175 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:26:58.175 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-09-12 17:26:52.381624300 +0000 2024-09-12T17:26:58.175 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-09-12 17:24:14.964600041 +0000 2024-09-12T17:26:58.175 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-09-12 17:24:14.964600041 +0000 2024-09-12T17:26:58.175 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-09-12 17:24:14.964600041 +0000 2024-09-12T17:26:58.175 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T17:26:58.239 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-09-12T17:26:58.239 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-09-12T17:26:58.239 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000108776 s, 4.7 MB/s 2024-09-12T17:26:58.241 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T17:26:58.298 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_3 2024-09-12T17:26:58.354 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T17:26:58.354 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:26:58.354 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-12T17:26:58.354 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:26:58.354 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:26:58.354 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-09-12 17:26:52.382624276 +0000 2024-09-12T17:26:58.354 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-09-12 17:24:15.283592457 +0000 2024-09-12T17:26:58.355 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-09-12 17:24:15.283592457 +0000 2024-09-12T17:26:58.355 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-09-12 17:24:15.283592457 +0000 2024-09-12T17:26:58.355 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T17:26:58.418 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-09-12T17:26:58.418 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-09-12T17:26:58.418 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 8.5997e-05 s, 6.0 MB/s 2024-09-12T17:26:58.419 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T17:26:58.476 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_4 2024-09-12T17:26:58.532 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T17:26:58.533 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:26:58.533 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-12T17:26:58.533 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:26:58.533 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:26:58.533 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-09-12 17:26:52.382624276 +0000 2024-09-12T17:26:58.533 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-09-12 17:24:15.601584896 +0000 2024-09-12T17:26:58.533 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-09-12 17:24:15.601584896 +0000 2024-09-12T17:26:58.533 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-09-12 17:24:15.601584896 +0000 2024-09-12T17:26:58.534 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T17:26:58.596 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-09-12T17:26:58.596 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-09-12T17:26:58.597 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000102416 s, 5.0 MB/s 2024-09-12T17:26:58.598 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T17:26:58.654 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-12T17:26:58.655 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi047.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi170.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-12T17:26:58.655 INFO:tasks.ceph:Generating config... 2024-09-12T17:26:58.656 INFO:tasks.ceph:[client] debug ms = 1 2024-09-12T17:26:58.656 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-09-12T17:26:58.656 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-12T17:26:58.656 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-12T17:26:58.656 INFO:tasks.ceph:[client] setuser = ceph 2024-09-12T17:26:58.656 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T17:26:58.656 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-12T17:26:58.657 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-12T17:26:58.657 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-12T17:26:58.657 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-12T17:26:58.657 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T17:26:58.657 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T17:26:58.657 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T17:26:58.657 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T17:26:58.657 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T17:26:58.657 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T17:26:58.657 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T17:26:58.657 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T17:26:58.657 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T17:26:58.657 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T17:26:58.658 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T17:26:58.658 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T17:26:58.658 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T17:26:58.658 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T17:26:58.658 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T17:26:58.658 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T17:26:58.658 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T17:26:58.658 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T17:26:58.714 INFO:teuthology.orchestra.run.smithi047.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T17:26:58.717 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T17:26:58.765 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T17:26:58.792 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.47')] 2024-09-12T17:26:58.792 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.47'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-09-12T17:26:58.793 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T17:26:58.793 DEBUG:teuthology.orchestra.run.smithi047:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T17:26:58.849 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.47 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:26:58.930 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:58.994 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:58.995 INFO:teuthology.orchestra.run.smithi047.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:26:58.995 INFO:teuthology.orchestra.run.smithi047.stdout:monmaptool: generated fsid e43073ba-e4e6-405e-a192-e8c972c1bee5 2024-09-12T17:26:58.995 INFO:teuthology.orchestra.run.smithi047.stdout:setting min_mon_release = quincy 2024-09-12T17:26:58.996 INFO:teuthology.orchestra.run.smithi047.stdout:epoch 0 2024-09-12T17:26:58.996 INFO:teuthology.orchestra.run.smithi047.stdout:fsid e43073ba-e4e6-405e-a192-e8c972c1bee5 2024-09-12T17:26:58.996 INFO:teuthology.orchestra.run.smithi047.stdout:last_changed 2024-09-12T17:26:58.931030+0000 2024-09-12T17:26:58.996 INFO:teuthology.orchestra.run.smithi047.stdout:created 2024-09-12T17:26:58.931030+0000 2024-09-12T17:26:58.996 INFO:teuthology.orchestra.run.smithi047.stdout:min_mon_release 17 (quincy) 2024-09-12T17:26:58.996 INFO:teuthology.orchestra.run.smithi047.stdout:election_strategy: 1 2024-09-12T17:26:58.996 INFO:teuthology.orchestra.run.smithi047.stdout:0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-09-12T17:26:58.996 INFO:teuthology.orchestra.run.smithi047.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-12T17:26:58.997 DEBUG:teuthology.orchestra.run.smithi047:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T17:26:59.052 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e43073ba-e4e6-405e-a192-e8c972c1bee5... 2024-09-12T17:26:59.053 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T17:26:59.096 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T17:26:59.138 INFO:teuthology.orchestra.run.smithi047.stdout:[global] 2024-09-12T17:26:59.139 INFO:teuthology.orchestra.run.smithi047.stdout: chdir = "" 2024-09-12T17:26:59.139 INFO:teuthology.orchestra.run.smithi047.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T17:26:59.139 INFO:teuthology.orchestra.run.smithi047.stdout: auth supported = cephx 2024-09-12T17:26:59.139 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:59.139 INFO:teuthology.orchestra.run.smithi047.stdout: filestore xattr use omap = true 2024-09-12T17:26:59.139 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:59.139 INFO:teuthology.orchestra.run.smithi047.stdout: mon clock drift allowed = 1.000 2024-09-12T17:26:59.139 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:59.139 INFO:teuthology.orchestra.run.smithi047.stdout: osd crush chooseleaf type = 0 2024-09-12T17:26:59.139 INFO:teuthology.orchestra.run.smithi047.stdout: auth debug = true 2024-09-12T17:26:59.139 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:59.139 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on old message = true 2024-09-12T17:26:59.139 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on bug = true 2024-09-12T17:26:59.140 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:59.140 INFO:teuthology.orchestra.run.smithi047.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T17:26:59.140 INFO:teuthology.orchestra.run.smithi047.stdout: mon pg warn max object skew = 0 2024-09-12T17:26:59.140 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:59.140 INFO:teuthology.orchestra.run.smithi047.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T17:26:59.140 INFO:teuthology.orchestra.run.smithi047.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T17:26:59.140 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:59.140 INFO:teuthology.orchestra.run.smithi047.stdout: osd pool default size = 2 2024-09-12T17:26:59.140 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:59.140 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd allow primary affinity = true 2024-09-12T17:26:59.140 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd allow pg remap = true 2024-09-12T17:26:59.140 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on legacy crush tunables = false 2024-09-12T17:26:59.140 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on crush straw calc version zero = false 2024-09-12T17:26:59.140 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on no sortbitwise = false 2024-09-12T17:26:59.141 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on osd down out interval zero = false 2024-09-12T17:26:59.141 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on too few osds = false 2024-09-12T17:26:59.141 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T17:26:59.141 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T17:26:59.141 INFO:teuthology.orchestra.run.smithi047.stdout: mon_allow_pool_size_one = true 2024-09-12T17:26:59.141 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:59.141 INFO:teuthology.orchestra.run.smithi047.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T17:26:59.141 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:59.141 INFO:teuthology.orchestra.run.smithi047.stdout: osd default data pool replay window = 5 2024-09-12T17:26:59.142 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:59.142 INFO:teuthology.orchestra.run.smithi047.stdout: mon allow pool delete = true 2024-09-12T17:26:59.142 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:59.142 INFO:teuthology.orchestra.run.smithi047.stdout: mon cluster log file level = debug 2024-09-12T17:26:59.142 INFO:teuthology.orchestra.run.smithi047.stdout: debug asserts on shutdown = true 2024-09-12T17:26:59.142 INFO:teuthology.orchestra.run.smithi047.stdout: mon health detail to clog = false 2024-09-12T17:26:59.143 INFO:teuthology.orchestra.run.smithi047.stdout: mon host = 172.21.15.47 2024-09-12T17:26:59.143 INFO:teuthology.orchestra.run.smithi047.stdout: fsid = e43073ba-e4e6-405e-a192-e8c972c1bee5 2024-09-12T17:26:59.143 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:59.143 INFO:teuthology.orchestra.run.smithi047.stdout:[osd] 2024-09-12T17:26:59.143 INFO:teuthology.orchestra.run.smithi047.stdout: osd journal size = 100 2024-09-12T17:26:59.143 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:59.143 INFO:teuthology.orchestra.run.smithi047.stdout: osd scrub load threshold = 5.0 2024-09-12T17:26:59.143 INFO:teuthology.orchestra.run.smithi047.stdout: osd scrub max interval = 600 2024-09-12T17:26:59.143 INFO:teuthology.orchestra.run.smithi047.stdout: osd mclock profile = high_recovery_ops 2024-09-12T17:26:59.143 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:59.143 INFO:teuthology.orchestra.run.smithi047.stdout: osd recover clone overlap = true 2024-09-12T17:26:59.143 INFO:teuthology.orchestra.run.smithi047.stdout: osd recovery max chunk = 1048576 2024-09-12T17:26:59.143 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:59.144 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug shutdown = true 2024-09-12T17:26:59.144 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug op order = true 2024-09-12T17:26:59.144 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug verify stray on activate = true 2024-09-12T17:26:59.144 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug trim objects = true 2024-09-12T17:26:59.144 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:59.144 INFO:teuthology.orchestra.run.smithi047.stdout: osd open classes on start = true 2024-09-12T17:26:59.144 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug pg log writeout = true 2024-09-12T17:26:59.144 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:59.144 INFO:teuthology.orchestra.run.smithi047.stdout: osd deep scrub update digest min age = 30 2024-09-12T17:26:59.144 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:59.144 INFO:teuthology.orchestra.run.smithi047.stdout: osd map max advance = 10 2024-09-12T17:26:59.144 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:59.144 INFO:teuthology.orchestra.run.smithi047.stdout: journal zero on create = true 2024-09-12T17:26:59.145 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:59.145 INFO:teuthology.orchestra.run.smithi047.stdout: filestore ondisk finisher threads = 3 2024-09-12T17:26:59.145 INFO:teuthology.orchestra.run.smithi047.stdout: filestore apply finisher threads = 3 2024-09-12T17:26:59.145 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:59.145 INFO:teuthology.orchestra.run.smithi047.stdout: bdev debug aio = true 2024-09-12T17:26:59.145 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug misdirected ops = true 2024-09-12T17:26:59.145 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-09-12T17:26:59.145 INFO:teuthology.orchestra.run.smithi047.stdout: debug objclass = 20 2024-09-12T17:26:59.145 INFO:teuthology.orchestra.run.smithi047.stdout: bdev async discard = True 2024-09-12T17:26:59.145 INFO:teuthology.orchestra.run.smithi047.stdout: bdev enable discard = True 2024-09-12T17:26:59.145 INFO:teuthology.orchestra.run.smithi047.stdout: bluestore allocator = bitmap 2024-09-12T17:26:59.145 INFO:teuthology.orchestra.run.smithi047.stdout: bluestore block size = 96636764160 2024-09-12T17:26:59.145 INFO:teuthology.orchestra.run.smithi047.stdout: bluestore fsck on mount = True 2024-09-12T17:26:59.146 INFO:teuthology.orchestra.run.smithi047.stdout: debug bluefs = 1/20 2024-09-12T17:26:59.146 INFO:teuthology.orchestra.run.smithi047.stdout: debug bluestore = 1/20 2024-09-12T17:26:59.146 INFO:teuthology.orchestra.run.smithi047.stdout: debug osd = 20 2024-09-12T17:26:59.146 INFO:teuthology.orchestra.run.smithi047.stdout: debug rocksdb = 4/10 2024-09-12T17:26:59.146 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T17:26:59.146 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd full ratio = 0.9 2024-09-12T17:26:59.146 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd nearfull ratio = 0.8 2024-09-12T17:26:59.146 INFO:teuthology.orchestra.run.smithi047.stdout: osd failsafe full ratio = 0.95 2024-09-12T17:26:59.146 INFO:teuthology.orchestra.run.smithi047.stdout: osd objectstore = bluestore 2024-09-12T17:26:59.146 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:59.146 INFO:teuthology.orchestra.run.smithi047.stdout:[mgr] 2024-09-12T17:26:59.146 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-09-12T17:26:59.146 INFO:teuthology.orchestra.run.smithi047.stdout: debug mgr = 20 2024-09-12T17:26:59.147 INFO:teuthology.orchestra.run.smithi047.stdout: debug mon = 20 2024-09-12T17:26:59.147 INFO:teuthology.orchestra.run.smithi047.stdout: debug auth = 20 2024-09-12T17:26:59.147 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:26:59.147 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:26:59.147 INFO:teuthology.orchestra.run.smithi047.stdout: mgr/telemetry/nag = false 2024-09-12T17:26:59.147 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:59.147 INFO:teuthology.orchestra.run.smithi047.stdout:[mon] 2024-09-12T17:26:59.147 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-09-12T17:26:59.147 INFO:teuthology.orchestra.run.smithi047.stdout: debug mon = 20 2024-09-12T17:26:59.147 INFO:teuthology.orchestra.run.smithi047.stdout: debug paxos = 20 2024-09-12T17:26:59.147 INFO:teuthology.orchestra.run.smithi047.stdout: debug auth = 20 2024-09-12T17:26:59.147 INFO:teuthology.orchestra.run.smithi047.stdout: mon data avail warn = 5 2024-09-12T17:26:59.147 INFO:teuthology.orchestra.run.smithi047.stdout: mon mgr mkfs grace = 240 2024-09-12T17:26:59.147 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:26:59.148 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd reporter subtree level = osd 2024-09-12T17:26:59.148 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd prime pg temp = true 2024-09-12T17:26:59.148 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:26:59.148 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:59.148 INFO:teuthology.orchestra.run.smithi047.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T17:26:59.148 INFO:teuthology.orchestra.run.smithi047.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T17:26:59.148 INFO:teuthology.orchestra.run.smithi047.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T17:26:59.148 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:59.148 INFO:teuthology.orchestra.run.smithi047.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T17:26:59.148 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T17:26:59.148 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T17:26:59.148 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:59.148 INFO:teuthology.orchestra.run.smithi047.stdout: # 1m isn't quite enough 2024-09-12T17:26:59.149 INFO:teuthology.orchestra.run.smithi047.stdout: mon_down_mkfs_grace = 2m 2024-09-12T17:26:59.149 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:59.149 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_filestore_osds = false 2024-09-12T17:26:59.149 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:26:59.149 INFO:teuthology.orchestra.run.smithi047.stdout:[client] 2024-09-12T17:26:59.149 INFO:teuthology.orchestra.run.smithi047.stdout: rgw cache enabled = true 2024-09-12T17:26:59.149 INFO:teuthology.orchestra.run.smithi047.stdout: rgw enable ops log = true 2024-09-12T17:26:59.149 INFO:teuthology.orchestra.run.smithi047.stdout: rgw enable usage log = true 2024-09-12T17:26:59.149 INFO:teuthology.orchestra.run.smithi047.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T17:26:59.149 INFO:teuthology.orchestra.run.smithi047.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T17:26:59.149 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-09-12T17:26:59.149 INFO:teuthology.orchestra.run.smithi047.stdout: rgw gc obj min wait = 15 2024-09-12T17:26:59.149 INFO:teuthology.orchestra.run.smithi047.stdout: debug rgw = 20 2024-09-12T17:26:59.149 INFO:teuthology.orchestra.run.smithi047.stdout: setgroup = ceph 2024-09-12T17:26:59.149 INFO:teuthology.orchestra.run.smithi047.stdout: setuser = ceph 2024-09-12T17:26:59.150 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.a] 2024-09-12T17:26:59.150 INFO:teuthology.orchestra.run.smithi170.stdout:[global] 2024-09-12T17:26:59.150 INFO:teuthology.orchestra.run.smithi170.stdout: chdir = "" 2024-09-12T17:26:59.150 INFO:teuthology.orchestra.run.smithi170.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T17:26:59.150 INFO:teuthology.orchestra.run.smithi170.stdout: auth supported = cephx 2024-09-12T17:26:59.150 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:59.150 INFO:teuthology.orchestra.run.smithi170.stdout: filestore xattr use omap = true 2024-09-12T17:26:59.150 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:59.150 INFO:teuthology.orchestra.run.smithi170.stdout: mon clock drift allowed = 1.000 2024-09-12T17:26:59.151 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:59.151 INFO:teuthology.orchestra.run.smithi170.stdout: osd crush chooseleaf type = 0 2024-09-12T17:26:59.151 INFO:teuthology.orchestra.run.smithi170.stdout: auth debug = true 2024-09-12T17:26:59.151 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:59.151 INFO:teuthology.orchestra.run.smithi170.stdout: ms die on old message = true 2024-09-12T17:26:59.151 INFO:teuthology.orchestra.run.smithi170.stdout: ms die on bug = true 2024-09-12T17:26:59.151 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:59.151 INFO:teuthology.orchestra.run.smithi170.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T17:26:59.151 INFO:teuthology.orchestra.run.smithi170.stdout: mon pg warn max object skew = 0 2024-09-12T17:26:59.151 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:59.151 INFO:teuthology.orchestra.run.smithi170.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T17:26:59.151 INFO:teuthology.orchestra.run.smithi170.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T17:26:59.151 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:59.152 INFO:teuthology.orchestra.run.smithi170.stdout: osd pool default size = 2 2024-09-12T17:26:59.152 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:59.152 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd allow primary affinity = true 2024-09-12T17:26:59.152 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd allow pg remap = true 2024-09-12T17:26:59.152 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on legacy crush tunables = false 2024-09-12T17:26:59.152 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on crush straw calc version zero = false 2024-09-12T17:26:59.152 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on no sortbitwise = false 2024-09-12T17:26:59.152 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on osd down out interval zero = false 2024-09-12T17:26:59.152 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on too few osds = false 2024-09-12T17:26:59.152 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T17:26:59.152 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T17:26:59.152 INFO:teuthology.orchestra.run.smithi170.stdout: mon_allow_pool_size_one = true 2024-09-12T17:26:59.152 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:59.153 INFO:teuthology.orchestra.run.smithi170.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T17:26:59.153 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:59.153 INFO:teuthology.orchestra.run.smithi170.stdout: osd default data pool replay window = 5 2024-09-12T17:26:59.153 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:59.153 INFO:teuthology.orchestra.run.smithi170.stdout: mon allow pool delete = true 2024-09-12T17:26:59.153 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:59.153 INFO:teuthology.orchestra.run.smithi170.stdout: mon cluster log file level = debug 2024-09-12T17:26:59.153 INFO:teuthology.orchestra.run.smithi170.stdout: debug asserts on shutdown = true 2024-09-12T17:26:59.153 INFO:teuthology.orchestra.run.smithi170.stdout: mon health detail to clog = false 2024-09-12T17:26:59.153 INFO:teuthology.orchestra.run.smithi170.stdout: mon host = 172.21.15.47 2024-09-12T17:26:59.153 INFO:teuthology.orchestra.run.smithi170.stdout: fsid = e43073ba-e4e6-405e-a192-e8c972c1bee5 2024-09-12T17:26:59.153 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:59.153 INFO:teuthology.orchestra.run.smithi170.stdout:[osd] 2024-09-12T17:26:59.154 INFO:teuthology.orchestra.run.smithi170.stdout: osd journal size = 100 2024-09-12T17:26:59.154 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:59.154 INFO:teuthology.orchestra.run.smithi170.stdout: osd scrub load threshold = 5.0 2024-09-12T17:26:59.154 INFO:teuthology.orchestra.run.smithi170.stdout: osd scrub max interval = 600 2024-09-12T17:26:59.154 INFO:teuthology.orchestra.run.smithi170.stdout: osd mclock profile = high_recovery_ops 2024-09-12T17:26:59.154 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:59.154 INFO:teuthology.orchestra.run.smithi170.stdout: osd recover clone overlap = true 2024-09-12T17:26:59.154 INFO:teuthology.orchestra.run.smithi170.stdout: osd recovery max chunk = 1048576 2024-09-12T17:26:59.154 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:59.154 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug shutdown = true 2024-09-12T17:26:59.154 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug op order = true 2024-09-12T17:26:59.154 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug verify stray on activate = true 2024-09-12T17:26:59.154 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug trim objects = true 2024-09-12T17:26:59.154 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:59.155 INFO:teuthology.orchestra.run.smithi170.stdout: osd open classes on start = true 2024-09-12T17:26:59.155 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug pg log writeout = true 2024-09-12T17:26:59.155 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:59.155 INFO:teuthology.orchestra.run.smithi170.stdout: osd deep scrub update digest min age = 30 2024-09-12T17:26:59.155 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:59.155 INFO:teuthology.orchestra.run.smithi170.stdout: osd map max advance = 10 2024-09-12T17:26:59.155 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:59.155 INFO:teuthology.orchestra.run.smithi170.stdout: journal zero on create = true 2024-09-12T17:26:59.155 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:59.155 INFO:teuthology.orchestra.run.smithi170.stdout: filestore ondisk finisher threads = 3 2024-09-12T17:26:59.155 INFO:teuthology.orchestra.run.smithi170.stdout: filestore apply finisher threads = 3 2024-09-12T17:26:59.155 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:59.155 INFO:teuthology.orchestra.run.smithi170.stdout: bdev debug aio = true 2024-09-12T17:26:59.156 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug misdirected ops = true 2024-09-12T17:26:59.156 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-09-12T17:26:59.156 INFO:teuthology.orchestra.run.smithi170.stdout: debug objclass = 20 2024-09-12T17:26:59.156 INFO:teuthology.orchestra.run.smithi170.stdout: bdev async discard = True 2024-09-12T17:26:59.156 INFO:teuthology.orchestra.run.smithi170.stdout: bdev enable discard = True 2024-09-12T17:26:59.156 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore allocator = bitmap 2024-09-12T17:26:59.156 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore block size = 96636764160 2024-09-12T17:26:59.156 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore fsck on mount = True 2024-09-12T17:26:59.156 INFO:teuthology.orchestra.run.smithi170.stdout: debug bluefs = 1/20 2024-09-12T17:26:59.156 INFO:teuthology.orchestra.run.smithi170.stdout: debug bluestore = 1/20 2024-09-12T17:26:59.156 INFO:teuthology.orchestra.run.smithi170.stdout: debug osd = 20 2024-09-12T17:26:59.157 INFO:teuthology.orchestra.run.smithi170.stdout: debug rocksdb = 4/10 2024-09-12T17:26:59.157 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T17:26:59.157 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd full ratio = 0.9 2024-09-12T17:26:59.157 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd nearfull ratio = 0.8 2024-09-12T17:26:59.157 INFO:teuthology.orchestra.run.smithi170.stdout: osd failsafe full ratio = 0.95 2024-09-12T17:26:59.157 INFO:teuthology.orchestra.run.smithi170.stdout: osd objectstore = bluestore 2024-09-12T17:26:59.157 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:59.157 INFO:teuthology.orchestra.run.smithi170.stdout:[mgr] 2024-09-12T17:26:59.157 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-09-12T17:26:59.157 INFO:teuthology.orchestra.run.smithi170.stdout: debug mgr = 20 2024-09-12T17:26:59.157 INFO:teuthology.orchestra.run.smithi170.stdout: debug mon = 20 2024-09-12T17:26:59.157 INFO:teuthology.orchestra.run.smithi170.stdout: debug auth = 20 2024-09-12T17:26:59.157 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:26:59.157 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:26:59.158 INFO:teuthology.orchestra.run.smithi170.stdout: mgr/telemetry/nag = false 2024-09-12T17:26:59.158 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:59.158 INFO:teuthology.orchestra.run.smithi170.stdout:[mon] 2024-09-12T17:26:59.158 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-09-12T17:26:59.158 INFO:teuthology.orchestra.run.smithi170.stdout: debug mon = 20 2024-09-12T17:26:59.158 INFO:teuthology.orchestra.run.smithi170.stdout: debug paxos = 20 2024-09-12T17:26:59.158 INFO:teuthology.orchestra.run.smithi170.stdout: debug auth = 20 2024-09-12T17:26:59.158 INFO:teuthology.orchestra.run.smithi170.stdout: mon data avail warn = 5 2024-09-12T17:26:59.158 INFO:teuthology.orchestra.run.smithi170.stdout: mon mgr mkfs grace = 240 2024-09-12T17:26:59.158 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:26:59.158 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd reporter subtree level = osd 2024-09-12T17:26:59.158 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd prime pg temp = true 2024-09-12T17:26:59.158 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:26:59.159 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:59.159 INFO:teuthology.orchestra.run.smithi170.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T17:26:59.159 INFO:teuthology.orchestra.run.smithi170.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T17:26:59.159 INFO:teuthology.orchestra.run.smithi170.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T17:26:59.159 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:59.159 INFO:teuthology.orchestra.run.smithi170.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T17:26:59.159 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T17:26:59.159 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T17:26:59.159 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:59.159 INFO:teuthology.orchestra.run.smithi170.stdout: # 1m isn't quite enough 2024-09-12T17:26:59.159 INFO:teuthology.orchestra.run.smithi170.stdout: mon_down_mkfs_grace = 2m 2024-09-12T17:26:59.159 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:59.159 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_filestore_osds = false 2024-09-12T17:26:59.159 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T17:26:59.160 INFO:teuthology.orchestra.run.smithi170.stdout:[client] 2024-09-12T17:26:59.160 INFO:teuthology.orchestra.run.smithi170.stdout: rgw cache enabled = true 2024-09-12T17:26:59.160 INFO:teuthology.orchestra.run.smithi170.stdout: rgw enable ops log = true 2024-09-12T17:26:59.160 INFO:teuthology.orchestra.run.smithi170.stdout: rgw enable usage log = true 2024-09-12T17:26:59.160 INFO:teuthology.orchestra.run.smithi170.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T17:26:59.160 INFO:teuthology.orchestra.run.smithi170.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T17:26:59.160 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-09-12T17:26:59.160 INFO:teuthology.orchestra.run.smithi170.stdout: rgw gc obj min wait = 15 2024-09-12T17:26:59.160 INFO:teuthology.orchestra.run.smithi170.stdout: debug rgw = 20 2024-09-12T17:26:59.160 INFO:teuthology.orchestra.run.smithi170.stdout: setgroup = ceph 2024-09-12T17:26:59.160 INFO:teuthology.orchestra.run.smithi170.stdout: setuser = ceph 2024-09-12T17:26:59.160 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.a] 2024-09-12T17:26:59.163 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T17:26:59.163 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T17:26:59.259 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T17:26:59.259 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T17:26:59.259 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T17:26:59.275 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T17:26:59.275 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T17:26:59.330 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi047.front.sepia.ceph.com 2024-09-12T17:26:59.331 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T17:26:59.331 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T17:26:59.331 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T17:26:59.407 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T17:26:59.407 DEBUG:teuthology.orchestra.run.smithi047:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:26:59.463 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi170.front.sepia.ceph.com 2024-09-12T17:26:59.463 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-12T17:26:59.463 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T17:26:59.463 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T17:26:59.499 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-12T17:26:59.499 DEBUG:teuthology.orchestra.run.smithi170:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:26:59.554 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T17:26:59.555 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T17:26:59.555 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T17:26:59.653 INFO:teuthology.orchestra.run.smithi170.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T17:26:59.656 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T17:26:59.656 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T17:26:59.657 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T17:26:59.697 INFO:teuthology.orchestra.run.smithi170.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T17:26:59.710 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T17:26:59.710 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi047.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi170.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-12T17:26:59.710 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T17:26:59.737 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-12T17:26:59.737 INFO:tasks.ceph:role: osd.0 2024-09-12T17:26:59.738 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi047.front.sepia.ceph.com 2024-09-12T17:26:59.738 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T17:26:59.803 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:26:59.804 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:26:59.804 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:26:59.804 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T17:26:59.804 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:26:59.804 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:26:59.804 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:26:59.804 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T17:26:59.804 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:26:59.804 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:26:59.840 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-09-12T17:26:59.842 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-09-12T17:26:59.842 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T17:26:59.913 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T17:26:59.983 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:27:00.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:00.085+0000 7fad80013640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T17:27:00.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:00.085+0000 7fad80013640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T17:27:00.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:00.085+0000 7fad80013640 -1 bdev(0x55880fcdb800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T17:27:00.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:00.085+0000 7fad80013640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T17:27:03.009 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T17:27:03.040 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T17:27:03.071 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-12T17:27:03.071 INFO:tasks.ceph:role: osd.1 2024-09-12T17:27:03.071 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi170.front.sepia.ceph.com 2024-09-12T17:27:03.071 DEBUG:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T17:27:03.139 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:27:03.139 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:27:03.139 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:27:03.139 INFO:teuthology.orchestra.run.smithi170.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T17:27:03.139 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:27:03.139 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:27:03.139 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:27:03.140 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T17:27:03.140 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:27:03.140 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:27:03.171 INFO:teuthology.orchestra.run.smithi170.stdout:Discarding blocks...Done. 2024-09-12T17:27:03.174 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2024-09-12T17:27:03.174 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-12T17:27:03.250 DEBUG:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T17:27:03.319 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T17:27:03.385 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-12T17:27:03.385 INFO:tasks.ceph:role: osd.2 2024-09-12T17:27:03.385 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi170.front.sepia.ceph.com 2024-09-12T17:27:03.385 DEBUG:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T17:27:03.450 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:27:03.451 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:27:03.451 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:27:03.451 INFO:teuthology.orchestra.run.smithi170.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T17:27:03.451 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:27:03.451 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:27:03.451 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:27:03.451 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T17:27:03.451 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:27:03.451 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:27:03.483 INFO:teuthology.orchestra.run.smithi170.stdout:Discarding blocks...Done. 2024-09-12T17:27:03.485 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2024-09-12T17:27:03.486 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-09-12T17:27:03.555 DEBUG:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T17:27:03.624 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-12T17:27:03.690 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-12T17:27:03.690 INFO:tasks.ceph:role: osd.3 2024-09-12T17:27:03.690 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi170.front.sepia.ceph.com 2024-09-12T17:27:03.690 DEBUG:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T17:27:03.756 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:27:03.756 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:27:03.756 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:27:03.757 INFO:teuthology.orchestra.run.smithi170.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T17:27:03.757 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:27:03.757 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:27:03.757 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:27:03.757 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T17:27:03.757 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:27:03.757 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:27:03.789 INFO:teuthology.orchestra.run.smithi170.stdout:Discarding blocks...Done. 2024-09-12T17:27:03.791 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2024-09-12T17:27:03.791 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-09-12T17:27:03.861 DEBUG:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-12T17:27:03.931 DEBUG:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:27:04.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:04.070+0000 7f209a14b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T17:27:04.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:04.070+0000 7f209a14b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T17:27:04.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:04.070+0000 7f209a14b640 -1 bdev(0x55eedb949800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T17:27:04.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:04.071+0000 7f209a14b640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T17:27:07.490 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T17:27:07.521 DEBUG:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:27:07.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:07.611+0000 7f7e5262c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T17:27:07.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:07.611+0000 7f7e5262c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T17:27:07.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:07.611+0000 7f7e5262c640 -1 bdev(0x5614ae7c7800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T17:27:07.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:07.611+0000 7f7e5262c640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T17:27:10.778 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T17:27:10.807 DEBUG:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:27:10.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:10.900+0000 7f790dbdd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-12T17:27:10.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:10.900+0000 7f790dbdd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-12T17:27:10.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:10.900+0000 7f790dbdd640 -1 bdev(0x55e159c53800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-12T17:27:10.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:10.900+0000 7f790dbdd640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-12T17:27:14.313 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T17:27:14.344 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T17:27:14.345 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T17:27:14.345 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T17:27:14.379 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-12T17:27:14.379 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T17:27:14.415 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-12T17:27:14.415 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T17:27:14.482 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-12T17:27:14.482 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T17:27:14.546 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-12T17:27:14.547 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-12T17:27:14.612 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-12T17:27:14.612 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T17:27:14.668 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T17:27:14.668 DEBUG:teuthology.orchestra.run.smithi047:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T17:27:14.698 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.0] 2024-09-12T17:27:14.699 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQBkJONme3AkBRAA8lnskNK+Y/hTL2Gd0/Yo6w== 2024-09-12T17:27:14.699 INFO:teuthology.orchestra.run.smithi047.stdout:[mgr.x] 2024-09-12T17:27:14.699 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQBjJONmPTj2JhAAHtnCwD8rm59W6t0YGIGauQ== 2024-09-12T17:27:14.699 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.1] 2024-09-12T17:27:14.699 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQBoJONmBGRFBBAAUYSZ0DtnKUh9WQPLDoZ54A== 2024-09-12T17:27:14.699 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.2] 2024-09-12T17:27:14.699 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQBrJONmpL57JBAAJgHdV6TQiv486OscYOM1WQ== 2024-09-12T17:27:14.699 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.3] 2024-09-12T17:27:14.699 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQBuJONm0nGzNRAAoCbNsL2Mio8NPo8Hi2EWpw== 2024-09-12T17:27:14.699 INFO:teuthology.orchestra.run.smithi047.stdout:[client.0] 2024-09-12T17:27:14.699 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQBjJONmXUiMKRAAR+hNVhEOvLLCC6fJF/nD5Q== 2024-09-12T17:27:14.700 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:27:14.800 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T17:27:14.856 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:27:14.911 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:27:14.963 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:27:15.016 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T17:27:15.071 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T17:27:15.071 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T17:27:15.097 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T17:27:15.195 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T17:27:15.221 DEBUG:teuthology.orchestra.run.smithi047:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:27:15.276 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T17:27:15.277 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T17:27:15.277 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T17:27:15.319 INFO:tasks.ceph.mon.a:Started 2024-09-12T17:27:15.320 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T17:27:15.320 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T17:27:15.320 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T17:27:15.323 INFO:tasks.ceph.mgr.x:Started 2024-09-12T17:27:15.323 DEBUG:tasks.ceph:set 0 configs 2024-09-12T17:27:15.323 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T17:27:15.323 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T17:27:15.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.423+0000 7f93d228e640 1 Processor -- start 2024-09-12T17:27:15.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.424+0000 7f93d228e640 1 -- start start 2024-09-12T17:27:15.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.424+0000 7f93d228e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f93cc12f420 0x7f93cc12f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:15.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.424+0000 7f93d228e640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93cc09bd30 con 0x7f93cc12fd40 2024-09-12T17:27:15.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.424+0000 7f93d228e640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f93cc09ae70 con 0x7f93cc12f420 2024-09-12T17:27:15.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.424+0000 7f93cbfff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f93cc12f420 0x7f93cc12f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:15.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.424+0000 7f93cb7fe640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f93cc12fd40 0x7f93cc099670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49640/0 (socket says 172.21.15.47:49640) 2024-09-12T17:27:15.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.424+0000 7f93cbfff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f93cc12f420 0x7f93cc12f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59776/0 (socket says 172.21.15.47:59776) 2024-09-12T17:27:15.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.424+0000 7f93cb7fe640 1 -- 172.21.15.47:0/583250320 learned_addr learned my addr 172.21.15.47:0/583250320 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-09-12T17:27:15.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.424+0000 7f93cbfff640 1 -- 172.21.15.47:0/583250320 >> v1:172.21.15.47:6789/0 conn(0x7f93cc12fd40 legacy=0x7f93cc099670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:15.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.424+0000 7f93cbfff640 1 -- 172.21.15.47:0/583250320 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93cc099d80 con 0x7f93cc12f420 2024-09-12T17:27:15.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.426+0000 7f93cbfff640 1 --2- 172.21.15.47:0/583250320 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93cc12f420 0x7f93cc12f800 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f93bc009720 tx=0x7f93bc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9adf9aa230c644e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:15.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.426+0000 7f93caffd640 1 -- 172.21.15.47:0/583250320 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93bc037070 con 0x7f93cc12f420 2024-09-12T17:27:15.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.426+0000 7f93caffd640 1 -- 172.21.15.47:0/583250320 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93bc02ad90 con 0x7f93cc12f420 2024-09-12T17:27:15.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.426+0000 7f93caffd640 1 -- 172.21.15.47:0/583250320 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93bc032590 con 0x7f93cc12f420 2024-09-12T17:27:15.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.427+0000 7f93d228e640 1 -- 172.21.15.47:0/583250320 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93cc12f420 msgr2=0x7f93cc12f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:15.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.427+0000 7f93d228e640 1 --2- 172.21.15.47:0/583250320 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93cc12f420 0x7f93cc12f800 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f93bc009720 tx=0x7f93bc02a110 comp rx=0 tx=0).stop 2024-09-12T17:27:15.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.427+0000 7f93d228e640 1 -- 172.21.15.47:0/583250320 shutdown_connections 2024-09-12T17:27:15.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.427+0000 7f93d228e640 1 --2- 172.21.15.47:0/583250320 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93cc12f420 0x7f93cc12f800 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:15.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.427+0000 7f93d228e640 1 -- 172.21.15.47:0/583250320 >> 172.21.15.47:0/583250320 conn(0x7f93cc0a0000 msgr2=0x7f93cc0a03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:15.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.427+0000 7f93d228e640 1 -- 172.21.15.47:0/583250320 shutdown_connections 2024-09-12T17:27:15.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.427+0000 7f93d228e640 1 -- 172.21.15.47:0/583250320 wait complete. 2024-09-12T17:27:15.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.428+0000 7f93d228e640 1 Processor -- start 2024-09-12T17:27:15.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.428+0000 7f93d228e640 1 -- start start 2024-09-12T17:27:15.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.429+0000 7f93d228e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93cc12f420 0x7f93cc127670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:15.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.429+0000 7f93d228e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f93cc09a490 con 0x7f93cc12f420 2024-09-12T17:27:15.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.429+0000 7f93cbfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93cc12f420 0x7f93cc127670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:15.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.429+0000 7f93cbfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93cc12f420 0x7f93cc127670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59790/0 (socket says 172.21.15.47:59790) 2024-09-12T17:27:15.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.429+0000 7f93cbfff640 1 -- 172.21.15.47:0/447430178 learned_addr learned my addr 172.21.15.47:0/447430178 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:27:15.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.429+0000 7f93cbfff640 1 -- 172.21.15.47:0/447430178 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93cc129610 con 0x7f93cc12f420 2024-09-12T17:27:15.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.429+0000 7f93cbfff640 1 --2- 172.21.15.47:0/447430178 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93cc12f420 0x7f93cc127670 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f93bc009720 tx=0x7f93bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:15.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.429+0000 7f93c8ff9640 1 -- 172.21.15.47:0/447430178 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93bc041070 con 0x7f93cc12f420 2024-09-12T17:27:15.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.429+0000 7f93c8ff9640 1 -- 172.21.15.47:0/447430178 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93bc03c460 con 0x7f93cc12f420 2024-09-12T17:27:15.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.429+0000 7f93c8ff9640 1 -- 172.21.15.47:0/447430178 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93bc037040 con 0x7f93cc12f420 2024-09-12T17:27:15.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.429+0000 7f93d228e640 1 -- 172.21.15.47:0/447430178 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93cc12a610 con 0x7f93cc12f420 2024-09-12T17:27:15.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.429+0000 7f93d228e640 1 -- 172.21.15.47:0/447430178 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93cc127bb0 con 0x7f93cc12f420 2024-09-12T17:27:15.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.429+0000 7f93c8ff9640 1 -- 172.21.15.47:0/447430178 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f93bc044070 con 0x7f93cc12f420 2024-09-12T17:27:15.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.430+0000 7f93c8ff9640 1 -- 172.21.15.47:0/447430178 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f93bc046a50 con 0x7f93cc12f420 2024-09-12T17:27:15.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.430+0000 7f93d228e640 1 -- 172.21.15.47:0/447430178 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93cc12f800 con 0x7f93cc12f420 2024-09-12T17:27:15.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.432+0000 7f93c8ff9640 1 -- 172.21.15.47:0/447430178 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f93bc03c740 con 0x7f93cc12f420 2024-09-12T17:27:15.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.498+0000 7f93d228e640 1 -- 172.21.15.47:0/447430178 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f93cc12a0f0 con 0x7f93cc12f420 2024-09-12T17:27:15.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.499+0000 7f93c8ff9640 1 -- 172.21.15.47:0/447430178 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f93bc03c920 con 0x7f93cc12f420 2024-09-12T17:27:15.501 INFO:teuthology.orchestra.run.smithi047.stderr:adjusted tunables profile to default 2024-09-12T17:27:15.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.500+0000 7f93d228e640 1 -- 172.21.15.47:0/447430178 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93cc12f420 msgr2=0x7f93cc127670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:15.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.500+0000 7f93d228e640 1 --2- 172.21.15.47:0/447430178 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93cc12f420 0x7f93cc127670 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f93bc009720 tx=0x7f93bc0046c0 comp rx=0 tx=0).stop 2024-09-12T17:27:15.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.500+0000 7f93d228e640 1 -- 172.21.15.47:0/447430178 shutdown_connections 2024-09-12T17:27:15.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.500+0000 7f93d228e640 1 --2- 172.21.15.47:0/447430178 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93cc12f420 0x7f93cc127670 secure :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f93bc009720 tx=0x7f93bc0046c0 comp rx=0 tx=0).stop 2024-09-12T17:27:15.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.500+0000 7f93d228e640 1 -- 172.21.15.47:0/447430178 >> 172.21.15.47:0/447430178 conn(0x7f93cc0a0000 msgr2=0x7f93cc1b74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:15.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.500+0000 7f93d228e640 1 -- 172.21.15.47:0/447430178 shutdown_connections 2024-09-12T17:27:15.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:15.500+0000 7f93d228e640 1 -- 172.21.15.47:0/447430178 wait complete. 2024-09-12T17:27:15.512 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T17:27:15.512 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T17:27:15.513 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T17:27:15.513 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T17:27:15.539 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-12T17:27:15.539 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T17:27:15.566 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-12T17:27:15.566 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T17:27:15.630 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-12T17:27:15.630 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-12T17:27:15.695 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new d97fac4f-551d-416d-8b2b-e59c453a8d20 0 2024-09-12T17:27:15.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.833+0000 7f53a9bbb640 1 Processor -- start 2024-09-12T17:27:15.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.834+0000 7f53a9bbb640 1 -- start start 2024-09-12T17:27:15.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.834+0000 7f53a9bbb640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f53a41196f0 0x7f53a411bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:15.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.834+0000 7f53a9bbb640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53a411c0b0 con 0x7f53a41157c0 2024-09-12T17:27:15.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.834+0000 7f53a9bbb640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f53a411d290 con 0x7f53a41196f0 2024-09-12T17:27:15.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.834+0000 7f539bfff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f53a41196f0 0x7f53a411bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:15.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.834+0000 7f539bfff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f53a41196f0 0x7f53a411bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:48114/0 (socket says 172.21.15.170:48114) 2024-09-12T17:27:15.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.834+0000 7f53a37fe640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f53a41157c0 0x7f53a4115ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:51682/0 (socket says 172.21.15.170:51682) 2024-09-12T17:27:15.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.834+0000 7f539bfff640 1 -- 172.21.15.170:0/3969408917 learned_addr learned my addr 172.21.15.170:0/3969408917 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:15.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.834+0000 7f53a2ffd640 1 -- 172.21.15.170:0/3969408917 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3002247022 0 0) 0x7f53a411c0b0 con 0x7f53a41157c0 2024-09-12T17:27:15.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.834+0000 7f53a2ffd640 1 -- 172.21.15.170:0/3969408917 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5390003520 con 0x7f53a41157c0 2024-09-12T17:27:15.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.834+0000 7f539bfff640 1 -- 172.21.15.170:0/3969408917 >> v1:172.21.15.47:6789/0 conn(0x7f53a41157c0 legacy=0x7f53a4115ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:15.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.834+0000 7f539bfff640 1 -- 172.21.15.170:0/3969408917 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53a411d410 con 0x7f53a41196f0 2024-09-12T17:27:15.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.835+0000 7f539bfff640 1 --2- 172.21.15.170:0/3969408917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f53a41196f0 0x7f53a411bae0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f538c0097f0 tx=0x7f538c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3e3aeb08237963b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:15.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.835+0000 7f53a2ffd640 1 -- 172.21.15.170:0/3969408917 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f538c037070 con 0x7f53a41196f0 2024-09-12T17:27:15.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.835+0000 7f53a2ffd640 1 -- 172.21.15.170:0/3969408917 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f538c032440 con 0x7f53a41196f0 2024-09-12T17:27:15.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.835+0000 7f53a2ffd640 1 -- 172.21.15.170:0/3969408917 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f538c02ae60 con 0x7f53a41196f0 2024-09-12T17:27:15.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.836+0000 7f53a9bbb640 1 -- 172.21.15.170:0/3969408917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f53a41196f0 msgr2=0x7f53a411bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:15.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.836+0000 7f53a9bbb640 1 --2- 172.21.15.170:0/3969408917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f53a41196f0 0x7f53a411bae0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f538c0097f0 tx=0x7f538c02a1e0 comp rx=0 tx=0).stop 2024-09-12T17:27:15.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.836+0000 7f53a9bbb640 1 -- 172.21.15.170:0/3969408917 shutdown_connections 2024-09-12T17:27:15.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.836+0000 7f53a9bbb640 1 --2- 172.21.15.170:0/3969408917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f53a41196f0 0x7f53a411bae0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:15.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.836+0000 7f53a9bbb640 1 -- 172.21.15.170:0/3969408917 >> 172.21.15.170:0/3969408917 conn(0x7f53a4070c60 msgr2=0x7f53a4073080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:15.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.836+0000 7f53a9bbb640 1 -- 172.21.15.170:0/3969408917 shutdown_connections 2024-09-12T17:27:15.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.836+0000 7f53a9bbb640 1 -- 172.21.15.170:0/3969408917 wait complete. 2024-09-12T17:27:15.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.837+0000 7f53a9bbb640 1 Processor -- start 2024-09-12T17:27:15.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.837+0000 7f53a9bbb640 1 -- start start 2024-09-12T17:27:15.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.837+0000 7f53a9bbb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f53a41157c0 0x7f53a41a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:15.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.837+0000 7f53a9bbb640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f53a411c760 con 0x7f53a41157c0 2024-09-12T17:27:15.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.837+0000 7f53a37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f53a41157c0 0x7f53a41a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:15.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.837+0000 7f53a37fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f53a41157c0 0x7f53a41a5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:48122/0 (socket says 172.21.15.170:48122) 2024-09-12T17:27:15.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.837+0000 7f53a37fe640 1 -- 172.21.15.170:0/1355495162 learned_addr learned my addr 172.21.15.170:0/1355495162 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:15.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.837+0000 7f53a37fe640 1 -- 172.21.15.170:0/1355495162 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53a41a5920 con 0x7f53a41157c0 2024-09-12T17:27:15.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.838+0000 7f53a37fe640 1 --2- 172.21.15.170:0/1355495162 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f53a41157c0 0x7f53a41a5350 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f539400c480 tx=0x7f539400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:15.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.838+0000 7f53a0ff9640 1 -- 172.21.15.170:0/1355495162 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53940074d0 con 0x7f53a41157c0 2024-09-12T17:27:15.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.838+0000 7f53a0ff9640 1 -- 172.21.15.170:0/1355495162 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53940047e0 con 0x7f53a41157c0 2024-09-12T17:27:15.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.838+0000 7f53a9bbb640 1 -- 172.21.15.170:0/1355495162 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53a41a5bb0 con 0x7f53a41157c0 2024-09-12T17:27:15.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.838+0000 7f53a0ff9640 1 -- 172.21.15.170:0/1355495162 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5394007690 con 0x7f53a41157c0 2024-09-12T17:27:15.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.838+0000 7f53a9bbb640 1 -- 172.21.15.170:0/1355495162 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53a41aac00 con 0x7f53a41157c0 2024-09-12T17:27:15.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.838+0000 7f53a0ff9640 1 -- 172.21.15.170:0/1355495162 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f539401a020 con 0x7f53a41157c0 2024-09-12T17:27:15.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.838+0000 7f53a0ff9640 1 -- 172.21.15.170:0/1355495162 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f539401c510 con 0x7f53a41157c0 2024-09-12T17:27:15.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.839+0000 7f53a9bbb640 1 -- 172.21.15.170:0/1355495162 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53a411cdc0 con 0x7f53a41157c0 2024-09-12T17:27:15.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.841+0000 7f53a0ff9640 1 -- 172.21.15.170:0/1355495162 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f5394021070 con 0x7f53a41157c0 2024-09-12T17:27:15.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.911+0000 7f53a9bbb640 1 -- 172.21.15.170:0/1355495162 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d97fac4f-551d-416d-8b2b-e59c453a8d20", "id": 0} v 0) -- 0x7f53a41196f0 con 0x7f53a41157c0 2024-09-12T17:27:15.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.912+0000 7f53a0ff9640 1 -- 172.21.15.170:0/1355495162 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d97fac4f-551d-416d-8b2b-e59c453a8d20", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f539401c880 con 0x7f53a41157c0 2024-09-12T17:27:15.914 INFO:teuthology.orchestra.run.smithi170.stdout:0 2024-09-12T17:27:15.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.913+0000 7f53a9bbb640 1 -- 172.21.15.170:0/1355495162 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f53a41157c0 msgr2=0x7f53a41a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:15.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.913+0000 7f53a9bbb640 1 --2- 172.21.15.170:0/1355495162 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f53a41157c0 0x7f53a41a5350 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f539400c480 tx=0x7f539400c940 comp rx=0 tx=0).stop 2024-09-12T17:27:15.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.913+0000 7f53a9bbb640 1 -- 172.21.15.170:0/1355495162 shutdown_connections 2024-09-12T17:27:15.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.913+0000 7f53a9bbb640 1 --2- 172.21.15.170:0/1355495162 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f53a41157c0 0x7f53a41a5350 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:15.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.913+0000 7f53a9bbb640 1 -- 172.21.15.170:0/1355495162 >> 172.21.15.170:0/1355495162 conn(0x7f53a4070c60 msgr2=0x7f53a4116580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:15.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.913+0000 7f53a9bbb640 1 -- 172.21.15.170:0/1355495162 shutdown_connections 2024-09-12T17:27:15.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:15.913+0000 7f53a9bbb640 1 -- 172.21.15.170:0/1355495162 wait complete. 2024-09-12T17:27:15.925 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new c128aa03-fca1-4254-92ef-e52ded72aae3 1 2024-09-12T17:27:16.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.021+0000 7f8c6e5c3640 1 Processor -- start 2024-09-12T17:27:16.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.021+0000 7f8c6e5c3640 1 -- start start 2024-09-12T17:27:16.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.022+0000 7f8c6e5c3640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f8c681147b0 0x7f8c68114b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:16.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.022+0000 7f8c6e5c3640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c68115270 con 0x7f8c6806d280 2024-09-12T17:27:16.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.022+0000 7f8c6e5c3640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f8c6806de40 con 0x7f8c681147b0 2024-09-12T17:27:16.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.022+0000 7f8c67fff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f8c681147b0 0x7f8c68114b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:16.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.022+0000 7f8c677fe640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f8c6806d280 0x7f8c6806d730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:51690/0 (socket says 172.21.15.170:51690) 2024-09-12T17:27:16.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.022+0000 7f8c67fff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f8c681147b0 0x7f8c68114b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:48126/0 (socket says 172.21.15.170:48126) 2024-09-12T17:27:16.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.022+0000 7f8c677fe640 1 -- 172.21.15.170:0/2793796552 learned_addr learned my addr 172.21.15.170:0/2793796552 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:27:16.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.022+0000 7f8c67fff640 1 -- 172.21.15.170:0/2793796552 >> v1:172.21.15.47:6789/0 conn(0x7f8c6806d280 legacy=0x7f8c6806d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:16.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.022+0000 7f8c67fff640 1 -- 172.21.15.170:0/2793796552 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c6806dff0 con 0x7f8c681147b0 2024-09-12T17:27:16.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.023+0000 7f8c67fff640 1 --2- 172.21.15.170:0/2793796552 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c681147b0 0x7f8c68114b90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8c58009720 tx=0x7f8c5802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82fad4ef377a2bfb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:16.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.023+0000 7f8c66ffd640 1 -- 172.21.15.170:0/2793796552 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c58037070 con 0x7f8c681147b0 2024-09-12T17:27:16.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.023+0000 7f8c66ffd640 1 -- 172.21.15.170:0/2793796552 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c5802ad90 con 0x7f8c681147b0 2024-09-12T17:27:16.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.023+0000 7f8c66ffd640 1 -- 172.21.15.170:0/2793796552 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c58032590 con 0x7f8c681147b0 2024-09-12T17:27:16.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.024+0000 7f8c6e5c3640 1 -- 172.21.15.170:0/2793796552 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c681147b0 msgr2=0x7f8c68114b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:16.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.024+0000 7f8c6e5c3640 1 --2- 172.21.15.170:0/2793796552 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c681147b0 0x7f8c68114b90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8c58009720 tx=0x7f8c5802a110 comp rx=0 tx=0).stop 2024-09-12T17:27:16.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.024+0000 7f8c6e5c3640 1 -- 172.21.15.170:0/2793796552 shutdown_connections 2024-09-12T17:27:16.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.024+0000 7f8c6e5c3640 1 --2- 172.21.15.170:0/2793796552 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c681147b0 0x7f8c68114b90 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:16.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.024+0000 7f8c6e5c3640 1 -- 172.21.15.170:0/2793796552 >> 172.21.15.170:0/2793796552 conn(0x7f8c68070cd0 msgr2=0x7f8c680730f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:16.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.024+0000 7f8c6e5c3640 1 -- 172.21.15.170:0/2793796552 shutdown_connections 2024-09-12T17:27:16.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.024+0000 7f8c6e5c3640 1 -- 172.21.15.170:0/2793796552 wait complete. 2024-09-12T17:27:16.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.024+0000 7f8c6e5c3640 1 Processor -- start 2024-09-12T17:27:16.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.025+0000 7f8c6e5c3640 1 -- start start 2024-09-12T17:27:16.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.025+0000 7f8c6e5c3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c6806d280 0x7f8c6810fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:16.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.025+0000 7f8c6e5c3640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6811cc50 con 0x7f8c6806d280 2024-09-12T17:27:16.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.025+0000 7f8c67fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c6806d280 0x7f8c6810fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:16.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.025+0000 7f8c67fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c6806d280 0x7f8c6810fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:48142/0 (socket says 172.21.15.170:48142) 2024-09-12T17:27:16.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.025+0000 7f8c67fff640 1 -- 172.21.15.170:0/617833127 learned_addr learned my addr 172.21.15.170:0/617833127 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:16.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.025+0000 7f8c67fff640 1 -- 172.21.15.170:0/617833127 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c68111da0 con 0x7f8c6806d280 2024-09-12T17:27:16.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.026+0000 7f8c67fff640 1 --2- 172.21.15.170:0/617833127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c6806d280 0x7f8c6810fea0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8c58009720 tx=0x7f8c580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:16.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.026+0000 7f8c64ff9640 1 -- 172.21.15.170:0/617833127 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c58041070 con 0x7f8c6806d280 2024-09-12T17:27:16.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.026+0000 7f8c64ff9640 1 -- 172.21.15.170:0/617833127 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c5803c460 con 0x7f8c6806d280 2024-09-12T17:27:16.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.026+0000 7f8c6e5c3640 1 -- 172.21.15.170:0/617833127 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c68110440 con 0x7f8c6806d280 2024-09-12T17:27:16.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.026+0000 7f8c64ff9640 1 -- 172.21.15.170:0/617833127 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c58037040 con 0x7f8c6806d280 2024-09-12T17:27:16.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.026+0000 7f8c6e5c3640 1 -- 172.21.15.170:0/617833127 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c68110960 con 0x7f8c6806d280 2024-09-12T17:27:16.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.026+0000 7f8c64ff9640 1 -- 172.21.15.170:0/617833127 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8c58044070 con 0x7f8c6806d280 2024-09-12T17:27:16.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.026+0000 7f8c64ff9640 1 -- 172.21.15.170:0/617833127 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f8c58046ac0 con 0x7f8c6806d280 2024-09-12T17:27:16.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.027+0000 7f8c6e5c3640 1 -- 172.21.15.170:0/617833127 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c680767d0 con 0x7f8c6806d280 2024-09-12T17:27:16.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.029+0000 7f8c64ff9640 1 -- 172.21.15.170:0/617833127 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f8c5803c740 con 0x7f8c6806d280 2024-09-12T17:27:16.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.097+0000 7f8c6e5c3640 1 -- 172.21.15.170:0/617833127 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c128aa03-fca1-4254-92ef-e52ded72aae3", "id": 1} v 0) -- 0x7f8c68110ca0 con 0x7f8c6806d280 2024-09-12T17:27:16.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.098+0000 7f8c64ff9640 1 -- 172.21.15.170:0/617833127 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c128aa03-fca1-4254-92ef-e52ded72aae3", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f8c5803c920 con 0x7f8c6806d280 2024-09-12T17:27:16.100 INFO:teuthology.orchestra.run.smithi170.stdout:1 2024-09-12T17:27:16.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.099+0000 7f8c6e5c3640 1 -- 172.21.15.170:0/617833127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c6806d280 msgr2=0x7f8c6810fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:16.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.099+0000 7f8c6e5c3640 1 --2- 172.21.15.170:0/617833127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c6806d280 0x7f8c6810fea0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8c58009720 tx=0x7f8c580046c0 comp rx=0 tx=0).stop 2024-09-12T17:27:16.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.099+0000 7f8c6e5c3640 1 -- 172.21.15.170:0/617833127 shutdown_connections 2024-09-12T17:27:16.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.100+0000 7f8c6e5c3640 1 --2- 172.21.15.170:0/617833127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c6806d280 0x7f8c6810fea0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:16.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.100+0000 7f8c6e5c3640 1 -- 172.21.15.170:0/617833127 >> 172.21.15.170:0/617833127 conn(0x7f8c68070cd0 msgr2=0x7f8c681131b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:16.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.100+0000 7f8c6e5c3640 1 -- 172.21.15.170:0/617833127 shutdown_connections 2024-09-12T17:27:16.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.100+0000 7f8c6e5c3640 1 -- 172.21.15.170:0/617833127 wait complete. 2024-09-12T17:27:16.112 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 06af30af-11dd-4c7c-9009-9d1c015bc547 2 2024-09-12T17:27:16.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.207+0000 7f7809a49640 1 Processor -- start 2024-09-12T17:27:16.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.207+0000 7f7809a49640 1 -- start start 2024-09-12T17:27:16.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.207+0000 7f7809a49640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f780406ea30 0x7f780411e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:16.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.207+0000 7f7809a49640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f780406eec0 con 0x7f780406ff60 2024-09-12T17:27:16.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.207+0000 7f7809a49640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f780406f090 con 0x7f780406ea30 2024-09-12T17:27:16.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.207+0000 7f78027fc640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f780406ea30 0x7f780411e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:16.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.207+0000 7f78027fc640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f780406ea30 0x7f780411e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:48144/0 (socket says 172.21.15.170:48144) 2024-09-12T17:27:16.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.207+0000 7f78027fc640 1 -- 172.21.15.170:0/3378148437 learned_addr learned my addr 172.21.15.170:0/3378148437 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:16.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.208+0000 7f78027fc640 1 -- 172.21.15.170:0/3378148437 >> v1:172.21.15.47:6789/0 conn(0x7f780406ff60 legacy=0x7f780406e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:16.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.208+0000 7f78027fc640 1 -- 172.21.15.170:0/3378148437 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f780411f760 con 0x7f780406ea30 2024-09-12T17:27:16.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.208+0000 7f78027fc640 1 --2- 172.21.15.170:0/3378148437 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f780406ea30 0x7f780411e210 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f77ec0097f0 tx=0x7f77ec02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ade4973c3d7a2ae7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:16.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.209+0000 7f7801ffb640 1 -- 172.21.15.170:0/3378148437 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77ec037070 con 0x7f780406ea30 2024-09-12T17:27:16.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.209+0000 7f7801ffb640 1 -- 172.21.15.170:0/3378148437 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77ec032440 con 0x7f780406ea30 2024-09-12T17:27:16.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.209+0000 7f7801ffb640 1 -- 172.21.15.170:0/3378148437 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77ec02ae60 con 0x7f780406ea30 2024-09-12T17:27:16.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.209+0000 7f7809a49640 1 -- 172.21.15.170:0/3378148437 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f780406ea30 msgr2=0x7f780411e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:16.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.209+0000 7f7809a49640 1 --2- 172.21.15.170:0/3378148437 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f780406ea30 0x7f780411e210 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f77ec0097f0 tx=0x7f77ec02a1e0 comp rx=0 tx=0).stop 2024-09-12T17:27:16.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.209+0000 7f7809a49640 1 -- 172.21.15.170:0/3378148437 shutdown_connections 2024-09-12T17:27:16.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.209+0000 7f7809a49640 1 --2- 172.21.15.170:0/3378148437 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f780406ea30 0x7f780411e210 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:16.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.209+0000 7f7809a49640 1 -- 172.21.15.170:0/3378148437 >> 172.21.15.170:0/3378148437 conn(0x7f7804071dd0 msgr2=0x7f78040741f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:16.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.209+0000 7f7809a49640 1 -- 172.21.15.170:0/3378148437 shutdown_connections 2024-09-12T17:27:16.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.209+0000 7f7809a49640 1 -- 172.21.15.170:0/3378148437 wait complete. 2024-09-12T17:27:16.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.210+0000 7f7809a49640 1 Processor -- start 2024-09-12T17:27:16.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.210+0000 7f7809a49640 1 -- start start 2024-09-12T17:27:16.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.210+0000 7f7809a49640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f780406ea30 0x7f78041a7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:16.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.210+0000 7f7809a49640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f780411eba0 con 0x7f780406ea30 2024-09-12T17:27:16.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.210+0000 7f7802ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f780406ea30 0x7f78041a7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:16.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.210+0000 7f7802ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f780406ea30 0x7f78041a7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:48154/0 (socket says 172.21.15.170:48154) 2024-09-12T17:27:16.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.211+0000 7f7802ffd640 1 -- 172.21.15.170:0/2302849260 learned_addr learned my addr 172.21.15.170:0/2302849260 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:16.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.211+0000 7f7802ffd640 1 -- 172.21.15.170:0/2302849260 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78041a7d30 con 0x7f780406ea30 2024-09-12T17:27:16.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.211+0000 7f7802ffd640 1 --2- 172.21.15.170:0/2302849260 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f780406ea30 0x7f78041a7760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f77f400c480 tx=0x7f77f400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:16.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.211+0000 7f77fbfff640 1 -- 172.21.15.170:0/2302849260 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77f4017070 con 0x7f780406ea30 2024-09-12T17:27:16.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.211+0000 7f77fbfff640 1 -- 172.21.15.170:0/2302849260 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77f4005200 con 0x7f780406ea30 2024-09-12T17:27:16.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.211+0000 7f7809a49640 1 -- 172.21.15.170:0/2302849260 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78041a8020 con 0x7f780406ea30 2024-09-12T17:27:16.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.211+0000 7f77fbfff640 1 -- 172.21.15.170:0/2302849260 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77f40035f0 con 0x7f780406ea30 2024-09-12T17:27:16.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.211+0000 7f7809a49640 1 -- 172.21.15.170:0/2302849260 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78041ad1f0 con 0x7f780406ea30 2024-09-12T17:27:16.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.211+0000 7f77fbfff640 1 -- 172.21.15.170:0/2302849260 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f77f401a070 con 0x7f780406ea30 2024-09-12T17:27:16.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.211+0000 7f77fbfff640 1 -- 172.21.15.170:0/2302849260 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f77f4012420 con 0x7f780406ea30 2024-09-12T17:27:16.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.212+0000 7f7809a49640 1 -- 172.21.15.170:0/2302849260 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78041a8360 con 0x7f780406ea30 2024-09-12T17:27:16.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.214+0000 7f77fbfff640 1 -- 172.21.15.170:0/2302849260 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f77f4021070 con 0x7f780406ea30 2024-09-12T17:27:16.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.283+0000 7f7809a49640 1 -- 172.21.15.170:0/2302849260 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd new", "uuid": "06af30af-11dd-4c7c-9009-9d1c015bc547", "id": 2} v 0) -- 0x7f780411f200 con 0x7f780406ea30 2024-09-12T17:27:16.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.284+0000 7f77fbfff640 1 -- 172.21.15.170:0/2302849260 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "06af30af-11dd-4c7c-9009-9d1c015bc547", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f77f40116d0 con 0x7f780406ea30 2024-09-12T17:27:16.285 INFO:teuthology.orchestra.run.smithi170.stdout:2 2024-09-12T17:27:16.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.285+0000 7f7809a49640 1 -- 172.21.15.170:0/2302849260 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f780406ea30 msgr2=0x7f78041a7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:16.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.285+0000 7f7809a49640 1 --2- 172.21.15.170:0/2302849260 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f780406ea30 0x7f78041a7760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f77f400c480 tx=0x7f77f400c940 comp rx=0 tx=0).stop 2024-09-12T17:27:16.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.285+0000 7f7809a49640 1 -- 172.21.15.170:0/2302849260 shutdown_connections 2024-09-12T17:27:16.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.285+0000 7f7809a49640 1 --2- 172.21.15.170:0/2302849260 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f780406ea30 0x7f78041a7760 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:16.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.285+0000 7f7809a49640 1 -- 172.21.15.170:0/2302849260 >> 172.21.15.170:0/2302849260 conn(0x7f7804071dd0 msgr2=0x7f7804118180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:16.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.285+0000 7f7809a49640 1 -- 172.21.15.170:0/2302849260 shutdown_connections 2024-09-12T17:27:16.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.285+0000 7f7809a49640 1 -- 172.21.15.170:0/2302849260 wait complete. 2024-09-12T17:27:16.297 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new a6700a39-ad47-4fcc-a6b1-a0953f82883e 3 2024-09-12T17:27:16.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.392+0000 7f88e5850640 1 Processor -- start 2024-09-12T17:27:16.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.392+0000 7f88e5850640 1 -- start start 2024-09-12T17:27:16.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.393+0000 7f88e5850640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f88e006eaa0 0x7f88e011e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:16.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.393+0000 7f88e5850640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88e006ef50 con 0x7f88e006ff80 2024-09-12T17:27:16.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.393+0000 7f88e5850640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f88e006f120 con 0x7f88e006eaa0 2024-09-12T17:27:16.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.393+0000 7f88de7fc640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f88e006eaa0 0x7f88e011e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:16.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.393+0000 7f88de7fc640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f88e006eaa0 0x7f88e011e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:48158/0 (socket says 172.21.15.170:48158) 2024-09-12T17:27:16.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.393+0000 7f88de7fc640 1 -- 172.21.15.170:0/781897667 learned_addr learned my addr 172.21.15.170:0/781897667 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:16.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.393+0000 7f88de7fc640 1 -- 172.21.15.170:0/781897667 >> v1:172.21.15.47:6789/0 conn(0x7f88e006ff80 legacy=0x7f88e006e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:16.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.393+0000 7f88de7fc640 1 -- 172.21.15.170:0/781897667 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88e011f760 con 0x7f88e006eaa0 2024-09-12T17:27:16.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.394+0000 7f88de7fc640 1 --2- 172.21.15.170:0/781897667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88e006eaa0 0x7f88e011e210 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f88c80097f0 tx=0x7f88c802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ab62bc0113455 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:16.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.394+0000 7f88ddffb640 1 -- 172.21.15.170:0/781897667 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88c8037070 con 0x7f88e006eaa0 2024-09-12T17:27:16.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.394+0000 7f88ddffb640 1 -- 172.21.15.170:0/781897667 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88c8032440 con 0x7f88e006eaa0 2024-09-12T17:27:16.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.394+0000 7f88ddffb640 1 -- 172.21.15.170:0/781897667 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88c802ae60 con 0x7f88e006eaa0 2024-09-12T17:27:16.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.395+0000 7f88e5850640 1 -- 172.21.15.170:0/781897667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88e006eaa0 msgr2=0x7f88e011e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:16.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.395+0000 7f88e5850640 1 --2- 172.21.15.170:0/781897667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88e006eaa0 0x7f88e011e210 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f88c80097f0 tx=0x7f88c802a1e0 comp rx=0 tx=0).stop 2024-09-12T17:27:16.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.395+0000 7f88e5850640 1 -- 172.21.15.170:0/781897667 shutdown_connections 2024-09-12T17:27:16.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.395+0000 7f88e5850640 1 --2- 172.21.15.170:0/781897667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88e006eaa0 0x7f88e011e210 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:16.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.395+0000 7f88e5850640 1 -- 172.21.15.170:0/781897667 >> 172.21.15.170:0/781897667 conn(0x7f88e0071de0 msgr2=0x7f88e0074200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:16.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.395+0000 7f88e5850640 1 -- 172.21.15.170:0/781897667 shutdown_connections 2024-09-12T17:27:16.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.395+0000 7f88e5850640 1 -- 172.21.15.170:0/781897667 wait complete. 2024-09-12T17:27:16.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.395+0000 7f88e5850640 1 Processor -- start 2024-09-12T17:27:16.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.396+0000 7f88e5850640 1 -- start start 2024-09-12T17:27:16.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.396+0000 7f88e5850640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88e006eaa0 0x7f88e01a77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:16.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.396+0000 7f88e5850640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f88e011ec00 con 0x7f88e006eaa0 2024-09-12T17:27:16.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.396+0000 7f88deffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88e006eaa0 0x7f88e01a77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:16.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.396+0000 7f88deffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88e006eaa0 0x7f88e01a77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:48172/0 (socket says 172.21.15.170:48172) 2024-09-12T17:27:16.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.396+0000 7f88deffd640 1 -- 172.21.15.170:0/1758903342 learned_addr learned my addr 172.21.15.170:0/1758903342 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:16.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.396+0000 7f88deffd640 1 -- 172.21.15.170:0/1758903342 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88e01a7db0 con 0x7f88e006eaa0 2024-09-12T17:27:16.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.396+0000 7f88deffd640 1 --2- 172.21.15.170:0/1758903342 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88e006eaa0 0x7f88e01a77e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f88d000c480 tx=0x7f88d000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:16.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.397+0000 7f88d7fff640 1 -- 172.21.15.170:0/1758903342 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88d0017070 con 0x7f88e006eaa0 2024-09-12T17:27:16.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.397+0000 7f88d7fff640 1 -- 172.21.15.170:0/1758903342 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88d0005200 con 0x7f88e006eaa0 2024-09-12T17:27:16.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.397+0000 7f88e5850640 1 -- 172.21.15.170:0/1758903342 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88e01a80a0 con 0x7f88e006eaa0 2024-09-12T17:27:16.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.397+0000 7f88d7fff640 1 -- 172.21.15.170:0/1758903342 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88d00035f0 con 0x7f88e006eaa0 2024-09-12T17:27:16.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.397+0000 7f88e5850640 1 -- 172.21.15.170:0/1758903342 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88e01ad1f0 con 0x7f88e006eaa0 2024-09-12T17:27:16.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.397+0000 7f88d7fff640 1 -- 172.21.15.170:0/1758903342 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f88d001a070 con 0x7f88e006eaa0 2024-09-12T17:27:16.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.397+0000 7f88d7fff640 1 -- 172.21.15.170:0/1758903342 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f88d0012420 con 0x7f88e006eaa0 2024-09-12T17:27:16.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.398+0000 7f88e5850640 1 -- 172.21.15.170:0/1758903342 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88e01a83e0 con 0x7f88e006eaa0 2024-09-12T17:27:16.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.400+0000 7f88d7fff640 1 -- 172.21.15.170:0/1758903342 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f88d0021070 con 0x7f88e006eaa0 2024-09-12T17:27:16.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.469+0000 7f88e5850640 1 -- 172.21.15.170:0/1758903342 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a6700a39-ad47-4fcc-a6b1-a0953f82883e", "id": 3} v 0) -- 0x7f88e011f210 con 0x7f88e006eaa0 2024-09-12T17:27:16.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.470+0000 7f88d7fff640 1 -- 172.21.15.170:0/1758903342 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a6700a39-ad47-4fcc-a6b1-a0953f82883e", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f88d0011690 con 0x7f88e006eaa0 2024-09-12T17:27:16.471 INFO:teuthology.orchestra.run.smithi170.stdout:3 2024-09-12T17:27:16.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.471+0000 7f88e5850640 1 -- 172.21.15.170:0/1758903342 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88e006eaa0 msgr2=0x7f88e01a77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:16.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.471+0000 7f88e5850640 1 --2- 172.21.15.170:0/1758903342 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88e006eaa0 0x7f88e01a77e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f88d000c480 tx=0x7f88d000c940 comp rx=0 tx=0).stop 2024-09-12T17:27:16.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.471+0000 7f88e5850640 1 -- 172.21.15.170:0/1758903342 shutdown_connections 2024-09-12T17:27:16.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.471+0000 7f88e5850640 1 --2- 172.21.15.170:0/1758903342 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88e006eaa0 0x7f88e01a77e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:16.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.471+0000 7f88e5850640 1 -- 172.21.15.170:0/1758903342 >> 172.21.15.170:0/1758903342 conn(0x7f88e0071de0 msgr2=0x7f88e0118230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:16.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.471+0000 7f88e5850640 1 -- 172.21.15.170:0/1758903342 shutdown_connections 2024-09-12T17:27:16.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:16.471+0000 7f88e5850640 1 -- 172.21.15.170:0/1758903342 wait complete. 2024-09-12T17:27:16.483 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T17:27:16.483 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T17:27:16.485 INFO:tasks.ceph.osd.0:Started 2024-09-12T17:27:16.486 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T17:27:16.486 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T17:27:16.488 INFO:tasks.ceph.osd.1:Started 2024-09-12T17:27:16.488 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T17:27:16.488 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T17:27:16.490 INFO:tasks.ceph.osd.2:Started 2024-09-12T17:27:16.490 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-12T17:27:16.491 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-12T17:27:16.493 INFO:tasks.ceph.osd.3:Started 2024-09-12T17:27:16.493 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T17:27:16.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.595+0000 7f7d192f6640 1 Processor -- start 2024-09-12T17:27:16.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.595+0000 7f7d192f6640 1 -- start start 2024-09-12T17:27:16.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.595+0000 7f7d192f6640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7d14130270 0x7f7d14132660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:16.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.595+0000 7f7d192f6640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d1406dc00 con 0x7f7d14129d80 2024-09-12T17:27:16.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.595+0000 7f7d192f6640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f7d141299c0 con 0x7f7d14130270 2024-09-12T17:27:16.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.596+0000 7f7d127fc640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7d14130270 0x7f7d14132660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:16.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.596+0000 7f7d12ffd640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f7d14129d80 0x7f7d1412a160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49656/0 (socket says 172.21.15.47:49656) 2024-09-12T17:27:16.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.596+0000 7f7d12ffd640 1 -- 172.21.15.47:0/1853183359 learned_addr learned my addr 172.21.15.47:0/1853183359 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-09-12T17:27:16.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.596+0000 7f7d127fc640 1 -- 172.21.15.47:0/1853183359 >> v1:172.21.15.47:6789/0 conn(0x7f7d14129d80 legacy=0x7f7d1412a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:16.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.596+0000 7f7d127fc640 1 -- 172.21.15.47:0/1853183359 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d1412a870 con 0x7f7d14130270 2024-09-12T17:27:16.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.596+0000 7f7d11ffb640 1 -- 172.21.15.47:0/1853183359 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2524660336 0 0) 0x7f7d1406dc00 con 0x7f7d14129d80 2024-09-12T17:27:16.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.597+0000 7f7d127fc640 1 --2- 172.21.15.47:0/1853183359 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d14130270 0x7f7d14132660 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009720 tx=0x7f7cfc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ed01c1a268a72e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:16.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.597+0000 7f7d11ffb640 1 -- 172.21.15.47:0/1853183359 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cfc037070 con 0x7f7d14130270 2024-09-12T17:27:16.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.597+0000 7f7d11ffb640 1 -- 172.21.15.47:0/1853183359 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cfc02ad90 con 0x7f7d14130270 2024-09-12T17:27:16.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.597+0000 7f7d11ffb640 1 -- 172.21.15.47:0/1853183359 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cfc032590 con 0x7f7d14130270 2024-09-12T17:27:16.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.597+0000 7f7d192f6640 1 -- 172.21.15.47:0/1853183359 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d14130270 msgr2=0x7f7d14132660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:16.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.597+0000 7f7d192f6640 1 --2- 172.21.15.47:0/1853183359 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d14130270 0x7f7d14132660 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009720 tx=0x7f7cfc02a110 comp rx=0 tx=0).stop 2024-09-12T17:27:16.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.597+0000 7f7d192f6640 1 -- 172.21.15.47:0/1853183359 shutdown_connections 2024-09-12T17:27:16.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.597+0000 7f7d192f6640 1 --2- 172.21.15.47:0/1853183359 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d14130270 0x7f7d14132660 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:16.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.597+0000 7f7d192f6640 1 -- 172.21.15.47:0/1853183359 >> 172.21.15.47:0/1853183359 conn(0x7f7d14070850 msgr2=0x7f7d14072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:16.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.597+0000 7f7d192f6640 1 -- 172.21.15.47:0/1853183359 shutdown_connections 2024-09-12T17:27:16.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.597+0000 7f7d192f6640 1 -- 172.21.15.47:0/1853183359 wait complete. 2024-09-12T17:27:16.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.598+0000 7f7d192f6640 1 Processor -- start 2024-09-12T17:27:16.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.598+0000 7f7d192f6640 1 -- start start 2024-09-12T17:27:16.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.599+0000 7f7d192f6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d14129d80 0x7f7d14115750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:16.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.599+0000 7f7d192f6640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7d14073a10 con 0x7f7d14129d80 2024-09-12T17:27:16.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.599+0000 7f7d12ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d14129d80 0x7f7d14115750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:16.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.599+0000 7f7d12ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d14129d80 0x7f7d14115750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59824/0 (socket says 172.21.15.47:59824) 2024-09-12T17:27:16.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.599+0000 7f7d12ffd640 1 -- 172.21.15.47:0/1711228709 learned_addr learned my addr 172.21.15.47:0/1711228709 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:27:16.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.599+0000 7f7d12ffd640 1 -- 172.21.15.47:0/1711228709 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d14117520 con 0x7f7d14129d80 2024-09-12T17:27:16.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.599+0000 7f7d12ffd640 1 --2- 172.21.15.47:0/1711228709 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d14129d80 0x7f7d14115750 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c00c7c0 tx=0x7f7d0c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:16.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.599+0000 7f7d0b7fe640 1 -- 172.21.15.47:0/1711228709 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d0c018070 con 0x7f7d14129d80 2024-09-12T17:27:16.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.600+0000 7f7d0b7fe640 1 -- 172.21.15.47:0/1711228709 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d0c004d70 con 0x7f7d14129d80 2024-09-12T17:27:16.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.600+0000 7f7d192f6640 1 -- 172.21.15.47:0/1711228709 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d14118520 con 0x7f7d14129d80 2024-09-12T17:27:16.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.600+0000 7f7d0b7fe640 1 -- 172.21.15.47:0/1711228709 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d0c00a710 con 0x7f7d14129d80 2024-09-12T17:27:16.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.600+0000 7f7d192f6640 1 -- 172.21.15.47:0/1711228709 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d14118960 con 0x7f7d14129d80 2024-09-12T17:27:16.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.600+0000 7f7d0b7fe640 1 -- 172.21.15.47:0/1711228709 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7d0c01b070 con 0x7f7d14129d80 2024-09-12T17:27:16.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.600+0000 7f7d0b7fe640 1 -- 172.21.15.47:0/1711228709 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f7d0c0077e0 con 0x7f7d14129d80 2024-09-12T17:27:16.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.600+0000 7f7d192f6640 1 -- 172.21.15.47:0/1711228709 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d1412a160 con 0x7f7d14129d80 2024-09-12T17:27:16.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.602+0000 7f7d0b7fe640 1 -- 172.21.15.47:0/1711228709 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f7d0c0070d0 con 0x7f7d14129d80 2024-09-12T17:27:16.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.663+0000 7f7d192f6640 1 -- 172.21.15.47:0/1711228709 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7d14068da0 con 0x7f7d14129d80 2024-09-12T17:27:16.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.664+0000 7f7d0b7fe640 1 -- 172.21.15.47:0/1711228709 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f7d0c0072b0 con 0x7f7d14129d80 2024-09-12T17:27:16.665 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:27:16.665 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":6,"fsid":"e43073ba-e4e6-405e-a192-e8c972c1bee5","created":"2024-09-12T17:27:15.406724+0000","modified":"2024-09-12T17:27:16.470942+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T17:27:16.470942+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d97fac4f-551d-416d-8b2b-e59c453a8d20","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c128aa03-fca1-4254-92ef-e52ded72aae3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"06af30af-11dd-4c7c-9009-9d1c015bc547","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a6700a39-ad47-4fcc-a6b1-a0953f82883e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:27:16.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.664+0000 7f7d192f6640 1 -- 172.21.15.47:0/1711228709 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d14129d80 msgr2=0x7f7d14115750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:16.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.664+0000 7f7d192f6640 1 --2- 172.21.15.47:0/1711228709 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d14129d80 0x7f7d14115750 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c00c7c0 tx=0x7f7d0c00cc80 comp rx=0 tx=0).stop 2024-09-12T17:27:16.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.664+0000 7f7d192f6640 1 -- 172.21.15.47:0/1711228709 shutdown_connections 2024-09-12T17:27:16.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.664+0000 7f7d192f6640 1 --2- 172.21.15.47:0/1711228709 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d14129d80 0x7f7d14115750 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:16.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.664+0000 7f7d192f6640 1 -- 172.21.15.47:0/1711228709 >> 172.21.15.47:0/1711228709 conn(0x7f7d14070850 msgr2=0x7f7d141282f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:16.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.664+0000 7f7d192f6640 1 -- 172.21.15.47:0/1711228709 shutdown_connections 2024-09-12T17:27:16.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:16.664+0000 7f7d192f6640 1 -- 172.21.15.47:0/1711228709 wait complete. 2024-09-12T17:27:16.675 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T17:27:16.676 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T17:27:17.078 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T17:27:17.172 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.169+0000 7fd37d964640 1 Processor -- start 2024-09-12T17:27:17.172 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.170+0000 7fd37d964640 1 -- start start 2024-09-12T17:27:17.172 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.170+0000 7fd37d964640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd378112210 0x7fd3781314b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:17.173 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.170+0000 7fd37d964640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd378112ab0 con 0x7fd378111720 2024-09-12T17:27:17.173 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.170+0000 7fd37d964640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fd37810fff0 con 0x7fd378112210 2024-09-12T17:27:17.173 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.170+0000 7fd3767fc640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd378112210 0x7fd3781314b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:17.173 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.170+0000 7fd376ffd640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fd378111720 0x7fd378111b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49660/0 (socket says 172.21.15.47:49660) 2024-09-12T17:27:17.173 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.170+0000 7fd376ffd640 1 -- 172.21.15.47:0/1500946021 learned_addr learned my addr 172.21.15.47:0/1500946021 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-09-12T17:27:17.173 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.170+0000 7fd3767fc640 1 -- 172.21.15.47:0/1500946021 >> v1:172.21.15.47:6789/0 conn(0x7fd378111720 legacy=0x7fd378111b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:17.173 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.171+0000 7fd3767fc640 1 -- 172.21.15.47:0/1500946021 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd37806ddc0 con 0x7fd378112210 2024-09-12T17:27:17.173 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.171+0000 7fd375ffb640 1 -- 172.21.15.47:0/1500946021 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3837015655 0 0) 0x7fd378112ab0 con 0x7fd378111720 2024-09-12T17:27:17.177 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.171+0000 7fd3767fc640 1 --2- 172.21.15.47:0/1500946021 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd378112210 0x7fd3781314b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd36c009720 tx=0x7fd36c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=149efd9351ef83 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:17.177 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.171+0000 7fd375ffb640 1 -- 172.21.15.47:0/1500946021 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd36c037070 con 0x7fd378112210 2024-09-12T17:27:17.177 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.171+0000 7fd375ffb640 1 -- 172.21.15.47:0/1500946021 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd36c02ad90 con 0x7fd378112210 2024-09-12T17:27:17.177 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.171+0000 7fd375ffb640 1 -- 172.21.15.47:0/1500946021 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd36c032590 con 0x7fd378112210 2024-09-12T17:27:17.177 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.172+0000 7fd37d964640 1 -- 172.21.15.47:0/1500946021 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd378112210 msgr2=0x7fd3781314b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:17.177 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.172+0000 7fd37d964640 1 --2- 172.21.15.47:0/1500946021 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd378112210 0x7fd3781314b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd36c009720 tx=0x7fd36c02a110 comp rx=0 tx=0).stop 2024-09-12T17:27:17.177 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.172+0000 7fd37d964640 1 -- 172.21.15.47:0/1500946021 shutdown_connections 2024-09-12T17:27:17.178 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.172+0000 7fd37d964640 1 --2- 172.21.15.47:0/1500946021 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd378112210 0x7fd3781314b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:17.178 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.172+0000 7fd37d964640 1 -- 172.21.15.47:0/1500946021 >> 172.21.15.47:0/1500946021 conn(0x7fd37806fcf0 msgr2=0x7fd3780720e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:17.178 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.172+0000 7fd37d964640 1 -- 172.21.15.47:0/1500946021 shutdown_connections 2024-09-12T17:27:17.178 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.172+0000 7fd37d964640 1 -- 172.21.15.47:0/1500946021 wait complete. 2024-09-12T17:27:17.178 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.173+0000 7fd37d964640 1 Processor -- start 2024-09-12T17:27:17.178 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.173+0000 7fd37d964640 1 -- start start 2024-09-12T17:27:17.178 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.173+0000 7fd37d964640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd378111720 0x7fd378121860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:17.178 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.173+0000 7fd37d964640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd378113950 con 0x7fd378111720 2024-09-12T17:27:17.178 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.174+0000 7fd376ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd378111720 0x7fd378121860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:17.178 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.174+0000 7fd376ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd378111720 0x7fd378121860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59844/0 (socket says 172.21.15.47:59844) 2024-09-12T17:27:17.178 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.174+0000 7fd376ffd640 1 -- 172.21.15.47:0/3111964828 learned_addr learned my addr 172.21.15.47:0/3111964828 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:27:17.178 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.174+0000 7fd376ffd640 1 -- 172.21.15.47:0/3111964828 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3781253e0 con 0x7fd378111720 2024-09-12T17:27:17.178 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.174+0000 7fd376ffd640 1 --2- 172.21.15.47:0/3111964828 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd378111720 0x7fd378121860 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd36800c3d0 tx=0x7fd36800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:17.179 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.174+0000 7fd35ffff640 1 -- 172.21.15.47:0/3111964828 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3680074d0 con 0x7fd378111720 2024-09-12T17:27:17.179 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.174+0000 7fd35ffff640 1 -- 172.21.15.47:0/3111964828 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3680047e0 con 0x7fd378111720 2024-09-12T17:27:17.179 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.174+0000 7fd37d964640 1 -- 172.21.15.47:0/3111964828 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3781251a0 con 0x7fd378111720 2024-09-12T17:27:17.179 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.174+0000 7fd35ffff640 1 -- 172.21.15.47:0/3111964828 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd368007670 con 0x7fd378111720 2024-09-12T17:27:17.179 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.174+0000 7fd37d964640 1 -- 172.21.15.47:0/3111964828 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd37812fb50 con 0x7fd378111720 2024-09-12T17:27:17.179 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.174+0000 7fd35ffff640 1 -- 172.21.15.47:0/3111964828 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd368011070 con 0x7fd378111720 2024-09-12T17:27:17.179 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.174+0000 7fd35ffff640 1 -- 172.21.15.47:0/3111964828 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fd368004b00 con 0x7fd378111720 2024-09-12T17:27:17.179 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.175+0000 7fd37d964640 1 -- 172.21.15.47:0/3111964828 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd378126670 con 0x7fd378111720 2024-09-12T17:27:17.179 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.177+0000 7fd35ffff640 1 -- 172.21.15.47:0/3111964828 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fd378126670 con 0x7fd378111720 2024-09-12T17:27:17.239 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.238+0000 7fd37d964640 1 -- 172.21.15.47:0/3111964828 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd378111b00 con 0x7fd378111720 2024-09-12T17:27:17.240 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.238+0000 7fd35ffff640 1 -- 172.21.15.47:0/3111964828 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7fd36801d3f0 con 0x7fd378111720 2024-09-12T17:27:17.240 INFO:teuthology.misc.health.smithi047.stdout: 2024-09-12T17:27:17.240 INFO:teuthology.misc.health.smithi047.stdout:{"epoch":6,"fsid":"e43073ba-e4e6-405e-a192-e8c972c1bee5","created":"2024-09-12T17:27:15.406724+0000","modified":"2024-09-12T17:27:16.470942+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T17:27:16.470942+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d97fac4f-551d-416d-8b2b-e59c453a8d20","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c128aa03-fca1-4254-92ef-e52ded72aae3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"06af30af-11dd-4c7c-9009-9d1c015bc547","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a6700a39-ad47-4fcc-a6b1-a0953f82883e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:27:17.241 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.239+0000 7fd37d964640 1 -- 172.21.15.47:0/3111964828 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd378111720 msgr2=0x7fd378121860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:17.241 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.239+0000 7fd37d964640 1 --2- 172.21.15.47:0/3111964828 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd378111720 0x7fd378121860 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd36800c3d0 tx=0x7fd36800c890 comp rx=0 tx=0).stop 2024-09-12T17:27:17.241 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.239+0000 7fd37d964640 1 -- 172.21.15.47:0/3111964828 shutdown_connections 2024-09-12T17:27:17.241 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.239+0000 7fd37d964640 1 --2- 172.21.15.47:0/3111964828 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd378111720 0x7fd378121860 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:17.241 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.239+0000 7fd37d964640 1 -- 172.21.15.47:0/3111964828 >> 172.21.15.47:0/3111964828 conn(0x7fd37806fcf0 msgr2=0x7fd378110610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:17.241 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.239+0000 7fd37d964640 1 -- 172.21.15.47:0/3111964828 shutdown_connections 2024-09-12T17:27:17.241 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:17.239+0000 7fd37d964640 1 -- 172.21.15.47:0/3111964828 wait complete. 2024-09-12T17:27:17.249 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-12T17:27:17.407 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T17:27:17.406+0000 7fac9e619640 -1 Falling back to public interface 2024-09-12T17:27:17.447 INFO:tasks.ceph.osd.1.smithi170.stderr:2024-09-12T17:27:17.446+0000 7f303cc0b640 -1 Falling back to public interface 2024-09-12T17:27:17.452 INFO:tasks.ceph.osd.2.smithi170.stderr:2024-09-12T17:27:17.451+0000 7fd5f320d640 -1 Falling back to public interface 2024-09-12T17:27:17.454 INFO:tasks.ceph.osd.3.smithi170.stderr:2024-09-12T17:27:17.453+0000 7f36373a6640 -1 Falling back to public interface 2024-09-12T17:27:20.734 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-09-12T17:27:20.732+0000 7fb51dce2640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-12T17:27:20.916 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T17:27:20.915+0000 7fac9e619640 -1 osd.0 0 log_to_monitors true 2024-09-12T17:27:20.991 INFO:tasks.ceph.osd.2.smithi170.stderr:2024-09-12T17:27:20.989+0000 7fd5f320d640 -1 osd.2 0 log_to_monitors true 2024-09-12T17:27:21.539 INFO:tasks.ceph.osd.1.smithi170.stderr:2024-09-12T17:27:21.537+0000 7f303cc0b640 -1 osd.1 0 log_to_monitors true 2024-09-12T17:27:21.770 INFO:tasks.ceph.osd.3.smithi170.stderr:2024-09-12T17:27:21.768+0000 7f36373a6640 -1 osd.3 0 log_to_monitors true 2024-09-12T17:27:23.503 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T17:27:23.502+0000 7fac99f26640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T17:27:23.517 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-09-12T17:27:23.516+0000 7fac91d45640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:27:23.653 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T17:27:23.659 INFO:tasks.ceph.osd.2.smithi170.stderr:2024-09-12T17:27:23.657+0000 7fd5ef312640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T17:27:23.660 INFO:tasks.ceph.osd.1.smithi170.stderr:2024-09-12T17:27:23.658+0000 7f3038631640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T17:27:23.668 INFO:tasks.ceph.osd.2.smithi170.stderr:2024-09-12T17:27:23.666+0000 7fd5e691d640 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:27:23.672 INFO:tasks.ceph.osd.1.smithi170.stderr:2024-09-12T17:27:23.671+0000 7f3030450640 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:27:23.749 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.748+0000 7f9dd7085640 1 Processor -- start 2024-09-12T17:27:23.749 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.748+0000 7f9dd7085640 1 -- start start 2024-09-12T17:27:23.750 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.748+0000 7f9dd7085640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9dd01325a0 0x7f9dd0134990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:23.750 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.748+0000 7f9dd7085640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dd0116650 con 0x7f9dd012c140 2024-09-12T17:27:23.750 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.748+0000 7f9dd7085640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f9dd0116f90 con 0x7f9dd01325a0 2024-09-12T17:27:23.751 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.748+0000 7f9dd4e21640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f9dd012c140 0x7f9dd012c520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49676/0 (socket says 172.21.15.47:49676) 2024-09-12T17:27:23.751 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.748+0000 7f9dd4e21640 1 -- 172.21.15.47:0/1177399521 learned_addr learned my addr 172.21.15.47:0/1177399521 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-09-12T17:27:23.751 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.748+0000 7f9dcffff640 1 --2- 172.21.15.47:0/1177399521 >> v2:172.21.15.47:3300/0 conn(0x7f9dd01325a0 0x7f9dd0134990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:23.751 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.749+0000 7f9dcffff640 1 -- 172.21.15.47:0/1177399521 >> v1:172.21.15.47:6789/0 conn(0x7f9dd012c140 legacy=0x7f9dd012c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:23.751 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.749+0000 7f9dcffff640 1 -- 172.21.15.47:0/1177399521 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd012cc30 con 0x7f9dd01325a0 2024-09-12T17:27:23.751 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.749+0000 7f9dcffff640 1 --2- 172.21.15.47:0/1177399521 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9dd01325a0 0x7f9dd0134990 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc009720 tx=0x7f9dbc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ced6a853a25358b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:23.752 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.750+0000 7f9dcf7fe640 1 -- 172.21.15.47:0/1177399521 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dbc037070 con 0x7f9dd01325a0 2024-09-12T17:27:23.752 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.750+0000 7f9dcf7fe640 1 -- 172.21.15.47:0/1177399521 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dbc02ad90 con 0x7f9dd01325a0 2024-09-12T17:27:23.752 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.750+0000 7f9dcf7fe640 1 -- 172.21.15.47:0/1177399521 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dbc032590 con 0x7f9dd01325a0 2024-09-12T17:27:23.752 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.750+0000 7f9dd7085640 1 -- 172.21.15.47:0/1177399521 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9dd01325a0 msgr2=0x7f9dd0134990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:23.753 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.750+0000 7f9dd7085640 1 --2- 172.21.15.47:0/1177399521 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9dd01325a0 0x7f9dd0134990 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc009720 tx=0x7f9dbc02a110 comp rx=0 tx=0).stop 2024-09-12T17:27:23.753 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.750+0000 7f9dd7085640 1 -- 172.21.15.47:0/1177399521 shutdown_connections 2024-09-12T17:27:23.753 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.750+0000 7f9dd7085640 1 --2- 172.21.15.47:0/1177399521 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9dd01325a0 0x7f9dd0134990 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:23.753 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.750+0000 7f9dd7085640 1 -- 172.21.15.47:0/1177399521 >> 172.21.15.47:0/1177399521 conn(0x7f9dd00705c0 msgr2=0x7f9dd00729e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:23.753 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.750+0000 7f9dd7085640 1 -- 172.21.15.47:0/1177399521 shutdown_connections 2024-09-12T17:27:23.753 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.750+0000 7f9dd7085640 1 -- 172.21.15.47:0/1177399521 wait complete. 2024-09-12T17:27:23.753 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.751+0000 7f9dd7085640 1 Processor -- start 2024-09-12T17:27:23.753 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.751+0000 7f9dd7085640 1 -- start start 2024-09-12T17:27:23.755 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.752+0000 7f9dd7085640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9dd012c140 0x7f9dd0124b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:23.755 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.752+0000 7f9dd7085640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd0116ae0 con 0x7f9dd012c140 2024-09-12T17:27:23.755 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.752+0000 7f9dd4e21640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9dd012c140 0x7f9dd0124b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:23.755 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.752+0000 7f9dd4e21640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9dd012c140 0x7f9dd0124b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59884/0 (socket says 172.21.15.47:59884) 2024-09-12T17:27:23.755 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.752+0000 7f9dd4e21640 1 -- 172.21.15.47:0/1946204619 learned_addr learned my addr 172.21.15.47:0/1946204619 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:27:23.755 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.752+0000 7f9dd4e21640 1 -- 172.21.15.47:0/1946204619 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd01177c0 con 0x7f9dd012c140 2024-09-12T17:27:23.755 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.752+0000 7f9dd4e21640 1 --2- 172.21.15.47:0/1946204619 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9dd012c140 0x7f9dd0124b90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9dc400c380 tx=0x7f9dc400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:23.755 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.752+0000 7f9dcd7fa640 1 -- 172.21.15.47:0/1946204619 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dc4017070 con 0x7f9dd012c140 2024-09-12T17:27:23.756 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.752+0000 7f9dcd7fa640 1 -- 172.21.15.47:0/1946204619 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dc4005c10 con 0x7f9dd012c140 2024-09-12T17:27:23.756 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.752+0000 7f9dcd7fa640 1 -- 172.21.15.47:0/1946204619 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dc40070d0 con 0x7f9dd012c140 2024-09-12T17:27:23.756 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.752+0000 7f9dd7085640 1 -- 172.21.15.47:0/1946204619 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dd012f8c0 con 0x7f9dd012c140 2024-09-12T17:27:23.756 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.753+0000 7f9dd7085640 1 -- 172.21.15.47:0/1946204619 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dd01181f0 con 0x7f9dd012c140 2024-09-12T17:27:23.756 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.753+0000 7f9dcd7fa640 1 -- 172.21.15.47:0/1946204619 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 4) ==== 50363+0+0 (secure 0 0 0) 0x7f9dc401a070 con 0x7f9dd012c140 2024-09-12T17:27:23.756 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.753+0000 7f9dd7085640 1 -- 172.21.15.47:0/1946204619 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dd012c520 con 0x7f9dd012c140 2024-09-12T17:27:23.756 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.754+0000 7f9dcd7fa640 1 --2- 172.21.15.47:0/1946204619 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f9db403de00 0x7f9db40402c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:23.756 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.754+0000 7f9dcd7fa640 1 -- 172.21.15.47:0/1946204619 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 2463+0+0 (secure 0 0 0) 0x7f9dc4050fc0 con 0x7f9dd012c140 2024-09-12T17:27:23.756 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.754+0000 7f9dcffff640 1 --2- 172.21.15.47:0/1946204619 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f9db403de00 0x7f9db40402c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:23.757 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.754+0000 7f9dcffff640 1 --2- 172.21.15.47:0/1946204619 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f9db403de00 0x7f9db40402c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc034000 tx=0x7f9dbc02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:23.760 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.759+0000 7f9dcd7fa640 1 -- 172.21.15.47:0/1946204619 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f9dc4019cd0 con 0x7f9dd012c140 2024-09-12T17:27:23.944 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.943+0000 7f9dd7085640 1 -- 172.21.15.47:0/1946204619 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9dd0050d60 con 0x7f9dd012c140 2024-09-12T17:27:23.945 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.943+0000 7f9dcd7fa640 1 -- 172.21.15.47:0/1946204619 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v9) ==== 74+0+5619 (secure 0 0 0) 0x7f9dc401b3b0 con 0x7f9dd012c140 2024-09-12T17:27:23.945 INFO:teuthology.misc.health.smithi047.stdout: 2024-09-12T17:27:23.945 INFO:teuthology.misc.health.smithi047.stdout:{"epoch":9,"fsid":"e43073ba-e4e6-405e-a192-e8c972c1bee5","created":"2024-09-12T17:27:15.406724+0000","modified":"2024-09-12T17:27:23.734681+0000","last_up_change":"2024-09-12T17:27:23.734681+0000","last_in_change":"2024-09-12T17:27:16.470942+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d97fac4f-551d-416d-8b2b-e59c453a8d20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":3978157098},{"type":"v1","addr":"172.21.15.47:6801","nonce":3978157098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":3978157098},{"type":"v1","addr":"172.21.15.47:6803","nonce":3978157098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":3978157098},{"type":"v1","addr":"172.21.15.47:6807","nonce":3978157098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":3978157098},{"type":"v1","addr":"172.21.15.47:6805","nonce":3978157098}]},"public_addr":"172.21.15.47:6801/3978157098","cluster_addr":"172.21.15.47:6803/3978157098","heartbeat_back_addr":"172.21.15.47:6807/3978157098","heartbeat_front_addr":"172.21.15.47:6805/3978157098","state":["exists","up"]},{"osd":1,"uuid":"c128aa03-fca1-4254-92ef-e52ded72aae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1903654092},{"type":"v1","addr":"172.21.15.170:6801","nonce":1903654092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1903654092},{"type":"v1","addr":"172.21.15.170:6803","nonce":1903654092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1903654092},{"type":"v1","addr":"172.21.15.170:6807","nonce":1903654092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1903654092},{"type":"v1","addr":"172.21.15.170:6805","nonce":1903654092}]},"public_addr":"172.21.15.170:6801/1903654092","cluster_addr":"172.21.15.170:6803/1903654092","heartbeat_back_addr":"172.21.15.170:6807/1903654092","heartbeat_front_addr":"172.21.15.170:6805/1903654092","state":["exists","up"]},{"osd":2,"uuid":"06af30af-11dd-4c7c-9009-9d1c015bc547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3855567754},{"type":"v1","addr":"172.21.15.170:6809","nonce":3855567754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":3855567754},{"type":"v1","addr":"172.21.15.170:6811","nonce":3855567754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":3855567754},{"type":"v1","addr":"172.21.15.170:6815","nonce":3855567754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":3855567754},{"type":"v1","addr":"172.21.15.170:6813","nonce":3855567754}]},"public_addr":"172.21.15.170:6809/3855567754","cluster_addr":"172.21.15.170:6811/3855567754","heartbeat_back_addr":"172.21.15.170:6815/3855567754","heartbeat_front_addr":"172.21.15.170:6813/3855567754","state":["exists","up"]},{"osd":3,"uuid":"a6700a39-ad47-4fcc-a6b1-a0953f82883e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:27:23.947 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.946+0000 7f9dd7085640 1 -- 172.21.15.47:0/1946204619 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f9db403de00 msgr2=0x7f9db40402c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:23.947 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.946+0000 7f9dd7085640 1 --2- 172.21.15.47:0/1946204619 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f9db403de00 0x7f9db40402c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc034000 tx=0x7f9dbc02e000 comp rx=0 tx=0).stop 2024-09-12T17:27:23.947 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.946+0000 7f9dd7085640 1 -- 172.21.15.47:0/1946204619 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9dd012c140 msgr2=0x7f9dd0124b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:23.947 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.946+0000 7f9dd7085640 1 --2- 172.21.15.47:0/1946204619 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9dd012c140 0x7f9dd0124b90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9dc400c380 tx=0x7f9dc400c840 comp rx=0 tx=0).stop 2024-09-12T17:27:23.948 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.946+0000 7f9dd7085640 1 -- 172.21.15.47:0/1946204619 shutdown_connections 2024-09-12T17:27:23.948 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.946+0000 7f9dd7085640 1 --2- 172.21.15.47:0/1946204619 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f9db403de00 0x7f9db40402c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:23.948 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.946+0000 7f9dd7085640 1 --2- 172.21.15.47:0/1946204619 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9dd012c140 0x7f9dd0124b90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:23.948 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.946+0000 7f9dd7085640 1 -- 172.21.15.47:0/1946204619 >> 172.21.15.47:0/1946204619 conn(0x7f9dd00705c0 msgr2=0x7f9dd012a780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:23.948 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.946+0000 7f9dd7085640 1 -- 172.21.15.47:0/1946204619 shutdown_connections 2024-09-12T17:27:23.948 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:23.946+0000 7f9dd7085640 1 -- 172.21.15.47:0/1946204619 wait complete. 2024-09-12T17:27:23.956 DEBUG:teuthology.misc:3 of 4 OSDs are up 2024-09-12T17:27:24.449 INFO:tasks.ceph.osd.3.smithi170.stderr:2024-09-12T17:27:24.448+0000 7f3633b49640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T17:27:24.463 INFO:tasks.ceph.osd.3.smithi170.stderr:2024-09-12T17:27:24.462+0000 7f362b154640 -1 osd.3 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:27:30.359 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T17:27:30.464 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.463+0000 7ff5d94e4640 1 Processor -- start 2024-09-12T17:27:30.464 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.463+0000 7ff5d94e4640 1 -- start start 2024-09-12T17:27:30.465 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.463+0000 7ff5d94e4640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff5d412cfb0 0x7ff5d412d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:30.465 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.463+0000 7ff5d94e4640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5d4114860 con 0x7ff5d4114110 2024-09-12T17:27:30.465 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.463+0000 7ff5d94e4640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7ff5d4114a30 con 0x7ff5d412cfb0 2024-09-12T17:27:30.465 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.463+0000 7ff5d2ffd640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff5d412cfb0 0x7ff5d412d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:30.465 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.463+0000 7ff5d27fc640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7ff5d4114110 0x7ff5d412d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:45986/0 (socket says 172.21.15.47:45986) 2024-09-12T17:27:30.466 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.463+0000 7ff5d27fc640 1 -- 172.21.15.47:0/1927601746 learned_addr learned my addr 172.21.15.47:0/1927601746 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-09-12T17:27:30.466 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.464+0000 7ff5d2ffd640 1 -- 172.21.15.47:0/1927601746 >> v1:172.21.15.47:6789/0 conn(0x7ff5d4114110 legacy=0x7ff5d412d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:30.466 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.464+0000 7ff5d1ffb640 1 -- 172.21.15.47:0/1927601746 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 200202768 0 0) 0x7ff5d4114860 con 0x7ff5d4114110 2024-09-12T17:27:30.466 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.464+0000 7ff5d2ffd640 1 -- 172.21.15.47:0/1927601746 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5d4133340 con 0x7ff5d412cfb0 2024-09-12T17:27:30.467 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.464+0000 7ff5d2ffd640 1 --2- 172.21.15.47:0/1927601746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5d412cfb0 0x7ff5d412d390 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4009720 tx=0x7ff5c402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eb9405dad7e1cef server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:30.467 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.465+0000 7ff5d1ffb640 1 -- 172.21.15.47:0/1927601746 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5c4037070 con 0x7ff5d412cfb0 2024-09-12T17:27:30.468 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.465+0000 7ff5d1ffb640 1 -- 172.21.15.47:0/1927601746 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5c402ad90 con 0x7ff5d412cfb0 2024-09-12T17:27:30.468 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.465+0000 7ff5d1ffb640 1 -- 172.21.15.47:0/1927601746 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5c4032590 con 0x7ff5d412cfb0 2024-09-12T17:27:30.468 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.465+0000 7ff5d94e4640 1 -- 172.21.15.47:0/1927601746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5d412cfb0 msgr2=0x7ff5d412d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:30.468 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.465+0000 7ff5d94e4640 1 --2- 172.21.15.47:0/1927601746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5d412cfb0 0x7ff5d412d390 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4009720 tx=0x7ff5c402a110 comp rx=0 tx=0).stop 2024-09-12T17:27:30.468 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.465+0000 7ff5d94e4640 1 -- 172.21.15.47:0/1927601746 shutdown_connections 2024-09-12T17:27:30.468 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.465+0000 7ff5d94e4640 1 --2- 172.21.15.47:0/1927601746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5d412cfb0 0x7ff5d412d390 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:30.468 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.465+0000 7ff5d94e4640 1 -- 172.21.15.47:0/1927601746 >> 172.21.15.47:0/1927601746 conn(0x7ff5d406fcf0 msgr2=0x7ff5d40720e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:30.469 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.465+0000 7ff5d94e4640 1 -- 172.21.15.47:0/1927601746 shutdown_connections 2024-09-12T17:27:30.469 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.465+0000 7ff5d94e4640 1 -- 172.21.15.47:0/1927601746 wait complete. 2024-09-12T17:27:30.469 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.466+0000 7ff5d94e4640 1 Processor -- start 2024-09-12T17:27:30.469 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.466+0000 7ff5d94e4640 1 -- start start 2024-09-12T17:27:30.471 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.467+0000 7ff5d94e4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5d4114110 0x7ff5d41be360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:30.471 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.467+0000 7ff5d94e4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d41326c0 con 0x7ff5d4114110 2024-09-12T17:27:30.471 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.467+0000 7ff5d2ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5d4114110 0x7ff5d41be360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:30.471 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.467+0000 7ff5d2ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5d4114110 0x7ff5d41be360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52014/0 (socket says 172.21.15.47:52014) 2024-09-12T17:27:30.472 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.467+0000 7ff5d2ffd640 1 -- 172.21.15.47:0/3948852982 learned_addr learned my addr 172.21.15.47:0/3948852982 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:27:30.472 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.467+0000 7ff5d2ffd640 1 -- 172.21.15.47:0/3948852982 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5d4131e60 con 0x7ff5d4114110 2024-09-12T17:27:30.472 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.467+0000 7ff5d2ffd640 1 --2- 172.21.15.47:0/3948852982 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5d4114110 0x7ff5d41be360 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4009840 tx=0x7ff5c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:30.472 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.468+0000 7ff5bb7fe640 1 -- 172.21.15.47:0/3948852982 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5c4041070 con 0x7ff5d4114110 2024-09-12T17:27:30.472 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.468+0000 7ff5bb7fe640 1 -- 172.21.15.47:0/3948852982 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5c403c460 con 0x7ff5d4114110 2024-09-12T17:27:30.472 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.468+0000 7ff5d94e4640 1 -- 172.21.15.47:0/3948852982 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5d41155e0 con 0x7ff5d4114110 2024-09-12T17:27:30.472 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.468+0000 7ff5bb7fe640 1 -- 172.21.15.47:0/3948852982 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5c4037040 con 0x7ff5d4114110 2024-09-12T17:27:30.472 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.468+0000 7ff5d94e4640 1 -- 172.21.15.47:0/3948852982 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5d41bea80 con 0x7ff5d4114110 2024-09-12T17:27:30.472 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.469+0000 7ff5bb7fe640 1 -- 172.21.15.47:0/3948852982 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ff5c4044070 con 0x7ff5d4114110 2024-09-12T17:27:30.473 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.469+0000 7ff5d94e4640 1 -- 172.21.15.47:0/3948852982 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5d4132c00 con 0x7ff5d4114110 2024-09-12T17:27:30.473 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.469+0000 7ff5bb7fe640 1 --2- 172.21.15.47:0/3948852982 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff5c003de90 0x7ff5c0040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:30.473 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.469+0000 7ff5bb7fe640 1 -- 172.21.15.47:0/3948852982 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3129+0+0 (secure 0 0 0) 0x7ff5c4072930 con 0x7ff5d4114110 2024-09-12T17:27:30.473 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.469+0000 7ff5d27fc640 1 --2- 172.21.15.47:0/3948852982 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff5c003de90 0x7ff5c0040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:30.473 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.470+0000 7ff5d27fc640 1 --2- 172.21.15.47:0/3948852982 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff5c003de90 0x7ff5c0040350 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8000c00 tx=0x7ff5c80078d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:30.476 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.474+0000 7ff5bb7fe640 1 -- 172.21.15.47:0/3948852982 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7ff5c404e350 con 0x7ff5d4114110 2024-09-12T17:27:30.658 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.657+0000 7ff5d94e4640 1 -- 172.21.15.47:0/3948852982 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff5d4115b00 con 0x7ff5d4114110 2024-09-12T17:27:30.659 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.657+0000 7ff5bb7fe640 1 -- 172.21.15.47:0/3948852982 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+8012 (secure 0 0 0) 0x7ff5c403c780 con 0x7ff5d4114110 2024-09-12T17:27:30.659 INFO:teuthology.misc.health.smithi047.stdout: 2024-09-12T17:27:30.659 INFO:teuthology.misc.health.smithi047.stdout:{"epoch":12,"fsid":"e43073ba-e4e6-405e-a192-e8c972c1bee5","created":"2024-09-12T17:27:15.406724+0000","modified":"2024-09-12T17:27:26.747204+0000","last_up_change":"2024-09-12T17:27:24.738801+0000","last_in_change":"2024-09-12T17:27:16.470942+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:27:23.745577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d97fac4f-551d-416d-8b2b-e59c453a8d20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":3978157098},{"type":"v1","addr":"172.21.15.47:6801","nonce":3978157098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":3978157098},{"type":"v1","addr":"172.21.15.47:6803","nonce":3978157098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":3978157098},{"type":"v1","addr":"172.21.15.47:6807","nonce":3978157098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":3978157098},{"type":"v1","addr":"172.21.15.47:6805","nonce":3978157098}]},"public_addr":"172.21.15.47:6801/3978157098","cluster_addr":"172.21.15.47:6803/3978157098","heartbeat_back_addr":"172.21.15.47:6807/3978157098","heartbeat_front_addr":"172.21.15.47:6805/3978157098","state":["exists","up"]},{"osd":1,"uuid":"c128aa03-fca1-4254-92ef-e52ded72aae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1903654092},{"type":"v1","addr":"172.21.15.170:6801","nonce":1903654092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1903654092},{"type":"v1","addr":"172.21.15.170:6803","nonce":1903654092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1903654092},{"type":"v1","addr":"172.21.15.170:6807","nonce":1903654092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1903654092},{"type":"v1","addr":"172.21.15.170:6805","nonce":1903654092}]},"public_addr":"172.21.15.170:6801/1903654092","cluster_addr":"172.21.15.170:6803/1903654092","heartbeat_back_addr":"172.21.15.170:6807/1903654092","heartbeat_front_addr":"172.21.15.170:6805/1903654092","state":["exists","up"]},{"osd":2,"uuid":"06af30af-11dd-4c7c-9009-9d1c015bc547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3855567754},{"type":"v1","addr":"172.21.15.170:6809","nonce":3855567754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":3855567754},{"type":"v1","addr":"172.21.15.170:6811","nonce":3855567754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":3855567754},{"type":"v1","addr":"172.21.15.170:6815","nonce":3855567754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":3855567754},{"type":"v1","addr":"172.21.15.170:6813","nonce":3855567754}]},"public_addr":"172.21.15.170:6809/3855567754","cluster_addr":"172.21.15.170:6811/3855567754","heartbeat_back_addr":"172.21.15.170:6815/3855567754","heartbeat_front_addr":"172.21.15.170:6813/3855567754","state":["exists","up"]},{"osd":3,"uuid":"a6700a39-ad47-4fcc-a6b1-a0953f82883e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2664906588},{"type":"v1","addr":"172.21.15.170:6817","nonce":2664906588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2664906588},{"type":"v1","addr":"172.21.15.170:6819","nonce":2664906588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2664906588},{"type":"v1","addr":"172.21.15.170:6823","nonce":2664906588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2664906588},{"type":"v1","addr":"172.21.15.170:6821","nonce":2664906588}]},"public_addr":"172.21.15.170:6817/2664906588","cluster_addr":"172.21.15.170:6819/2664906588","heartbeat_back_addr":"172.21.15.170:6823/2664906588","heartbeat_front_addr":"172.21.15.170:6821/2664906588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:27:21.948935+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:27:22.508052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:27:22.007283+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:27:22.726262+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:27:30.661 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.659+0000 7ff5d94e4640 1 -- 172.21.15.47:0/3948852982 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff5c003de90 msgr2=0x7ff5c0040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:30.661 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.659+0000 7ff5d94e4640 1 --2- 172.21.15.47:0/3948852982 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff5c003de90 0x7ff5c0040350 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8000c00 tx=0x7ff5c80078d0 comp rx=0 tx=0).stop 2024-09-12T17:27:30.661 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.659+0000 7ff5d94e4640 1 -- 172.21.15.47:0/3948852982 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5d4114110 msgr2=0x7ff5d41be360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:30.661 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.659+0000 7ff5d94e4640 1 --2- 172.21.15.47:0/3948852982 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5d4114110 0x7ff5d41be360 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4009840 tx=0x7ff5c40046c0 comp rx=0 tx=0).stop 2024-09-12T17:27:30.661 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.659+0000 7ff5d94e4640 1 -- 172.21.15.47:0/3948852982 shutdown_connections 2024-09-12T17:27:30.661 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.659+0000 7ff5d94e4640 1 --2- 172.21.15.47:0/3948852982 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff5c003de90 0x7ff5c0040350 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:30.662 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.659+0000 7ff5d94e4640 1 --2- 172.21.15.47:0/3948852982 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5d4114110 0x7ff5d41be360 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:30.662 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.660+0000 7ff5d94e4640 1 -- 172.21.15.47:0/3948852982 >> 172.21.15.47:0/3948852982 conn(0x7ff5d406fcf0 msgr2=0x7ff5d4128210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:30.662 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.660+0000 7ff5d94e4640 1 -- 172.21.15.47:0/3948852982 shutdown_connections 2024-09-12T17:27:30.662 INFO:teuthology.misc.health.smithi047.stderr:2024-09-12T17:27:30.660+0000 7ff5d94e4640 1 -- 172.21.15.47:0/3948852982 wait complete. 2024-09-12T17:27:30.670 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-12T17:27:30.670 INFO:tasks.ceph:Creating RBD pool 2024-09-12T17:27:30.671 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-12T17:27:30.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:30.771+0000 7f0c28616640 1 Processor -- start 2024-09-12T17:27:30.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:30.771+0000 7f0c28616640 1 -- start start 2024-09-12T17:27:30.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:30.771+0000 7f0c28616640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f0c2012ca00 0x7f0c201314b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:30.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:30.771+0000 7f0c28616640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c2009a160 con 0x7f0c2012bf10 2024-09-12T17:27:30.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:30.771+0000 7f0c28616640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f0c2006def0 con 0x7f0c2012ca00 2024-09-12T17:27:30.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:30.771+0000 7f0c25bb1640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f0c2012ca00 0x7f0c201314b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:30.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:30.771+0000 7f0c263b2640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f0c2012bf10 0x7f0c2012c2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:46000/0 (socket says 172.21.15.47:46000) 2024-09-12T17:27:30.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:30.771+0000 7f0c263b2640 1 -- 172.21.15.47:0/739105117 learned_addr learned my addr 172.21.15.47:0/739105117 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-09-12T17:27:30.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:30.772+0000 7f0c25bb1640 1 -- 172.21.15.47:0/739105117 >> v1:172.21.15.47:6789/0 conn(0x7f0c2012bf10 legacy=0x7f0c2012c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:30.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:30.772+0000 7f0c25bb1640 1 -- 172.21.15.47:0/739105117 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c20099b10 con 0x7f0c2012ca00 2024-09-12T17:27:30.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:30.772+0000 7f0c25bb1640 1 --2- 172.21.15.47:0/739105117 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c2012ca00 0x7f0c201314b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0c10009720 tx=0x7f0c1002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69dae4fb1c745661 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:30.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:30.772+0000 7f0c253b0640 1 -- 172.21.15.47:0/739105117 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c10037070 con 0x7f0c2012ca00 2024-09-12T17:27:30.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:30.772+0000 7f0c253b0640 1 -- 172.21.15.47:0/739105117 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c1002ad90 con 0x7f0c2012ca00 2024-09-12T17:27:30.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:30.773+0000 7f0c253b0640 1 -- 172.21.15.47:0/739105117 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c10032590 con 0x7f0c2012ca00 2024-09-12T17:27:30.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:30.773+0000 7f0c28616640 1 -- 172.21.15.47:0/739105117 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c2012ca00 msgr2=0x7f0c201314b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:30.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:30.773+0000 7f0c28616640 1 --2- 172.21.15.47:0/739105117 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c2012ca00 0x7f0c201314b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0c10009720 tx=0x7f0c1002a110 comp rx=0 tx=0).stop 2024-09-12T17:27:30.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:30.773+0000 7f0c28616640 1 -- 172.21.15.47:0/739105117 shutdown_connections 2024-09-12T17:27:30.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:30.773+0000 7f0c28616640 1 --2- 172.21.15.47:0/739105117 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c2012ca00 0x7f0c201314b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:30.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:30.773+0000 7f0c28616640 1 -- 172.21.15.47:0/739105117 >> 172.21.15.47:0/739105117 conn(0x7f0c2009a930 msgr2=0x7f0c2009ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:30.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:30.773+0000 7f0c28616640 1 -- 172.21.15.47:0/739105117 shutdown_connections 2024-09-12T17:27:30.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:30.773+0000 7f0c28616640 1 -- 172.21.15.47:0/739105117 wait complete. 2024-09-12T17:27:30.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:30.774+0000 7f0c28616640 1 Processor -- start 2024-09-12T17:27:30.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:30.774+0000 7f0c28616640 1 -- start start 2024-09-12T17:27:30.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:30.774+0000 7f0c28616640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c2012bf10 0x7f0c201c4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:30.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:30.774+0000 7f0c28616640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0c20095150 con 0x7f0c2012bf10 2024-09-12T17:27:30.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:30.775+0000 7f0c263b2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c2012bf10 0x7f0c201c4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:30.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:30.775+0000 7f0c263b2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c2012bf10 0x7f0c201c4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52032/0 (socket says 172.21.15.47:52032) 2024-09-12T17:27:30.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:30.775+0000 7f0c263b2640 1 -- 172.21.15.47:0/3244266929 learned_addr learned my addr 172.21.15.47:0/3244266929 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:27:30.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:30.775+0000 7f0c263b2640 1 -- 172.21.15.47:0/3244266929 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c201254b0 con 0x7f0c2012bf10 2024-09-12T17:27:30.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:30.775+0000 7f0c263b2640 1 --2- 172.21.15.47:0/3244266929 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c2012bf10 0x7f0c201c4530 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c00c480 tx=0x7f0c1c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:30.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:30.775+0000 7f0c16ffd640 1 -- 172.21.15.47:0/3244266929 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c1c017070 con 0x7f0c2012bf10 2024-09-12T17:27:30.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:30.775+0000 7f0c16ffd640 1 -- 172.21.15.47:0/3244266929 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c1c005c10 con 0x7f0c2012bf10 2024-09-12T17:27:30.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:30.775+0000 7f0c16ffd640 1 -- 172.21.15.47:0/3244266929 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c1c007070 con 0x7f0c2012bf10 2024-09-12T17:27:30.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:30.775+0000 7f0c28616640 1 -- 172.21.15.47:0/3244266929 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c20125060 con 0x7f0c2012bf10 2024-09-12T17:27:30.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:30.775+0000 7f0c28616640 1 -- 172.21.15.47:0/3244266929 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c201c4a70 con 0x7f0c2012bf10 2024-09-12T17:27:30.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:30.776+0000 7f0c28616640 1 -- 172.21.15.47:0/3244266929 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c2012c640 con 0x7f0c2012bf10 2024-09-12T17:27:30.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:30.776+0000 7f0c16ffd640 1 -- 172.21.15.47:0/3244266929 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f0c1c01a070 con 0x7f0c2012bf10 2024-09-12T17:27:30.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:30.776+0000 7f0c16ffd640 1 --2- 172.21.15.47:0/3244266929 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0c0403de90 0x7f0c04040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:30.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:30.776+0000 7f0c16ffd640 1 -- 172.21.15.47:0/3244266929 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3129+0+0 (secure 0 0 0) 0x7f0c1c0512d0 con 0x7f0c2012bf10 2024-09-12T17:27:30.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:30.777+0000 7f0c25bb1640 1 --2- 172.21.15.47:0/3244266929 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0c0403de90 0x7f0c04040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:30.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:30.777+0000 7f0c25bb1640 1 --2- 172.21.15.47:0/3244266929 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0c0403de90 0x7f0c04040350 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0c10034000 tx=0x7f0c1002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:30.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:30.781+0000 7f0c16ffd640 1 -- 172.21.15.47:0/3244266929 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f0c2012c640 con 0x7f0c2012bf10 2024-09-12T17:27:30.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:30.963+0000 7f0c28616640 1 -- 172.21.15.47:0/3244266929 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f0c2012c2f0 con 0x7f0c2012bf10 2024-09-12T17:27:31.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.754+0000 7f0c16ffd640 1 -- 172.21.15.47:0/3244266929 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v13) ==== 109+0+0 (secure 0 0 0) 0x7f0c1c01ac60 con 0x7f0c2012bf10 2024-09-12T17:27:31.756 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'rbd' created 2024-09-12T17:27:31.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.758+0000 7f0c28616640 1 -- 172.21.15.47:0/3244266929 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0c0403de90 msgr2=0x7f0c04040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:31.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.758+0000 7f0c28616640 1 --2- 172.21.15.47:0/3244266929 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0c0403de90 0x7f0c04040350 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0c10034000 tx=0x7f0c1002e000 comp rx=0 tx=0).stop 2024-09-12T17:27:31.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.758+0000 7f0c28616640 1 -- 172.21.15.47:0/3244266929 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c2012bf10 msgr2=0x7f0c201c4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:31.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.758+0000 7f0c28616640 1 --2- 172.21.15.47:0/3244266929 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c2012bf10 0x7f0c201c4530 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c00c480 tx=0x7f0c1c00c940 comp rx=0 tx=0).stop 2024-09-12T17:27:31.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.758+0000 7f0c28616640 1 -- 172.21.15.47:0/3244266929 shutdown_connections 2024-09-12T17:27:31.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.758+0000 7f0c28616640 1 --2- 172.21.15.47:0/3244266929 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0c0403de90 0x7f0c04040350 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:31.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.758+0000 7f0c28616640 1 --2- 172.21.15.47:0/3244266929 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c2012bf10 0x7f0c201c4530 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:31.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.758+0000 7f0c28616640 1 -- 172.21.15.47:0/3244266929 >> 172.21.15.47:0/3244266929 conn(0x7f0c2009a930 msgr2=0x7f0c2009c580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:31.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.758+0000 7f0c28616640 1 -- 172.21.15.47:0/3244266929 shutdown_connections 2024-09-12T17:27:31.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.758+0000 7f0c28616640 1 -- 172.21.15.47:0/3244266929 wait complete. 2024-09-12T17:27:31.772 DEBUG:teuthology.orchestra.run.smithi047:> rbd --cluster ceph pool init rbd 2024-09-12T17:27:31.829 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:31.829 INFO:teuthology.orchestra.run.smithi047.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:31.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.829+0000 7fc0c71a1f00 1 Processor -- start 2024-09-12T17:27:31.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.829+0000 7fc0c71a1f00 1 -- start start 2024-09-12T17:27:31.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.830+0000 7fc0c71a1f00 1 --2- >> v2:172.21.15.47:3300/0 conn(0x560cb2aaea90 0x560cb2aaee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:31.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.830+0000 7fc0c71a1f00 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x560cb2921f30 con 0x560cb2aafe30 2024-09-12T17:27:31.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.830+0000 7fc0c71a1f00 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x560cb2988a10 con 0x560cb2aaea90 2024-09-12T17:27:31.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.830+0000 7fc0c5c8f640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x560cb2aaea90 0x560cb2aaee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:31.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.830+0000 7fc0c548e640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x560cb2aafe30 0x560cb2b44eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:46016/0 (socket says 172.21.15.47:46016) 2024-09-12T17:27:31.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.830+0000 7fc0c548e640 1 -- 172.21.15.47:0/4022582540 learned_addr learned my addr 172.21.15.47:0/4022582540 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-09-12T17:27:31.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.830+0000 7fc0c5c8f640 1 -- 172.21.15.47:0/4022582540 >> v1:172.21.15.47:6789/0 conn(0x560cb2aafe30 legacy=0x560cb2b44eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:31.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.830+0000 7fc0c5c8f640 1 -- 172.21.15.47:0/4022582540 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cb29070c0 con 0x560cb2aaea90 2024-09-12T17:27:31.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.832+0000 7fc0c5c8f640 1 --2- 172.21.15.47:0/4022582540 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560cb2aaea90 0x560cb2aaee70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc0b800a470 tx=0x7fc0b8045e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=927d17a15b42dafd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:31.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.832+0000 7fc0c4c8d640 1 -- 172.21.15.47:0/4022582540 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0b805a070 con 0x560cb2aaea90 2024-09-12T17:27:31.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.832+0000 7fc0c4c8d640 1 -- 172.21.15.47:0/4022582540 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0b804d610 con 0x560cb2aaea90 2024-09-12T17:27:31.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.832+0000 7fc0c4c8d640 1 -- 172.21.15.47:0/4022582540 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0b804d930 con 0x560cb2aaea90 2024-09-12T17:27:31.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.833+0000 7fc0c71a1f00 1 -- 172.21.15.47:0/4022582540 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560cb2aaea90 msgr2=0x560cb2aaee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:31.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.833+0000 7fc0c71a1f00 1 --2- 172.21.15.47:0/4022582540 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560cb2aaea90 0x560cb2aaee70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc0b800a470 tx=0x7fc0b8045e50 comp rx=0 tx=0).stop 2024-09-12T17:27:31.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.833+0000 7fc0c71a1f00 1 -- 172.21.15.47:0/4022582540 shutdown_connections 2024-09-12T17:27:31.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.833+0000 7fc0c71a1f00 1 --2- 172.21.15.47:0/4022582540 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560cb2aaea90 0x560cb2aaee70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:31.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.833+0000 7fc0c71a1f00 1 -- 172.21.15.47:0/4022582540 >> 172.21.15.47:0/4022582540 conn(0x560cb2ab7d50 msgr2=0x560cb2ab4110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:31.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.833+0000 7fc0c71a1f00 1 -- 172.21.15.47:0/4022582540 shutdown_connections 2024-09-12T17:27:31.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.833+0000 7fc0c71a1f00 1 -- 172.21.15.47:0/4022582540 wait complete. 2024-09-12T17:27:31.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.834+0000 7fc0c71a1f00 1 Processor -- start 2024-09-12T17:27:31.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.834+0000 7fc0c71a1f00 1 -- start start 2024-09-12T17:27:31.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.834+0000 7fc0c71a1f00 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560cb2aaea90 0x560cb2b50630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:31.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.834+0000 7fc0c71a1f00 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x560cb298c9c0 con 0x560cb2aaea90 2024-09-12T17:27:31.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.834+0000 7fc0c5c8f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560cb2aaea90 0x560cb2b50630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:31.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.834+0000 7fc0c5c8f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560cb2aaea90 0x560cb2b50630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:52054/0 (socket says 172.21.15.47:52054) 2024-09-12T17:27:31.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.834+0000 7fc0c5c8f640 1 -- 172.21.15.47:0/3126909017 learned_addr learned my addr 172.21.15.47:0/3126909017 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:27:31.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.834+0000 7fc0c5c8f640 1 -- 172.21.15.47:0/3126909017 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cb2b35550 con 0x560cb2aaea90 2024-09-12T17:27:31.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.835+0000 7fc0c5c8f640 1 --2- 172.21.15.47:0/3126909017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560cb2aaea90 0x560cb2b50630 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc0b800a470 tx=0x7fc0b8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:31.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.835+0000 7fc0b5ffb640 1 -- 172.21.15.47:0/3126909017 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0b804ecc0 con 0x560cb2aaea90 2024-09-12T17:27:31.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.835+0000 7fc0b5ffb640 1 -- 172.21.15.47:0/3126909017 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0b8055440 con 0x560cb2aaea90 2024-09-12T17:27:31.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.835+0000 7fc0c71a1f00 1 -- 172.21.15.47:0/3126909017 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560cb2b37230 con 0x560cb2aaea90 2024-09-12T17:27:31.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.835+0000 7fc0b5ffb640 1 -- 172.21.15.47:0/3126909017 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0b804ee60 con 0x560cb2aaea90 2024-09-12T17:27:31.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.835+0000 7fc0c71a1f00 1 -- 172.21.15.47:0/3126909017 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560cb2b50b70 con 0x560cb2aaea90 2024-09-12T17:27:31.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.836+0000 7fc0b5ffb640 1 -- 172.21.15.47:0/3126909017 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc0b806e060 con 0x560cb2aaea90 2024-09-12T17:27:31.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.836+0000 7fc0b5ffb640 1 --2- 172.21.15.47:0/3126909017 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc0a803c730 0x7fc0a803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:31.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.836+0000 7fc0b5ffb640 1 -- 172.21.15.47:0/3126909017 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3471+0+0 (secure 0 0 0) 0x7fc0b8096ba0 con 0x560cb2aaea90 2024-09-12T17:27:31.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.836+0000 7fc0c71a1f00 1 -- 172.21.15.47:0/3126909017 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x560cb2b51130 con 0x560cb2aaea90 2024-09-12T17:27:31.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.837+0000 7fc0c548e640 1 --2- 172.21.15.47:0/3126909017 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc0a803c730 0x7fc0a803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:31.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:31.837+0000 7fc0c548e640 1 --2- 172.21.15.47:0/3126909017 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc0a803c730 0x7fc0a803ebf0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc001d70 tx=0x7fc0bc0012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:32.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:32.755+0000 7fc0b5ffb640 1 -- 172.21.15.47:0/3126909017 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v14) ==== 141+0+0 (secure 0 0 0) 0x7fc0b8062070 con 0x560cb2aaea90 2024-09-12T17:27:32.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:32.755+0000 7fc0c71a1f00 1 -- 172.21.15.47:0/3126909017 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc0b804d610 con 0x560cb2aaea90 2024-09-12T17:27:32.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:32.757+0000 7fc0b5ffb640 1 -- 172.21.15.47:0/3126909017 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fc0b80067e0 con 0x560cb2aaea90 2024-09-12T17:27:32.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:32.757+0000 7fc0b7fff640 1 -- 172.21.15.47:0/3126909017 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=14}) -- 0x7fc0a4002ae0 con 0x560cb2aaea90 2024-09-12T17:27:32.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:32.760+0000 7fc0b5ffb640 1 -- 172.21.15.47:0/3126909017 <== mon.0 v2:172.21.15.47:3300/0 8 ==== osd_map(14..14 src has 1..14) ==== 650+0+0 (secure 0 0 0) 0x7fc0b8006380 con 0x560cb2aaea90 2024-09-12T17:27:32.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:32.760+0000 7fc0c71a1f00 1 --2- 172.21.15.47:0/3126909017 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x560cb2aafe30 0x560cb2b543c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:32.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:32.760+0000 7fc0c71a1f00 1 -- 172.21.15.47:0/3126909017 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14) -- 0x560cb2a9aa60 con 0x560cb2aafe30 2024-09-12T17:27:32.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:32.760+0000 7fc0c6ef1640 1 --2- 172.21.15.47:0/3126909017 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x560cb2aafe30 0x560cb2b543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:32.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:32.762+0000 7fc0c6ef1640 1 --2- 172.21.15.47:0/3126909017 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x560cb2aafe30 0x560cb2b543c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:32.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:32.763+0000 7fc0c6ef1640 1 -- 172.21.15.47:0/3126909017 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(1 rbd_trash [create] v14'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7fc0c0002040 con 0x560cb2aafe30 2024-09-12T17:27:32.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:32.766+0000 7fc0c71a1f00 1 -- 172.21.15.47:0/3126909017 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e14) -- 0x560cb2ba9f90 con 0x560cb2aafe30 2024-09-12T17:27:32.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:32.766+0000 7fc0c6ef1640 1 -- 172.21.15.47:0/3126909017 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc0c0002040 con 0x560cb2aafe30 2024-09-12T17:27:32.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:32.766+0000 7fc0c71a1f00 1 -- 172.21.15.47:0/3126909017 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e14) -- 0x560cb2ba90a0 con 0x560cb2aafe30 2024-09-12T17:27:32.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:32.766+0000 7fc0c6ef1640 1 -- 172.21.15.47:0/3126909017 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc0c0002040 con 0x560cb2aafe30 2024-09-12T17:27:32.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:32.766+0000 7fc0b77fe640 1 -- 172.21.15.47:0/3126909017 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7fc09c001f00 con 0x560cb2aaea90 2024-09-12T17:27:33.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:33.762+0000 7fc0b5ffb640 1 -- 172.21.15.47:0/3126909017 <== mon.0 v2:172.21.15.47:3300/0 9 ==== pool_op_reply(tid 4 (0) Success v15) ==== 55+0+0 (secure 0 0 0) 0x7fc0b8019080 con 0x560cb2aaea90 2024-09-12T17:27:33.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:33.762+0000 7fc0b5ffb640 1 -- 172.21.15.47:0/3126909017 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=15}) -- 0x7fc0a8042230 con 0x560cb2aaea90 2024-09-12T17:27:33.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:33.762+0000 7fc0b5ffb640 1 -- 172.21.15.47:0/3126909017 <== mon.0 v2:172.21.15.47:3300/0 10 ==== osd_map(15..15 src has 1..15) ==== 626+0+0 (secure 0 0 0) 0x7fc0b8087060 con 0x560cb2aaea90 2024-09-12T17:27:33.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:33.762+0000 7fc0b7fff640 1 -- 172.21.15.47:0/3126909017 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15) -- 0x7fc0a4005610 con 0x560cb2aafe30 2024-09-12T17:27:33.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:33.766+0000 7fc0c6ef1640 1 -- 172.21.15.47:0/3126909017 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v15'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc0c0002040 con 0x560cb2aafe30 2024-09-12T17:27:33.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:33.766+0000 7fc0b77fe640 1 -- 172.21.15.47:0/3126909017 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v15) -- 0x7fc09c003350 con 0x560cb2aaea90 2024-09-12T17:27:34.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.764+0000 7fc0b5ffb640 1 -- 172.21.15.47:0/3126909017 <== mon.0 v2:172.21.15.47:3300/0 11 ==== pool_op_reply(tid 6 (0) Success v16) ==== 43+0+0 (secure 0 0 0) 0x7fc0b801b300 con 0x560cb2aaea90 2024-09-12T17:27:34.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.764+0000 7fc0b5ffb640 1 -- 172.21.15.47:0/3126909017 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=16}) -- 0x7fc0a80422e0 con 0x560cb2aaea90 2024-09-12T17:27:34.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.764+0000 7fc0b5ffb640 1 -- 172.21.15.47:0/3126909017 <== mon.0 v2:172.21.15.47:3300/0 12 ==== osd_map(16..16 src has 1..16) ==== 654+0+0 (secure 0 0 0) 0x7fc0b805bd40 con 0x560cb2aaea90 2024-09-12T17:27:34.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.764+0000 7fc0b7fff640 1 -- 172.21.15.47:0/3126909017 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16) -- 0x7fc0a40059d0 con 0x560cb2aafe30 2024-09-12T17:27:34.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.769+0000 7fc0c6ef1640 1 -- 172.21.15.47:0/3126909017 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(7 rbd_info [write 0~19] v16'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0c0002040 con 0x560cb2aafe30 2024-09-12T17:27:34.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.770+0000 7fc0c71a1f00 1 -- 172.21.15.47:0/3126909017 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x560cb2aafe30 msgr2=0x560cb2b543c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:34.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.770+0000 7fc0c71a1f00 1 --2- 172.21.15.47:0/3126909017 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x560cb2aafe30 0x560cb2b543c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:34.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.770+0000 7fc0c71a1f00 1 -- 172.21.15.47:0/3126909017 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc0a803c730 msgr2=0x7fc0a803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:34.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.770+0000 7fc0c71a1f00 1 --2- 172.21.15.47:0/3126909017 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc0a803c730 0x7fc0a803ebf0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc001d70 tx=0x7fc0bc0012d0 comp rx=0 tx=0).stop 2024-09-12T17:27:34.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.770+0000 7fc0c71a1f00 1 -- 172.21.15.47:0/3126909017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560cb2aaea90 msgr2=0x560cb2b50630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:34.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.770+0000 7fc0c71a1f00 1 --2- 172.21.15.47:0/3126909017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560cb2aaea90 0x560cb2b50630 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc0b800a470 tx=0x7fc0b8002fb0 comp rx=0 tx=0).stop 2024-09-12T17:27:34.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.770+0000 7fc0c71a1f00 1 -- 172.21.15.47:0/3126909017 shutdown_connections 2024-09-12T17:27:34.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.770+0000 7fc0c71a1f00 1 --2- 172.21.15.47:0/3126909017 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x560cb2aafe30 0x560cb2b543c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:34.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.770+0000 7fc0c71a1f00 1 --2- 172.21.15.47:0/3126909017 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc0a803c730 0x7fc0a803ebf0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:34.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.770+0000 7fc0c71a1f00 1 --2- 172.21.15.47:0/3126909017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560cb2aaea90 0x560cb2b50630 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:34.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.770+0000 7fc0c71a1f00 1 -- 172.21.15.47:0/3126909017 >> 172.21.15.47:0/3126909017 conn(0x560cb2ab7d50 msgr2=0x560cb2b439f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:34.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.770+0000 7fc0c71a1f00 1 -- 172.21.15.47:0/3126909017 shutdown_connections 2024-09-12T17:27:34.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.770+0000 7fc0c71a1f00 1 -- 172.21.15.47:0/3126909017 wait complete. 2024-09-12T17:27:34.775 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T17:27:34.776 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-12T17:27:34.776 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T17:27:34.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.888+0000 7f46aaf64640 1 Processor -- start 2024-09-12T17:27:34.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.888+0000 7f46aaf64640 1 -- start start 2024-09-12T17:27:34.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.888+0000 7f46aaf64640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f46a409ec40 0x7f46a4132560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:34.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.888+0000 7f46aaf64640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46a4071de0 con 0x7f46a4070370 2024-09-12T17:27:34.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.888+0000 7f46aaf64640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f46a406dc30 con 0x7f46a409ec40 2024-09-12T17:27:34.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.888+0000 7f46a3fff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f46a409ec40 0x7f46a4132560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:34.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.888+0000 7f46a8d00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f46a4070370 0x7f46a4070750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:45880/0 (socket says 172.21.15.47:45880) 2024-09-12T17:27:34.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.888+0000 7f46a8d00640 1 -- 172.21.15.47:0/1902125712 learned_addr learned my addr 172.21.15.47:0/1902125712 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-09-12T17:27:34.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.889+0000 7f46a3fff640 1 -- 172.21.15.47:0/1902125712 >> v1:172.21.15.47:6789/0 conn(0x7f46a4070370 legacy=0x7f46a4070750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:34.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.889+0000 7f46a3fff640 1 -- 172.21.15.47:0/1902125712 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46a40721e0 con 0x7f46a409ec40 2024-09-12T17:27:34.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.889+0000 7f46a37fe640 1 -- 172.21.15.47:0/1902125712 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1443934159 0 0) 0x7f46a4071de0 con 0x7f46a4070370 2024-09-12T17:27:34.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.889+0000 7f46a3fff640 1 --2- 172.21.15.47:0/1902125712 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46a409ec40 0x7f46a4132560 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4690009720 tx=0x7f469002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97ab9837a6810f4f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:34.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.889+0000 7f46a37fe640 1 -- 172.21.15.47:0/1902125712 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4690037070 con 0x7f46a409ec40 2024-09-12T17:27:34.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.890+0000 7f46a37fe640 1 -- 172.21.15.47:0/1902125712 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f469002ae20 con 0x7f46a409ec40 2024-09-12T17:27:34.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.890+0000 7f46a37fe640 1 -- 172.21.15.47:0/1902125712 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4690032590 con 0x7f46a409ec40 2024-09-12T17:27:34.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.890+0000 7f46aaf64640 1 -- 172.21.15.47:0/1902125712 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46a409ec40 msgr2=0x7f46a4132560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:34.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.890+0000 7f46aaf64640 1 --2- 172.21.15.47:0/1902125712 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46a409ec40 0x7f46a4132560 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4690009720 tx=0x7f469002a1a0 comp rx=0 tx=0).stop 2024-09-12T17:27:34.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.890+0000 7f46aaf64640 1 -- 172.21.15.47:0/1902125712 shutdown_connections 2024-09-12T17:27:34.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.890+0000 7f46aaf64640 1 --2- 172.21.15.47:0/1902125712 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46a409ec40 0x7f46a4132560 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:34.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.890+0000 7f46aaf64640 1 -- 172.21.15.47:0/1902125712 >> 172.21.15.47:0/1902125712 conn(0x7f46a409c640 msgr2=0x7f46a406ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:34.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.890+0000 7f46aaf64640 1 -- 172.21.15.47:0/1902125712 shutdown_connections 2024-09-12T17:27:34.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.890+0000 7f46aaf64640 1 -- 172.21.15.47:0/1902125712 wait complete. 2024-09-12T17:27:34.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.891+0000 7f46aaf64640 1 Processor -- start 2024-09-12T17:27:34.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.891+0000 7f46aaf64640 1 -- start start 2024-09-12T17:27:34.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.892+0000 7f46aaf64640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46a4070370 0x7f46a41c3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:34.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.892+0000 7f46aaf64640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f46a4071070 con 0x7f46a4070370 2024-09-12T17:27:34.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.892+0000 7f46a8d00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46a4070370 0x7f46a41c3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:34.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.892+0000 7f46a8d00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46a4070370 0x7f46a41c3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35984/0 (socket says 172.21.15.47:35984) 2024-09-12T17:27:34.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.892+0000 7f46a8d00640 1 -- 172.21.15.47:0/2586431487 learned_addr learned my addr 172.21.15.47:0/2586431487 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:27:34.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.892+0000 7f46a8d00640 1 -- 172.21.15.47:0/2586431487 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46a411b830 con 0x7f46a4070370 2024-09-12T17:27:34.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.892+0000 7f46a8d00640 1 --2- 172.21.15.47:0/2586431487 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46a4070370 0x7f46a41c3d30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f469800c3d0 tx=0x7f469800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:34.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.892+0000 7f46a17fa640 1 -- 172.21.15.47:0/2586431487 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46980074d0 con 0x7f46a4070370 2024-09-12T17:27:34.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.892+0000 7f46a17fa640 1 -- 172.21.15.47:0/2586431487 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46980047e0 con 0x7f46a4070370 2024-09-12T17:27:34.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.892+0000 7f46aaf64640 1 -- 172.21.15.47:0/2586431487 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46a41163c0 con 0x7f46a4070370 2024-09-12T17:27:34.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.892+0000 7f46a17fa640 1 -- 172.21.15.47:0/2586431487 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4698007670 con 0x7f46a4070370 2024-09-12T17:27:34.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.892+0000 7f46aaf64640 1 -- 172.21.15.47:0/2586431487 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46a411b2a0 con 0x7f46a4070370 2024-09-12T17:27:34.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.893+0000 7f46a17fa640 1 -- 172.21.15.47:0/2586431487 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f4698011070 con 0x7f46a4070370 2024-09-12T17:27:34.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.893+0000 7f46a17fa640 1 --2- 172.21.15.47:0/2586431487 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f468803df10 0x7f46880403d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:34.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.893+0000 7f46aaf64640 1 -- 172.21.15.47:0/2586431487 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46a411bb50 con 0x7f46a4070370 2024-09-12T17:27:34.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.894+0000 7f46a17fa640 1 -- 172.21.15.47:0/2586431487 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f4698051ee0 con 0x7f46a4070370 2024-09-12T17:27:34.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.894+0000 7f46a3fff640 1 --2- 172.21.15.47:0/2586431487 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f468803df10 0x7f46880403d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:34.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.894+0000 7f46a3fff640 1 --2- 172.21.15.47:0/2586431487 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f468803df10 0x7f46880403d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4690009720 tx=0x7f469002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:34.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:34.898+0000 7f46a17fa640 1 -- 172.21.15.47:0/2586431487 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f4698012dd0 con 0x7f46a4070370 2024-09-12T17:27:35.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.084+0000 7f46aaf64640 1 -- 172.21.15.47:0/2586431487 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f46a4070750 con 0x7f46a4070370 2024-09-12T17:27:35.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.084+0000 7f46a17fa640 1 -- 172.21.15.47:0/2586431487 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v5) ==== 86+0+159 (secure 0 0 0) 0x7f4698050cf0 con 0x7f46a4070370 2024-09-12T17:27:35.086 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:27:35.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.086+0000 7f46aaf64640 1 -- 172.21.15.47:0/2586431487 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f468803df10 msgr2=0x7f46880403d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:35.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.086+0000 7f46aaf64640 1 --2- 172.21.15.47:0/2586431487 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f468803df10 0x7f46880403d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4690009720 tx=0x7f469002e000 comp rx=0 tx=0).stop 2024-09-12T17:27:35.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.086+0000 7f46aaf64640 1 -- 172.21.15.47:0/2586431487 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46a4070370 msgr2=0x7f46a41c3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:35.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.086+0000 7f46aaf64640 1 --2- 172.21.15.47:0/2586431487 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46a4070370 0x7f46a41c3d30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f469800c3d0 tx=0x7f469800c890 comp rx=0 tx=0).stop 2024-09-12T17:27:35.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.086+0000 7f46aaf64640 1 -- 172.21.15.47:0/2586431487 shutdown_connections 2024-09-12T17:27:35.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.086+0000 7f46aaf64640 1 --2- 172.21.15.47:0/2586431487 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f468803df10 0x7f46880403d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:35.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.086+0000 7f46aaf64640 1 --2- 172.21.15.47:0/2586431487 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46a4070370 0x7f46a41c3d30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:35.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.086+0000 7f46aaf64640 1 -- 172.21.15.47:0/2586431487 >> 172.21.15.47:0/2586431487 conn(0x7f46a409c640 msgr2=0x7f46a4127b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:35.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.086+0000 7f46aaf64640 1 -- 172.21.15.47:0/2586431487 shutdown_connections 2024-09-12T17:27:35.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.086+0000 7f46aaf64640 1 -- 172.21.15.47:0/2586431487 wait complete. 2024-09-12T17:27:35.098 INFO:teuthology.orchestra.run.smithi047.stdout:[{"version":5,"timestamp":"2024-09-12T17:27:24.449289+0000","name":"","changes":[{"name":"osd.3/osd_mclock_max_capacity_iops_ssd","new_value":"7758.068342"}]}] 2024-09-12T17:27:35.099 INFO:tasks.ceph_manager:config epoch is 5 2024-09-12T17:27:35.099 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T17:27:35.099 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T17:27:35.099 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T17:27:35.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.200+0000 7fc544e08640 1 Processor -- start 2024-09-12T17:27:35.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.200+0000 7fc544e08640 1 -- start start 2024-09-12T17:27:35.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.201+0000 7fc544e08640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc540129d80 0x7fc54012a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:35.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.201+0000 7fc544e08640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc54006dc00 con 0x7fc54012a6a0 2024-09-12T17:27:35.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.201+0000 7fc544e08640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fc5401299c0 con 0x7fc540129d80 2024-09-12T17:27:35.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.201+0000 7fc53e59c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc540129d80 0x7fc54012a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:35.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.201+0000 7fc53dd9b640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fc54012a6a0 0x7fc540110d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:45886/0 (socket says 172.21.15.47:45886) 2024-09-12T17:27:35.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.201+0000 7fc53dd9b640 1 -- 172.21.15.47:0/2828747197 learned_addr learned my addr 172.21.15.47:0/2828747197 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-09-12T17:27:35.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.201+0000 7fc53e59c640 1 -- 172.21.15.47:0/2828747197 >> v1:172.21.15.47:6789/0 conn(0x7fc54012a6a0 legacy=0x7fc540110d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:35.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.201+0000 7fc53e59c640 1 -- 172.21.15.47:0/2828747197 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc540114d20 con 0x7fc540129d80 2024-09-12T17:27:35.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.202+0000 7fc53e59c640 1 --2- 172.21.15.47:0/2828747197 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc540129d80 0x7fc54012a160 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc538009720 tx=0x7fc53802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6fe11eec8a406c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:35.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.202+0000 7fc53d59a640 1 -- 172.21.15.47:0/2828747197 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc538037070 con 0x7fc540129d80 2024-09-12T17:27:35.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.202+0000 7fc53d59a640 1 -- 172.21.15.47:0/2828747197 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc53802ad90 con 0x7fc540129d80 2024-09-12T17:27:35.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.202+0000 7fc53d59a640 1 -- 172.21.15.47:0/2828747197 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc538032590 con 0x7fc540129d80 2024-09-12T17:27:35.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.202+0000 7fc544e08640 1 -- 172.21.15.47:0/2828747197 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc540129d80 msgr2=0x7fc54012a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:35.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.202+0000 7fc544e08640 1 --2- 172.21.15.47:0/2828747197 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc540129d80 0x7fc54012a160 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc538009720 tx=0x7fc53802a110 comp rx=0 tx=0).stop 2024-09-12T17:27:35.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.202+0000 7fc544e08640 1 -- 172.21.15.47:0/2828747197 shutdown_connections 2024-09-12T17:27:35.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.202+0000 7fc544e08640 1 --2- 172.21.15.47:0/2828747197 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc540129d80 0x7fc54012a160 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:35.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.202+0000 7fc544e08640 1 -- 172.21.15.47:0/2828747197 >> 172.21.15.47:0/2828747197 conn(0x7fc540070850 msgr2=0x7fc540072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:35.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.203+0000 7fc544e08640 1 -- 172.21.15.47:0/2828747197 shutdown_connections 2024-09-12T17:27:35.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.203+0000 7fc544e08640 1 -- 172.21.15.47:0/2828747197 wait complete. 2024-09-12T17:27:35.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.203+0000 7fc544e08640 1 Processor -- start 2024-09-12T17:27:35.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.204+0000 7fc544e08640 1 -- start start 2024-09-12T17:27:35.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.204+0000 7fc544e08640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc540129d80 0x7fc5401c0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:35.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.204+0000 7fc544e08640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc540114940 con 0x7fc540129d80 2024-09-12T17:27:35.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.204+0000 7fc53e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc540129d80 0x7fc5401c0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:35.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.204+0000 7fc53e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc540129d80 0x7fc5401c0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35994/0 (socket says 172.21.15.47:35994) 2024-09-12T17:27:35.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.204+0000 7fc53e59c640 1 -- 172.21.15.47:0/896730636 learned_addr learned my addr 172.21.15.47:0/896730636 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:27:35.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.204+0000 7fc53e59c640 1 -- 172.21.15.47:0/896730636 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc54011fc10 con 0x7fc540129d80 2024-09-12T17:27:35.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.204+0000 7fc53e59c640 1 --2- 172.21.15.47:0/896730636 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc540129d80 0x7fc5401c0d70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc538009840 tx=0x7fc5380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:35.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.205+0000 7fc536ffd640 1 -- 172.21.15.47:0/896730636 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc538041020 con 0x7fc540129d80 2024-09-12T17:27:35.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.205+0000 7fc536ffd640 1 -- 172.21.15.47:0/896730636 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc53803d550 con 0x7fc540129d80 2024-09-12T17:27:35.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.205+0000 7fc544e08640 1 -- 172.21.15.47:0/896730636 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc54011fea0 con 0x7fc540129d80 2024-09-12T17:27:35.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.205+0000 7fc536ffd640 1 -- 172.21.15.47:0/896730636 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc538037040 con 0x7fc540129d80 2024-09-12T17:27:35.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.205+0000 7fc544e08640 1 -- 172.21.15.47:0/896730636 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5401c1490 con 0x7fc540129d80 2024-09-12T17:27:35.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.206+0000 7fc536ffd640 1 -- 172.21.15.47:0/896730636 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc538044020 con 0x7fc540129d80 2024-09-12T17:27:35.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.206+0000 7fc544e08640 1 -- 172.21.15.47:0/896730636 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5401119e0 con 0x7fc540129d80 2024-09-12T17:27:35.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.206+0000 7fc536ffd640 1 --2- 172.21.15.47:0/896730636 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc52003de90 0x7fc520040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:35.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.206+0000 7fc536ffd640 1 -- 172.21.15.47:0/896730636 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7fc538072960 con 0x7fc540129d80 2024-09-12T17:27:35.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.206+0000 7fc53dd9b640 1 --2- 172.21.15.47:0/896730636 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc52003de90 0x7fc520040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:35.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.207+0000 7fc53dd9b640 1 --2- 172.21.15.47:0/896730636 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc52003de90 0x7fc520040350 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc528007fd0 tx=0x7fc528007aa0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:35.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.211+0000 7fc536ffd640 1 -- 172.21.15.47:0/896730636 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7fc53804b030 con 0x7fc540129d80 2024-09-12T17:27:35.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.441+0000 7fc544e08640 1 -- 172.21.15.47:0/896730636 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fc540068da0 con 0x7fc540129d80 2024-09-12T17:27:35.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.443+0000 7fc536ffd640 1 -- 172.21.15.47:0/896730636 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+97045 (secure 0 0 0) 0x7fc53803cc60 con 0x7fc540129d80 2024-09-12T17:27:35.447 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:27:35.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.445+0000 7fc544e08640 1 -- 172.21.15.47:0/896730636 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc52003de90 msgr2=0x7fc520040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:35.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.445+0000 7fc544e08640 1 --2- 172.21.15.47:0/896730636 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc52003de90 0x7fc520040350 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc528007fd0 tx=0x7fc528007aa0 comp rx=0 tx=0).stop 2024-09-12T17:27:35.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.445+0000 7fc544e08640 1 -- 172.21.15.47:0/896730636 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc540129d80 msgr2=0x7fc5401c0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:35.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.445+0000 7fc544e08640 1 --2- 172.21.15.47:0/896730636 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc540129d80 0x7fc5401c0d70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc538009840 tx=0x7fc5380046c0 comp rx=0 tx=0).stop 2024-09-12T17:27:35.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.445+0000 7fc544e08640 1 -- 172.21.15.47:0/896730636 shutdown_connections 2024-09-12T17:27:35.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.445+0000 7fc544e08640 1 --2- 172.21.15.47:0/896730636 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc52003de90 0x7fc520040350 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:35.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.445+0000 7fc544e08640 1 --2- 172.21.15.47:0/896730636 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc540129d80 0x7fc5401c0d70 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:35.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.445+0000 7fc544e08640 1 -- 172.21.15.47:0/896730636 >> 172.21.15.47:0/896730636 conn(0x7fc540070850 msgr2=0x7fc540126310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:35.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.445+0000 7fc544e08640 1 -- 172.21.15.47:0/896730636 shutdown_connections 2024-09-12T17:27:35.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.445+0000 7fc544e08640 1 -- 172.21.15.47:0/896730636 wait complete. 2024-09-12T17:27:35.458 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":4146902489},{"type":"v1","addr":"172.21.15.170:6825","nonce":4146902489}]},"active_addr":"172.21.15.170:6825/4146902489","active_change":"2024-09-12T17:27:19.726724+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.170:0","nonce":2273310124}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.170:0","nonce":4074927300}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.170:0","nonce":124606738}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.170:0","nonce":1865479554}]}]} 2024-09-12T17:27:35.461 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T17:27:35.461 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T17:27:35.461 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T17:27:35.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.561+0000 7f72fcdd1640 1 Processor -- start 2024-09-12T17:27:35.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.561+0000 7f72fcdd1640 1 -- start start 2024-09-12T17:27:35.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.561+0000 7f72fcdd1640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f72f8129d80 0x7f72f812a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:35.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.561+0000 7f72fcdd1640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72f806dc00 con 0x7f72f812a6a0 2024-09-12T17:27:35.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.561+0000 7f72fcdd1640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f72f81299c0 con 0x7f72f8129d80 2024-09-12T17:27:35.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.561+0000 7f72f659c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f72f8129d80 0x7f72f812a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:35.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.561+0000 7f72f5d9b640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f72f812a6a0 0x7f72f8110d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:45894/0 (socket says 172.21.15.47:45894) 2024-09-12T17:27:35.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.561+0000 7f72f659c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f72f8129d80 0x7f72f812a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35998/0 (socket says 172.21.15.47:35998) 2024-09-12T17:27:35.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.561+0000 7f72f5d9b640 1 -- 172.21.15.47:0/3824294460 learned_addr learned my addr 172.21.15.47:0/3824294460 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-09-12T17:27:35.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.562+0000 7f72f659c640 1 -- 172.21.15.47:0/3824294460 >> v1:172.21.15.47:6789/0 conn(0x7f72f812a6a0 legacy=0x7f72f8110d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:35.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.562+0000 7f72f659c640 1 -- 172.21.15.47:0/3824294460 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f8114d20 con 0x7f72f8129d80 2024-09-12T17:27:35.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.562+0000 7f72f659c640 1 --2- 172.21.15.47:0/3824294460 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f72f8129d80 0x7f72f812a160 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f72f0009d90 tx=0x7f72f002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=615de02c2edafcd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:35.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.563+0000 7f72f559a640 1 -- 172.21.15.47:0/3824294460 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72f0007670 con 0x7f72f8129d80 2024-09-12T17:27:35.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.563+0000 7f72f559a640 1 -- 172.21.15.47:0/3824294460 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72f0007810 con 0x7f72f8129d80 2024-09-12T17:27:35.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.563+0000 7f72f559a640 1 -- 172.21.15.47:0/3824294460 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72f0007b10 con 0x7f72f8129d80 2024-09-12T17:27:35.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.563+0000 7f72fcdd1640 1 -- 172.21.15.47:0/3824294460 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f72f8129d80 msgr2=0x7f72f812a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:35.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.563+0000 7f72fcdd1640 1 --2- 172.21.15.47:0/3824294460 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f72f8129d80 0x7f72f812a160 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f72f0009d90 tx=0x7f72f002a660 comp rx=0 tx=0).stop 2024-09-12T17:27:35.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.563+0000 7f72fcdd1640 1 -- 172.21.15.47:0/3824294460 shutdown_connections 2024-09-12T17:27:35.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.563+0000 7f72fcdd1640 1 --2- 172.21.15.47:0/3824294460 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f72f8129d80 0x7f72f812a160 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:35.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.563+0000 7f72fcdd1640 1 -- 172.21.15.47:0/3824294460 >> 172.21.15.47:0/3824294460 conn(0x7f72f8070850 msgr2=0x7f72f8072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:35.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.563+0000 7f72fcdd1640 1 -- 172.21.15.47:0/3824294460 shutdown_connections 2024-09-12T17:27:35.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.563+0000 7f72fcdd1640 1 -- 172.21.15.47:0/3824294460 wait complete. 2024-09-12T17:27:35.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.564+0000 7f72fcdd1640 1 Processor -- start 2024-09-12T17:27:35.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.564+0000 7f72fcdd1640 1 -- start start 2024-09-12T17:27:35.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.565+0000 7f72fcdd1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f72f8129d80 0x7f72f811d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:35.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.565+0000 7f72fcdd1640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f72f8114940 con 0x7f72f8129d80 2024-09-12T17:27:35.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.565+0000 7f72f659c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f72f8129d80 0x7f72f811d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:35.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.565+0000 7f72f659c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f72f8129d80 0x7f72f811d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36002/0 (socket says 172.21.15.47:36002) 2024-09-12T17:27:35.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.565+0000 7f72f659c640 1 -- 172.21.15.47:0/1276806429 learned_addr learned my addr 172.21.15.47:0/1276806429 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:27:35.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.565+0000 7f72f659c640 1 -- 172.21.15.47:0/1276806429 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f811eab0 con 0x7f72f8129d80 2024-09-12T17:27:35.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.565+0000 7f72f659c640 1 --2- 172.21.15.47:0/1276806429 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f72f8129d80 0x7f72f811d520 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f72f0009d90 tx=0x7f72f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:35.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.565+0000 7f72eeffd640 1 -- 172.21.15.47:0/1276806429 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72f0040070 con 0x7f72f8129d80 2024-09-12T17:27:35.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.565+0000 7f72eeffd640 1 -- 172.21.15.47:0/1276806429 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72f0031a90 con 0x7f72f8129d80 2024-09-12T17:27:35.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.565+0000 7f72fcdd1640 1 -- 172.21.15.47:0/1276806429 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72f811f740 con 0x7f72f8129d80 2024-09-12T17:27:35.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.565+0000 7f72eeffd640 1 -- 172.21.15.47:0/1276806429 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72f0031d70 con 0x7f72f8129d80 2024-09-12T17:27:35.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.565+0000 7f72fcdd1640 1 -- 172.21.15.47:0/1276806429 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72f811fd90 con 0x7f72f8129d80 2024-09-12T17:27:35.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.566+0000 7f72eeffd640 1 -- 172.21.15.47:0/1276806429 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f72f0039040 con 0x7f72f8129d80 2024-09-12T17:27:35.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.566+0000 7f72eeffd640 1 --2- 172.21.15.47:0/1276806429 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f72d803de90 0x7f72d8040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:35.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.566+0000 7f72fcdd1640 1 -- 172.21.15.47:0/1276806429 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72f81119e0 con 0x7f72f8129d80 2024-09-12T17:27:35.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.566+0000 7f72eeffd640 1 -- 172.21.15.47:0/1276806429 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f72f002ae00 con 0x7f72f8129d80 2024-09-12T17:27:35.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.567+0000 7f72f5d9b640 1 --2- 172.21.15.47:0/1276806429 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f72d803de90 0x7f72d8040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:35.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.567+0000 7f72f5d9b640 1 --2- 172.21.15.47:0/1276806429 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f72d803de90 0x7f72d8040350 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f72e0007fd0 tx=0x7f72e0007aa0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:35.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.571+0000 7f72eeffd640 1 -- 172.21.15.47:0/1276806429 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f72f0073e20 con 0x7f72f8129d80 2024-09-12T17:27:35.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.755+0000 7f72fcdd1640 1 -- 172.21.15.47:0/1276806429 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f72f8068da0 con 0x7f72f8129d80 2024-09-12T17:27:35.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.756+0000 7f72eeffd640 1 -- 172.21.15.47:0/1276806429 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+9912 (secure 0 0 0) 0x7f72f003cc20 con 0x7f72f8129d80 2024-09-12T17:27:35.757 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:27:35.757 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":16,"fsid":"e43073ba-e4e6-405e-a192-e8c972c1bee5","created":"2024-09-12T17:27:15.406724+0000","modified":"2024-09-12T17:27:34.761705+0000","last_up_change":"2024-09-12T17:27:24.738801+0000","last_in_change":"2024-09-12T17:27:16.470942+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:27:23.745577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T17:27:30.967806+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d97fac4f-551d-416d-8b2b-e59c453a8d20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":3978157098},{"type":"v1","addr":"172.21.15.47:6801","nonce":3978157098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":3978157098},{"type":"v1","addr":"172.21.15.47:6803","nonce":3978157098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":3978157098},{"type":"v1","addr":"172.21.15.47:6807","nonce":3978157098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":3978157098},{"type":"v1","addr":"172.21.15.47:6805","nonce":3978157098}]},"public_addr":"172.21.15.47:6801/3978157098","cluster_addr":"172.21.15.47:6803/3978157098","heartbeat_back_addr":"172.21.15.47:6807/3978157098","heartbeat_front_addr":"172.21.15.47:6805/3978157098","state":["exists","up"]},{"osd":1,"uuid":"c128aa03-fca1-4254-92ef-e52ded72aae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1903654092},{"type":"v1","addr":"172.21.15.170:6801","nonce":1903654092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1903654092},{"type":"v1","addr":"172.21.15.170:6803","nonce":1903654092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1903654092},{"type":"v1","addr":"172.21.15.170:6807","nonce":1903654092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1903654092},{"type":"v1","addr":"172.21.15.170:6805","nonce":1903654092}]},"public_addr":"172.21.15.170:6801/1903654092","cluster_addr":"172.21.15.170:6803/1903654092","heartbeat_back_addr":"172.21.15.170:6807/1903654092","heartbeat_front_addr":"172.21.15.170:6805/1903654092","state":["exists","up"]},{"osd":2,"uuid":"06af30af-11dd-4c7c-9009-9d1c015bc547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3855567754},{"type":"v1","addr":"172.21.15.170:6809","nonce":3855567754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":3855567754},{"type":"v1","addr":"172.21.15.170:6811","nonce":3855567754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":3855567754},{"type":"v1","addr":"172.21.15.170:6815","nonce":3855567754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":3855567754},{"type":"v1","addr":"172.21.15.170:6813","nonce":3855567754}]},"public_addr":"172.21.15.170:6809/3855567754","cluster_addr":"172.21.15.170:6811/3855567754","heartbeat_back_addr":"172.21.15.170:6815/3855567754","heartbeat_front_addr":"172.21.15.170:6813/3855567754","state":["exists","up"]},{"osd":3,"uuid":"a6700a39-ad47-4fcc-a6b1-a0953f82883e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2664906588},{"type":"v1","addr":"172.21.15.170:6817","nonce":2664906588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2664906588},{"type":"v1","addr":"172.21.15.170:6819","nonce":2664906588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2664906588},{"type":"v1","addr":"172.21.15.170:6823","nonce":2664906588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2664906588},{"type":"v1","addr":"172.21.15.170:6821","nonce":2664906588}]},"public_addr":"172.21.15.170:6817/2664906588","cluster_addr":"172.21.15.170:6819/2664906588","heartbeat_back_addr":"172.21.15.170:6823/2664906588","heartbeat_front_addr":"172.21.15.170:6821/2664906588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:27:21.948935+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:27:22.508052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:27:22.007283+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:27:22.726262+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:27:35.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.758+0000 7f72fcdd1640 1 -- 172.21.15.47:0/1276806429 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f72d803de90 msgr2=0x7f72d8040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:35.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.758+0000 7f72fcdd1640 1 --2- 172.21.15.47:0/1276806429 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f72d803de90 0x7f72d8040350 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f72e0007fd0 tx=0x7f72e0007aa0 comp rx=0 tx=0).stop 2024-09-12T17:27:35.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.758+0000 7f72fcdd1640 1 -- 172.21.15.47:0/1276806429 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f72f8129d80 msgr2=0x7f72f811d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:35.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.758+0000 7f72fcdd1640 1 --2- 172.21.15.47:0/1276806429 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f72f8129d80 0x7f72f811d520 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f72f0009d90 tx=0x7f72f0004a40 comp rx=0 tx=0).stop 2024-09-12T17:27:35.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.758+0000 7f72fcdd1640 1 -- 172.21.15.47:0/1276806429 shutdown_connections 2024-09-12T17:27:35.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.758+0000 7f72fcdd1640 1 --2- 172.21.15.47:0/1276806429 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f72d803de90 0x7f72d8040350 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:35.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.758+0000 7f72fcdd1640 1 --2- 172.21.15.47:0/1276806429 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f72f8129d80 0x7f72f811d520 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:35.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.758+0000 7f72fcdd1640 1 -- 172.21.15.47:0/1276806429 >> 172.21.15.47:0/1276806429 conn(0x7f72f8070850 msgr2=0x7f72f8124300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:35.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.758+0000 7f72fcdd1640 1 -- 172.21.15.47:0/1276806429 shutdown_connections 2024-09-12T17:27:35.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.758+0000 7f72fcdd1640 1 -- 172.21.15.47:0/1276806429 wait complete. 2024-09-12T17:27:35.770 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T17:27:35.770 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T17:27:35.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.871+0000 7f9230c8e640 1 Processor -- start 2024-09-12T17:27:35.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.871+0000 7f9230c8e640 1 -- start start 2024-09-12T17:27:35.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.871+0000 7f9230c8e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f922c130270 0x7f922c132660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:35.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.871+0000 7f9230c8e640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f922c06dc00 con 0x7f922c129d80 2024-09-12T17:27:35.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.871+0000 7f9230c8e640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f922c1299c0 con 0x7f922c130270 2024-09-12T17:27:35.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.872+0000 7f9229d9b640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f922c130270 0x7f922c132660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:35.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.872+0000 7f922a59c640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f922c129d80 0x7f922c12a160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:45904/0 (socket says 172.21.15.47:45904) 2024-09-12T17:27:35.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.872+0000 7f922a59c640 1 -- 172.21.15.47:0/1295011087 learned_addr learned my addr 172.21.15.47:0/1295011087 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-09-12T17:27:35.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.872+0000 7f9229d9b640 1 -- 172.21.15.47:0/1295011087 >> v1:172.21.15.47:6789/0 conn(0x7f922c129d80 legacy=0x7f922c12a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:35.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.872+0000 7f9229d9b640 1 -- 172.21.15.47:0/1295011087 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f922c12a870 con 0x7f922c130270 2024-09-12T17:27:35.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.873+0000 7f9229d9b640 1 --2- 172.21.15.47:0/1295011087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f922c130270 0x7f922c132660 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9220009720 tx=0x7f922002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=553fd0604c14fb70 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:35.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.873+0000 7f922959a640 1 -- 172.21.15.47:0/1295011087 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9220037070 con 0x7f922c130270 2024-09-12T17:27:35.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.873+0000 7f922959a640 1 -- 172.21.15.47:0/1295011087 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f922002ad90 con 0x7f922c130270 2024-09-12T17:27:35.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.873+0000 7f922959a640 1 -- 172.21.15.47:0/1295011087 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9220032590 con 0x7f922c130270 2024-09-12T17:27:35.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.873+0000 7f9230c8e640 1 -- 172.21.15.47:0/1295011087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f922c130270 msgr2=0x7f922c132660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:35.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.873+0000 7f9230c8e640 1 --2- 172.21.15.47:0/1295011087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f922c130270 0x7f922c132660 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9220009720 tx=0x7f922002a110 comp rx=0 tx=0).stop 2024-09-12T17:27:35.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.873+0000 7f9230c8e640 1 -- 172.21.15.47:0/1295011087 shutdown_connections 2024-09-12T17:27:35.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.873+0000 7f9230c8e640 1 --2- 172.21.15.47:0/1295011087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f922c130270 0x7f922c132660 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:35.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.873+0000 7f9230c8e640 1 -- 172.21.15.47:0/1295011087 >> 172.21.15.47:0/1295011087 conn(0x7f922c070850 msgr2=0x7f922c072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:35.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.873+0000 7f9230c8e640 1 -- 172.21.15.47:0/1295011087 shutdown_connections 2024-09-12T17:27:35.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.873+0000 7f9230c8e640 1 -- 172.21.15.47:0/1295011087 wait complete. 2024-09-12T17:27:35.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.874+0000 7f9230c8e640 1 Processor -- start 2024-09-12T17:27:35.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.874+0000 7f9230c8e640 1 -- start start 2024-09-12T17:27:35.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.875+0000 7f9230c8e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f922c129d80 0x7f922c112730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:35.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.875+0000 7f9230c8e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f922c073a10 con 0x7f922c129d80 2024-09-12T17:27:35.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.875+0000 7f922a59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f922c129d80 0x7f922c112730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:35.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.875+0000 7f922a59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f922c129d80 0x7f922c112730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36010/0 (socket says 172.21.15.47:36010) 2024-09-12T17:27:35.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.875+0000 7f922a59c640 1 -- 172.21.15.47:0/177644117 learned_addr learned my addr 172.21.15.47:0/177644117 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:27:35.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.875+0000 7f922a59c640 1 -- 172.21.15.47:0/177644117 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f922c123de0 con 0x7f922c129d80 2024-09-12T17:27:35.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.875+0000 7f922a59c640 1 --2- 172.21.15.47:0/177644117 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f922c129d80 0x7f922c112730 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f921c00c480 tx=0x7f921c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:35.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.875+0000 7f921affd640 1 -- 172.21.15.47:0/177644117 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f921c017070 con 0x7f922c129d80 2024-09-12T17:27:35.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.875+0000 7f921affd640 1 -- 172.21.15.47:0/177644117 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f921c005c10 con 0x7f922c129d80 2024-09-12T17:27:35.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.875+0000 7f9230c8e640 1 -- 172.21.15.47:0/177644117 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f922c11a240 con 0x7f922c129d80 2024-09-12T17:27:35.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.875+0000 7f921affd640 1 -- 172.21.15.47:0/177644117 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f921c007070 con 0x7f922c129d80 2024-09-12T17:27:35.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.876+0000 7f9230c8e640 1 -- 172.21.15.47:0/177644117 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f922c112c70 con 0x7f922c129d80 2024-09-12T17:27:35.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.876+0000 7f921affd640 1 -- 172.21.15.47:0/177644117 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f921c01a070 con 0x7f922c129d80 2024-09-12T17:27:35.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.877+0000 7f9230c8e640 1 -- 172.21.15.47:0/177644117 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f922c11a010 con 0x7f922c129d80 2024-09-12T17:27:35.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.877+0000 7f921affd640 1 --2- 172.21.15.47:0/177644117 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f920c03de90 0x7f920c040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:35.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.877+0000 7f921affd640 1 -- 172.21.15.47:0/177644117 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f921c051470 con 0x7f922c129d80 2024-09-12T17:27:35.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.877+0000 7f9229d9b640 1 --2- 172.21.15.47:0/177644117 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f920c03de90 0x7f920c040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:35.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.877+0000 7f9229d9b640 1 --2- 172.21.15.47:0/177644117 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f920c03de90 0x7f920c040350 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9220034000 tx=0x7f922002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:35.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:35.881+0000 7f921affd640 1 -- 172.21.15.47:0/177644117 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f921c01ac60 con 0x7f922c129d80 2024-09-12T17:27:36.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.065+0000 7f9230c8e640 1 -- 172.21.15.47:0/177644117 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f922c12a160 con 0x7f922c129d80 2024-09-12T17:27:36.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.066+0000 7f921affd640 1 -- 172.21.15.47:0/177644117 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+9912 (secure 0 0 0) 0x7f921c019cd0 con 0x7f922c129d80 2024-09-12T17:27:36.068 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:27:36.068 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":16,"fsid":"e43073ba-e4e6-405e-a192-e8c972c1bee5","created":"2024-09-12T17:27:15.406724+0000","modified":"2024-09-12T17:27:34.761705+0000","last_up_change":"2024-09-12T17:27:24.738801+0000","last_in_change":"2024-09-12T17:27:16.470942+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:27:23.745577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T17:27:30.967806+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d97fac4f-551d-416d-8b2b-e59c453a8d20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":3978157098},{"type":"v1","addr":"172.21.15.47:6801","nonce":3978157098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":3978157098},{"type":"v1","addr":"172.21.15.47:6803","nonce":3978157098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":3978157098},{"type":"v1","addr":"172.21.15.47:6807","nonce":3978157098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":3978157098},{"type":"v1","addr":"172.21.15.47:6805","nonce":3978157098}]},"public_addr":"172.21.15.47:6801/3978157098","cluster_addr":"172.21.15.47:6803/3978157098","heartbeat_back_addr":"172.21.15.47:6807/3978157098","heartbeat_front_addr":"172.21.15.47:6805/3978157098","state":["exists","up"]},{"osd":1,"uuid":"c128aa03-fca1-4254-92ef-e52ded72aae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1903654092},{"type":"v1","addr":"172.21.15.170:6801","nonce":1903654092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1903654092},{"type":"v1","addr":"172.21.15.170:6803","nonce":1903654092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1903654092},{"type":"v1","addr":"172.21.15.170:6807","nonce":1903654092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1903654092},{"type":"v1","addr":"172.21.15.170:6805","nonce":1903654092}]},"public_addr":"172.21.15.170:6801/1903654092","cluster_addr":"172.21.15.170:6803/1903654092","heartbeat_back_addr":"172.21.15.170:6807/1903654092","heartbeat_front_addr":"172.21.15.170:6805/1903654092","state":["exists","up"]},{"osd":2,"uuid":"06af30af-11dd-4c7c-9009-9d1c015bc547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3855567754},{"type":"v1","addr":"172.21.15.170:6809","nonce":3855567754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":3855567754},{"type":"v1","addr":"172.21.15.170:6811","nonce":3855567754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":3855567754},{"type":"v1","addr":"172.21.15.170:6815","nonce":3855567754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":3855567754},{"type":"v1","addr":"172.21.15.170:6813","nonce":3855567754}]},"public_addr":"172.21.15.170:6809/3855567754","cluster_addr":"172.21.15.170:6811/3855567754","heartbeat_back_addr":"172.21.15.170:6815/3855567754","heartbeat_front_addr":"172.21.15.170:6813/3855567754","state":["exists","up"]},{"osd":3,"uuid":"a6700a39-ad47-4fcc-a6b1-a0953f82883e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2664906588},{"type":"v1","addr":"172.21.15.170:6817","nonce":2664906588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2664906588},{"type":"v1","addr":"172.21.15.170:6819","nonce":2664906588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2664906588},{"type":"v1","addr":"172.21.15.170:6823","nonce":2664906588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2664906588},{"type":"v1","addr":"172.21.15.170:6821","nonce":2664906588}]},"public_addr":"172.21.15.170:6817/2664906588","cluster_addr":"172.21.15.170:6819/2664906588","heartbeat_back_addr":"172.21.15.170:6823/2664906588","heartbeat_front_addr":"172.21.15.170:6821/2664906588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:27:21.948935+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:27:22.508052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:27:22.007283+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:27:22.726262+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:27:36.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.068+0000 7f9230c8e640 1 -- 172.21.15.47:0/177644117 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f920c03de90 msgr2=0x7f920c040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:36.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.068+0000 7f9230c8e640 1 --2- 172.21.15.47:0/177644117 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f920c03de90 0x7f920c040350 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9220034000 tx=0x7f922002e000 comp rx=0 tx=0).stop 2024-09-12T17:27:36.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.068+0000 7f9230c8e640 1 -- 172.21.15.47:0/177644117 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f922c129d80 msgr2=0x7f922c112730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:36.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.068+0000 7f9230c8e640 1 --2- 172.21.15.47:0/177644117 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f922c129d80 0x7f922c112730 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f921c00c480 tx=0x7f921c00c940 comp rx=0 tx=0).stop 2024-09-12T17:27:36.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.068+0000 7f9230c8e640 1 -- 172.21.15.47:0/177644117 shutdown_connections 2024-09-12T17:27:36.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.068+0000 7f9230c8e640 1 --2- 172.21.15.47:0/177644117 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f920c03de90 0x7f920c040350 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.068+0000 7f9230c8e640 1 --2- 172.21.15.47:0/177644117 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f922c129d80 0x7f922c112730 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.068+0000 7f9230c8e640 1 -- 172.21.15.47:0/177644117 >> 172.21.15.47:0/177644117 conn(0x7f922c070850 msgr2=0x7f922c1284b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:36.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.068+0000 7f9230c8e640 1 -- 172.21.15.47:0/177644117 shutdown_connections 2024-09-12T17:27:36.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.068+0000 7f9230c8e640 1 -- 172.21.15.47:0/177644117 wait complete. 2024-09-12T17:27:36.081 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T17:27:36.082 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T17:27:36.082 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T17:27:36.083 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T17:27:36.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.188+0000 7f0cf80cd640 1 Processor -- start 2024-09-12T17:27:36.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.188+0000 7fd78d6a9640 1 Processor -- start 2024-09-12T17:27:36.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.189+0000 7fd78d6a9640 1 -- start start 2024-09-12T17:27:36.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.189+0000 7f0cf80cd640 1 -- start start 2024-09-12T17:27:36.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.189+0000 7f2135c08640 1 Processor -- start 2024-09-12T17:27:36.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.189+0000 7f3ba034c640 1 Processor -- start 2024-09-12T17:27:36.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.189+0000 7f2135c08640 1 -- start start 2024-09-12T17:27:36.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.189+0000 7f3ba034c640 1 -- start start 2024-09-12T17:27:36.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.189+0000 7f0cf80cd640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f0cf009c150 0x7f0cf009c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:36.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.189+0000 7fd78d6a9640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd788125890 0x7fd788125c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:36.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.189+0000 7f0cf80cd640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cf00739d0 con 0x7f0cf009ca70 2024-09-12T17:27:36.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.189+0000 7f0cf80cd640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f0cf009fd70 con 0x7f0cf009c150 2024-09-12T17:27:36.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.189+0000 7fd78d6a9640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd78806fe70 con 0x7fd78806ed40 2024-09-12T17:27:36.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.189+0000 7fd78d6a9640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fd788117030 con 0x7fd788125890 2024-09-12T17:27:36.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.189+0000 7f0cf5e69640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f0cf009c150 0x7f0cf009c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:36.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.190+0000 7f0cf5e69640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f0cf009c150 0x7f0cf009c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36022/0 (socket says 172.21.15.47:36022) 2024-09-12T17:27:36.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.190+0000 7f0cf5e69640 1 -- 172.21.15.47:0/4027053333 learned_addr learned my addr 172.21.15.47:0/4027053333 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:27:36.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.190+0000 7fd7867fc640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fd78806ed40 0x7fd78806f150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:45916/0 (socket says 172.21.15.47:45916) 2024-09-12T17:27:36.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.190+0000 7fd7867fc640 1 -- 172.21.15.47:0/1148927991 learned_addr learned my addr 172.21.15.47:0/1148927991 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-09-12T17:27:36.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.190+0000 7fd786ffd640 1 --2- 172.21.15.47:0/1148927991 >> v2:172.21.15.47:3300/0 conn(0x7fd788125890 0x7fd788125c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:36.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.190+0000 7f2135c08640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2130132640 0x7f2130134a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:36.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.190+0000 7f2135c08640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2130116b80 con 0x7f213012c0d0 2024-09-12T17:27:36.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.190+0000 7f3ba034c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3b9812c2e0 0x7f3b9812c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:36.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.190+0000 7f3ba034c640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b9809d900 con 0x7f3b9809dfe0 2024-09-12T17:27:36.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.190+0000 7f3ba034c640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f3b9809e870 con 0x7f3b9812c2e0 2024-09-12T17:27:36.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.190+0000 7f2135c08640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f2130070ce0 con 0x7f2130132640 2024-09-12T17:27:36.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.190+0000 7f0cf5e69640 1 -- 172.21.15.47:0/4027053333 >> v1:172.21.15.47:6789/0 conn(0x7f0cf009ca70 legacy=0x7f0cf0128b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:36.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.190+0000 7f212f7fe640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f213012c0d0 0x7f213012c4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:45938/0 (socket says 172.21.15.47:45938) 2024-09-12T17:27:36.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.190+0000 7fd786ffd640 1 -- 172.21.15.47:0/1148927991 >> v1:172.21.15.47:6789/0 conn(0x7fd78806ed40 legacy=0x7fd78806f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:36.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.190+0000 7f212f7fe640 1 -- 172.21.15.47:0/2914497974 learned_addr learned my addr 172.21.15.47:0/2914497974 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-09-12T17:27:36.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.190+0000 7f0cf5e69640 1 -- 172.21.15.47:0/4027053333 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cf009d610 con 0x7f0cf009c150 2024-09-12T17:27:36.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.190+0000 7fd785ffb640 1 -- 172.21.15.47:0/1148927991 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2249829106 0 0) 0x7fd78806fe70 con 0x7fd78806ed40 2024-09-12T17:27:36.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.190+0000 7fd786ffd640 1 -- 172.21.15.47:0/1148927991 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd788116c90 con 0x7fd788125890 2024-09-12T17:27:36.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.190+0000 7f3b9d8e7640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f3b9809dfe0 0x7f3b9812cc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:45946/0 (socket says 172.21.15.47:45946) 2024-09-12T17:27:36.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.190+0000 7f3b9d8e7640 1 -- 172.21.15.47:0/3880339897 learned_addr learned my addr 172.21.15.47:0/3880339897 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-09-12T17:27:36.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.190+0000 7f3b9e0e8640 1 --2- 172.21.15.47:0/3880339897 >> v2:172.21.15.47:3300/0 conn(0x7f3b9812c2e0 0x7f3b9812c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:36.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.190+0000 7f212effd640 1 --2- 172.21.15.47:0/2914497974 >> v2:172.21.15.47:3300/0 conn(0x7f2130132640 0x7f2130134a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:36.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.190+0000 7f212e7fc640 1 -- 172.21.15.47:0/2914497974 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 635135119 0 0) 0x7f2130116b80 con 0x7f213012c0d0 2024-09-12T17:27:36.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.191+0000 7f3b9d0e6640 1 -- 172.21.15.47:0/3880339897 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1044309837 0 0) 0x7f3b9809d900 con 0x7f3b9809dfe0 2024-09-12T17:27:36.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.191+0000 7f3b9d0e6640 1 -- 172.21.15.47:0/3880339897 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b84003520 con 0x7f3b9809dfe0 2024-09-12T17:27:36.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.191+0000 7f212e7fc640 1 -- 172.21.15.47:0/2914497974 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2118003520 con 0x7f213012c0d0 2024-09-12T17:27:36.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.191+0000 7f212effd640 1 -- 172.21.15.47:0/2914497974 >> v1:172.21.15.47:6789/0 conn(0x7f213012c0d0 legacy=0x7f213012c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:36.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.191+0000 7f212effd640 1 -- 172.21.15.47:0/2914497974 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f213012cbc0 con 0x7f2130132640 2024-09-12T17:27:36.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.191+0000 7f0cf5e69640 1 --2- 172.21.15.47:0/4027053333 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0cf009c150 0x7f0cf009c530 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0cec0097f0 tx=0x7f0cec02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6102fc77120f8b27 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:36.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.191+0000 7f3b9e0e8640 1 -- 172.21.15.47:0/3880339897 >> v1:172.21.15.47:6789/0 conn(0x7f3b9809dfe0 legacy=0x7f3b9812cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:36.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.191+0000 7f3b9e0e8640 1 -- 172.21.15.47:0/3880339897 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b98132610 con 0x7f3b9812c2e0 2024-09-12T17:27:36.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.191+0000 7fd786ffd640 1 --2- 172.21.15.47:0/1148927991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd788125890 0x7fd788125c70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd778009720 tx=0x7fd77802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=780d4c1d81ccdc6a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:36.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.191+0000 7f0cf4e67640 1 -- 172.21.15.47:0/4027053333 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cec037070 con 0x7f0cf009c150 2024-09-12T17:27:36.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.191+0000 7f0cf4e67640 1 -- 172.21.15.47:0/4027053333 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cec032440 con 0x7f0cf009c150 2024-09-12T17:27:36.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.191+0000 7fd785ffb640 1 -- 172.21.15.47:0/1148927991 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd778037070 con 0x7fd788125890 2024-09-12T17:27:36.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.191+0000 7fd785ffb640 1 -- 172.21.15.47:0/1148927991 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd77802ae20 con 0x7fd788125890 2024-09-12T17:27:36.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.192+0000 7fd785ffb640 1 -- 172.21.15.47:0/1148927991 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd778032590 con 0x7fd788125890 2024-09-12T17:27:36.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.192+0000 7f0cf4e67640 1 -- 172.21.15.47:0/4027053333 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cec02ae60 con 0x7f0cf009c150 2024-09-12T17:27:36.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.192+0000 7f3b9e0e8640 1 --2- 172.21.15.47:0/3880339897 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b9812c2e0 0x7f3b9812c6c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3b94009720 tx=0x7f3b9402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de4eb9510b99ba95 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:36.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.192+0000 7f212effd640 1 --2- 172.21.15.47:0/2914497974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2130132640 0x7f2130134a30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2124009720 tx=0x7f212402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60bfa186070dee38 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:36.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.192+0000 7f212e7fc640 1 -- 172.21.15.47:0/2914497974 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2124037070 con 0x7f2130132640 2024-09-12T17:27:36.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.192+0000 7f3b9d0e6640 1 -- 172.21.15.47:0/3880339897 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b94037070 con 0x7f3b9812c2e0 2024-09-12T17:27:36.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.192+0000 7f3b9d0e6640 1 -- 172.21.15.47:0/3880339897 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b9402ad90 con 0x7f3b9812c2e0 2024-09-12T17:27:36.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.192+0000 7f3b9d0e6640 1 -- 172.21.15.47:0/3880339897 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b94032590 con 0x7f3b9812c2e0 2024-09-12T17:27:36.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.192+0000 7f212e7fc640 1 -- 172.21.15.47:0/2914497974 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f212402ae20 con 0x7f2130132640 2024-09-12T17:27:36.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.192+0000 7f212e7fc640 1 -- 172.21.15.47:0/2914497974 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2124032590 con 0x7f2130132640 2024-09-12T17:27:36.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.192+0000 7f0cf80cd640 1 -- 172.21.15.47:0/4027053333 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0cf009c150 msgr2=0x7f0cf009c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:36.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.192+0000 7f0cf80cd640 1 --2- 172.21.15.47:0/4027053333 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0cf009c150 0x7f0cf009c530 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0cec0097f0 tx=0x7f0cec02a1e0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.192+0000 7f0cf80cd640 1 -- 172.21.15.47:0/4027053333 shutdown_connections 2024-09-12T17:27:36.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.192+0000 7f0cf80cd640 1 --2- 172.21.15.47:0/4027053333 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0cf009c150 0x7f0cf009c530 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.192+0000 7f0cf80cd640 1 -- 172.21.15.47:0/4027053333 >> 172.21.15.47:0/4027053333 conn(0x7f0cf00715b0 msgr2=0x7f0cf009aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:36.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.192+0000 7fd78d6a9640 1 -- 172.21.15.47:0/1148927991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd788125890 msgr2=0x7fd788125c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:36.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.193+0000 7fd78d6a9640 1 --2- 172.21.15.47:0/1148927991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd788125890 0x7fd788125c70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd778009720 tx=0x7fd77802a1a0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.193+0000 7f0cf80cd640 1 -- 172.21.15.47:0/4027053333 shutdown_connections 2024-09-12T17:27:36.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.193+0000 7f0cf80cd640 1 -- 172.21.15.47:0/4027053333 wait complete. 2024-09-12T17:27:36.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.193+0000 7fd78d6a9640 1 -- 172.21.15.47:0/1148927991 shutdown_connections 2024-09-12T17:27:36.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.193+0000 7fd78d6a9640 1 --2- 172.21.15.47:0/1148927991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd788125890 0x7fd788125c70 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.193+0000 7fd78d6a9640 1 -- 172.21.15.47:0/1148927991 >> 172.21.15.47:0/1148927991 conn(0x7fd788071580 msgr2=0x7fd78809aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:36.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.193+0000 7f3ba034c640 1 -- 172.21.15.47:0/3880339897 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b9812c2e0 msgr2=0x7f3b9812c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:36.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.193+0000 7f3ba034c640 1 --2- 172.21.15.47:0/3880339897 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b9812c2e0 0x7f3b9812c6c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3b94009720 tx=0x7f3b9402a110 comp rx=0 tx=0).stop 2024-09-12T17:27:36.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.193+0000 7fd78d6a9640 1 -- 172.21.15.47:0/1148927991 shutdown_connections 2024-09-12T17:27:36.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.193+0000 7fd78d6a9640 1 -- 172.21.15.47:0/1148927991 wait complete. 2024-09-12T17:27:36.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.193+0000 7f3ba034c640 1 -- 172.21.15.47:0/3880339897 shutdown_connections 2024-09-12T17:27:36.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.193+0000 7f3ba034c640 1 --2- 172.21.15.47:0/3880339897 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b9812c2e0 0x7f3b9812c6c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.193+0000 7f3ba034c640 1 -- 172.21.15.47:0/3880339897 >> 172.21.15.47:0/3880339897 conn(0x7f3b980715a0 msgr2=0x7f3b9809aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:36.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.193+0000 7f3ba034c640 1 -- 172.21.15.47:0/3880339897 shutdown_connections 2024-09-12T17:27:36.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.193+0000 7f3ba034c640 1 -- 172.21.15.47:0/3880339897 wait complete. 2024-09-12T17:27:36.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.193+0000 7f2135c08640 1 -- 172.21.15.47:0/2914497974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2130132640 msgr2=0x7f2130134a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:36.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.193+0000 7f2135c08640 1 --2- 172.21.15.47:0/2914497974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2130132640 0x7f2130134a30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2124009720 tx=0x7f212402a1a0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.193+0000 7f2135c08640 1 -- 172.21.15.47:0/2914497974 shutdown_connections 2024-09-12T17:27:36.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.193+0000 7f2135c08640 1 --2- 172.21.15.47:0/2914497974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2130132640 0x7f2130134a30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.193+0000 7f2135c08640 1 -- 172.21.15.47:0/2914497974 >> 172.21.15.47:0/2914497974 conn(0x7f2130071790 msgr2=0x7f213009aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:36.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.194+0000 7f2135c08640 1 -- 172.21.15.47:0/2914497974 shutdown_connections 2024-09-12T17:27:36.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.194+0000 7f0cf80cd640 1 Processor -- start 2024-09-12T17:27:36.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.194+0000 7f3ba034c640 1 Processor -- start 2024-09-12T17:27:36.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.194+0000 7f0cf80cd640 1 -- start start 2024-09-12T17:27:36.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.194+0000 7f3ba034c640 1 -- start start 2024-09-12T17:27:36.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.194+0000 7f2135c08640 1 -- 172.21.15.47:0/2914497974 wait complete. 2024-09-12T17:27:36.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.194+0000 7fd78d6a9640 1 Processor -- start 2024-09-12T17:27:36.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.194+0000 7f0cf80cd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0cf009c150 0x7f0cf011d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:36.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.194+0000 7f0cf80cd640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf006de10 con 0x7f0cf009c150 2024-09-12T17:27:36.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.194+0000 7fd78d6a9640 1 -- start start 2024-09-12T17:27:36.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.194+0000 7f0cf5e69640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0cf009c150 0x7f0cf011d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:36.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.195+0000 7f0cf5e69640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0cf009c150 0x7f0cf011d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36058/0 (socket says 172.21.15.47:36058) 2024-09-12T17:27:36.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.195+0000 7f0cf5e69640 1 -- 172.21.15.47:0/334204606 learned_addr learned my addr 172.21.15.47:0/334204606 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:27:36.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.195+0000 7f3ba034c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b9809dfe0 0x7f3b98115d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:36.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.195+0000 7f3ba034c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3b98131990 con 0x7f3b9809dfe0 2024-09-12T17:27:36.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.195+0000 7f3b9e0e8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b9809dfe0 0x7f3b98115d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:36.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.195+0000 7f3b9e0e8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b9809dfe0 0x7f3b98115d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36064/0 (socket says 172.21.15.47:36064) 2024-09-12T17:27:36.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.195+0000 7f3b9e0e8640 1 -- 172.21.15.47:0/1738795591 learned_addr learned my addr 172.21.15.47:0/1738795591 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:27:36.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.195+0000 7f0cf5e69640 1 -- 172.21.15.47:0/334204606 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cf0120550 con 0x7f0cf009c150 2024-09-12T17:27:36.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.195+0000 7fd78d6a9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd78806ed40 0x7fd7881c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:36.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.195+0000 7fd78d6a9640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd7881261b0 con 0x7fd78806ed40 2024-09-12T17:27:36.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.195+0000 7f2135c08640 1 Processor -- start 2024-09-12T17:27:36.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.195+0000 7fd786ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd78806ed40 0x7fd7881c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:36.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.195+0000 7fd786ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd78806ed40 0x7fd7881c40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36068/0 (socket says 172.21.15.47:36068) 2024-09-12T17:27:36.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.195+0000 7f3b9e0e8640 1 -- 172.21.15.47:0/1738795591 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b98118a50 con 0x7f3b9809dfe0 2024-09-12T17:27:36.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.195+0000 7f0cf5e69640 1 --2- 172.21.15.47:0/334204606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0cf009c150 0x7f0cf011d200 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0cec035040 tx=0x7f0cec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:36.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.195+0000 7fd786ffd640 1 -- 172.21.15.47:0/3187654728 learned_addr learned my addr 172.21.15.47:0/3187654728 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:27:36.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.195+0000 7f2135c08640 1 -- start start 2024-09-12T17:27:36.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.196+0000 7f0ce67fc640 1 -- 172.21.15.47:0/334204606 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cec041070 con 0x7f0cf009c150 2024-09-12T17:27:36.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.196+0000 7fd786ffd640 1 -- 172.21.15.47:0/3187654728 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7881299b0 con 0x7fd78806ed40 2024-09-12T17:27:36.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.196+0000 7f3b9e0e8640 1 --2- 172.21.15.47:0/1738795591 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b9809dfe0 0x7f3b98115d90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3b94000c00 tx=0x7f3b940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:36.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.196+0000 7f0ce67fc640 1 -- 172.21.15.47:0/334204606 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cec03c7a0 con 0x7f0cf009c150 2024-09-12T17:27:36.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.196+0000 7f0cf80cd640 1 -- 172.21.15.47:0/334204606 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cf011eba0 con 0x7f0cf009c150 2024-09-12T17:27:36.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.196+0000 7f0ce67fc640 1 -- 172.21.15.47:0/334204606 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cec037040 con 0x7f0cf009c150 2024-09-12T17:27:36.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.196+0000 7f3b8effd640 1 -- 172.21.15.47:0/1738795591 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b94037040 con 0x7f3b9809dfe0 2024-09-12T17:27:36.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.196+0000 7f3b8effd640 1 -- 172.21.15.47:0/1738795591 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b94042070 con 0x7f3b9809dfe0 2024-09-12T17:27:36.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.196+0000 7f3b8effd640 1 -- 172.21.15.47:0/1738795591 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b9403d590 con 0x7f3b9809dfe0 2024-09-12T17:27:36.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.196+0000 7f3ba034c640 1 -- 172.21.15.47:0/1738795591 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b98118320 con 0x7f3b9809dfe0 2024-09-12T17:27:36.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.196+0000 7f2135c08640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f213012c0d0 0x7f21301172d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:36.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.196+0000 7f2135c08640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f21300a07b0 con 0x7f213012c0d0 2024-09-12T17:27:36.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.196+0000 7fd786ffd640 1 --2- 172.21.15.47:0/3187654728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd78806ed40 0x7fd7881c40e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd77802a1e0 tx=0x7fd7780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:36.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.196+0000 7f3ba034c640 1 -- 172.21.15.47:0/1738795591 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b981262d0 con 0x7f3b9809dfe0 2024-09-12T17:27:36.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.196+0000 7f212f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f213012c0d0 0x7f21301172d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:36.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.196+0000 7f212f7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f213012c0d0 0x7f21301172d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36078/0 (socket says 172.21.15.47:36078) 2024-09-12T17:27:36.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.196+0000 7f212f7fe640 1 -- 172.21.15.47:0/2892578313 learned_addr learned my addr 172.21.15.47:0/2892578313 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:27:36.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.196+0000 7f0cf80cd640 1 -- 172.21.15.47:0/334204606 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cf011f880 con 0x7f0cf009c150 2024-09-12T17:27:36.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.196+0000 7fd76f7fe640 1 -- 172.21.15.47:0/3187654728 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd778042070 con 0x7fd78806ed40 2024-09-12T17:27:36.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.197+0000 7fd76f7fe640 1 -- 172.21.15.47:0/3187654728 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd77803e590 con 0x7fd78806ed40 2024-09-12T17:27:36.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.197+0000 7fd76f7fe640 1 -- 172.21.15.47:0/3187654728 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd778037040 con 0x7fd78806ed40 2024-09-12T17:27:36.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.197+0000 7fd78d6a9640 1 -- 172.21.15.47:0/3187654728 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd78811cc50 con 0x7fd78806ed40 2024-09-12T17:27:36.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.197+0000 7f212f7fe640 1 -- 172.21.15.47:0/2892578313 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21301314c0 con 0x7f213012c0d0 2024-09-12T17:27:36.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.197+0000 7fd78d6a9640 1 -- 172.21.15.47:0/3187654728 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7881c4800 con 0x7fd78806ed40 2024-09-12T17:27:36.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.197+0000 7f212f7fe640 1 --2- 172.21.15.47:0/2892578313 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f213012c0d0 0x7f21301172d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f212000c480 tx=0x7f212000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:36.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.197+0000 7f0cd3fff640 1 -- 172.21.15.47:0/334204606 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0cf009c530 con 0x7f0cf009c150 2024-09-12T17:27:36.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.197+0000 7f3ba034c640 1 -- 172.21.15.47:0/1738795591 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3b98126550 con 0x7f3b9809dfe0 2024-09-12T17:27:36.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.197+0000 7f3b8effd640 1 -- 172.21.15.47:0/1738795591 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3b9403d730 con 0x7f3b9809dfe0 2024-09-12T17:27:36.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.198+0000 7f2117fff640 1 -- 172.21.15.47:0/2892578313 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2120017070 con 0x7f213012c0d0 2024-09-12T17:27:36.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.198+0000 7f2135c08640 1 -- 172.21.15.47:0/2892578313 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2130129a20 con 0x7f213012c0d0 2024-09-12T17:27:36.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.198+0000 7f3b8effd640 1 --2- 172.21.15.47:0/1738795591 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3b7c03dee0 0x7f3b7c0403a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:36.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.198+0000 7f3b8effd640 1 -- 172.21.15.47:0/1738795591 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f3b94072970 con 0x7f3b9809dfe0 2024-09-12T17:27:36.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.198+0000 7f3b8effd640 1 --2- 172.21.15.47:0/1738795591 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x7f3b7c043660 0x7f3b7c045ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:36.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.198+0000 7f3b8effd640 1 -- 172.21.15.47:0/1738795591 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3b94001d30 con 0x7f3b7c043660 2024-09-12T17:27:36.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.198+0000 7fd78d6a9640 1 -- 172.21.15.47:0/3187654728 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd788075cc0 con 0x7fd78806ed40 2024-09-12T17:27:36.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.198+0000 7f3b8effd640 1 -- 172.21.15.47:0/1738795591 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f3b9403aba0 con 0x7f3b9809dfe0 2024-09-12T17:27:36.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.198+0000 7fd76f7fe640 1 -- 172.21.15.47:0/3187654728 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fd778045070 con 0x7fd78806ed40 2024-09-12T17:27:36.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.198+0000 7f2135c08640 1 -- 172.21.15.47:0/2892578313 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2130119030 con 0x7f213012c0d0 2024-09-12T17:27:36.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.198+0000 7f3b9e8e9640 1 --2- 172.21.15.47:0/1738795591 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x7f3b7c043660 0x7f3b7c045ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:36.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.198+0000 7f3b9d8e7640 1 --2- 172.21.15.47:0/1738795591 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3b7c03dee0 0x7f3b7c0403a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:36.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.198+0000 7f2117fff640 1 -- 172.21.15.47:0/2892578313 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2120005cd0 con 0x7f213012c0d0 2024-09-12T17:27:36.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.198+0000 7f2117fff640 1 -- 172.21.15.47:0/2892578313 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2120021060 con 0x7f213012c0d0 2024-09-12T17:27:36.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.198+0000 7fd76f7fe640 1 --2- 172.21.15.47:0/3187654728 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd77403df60 0x7fd774040420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:36.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.199+0000 7fd76f7fe640 1 -- 172.21.15.47:0/3187654728 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7fd778072d70 con 0x7fd78806ed40 2024-09-12T17:27:36.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.199+0000 7f0ce67fc640 1 -- 172.21.15.47:0/334204606 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f0cec044070 con 0x7f0cf009c150 2024-09-12T17:27:36.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.199+0000 7fd76f7fe640 1 --2- 172.21.15.47:0/3187654728 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x7fd7740436e0 0x7fd774045b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:36.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.199+0000 7fd76f7fe640 1 -- 172.21.15.47:0/3187654728 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd778006810 con 0x7fd7740436e0 2024-09-12T17:27:36.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.199+0000 7fd76f7fe640 1 -- 172.21.15.47:0/3187654728 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7fd778045a50 con 0x7fd78806ed40 2024-09-12T17:27:36.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.199+0000 7fd7867fc640 1 --2- 172.21.15.47:0/3187654728 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd77403df60 0x7fd774040420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:36.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.199+0000 7f2135c08640 1 -- 172.21.15.47:0/2892578313 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2130118920 con 0x7f213012c0d0 2024-09-12T17:27:36.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.199+0000 7f0ce67fc640 1 --2- 172.21.15.47:0/334204606 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0cd403df30 0x7f0cd40403f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:36.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.199+0000 7f3b9e8e9640 1 --2- 172.21.15.47:0/1738795591 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x7f3b7c043660 0x7f3b7c045ae0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:36.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.199+0000 7fd7877fe640 1 --2- 172.21.15.47:0/3187654728 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x7fd7740436e0 0x7fd774045b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:36.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.199+0000 7f0ce67fc640 1 -- 172.21.15.47:0/334204606 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f0cec0733b0 con 0x7f0cf009c150 2024-09-12T17:27:36.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.199+0000 7f3b9d8e7640 1 --2- 172.21.15.47:0/1738795591 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3b7c03dee0 0x7f3b7c0403a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3b88001220 tx=0x7f3b88007930 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:36.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.199+0000 7f0ce67fc640 1 --2- 172.21.15.47:0/334204606 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x7f0cd4043730 0x7f0cd4045bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:36.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.199+0000 7f0cf5668640 1 --2- 172.21.15.47:0/334204606 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0cd403df30 0x7f0cd40403f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:36.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.199+0000 7f0ce67fc640 1 -- 172.21.15.47:0/334204606 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0cec032440 con 0x7f0cd4043730 2024-09-12T17:27:36.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.199+0000 7f0ce67fc640 1 -- 172.21.15.47:0/334204606 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f0cec073720 con 0x7f0cf009c150 2024-09-12T17:27:36.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.199+0000 7f2117fff640 1 -- 172.21.15.47:0/2892578313 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f212001a070 con 0x7f213012c0d0 2024-09-12T17:27:36.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.199+0000 7f0cf666a640 1 --2- 172.21.15.47:0/334204606 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x7f0cd4043730 0x7f0cd4045bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:36.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.200+0000 7fd7867fc640 1 --2- 172.21.15.47:0/3187654728 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd77403df60 0x7fd774040420 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd77c000c00 tx=0x7fd77c0078d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:36.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.200+0000 7fd7877fe640 1 --2- 172.21.15.47:0/3187654728 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x7fd7740436e0 0x7fd774045b60 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:36.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.200+0000 7f2117fff640 1 --2- 172.21.15.47:0/2892578313 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f211c03dec0 0x7f211c040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:36.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.200+0000 7f2117fff640 1 -- 172.21.15.47:0/2892578313 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f21200515f0 con 0x7f213012c0d0 2024-09-12T17:27:36.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.200+0000 7f0cf5668640 1 --2- 172.21.15.47:0/334204606 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0cd403df30 0x7f0cd40403f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0001600 tx=0x7f0ce00079f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:36.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.200+0000 7f2117fff640 1 --2- 172.21.15.47:0/2892578313 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f211c043640 0x7f211c045ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:36.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.200+0000 7f212effd640 1 --2- 172.21.15.47:0/2892578313 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f211c03dec0 0x7f211c040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:36.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.200+0000 7f2117fff640 1 -- 172.21.15.47:0/2892578313 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f211c046190 con 0x7f211c043640 2024-09-12T17:27:36.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.200+0000 7f0cf666a640 1 --2- 172.21.15.47:0/334204606 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x7f0cd4043730 0x7f0cd4045bb0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:36.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.200+0000 7f3b8effd640 1 -- 172.21.15.47:0/1738795591 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3b94001d30 con 0x7f3b7c043660 2024-09-12T17:27:36.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.200+0000 7f2117fff640 1 -- 172.21.15.47:0/2892578313 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f2120058050 con 0x7f213012c0d0 2024-09-12T17:27:36.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.200+0000 7f212ffff640 1 --2- 172.21.15.47:0/2892578313 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f211c043640 0x7f211c045ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:36.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.200+0000 7fd76f7fe640 1 -- 172.21.15.47:0/3187654728 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd778006810 con 0x7fd7740436e0 2024-09-12T17:27:36.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.200+0000 7f212effd640 1 --2- 172.21.15.47:0/2892578313 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f211c03dec0 0x7f211c040380 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2124034000 tx=0x7f212402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:36.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.200+0000 7f212ffff640 1 --2- 172.21.15.47:0/2892578313 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f211c043640 0x7f211c045ac0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:36.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.201+0000 7f0ce67fc640 1 -- 172.21.15.47:0/334204606 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0cec032440 con 0x7f0cd4043730 2024-09-12T17:27:36.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.202+0000 7f2117fff640 1 -- 172.21.15.47:0/2892578313 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f211c046190 con 0x7f211c043640 2024-09-12T17:27:36.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.214+0000 7f3ba034c640 1 -- 172.21.15.47:0/1738795591 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3b98131f20 con 0x7f3b7c043660 2024-09-12T17:27:36.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.214+0000 7f3b8effd640 1 -- 172.21.15.47:0/1738795591 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3b98131f20 con 0x7f3b7c043660 2024-09-12T17:27:36.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.214+0000 7f3ba034c640 1 -- 172.21.15.47:0/1738795591 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x7f3b7c043660 msgr2=0x7f3b7c045ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:36.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.214+0000 7f3ba034c640 1 --2- 172.21.15.47:0/1738795591 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x7f3b7c043660 0x7f3b7c045ae0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.215+0000 7fd78d6a9640 1 -- 172.21.15.47:0/3187654728 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd78811d3c0 con 0x7fd7740436e0 2024-09-12T17:27:36.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.215+0000 7f0cd3fff640 1 -- 172.21.15.47:0/334204606 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0cf009ca70 con 0x7f0cd4043730 2024-09-12T17:27:36.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.215+0000 7f3ba034c640 1 -- 172.21.15.47:0/1738795591 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3b7c03dee0 msgr2=0x7f3b7c0403a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:36.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.215+0000 7f3ba034c640 1 --2- 172.21.15.47:0/1738795591 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3b7c03dee0 0x7f3b7c0403a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3b88001220 tx=0x7f3b88007930 comp rx=0 tx=0).stop 2024-09-12T17:27:36.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.215+0000 7f3ba034c640 1 -- 172.21.15.47:0/1738795591 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b9809dfe0 msgr2=0x7f3b98115d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:36.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.215+0000 7f3ba034c640 1 --2- 172.21.15.47:0/1738795591 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b9809dfe0 0x7f3b98115d90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3b94000c00 tx=0x7f3b940046c0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.215+0000 7f3ba034c640 1 -- 172.21.15.47:0/1738795591 shutdown_connections 2024-09-12T17:27:36.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.215+0000 7f3ba034c640 1 --2- 172.21.15.47:0/1738795591 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x7f3b7c043660 0x7f3b7c045ae0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.215+0000 7f3ba034c640 1 --2- 172.21.15.47:0/1738795591 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3b7c03dee0 0x7f3b7c0403a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.215+0000 7f3ba034c640 1 --2- 172.21.15.47:0/1738795591 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b9809dfe0 0x7f3b98115d90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.215+0000 7f3ba034c640 1 -- 172.21.15.47:0/1738795591 >> 172.21.15.47:0/1738795591 conn(0x7f3b980715a0 msgr2=0x7f3b9812aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:36.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.215+0000 7f3ba034c640 1 -- 172.21.15.47:0/1738795591 shutdown_connections 2024-09-12T17:27:36.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.215+0000 7f3ba034c640 1 -- 172.21.15.47:0/1738795591 wait complete. 2024-09-12T17:27:36.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.215+0000 7fd76f7fe640 1 -- 172.21.15.47:0/3187654728 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd78000ad10 con 0x7fd7740436e0 2024-09-12T17:27:36.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.215+0000 7f0ce67fc640 1 -- 172.21.15.47:0/334204606 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0cf009ca70 con 0x7f0cd4043730 2024-09-12T17:27:36.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.215+0000 7fd78d6a9640 1 -- 172.21.15.47:0/3187654728 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x7fd7740436e0 msgr2=0x7fd774045b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:36.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.215+0000 7f0cd3fff640 1 -- 172.21.15.47:0/334204606 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x7f0cd4043730 msgr2=0x7f0cd4045bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:36.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.215+0000 7f0cd3fff640 1 --2- 172.21.15.47:0/334204606 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x7f0cd4043730 0x7f0cd4045bb0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.215+0000 7fd78d6a9640 1 --2- 172.21.15.47:0/3187654728 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x7fd7740436e0 0x7fd774045b60 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.216+0000 7fd78d6a9640 1 -- 172.21.15.47:0/3187654728 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd77403df60 msgr2=0x7fd774040420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:36.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.216+0000 7f0cd3fff640 1 -- 172.21.15.47:0/334204606 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0cd403df30 msgr2=0x7f0cd40403f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:36.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.216+0000 7fd78d6a9640 1 --2- 172.21.15.47:0/3187654728 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd77403df60 0x7fd774040420 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd77c000c00 tx=0x7fd77c0078d0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.216+0000 7f0cd3fff640 1 --2- 172.21.15.47:0/334204606 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0cd403df30 0x7f0cd40403f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0001600 tx=0x7f0ce00079f0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.216+0000 7fd78d6a9640 1 -- 172.21.15.47:0/3187654728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd78806ed40 msgr2=0x7fd7881c40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:36.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.216+0000 7fd78d6a9640 1 --2- 172.21.15.47:0/3187654728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd78806ed40 0x7fd7881c40e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd77802a1e0 tx=0x7fd7780046c0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.216+0000 7f0cd3fff640 1 -- 172.21.15.47:0/334204606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0cf009c150 msgr2=0x7f0cf011d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:36.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.216+0000 7f0cd3fff640 1 --2- 172.21.15.47:0/334204606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0cf009c150 0x7f0cf011d200 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0cec035040 tx=0x7f0cec0046c0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.216+0000 7f2135c08640 1 -- 172.21.15.47:0/2892578313 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f213012c4b0 con 0x7f211c043640 2024-09-12T17:27:36.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.216+0000 7f0cd3fff640 1 -- 172.21.15.47:0/334204606 shutdown_connections 2024-09-12T17:27:36.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.216+0000 7fd78d6a9640 1 -- 172.21.15.47:0/3187654728 shutdown_connections 2024-09-12T17:27:36.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.216+0000 7f0cd3fff640 1 --2- 172.21.15.47:0/334204606 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0cd403df30 0x7f0cd40403f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.216+0000 7f0cd3fff640 1 --2- 172.21.15.47:0/334204606 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x7f0cd4043730 0x7f0cd4045bb0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.216+0000 7f0cd3fff640 1 --2- 172.21.15.47:0/334204606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0cf009c150 0x7f0cf011d200 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.216+0000 7f0cd3fff640 1 -- 172.21.15.47:0/334204606 >> 172.21.15.47:0/334204606 conn(0x7f0cf00715b0 msgr2=0x7f0cf00721b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:36.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.216+0000 7fd78d6a9640 1 --2- 172.21.15.47:0/3187654728 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x7fd7740436e0 0x7fd774045b60 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.216+0000 7fd78d6a9640 1 --2- 172.21.15.47:0/3187654728 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd77403df60 0x7fd774040420 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.216+0000 7fd78d6a9640 1 --2- 172.21.15.47:0/3187654728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd78806ed40 0x7fd7881c40e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.216+0000 7fd78d6a9640 1 -- 172.21.15.47:0/3187654728 >> 172.21.15.47:0/3187654728 conn(0x7fd788071580 msgr2=0x7fd788128580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:36.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.216+0000 7fd78d6a9640 1 -- 172.21.15.47:0/3187654728 shutdown_connections 2024-09-12T17:27:36.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.216+0000 7fd78d6a9640 1 -- 172.21.15.47:0/3187654728 wait complete. 2024-09-12T17:27:36.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.216+0000 7f0cd3fff640 1 -- 172.21.15.47:0/334204606 shutdown_connections 2024-09-12T17:27:36.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.216+0000 7f0cd3fff640 1 -- 172.21.15.47:0/334204606 wait complete. 2024-09-12T17:27:36.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.216+0000 7f2117fff640 1 -- 172.21.15.47:0/2892578313 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f213012c4b0 con 0x7f211c043640 2024-09-12T17:27:36.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.217+0000 7f2135c08640 1 -- 172.21.15.47:0/2892578313 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f211c043640 msgr2=0x7f211c045ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:36.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.217+0000 7f2135c08640 1 --2- 172.21.15.47:0/2892578313 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f211c043640 0x7f211c045ac0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.217+0000 7f2135c08640 1 -- 172.21.15.47:0/2892578313 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f211c03dec0 msgr2=0x7f211c040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:36.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.217+0000 7f2135c08640 1 --2- 172.21.15.47:0/2892578313 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f211c03dec0 0x7f211c040380 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2124034000 tx=0x7f212402e000 comp rx=0 tx=0).stop 2024-09-12T17:27:36.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.217+0000 7f2135c08640 1 -- 172.21.15.47:0/2892578313 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f213012c0d0 msgr2=0x7f21301172d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:36.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.217+0000 7f2135c08640 1 --2- 172.21.15.47:0/2892578313 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f213012c0d0 0x7f21301172d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f212000c480 tx=0x7f212000c940 comp rx=0 tx=0).stop 2024-09-12T17:27:36.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.217+0000 7f2135c08640 1 -- 172.21.15.47:0/2892578313 shutdown_connections 2024-09-12T17:27:36.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.217+0000 7f2135c08640 1 --2- 172.21.15.47:0/2892578313 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f211c043640 0x7f211c045ac0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.217+0000 7f2135c08640 1 --2- 172.21.15.47:0/2892578313 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f211c03dec0 0x7f211c040380 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.217+0000 7f2135c08640 1 --2- 172.21.15.47:0/2892578313 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f213012c0d0 0x7f21301172d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.217+0000 7f2135c08640 1 -- 172.21.15.47:0/2892578313 >> 172.21.15.47:0/2892578313 conn(0x7f2130071790 msgr2=0x7f2130071b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:36.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.217+0000 7f2135c08640 1 -- 172.21.15.47:0/2892578313 shutdown_connections 2024-09-12T17:27:36.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.217+0000 7f2135c08640 1 -- 172.21.15.47:0/2892578313 wait complete. 2024-09-12T17:27:36.265 INFO:teuthology.orchestra.run.smithi047.stdout:42949672966 2024-09-12T17:27:36.265 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T17:27:36.266 INFO:teuthology.orchestra.run.smithi047.stdout:38654705669 2024-09-12T17:27:36.266 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T17:27:36.267 INFO:teuthology.orchestra.run.smithi047.stdout:38654705670 2024-09-12T17:27:36.267 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T17:27:36.268 INFO:teuthology.orchestra.run.smithi047.stdout:38654705669 2024-09-12T17:27:36.269 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T17:27:36.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.412+0000 7f71af545640 1 Processor -- start 2024-09-12T17:27:36.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.412+0000 7f3f1c12c640 1 Processor -- start 2024-09-12T17:27:36.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.412+0000 7f67eb956640 1 Processor -- start 2024-09-12T17:27:36.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.412+0000 7f4bcd500640 1 Processor -- start 2024-09-12T17:27:36.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.412+0000 7f4bcd500640 1 -- start start 2024-09-12T17:27:36.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.412+0000 7f71af545640 1 -- start start 2024-09-12T17:27:36.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.412+0000 7f67eb956640 1 -- start start 2024-09-12T17:27:36.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.413+0000 7f3f1c12c640 1 -- start start 2024-09-12T17:27:36.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.413+0000 7f71af545640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f71a809ecd0 0x7f71a81314d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:36.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.413+0000 7f71af545640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71a8073050 con 0x7f71a8071d10 2024-09-12T17:27:36.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.413+0000 7f71af545640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f71a8073600 con 0x7f71a809ecd0 2024-09-12T17:27:36.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.413+0000 7f67eb956640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f67e4070c00 0x7f67e4070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:36.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.413+0000 7f67eb956640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67e406de00 con 0x7f67e4071ec0 2024-09-12T17:27:36.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.413+0000 7f67eb956640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f67e4069380 con 0x7f67e4070c00 2024-09-12T17:27:36.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.413+0000 7f67e96f2640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f67e4070c00 0x7f67e4070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:36.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.413+0000 7f67e96f2640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f67e4070c00 0x7f67e4070fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36108/0 (socket says 172.21.15.47:36108) 2024-09-12T17:27:36.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.413+0000 7f71ad2e1640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f71a8071d10 0x7f71a80720f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:45962/0 (socket says 172.21.15.47:45962) 2024-09-12T17:27:36.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.413+0000 7f71ad2e1640 1 -- 172.21.15.47:0/89880895 learned_addr learned my addr 172.21.15.47:0/89880895 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-09-12T17:27:36.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.413+0000 7f67e96f2640 1 -- 172.21.15.47:0/1454802749 learned_addr learned my addr 172.21.15.47:0/1454802749 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:27:36.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.413+0000 7f71acae0640 1 --2- 172.21.15.47:0/89880895 >> v2:172.21.15.47:3300/0 conn(0x7f71a809ecd0 0x7f71a81314d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:36.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.413+0000 7f4bcd500640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4bc812c2e0 0x7f4bc812c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:36.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.413+0000 7f3f1c12c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3f1409c150 0x7f3f1409c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:36.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.413+0000 7f3f1c12c640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f140739d0 con 0x7f3f1409ca70 2024-09-12T17:27:36.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.413+0000 7f3f1c12c640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f3f1409fd70 con 0x7f3f1409c150 2024-09-12T17:27:36.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.414+0000 7f3f196c7640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f3f1409ca70 0x7f3f14128b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:45972/0 (socket says 172.21.15.47:45972) 2024-09-12T17:27:36.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.414+0000 7f3f196c7640 1 -- 172.21.15.47:0/225690038 learned_addr learned my addr 172.21.15.47:0/225690038 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-09-12T17:27:36.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.414+0000 7f4bcd500640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bc809d900 con 0x7f4bc809dfe0 2024-09-12T17:27:36.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.414+0000 7f4bcd500640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f4bc809e870 con 0x7f4bc812c2e0 2024-09-12T17:27:36.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.414+0000 7f719ffff640 1 -- 172.21.15.47:0/89880895 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3656644365 0 0) 0x7f71a4001110 con 0x7f71a8071d10 2024-09-12T17:27:36.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.414+0000 7f719ffff640 1 -- 172.21.15.47:0/89880895 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7194005730 con 0x7f71a8071d10 2024-09-12T17:27:36.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.414+0000 7f3f19ec8640 1 --2- 172.21.15.47:0/225690038 >> v2:172.21.15.47:3300/0 conn(0x7f3f1409c150 0x7f3f1409c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:36.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.414+0000 7f67e96f2640 1 -- 172.21.15.47:0/1454802749 >> v1:172.21.15.47:6789/0 conn(0x7f67e4071ec0 legacy=0x7f67e412b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:36.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.414+0000 7f67e96f2640 1 -- 172.21.15.47:0/1454802749 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67e409ecd0 con 0x7f67e4070c00 2024-09-12T17:27:36.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.414+0000 7f4bc6ffd640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4bc812c2e0 0x7f4bc812c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:36.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.414+0000 7f4bc6ffd640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4bc812c2e0 0x7f4bc812c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36120/0 (socket says 172.21.15.47:36120) 2024-09-12T17:27:36.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.414+0000 7f4bc6ffd640 1 -- 172.21.15.47:0/2663737015 learned_addr learned my addr 172.21.15.47:0/2663737015 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:27:36.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.414+0000 7f71acae0640 1 -- 172.21.15.47:0/89880895 >> v1:172.21.15.47:6789/0 conn(0x7f71a8071d10 legacy=0x7f71a80720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:36.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.414+0000 7f71acae0640 1 -- 172.21.15.47:0/89880895 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71a80732f0 con 0x7f71a809ecd0 2024-09-12T17:27:36.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.414+0000 7f4bc6ffd640 1 -- 172.21.15.47:0/2663737015 >> v1:172.21.15.47:6789/0 conn(0x7f4bc809dfe0 legacy=0x7f4bc812cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:36.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.414+0000 7f4bc6ffd640 1 -- 172.21.15.47:0/2663737015 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bc8132610 con 0x7f4bc812c2e0 2024-09-12T17:27:36.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.414+0000 7f3f18ec6640 1 -- 172.21.15.47:0/225690038 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 466569079 0 0) 0x7f3f140739d0 con 0x7f3f1409ca70 2024-09-12T17:27:36.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.414+0000 7f3f18ec6640 1 -- 172.21.15.47:0/225690038 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f00003520 con 0x7f3f1409ca70 2024-09-12T17:27:36.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.415+0000 7f67e96f2640 1 --2- 172.21.15.47:0/1454802749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67e4070c00 0x7f67e4070fe0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f67e00097f0 tx=0x7f67e002a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f05f912fe2ef5093 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:36.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.415+0000 7f3f19ec8640 1 -- 172.21.15.47:0/225690038 >> v1:172.21.15.47:6789/0 conn(0x7f3f1409ca70 legacy=0x7f3f14128b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:36.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.415+0000 7f3f19ec8640 1 -- 172.21.15.47:0/225690038 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f1409d610 con 0x7f3f1409c150 2024-09-12T17:27:36.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.415+0000 7f4bc6ffd640 1 --2- 172.21.15.47:0/2663737015 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bc812c2e0 0x7f4bc812c6c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4bb80097f0 tx=0x7f4bb802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95c4f151126c9995 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:36.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.415+0000 7f71acae0640 1 --2- 172.21.15.47:0/89880895 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71a809ecd0 0x7f71a81314d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7198009720 tx=0x7f719802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c108f9df647abb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:36.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.415+0000 7f67dbfff640 1 -- 172.21.15.47:0/1454802749 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67e0037070 con 0x7f67e4070c00 2024-09-12T17:27:36.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.415+0000 7f4bc5ffb640 1 -- 172.21.15.47:0/2663737015 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bb8037070 con 0x7f4bc812c2e0 2024-09-12T17:27:36.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.415+0000 7f67dbfff640 1 -- 172.21.15.47:0/1454802749 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67e0032440 con 0x7f67e4070c00 2024-09-12T17:27:36.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.415+0000 7f4bc5ffb640 1 -- 172.21.15.47:0/2663737015 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bb8032440 con 0x7f4bc812c2e0 2024-09-12T17:27:36.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.415+0000 7f4bc5ffb640 1 -- 172.21.15.47:0/2663737015 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bb802ae60 con 0x7f4bc812c2e0 2024-09-12T17:27:36.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.415+0000 7f67dbfff640 1 -- 172.21.15.47:0/1454802749 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67e0032740 con 0x7f67e4070c00 2024-09-12T17:27:36.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.415+0000 7f719ffff640 1 -- 172.21.15.47:0/89880895 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7198037070 con 0x7f71a809ecd0 2024-09-12T17:27:36.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.415+0000 7f719ffff640 1 -- 172.21.15.47:0/89880895 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f719802ad90 con 0x7f71a809ecd0 2024-09-12T17:27:36.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.416+0000 7f4bcd500640 1 -- 172.21.15.47:0/2663737015 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bc812c2e0 msgr2=0x7f4bc812c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:36.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.416+0000 7f4bcd500640 1 --2- 172.21.15.47:0/2663737015 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bc812c2e0 0x7f4bc812c6c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4bb80097f0 tx=0x7f4bb802a1e0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.416+0000 7f67eb956640 1 -- 172.21.15.47:0/1454802749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67e4070c00 msgr2=0x7f67e4070fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:36.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.416+0000 7f67eb956640 1 --2- 172.21.15.47:0/1454802749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67e4070c00 0x7f67e4070fe0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f67e00097f0 tx=0x7f67e002a1f0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.416+0000 7f71af545640 1 -- 172.21.15.47:0/89880895 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71a809ecd0 msgr2=0x7f71a81314d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:36.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.416+0000 7f719ffff640 1 -- 172.21.15.47:0/89880895 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7198037070 con 0x7f71a809ecd0 2024-09-12T17:27:36.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.416+0000 7f4bcd500640 1 -- 172.21.15.47:0/2663737015 shutdown_connections 2024-09-12T17:27:36.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.416+0000 7f4bcd500640 1 --2- 172.21.15.47:0/2663737015 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bc812c2e0 0x7f4bc812c6c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.416+0000 7f71af545640 1 --2- 172.21.15.47:0/89880895 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71a809ecd0 0x7f71a81314d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7198009720 tx=0x7f719802a110 comp rx=0 tx=0).stop 2024-09-12T17:27:36.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.416+0000 7f4bcd500640 1 -- 172.21.15.47:0/2663737015 >> 172.21.15.47:0/2663737015 conn(0x7f4bc80715a0 msgr2=0x7f4bc809aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:36.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.416+0000 7f67eb956640 1 -- 172.21.15.47:0/1454802749 shutdown_connections 2024-09-12T17:27:36.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.416+0000 7f67eb956640 1 --2- 172.21.15.47:0/1454802749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67e4070c00 0x7f67e4070fe0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.416+0000 7f67eb956640 1 -- 172.21.15.47:0/1454802749 >> 172.21.15.47:0/1454802749 conn(0x7f67e409c640 msgr2=0x7f67e406ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:36.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.416+0000 7f71af545640 1 -- 172.21.15.47:0/89880895 shutdown_connections 2024-09-12T17:27:36.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.416+0000 7f71af545640 1 --2- 172.21.15.47:0/89880895 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71a809ecd0 0x7f71a81314d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.416+0000 7f71af545640 1 -- 172.21.15.47:0/89880895 >> 172.21.15.47:0/89880895 conn(0x7f71a809c640 msgr2=0x7f71a806ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:36.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.416+0000 7f3f19ec8640 1 --2- 172.21.15.47:0/225690038 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f1409c150 0x7f3f1409c530 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3f10009720 tx=0x7f3f1002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c80632267d77904b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:36.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.416+0000 7f4bcd500640 1 -- 172.21.15.47:0/2663737015 shutdown_connections 2024-09-12T17:27:36.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.416+0000 7f71af545640 1 -- 172.21.15.47:0/89880895 shutdown_connections 2024-09-12T17:27:36.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.416+0000 7f4bcd500640 1 -- 172.21.15.47:0/2663737015 wait complete. 2024-09-12T17:27:36.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.416+0000 7f67eb956640 1 -- 172.21.15.47:0/1454802749 shutdown_connections 2024-09-12T17:27:36.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.416+0000 7f3f18ec6640 1 -- 172.21.15.47:0/225690038 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f10037070 con 0x7f3f1409c150 2024-09-12T17:27:36.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.416+0000 7f67eb956640 1 -- 172.21.15.47:0/1454802749 wait complete. 2024-09-12T17:27:36.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.416+0000 7f71af545640 1 -- 172.21.15.47:0/89880895 wait complete. 2024-09-12T17:27:36.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.417+0000 7f3f18ec6640 1 -- 172.21.15.47:0/225690038 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f1002ad90 con 0x7f3f1409c150 2024-09-12T17:27:36.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.417+0000 7f3f18ec6640 1 -- 172.21.15.47:0/225690038 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f10032590 con 0x7f3f1409c150 2024-09-12T17:27:36.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.417+0000 7f3f1c12c640 1 -- 172.21.15.47:0/225690038 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f1409c150 msgr2=0x7f3f1409c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:36.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.417+0000 7f3f1c12c640 1 --2- 172.21.15.47:0/225690038 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f1409c150 0x7f3f1409c530 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3f10009720 tx=0x7f3f1002a110 comp rx=0 tx=0).stop 2024-09-12T17:27:36.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.417+0000 7f3f1c12c640 1 -- 172.21.15.47:0/225690038 shutdown_connections 2024-09-12T17:27:36.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.417+0000 7f3f1c12c640 1 --2- 172.21.15.47:0/225690038 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f1409c150 0x7f3f1409c530 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.417+0000 7f3f1c12c640 1 -- 172.21.15.47:0/225690038 >> 172.21.15.47:0/225690038 conn(0x7f3f140715b0 msgr2=0x7f3f1409aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:36.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.417+0000 7f71af545640 1 Processor -- start 2024-09-12T17:27:36.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.418+0000 7f3f1c12c640 1 -- 172.21.15.47:0/225690038 shutdown_connections 2024-09-12T17:27:36.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.418+0000 7f67eb956640 1 Processor -- start 2024-09-12T17:27:36.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.418+0000 7f3f1c12c640 1 -- 172.21.15.47:0/225690038 wait complete. 2024-09-12T17:27:36.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.418+0000 7f4bcd500640 1 Processor -- start 2024-09-12T17:27:36.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.418+0000 7f71af545640 1 -- start start 2024-09-12T17:27:36.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.418+0000 7f67eb956640 1 -- start start 2024-09-12T17:27:36.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.418+0000 7f4bcd500640 1 -- start start 2024-09-12T17:27:36.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.418+0000 7f67eb956640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67e4070c00 0x7f67e412b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:36.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.418+0000 7f67eb956640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f67e40718b0 con 0x7f67e4070c00 2024-09-12T17:27:36.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.418+0000 7f71af545640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71a8071d10 0x7f71a8118c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:36.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.418+0000 7f71af545640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f71a8072980 con 0x7f71a8071d10 2024-09-12T17:27:36.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.418+0000 7f71ad2e1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71a8071d10 0x7f71a8118c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:36.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.418+0000 7f71ad2e1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71a8071d10 0x7f71a8118c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36130/0 (socket says 172.21.15.47:36130) 2024-09-12T17:27:36.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.418+0000 7f71ad2e1640 1 -- 172.21.15.47:0/1820263714 learned_addr learned my addr 172.21.15.47:0/1820263714 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:27:36.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.418+0000 7f67e96f2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67e4070c00 0x7f67e412b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:36.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.418+0000 7f67e96f2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67e4070c00 0x7f67e412b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36126/0 (socket says 172.21.15.47:36126) 2024-09-12T17:27:36.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.418+0000 7f67e96f2640 1 -- 172.21.15.47:0/3218702079 learned_addr learned my addr 172.21.15.47:0/3218702079 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:27:36.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.418+0000 7f4bcd500640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bc809dfe0 0x7f4bc806dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:36.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.418+0000 7f4bcd500640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc8131990 con 0x7f4bc809dfe0 2024-09-12T17:27:36.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.418+0000 7f4bc6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bc809dfe0 0x7f4bc806dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:36.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.418+0000 7f4bc6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bc809dfe0 0x7f4bc806dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36144/0 (socket says 172.21.15.47:36144) 2024-09-12T17:27:36.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.418+0000 7f4bc6ffd640 1 -- 172.21.15.47:0/2518297813 learned_addr learned my addr 172.21.15.47:0/2518297813 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:27:36.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.419+0000 7f3f1c12c640 1 Processor -- start 2024-09-12T17:27:36.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.419+0000 7f3f1c12c640 1 -- start start 2024-09-12T17:27:36.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.419+0000 7f71ad2e1640 1 -- 172.21.15.47:0/1820263714 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71a811bcf0 con 0x7f71a8071d10 2024-09-12T17:27:36.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.419+0000 7f71ad2e1640 1 --2- 172.21.15.47:0/1820263714 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71a8071d10 0x7f71a8118c10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f71a400c680 tx=0x7f71a400cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:36.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.419+0000 7f67e96f2640 1 -- 172.21.15.47:0/3218702079 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67e411cf20 con 0x7f67e4070c00 2024-09-12T17:27:36.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.419+0000 7f4bc6ffd640 1 -- 172.21.15.47:0/2518297813 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bc8115aa0 con 0x7f4bc809dfe0 2024-09-12T17:27:36.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.419+0000 7f67e96f2640 1 --2- 172.21.15.47:0/3218702079 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67e4070c00 0x7f67e412b270 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f67e002a230 tx=0x7f67e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:36.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.419+0000 7f719dffb640 1 -- 172.21.15.47:0/1820263714 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71a40058b0 con 0x7f71a8071d10 2024-09-12T17:27:36.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.419+0000 7f4bc6ffd640 1 --2- 172.21.15.47:0/2518297813 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bc809dfe0 0x7f4bc806dc30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4bb80090b0 tx=0x7f4bb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:36.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.419+0000 7f3f1c12c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f1409c150 0x7f3f1411cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:36.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.419+0000 7f3f1c12c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1406de10 con 0x7f3f1409c150 2024-09-12T17:27:36.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.419+0000 7f719dffb640 1 -- 172.21.15.47:0/1820263714 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71a4005a50 con 0x7f71a8071d10 2024-09-12T17:27:36.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.419+0000 7f71af545640 1 -- 172.21.15.47:0/1820263714 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71a8126730 con 0x7f71a8071d10 2024-09-12T17:27:36.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.419+0000 7f719dffb640 1 -- 172.21.15.47:0/1820263714 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71a4005db0 con 0x7f71a8071d10 2024-09-12T17:27:36.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.419+0000 7f3f19ec8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f1409c150 0x7f3f1411cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:36.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.419+0000 7f67d9ffb640 1 -- 172.21.15.47:0/3218702079 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67e0041070 con 0x7f67e4070c00 2024-09-12T17:27:36.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.419+0000 7f3f19ec8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f1409c150 0x7f3f1411cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36150/0 (socket says 172.21.15.47:36150) 2024-09-12T17:27:36.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.419+0000 7f3f19ec8640 1 -- 172.21.15.47:0/3994543076 learned_addr learned my addr 172.21.15.47:0/3994543076 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:27:36.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.419+0000 7f4baf7fe640 1 -- 172.21.15.47:0/2518297813 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bb8041020 con 0x7f4bc809dfe0 2024-09-12T17:27:36.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.419+0000 7f4baf7fe640 1 -- 172.21.15.47:0/2518297813 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bb8030a10 con 0x7f4bc809dfe0 2024-09-12T17:27:36.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.419+0000 7f4baf7fe640 1 -- 172.21.15.47:0/2518297813 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bb8037040 con 0x7f4bc809dfe0 2024-09-12T17:27:36.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.419+0000 7f67d9ffb640 1 -- 172.21.15.47:0/3218702079 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67e00307d0 con 0x7f67e4070c00 2024-09-12T17:27:36.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.419+0000 7f67eb956640 1 -- 172.21.15.47:0/3218702079 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67e4135780 con 0x7f67e4070c00 2024-09-12T17:27:36.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.419+0000 7f4bcd500640 1 -- 172.21.15.47:0/2518297813 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bc8116a10 con 0x7f4bc809dfe0 2024-09-12T17:27:36.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.419+0000 7f67d9ffb640 1 -- 172.21.15.47:0/3218702079 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67e0037040 con 0x7f67e4070c00 2024-09-12T17:27:36.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.420+0000 7f4bcd500640 1 -- 172.21.15.47:0/2518297813 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bc8130d60 con 0x7f4bc809dfe0 2024-09-12T17:27:36.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.420+0000 7f3f19ec8640 1 -- 172.21.15.47:0/3994543076 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f141201c0 con 0x7f3f1409c150 2024-09-12T17:27:36.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.420+0000 7f67eb956640 1 -- 172.21.15.47:0/3218702079 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67e412b7b0 con 0x7f67e4070c00 2024-09-12T17:27:36.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.419+0000 7f71af545640 1 -- 172.21.15.47:0/1820263714 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71a811ac20 con 0x7f71a8071d10 2024-09-12T17:27:36.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.420+0000 7f3f19ec8640 1 --2- 172.21.15.47:0/3994543076 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f1409c150 0x7f3f1411cf80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3f10000c00 tx=0x7f3f100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:36.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.421+0000 7f67d9ffb640 1 -- 172.21.15.47:0/3218702079 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f67e0044070 con 0x7f67e4070c00 2024-09-12T17:27:36.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.421+0000 7f3f0a7fc640 1 -- 172.21.15.47:0/3994543076 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f10041070 con 0x7f3f1409c150 2024-09-12T17:27:36.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.421+0000 7f3f1c12c640 1 -- 172.21.15.47:0/3994543076 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f1411fa50 con 0x7f3f1409c150 2024-09-12T17:27:36.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.421+0000 7f67d9ffb640 1 --2- 172.21.15.47:0/3218702079 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f67c803dee0 0x7f67c80403a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:36.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.421+0000 7f3f1c12c640 1 -- 172.21.15.47:0/3994543076 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f14129570 con 0x7f3f1409c150 2024-09-12T17:27:36.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.421+0000 7f67d9ffb640 1 -- 172.21.15.47:0/3218702079 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f67e0072e80 con 0x7f67e4070c00 2024-09-12T17:27:36.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.421+0000 7f71af545640 1 -- 172.21.15.47:0/1820263714 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71a80720f0 con 0x7f71a8071d10 2024-09-12T17:27:36.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.421+0000 7f67eb956640 1 -- 172.21.15.47:0/3218702079 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67e4070fe0 con 0x7f67e4070c00 2024-09-12T17:27:36.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.422+0000 7f67e8ef1640 1 --2- 172.21.15.47:0/3218702079 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f67c803dee0 0x7f67c80403a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:36.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.421+0000 7f4baf7fe640 1 -- 172.21.15.47:0/2518297813 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f4bb8044020 con 0x7f4bc809dfe0 2024-09-12T17:27:36.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.421+0000 7f4bcd500640 1 -- 172.21.15.47:0/2518297813 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bc8074170 con 0x7f4bc809dfe0 2024-09-12T17:27:36.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.422+0000 7f4baf7fe640 1 --2- 172.21.15.47:0/2518297813 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f4bb403dee0 0x7f4bb40403a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:36.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.422+0000 7f4baf7fe640 1 -- 172.21.15.47:0/2518297813 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f4bb8073000 con 0x7f4bc809dfe0 2024-09-12T17:27:36.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.422+0000 7f3f0a7fc640 1 -- 172.21.15.47:0/3994543076 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f1003c460 con 0x7f3f1409c150 2024-09-12T17:27:36.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.422+0000 7f4bc67fc640 1 --2- 172.21.15.47:0/2518297813 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f4bb403dee0 0x7f4bb40403a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:36.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.422+0000 7f719dffb640 1 -- 172.21.15.47:0/1820263714 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f71a4007070 con 0x7f71a8071d10 2024-09-12T17:27:36.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.422+0000 7f3f0a7fc640 1 -- 172.21.15.47:0/3994543076 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f1004b060 con 0x7f3f1409c150 2024-09-12T17:27:36.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.422+0000 7f67e8ef1640 1 --2- 172.21.15.47:0/3218702079 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f67c803dee0 0x7f67c80403a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f67d4001600 tx=0x7f67d40079f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:36.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.422+0000 7f3f0a7fc640 1 -- 172.21.15.47:0/3994543076 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3f10044070 con 0x7f3f1409c150 2024-09-12T17:27:36.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.422+0000 7f719dffb640 1 --2- 172.21.15.47:0/1820263714 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f718c03de90 0x7f718c040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:36.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.423+0000 7f719dffb640 1 -- 172.21.15.47:0/1820263714 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f71a4051ea0 con 0x7f71a8071d10 2024-09-12T17:27:36.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.423+0000 7f71acae0640 1 --2- 172.21.15.47:0/1820263714 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f718c03de90 0x7f718c040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:36.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.423+0000 7f3f1c12c640 1 -- 172.21.15.47:0/3994543076 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3efc005080 con 0x7f3f1409c150 2024-09-12T17:27:36.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.423+0000 7f4bc67fc640 1 --2- 172.21.15.47:0/2518297813 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f4bb403dee0 0x7f4bb40403a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc001600 tx=0x7f4bbc0079f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:36.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.423+0000 7f3f0a7fc640 1 --2- 172.21.15.47:0/3994543076 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3ef803de90 0x7f3ef8040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:36.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.423+0000 7f3f0a7fc640 1 -- 172.21.15.47:0/3994543076 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f3f100729f0 con 0x7f3f1409c150 2024-09-12T17:27:36.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.423+0000 7f3f196c7640 1 --2- 172.21.15.47:0/3994543076 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3ef803de90 0x7f3ef8040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:36.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.423+0000 7f71acae0640 1 --2- 172.21.15.47:0/1820263714 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f718c03de90 0x7f718c040350 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7198034000 tx=0x7f719802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:36.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.423+0000 7f3f196c7640 1 --2- 172.21.15.47:0/3994543076 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3ef803de90 0x7f3ef8040350 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3f04001610 tx=0x7f3f040078f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:36.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.427+0000 7f67d9ffb640 1 -- 172.21.15.47:0/3218702079 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f67e003bce0 con 0x7f67e4070c00 2024-09-12T17:27:36.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.435+0000 7f4baf7fe640 1 -- 172.21.15.47:0/2518297813 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f4bb804b030 con 0x7f4bc809dfe0 2024-09-12T17:27:36.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.445+0000 7f3f0a7fc640 1 -- 172.21.15.47:0/3994543076 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f3f1003cc60 con 0x7f3f1409c150 2024-09-12T17:27:36.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.454+0000 7f719dffb640 1 -- 172.21.15.47:0/1820263714 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f71a8073050 con 0x7f71a8071d10 2024-09-12T17:27:36.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.626+0000 7f4bcd500640 1 -- 172.21.15.47:0/2518297813 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f4bc8075930 con 0x7f4bc809dfe0 2024-09-12T17:27:36.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.626+0000 7f4baf7fe640 1 -- 172.21.15.47:0/2518297813 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4bb803c380 con 0x7f4bc809dfe0 2024-09-12T17:27:36.628 INFO:teuthology.orchestra.run.smithi047.stdout:38654705668 2024-09-12T17:27:36.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.629+0000 7f67eb956640 1 -- 172.21.15.47:0/3218702079 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f67e4068da0 con 0x7f67e4070c00 2024-09-12T17:27:36.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.630+0000 7f67d9ffb640 1 -- 172.21.15.47:0/3218702079 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f67e003c460 con 0x7f67e4070c00 2024-09-12T17:27:36.631 INFO:teuthology.orchestra.run.smithi047.stdout:38654705668 2024-09-12T17:27:36.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.630+0000 7f4bcd500640 1 -- 172.21.15.47:0/2518297813 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f4bb403dee0 msgr2=0x7f4bb40403a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:36.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.630+0000 7f4bcd500640 1 --2- 172.21.15.47:0/2518297813 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f4bb403dee0 0x7f4bb40403a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc001600 tx=0x7f4bbc0079f0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.630+0000 7f4bcd500640 1 -- 172.21.15.47:0/2518297813 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bc809dfe0 msgr2=0x7f4bc806dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:36.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.630+0000 7f4bcd500640 1 --2- 172.21.15.47:0/2518297813 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bc809dfe0 0x7f4bc806dc30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4bb80090b0 tx=0x7f4bb80046c0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.630+0000 7f4bcd500640 1 -- 172.21.15.47:0/2518297813 shutdown_connections 2024-09-12T17:27:36.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.630+0000 7f4bcd500640 1 --2- 172.21.15.47:0/2518297813 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f4bb403dee0 0x7f4bb40403a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.630+0000 7f4bcd500640 1 --2- 172.21.15.47:0/2518297813 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4bc809dfe0 0x7f4bc806dc30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.630+0000 7f4bcd500640 1 -- 172.21.15.47:0/2518297813 >> 172.21.15.47:0/2518297813 conn(0x7f4bc80715a0 msgr2=0x7f4bc8072610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:36.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.630+0000 7f4bcd500640 1 -- 172.21.15.47:0/2518297813 shutdown_connections 2024-09-12T17:27:36.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.630+0000 7f4bcd500640 1 -- 172.21.15.47:0/2518297813 wait complete. 2024-09-12T17:27:36.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.632+0000 7f3f1c12c640 1 -- 172.21.15.47:0/3994543076 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f3efc005370 con 0x7f3f1409c150 2024-09-12T17:27:36.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.632+0000 7f67eb956640 1 -- 172.21.15.47:0/3218702079 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f67c803dee0 msgr2=0x7f67c80403a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:36.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.632+0000 7f67eb956640 1 --2- 172.21.15.47:0/3218702079 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f67c803dee0 0x7f67c80403a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f67d4001600 tx=0x7f67d40079f0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.632+0000 7f67eb956640 1 -- 172.21.15.47:0/3218702079 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67e4070c00 msgr2=0x7f67e412b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:36.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.632+0000 7f67eb956640 1 --2- 172.21.15.47:0/3218702079 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67e4070c00 0x7f67e412b270 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f67e002a230 tx=0x7f67e00046c0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.632+0000 7f67eb956640 1 -- 172.21.15.47:0/3218702079 shutdown_connections 2024-09-12T17:27:36.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.632+0000 7f67eb956640 1 --2- 172.21.15.47:0/3218702079 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f67c803dee0 0x7f67c80403a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.632+0000 7f67eb956640 1 --2- 172.21.15.47:0/3218702079 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67e4070c00 0x7f67e412b270 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.632+0000 7f67eb956640 1 -- 172.21.15.47:0/3218702079 >> 172.21.15.47:0/3218702079 conn(0x7f67e409c640 msgr2=0x7f67e4130420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:36.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.632+0000 7f67eb956640 1 -- 172.21.15.47:0/3218702079 shutdown_connections 2024-09-12T17:27:36.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.632+0000 7f3f0a7fc640 1 -- 172.21.15.47:0/3994543076 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3f1003c740 con 0x7f3f1409c150 2024-09-12T17:27:36.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.632+0000 7f67eb956640 1 -- 172.21.15.47:0/3218702079 wait complete. 2024-09-12T17:27:36.636 INFO:teuthology.orchestra.run.smithi047.stdout:38654705669 2024-09-12T17:27:36.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.635+0000 7f3f1c12c640 1 -- 172.21.15.47:0/3994543076 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3ef803de90 msgr2=0x7f3ef8040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:36.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.635+0000 7f3f1c12c640 1 --2- 172.21.15.47:0/3994543076 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3ef803de90 0x7f3ef8040350 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3f04001610 tx=0x7f3f040078f0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.635+0000 7f3f1c12c640 1 -- 172.21.15.47:0/3994543076 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f1409c150 msgr2=0x7f3f1411cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:36.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.635+0000 7f3f1c12c640 1 --2- 172.21.15.47:0/3994543076 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f1409c150 0x7f3f1411cf80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3f10000c00 tx=0x7f3f100046c0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.635+0000 7f3f1c12c640 1 -- 172.21.15.47:0/3994543076 shutdown_connections 2024-09-12T17:27:36.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.635+0000 7f3f1c12c640 1 --2- 172.21.15.47:0/3994543076 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3ef803de90 0x7f3ef8040350 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.635+0000 7f3f1c12c640 1 --2- 172.21.15.47:0/3994543076 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f1409c150 0x7f3f1411cf80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.635+0000 7f3f1c12c640 1 -- 172.21.15.47:0/3994543076 >> 172.21.15.47:0/3994543076 conn(0x7f3f140715b0 msgr2=0x7f3f1412b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:36.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.635+0000 7f3f1c12c640 1 -- 172.21.15.47:0/3994543076 shutdown_connections 2024-09-12T17:27:36.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.635+0000 7f3f1c12c640 1 -- 172.21.15.47:0/3994543076 wait complete. 2024-09-12T17:27:36.646 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.2 2024-09-12T17:27:36.649 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.0 2024-09-12T17:27:36.649 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.1 2024-09-12T17:27:36.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.650+0000 7f71af545640 1 -- 172.21.15.47:0/1820263714 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f71a8119d90 con 0x7f71a8071d10 2024-09-12T17:27:36.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.650+0000 7f719dffb640 1 -- 172.21.15.47:0/1820263714 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f71a400aae0 con 0x7f71a8071d10 2024-09-12T17:27:36.652 INFO:teuthology.orchestra.run.smithi047.stdout:42949672964 2024-09-12T17:27:36.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.653+0000 7f71af545640 1 -- 172.21.15.47:0/1820263714 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f718c03de90 msgr2=0x7f718c040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:36.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.653+0000 7f71af545640 1 --2- 172.21.15.47:0/1820263714 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f718c03de90 0x7f718c040350 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7198034000 tx=0x7f719802e000 comp rx=0 tx=0).stop 2024-09-12T17:27:36.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.653+0000 7f71af545640 1 -- 172.21.15.47:0/1820263714 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71a8071d10 msgr2=0x7f71a8118c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:36.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.653+0000 7f71af545640 1 --2- 172.21.15.47:0/1820263714 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71a8071d10 0x7f71a8118c10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f71a400c680 tx=0x7f71a400cb40 comp rx=0 tx=0).stop 2024-09-12T17:27:36.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.653+0000 7f71af545640 1 -- 172.21.15.47:0/1820263714 shutdown_connections 2024-09-12T17:27:36.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.653+0000 7f71af545640 1 --2- 172.21.15.47:0/1820263714 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f718c03de90 0x7f718c040350 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.653+0000 7f71af545640 1 --2- 172.21.15.47:0/1820263714 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71a8071d10 0x7f71a8118c10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:36.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.653+0000 7f71af545640 1 -- 172.21.15.47:0/1820263714 >> 172.21.15.47:0/1820263714 conn(0x7f71a809c640 msgr2=0x7f71a8127fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:36.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.653+0000 7f71af545640 1 -- 172.21.15.47:0/1820263714 shutdown_connections 2024-09-12T17:27:36.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:36.653+0000 7f71af545640 1 -- 172.21.15.47:0/1820263714 wait complete. 2024-09-12T17:27:36.664 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672964 for osd.3 2024-09-12T17:27:37.647 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T17:27:37.650 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T17:27:37.650 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T17:27:37.665 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T17:27:37.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.766+0000 7f7993d10640 1 Processor -- start 2024-09-12T17:27:37.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.766+0000 7f01e4ab8640 1 Processor -- start 2024-09-12T17:27:37.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.767+0000 7f01e4ab8640 1 -- start start 2024-09-12T17:27:37.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.767+0000 7fdecd6e4640 1 Processor -- start 2024-09-12T17:27:37.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.767+0000 7fdecd6e4640 1 -- start start 2024-09-12T17:27:37.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.767+0000 7f7993d10640 1 -- start start 2024-09-12T17:27:37.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.767+0000 7fdecd6e4640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fdec812d060 0x7fdec812d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:37.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.767+0000 7fdecd6e4640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdec809ec60 con 0x7fdec812d980 2024-09-12T17:27:37.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.767+0000 7fdecd6e4640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fdec809f4e0 con 0x7fdec812d060 2024-09-12T17:27:37.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.767+0000 7f01e4ab8640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f01e006fe70 0x7f01e0070250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:37.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.767+0000 7f01e4ab8640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01e0071680 con 0x7f01e0070790 2024-09-12T17:27:37.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.767+0000 7f01e4ab8640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f01e00a30e0 con 0x7f01e006fe70 2024-09-12T17:27:37.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.768+0000 7f7993d10640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f798c06fe70 0x7f798c070250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:37.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.768+0000 7fdec67fc640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fdec812d980 0x7fdec8129b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:45994/0 (socket says 172.21.15.47:45994) 2024-09-12T17:27:37.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.768+0000 7fdec67fc640 1 -- 172.21.15.47:0/645107214 learned_addr learned my addr 172.21.15.47:0/645107214 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-09-12T17:27:37.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.768+0000 7fdec6ffd640 1 --2- 172.21.15.47:0/645107214 >> v2:172.21.15.47:3300/0 conn(0x7fdec812d060 0x7fdec812d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:37.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.768+0000 7f01ddd9b640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f01e0070790 0x7f01e012ab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:46010/0 (socket says 172.21.15.47:46010) 2024-09-12T17:27:37.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.768+0000 7f01ddd9b640 1 -- 172.21.15.47:0/3092077608 learned_addr learned my addr 172.21.15.47:0/3092077608 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-09-12T17:27:37.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.768+0000 7f7993d10640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f798c071680 con 0x7f798c070790 2024-09-12T17:27:37.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.768+0000 7f7993d10640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f798c0a30e0 con 0x7f798c06fe70 2024-09-12T17:27:37.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.768+0000 7f7991aac640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f798c06fe70 0x7f798c070250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:37.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.768+0000 7f01de59c640 1 --2- 172.21.15.47:0/3092077608 >> v2:172.21.15.47:3300/0 conn(0x7f01e006fe70 0x7f01e0070250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:37.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.768+0000 7f7991aac640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f798c06fe70 0x7f798c070250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36182/0 (socket says 172.21.15.47:36182) 2024-09-12T17:27:37.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.768+0000 7f7991aac640 1 -- 172.21.15.47:0/1033418842 learned_addr learned my addr 172.21.15.47:0/1033418842 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:27:37.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.768+0000 7fdec6ffd640 1 -- 172.21.15.47:0/645107214 >> v1:172.21.15.47:6789/0 conn(0x7fdec812d980 legacy=0x7fdec8129b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:37.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.768+0000 7fdec6ffd640 1 -- 172.21.15.47:0/645107214 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdec809f810 con 0x7fdec812d060 2024-09-12T17:27:37.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.769+0000 7f01de59c640 1 -- 172.21.15.47:0/3092077608 >> v1:172.21.15.47:6789/0 conn(0x7f01e0070790 legacy=0x7f01e012ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:37.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.769+0000 7f01de59c640 1 -- 172.21.15.47:0/3092077608 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01e0071dd0 con 0x7f01e006fe70 2024-09-12T17:27:37.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.769+0000 7f7991aac640 1 -- 172.21.15.47:0/1033418842 >> v1:172.21.15.47:6789/0 conn(0x7f798c070790 legacy=0x7f798c12ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:37.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.769+0000 7f7991aac640 1 -- 172.21.15.47:0/1033418842 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f798c071dd0 con 0x7f798c06fe70 2024-09-12T17:27:37.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.770+0000 7f7991aac640 1 --2- 172.21.15.47:0/1033418842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f798c06fe70 0x7f798c070250 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f79880097f0 tx=0x7f798802a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49ef594f59e4d1eb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:37.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.770+0000 7fdec6ffd640 1 --2- 172.21.15.47:0/645107214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdec812d060 0x7fdec812d440 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8009720 tx=0x7fdeb802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dd611316aae0f89 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:37.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.770+0000 7f7990aaa640 1 -- 172.21.15.47:0/1033418842 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7988037070 con 0x7f798c06fe70 2024-09-12T17:27:37.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.770+0000 7f01de59c640 1 --2- 172.21.15.47:0/3092077608 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01e006fe70 0x7f01e0070250 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f01d0009720 tx=0x7f01d002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6464aa8b08601c67 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:37.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.770+0000 7f7990aaa640 1 -- 172.21.15.47:0/1033418842 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7988032440 con 0x7f798c06fe70 2024-09-12T17:27:37.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.770+0000 7fdec5ffb640 1 -- 172.21.15.47:0/645107214 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdeb8037070 con 0x7fdec812d060 2024-09-12T17:27:37.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.770+0000 7fdec5ffb640 1 -- 172.21.15.47:0/645107214 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdeb802ae20 con 0x7fdec812d060 2024-09-12T17:27:37.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.770+0000 7f7990aaa640 1 -- 172.21.15.47:0/1033418842 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7988032740 con 0x7f798c06fe70 2024-09-12T17:27:37.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.770+0000 7fdec5ffb640 1 -- 172.21.15.47:0/645107214 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdeb8032590 con 0x7fdec812d060 2024-09-12T17:27:37.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.770+0000 7f01dd59a640 1 -- 172.21.15.47:0/3092077608 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01d0037070 con 0x7f01e006fe70 2024-09-12T17:27:37.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.770+0000 7f01dd59a640 1 -- 172.21.15.47:0/3092077608 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01d002ad90 con 0x7f01e006fe70 2024-09-12T17:27:37.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.770+0000 7f01dd59a640 1 -- 172.21.15.47:0/3092077608 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01d0032590 con 0x7f01e006fe70 2024-09-12T17:27:37.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.771+0000 7f7993d10640 1 -- 172.21.15.47:0/1033418842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f798c06fe70 msgr2=0x7f798c070250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:37.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.771+0000 7f7993d10640 1 --2- 172.21.15.47:0/1033418842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f798c06fe70 0x7f798c070250 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f79880097f0 tx=0x7f798802a1f0 comp rx=0 tx=0).stop 2024-09-12T17:27:37.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.771+0000 7fdecd6e4640 1 -- 172.21.15.47:0/645107214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdec812d060 msgr2=0x7fdec812d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:37.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.771+0000 7f7993d10640 1 -- 172.21.15.47:0/1033418842 shutdown_connections 2024-09-12T17:27:37.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.771+0000 7fdecd6e4640 1 --2- 172.21.15.47:0/645107214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdec812d060 0x7fdec812d440 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8009720 tx=0x7fdeb802a1a0 comp rx=0 tx=0).stop 2024-09-12T17:27:37.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.771+0000 7f7993d10640 1 --2- 172.21.15.47:0/1033418842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f798c06fe70 0x7f798c070250 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:37.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.771+0000 7f7993d10640 1 -- 172.21.15.47:0/1033418842 >> 172.21.15.47:0/1033418842 conn(0x7f798c0a0a50 msgr2=0x7f798c06e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:37.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.771+0000 7fdecd6e4640 1 -- 172.21.15.47:0/645107214 shutdown_connections 2024-09-12T17:27:37.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.771+0000 7fdecd6e4640 1 --2- 172.21.15.47:0/645107214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdec812d060 0x7fdec812d440 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:37.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.771+0000 7fdecd6e4640 1 -- 172.21.15.47:0/645107214 >> 172.21.15.47:0/645107214 conn(0x7fdec8071df0 msgr2=0x7fdec8072200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:37.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.771+0000 7fdecd6e4640 1 -- 172.21.15.47:0/645107214 shutdown_connections 2024-09-12T17:27:37.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.771+0000 7f7993d10640 1 -- 172.21.15.47:0/1033418842 shutdown_connections 2024-09-12T17:27:37.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.771+0000 7f7993d10640 1 -- 172.21.15.47:0/1033418842 wait complete. 2024-09-12T17:27:37.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.771+0000 7fdecd6e4640 1 -- 172.21.15.47:0/645107214 wait complete. 2024-09-12T17:27:37.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.771+0000 7f01e4ab8640 1 -- 172.21.15.47:0/3092077608 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01e006fe70 msgr2=0x7f01e0070250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:37.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.771+0000 7f01e4ab8640 1 --2- 172.21.15.47:0/3092077608 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01e006fe70 0x7f01e0070250 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f01d0009720 tx=0x7f01d002a110 comp rx=0 tx=0).stop 2024-09-12T17:27:37.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.772+0000 7f01e4ab8640 1 -- 172.21.15.47:0/3092077608 shutdown_connections 2024-09-12T17:27:37.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.772+0000 7f01e4ab8640 1 --2- 172.21.15.47:0/3092077608 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01e006fe70 0x7f01e0070250 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:37.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.772+0000 7f01e4ab8640 1 -- 172.21.15.47:0/3092077608 >> 172.21.15.47:0/3092077608 conn(0x7f01e00a0a50 msgr2=0x7f01e006e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:37.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.772+0000 7f01e4ab8640 1 -- 172.21.15.47:0/3092077608 shutdown_connections 2024-09-12T17:27:37.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.772+0000 7f01e4ab8640 1 -- 172.21.15.47:0/3092077608 wait complete. 2024-09-12T17:27:37.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.772+0000 7f7993d10640 1 Processor -- start 2024-09-12T17:27:37.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.772+0000 7f7993d10640 1 -- start start 2024-09-12T17:27:37.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.772+0000 7fdecd6e4640 1 Processor -- start 2024-09-12T17:27:37.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.772+0000 7fdecd6e4640 1 -- start start 2024-09-12T17:27:37.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.773+0000 7f01e4ab8640 1 Processor -- start 2024-09-12T17:27:37.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.773+0000 7f7993d10640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f798c06fe70 0x7f798c11cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:37.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.773+0000 7f7993d10640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f798c075cc0 con 0x7f798c06fe70 2024-09-12T17:27:37.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.773+0000 7fdecd6e4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdec812d060 0x7fdec811d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:37.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.773+0000 7fdecd6e4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdec812a210 con 0x7fdec812d060 2024-09-12T17:27:37.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.773+0000 7f01e4ab8640 1 -- start start 2024-09-12T17:27:37.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.773+0000 7f7991aac640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f798c06fe70 0x7f798c11cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:37.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.773+0000 7f7991aac640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f798c06fe70 0x7f798c11cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36194/0 (socket says 172.21.15.47:36194) 2024-09-12T17:27:37.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.773+0000 7f7991aac640 1 -- 172.21.15.47:0/1235845910 learned_addr learned my addr 172.21.15.47:0/1235845910 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:27:37.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.773+0000 7fdec6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdec812d060 0x7fdec811d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:37.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.773+0000 7fdec6ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdec812d060 0x7fdec811d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36204/0 (socket says 172.21.15.47:36204) 2024-09-12T17:27:37.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.773+0000 7fdec6ffd640 1 -- 172.21.15.47:0/1564993814 learned_addr learned my addr 172.21.15.47:0/1564993814 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:27:37.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.774+0000 7f01e4ab8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01e006fe70 0x7f01e011f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:37.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.774+0000 7f01e4ab8640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f01e0075cc0 con 0x7f01e006fe70 2024-09-12T17:27:37.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.774+0000 7f7991aac640 1 -- 172.21.15.47:0/1235845910 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f798c11f2d0 con 0x7f798c06fe70 2024-09-12T17:27:37.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.774+0000 7fdec6ffd640 1 -- 172.21.15.47:0/1564993814 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdec8127730 con 0x7fdec812d060 2024-09-12T17:27:37.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.774+0000 7f01de59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01e006fe70 0x7f01e011f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:37.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.774+0000 7f01de59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01e006fe70 0x7f01e011f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36216/0 (socket says 172.21.15.47:36216) 2024-09-12T17:27:37.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.774+0000 7f01de59c640 1 -- 172.21.15.47:0/2052243602 learned_addr learned my addr 172.21.15.47:0/2052243602 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:27:37.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.774+0000 7fdec6ffd640 1 --2- 172.21.15.47:0/1564993814 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdec812d060 0x7fdec811d650 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdeb802a1e0 tx=0x7fdeb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:37.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.774+0000 7f7991aac640 1 --2- 172.21.15.47:0/1235845910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f798c06fe70 0x7f798c11cea0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f798802a230 tx=0x7f79880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:37.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.774+0000 7fdeaf7fe640 1 -- 172.21.15.47:0/1564993814 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdeb8042070 con 0x7fdec812d060 2024-09-12T17:27:37.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.774+0000 7fdecd6e4640 1 -- 172.21.15.47:0/1564993814 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdec811fc10 con 0x7fdec812d060 2024-09-12T17:27:37.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.774+0000 7fdeaf7fe640 1 -- 172.21.15.47:0/1564993814 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdeb803e590 con 0x7fdec812d060 2024-09-12T17:27:37.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.774+0000 7fdecd6e4640 1 -- 172.21.15.47:0/1564993814 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdec811db90 con 0x7fdec812d060 2024-09-12T17:27:37.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.774+0000 7fdeaf7fe640 1 -- 172.21.15.47:0/1564993814 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdeb8037040 con 0x7fdec812d060 2024-09-12T17:27:37.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.774+0000 7f01de59c640 1 -- 172.21.15.47:0/2052243602 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01e0121300 con 0x7f01e006fe70 2024-09-12T17:27:37.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.775+0000 7f01de59c640 1 --2- 172.21.15.47:0/2052243602 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01e006fe70 0x7f01e011f210 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f01d0009840 tx=0x7f01d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:37.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.774+0000 7f79827fc640 1 -- 172.21.15.47:0/1235845910 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7988041070 con 0x7f798c06fe70 2024-09-12T17:27:37.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.775+0000 7f79827fc640 1 -- 172.21.15.47:0/1235845910 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79880307d0 con 0x7f798c06fe70 2024-09-12T17:27:37.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.775+0000 7f79827fc640 1 -- 172.21.15.47:0/1235845910 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7988037040 con 0x7f798c06fe70 2024-09-12T17:27:37.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.775+0000 7f7993d10640 1 -- 172.21.15.47:0/1235845910 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f798c1202b0 con 0x7f798c06fe70 2024-09-12T17:27:37.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.775+0000 7f7993d10640 1 -- 172.21.15.47:0/1235845910 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f798c11d3e0 con 0x7f798c06fe70 2024-09-12T17:27:37.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.776+0000 7f01ceffd640 1 -- 172.21.15.47:0/2052243602 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01d0041070 con 0x7f01e006fe70 2024-09-12T17:27:37.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.776+0000 7f01e4ab8640 1 -- 172.21.15.47:0/2052243602 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01e0122560 con 0x7f01e006fe70 2024-09-12T17:27:37.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.776+0000 7fdecd6e4640 1 -- 172.21.15.47:0/1564993814 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdea8005080 con 0x7fdec812d060 2024-09-12T17:27:37.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.776+0000 7fdeaf7fe640 1 -- 172.21.15.47:0/1564993814 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fdeb8045070 con 0x7fdec812d060 2024-09-12T17:27:37.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.776+0000 7fdeaf7fe640 1 --2- 172.21.15.47:0/1564993814 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fdeb403dec0 0x7fdeb4040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:37.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.776+0000 7f01ceffd640 1 -- 172.21.15.47:0/2052243602 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01d003c460 con 0x7f01e006fe70 2024-09-12T17:27:37.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.776+0000 7f01ceffd640 1 -- 172.21.15.47:0/2052243602 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01d004b060 con 0x7f01e006fe70 2024-09-12T17:27:37.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.776+0000 7fdeaf7fe640 1 -- 172.21.15.47:0/1564993814 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7fdeb8072cd0 con 0x7fdec812d060 2024-09-12T17:27:37.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.776+0000 7f01e4ab8640 1 -- 172.21.15.47:0/2052243602 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01e0122890 con 0x7f01e006fe70 2024-09-12T17:27:37.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.777+0000 7fdec67fc640 1 --2- 172.21.15.47:0/1564993814 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fdeb403dec0 0x7fdeb4040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:37.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.777+0000 7f79827fc640 1 -- 172.21.15.47:0/1235845910 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f7988044070 con 0x7f798c06fe70 2024-09-12T17:27:37.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.777+0000 7f7993d10640 1 -- 172.21.15.47:0/1235845910 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f798c11f640 con 0x7f798c06fe70 2024-09-12T17:27:37.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.777+0000 7f79827fc640 1 --2- 172.21.15.47:0/1235845910 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f797003de90 0x7f7970040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:37.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.777+0000 7f79827fc640 1 -- 172.21.15.47:0/1235845910 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f7988072f70 con 0x7f798c06fe70 2024-09-12T17:27:37.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.778+0000 7fdec67fc640 1 --2- 172.21.15.47:0/1564993814 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fdeb403dec0 0x7fdeb4040380 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdebc007fd0 tx=0x7fdebc007aa0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:37.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.778+0000 7f01ceffd640 1 -- 172.21.15.47:0/2052243602 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f01d0044070 con 0x7f01e006fe70 2024-09-12T17:27:37.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.778+0000 7f01e4ab8640 1 -- 172.21.15.47:0/2052243602 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01e0070250 con 0x7f01e006fe70 2024-09-12T17:27:37.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.778+0000 7f79912ab640 1 --2- 172.21.15.47:0/1235845910 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f797003de90 0x7f7970040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:37.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.778+0000 7f01ceffd640 1 --2- 172.21.15.47:0/2052243602 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f01c003dec0 0x7f01c0040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:37.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.778+0000 7f79912ab640 1 --2- 172.21.15.47:0/1235845910 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f797003de90 0x7f7970040350 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f797c001600 tx=0x7f797c0079f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:37.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.778+0000 7f01ddd9b640 1 --2- 172.21.15.47:0/2052243602 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f01c003dec0 0x7f01c0040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:37.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.779+0000 7f01ddd9b640 1 --2- 172.21.15.47:0/2052243602 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f01c003dec0 0x7f01c0040380 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f01d4007fd0 tx=0x7f01d4007aa0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:37.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.782+0000 7fdeaf7fe640 1 -- 172.21.15.47:0/1564993814 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7fdeb80463b0 con 0x7fdec812d060 2024-09-12T17:27:37.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.782+0000 7f01ceffd640 1 -- 172.21.15.47:0/2052243602 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f01d0071f70 con 0x7f01e006fe70 2024-09-12T17:27:37.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.786+0000 7f79827fc640 1 -- 172.21.15.47:0/1235845910 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f798c11f640 con 0x7f798c06fe70 2024-09-12T17:27:37.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.791+0000 7f01ceffd640 1 -- 172.21.15.47:0/2052243602 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f01d0046450 con 0x7f01e006fe70 2024-09-12T17:27:37.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.820+0000 7f59fa2ef640 1 Processor -- start 2024-09-12T17:27:37.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.820+0000 7f59fa2ef640 1 -- start start 2024-09-12T17:27:37.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.821+0000 7f59fa2ef640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f59f4125960 0x7f59f4125d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:37.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.821+0000 7f59fa2ef640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59f4073a30 con 0x7f59f4114190 2024-09-12T17:27:37.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.821+0000 7f59fa2ef640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f59f4117100 con 0x7f59f4125960 2024-09-12T17:27:37.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.821+0000 7f59f37fe640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f59f4114190 0x7f59f41145a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:46032/0 (socket says 172.21.15.47:46032) 2024-09-12T17:27:37.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.821+0000 7f59f37fe640 1 -- 172.21.15.47:0/1772495507 learned_addr learned my addr 172.21.15.47:0/1772495507 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-09-12T17:27:37.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.821+0000 7f59f3fff640 1 --2- 172.21.15.47:0/1772495507 >> v2:172.21.15.47:3300/0 conn(0x7f59f4125960 0x7f59f4125d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:37.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.821+0000 7f59f2ffd640 1 -- 172.21.15.47:0/1772495507 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4134867886 0 0) 0x7f59f4073a30 con 0x7f59f4114190 2024-09-12T17:27:37.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.821+0000 7f59f2ffd640 1 -- 172.21.15.47:0/1772495507 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59dc003520 con 0x7f59f4114190 2024-09-12T17:27:37.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.822+0000 7f59f2ffd640 1 -- 172.21.15.47:0/1772495507 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1695309433 0 0) 0x7f59dc003520 con 0x7f59f4114190 2024-09-12T17:27:37.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.822+0000 7f59f2ffd640 1 -- 172.21.15.47:0/1772495507 >> v2:172.21.15.47:3300/0 conn(0x7f59f4125960 msgr2=0x7f59f4125d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T17:27:37.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.822+0000 7f59f2ffd640 1 --2- 172.21.15.47:0/1772495507 >> v2:172.21.15.47:3300/0 conn(0x7f59f4125960 0x7f59f4125d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:37.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.822+0000 7f59f2ffd640 1 -- 172.21.15.47:0/1772495507 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59f4116d60 con 0x7f59f4114190 2024-09-12T17:27:37.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.822+0000 7f59f2ffd640 1 -- 172.21.15.47:0/1772495507 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 513342583 0 0) 0x7f59e8001620 con 0x7f59f4114190 2024-09-12T17:27:37.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.822+0000 7f59f3fff640 1 --2- 172.21.15.47:0/1772495507 >> v2:172.21.15.47:3300/0 conn(0x7f59f4125960 0x7f59f4125d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T17:27:37.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.822+0000 7f59f2ffd640 1 -- 172.21.15.47:0/1772495507 >> v1:172.21.15.47:6789/0 conn(0x7f59f4114190 legacy=0x7f59f41145a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:37.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.822+0000 7f59f2ffd640 1 --2- 172.21.15.47:0/1772495507 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59dc003a50 0x7f59dc003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:37.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.822+0000 7f59f2ffd640 1 -- 172.21.15.47:0/1772495507 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f59dc0045c0 con 0x7f59dc003a50 2024-09-12T17:27:37.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.822+0000 7f59f3fff640 1 --2- 172.21.15.47:0/1772495507 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59dc003a50 0x7f59dc003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:37.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.823+0000 7f59f3fff640 1 -- 172.21.15.47:0/1772495507 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59dc003520 con 0x7f59dc003a50 2024-09-12T17:27:37.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.824+0000 7f59f3fff640 1 --2- 172.21.15.47:0/1772495507 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59dc003a50 0x7f59dc003e50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f59e4009820 tx=0x7f59dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0592f2d9ceeadbb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:37.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.824+0000 7f59f2ffd640 1 -- 172.21.15.47:0/1772495507 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59e400f040 con 0x7f59dc003a50 2024-09-12T17:27:37.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.824+0000 7f59f2ffd640 1 -- 172.21.15.47:0/1772495507 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59e402adf0 con 0x7f59dc003a50 2024-09-12T17:27:37.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.824+0000 7f59f2ffd640 1 -- 172.21.15.47:0/1772495507 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59e4004160 con 0x7f59dc003a50 2024-09-12T17:27:37.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.825+0000 7f59fa2ef640 1 -- 172.21.15.47:0/1772495507 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59dc003a50 msgr2=0x7f59dc003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:37.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.825+0000 7f59fa2ef640 1 --2- 172.21.15.47:0/1772495507 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59dc003a50 0x7f59dc003e50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f59e4009820 tx=0x7f59dc005830 comp rx=0 tx=0).stop 2024-09-12T17:27:37.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.825+0000 7f59fa2ef640 1 -- 172.21.15.47:0/1772495507 shutdown_connections 2024-09-12T17:27:37.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.825+0000 7f59fa2ef640 1 --2- 172.21.15.47:0/1772495507 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59dc003a50 0x7f59dc003e50 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:37.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.825+0000 7f59fa2ef640 1 --2- 172.21.15.47:0/1772495507 >> v2:172.21.15.47:3300/0 conn(0x7f59f4125960 0x7f59f4125d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:37.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.825+0000 7f59fa2ef640 1 -- 172.21.15.47:0/1772495507 >> 172.21.15.47:0/1772495507 conn(0x7f59f406f8d0 msgr2=0x7f59f4071cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:37.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.825+0000 7f59fa2ef640 1 -- 172.21.15.47:0/1772495507 shutdown_connections 2024-09-12T17:27:37.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.825+0000 7f59fa2ef640 1 -- 172.21.15.47:0/1772495507 wait complete. 2024-09-12T17:27:37.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.826+0000 7f59fa2ef640 1 Processor -- start 2024-09-12T17:27:37.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.826+0000 7f59fa2ef640 1 -- start start 2024-09-12T17:27:37.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.826+0000 7f59fa2ef640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59dc003a50 0x7f59f4117330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:37.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.826+0000 7f59fa2ef640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f59f41165f0 con 0x7f59dc003a50 2024-09-12T17:27:37.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.827+0000 7f59f3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59dc003a50 0x7f59f4117330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:37.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.827+0000 7f59f3fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59dc003a50 0x7f59f4117330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36242/0 (socket says 172.21.15.47:36242) 2024-09-12T17:27:37.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.827+0000 7f59f3fff640 1 -- 172.21.15.47:0/2983215149 learned_addr learned my addr 172.21.15.47:0/2983215149 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:27:37.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.827+0000 7f59f3fff640 1 -- 172.21.15.47:0/2983215149 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59f4118b20 con 0x7f59dc003a50 2024-09-12T17:27:37.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.828+0000 7f59f3fff640 1 --2- 172.21.15.47:0/2983215149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59dc003a50 0x7f59f4117330 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f59e402bfd0 tx=0x7f59e4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:37.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.828+0000 7f59f0ff9640 1 -- 172.21.15.47:0/2983215149 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59e4042070 con 0x7f59dc003a50 2024-09-12T17:27:37.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.828+0000 7f59f0ff9640 1 -- 172.21.15.47:0/2983215149 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59e400f000 con 0x7f59dc003a50 2024-09-12T17:27:37.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.828+0000 7f59f0ff9640 1 -- 172.21.15.47:0/2983215149 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59e4003e20 con 0x7f59dc003a50 2024-09-12T17:27:37.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.828+0000 7f59fa2ef640 1 -- 172.21.15.47:0/2983215149 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59f411a010 con 0x7f59dc003a50 2024-09-12T17:27:37.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.828+0000 7f59fa2ef640 1 -- 172.21.15.47:0/2983215149 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59f4072ce0 con 0x7f59dc003a50 2024-09-12T17:27:37.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.829+0000 7f59da7fc640 1 -- 172.21.15.47:0/2983215149 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59cc005080 con 0x7f59dc003a50 2024-09-12T17:27:37.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.830+0000 7f59f0ff9640 1 -- 172.21.15.47:0/2983215149 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f59e4045070 con 0x7f59dc003a50 2024-09-12T17:27:37.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.830+0000 7f59f0ff9640 1 --2- 172.21.15.47:0/2983215149 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f59e003de60 0x7f59e0040320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:37.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.830+0000 7f59f0ff9640 1 -- 172.21.15.47:0/2983215149 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f59e4072980 con 0x7f59dc003a50 2024-09-12T17:27:37.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.830+0000 7f59f37fe640 1 --2- 172.21.15.47:0/2983215149 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f59e003de60 0x7f59e0040320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:37.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.831+0000 7f59f37fe640 1 --2- 172.21.15.47:0/2983215149 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f59e003de60 0x7f59e0040320 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f59e8001810 tx=0x7f59e8001180 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:37.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.839+0000 7f59f0ff9640 1 -- 172.21.15.47:0/2983215149 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f59e4045d70 con 0x7f59dc003a50 2024-09-12T17:27:37.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.970+0000 7fdecd6e4640 1 -- 172.21.15.47:0/1564993814 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fdea8005370 con 0x7fdec812d060 2024-09-12T17:27:37.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.971+0000 7fdeaf7fe640 1 -- 172.21.15.47:0/1564993814 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdeb802ae20 con 0x7fdec812d060 2024-09-12T17:27:37.972 INFO:teuthology.orchestra.run.smithi047.stdout:38654705670 2024-09-12T17:27:37.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.974+0000 7fdecd6e4640 1 -- 172.21.15.47:0/1564993814 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fdeb403dec0 msgr2=0x7fdeb4040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:37.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.974+0000 7fdecd6e4640 1 --2- 172.21.15.47:0/1564993814 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fdeb403dec0 0x7fdeb4040380 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdebc007fd0 tx=0x7fdebc007aa0 comp rx=0 tx=0).stop 2024-09-12T17:27:37.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.974+0000 7fdecd6e4640 1 -- 172.21.15.47:0/1564993814 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdec812d060 msgr2=0x7fdec811d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:37.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.974+0000 7fdecd6e4640 1 --2- 172.21.15.47:0/1564993814 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdec812d060 0x7fdec811d650 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdeb802a1e0 tx=0x7fdeb80046c0 comp rx=0 tx=0).stop 2024-09-12T17:27:37.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.974+0000 7fdecd6e4640 1 -- 172.21.15.47:0/1564993814 shutdown_connections 2024-09-12T17:27:37.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.974+0000 7fdecd6e4640 1 --2- 172.21.15.47:0/1564993814 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fdeb403dec0 0x7fdeb4040380 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:37.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.974+0000 7fdecd6e4640 1 --2- 172.21.15.47:0/1564993814 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdec812d060 0x7fdec811d650 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:37.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.974+0000 7fdecd6e4640 1 -- 172.21.15.47:0/1564993814 >> 172.21.15.47:0/1564993814 conn(0x7fdec8071df0 msgr2=0x7fdec812b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:37.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.974+0000 7fdecd6e4640 1 -- 172.21.15.47:0/1564993814 shutdown_connections 2024-09-12T17:27:37.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.975+0000 7fdecd6e4640 1 -- 172.21.15.47:0/1564993814 wait complete. 2024-09-12T17:27:37.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.983+0000 7f01e4ab8640 1 -- 172.21.15.47:0/2052243602 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f01e0120bb0 con 0x7f01e006fe70 2024-09-12T17:27:37.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.984+0000 7f01ceffd640 1 -- 172.21.15.47:0/2052243602 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f01d003bca0 con 0x7f01e006fe70 2024-09-12T17:27:37.985 INFO:teuthology.orchestra.run.smithi047.stdout:38654705669 2024-09-12T17:27:37.987 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.0 2024-09-12T17:27:37.987 DEBUG:teuthology.parallel:result is None 2024-09-12T17:27:37.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.987+0000 7f01e4ab8640 1 -- 172.21.15.47:0/2052243602 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f01c003dec0 msgr2=0x7f01c0040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:37.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.987+0000 7f01e4ab8640 1 --2- 172.21.15.47:0/2052243602 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f01c003dec0 0x7f01c0040380 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f01d4007fd0 tx=0x7f01d4007aa0 comp rx=0 tx=0).stop 2024-09-12T17:27:37.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.987+0000 7f01e4ab8640 1 -- 172.21.15.47:0/2052243602 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01e006fe70 msgr2=0x7f01e011f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:37.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.987+0000 7f01e4ab8640 1 --2- 172.21.15.47:0/2052243602 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01e006fe70 0x7f01e011f210 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f01d0009840 tx=0x7f01d00046c0 comp rx=0 tx=0).stop 2024-09-12T17:27:37.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.987+0000 7f01e4ab8640 1 -- 172.21.15.47:0/2052243602 shutdown_connections 2024-09-12T17:27:37.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.987+0000 7f01e4ab8640 1 --2- 172.21.15.47:0/2052243602 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f01c003dec0 0x7f01c0040380 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:37.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.987+0000 7f01e4ab8640 1 --2- 172.21.15.47:0/2052243602 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01e006fe70 0x7f01e011f210 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:37.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.987+0000 7f01e4ab8640 1 -- 172.21.15.47:0/2052243602 >> 172.21.15.47:0/2052243602 conn(0x7f01e00a0a50 msgr2=0x7f01e012c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:37.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.987+0000 7f01e4ab8640 1 -- 172.21.15.47:0/2052243602 shutdown_connections 2024-09-12T17:27:37.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.987+0000 7f01e4ab8640 1 -- 172.21.15.47:0/2052243602 wait complete. 2024-09-12T17:27:37.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.994+0000 7f7993d10640 1 -- 172.21.15.47:0/1235845910 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f798c11e5d0 con 0x7f798c06fe70 2024-09-12T17:27:37.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.995+0000 7f79827fc640 1 -- 172.21.15.47:0/1235845910 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7988071e00 con 0x7f798c06fe70 2024-09-12T17:27:37.996 INFO:teuthology.orchestra.run.smithi047.stdout:38654705669 2024-09-12T17:27:37.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.997+0000 7f7993d10640 1 -- 172.21.15.47:0/1235845910 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f797003de90 msgr2=0x7f7970040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:37.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.997+0000 7f7993d10640 1 --2- 172.21.15.47:0/1235845910 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f797003de90 0x7f7970040350 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f797c001600 tx=0x7f797c0079f0 comp rx=0 tx=0).stop 2024-09-12T17:27:37.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.997+0000 7f7993d10640 1 -- 172.21.15.47:0/1235845910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f798c06fe70 msgr2=0x7f798c11cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:37.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.997+0000 7f7993d10640 1 --2- 172.21.15.47:0/1235845910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f798c06fe70 0x7f798c11cea0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f798802a230 tx=0x7f79880046c0 comp rx=0 tx=0).stop 2024-09-12T17:27:37.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.997+0000 7f7993d10640 1 -- 172.21.15.47:0/1235845910 shutdown_connections 2024-09-12T17:27:37.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.997+0000 7f7993d10640 1 --2- 172.21.15.47:0/1235845910 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f797003de90 0x7f7970040350 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:37.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.997+0000 7f7993d10640 1 --2- 172.21.15.47:0/1235845910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f798c06fe70 0x7f798c11cea0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:37.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.997+0000 7f7993d10640 1 -- 172.21.15.47:0/1235845910 >> 172.21.15.47:0/1235845910 conn(0x7f798c0a0a50 msgr2=0x7f798c1b7600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:37.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.998+0000 7f7993d10640 1 -- 172.21.15.47:0/1235845910 shutdown_connections 2024-09-12T17:27:38.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:37.998+0000 7f7993d10640 1 -- 172.21.15.47:0/1235845910 wait complete. 2024-09-12T17:27:38.000 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.1 2024-09-12T17:27:38.001 DEBUG:teuthology.parallel:result is None 2024-09-12T17:27:38.010 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.2 2024-09-12T17:27:38.010 DEBUG:teuthology.parallel:result is None 2024-09-12T17:27:38.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.030+0000 7f59da7fc640 1 -- 172.21.15.47:0/2983215149 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f59cc005370 con 0x7f59dc003a50 2024-09-12T17:27:38.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.030+0000 7f59f0ff9640 1 -- 172.21.15.47:0/2983215149 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f59e403ccf0 con 0x7f59dc003a50 2024-09-12T17:27:38.032 INFO:teuthology.orchestra.run.smithi047.stdout:42949672966 2024-09-12T17:27:38.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.033+0000 7f59da7fc640 1 -- 172.21.15.47:0/2983215149 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f59e003de60 msgr2=0x7f59e0040320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:38.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.033+0000 7f59da7fc640 1 --2- 172.21.15.47:0/2983215149 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f59e003de60 0x7f59e0040320 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f59e8001810 tx=0x7f59e8001180 comp rx=0 tx=0).stop 2024-09-12T17:27:38.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.033+0000 7f59da7fc640 1 -- 172.21.15.47:0/2983215149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59dc003a50 msgr2=0x7f59f4117330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:38.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.033+0000 7f59da7fc640 1 --2- 172.21.15.47:0/2983215149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59dc003a50 0x7f59f4117330 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f59e402bfd0 tx=0x7f59e4004730 comp rx=0 tx=0).stop 2024-09-12T17:27:38.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.033+0000 7f59da7fc640 1 -- 172.21.15.47:0/2983215149 shutdown_connections 2024-09-12T17:27:38.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.033+0000 7f59da7fc640 1 --2- 172.21.15.47:0/2983215149 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f59e003de60 0x7f59e0040320 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:38.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.033+0000 7f59da7fc640 1 --2- 172.21.15.47:0/2983215149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59dc003a50 0x7f59f4117330 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:38.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.033+0000 7f59da7fc640 1 -- 172.21.15.47:0/2983215149 >> 172.21.15.47:0/2983215149 conn(0x7f59f406f8d0 msgr2=0x7f59f4128650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:38.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.033+0000 7f59da7fc640 1 -- 172.21.15.47:0/2983215149 shutdown_connections 2024-09-12T17:27:38.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.033+0000 7f59da7fc640 1 -- 172.21.15.47:0/2983215149 wait complete. 2024-09-12T17:27:38.044 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672966 for osd.3 2024-09-12T17:27:38.045 DEBUG:teuthology.parallel:result is None 2024-09-12T17:27:38.045 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T17:27:38.045 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:27:38.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.185+0000 7fb8a13cd640 1 Processor -- start 2024-09-12T17:27:38.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.185+0000 7fb8a13cd640 1 -- start start 2024-09-12T17:27:38.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.186+0000 7fb8a13cd640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb89c12fc50 0x7fb89c1344e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:38.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.186+0000 7fb8a13cd640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb89c070f40 con 0x7fb89c12f160 2024-09-12T17:27:38.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.186+0000 7fb8a13cd640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fb89c070d70 con 0x7fb89c12fc50 2024-09-12T17:27:38.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.186+0000 7fb89a7fc640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb89c12fc50 0x7fb89c1344e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:38.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.186+0000 7fb89a7fc640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb89c12fc50 0x7fb89c1344e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36258/0 (socket says 172.21.15.47:36258) 2024-09-12T17:27:38.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.186+0000 7fb89affd640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fb89c12f160 0x7fb89c12f540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:46048/0 (socket says 172.21.15.47:46048) 2024-09-12T17:27:38.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.186+0000 7fb89a7fc640 1 -- 172.21.15.47:0/3419756348 learned_addr learned my addr 172.21.15.47:0/3419756348 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:27:38.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.186+0000 7fb89a7fc640 1 -- 172.21.15.47:0/3419756348 >> v1:172.21.15.47:6789/0 conn(0x7fb89c12f160 legacy=0x7fb89c12f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:38.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.186+0000 7fb89a7fc640 1 -- 172.21.15.47:0/3419756348 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb89c072160 con 0x7fb89c12fc50 2024-09-12T17:27:38.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.187+0000 7fb89a7fc640 1 --2- 172.21.15.47:0/3419756348 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb89c12fc50 0x7fb89c1344e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb8900097f0 tx=0x7fb89002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6afeadf4c0a41c2b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:38.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.187+0000 7fb899ffb640 1 -- 172.21.15.47:0/3419756348 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb890037070 con 0x7fb89c12fc50 2024-09-12T17:27:38.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.187+0000 7fb899ffb640 1 -- 172.21.15.47:0/3419756348 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb890032440 con 0x7fb89c12fc50 2024-09-12T17:27:38.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.187+0000 7fb899ffb640 1 -- 172.21.15.47:0/3419756348 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb89002ae60 con 0x7fb89c12fc50 2024-09-12T17:27:38.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.187+0000 7fb8a13cd640 1 -- 172.21.15.47:0/3419756348 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb89c12fc50 msgr2=0x7fb89c1344e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:38.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.188+0000 7fb8a13cd640 1 --2- 172.21.15.47:0/3419756348 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb89c12fc50 0x7fb89c1344e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb8900097f0 tx=0x7fb89002a1e0 comp rx=0 tx=0).stop 2024-09-12T17:27:38.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.188+0000 7fb8a13cd640 1 -- 172.21.15.47:0/3419756348 shutdown_connections 2024-09-12T17:27:38.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.188+0000 7fb8a13cd640 1 --2- 172.21.15.47:0/3419756348 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb89c12fc50 0x7fb89c1344e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:38.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.188+0000 7fb8a13cd640 1 -- 172.21.15.47:0/3419756348 >> 172.21.15.47:0/3419756348 conn(0x7fb89c0a0ae0 msgr2=0x7fb89c06dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:38.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.188+0000 7fb8a13cd640 1 -- 172.21.15.47:0/3419756348 shutdown_connections 2024-09-12T17:27:38.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.188+0000 7fb8a13cd640 1 -- 172.21.15.47:0/3419756348 wait complete. 2024-09-12T17:27:38.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.189+0000 7fb8a13cd640 1 Processor -- start 2024-09-12T17:27:38.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.189+0000 7fb8a13cd640 1 -- start start 2024-09-12T17:27:38.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.189+0000 7fb8a13cd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb89c12f160 0x7fb89c11bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:38.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.189+0000 7fb8a13cd640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb89c134ba0 con 0x7fb89c12f160 2024-09-12T17:27:38.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.189+0000 7fb89affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb89c12f160 0x7fb89c11bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:38.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.189+0000 7fb89affd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb89c12f160 0x7fb89c11bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36260/0 (socket says 172.21.15.47:36260) 2024-09-12T17:27:38.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.189+0000 7fb89affd640 1 -- 172.21.15.47:0/3394260402 learned_addr learned my addr 172.21.15.47:0/3394260402 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:27:38.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.189+0000 7fb89affd640 1 -- 172.21.15.47:0/3394260402 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb89c11e2f0 con 0x7fb89c12f160 2024-09-12T17:27:38.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.190+0000 7fb89affd640 1 --2- 172.21.15.47:0/3394260402 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb89c12f160 0x7fb89c11bfc0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb88c00c450 tx=0x7fb88c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:38.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.190+0000 7fb8837fe640 1 -- 172.21.15.47:0/3394260402 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb88c007410 con 0x7fb89c12f160 2024-09-12T17:27:38.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.190+0000 7fb8837fe640 1 -- 172.21.15.47:0/3394260402 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb88c0075b0 con 0x7fb89c12f160 2024-09-12T17:27:38.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.190+0000 7fb8a13cd640 1 -- 172.21.15.47:0/3394260402 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb89c11f3d0 con 0x7fb89c12f160 2024-09-12T17:27:38.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.190+0000 7fb8837fe640 1 -- 172.21.15.47:0/3394260402 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb88c004950 con 0x7fb89c12f160 2024-09-12T17:27:38.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.190+0000 7fb8a13cd640 1 -- 172.21.15.47:0/3394260402 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb89c11c500 con 0x7fb89c12f160 2024-09-12T17:27:38.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.191+0000 7fb8a13cd640 1 -- 172.21.15.47:0/3394260402 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb89c11d6f0 con 0x7fb89c12f160 2024-09-12T17:27:38.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.191+0000 7fb8837fe640 1 -- 172.21.15.47:0/3394260402 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb88c004af0 con 0x7fb89c12f160 2024-09-12T17:27:38.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.191+0000 7fb8837fe640 1 --2- 172.21.15.47:0/3394260402 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb88803de90 0x7fb888040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:38.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.191+0000 7fb8837fe640 1 -- 172.21.15.47:0/3394260402 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7fb88c051710 con 0x7fb89c12f160 2024-09-12T17:27:38.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.191+0000 7fb89a7fc640 1 --2- 172.21.15.47:0/3394260402 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb88803de90 0x7fb888040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:38.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.192+0000 7fb89a7fc640 1 --2- 172.21.15.47:0/3394260402 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb88803de90 0x7fb888040350 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb890034000 tx=0x7fb89002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:38.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.195+0000 7fb8837fe640 1 -- 172.21.15.47:0/3394260402 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7fb88c019310 con 0x7fb89c12f160 2024-09-12T17:27:38.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.376+0000 7fb8a13cd640 1 -- 172.21.15.47:0/3394260402 --> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb89c12f540 con 0x7fb88803de90 2024-09-12T17:27:38.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.377+0000 7fb8837fe640 1 -- 172.21.15.47:0/3394260402 <== mgr.4102 v2:172.21.15.170:6824/4146902489 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32166 (secure 0 0 0) 0x7fb89c12f540 con 0x7fb88803de90 2024-09-12T17:27:38.379 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:27:38.379 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-09-12T17:27:38.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.379+0000 7fb8a13cd640 1 -- 172.21.15.47:0/3394260402 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb88803de90 msgr2=0x7fb888040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:38.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.379+0000 7fb8a13cd640 1 --2- 172.21.15.47:0/3394260402 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb88803de90 0x7fb888040350 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb890034000 tx=0x7fb89002e000 comp rx=0 tx=0).stop 2024-09-12T17:27:38.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.379+0000 7fb8a13cd640 1 -- 172.21.15.47:0/3394260402 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb89c12f160 msgr2=0x7fb89c11bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:38.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.379+0000 7fb8a13cd640 1 --2- 172.21.15.47:0/3394260402 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb89c12f160 0x7fb89c11bfc0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb88c00c450 tx=0x7fb88c00c910 comp rx=0 tx=0).stop 2024-09-12T17:27:38.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.379+0000 7fb8a13cd640 1 -- 172.21.15.47:0/3394260402 shutdown_connections 2024-09-12T17:27:38.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.379+0000 7fb8a13cd640 1 --2- 172.21.15.47:0/3394260402 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb88803de90 0x7fb888040350 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:38.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.379+0000 7fb8a13cd640 1 --2- 172.21.15.47:0/3394260402 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb89c12f160 0x7fb89c11bfc0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:38.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.380+0000 7fb8a13cd640 1 -- 172.21.15.47:0/3394260402 >> 172.21.15.47:0/3394260402 conn(0x7fb89c0a0ae0 msgr2=0x7fb89c06e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:38.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.380+0000 7fb8a13cd640 1 -- 172.21.15.47:0/3394260402 shutdown_connections 2024-09-12T17:27:38.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.380+0000 7fb8a13cd640 1 -- 172.21.15.47:0/3394260402 wait complete. 2024-09-12T17:27:38.391 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-12T17:27:37.733784+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":143128,"kb_used_data":1712,"kb_used_omap":6,"kb_used_meta":141305,"kb_avail":377344232,"statfs":{"total":386547056640,"available":386400493568,"internally_reserved":0,"allocated":1753088,"data_stored":1363118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":144697110},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.977985"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T17:27:34.769850+0000","last_change":"2024-09-12T17:27:34.769850+0000","last_active":"2024-09-12T17:27:34.769850+0000","last_peered":"2024-09-12T17:27:34.769850+0000","last_clean":"2024-09-12T17:27:34.769850+0000","last_became_active":"2024-09-12T17:27:32.775344+0000","last_became_peered":"2024-09-12T17:27:32.775344+0000","last_unstale":"2024-09-12T17:27:34.769850+0000","last_undegraded":"2024-09-12T17:27:34.769850+0000","last_fullsized":"2024-09-12T17:27:34.769850+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:45.298951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011343939999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T17:27:34.764608+0000","last_change":"2024-09-12T17:27:34.764838+0000","last_active":"2024-09-12T17:27:34.764608+0000","last_peered":"2024-09-12T17:27:34.764608+0000","last_clean":"2024-09-12T17:27:34.764608+0000","last_became_active":"2024-09-12T17:27:32.761590+0000","last_became_peered":"2024-09-12T17:27:32.761590+0000","last_unstale":"2024-09-12T17:27:34.764608+0000","last_undegraded":"2024-09-12T17:27:34.764608+0000","last_fullsized":"2024-09-12T17:27:34.764608+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:23.009450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036072200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T17:27:34.770070+0000","last_change":"2024-09-12T17:27:34.770070+0000","last_active":"2024-09-12T17:27:34.770070+0000","last_peered":"2024-09-12T17:27:34.770070+0000","last_clean":"2024-09-12T17:27:34.770070+0000","last_became_active":"2024-09-12T17:27:32.761677+0000","last_became_peered":"2024-09-12T17:27:32.761677+0000","last_unstale":"2024-09-12T17:27:34.770070+0000","last_undegraded":"2024-09-12T17:27:34.770070+0000","last_fullsized":"2024-09-12T17:27:34.770070+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:22.236160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001356625,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T17:27:34.764539+0000","last_change":"2024-09-12T17:27:34.764756+0000","last_active":"2024-09-12T17:27:34.764539+0000","last_peered":"2024-09-12T17:27:34.764539+0000","last_clean":"2024-09-12T17:27:34.764539+0000","last_became_active":"2024-09-12T17:27:32.761595+0000","last_became_peered":"2024-09-12T17:27:32.761595+0000","last_unstale":"2024-09-12T17:27:34.764539+0000","last_undegraded":"2024-09-12T17:27:34.764539+0000","last_fullsized":"2024-09-12T17:27:34.764539+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:18.306129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000417551,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"16'2","reported_seq":22,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T17:27:34.770527+0000","last_change":"2024-09-12T17:27:34.769764+0000","last_active":"2024-09-12T17:27:34.770527+0000","last_peered":"2024-09-12T17:27:34.770527+0000","last_clean":"2024-09-12T17:27:34.770527+0000","last_became_active":"2024-09-12T17:27:32.761967+0000","last_became_peered":"2024-09-12T17:27:32.761967+0000","last_unstale":"2024-09-12T17:27:34.770527+0000","last_undegraded":"2024-09-12T17:27:34.770527+0000","last_fullsized":"2024-09-12T17:27:34.770527+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:25.345465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001062323,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T17:27:35.051864+0000","last_change":"2024-09-12T17:27:35.052087+0000","last_active":"2024-09-12T17:27:35.051864+0000","last_peered":"2024-09-12T17:27:35.051864+0000","last_clean":"2024-09-12T17:27:35.051864+0000","last_became_active":"2024-09-12T17:27:32.761809+0000","last_became_peered":"2024-09-12T17:27:32.761809+0000","last_unstale":"2024-09-12T17:27:35.051864+0000","last_undegraded":"2024-09-12T17:27:35.051864+0000","last_fullsized":"2024-09-12T17:27:35.051864+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:18.084479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051333900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T17:27:34.769202+0000","last_change":"2024-09-12T17:27:34.769202+0000","last_active":"2024-09-12T17:27:34.769202+0000","last_peered":"2024-09-12T17:27:34.769202+0000","last_clean":"2024-09-12T17:27:34.769202+0000","last_became_active":"2024-09-12T17:27:32.761687+0000","last_became_peered":"2024-09-12T17:27:32.761687+0000","last_unstale":"2024-09-12T17:27:34.769202+0000","last_undegraded":"2024-09-12T17:27:34.769202+0000","last_fullsized":"2024-09-12T17:27:34.769202+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:00.950082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056694099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"14'1","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T17:27:34.770151+0000","last_change":"2024-09-12T17:27:34.770151+0000","last_active":"2024-09-12T17:27:34.770151+0000","last_peered":"2024-09-12T17:27:34.770151+0000","last_clean":"2024-09-12T17:27:34.770151+0000","last_became_active":"2024-09-12T17:27:32.760744+0000","last_became_peered":"2024-09-12T17:27:32.760744+0000","last_unstale":"2024-09-12T17:27:34.770151+0000","last_undegraded":"2024-09-12T17:27:34.770151+0000","last_fullsized":"2024-09-12T17:27:34.770151+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:22:57.115660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014241220000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"11'72","reported_seq":111,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T17:27:35.074418+0000","last_change":"2024-09-12T17:27:25.975511+0000","last_active":"2024-09-12T17:27:35.074418+0000","last_peered":"2024-09-12T17:27:35.074418+0000","last_clean":"2024-09-12T17:27:35.074418+0000","last_became_active":"2024-09-12T17:27:25.974522+0000","last_became_peered":"2024-09-12T17:27:25.974522+0000","last_unstale":"2024-09-12T17:27:35.074418+0000","last_undegraded":"2024-09-12T17:27:35.074418+0000","last_fullsized":"2024-09-12T17:27:35.074418+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:24.738801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:24.738801+0000","last_clean_scrub_stamp":"2024-09-12T17:27:24.738801+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:42.005302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672966,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35488,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336352,"statfs":{"total":96636764160,"available":96600424448,"internally_reserved":0,"allocated":143360,"data_stored":45605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36068,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335772,"statfs":{"total":96636764160,"available":96599830528,"internally_reserved":0,"allocated":733184,"data_stored":635954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36072,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335768,"statfs":{"total":96636764160,"available":96599826432,"internally_reserved":0,"allocated":733184,"data_stored":635954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35500,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336340,"statfs":{"total":96636764160,"available":96600412160,"internally_reserved":0,"allocated":143360,"data_stored":45605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:27:38.392 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:27:38.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.492+0000 7f35de20f640 1 Processor -- start 2024-09-12T17:27:38.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.492+0000 7f35de20f640 1 -- start start 2024-09-12T17:27:38.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.492+0000 7f35de20f640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f35d8129d80 0x7f35d812a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:38.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.492+0000 7f35de20f640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35d806dc00 con 0x7f35d812a6a0 2024-09-12T17:27:38.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.492+0000 7f35de20f640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f35d81299c0 con 0x7f35d8129d80 2024-09-12T17:27:38.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.493+0000 7f35d77fe640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f35d8129d80 0x7f35d812a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:38.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.493+0000 7f35d6ffd640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f35d812a6a0 0x7f35d8110d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:46054/0 (socket says 172.21.15.47:46054) 2024-09-12T17:27:38.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.493+0000 7f35d6ffd640 1 -- 172.21.15.47:0/1980142576 learned_addr learned my addr 172.21.15.47:0/1980142576 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-09-12T17:27:38.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.493+0000 7f35d77fe640 1 -- 172.21.15.47:0/1980142576 >> v1:172.21.15.47:6789/0 conn(0x7f35d812a6a0 legacy=0x7f35d8110d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:38.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.493+0000 7f35d77fe640 1 -- 172.21.15.47:0/1980142576 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35d8114d20 con 0x7f35d8129d80 2024-09-12T17:27:38.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.494+0000 7f35d77fe640 1 --2- 172.21.15.47:0/1980142576 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35d8129d80 0x7f35d812a160 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f35c8009720 tx=0x7f35c802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aa7e21c5d3cb134 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:38.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.494+0000 7f35d67fc640 1 -- 172.21.15.47:0/1980142576 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35c8037070 con 0x7f35d8129d80 2024-09-12T17:27:38.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.494+0000 7f35d67fc640 1 -- 172.21.15.47:0/1980142576 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35c802ad90 con 0x7f35d8129d80 2024-09-12T17:27:38.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.494+0000 7f35d67fc640 1 -- 172.21.15.47:0/1980142576 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35c8032590 con 0x7f35d8129d80 2024-09-12T17:27:38.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.494+0000 7f35de20f640 1 -- 172.21.15.47:0/1980142576 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35d8129d80 msgr2=0x7f35d812a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:38.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.494+0000 7f35de20f640 1 --2- 172.21.15.47:0/1980142576 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35d8129d80 0x7f35d812a160 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f35c8009720 tx=0x7f35c802a110 comp rx=0 tx=0).stop 2024-09-12T17:27:38.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.494+0000 7f35de20f640 1 -- 172.21.15.47:0/1980142576 shutdown_connections 2024-09-12T17:27:38.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.494+0000 7f35de20f640 1 --2- 172.21.15.47:0/1980142576 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35d8129d80 0x7f35d812a160 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:38.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.494+0000 7f35de20f640 1 -- 172.21.15.47:0/1980142576 >> 172.21.15.47:0/1980142576 conn(0x7f35d8070850 msgr2=0x7f35d8072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:38.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.494+0000 7f35de20f640 1 -- 172.21.15.47:0/1980142576 shutdown_connections 2024-09-12T17:27:38.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.494+0000 7f35de20f640 1 -- 172.21.15.47:0/1980142576 wait complete. 2024-09-12T17:27:38.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.495+0000 7f35de20f640 1 Processor -- start 2024-09-12T17:27:38.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.495+0000 7f35de20f640 1 -- start start 2024-09-12T17:27:38.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.496+0000 7f35de20f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35d8129d80 0x7f35d81c0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:38.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.496+0000 7f35de20f640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f35d8114940 con 0x7f35d8129d80 2024-09-12T17:27:38.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.496+0000 7f35d77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35d8129d80 0x7f35d81c0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:38.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.496+0000 7f35d77fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35d8129d80 0x7f35d81c0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36274/0 (socket says 172.21.15.47:36274) 2024-09-12T17:27:38.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.496+0000 7f35d77fe640 1 -- 172.21.15.47:0/1281942808 learned_addr learned my addr 172.21.15.47:0/1281942808 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:27:38.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.496+0000 7f35d77fe640 1 -- 172.21.15.47:0/1281942808 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35d811fc10 con 0x7f35d8129d80 2024-09-12T17:27:38.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.496+0000 7f35d77fe640 1 --2- 172.21.15.47:0/1281942808 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35d8129d80 0x7f35d81c0d70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f35c8009840 tx=0x7f35c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:38.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.496+0000 7f35bffff640 1 -- 172.21.15.47:0/1281942808 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35c8041020 con 0x7f35d8129d80 2024-09-12T17:27:38.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.496+0000 7f35bffff640 1 -- 172.21.15.47:0/1281942808 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35c803d550 con 0x7f35d8129d80 2024-09-12T17:27:38.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.496+0000 7f35de20f640 1 -- 172.21.15.47:0/1281942808 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35d811fea0 con 0x7f35d8129d80 2024-09-12T17:27:38.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.496+0000 7f35bffff640 1 -- 172.21.15.47:0/1281942808 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35c8037040 con 0x7f35d8129d80 2024-09-12T17:27:38.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.496+0000 7f35de20f640 1 -- 172.21.15.47:0/1281942808 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35d81c1490 con 0x7f35d8129d80 2024-09-12T17:27:38.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.497+0000 7f35bffff640 1 -- 172.21.15.47:0/1281942808 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f35c8044020 con 0x7f35d8129d80 2024-09-12T17:27:38.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.497+0000 7f35de20f640 1 -- 172.21.15.47:0/1281942808 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35d81119e0 con 0x7f35d8129d80 2024-09-12T17:27:38.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.498+0000 7f35bffff640 1 --2- 172.21.15.47:0/1281942808 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f35c403de90 0x7f35c4040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:38.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.498+0000 7f35bffff640 1 -- 172.21.15.47:0/1281942808 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f35c8072960 con 0x7f35d8129d80 2024-09-12T17:27:38.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.498+0000 7f35d6ffd640 1 --2- 172.21.15.47:0/1281942808 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f35c403de90 0x7f35c4040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:38.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.499+0000 7f35d6ffd640 1 --2- 172.21.15.47:0/1281942808 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f35c403de90 0x7f35c4040350 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f35cc007fd0 tx=0x7f35cc007aa0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:38.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.502+0000 7f35bffff640 1 -- 172.21.15.47:0/1281942808 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f35c804b030 con 0x7f35d8129d80 2024-09-12T17:27:38.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.681+0000 7f35de20f640 1 -- 172.21.15.47:0/1281942808 --> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f35d8114010 con 0x7f35c403de90 2024-09-12T17:27:38.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.682+0000 7f35bffff640 1 -- 172.21.15.47:0/1281942808 <== mgr.4102 v2:172.21.15.170:6824/4146902489 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32166 (secure 0 0 0) 0x7f35d8114010 con 0x7f35c403de90 2024-09-12T17:27:38.684 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:27:38.684 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-09-12T17:27:38.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.685+0000 7f35de20f640 1 -- 172.21.15.47:0/1281942808 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f35c403de90 msgr2=0x7f35c4040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:38.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.685+0000 7f35de20f640 1 --2- 172.21.15.47:0/1281942808 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f35c403de90 0x7f35c4040350 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f35cc007fd0 tx=0x7f35cc007aa0 comp rx=0 tx=0).stop 2024-09-12T17:27:38.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.685+0000 7f35de20f640 1 -- 172.21.15.47:0/1281942808 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35d8129d80 msgr2=0x7f35d81c0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:38.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.685+0000 7f35de20f640 1 --2- 172.21.15.47:0/1281942808 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35d8129d80 0x7f35d81c0d70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f35c8009840 tx=0x7f35c80046c0 comp rx=0 tx=0).stop 2024-09-12T17:27:38.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.685+0000 7f35de20f640 1 -- 172.21.15.47:0/1281942808 shutdown_connections 2024-09-12T17:27:38.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.685+0000 7f35de20f640 1 --2- 172.21.15.47:0/1281942808 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f35c403de90 0x7f35c4040350 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:38.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.685+0000 7f35de20f640 1 --2- 172.21.15.47:0/1281942808 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35d8129d80 0x7f35d81c0d70 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:38.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.685+0000 7f35de20f640 1 -- 172.21.15.47:0/1281942808 >> 172.21.15.47:0/1281942808 conn(0x7f35d8070850 msgr2=0x7f35d8126310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:38.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.685+0000 7f35de20f640 1 -- 172.21.15.47:0/1281942808 shutdown_connections 2024-09-12T17:27:38.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.685+0000 7f35de20f640 1 -- 172.21.15.47:0/1281942808 wait complete. 2024-09-12T17:27:38.697 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-12T17:27:37.733784+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":143128,"kb_used_data":1712,"kb_used_omap":6,"kb_used_meta":141305,"kb_avail":377344232,"statfs":{"total":386547056640,"available":386400493568,"internally_reserved":0,"allocated":1753088,"data_stored":1363118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":144697110},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.977985"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T17:27:34.769850+0000","last_change":"2024-09-12T17:27:34.769850+0000","last_active":"2024-09-12T17:27:34.769850+0000","last_peered":"2024-09-12T17:27:34.769850+0000","last_clean":"2024-09-12T17:27:34.769850+0000","last_became_active":"2024-09-12T17:27:32.775344+0000","last_became_peered":"2024-09-12T17:27:32.775344+0000","last_unstale":"2024-09-12T17:27:34.769850+0000","last_undegraded":"2024-09-12T17:27:34.769850+0000","last_fullsized":"2024-09-12T17:27:34.769850+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:45.298951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011343939999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T17:27:34.764608+0000","last_change":"2024-09-12T17:27:34.764838+0000","last_active":"2024-09-12T17:27:34.764608+0000","last_peered":"2024-09-12T17:27:34.764608+0000","last_clean":"2024-09-12T17:27:34.764608+0000","last_became_active":"2024-09-12T17:27:32.761590+0000","last_became_peered":"2024-09-12T17:27:32.761590+0000","last_unstale":"2024-09-12T17:27:34.764608+0000","last_undegraded":"2024-09-12T17:27:34.764608+0000","last_fullsized":"2024-09-12T17:27:34.764608+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:23.009450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036072200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T17:27:34.770070+0000","last_change":"2024-09-12T17:27:34.770070+0000","last_active":"2024-09-12T17:27:34.770070+0000","last_peered":"2024-09-12T17:27:34.770070+0000","last_clean":"2024-09-12T17:27:34.770070+0000","last_became_active":"2024-09-12T17:27:32.761677+0000","last_became_peered":"2024-09-12T17:27:32.761677+0000","last_unstale":"2024-09-12T17:27:34.770070+0000","last_undegraded":"2024-09-12T17:27:34.770070+0000","last_fullsized":"2024-09-12T17:27:34.770070+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:22.236160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001356625,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T17:27:34.764539+0000","last_change":"2024-09-12T17:27:34.764756+0000","last_active":"2024-09-12T17:27:34.764539+0000","last_peered":"2024-09-12T17:27:34.764539+0000","last_clean":"2024-09-12T17:27:34.764539+0000","last_became_active":"2024-09-12T17:27:32.761595+0000","last_became_peered":"2024-09-12T17:27:32.761595+0000","last_unstale":"2024-09-12T17:27:34.764539+0000","last_undegraded":"2024-09-12T17:27:34.764539+0000","last_fullsized":"2024-09-12T17:27:34.764539+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:18.306129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000417551,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"16'2","reported_seq":22,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T17:27:34.770527+0000","last_change":"2024-09-12T17:27:34.769764+0000","last_active":"2024-09-12T17:27:34.770527+0000","last_peered":"2024-09-12T17:27:34.770527+0000","last_clean":"2024-09-12T17:27:34.770527+0000","last_became_active":"2024-09-12T17:27:32.761967+0000","last_became_peered":"2024-09-12T17:27:32.761967+0000","last_unstale":"2024-09-12T17:27:34.770527+0000","last_undegraded":"2024-09-12T17:27:34.770527+0000","last_fullsized":"2024-09-12T17:27:34.770527+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:25.345465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001062323,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T17:27:35.051864+0000","last_change":"2024-09-12T17:27:35.052087+0000","last_active":"2024-09-12T17:27:35.051864+0000","last_peered":"2024-09-12T17:27:35.051864+0000","last_clean":"2024-09-12T17:27:35.051864+0000","last_became_active":"2024-09-12T17:27:32.761809+0000","last_became_peered":"2024-09-12T17:27:32.761809+0000","last_unstale":"2024-09-12T17:27:35.051864+0000","last_undegraded":"2024-09-12T17:27:35.051864+0000","last_fullsized":"2024-09-12T17:27:35.051864+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:18.084479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051333900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T17:27:34.769202+0000","last_change":"2024-09-12T17:27:34.769202+0000","last_active":"2024-09-12T17:27:34.769202+0000","last_peered":"2024-09-12T17:27:34.769202+0000","last_clean":"2024-09-12T17:27:34.769202+0000","last_became_active":"2024-09-12T17:27:32.761687+0000","last_became_peered":"2024-09-12T17:27:32.761687+0000","last_unstale":"2024-09-12T17:27:34.769202+0000","last_undegraded":"2024-09-12T17:27:34.769202+0000","last_fullsized":"2024-09-12T17:27:34.769202+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:00.950082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056694099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"14'1","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T17:27:34.770151+0000","last_change":"2024-09-12T17:27:34.770151+0000","last_active":"2024-09-12T17:27:34.770151+0000","last_peered":"2024-09-12T17:27:34.770151+0000","last_clean":"2024-09-12T17:27:34.770151+0000","last_became_active":"2024-09-12T17:27:32.760744+0000","last_became_peered":"2024-09-12T17:27:32.760744+0000","last_unstale":"2024-09-12T17:27:34.770151+0000","last_undegraded":"2024-09-12T17:27:34.770151+0000","last_fullsized":"2024-09-12T17:27:34.770151+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:22:57.115660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014241220000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"11'72","reported_seq":111,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T17:27:35.074418+0000","last_change":"2024-09-12T17:27:25.975511+0000","last_active":"2024-09-12T17:27:35.074418+0000","last_peered":"2024-09-12T17:27:35.074418+0000","last_clean":"2024-09-12T17:27:35.074418+0000","last_became_active":"2024-09-12T17:27:25.974522+0000","last_became_peered":"2024-09-12T17:27:25.974522+0000","last_unstale":"2024-09-12T17:27:35.074418+0000","last_undegraded":"2024-09-12T17:27:35.074418+0000","last_fullsized":"2024-09-12T17:27:35.074418+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:24.738801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:24.738801+0000","last_clean_scrub_stamp":"2024-09-12T17:27:24.738801+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:42.005302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672966,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35488,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336352,"statfs":{"total":96636764160,"available":96600424448,"internally_reserved":0,"allocated":143360,"data_stored":45605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36068,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335772,"statfs":{"total":96636764160,"available":96599830528,"internally_reserved":0,"allocated":733184,"data_stored":635954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36072,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335768,"statfs":{"total":96636764160,"available":96599826432,"internally_reserved":0,"allocated":733184,"data_stored":635954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35500,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336340,"statfs":{"total":96636764160,"available":96600412160,"internally_reserved":0,"allocated":143360,"data_stored":45605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:27:38.698 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T17:27:38.698 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T17:27:38.698 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T17:27:38.698 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T17:27:38.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.797+0000 7f8dd01a4640 1 Processor -- start 2024-09-12T17:27:38.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.797+0000 7f8dd01a4640 1 -- start start 2024-09-12T17:27:38.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.797+0000 7f8dd01a4640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f8dc8130270 0x7f8dc8132660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:38.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.797+0000 7f8dd01a4640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dc806dc00 con 0x7f8dc8129d80 2024-09-12T17:27:38.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.797+0000 7f8dd01a4640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f8dc81299c0 con 0x7f8dc8130270 2024-09-12T17:27:38.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.798+0000 7f8dcd73f640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f8dc8130270 0x7f8dc8132660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:38.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.798+0000 7f8dcdf40640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f8dc8129d80 0x7f8dc812a160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:46066/0 (socket says 172.21.15.47:46066) 2024-09-12T17:27:38.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.798+0000 7f8dcdf40640 1 -- 172.21.15.47:0/4198908352 learned_addr learned my addr 172.21.15.47:0/4198908352 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-09-12T17:27:38.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.798+0000 7f8dcd73f640 1 -- 172.21.15.47:0/4198908352 >> v1:172.21.15.47:6789/0 conn(0x7f8dc8129d80 legacy=0x7f8dc812a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:38.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.798+0000 7f8dcd73f640 1 -- 172.21.15.47:0/4198908352 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dc812a870 con 0x7f8dc8130270 2024-09-12T17:27:38.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.798+0000 7f8dccf3e640 1 -- 172.21.15.47:0/4198908352 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3508432025 0 0) 0x7f8dc806dc00 con 0x7f8dc8129d80 2024-09-12T17:27:38.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.799+0000 7f8dcd73f640 1 --2- 172.21.15.47:0/4198908352 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8dc8130270 0x7f8dc8132660 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8db8009720 tx=0x7f8db802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c34463b470dd2d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:38.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.799+0000 7f8dccf3e640 1 -- 172.21.15.47:0/4198908352 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8db8037070 con 0x7f8dc8130270 2024-09-12T17:27:38.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.799+0000 7f8dccf3e640 1 -- 172.21.15.47:0/4198908352 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8db802ad90 con 0x7f8dc8130270 2024-09-12T17:27:38.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.799+0000 7f8dccf3e640 1 -- 172.21.15.47:0/4198908352 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8db8032590 con 0x7f8dc8130270 2024-09-12T17:27:38.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.799+0000 7f8dd01a4640 1 -- 172.21.15.47:0/4198908352 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8dc8130270 msgr2=0x7f8dc8132660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:38.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.799+0000 7f8dd01a4640 1 --2- 172.21.15.47:0/4198908352 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8dc8130270 0x7f8dc8132660 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8db8009720 tx=0x7f8db802a110 comp rx=0 tx=0).stop 2024-09-12T17:27:38.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.799+0000 7f8dd01a4640 1 -- 172.21.15.47:0/4198908352 shutdown_connections 2024-09-12T17:27:38.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.799+0000 7f8dd01a4640 1 --2- 172.21.15.47:0/4198908352 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8dc8130270 0x7f8dc8132660 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:38.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.799+0000 7f8dd01a4640 1 -- 172.21.15.47:0/4198908352 >> 172.21.15.47:0/4198908352 conn(0x7f8dc8070850 msgr2=0x7f8dc8072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:38.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.799+0000 7f8dd01a4640 1 -- 172.21.15.47:0/4198908352 shutdown_connections 2024-09-12T17:27:38.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.799+0000 7f8dd01a4640 1 -- 172.21.15.47:0/4198908352 wait complete. 2024-09-12T17:27:38.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.800+0000 7f8dd01a4640 1 Processor -- start 2024-09-12T17:27:38.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.800+0000 7f8dd01a4640 1 -- start start 2024-09-12T17:27:38.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.801+0000 7f8dd01a4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8dc8129d80 0x7f8dc8115750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:38.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.801+0000 7f8dd01a4640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc8073a10 con 0x7f8dc8129d80 2024-09-12T17:27:38.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.801+0000 7f8dcdf40640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8dc8129d80 0x7f8dc8115750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:38.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.801+0000 7f8dcdf40640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8dc8129d80 0x7f8dc8115750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36300/0 (socket says 172.21.15.47:36300) 2024-09-12T17:27:38.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.801+0000 7f8dcdf40640 1 -- 172.21.15.47:0/2342240740 learned_addr learned my addr 172.21.15.47:0/2342240740 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:27:38.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.801+0000 7f8dcdf40640 1 -- 172.21.15.47:0/2342240740 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dc8117520 con 0x7f8dc8129d80 2024-09-12T17:27:38.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.801+0000 7f8dcdf40640 1 --2- 172.21.15.47:0/2342240740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8dc8129d80 0x7f8dc8115750 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8dc400c3d0 tx=0x7f8dc400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:38.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.801+0000 7f8dbe7fc640 1 -- 172.21.15.47:0/2342240740 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dc40074d0 con 0x7f8dc8129d80 2024-09-12T17:27:38.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.801+0000 7f8dbe7fc640 1 -- 172.21.15.47:0/2342240740 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dc40047e0 con 0x7f8dc8129d80 2024-09-12T17:27:38.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.801+0000 7f8dd01a4640 1 -- 172.21.15.47:0/2342240740 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dc8118520 con 0x7f8dc8129d80 2024-09-12T17:27:38.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.801+0000 7f8dbe7fc640 1 -- 172.21.15.47:0/2342240740 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dc4007670 con 0x7f8dc8129d80 2024-09-12T17:27:38.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.801+0000 7f8dd01a4640 1 -- 172.21.15.47:0/2342240740 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dc8118960 con 0x7f8dc8129d80 2024-09-12T17:27:38.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.802+0000 7f8dd01a4640 1 -- 172.21.15.47:0/2342240740 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dc812a160 con 0x7f8dc8129d80 2024-09-12T17:27:38.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.802+0000 7f8dbe7fc640 1 -- 172.21.15.47:0/2342240740 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8dc4011070 con 0x7f8dc8129d80 2024-09-12T17:27:38.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.803+0000 7f8dbe7fc640 1 --2- 172.21.15.47:0/2342240740 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8dac03de90 0x7f8dac040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:38.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.803+0000 7f8dbe7fc640 1 -- 172.21.15.47:0/2342240740 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f8dc4051e60 con 0x7f8dc8129d80 2024-09-12T17:27:38.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.803+0000 7f8dcd73f640 1 --2- 172.21.15.47:0/2342240740 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8dac03de90 0x7f8dac040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:38.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.804+0000 7f8dcd73f640 1 --2- 172.21.15.47:0/2342240740 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8dac03de90 0x7f8dac040350 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8db8034000 tx=0x7f8db802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:38.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:38.807+0000 7f8dbe7fc640 1 -- 172.21.15.47:0/2342240740 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f8dc4012dd0 con 0x7f8dc8129d80 2024-09-12T17:27:39.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:39.027+0000 7f8dd01a4640 1 -- 172.21.15.47:0/2342240740 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8dc8068da0 con 0x7f8dc8129d80 2024-09-12T17:27:39.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:39.027+0000 7f8dbe7fc640 1 -- 172.21.15.47:0/2342240740 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f8dc4050d70 con 0x7f8dc8129d80 2024-09-12T17:27:39.029 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:27:39.029 INFO:teuthology.orchestra.run.smithi047.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T17:27:39.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:39.029+0000 7f8dd01a4640 1 -- 172.21.15.47:0/2342240740 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8dac03de90 msgr2=0x7f8dac040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:39.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:39.029+0000 7f8dd01a4640 1 --2- 172.21.15.47:0/2342240740 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8dac03de90 0x7f8dac040350 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8db8034000 tx=0x7f8db802e000 comp rx=0 tx=0).stop 2024-09-12T17:27:39.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:39.029+0000 7f8dd01a4640 1 -- 172.21.15.47:0/2342240740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8dc8129d80 msgr2=0x7f8dc8115750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:39.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:39.029+0000 7f8dd01a4640 1 --2- 172.21.15.47:0/2342240740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8dc8129d80 0x7f8dc8115750 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8dc400c3d0 tx=0x7f8dc400c890 comp rx=0 tx=0).stop 2024-09-12T17:27:39.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:39.029+0000 7f8dd01a4640 1 -- 172.21.15.47:0/2342240740 shutdown_connections 2024-09-12T17:27:39.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:39.029+0000 7f8dd01a4640 1 --2- 172.21.15.47:0/2342240740 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8dac03de90 0x7f8dac040350 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:39.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:39.029+0000 7f8dd01a4640 1 --2- 172.21.15.47:0/2342240740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8dc8129d80 0x7f8dc8115750 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:39.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:39.029+0000 7f8dd01a4640 1 -- 172.21.15.47:0/2342240740 >> 172.21.15.47:0/2342240740 conn(0x7f8dc8070850 msgr2=0x7f8dc81282f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:39.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:39.030+0000 7f8dd01a4640 1 -- 172.21.15.47:0/2342240740 shutdown_connections 2024-09-12T17:27:39.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:27:39.030+0000 7f8dd01a4640 1 -- 172.21.15.47:0/2342240740 wait complete. 2024-09-12T17:27:39.041 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T17:27:39.042 INFO:teuthology.run_tasks:Running task rgw... 2024-09-12T17:27:39.058 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-12T17:27:39.058 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-12T17:27:39.058 INFO:tasks.rgw:Creating data pools 2024-09-12T17:27:39.058 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-12T17:27:39.058 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-09-12T17:27:39.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.168+0000 7f5be752b640 1 Processor -- start 2024-09-12T17:27:39.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.168+0000 7f5be752b640 1 -- start start 2024-09-12T17:27:39.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.168+0000 7f5be752b640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5be0117e10 0x7f5be011a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:39.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.168+0000 7f5be752b640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5be011a740 con 0x7f5be010fff0 2024-09-12T17:27:39.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.168+0000 7f5be752b640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f5be011b920 con 0x7f5be0117e10 2024-09-12T17:27:39.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.169+0000 7f5be4ac6640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5be0117e10 0x7f5be011a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:39.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.169+0000 7f5be4ac6640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5be0117e10 0x7f5be011a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:41120/0 (socket says 172.21.15.170:41120) 2024-09-12T17:27:39.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.169+0000 7f5be52c7640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f5be010fff0 0x7f5be01103d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:49738/0 (socket says 172.21.15.170:49738) 2024-09-12T17:27:39.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.169+0000 7f5be4ac6640 1 -- 172.21.15.170:0/973704521 learned_addr learned my addr 172.21.15.170:0/973704521 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:39.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.169+0000 7f5be4ac6640 1 -- 172.21.15.170:0/973704521 >> v1:172.21.15.47:6789/0 conn(0x7f5be010fff0 legacy=0x7f5be01103d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:39.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.169+0000 7f5be4ac6640 1 -- 172.21.15.170:0/973704521 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5be011baa0 con 0x7f5be0117e10 2024-09-12T17:27:39.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.170+0000 7f5be4ac6640 1 --2- 172.21.15.170:0/973704521 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5be0117e10 0x7f5be011a200 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5bd00097f0 tx=0x7f5bd002b2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4248e6b37721d4fa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:39.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.170+0000 7f5bd7fff640 1 -- 172.21.15.170:0/973704521 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bd0038070 con 0x7f5be0117e10 2024-09-12T17:27:39.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.170+0000 7f5bd7fff640 1 -- 172.21.15.170:0/973704521 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bd0033440 con 0x7f5be0117e10 2024-09-12T17:27:39.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.170+0000 7f5bd7fff640 1 -- 172.21.15.170:0/973704521 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bd0033740 con 0x7f5be0117e10 2024-09-12T17:27:39.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.171+0000 7f5be752b640 1 -- 172.21.15.170:0/973704521 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5be0117e10 msgr2=0x7f5be011a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:39.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.171+0000 7f5be752b640 1 --2- 172.21.15.170:0/973704521 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5be0117e10 0x7f5be011a200 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5bd00097f0 tx=0x7f5bd002b2f0 comp rx=0 tx=0).stop 2024-09-12T17:27:39.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.171+0000 7f5be752b640 1 -- 172.21.15.170:0/973704521 shutdown_connections 2024-09-12T17:27:39.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.171+0000 7f5be752b640 1 --2- 172.21.15.170:0/973704521 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5be0117e10 0x7f5be011a200 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:39.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.171+0000 7f5be752b640 1 -- 172.21.15.170:0/973704521 >> 172.21.15.170:0/973704521 conn(0x7f5be006ff80 msgr2=0x7f5be00723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:39.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.171+0000 7f5be752b640 1 -- 172.21.15.170:0/973704521 shutdown_connections 2024-09-12T17:27:39.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.171+0000 7f5be752b640 1 -- 172.21.15.170:0/973704521 wait complete. 2024-09-12T17:27:39.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.171+0000 7f5be752b640 1 Processor -- start 2024-09-12T17:27:39.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.171+0000 7f5be752b640 1 -- start start 2024-09-12T17:27:39.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.172+0000 7f5be752b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5be010fff0 0x7f5be01a5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:39.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.172+0000 7f5be752b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5be0074390 con 0x7f5be010fff0 2024-09-12T17:27:39.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.172+0000 7f5be52c7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5be010fff0 0x7f5be01a5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:39.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.172+0000 7f5be52c7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5be010fff0 0x7f5be01a5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:41134/0 (socket says 172.21.15.170:41134) 2024-09-12T17:27:39.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.172+0000 7f5be52c7640 1 -- 172.21.15.170:0/4251027318 learned_addr learned my addr 172.21.15.170:0/4251027318 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:39.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.172+0000 7f5be52c7640 1 -- 172.21.15.170:0/4251027318 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5be01a5bd0 con 0x7f5be010fff0 2024-09-12T17:27:39.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.172+0000 7f5be52c7640 1 --2- 172.21.15.170:0/4251027318 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5be010fff0 0x7f5be01a5600 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc00c450 tx=0x7f5bdc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:39.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.173+0000 7f5bd5ffb640 1 -- 172.21.15.170:0/4251027318 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bdc007410 con 0x7f5be010fff0 2024-09-12T17:27:39.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.173+0000 7f5bd5ffb640 1 -- 172.21.15.170:0/4251027318 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bdc0075b0 con 0x7f5be010fff0 2024-09-12T17:27:39.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.173+0000 7f5be752b640 1 -- 172.21.15.170:0/4251027318 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5be01a5ec0 con 0x7f5be010fff0 2024-09-12T17:27:39.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.173+0000 7f5bd5ffb640 1 -- 172.21.15.170:0/4251027318 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bdc004950 con 0x7f5be010fff0 2024-09-12T17:27:39.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.173+0000 7f5be752b640 1 -- 172.21.15.170:0/4251027318 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5be01ab090 con 0x7f5be010fff0 2024-09-12T17:27:39.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.173+0000 7f5bd5ffb640 1 -- 172.21.15.170:0/4251027318 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f5bdc004bc0 con 0x7f5be010fff0 2024-09-12T17:27:39.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.174+0000 7f5bd5ffb640 1 --2- 172.21.15.170:0/4251027318 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5bc403de70 0x7f5bc4040330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:39.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.174+0000 7f5bd5ffb640 1 -- 172.21.15.170:0/4251027318 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f5bdc051740 con 0x7f5be010fff0 2024-09-12T17:27:39.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.174+0000 7f5be752b640 1 -- 172.21.15.170:0/4251027318 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5be01a6200 con 0x7f5be010fff0 2024-09-12T17:27:39.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.174+0000 7f5be4ac6640 1 --2- 172.21.15.170:0/4251027318 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5bc403de70 0x7f5bc4040330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:39.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.174+0000 7f5be4ac6640 1 --2- 172.21.15.170:0/4251027318 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5bc403de70 0x7f5bc4040330 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0035000 tx=0x7f5bd002f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:39.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.179+0000 7f5bd5ffb640 1 -- 172.21.15.170:0/4251027318 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f5bdc019310 con 0x7f5be010fff0 2024-09-12T17:27:39.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.352+0000 7f5be752b640 1 -- 172.21.15.170:0/4251027318 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7f5be0110450 con 0x7f5be010fff0 2024-09-12T17:27:39.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.771+0000 7f5bd5ffb640 1 -- 172.21.15.170:0/4251027318 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.data' created v17) ==== 167+0+0 (secure 0 0 0) 0x7f5bdc0194f0 con 0x7f5be010fff0 2024-09-12T17:27:39.773 INFO:teuthology.orchestra.run.smithi170.stderr:pool 'default.rgw.buckets.data' created 2024-09-12T17:27:39.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.775+0000 7f5be752b640 1 -- 172.21.15.170:0/4251027318 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5bc403de70 msgr2=0x7f5bc4040330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:39.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.775+0000 7f5be752b640 1 --2- 172.21.15.170:0/4251027318 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5bc403de70 0x7f5bc4040330 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0035000 tx=0x7f5bd002f000 comp rx=0 tx=0).stop 2024-09-12T17:27:39.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.775+0000 7f5be752b640 1 -- 172.21.15.170:0/4251027318 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5be010fff0 msgr2=0x7f5be01a5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:39.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.775+0000 7f5be752b640 1 --2- 172.21.15.170:0/4251027318 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5be010fff0 0x7f5be01a5600 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc00c450 tx=0x7f5bdc00c910 comp rx=0 tx=0).stop 2024-09-12T17:27:39.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.775+0000 7f5be752b640 1 -- 172.21.15.170:0/4251027318 shutdown_connections 2024-09-12T17:27:39.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.775+0000 7f5be752b640 1 --2- 172.21.15.170:0/4251027318 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5bc403de70 0x7f5bc4040330 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:39.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.775+0000 7f5be752b640 1 --2- 172.21.15.170:0/4251027318 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5be010fff0 0x7f5be01a5600 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:39.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.775+0000 7f5be752b640 1 -- 172.21.15.170:0/4251027318 >> 172.21.15.170:0/4251027318 conn(0x7f5be006ff80 msgr2=0x7f5be0115170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:39.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.775+0000 7f5be752b640 1 -- 172.21.15.170:0/4251027318 shutdown_connections 2024-09-12T17:27:39.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.775+0000 7f5be752b640 1 -- 172.21.15.170:0/4251027318 wait complete. 2024-09-12T17:27:39.794 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-12T17:27:39.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.894+0000 7f5857b94640 1 Processor -- start 2024-09-12T17:27:39.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.894+0000 7f5857b94640 1 -- start start 2024-09-12T17:27:39.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.894+0000 7f5857b94640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5850117e10 0x7f585011a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:39.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.894+0000 7f5857b94640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f585011a740 con 0x7f585010fff0 2024-09-12T17:27:39.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.894+0000 7f5857b94640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f585011b920 con 0x7f5850117e10 2024-09-12T17:27:39.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.894+0000 7f585512f640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5850117e10 0x7f585011a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:39.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.894+0000 7f585512f640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5850117e10 0x7f585011a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:41142/0 (socket says 172.21.15.170:41142) 2024-09-12T17:27:39.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.894+0000 7f585512f640 1 -- 172.21.15.170:0/1678819279 learned_addr learned my addr 172.21.15.170:0/1678819279 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:39.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.894+0000 7f5855930640 1 --1- 172.21.15.170:0/1678819279 >> v1:172.21.15.47:6789/0 conn(0x7f585010fff0 0x7f58501103d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:49744/0 (socket says 172.21.15.170:49744) 2024-09-12T17:27:39.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.895+0000 7f585512f640 1 -- 172.21.15.170:0/1678819279 >> v1:172.21.15.47:6789/0 conn(0x7f585010fff0 legacy=0x7f58501103d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:39.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.895+0000 7f585512f640 1 -- 172.21.15.170:0/1678819279 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f585011baa0 con 0x7f5850117e10 2024-09-12T17:27:39.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.895+0000 7f585512f640 1 --2- 172.21.15.170:0/1678819279 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5850117e10 0x7f585011a200 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5844009e50 tx=0x7f584402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dab8fb2de2049624 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:39.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.896+0000 7f585492e640 1 -- 172.21.15.170:0/1678819279 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5844037070 con 0x7f5850117e10 2024-09-12T17:27:39.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.896+0000 7f585492e640 1 -- 172.21.15.170:0/1678819279 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5844032400 con 0x7f5850117e10 2024-09-12T17:27:39.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.896+0000 7f585492e640 1 -- 172.21.15.170:0/1678819279 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5844032720 con 0x7f5850117e10 2024-09-12T17:27:39.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.896+0000 7f5857b94640 1 -- 172.21.15.170:0/1678819279 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5850117e10 msgr2=0x7f585011a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:39.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.896+0000 7f5857b94640 1 --2- 172.21.15.170:0/1678819279 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5850117e10 0x7f585011a200 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5844009e50 tx=0x7f584402b840 comp rx=0 tx=0).stop 2024-09-12T17:27:39.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.896+0000 7f5857b94640 1 -- 172.21.15.170:0/1678819279 shutdown_connections 2024-09-12T17:27:39.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.896+0000 7f5857b94640 1 --2- 172.21.15.170:0/1678819279 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5850117e10 0x7f585011a200 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:39.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.896+0000 7f5857b94640 1 -- 172.21.15.170:0/1678819279 >> 172.21.15.170:0/1678819279 conn(0x7f585006ff80 msgr2=0x7f58500723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:39.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.896+0000 7f5857b94640 1 -- 172.21.15.170:0/1678819279 shutdown_connections 2024-09-12T17:27:39.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.896+0000 7f5857b94640 1 -- 172.21.15.170:0/1678819279 wait complete. 2024-09-12T17:27:39.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.897+0000 7f5857b94640 1 Processor -- start 2024-09-12T17:27:39.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.897+0000 7f5857b94640 1 -- start start 2024-09-12T17:27:39.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.897+0000 7f5857b94640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f585010fff0 0x7f58501a55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:39.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.897+0000 7f5857b94640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5850074390 con 0x7f585010fff0 2024-09-12T17:27:39.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.897+0000 7f5855930640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f585010fff0 0x7f58501a55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:39.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.897+0000 7f5855930640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f585010fff0 0x7f58501a55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:41152/0 (socket says 172.21.15.170:41152) 2024-09-12T17:27:39.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.897+0000 7f5855930640 1 -- 172.21.15.170:0/1369136514 learned_addr learned my addr 172.21.15.170:0/1369136514 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:39.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.898+0000 7f5855930640 1 -- 172.21.15.170:0/1369136514 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58501a5b90 con 0x7f585010fff0 2024-09-12T17:27:39.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.898+0000 7f5855930640 1 --2- 172.21.15.170:0/1369136514 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f585010fff0 0x7f58501a55c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f584800c450 tx=0x7f584800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:39.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.898+0000 7f584e7fc640 1 -- 172.21.15.170:0/1369136514 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5848007410 con 0x7f585010fff0 2024-09-12T17:27:39.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.898+0000 7f584e7fc640 1 -- 172.21.15.170:0/1369136514 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58480075b0 con 0x7f585010fff0 2024-09-12T17:27:39.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.898+0000 7f584e7fc640 1 -- 172.21.15.170:0/1369136514 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5848004950 con 0x7f585010fff0 2024-09-12T17:27:39.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.898+0000 7f5857b94640 1 -- 172.21.15.170:0/1369136514 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58501a5e80 con 0x7f585010fff0 2024-09-12T17:27:39.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.898+0000 7f5857b94640 1 -- 172.21.15.170:0/1369136514 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58501ab050 con 0x7f585010fff0 2024-09-12T17:27:39.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.899+0000 7f5857b94640 1 -- 172.21.15.170:0/1369136514 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58501a61c0 con 0x7f585010fff0 2024-09-12T17:27:39.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.899+0000 7f584e7fc640 1 -- 172.21.15.170:0/1369136514 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f5848004bc0 con 0x7f585010fff0 2024-09-12T17:27:39.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.899+0000 7f584e7fc640 1 --2- 172.21.15.170:0/1369136514 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f583c03de70 0x7f583c040330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:39.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.899+0000 7f584e7fc640 1 -- 172.21.15.170:0/1369136514 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3873+0+0 (secure 0 0 0) 0x7f5848051910 con 0x7f585010fff0 2024-09-12T17:27:39.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.899+0000 7f585512f640 1 --2- 172.21.15.170:0/1369136514 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f583c03de70 0x7f583c040330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:39.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.900+0000 7f585512f640 1 --2- 172.21.15.170:0/1369136514 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f583c03de70 0x7f583c040330 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5844034000 tx=0x7f5844009000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:39.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:39.904+0000 7f584e7fc640 1 -- 172.21.15.170:0/1369136514 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f5848019310 con 0x7f585010fff0 2024-09-12T17:27:40.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.080+0000 7f5857b94640 1 -- 172.21.15.170:0/1369136514 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) -- 0x7f5850110450 con 0x7f585010fff0 2024-09-12T17:27:40.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.404+0000 7f584e7fc640 1 -- 172.21.15.170:0/1369136514 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v18) ==== 185+0+0 (secure 0 0 0) 0x7f58480194f0 con 0x7f585010fff0 2024-09-12T17:27:40.406 INFO:teuthology.orchestra.run.smithi170.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-12T17:27:40.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.408+0000 7f5857b94640 1 -- 172.21.15.170:0/1369136514 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f583c03de70 msgr2=0x7f583c040330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:40.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.408+0000 7f5857b94640 1 --2- 172.21.15.170:0/1369136514 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f583c03de70 0x7f583c040330 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5844034000 tx=0x7f5844009000 comp rx=0 tx=0).stop 2024-09-12T17:27:40.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.408+0000 7f5857b94640 1 -- 172.21.15.170:0/1369136514 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f585010fff0 msgr2=0x7f58501a55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:40.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.408+0000 7f5857b94640 1 --2- 172.21.15.170:0/1369136514 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f585010fff0 0x7f58501a55c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f584800c450 tx=0x7f584800c910 comp rx=0 tx=0).stop 2024-09-12T17:27:40.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.408+0000 7f5857b94640 1 -- 172.21.15.170:0/1369136514 shutdown_connections 2024-09-12T17:27:40.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.408+0000 7f5857b94640 1 --2- 172.21.15.170:0/1369136514 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f583c03de70 0x7f583c040330 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:40.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.408+0000 7f5857b94640 1 --2- 172.21.15.170:0/1369136514 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f585010fff0 0x7f58501a55c0 secure :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f584800c450 tx=0x7f584800c910 comp rx=0 tx=0).stop 2024-09-12T17:27:40.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.408+0000 7f5857b94640 1 -- 172.21.15.170:0/1369136514 >> 172.21.15.170:0/1369136514 conn(0x7f585006ff80 msgr2=0x7f5850071d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:40.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.408+0000 7f5857b94640 1 -- 172.21.15.170:0/1369136514 shutdown_connections 2024-09-12T17:27:40.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.409+0000 7f5857b94640 1 -- 172.21.15.170:0/1369136514 wait complete. 2024-09-12T17:27:40.436 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-12T17:27:40.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.533+0000 7ff07931e640 1 Processor -- start 2024-09-12T17:27:40.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.533+0000 7ff07931e640 1 -- start start 2024-09-12T17:27:40.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.533+0000 7ff07931e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff074074b00 0x7ff07410fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:40.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.533+0000 7ff07931e640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff074110770 con 0x7ff0741102c0 2024-09-12T17:27:40.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.533+0000 7ff07931e640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7ff074075060 con 0x7ff074074b00 2024-09-12T17:27:40.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.534+0000 7ff072ffd640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff074074b00 0x7ff07410fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:40.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.534+0000 7ff06a7fc640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7ff0741102c0 0x7ff07411b100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:49758/0 (socket says 172.21.15.170:49758) 2024-09-12T17:27:40.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.534+0000 7ff06a7fc640 1 -- 172.21.15.170:0/858308196 learned_addr learned my addr 172.21.15.170:0/858308196 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:27:40.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.534+0000 7ff072ffd640 1 --2- 172.21.15.170:0/858308196 >> v2:172.21.15.47:3300/0 conn(0x7ff074074b00 0x7ff07410fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:41160/0 (socket says 172.21.15.170:41160) 2024-09-12T17:27:40.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.534+0000 7ff072ffd640 1 -- 172.21.15.170:0/858308196 >> v1:172.21.15.47:6789/0 conn(0x7ff0741102c0 legacy=0x7ff07411b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:40.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.534+0000 7ff072ffd640 1 -- 172.21.15.170:0/858308196 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff074110970 con 0x7ff074074b00 2024-09-12T17:27:40.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.535+0000 7ff072ffd640 1 --2- 172.21.15.170:0/858308196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff074074b00 0x7ff07410fd80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff064009720 tx=0x7ff06402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1de169aefc64b62 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:40.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.535+0000 7ff0727fc640 1 -- 172.21.15.170:0/858308196 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff064037070 con 0x7ff074074b00 2024-09-12T17:27:40.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.535+0000 7ff0727fc640 1 -- 172.21.15.170:0/858308196 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff06402ad90 con 0x7ff074074b00 2024-09-12T17:27:40.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.535+0000 7ff0727fc640 1 -- 172.21.15.170:0/858308196 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff064032590 con 0x7ff074074b00 2024-09-12T17:27:40.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.535+0000 7ff07931e640 1 -- 172.21.15.170:0/858308196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff074074b00 msgr2=0x7ff07410fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:40.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.535+0000 7ff07931e640 1 --2- 172.21.15.170:0/858308196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff074074b00 0x7ff07410fd80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff064009720 tx=0x7ff06402a110 comp rx=0 tx=0).stop 2024-09-12T17:27:40.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.536+0000 7ff07931e640 1 -- 172.21.15.170:0/858308196 shutdown_connections 2024-09-12T17:27:40.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.536+0000 7ff07931e640 1 --2- 172.21.15.170:0/858308196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff074074b00 0x7ff07410fd80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:40.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.536+0000 7ff07931e640 1 -- 172.21.15.170:0/858308196 >> 172.21.15.170:0/858308196 conn(0x7ff07406ff80 msgr2=0x7ff0740723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:40.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.536+0000 7ff07931e640 1 -- 172.21.15.170:0/858308196 shutdown_connections 2024-09-12T17:27:40.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.536+0000 7ff07931e640 1 -- 172.21.15.170:0/858308196 wait complete. 2024-09-12T17:27:40.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.536+0000 7ff07931e640 1 Processor -- start 2024-09-12T17:27:40.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.536+0000 7ff07931e640 1 -- start start 2024-09-12T17:27:40.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.537+0000 7ff07931e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff074074b00 0x7ff0741a5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:40.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.537+0000 7ff07931e640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff07411cbb0 con 0x7ff074074b00 2024-09-12T17:27:40.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.537+0000 7ff072ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff074074b00 0x7ff0741a5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:40.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.537+0000 7ff072ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff074074b00 0x7ff0741a5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:41168/0 (socket says 172.21.15.170:41168) 2024-09-12T17:27:40.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.537+0000 7ff072ffd640 1 -- 172.21.15.170:0/961183179 learned_addr learned my addr 172.21.15.170:0/961183179 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:40.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.537+0000 7ff072ffd640 1 -- 172.21.15.170:0/961183179 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0741a5b50 con 0x7ff074074b00 2024-09-12T17:27:40.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.537+0000 7ff072ffd640 1 --2- 172.21.15.170:0/961183179 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff074074b00 0x7ff0741a5580 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff064009720 tx=0x7ff0640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:40.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.537+0000 7ff06bfff640 1 -- 172.21.15.170:0/961183179 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff064041070 con 0x7ff074074b00 2024-09-12T17:27:40.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.537+0000 7ff06bfff640 1 -- 172.21.15.170:0/961183179 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff06403c460 con 0x7ff074074b00 2024-09-12T17:27:40.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.537+0000 7ff06bfff640 1 -- 172.21.15.170:0/961183179 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff064037040 con 0x7ff074074b00 2024-09-12T17:27:40.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.537+0000 7ff07931e640 1 -- 172.21.15.170:0/961183179 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0741a5de0 con 0x7ff074074b00 2024-09-12T17:27:40.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.537+0000 7ff07931e640 1 -- 172.21.15.170:0/961183179 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0741aadb0 con 0x7ff074074b00 2024-09-12T17:27:40.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.538+0000 7ff07931e640 1 -- 172.21.15.170:0/961183179 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff07410fe00 con 0x7ff074074b00 2024-09-12T17:27:40.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.539+0000 7ff06bfff640 1 -- 172.21.15.170:0/961183179 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ff064044070 con 0x7ff074074b00 2024-09-12T17:27:40.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.539+0000 7ff06bfff640 1 --2- 172.21.15.170:0/961183179 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff05403de90 0x7ff054040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:40.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.539+0000 7ff06bfff640 1 -- 172.21.15.170:0/961183179 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3884+0+0 (secure 0 0 0) 0x7ff064072e20 con 0x7ff074074b00 2024-09-12T17:27:40.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.539+0000 7ff06a7fc640 1 --2- 172.21.15.170:0/961183179 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff05403de90 0x7ff054040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:40.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.539+0000 7ff06a7fc640 1 --2- 172.21.15.170:0/961183179 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff05403de90 0x7ff054040350 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff05c007fd0 tx=0x7ff05c007aa0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:40.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.544+0000 7ff06bfff640 1 -- 172.21.15.170:0/961183179 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7ff06403d3f0 con 0x7ff074074b00 2024-09-12T17:27:40.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:40.718+0000 7ff07931e640 1 -- 172.21.15.170:0/961183179 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7ff0741102c0 con 0x7ff074074b00 2024-09-12T17:27:41.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.406+0000 7ff06bfff640 1 -- 172.21.15.170:0/961183179 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v19) ==== 169+0+0 (secure 0 0 0) 0x7ff06403ac80 con 0x7ff074074b00 2024-09-12T17:27:41.407 INFO:teuthology.orchestra.run.smithi170.stderr:pool 'default.rgw.buckets.index' created 2024-09-12T17:27:41.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.410+0000 7ff07931e640 1 -- 172.21.15.170:0/961183179 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff05403de90 msgr2=0x7ff054040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:41.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.410+0000 7ff07931e640 1 --2- 172.21.15.170:0/961183179 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff05403de90 0x7ff054040350 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff05c007fd0 tx=0x7ff05c007aa0 comp rx=0 tx=0).stop 2024-09-12T17:27:41.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.410+0000 7ff07931e640 1 -- 172.21.15.170:0/961183179 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff074074b00 msgr2=0x7ff0741a5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:41.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.410+0000 7ff07931e640 1 --2- 172.21.15.170:0/961183179 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff074074b00 0x7ff0741a5580 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff064009720 tx=0x7ff0640046c0 comp rx=0 tx=0).stop 2024-09-12T17:27:41.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.411+0000 7ff07931e640 1 -- 172.21.15.170:0/961183179 shutdown_connections 2024-09-12T17:27:41.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.411+0000 7ff07931e640 1 --2- 172.21.15.170:0/961183179 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff05403de90 0x7ff054040350 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:41.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.411+0000 7ff07931e640 1 --2- 172.21.15.170:0/961183179 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff074074b00 0x7ff0741a5580 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:41.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.411+0000 7ff07931e640 1 -- 172.21.15.170:0/961183179 >> 172.21.15.170:0/961183179 conn(0x7ff07406ff80 msgr2=0x7ff074117630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:41.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.411+0000 7ff07931e640 1 -- 172.21.15.170:0/961183179 shutdown_connections 2024-09-12T17:27:41.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.411+0000 7ff07931e640 1 -- 172.21.15.170:0/961183179 wait complete. 2024-09-12T17:27:41.433 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-12T17:27:41.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.535+0000 7fb24a449640 1 Processor -- start 2024-09-12T17:27:41.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.535+0000 7fb24a449640 1 -- start start 2024-09-12T17:27:41.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.535+0000 7fb24a449640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb244113070 0x7fb244113450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:41.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.536+0000 7fb24a449640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb244113b70 con 0x7fb244118780 2024-09-12T17:27:41.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.536+0000 7fb24a449640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fb244119300 con 0x7fb244113070 2024-09-12T17:27:41.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.536+0000 7fb243fff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb244113070 0x7fb244113450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:41.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.536+0000 7fb2437fe640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fb244118780 0x7fb244118bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:49774/0 (socket says 172.21.15.170:49774) 2024-09-12T17:27:41.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.536+0000 7fb243fff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb244113070 0x7fb244113450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:41172/0 (socket says 172.21.15.170:41172) 2024-09-12T17:27:41.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.536+0000 7fb2437fe640 1 -- 172.21.15.170:0/2157892472 learned_addr learned my addr 172.21.15.170:0/2157892472 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:27:41.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.536+0000 7fb243fff640 1 -- 172.21.15.170:0/2157892472 >> v1:172.21.15.47:6789/0 conn(0x7fb244118780 legacy=0x7fb244118bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:41.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.536+0000 7fb243fff640 1 -- 172.21.15.170:0/2157892472 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2441194b0 con 0x7fb244113070 2024-09-12T17:27:41.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.537+0000 7fb243fff640 1 --2- 172.21.15.170:0/2157892472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb244113070 0x7fb244113450 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb234009720 tx=0x7fb23402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8db236ed27f874 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:41.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.537+0000 7fb242ffd640 1 -- 172.21.15.170:0/2157892472 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb234037070 con 0x7fb244113070 2024-09-12T17:27:41.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.537+0000 7fb242ffd640 1 -- 172.21.15.170:0/2157892472 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb23402ad90 con 0x7fb244113070 2024-09-12T17:27:41.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.537+0000 7fb242ffd640 1 -- 172.21.15.170:0/2157892472 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb234032590 con 0x7fb244113070 2024-09-12T17:27:41.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.538+0000 7fb24a449640 1 -- 172.21.15.170:0/2157892472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb244113070 msgr2=0x7fb244113450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:41.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.538+0000 7fb24a449640 1 --2- 172.21.15.170:0/2157892472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb244113070 0x7fb244113450 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb234009720 tx=0x7fb23402a110 comp rx=0 tx=0).stop 2024-09-12T17:27:41.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.538+0000 7fb24a449640 1 -- 172.21.15.170:0/2157892472 shutdown_connections 2024-09-12T17:27:41.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.538+0000 7fb24a449640 1 --2- 172.21.15.170:0/2157892472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb244113070 0x7fb244113450 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:41.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.538+0000 7fb24a449640 1 -- 172.21.15.170:0/2157892472 >> 172.21.15.170:0/2157892472 conn(0x7fb24406f290 msgr2=0x7fb24406f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:41.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.538+0000 7fb24a449640 1 -- 172.21.15.170:0/2157892472 shutdown_connections 2024-09-12T17:27:41.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.538+0000 7fb24a449640 1 -- 172.21.15.170:0/2157892472 wait complete. 2024-09-12T17:27:41.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.539+0000 7fb24a449640 1 Processor -- start 2024-09-12T17:27:41.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.539+0000 7fb24a449640 1 -- start start 2024-09-12T17:27:41.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.539+0000 7fb24a449640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb244113070 0x7fb2441a7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:41.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.539+0000 7fb24a449640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb24411edd0 con 0x7fb244113070 2024-09-12T17:27:41.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.539+0000 7fb243fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb244113070 0x7fb2441a7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:41.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.539+0000 7fb243fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb244113070 0x7fb2441a7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:41180/0 (socket says 172.21.15.170:41180) 2024-09-12T17:27:41.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.539+0000 7fb243fff640 1 -- 172.21.15.170:0/2124553270 learned_addr learned my addr 172.21.15.170:0/2124553270 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:41.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.540+0000 7fb243fff640 1 -- 172.21.15.170:0/2124553270 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2441a7d20 con 0x7fb244113070 2024-09-12T17:27:41.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.540+0000 7fb243fff640 1 --2- 172.21.15.170:0/2124553270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb244113070 0x7fb2441a7750 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb234009720 tx=0x7fb2340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:41.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.540+0000 7fb240ff9640 1 -- 172.21.15.170:0/2124553270 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb234041070 con 0x7fb244113070 2024-09-12T17:27:41.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.540+0000 7fb240ff9640 1 -- 172.21.15.170:0/2124553270 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb23403c460 con 0x7fb244113070 2024-09-12T17:27:41.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.540+0000 7fb240ff9640 1 -- 172.21.15.170:0/2124553270 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb234037040 con 0x7fb244113070 2024-09-12T17:27:41.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.540+0000 7fb24a449640 1 -- 172.21.15.170:0/2124553270 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2441a7fb0 con 0x7fb244113070 2024-09-12T17:27:41.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.540+0000 7fb24a449640 1 -- 172.21.15.170:0/2124553270 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2441acf80 con 0x7fb244113070 2024-09-12T17:27:41.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.541+0000 7fb24a449640 1 -- 172.21.15.170:0/2124553270 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2441134d0 con 0x7fb244113070 2024-09-12T17:27:41.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.541+0000 7fb240ff9640 1 -- 172.21.15.170:0/2124553270 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb234044070 con 0x7fb244113070 2024-09-12T17:27:41.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.542+0000 7fb240ff9640 1 --2- 172.21.15.170:0/2124553270 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb23003dec0 0x7fb230040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:41.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.542+0000 7fb240ff9640 1 -- 172.21.15.170:0/2124553270 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4220+0+0 (secure 0 0 0) 0x7fb234072ff0 con 0x7fb244113070 2024-09-12T17:27:41.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.542+0000 7fb2437fe640 1 --2- 172.21.15.170:0/2124553270 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb23003dec0 0x7fb230040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:41.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.542+0000 7fb2437fe640 1 --2- 172.21.15.170:0/2124553270 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb23003dec0 0x7fb230040380 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb238007fd0 tx=0x7fb238007aa0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:41.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.547+0000 7fb240ff9640 1 -- 172.21.15.170:0/2124553270 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7fb234071c20 con 0x7fb244113070 2024-09-12T17:27:41.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:41.721+0000 7fb24a449640 1 -- 172.21.15.170:0/2124553270 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) -- 0x7fb244118780 con 0x7fb244113070 2024-09-12T17:27:42.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:42.409+0000 7fb240ff9640 1 -- 172.21.15.170:0/2124553270 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v20) ==== 187+0+0 (secure 0 0 0) 0x7fb23403d3f0 con 0x7fb244113070 2024-09-12T17:27:42.411 INFO:teuthology.orchestra.run.smithi170.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-12T17:27:42.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:42.416+0000 7fb24a449640 1 -- 172.21.15.170:0/2124553270 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb23003dec0 msgr2=0x7fb230040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:42.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:42.416+0000 7fb24a449640 1 --2- 172.21.15.170:0/2124553270 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb23003dec0 0x7fb230040380 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb238007fd0 tx=0x7fb238007aa0 comp rx=0 tx=0).stop 2024-09-12T17:27:42.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:42.417+0000 7fb24a449640 1 -- 172.21.15.170:0/2124553270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb244113070 msgr2=0x7fb2441a7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:42.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:42.417+0000 7fb24a449640 1 --2- 172.21.15.170:0/2124553270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb244113070 0x7fb2441a7750 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb234009720 tx=0x7fb2340046c0 comp rx=0 tx=0).stop 2024-09-12T17:27:42.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:42.417+0000 7fb24a449640 1 -- 172.21.15.170:0/2124553270 shutdown_connections 2024-09-12T17:27:42.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:42.417+0000 7fb24a449640 1 --2- 172.21.15.170:0/2124553270 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb23003dec0 0x7fb230040380 secure :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb238007fd0 tx=0x7fb238007aa0 comp rx=0 tx=0).stop 2024-09-12T17:27:42.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:42.417+0000 7fb24a449640 1 --2- 172.21.15.170:0/2124553270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb244113070 0x7fb2441a7750 secure :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb234009720 tx=0x7fb2340046c0 comp rx=0 tx=0).stop 2024-09-12T17:27:42.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:42.417+0000 7fb24a449640 1 -- 172.21.15.170:0/2124553270 >> 172.21.15.170:0/2124553270 conn(0x7fb24406f290 msgr2=0x7fb244114d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:42.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:42.420+0000 7fb24a449640 1 -- 172.21.15.170:0/2124553270 shutdown_connections 2024-09-12T17:27:42.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:42.423+0000 7fb24a449640 1 -- 172.21.15.170:0/2124553270 wait complete. 2024-09-12T17:27:42.445 DEBUG:tasks.rgw:Pools created 2024-09-12T17:27:42.445 INFO:tasks.rgw:Starting rgw... 2024-09-12T17:27:42.445 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-12T17:27:42.445 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-12T17:27:42.445 DEBUG:teuthology.orchestra.run.smithi170:> sudo echo -n http://smithi170.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-12T17:27:42.475 INFO:teuthology.orchestra.run.smithi170.stdout:http://smithi170.front.sepia.ceph.com:80 2024-09-12T17:27:42.475 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-12T17:27:42.541 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-12T17:27:42.541 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-12T17:27:42.583 INFO:tasks.rgw.client.0:Started 2024-09-12T17:27:42.584 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi170.front.sepia.ceph.com:80/ 2024-09-12T17:27:42.584 DEBUG:teuthology.orchestra.run.smithi170:> curl http://smithi170.front.sepia.ceph.com:80/ 2024-09-12T17:27:42.619 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:27:42.619 INFO:teuthology.orchestra.run.smithi170.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:27:42.620 INFO:teuthology.orchestra.run.smithi170.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:27:42.620 INFO:teuthology.orchestra.run.smithi170.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:27:42.620 INFO:teuthology.orchestra.run.smithi170.stderr:curl: (7) Failed to connect to smithi170.front.sepia.ceph.com port 80: Connection refused 2024-09-12T17:27:43.621 DEBUG:teuthology.orchestra.run.smithi170:> curl http://smithi170.front.sepia.ceph.com:80/ 2024-09-12T17:27:43.645 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:27:43.645 INFO:teuthology.orchestra.run.smithi170.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:27:43.645 INFO:teuthology.orchestra.run.smithi170.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:27:43.645 INFO:teuthology.orchestra.run.smithi170.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:27:43.646 INFO:teuthology.orchestra.run.smithi170.stderr:curl: (7) Failed to connect to smithi170.front.sepia.ceph.com port 80: Connection refused 2024-09-12T17:27:45.647 DEBUG:teuthology.orchestra.run.smithi170:> curl http://smithi170.front.sepia.ceph.com:80/ 2024-09-12T17:27:45.672 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:27:45.673 INFO:teuthology.orchestra.run.smithi170.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:27:45.673 INFO:teuthology.orchestra.run.smithi170.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:27:45.673 INFO:teuthology.orchestra.run.smithi170.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:27:45.673 INFO:teuthology.orchestra.run.smithi170.stderr:curl: (7) Failed to connect to smithi170.front.sepia.ceph.com port 80: Connection refused 2024-09-12T17:27:49.674 DEBUG:teuthology.orchestra.run.smithi170:> curl http://smithi170.front.sepia.ceph.com:80/ 2024-09-12T17:27:49.699 INFO:teuthology.orchestra.run.smithi170.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:27:49.699 INFO:teuthology.orchestra.run.smithi170.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:27:49.699 INFO:teuthology.orchestra.run.smithi170.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:27:49.700 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:27:49.700 INFO:teuthology.orchestra.run.smithi170.stderr:curl: (7) Failed to connect to smithi170.front.sepia.ceph.com port 80: Connection refused 2024-09-12T17:27:57.701 DEBUG:teuthology.orchestra.run.smithi170:> curl http://smithi170.front.sepia.ceph.com:80/ 2024-09-12T17:27:57.725 INFO:teuthology.orchestra.run.smithi170.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:27:57.725 INFO:teuthology.orchestra.run.smithi170.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:27:57.728 INFO:teuthology.orchestra.run.smithi170.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 93500 0 --:--:-- --:--:-- --:--:-- 93500 2024-09-12T17:27:57.728 INFO:teuthology.orchestra.run.smithi170.stdout:anonymous 2024-09-12T17:27:57.728 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-09-12T17:27:58.017 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-09-12T17:27:58.017 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-12T17:27:58.017 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-12T17:27:58.017 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-12T17:27:58.069 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:58.070 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:58.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.069+0000 7fb101f75800 1 Processor -- start 2024-09-12T17:27:58.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.069+0000 7fb101f75800 1 -- start start 2024-09-12T17:27:58.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.069+0000 7fb101f75800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x564813d68690 0x564813d6aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.069+0000 7fb101f75800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564813c11e40 con 0x564813d6b020 2024-09-12T17:27:58.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.069+0000 7fb101f75800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x564813bdc680 con 0x564813d68690 2024-09-12T17:27:58.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.070+0000 7fb0ffa66640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x564813d68690 0x564813d6aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.070+0000 7fb0ff265640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x564813d6b020 0x564813d6d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:48176/0 (socket says 172.21.15.170:48176) 2024-09-12T17:27:58.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.070+0000 7fb0ff265640 1 -- 172.21.15.170:0/3887850272 learned_addr learned my addr 172.21.15.170:0/3887850272 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:27:58.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.070+0000 7fb0ffa66640 1 -- 172.21.15.170:0/3887850272 >> v1:172.21.15.47:6789/0 conn(0x564813d6b020 legacy=0x564813d6d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.070+0000 7fb0ffa66640 1 -- 172.21.15.170:0/3887850272 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564813bf86b0 con 0x564813d68690 2024-09-12T17:27:58.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.072+0000 7fb0ffa66640 1 --2- 172.21.15.170:0/3887850272 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564813d68690 0x564813d6aa80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0005fd0 tx=0x7fb0f0045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5e25937671a473 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.072+0000 7fb0fea64640 1 -- 172.21.15.170:0/3887850272 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0f0058530 con 0x564813d68690 2024-09-12T17:27:58.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.072+0000 7fb0fea64640 1 -- 172.21.15.170:0/3887850272 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0f00586d0 con 0x564813d68690 2024-09-12T17:27:58.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.072+0000 7fb0fea64640 1 -- 172.21.15.170:0/3887850272 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0f00589d0 con 0x564813d68690 2024-09-12T17:27:58.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.073+0000 7fb101f75800 1 -- 172.21.15.170:0/3887850272 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564813d68690 msgr2=0x564813d6aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.073+0000 7fb101f75800 1 --2- 172.21.15.170:0/3887850272 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564813d68690 0x564813d6aa80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0005fd0 tx=0x7fb0f0045c30 comp rx=0 tx=0).stop 2024-09-12T17:27:58.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.073+0000 7fb101f75800 1 -- 172.21.15.170:0/3887850272 shutdown_connections 2024-09-12T17:27:58.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.073+0000 7fb101f75800 1 --2- 172.21.15.170:0/3887850272 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564813d68690 0x564813d6aa80 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.073+0000 7fb101f75800 1 -- 172.21.15.170:0/3887850272 >> 172.21.15.170:0/3887850272 conn(0x564813d621b0 msgr2=0x564813d64610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:58.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.073+0000 7fb101f75800 1 -- 172.21.15.170:0/3887850272 shutdown_connections 2024-09-12T17:27:58.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.073+0000 7fb101f75800 1 -- 172.21.15.170:0/3887850272 wait complete. 2024-09-12T17:27:58.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.089+0000 7fb101f75800 1 Processor -- start 2024-09-12T17:27:58.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.089+0000 7fb101f75800 1 -- start start 2024-09-12T17:27:58.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.089+0000 7fb101f75800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564813d68690 0x564813e576a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.089+0000 7fb101f75800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564813c00dd0 con 0x564813d68690 2024-09-12T17:27:58.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.089+0000 7fb0ffa66640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564813d68690 0x564813e576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.089+0000 7fb0ffa66640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564813d68690 0x564813e576a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56082/0 (socket says 172.21.15.170:56082) 2024-09-12T17:27:58.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.089+0000 7fb0ffa66640 1 -- 172.21.15.170:0/3486338310 learned_addr learned my addr 172.21.15.170:0/3486338310 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:58.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.090+0000 7fb0ffa66640 1 -- 172.21.15.170:0/3486338310 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564813c19e10 con 0x564813d68690 2024-09-12T17:27:58.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.090+0000 7fb0ffa66640 1 --2- 172.21.15.170:0/3486338310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564813d68690 0x564813e576a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0025a60 tx=0x7fb0f0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33d715688c21622e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.090+0000 7fafede0b640 1 -- 172.21.15.170:0/3486338310 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0f00589b0 con 0x564813d68690 2024-09-12T17:27:58.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.090+0000 7fafede0b640 1 -- 172.21.15.170:0/3486338310 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0f0068070 con 0x564813d68690 2024-09-12T17:27:58.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.090+0000 7fafede0b640 1 -- 172.21.15.170:0/3486338310 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0f0058c80 con 0x564813d68690 2024-09-12T17:27:58.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.091+0000 7fb101f75800 1 -- 172.21.15.170:0/3486338310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564813d68690 msgr2=0x564813e576a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.091+0000 7fb101f75800 1 --2- 172.21.15.170:0/3486338310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564813d68690 0x564813e576a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0025a60 tx=0x7fb0f0051000 comp rx=0 tx=0).stop 2024-09-12T17:27:58.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.091+0000 7fb101f75800 1 -- 172.21.15.170:0/3486338310 shutdown_connections 2024-09-12T17:27:58.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.091+0000 7fb101f75800 1 --2- 172.21.15.170:0/3486338310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564813d68690 0x564813e576a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.091+0000 7fb101f75800 1 -- 172.21.15.170:0/3486338310 >> 172.21.15.170:0/3486338310 conn(0x564813d621b0 msgr2=0x564813e53020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:58.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.091+0000 7fb101f75800 1 -- 172.21.15.170:0/3486338310 shutdown_connections 2024-09-12T17:27:58.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.091+0000 7fb101f75800 1 -- 172.21.15.170:0/3486338310 wait complete. 2024-09-12T17:27:58.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.091+0000 7fb101f75800 1 Processor -- start 2024-09-12T17:27:58.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.091+0000 7fb101f75800 1 -- start start 2024-09-12T17:27:58.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.092+0000 7fb101f75800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564813d68690 0x564813e5eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.092+0000 7fb101f75800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564813d6f020 con 0x564813d68690 2024-09-12T17:27:58.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.092+0000 7fb0ffa66640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564813d68690 0x564813e5eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.092+0000 7fb0ffa66640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564813d68690 0x564813e5eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56090/0 (socket says 172.21.15.170:56090) 2024-09-12T17:27:58.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.092+0000 7fb0ffa66640 1 -- 172.21.15.170:0/3643805349 learned_addr learned my addr 172.21.15.170:0/3643805349 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:58.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.092+0000 7fb0ffa66640 1 -- 172.21.15.170:0/3643805349 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564813e5f440 con 0x564813d68690 2024-09-12T17:27:58.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.092+0000 7fb0ffa66640 1 --2- 172.21.15.170:0/3643805349 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564813d68690 0x564813e5eee0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0025a60 tx=0x7fb0f0003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.093+0000 7fafe7fff640 1 -- 172.21.15.170:0/3643805349 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0f0063650 con 0x564813d68690 2024-09-12T17:27:58.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.093+0000 7fafe7fff640 1 -- 172.21.15.170:0/3643805349 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0f00637f0 con 0x564813d68690 2024-09-12T17:27:58.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.093+0000 7fafe7fff640 1 -- 172.21.15.170:0/3643805349 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0f0063af0 con 0x564813d68690 2024-09-12T17:27:58.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.093+0000 7fb101f75800 1 -- 172.21.15.170:0/3643805349 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564813e5f6d0 con 0x564813d68690 2024-09-12T17:27:58.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.093+0000 7fb101f75800 1 -- 172.21.15.170:0/3643805349 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564813e602e0 con 0x564813d68690 2024-09-12T17:27:58.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.094+0000 7fafe7fff640 1 -- 172.21.15.170:0/3643805349 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb0f0063c90 con 0x564813d68690 2024-09-12T17:27:58.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.094+0000 7fafe7fff640 1 --2- 172.21.15.170:0/3643805349 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fafe803c730 0x7fafe803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.094+0000 7fafe7fff640 1 -- 172.21.15.170:0/3643805349 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fb0f0097be0 con 0x564813d68690 2024-09-12T17:27:58.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.094+0000 7fb0ff265640 1 --2- 172.21.15.170:0/3643805349 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fafe803c730 0x7fafe803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.094+0000 7fb101f75800 1 --2- 172.21.15.170:0/3643805349 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564813d6b020 0x564813e66530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.094+0000 7fb101f75800 1 -- 172.21.15.170:0/3643805349 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564813e66a70 con 0x564813d6b020 2024-09-12T17:27:58.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.094+0000 7fb100267640 1 --2- 172.21.15.170:0/3643805349 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564813d6b020 0x564813e66530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.094+0000 7fb0ff265640 1 --2- 172.21.15.170:0/3643805349 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fafe803c730 0x7fafe803ebf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4001d70 tx=0x7fb0f40012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.095+0000 7fb100267640 1 --2- 172.21.15.170:0/3643805349 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564813d6b020 0x564813e66530 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.095+0000 7fb100267640 1 -- 172.21.15.170:0/3643805349 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb0f80083e0 con 0x564813d6b020 2024-09-12T17:27:58.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.095+0000 7fb101f75800 1 -- 172.21.15.170:0/3643805349 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564813e66e10 con 0x564813d6b020 2024-09-12T17:27:58.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.095+0000 7fb100267640 1 -- 172.21.15.170:0/3643805349 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb0f80083e0 con 0x564813d6b020 2024-09-12T17:27:58.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.095+0000 7fb101f75800 1 --2- 172.21.15.170:0/3643805349 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564813e68950 0x564813e6adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.095+0000 7fb101f75800 1 -- 172.21.15.170:0/3643805349 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564813e6b550 con 0x564813e68950 2024-09-12T17:27:58.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.095+0000 7fb0ffa66640 1 --2- 172.21.15.170:0/3643805349 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564813e68950 0x564813e6adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.096+0000 7fb0ffa66640 1 --2- 172.21.15.170:0/3643805349 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564813e68950 0x564813e6adc0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.096+0000 7fb0ffa66640 1 -- 172.21.15.170:0/3643805349 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb0f00743e0 con 0x564813e68950 2024-09-12T17:27:58.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.096+0000 7fb101f75800 1 -- 172.21.15.170:0/3643805349 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564813e67660 con 0x564813d6b020 2024-09-12T17:27:58.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.096+0000 7fb100267640 1 -- 172.21.15.170:0/3643805349 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb0f80083e0 con 0x564813d6b020 2024-09-12T17:27:58.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.096+0000 7fb101f75800 1 -- 172.21.15.170:0/3643805349 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564813e67ac0 con 0x564813e68950 2024-09-12T17:27:58.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.097+0000 7fb0ffa66640 1 -- 172.21.15.170:0/3643805349 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb0f00743e0 con 0x564813e68950 2024-09-12T17:27:58.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.097+0000 7fb101f75800 1 Processor -- start 2024-09-12T17:27:58.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.097+0000 7fb101f75800 1 -- start start 2024-09-12T17:27:58.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.097+0000 7fb101f75800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564813e79e40 0x564813e7a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.097+0000 7fb101f75800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564813c5ea00 con 0x564813e79e40 2024-09-12T17:27:58.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.097+0000 7fb100267640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564813e79e40 0x564813e7a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.098+0000 7fb100267640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564813e79e40 0x564813e7a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56104/0 (socket says 172.21.15.170:56104) 2024-09-12T17:27:58.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.098+0000 7fb100267640 1 -- 172.21.15.170:0/458484678 learned_addr learned my addr 172.21.15.170:0/458484678 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:58.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.098+0000 7fb100267640 1 -- 172.21.15.170:0/458484678 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564813e7a8a0 con 0x564813e79e40 2024-09-12T17:27:58.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.098+0000 7fb100267640 1 --2- 172.21.15.170:0/458484678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564813e79e40 0x564813e7a260 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x564813e5fee0 tx=0x7fb0f800bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.098+0000 7fafe57fa640 1 -- 172.21.15.170:0/458484678 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0f801c020 con 0x564813e79e40 2024-09-12T17:27:58.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.098+0000 7fafe57fa640 1 -- 172.21.15.170:0/458484678 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0f8007c90 con 0x564813e79e40 2024-09-12T17:27:58.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.098+0000 7fb101f75800 1 -- 172.21.15.170:0/458484678 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564813e7b0d0 con 0x564813e79e40 2024-09-12T17:27:58.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.098+0000 7fafe57fa640 1 -- 172.21.15.170:0/458484678 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0f8018440 con 0x564813e79e40 2024-09-12T17:27:58.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.098+0000 7fb101f75800 1 -- 172.21.15.170:0/458484678 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564813e7b670 con 0x564813e79e40 2024-09-12T17:27:58.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.099+0000 7fafe57fa640 1 -- 172.21.15.170:0/458484678 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb0f801f020 con 0x564813e79e40 2024-09-12T17:27:58.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.100+0000 7fafe57fa640 1 --2- 172.21.15.170:0/458484678 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fafd803c730 0x7fafd803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.100+0000 7fafe57fa640 1 -- 172.21.15.170:0/458484678 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fb0f8054dc0 con 0x564813e79e40 2024-09-12T17:27:58.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.100+0000 7fb0ffa66640 1 --2- 172.21.15.170:0/458484678 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fafd803c730 0x7fafd803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.100+0000 7fb101f75800 1 Processor -- start 2024-09-12T17:27:58.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.100+0000 7fb0ffa66640 1 --2- 172.21.15.170:0/458484678 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fafd803c730 0x7fafd803ebf0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x564813e67a00 tx=0x7fb0f004ea10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.100+0000 7fb101f75800 1 -- start start 2024-09-12T17:27:58.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.100+0000 7fb101f75800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564813e86960 0x564813e86d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.100+0000 7fb101f75800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564813e57e30 con 0x564813e86960 2024-09-12T17:27:58.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.101+0000 7fb100267640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564813e86960 0x564813e86d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.101+0000 7fb100267640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564813e86960 0x564813e86d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56108/0 (socket says 172.21.15.170:56108) 2024-09-12T17:27:58.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.101+0000 7fb100267640 1 -- 172.21.15.170:0/1071514506 learned_addr learned my addr 172.21.15.170:0/1071514506 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:58.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.101+0000 7fb100267640 1 -- 172.21.15.170:0/1071514506 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564813e87350 con 0x564813e86960 2024-09-12T17:27:58.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.101+0000 7fb100267640 1 --2- 172.21.15.170:0/1071514506 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564813e86960 0x564813e86d60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb0f80532d0 tx=0x7fb0f80158b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99278c1c82237e61 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.101+0000 7fafdeffd640 1 -- 172.21.15.170:0/1071514506 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0f8050020 con 0x564813e86960 2024-09-12T17:27:58.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.101+0000 7fafdeffd640 1 -- 172.21.15.170:0/1071514506 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0f8015e70 con 0x564813e86960 2024-09-12T17:27:58.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.101+0000 7fafdeffd640 1 -- 172.21.15.170:0/1071514506 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0f80174d0 con 0x564813e86960 2024-09-12T17:27:58.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.102+0000 7fb101f75800 1 -- 172.21.15.170:0/1071514506 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564813e86960 msgr2=0x564813e86d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.102+0000 7fb101f75800 1 --2- 172.21.15.170:0/1071514506 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564813e86960 0x564813e86d60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb0f80532d0 tx=0x7fb0f80158b0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.102+0000 7fb101f75800 1 -- 172.21.15.170:0/1071514506 shutdown_connections 2024-09-12T17:27:58.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.102+0000 7fb101f75800 1 --2- 172.21.15.170:0/1071514506 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564813e86960 0x564813e86d60 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.102+0000 7fb101f75800 1 -- 172.21.15.170:0/1071514506 >> 172.21.15.170:0/1071514506 conn(0x564813e82d60 msgr2=0x564813e80fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:58.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.102+0000 7fb101f75800 1 -- 172.21.15.170:0/1071514506 shutdown_connections 2024-09-12T17:27:58.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.102+0000 7fb101f75800 1 -- 172.21.15.170:0/1071514506 wait complete. 2024-09-12T17:27:58.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.102+0000 7fb101f75800 1 Processor -- start 2024-09-12T17:27:58.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.102+0000 7fb101f75800 1 -- start start 2024-09-12T17:27:58.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.102+0000 7fb101f75800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564813e86960 0x564813e8ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.102+0000 7fb101f75800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564813e87970 con 0x564813e86960 2024-09-12T17:27:58.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.102+0000 7fb100267640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564813e86960 0x564813e8ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.102+0000 7fb100267640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564813e86960 0x564813e8ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56120/0 (socket says 172.21.15.170:56120) 2024-09-12T17:27:58.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.102+0000 7fb100267640 1 -- 172.21.15.170:0/25945462 learned_addr learned my addr 172.21.15.170:0/25945462 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:58.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.103+0000 7fb100267640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564813e8e430 con 0x564813e86960 2024-09-12T17:27:58.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.103+0000 7fb100267640 1 --2- 172.21.15.170:0/25945462 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564813e86960 0x564813e8ded0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb0f80154a0 tx=0x7fb0f8053230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.103+0000 7fafdd7fa640 1 -- 172.21.15.170:0/25945462 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0f804a040 con 0x564813e86960 2024-09-12T17:27:58.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.103+0000 7fafdd7fa640 1 -- 172.21.15.170:0/25945462 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0f8016c50 con 0x564813e86960 2024-09-12T17:27:58.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.103+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564813e8e6c0 con 0x564813e86960 2024-09-12T17:27:58.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.103+0000 7fafdd7fa640 1 -- 172.21.15.170:0/25945462 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0f800b030 con 0x564813e86960 2024-09-12T17:27:58.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.103+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564813e8f040 con 0x564813e86960 2024-09-12T17:27:58.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.104+0000 7fafdd7fa640 1 -- 172.21.15.170:0/25945462 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb0f8033020 con 0x564813e86960 2024-09-12T17:27:58.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.104+0000 7fafdd7fa640 1 --2- 172.21.15.170:0/25945462 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fafc803c730 0x7fafc803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.104+0000 7fafdd7fa640 1 -- 172.21.15.170:0/25945462 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fb0f8031020 con 0x564813e86960 2024-09-12T17:27:58.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.105+0000 7fb0ffa66640 1 --2- 172.21.15.170:0/25945462 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fafc803c730 0x7fafc803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.105+0000 7fb101f75800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.105+0000 7fb101f75800 1 --2- 172.21.15.170:0/25945462 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564813e997f0 0x564813e9bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.105+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564813e9c3d0 con 0x564813e997f0 2024-09-12T17:27:58.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.105+0000 7fb0ff265640 1 --2- 172.21.15.170:0/25945462 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564813e997f0 0x564813e9bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.105+0000 7fb0ffa66640 1 --2- 172.21.15.170:0/25945462 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fafc803c730 0x7fafc803ebf0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb0f00863f0 tx=0x7fb0f0090000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.105+0000 7fb0ff265640 1 --2- 172.21.15.170:0/25945462 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564813e997f0 0x564813e9bc80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.105+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb0f4009050 con 0x564813e997f0 2024-09-12T17:27:58.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.105+0000 7fb101f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:58.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.105+0000 7fb101f75800 20 realm 2024-09-12T17:27:58.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.105+0000 7fb101f75800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.105+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564813e98ba0 con 0x564813e997f0 2024-09-12T17:27:58.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.106+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb0f4009050 con 0x564813e997f0 2024-09-12T17:27:58.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.106+0000 7fb101f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:58.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.106+0000 7fb101f75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:58.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.106+0000 7fb101f75800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.106+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564813e9ceb0 con 0x564813e997f0 2024-09-12T17:27:58.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.106+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb0f4009050 con 0x564813e997f0 2024-09-12T17:27:58.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.106+0000 7fb101f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:58.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.106+0000 7fb101f75800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.106+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564813e9d780 con 0x564813e997f0 2024-09-12T17:27:58.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.106+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb0f4009050 con 0x564813e997f0 2024-09-12T17:27:58.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.106+0000 7fb101f75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:58.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.106+0000 7fb101f75800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.106+0000 7fb101f75800 1 --2- 172.21.15.170:0/25945462 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564813e9e0c0 0x564813ea04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.106+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564813ea0bf0 con 0x564813e9e0c0 2024-09-12T17:27:58.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.106+0000 7fb100267640 1 --2- 172.21.15.170:0/25945462 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564813e9e0c0 0x564813ea04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.107+0000 7fb100267640 1 --2- 172.21.15.170:0/25945462 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564813e9e0c0 0x564813ea04b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.107+0000 7fb100267640 1 -- 172.21.15.170:0/25945462 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb0f80083e0 con 0x564813e9e0c0 2024-09-12T17:27:58.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.107+0000 7fb101f75800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:27:58.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.107+0000 7fb101f75800 20 searching for the correct realm 2024-09-12T17:27:58.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.107+0000 7fb101f75800 1 --2- 172.21.15.170:0/25945462 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x564813ea2c70 0x564813ea5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.107+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x564813ea2c70 2024-09-12T17:27:58.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.107+0000 7fb0ffa66640 1 --2- 172.21.15.170:0/25945462 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x564813ea2c70 0x564813ea5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.107+0000 7fb0ffa66640 1 --2- 172.21.15.170:0/25945462 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x564813ea2c70 0x564813ea5130 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.108+0000 7fb0ffa66640 1 -- 172.21.15.170:0/25945462 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f0089040 con 0x564813ea2c70 2024-09-12T17:27:58.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.108+0000 7fb0ffa66640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x564813e9e0c0 2024-09-12T17:27:58.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.108+0000 7fb100267640 1 -- 172.21.15.170:0/25945462 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f80083e0 con 0x564813e9e0c0 2024-09-12T17:27:58.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.108+0000 7fb100267640 1 --2- 172.21.15.170:0/25945462 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fb0f8021020 0x7fb0f800a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.108+0000 7fb100267640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x7fb0f8021020 2024-09-12T17:27:58.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.108+0000 7fb0ff265640 1 --2- 172.21.15.170:0/25945462 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fb0f8021020 0x7fb0f800a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.109+0000 7fb0ff265640 1 --2- 172.21.15.170:0/25945462 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fb0f8021020 0x7fb0f800a960 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.109+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f4009050 con 0x7fb0f8021020 2024-09-12T17:27:58.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.109+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x564813e997f0 2024-09-12T17:27:58.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.109+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f4009050 con 0x564813e997f0 2024-09-12T17:27:58.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.109+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x564813e997f0 2024-09-12T17:27:58.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.109+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f4029040 con 0x564813e997f0 2024-09-12T17:27:58.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.109+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x7fb0f8021020 2024-09-12T17:27:58.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.110+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f4029040 con 0x7fb0f8021020 2024-09-12T17:27:58.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.110+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x7fb0f8021020 2024-09-12T17:27:58.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.110+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f4029040 con 0x7fb0f8021020 2024-09-12T17:27:58.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.110+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x564813e9e0c0 2024-09-12T17:27:58.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.110+0000 7fb100267640 1 -- 172.21.15.170:0/25945462 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f80083e0 con 0x564813e9e0c0 2024-09-12T17:27:58.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.110+0000 7fb100267640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x564813ea2c70 2024-09-12T17:27:58.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.111+0000 7fb0ffa66640 1 -- 172.21.15.170:0/25945462 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f0089040 con 0x564813ea2c70 2024-09-12T17:27:58.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.111+0000 7fb0ffa66640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x564813e997f0 2024-09-12T17:27:58.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.111+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f4029040 con 0x564813e997f0 2024-09-12T17:27:58.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.111+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x7fb0f8021020 2024-09-12T17:27:58.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.111+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f4029040 con 0x7fb0f8021020 2024-09-12T17:27:58.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.111+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x564813e997f0 2024-09-12T17:27:58.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.111+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f4029040 con 0x564813e997f0 2024-09-12T17:27:58.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.111+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x564813e9e0c0 2024-09-12T17:27:58.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.112+0000 7fb100267640 1 -- 172.21.15.170:0/25945462 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fb0f80083e0 con 0x564813e9e0c0 2024-09-12T17:27:58.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.112+0000 7fb100267640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x564813ea2c70 2024-09-12T17:27:58.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.112+0000 7fb0ffa66640 1 -- 172.21.15.170:0/25945462 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f0089040 con 0x564813ea2c70 2024-09-12T17:27:58.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.112+0000 7fb0ffa66640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x564813ea2c70 2024-09-12T17:27:58.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.112+0000 7fb0ffa66640 1 -- 172.21.15.170:0/25945462 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f0089040 con 0x564813ea2c70 2024-09-12T17:27:58.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.112+0000 7fb0ffa66640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x7fb0f8021020 2024-09-12T17:27:58.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.112+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f4029040 con 0x7fb0f8021020 2024-09-12T17:27:58.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.112+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x564813ea2c70 2024-09-12T17:27:58.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.113+0000 7fb0ffa66640 1 -- 172.21.15.170:0/25945462 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f0089040 con 0x564813ea2c70 2024-09-12T17:27:58.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.113+0000 7fb0ffa66640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x564813ea2c70 2024-09-12T17:27:58.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.113+0000 7fb0ffa66640 1 -- 172.21.15.170:0/25945462 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f0089040 con 0x564813ea2c70 2024-09-12T17:27:58.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.113+0000 7fb0ffa66640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x564813e997f0 2024-09-12T17:27:58.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.113+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f4029040 con 0x564813e997f0 2024-09-12T17:27:58.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.113+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x564813e997f0 2024-09-12T17:27:58.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.113+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb0f4029040 con 0x564813e997f0 2024-09-12T17:27:58.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.113+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x7fb0f8021020 2024-09-12T17:27:58.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.114+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f4029040 con 0x7fb0f8021020 2024-09-12T17:27:58.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.114+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x564813ea2c70 2024-09-12T17:27:58.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.114+0000 7fb0ffa66640 1 -- 172.21.15.170:0/25945462 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f0089040 con 0x564813ea2c70 2024-09-12T17:27:58.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.114+0000 7fb0ffa66640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x564813e9e0c0 2024-09-12T17:27:58.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.114+0000 7fb100267640 1 -- 172.21.15.170:0/25945462 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f80083e0 con 0x564813e9e0c0 2024-09-12T17:27:58.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.114+0000 7fb100267640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x564813e997f0 2024-09-12T17:27:58.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.114+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f4029040 con 0x564813e997f0 2024-09-12T17:27:58.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.114+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x7fb0f8021020 2024-09-12T17:27:58.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.115+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f4029040 con 0x7fb0f8021020 2024-09-12T17:27:58.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.115+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x564813ea2c70 2024-09-12T17:27:58.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.115+0000 7fb0ffa66640 1 -- 172.21.15.170:0/25945462 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f0089040 con 0x564813ea2c70 2024-09-12T17:27:58.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.115+0000 7fb0ffa66640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x7fb0f8021020 2024-09-12T17:27:58.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.115+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f4029040 con 0x7fb0f8021020 2024-09-12T17:27:58.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.115+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x564813e9e0c0 2024-09-12T17:27:58.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.115+0000 7fb100267640 1 -- 172.21.15.170:0/25945462 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f80083e0 con 0x564813e9e0c0 2024-09-12T17:27:58.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.115+0000 7fb100267640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x564813ea2c70 2024-09-12T17:27:58.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.116+0000 7fb0ffa66640 1 -- 172.21.15.170:0/25945462 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f0089040 con 0x564813ea2c70 2024-09-12T17:27:58.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.116+0000 7fb0ffa66640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x7fb0f8021020 2024-09-12T17:27:58.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.116+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f4029040 con 0x7fb0f8021020 2024-09-12T17:27:58.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.116+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x564813e997f0 2024-09-12T17:27:58.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.116+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb0f4029040 con 0x564813e997f0 2024-09-12T17:27:58.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.116+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x564813e9e0c0 2024-09-12T17:27:58.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.117+0000 7fb100267640 1 -- 172.21.15.170:0/25945462 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v22'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb0f80083e0 con 0x564813e9e0c0 2024-09-12T17:27:58.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.117+0000 7fb101f75800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:27:58.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.117+0000 7fb101f75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:58.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.117+0000 7fb101f75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:58.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.117+0000 7fb101f75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:58.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.117+0000 7fb101f75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:58.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.117+0000 7fb101f75800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:27:58.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.117+0000 7fb101f75800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.117+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564813ea1670 con 0x564813e997f0 2024-09-12T17:27:58.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.117+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb0f4029040 con 0x564813e997f0 2024-09-12T17:27:58.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.117+0000 7fb101f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:58.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.117+0000 7fb101f75800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.117+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564813ea1250 con 0x564813e997f0 2024-09-12T17:27:58.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.117+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb0f4029040 con 0x564813e997f0 2024-09-12T17:27:58.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.117+0000 7fb101f75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:58.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.117+0000 7fb101f75800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.117+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564813ea1fd0 con 0x564813e9e0c0 2024-09-12T17:27:58.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.117+0000 7fb100267640 1 -- 172.21.15.170:0/25945462 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb0f80083e0 con 0x564813e9e0c0 2024-09-12T17:27:58.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.117+0000 7fb101f75800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:27:58.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.117+0000 7fb101f75800 20 zone default found 2024-09-12T17:27:58.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.117+0000 7fb101f75800 4 Realm: () 2024-09-12T17:27:58.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.117+0000 7fb101f75800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:27:58.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.117+0000 7fb101f75800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:27:58.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.117+0000 7fb101f75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:58.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.117+0000 7fb101f75800 20 zonegroup default 2024-09-12T17:27:58.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.117+0000 7fb101f75800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.117+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5c80 con 0x7fb0f8021020 2024-09-12T17:27:58.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.118+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb0f4029040 con 0x7fb0f8021020 2024-09-12T17:27:58.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.118+0000 7fb101f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:58.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.118+0000 7fb101f75800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.118+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564813ea7ba0 con 0x564813ea2c70 2024-09-12T17:27:58.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.118+0000 7fb0ffa66640 1 -- 172.21.15.170:0/25945462 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb0f0089040 con 0x564813ea2c70 2024-09-12T17:27:58.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.118+0000 7fb101f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:58.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.118+0000 7fb101f75800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.118+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564813ea7ff0 con 0x564813ea2c70 2024-09-12T17:27:58.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.118+0000 7fb0ffa66640 1 -- 172.21.15.170:0/25945462 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb0f0089040 con 0x564813ea2c70 2024-09-12T17:27:58.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.118+0000 7fb101f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:58.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.118+0000 7fb101f75800 20 started sync module instance, tier type = 2024-09-12T17:27:58.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.118+0000 7fb101f75800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:27:58.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.118+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564813ea6eb0 con 0x564813e9e0c0 2024-09-12T17:27:58.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.119+0000 7fb100267640 1 -- 172.21.15.170:0/25945462 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0f80083e0 con 0x564813e9e0c0 2024-09-12T17:27:58.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.119+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94867571766256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564813ea8450 con 0x564813e9e0c0 2024-09-12T17:27:58.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.120+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564813ea8ca0 con 0x564813e997f0 2024-09-12T17:27:58.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.121+0000 7fb100267640 1 -- 172.21.15.170:0/25945462 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94867571766256] v29'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0f80083e0 con 0x564813e9e0c0 2024-09-12T17:27:58.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.121+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0f4029040 con 0x564813e997f0 2024-09-12T17:27:58.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.121+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94867571770448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564813ea8d20 con 0x564813e997f0 2024-09-12T17:27:58.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.121+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564813ea96e0 con 0x564813ea2c70 2024-09-12T17:27:58.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.122+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94867571770448] v29'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0f4029040 con 0x564813e997f0 2024-09-12T17:27:58.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.123+0000 7fb0ffa66640 1 -- 172.21.15.170:0/25945462 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0f0089040 con 0x564813ea2c70 2024-09-12T17:27:58.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.123+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94867571771504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564813ea8c90 con 0x564813ea2c70 2024-09-12T17:27:58.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.123+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564813eaa550 con 0x564813e9e0c0 2024-09-12T17:27:58.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.124+0000 7fb100267640 1 -- 172.21.15.170:0/25945462 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0f80083e0 con 0x564813e9e0c0 2024-09-12T17:27:58.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.124+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94867571778176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564813eaacf0 con 0x564813e9e0c0 2024-09-12T17:27:58.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.124+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564813eab810 con 0x564813e997f0 2024-09-12T17:27:58.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.124+0000 7fb0ffa66640 1 -- 172.21.15.170:0/25945462 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94867571771504] v29'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0f0089040 con 0x564813ea2c70 2024-09-12T17:27:58.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.125+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0f4029040 con 0x564813e997f0 2024-09-12T17:27:58.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.125+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94867571782368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564813eab7d0 con 0x564813e997f0 2024-09-12T17:27:58.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.125+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564813eac250 con 0x7fb0f8021020 2024-09-12T17:27:58.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.125+0000 7fb100267640 1 -- 172.21.15.170:0/25945462 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94867571778176] v29'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0f80083e0 con 0x564813e9e0c0 2024-09-12T17:27:58.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.126+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0f4029040 con 0x7fb0f8021020 2024-09-12T17:27:58.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.126+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94867571779392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564813eac250 con 0x7fb0f8021020 2024-09-12T17:27:58.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.126+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564813eacc90 con 0x7fb0f8021020 2024-09-12T17:27:58.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.126+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94867571782368] v29'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0f4029040 con 0x564813e997f0 2024-09-12T17:27:58.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.127+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94867571779392] v29'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0f4029040 con 0x7fb0f8021020 2024-09-12T17:27:58.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.127+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(56 notify.6 [create] v29'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0f4029040 con 0x7fb0f8021020 2024-09-12T17:27:58.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.127+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94867571785120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564813eac1c0 con 0x7fb0f8021020 2024-09-12T17:27:58.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.128+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564813ead140 con 0x7fb0f8021020 2024-09-12T17:27:58.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.129+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94867571785120] v29'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0f4029040 con 0x7fb0f8021020 2024-09-12T17:27:58.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.129+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(58 notify.7 [create] v29'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0f4029040 con 0x7fb0f8021020 2024-09-12T17:27:58.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.129+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94867571787744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564813ead0b0 con 0x7fb0f8021020 2024-09-12T17:27:58.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.129+0000 7fb101f75800 20 add_watcher() i=0 2024-09-12T17:27:58.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.129+0000 7fb101f75800 20 add_watcher() i=1 2024-09-12T17:27:58.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.129+0000 7fb101f75800 20 add_watcher() i=2 2024-09-12T17:27:58.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.129+0000 7fb101f75800 20 add_watcher() i=3 2024-09-12T17:27:58.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.129+0000 7fb101f75800 20 add_watcher() i=4 2024-09-12T17:27:58.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.129+0000 7fb101f75800 20 add_watcher() i=5 2024-09-12T17:27:58.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.129+0000 7fb101f75800 20 add_watcher() i=6 2024-09-12T17:27:58.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.130+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94867571787744] v29'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0f4029040 con 0x7fb0f8021020 2024-09-12T17:27:58.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.130+0000 7fb101f75800 20 add_watcher() i=7 2024-09-12T17:27:58.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.130+0000 7fb101f75800 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:58.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.130+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564813eb0510 con 0x564813e997f0 2024-09-12T17:27:58.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.130+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb0f4029040 con 0x564813e997f0 2024-09-12T17:27:58.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.130+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94867571789264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564813eada60 con 0x564813e997f0 2024-09-12T17:27:58.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.131+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94867571789264] v29'24 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb0f4029040 con 0x564813e997f0 2024-09-12T17:27:58.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.131+0000 7fafb5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:58.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.132+0000 7fb101f75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:58.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.132+0000 7fb101f75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:58.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.132+0000 7fb101f75800 5 note: GC not initialized 2024-09-12T17:27:58.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.132+0000 7fafb4fe1640 20 reqs_thread_entry: start 2024-09-12T17:27:58.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.132+0000 7fb101f75800 20 init_complete bucket index max shards: 11 2024-09-12T17:27:58.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.132+0000 7fb101f75800 20 Filter name: none 2024-09-12T17:27:58.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.132+0000 7faf2e7fc640 20 reqs_thread_entry: start 2024-09-12T17:27:58.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.132+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ee2e00 con 0x564813ea2c70 2024-09-12T17:27:58.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.132+0000 7fb0ffa66640 1 -- 172.21.15.170:0/25945462 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f0089040 con 0x564813ea2c70 2024-09-12T17:27:58.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.132+0000 7fb0ffa66640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ee2e00 con 0x564813ea2c70 2024-09-12T17:27:58.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.133+0000 7fb0ffa66640 1 -- 172.21.15.170:0/25945462 <== osd.3 v2:172.21.15.170:6816/2664906588 15 ==== osd_op_reply(63 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f0089040 con 0x564813ea2c70 2024-09-12T17:27:58.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.133+0000 7fb0ffa66640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ee2e00 con 0x564813e997f0 2024-09-12T17:27:58.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.133+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f4029040 con 0x564813e997f0 2024-09-12T17:27:58.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.133+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5c80 con 0x564813e997f0 2024-09-12T17:27:58.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.133+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f4029040 con 0x564813e997f0 2024-09-12T17:27:58.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.133+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5c80 con 0x564813e9e0c0 2024-09-12T17:27:58.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.133+0000 7fb100267640 1 -- 172.21.15.170:0/25945462 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f80083e0 con 0x564813e9e0c0 2024-09-12T17:27:58.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.133+0000 7fb100267640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x564813ea2c70 2024-09-12T17:27:58.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.134+0000 7fb0ffa66640 1 -- 172.21.15.170:0/25945462 <== osd.3 v2:172.21.15.170:6816/2664906588 16 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f0089040 con 0x564813ea2c70 2024-09-12T17:27:58.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.134+0000 7fb0ffa66640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x564813e997f0 2024-09-12T17:27:58.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.134+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f4029040 con 0x564813e997f0 2024-09-12T17:27:58.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.134+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x564813ea2c70 2024-09-12T17:27:58.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.134+0000 7fb0ffa66640 1 -- 172.21.15.170:0/25945462 <== osd.3 v2:172.21.15.170:6816/2664906588 17 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f0089040 con 0x564813ea2c70 2024-09-12T17:27:58.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.134+0000 7fb0ffa66640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x564813e9e0c0 2024-09-12T17:27:58.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.134+0000 7fb100267640 1 -- 172.21.15.170:0/25945462 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f80083e0 con 0x564813e9e0c0 2024-09-12T17:27:58.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.134+0000 7fb100267640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x564813ea2c70 2024-09-12T17:27:58.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.134+0000 7fb0ffa66640 1 -- 172.21.15.170:0/25945462 <== osd.3 v2:172.21.15.170:6816/2664906588 18 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f0089040 con 0x564813ea2c70 2024-09-12T17:27:58.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.134+0000 7fb0ffa66640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x564813e997f0 2024-09-12T17:27:58.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.135+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f4029040 con 0x564813e997f0 2024-09-12T17:27:58.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.135+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x7fb0f8021020 2024-09-12T17:27:58.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.135+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f4029040 con 0x7fb0f8021020 2024-09-12T17:27:58.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.135+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x7fb0f8021020 2024-09-12T17:27:58.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.136+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(74 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f4029040 con 0x7fb0f8021020 2024-09-12T17:27:58.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.136+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x564813ea2c70 2024-09-12T17:27:58.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.136+0000 7fb0ffa66640 1 -- 172.21.15.170:0/25945462 <== osd.3 v2:172.21.15.170:6816/2664906588 19 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f0089040 con 0x564813ea2c70 2024-09-12T17:27:58.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.136+0000 7fb0ffa66640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x7fb0f8021020 2024-09-12T17:27:58.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.136+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(76 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f4029040 con 0x7fb0f8021020 2024-09-12T17:27:58.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.136+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x7fb0f8021020 2024-09-12T17:27:58.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.136+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(77 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f4029040 con 0x7fb0f8021020 2024-09-12T17:27:58.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.136+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x7fb0f8021020 2024-09-12T17:27:58.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.137+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== osd_op_reply(78 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f4029040 con 0x7fb0f8021020 2024-09-12T17:27:58.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.137+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x564813ea2c70 2024-09-12T17:27:58.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.137+0000 7fb0ffa66640 1 -- 172.21.15.170:0/25945462 <== osd.3 v2:172.21.15.170:6816/2664906588 20 ==== osd_op_reply(79 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f0089040 con 0x564813ea2c70 2024-09-12T17:27:58.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.137+0000 7fb0ffa66640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x564813e9e0c0 2024-09-12T17:27:58.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.137+0000 7fb100267640 1 -- 172.21.15.170:0/25945462 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(80 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f80083e0 con 0x564813e9e0c0 2024-09-12T17:27:58.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.137+0000 7fb100267640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x564813e997f0 2024-09-12T17:27:58.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.137+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(81 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f4029040 con 0x564813e997f0 2024-09-12T17:27:58.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.137+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x564813e997f0 2024-09-12T17:27:58.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.138+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(82 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f4029040 con 0x564813e997f0 2024-09-12T17:27:58.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.138+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x564813ea2c70 2024-09-12T17:27:58.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.138+0000 7fb0ffa66640 1 -- 172.21.15.170:0/25945462 <== osd.3 v2:172.21.15.170:6816/2664906588 21 ==== osd_op_reply(83 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f0089040 con 0x564813ea2c70 2024-09-12T17:27:58.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.138+0000 7fb0ffa66640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x564813e9e0c0 2024-09-12T17:27:58.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.138+0000 7fb100267640 1 -- 172.21.15.170:0/25945462 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(84 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f80083e0 con 0x564813e9e0c0 2024-09-12T17:27:58.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.138+0000 7fb100267640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x7fb0f8021020 2024-09-12T17:27:58.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.138+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.0 v2:172.21.15.47:6800/3978157098 22 ==== osd_op_reply(85 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f4029040 con 0x7fb0f8021020 2024-09-12T17:27:58.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.138+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x564813e997f0 2024-09-12T17:27:58.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.139+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(86 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f4029040 con 0x564813e997f0 2024-09-12T17:27:58.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.139+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x7fb0f8021020 2024-09-12T17:27:58.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.139+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.0 v2:172.21.15.47:6800/3978157098 23 ==== osd_op_reply(87 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f4029040 con 0x7fb0f8021020 2024-09-12T17:27:58.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.139+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb0f4049040 con 0x564813ea2c70 2024-09-12T17:27:58.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.139+0000 7fb0ffa66640 1 -- 172.21.15.170:0/25945462 <== osd.3 v2:172.21.15.170:6816/2664906588 22 ==== osd_op_reply(88 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f0089040 con 0x564813ea2c70 2024-09-12T17:27:58.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.139+0000 7fb0ffa66640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb0f4049040 con 0x564813e9e0c0 2024-09-12T17:27:58.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.139+0000 7fb100267640 1 -- 172.21.15.170:0/25945462 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== osd_op_reply(89 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f80083e0 con 0x564813e9e0c0 2024-09-12T17:27:58.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.139+0000 7fb100267640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb0f4049040 con 0x7fb0f8021020 2024-09-12T17:27:58.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.140+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.0 v2:172.21.15.47:6800/3978157098 24 ==== osd_op_reply(90 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f4029040 con 0x7fb0f8021020 2024-09-12T17:27:58.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.140+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb0f4049040 con 0x564813e997f0 2024-09-12T17:27:58.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.140+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(91 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f4029040 con 0x564813e997f0 2024-09-12T17:27:58.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.140+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb0f4049040 con 0x564813ea2c70 2024-09-12T17:27:58.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.140+0000 7fb0ffa66640 1 -- 172.21.15.170:0/25945462 <== osd.3 v2:172.21.15.170:6816/2664906588 23 ==== osd_op_reply(92 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f0089040 con 0x564813ea2c70 2024-09-12T17:27:58.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.140+0000 7fb0ffa66640 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb0f4049040 con 0x564813e9e0c0 2024-09-12T17:27:58.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.140+0000 7fb100267640 1 -- 172.21.15.170:0/25945462 <== osd.2 v2:172.21.15.170:6808/3855567754 18 ==== osd_op_reply(93 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f80083e0 con 0x564813e9e0c0 2024-09-12T17:27:58.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.141+0000 7fafb5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:58.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.141+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94867571789264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5c80 con 0x564813e997f0 2024-09-12T17:27:58.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.142+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94867571789264] v29'25 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb0f4029040 con 0x564813e997f0 2024-09-12T17:27:58.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.142+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94867571766256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x564813e9e0c0 2024-09-12T17:27:58.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.143+0000 7fb100267640 1 -- 172.21.15.170:0/25945462 <== osd.2 v2:172.21.15.170:6808/3855567754 19 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94867571766256] v29'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0f80083e0 con 0x564813e9e0c0 2024-09-12T17:27:58.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.143+0000 7fb101f75800 20 remove_watcher() i=0 2024-09-12T17:27:58.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.143+0000 7fb101f75800 2 removed watcher, disabling cache 2024-09-12T17:27:58.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.143+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94867571770448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x564813e997f0 2024-09-12T17:27:58.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.145+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.1 v2:172.21.15.170:6800/1903654092 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94867571770448] v29'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0f4029040 con 0x564813e997f0 2024-09-12T17:27:58.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.145+0000 7fb101f75800 20 remove_watcher() i=1 2024-09-12T17:27:58.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.145+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94867571771504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564813ea5800 con 0x564813ea2c70 2024-09-12T17:27:58.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.146+0000 7fb0ffa66640 1 -- 172.21.15.170:0/25945462 <== osd.3 v2:172.21.15.170:6816/2664906588 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94867571771504] v29'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0f0089040 con 0x564813ea2c70 2024-09-12T17:27:58.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.146+0000 7fb101f75800 20 remove_watcher() i=2 2024-09-12T17:27:58.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.146+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94867571778176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564813ea73f0 con 0x564813e9e0c0 2024-09-12T17:27:58.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.147+0000 7fb100267640 1 -- 172.21.15.170:0/25945462 <== osd.2 v2:172.21.15.170:6808/3855567754 20 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94867571778176] v29'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0f80083e0 con 0x564813e9e0c0 2024-09-12T17:27:58.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.147+0000 7fb101f75800 20 remove_watcher() i=3 2024-09-12T17:27:58.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.147+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94867571782368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564813ea73f0 con 0x564813e997f0 2024-09-12T17:27:58.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.148+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.1 v2:172.21.15.170:6800/1903654092 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94867571782368] v29'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0f4029040 con 0x564813e997f0 2024-09-12T17:27:58.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.148+0000 7fb101f75800 20 remove_watcher() i=4 2024-09-12T17:27:58.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.148+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94867571779392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564813eab2e0 con 0x7fb0f8021020 2024-09-12T17:27:58.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.149+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.0 v2:172.21.15.47:6800/3978157098 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94867571779392] v29'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0f4029040 con 0x7fb0f8021020 2024-09-12T17:27:58.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.149+0000 7fb101f75800 20 remove_watcher() i=5 2024-09-12T17:27:58.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.149+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94867571785120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564813ea73f0 con 0x7fb0f8021020 2024-09-12T17:27:58.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.150+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.0 v2:172.21.15.47:6800/3978157098 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94867571785120] v29'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0f4029040 con 0x7fb0f8021020 2024-09-12T17:27:58.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.150+0000 7fb101f75800 20 remove_watcher() i=6 2024-09-12T17:27:58.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.150+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94867571787744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564813ea73f0 con 0x7fb0f8021020 2024-09-12T17:27:58.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.151+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 <== osd.0 v2:172.21.15.47:6800/3978157098 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94867571787744] v29'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0f4029040 con 0x7fb0f8021020 2024-09-12T17:27:58.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.151+0000 7fb101f75800 20 remove_watcher() i=7 2024-09-12T17:27:58.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.151+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fb0f8021020 msgr2=0x7fb0f800a960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.151+0000 7fb101f75800 1 --2- 172.21.15.170:0/25945462 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fb0f8021020 0x7fb0f800a960 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.151+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564813e997f0 msgr2=0x564813e9bc80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.151+0000 7fb101f75800 1 --2- 172.21.15.170:0/25945462 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564813e997f0 0x564813e9bc80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.151+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564813e9e0c0 msgr2=0x564813ea04b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.151+0000 7fb101f75800 1 --2- 172.21.15.170:0/25945462 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564813e9e0c0 0x564813ea04b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.151+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x564813ea2c70 msgr2=0x564813ea5130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.151+0000 7fb101f75800 1 --2- 172.21.15.170:0/25945462 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x564813ea2c70 0x564813ea5130 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.151+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fafc803c730 msgr2=0x7fafc803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.151+0000 7fb101f75800 1 --2- 172.21.15.170:0/25945462 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fafc803c730 0x7fafc803ebf0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb0f00863f0 tx=0x7fb0f0090000 comp rx=0 tx=0).stop 2024-09-12T17:27:58.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.151+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564813e86960 msgr2=0x564813e8ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.151+0000 7fb0ff265640 1 -- 172.21.15.170:0/25945462 reap_dead start 2024-09-12T17:27:58.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.151+0000 7fb101f75800 1 --2- 172.21.15.170:0/25945462 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564813e86960 0x564813e8ded0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb0f80154a0 tx=0x7fb0f8053230 comp rx=0 tx=0).stop 2024-09-12T17:27:58.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.151+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 shutdown_connections 2024-09-12T17:27:58.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.151+0000 7fb101f75800 1 --2- 172.21.15.170:0/25945462 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564813e86960 0x564813e8ded0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.151+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 >> 172.21.15.170:0/25945462 conn(0x564813e82d60 msgr2=0x564813e80f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:58.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.151+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 shutdown_connections 2024-09-12T17:27:58.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.151+0000 7fb101f75800 1 -- 172.21.15.170:0/25945462 wait complete. 2024-09-12T17:27:58.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.152+0000 7fb101f75800 1 -- 172.21.15.170:0/458484678 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fafd803c730 msgr2=0x7fafd803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.152+0000 7fb101f75800 1 --2- 172.21.15.170:0/458484678 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fafd803c730 0x7fafd803ebf0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x564813e67a00 tx=0x7fb0f004ea10 comp rx=0 tx=0).stop 2024-09-12T17:27:58.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.152+0000 7fb101f75800 1 -- 172.21.15.170:0/458484678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564813e79e40 msgr2=0x564813e7a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.152+0000 7fb101f75800 1 --2- 172.21.15.170:0/458484678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564813e79e40 0x564813e7a260 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x564813e5fee0 tx=0x7fb0f800bf30 comp rx=0 tx=0).stop 2024-09-12T17:27:58.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.152+0000 7fb101f75800 1 -- 172.21.15.170:0/458484678 shutdown_connections 2024-09-12T17:27:58.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.152+0000 7fb101f75800 1 --2- 172.21.15.170:0/458484678 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fafd803c730 0x7fafd803ebf0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.152+0000 7fb101f75800 1 --2- 172.21.15.170:0/458484678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564813e79e40 0x564813e7a260 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.152+0000 7fb101f75800 1 -- 172.21.15.170:0/458484678 >> 172.21.15.170:0/458484678 conn(0x564813e6e1f0 msgr2=0x564813e6e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:58.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.152+0000 7fb101f75800 1 -- 172.21.15.170:0/458484678 shutdown_connections 2024-09-12T17:27:58.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.152+0000 7fb101f75800 1 -- 172.21.15.170:0/458484678 wait complete. 2024-09-12T17:27:58.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.152+0000 7fb101f75800 1 -- 172.21.15.170:0/3643805349 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564813d6b020 msgr2=0x564813e66530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.152+0000 7fb101f75800 1 --2- 172.21.15.170:0/3643805349 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564813d6b020 0x564813e66530 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.152+0000 7fb101f75800 1 -- 172.21.15.170:0/3643805349 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564813e68950 msgr2=0x564813e6adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.152+0000 7fb101f75800 1 --2- 172.21.15.170:0/3643805349 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564813e68950 0x564813e6adc0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.152+0000 7fb101f75800 1 -- 172.21.15.170:0/3643805349 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fafe803c730 msgr2=0x7fafe803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.152+0000 7fb101f75800 1 --2- 172.21.15.170:0/3643805349 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fafe803c730 0x7fafe803ebf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4001d70 tx=0x7fb0f40012d0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.152+0000 7fb101f75800 1 -- 172.21.15.170:0/3643805349 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564813d68690 msgr2=0x564813e5eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.152+0000 7fb101f75800 1 --2- 172.21.15.170:0/3643805349 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564813d68690 0x564813e5eee0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0025a60 tx=0x7fb0f0003330 comp rx=0 tx=0).stop 2024-09-12T17:27:58.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.152+0000 7fb101f75800 1 -- 172.21.15.170:0/3643805349 shutdown_connections 2024-09-12T17:27:58.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.152+0000 7fb101f75800 1 --2- 172.21.15.170:0/3643805349 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564813e68950 0x564813e6adc0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.152+0000 7fb101f75800 1 --2- 172.21.15.170:0/3643805349 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fafe803c730 0x7fafe803ebf0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.152+0000 7fb101f75800 1 --2- 172.21.15.170:0/3643805349 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564813d6b020 0x564813e66530 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.152+0000 7fb101f75800 1 --2- 172.21.15.170:0/3643805349 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564813d68690 0x564813e5eee0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.152+0000 7fb101f75800 1 -- 172.21.15.170:0/3643805349 >> 172.21.15.170:0/3643805349 conn(0x564813d621b0 msgr2=0x564813e51810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:58.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.153+0000 7fb101f75800 1 -- 172.21.15.170:0/3643805349 shutdown_connections 2024-09-12T17:27:58.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.153+0000 7fb101f75800 1 -- 172.21.15.170:0/3643805349 wait complete. 2024-09-12T17:27:58.179 INFO:teuthology.orchestra.run.smithi170.stdout:[] 2024-09-12T17:27:58.179 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T17:27:58.179 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-09-12T17:27:58.179 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-09-12T17:27:58.180 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-09-12T17:27:58.224 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:58.224 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:58.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.224+0000 7f6fed011800 1 Processor -- start 2024-09-12T17:27:58.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.224+0000 7f6fed011800 1 -- start start 2024-09-12T17:27:58.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.224+0000 7f6fed011800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x559b88777210 0x559b887796b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.224+0000 7f6fed011800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559b8861ce40 con 0x559b88773700 2024-09-12T17:27:58.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.224+0000 7f6fed011800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x559b885e7680 con 0x559b88777210 2024-09-12T17:27:58.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.224+0000 7f6fe7f47640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x559b88777210 0x559b887796b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.224+0000 7f6fe8748640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x559b88773700 0x559b88775af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:48186/0 (socket says 172.21.15.170:48186) 2024-09-12T17:27:58.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.224+0000 7f6fe8748640 1 -- 172.21.15.170:0/4105550881 learned_addr learned my addr 172.21.15.170:0/4105550881 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:27:58.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.225+0000 7f6fe7f47640 1 -- 172.21.15.170:0/4105550881 >> v1:172.21.15.47:6789/0 conn(0x559b88773700 legacy=0x559b88775af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.225+0000 7f6fe7f47640 1 -- 172.21.15.170:0/4105550881 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b886036b0 con 0x559b88777210 2024-09-12T17:27:58.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.226+0000 7f6fe7f47640 1 --2- 172.21.15.170:0/4105550881 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b88777210 0x559b887796b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00a470 tx=0x7f6fdc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84549ace0bae7cd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.227+0000 7f6fe7746640 1 -- 172.21.15.170:0/4105550881 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fdc053570 con 0x559b88777210 2024-09-12T17:27:58.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.227+0000 7f6fe7746640 1 -- 172.21.15.170:0/4105550881 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fdc058070 con 0x559b88777210 2024-09-12T17:27:58.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.227+0000 7f6fe7746640 1 -- 172.21.15.170:0/4105550881 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fdc053880 con 0x559b88777210 2024-09-12T17:27:58.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.227+0000 7f6fed011800 1 -- 172.21.15.170:0/4105550881 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b88777210 msgr2=0x559b887796b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.227+0000 7f6fed011800 1 --2- 172.21.15.170:0/4105550881 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b88777210 0x559b887796b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00a470 tx=0x7f6fdc045a20 comp rx=0 tx=0).stop 2024-09-12T17:27:58.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.227+0000 7f6fed011800 1 -- 172.21.15.170:0/4105550881 shutdown_connections 2024-09-12T17:27:58.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.227+0000 7f6fed011800 1 --2- 172.21.15.170:0/4105550881 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b88777210 0x559b887796b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.227+0000 7f6fed011800 1 -- 172.21.15.170:0/4105550881 >> 172.21.15.170:0/4105550881 conn(0x559b8876d1c0 msgr2=0x559b8876f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:58.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.227+0000 7f6fed011800 1 -- 172.21.15.170:0/4105550881 shutdown_connections 2024-09-12T17:27:58.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.227+0000 7f6fed011800 1 -- 172.21.15.170:0/4105550881 wait complete. 2024-09-12T17:27:58.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.241+0000 7f6fed011800 1 Processor -- start 2024-09-12T17:27:58.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.241+0000 7f6fed011800 1 -- start start 2024-09-12T17:27:58.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.241+0000 7f6fed011800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b88773700 0x559b88772e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.241+0000 7f6fed011800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559b8860bdd0 con 0x559b88773700 2024-09-12T17:27:58.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.242+0000 7f6fe8748640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b88773700 0x559b88772e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.242+0000 7f6fe8748640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b88773700 0x559b88772e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56134/0 (socket says 172.21.15.170:56134) 2024-09-12T17:27:58.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.242+0000 7f6fe8748640 1 -- 172.21.15.170:0/1963764235 learned_addr learned my addr 172.21.15.170:0/1963764235 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:58.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.242+0000 7f6fe8748640 1 -- 172.21.15.170:0/1963764235 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b88624e10 con 0x559b88773700 2024-09-12T17:27:58.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.242+0000 7f6fe8748640 1 --2- 172.21.15.170:0/1963764235 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b88773700 0x559b88772e90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8001df0 tx=0x7f6fd800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5633b68b618ae9a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.242+0000 7f6ed660c640 1 -- 172.21.15.170:0/1963764235 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fd8012020 con 0x559b88773700 2024-09-12T17:27:58.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.242+0000 7f6ed660c640 1 -- 172.21.15.170:0/1963764235 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fd800e470 con 0x559b88773700 2024-09-12T17:27:58.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.242+0000 7f6ed660c640 1 -- 172.21.15.170:0/1963764235 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fd800e7f0 con 0x559b88773700 2024-09-12T17:27:58.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.243+0000 7f6fed011800 1 -- 172.21.15.170:0/1963764235 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b88773700 msgr2=0x559b88772e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.243+0000 7f6fed011800 1 --2- 172.21.15.170:0/1963764235 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b88773700 0x559b88772e90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8001df0 tx=0x7f6fd800b6c0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.243+0000 7f6fed011800 1 -- 172.21.15.170:0/1963764235 shutdown_connections 2024-09-12T17:27:58.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.243+0000 7f6fed011800 1 --2- 172.21.15.170:0/1963764235 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b88773700 0x559b88772e90 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.243+0000 7f6fed011800 1 -- 172.21.15.170:0/1963764235 >> 172.21.15.170:0/1963764235 conn(0x559b8876d1c0 msgr2=0x559b8885dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:58.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.243+0000 7f6fed011800 1 -- 172.21.15.170:0/1963764235 shutdown_connections 2024-09-12T17:27:58.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.243+0000 7f6fed011800 1 -- 172.21.15.170:0/1963764235 wait complete. 2024-09-12T17:27:58.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.243+0000 7f6fed011800 1 Processor -- start 2024-09-12T17:27:58.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.243+0000 7f6fed011800 1 -- start start 2024-09-12T17:27:58.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.244+0000 7f6fed011800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b88773700 0x559b8886c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.244+0000 7f6fed011800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559b8877a030 con 0x559b88773700 2024-09-12T17:27:58.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.244+0000 7f6fe8748640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b88773700 0x559b8886c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.244+0000 7f6fe8748640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b88773700 0x559b8886c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56138/0 (socket says 172.21.15.170:56138) 2024-09-12T17:27:58.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.244+0000 7f6fe8748640 1 -- 172.21.15.170:0/1983809831 learned_addr learned my addr 172.21.15.170:0/1983809831 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:58.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.244+0000 7f6fe8748640 1 -- 172.21.15.170:0/1983809831 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b8886c710 con 0x559b88773700 2024-09-12T17:27:58.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.244+0000 7f6fe8748640 1 --2- 172.21.15.170:0/1983809831 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b88773700 0x559b8886c1b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x559b887729c0 tx=0x7f6fd8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.244+0000 7f6ed4e09640 1 -- 172.21.15.170:0/1983809831 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fd8012030 con 0x559b88773700 2024-09-12T17:27:58.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.244+0000 7f6fed011800 1 -- 172.21.15.170:0/1983809831 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559b8886c9a0 con 0x559b88773700 2024-09-12T17:27:58.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.244+0000 7f6ed4e09640 1 -- 172.21.15.170:0/1983809831 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fd801a6d0 con 0x559b88773700 2024-09-12T17:27:58.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.244+0000 7f6ed4e09640 1 -- 172.21.15.170:0/1983809831 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fd801a9d0 con 0x559b88773700 2024-09-12T17:27:58.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.245+0000 7f6fed011800 1 -- 172.21.15.170:0/1983809831 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b8886d3a0 con 0x559b88773700 2024-09-12T17:27:58.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.246+0000 7f6ed4e09640 1 -- 172.21.15.170:0/1983809831 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f6fd8015020 con 0x559b88773700 2024-09-12T17:27:58.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.246+0000 7f6ed4e09640 1 --2- 172.21.15.170:0/1983809831 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f6ed003c730 0x7f6ed003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.246+0000 7f6ed4e09640 1 -- 172.21.15.170:0/1983809831 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f6fd8020030 con 0x559b88773700 2024-09-12T17:27:58.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.246+0000 7f6fe7f47640 1 --2- 172.21.15.170:0/1983809831 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f6ed003c730 0x7f6ed003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.246+0000 7f6fed011800 1 --2- 172.21.15.170:0/1983809831 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x559b88777210 0x559b88873800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.246+0000 7f6fed011800 1 -- 172.21.15.170:0/1983809831 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559b88873d40 con 0x559b88777210 2024-09-12T17:27:58.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.246+0000 7f6fe8f49640 1 --2- 172.21.15.170:0/1983809831 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x559b88777210 0x559b88873800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.246+0000 7f6fe7f47640 1 --2- 172.21.15.170:0/1983809831 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f6ed003c730 0x7f6ed003ebf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc057000 tx=0x7f6fdc052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.247+0000 7f6fe8f49640 1 --2- 172.21.15.170:0/1983809831 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x559b88777210 0x559b88873800 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.247+0000 7f6fe8f49640 1 -- 172.21.15.170:0/1983809831 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6fe000a4d0 con 0x559b88777210 2024-09-12T17:27:58.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.247+0000 7f6fed011800 1 -- 172.21.15.170:0/1983809831 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559b888740e0 con 0x559b88777210 2024-09-12T17:27:58.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.247+0000 7f6fe8f49640 1 -- 172.21.15.170:0/1983809831 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6fe000a4d0 con 0x559b88777210 2024-09-12T17:27:58.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.247+0000 7f6fed011800 1 --2- 172.21.15.170:0/1983809831 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x559b88875c20 0x559b88878090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.247+0000 7f6fed011800 1 -- 172.21.15.170:0/1983809831 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559b88878820 con 0x559b88875c20 2024-09-12T17:27:58.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.247+0000 7f6fe8748640 1 --2- 172.21.15.170:0/1983809831 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x559b88875c20 0x559b88878090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.247+0000 7f6fe8748640 1 --2- 172.21.15.170:0/1983809831 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x559b88875c20 0x559b88878090 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.248+0000 7f6fe8748640 1 -- 172.21.15.170:0/1983809831 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6fd801ad50 con 0x559b88875c20 2024-09-12T17:27:58.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.248+0000 7f6fed011800 1 -- 172.21.15.170:0/1983809831 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559b88874930 con 0x559b88777210 2024-09-12T17:27:58.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.248+0000 7f6fe8f49640 1 -- 172.21.15.170:0/1983809831 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6fe000a4d0 con 0x559b88777210 2024-09-12T17:27:58.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.248+0000 7f6fed011800 1 -- 172.21.15.170:0/1983809831 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559b88874d50 con 0x559b88875c20 2024-09-12T17:27:58.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.248+0000 7f6fe8748640 1 -- 172.21.15.170:0/1983809831 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6fd801ad50 con 0x559b88875c20 2024-09-12T17:27:58.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.249+0000 7f6fed011800 1 Processor -- start 2024-09-12T17:27:58.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.249+0000 7f6fed011800 1 -- start start 2024-09-12T17:27:58.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.249+0000 7f6fed011800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b888870d0 0x559b888874f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.249+0000 7f6fed011800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559b88669a00 con 0x559b888870d0 2024-09-12T17:27:58.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.249+0000 7f6fe8f49640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b888870d0 0x559b888874f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.249+0000 7f6fe8f49640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b888870d0 0x559b888874f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56144/0 (socket says 172.21.15.170:56144) 2024-09-12T17:27:58.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.249+0000 7f6fe8f49640 1 -- 172.21.15.170:0/4231350657 learned_addr learned my addr 172.21.15.170:0/4231350657 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:58.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.250+0000 7f6fe8f49640 1 -- 172.21.15.170:0/4231350657 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b88887b30 con 0x559b888870d0 2024-09-12T17:27:58.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.250+0000 7f6fe8f49640 1 --2- 172.21.15.170:0/4231350657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b888870d0 0x559b888874f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x559b8886d570 tx=0x7f6fe00167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.250+0000 7f6ecdffb640 1 -- 172.21.15.170:0/4231350657 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fe0013640 con 0x559b888870d0 2024-09-12T17:27:58.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.250+0000 7f6ecdffb640 1 -- 172.21.15.170:0/4231350657 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fe00137e0 con 0x559b888870d0 2024-09-12T17:27:58.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.250+0000 7f6fed011800 1 -- 172.21.15.170:0/4231350657 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559b88888360 con 0x559b888870d0 2024-09-12T17:27:58.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.250+0000 7f6ecdffb640 1 -- 172.21.15.170:0/4231350657 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fe0013ae0 con 0x559b888870d0 2024-09-12T17:27:58.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.250+0000 7f6fed011800 1 -- 172.21.15.170:0/4231350657 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b88888900 con 0x559b888870d0 2024-09-12T17:27:58.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.251+0000 7f6ecdffb640 1 -- 172.21.15.170:0/4231350657 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f6fe0011040 con 0x559b888870d0 2024-09-12T17:27:58.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.251+0000 7f6ecdffb640 1 --2- 172.21.15.170:0/4231350657 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f6ec003c780 0x7f6ec003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.252+0000 7f6ecdffb640 1 -- 172.21.15.170:0/4231350657 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f6fe000e040 con 0x559b888870d0 2024-09-12T17:27:58.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.252+0000 7f6fe8748640 1 --2- 172.21.15.170:0/4231350657 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f6ec003c780 0x7f6ec003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.252+0000 7f6fed011800 1 Processor -- start 2024-09-12T17:27:58.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.252+0000 7f6fed011800 1 -- start start 2024-09-12T17:27:58.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.252+0000 7f6fe8748640 1 --2- 172.21.15.170:0/4231350657 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f6ec003c780 0x7f6ec003ec40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x559b88878bc0 tx=0x7f6fd8051f80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.252+0000 7f6fed011800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b88893bb0 0x559b88893fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.252+0000 7f6fed011800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559b88771730 con 0x559b88893bb0 2024-09-12T17:27:58.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.252+0000 7f6fe8f49640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b88893bb0 0x559b88893fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.252+0000 7f6fe8f49640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b88893bb0 0x559b88893fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56148/0 (socket says 172.21.15.170:56148) 2024-09-12T17:27:58.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.252+0000 7f6fe8f49640 1 -- 172.21.15.170:0/3406649689 learned_addr learned my addr 172.21.15.170:0/3406649689 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:58.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.253+0000 7f6fe8f49640 1 -- 172.21.15.170:0/3406649689 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b888945a0 con 0x559b88893bb0 2024-09-12T17:27:58.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.253+0000 7f6fe8f49640 1 --2- 172.21.15.170:0/3406649689 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b88893bb0 0x559b88893fb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0005a50 tx=0x7f6fe0020690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e0d2d822e1ab8c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.253+0000 7f6ec77fe640 1 -- 172.21.15.170:0/3406649689 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fe0052020 con 0x559b88893bb0 2024-09-12T17:27:58.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.253+0000 7f6ec77fe640 1 -- 172.21.15.170:0/3406649689 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fe00143c0 con 0x559b88893bb0 2024-09-12T17:27:58.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.253+0000 7f6ec77fe640 1 -- 172.21.15.170:0/3406649689 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fe001fbd0 con 0x559b88893bb0 2024-09-12T17:27:58.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.253+0000 7f6fed011800 1 -- 172.21.15.170:0/3406649689 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b88893bb0 msgr2=0x559b88893fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.253+0000 7f6fed011800 1 --2- 172.21.15.170:0/3406649689 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b88893bb0 0x559b88893fb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0005a50 tx=0x7f6fe0020690 comp rx=0 tx=0).stop 2024-09-12T17:27:58.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.253+0000 7f6fed011800 1 -- 172.21.15.170:0/3406649689 shutdown_connections 2024-09-12T17:27:58.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.253+0000 7f6fed011800 1 --2- 172.21.15.170:0/3406649689 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b88893bb0 0x559b88893fb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.253+0000 7f6fed011800 1 -- 172.21.15.170:0/3406649689 >> 172.21.15.170:0/3406649689 conn(0x559b8888ffb0 msgr2=0x559b8888e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:58.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.253+0000 7f6fed011800 1 -- 172.21.15.170:0/3406649689 shutdown_connections 2024-09-12T17:27:58.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.253+0000 7f6fed011800 1 -- 172.21.15.170:0/3406649689 wait complete. 2024-09-12T17:27:58.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.254+0000 7f6fed011800 1 Processor -- start 2024-09-12T17:27:58.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.254+0000 7f6fed011800 1 -- start start 2024-09-12T17:27:58.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.254+0000 7f6fed011800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b88893bb0 0x559b8889b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.254+0000 7f6fed011800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559b88894b90 con 0x559b88893bb0 2024-09-12T17:27:58.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.254+0000 7f6fe8f49640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b88893bb0 0x559b8889b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.254+0000 7f6fe8f49640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b88893bb0 0x559b8889b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56150/0 (socket says 172.21.15.170:56150) 2024-09-12T17:27:58.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.254+0000 7f6fe8f49640 1 -- 172.21.15.170:0/3282160131 learned_addr learned my addr 172.21.15.170:0/3282160131 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:58.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.255+0000 7f6fe8f49640 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b8889b610 con 0x559b88893bb0 2024-09-12T17:27:58.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.255+0000 7f6fe8f49640 1 --2- 172.21.15.170:0/3282160131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b88893bb0 0x559b8889b0b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0020560 tx=0x7f6fe0053d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.255+0000 7f6ec5ffb640 1 -- 172.21.15.170:0/3282160131 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fe001fbd0 con 0x559b88893bb0 2024-09-12T17:27:58.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.255+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559b8889b8a0 con 0x559b88893bb0 2024-09-12T17:27:58.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.255+0000 7f6ec5ffb640 1 -- 172.21.15.170:0/3282160131 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fe00555c0 con 0x559b88893bb0 2024-09-12T17:27:58.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.255+0000 7f6ec5ffb640 1 -- 172.21.15.170:0/3282160131 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fe001fdb0 con 0x559b88893bb0 2024-09-12T17:27:58.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.255+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b8889c430 con 0x559b88893bb0 2024-09-12T17:27:58.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.256+0000 7f6ec5ffb640 1 -- 172.21.15.170:0/3282160131 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f6fe0020b40 con 0x559b88893bb0 2024-09-12T17:27:58.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.256+0000 7f6ec5ffb640 1 --2- 172.21.15.170:0/3282160131 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f6eb803c730 0x7f6eb803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.256+0000 7f6ec5ffb640 1 -- 172.21.15.170:0/3282160131 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f6fe0017450 con 0x559b88893bb0 2024-09-12T17:27:58.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.256+0000 7f6fe8748640 1 --2- 172.21.15.170:0/3282160131 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f6eb803c730 0x7f6eb803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.256+0000 7f6fe8748640 1 --2- 172.21.15.170:0/3282160131 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f6eb803c730 0x7f6eb803ebf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8052310 tx=0x7f6fd800d7a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.256+0000 7f6fed011800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.256+0000 7f6fed011800 1 --2- 172.21.15.170:0/3282160131 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x559b888a6a90 0x559b888a8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.257+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559b888a96a0 con 0x559b888a6a90 2024-09-12T17:27:58.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.257+0000 7f6fe7f47640 1 --2- 172.21.15.170:0/3282160131 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x559b888a6a90 0x559b888a8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.257+0000 7f6fe7f47640 1 --2- 172.21.15.170:0/3282160131 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x559b888a6a90 0x559b888a8f50 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.257+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x559b888a6a90 2024-09-12T17:27:58.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.257+0000 7f6fed011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:58.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.257+0000 7f6fed011800 20 realm 2024-09-12T17:27:58.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.257+0000 7f6fed011800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.257+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559b888a9ad0 con 0x559b888a6a90 2024-09-12T17:27:58.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.257+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x559b888a6a90 2024-09-12T17:27:58.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.257+0000 7f6fed011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:58.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.257+0000 7f6fed011800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:58.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.257+0000 7f6fed011800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.257+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559b888aa3a0 con 0x559b888a6a90 2024-09-12T17:27:58.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.258+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x559b888a6a90 2024-09-12T17:27:58.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.258+0000 7f6fed011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:58.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.258+0000 7f6fed011800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.258+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559b888aa740 con 0x559b888a6a90 2024-09-12T17:27:58.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.258+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6fdc051070 con 0x559b888a6a90 2024-09-12T17:27:58.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.258+0000 7f6fed011800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:58.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.258+0000 7f6fed011800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.258+0000 7f6fed011800 1 --2- 172.21.15.170:0/3282160131 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x559b888ab4a0 0x559b888ad890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.258+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559b888adea0 con 0x559b888ab4a0 2024-09-12T17:27:58.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.258+0000 7f6fe8f49640 1 --2- 172.21.15.170:0/3282160131 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x559b888ab4a0 0x559b888ad890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.258+0000 7f6fe8f49640 1 --2- 172.21.15.170:0/3282160131 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x559b888ab4a0 0x559b888ad890 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.259+0000 7f6fe8f49640 1 -- 172.21.15.170:0/3282160131 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6fe000a4d0 con 0x559b888ab4a0 2024-09-12T17:27:58.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.259+0000 7f6fed011800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:27:58.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.259+0000 7f6fed011800 20 searching for the correct realm 2024-09-12T17:27:58.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.259+0000 7f6fed011800 1 --2- 172.21.15.170:0/3282160131 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x559b888afe50 0x559b888b2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.259+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b888b2990 con 0x559b888afe50 2024-09-12T17:27:58.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.259+0000 7f6fe8748640 1 --2- 172.21.15.170:0/3282160131 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x559b888afe50 0x559b888b2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.259+0000 7f6fe8748640 1 --2- 172.21.15.170:0/3282160131 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x559b888afe50 0x559b888b2310 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.259+0000 7f6fe8748640 1 -- 172.21.15.170:0/3282160131 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd801ad50 con 0x559b888afe50 2024-09-12T17:27:58.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.259+0000 7f6fe8748640 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b888b2990 con 0x559b888ab4a0 2024-09-12T17:27:58.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.259+0000 7f6fe8f49640 1 -- 172.21.15.170:0/3282160131 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fe000a4d0 con 0x559b888ab4a0 2024-09-12T17:27:58.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.259+0000 7f6fe8f49640 1 --2- 172.21.15.170:0/3282160131 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f6fe0035ba0 0x7f6fe004e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.259+0000 7f6fe8f49640 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b888b2990 con 0x7f6fe0035ba0 2024-09-12T17:27:58.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.260+0000 7f6fe7f47640 1 --2- 172.21.15.170:0/3282160131 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f6fe0035ba0 0x7f6fe004e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.260+0000 7f6fe7f47640 1 --2- 172.21.15.170:0/3282160131 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f6fe0035ba0 0x7f6fe004e980 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.260+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe0035ba0 2024-09-12T17:27:58.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.260+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b888b2990 con 0x559b888a6a90 2024-09-12T17:27:58.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.261+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fdc051070 con 0x559b888a6a90 2024-09-12T17:27:58.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.261+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b888b2990 con 0x559b888a6a90 2024-09-12T17:27:58.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.261+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fdc051070 con 0x559b888a6a90 2024-09-12T17:27:58.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.261+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b888b2990 con 0x7f6fe0035ba0 2024-09-12T17:27:58.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.261+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe0035ba0 2024-09-12T17:27:58.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.261+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b888b2990 con 0x7f6fe0035ba0 2024-09-12T17:27:58.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.261+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe0035ba0 2024-09-12T17:27:58.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.261+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b888b2990 con 0x559b888ab4a0 2024-09-12T17:27:58.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.262+0000 7f6fe8f49640 1 -- 172.21.15.170:0/3282160131 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fe0062040 con 0x559b888ab4a0 2024-09-12T17:27:58.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.262+0000 7f6fe8f49640 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b888b2990 con 0x559b888afe50 2024-09-12T17:27:58.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.262+0000 7f6fe8748640 1 -- 172.21.15.170:0/3282160131 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd801ad50 con 0x559b888afe50 2024-09-12T17:27:58.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.262+0000 7f6fe8748640 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b888b2990 con 0x559b888a6a90 2024-09-12T17:27:58.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.262+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fdc051070 con 0x559b888a6a90 2024-09-12T17:27:58.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.262+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b888b2990 con 0x7f6fe0035ba0 2024-09-12T17:27:58.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.263+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe0035ba0 2024-09-12T17:27:58.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.263+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b888b2990 con 0x559b888a6a90 2024-09-12T17:27:58.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.263+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fdc051070 con 0x559b888a6a90 2024-09-12T17:27:58.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.263+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b888b2990 con 0x559b888ab4a0 2024-09-12T17:27:58.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.263+0000 7f6fe8f49640 1 -- 172.21.15.170:0/3282160131 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f6fe0062040 con 0x559b888ab4a0 2024-09-12T17:27:58.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.263+0000 7f6fe8f49640 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b888b2990 con 0x559b888afe50 2024-09-12T17:27:58.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.263+0000 7f6fe8748640 1 -- 172.21.15.170:0/3282160131 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd801ad50 con 0x559b888afe50 2024-09-12T17:27:58.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.263+0000 7f6fe8748640 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b888b2990 con 0x559b888afe50 2024-09-12T17:27:58.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.263+0000 7f6fe8748640 1 -- 172.21.15.170:0/3282160131 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd801ad50 con 0x559b888afe50 2024-09-12T17:27:58.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.263+0000 7f6fe8748640 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b888b2990 con 0x7f6fe0035ba0 2024-09-12T17:27:58.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.264+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe0035ba0 2024-09-12T17:27:58.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.264+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b888b2990 con 0x559b888afe50 2024-09-12T17:27:58.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.264+0000 7f6fe8748640 1 -- 172.21.15.170:0/3282160131 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd801ad50 con 0x559b888afe50 2024-09-12T17:27:58.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.264+0000 7f6fe8748640 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b888b2990 con 0x559b888afe50 2024-09-12T17:27:58.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.264+0000 7f6fe8748640 1 -- 172.21.15.170:0/3282160131 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd801ad50 con 0x559b888afe50 2024-09-12T17:27:58.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.264+0000 7f6fe8748640 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b888b2990 con 0x559b888a6a90 2024-09-12T17:27:58.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.264+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fdc051070 con 0x559b888a6a90 2024-09-12T17:27:58.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.264+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b888b2990 con 0x559b888a6a90 2024-09-12T17:27:58.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.265+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6fdc051070 con 0x559b888a6a90 2024-09-12T17:27:58.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.265+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b888b2990 con 0x7f6fe0035ba0 2024-09-12T17:27:58.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.265+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe0035ba0 2024-09-12T17:27:58.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.265+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b888b2990 con 0x559b888afe50 2024-09-12T17:27:58.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.265+0000 7f6fe8748640 1 -- 172.21.15.170:0/3282160131 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd801ad50 con 0x559b888afe50 2024-09-12T17:27:58.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.265+0000 7f6fe8748640 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b888b2990 con 0x559b888ab4a0 2024-09-12T17:27:58.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.265+0000 7f6fe8f49640 1 -- 172.21.15.170:0/3282160131 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fe0062040 con 0x559b888ab4a0 2024-09-12T17:27:58.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.265+0000 7f6fe8f49640 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b888b2990 con 0x559b888a6a90 2024-09-12T17:27:58.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.266+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fdc051070 con 0x559b888a6a90 2024-09-12T17:27:58.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.266+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b888b2990 con 0x7f6fe0035ba0 2024-09-12T17:27:58.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.266+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe0035ba0 2024-09-12T17:27:58.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.266+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b888b2990 con 0x559b888afe50 2024-09-12T17:27:58.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.266+0000 7f6fe8748640 1 -- 172.21.15.170:0/3282160131 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd801ad50 con 0x559b888afe50 2024-09-12T17:27:58.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.266+0000 7f6fe8748640 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b888b2990 con 0x7f6fe0035ba0 2024-09-12T17:27:58.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.267+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe0035ba0 2024-09-12T17:27:58.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.267+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b888b2990 con 0x559b888ab4a0 2024-09-12T17:27:58.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.267+0000 7f6fe8f49640 1 -- 172.21.15.170:0/3282160131 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fe0062040 con 0x559b888ab4a0 2024-09-12T17:27:58.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.267+0000 7f6fe8f49640 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b888b2990 con 0x559b888afe50 2024-09-12T17:27:58.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.267+0000 7f6fe8748640 1 -- 172.21.15.170:0/3282160131 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fd801ad50 con 0x559b888afe50 2024-09-12T17:27:58.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.267+0000 7f6fe8748640 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b888b2990 con 0x7f6fe0035ba0 2024-09-12T17:27:58.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.267+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe0035ba0 2024-09-12T17:27:58.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.267+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b888b2990 con 0x559b888a6a90 2024-09-12T17:27:58.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.268+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6fdc051070 con 0x559b888a6a90 2024-09-12T17:27:58.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.268+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559b888b2990 con 0x559b888ab4a0 2024-09-12T17:27:58.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.268+0000 7f6fe8f49640 1 -- 172.21.15.170:0/3282160131 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v22'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6fe0062040 con 0x559b888ab4a0 2024-09-12T17:27:58.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.268+0000 7f6fed011800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:27:58.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.268+0000 7f6fed011800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:58.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.268+0000 7f6fed011800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:58.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.268+0000 7f6fed011800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:58.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.268+0000 7f6fed011800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:58.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.268+0000 7f6fed011800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:27:58.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.268+0000 7f6fed011800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.268+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559b888ae860 con 0x559b888a6a90 2024-09-12T17:27:58.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.268+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x559b888a6a90 2024-09-12T17:27:58.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.268+0000 7f6fed011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:58.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.268+0000 7f6fed011800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.268+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559b888af100 con 0x559b888a6a90 2024-09-12T17:27:58.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.268+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6fdc051070 con 0x559b888a6a90 2024-09-12T17:27:58.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.268+0000 7f6fed011800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:58.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.268+0000 7f6fed011800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.268+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559b888ae4a0 con 0x559b888ab4a0 2024-09-12T17:27:58.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.269+0000 7f6fe8f49640 1 -- 172.21.15.170:0/3282160131 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6fe0062040 con 0x559b888ab4a0 2024-09-12T17:27:58.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.269+0000 7f6fed011800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:27:58.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.269+0000 7f6fed011800 20 zone default found 2024-09-12T17:27:58.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.269+0000 7f6fed011800 4 Realm: () 2024-09-12T17:27:58.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.269+0000 7f6fed011800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:27:58.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.269+0000 7f6fed011800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:27:58.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.269+0000 7f6fed011800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:58.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.269+0000 7f6fed011800 20 zonegroup default 2024-09-12T17:27:58.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.269+0000 7f6fed011800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.269+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559b888b32c0 con 0x7f6fe0035ba0 2024-09-12T17:27:58.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.269+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe0035ba0 2024-09-12T17:27:58.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.269+0000 7f6fed011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:58.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.269+0000 7f6fed011800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.269+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559b888b5500 con 0x559b888afe50 2024-09-12T17:27:58.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.269+0000 7f6fe8748640 1 -- 172.21.15.170:0/3282160131 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6fd801ad50 con 0x559b888afe50 2024-09-12T17:27:58.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.269+0000 7f6fed011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:58.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.269+0000 7f6fed011800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.269+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559b888b58a0 con 0x559b888afe50 2024-09-12T17:27:58.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.270+0000 7f6fe8748640 1 -- 172.21.15.170:0/3282160131 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6fd801ad50 con 0x559b888afe50 2024-09-12T17:27:58.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.270+0000 7f6fed011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:58.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.270+0000 7f6fed011800 20 started sync module instance, tier type = 2024-09-12T17:27:58.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.270+0000 7f6fed011800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:27:58.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.270+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888b4990 con 0x559b888ab4a0 2024-09-12T17:27:58.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.271+0000 7f6fe8f49640 1 -- 172.21.15.170:0/3282160131 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fe0062040 con 0x559b888ab4a0 2024-09-12T17:27:58.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.271+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94126499122608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888b45f0 con 0x559b888ab4a0 2024-09-12T17:27:58.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.271+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888b6760 con 0x559b888a6a90 2024-09-12T17:27:58.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.272+0000 7f6fe8f49640 1 -- 172.21.15.170:0/3282160131 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94126499122608] v29'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fe0062040 con 0x559b888ab4a0 2024-09-12T17:27:58.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.272+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x559b888a6a90 2024-09-12T17:27:58.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.272+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94126499126416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888b6760 con 0x559b888a6a90 2024-09-12T17:27:58.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.272+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888b71f0 con 0x559b888afe50 2024-09-12T17:27:58.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.273+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94126499126416] v29'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x559b888a6a90 2024-09-12T17:27:58.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.274+0000 7f6fe8748640 1 -- 172.21.15.170:0/3282160131 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fd801ad50 con 0x559b888afe50 2024-09-12T17:27:58.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.274+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94126499127984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888b66d0 con 0x559b888afe50 2024-09-12T17:27:58.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.274+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888b80b0 con 0x559b888ab4a0 2024-09-12T17:27:58.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.275+0000 7f6fe8f49640 1 -- 172.21.15.170:0/3282160131 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fe0062040 con 0x559b888ab4a0 2024-09-12T17:27:58.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.275+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94126499134976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888b8950 con 0x559b888ab4a0 2024-09-12T17:27:58.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.275+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888b9400 con 0x559b888a6a90 2024-09-12T17:27:58.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.275+0000 7f6fe8748640 1 -- 172.21.15.170:0/3282160131 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94126499127984] v29'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fd801ad50 con 0x559b888afe50 2024-09-12T17:27:58.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.276+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x559b888a6a90 2024-09-12T17:27:58.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.276+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94126499132896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888b9400 con 0x559b888a6a90 2024-09-12T17:27:58.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.276+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888b9e50 con 0x7f6fe0035ba0 2024-09-12T17:27:58.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.276+0000 7f6fe8f49640 1 -- 172.21.15.170:0/3282160131 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94126499134976] v29'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fe0062040 con 0x559b888ab4a0 2024-09-12T17:27:58.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.277+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe0035ba0 2024-09-12T17:27:58.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.277+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94126499136672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888b9e10 con 0x7f6fe0035ba0 2024-09-12T17:27:58.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.277+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888ba880 con 0x7f6fe0035ba0 2024-09-12T17:27:58.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.277+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94126499132896] v29'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x559b888a6a90 2024-09-12T17:27:58.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.278+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94126499136672] v29'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe0035ba0 2024-09-12T17:27:58.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.278+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(56 notify.6 [create] v29'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe0035ba0 2024-09-12T17:27:58.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.278+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94126499144624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888b9960 con 0x7f6fe0035ba0 2024-09-12T17:27:58.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.278+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888baf10 con 0x7f6fe0035ba0 2024-09-12T17:27:58.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.279+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94126499144624] v29'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe0035ba0 2024-09-12T17:27:58.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.279+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(58 notify.7 [create] v29'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe0035ba0 2024-09-12T17:27:58.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.279+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94126499139296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888b9960 con 0x7f6fe0035ba0 2024-09-12T17:27:58.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.279+0000 7f6fed011800 20 add_watcher() i=0 2024-09-12T17:27:58.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.279+0000 7f6fed011800 20 add_watcher() i=1 2024-09-12T17:27:58.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.279+0000 7f6fed011800 20 add_watcher() i=2 2024-09-12T17:27:58.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.279+0000 7f6fed011800 20 add_watcher() i=3 2024-09-12T17:27:58.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.279+0000 7f6fed011800 20 add_watcher() i=4 2024-09-12T17:27:58.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.279+0000 7f6fed011800 20 add_watcher() i=5 2024-09-12T17:27:58.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.279+0000 7f6fed011800 20 add_watcher() i=6 2024-09-12T17:27:58.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.280+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94126499139296] v29'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe0035ba0 2024-09-12T17:27:58.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.280+0000 7f6fed011800 20 add_watcher() i=7 2024-09-12T17:27:58.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.280+0000 7f6fed011800 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:58.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.280+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559b888be110 con 0x559b888a6a90 2024-09-12T17:27:58.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.281+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6fdc051070 con 0x559b888a6a90 2024-09-12T17:27:58.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.281+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94126499146336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888bb630 con 0x559b888a6a90 2024-09-12T17:27:58.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.282+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94126499146336] v29'26 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x559b888a6a90 2024-09-12T17:27:58.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.282+0000 7f6e9efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:58.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.282+0000 7f6fed011800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:58.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.282+0000 7f6fed011800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:58.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.282+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888c6a20 con 0x559b888a6a90 2024-09-12T17:27:58.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.283+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x559b888a6a90 2024-09-12T17:27:58.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.283+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888c0480 con 0x7f6fe0035ba0 2024-09-12T17:27:58.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.284+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'10 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe0035ba0 2024-09-12T17:27:58.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.284+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888c7440 con 0x559b888afe50 2024-09-12T17:27:58.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.285+0000 7f6fe8748640 1 -- 172.21.15.170:0/3282160131 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6fd801ad50 con 0x559b888afe50 2024-09-12T17:27:58.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.285+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888c6090 con 0x559b888a6a90 2024-09-12T17:27:58.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.286+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'27 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x559b888a6a90 2024-09-12T17:27:58.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.286+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888c6090 con 0x559b888ab4a0 2024-09-12T17:27:58.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.287+0000 7f6fe8f49640 1 -- 172.21.15.170:0/3282160131 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'20 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6fe0070040 con 0x559b888ab4a0 2024-09-12T17:27:58.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.287+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888c6090 con 0x559b888afe50 2024-09-12T17:27:58.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.288+0000 7f6fe8748640 1 -- 172.21.15.170:0/3282160131 <== osd.3 v2:172.21.15.170:6816/2664906588 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'13 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6fd801ad50 con 0x559b888afe50 2024-09-12T17:27:58.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.288+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888c8030 con 0x559b888a6a90 2024-09-12T17:27:58.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.289+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x559b888a6a90 2024-09-12T17:27:58.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.289+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888c8010 con 0x7f6fe0035ba0 2024-09-12T17:27:58.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.291+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'13 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe0035ba0 2024-09-12T17:27:58.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.291+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888c7fa0 con 0x559b888ab4a0 2024-09-12T17:27:58.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.292+0000 7f6fe8f49640 1 -- 172.21.15.170:0/3282160131 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6fe0070040 con 0x559b888ab4a0 2024-09-12T17:27:58.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.292+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888c7fa0 con 0x559b888afe50 2024-09-12T17:27:58.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.293+0000 7f6fe8748640 1 -- 172.21.15.170:0/3282160131 <== osd.3 v2:172.21.15.170:6816/2664906588 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'16 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6fd801ad50 con 0x559b888afe50 2024-09-12T17:27:58.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.293+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888c8030 con 0x559b888ab4a0 2024-09-12T17:27:58.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.294+0000 7f6fe8f49640 1 -- 172.21.15.170:0/3282160131 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'21 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6fe0070040 con 0x559b888ab4a0 2024-09-12T17:27:58.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.294+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888c85f0 con 0x7f6fe0035ba0 2024-09-12T17:27:58.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.295+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe0035ba0 2024-09-12T17:27:58.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.295+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888c85f0 con 0x559b888ab4a0 2024-09-12T17:27:58.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.296+0000 7f6fe8f49640 1 -- 172.21.15.170:0/3282160131 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6fe0070040 con 0x559b888ab4a0 2024-09-12T17:27:58.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.296+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888c85f0 con 0x7f6fe0035ba0 2024-09-12T17:27:58.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.297+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'19 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe0035ba0 2024-09-12T17:27:58.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.297+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888c85f0 con 0x559b888a6a90 2024-09-12T17:27:58.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.298+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'28 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x559b888a6a90 2024-09-12T17:27:58.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.298+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888c85f0 con 0x559b888afe50 2024-09-12T17:27:58.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.299+0000 7f6fe8748640 1 -- 172.21.15.170:0/3282160131 <== osd.3 v2:172.21.15.170:6816/2664906588 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6fd801ad50 con 0x559b888afe50 2024-09-12T17:27:58.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.299+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888c85f0 con 0x559b888ab4a0 2024-09-12T17:27:58.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.300+0000 7f6fe8f49640 1 -- 172.21.15.170:0/3282160131 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6fe0070040 con 0x559b888ab4a0 2024-09-12T17:27:58.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.300+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888c85f0 con 0x559b888afe50 2024-09-12T17:27:58.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.301+0000 7f6fe8748640 1 -- 172.21.15.170:0/3282160131 <== osd.3 v2:172.21.15.170:6816/2664906588 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6fd801ad50 con 0x559b888afe50 2024-09-12T17:27:58.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.301+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888c85f0 con 0x559b888a6a90 2024-09-12T17:27:58.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.302+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x559b888a6a90 2024-09-12T17:27:58.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.302+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888c85f0 con 0x559b888a6a90 2024-09-12T17:27:58.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.303+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'29 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x559b888a6a90 2024-09-12T17:27:58.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.303+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888c85f0 con 0x559b888afe50 2024-09-12T17:27:58.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.304+0000 7f6fe8748640 1 -- 172.21.15.170:0/3282160131 <== osd.3 v2:172.21.15.170:6816/2664906588 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6fd801ad50 con 0x559b888afe50 2024-09-12T17:27:58.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.304+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888c85f0 con 0x559b888ab4a0 2024-09-12T17:27:58.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.305+0000 7f6fe8f49640 1 -- 172.21.15.170:0/3282160131 <== osd.2 v2:172.21.15.170:6808/3855567754 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6fe0070040 con 0x559b888ab4a0 2024-09-12T17:27:58.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.305+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888c85f0 con 0x559b888afe50 2024-09-12T17:27:58.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.306+0000 7f6fe8748640 1 -- 172.21.15.170:0/3282160131 <== osd.3 v2:172.21.15.170:6816/2664906588 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6fd801ad50 con 0x559b888afe50 2024-09-12T17:27:58.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.306+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888c85f0 con 0x559b888afe50 2024-09-12T17:27:58.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.307+0000 7f6fe8748640 1 -- 172.21.15.170:0/3282160131 <== osd.3 v2:172.21.15.170:6816/2664906588 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6fd801ad50 con 0x559b888afe50 2024-09-12T17:27:58.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.307+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888c85f0 con 0x559b888afe50 2024-09-12T17:27:58.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.308+0000 7f6fe8748640 1 -- 172.21.15.170:0/3282160131 <== osd.3 v2:172.21.15.170:6816/2664906588 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'6 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6fd801ad50 con 0x559b888afe50 2024-09-12T17:27:58.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.308+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888c85f0 con 0x559b888afe50 2024-09-12T17:27:58.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.309+0000 7f6fe8748640 1 -- 172.21.15.170:0/3282160131 <== osd.3 v2:172.21.15.170:6816/2664906588 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'14 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6fd801ad50 con 0x559b888afe50 2024-09-12T17:27:58.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.309+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888c85f0 con 0x7f6fe0035ba0 2024-09-12T17:27:58.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.310+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe0035ba0 2024-09-12T17:27:58.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.310+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888c85f0 con 0x559b888afe50 2024-09-12T17:27:58.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.311+0000 7f6fe8748640 1 -- 172.21.15.170:0/3282160131 <== osd.3 v2:172.21.15.170:6816/2664906588 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6fd801ad50 con 0x559b888afe50 2024-09-12T17:27:58.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.311+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888c85f0 con 0x7f6fe0035ba0 2024-09-12T17:27:58.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.312+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.0 v2:172.21.15.47:6800/3978157098 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'14 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe0035ba0 2024-09-12T17:27:58.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.312+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888c85f0 con 0x559b888afe50 2024-09-12T17:27:58.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.313+0000 7f6fe8748640 1 -- 172.21.15.170:0/3282160131 <== osd.3 v2:172.21.15.170:6816/2664906588 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'16 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6fd801ad50 con 0x559b888afe50 2024-09-12T17:27:58.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.313+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888c85f0 con 0x7f6fe0035ba0 2024-09-12T17:27:58.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.314+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.0 v2:172.21.15.47:6800/3978157098 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'20 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe0035ba0 2024-09-12T17:27:58.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.314+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888c85f0 con 0x559b888ab4a0 2024-09-12T17:27:58.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.315+0000 7f6fe8f49640 1 -- 172.21.15.170:0/3282160131 <== osd.2 v2:172.21.15.170:6808/3855567754 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6fe0070040 con 0x559b888ab4a0 2024-09-12T17:27:58.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.316+0000 7f6e9dfe3640 20 reqs_thread_entry: start 2024-09-12T17:27:58.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.316+0000 7f6fed011800 20 init_complete bucket index max shards: 11 2024-09-12T17:27:58.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.316+0000 7f6fed011800 20 Filter name: none 2024-09-12T17:27:58.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.316+0000 7f6e96ffd640 20 reqs_thread_entry: start 2024-09-12T17:27:58.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.316+0000 7f6fed011800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-12T17:27:58.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.316+0000 7f6fed011800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.316+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559b888f34d0 con 0x559b888ab4a0 2024-09-12T17:27:58.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.316+0000 7f6fe8f49640 1 -- 172.21.15.170:0/3282160131 <== osd.2 v2:172.21.15.170:6808/3855567754 20 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f6fe0070040 con 0x559b888ab4a0 2024-09-12T17:27:58.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.316+0000 7f6fed011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:58.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.316+0000 7f6fed011800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-09-12T17:27:58.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.316+0000 7f6fed011800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-12T17:27:58.319 INFO:teuthology.orchestra.run.smithi170.stderr:could not remove user: unable to remove user, user does not exist 2024-09-12T17:27:58.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.317+0000 7f6e9efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:58.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.317+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94126499146336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888c0e70 con 0x559b888a6a90 2024-09-12T17:27:58.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.318+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94126499146336] v29'30 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x559b888a6a90 2024-09-12T17:27:58.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.318+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94126499122608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888baa60 con 0x559b888ab4a0 2024-09-12T17:27:58.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.319+0000 7f6fe8f49640 1 -- 172.21.15.170:0/3282160131 <== osd.2 v2:172.21.15.170:6808/3855567754 21 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94126499122608] v29'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fe0070040 con 0x559b888ab4a0 2024-09-12T17:27:58.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.319+0000 7f6fed011800 20 remove_watcher() i=0 2024-09-12T17:27:58.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.319+0000 7f6fed011800 2 removed watcher, disabling cache 2024-09-12T17:27:58.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.319+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94126499126416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888b4db0 con 0x559b888a6a90 2024-09-12T17:27:58.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.320+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94126499126416] v29'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x559b888a6a90 2024-09-12T17:27:58.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.320+0000 7f6fed011800 20 remove_watcher() i=1 2024-09-12T17:27:58.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.320+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94126499127984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888b4db0 con 0x559b888afe50 2024-09-12T17:27:58.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.321+0000 7f6fe8748640 1 -- 172.21.15.170:0/3282160131 <== osd.3 v2:172.21.15.170:6816/2664906588 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94126499127984] v29'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fd801ad50 con 0x559b888afe50 2024-09-12T17:27:58.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.321+0000 7f6fed011800 20 remove_watcher() i=2 2024-09-12T17:27:58.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.321+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94126499134976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888b4db0 con 0x559b888ab4a0 2024-09-12T17:27:58.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.322+0000 7f6fe8f49640 1 -- 172.21.15.170:0/3282160131 <== osd.2 v2:172.21.15.170:6808/3855567754 22 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94126499134976] v29'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fe0070040 con 0x559b888ab4a0 2024-09-12T17:27:58.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.322+0000 7f6fed011800 20 remove_watcher() i=3 2024-09-12T17:27:58.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.322+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94126499132896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888b7e00 con 0x559b888a6a90 2024-09-12T17:27:58.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.323+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94126499132896] v29'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x559b888a6a90 2024-09-12T17:27:58.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.323+0000 7f6fed011800 20 remove_watcher() i=4 2024-09-12T17:27:58.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.323+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94126499136672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888b4db0 con 0x7f6fe0035ba0 2024-09-12T17:27:58.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.324+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.0 v2:172.21.15.47:6800/3978157098 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94126499136672] v29'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe0035ba0 2024-09-12T17:27:58.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.324+0000 7f6fed011800 20 remove_watcher() i=5 2024-09-12T17:27:58.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.324+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94126499144624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888b7e00 con 0x7f6fe0035ba0 2024-09-12T17:27:58.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.325+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.0 v2:172.21.15.47:6800/3978157098 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94126499144624] v29'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe0035ba0 2024-09-12T17:27:58.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.325+0000 7f6fed011800 20 remove_watcher() i=6 2024-09-12T17:27:58.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.325+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94126499139296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559b888b84a0 con 0x7f6fe0035ba0 2024-09-12T17:27:58.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.326+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 <== osd.0 v2:172.21.15.47:6800/3978157098 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94126499139296] v29'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fdc051070 con 0x7f6fe0035ba0 2024-09-12T17:27:58.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.326+0000 7f6fed011800 20 remove_watcher() i=7 2024-09-12T17:27:58.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.326+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f6fe0035ba0 msgr2=0x7f6fe004e980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.327+0000 7f6fed011800 1 --2- 172.21.15.170:0/3282160131 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f6fe0035ba0 0x7f6fe004e980 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.327+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x559b888a6a90 msgr2=0x559b888a8f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.327+0000 7f6fed011800 1 --2- 172.21.15.170:0/3282160131 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x559b888a6a90 0x559b888a8f50 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.327+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x559b888ab4a0 msgr2=0x559b888ad890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.327+0000 7f6fed011800 1 --2- 172.21.15.170:0/3282160131 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x559b888ab4a0 0x559b888ad890 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.327+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x559b888afe50 msgr2=0x559b888b2310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.327+0000 7f6fed011800 1 --2- 172.21.15.170:0/3282160131 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x559b888afe50 0x559b888b2310 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.327+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f6eb803c730 msgr2=0x7f6eb803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.327+0000 7f6fed011800 1 --2- 172.21.15.170:0/3282160131 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f6eb803c730 0x7f6eb803ebf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8052310 tx=0x7f6fd800d7a0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.327+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b88893bb0 msgr2=0x559b8889b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.327+0000 7f6fed011800 1 --2- 172.21.15.170:0/3282160131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b88893bb0 0x559b8889b0b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0020560 tx=0x7f6fe0053d00 comp rx=0 tx=0).stop 2024-09-12T17:27:58.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.327+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 reap_dead start 2024-09-12T17:27:58.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.327+0000 7f6fe7f47640 1 -- 172.21.15.170:0/3282160131 reap_dead start 2024-09-12T17:27:58.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.327+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 shutdown_connections 2024-09-12T17:27:58.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.327+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 >> 172.21.15.170:0/3282160131 conn(0x559b8888ffb0 msgr2=0x559b8888e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:58.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.327+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 shutdown_connections 2024-09-12T17:27:58.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.327+0000 7f6fed011800 1 -- 172.21.15.170:0/3282160131 wait complete. 2024-09-12T17:27:58.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.327+0000 7f6fed011800 1 -- 172.21.15.170:0/4231350657 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f6ec003c780 msgr2=0x7f6ec003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.327+0000 7f6fed011800 1 --2- 172.21.15.170:0/4231350657 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f6ec003c780 0x7f6ec003ec40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x559b88878bc0 tx=0x7f6fd8051f80 comp rx=0 tx=0).stop 2024-09-12T17:27:58.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.327+0000 7f6fed011800 1 -- 172.21.15.170:0/4231350657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b888870d0 msgr2=0x559b888874f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.327+0000 7f6fed011800 1 --2- 172.21.15.170:0/4231350657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b888870d0 0x559b888874f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x559b8886d570 tx=0x7f6fe00167b0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.327+0000 7f6fed011800 1 -- 172.21.15.170:0/4231350657 shutdown_connections 2024-09-12T17:27:58.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.327+0000 7f6fed011800 1 --2- 172.21.15.170:0/4231350657 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f6ec003c780 0x7f6ec003ec40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.327+0000 7f6fed011800 1 --2- 172.21.15.170:0/4231350657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b888870d0 0x559b888874f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.327+0000 7f6fed011800 1 -- 172.21.15.170:0/4231350657 >> 172.21.15.170:0/4231350657 conn(0x559b8887b480 msgr2=0x559b8887b860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:58.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.327+0000 7f6fed011800 1 -- 172.21.15.170:0/4231350657 shutdown_connections 2024-09-12T17:27:58.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.327+0000 7f6fed011800 1 -- 172.21.15.170:0/4231350657 wait complete. 2024-09-12T17:27:58.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.328+0000 7f6fed011800 1 -- 172.21.15.170:0/1983809831 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x559b88777210 msgr2=0x559b88873800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.328+0000 7f6fed011800 1 --2- 172.21.15.170:0/1983809831 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x559b88777210 0x559b88873800 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.328+0000 7f6fed011800 1 -- 172.21.15.170:0/1983809831 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x559b88875c20 msgr2=0x559b88878090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.328+0000 7f6fed011800 1 --2- 172.21.15.170:0/1983809831 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x559b88875c20 0x559b88878090 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.328+0000 7f6fed011800 1 -- 172.21.15.170:0/1983809831 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f6ed003c730 msgr2=0x7f6ed003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.328+0000 7f6fed011800 1 --2- 172.21.15.170:0/1983809831 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f6ed003c730 0x7f6ed003ebf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc057000 tx=0x7f6fdc052000 comp rx=0 tx=0).stop 2024-09-12T17:27:58.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.328+0000 7f6fed011800 1 -- 172.21.15.170:0/1983809831 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b88773700 msgr2=0x559b8886c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.328+0000 7f6fed011800 1 --2- 172.21.15.170:0/1983809831 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b88773700 0x559b8886c1b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x559b887729c0 tx=0x7f6fd8000bc0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.328+0000 7f6fed011800 1 -- 172.21.15.170:0/1983809831 shutdown_connections 2024-09-12T17:27:58.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.328+0000 7f6fed011800 1 --2- 172.21.15.170:0/1983809831 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x559b88875c20 0x559b88878090 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.328+0000 7f6fed011800 1 --2- 172.21.15.170:0/1983809831 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f6ed003c730 0x7f6ed003ebf0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.328+0000 7f6fed011800 1 --2- 172.21.15.170:0/1983809831 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x559b88777210 0x559b88873800 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.328+0000 7f6fed011800 1 --2- 172.21.15.170:0/1983809831 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b88773700 0x559b8886c1b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.328+0000 7f6fed011800 1 -- 172.21.15.170:0/1983809831 >> 172.21.15.170:0/1983809831 conn(0x559b8876d1c0 msgr2=0x559b8885db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:58.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.328+0000 7f6fed011800 1 -- 172.21.15.170:0/1983809831 shutdown_connections 2024-09-12T17:27:58.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.328+0000 7f6fed011800 1 -- 172.21.15.170:0/1983809831 wait complete. 2024-09-12T17:27:58.337 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-12T17:27:58.338 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-09-12T17:27:58.338 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-09-12T17:27:58.338 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-09-12T17:27:58.382 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:58.382 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:58.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.382+0000 7fc802840800 1 Processor -- start 2024-09-12T17:27:58.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.382+0000 7fc802840800 1 -- start start 2024-09-12T17:27:58.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.382+0000 7fc802840800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x559725dec440 0x559725dec840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.382+0000 7fc802840800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559725c96e40 con 0x559725deef30 2024-09-12T17:27:58.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.382+0000 7fc802840800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x559725c61680 con 0x559725dec440 2024-09-12T17:27:58.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.382+0000 7fc80032a640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x559725dec440 0x559725dec840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.382+0000 7fc7ffb29640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x559725deef30 0x559725df13f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:48196/0 (socket says 172.21.15.170:48196) 2024-09-12T17:27:58.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.382+0000 7fc7ffb29640 1 -- 172.21.15.170:0/696433766 learned_addr learned my addr 172.21.15.170:0/696433766 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:27:58.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.382+0000 7fc80032a640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x559725dec440 0x559725dec840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56164/0 (socket says 172.21.15.170:56164) 2024-09-12T17:27:58.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.383+0000 7fc80032a640 1 -- 172.21.15.170:0/696433766 >> v1:172.21.15.47:6789/0 conn(0x559725deef30 legacy=0x559725df13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.383+0000 7fc80032a640 1 -- 172.21.15.170:0/696433766 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559725c7d6b0 con 0x559725dec440 2024-09-12T17:27:58.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.383+0000 7fc7ff328640 1 -- 172.21.15.170:0/696433766 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1149876412 0 0) 0x559725c96e40 con 0x559725deef30 2024-09-12T17:27:58.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.385+0000 7fc80032a640 1 --2- 172.21.15.170:0/696433766 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559725dec440 0x559725dec840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc7f000a470 tx=0x7fc7f0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c99aca14fc2a885b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.385+0000 7fc7ff328640 1 -- 172.21.15.170:0/696433766 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7f0053570 con 0x559725dec440 2024-09-12T17:27:58.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.385+0000 7fc7ff328640 1 -- 172.21.15.170:0/696433766 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7f0058070 con 0x559725dec440 2024-09-12T17:27:58.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.385+0000 7fc7ff328640 1 -- 172.21.15.170:0/696433766 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7f0053880 con 0x559725dec440 2024-09-12T17:27:58.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.385+0000 7fc802840800 1 -- 172.21.15.170:0/696433766 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559725dec440 msgr2=0x559725dec840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.385+0000 7fc802840800 1 --2- 172.21.15.170:0/696433766 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559725dec440 0x559725dec840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc7f000a470 tx=0x7fc7f0045a20 comp rx=0 tx=0).stop 2024-09-12T17:27:58.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.385+0000 7fc802840800 1 -- 172.21.15.170:0/696433766 shutdown_connections 2024-09-12T17:27:58.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.385+0000 7fc802840800 1 --2- 172.21.15.170:0/696433766 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559725dec440 0x559725dec840 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.385+0000 7fc802840800 1 -- 172.21.15.170:0/696433766 >> 172.21.15.170:0/696433766 conn(0x559725de6920 msgr2=0x559725de8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:58.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.385+0000 7fc802840800 1 -- 172.21.15.170:0/696433766 shutdown_connections 2024-09-12T17:27:58.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.385+0000 7fc802840800 1 -- 172.21.15.170:0/696433766 wait complete. 2024-09-12T17:27:58.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.399+0000 7fc802840800 1 Processor -- start 2024-09-12T17:27:58.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.399+0000 7fc802840800 1 -- start start 2024-09-12T17:27:58.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.399+0000 7fc802840800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559725dec440 0x559725deb620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.399+0000 7fc802840800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559725c85dd0 con 0x559725dec440 2024-09-12T17:27:58.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.400+0000 7fc80032a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559725dec440 0x559725deb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.400+0000 7fc80032a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559725dec440 0x559725deb620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56174/0 (socket says 172.21.15.170:56174) 2024-09-12T17:27:58.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.400+0000 7fc80032a640 1 -- 172.21.15.170:0/1653203953 learned_addr learned my addr 172.21.15.170:0/1653203953 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:58.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.400+0000 7fc80032a640 1 -- 172.21.15.170:0/1653203953 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559725c9ee10 con 0x559725dec440 2024-09-12T17:27:58.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.400+0000 7fc80032a640 1 --2- 172.21.15.170:0/1653203953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559725dec440 0x559725deb620 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc7f000a470 tx=0x7fc7f0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11c8b05d5643276c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.400+0000 7fc6ee60c640 1 -- 172.21.15.170:0/1653203953 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7f0053570 con 0x559725dec440 2024-09-12T17:27:58.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.400+0000 7fc6ee60c640 1 -- 172.21.15.170:0/1653203953 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7f0063030 con 0x559725dec440 2024-09-12T17:27:58.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.400+0000 7fc6ee60c640 1 -- 172.21.15.170:0/1653203953 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7f0053840 con 0x559725dec440 2024-09-12T17:27:58.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.401+0000 7fc802840800 1 -- 172.21.15.170:0/1653203953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559725dec440 msgr2=0x559725deb620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.401+0000 7fc802840800 1 --2- 172.21.15.170:0/1653203953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559725dec440 0x559725deb620 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc7f000a470 tx=0x7fc7f0051000 comp rx=0 tx=0).stop 2024-09-12T17:27:58.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.401+0000 7fc802840800 1 -- 172.21.15.170:0/1653203953 shutdown_connections 2024-09-12T17:27:58.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.401+0000 7fc802840800 1 --2- 172.21.15.170:0/1653203953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559725dec440 0x559725deb620 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.401+0000 7fc802840800 1 -- 172.21.15.170:0/1653203953 >> 172.21.15.170:0/1653203953 conn(0x559725de6920 msgr2=0x559725ed6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:58.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.401+0000 7fc802840800 1 -- 172.21.15.170:0/1653203953 shutdown_connections 2024-09-12T17:27:58.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.401+0000 7fc802840800 1 -- 172.21.15.170:0/1653203953 wait complete. 2024-09-12T17:27:58.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.402+0000 7fc802840800 1 Processor -- start 2024-09-12T17:27:58.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.402+0000 7fc802840800 1 -- start start 2024-09-12T17:27:58.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.402+0000 7fc802840800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559725dec440 0x559725edc740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.402+0000 7fc802840800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559725df2f50 con 0x559725dec440 2024-09-12T17:27:58.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.402+0000 7fc80032a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559725dec440 0x559725edc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.402+0000 7fc80032a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559725dec440 0x559725edc740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56190/0 (socket says 172.21.15.170:56190) 2024-09-12T17:27:58.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.402+0000 7fc80032a640 1 -- 172.21.15.170:0/486593470 learned_addr learned my addr 172.21.15.170:0/486593470 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:58.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.402+0000 7fc80032a640 1 -- 172.21.15.170:0/486593470 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559725edcca0 con 0x559725dec440 2024-09-12T17:27:58.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.402+0000 7fc80032a640 1 --2- 172.21.15.170:0/486593470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559725dec440 0x559725edc740 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc7f000a470 tx=0x7fc7f0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.403+0000 7fc6ece09640 1 -- 172.21.15.170:0/486593470 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7f0078070 con 0x559725dec440 2024-09-12T17:27:58.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.403+0000 7fc6ece09640 1 -- 172.21.15.170:0/486593470 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7f0068420 con 0x559725dec440 2024-09-12T17:27:58.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.403+0000 7fc6ece09640 1 -- 172.21.15.170:0/486593470 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7f0068700 con 0x559725dec440 2024-09-12T17:27:58.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.403+0000 7fc802840800 1 -- 172.21.15.170:0/486593470 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559725edb050 con 0x559725dec440 2024-09-12T17:27:58.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.403+0000 7fc802840800 1 -- 172.21.15.170:0/486593470 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559725edb670 con 0x559725dec440 2024-09-12T17:27:58.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.404+0000 7fc6ece09640 1 -- 172.21.15.170:0/486593470 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc7f007b070 con 0x559725dec440 2024-09-12T17:27:58.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.404+0000 7fc6ece09640 1 --2- 172.21.15.170:0/486593470 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc6e803c730 0x7fc6e803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.404+0000 7fc6ece09640 1 -- 172.21.15.170:0/486593470 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fc7f00977b0 con 0x559725dec440 2024-09-12T17:27:58.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.404+0000 7fc7ffb29640 1 --2- 172.21.15.170:0/486593470 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc6e803c730 0x7fc6e803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.404+0000 7fc802840800 1 --2- 172.21.15.170:0/486593470 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x559725deef30 0x559725eed240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.404+0000 7fc802840800 1 -- 172.21.15.170:0/486593470 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559725eed7c0 con 0x559725deef30 2024-09-12T17:27:58.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.404+0000 7fc800b2b640 1 --2- 172.21.15.170:0/486593470 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x559725deef30 0x559725eed240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.404+0000 7fc7ffb29640 1 --2- 172.21.15.170:0/486593470 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc6e803c730 0x7fc6e803ebf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4000c00 tx=0x7fc7f40013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.404+0000 7fc800b2b640 1 --2- 172.21.15.170:0/486593470 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x559725deef30 0x559725eed240 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.405+0000 7fc800b2b640 1 -- 172.21.15.170:0/486593470 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7f800a4d0 con 0x559725deef30 2024-09-12T17:27:58.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.405+0000 7fc802840800 1 -- 172.21.15.170:0/486593470 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559725edbb50 con 0x559725deef30 2024-09-12T17:27:58.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.405+0000 7fc800b2b640 1 -- 172.21.15.170:0/486593470 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc7f800a4d0 con 0x559725deef30 2024-09-12T17:27:58.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.405+0000 7fc802840800 1 --2- 172.21.15.170:0/486593470 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x559725eefab0 0x559725ef1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.405+0000 7fc802840800 1 -- 172.21.15.170:0/486593470 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559725ef2570 con 0x559725eefab0 2024-09-12T17:27:58.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.405+0000 7fc80032a640 1 --2- 172.21.15.170:0/486593470 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x559725eefab0 0x559725ef1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.405+0000 7fc80032a640 1 --2- 172.21.15.170:0/486593470 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x559725eefab0 0x559725ef1ea0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.406+0000 7fc80032a640 1 -- 172.21.15.170:0/486593470 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc7f007a030 con 0x559725eefab0 2024-09-12T17:27:58.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.406+0000 7fc802840800 1 -- 172.21.15.170:0/486593470 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559725eee890 con 0x559725deef30 2024-09-12T17:27:58.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.406+0000 7fc800b2b640 1 -- 172.21.15.170:0/486593470 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc7f800a4d0 con 0x559725deef30 2024-09-12T17:27:58.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.406+0000 7fc802840800 1 -- 172.21.15.170:0/486593470 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559725eeed30 con 0x559725eefab0 2024-09-12T17:27:58.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.406+0000 7fc80032a640 1 -- 172.21.15.170:0/486593470 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc7f007a030 con 0x559725eefab0 2024-09-12T17:27:58.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.407+0000 7fc802840800 1 Processor -- start 2024-09-12T17:27:58.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.407+0000 7fc802840800 1 -- start start 2024-09-12T17:27:58.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.407+0000 7fc802840800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559725f00d60 0x559725f01180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.407+0000 7fc802840800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559725ce3a00 con 0x559725f00d60 2024-09-12T17:27:58.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.407+0000 7fc800b2b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559725f00d60 0x559725f01180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.407+0000 7fc800b2b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559725f00d60 0x559725f01180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56200/0 (socket says 172.21.15.170:56200) 2024-09-12T17:27:58.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.407+0000 7fc800b2b640 1 -- 172.21.15.170:0/212331858 learned_addr learned my addr 172.21.15.170:0/212331858 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:58.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.408+0000 7fc800b2b640 1 -- 172.21.15.170:0/212331858 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559725f017c0 con 0x559725f00d60 2024-09-12T17:27:58.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.408+0000 7fc800b2b640 1 --2- 172.21.15.170:0/212331858 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559725f00d60 0x559725f01180 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x559725edc2e0 tx=0x7fc7f80167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.408+0000 7fc6e5ffb640 1 -- 172.21.15.170:0/212331858 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7f8013640 con 0x559725f00d60 2024-09-12T17:27:58.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.408+0000 7fc6e5ffb640 1 -- 172.21.15.170:0/212331858 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7f80137e0 con 0x559725f00d60 2024-09-12T17:27:58.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.408+0000 7fc6e5ffb640 1 -- 172.21.15.170:0/212331858 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7f8013ae0 con 0x559725f00d60 2024-09-12T17:27:58.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.408+0000 7fc802840800 1 -- 172.21.15.170:0/212331858 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559725f01ff0 con 0x559725f00d60 2024-09-12T17:27:58.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.408+0000 7fc802840800 1 -- 172.21.15.170:0/212331858 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559725f02590 con 0x559725f00d60 2024-09-12T17:27:58.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.409+0000 7fc6e5ffb640 1 -- 172.21.15.170:0/212331858 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc7f8011040 con 0x559725f00d60 2024-09-12T17:27:58.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.409+0000 7fc6e5ffb640 1 --2- 172.21.15.170:0/212331858 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc6d803c730 0x7fc6d803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.409+0000 7fc6e5ffb640 1 -- 172.21.15.170:0/212331858 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fc7f800e040 con 0x559725f00d60 2024-09-12T17:27:58.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.409+0000 7fc80032a640 1 --2- 172.21.15.170:0/212331858 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc6d803c730 0x7fc6d803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.409+0000 7fc802840800 1 Processor -- start 2024-09-12T17:27:58.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.410+0000 7fc80032a640 1 --2- 172.21.15.170:0/212331858 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc6d803c730 0x7fc6d803ebf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x559725eedc50 tx=0x7fc7f0052650 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.410+0000 7fc802840800 1 -- start start 2024-09-12T17:27:58.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.410+0000 7fc802840800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559725f0d8a0 0x559725f0dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.410+0000 7fc802840800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559725edf0e0 con 0x559725f0d8a0 2024-09-12T17:27:58.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.410+0000 7fc800b2b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559725f0d8a0 0x559725f0dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.410+0000 7fc800b2b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559725f0d8a0 0x559725f0dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56202/0 (socket says 172.21.15.170:56202) 2024-09-12T17:27:58.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.410+0000 7fc800b2b640 1 -- 172.21.15.170:0/425917810 learned_addr learned my addr 172.21.15.170:0/425917810 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:58.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.410+0000 7fc800b2b640 1 -- 172.21.15.170:0/425917810 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559725f0e270 con 0x559725f0d8a0 2024-09-12T17:27:58.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.410+0000 7fc800b2b640 1 --2- 172.21.15.170:0/425917810 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559725f0d8a0 0x559725f0dc80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8005a30 tx=0x7fc7f801fee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0fa72fe313fe9bc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.411+0000 7fc6d77fe640 1 -- 172.21.15.170:0/425917810 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7f804a070 con 0x559725f0d8a0 2024-09-12T17:27:58.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.411+0000 7fc6d77fe640 1 -- 172.21.15.170:0/425917810 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7f8055040 con 0x559725f0d8a0 2024-09-12T17:27:58.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.411+0000 7fc6d77fe640 1 -- 172.21.15.170:0/425917810 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7f801f340 con 0x559725f0d8a0 2024-09-12T17:27:58.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.411+0000 7fc802840800 1 -- 172.21.15.170:0/425917810 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559725f0d8a0 msgr2=0x559725f0dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.411+0000 7fc802840800 1 --2- 172.21.15.170:0/425917810 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559725f0d8a0 0x559725f0dc80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8005a30 tx=0x7fc7f801fee0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.411+0000 7fc802840800 1 -- 172.21.15.170:0/425917810 shutdown_connections 2024-09-12T17:27:58.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.411+0000 7fc802840800 1 --2- 172.21.15.170:0/425917810 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559725f0d8a0 0x559725f0dc80 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.411+0000 7fc802840800 1 -- 172.21.15.170:0/425917810 >> 172.21.15.170:0/425917810 conn(0x559725f09ca0 msgr2=0x559725f07ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:58.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.411+0000 7fc802840800 1 -- 172.21.15.170:0/425917810 shutdown_connections 2024-09-12T17:27:58.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.411+0000 7fc802840800 1 -- 172.21.15.170:0/425917810 wait complete. 2024-09-12T17:27:58.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.411+0000 7fc802840800 1 Processor -- start 2024-09-12T17:27:58.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.411+0000 7fc802840800 1 -- start start 2024-09-12T17:27:58.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.412+0000 7fc802840800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559725f0d8a0 0x559725f14e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.412+0000 7fc802840800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559725f0e8b0 con 0x559725f0d8a0 2024-09-12T17:27:58.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.412+0000 7fc800b2b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559725f0d8a0 0x559725f14e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.412+0000 7fc800b2b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559725f0d8a0 0x559725f14e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56210/0 (socket says 172.21.15.170:56210) 2024-09-12T17:27:58.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.412+0000 7fc800b2b640 1 -- 172.21.15.170:0/1641570204 learned_addr learned my addr 172.21.15.170:0/1641570204 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:58.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.412+0000 7fc800b2b640 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559725f153b0 con 0x559725f0d8a0 2024-09-12T17:27:58.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.412+0000 7fc800b2b640 1 --2- 172.21.15.170:0/1641570204 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559725f0d8a0 0x559725f14e50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8054110 tx=0x7fc7f8053d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.412+0000 7fc6d5ffb640 1 -- 172.21.15.170:0/1641570204 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7f804a040 con 0x559725f0d8a0 2024-09-12T17:27:58.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.412+0000 7fc6d5ffb640 1 -- 172.21.15.170:0/1641570204 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7f8013c80 con 0x559725f0d8a0 2024-09-12T17:27:58.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.412+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559725f15640 con 0x559725f0d8a0 2024-09-12T17:27:58.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.413+0000 7fc6d5ffb640 1 -- 172.21.15.170:0/1641570204 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7f8021440 con 0x559725f0d8a0 2024-09-12T17:27:58.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.413+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559725f15fc0 con 0x559725f0d8a0 2024-09-12T17:27:58.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.413+0000 7fc6d5ffb640 1 -- 172.21.15.170:0/1641570204 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc7f8039060 con 0x559725f0d8a0 2024-09-12T17:27:58.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.414+0000 7fc6d5ffb640 1 --2- 172.21.15.170:0/1641570204 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc6c803c6c0 0x7fc6c803eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.414+0000 7fc6d5ffb640 1 -- 172.21.15.170:0/1641570204 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fc7f802f070 con 0x559725f0d8a0 2024-09-12T17:27:58.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.414+0000 7fc80032a640 1 --2- 172.21.15.170:0/1641570204 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc6c803c6c0 0x7fc6c803eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.414+0000 7fc80032a640 1 --2- 172.21.15.170:0/1641570204 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc6c803c6c0 0x7fc6c803eb80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc7f00539f0 tx=0x7fc7f0092000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.414+0000 7fc802840800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.414+0000 7fc802840800 1 --2- 172.21.15.170:0/1641570204 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x559725f20830 0x559725f22cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.414+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559725f23440 con 0x559725f20830 2024-09-12T17:27:58.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.414+0000 7fc7ffb29640 1 --2- 172.21.15.170:0/1641570204 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x559725f20830 0x559725f22cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.415+0000 7fc7ffb29640 1 --2- 172.21.15.170:0/1641570204 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x559725f20830 0x559725f22cf0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.415+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7f400f5f0 con 0x559725f20830 2024-09-12T17:27:58.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.415+0000 7fc802840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:58.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.415+0000 7fc802840800 20 realm 2024-09-12T17:27:58.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.415+0000 7fc802840800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.415+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559725f1fb80 con 0x559725f20830 2024-09-12T17:27:58.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.415+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7f400f5f0 con 0x559725f20830 2024-09-12T17:27:58.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.415+0000 7fc802840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:58.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.415+0000 7fc802840800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:58.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.415+0000 7fc802840800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.415+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559725f23f30 con 0x559725f20830 2024-09-12T17:27:58.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.415+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7f400f5f0 con 0x559725f20830 2024-09-12T17:27:58.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.415+0000 7fc802840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:58.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.415+0000 7fc802840800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.415+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559725f24800 con 0x559725f20830 2024-09-12T17:27:58.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.416+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc7f400f5f0 con 0x559725f20830 2024-09-12T17:27:58.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.416+0000 7fc802840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:58.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.416+0000 7fc802840800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.416+0000 7fc802840800 1 --2- 172.21.15.170:0/1641570204 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x559725f25220 0x559725f27610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.416+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559725f27d80 con 0x559725f25220 2024-09-12T17:27:58.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.416+0000 7fc800b2b640 1 --2- 172.21.15.170:0/1641570204 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x559725f25220 0x559725f27610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.416+0000 7fc800b2b640 1 --2- 172.21.15.170:0/1641570204 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x559725f25220 0x559725f27610 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.416+0000 7fc800b2b640 1 -- 172.21.15.170:0/1641570204 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc7f800a4d0 con 0x559725f25220 2024-09-12T17:27:58.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.416+0000 7fc802840800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:27:58.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.416+0000 7fc802840800 20 searching for the correct realm 2024-09-12T17:27:58.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.416+0000 7fc802840800 1 --2- 172.21.15.170:0/1641570204 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x559725f29d30 0x559725f2c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.416+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559725f2c8c0 con 0x559725f29d30 2024-09-12T17:27:58.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.416+0000 7fc80032a640 1 --2- 172.21.15.170:0/1641570204 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x559725f29d30 0x559725f2c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.417+0000 7fc80032a640 1 --2- 172.21.15.170:0/1641570204 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x559725f29d30 0x559725f2c1f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.417+0000 7fc80032a640 1 -- 172.21.15.170:0/1641570204 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f008a050 con 0x559725f29d30 2024-09-12T17:27:58.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.417+0000 7fc80032a640 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559725f2c8c0 con 0x559725f25220 2024-09-12T17:27:58.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.417+0000 7fc800b2b640 1 -- 172.21.15.170:0/1641570204 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f800a4d0 con 0x559725f25220 2024-09-12T17:27:58.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.417+0000 7fc800b2b640 1 --2- 172.21.15.170:0/1641570204 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fc7f803b070 0x7fc7f800d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.417+0000 7fc800b2b640 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559725f2c8c0 con 0x7fc7f803b070 2024-09-12T17:27:58.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.418+0000 7fc7ffb29640 1 --2- 172.21.15.170:0/1641570204 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fc7f803b070 0x7fc7f800d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.418+0000 7fc7ffb29640 1 --2- 172.21.15.170:0/1641570204 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fc7f803b070 0x7fc7f800d850 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.418+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f400f5f0 con 0x7fc7f803b070 2024-09-12T17:27:58.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.418+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559725f2c8c0 con 0x559725f20830 2024-09-12T17:27:58.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.419+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f400f5f0 con 0x559725f20830 2024-09-12T17:27:58.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.419+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559725f2c8c0 con 0x559725f20830 2024-09-12T17:27:58.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.419+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f400f5f0 con 0x559725f20830 2024-09-12T17:27:58.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.419+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559725f2c8c0 con 0x7fc7f803b070 2024-09-12T17:27:58.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.419+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f400f5f0 con 0x7fc7f803b070 2024-09-12T17:27:58.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.419+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559725f2c8c0 con 0x7fc7f803b070 2024-09-12T17:27:58.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.419+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f400f5f0 con 0x7fc7f803b070 2024-09-12T17:27:58.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.419+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559725f2c8c0 con 0x559725f25220 2024-09-12T17:27:58.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.420+0000 7fc800b2b640 1 -- 172.21.15.170:0/1641570204 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f800a4d0 con 0x559725f25220 2024-09-12T17:27:58.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.420+0000 7fc800b2b640 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559725f2c8c0 con 0x559725f29d30 2024-09-12T17:27:58.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.420+0000 7fc80032a640 1 -- 172.21.15.170:0/1641570204 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f008a050 con 0x559725f29d30 2024-09-12T17:27:58.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.420+0000 7fc80032a640 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559725f2c8c0 con 0x559725f20830 2024-09-12T17:27:58.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.420+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f400f5f0 con 0x559725f20830 2024-09-12T17:27:58.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.420+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559725f2c8c0 con 0x7fc7f803b070 2024-09-12T17:27:58.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.420+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f400f5f0 con 0x7fc7f803b070 2024-09-12T17:27:58.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.420+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559725f2c8c0 con 0x559725f20830 2024-09-12T17:27:58.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.421+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f400f5f0 con 0x559725f20830 2024-09-12T17:27:58.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.421+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559725f2c8c0 con 0x559725f25220 2024-09-12T17:27:58.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.421+0000 7fc800b2b640 1 -- 172.21.15.170:0/1641570204 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fc7f800a4d0 con 0x559725f25220 2024-09-12T17:27:58.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.421+0000 7fc800b2b640 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559725f2c8c0 con 0x559725f29d30 2024-09-12T17:27:58.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.421+0000 7fc80032a640 1 -- 172.21.15.170:0/1641570204 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f008a050 con 0x559725f29d30 2024-09-12T17:27:58.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.421+0000 7fc80032a640 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559725f2c8c0 con 0x559725f29d30 2024-09-12T17:27:58.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.421+0000 7fc80032a640 1 -- 172.21.15.170:0/1641570204 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f008a050 con 0x559725f29d30 2024-09-12T17:27:58.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.421+0000 7fc80032a640 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559725f2c8c0 con 0x7fc7f803b070 2024-09-12T17:27:58.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.422+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f400f5f0 con 0x7fc7f803b070 2024-09-12T17:27:58.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.422+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559725f2c8c0 con 0x559725f29d30 2024-09-12T17:27:58.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.422+0000 7fc80032a640 1 -- 172.21.15.170:0/1641570204 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f008a050 con 0x559725f29d30 2024-09-12T17:27:58.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.422+0000 7fc80032a640 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559725f2c8c0 con 0x559725f29d30 2024-09-12T17:27:58.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.422+0000 7fc80032a640 1 -- 172.21.15.170:0/1641570204 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f008a050 con 0x559725f29d30 2024-09-12T17:27:58.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.422+0000 7fc80032a640 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559725f2c8c0 con 0x559725f20830 2024-09-12T17:27:58.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.422+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f400f5f0 con 0x559725f20830 2024-09-12T17:27:58.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.422+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559725f2c8c0 con 0x559725f20830 2024-09-12T17:27:58.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.423+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc7f400f5f0 con 0x559725f20830 2024-09-12T17:27:58.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.423+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559725f2c8c0 con 0x7fc7f803b070 2024-09-12T17:27:58.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.423+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f400f5f0 con 0x7fc7f803b070 2024-09-12T17:27:58.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.423+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559725f2c8c0 con 0x559725f29d30 2024-09-12T17:27:58.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.423+0000 7fc80032a640 1 -- 172.21.15.170:0/1641570204 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f008a050 con 0x559725f29d30 2024-09-12T17:27:58.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.423+0000 7fc80032a640 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559725f2c8c0 con 0x559725f25220 2024-09-12T17:27:58.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.423+0000 7fc800b2b640 1 -- 172.21.15.170:0/1641570204 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f800a4d0 con 0x559725f25220 2024-09-12T17:27:58.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.423+0000 7fc800b2b640 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559725f2c8c0 con 0x559725f20830 2024-09-12T17:27:58.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.424+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f400f5f0 con 0x559725f20830 2024-09-12T17:27:58.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.424+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559725f2c8c0 con 0x7fc7f803b070 2024-09-12T17:27:58.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.424+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f400f5f0 con 0x7fc7f803b070 2024-09-12T17:27:58.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.424+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559725f2c8c0 con 0x559725f29d30 2024-09-12T17:27:58.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.424+0000 7fc80032a640 1 -- 172.21.15.170:0/1641570204 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f008a050 con 0x559725f29d30 2024-09-12T17:27:58.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.424+0000 7fc80032a640 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559725f2c8c0 con 0x7fc7f803b070 2024-09-12T17:27:58.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.424+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f400f5f0 con 0x7fc7f803b070 2024-09-12T17:27:58.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.424+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559725f2c8c0 con 0x559725f25220 2024-09-12T17:27:58.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.425+0000 7fc800b2b640 1 -- 172.21.15.170:0/1641570204 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f800a4d0 con 0x559725f25220 2024-09-12T17:27:58.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.425+0000 7fc800b2b640 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559725f2c8c0 con 0x559725f29d30 2024-09-12T17:27:58.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.425+0000 7fc80032a640 1 -- 172.21.15.170:0/1641570204 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f008a050 con 0x559725f29d30 2024-09-12T17:27:58.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.425+0000 7fc80032a640 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559725f2c8c0 con 0x7fc7f803b070 2024-09-12T17:27:58.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.425+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f400f5f0 con 0x7fc7f803b070 2024-09-12T17:27:58.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.425+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559725f2c8c0 con 0x559725f20830 2024-09-12T17:27:58.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.425+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc7f400f5f0 con 0x559725f20830 2024-09-12T17:27:58.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.426+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559725f2c8c0 con 0x559725f25220 2024-09-12T17:27:58.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.426+0000 7fc800b2b640 1 -- 172.21.15.170:0/1641570204 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v22'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc7f8066040 con 0x559725f25220 2024-09-12T17:27:58.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.426+0000 7fc802840800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:27:58.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.426+0000 7fc802840800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:58.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.426+0000 7fc802840800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:58.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.426+0000 7fc802840800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:58.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.426+0000 7fc802840800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:58.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.426+0000 7fc802840800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:27:58.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.426+0000 7fc802840800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.426+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559725f28770 con 0x559725f20830 2024-09-12T17:27:58.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.426+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7f400f5f0 con 0x559725f20830 2024-09-12T17:27:58.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.426+0000 7fc802840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:58.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.426+0000 7fc802840800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.426+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559725f29010 con 0x559725f20830 2024-09-12T17:27:58.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.426+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc7f400f5f0 con 0x559725f20830 2024-09-12T17:27:58.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.426+0000 7fc802840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:58.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.426+0000 7fc802840800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.426+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559725f283b0 con 0x559725f25220 2024-09-12T17:27:58.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.427+0000 7fc800b2b640 1 -- 172.21.15.170:0/1641570204 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc7f8066040 con 0x559725f25220 2024-09-12T17:27:58.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.427+0000 7fc802840800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:27:58.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.427+0000 7fc802840800 20 zone default found 2024-09-12T17:27:58.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.427+0000 7fc802840800 4 Realm: () 2024-09-12T17:27:58.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.427+0000 7fc802840800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:27:58.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.427+0000 7fc802840800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:27:58.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.427+0000 7fc802840800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:58.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.427+0000 7fc802840800 20 zonegroup default 2024-09-12T17:27:58.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.427+0000 7fc802840800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.427+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559725f2d1f0 con 0x7fc7f803b070 2024-09-12T17:27:58.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.427+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc7f400f5f0 con 0x7fc7f803b070 2024-09-12T17:27:58.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.427+0000 7fc802840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:58.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.427+0000 7fc802840800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.427+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559725f2f430 con 0x559725f29d30 2024-09-12T17:27:58.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.427+0000 7fc80032a640 1 -- 172.21.15.170:0/1641570204 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc7f008a050 con 0x559725f29d30 2024-09-12T17:27:58.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.427+0000 7fc802840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:58.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.427+0000 7fc802840800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.427+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559725f2f7d0 con 0x559725f29d30 2024-09-12T17:27:58.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.428+0000 7fc80032a640 1 -- 172.21.15.170:0/1641570204 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc7f008a050 con 0x559725f29d30 2024-09-12T17:27:58.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.428+0000 7fc802840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:58.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.428+0000 7fc802840800 20 started sync module instance, tier type = 2024-09-12T17:27:58.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.428+0000 7fc802840800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:27:58.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.428+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f2e8c0 con 0x559725f25220 2024-09-12T17:27:58.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.429+0000 7fc800b2b640 1 -- 172.21.15.170:0/1641570204 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7f8066040 con 0x559725f25220 2024-09-12T17:27:58.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.429+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94107665100272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f2e8c0 con 0x559725f25220 2024-09-12T17:27:58.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.429+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f301f0 con 0x559725f20830 2024-09-12T17:27:58.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.430+0000 7fc800b2b640 1 -- 172.21.15.170:0/1641570204 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94107665100272] v29'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7f8066040 con 0x559725f25220 2024-09-12T17:27:58.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.430+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7f400f5f0 con 0x559725f20830 2024-09-12T17:27:58.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.430+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94107665104096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f2e8c0 con 0x559725f20830 2024-09-12T17:27:58.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.430+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f30c80 con 0x559725f29d30 2024-09-12T17:27:58.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.431+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94107665104096] v29'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7f400f5f0 con 0x559725f20830 2024-09-12T17:27:58.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.432+0000 7fc80032a640 1 -- 172.21.15.170:0/1641570204 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7f008a050 con 0x559725f29d30 2024-09-12T17:27:58.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.432+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94107665097744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f2e830 con 0x559725f29d30 2024-09-12T17:27:58.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.432+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f31b40 con 0x559725f25220 2024-09-12T17:27:58.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.433+0000 7fc80032a640 1 -- 172.21.15.170:0/1641570204 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94107665097744] v29'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7f008a050 con 0x559725f29d30 2024-09-12T17:27:58.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.433+0000 7fc800b2b640 1 -- 172.21.15.170:0/1641570204 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7f8066040 con 0x559725f25220 2024-09-12T17:27:58.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.433+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94107665110672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f31f60 con 0x559725f25220 2024-09-12T17:27:58.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.433+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f32920 con 0x559725f20830 2024-09-12T17:27:58.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.434+0000 7fc800b2b640 1 -- 172.21.15.170:0/1641570204 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94107665110672] v29'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7f8066040 con 0x559725f25220 2024-09-12T17:27:58.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.434+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7f400f5f0 con 0x559725f20830 2024-09-12T17:27:58.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.434+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94107665114704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f31f60 con 0x559725f20830 2024-09-12T17:27:58.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.434+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f33370 con 0x7fc7f803b070 2024-09-12T17:27:58.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.435+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7f400f5f0 con 0x7fc7f803b070 2024-09-12T17:27:58.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.435+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94107665116800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f332a0 con 0x7fc7f803b070 2024-09-12T17:27:58.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.435+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f340c0 con 0x7fc7f803b070 2024-09-12T17:27:58.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.435+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94107665114704] v29'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7f400f5f0 con 0x559725f20830 2024-09-12T17:27:58.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.436+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94107665116800] v29'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7f400f5f0 con 0x7fc7f803b070 2024-09-12T17:27:58.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.436+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(56 notify.6 [create] v29'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7f400f5f0 con 0x7fc7f803b070 2024-09-12T17:27:58.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.436+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94107665118992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f31bc0 con 0x7fc7f803b070 2024-09-12T17:27:58.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.437+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f346c0 con 0x7fc7f803b070 2024-09-12T17:27:58.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.438+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94107665118992] v29'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7f400f5f0 con 0x7fc7f803b070 2024-09-12T17:27:58.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.438+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(58 notify.7 [create] v29'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7f400f5f0 con 0x7fc7f803b070 2024-09-12T17:27:58.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.438+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94107665121744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f346c0 con 0x7fc7f803b070 2024-09-12T17:27:58.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.438+0000 7fc802840800 20 add_watcher() i=0 2024-09-12T17:27:58.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.438+0000 7fc802840800 20 add_watcher() i=1 2024-09-12T17:27:58.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.438+0000 7fc802840800 20 add_watcher() i=2 2024-09-12T17:27:58.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.438+0000 7fc802840800 20 add_watcher() i=3 2024-09-12T17:27:58.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.438+0000 7fc802840800 20 add_watcher() i=4 2024-09-12T17:27:58.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.438+0000 7fc802840800 20 add_watcher() i=5 2024-09-12T17:27:58.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.438+0000 7fc802840800 20 add_watcher() i=6 2024-09-12T17:27:58.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.439+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94107665121744] v29'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7f400f5f0 con 0x7fc7f803b070 2024-09-12T17:27:58.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.439+0000 7fc802840800 20 add_watcher() i=7 2024-09-12T17:27:58.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.439+0000 7fc802840800 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:58.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.439+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559725f37b20 con 0x559725f20830 2024-09-12T17:27:58.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.439+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc7f400f5f0 con 0x559725f20830 2024-09-12T17:27:58.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.439+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94107665120048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f35010 con 0x559725f20830 2024-09-12T17:27:58.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.440+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94107665120048] v29'31 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc7f400f5f0 con 0x559725f20830 2024-09-12T17:27:58.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.440+0000 7fc6b67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:58.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.440+0000 7fc802840800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:58.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.440+0000 7fc802840800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:58.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.440+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f40360 con 0x559725f20830 2024-09-12T17:27:58.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.441+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc7f400f5f0 con 0x559725f20830 2024-09-12T17:27:58.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.441+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f40970 con 0x7fc7f803b070 2024-09-12T17:27:58.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.443+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'11 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc7f400f5f0 con 0x7fc7f803b070 2024-09-12T17:27:58.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.443+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f40ee0 con 0x559725f29d30 2024-09-12T17:27:58.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.444+0000 7fc80032a640 1 -- 172.21.15.170:0/1641570204 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc7f008a050 con 0x559725f29d30 2024-09-12T17:27:58.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.444+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f41390 con 0x559725f20830 2024-09-12T17:27:58.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.445+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'32 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc7f400f5f0 con 0x559725f20830 2024-09-12T17:27:58.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.445+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f41900 con 0x559725f25220 2024-09-12T17:27:58.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.445+0000 7fc800b2b640 1 -- 172.21.15.170:0/1641570204 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'23 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc7f8066040 con 0x559725f25220 2024-09-12T17:27:58.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.446+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f41900 con 0x559725f29d30 2024-09-12T17:27:58.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.447+0000 7fc80032a640 1 -- 172.21.15.170:0/1641570204 <== osd.3 v2:172.21.15.170:6816/2664906588 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'15 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc7f008a050 con 0x559725f29d30 2024-09-12T17:27:58.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.447+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f412b0 con 0x559725f20830 2024-09-12T17:27:58.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.448+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc7f400f5f0 con 0x559725f20830 2024-09-12T17:27:58.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.448+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f3e2d0 con 0x7fc7f803b070 2024-09-12T17:27:58.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.449+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'15 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc7f400f5f0 con 0x7fc7f803b070 2024-09-12T17:27:58.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.449+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f3e400 con 0x559725f25220 2024-09-12T17:27:58.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.450+0000 7fc800b2b640 1 -- 172.21.15.170:0/1641570204 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc7f8066040 con 0x559725f25220 2024-09-12T17:27:58.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.450+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f41ef0 con 0x559725f29d30 2024-09-12T17:27:58.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.451+0000 7fc80032a640 1 -- 172.21.15.170:0/1641570204 <== osd.3 v2:172.21.15.170:6816/2664906588 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'17 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc7f008a050 con 0x559725f29d30 2024-09-12T17:27:58.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.451+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f41ef0 con 0x559725f25220 2024-09-12T17:27:58.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.452+0000 7fc800b2b640 1 -- 172.21.15.170:0/1641570204 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'24 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7f8066040 con 0x559725f25220 2024-09-12T17:27:58.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.452+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f41ef0 con 0x7fc7f803b070 2024-09-12T17:27:58.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.453+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7f400f5f0 con 0x7fc7f803b070 2024-09-12T17:27:58.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.453+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f41ef0 con 0x559725f25220 2024-09-12T17:27:58.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.454+0000 7fc800b2b640 1 -- 172.21.15.170:0/1641570204 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7f8066040 con 0x559725f25220 2024-09-12T17:27:58.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.454+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f41ef0 con 0x7fc7f803b070 2024-09-12T17:27:58.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.456+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'21 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7f400f5f0 con 0x7fc7f803b070 2024-09-12T17:27:58.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.456+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f41ef0 con 0x559725f20830 2024-09-12T17:27:58.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.457+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'33 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7f400f5f0 con 0x559725f20830 2024-09-12T17:27:58.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.457+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f41ef0 con 0x559725f29d30 2024-09-12T17:27:58.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.458+0000 7fc80032a640 1 -- 172.21.15.170:0/1641570204 <== osd.3 v2:172.21.15.170:6816/2664906588 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7f008a050 con 0x559725f29d30 2024-09-12T17:27:58.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.458+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f41f80 con 0x559725f25220 2024-09-12T17:27:58.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.459+0000 7fc800b2b640 1 -- 172.21.15.170:0/1641570204 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7f8066040 con 0x559725f25220 2024-09-12T17:27:58.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.459+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f42430 con 0x559725f29d30 2024-09-12T17:27:58.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.460+0000 7fc80032a640 1 -- 172.21.15.170:0/1641570204 <== osd.3 v2:172.21.15.170:6816/2664906588 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7f008a050 con 0x559725f29d30 2024-09-12T17:27:58.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.460+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f42430 con 0x559725f20830 2024-09-12T17:27:58.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.461+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7f400f5f0 con 0x559725f20830 2024-09-12T17:27:58.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.461+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f42430 con 0x559725f20830 2024-09-12T17:27:58.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.462+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'34 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7f400f5f0 con 0x559725f20830 2024-09-12T17:27:58.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.462+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f42430 con 0x559725f29d30 2024-09-12T17:27:58.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.463+0000 7fc80032a640 1 -- 172.21.15.170:0/1641570204 <== osd.3 v2:172.21.15.170:6816/2664906588 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7f008a050 con 0x559725f29d30 2024-09-12T17:27:58.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.463+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f41f80 con 0x559725f25220 2024-09-12T17:27:58.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.464+0000 7fc800b2b640 1 -- 172.21.15.170:0/1641570204 <== osd.2 v2:172.21.15.170:6808/3855567754 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'21 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7f8066040 con 0x559725f25220 2024-09-12T17:27:58.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.464+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f41f80 con 0x559725f29d30 2024-09-12T17:27:58.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.465+0000 7fc80032a640 1 -- 172.21.15.170:0/1641570204 <== osd.3 v2:172.21.15.170:6816/2664906588 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7f008a050 con 0x559725f29d30 2024-09-12T17:27:58.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.465+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f41f80 con 0x559725f29d30 2024-09-12T17:27:58.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.466+0000 7fc80032a640 1 -- 172.21.15.170:0/1641570204 <== osd.3 v2:172.21.15.170:6816/2664906588 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7f008a050 con 0x559725f29d30 2024-09-12T17:27:58.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.466+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f42020 con 0x559725f29d30 2024-09-12T17:27:58.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.467+0000 7fc80032a640 1 -- 172.21.15.170:0/1641570204 <== osd.3 v2:172.21.15.170:6816/2664906588 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'7 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7f008a050 con 0x559725f29d30 2024-09-12T17:27:58.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.467+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f42020 con 0x559725f29d30 2024-09-12T17:27:58.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.468+0000 7fc80032a640 1 -- 172.21.15.170:0/1641570204 <== osd.3 v2:172.21.15.170:6816/2664906588 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'16 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7f008a050 con 0x559725f29d30 2024-09-12T17:27:58.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.468+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f42020 con 0x7fc7f803b070 2024-09-12T17:27:58.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.469+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7f400f5f0 con 0x7fc7f803b070 2024-09-12T17:27:58.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.469+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f421f0 con 0x559725f29d30 2024-09-12T17:27:58.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.470+0000 7fc80032a640 1 -- 172.21.15.170:0/1641570204 <== osd.3 v2:172.21.15.170:6816/2664906588 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7f008a050 con 0x559725f29d30 2024-09-12T17:27:58.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.470+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f421f0 con 0x7fc7f803b070 2024-09-12T17:27:58.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.471+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.0 v2:172.21.15.47:6800/3978157098 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'16 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7f400f5f0 con 0x7fc7f803b070 2024-09-12T17:27:58.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.471+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f421f0 con 0x559725f29d30 2024-09-12T17:27:58.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.472+0000 7fc80032a640 1 -- 172.21.15.170:0/1641570204 <== osd.3 v2:172.21.15.170:6816/2664906588 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'19 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7f008a050 con 0x559725f29d30 2024-09-12T17:27:58.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.472+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f425b0 con 0x7fc7f803b070 2024-09-12T17:27:58.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.473+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.0 v2:172.21.15.47:6800/3978157098 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'22 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7f400f5f0 con 0x7fc7f803b070 2024-09-12T17:27:58.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.473+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f424d0 con 0x559725f25220 2024-09-12T17:27:58.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.474+0000 7fc800b2b640 1 -- 172.21.15.170:0/1641570204 <== osd.2 v2:172.21.15.170:6808/3855567754 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7f8066040 con 0x559725f25220 2024-09-12T17:27:58.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.475+0000 7fc6b57e2640 20 reqs_thread_entry: start 2024-09-12T17:27:58.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.475+0000 7fc802840800 20 init_complete bucket index max shards: 11 2024-09-12T17:27:58.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.475+0000 7fc802840800 20 Filter name: none 2024-09-12T17:27:58.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.475+0000 7fc626ffd640 20 reqs_thread_entry: start 2024-09-12T17:27:58.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.475+0000 7fc802840800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-12T17:27:58.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.475+0000 7fc802840800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.475+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559725f6cce0 con 0x7fc7f803b070 2024-09-12T17:27:58.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.475+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.0 v2:172.21.15.47:6800/3978157098 24 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fc7f400f5f0 con 0x7fc7f803b070 2024-09-12T17:27:58.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.475+0000 7fc802840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:58.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.475+0000 7fc802840800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-12T17:27:58.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.475+0000 7fc802840800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-12T17:27:58.478 INFO:teuthology.orchestra.run.smithi170.stderr:could not remove user: unable to remove user, user does not exist 2024-09-12T17:27:58.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.476+0000 7fc6b67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:58.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.476+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94107665120048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f3d7c0 con 0x559725f20830 2024-09-12T17:27:58.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.477+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94107665120048] v29'35 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc7f400f5f0 con 0x559725f20830 2024-09-12T17:27:58.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.477+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94107665100272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f33b30 con 0x559725f25220 2024-09-12T17:27:58.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.478+0000 7fc800b2b640 1 -- 172.21.15.170:0/1641570204 <== osd.2 v2:172.21.15.170:6808/3855567754 20 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94107665100272] v29'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7f8066040 con 0x559725f25220 2024-09-12T17:27:58.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.478+0000 7fc802840800 20 remove_watcher() i=0 2024-09-12T17:27:58.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.478+0000 7fc802840800 2 removed watcher, disabling cache 2024-09-12T17:27:58.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.478+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94107665104096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f2edf0 con 0x559725f20830 2024-09-12T17:27:58.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.479+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94107665104096] v29'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7f400f5f0 con 0x559725f20830 2024-09-12T17:27:58.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.479+0000 7fc802840800 20 remove_watcher() i=1 2024-09-12T17:27:58.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.479+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94107665097744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f2edf0 con 0x559725f29d30 2024-09-12T17:27:58.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.480+0000 7fc80032a640 1 -- 172.21.15.170:0/1641570204 <== osd.3 v2:172.21.15.170:6816/2664906588 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94107665097744] v29'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7f008a050 con 0x559725f29d30 2024-09-12T17:27:58.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.480+0000 7fc802840800 20 remove_watcher() i=2 2024-09-12T17:27:58.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.480+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94107665110672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f2edf0 con 0x559725f25220 2024-09-12T17:27:58.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.481+0000 7fc800b2b640 1 -- 172.21.15.170:0/1641570204 <== osd.2 v2:172.21.15.170:6808/3855567754 21 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94107665110672] v29'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7f8066040 con 0x559725f25220 2024-09-12T17:27:58.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.481+0000 7fc802840800 20 remove_watcher() i=3 2024-09-12T17:27:58.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.481+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94107665114704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f31690 con 0x559725f20830 2024-09-12T17:27:58.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.482+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94107665114704] v29'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7f400f5f0 con 0x559725f20830 2024-09-12T17:27:58.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.482+0000 7fc802840800 20 remove_watcher() i=4 2024-09-12T17:27:58.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.482+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94107665116800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f2edf0 con 0x7fc7f803b070 2024-09-12T17:27:58.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.483+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.0 v2:172.21.15.47:6800/3978157098 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94107665116800] v29'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7f400f5f0 con 0x7fc7f803b070 2024-09-12T17:27:58.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.483+0000 7fc802840800 20 remove_watcher() i=5 2024-09-12T17:27:58.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.483+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94107665118992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f32650 con 0x7fc7f803b070 2024-09-12T17:27:58.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.484+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.0 v2:172.21.15.47:6800/3978157098 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94107665118992] v29'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7f400f5f0 con 0x7fc7f803b070 2024-09-12T17:27:58.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.484+0000 7fc802840800 20 remove_watcher() i=6 2024-09-12T17:27:58.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.484+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94107665121744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559725f31690 con 0x7fc7f803b070 2024-09-12T17:27:58.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.485+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 <== osd.0 v2:172.21.15.47:6800/3978157098 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94107665121744] v29'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7f400f5f0 con 0x7fc7f803b070 2024-09-12T17:27:58.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.485+0000 7fc802840800 20 remove_watcher() i=7 2024-09-12T17:27:58.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.485+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fc7f803b070 msgr2=0x7fc7f800d850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.485+0000 7fc802840800 1 --2- 172.21.15.170:0/1641570204 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fc7f803b070 0x7fc7f800d850 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.485+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x559725f20830 msgr2=0x559725f22cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.485+0000 7fc802840800 1 --2- 172.21.15.170:0/1641570204 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x559725f20830 0x559725f22cf0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.485+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x559725f25220 msgr2=0x559725f27610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.485+0000 7fc802840800 1 --2- 172.21.15.170:0/1641570204 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x559725f25220 0x559725f27610 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.485+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x559725f29d30 msgr2=0x559725f2c1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.485+0000 7fc802840800 1 --2- 172.21.15.170:0/1641570204 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x559725f29d30 0x559725f2c1f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.485+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc6c803c6c0 msgr2=0x7fc6c803eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.485+0000 7fc802840800 1 --2- 172.21.15.170:0/1641570204 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc6c803c6c0 0x7fc6c803eb80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc7f00539f0 tx=0x7fc7f0092000 comp rx=0 tx=0).stop 2024-09-12T17:27:58.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.485+0000 7fc7ffb29640 1 -- 172.21.15.170:0/1641570204 reap_dead start 2024-09-12T17:27:58.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.485+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559725f0d8a0 msgr2=0x559725f14e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.485+0000 7fc802840800 1 --2- 172.21.15.170:0/1641570204 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559725f0d8a0 0x559725f14e50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8054110 tx=0x7fc7f8053d00 comp rx=0 tx=0).stop 2024-09-12T17:27:58.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.485+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 shutdown_connections 2024-09-12T17:27:58.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.485+0000 7fc802840800 1 --2- 172.21.15.170:0/1641570204 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559725f0d8a0 0x559725f14e50 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.485+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 >> 172.21.15.170:0/1641570204 conn(0x559725f09ca0 msgr2=0x559725f07eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:58.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.485+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 shutdown_connections 2024-09-12T17:27:58.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.485+0000 7fc802840800 1 -- 172.21.15.170:0/1641570204 wait complete. 2024-09-12T17:27:58.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.486+0000 7fc802840800 1 -- 172.21.15.170:0/212331858 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc6d803c730 msgr2=0x7fc6d803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.486+0000 7fc802840800 1 --2- 172.21.15.170:0/212331858 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc6d803c730 0x7fc6d803ebf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x559725eedc50 tx=0x7fc7f0052650 comp rx=0 tx=0).stop 2024-09-12T17:27:58.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.486+0000 7fc802840800 1 -- 172.21.15.170:0/212331858 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559725f00d60 msgr2=0x559725f01180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.486+0000 7fc802840800 1 --2- 172.21.15.170:0/212331858 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559725f00d60 0x559725f01180 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x559725edc2e0 tx=0x7fc7f80167b0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.486+0000 7fc802840800 1 -- 172.21.15.170:0/212331858 shutdown_connections 2024-09-12T17:27:58.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.486+0000 7fc802840800 1 --2- 172.21.15.170:0/212331858 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc6d803c730 0x7fc6d803ebf0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.486+0000 7fc802840800 1 --2- 172.21.15.170:0/212331858 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559725f00d60 0x559725f01180 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.486+0000 7fc802840800 1 -- 172.21.15.170:0/212331858 >> 172.21.15.170:0/212331858 conn(0x559725ef5110 msgr2=0x559725ef54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:58.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.486+0000 7fc802840800 1 -- 172.21.15.170:0/212331858 shutdown_connections 2024-09-12T17:27:58.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.486+0000 7fc802840800 1 -- 172.21.15.170:0/212331858 wait complete. 2024-09-12T17:27:58.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.486+0000 7fc802840800 1 -- 172.21.15.170:0/486593470 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x559725deef30 msgr2=0x559725eed240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.486+0000 7fc802840800 1 --2- 172.21.15.170:0/486593470 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x559725deef30 0x559725eed240 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.486+0000 7fc802840800 1 -- 172.21.15.170:0/486593470 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x559725eefab0 msgr2=0x559725ef1ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.486+0000 7fc802840800 1 --2- 172.21.15.170:0/486593470 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x559725eefab0 0x559725ef1ea0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.486+0000 7fc802840800 1 -- 172.21.15.170:0/486593470 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc6e803c730 msgr2=0x7fc6e803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.486+0000 7fc802840800 1 --2- 172.21.15.170:0/486593470 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc6e803c730 0x7fc6e803ebf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4000c00 tx=0x7fc7f40013b0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.486+0000 7fc802840800 1 -- 172.21.15.170:0/486593470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559725dec440 msgr2=0x559725edc740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.486+0000 7fc802840800 1 --2- 172.21.15.170:0/486593470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559725dec440 0x559725edc740 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc7f000a470 tx=0x7fc7f0002fb0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.486+0000 7fc802840800 1 -- 172.21.15.170:0/486593470 shutdown_connections 2024-09-12T17:27:58.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.486+0000 7fc802840800 1 --2- 172.21.15.170:0/486593470 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x559725eefab0 0x559725ef1ea0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.486+0000 7fc802840800 1 --2- 172.21.15.170:0/486593470 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc6e803c730 0x7fc6e803ebf0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.486+0000 7fc802840800 1 --2- 172.21.15.170:0/486593470 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x559725deef30 0x559725eed240 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.486+0000 7fc802840800 1 --2- 172.21.15.170:0/486593470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559725dec440 0x559725edc740 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.486+0000 7fc802840800 1 -- 172.21.15.170:0/486593470 >> 172.21.15.170:0/486593470 conn(0x559725de6920 msgr2=0x559725ed54e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:58.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.486+0000 7fc802840800 1 -- 172.21.15.170:0/486593470 shutdown_connections 2024-09-12T17:27:58.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.486+0000 7fc802840800 1 -- 172.21.15.170:0/486593470 wait complete. 2024-09-12T17:27:58.496 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-12T17:27:58.497 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-12T17:27:58.497 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-12T17:27:58.497 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-12T17:27:58.541 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:58.541 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:58.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.541+0000 7fe55972e800 1 Processor -- start 2024-09-12T17:27:58.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.541+0000 7fe55972e800 1 -- start start 2024-09-12T17:27:58.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.541+0000 7fe55972e800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55f70cde0f00 0x55f70cde13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.541+0000 7fe55972e800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f70cc8ae40 con 0x55f70cde0300 2024-09-12T17:27:58.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.541+0000 7fe55972e800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x55f70cc55680 con 0x55f70cde0f00 2024-09-12T17:27:58.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.542+0000 7fe554b63640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55f70cde0f00 0x55f70cde13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.542+0000 7fe555364640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x55f70cde0300 0x55f70cde0700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:48198/0 (socket says 172.21.15.170:48198) 2024-09-12T17:27:58.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.542+0000 7fe555364640 1 -- 172.21.15.170:0/3939562618 learned_addr learned my addr 172.21.15.170:0/3939562618 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:27:58.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.542+0000 7fe554b63640 1 -- 172.21.15.170:0/3939562618 >> v1:172.21.15.47:6789/0 conn(0x55f70cde0300 legacy=0x55f70cde0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.542+0000 7fe554b63640 1 -- 172.21.15.170:0/3939562618 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f70cc716b0 con 0x55f70cde0f00 2024-09-12T17:27:58.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.544+0000 7fe554b63640 1 --2- 172.21.15.170:0/3939562618 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f70cde0f00 0x55f70cde13b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe54c00a470 tx=0x7fe54c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caa223100ad2b2f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.544+0000 7fe547fff640 1 -- 172.21.15.170:0/3939562618 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe54c053570 con 0x55f70cde0f00 2024-09-12T17:27:58.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.544+0000 7fe547fff640 1 -- 172.21.15.170:0/3939562618 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe54c058070 con 0x55f70cde0f00 2024-09-12T17:27:58.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.544+0000 7fe547fff640 1 -- 172.21.15.170:0/3939562618 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe54c053880 con 0x55f70cde0f00 2024-09-12T17:27:58.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.544+0000 7fe55972e800 1 -- 172.21.15.170:0/3939562618 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f70cde0f00 msgr2=0x55f70cde13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.544+0000 7fe55972e800 1 --2- 172.21.15.170:0/3939562618 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f70cde0f00 0x55f70cde13b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe54c00a470 tx=0x7fe54c045a20 comp rx=0 tx=0).stop 2024-09-12T17:27:58.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.544+0000 7fe55972e800 1 -- 172.21.15.170:0/3939562618 shutdown_connections 2024-09-12T17:27:58.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.544+0000 7fe55972e800 1 --2- 172.21.15.170:0/3939562618 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f70cde0f00 0x55f70cde13b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.544+0000 7fe55972e800 1 -- 172.21.15.170:0/3939562618 >> 172.21.15.170:0/3939562618 conn(0x55f70cdda920 msgr2=0x55f70cddcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:58.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.544+0000 7fe55972e800 1 -- 172.21.15.170:0/3939562618 shutdown_connections 2024-09-12T17:27:58.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.544+0000 7fe55972e800 1 -- 172.21.15.170:0/3939562618 wait complete. 2024-09-12T17:27:58.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.558+0000 7fe55972e800 1 Processor -- start 2024-09-12T17:27:58.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.558+0000 7fe55972e800 1 -- start start 2024-09-12T17:27:58.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.558+0000 7fe55972e800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f70cde0300 0x55f70cece460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.558+0000 7fe55972e800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f70cc79dd0 con 0x55f70cde0300 2024-09-12T17:27:58.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.559+0000 7fe555364640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f70cde0300 0x55f70cece460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.559+0000 7fe555364640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f70cde0300 0x55f70cece460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56228/0 (socket says 172.21.15.170:56228) 2024-09-12T17:27:58.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.559+0000 7fe555364640 1 -- 172.21.15.170:0/2559185157 learned_addr learned my addr 172.21.15.170:0/2559185157 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:58.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.559+0000 7fe555364640 1 -- 172.21.15.170:0/2559185157 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f70cc92e10 con 0x55f70cde0300 2024-09-12T17:27:58.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.559+0000 7fe555364640 1 --2- 172.21.15.170:0/2559185157 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f70cde0300 0x55f70cece460 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe548001e40 tx=0x7fe548001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba5cb4344f05c107 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.559+0000 7fe443606640 1 -- 172.21.15.170:0/2559185157 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe548012020 con 0x55f70cde0300 2024-09-12T17:27:58.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.559+0000 7fe443606640 1 -- 172.21.15.170:0/2559185157 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe54800e5a0 con 0x55f70cde0300 2024-09-12T17:27:58.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.559+0000 7fe443606640 1 -- 172.21.15.170:0/2559185157 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe54800e8a0 con 0x55f70cde0300 2024-09-12T17:27:58.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.560+0000 7fe55972e800 1 -- 172.21.15.170:0/2559185157 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f70cde0300 msgr2=0x55f70cece460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.560+0000 7fe55972e800 1 --2- 172.21.15.170:0/2559185157 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f70cde0300 0x55f70cece460 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe548001e40 tx=0x7fe548001e70 comp rx=0 tx=0).stop 2024-09-12T17:27:58.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.560+0000 7fe55972e800 1 -- 172.21.15.170:0/2559185157 shutdown_connections 2024-09-12T17:27:58.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.560+0000 7fe55972e800 1 --2- 172.21.15.170:0/2559185157 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f70cde0300 0x55f70cece460 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.560+0000 7fe55972e800 1 -- 172.21.15.170:0/2559185157 >> 172.21.15.170:0/2559185157 conn(0x55f70cdda920 msgr2=0x55f70cec9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:58.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.560+0000 7fe55972e800 1 -- 172.21.15.170:0/2559185157 shutdown_connections 2024-09-12T17:27:58.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.560+0000 7fe55972e800 1 -- 172.21.15.170:0/2559185157 wait complete. 2024-09-12T17:27:58.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.560+0000 7fe55972e800 1 Processor -- start 2024-09-12T17:27:58.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.560+0000 7fe55972e800 1 -- start start 2024-09-12T17:27:58.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.561+0000 7fe55972e800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f70cde0f00 0x55f70ceda3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.561+0000 7fe55972e800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f70cdded70 con 0x55f70cde0f00 2024-09-12T17:27:58.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.561+0000 7fe555364640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f70cde0f00 0x55f70ceda3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.561+0000 7fe555364640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f70cde0f00 0x55f70ceda3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56244/0 (socket says 172.21.15.170:56244) 2024-09-12T17:27:58.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.561+0000 7fe555364640 1 -- 172.21.15.170:0/3913777012 learned_addr learned my addr 172.21.15.170:0/3913777012 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:58.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.561+0000 7fe555364640 1 -- 172.21.15.170:0/3913777012 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f70ceda930 con 0x55f70cde0f00 2024-09-12T17:27:58.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.561+0000 7fe555364640 1 --2- 172.21.15.170:0/3913777012 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f70cde0f00 0x55f70ceda3d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe54800c010 tx=0x7fe548000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.561+0000 7fe441e03640 1 -- 172.21.15.170:0/3913777012 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe548012030 con 0x55f70cde0f00 2024-09-12T17:27:58.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.561+0000 7fe441e03640 1 -- 172.21.15.170:0/3913777012 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5480014a0 con 0x55f70cde0f00 2024-09-12T17:27:58.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.561+0000 7fe441e03640 1 -- 172.21.15.170:0/3913777012 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe54801a700 con 0x55f70cde0f00 2024-09-12T17:27:58.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.561+0000 7fe55972e800 1 -- 172.21.15.170:0/3913777012 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f70cedabc0 con 0x55f70cde0f00 2024-09-12T17:27:58.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.562+0000 7fe55972e800 1 -- 172.21.15.170:0/3913777012 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f70cedb5c0 con 0x55f70cde0f00 2024-09-12T17:27:58.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.562+0000 7fe441e03640 1 -- 172.21.15.170:0/3913777012 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe548015020 con 0x55f70cde0f00 2024-09-12T17:27:58.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.563+0000 7fe441e03640 1 --2- 172.21.15.170:0/3913777012 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe43c03c730 0x7fe43c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.563+0000 7fe441e03640 1 -- 172.21.15.170:0/3913777012 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fe548020030 con 0x55f70cde0f00 2024-09-12T17:27:58.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.563+0000 7fe554b63640 1 --2- 172.21.15.170:0/3913777012 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe43c03c730 0x7fe43c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.563+0000 7fe55972e800 1 --2- 172.21.15.170:0/3913777012 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55f70cedc0e0 0x55f70cee1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.563+0000 7fe55972e800 1 -- 172.21.15.170:0/3913777012 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f70cee2000 con 0x55f70cedc0e0 2024-09-12T17:27:58.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.563+0000 7fe555b65640 1 --2- 172.21.15.170:0/3913777012 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55f70cedc0e0 0x55f70cee1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.563+0000 7fe554b63640 1 --2- 172.21.15.170:0/3913777012 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe43c03c730 0x7fe43c03ebf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe54c057000 tx=0x7fe54c052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.563+0000 7fe555b65640 1 --2- 172.21.15.170:0/3913777012 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55f70cedc0e0 0x55f70cee1a20 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.564+0000 7fe555b65640 1 -- 172.21.15.170:0/3913777012 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe55000a4d0 con 0x55f70cedc0e0 2024-09-12T17:27:58.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.564+0000 7fe55972e800 1 -- 172.21.15.170:0/3913777012 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f70cedba50 con 0x55f70cedc0e0 2024-09-12T17:27:58.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.564+0000 7fe555b65640 1 -- 172.21.15.170:0/3913777012 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe55000a4d0 con 0x55f70cedc0e0 2024-09-12T17:27:58.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.564+0000 7fe55972e800 1 --2- 172.21.15.170:0/3913777012 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55f70cee4330 0x55f70cee6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.564+0000 7fe55972e800 1 -- 172.21.15.170:0/3913777012 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f70cee6df0 con 0x55f70cee4330 2024-09-12T17:27:58.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.564+0000 7fe555364640 1 --2- 172.21.15.170:0/3913777012 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55f70cee4330 0x55f70cee6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.564+0000 7fe555364640 1 --2- 172.21.15.170:0/3913777012 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55f70cee4330 0x55f70cee6720 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.564+0000 7fe555364640 1 -- 172.21.15.170:0/3913777012 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe5480187b0 con 0x55f70cee4330 2024-09-12T17:27:58.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.565+0000 7fe55972e800 1 -- 172.21.15.170:0/3913777012 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f70cee31d0 con 0x55f70cedc0e0 2024-09-12T17:27:58.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.565+0000 7fe555b65640 1 -- 172.21.15.170:0/3913777012 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe55000a4d0 con 0x55f70cedc0e0 2024-09-12T17:27:58.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.565+0000 7fe55972e800 1 -- 172.21.15.170:0/3913777012 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f70cee3670 con 0x55f70cee4330 2024-09-12T17:27:58.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.565+0000 7fe555364640 1 -- 172.21.15.170:0/3913777012 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe5480187b0 con 0x55f70cee4330 2024-09-12T17:27:58.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.565+0000 7fe55972e800 1 Processor -- start 2024-09-12T17:27:58.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.566+0000 7fe55972e800 1 -- start start 2024-09-12T17:27:58.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.566+0000 7fe55972e800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f70cef5680 0x55f70cef5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.566+0000 7fe55972e800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f70ccd7a00 con 0x55f70cef5680 2024-09-12T17:27:58.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.566+0000 7fe555b65640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f70cef5680 0x55f70cef5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.566+0000 7fe555b65640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f70cef5680 0x55f70cef5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56252/0 (socket says 172.21.15.170:56252) 2024-09-12T17:27:58.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.566+0000 7fe555b65640 1 -- 172.21.15.170:0/2377118056 learned_addr learned my addr 172.21.15.170:0/2377118056 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:58.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.566+0000 7fe555b65640 1 -- 172.21.15.170:0/2377118056 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f70cef60e0 con 0x55f70cef5680 2024-09-12T17:27:58.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.566+0000 7fe555b65640 1 --2- 172.21.15.170:0/2377118056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f70cef5680 0x55f70cef5aa0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x55f70cedb260 tx=0x7fe5500167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.567+0000 7fe43affd640 1 -- 172.21.15.170:0/2377118056 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe550013640 con 0x55f70cef5680 2024-09-12T17:27:58.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.567+0000 7fe43affd640 1 -- 172.21.15.170:0/2377118056 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5500137e0 con 0x55f70cef5680 2024-09-12T17:27:58.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.567+0000 7fe55972e800 1 -- 172.21.15.170:0/2377118056 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f70cef6910 con 0x55f70cef5680 2024-09-12T17:27:58.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.567+0000 7fe43affd640 1 -- 172.21.15.170:0/2377118056 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe550013ae0 con 0x55f70cef5680 2024-09-12T17:27:58.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.567+0000 7fe55972e800 1 -- 172.21.15.170:0/2377118056 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f70cef6eb0 con 0x55f70cef5680 2024-09-12T17:27:58.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.567+0000 7fe43affd640 1 -- 172.21.15.170:0/2377118056 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe550011040 con 0x55f70cef5680 2024-09-12T17:27:58.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.568+0000 7fe43affd640 1 --2- 172.21.15.170:0/2377118056 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe43003c730 0x7fe43003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.568+0000 7fe43affd640 1 -- 172.21.15.170:0/2377118056 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fe55000e040 con 0x55f70cef5680 2024-09-12T17:27:58.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.568+0000 7fe555364640 1 --2- 172.21.15.170:0/2377118056 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe43003c730 0x7fe43003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.568+0000 7fe55972e800 1 Processor -- start 2024-09-12T17:27:58.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.568+0000 7fe555364640 1 --2- 172.21.15.170:0/2377118056 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe43003c730 0x7fe43003ebf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe54800c750 tx=0x7fe548018f20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.568+0000 7fe55972e800 1 -- start start 2024-09-12T17:27:58.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.568+0000 7fe55972e800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f70cf02180 0x55f70cf02580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.568+0000 7fe55972e800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f70cececb0 con 0x55f70cf02180 2024-09-12T17:27:58.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.568+0000 7fe555b65640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f70cf02180 0x55f70cf02580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.568+0000 7fe555b65640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f70cf02180 0x55f70cf02580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56254/0 (socket says 172.21.15.170:56254) 2024-09-12T17:27:58.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.568+0000 7fe555b65640 1 -- 172.21.15.170:0/570009174 learned_addr learned my addr 172.21.15.170:0/570009174 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:58.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.569+0000 7fe555b65640 1 -- 172.21.15.170:0/570009174 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f70cf02b70 con 0x55f70cf02180 2024-09-12T17:27:58.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.569+0000 7fe555b65640 1 --2- 172.21.15.170:0/570009174 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f70cf02180 0x55f70cf02580 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe550053cd0 tx=0x7fe550014480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9344c036c040e9b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.569+0000 7fe438ff9640 1 -- 172.21.15.170:0/570009174 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe55004a070 con 0x55f70cf02180 2024-09-12T17:27:58.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.569+0000 7fe438ff9640 1 -- 172.21.15.170:0/570009174 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe550021a90 con 0x55f70cf02180 2024-09-12T17:27:58.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.569+0000 7fe438ff9640 1 -- 172.21.15.170:0/570009174 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe55001f4b0 con 0x55f70cf02180 2024-09-12T17:27:58.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.569+0000 7fe55972e800 1 -- 172.21.15.170:0/570009174 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f70cf02180 msgr2=0x55f70cf02580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.569+0000 7fe55972e800 1 --2- 172.21.15.170:0/570009174 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f70cf02180 0x55f70cf02580 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe550053cd0 tx=0x7fe550014480 comp rx=0 tx=0).stop 2024-09-12T17:27:58.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.569+0000 7fe55972e800 1 -- 172.21.15.170:0/570009174 shutdown_connections 2024-09-12T17:27:58.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.569+0000 7fe55972e800 1 --2- 172.21.15.170:0/570009174 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f70cf02180 0x55f70cf02580 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.569+0000 7fe55972e800 1 -- 172.21.15.170:0/570009174 >> 172.21.15.170:0/570009174 conn(0x55f70cefe580 msgr2=0x55f70cefc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:58.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.570+0000 7fe55972e800 1 -- 172.21.15.170:0/570009174 shutdown_connections 2024-09-12T17:27:58.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.570+0000 7fe55972e800 1 -- 172.21.15.170:0/570009174 wait complete. 2024-09-12T17:27:58.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.570+0000 7fe55972e800 1 Processor -- start 2024-09-12T17:27:58.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.570+0000 7fe55972e800 1 -- start start 2024-09-12T17:27:58.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.570+0000 7fe55972e800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f70cf02180 0x55f70cf097d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.570+0000 7fe55972e800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f70cf03190 con 0x55f70cf02180 2024-09-12T17:27:58.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.570+0000 7fe555b65640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f70cf02180 0x55f70cf097d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.570+0000 7fe555b65640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f70cf02180 0x55f70cf097d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56258/0 (socket says 172.21.15.170:56258) 2024-09-12T17:27:58.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.570+0000 7fe555b65640 1 -- 172.21.15.170:0/135686858 learned_addr learned my addr 172.21.15.170:0/135686858 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:58.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.571+0000 7fe555b65640 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f70cf09d30 con 0x55f70cf02180 2024-09-12T17:27:58.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.571+0000 7fe555b65640 1 --2- 172.21.15.170:0/135686858 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f70cf02180 0x55f70cf097d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe550021a60 tx=0x7fe550053d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.571+0000 7fe426ffd640 1 -- 172.21.15.170:0/135686858 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe55004a040 con 0x55f70cf02180 2024-09-12T17:27:58.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.571+0000 7fe426ffd640 1 -- 172.21.15.170:0/135686858 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe550021570 con 0x55f70cf02180 2024-09-12T17:27:58.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.571+0000 7fe426ffd640 1 -- 172.21.15.170:0/135686858 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe550020970 con 0x55f70cf02180 2024-09-12T17:27:58.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.571+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f70cf09fc0 con 0x55f70cf02180 2024-09-12T17:27:58.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.571+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f70cf0a940 con 0x55f70cf02180 2024-09-12T17:27:58.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.572+0000 7fe426ffd640 1 -- 172.21.15.170:0/135686858 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe55004d070 con 0x55f70cf02180 2024-09-12T17:27:58.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.572+0000 7fe426ffd640 1 --2- 172.21.15.170:0/135686858 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe42003c780 0x7fe42003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.572+0000 7fe426ffd640 1 -- 172.21.15.170:0/135686858 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fe550034af0 con 0x55f70cf02180 2024-09-12T17:27:58.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.572+0000 7fe555364640 1 --2- 172.21.15.170:0/135686858 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe42003c780 0x7fe42003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.573+0000 7fe555364640 1 --2- 172.21.15.170:0/135686858 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe42003c780 0x7fe42003ec40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe548001e90 tx=0x7fe548049000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.573+0000 7fe55972e800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.573+0000 7fe55972e800 1 --2- 172.21.15.170:0/135686858 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55f70cf150e0 0x55f70cf175a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.573+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf17cf0 con 0x55f70cf150e0 2024-09-12T17:27:58.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.573+0000 7fe554b63640 1 --2- 172.21.15.170:0/135686858 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55f70cf150e0 0x55f70cf175a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.573+0000 7fe554b63640 1 --2- 172.21.15.170:0/135686858 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55f70cf150e0 0x55f70cf175a0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.574+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe54c051070 con 0x55f70cf150e0 2024-09-12T17:27:58.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.574+0000 7fe55972e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:58.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.574+0000 7fe55972e800 20 realm 2024-09-12T17:27:58.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.574+0000 7fe55972e800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.574+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf18120 con 0x55f70cf150e0 2024-09-12T17:27:58.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.574+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe54c051070 con 0x55f70cf150e0 2024-09-12T17:27:58.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.574+0000 7fe55972e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:58.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.574+0000 7fe55972e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:58.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.574+0000 7fe55972e800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.574+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf189f0 con 0x55f70cf150e0 2024-09-12T17:27:58.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.574+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe54c051070 con 0x55f70cf150e0 2024-09-12T17:27:58.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.574+0000 7fe55972e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:58.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.574+0000 7fe55972e800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.574+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf18d90 con 0x55f70cf150e0 2024-09-12T17:27:58.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.574+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe54c051070 con 0x55f70cf150e0 2024-09-12T17:27:58.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.574+0000 7fe55972e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:58.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.574+0000 7fe55972e800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.574+0000 7fe55972e800 1 --2- 172.21.15.170:0/135686858 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55f70cf19af0 0x55f70cf1bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.574+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf1c4f0 con 0x55f70cf19af0 2024-09-12T17:27:58.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.574+0000 7fe555b65640 1 --2- 172.21.15.170:0/135686858 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55f70cf19af0 0x55f70cf1bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.575+0000 7fe555b65640 1 --2- 172.21.15.170:0/135686858 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55f70cf19af0 0x55f70cf1bee0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.575+0000 7fe555b65640 1 -- 172.21.15.170:0/135686858 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe550039020 con 0x55f70cf19af0 2024-09-12T17:27:58.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.575+0000 7fe55972e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:27:58.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.575+0000 7fe55972e800 20 searching for the correct realm 2024-09-12T17:27:58.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.575+0000 7fe55972e800 1 --2- 172.21.15.170:0/135686858 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55f70cf1e4a0 0x55f70cf20960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.575+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf20fe0 con 0x55f70cf1e4a0 2024-09-12T17:27:58.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.575+0000 7fe555364640 1 --2- 172.21.15.170:0/135686858 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55f70cf1e4a0 0x55f70cf20960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.575+0000 7fe555364640 1 --2- 172.21.15.170:0/135686858 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55f70cf1e4a0 0x55f70cf20960 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.576+0000 7fe555364640 1 -- 172.21.15.170:0/135686858 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5480187b0 con 0x55f70cf1e4a0 2024-09-12T17:27:58.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.576+0000 7fe555364640 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf20fe0 con 0x55f70cf19af0 2024-09-12T17:27:58.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.576+0000 7fe555b65640 1 -- 172.21.15.170:0/135686858 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe550039020 con 0x55f70cf19af0 2024-09-12T17:27:58.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.576+0000 7fe555b65640 1 --2- 172.21.15.170:0/135686858 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fe5500325c0 0x7fe550055970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.576+0000 7fe555b65640 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf20fe0 con 0x7fe5500325c0 2024-09-12T17:27:58.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.576+0000 7fe554b63640 1 --2- 172.21.15.170:0/135686858 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fe5500325c0 0x7fe550055970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.577+0000 7fe554b63640 1 --2- 172.21.15.170:0/135686858 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fe5500325c0 0x7fe550055970 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.577+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe54c051070 con 0x7fe5500325c0 2024-09-12T17:27:58.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.577+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf20fe0 con 0x55f70cf150e0 2024-09-12T17:27:58.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.577+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe54c051070 con 0x55f70cf150e0 2024-09-12T17:27:58.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.577+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf20fe0 con 0x55f70cf150e0 2024-09-12T17:27:58.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.577+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe54c051070 con 0x55f70cf150e0 2024-09-12T17:27:58.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.577+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf20fe0 con 0x7fe5500325c0 2024-09-12T17:27:58.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.578+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe54c051070 con 0x7fe5500325c0 2024-09-12T17:27:58.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.578+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf20fe0 con 0x7fe5500325c0 2024-09-12T17:27:58.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.578+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe54c051070 con 0x7fe5500325c0 2024-09-12T17:27:58.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.578+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf20fe0 con 0x55f70cf19af0 2024-09-12T17:27:58.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.578+0000 7fe555b65640 1 -- 172.21.15.170:0/135686858 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe550039020 con 0x55f70cf19af0 2024-09-12T17:27:58.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.578+0000 7fe555b65640 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf20fe0 con 0x55f70cf1e4a0 2024-09-12T17:27:58.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.578+0000 7fe555364640 1 -- 172.21.15.170:0/135686858 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5480187b0 con 0x55f70cf1e4a0 2024-09-12T17:27:58.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.578+0000 7fe555364640 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf20fe0 con 0x55f70cf150e0 2024-09-12T17:27:58.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.579+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe54c051070 con 0x55f70cf150e0 2024-09-12T17:27:58.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.579+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf20fe0 con 0x7fe5500325c0 2024-09-12T17:27:58.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.579+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe54c051070 con 0x7fe5500325c0 2024-09-12T17:27:58.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.579+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf20fe0 con 0x55f70cf150e0 2024-09-12T17:27:58.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.579+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe54c051070 con 0x55f70cf150e0 2024-09-12T17:27:58.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.579+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf20fe0 con 0x55f70cf19af0 2024-09-12T17:27:58.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.579+0000 7fe555b65640 1 -- 172.21.15.170:0/135686858 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fe550039020 con 0x55f70cf19af0 2024-09-12T17:27:58.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.579+0000 7fe555b65640 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf20fe0 con 0x55f70cf1e4a0 2024-09-12T17:27:58.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.580+0000 7fe555364640 1 -- 172.21.15.170:0/135686858 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5480187b0 con 0x55f70cf1e4a0 2024-09-12T17:27:58.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.580+0000 7fe555364640 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf20fe0 con 0x55f70cf1e4a0 2024-09-12T17:27:58.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.580+0000 7fe555364640 1 -- 172.21.15.170:0/135686858 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5480187b0 con 0x55f70cf1e4a0 2024-09-12T17:27:58.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.580+0000 7fe555364640 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf20fe0 con 0x7fe5500325c0 2024-09-12T17:27:58.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.580+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe54c051070 con 0x7fe5500325c0 2024-09-12T17:27:58.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.580+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf20fe0 con 0x55f70cf1e4a0 2024-09-12T17:27:58.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.580+0000 7fe555364640 1 -- 172.21.15.170:0/135686858 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5480187b0 con 0x55f70cf1e4a0 2024-09-12T17:27:58.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.580+0000 7fe555364640 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf20fe0 con 0x55f70cf1e4a0 2024-09-12T17:27:58.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.581+0000 7fe555364640 1 -- 172.21.15.170:0/135686858 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5480187b0 con 0x55f70cf1e4a0 2024-09-12T17:27:58.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.581+0000 7fe555364640 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf20fe0 con 0x55f70cf150e0 2024-09-12T17:27:58.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.581+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe54c051070 con 0x55f70cf150e0 2024-09-12T17:27:58.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.581+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf20fe0 con 0x55f70cf150e0 2024-09-12T17:27:58.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.581+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe54c051070 con 0x55f70cf150e0 2024-09-12T17:27:58.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.581+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf20fe0 con 0x7fe5500325c0 2024-09-12T17:27:58.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.581+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe54c051070 con 0x7fe5500325c0 2024-09-12T17:27:58.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.581+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf20fe0 con 0x55f70cf1e4a0 2024-09-12T17:27:58.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.582+0000 7fe555364640 1 -- 172.21.15.170:0/135686858 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5480187b0 con 0x55f70cf1e4a0 2024-09-12T17:27:58.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.582+0000 7fe555364640 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf20fe0 con 0x55f70cf19af0 2024-09-12T17:27:58.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.582+0000 7fe555b65640 1 -- 172.21.15.170:0/135686858 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe550039020 con 0x55f70cf19af0 2024-09-12T17:27:58.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.582+0000 7fe555b65640 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf20fe0 con 0x55f70cf150e0 2024-09-12T17:27:58.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.582+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe54c051070 con 0x55f70cf150e0 2024-09-12T17:27:58.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.582+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf20fe0 con 0x7fe5500325c0 2024-09-12T17:27:58.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.582+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe54c051070 con 0x7fe5500325c0 2024-09-12T17:27:58.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.582+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf20fe0 con 0x55f70cf1e4a0 2024-09-12T17:27:58.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.583+0000 7fe555364640 1 -- 172.21.15.170:0/135686858 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5480187b0 con 0x55f70cf1e4a0 2024-09-12T17:27:58.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.583+0000 7fe555364640 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf20fe0 con 0x7fe5500325c0 2024-09-12T17:27:58.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.583+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe54c051070 con 0x7fe5500325c0 2024-09-12T17:27:58.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.583+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf20fe0 con 0x55f70cf19af0 2024-09-12T17:27:58.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.583+0000 7fe555b65640 1 -- 172.21.15.170:0/135686858 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe550039020 con 0x55f70cf19af0 2024-09-12T17:27:58.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.583+0000 7fe555b65640 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf20fe0 con 0x55f70cf1e4a0 2024-09-12T17:27:58.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.583+0000 7fe555364640 1 -- 172.21.15.170:0/135686858 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5480187b0 con 0x55f70cf1e4a0 2024-09-12T17:27:58.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.583+0000 7fe555364640 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf20fe0 con 0x7fe5500325c0 2024-09-12T17:27:58.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.584+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe54c051070 con 0x7fe5500325c0 2024-09-12T17:27:58.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.584+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf20fe0 con 0x55f70cf150e0 2024-09-12T17:27:58.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.584+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe54c051070 con 0x55f70cf150e0 2024-09-12T17:27:58.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.584+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf20fe0 con 0x55f70cf19af0 2024-09-12T17:27:58.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.584+0000 7fe555b65640 1 -- 172.21.15.170:0/135686858 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v22'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe550039020 con 0x55f70cf19af0 2024-09-12T17:27:58.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.584+0000 7fe55972e800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:27:58.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.584+0000 7fe55972e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:58.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.584+0000 7fe55972e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:58.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.584+0000 7fe55972e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:58.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.584+0000 7fe55972e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:58.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.584+0000 7fe55972e800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:27:58.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.584+0000 7fe55972e800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.584+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf1ceb0 con 0x55f70cf150e0 2024-09-12T17:27:58.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.584+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe54c051070 con 0x55f70cf150e0 2024-09-12T17:27:58.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.584+0000 7fe55972e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:58.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.584+0000 7fe55972e800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.584+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf1d750 con 0x55f70cf150e0 2024-09-12T17:27:58.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.585+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe54c051070 con 0x55f70cf150e0 2024-09-12T17:27:58.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.585+0000 7fe55972e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:58.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.585+0000 7fe55972e800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.585+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf1caf0 con 0x55f70cf19af0 2024-09-12T17:27:58.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.585+0000 7fe555b65640 1 -- 172.21.15.170:0/135686858 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe550039020 con 0x55f70cf19af0 2024-09-12T17:27:58.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.585+0000 7fe55972e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:27:58.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.585+0000 7fe55972e800 20 zone default found 2024-09-12T17:27:58.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.585+0000 7fe55972e800 4 Realm: () 2024-09-12T17:27:58.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.585+0000 7fe55972e800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:27:58.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.585+0000 7fe55972e800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:27:58.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.585+0000 7fe55972e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:58.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.585+0000 7fe55972e800 20 zonegroup default 2024-09-12T17:27:58.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.585+0000 7fe55972e800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.585+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf21910 con 0x7fe5500325c0 2024-09-12T17:27:58.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.585+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe54c051070 con 0x7fe5500325c0 2024-09-12T17:27:58.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.585+0000 7fe55972e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:58.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.585+0000 7fe55972e800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.585+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf23b50 con 0x55f70cf1e4a0 2024-09-12T17:27:58.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.586+0000 7fe555364640 1 -- 172.21.15.170:0/135686858 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe5480187b0 con 0x55f70cf1e4a0 2024-09-12T17:27:58.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.586+0000 7fe55972e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:58.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.586+0000 7fe55972e800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.586+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf23ef0 con 0x55f70cf1e4a0 2024-09-12T17:27:58.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.586+0000 7fe555364640 1 -- 172.21.15.170:0/135686858 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe5480187b0 con 0x55f70cf1e4a0 2024-09-12T17:27:58.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.586+0000 7fe55972e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:58.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.586+0000 7fe55972e800 20 started sync module instance, tier type = 2024-09-12T17:27:58.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.586+0000 7fe55972e800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:27:58.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.586+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf22fe0 con 0x55f70cf19af0 2024-09-12T17:27:58.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.587+0000 7fe555b65640 1 -- 172.21.15.170:0/135686858 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe550039020 con 0x55f70cf19af0 2024-09-12T17:27:58.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.587+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94519562482640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf24790 con 0x55f70cf19af0 2024-09-12T17:27:58.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.587+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf24fe0 con 0x55f70cf150e0 2024-09-12T17:27:58.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.588+0000 7fe555b65640 1 -- 172.21.15.170:0/135686858 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94519562482640] v29'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe550039020 con 0x55f70cf19af0 2024-09-12T17:27:58.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.588+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe54c051070 con 0x55f70cf150e0 2024-09-12T17:27:58.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.588+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94519562486496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf24cd0 con 0x55f70cf150e0 2024-09-12T17:27:58.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.588+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf257f0 con 0x55f70cf1e4a0 2024-09-12T17:27:58.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.589+0000 7fe555364640 1 -- 172.21.15.170:0/135686858 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5480187b0 con 0x55f70cf1e4a0 2024-09-12T17:27:58.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.589+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94519562490560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf26090 con 0x55f70cf1e4a0 2024-09-12T17:27:58.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.589+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf26b80 con 0x55f70cf19af0 2024-09-12T17:27:58.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.590+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94519562486496] v29'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe54c051070 con 0x55f70cf150e0 2024-09-12T17:27:58.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.590+0000 7fe555364640 1 -- 172.21.15.170:0/135686858 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94519562490560] v29'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5480187b0 con 0x55f70cf1e4a0 2024-09-12T17:27:58.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.591+0000 7fe555b65640 1 -- 172.21.15.170:0/135686858 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe550039020 con 0x55f70cf19af0 2024-09-12T17:27:58.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.591+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94519562492896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf24740 con 0x55f70cf19af0 2024-09-12T17:27:58.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.591+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf27590 con 0x55f70cf150e0 2024-09-12T17:27:58.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.592+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe54c051070 con 0x55f70cf150e0 2024-09-12T17:27:58.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.592+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94519562498272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf279b0 con 0x55f70cf150e0 2024-09-12T17:27:58.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.592+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf283d0 con 0x7fe5500325c0 2024-09-12T17:27:58.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.592+0000 7fe555b65640 1 -- 172.21.15.170:0/135686858 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94519562492896] v29'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe550039020 con 0x55f70cf19af0 2024-09-12T17:27:58.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.593+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe54c051070 con 0x7fe5500325c0 2024-09-12T17:27:58.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.593+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94519562501824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf28390 con 0x7fe5500325c0 2024-09-12T17:27:58.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.593+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf28de0 con 0x7fe5500325c0 2024-09-12T17:27:58.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.593+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94519562498272] v29'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe54c051070 con 0x55f70cf150e0 2024-09-12T17:27:58.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.594+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94519562501824] v29'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe54c051070 con 0x7fe5500325c0 2024-09-12T17:27:58.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.594+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(56 notify.6 [create] v29'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe54c051070 con 0x7fe5500325c0 2024-09-12T17:27:58.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.594+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94519562495568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf28930 con 0x7fe5500325c0 2024-09-12T17:27:58.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.594+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf292f0 con 0x7fe5500325c0 2024-09-12T17:27:58.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.595+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94519562495568] v29'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe54c051070 con 0x7fe5500325c0 2024-09-12T17:27:58.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.595+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(58 notify.7 [create] v29'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe54c051070 con 0x7fe5500325c0 2024-09-12T17:27:58.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.595+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94519562499328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf292f0 con 0x7fe5500325c0 2024-09-12T17:27:58.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.595+0000 7fe55972e800 20 add_watcher() i=0 2024-09-12T17:27:58.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.595+0000 7fe55972e800 20 add_watcher() i=1 2024-09-12T17:27:58.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.595+0000 7fe55972e800 20 add_watcher() i=2 2024-09-12T17:27:58.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.595+0000 7fe55972e800 20 add_watcher() i=3 2024-09-12T17:27:58.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.595+0000 7fe55972e800 20 add_watcher() i=4 2024-09-12T17:27:58.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.595+0000 7fe55972e800 20 add_watcher() i=5 2024-09-12T17:27:58.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.595+0000 7fe55972e800 20 add_watcher() i=6 2024-09-12T17:27:58.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.596+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94519562499328] v29'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe54c051070 con 0x7fe5500325c0 2024-09-12T17:27:58.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.596+0000 7fe55972e800 20 add_watcher() i=7 2024-09-12T17:27:58.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.596+0000 7fe55972e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:58.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.596+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf2c5f0 con 0x55f70cf150e0 2024-09-12T17:27:58.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.596+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe54c051070 con 0x55f70cf150e0 2024-09-12T17:27:58.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.596+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94519562506160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf29880 con 0x55f70cf150e0 2024-09-12T17:27:58.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.597+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94519562506160] v29'36 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe54c051070 con 0x55f70cf150e0 2024-09-12T17:27:58.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.597+0000 7fe40bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:58.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.597+0000 7fe55972e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:58.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.597+0000 7fe55972e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:58.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.597+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf34e60 con 0x55f70cf150e0 2024-09-12T17:27:58.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.598+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe54c051070 con 0x55f70cf150e0 2024-09-12T17:27:58.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.599+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf35510 con 0x7fe5500325c0 2024-09-12T17:27:58.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.600+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe54c051070 con 0x7fe5500325c0 2024-09-12T17:27:58.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.600+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf35950 con 0x55f70cf1e4a0 2024-09-12T17:27:58.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.600+0000 7fe555364640 1 -- 172.21.15.170:0/135686858 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe5480187b0 con 0x55f70cf1e4a0 2024-09-12T17:27:58.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.601+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf35d40 con 0x55f70cf150e0 2024-09-12T17:27:58.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.601+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'37 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe54c051070 con 0x55f70cf150e0 2024-09-12T17:27:58.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.601+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf36130 con 0x55f70cf19af0 2024-09-12T17:27:58.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.602+0000 7fe555b65640 1 -- 172.21.15.170:0/135686858 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'26 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe550039020 con 0x55f70cf19af0 2024-09-12T17:27:58.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.602+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf36130 con 0x55f70cf1e4a0 2024-09-12T17:27:58.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.603+0000 7fe555364640 1 -- 172.21.15.170:0/135686858 <== osd.3 v2:172.21.15.170:6816/2664906588 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'17 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe5480187b0 con 0x55f70cf1e4a0 2024-09-12T17:27:58.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.603+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf36130 con 0x55f70cf150e0 2024-09-12T17:27:58.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.605+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe54c051070 con 0x55f70cf150e0 2024-09-12T17:27:58.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.605+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf36130 con 0x7fe5500325c0 2024-09-12T17:27:58.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.606+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'17 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe54c051070 con 0x7fe5500325c0 2024-09-12T17:27:58.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.606+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf361c0 con 0x55f70cf19af0 2024-09-12T17:27:58.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.607+0000 7fe555b65640 1 -- 172.21.15.170:0/135686858 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe550039020 con 0x55f70cf19af0 2024-09-12T17:27:58.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.607+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf362f0 con 0x55f70cf1e4a0 2024-09-12T17:27:58.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.608+0000 7fe555364640 1 -- 172.21.15.170:0/135686858 <== osd.3 v2:172.21.15.170:6816/2664906588 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe5480187b0 con 0x55f70cf1e4a0 2024-09-12T17:27:58.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.608+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf36380 con 0x55f70cf19af0 2024-09-12T17:27:58.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.609+0000 7fe555b65640 1 -- 172.21.15.170:0/135686858 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'27 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe550039020 con 0x55f70cf19af0 2024-09-12T17:27:58.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.609+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf364b0 con 0x7fe5500325c0 2024-09-12T17:27:58.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.610+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe54c051070 con 0x7fe5500325c0 2024-09-12T17:27:58.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.610+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf36970 con 0x55f70cf19af0 2024-09-12T17:27:58.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.611+0000 7fe555b65640 1 -- 172.21.15.170:0/135686858 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe550039020 con 0x55f70cf19af0 2024-09-12T17:27:58.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.611+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf36970 con 0x7fe5500325c0 2024-09-12T17:27:58.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.612+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'23 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe54c051070 con 0x7fe5500325c0 2024-09-12T17:27:58.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.612+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf36970 con 0x55f70cf150e0 2024-09-12T17:27:58.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.613+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'38 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe54c051070 con 0x55f70cf150e0 2024-09-12T17:27:58.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.613+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf36970 con 0x55f70cf1e4a0 2024-09-12T17:27:58.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.614+0000 7fe555364640 1 -- 172.21.15.170:0/135686858 <== osd.3 v2:172.21.15.170:6816/2664906588 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe5480187b0 con 0x55f70cf1e4a0 2024-09-12T17:27:58.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.614+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf36970 con 0x55f70cf19af0 2024-09-12T17:27:58.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.616+0000 7fe555b65640 1 -- 172.21.15.170:0/135686858 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'28 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe550039020 con 0x55f70cf19af0 2024-09-12T17:27:58.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.616+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf36970 con 0x55f70cf1e4a0 2024-09-12T17:27:58.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.617+0000 7fe555364640 1 -- 172.21.15.170:0/135686858 <== osd.3 v2:172.21.15.170:6816/2664906588 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe5480187b0 con 0x55f70cf1e4a0 2024-09-12T17:27:58.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.617+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf36970 con 0x55f70cf150e0 2024-09-12T17:27:58.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.618+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe54c051070 con 0x55f70cf150e0 2024-09-12T17:27:58.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.618+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf36970 con 0x55f70cf150e0 2024-09-12T17:27:58.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.619+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'39 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe54c051070 con 0x55f70cf150e0 2024-09-12T17:27:58.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.619+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf36970 con 0x55f70cf1e4a0 2024-09-12T17:27:58.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.620+0000 7fe555364640 1 -- 172.21.15.170:0/135686858 <== osd.3 v2:172.21.15.170:6816/2664906588 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe5480187b0 con 0x55f70cf1e4a0 2024-09-12T17:27:58.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.620+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf36970 con 0x55f70cf19af0 2024-09-12T17:27:58.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.621+0000 7fe555b65640 1 -- 172.21.15.170:0/135686858 <== osd.2 v2:172.21.15.170:6808/3855567754 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe550039020 con 0x55f70cf19af0 2024-09-12T17:27:58.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.621+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf36970 con 0x55f70cf1e4a0 2024-09-12T17:27:58.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.622+0000 7fe555364640 1 -- 172.21.15.170:0/135686858 <== osd.3 v2:172.21.15.170:6816/2664906588 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe5480187b0 con 0x55f70cf1e4a0 2024-09-12T17:27:58.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.622+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf36970 con 0x55f70cf1e4a0 2024-09-12T17:27:58.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.623+0000 7fe555364640 1 -- 172.21.15.170:0/135686858 <== osd.3 v2:172.21.15.170:6816/2664906588 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe5480187b0 con 0x55f70cf1e4a0 2024-09-12T17:27:58.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.623+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf36970 con 0x55f70cf1e4a0 2024-09-12T17:27:58.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.624+0000 7fe555364640 1 -- 172.21.15.170:0/135686858 <== osd.3 v2:172.21.15.170:6816/2664906588 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'8 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe5480187b0 con 0x55f70cf1e4a0 2024-09-12T17:27:58.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.624+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf36970 con 0x55f70cf1e4a0 2024-09-12T17:27:58.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.625+0000 7fe555364640 1 -- 172.21.15.170:0/135686858 <== osd.3 v2:172.21.15.170:6816/2664906588 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'18 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe5480187b0 con 0x55f70cf1e4a0 2024-09-12T17:27:58.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.625+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf36970 con 0x7fe5500325c0 2024-09-12T17:27:58.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.626+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe54c051070 con 0x7fe5500325c0 2024-09-12T17:27:58.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.626+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf36970 con 0x55f70cf1e4a0 2024-09-12T17:27:58.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.627+0000 7fe555364640 1 -- 172.21.15.170:0/135686858 <== osd.3 v2:172.21.15.170:6816/2664906588 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe5480187b0 con 0x55f70cf1e4a0 2024-09-12T17:27:58.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.627+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf36970 con 0x7fe5500325c0 2024-09-12T17:27:58.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.628+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.0 v2:172.21.15.47:6800/3978157098 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'18 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe54c051070 con 0x7fe5500325c0 2024-09-12T17:27:58.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.628+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf36970 con 0x55f70cf1e4a0 2024-09-12T17:27:58.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.629+0000 7fe555364640 1 -- 172.21.15.170:0/135686858 <== osd.3 v2:172.21.15.170:6816/2664906588 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'22 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe5480187b0 con 0x55f70cf1e4a0 2024-09-12T17:27:58.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.629+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf36970 con 0x7fe5500325c0 2024-09-12T17:27:58.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.630+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.0 v2:172.21.15.47:6800/3978157098 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'24 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe54c051070 con 0x7fe5500325c0 2024-09-12T17:27:58.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.630+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf36970 con 0x55f70cf19af0 2024-09-12T17:27:58.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.631+0000 7fe555b65640 1 -- 172.21.15.170:0/135686858 <== osd.2 v2:172.21.15.170:6808/3855567754 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe550039020 con 0x55f70cf19af0 2024-09-12T17:27:58.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.631+0000 7fe40afe5640 20 reqs_thread_entry: start 2024-09-12T17:27:58.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.632+0000 7fe55972e800 20 init_complete bucket index max shards: 11 2024-09-12T17:27:58.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.632+0000 7fe55972e800 20 Filter name: none 2024-09-12T17:27:58.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.632+0000 7fe408fe1640 20 reqs_thread_entry: start 2024-09-12T17:27:58.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.632+0000 7fe55972e800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-12T17:27:58.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.632+0000 7fe55972e800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.632+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf616a0 con 0x7fe5500325c0 2024-09-12T17:27:58.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.632+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.0 v2:172.21.15.47:6800/3978157098 24 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fe54c051070 con 0x7fe5500325c0 2024-09-12T17:27:58.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.632+0000 7fe55972e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:58.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.632+0000 7fe55972e800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-12T17:27:58.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.632+0000 7fe55972e800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T17:27:58.634 INFO:teuthology.orchestra.run.smithi170.stderr:could not remove user: unable to remove user, user does not exist 2024-09-12T17:27:58.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.633+0000 7fe40bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:58.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.633+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94519562506160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf32a20 con 0x55f70cf150e0 2024-09-12T17:27:58.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.634+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94519562506160] v29'40 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe54c051070 con 0x55f70cf150e0 2024-09-12T17:27:58.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.634+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94519562482640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf28fb0 con 0x55f70cf19af0 2024-09-12T17:27:58.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.635+0000 7fe555b65640 1 -- 172.21.15.170:0/135686858 <== osd.2 v2:172.21.15.170:6808/3855567754 20 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94519562482640] v29'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe550039020 con 0x55f70cf19af0 2024-09-12T17:27:58.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.635+0000 7fe55972e800 20 remove_watcher() i=0 2024-09-12T17:27:58.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.635+0000 7fe55972e800 2 removed watcher, disabling cache 2024-09-12T17:27:58.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.635+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94519562486496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf28fb0 con 0x55f70cf150e0 2024-09-12T17:27:58.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.636+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94519562486496] v29'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe54c051070 con 0x55f70cf150e0 2024-09-12T17:27:58.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.636+0000 7fe55972e800 20 remove_watcher() i=1 2024-09-12T17:27:58.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.636+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94519562490560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf242e0 con 0x55f70cf1e4a0 2024-09-12T17:27:58.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.637+0000 7fe555364640 1 -- 172.21.15.170:0/135686858 <== osd.3 v2:172.21.15.170:6816/2664906588 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94519562490560] v29'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5480187b0 con 0x55f70cf1e4a0 2024-09-12T17:27:58.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.637+0000 7fe55972e800 20 remove_watcher() i=2 2024-09-12T17:27:58.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.637+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94519562492896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf28fb0 con 0x55f70cf19af0 2024-09-12T17:27:58.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.638+0000 7fe555b65640 1 -- 172.21.15.170:0/135686858 <== osd.2 v2:172.21.15.170:6808/3855567754 21 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94519562492896] v29'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe550039020 con 0x55f70cf19af0 2024-09-12T17:27:58.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.638+0000 7fe55972e800 20 remove_watcher() i=3 2024-09-12T17:27:58.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.638+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94519562498272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf252c0 con 0x55f70cf150e0 2024-09-12T17:27:58.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.639+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94519562498272] v29'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe54c051070 con 0x55f70cf150e0 2024-09-12T17:27:58.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.639+0000 7fe55972e800 20 remove_watcher() i=4 2024-09-12T17:27:58.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.639+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94519562501824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf28fb0 con 0x7fe5500325c0 2024-09-12T17:27:58.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.640+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.0 v2:172.21.15.47:6800/3978157098 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94519562501824] v29'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe54c051070 con 0x7fe5500325c0 2024-09-12T17:27:58.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.640+0000 7fe55972e800 20 remove_watcher() i=5 2024-09-12T17:27:58.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.640+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94519562495568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf270e0 con 0x7fe5500325c0 2024-09-12T17:27:58.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.641+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.0 v2:172.21.15.47:6800/3978157098 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94519562495568] v29'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe54c051070 con 0x7fe5500325c0 2024-09-12T17:27:58.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.641+0000 7fe55972e800 20 remove_watcher() i=6 2024-09-12T17:27:58.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.641+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94519562499328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f70cf252c0 con 0x7fe5500325c0 2024-09-12T17:27:58.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.642+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 <== osd.0 v2:172.21.15.47:6800/3978157098 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94519562499328] v29'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe54c051070 con 0x7fe5500325c0 2024-09-12T17:27:58.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.642+0000 7fe55972e800 20 remove_watcher() i=7 2024-09-12T17:27:58.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.643+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fe5500325c0 msgr2=0x7fe550055970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.643+0000 7fe55972e800 1 --2- 172.21.15.170:0/135686858 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fe5500325c0 0x7fe550055970 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.643+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55f70cf150e0 msgr2=0x55f70cf175a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.643+0000 7fe55972e800 1 --2- 172.21.15.170:0/135686858 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55f70cf150e0 0x55f70cf175a0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.643+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55f70cf19af0 msgr2=0x55f70cf1bee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.643+0000 7fe55972e800 1 --2- 172.21.15.170:0/135686858 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55f70cf19af0 0x55f70cf1bee0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.643+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55f70cf1e4a0 msgr2=0x55f70cf20960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.643+0000 7fe55972e800 1 --2- 172.21.15.170:0/135686858 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55f70cf1e4a0 0x55f70cf20960 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.643+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe42003c780 msgr2=0x7fe42003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.643+0000 7fe55972e800 1 --2- 172.21.15.170:0/135686858 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe42003c780 0x7fe42003ec40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe548001e90 tx=0x7fe548049000 comp rx=0 tx=0).stop 2024-09-12T17:27:58.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.643+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f70cf02180 msgr2=0x55f70cf097d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.643+0000 7fe55972e800 1 --2- 172.21.15.170:0/135686858 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f70cf02180 0x55f70cf097d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe550021a60 tx=0x7fe550053d00 comp rx=0 tx=0).stop 2024-09-12T17:27:58.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.643+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 reap_dead start 2024-09-12T17:27:58.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.643+0000 7fe554b63640 1 -- 172.21.15.170:0/135686858 reap_dead start 2024-09-12T17:27:58.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.643+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 shutdown_connections 2024-09-12T17:27:58.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.643+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 >> 172.21.15.170:0/135686858 conn(0x55f70cefe580 msgr2=0x55f70cefc790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:58.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.643+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 shutdown_connections 2024-09-12T17:27:58.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.643+0000 7fe55972e800 1 -- 172.21.15.170:0/135686858 wait complete. 2024-09-12T17:27:58.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.643+0000 7fe55972e800 1 -- 172.21.15.170:0/2377118056 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe43003c730 msgr2=0x7fe43003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.643+0000 7fe55972e800 1 --2- 172.21.15.170:0/2377118056 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe43003c730 0x7fe43003ebf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe54800c750 tx=0x7fe548018f20 comp rx=0 tx=0).stop 2024-09-12T17:27:58.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.643+0000 7fe55972e800 1 -- 172.21.15.170:0/2377118056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f70cef5680 msgr2=0x55f70cef5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.643+0000 7fe55972e800 1 --2- 172.21.15.170:0/2377118056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f70cef5680 0x55f70cef5aa0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x55f70cedb260 tx=0x7fe5500167b0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.643+0000 7fe55972e800 1 -- 172.21.15.170:0/2377118056 shutdown_connections 2024-09-12T17:27:58.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.643+0000 7fe55972e800 1 --2- 172.21.15.170:0/2377118056 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe43003c730 0x7fe43003ebf0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.643+0000 7fe55972e800 1 --2- 172.21.15.170:0/2377118056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f70cef5680 0x55f70cef5aa0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.643+0000 7fe55972e800 1 -- 172.21.15.170:0/2377118056 >> 172.21.15.170:0/2377118056 conn(0x55f70cee9a30 msgr2=0x55f70cee9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:58.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.643+0000 7fe55972e800 1 -- 172.21.15.170:0/2377118056 shutdown_connections 2024-09-12T17:27:58.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.643+0000 7fe55972e800 1 -- 172.21.15.170:0/2377118056 wait complete. 2024-09-12T17:27:58.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.644+0000 7fe55972e800 1 -- 172.21.15.170:0/3913777012 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55f70cedc0e0 msgr2=0x55f70cee1a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.644+0000 7fe55972e800 1 --2- 172.21.15.170:0/3913777012 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55f70cedc0e0 0x55f70cee1a20 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.644+0000 7fe55972e800 1 -- 172.21.15.170:0/3913777012 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55f70cee4330 msgr2=0x55f70cee6720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.644+0000 7fe55972e800 1 --2- 172.21.15.170:0/3913777012 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55f70cee4330 0x55f70cee6720 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.644+0000 7fe55972e800 1 -- 172.21.15.170:0/3913777012 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe43c03c730 msgr2=0x7fe43c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.644+0000 7fe55972e800 1 --2- 172.21.15.170:0/3913777012 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe43c03c730 0x7fe43c03ebf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe54c057000 tx=0x7fe54c052000 comp rx=0 tx=0).stop 2024-09-12T17:27:58.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.644+0000 7fe55972e800 1 -- 172.21.15.170:0/3913777012 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f70cde0f00 msgr2=0x55f70ceda3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.644+0000 7fe55972e800 1 --2- 172.21.15.170:0/3913777012 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f70cde0f00 0x55f70ceda3d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe54800c010 tx=0x7fe548000ed0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.644+0000 7fe55972e800 1 -- 172.21.15.170:0/3913777012 shutdown_connections 2024-09-12T17:27:58.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.644+0000 7fe55972e800 1 --2- 172.21.15.170:0/3913777012 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55f70cee4330 0x55f70cee6720 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.644+0000 7fe55972e800 1 --2- 172.21.15.170:0/3913777012 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe43c03c730 0x7fe43c03ebf0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.644+0000 7fe55972e800 1 --2- 172.21.15.170:0/3913777012 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55f70cedc0e0 0x55f70cee1a20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.644+0000 7fe55972e800 1 --2- 172.21.15.170:0/3913777012 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f70cde0f00 0x55f70ceda3d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.644+0000 7fe55972e800 1 -- 172.21.15.170:0/3913777012 >> 172.21.15.170:0/3913777012 conn(0x55f70cdda920 msgr2=0x55f70cecf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:58.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.644+0000 7fe55972e800 1 -- 172.21.15.170:0/3913777012 shutdown_connections 2024-09-12T17:27:58.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.644+0000 7fe55972e800 1 -- 172.21.15.170:0/3913777012 wait complete. 2024-09-12T17:27:58.653 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-12T17:27:58.654 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-12T17:27:58.654 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-12T17:27:58.654 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-12T17:27:58.699 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:58.699 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:58.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.698+0000 7f408ed75800 1 Processor -- start 2024-09-12T17:27:58.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.698+0000 7f408ed75800 1 -- start start 2024-09-12T17:27:58.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.698+0000 7f408ed75800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55ca6e2aa2c0 0x55ca6e2afe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.698+0000 7f408ed75800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ca6e152e40 con 0x55ca6e2a8ff0 2024-09-12T17:27:58.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.698+0000 7f408ed75800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x55ca6e11d680 con 0x55ca6e2aa2c0 2024-09-12T17:27:58.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.699+0000 7f408c05e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55ca6e2aa2c0 0x55ca6e2afe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.699+0000 7f408c05e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55ca6e2aa2c0 0x55ca6e2afe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56264/0 (socket says 172.21.15.170:56264) 2024-09-12T17:27:58.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.699+0000 7f408c05e640 1 -- 172.21.15.170:0/64087033 learned_addr learned my addr 172.21.15.170:0/64087033 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:58.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.699+0000 7f408c85f640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x55ca6e2a8ff0 0x55ca6e2a9bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:48214/0 (socket says 172.21.15.170:48214) 2024-09-12T17:27:58.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.699+0000 7f408c05e640 1 -- 172.21.15.170:0/64087033 >> v1:172.21.15.47:6789/0 conn(0x55ca6e2a8ff0 legacy=0x55ca6e2a9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.699+0000 7f408c05e640 1 -- 172.21.15.170:0/64087033 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca6e1396b0 con 0x55ca6e2aa2c0 2024-09-12T17:27:58.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.701+0000 7f408c05e640 1 --2- 172.21.15.170:0/64087033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca6e2aa2c0 0x55ca6e2afe60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f407400a520 tx=0x7f4074045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cd0ad1afce83032 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.701+0000 7f408b85d640 1 -- 172.21.15.170:0/64087033 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4074055070 con 0x55ca6e2aa2c0 2024-09-12T17:27:58.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.701+0000 7f408b85d640 1 -- 172.21.15.170:0/64087033 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40740515b0 con 0x55ca6e2aa2c0 2024-09-12T17:27:58.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.701+0000 7f408b85d640 1 -- 172.21.15.170:0/64087033 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40740518d0 con 0x55ca6e2aa2c0 2024-09-12T17:27:58.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.702+0000 7f408ed75800 1 -- 172.21.15.170:0/64087033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca6e2aa2c0 msgr2=0x55ca6e2afe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.702+0000 7f408ed75800 1 --2- 172.21.15.170:0/64087033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca6e2aa2c0 0x55ca6e2afe60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f407400a520 tx=0x7f4074045ba0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.702+0000 7f408ed75800 1 -- 172.21.15.170:0/64087033 shutdown_connections 2024-09-12T17:27:58.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.702+0000 7f408ed75800 1 --2- 172.21.15.170:0/64087033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca6e2aa2c0 0x55ca6e2afe60 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.702+0000 7f408ed75800 1 -- 172.21.15.170:0/64087033 >> 172.21.15.170:0/64087033 conn(0x55ca6e2a43c0 msgr2=0x55ca6e2a6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:58.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.702+0000 7f408ed75800 1 -- 172.21.15.170:0/64087033 shutdown_connections 2024-09-12T17:27:58.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.702+0000 7f408ed75800 1 -- 172.21.15.170:0/64087033 wait complete. 2024-09-12T17:27:58.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.715+0000 7f408ed75800 1 Processor -- start 2024-09-12T17:27:58.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.715+0000 7f408ed75800 1 -- start start 2024-09-12T17:27:58.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.716+0000 7f408ed75800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca6e2a8ff0 0x55ca6e3985e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.716+0000 7f408ed75800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ca6e141dd0 con 0x55ca6e2a8ff0 2024-09-12T17:27:58.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.716+0000 7f408c85f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca6e2a8ff0 0x55ca6e3985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.716+0000 7f408c85f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca6e2a8ff0 0x55ca6e3985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56278/0 (socket says 172.21.15.170:56278) 2024-09-12T17:27:58.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.716+0000 7f408c85f640 1 -- 172.21.15.170:0/2997070150 learned_addr learned my addr 172.21.15.170:0/2997070150 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:58.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.716+0000 7f408c85f640 1 -- 172.21.15.170:0/2997070150 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca6e15ae10 con 0x55ca6e2a8ff0 2024-09-12T17:27:58.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.717+0000 7f408c85f640 1 --2- 172.21.15.170:0/2997070150 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca6e2a8ff0 0x55ca6e3985e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f40840016e0 tx=0x7f4084001ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=500bcb55ac76dfeb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.717+0000 7f3f7ae0d640 1 -- 172.21.15.170:0/2997070150 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4084013420 con 0x55ca6e2a8ff0 2024-09-12T17:27:58.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.717+0000 7f3f7ae0d640 1 -- 172.21.15.170:0/2997070150 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40840135e0 con 0x55ca6e2a8ff0 2024-09-12T17:27:58.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.717+0000 7f3f7ae0d640 1 -- 172.21.15.170:0/2997070150 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4084013900 con 0x55ca6e2a8ff0 2024-09-12T17:27:58.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.717+0000 7f408ed75800 1 -- 172.21.15.170:0/2997070150 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca6e2a8ff0 msgr2=0x55ca6e3985e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.717+0000 7f408ed75800 1 --2- 172.21.15.170:0/2997070150 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca6e2a8ff0 0x55ca6e3985e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f40840016e0 tx=0x7f4084001ba0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.718+0000 7f408ed75800 1 -- 172.21.15.170:0/2997070150 shutdown_connections 2024-09-12T17:27:58.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.718+0000 7f408ed75800 1 --2- 172.21.15.170:0/2997070150 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca6e2a8ff0 0x55ca6e3985e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.718+0000 7f408ed75800 1 -- 172.21.15.170:0/2997070150 >> 172.21.15.170:0/2997070150 conn(0x55ca6e2a43c0 msgr2=0x55ca6e393f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:58.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.718+0000 7f408ed75800 1 -- 172.21.15.170:0/2997070150 shutdown_connections 2024-09-12T17:27:58.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.718+0000 7f408ed75800 1 -- 172.21.15.170:0/2997070150 wait complete. 2024-09-12T17:27:58.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.718+0000 7f408ed75800 1 Processor -- start 2024-09-12T17:27:58.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.718+0000 7f408ed75800 1 -- start start 2024-09-12T17:27:58.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.718+0000 7f408ed75800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca6e2a8ff0 0x55ca6e39ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.718+0000 7f408ed75800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ca6e2aa9b0 con 0x55ca6e2a8ff0 2024-09-12T17:27:58.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.718+0000 7f408c85f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca6e2a8ff0 0x55ca6e39ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.718+0000 7f408c85f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca6e2a8ff0 0x55ca6e39ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56284/0 (socket says 172.21.15.170:56284) 2024-09-12T17:27:58.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.718+0000 7f408c85f640 1 -- 172.21.15.170:0/1617897127 learned_addr learned my addr 172.21.15.170:0/1617897127 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:58.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.719+0000 7f408c85f640 1 -- 172.21.15.170:0/1617897127 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca6e3a04d0 con 0x55ca6e2a8ff0 2024-09-12T17:27:58.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.719+0000 7f408c85f640 1 --2- 172.21.15.170:0/1617897127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca6e2a8ff0 0x55ca6e39ff70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4084000f80 tx=0x7f4084001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.719+0000 7f3f7960a640 1 -- 172.21.15.170:0/1617897127 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4084022020 con 0x55ca6e2a8ff0 2024-09-12T17:27:58.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.719+0000 7f3f7960a640 1 -- 172.21.15.170:0/1617897127 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4084006810 con 0x55ca6e2a8ff0 2024-09-12T17:27:58.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.719+0000 7f3f7960a640 1 -- 172.21.15.170:0/1617897127 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4084004ae0 con 0x55ca6e2a8ff0 2024-09-12T17:27:58.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.719+0000 7f408ed75800 1 -- 172.21.15.170:0/1617897127 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ca6e3a0760 con 0x55ca6e2a8ff0 2024-09-12T17:27:58.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.719+0000 7f408ed75800 1 -- 172.21.15.170:0/1617897127 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca6e3a1160 con 0x55ca6e2a8ff0 2024-09-12T17:27:58.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.720+0000 7f3f7960a640 1 -- 172.21.15.170:0/1617897127 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f4084025020 con 0x55ca6e2a8ff0 2024-09-12T17:27:58.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.720+0000 7f3f7960a640 1 --2- 172.21.15.170:0/1617897127 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3f7403c730 0x7f3f7403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.720+0000 7f3f7960a640 1 -- 172.21.15.170:0/1617897127 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f4084018030 con 0x55ca6e2a8ff0 2024-09-12T17:27:58.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.720+0000 7f408c05e640 1 --2- 172.21.15.170:0/1617897127 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3f7403c730 0x7f3f7403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.720+0000 7f408ed75800 1 --2- 172.21.15.170:0/1617897127 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55ca6e2aa2c0 0x55ca6e3a75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.720+0000 7f408ed75800 1 -- 172.21.15.170:0/1617897127 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3a7b00 con 0x55ca6e2aa2c0 2024-09-12T17:27:58.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.720+0000 7f408d060640 1 --2- 172.21.15.170:0/1617897127 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55ca6e2aa2c0 0x55ca6e3a75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.721+0000 7f408c05e640 1 --2- 172.21.15.170:0/1617897127 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3f7403c730 0x7f3f7403ebf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4074057000 tx=0x7f4074052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.721+0000 7f408d060640 1 --2- 172.21.15.170:0/1617897127 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55ca6e2aa2c0 0x55ca6e3a75c0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.721+0000 7f408d060640 1 -- 172.21.15.170:0/1617897127 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f407c0083e0 con 0x55ca6e2aa2c0 2024-09-12T17:27:58.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.721+0000 7f408ed75800 1 -- 172.21.15.170:0/1617897127 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3a7ea0 con 0x55ca6e2aa2c0 2024-09-12T17:27:58.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.721+0000 7f408d060640 1 -- 172.21.15.170:0/1617897127 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f407c0083e0 con 0x55ca6e2aa2c0 2024-09-12T17:27:58.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.721+0000 7f408ed75800 1 --2- 172.21.15.170:0/1617897127 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55ca6e3a99a0 0x55ca6e3abe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.721+0000 7f408ed75800 1 -- 172.21.15.170:0/1617897127 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3ac5b0 con 0x55ca6e3a99a0 2024-09-12T17:27:58.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.721+0000 7f408c85f640 1 --2- 172.21.15.170:0/1617897127 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55ca6e3a99a0 0x55ca6e3abe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.722+0000 7f408c85f640 1 --2- 172.21.15.170:0/1617897127 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55ca6e3a99a0 0x55ca6e3abe20 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.722+0000 7f408c85f640 1 -- 172.21.15.170:0/1617897127 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f408401b070 con 0x55ca6e3a99a0 2024-09-12T17:27:58.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.722+0000 7f408ed75800 1 -- 172.21.15.170:0/1617897127 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3a86f0 con 0x55ca6e2aa2c0 2024-09-12T17:27:58.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.722+0000 7f408d060640 1 -- 172.21.15.170:0/1617897127 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f407c0083e0 con 0x55ca6e2aa2c0 2024-09-12T17:27:58.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.722+0000 7f408ed75800 1 -- 172.21.15.170:0/1617897127 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3a8b20 con 0x55ca6e3a99a0 2024-09-12T17:27:58.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.722+0000 7f408c85f640 1 -- 172.21.15.170:0/1617897127 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f408401b070 con 0x55ca6e3a99a0 2024-09-12T17:27:58.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.723+0000 7f408ed75800 1 Processor -- start 2024-09-12T17:27:58.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.723+0000 7f408ed75800 1 -- start start 2024-09-12T17:27:58.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.723+0000 7f408ed75800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca6e3baea0 0x55ca6e3bb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.723+0000 7f408ed75800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ca6e19fa00 con 0x55ca6e3baea0 2024-09-12T17:27:58.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.723+0000 7f408d060640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca6e3baea0 0x55ca6e3bb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.723+0000 7f408d060640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca6e3baea0 0x55ca6e3bb2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56294/0 (socket says 172.21.15.170:56294) 2024-09-12T17:27:58.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.723+0000 7f408d060640 1 -- 172.21.15.170:0/2892186064 learned_addr learned my addr 172.21.15.170:0/2892186064 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:58.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.724+0000 7f408d060640 1 -- 172.21.15.170:0/2892186064 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca6e3bb900 con 0x55ca6e3baea0 2024-09-12T17:27:58.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.724+0000 7f408d060640 1 --2- 172.21.15.170:0/2892186064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca6e3baea0 0x55ca6e3bb2c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55ca6e3a0f70 tx=0x7f407c00bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.724+0000 7f3f727fc640 1 -- 172.21.15.170:0/2892186064 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f407c01c020 con 0x55ca6e3baea0 2024-09-12T17:27:58.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.724+0000 7f3f727fc640 1 -- 172.21.15.170:0/2892186064 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f407c007c90 con 0x55ca6e3baea0 2024-09-12T17:27:58.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.724+0000 7f408ed75800 1 -- 172.21.15.170:0/2892186064 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ca6e3bc130 con 0x55ca6e3baea0 2024-09-12T17:27:58.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.724+0000 7f3f727fc640 1 -- 172.21.15.170:0/2892186064 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f407c018440 con 0x55ca6e3baea0 2024-09-12T17:27:58.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.724+0000 7f408ed75800 1 -- 172.21.15.170:0/2892186064 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca6e3bc6d0 con 0x55ca6e3baea0 2024-09-12T17:27:58.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.725+0000 7f3f727fc640 1 -- 172.21.15.170:0/2892186064 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f407c01f020 con 0x55ca6e3baea0 2024-09-12T17:27:58.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.725+0000 7f3f727fc640 1 --2- 172.21.15.170:0/2892186064 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3f6403c730 0x7f3f6403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.725+0000 7f3f727fc640 1 -- 172.21.15.170:0/2892186064 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f407c054dc0 con 0x55ca6e3baea0 2024-09-12T17:27:58.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.725+0000 7f408c85f640 1 --2- 172.21.15.170:0/2892186064 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3f6403c730 0x7f3f6403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.725+0000 7f408ed75800 1 Processor -- start 2024-09-12T17:27:58.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.725+0000 7f408c85f640 1 --2- 172.21.15.170:0/2892186064 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3f6403c730 0x7f3f6403ebf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x55ca6e3ac980 tx=0x7f4084019f10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.726+0000 7f408ed75800 1 -- start start 2024-09-12T17:27:58.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.726+0000 7f408ed75800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca6e3c7960 0x55ca6e3c7d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.726+0000 7f408ed75800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ca6e398e30 con 0x55ca6e3c7960 2024-09-12T17:27:58.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.726+0000 7f408d060640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca6e3c7960 0x55ca6e3c7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.726+0000 7f408d060640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca6e3c7960 0x55ca6e3c7d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56310/0 (socket says 172.21.15.170:56310) 2024-09-12T17:27:58.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.726+0000 7f408d060640 1 -- 172.21.15.170:0/3060263944 learned_addr learned my addr 172.21.15.170:0/3060263944 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:58.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.726+0000 7f408d060640 1 -- 172.21.15.170:0/3060263944 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca6e3c8350 con 0x55ca6e3c7960 2024-09-12T17:27:58.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.726+0000 7f408d060640 1 --2- 172.21.15.170:0/3060263944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca6e3c7960 0x55ca6e3c7d60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f407c0532d0 tx=0x7f407c0158b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f992773c1768811 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.726+0000 7f3f63fff640 1 -- 172.21.15.170:0/3060263944 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f407c050020 con 0x55ca6e3c7960 2024-09-12T17:27:58.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.726+0000 7f3f63fff640 1 -- 172.21.15.170:0/3060263944 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f407c015e70 con 0x55ca6e3c7960 2024-09-12T17:27:58.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.726+0000 7f3f63fff640 1 -- 172.21.15.170:0/3060263944 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f407c0174d0 con 0x55ca6e3c7960 2024-09-12T17:27:58.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.727+0000 7f408ed75800 1 -- 172.21.15.170:0/3060263944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca6e3c7960 msgr2=0x55ca6e3c7d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.727+0000 7f408ed75800 1 --2- 172.21.15.170:0/3060263944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca6e3c7960 0x55ca6e3c7d60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f407c0532d0 tx=0x7f407c0158b0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.727+0000 7f408ed75800 1 -- 172.21.15.170:0/3060263944 shutdown_connections 2024-09-12T17:27:58.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.727+0000 7f408ed75800 1 --2- 172.21.15.170:0/3060263944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca6e3c7960 0x55ca6e3c7d60 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.727+0000 7f408ed75800 1 -- 172.21.15.170:0/3060263944 >> 172.21.15.170:0/3060263944 conn(0x55ca6e3c3d60 msgr2=0x55ca6e3c1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:58.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.727+0000 7f408ed75800 1 -- 172.21.15.170:0/3060263944 shutdown_connections 2024-09-12T17:27:58.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.727+0000 7f408ed75800 1 -- 172.21.15.170:0/3060263944 wait complete. 2024-09-12T17:27:58.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.727+0000 7f408ed75800 1 Processor -- start 2024-09-12T17:27:58.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.727+0000 7f408ed75800 1 -- start start 2024-09-12T17:27:58.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.727+0000 7f408ed75800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca6e3c7960 0x55ca6e3ceed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.727+0000 7f408ed75800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ca6e3c8970 con 0x55ca6e3c7960 2024-09-12T17:27:58.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.728+0000 7f408d060640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca6e3c7960 0x55ca6e3ceed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.728+0000 7f408d060640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca6e3c7960 0x55ca6e3ceed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56318/0 (socket says 172.21.15.170:56318) 2024-09-12T17:27:58.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.728+0000 7f408d060640 1 -- 172.21.15.170:0/2148226489 learned_addr learned my addr 172.21.15.170:0/2148226489 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:58.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.728+0000 7f408d060640 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca6e3cf430 con 0x55ca6e3c7960 2024-09-12T17:27:58.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.728+0000 7f408d060640 1 --2- 172.21.15.170:0/2148226489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca6e3c7960 0x55ca6e3ceed0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f407c0154a0 tx=0x7f407c053230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.728+0000 7f3f627fc640 1 -- 172.21.15.170:0/2148226489 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f407c04a040 con 0x55ca6e3c7960 2024-09-12T17:27:58.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.728+0000 7f3f627fc640 1 -- 172.21.15.170:0/2148226489 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f407c016c50 con 0x55ca6e3c7960 2024-09-12T17:27:58.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.728+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ca6e3cf6c0 con 0x55ca6e3c7960 2024-09-12T17:27:58.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.728+0000 7f3f627fc640 1 -- 172.21.15.170:0/2148226489 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f407c00b030 con 0x55ca6e3c7960 2024-09-12T17:27:58.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.728+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca6e3d0040 con 0x55ca6e3c7960 2024-09-12T17:27:58.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.729+0000 7f3f627fc640 1 -- 172.21.15.170:0/2148226489 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f407c033020 con 0x55ca6e3c7960 2024-09-12T17:27:58.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.729+0000 7f3f627fc640 1 --2- 172.21.15.170:0/2148226489 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3f5803c780 0x7f3f5803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.729+0000 7f3f627fc640 1 -- 172.21.15.170:0/2148226489 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f407c031020 con 0x55ca6e3c7960 2024-09-12T17:27:58.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.729+0000 7f408c85f640 1 --2- 172.21.15.170:0/2148226489 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3f5803c780 0x7f3f5803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.730+0000 7f408c85f640 1 --2- 172.21.15.170:0/2148226489 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3f5803c780 0x7f3f5803ec40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x55ca6e3a2060 tx=0x7f4084030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.730+0000 7f408ed75800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.730+0000 7f408ed75800 1 --2- 172.21.15.170:0/2148226489 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55ca6e3da800 0x55ca6e3dccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.730+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3dd410 con 0x55ca6e3da800 2024-09-12T17:27:58.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.730+0000 7f408c05e640 1 --2- 172.21.15.170:0/2148226489 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55ca6e3da800 0x55ca6e3dccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.730+0000 7f408c05e640 1 --2- 172.21.15.170:0/2148226489 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55ca6e3da800 0x55ca6e3dccc0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.731+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4074057030 con 0x55ca6e3da800 2024-09-12T17:27:58.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.731+0000 7f408ed75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:58.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.731+0000 7f408ed75800 20 realm 2024-09-12T17:27:58.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.731+0000 7f408ed75800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.731+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3dd840 con 0x55ca6e3da800 2024-09-12T17:27:58.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.731+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4074057030 con 0x55ca6e3da800 2024-09-12T17:27:58.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.731+0000 7f408ed75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:58.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.731+0000 7f408ed75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:58.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.731+0000 7f408ed75800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.731+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3de110 con 0x55ca6e3da800 2024-09-12T17:27:58.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.731+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4074057030 con 0x55ca6e3da800 2024-09-12T17:27:58.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.731+0000 7f408ed75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:58.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.731+0000 7f408ed75800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.731+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3de4b0 con 0x55ca6e3da800 2024-09-12T17:27:58.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.731+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4074057030 con 0x55ca6e3da800 2024-09-12T17:27:58.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.731+0000 7f408ed75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:58.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.731+0000 7f408ed75800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.731+0000 7f408ed75800 1 --2- 172.21.15.170:0/2148226489 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55ca6e3df210 0x55ca6e3e1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.731+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e1c10 con 0x55ca6e3df210 2024-09-12T17:27:58.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.732+0000 7f408d060640 1 --2- 172.21.15.170:0/2148226489 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55ca6e3df210 0x55ca6e3e1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.732+0000 7f408d060640 1 --2- 172.21.15.170:0/2148226489 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55ca6e3df210 0x55ca6e3e1600 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.732+0000 7f408d060640 1 -- 172.21.15.170:0/2148226489 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f407c0083e0 con 0x55ca6e3df210 2024-09-12T17:27:58.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.732+0000 7f408ed75800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:27:58.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.732+0000 7f408ed75800 20 searching for the correct realm 2024-09-12T17:27:58.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.732+0000 7f408ed75800 1 --2- 172.21.15.170:0/2148226489 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55ca6e3e3be0 0x55ca6e3e60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.732+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e6720 con 0x55ca6e3e3be0 2024-09-12T17:27:58.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.732+0000 7f408c85f640 1 --2- 172.21.15.170:0/2148226489 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55ca6e3e3be0 0x55ca6e3e60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.733+0000 7f408c85f640 1 --2- 172.21.15.170:0/2148226489 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55ca6e3e3be0 0x55ca6e3e60a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.733+0000 7f408c85f640 1 -- 172.21.15.170:0/2148226489 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f408401b070 con 0x55ca6e3e3be0 2024-09-12T17:27:58.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.733+0000 7f408c85f640 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e6720 con 0x55ca6e3df210 2024-09-12T17:27:58.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.733+0000 7f408d060640 1 -- 172.21.15.170:0/2148226489 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f407c0083e0 con 0x55ca6e3df210 2024-09-12T17:27:58.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.733+0000 7f408d060640 1 --2- 172.21.15.170:0/2148226489 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f407c021020 0x7f407c00a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.733+0000 7f408d060640 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e6720 con 0x7f407c021020 2024-09-12T17:27:58.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.733+0000 7f408c05e640 1 --2- 172.21.15.170:0/2148226489 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f407c021020 0x7f407c00a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.734+0000 7f408c05e640 1 --2- 172.21.15.170:0/2148226489 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f407c021020 0x7f407c00a980 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.734+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4074057030 con 0x7f407c021020 2024-09-12T17:27:58.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.734+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e6720 con 0x55ca6e3da800 2024-09-12T17:27:58.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.734+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4074057030 con 0x55ca6e3da800 2024-09-12T17:27:58.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.734+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e6720 con 0x55ca6e3da800 2024-09-12T17:27:58.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.734+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4074057030 con 0x55ca6e3da800 2024-09-12T17:27:58.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.734+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e6720 con 0x7f407c021020 2024-09-12T17:27:58.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.735+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4074057030 con 0x7f407c021020 2024-09-12T17:27:58.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.735+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e6720 con 0x7f407c021020 2024-09-12T17:27:58.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.735+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4074057030 con 0x7f407c021020 2024-09-12T17:27:58.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.735+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e6720 con 0x55ca6e3df210 2024-09-12T17:27:58.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.735+0000 7f408d060640 1 -- 172.21.15.170:0/2148226489 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f407c0083e0 con 0x55ca6e3df210 2024-09-12T17:27:58.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.735+0000 7f408d060640 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e6720 con 0x55ca6e3e3be0 2024-09-12T17:27:58.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.735+0000 7f408c85f640 1 -- 172.21.15.170:0/2148226489 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f408401b070 con 0x55ca6e3e3be0 2024-09-12T17:27:58.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.735+0000 7f408c85f640 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e6720 con 0x55ca6e3da800 2024-09-12T17:27:58.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.736+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4074057030 con 0x55ca6e3da800 2024-09-12T17:27:58.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.736+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e6720 con 0x7f407c021020 2024-09-12T17:27:58.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.736+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4074057030 con 0x7f407c021020 2024-09-12T17:27:58.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.736+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e6720 con 0x55ca6e3da800 2024-09-12T17:27:58.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.736+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4074057030 con 0x55ca6e3da800 2024-09-12T17:27:58.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.736+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e6720 con 0x55ca6e3df210 2024-09-12T17:27:58.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.736+0000 7f408d060640 1 -- 172.21.15.170:0/2148226489 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f407c0083e0 con 0x55ca6e3df210 2024-09-12T17:27:58.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.736+0000 7f408d060640 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e6720 con 0x55ca6e3e3be0 2024-09-12T17:27:58.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.736+0000 7f408c85f640 1 -- 172.21.15.170:0/2148226489 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f408401b070 con 0x55ca6e3e3be0 2024-09-12T17:27:58.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.736+0000 7f408c85f640 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e6720 con 0x55ca6e3e3be0 2024-09-12T17:27:58.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.737+0000 7f408c85f640 1 -- 172.21.15.170:0/2148226489 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f408401b070 con 0x55ca6e3e3be0 2024-09-12T17:27:58.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.737+0000 7f408c85f640 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e6720 con 0x7f407c021020 2024-09-12T17:27:58.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.737+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4074057030 con 0x7f407c021020 2024-09-12T17:27:58.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.737+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e6720 con 0x55ca6e3e3be0 2024-09-12T17:27:58.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.737+0000 7f408c85f640 1 -- 172.21.15.170:0/2148226489 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f408401b070 con 0x55ca6e3e3be0 2024-09-12T17:27:58.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.737+0000 7f408c85f640 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e6720 con 0x55ca6e3e3be0 2024-09-12T17:27:58.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.737+0000 7f408c85f640 1 -- 172.21.15.170:0/2148226489 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f408401b070 con 0x55ca6e3e3be0 2024-09-12T17:27:58.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.737+0000 7f408c85f640 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e6720 con 0x55ca6e3da800 2024-09-12T17:27:58.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.738+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4074057030 con 0x55ca6e3da800 2024-09-12T17:27:58.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.738+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e6720 con 0x55ca6e3da800 2024-09-12T17:27:58.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.738+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4074057030 con 0x55ca6e3da800 2024-09-12T17:27:58.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.738+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e6720 con 0x7f407c021020 2024-09-12T17:27:58.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.738+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4074057030 con 0x7f407c021020 2024-09-12T17:27:58.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.738+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e6720 con 0x55ca6e3e3be0 2024-09-12T17:27:58.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.738+0000 7f408c85f640 1 -- 172.21.15.170:0/2148226489 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f408401b070 con 0x55ca6e3e3be0 2024-09-12T17:27:58.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.738+0000 7f408c85f640 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e6720 con 0x55ca6e3df210 2024-09-12T17:27:58.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.739+0000 7f408d060640 1 -- 172.21.15.170:0/2148226489 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f407c0083e0 con 0x55ca6e3df210 2024-09-12T17:27:58.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.739+0000 7f408d060640 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e6720 con 0x55ca6e3da800 2024-09-12T17:27:58.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.739+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4074057030 con 0x55ca6e3da800 2024-09-12T17:27:58.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.739+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e6720 con 0x7f407c021020 2024-09-12T17:27:58.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.739+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4074057030 con 0x7f407c021020 2024-09-12T17:27:58.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.739+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e6720 con 0x55ca6e3e3be0 2024-09-12T17:27:58.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.739+0000 7f408c85f640 1 -- 172.21.15.170:0/2148226489 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f408401b070 con 0x55ca6e3e3be0 2024-09-12T17:27:58.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.739+0000 7f408c85f640 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e6720 con 0x7f407c021020 2024-09-12T17:27:58.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.740+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4074057030 con 0x7f407c021020 2024-09-12T17:27:58.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.740+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e6720 con 0x55ca6e3df210 2024-09-12T17:27:58.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.740+0000 7f408d060640 1 -- 172.21.15.170:0/2148226489 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f407c0083e0 con 0x55ca6e3df210 2024-09-12T17:27:58.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.740+0000 7f408d060640 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e6720 con 0x55ca6e3e3be0 2024-09-12T17:27:58.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.740+0000 7f408c85f640 1 -- 172.21.15.170:0/2148226489 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f408401b070 con 0x55ca6e3e3be0 2024-09-12T17:27:58.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.740+0000 7f408c85f640 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e6720 con 0x7f407c021020 2024-09-12T17:27:58.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.740+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4074057030 con 0x7f407c021020 2024-09-12T17:27:58.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.740+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e6720 con 0x55ca6e3da800 2024-09-12T17:27:58.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.741+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4074057030 con 0x55ca6e3da800 2024-09-12T17:27:58.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.741+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e6720 con 0x55ca6e3df210 2024-09-12T17:27:58.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.741+0000 7f408d060640 1 -- 172.21.15.170:0/2148226489 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v22'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f407c0083e0 con 0x55ca6e3df210 2024-09-12T17:27:58.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.741+0000 7f408ed75800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:27:58.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.741+0000 7f408ed75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:58.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.741+0000 7f408ed75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:58.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.741+0000 7f408ed75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:58.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.741+0000 7f408ed75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:58.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.741+0000 7f408ed75800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:27:58.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.741+0000 7f408ed75800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.741+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e2630 con 0x55ca6e3da800 2024-09-12T17:27:58.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.741+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4074057030 con 0x55ca6e3da800 2024-09-12T17:27:58.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.741+0000 7f408ed75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:58.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.741+0000 7f408ed75800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.741+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e2ed0 con 0x55ca6e3da800 2024-09-12T17:27:58.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.741+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4074057030 con 0x55ca6e3da800 2024-09-12T17:27:58.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.741+0000 7f408ed75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:58.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.741+0000 7f408ed75800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.741+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e2270 con 0x55ca6e3df210 2024-09-12T17:27:58.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.742+0000 7f408d060640 1 -- 172.21.15.170:0/2148226489 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f407c0083e0 con 0x55ca6e3df210 2024-09-12T17:27:58.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.742+0000 7f408ed75800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:27:58.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.742+0000 7f408ed75800 20 zone default found 2024-09-12T17:27:58.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.742+0000 7f408ed75800 4 Realm: () 2024-09-12T17:27:58.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.742+0000 7f408ed75800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:27:58.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.742+0000 7f408ed75800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:27:58.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.742+0000 7f408ed75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:58.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.742+0000 7f408ed75800 20 zonegroup default 2024-09-12T17:27:58.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.742+0000 7f408ed75800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.742+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e6c80 con 0x7f407c021020 2024-09-12T17:27:58.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.742+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4074057030 con 0x7f407c021020 2024-09-12T17:27:58.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.742+0000 7f408ed75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:58.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.742+0000 7f408ed75800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.742+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e8f60 con 0x55ca6e3e3be0 2024-09-12T17:27:58.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.742+0000 7f408c85f640 1 -- 172.21.15.170:0/2148226489 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f408401b070 con 0x55ca6e3e3be0 2024-09-12T17:27:58.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.742+0000 7f408ed75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:58.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.742+0000 7f408ed75800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.742+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e9300 con 0x55ca6e3e3be0 2024-09-12T17:27:58.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.742+0000 7f408c85f640 1 -- 172.21.15.170:0/2148226489 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f408401b070 con 0x55ca6e3e3be0 2024-09-12T17:27:58.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.742+0000 7f408ed75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:58.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.742+0000 7f408ed75800 20 started sync module instance, tier type = 2024-09-12T17:27:58.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.742+0000 7f408ed75800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:27:58.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.742+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e83f0 con 0x55ca6e3df210 2024-09-12T17:27:58.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.743+0000 7f408d060640 1 -- 172.21.15.170:0/2148226489 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f407c0083e0 con 0x55ca6e3df210 2024-09-12T17:27:58.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.744+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94327921346800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e83f0 con 0x55ca6e3df210 2024-09-12T17:27:58.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.744+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e9dd0 con 0x55ca6e3da800 2024-09-12T17:27:58.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.744+0000 7f408d060640 1 -- 172.21.15.170:0/2148226489 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94327921346800] v29'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f407c0083e0 con 0x55ca6e3df210 2024-09-12T17:27:58.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.745+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4074057030 con 0x55ca6e3da800 2024-09-12T17:27:58.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.745+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94327921350816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e83f0 con 0x55ca6e3da800 2024-09-12T17:27:58.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.745+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3ea880 con 0x55ca6e3e3be0 2024-09-12T17:27:58.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.746+0000 7f408c85f640 1 -- 172.21.15.170:0/2148226489 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f408401b070 con 0x55ca6e3e3be0 2024-09-12T17:27:58.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.746+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94327921353568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3eb120 con 0x55ca6e3e3be0 2024-09-12T17:27:58.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.746+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3ebbe0 con 0x55ca6e3df210 2024-09-12T17:27:58.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.746+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94327921350816] v29'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4074057030 con 0x55ca6e3da800 2024-09-12T17:27:58.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.747+0000 7f408c85f640 1 -- 172.21.15.170:0/2148226489 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94327921353568] v29'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f408401b070 con 0x55ca6e3e3be0 2024-09-12T17:27:58.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.747+0000 7f408d060640 1 -- 172.21.15.170:0/2148226489 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f407c0083e0 con 0x55ca6e3df210 2024-09-12T17:27:58.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.747+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94327921355888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e7f40 con 0x55ca6e3df210 2024-09-12T17:27:58.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.747+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3ec4c0 con 0x55ca6e3da800 2024-09-12T17:27:58.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.748+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4074057030 con 0x55ca6e3da800 2024-09-12T17:27:58.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.748+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94327921360848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3ec450 con 0x55ca6e3da800 2024-09-12T17:27:58.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.748+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3ed460 con 0x7f407c021020 2024-09-12T17:27:58.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.748+0000 7f408d060640 1 -- 172.21.15.170:0/2148226489 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94327921355888] v29'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f407c0083e0 con 0x55ca6e3df210 2024-09-12T17:27:58.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.749+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4074057030 con 0x7f407c021020 2024-09-12T17:27:58.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.749+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94327921364784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3ed420 con 0x7f407c021020 2024-09-12T17:27:58.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.749+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94327921360848] v29'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4074057030 con 0x55ca6e3da800 2024-09-12T17:27:58.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.749+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3ede70 con 0x7f407c021020 2024-09-12T17:27:58.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.750+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94327921364784] v29'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4074057030 con 0x7f407c021020 2024-09-12T17:27:58.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.750+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(56 notify.6 [create] v29'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4074057030 con 0x7f407c021020 2024-09-12T17:27:58.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.750+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94327921363248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3ed9c0 con 0x7f407c021020 2024-09-12T17:27:58.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.750+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3ee380 con 0x7f407c021020 2024-09-12T17:27:58.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.751+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(58 notify.7 [create] v29'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4074057030 con 0x7f407c021020 2024-09-12T17:27:58.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.751+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94327921363248] v29'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4074057030 con 0x7f407c021020 2024-09-12T17:27:58.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.751+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94327921368784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3ee2f0 con 0x7f407c021020 2024-09-12T17:27:58.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.751+0000 7f408ed75800 20 add_watcher() i=0 2024-09-12T17:27:58.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.751+0000 7f408ed75800 20 add_watcher() i=1 2024-09-12T17:27:58.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.751+0000 7f408ed75800 20 add_watcher() i=2 2024-09-12T17:27:58.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.751+0000 7f408ed75800 20 add_watcher() i=3 2024-09-12T17:27:58.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.751+0000 7f408ed75800 20 add_watcher() i=4 2024-09-12T17:27:58.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.751+0000 7f408ed75800 20 add_watcher() i=5 2024-09-12T17:27:58.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.751+0000 7f408ed75800 20 add_watcher() i=6 2024-09-12T17:27:58.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.752+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94327921368784] v29'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4074057030 con 0x7f407c021020 2024-09-12T17:27:58.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.752+0000 7f408ed75800 20 add_watcher() i=7 2024-09-12T17:27:58.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.752+0000 7f408ed75800 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:58.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.752+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3f16f0 con 0x55ca6e3da800 2024-09-12T17:27:58.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.753+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4074057030 con 0x55ca6e3da800 2024-09-12T17:27:58.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.753+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94327921358512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3eec40 con 0x55ca6e3da800 2024-09-12T17:27:58.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.754+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94327921358512] v29'41 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4074057030 con 0x55ca6e3da800 2024-09-12T17:27:58.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.754+0000 7f3f42fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:58.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.754+0000 7f408ed75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:58.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.754+0000 7f408ed75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:58.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.754+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3f9ef0 con 0x55ca6e3da800 2024-09-12T17:27:58.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.755+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4074057030 con 0x55ca6e3da800 2024-09-12T17:27:58.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.755+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3fa580 con 0x7f407c021020 2024-09-12T17:27:58.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.756+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4074057030 con 0x7f407c021020 2024-09-12T17:27:58.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.756+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3faaf0 con 0x55ca6e3e3be0 2024-09-12T17:27:58.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.757+0000 7f408c85f640 1 -- 172.21.15.170:0/2148226489 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f408401b070 con 0x55ca6e3e3be0 2024-09-12T17:27:58.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.757+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3fafa0 con 0x55ca6e3da800 2024-09-12T17:27:58.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.758+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'42 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4074057030 con 0x55ca6e3da800 2024-09-12T17:27:58.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.758+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3f7d90 con 0x55ca6e3df210 2024-09-12T17:27:58.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.759+0000 7f408d060640 1 -- 172.21.15.170:0/2148226489 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'29 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f407c0083e0 con 0x55ca6e3df210 2024-09-12T17:27:58.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.759+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3f7d90 con 0x55ca6e3e3be0 2024-09-12T17:27:58.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.760+0000 7f408c85f640 1 -- 172.21.15.170:0/2148226489 <== osd.3 v2:172.21.15.170:6816/2664906588 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'19 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f408401b070 con 0x55ca6e3e3be0 2024-09-12T17:27:58.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.760+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3f7d90 con 0x55ca6e3da800 2024-09-12T17:27:58.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.761+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4074057030 con 0x55ca6e3da800 2024-09-12T17:27:58.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.761+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3f7d90 con 0x7f407c021020 2024-09-12T17:27:58.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.762+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'19 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4074057030 con 0x7f407c021020 2024-09-12T17:27:58.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.762+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3f7d90 con 0x55ca6e3df210 2024-09-12T17:27:58.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.764+0000 7f408d060640 1 -- 172.21.15.170:0/2148226489 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f407c0083e0 con 0x55ca6e3df210 2024-09-12T17:27:58.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.764+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3f7d90 con 0x55ca6e3e3be0 2024-09-12T17:27:58.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.765+0000 7f408c85f640 1 -- 172.21.15.170:0/2148226489 <== osd.3 v2:172.21.15.170:6816/2664906588 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f408401b070 con 0x55ca6e3e3be0 2024-09-12T17:27:58.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.765+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3f7e50 con 0x55ca6e3df210 2024-09-12T17:27:58.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.766+0000 7f408d060640 1 -- 172.21.15.170:0/2148226489 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'30 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f407c0083e0 con 0x55ca6e3df210 2024-09-12T17:27:58.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.766+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3f7e50 con 0x7f407c021020 2024-09-12T17:27:58.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.767+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4074057030 con 0x7f407c021020 2024-09-12T17:27:58.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.767+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3f7e20 con 0x55ca6e3df210 2024-09-12T17:27:58.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.768+0000 7f408d060640 1 -- 172.21.15.170:0/2148226489 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f407c0083e0 con 0x55ca6e3df210 2024-09-12T17:27:58.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.768+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3fbcf0 con 0x7f407c021020 2024-09-12T17:27:58.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.769+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'25 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4074057030 con 0x7f407c021020 2024-09-12T17:27:58.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.769+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3fbb00 con 0x55ca6e3da800 2024-09-12T17:27:58.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.770+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'43 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4074057030 con 0x55ca6e3da800 2024-09-12T17:27:58.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.770+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3fbb00 con 0x55ca6e3e3be0 2024-09-12T17:27:58.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.771+0000 7f408c85f640 1 -- 172.21.15.170:0/2148226489 <== osd.3 v2:172.21.15.170:6816/2664906588 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f408401b070 con 0x55ca6e3e3be0 2024-09-12T17:27:58.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.771+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3fbb00 con 0x55ca6e3df210 2024-09-12T17:27:58.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.772+0000 7f408d060640 1 -- 172.21.15.170:0/2148226489 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'31 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f407c0083e0 con 0x55ca6e3df210 2024-09-12T17:27:58.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.772+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3fbb00 con 0x55ca6e3e3be0 2024-09-12T17:27:58.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.773+0000 7f408c85f640 1 -- 172.21.15.170:0/2148226489 <== osd.3 v2:172.21.15.170:6816/2664906588 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f408401b070 con 0x55ca6e3e3be0 2024-09-12T17:27:58.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.773+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3fbb00 con 0x55ca6e3da800 2024-09-12T17:27:58.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.774+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4074057030 con 0x55ca6e3da800 2024-09-12T17:27:58.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.774+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3fbb00 con 0x55ca6e3da800 2024-09-12T17:27:58.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.775+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'44 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4074057030 con 0x55ca6e3da800 2024-09-12T17:27:58.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.775+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3fbb00 con 0x55ca6e3e3be0 2024-09-12T17:27:58.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.776+0000 7f408c85f640 1 -- 172.21.15.170:0/2148226489 <== osd.3 v2:172.21.15.170:6816/2664906588 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f408401b070 con 0x55ca6e3e3be0 2024-09-12T17:27:58.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.776+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3fbb00 con 0x55ca6e3df210 2024-09-12T17:27:58.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.777+0000 7f408d060640 1 -- 172.21.15.170:0/2148226489 <== osd.2 v2:172.21.15.170:6808/3855567754 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'23 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f407c0083e0 con 0x55ca6e3df210 2024-09-12T17:27:58.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.777+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3fbb00 con 0x55ca6e3e3be0 2024-09-12T17:27:58.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.778+0000 7f408c85f640 1 -- 172.21.15.170:0/2148226489 <== osd.3 v2:172.21.15.170:6816/2664906588 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f408401b070 con 0x55ca6e3e3be0 2024-09-12T17:27:58.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.778+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3fbb00 con 0x55ca6e3e3be0 2024-09-12T17:27:58.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.779+0000 7f408c85f640 1 -- 172.21.15.170:0/2148226489 <== osd.3 v2:172.21.15.170:6816/2664906588 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f408401b070 con 0x55ca6e3e3be0 2024-09-12T17:27:58.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.779+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3fbb00 con 0x55ca6e3e3be0 2024-09-12T17:27:58.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.780+0000 7f408c85f640 1 -- 172.21.15.170:0/2148226489 <== osd.3 v2:172.21.15.170:6816/2664906588 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'9 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f408401b070 con 0x55ca6e3e3be0 2024-09-12T17:27:58.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.780+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3fbb00 con 0x55ca6e3e3be0 2024-09-12T17:27:58.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.781+0000 7f408c85f640 1 -- 172.21.15.170:0/2148226489 <== osd.3 v2:172.21.15.170:6816/2664906588 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f408401b070 con 0x55ca6e3e3be0 2024-09-12T17:27:58.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.781+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3fbb00 con 0x7f407c021020 2024-09-12T17:27:58.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.782+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4074057030 con 0x7f407c021020 2024-09-12T17:27:58.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.782+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3fbb00 con 0x55ca6e3e3be0 2024-09-12T17:27:58.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.783+0000 7f408c85f640 1 -- 172.21.15.170:0/2148226489 <== osd.3 v2:172.21.15.170:6816/2664906588 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f408401b070 con 0x55ca6e3e3be0 2024-09-12T17:27:58.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.783+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3fbb00 con 0x7f407c021020 2024-09-12T17:27:58.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.785+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.0 v2:172.21.15.47:6800/3978157098 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4074057030 con 0x7f407c021020 2024-09-12T17:27:58.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.785+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3fbb00 con 0x55ca6e3e3be0 2024-09-12T17:27:58.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.786+0000 7f408c85f640 1 -- 172.21.15.170:0/2148226489 <== osd.3 v2:172.21.15.170:6816/2664906588 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'25 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f408401b070 con 0x55ca6e3e3be0 2024-09-12T17:27:58.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.786+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3fbb00 con 0x7f407c021020 2024-09-12T17:27:58.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.787+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.0 v2:172.21.15.47:6800/3978157098 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'26 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4074057030 con 0x7f407c021020 2024-09-12T17:27:58.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.787+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3fbb00 con 0x55ca6e3df210 2024-09-12T17:27:58.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.788+0000 7f408d060640 1 -- 172.21.15.170:0/2148226489 <== osd.2 v2:172.21.15.170:6808/3855567754 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f407c0083e0 con 0x55ca6e3df210 2024-09-12T17:27:58.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.788+0000 7f3f41fe3640 20 reqs_thread_entry: start 2024-09-12T17:27:58.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.788+0000 7f408ed75800 20 init_complete bucket index max shards: 11 2024-09-12T17:27:58.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.788+0000 7f408ed75800 20 Filter name: none 2024-09-12T17:27:58.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.788+0000 7f3eb37fe640 20 reqs_thread_entry: start 2024-09-12T17:27:58.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.788+0000 7f408ed75800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:27:58.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.788+0000 7f408ed75800 20 rados->read ofs=0 len=0 2024-09-12T17:27:58.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.788+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e4269a0 con 0x55ca6e3da800 2024-09-12T17:27:58.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.789+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f4074057030 con 0x55ca6e3da800 2024-09-12T17:27:58.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.789+0000 7f408ed75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:58.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.789+0000 7f408ed75800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-12T17:27:58.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.789+0000 7f408ed75800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:27:58.791 INFO:teuthology.orchestra.run.smithi170.stderr:could not remove user: unable to remove user, user does not exist 2024-09-12T17:27:58.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.790+0000 7f3f42fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:58.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.790+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94327921358512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3f07f0 con 0x55ca6e3da800 2024-09-12T17:27:58.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.790+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94327921358512] v29'45 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4074057030 con 0x55ca6e3da800 2024-09-12T17:27:58.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.791+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94327921346800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3eb6b0 con 0x55ca6e3df210 2024-09-12T17:27:58.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.791+0000 7f408d060640 1 -- 172.21.15.170:0/2148226489 <== osd.2 v2:172.21.15.170:6808/3855567754 20 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94327921346800] v29'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f407c0083e0 con 0x55ca6e3df210 2024-09-12T17:27:58.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.791+0000 7f408ed75800 20 remove_watcher() i=0 2024-09-12T17:27:58.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.791+0000 7f408ed75800 2 removed watcher, disabling cache 2024-09-12T17:27:58.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.791+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94327921350816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e88f0 con 0x55ca6e3da800 2024-09-12T17:27:58.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.792+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94327921350816] v29'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4074057030 con 0x55ca6e3da800 2024-09-12T17:27:58.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.793+0000 7f408ed75800 20 remove_watcher() i=1 2024-09-12T17:27:58.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.793+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94327921353568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e88f0 con 0x55ca6e3e3be0 2024-09-12T17:27:58.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.793+0000 7f408c85f640 1 -- 172.21.15.170:0/2148226489 <== osd.3 v2:172.21.15.170:6816/2664906588 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94327921353568] v29'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f408401b070 con 0x55ca6e3e3be0 2024-09-12T17:27:58.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.794+0000 7f408ed75800 20 remove_watcher() i=2 2024-09-12T17:27:58.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.794+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94327921355888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3ea360 con 0x55ca6e3df210 2024-09-12T17:27:58.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.795+0000 7f408d060640 1 -- 172.21.15.170:0/2148226489 <== osd.2 v2:172.21.15.170:6808/3855567754 21 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94327921355888] v29'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f407c0083e0 con 0x55ca6e3df210 2024-09-12T17:27:58.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.795+0000 7f408ed75800 20 remove_watcher() i=3 2024-09-12T17:27:58.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.795+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94327921360848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3e88f0 con 0x55ca6e3da800 2024-09-12T17:27:58.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.796+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.1 v2:172.21.15.170:6800/1903654092 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94327921360848] v29'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4074057030 con 0x55ca6e3da800 2024-09-12T17:27:58.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.796+0000 7f408ed75800 20 remove_watcher() i=4 2024-09-12T17:27:58.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.796+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94327921364784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3eac70 con 0x7f407c021020 2024-09-12T17:27:58.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.797+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.0 v2:172.21.15.47:6800/3978157098 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94327921364784] v29'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4074057030 con 0x7f407c021020 2024-09-12T17:27:58.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.797+0000 7f408ed75800 20 remove_watcher() i=5 2024-09-12T17:27:58.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.797+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94327921363248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3ea360 con 0x7f407c021020 2024-09-12T17:27:58.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.798+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.0 v2:172.21.15.47:6800/3978157098 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94327921363248] v29'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4074057030 con 0x7f407c021020 2024-09-12T17:27:58.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.798+0000 7f408ed75800 20 remove_watcher() i=6 2024-09-12T17:27:58.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.798+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94327921368784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ca6e3ebfd0 con 0x7f407c021020 2024-09-12T17:27:58.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.798+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 <== osd.0 v2:172.21.15.47:6800/3978157098 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94327921368784] v29'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4074057030 con 0x7f407c021020 2024-09-12T17:27:58.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.798+0000 7f408ed75800 20 remove_watcher() i=7 2024-09-12T17:27:58.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.799+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f407c021020 msgr2=0x7f407c00a980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.799+0000 7f408ed75800 1 --2- 172.21.15.170:0/2148226489 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f407c021020 0x7f407c00a980 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.799+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55ca6e3da800 msgr2=0x55ca6e3dccc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.799+0000 7f408ed75800 1 --2- 172.21.15.170:0/2148226489 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55ca6e3da800 0x55ca6e3dccc0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.799+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55ca6e3df210 msgr2=0x55ca6e3e1600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.799+0000 7f408ed75800 1 --2- 172.21.15.170:0/2148226489 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55ca6e3df210 0x55ca6e3e1600 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.799+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55ca6e3e3be0 msgr2=0x55ca6e3e60a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.799+0000 7f408ed75800 1 --2- 172.21.15.170:0/2148226489 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55ca6e3e3be0 0x55ca6e3e60a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.799+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3f5803c780 msgr2=0x7f3f5803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.799+0000 7f408ed75800 1 --2- 172.21.15.170:0/2148226489 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3f5803c780 0x7f3f5803ec40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x55ca6e3a2060 tx=0x7f4084030000 comp rx=0 tx=0).stop 2024-09-12T17:27:58.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.799+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca6e3c7960 msgr2=0x55ca6e3ceed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.799+0000 7f408ed75800 1 --2- 172.21.15.170:0/2148226489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca6e3c7960 0x55ca6e3ceed0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f407c0154a0 tx=0x7f407c053230 comp rx=0 tx=0).stop 2024-09-12T17:27:58.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.799+0000 7f408c05e640 1 -- 172.21.15.170:0/2148226489 reap_dead start 2024-09-12T17:27:58.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.799+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 shutdown_connections 2024-09-12T17:27:58.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.799+0000 7f408ed75800 1 --2- 172.21.15.170:0/2148226489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca6e3c7960 0x55ca6e3ceed0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.799+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 >> 172.21.15.170:0/2148226489 conn(0x55ca6e3c3d60 msgr2=0x55ca6e3c1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:58.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.799+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 shutdown_connections 2024-09-12T17:27:58.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.799+0000 7f408ed75800 1 -- 172.21.15.170:0/2148226489 wait complete. 2024-09-12T17:27:58.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.799+0000 7f408ed75800 1 -- 172.21.15.170:0/2892186064 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3f6403c730 msgr2=0x7f3f6403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.799+0000 7f408ed75800 1 --2- 172.21.15.170:0/2892186064 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3f6403c730 0x7f3f6403ebf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x55ca6e3ac980 tx=0x7f4084019f10 comp rx=0 tx=0).stop 2024-09-12T17:27:58.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.799+0000 7f408ed75800 1 -- 172.21.15.170:0/2892186064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca6e3baea0 msgr2=0x55ca6e3bb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.799+0000 7f408ed75800 1 --2- 172.21.15.170:0/2892186064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca6e3baea0 0x55ca6e3bb2c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55ca6e3a0f70 tx=0x7f407c00bf30 comp rx=0 tx=0).stop 2024-09-12T17:27:58.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.799+0000 7f408ed75800 1 -- 172.21.15.170:0/2892186064 shutdown_connections 2024-09-12T17:27:58.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.799+0000 7f408ed75800 1 --2- 172.21.15.170:0/2892186064 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3f6403c730 0x7f3f6403ebf0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.799+0000 7f408ed75800 1 --2- 172.21.15.170:0/2892186064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca6e3baea0 0x55ca6e3bb2c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.799+0000 7f408ed75800 1 -- 172.21.15.170:0/2892186064 >> 172.21.15.170:0/2892186064 conn(0x55ca6e3af250 msgr2=0x55ca6e3af630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:58.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.799+0000 7f408ed75800 1 -- 172.21.15.170:0/2892186064 shutdown_connections 2024-09-12T17:27:58.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.799+0000 7f408ed75800 1 -- 172.21.15.170:0/2892186064 wait complete. 2024-09-12T17:27:58.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.800+0000 7f408ed75800 1 -- 172.21.15.170:0/1617897127 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55ca6e2aa2c0 msgr2=0x55ca6e3a75c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.800+0000 7f408ed75800 1 --2- 172.21.15.170:0/1617897127 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55ca6e2aa2c0 0x55ca6e3a75c0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.800+0000 7f408ed75800 1 -- 172.21.15.170:0/1617897127 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55ca6e3a99a0 msgr2=0x55ca6e3abe20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.800+0000 7f408ed75800 1 --2- 172.21.15.170:0/1617897127 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55ca6e3a99a0 0x55ca6e3abe20 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.800+0000 7f408ed75800 1 -- 172.21.15.170:0/1617897127 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3f7403c730 msgr2=0x7f3f7403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.800+0000 7f408ed75800 1 --2- 172.21.15.170:0/1617897127 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3f7403c730 0x7f3f7403ebf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4074057000 tx=0x7f4074052000 comp rx=0 tx=0).stop 2024-09-12T17:27:58.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.800+0000 7f408ed75800 1 -- 172.21.15.170:0/1617897127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca6e2a8ff0 msgr2=0x55ca6e39ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.800+0000 7f408ed75800 1 --2- 172.21.15.170:0/1617897127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca6e2a8ff0 0x55ca6e39ff70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4084000f80 tx=0x7f4084001250 comp rx=0 tx=0).stop 2024-09-12T17:27:58.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.800+0000 7f408ed75800 1 -- 172.21.15.170:0/1617897127 shutdown_connections 2024-09-12T17:27:58.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.800+0000 7f408ed75800 1 --2- 172.21.15.170:0/1617897127 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55ca6e3a99a0 0x55ca6e3abe20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.800+0000 7f408ed75800 1 --2- 172.21.15.170:0/1617897127 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3f7403c730 0x7f3f7403ebf0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.800+0000 7f408ed75800 1 --2- 172.21.15.170:0/1617897127 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55ca6e2aa2c0 0x55ca6e3a75c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.800+0000 7f408ed75800 1 --2- 172.21.15.170:0/1617897127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca6e2a8ff0 0x55ca6e39ff70 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.800+0000 7f408ed75800 1 -- 172.21.15.170:0/1617897127 >> 172.21.15.170:0/1617897127 conn(0x55ca6e2a43c0 msgr2=0x55ca6e3998c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:58.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.800+0000 7f408ed75800 1 -- 172.21.15.170:0/1617897127 shutdown_connections 2024-09-12T17:27:58.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.800+0000 7f408ed75800 1 -- 172.21.15.170:0/1617897127 wait complete. 2024-09-12T17:27:58.809 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-12T17:27:58.810 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-12T17:27:58.810 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-12T17:27:58.810 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-12T17:27:58.857 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:58.857 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:58.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.856+0000 7f1f7b52d800 1 Processor -- start 2024-09-12T17:27:58.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.856+0000 7f1f7b52d800 1 -- start start 2024-09-12T17:27:58.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.856+0000 7f1f7b52d800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55b76c229340 0x55b76c22b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.856+0000 7f1f7b52d800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b76c0cee40 con 0x55b76c225740 2024-09-12T17:27:58.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.856+0000 7f1f7b52d800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x55b76c099680 con 0x55b76c229340 2024-09-12T17:27:58.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.857+0000 7f1f6ea75640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55b76c229340 0x55b76c22b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.857+0000 7f1f6ea75640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55b76c229340 0x55b76c22b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56326/0 (socket says 172.21.15.170:56326) 2024-09-12T17:27:58.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.857+0000 7f1f6ea75640 1 -- 172.21.15.170:0/4044436974 learned_addr learned my addr 172.21.15.170:0/4044436974 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:58.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.857+0000 7f1f77276640 1 --1- 172.21.15.170:0/4044436974 >> v1:172.21.15.47:6789/0 conn(0x55b76c225740 0x55b76c227b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:48226/0 (socket says 172.21.15.170:48226) 2024-09-12T17:27:58.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.857+0000 7f1f6ea75640 1 -- 172.21.15.170:0/4044436974 >> v1:172.21.15.47:6789/0 conn(0x55b76c225740 legacy=0x55b76c227b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.857+0000 7f1f6ea75640 1 -- 172.21.15.170:0/4044436974 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b76c0b56b0 con 0x55b76c229340 2024-09-12T17:27:58.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.859+0000 7f1f6ea75640 1 --2- 172.21.15.170:0/4044436974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b76c229340 0x55b76c22b800 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1f6000a520 tx=0x7f1f60045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f258d8d484a735a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.859+0000 7f1f76a75640 1 -- 172.21.15.170:0/4044436974 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f60055070 con 0x55b76c229340 2024-09-12T17:27:58.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.859+0000 7f1f76a75640 1 -- 172.21.15.170:0/4044436974 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f600515b0 con 0x55b76c229340 2024-09-12T17:27:58.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.859+0000 7f1f76a75640 1 -- 172.21.15.170:0/4044436974 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f600518d0 con 0x55b76c229340 2024-09-12T17:27:58.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.860+0000 7f1f7b52d800 1 -- 172.21.15.170:0/4044436974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b76c229340 msgr2=0x55b76c22b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.860+0000 7f1f7b52d800 1 --2- 172.21.15.170:0/4044436974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b76c229340 0x55b76c22b800 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1f6000a520 tx=0x7f1f60045ba0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.860+0000 7f1f7b52d800 1 -- 172.21.15.170:0/4044436974 shutdown_connections 2024-09-12T17:27:58.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.860+0000 7f1f7b52d800 1 --2- 172.21.15.170:0/4044436974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b76c229340 0x55b76c22b800 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.860+0000 7f1f7b52d800 1 -- 172.21.15.170:0/4044436974 >> 172.21.15.170:0/4044436974 conn(0x55b76c21f320 msgr2=0x55b76c221760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:58.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.860+0000 7f1f7b52d800 1 -- 172.21.15.170:0/4044436974 shutdown_connections 2024-09-12T17:27:58.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.860+0000 7f1f7b52d800 1 -- 172.21.15.170:0/4044436974 wait complete. 2024-09-12T17:27:58.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.873+0000 7f1f7b52d800 1 Processor -- start 2024-09-12T17:27:58.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.873+0000 7f1f7b52d800 1 -- start start 2024-09-12T17:27:58.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.874+0000 7f1f7b52d800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b76c225740 0x55b76c224eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.874+0000 7f1f7b52d800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b76c0bddd0 con 0x55b76c225740 2024-09-12T17:27:58.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.874+0000 7f1f77276640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b76c225740 0x55b76c224eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.874+0000 7f1f77276640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b76c225740 0x55b76c224eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56334/0 (socket says 172.21.15.170:56334) 2024-09-12T17:27:58.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.874+0000 7f1f77276640 1 -- 172.21.15.170:0/3751847367 learned_addr learned my addr 172.21.15.170:0/3751847367 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:58.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.874+0000 7f1f77276640 1 -- 172.21.15.170:0/3751847367 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b76c0d6e10 con 0x55b76c225740 2024-09-12T17:27:58.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.874+0000 7f1f77276640 1 --2- 172.21.15.170:0/3751847367 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b76c225740 0x55b76c224eb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1f6800b260 tx=0x7f1f6800b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f234615550f6adcb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.874+0000 7f1e6560a640 1 -- 172.21.15.170:0/3751847367 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f6800be60 con 0x55b76c225740 2024-09-12T17:27:58.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.875+0000 7f1e6560a640 1 -- 172.21.15.170:0/3751847367 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f68006070 con 0x55b76c225740 2024-09-12T17:27:58.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.875+0000 7f1e6560a640 1 -- 172.21.15.170:0/3751847367 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f6800e710 con 0x55b76c225740 2024-09-12T17:27:58.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.875+0000 7f1f7b52d800 1 -- 172.21.15.170:0/3751847367 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b76c225740 msgr2=0x55b76c224eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.875+0000 7f1f7b52d800 1 --2- 172.21.15.170:0/3751847367 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b76c225740 0x55b76c224eb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1f6800b260 tx=0x7f1f6800b660 comp rx=0 tx=0).stop 2024-09-12T17:27:58.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.875+0000 7f1f7b52d800 1 -- 172.21.15.170:0/3751847367 shutdown_connections 2024-09-12T17:27:58.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.875+0000 7f1f7b52d800 1 --2- 172.21.15.170:0/3751847367 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b76c225740 0x55b76c224eb0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.875+0000 7f1f7b52d800 1 -- 172.21.15.170:0/3751847367 >> 172.21.15.170:0/3751847367 conn(0x55b76c21f320 msgr2=0x55b76c3100d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:58.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.875+0000 7f1f7b52d800 1 -- 172.21.15.170:0/3751847367 shutdown_connections 2024-09-12T17:27:58.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.875+0000 7f1f7b52d800 1 -- 172.21.15.170:0/3751847367 wait complete. 2024-09-12T17:27:58.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.876+0000 7f1f7b52d800 1 Processor -- start 2024-09-12T17:27:58.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.876+0000 7f1f7b52d800 1 -- start start 2024-09-12T17:27:58.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.876+0000 7f1f7b52d800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b76c225740 0x55b76c31e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.876+0000 7f1f7b52d800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b76c22c180 con 0x55b76c225740 2024-09-12T17:27:58.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.876+0000 7f1f77276640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b76c225740 0x55b76c31e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.876+0000 7f1f77276640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b76c225740 0x55b76c31e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56336/0 (socket says 172.21.15.170:56336) 2024-09-12T17:27:58.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.876+0000 7f1f77276640 1 -- 172.21.15.170:0/3175992862 learned_addr learned my addr 172.21.15.170:0/3175992862 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:58.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.876+0000 7f1f77276640 1 -- 172.21.15.170:0/3175992862 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b76c31e7f0 con 0x55b76c225740 2024-09-12T17:27:58.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.876+0000 7f1f77276640 1 --2- 172.21.15.170:0/3175992862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b76c225740 0x55b76c31e290 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x55b76c2249e0 tx=0x7f1f68000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.877+0000 7f1e63e07640 1 -- 172.21.15.170:0/3175992862 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f6800f810 con 0x55b76c225740 2024-09-12T17:27:58.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.877+0000 7f1e63e07640 1 -- 172.21.15.170:0/3175992862 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f6800f9b0 con 0x55b76c225740 2024-09-12T17:27:58.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.877+0000 7f1e63e07640 1 -- 172.21.15.170:0/3175992862 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f6800fcd0 con 0x55b76c225740 2024-09-12T17:27:58.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.877+0000 7f1f7b52d800 1 -- 172.21.15.170:0/3175992862 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b76c31ea80 con 0x55b76c225740 2024-09-12T17:27:58.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.877+0000 7f1f7b52d800 1 -- 172.21.15.170:0/3175992862 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b76c31f480 con 0x55b76c225740 2024-09-12T17:27:58.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.877+0000 7f1f7b52d800 1 Processor -- start 2024-09-12T17:27:58.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.877+0000 7f1f7b52d800 1 -- start start 2024-09-12T17:27:58.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.877+0000 7f1f7b52d800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b76c32b780 0x55b76c32db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.877+0000 7f1f7b52d800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b76c11ba00 con 0x55b76c32b780 2024-09-12T17:27:58.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.877+0000 7f1e63e07640 1 -- 172.21.15.170:0/3175992862 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1f68017070 con 0x55b76c225740 2024-09-12T17:27:58.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.878+0000 7f1f77a77640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b76c32b780 0x55b76c32db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.878+0000 7f1f77a77640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b76c32b780 0x55b76c32db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56348/0 (socket says 172.21.15.170:56348) 2024-09-12T17:27:58.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.878+0000 7f1f77a77640 1 -- 172.21.15.170:0/2581621506 learned_addr learned my addr 172.21.15.170:0/2581621506 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:58.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.878+0000 7f1e63e07640 1 --2- 172.21.15.170:0/3175992862 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1e5c03c780 0x7f1e5c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.878+0000 7f1e63e07640 1 -- 172.21.15.170:0/3175992862 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f1f68015020 con 0x55b76c225740 2024-09-12T17:27:58.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.878+0000 7f1f77a77640 1 -- 172.21.15.170:0/2581621506 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b76c32e140 con 0x55b76c32b780 2024-09-12T17:27:58.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.878+0000 7f1f77276640 1 --2- 172.21.15.170:0/3175992862 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1e5c03c780 0x7f1e5c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.878+0000 7f1f77a77640 1 --2- 172.21.15.170:0/2581621506 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b76c32b780 0x55b76c32db70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1f7000a3e0 tx=0x7f1f7000a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=147857477f7327d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.878+0000 7f1e61e03640 1 -- 172.21.15.170:0/2581621506 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f70015070 con 0x55b76c32b780 2024-09-12T17:27:58.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.878+0000 7f1f77276640 1 --2- 172.21.15.170:0/3175992862 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1e5c03c780 0x7f1e5c03ec40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1f6800ef10 tx=0x7f1f6801c6c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.878+0000 7f1e61e03640 1 -- 172.21.15.170:0/2581621506 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f70001670 con 0x55b76c32b780 2024-09-12T17:27:58.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.878+0000 7f1e61e03640 1 -- 172.21.15.170:0/2581621506 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f70001990 con 0x55b76c32b780 2024-09-12T17:27:58.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.879+0000 7f1f7b52d800 1 -- 172.21.15.170:0/2581621506 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b76c32b780 msgr2=0x55b76c32db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.879+0000 7f1f7b52d800 1 --2- 172.21.15.170:0/2581621506 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b76c32b780 0x55b76c32db70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1f7000a3e0 tx=0x7f1f7000a8a0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.879+0000 7f1f7b52d800 1 -- 172.21.15.170:0/2581621506 shutdown_connections 2024-09-12T17:27:58.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.879+0000 7f1f7b52d800 1 --2- 172.21.15.170:0/2581621506 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b76c32b780 0x55b76c32db70 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.879+0000 7f1f7b52d800 1 -- 172.21.15.170:0/2581621506 >> 172.21.15.170:0/2581621506 conn(0x55b76c229340 msgr2=0x55b76c3260a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:58.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.879+0000 7f1f7b52d800 1 -- 172.21.15.170:0/2581621506 shutdown_connections 2024-09-12T17:27:58.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.879+0000 7f1f7b52d800 1 -- 172.21.15.170:0/2581621506 wait complete. 2024-09-12T17:27:58.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.879+0000 7f1f7b52d800 1 Processor -- start 2024-09-12T17:27:58.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.879+0000 7f1f7b52d800 1 -- start start 2024-09-12T17:27:58.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.879+0000 7f1f7b52d800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b76c32b780 0x55b76c332620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.879+0000 7f1f7b52d800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b76c32e490 con 0x55b76c32b780 2024-09-12T17:27:58.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.879+0000 7f1f77a77640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b76c32b780 0x55b76c332620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.879+0000 7f1f77a77640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b76c32b780 0x55b76c332620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56350/0 (socket says 172.21.15.170:56350) 2024-09-12T17:27:58.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.879+0000 7f1f77a77640 1 -- 172.21.15.170:0/3292792407 learned_addr learned my addr 172.21.15.170:0/3292792407 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:58.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.880+0000 7f1f77a77640 1 -- 172.21.15.170:0/3292792407 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b76c332b80 con 0x55b76c32b780 2024-09-12T17:27:58.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.880+0000 7f1f77a77640 1 --2- 172.21.15.170:0/3292792407 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b76c32b780 0x55b76c332620 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x55b76c326a80 tx=0x7f1f70003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.880+0000 7f1e53fff640 1 -- 172.21.15.170:0/3292792407 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f70020020 con 0x55b76c32b780 2024-09-12T17:27:58.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.880+0000 7f1e53fff640 1 -- 172.21.15.170:0/3292792407 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f70010780 con 0x55b76c32b780 2024-09-12T17:27:58.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.880+0000 7f1f7b52d800 1 -- 172.21.15.170:0/3292792407 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b76c332e10 con 0x55b76c32b780 2024-09-12T17:27:58.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.880+0000 7f1e53fff640 1 -- 172.21.15.170:0/3292792407 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f70015040 con 0x55b76c32b780 2024-09-12T17:27:58.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.880+0000 7f1f7b52d800 1 -- 172.21.15.170:0/3292792407 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b76c333790 con 0x55b76c32b780 2024-09-12T17:27:58.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.881+0000 7f1e53fff640 1 -- 172.21.15.170:0/3292792407 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1f70023020 con 0x55b76c32b780 2024-09-12T17:27:58.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.881+0000 7f1e53fff640 1 --2- 172.21.15.170:0/3292792407 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1e5803c730 0x7f1e5803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.881+0000 7f1e53fff640 1 -- 172.21.15.170:0/3292792407 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f1f70053170 con 0x55b76c32b780 2024-09-12T17:27:58.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.881+0000 7f1f6ea75640 1 --2- 172.21.15.170:0/3292792407 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1e5803c730 0x7f1e5803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.881+0000 7f1f7b52d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:58.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.881+0000 7f1f7b52d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:58.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.882+0000 7f1f7b52d800 1 Processor -- start 2024-09-12T17:27:58.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.882+0000 7f1f6ea75640 1 --2- 172.21.15.170:0/3292792407 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1e5803c730 0x7f1e5803ebf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1f60057000 tx=0x7f1f60052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.882+0000 7f1f7b52d800 1 -- start start 2024-09-12T17:27:58.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.882+0000 7f1f7b52d800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b76c34c4d0 0x55b76c34c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.882+0000 7f1f7b52d800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b76c223750 con 0x55b76c34c4d0 2024-09-12T17:27:58.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.882+0000 7f1f77276640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b76c34c4d0 0x55b76c34c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.882+0000 7f1f77276640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b76c34c4d0 0x55b76c34c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56366/0 (socket says 172.21.15.170:56366) 2024-09-12T17:27:58.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.882+0000 7f1f77276640 1 -- 172.21.15.170:0/2793737593 learned_addr learned my addr 172.21.15.170:0/2793737593 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:58.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.883+0000 7f1f77276640 1 -- 172.21.15.170:0/2793737593 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b76c34cf30 con 0x55b76c34c4d0 2024-09-12T17:27:58.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.883+0000 7f1f77276640 1 --2- 172.21.15.170:0/2793737593 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b76c34c4d0 0x55b76c34c8f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1f68000fb0 tx=0x7f1f6801af50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.883+0000 7f1de7fff640 1 -- 172.21.15.170:0/2793737593 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f6801d7f0 con 0x55b76c34c4d0 2024-09-12T17:27:58.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.883+0000 7f1de7fff640 1 -- 172.21.15.170:0/2793737593 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f6801d990 con 0x55b76c34c4d0 2024-09-12T17:27:58.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.883+0000 7f1f7b52d800 1 -- 172.21.15.170:0/2793737593 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b76c34d760 con 0x55b76c34c4d0 2024-09-12T17:27:58.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.883+0000 7f1de7fff640 1 -- 172.21.15.170:0/2793737593 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f6801dc70 con 0x55b76c34c4d0 2024-09-12T17:27:58.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.883+0000 7f1f7b52d800 1 -- 172.21.15.170:0/2793737593 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b76c34dd00 con 0x55b76c34c4d0 2024-09-12T17:27:58.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.884+0000 7f1de7fff640 1 -- 172.21.15.170:0/2793737593 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1f68053890 con 0x55b76c34c4d0 2024-09-12T17:27:58.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.884+0000 7f1de7fff640 1 --2- 172.21.15.170:0/2793737593 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1db003c780 0x7f1db003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.884+0000 7f1de7fff640 1 -- 172.21.15.170:0/2793737593 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f1f68044030 con 0x55b76c34c4d0 2024-09-12T17:27:58.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.884+0000 7f1f6ea75640 1 --2- 172.21.15.170:0/2793737593 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1db003c780 0x7f1db003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.884+0000 7f1de5ffb640 20 reqs_thread_entry: start 2024-09-12T17:27:58.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.884+0000 7f1f7b52d800 1 --2- 172.21.15.170:0/3175992862 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b76c359df0 0x55b76c35c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.884+0000 7f1f7b52d800 1 -- 172.21.15.170:0/3175992862 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b76c35c980 con 0x55b76c359df0 2024-09-12T17:27:58.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.885+0000 7f1f77a77640 1 --2- 172.21.15.170:0/3175992862 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b76c359df0 0x55b76c35c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.885+0000 7f1f6ea75640 1 --2- 172.21.15.170:0/2793737593 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1db003c780 0x7f1db003ec40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1f60045be0 tx=0x7f1f60005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.885+0000 7f1f77a77640 1 --2- 172.21.15.170:0/3175992862 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b76c359df0 0x55b76c35c2b0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.885+0000 7f1f77a77640 1 -- 172.21.15.170:0/3175992862 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1f7000e070 con 0x55b76c359df0 2024-09-12T17:27:58.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.885+0000 7f1f7b52d800 1 --2- 172.21.15.170:0/3175992862 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b76c35e750 0x55b76c360b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.885+0000 7f1f7b52d800 1 -- 172.21.15.170:0/3175992862 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:2 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b76c361230 con 0x55b76c35e750 2024-09-12T17:27:58.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.885+0000 7f1f77276640 1 --2- 172.21.15.170:0/3175992862 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b76c35e750 0x55b76c360b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.885+0000 7f1f77276640 1 --2- 172.21.15.170:0/3175992862 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b76c35e750 0x55b76c360b40 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.886+0000 7f1f77276640 1 -- 172.21.15.170:0/3175992862 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(2 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1f6802e070 con 0x55b76c35e750 2024-09-12T17:27:58.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.886+0000 7f1f7b52d800 1 -- 172.21.15.170:0/3175992862 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b76c35dc50 con 0x55b76c35e750 2024-09-12T17:27:58.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.887+0000 7f1f77276640 1 -- 172.21.15.170:0/3175992862 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [stat,call,call,writefull 0~993] v29'2 uv2 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f1f6802e070 con 0x55b76c35e750 2024-09-12T17:27:58.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.888+0000 7f1f7b52d800 1 -- 172.21.15.170:0/3292792407 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1e5803c730 msgr2=0x7f1e5803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.888+0000 7f1f7b52d800 1 --2- 172.21.15.170:0/3292792407 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1e5803c730 0x7f1e5803ebf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1f60057000 tx=0x7f1f60052000 comp rx=0 tx=0).stop 2024-09-12T17:27:58.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.888+0000 7f1f7b52d800 1 -- 172.21.15.170:0/3292792407 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b76c32b780 msgr2=0x55b76c332620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.888+0000 7f1f7b52d800 1 --2- 172.21.15.170:0/3292792407 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b76c32b780 0x55b76c332620 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x55b76c326a80 tx=0x7f1f70003370 comp rx=0 tx=0).stop 2024-09-12T17:27:58.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.888+0000 7f1f7b52d800 1 -- 172.21.15.170:0/3292792407 shutdown_connections 2024-09-12T17:27:58.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.888+0000 7f1f7b52d800 1 --2- 172.21.15.170:0/3292792407 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1e5803c730 0x7f1e5803ebf0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.888+0000 7f1f7b52d800 1 --2- 172.21.15.170:0/3292792407 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b76c32b780 0x55b76c332620 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.888+0000 7f1f7b52d800 1 -- 172.21.15.170:0/3292792407 >> 172.21.15.170:0/3292792407 conn(0x55b76c229340 msgr2=0x55b76c326070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:58.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.888+0000 7f1f7b52d800 1 -- 172.21.15.170:0/3292792407 shutdown_connections 2024-09-12T17:27:58.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.888+0000 7f1f7b52d800 1 -- 172.21.15.170:0/3292792407 wait complete. 2024-09-12T17:27:58.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.888+0000 7f1f7b52d800 1 -- 172.21.15.170:0/2793737593 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1db003c780 msgr2=0x7f1db003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.888+0000 7f1f7b52d800 1 --2- 172.21.15.170:0/2793737593 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1db003c780 0x7f1db003ec40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1f60045be0 tx=0x7f1f60005ac0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.888+0000 7f1f7b52d800 1 -- 172.21.15.170:0/2793737593 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b76c34c4d0 msgr2=0x55b76c34c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.888+0000 7f1f7b52d800 1 --2- 172.21.15.170:0/2793737593 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b76c34c4d0 0x55b76c34c8f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1f68000fb0 tx=0x7f1f6801af50 comp rx=0 tx=0).stop 2024-09-12T17:27:58.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.888+0000 7f1f7b52d800 1 -- 172.21.15.170:0/2793737593 shutdown_connections 2024-09-12T17:27:58.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.888+0000 7f1f7b52d800 1 --2- 172.21.15.170:0/2793737593 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1db003c780 0x7f1db003ec40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.888+0000 7f1f7b52d800 1 --2- 172.21.15.170:0/2793737593 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b76c34c4d0 0x55b76c34c8f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.889+0000 7f1f7b52d800 1 -- 172.21.15.170:0/2793737593 >> 172.21.15.170:0/2793737593 conn(0x55b76c341a30 msgr2=0x55b76c341e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:58.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.889+0000 7f1f7b52d800 1 -- 172.21.15.170:0/2793737593 shutdown_connections 2024-09-12T17:27:58.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.889+0000 7f1f7b52d800 1 -- 172.21.15.170:0/2793737593 wait complete. 2024-09-12T17:27:58.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.889+0000 7f1f7b52d800 1 -- 172.21.15.170:0/3175992862 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b76c359df0 msgr2=0x55b76c35c2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.889+0000 7f1f7b52d800 1 --2- 172.21.15.170:0/3175992862 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b76c359df0 0x55b76c35c2b0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.889+0000 7f1f7b52d800 1 -- 172.21.15.170:0/3175992862 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b76c35e750 msgr2=0x55b76c360b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.889+0000 7f1f7b52d800 1 --2- 172.21.15.170:0/3175992862 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b76c35e750 0x55b76c360b40 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.889+0000 7f1f7b52d800 1 -- 172.21.15.170:0/3175992862 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1e5c03c780 msgr2=0x7f1e5c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.889+0000 7f1f7b52d800 1 --2- 172.21.15.170:0/3175992862 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1e5c03c780 0x7f1e5c03ec40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1f6800ef10 tx=0x7f1f6801c6c0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.889+0000 7f1f7b52d800 1 -- 172.21.15.170:0/3175992862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b76c225740 msgr2=0x55b76c31e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.889+0000 7f1f7b52d800 1 --2- 172.21.15.170:0/3175992862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b76c225740 0x55b76c31e290 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x55b76c2249e0 tx=0x7f1f68000ed0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.889+0000 7f1f7b52d800 1 -- 172.21.15.170:0/3175992862 shutdown_connections 2024-09-12T17:27:58.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.889+0000 7f1f7b52d800 1 --2- 172.21.15.170:0/3175992862 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b76c35e750 0x55b76c360b40 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.889+0000 7f1f7b52d800 1 --2- 172.21.15.170:0/3175992862 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1e5c03c780 0x7f1e5c03ec40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.889+0000 7f1f7b52d800 1 --2- 172.21.15.170:0/3175992862 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b76c359df0 0x55b76c35c2b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.889+0000 7f1f7b52d800 1 --2- 172.21.15.170:0/3175992862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b76c225740 0x55b76c31e290 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.889+0000 7f1f7b52d800 1 -- 172.21.15.170:0/3175992862 >> 172.21.15.170:0/3175992862 conn(0x55b76c21f320 msgr2=0x55b76c30fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:58.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.889+0000 7f1f7b52d800 1 -- 172.21.15.170:0/3175992862 shutdown_connections 2024-09-12T17:27:58.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.889+0000 7f1f7b52d800 1 -- 172.21.15.170:0/3175992862 wait complete. 2024-09-12T17:27:58.900 INFO:teuthology.orchestra.run.smithi170.stdout:{"id":"7f05c86a-1902-4046-a99f-31d6f38ce8f7","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T17:27:58.900 DEBUG:tasks.util.rgw: json result: {'id': '7f05c86a-1902-4046-a99f-31d6f38ce8f7', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T17:27:58.902 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-12T17:27:58.902 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-12T17:27:58.902 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-12T17:27:58.944 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:58.944 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:58.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.944+0000 7f8facc0e800 1 Processor -- start 2024-09-12T17:27:58.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.944+0000 7f8facc0e800 1 -- start start 2024-09-12T17:27:58.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.944+0000 7f8facc0e800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55b9a5eb6de0 0x55b9a5eb7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.944+0000 7f8facc0e800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b9a5d61e40 con 0x55b9a5eb8020 2024-09-12T17:27:58.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.944+0000 7f8facc0e800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x55b9a5d2c680 con 0x55b9a5eb6de0 2024-09-12T17:27:58.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.944+0000 7f8fa836b640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55b9a5eb6de0 0x55b9a5eb7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.944+0000 7f8fa7b6a640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x55b9a5eb8020 0x55b9a5ebcd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:48240/0 (socket says 172.21.15.170:48240) 2024-09-12T17:27:58.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.944+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/2889118387 learned_addr learned my addr 172.21.15.170:0/2889118387 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:27:58.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.944+0000 7f8fa836b640 1 -- 172.21.15.170:0/2889118387 >> v1:172.21.15.47:6789/0 conn(0x55b9a5eb8020 legacy=0x55b9a5ebcd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.944+0000 7f8fa836b640 1 -- 172.21.15.170:0/2889118387 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9a5d486b0 con 0x55b9a5eb6de0 2024-09-12T17:27:58.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.946+0000 7f8fa836b640 1 --2- 172.21.15.170:0/2889118387 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9a5eb6de0 0x55b9a5eb7ae0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8f9800a470 tx=0x7f8f98045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33598bd6aa71e779 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.946+0000 7f8fa7369640 1 -- 172.21.15.170:0/2889118387 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f98053570 con 0x55b9a5eb6de0 2024-09-12T17:27:58.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.946+0000 7f8fa7369640 1 -- 172.21.15.170:0/2889118387 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f98058070 con 0x55b9a5eb6de0 2024-09-12T17:27:58.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.946+0000 7f8fa7369640 1 -- 172.21.15.170:0/2889118387 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f98053880 con 0x55b9a5eb6de0 2024-09-12T17:27:58.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.947+0000 7f8facc0e800 1 -- 172.21.15.170:0/2889118387 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9a5eb6de0 msgr2=0x55b9a5eb7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.947+0000 7f8facc0e800 1 --2- 172.21.15.170:0/2889118387 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9a5eb6de0 0x55b9a5eb7ae0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8f9800a470 tx=0x7f8f98045a20 comp rx=0 tx=0).stop 2024-09-12T17:27:58.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.947+0000 7f8facc0e800 1 -- 172.21.15.170:0/2889118387 shutdown_connections 2024-09-12T17:27:58.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.947+0000 7f8facc0e800 1 --2- 172.21.15.170:0/2889118387 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9a5eb6de0 0x55b9a5eb7ae0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.947+0000 7f8facc0e800 1 -- 172.21.15.170:0/2889118387 >> 172.21.15.170:0/2889118387 conn(0x55b9a5eb21b0 msgr2=0x55b9a5eb4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:58.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.947+0000 7f8facc0e800 1 -- 172.21.15.170:0/2889118387 shutdown_connections 2024-09-12T17:27:58.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.947+0000 7f8facc0e800 1 -- 172.21.15.170:0/2889118387 wait complete. 2024-09-12T17:27:58.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.960+0000 7f8facc0e800 1 Processor -- start 2024-09-12T17:27:58.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.961+0000 7f8facc0e800 1 -- start start 2024-09-12T17:27:58.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.961+0000 7f8facc0e800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9a5eb6de0 0x55b9a5fa6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.961+0000 7f8facc0e800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b9a5d50dd0 con 0x55b9a5eb6de0 2024-09-12T17:27:58.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.961+0000 7f8fa836b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9a5eb6de0 0x55b9a5fa6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.961+0000 7f8fa836b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9a5eb6de0 0x55b9a5fa6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56388/0 (socket says 172.21.15.170:56388) 2024-09-12T17:27:58.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.961+0000 7f8fa836b640 1 -- 172.21.15.170:0/338269590 learned_addr learned my addr 172.21.15.170:0/338269590 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:58.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.961+0000 7f8fa836b640 1 -- 172.21.15.170:0/338269590 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9a5d69e10 con 0x55b9a5eb6de0 2024-09-12T17:27:58.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.961+0000 7f8fa836b640 1 --2- 172.21.15.170:0/338269590 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9a5eb6de0 0x55b9a5fa6550 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8f98025c20 tx=0x7f8f98051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3864df7aeb8547b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.961+0000 7f8e9660c640 1 -- 172.21.15.170:0/338269590 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f98053a20 con 0x55b9a5eb6de0 2024-09-12T17:27:58.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.962+0000 7f8e9660c640 1 -- 172.21.15.170:0/338269590 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f98063070 con 0x55b9a5eb6de0 2024-09-12T17:27:58.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.962+0000 7f8e9660c640 1 -- 172.21.15.170:0/338269590 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f98053cf0 con 0x55b9a5eb6de0 2024-09-12T17:27:58.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.962+0000 7f8facc0e800 1 -- 172.21.15.170:0/338269590 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9a5eb6de0 msgr2=0x55b9a5fa6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:58.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.962+0000 7f8facc0e800 1 --2- 172.21.15.170:0/338269590 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9a5eb6de0 0x55b9a5fa6550 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8f98025c20 tx=0x7f8f98051000 comp rx=0 tx=0).stop 2024-09-12T17:27:58.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.962+0000 7f8facc0e800 1 -- 172.21.15.170:0/338269590 shutdown_connections 2024-09-12T17:27:58.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.962+0000 7f8facc0e800 1 --2- 172.21.15.170:0/338269590 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9a5eb6de0 0x55b9a5fa6550 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:58.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.962+0000 7f8facc0e800 1 -- 172.21.15.170:0/338269590 >> 172.21.15.170:0/338269590 conn(0x55b9a5eb21b0 msgr2=0x55b9a5fa1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:58.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.962+0000 7f8facc0e800 1 -- 172.21.15.170:0/338269590 shutdown_connections 2024-09-12T17:27:58.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.962+0000 7f8facc0e800 1 -- 172.21.15.170:0/338269590 wait complete. 2024-09-12T17:27:58.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.963+0000 7f8facc0e800 1 Processor -- start 2024-09-12T17:27:58.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.963+0000 7f8facc0e800 1 -- start start 2024-09-12T17:27:58.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.963+0000 7f8facc0e800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9a5eb6de0 0x55b9a5e2ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.963+0000 7f8facc0e800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b9a5eb8710 con 0x55b9a5eb6de0 2024-09-12T17:27:58.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.963+0000 7f8fa836b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9a5eb6de0 0x55b9a5e2ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.963+0000 7f8fa836b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9a5eb6de0 0x55b9a5e2ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56396/0 (socket says 172.21.15.170:56396) 2024-09-12T17:27:58.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.963+0000 7f8fa836b640 1 -- 172.21.15.170:0/1686046252 learned_addr learned my addr 172.21.15.170:0/1686046252 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:58.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.963+0000 7f8fa836b640 1 -- 172.21.15.170:0/1686046252 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9a5e2b2b0 con 0x55b9a5eb6de0 2024-09-12T17:27:58.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.963+0000 7f8fa836b640 1 --2- 172.21.15.170:0/1686046252 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9a5eb6de0 0x55b9a5e2ad50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8f98025c20 tx=0x7f8f98002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.964+0000 7f8e94e09640 1 -- 172.21.15.170:0/1686046252 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f9806c030 con 0x55b9a5eb6de0 2024-09-12T17:27:58.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.964+0000 7f8e94e09640 1 -- 172.21.15.170:0/1686046252 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f98068660 con 0x55b9a5eb6de0 2024-09-12T17:27:58.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.964+0000 7f8facc0e800 1 -- 172.21.15.170:0/1686046252 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b9a5fb1ae0 con 0x55b9a5eb6de0 2024-09-12T17:27:58.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.964+0000 7f8e94e09640 1 -- 172.21.15.170:0/1686046252 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f98068940 con 0x55b9a5eb6de0 2024-09-12T17:27:58.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.964+0000 7f8facc0e800 1 -- 172.21.15.170:0/1686046252 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9a5fb20a0 con 0x55b9a5eb6de0 2024-09-12T17:27:58.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.965+0000 7f8e94e09640 1 -- 172.21.15.170:0/1686046252 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8f98068ae0 con 0x55b9a5eb6de0 2024-09-12T17:27:58.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.965+0000 7f8e94e09640 1 --2- 172.21.15.170:0/1686046252 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8e9003c730 0x7f8e9003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.965+0000 7f8e94e09640 1 -- 172.21.15.170:0/1686046252 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f8f98097db0 con 0x55b9a5eb6de0 2024-09-12T17:27:58.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.965+0000 7f8fa7b6a640 1 --2- 172.21.15.170:0/1686046252 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8e9003c730 0x7f8e9003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.965+0000 7f8facc0e800 1 --2- 172.21.15.170:0/1686046252 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b9a5eb8020 0x55b9a5fb6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.965+0000 7f8facc0e800 1 -- 172.21.15.170:0/1686046252 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5fb6680 con 0x55b9a5eb8020 2024-09-12T17:27:58.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.965+0000 7f8fa8b6c640 1 --2- 172.21.15.170:0/1686046252 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b9a5eb8020 0x55b9a5fb6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.965+0000 7f8fa7b6a640 1 --2- 172.21.15.170:0/1686046252 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8e9003c730 0x7f8e9003ebf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c001d70 tx=0x7f8f9c0012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.965+0000 7f8fa8b6c640 1 --2- 172.21.15.170:0/1686046252 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b9a5eb8020 0x55b9a5fb6030 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.966+0000 7f8fa8b6c640 1 -- 172.21.15.170:0/1686046252 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fa000a4d0 con 0x55b9a5eb8020 2024-09-12T17:27:58.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.966+0000 7f8facc0e800 1 -- 172.21.15.170:0/1686046252 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5fb6f60 con 0x55b9a5eb8020 2024-09-12T17:27:58.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.966+0000 7f8fa8b6c640 1 -- 172.21.15.170:0/1686046252 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8fa000a4d0 con 0x55b9a5eb8020 2024-09-12T17:27:58.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.966+0000 7f8facc0e800 1 --2- 172.21.15.170:0/1686046252 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b9a5fb8870 0x55b9a5fbad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.966+0000 7f8facc0e800 1 -- 172.21.15.170:0/1686046252 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5fbb4a0 con 0x55b9a5fb8870 2024-09-12T17:27:58.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.966+0000 7f8fa836b640 1 --2- 172.21.15.170:0/1686046252 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b9a5fb8870 0x55b9a5fbad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.966+0000 7f8fa836b640 1 --2- 172.21.15.170:0/1686046252 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b9a5fb8870 0x55b9a5fbad10 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.967+0000 7f8fa836b640 1 -- 172.21.15.170:0/1686046252 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8f98051070 con 0x55b9a5fb8870 2024-09-12T17:27:58.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.967+0000 7f8facc0e800 1 -- 172.21.15.170:0/1686046252 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5fb77b0 con 0x55b9a5eb8020 2024-09-12T17:27:58.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.967+0000 7f8fa8b6c640 1 -- 172.21.15.170:0/1686046252 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8fa000a4d0 con 0x55b9a5eb8020 2024-09-12T17:27:58.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.967+0000 7f8facc0e800 1 -- 172.21.15.170:0/1686046252 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5fb7b90 con 0x55b9a5fb8870 2024-09-12T17:27:58.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.967+0000 7f8fa836b640 1 -- 172.21.15.170:0/1686046252 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8f98051070 con 0x55b9a5fb8870 2024-09-12T17:27:58.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.967+0000 7f8facc0e800 1 Processor -- start 2024-09-12T17:27:58.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.968+0000 7f8facc0e800 1 -- start start 2024-09-12T17:27:58.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.968+0000 7f8facc0e800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9a5fc9d30 0x55b9a5fca150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:58.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.968+0000 7f8facc0e800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b9a5daea00 con 0x55b9a5fc9d30 2024-09-12T17:27:58.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.968+0000 7f8fa8b6c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9a5fc9d30 0x55b9a5fca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:58.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.968+0000 7f8fa8b6c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9a5fc9d30 0x55b9a5fca150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56400/0 (socket says 172.21.15.170:56400) 2024-09-12T17:27:58.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.968+0000 7f8fa8b6c640 1 -- 172.21.15.170:0/4224052115 learned_addr learned my addr 172.21.15.170:0/4224052115 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:58.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.968+0000 7f8fa8b6c640 1 -- 172.21.15.170:0/4224052115 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9a5fca790 con 0x55b9a5fc9d30 2024-09-12T17:27:58.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.968+0000 7f8fa8b6c640 1 --2- 172.21.15.170:0/4224052115 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9a5fc9d30 0x55b9a5fca150 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x55b9a5e2a8f0 tx=0x7f8fa00167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:58.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.969+0000 7f8e8dffb640 1 -- 172.21.15.170:0/4224052115 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fa0013640 con 0x55b9a5fc9d30 2024-09-12T17:27:58.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.969+0000 7f8e8dffb640 1 -- 172.21.15.170:0/4224052115 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fa00137e0 con 0x55b9a5fc9d30 2024-09-12T17:27:58.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.969+0000 7f8e8dffb640 1 -- 172.21.15.170:0/4224052115 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fa0013ae0 con 0x55b9a5fc9d30 2024-09-12T17:27:58.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.969+0000 7f8facc0e800 1 -- 172.21.15.170:0/4224052115 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b9a5fcafc0 con 0x55b9a5fc9d30 2024-09-12T17:27:58.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.969+0000 7f8facc0e800 1 -- 172.21.15.170:0/4224052115 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9a5fcb560 con 0x55b9a5fc9d30 2024-09-12T17:27:59.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.969+0000 7f8e8dffb640 1 -- 172.21.15.170:0/4224052115 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8fa0011040 con 0x55b9a5fc9d30 2024-09-12T17:27:59.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.970+0000 7f8e8dffb640 1 --2- 172.21.15.170:0/4224052115 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8e8003c730 0x7f8e8003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.970+0000 7f8e8dffb640 1 -- 172.21.15.170:0/4224052115 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f8fa000e040 con 0x55b9a5fc9d30 2024-09-12T17:27:59.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.970+0000 7f8fa836b640 1 --2- 172.21.15.170:0/4224052115 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8e8003c730 0x7f8e8003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.970+0000 7f8facc0e800 1 Processor -- start 2024-09-12T17:27:59.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.970+0000 7f8fa836b640 1 --2- 172.21.15.170:0/4224052115 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8e8003c730 0x7f8e8003ebf0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8f98096410 tx=0x7f8f9805fe70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.970+0000 7f8facc0e800 1 -- start start 2024-09-12T17:27:59.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.970+0000 7f8facc0e800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9a5fd6830 0x55b9a5fd6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.970+0000 7f8facc0e800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b9a5fa6d40 con 0x55b9a5fd6830 2024-09-12T17:27:59.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.970+0000 7f8fa8b6c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9a5fd6830 0x55b9a5fd6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.970+0000 7f8fa8b6c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9a5fd6830 0x55b9a5fd6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56406/0 (socket says 172.21.15.170:56406) 2024-09-12T17:27:59.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.970+0000 7f8fa8b6c640 1 -- 172.21.15.170:0/2172239856 learned_addr learned my addr 172.21.15.170:0/2172239856 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:59.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.971+0000 7f8fa8b6c640 1 -- 172.21.15.170:0/2172239856 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9a5fd7220 con 0x55b9a5fd6830 2024-09-12T17:27:59.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.971+0000 7f8fa8b6c640 1 --2- 172.21.15.170:0/2172239856 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9a5fd6830 0x55b9a5fd6c30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0020000 tx=0x7f8fa001f400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9afb0d5944a3077 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.971+0000 7f8e7f7fe640 1 -- 172.21.15.170:0/2172239856 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fa0055040 con 0x55b9a5fd6830 2024-09-12T17:27:59.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.971+0000 7f8e7f7fe640 1 -- 172.21.15.170:0/2172239856 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fa0021960 con 0x55b9a5fd6830 2024-09-12T17:27:59.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.971+0000 7f8e7f7fe640 1 -- 172.21.15.170:0/2172239856 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fa0021440 con 0x55b9a5fd6830 2024-09-12T17:27:59.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.971+0000 7f8facc0e800 1 -- 172.21.15.170:0/2172239856 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9a5fd6830 msgr2=0x55b9a5fd6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.971+0000 7f8facc0e800 1 --2- 172.21.15.170:0/2172239856 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9a5fd6830 0x55b9a5fd6c30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0020000 tx=0x7f8fa001f400 comp rx=0 tx=0).stop 2024-09-12T17:27:59.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.971+0000 7f8facc0e800 1 -- 172.21.15.170:0/2172239856 shutdown_connections 2024-09-12T17:27:59.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.971+0000 7f8facc0e800 1 --2- 172.21.15.170:0/2172239856 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9a5fd6830 0x55b9a5fd6c30 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.971+0000 7f8facc0e800 1 -- 172.21.15.170:0/2172239856 >> 172.21.15.170:0/2172239856 conn(0x55b9a5fd2c50 msgr2=0x55b9a5fd0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:59.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.971+0000 7f8facc0e800 1 -- 172.21.15.170:0/2172239856 shutdown_connections 2024-09-12T17:27:59.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.971+0000 7f8facc0e800 1 -- 172.21.15.170:0/2172239856 wait complete. 2024-09-12T17:27:59.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.972+0000 7f8facc0e800 1 Processor -- start 2024-09-12T17:27:59.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.972+0000 7f8facc0e800 1 -- start start 2024-09-12T17:27:59.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.972+0000 7f8facc0e800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9a5fd6830 0x55b9a5fdde10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.972+0000 7f8facc0e800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b9a5fd7840 con 0x55b9a5fd6830 2024-09-12T17:27:59.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.972+0000 7f8fa8b6c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9a5fd6830 0x55b9a5fdde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.972+0000 7f8fa8b6c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9a5fd6830 0x55b9a5fdde10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56412/0 (socket says 172.21.15.170:56412) 2024-09-12T17:27:59.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.972+0000 7f8fa8b6c640 1 -- 172.21.15.170:0/3649214826 learned_addr learned my addr 172.21.15.170:0/3649214826 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:59.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.972+0000 7f8fa8b6c640 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9a5fde370 con 0x55b9a5fd6830 2024-09-12T17:27:59.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.973+0000 7f8fa8b6c640 1 --2- 172.21.15.170:0/3649214826 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9a5fd6830 0x55b9a5fdde10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0053c90 tx=0x7f8fa0053cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.973+0000 7f8e7dffb640 1 -- 172.21.15.170:0/3649214826 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fa0055050 con 0x55b9a5fd6830 2024-09-12T17:27:59.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.973+0000 7f8e7dffb640 1 -- 172.21.15.170:0/3649214826 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fa001f710 con 0x55b9a5fd6830 2024-09-12T17:27:59.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.973+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b9a5fde600 con 0x55b9a5fd6830 2024-09-12T17:27:59.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.973+0000 7f8e7dffb640 1 -- 172.21.15.170:0/3649214826 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fa00551f0 con 0x55b9a5fd6830 2024-09-12T17:27:59.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.973+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9a5fdef80 con 0x55b9a5fd6830 2024-09-12T17:27:59.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.973+0000 7f8e7dffb640 1 -- 172.21.15.170:0/3649214826 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8fa0055390 con 0x55b9a5fd6830 2024-09-12T17:27:59.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.974+0000 7f8e7dffb640 1 --2- 172.21.15.170:0/3649214826 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8e7003c780 0x7f8e7003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.974+0000 7f8e7dffb640 1 -- 172.21.15.170:0/3649214826 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f8fa004d040 con 0x55b9a5fd6830 2024-09-12T17:27:59.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.974+0000 7f8fa836b640 1 --2- 172.21.15.170:0/3649214826 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8e7003c780 0x7f8e7003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.974+0000 7f8facc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.974+0000 7f8facc0e800 1 --2- 172.21.15.170:0/3649214826 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b9a5fe96f0 0x55b9a5febbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.974+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5fec300 con 0x55b9a5fe96f0 2024-09-12T17:27:59.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.974+0000 7f8fa7b6a640 1 --2- 172.21.15.170:0/3649214826 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b9a5fe96f0 0x55b9a5febbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.974+0000 7f8fa836b640 1 --2- 172.21.15.170:0/3649214826 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8e7003c780 0x7f8e7003ec40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8f98068fd0 tx=0x7f8f98092000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.974+0000 7f8fa7b6a640 1 --2- 172.21.15.170:0/3649214826 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b9a5fe96f0 0x55b9a5febbb0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.975+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f9c009050 con 0x55b9a5fe96f0 2024-09-12T17:27:59.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.975+0000 7f8facc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.975+0000 7f8facc0e800 20 realm 2024-09-12T17:27:59.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.975+0000 7f8facc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.975+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5fe8a90 con 0x55b9a5fe96f0 2024-09-12T17:27:59.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.975+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f9c009050 con 0x55b9a5fe96f0 2024-09-12T17:27:59.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.975+0000 7f8facc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.975+0000 7f8facc0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:59.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.975+0000 7f8facc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.975+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5fecde0 con 0x55b9a5fe96f0 2024-09-12T17:27:59.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.975+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f9c009050 con 0x55b9a5fe96f0 2024-09-12T17:27:59.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.975+0000 7f8facc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.975+0000 7f8facc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.975+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5fed6b0 con 0x55b9a5fe96f0 2024-09-12T17:27:59.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.975+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8f9c009050 con 0x55b9a5fe96f0 2024-09-12T17:27:59.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.975+0000 7f8facc0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:59.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.975+0000 7f8facc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.975+0000 7f8facc0e800 1 --2- 172.21.15.170:0/3649214826 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b9a5fedff0 0x55b9a5ff03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.975+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ff0b20 con 0x55b9a5fedff0 2024-09-12T17:27:59.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.975+0000 7f8fa8b6c640 1 --2- 172.21.15.170:0/3649214826 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b9a5fedff0 0x55b9a5ff03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.976+0000 7f8fa8b6c640 1 --2- 172.21.15.170:0/3649214826 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b9a5fedff0 0x55b9a5ff03e0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.976+0000 7f8fa8b6c640 1 -- 172.21.15.170:0/3649214826 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8fa000a4d0 con 0x55b9a5fedff0 2024-09-12T17:27:59.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.976+0000 7f8facc0e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:27:59.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.976+0000 7f8facc0e800 20 searching for the correct realm 2024-09-12T17:27:59.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.976+0000 7f8facc0e800 1 --2- 172.21.15.170:0/3649214826 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55b9a5ff2ba0 0x55b9a5ff5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.976+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ff5730 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.976+0000 7f8fa836b640 1 --2- 172.21.15.170:0/3649214826 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55b9a5ff2ba0 0x55b9a5ff5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.976+0000 7f8fa836b640 1 --2- 172.21.15.170:0/3649214826 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55b9a5ff2ba0 0x55b9a5ff5060 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.977+0000 7f8fa836b640 1 -- 172.21.15.170:0/3649214826 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f98051070 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.977+0000 7f8fa836b640 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ff5730 con 0x55b9a5fedff0 2024-09-12T17:27:59.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.977+0000 7f8fa8b6c640 1 -- 172.21.15.170:0/3649214826 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa000a4d0 con 0x55b9a5fedff0 2024-09-12T17:27:59.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.977+0000 7f8fa8b6c640 1 --2- 172.21.15.170:0/3649214826 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f8fa0015f40 0x7f8fa00559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.977+0000 7f8fa8b6c640 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ff5730 con 0x7f8fa0015f40 2024-09-12T17:27:59.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.977+0000 7f8fa7b6a640 1 --2- 172.21.15.170:0/3649214826 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f8fa0015f40 0x7f8fa00559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.978+0000 7f8fa7b6a640 1 --2- 172.21.15.170:0/3649214826 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f8fa0015f40 0x7f8fa00559a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.978+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9c009050 con 0x7f8fa0015f40 2024-09-12T17:27:59.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.978+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ff5730 con 0x55b9a5fe96f0 2024-09-12T17:27:59.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.978+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9c009050 con 0x55b9a5fe96f0 2024-09-12T17:27:59.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.978+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ff5730 con 0x55b9a5fe96f0 2024-09-12T17:27:59.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.978+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9c029040 con 0x55b9a5fe96f0 2024-09-12T17:27:59.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.978+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ff5730 con 0x7f8fa0015f40 2024-09-12T17:27:59.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.978+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9c029040 con 0x7f8fa0015f40 2024-09-12T17:27:59.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.979+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ff5730 con 0x7f8fa0015f40 2024-09-12T17:27:59.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.979+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9c029040 con 0x7f8fa0015f40 2024-09-12T17:27:59.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.979+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ff5730 con 0x55b9a5fedff0 2024-09-12T17:27:59.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.979+0000 7f8fa8b6c640 1 -- 172.21.15.170:0/3649214826 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa000a4d0 con 0x55b9a5fedff0 2024-09-12T17:27:59.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.979+0000 7f8fa8b6c640 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ff5730 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.979+0000 7f8fa836b640 1 -- 172.21.15.170:0/3649214826 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f98051070 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.979+0000 7f8fa836b640 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ff5730 con 0x55b9a5fe96f0 2024-09-12T17:27:59.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.979+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9c029040 con 0x55b9a5fe96f0 2024-09-12T17:27:59.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.979+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ff5730 con 0x7f8fa0015f40 2024-09-12T17:27:59.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.980+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9c029040 con 0x7f8fa0015f40 2024-09-12T17:27:59.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.980+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ff5730 con 0x55b9a5fe96f0 2024-09-12T17:27:59.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.980+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9c029040 con 0x55b9a5fe96f0 2024-09-12T17:27:59.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.980+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ff5730 con 0x55b9a5fedff0 2024-09-12T17:27:59.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.980+0000 7f8fa8b6c640 1 -- 172.21.15.170:0/3649214826 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f8fa000a4d0 con 0x55b9a5fedff0 2024-09-12T17:27:59.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.980+0000 7f8fa8b6c640 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ff5730 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.980+0000 7f8fa836b640 1 -- 172.21.15.170:0/3649214826 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f98051070 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.980+0000 7f8fa836b640 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ff5730 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.981+0000 7f8fa836b640 1 -- 172.21.15.170:0/3649214826 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f98051070 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.981+0000 7f8fa836b640 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ff5730 con 0x7f8fa0015f40 2024-09-12T17:27:59.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.981+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9c029040 con 0x7f8fa0015f40 2024-09-12T17:27:59.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.981+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ff5730 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.981+0000 7f8fa836b640 1 -- 172.21.15.170:0/3649214826 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f98051070 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.981+0000 7f8fa836b640 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ff5730 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.981+0000 7f8fa836b640 1 -- 172.21.15.170:0/3649214826 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f98051070 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.981+0000 7f8fa836b640 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ff5730 con 0x55b9a5fe96f0 2024-09-12T17:27:59.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.981+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9c029040 con 0x55b9a5fe96f0 2024-09-12T17:27:59.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.981+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ff5730 con 0x55b9a5fe96f0 2024-09-12T17:27:59.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.982+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8f9c029040 con 0x55b9a5fe96f0 2024-09-12T17:27:59.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.982+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ff5730 con 0x7f8fa0015f40 2024-09-12T17:27:59.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.982+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9c029040 con 0x7f8fa0015f40 2024-09-12T17:27:59.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.982+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ff5730 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.982+0000 7f8fa836b640 1 -- 172.21.15.170:0/3649214826 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f98051070 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.982+0000 7f8fa836b640 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ff5730 con 0x55b9a5fedff0 2024-09-12T17:27:59.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.982+0000 7f8fa8b6c640 1 -- 172.21.15.170:0/3649214826 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa000a4d0 con 0x55b9a5fedff0 2024-09-12T17:27:59.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.982+0000 7f8fa8b6c640 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ff5730 con 0x55b9a5fe96f0 2024-09-12T17:27:59.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.983+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9c029040 con 0x55b9a5fe96f0 2024-09-12T17:27:59.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.983+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ff5730 con 0x7f8fa0015f40 2024-09-12T17:27:59.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.983+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9c029040 con 0x7f8fa0015f40 2024-09-12T17:27:59.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.983+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ff5730 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.983+0000 7f8fa836b640 1 -- 172.21.15.170:0/3649214826 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f98051070 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.983+0000 7f8fa836b640 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ff5730 con 0x7f8fa0015f40 2024-09-12T17:27:59.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.983+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9c029040 con 0x7f8fa0015f40 2024-09-12T17:27:59.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.983+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ff5730 con 0x55b9a5fedff0 2024-09-12T17:27:59.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.984+0000 7f8fa8b6c640 1 -- 172.21.15.170:0/3649214826 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa000a4d0 con 0x55b9a5fedff0 2024-09-12T17:27:59.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.984+0000 7f8fa8b6c640 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ff5730 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.984+0000 7f8fa836b640 1 -- 172.21.15.170:0/3649214826 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f98051070 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.984+0000 7f8fa836b640 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ff5730 con 0x7f8fa0015f40 2024-09-12T17:27:59.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.984+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9c029040 con 0x7f8fa0015f40 2024-09-12T17:27:59.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.984+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ff5730 con 0x55b9a5fe96f0 2024-09-12T17:27:59.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.984+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8f9c029040 con 0x55b9a5fe96f0 2024-09-12T17:27:59.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.984+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ff5730 con 0x55b9a5fedff0 2024-09-12T17:27:59.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.985+0000 7f8fa8b6c640 1 -- 172.21.15.170:0/3649214826 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8fa0066040 con 0x55b9a5fedff0 2024-09-12T17:27:59.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.985+0000 7f8facc0e800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:27:59.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.985+0000 7f8facc0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:59.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.985+0000 7f8facc0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:59.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.985+0000 7f8facc0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:59.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.985+0000 7f8facc0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:59.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.985+0000 7f8facc0e800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:27:59.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.985+0000 7f8facc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.985+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ff15a0 con 0x55b9a5fe96f0 2024-09-12T17:27:59.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.985+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f9c029040 con 0x55b9a5fe96f0 2024-09-12T17:27:59.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.985+0000 7f8facc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.985+0000 7f8facc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.985+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ff1180 con 0x55b9a5fe96f0 2024-09-12T17:27:59.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.985+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8f9c029040 con 0x55b9a5fe96f0 2024-09-12T17:27:59.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.985+0000 7f8facc0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:59.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.985+0000 7f8facc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.985+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ff1f00 con 0x55b9a5fedff0 2024-09-12T17:27:59.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.985+0000 7f8fa8b6c640 1 -- 172.21.15.170:0/3649214826 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8fa0066040 con 0x55b9a5fedff0 2024-09-12T17:27:59.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.985+0000 7f8facc0e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:27:59.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.986+0000 7f8facc0e800 20 zone default found 2024-09-12T17:27:59.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.986+0000 7f8facc0e800 4 Realm: () 2024-09-12T17:27:59.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.986+0000 7f8facc0e800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:27:59.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.986+0000 7f8facc0e800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:27:59.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.986+0000 7f8facc0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:59.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.986+0000 7f8facc0e800 20 zonegroup default 2024-09-12T17:27:59.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.986+0000 7f8facc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.986+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ff1a80 con 0x7f8fa0015f40 2024-09-12T17:27:59.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.986+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8f9c029040 con 0x7f8fa0015f40 2024-09-12T17:27:59.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.986+0000 7f8facc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.986+0000 7f8facc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.986+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ff7f80 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.986+0000 7f8fa836b640 1 -- 172.21.15.170:0/3649214826 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8f98051070 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.986+0000 7f8facc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.986+0000 7f8facc0e800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.986+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ff8340 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.986+0000 7f8fa836b640 1 -- 172.21.15.170:0/3649214826 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8f98051070 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.986+0000 7f8facc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.986+0000 7f8facc0e800 20 started sync module instance, tier type = 2024-09-12T17:27:59.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.986+0000 7f8facc0e800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:27:59.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.986+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ff7410 con 0x55b9a5fedff0 2024-09-12T17:27:59.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.987+0000 7f8fa8b6c640 1 -- 172.21.15.170:0/3649214826 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa0066040 con 0x55b9a5fedff0 2024-09-12T17:27:59.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.987+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94255842293808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ff8c50 con 0x55b9a5fedff0 2024-09-12T17:27:59.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.987+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ff94a0 con 0x55b9a5fe96f0 2024-09-12T17:27:59.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.988+0000 7f8fa8b6c640 1 -- 172.21.15.170:0/3649214826 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94255842293808] v29'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa0066040 con 0x55b9a5fedff0 2024-09-12T17:27:59.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.989+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c029040 con 0x55b9a5fe96f0 2024-09-12T17:27:59.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.989+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94255842297760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ff9130 con 0x55b9a5fe96f0 2024-09-12T17:27:59.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.989+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ff9c50 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.990+0000 7f8fa836b640 1 -- 172.21.15.170:0/3649214826 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f98051070 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.990+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94255842301728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ffa4f0 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.990+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ffafe0 con 0x55b9a5fedff0 2024-09-12T17:27:59.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.990+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94255842297760] v29'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c029040 con 0x55b9a5fe96f0 2024-09-12T17:27:59.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.991+0000 7f8fa836b640 1 -- 172.21.15.170:0/3649214826 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94255842301728] v29'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f98051070 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.991+0000 7f8fa8b6c640 1 -- 172.21.15.170:0/3649214826 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa0066040 con 0x55b9a5fedff0 2024-09-12T17:27:59.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.991+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94255842306736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ffa040 con 0x55b9a5fedff0 2024-09-12T17:27:59.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.991+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ffb880 con 0x55b9a5fe96f0 2024-09-12T17:27:59.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.992+0000 7f8fa8b6c640 1 -- 172.21.15.170:0/3649214826 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94255842306736] v29'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa0066040 con 0x55b9a5fedff0 2024-09-12T17:27:59.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.992+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c029040 con 0x55b9a5fe96f0 2024-09-12T17:27:59.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.992+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94255842298816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ffa040 con 0x55b9a5fe96f0 2024-09-12T17:27:59.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.992+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ffbf20 con 0x7f8fa0015f40 2024-09-12T17:27:59.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.993+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c029040 con 0x7f8fa0015f40 2024-09-12T17:27:59.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.993+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94255842310640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ffbee0 con 0x7f8fa0015f40 2024-09-12T17:27:59.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.993+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ffcf00 con 0x7f8fa0015f40 2024-09-12T17:27:59.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.993+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94255842298816] v29'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c029040 con 0x55b9a5fe96f0 2024-09-12T17:27:59.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.994+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94255842310640] v29'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c029040 con 0x7f8fa0015f40 2024-09-12T17:27:59.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.994+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(56 notify.6 [create] v29'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c029040 con 0x7f8fa0015f40 2024-09-12T17:27:59.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.994+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94255842312976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ffb3d0 con 0x7f8fa0015f40 2024-09-12T17:27:59.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.994+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ffd3b0 con 0x7f8fa0015f40 2024-09-12T17:27:59.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.995+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94255842312976] v29'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c029040 con 0x7f8fa0015f40 2024-09-12T17:27:59.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.995+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(58 notify.7 [create] v29'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c029040 con 0x7f8fa0015f40 2024-09-12T17:27:59.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.995+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94255842314768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ffd3b0 con 0x7f8fa0015f40 2024-09-12T17:27:59.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.995+0000 7f8facc0e800 20 add_watcher() i=0 2024-09-12T17:27:59.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.995+0000 7f8facc0e800 20 add_watcher() i=1 2024-09-12T17:27:59.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.995+0000 7f8facc0e800 20 add_watcher() i=2 2024-09-12T17:27:59.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.995+0000 7f8facc0e800 20 add_watcher() i=3 2024-09-12T17:27:59.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.995+0000 7f8facc0e800 20 add_watcher() i=4 2024-09-12T17:27:59.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.995+0000 7f8facc0e800 20 add_watcher() i=5 2024-09-12T17:27:59.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.995+0000 7f8facc0e800 20 add_watcher() i=6 2024-09-12T17:27:59.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.996+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94255842314768] v29'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c029040 con 0x7f8fa0015f40 2024-09-12T17:27:59.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.996+0000 7f8facc0e800 20 add_watcher() i=7 2024-09-12T17:27:59.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.996+0000 7f8facc0e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:59.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.996+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a60007b0 con 0x55b9a5fe96f0 2024-09-12T17:27:59.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.996+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8f9c029040 con 0x55b9a5fe96f0 2024-09-12T17:27:59.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.996+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94255842316496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b9a5ffdc70 con 0x55b9a5fe96f0 2024-09-12T17:27:59.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.997+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94255842316496] v29'46 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8f9c029040 con 0x55b9a5fe96f0 2024-09-12T17:27:59.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.997+0000 7f8e5e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:59.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.997+0000 7f8facc0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:59.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.997+0000 7f8facc0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:59.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.997+0000 7f8facc0e800 5 note: GC not initialized 2024-09-12T17:27:59.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.998+0000 7f8e5d7e2640 20 reqs_thread_entry: start 2024-09-12T17:27:59.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.998+0000 7f8facc0e800 20 init_complete bucket index max shards: 11 2024-09-12T17:27:59.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.998+0000 7f8facc0e800 20 Filter name: none 2024-09-12T17:27:59.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.998+0000 7f8dceffd640 20 reqs_thread_entry: start 2024-09-12T17:27:59.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.998+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a6033e90 con 0x55b9a5fe96f0 2024-09-12T17:27:59.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.998+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8f9c029040 con 0x55b9a5fe96f0 2024-09-12T17:27:59.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.998+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a6033e90 con 0x55b9a5fedff0 2024-09-12T17:27:59.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.998+0000 7f8fa8b6c640 1 -- 172.21.15.170:0/3649214826 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8fa0066040 con 0x55b9a5fedff0 2024-09-12T17:27:59.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.998+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a6033e90 con 0x55b9a5fe96f0 2024-09-12T17:27:59.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.999+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8f9c029040 con 0x55b9a5fe96f0 2024-09-12T17:27:59.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.999+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a6033e50 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.999+0000 7f8fa836b640 1 -- 172.21.15.170:0/3649214826 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8f98051070 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.999+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a6033e50 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.999+0000 7f8fa836b640 1 -- 172.21.15.170:0/3649214826 <== osd.3 v2:172.21.15.170:6816/2664906588 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8f98051070 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.999+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a6033e50 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.999+0000 7f8fa836b640 1 -- 172.21.15.170:0/3649214826 <== osd.3 v2:172.21.15.170:6816/2664906588 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8f98051070 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:58.999+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a6033e50 con 0x55b9a5fe96f0 2024-09-12T17:27:59.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.000+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8f9c029040 con 0x55b9a5fe96f0 2024-09-12T17:27:59.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.000+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a6033e50 con 0x55b9a5fe96f0 2024-09-12T17:27:59.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.000+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8f9c029040 con 0x55b9a5fe96f0 2024-09-12T17:27:59.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.000+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a6033e50 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.000+0000 7f8fa836b640 1 -- 172.21.15.170:0/3649214826 <== osd.3 v2:172.21.15.170:6816/2664906588 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8f98051070 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.000+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a6033e50 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.000+0000 7f8fa836b640 1 -- 172.21.15.170:0/3649214826 <== osd.3 v2:172.21.15.170:6816/2664906588 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8f98051070 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.000+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a6033e50 con 0x7f8fa0015f40 2024-09-12T17:27:59.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.001+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c029040 con 0x7f8fa0015f40 2024-09-12T17:27:59.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.001+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a6033e50 con 0x55b9a5fe96f0 2024-09-12T17:27:59.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.001+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c029040 con 0x55b9a5fe96f0 2024-09-12T17:27:59.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.001+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a6033e50 con 0x55b9a5fedff0 2024-09-12T17:27:59.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.001+0000 7f8fa8b6c640 1 -- 172.21.15.170:0/3649214826 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8fa0066040 con 0x55b9a5fedff0 2024-09-12T17:27:59.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.001+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a6033e50 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.001+0000 7f8fa836b640 1 -- 172.21.15.170:0/3649214826 <== osd.3 v2:172.21.15.170:6816/2664906588 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8f98051070 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.001+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a6033e50 con 0x7f8fa0015f40 2024-09-12T17:27:59.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.002+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c029040 con 0x7f8fa0015f40 2024-09-12T17:27:59.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.002+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a6033e50 con 0x7f8fa0015f40 2024-09-12T17:27:59.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.002+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c029040 con 0x7f8fa0015f40 2024-09-12T17:27:59.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.002+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a6033e50 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.002+0000 7f8fa836b640 1 -- 172.21.15.170:0/3649214826 <== osd.3 v2:172.21.15.170:6816/2664906588 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8f98051070 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.002+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a6033e50 con 0x7f8fa0015f40 2024-09-12T17:27:59.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.002+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c029040 con 0x7f8fa0015f40 2024-09-12T17:27:59.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.002+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a6033e50 con 0x55b9a5fe96f0 2024-09-12T17:27:59.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.003+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c029040 con 0x55b9a5fe96f0 2024-09-12T17:27:59.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.003+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a6033e50 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.003+0000 7f8fa836b640 1 -- 172.21.15.170:0/3649214826 <== osd.3 v2:172.21.15.170:6816/2664906588 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8f98051070 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.003+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a6033e50 con 0x7f8fa0015f40 2024-09-12T17:27:59.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.003+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c029040 con 0x7f8fa0015f40 2024-09-12T17:27:59.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.003+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a6033e50 con 0x55b9a5fedff0 2024-09-12T17:27:59.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.003+0000 7f8fa8b6c640 1 -- 172.21.15.170:0/3649214826 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8fa0066040 con 0x55b9a5fedff0 2024-09-12T17:27:59.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.003+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a6033e50 con 0x7f8fa0015f40 2024-09-12T17:27:59.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.004+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.0 v2:172.21.15.47:6800/3978157098 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c029040 con 0x7f8fa0015f40 2024-09-12T17:27:59.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.004+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a6033e50 con 0x55b9a5fe96f0 2024-09-12T17:27:59.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.004+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c029040 con 0x55b9a5fe96f0 2024-09-12T17:27:59.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.004+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a6033e50 con 0x55b9a5fe96f0 2024-09-12T17:27:59.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.004+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c029040 con 0x55b9a5fe96f0 2024-09-12T17:27:59.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.004+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a6033e50 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.004+0000 7f8fa836b640 1 -- 172.21.15.170:0/3649214826 <== osd.3 v2:172.21.15.170:6816/2664906588 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8f98051070 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.004+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a6033e50 con 0x55b9a5fe96f0 2024-09-12T17:27:59.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.004+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c029040 con 0x55b9a5fe96f0 2024-09-12T17:27:59.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.004+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a6033e50 con 0x55b9a5fe96f0 2024-09-12T17:27:59.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.005+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.1 v2:172.21.15.170:6800/1903654092 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c029040 con 0x55b9a5fe96f0 2024-09-12T17:27:59.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.005+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a6033e50 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.005+0000 7f8fa836b640 1 -- 172.21.15.170:0/3649214826 <== osd.3 v2:172.21.15.170:6816/2664906588 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8f98051070 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.005+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a6033e50 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.005+0000 7f8fa836b640 1 -- 172.21.15.170:0/3649214826 <== osd.3 v2:172.21.15.170:6816/2664906588 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8f98051070 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.005+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a6033e50 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.005+0000 7f8fa836b640 1 -- 172.21.15.170:0/3649214826 <== osd.3 v2:172.21.15.170:6816/2664906588 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8f98051070 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.005+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b9a6033e50 con 0x7f8fa0015f40 2024-09-12T17:27:59.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.006+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.0 v2:172.21.15.47:6800/3978157098 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c029040 con 0x7f8fa0015f40 2024-09-12T17:27:59.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.006+0000 7f8e5e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:59.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.006+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94255842316496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b9a6033e50 con 0x55b9a5fe96f0 2024-09-12T17:27:59.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.007+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.1 v2:172.21.15.170:6800/1903654092 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94255842316496] v29'47 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8f9c029040 con 0x55b9a5fe96f0 2024-09-12T17:27:59.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.007+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94255842293808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b9a6033e50 con 0x55b9a5fedff0 2024-09-12T17:27:59.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.008+0000 7f8fa8b6c640 1 -- 172.21.15.170:0/3649214826 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94255842293808] v29'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa0066040 con 0x55b9a5fedff0 2024-09-12T17:27:59.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.008+0000 7f8facc0e800 20 remove_watcher() i=0 2024-09-12T17:27:59.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.008+0000 7f8facc0e800 2 removed watcher, disabling cache 2024-09-12T17:27:59.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.008+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94255842297760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b9a6033e50 con 0x55b9a5fe96f0 2024-09-12T17:27:59.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.010+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.1 v2:172.21.15.170:6800/1903654092 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94255842297760] v29'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c029040 con 0x55b9a5fe96f0 2024-09-12T17:27:59.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.010+0000 7f8facc0e800 20 remove_watcher() i=1 2024-09-12T17:27:59.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.010+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94255842301728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b9a6033e50 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.011+0000 7f8fa836b640 1 -- 172.21.15.170:0/3649214826 <== osd.3 v2:172.21.15.170:6816/2664906588 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94255842301728] v29'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f98051070 con 0x55b9a5ff2ba0 2024-09-12T17:27:59.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.011+0000 7f8facc0e800 20 remove_watcher() i=2 2024-09-12T17:27:59.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.011+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94255842306736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b9a6033e50 con 0x55b9a5fedff0 2024-09-12T17:27:59.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.012+0000 7f8fa8b6c640 1 -- 172.21.15.170:0/3649214826 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94255842306736] v29'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa0066040 con 0x55b9a5fedff0 2024-09-12T17:27:59.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.012+0000 7f8facc0e800 20 remove_watcher() i=3 2024-09-12T17:27:59.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.012+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94255842298816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b9a6033e50 con 0x55b9a5fe96f0 2024-09-12T17:27:59.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.012+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.1 v2:172.21.15.170:6800/1903654092 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94255842298816] v29'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c029040 con 0x55b9a5fe96f0 2024-09-12T17:27:59.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.013+0000 7f8facc0e800 20 remove_watcher() i=4 2024-09-12T17:27:59.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.013+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94255842310640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b9a6033e50 con 0x7f8fa0015f40 2024-09-12T17:27:59.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.013+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.0 v2:172.21.15.47:6800/3978157098 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94255842310640] v29'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c029040 con 0x7f8fa0015f40 2024-09-12T17:27:59.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.013+0000 7f8facc0e800 20 remove_watcher() i=5 2024-09-12T17:27:59.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.013+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94255842312976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b9a6033e50 con 0x7f8fa0015f40 2024-09-12T17:27:59.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.014+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.0 v2:172.21.15.47:6800/3978157098 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94255842312976] v29'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c029040 con 0x7f8fa0015f40 2024-09-12T17:27:59.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.014+0000 7f8facc0e800 20 remove_watcher() i=6 2024-09-12T17:27:59.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.014+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94255842314768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b9a6033e50 con 0x7f8fa0015f40 2024-09-12T17:27:59.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.015+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 <== osd.0 v2:172.21.15.47:6800/3978157098 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94255842314768] v29'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c029040 con 0x7f8fa0015f40 2024-09-12T17:27:59.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.015+0000 7f8facc0e800 20 remove_watcher() i=7 2024-09-12T17:27:59.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.015+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f8fa0015f40 msgr2=0x7f8fa00559a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.015+0000 7f8facc0e800 1 --2- 172.21.15.170:0/3649214826 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f8fa0015f40 0x7f8fa00559a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.015+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b9a5fe96f0 msgr2=0x55b9a5febbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.015+0000 7f8facc0e800 1 --2- 172.21.15.170:0/3649214826 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b9a5fe96f0 0x55b9a5febbb0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.015+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b9a5fedff0 msgr2=0x55b9a5ff03e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.015+0000 7f8facc0e800 1 --2- 172.21.15.170:0/3649214826 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b9a5fedff0 0x55b9a5ff03e0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.015+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55b9a5ff2ba0 msgr2=0x55b9a5ff5060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.015+0000 7f8facc0e800 1 --2- 172.21.15.170:0/3649214826 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55b9a5ff2ba0 0x55b9a5ff5060 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.016+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8e7003c780 msgr2=0x7f8e7003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.016+0000 7f8facc0e800 1 --2- 172.21.15.170:0/3649214826 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8e7003c780 0x7f8e7003ec40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8f98068fd0 tx=0x7f8f98092000 comp rx=0 tx=0).stop 2024-09-12T17:27:59.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.016+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9a5fd6830 msgr2=0x55b9a5fdde10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.016+0000 7f8facc0e800 1 --2- 172.21.15.170:0/3649214826 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9a5fd6830 0x55b9a5fdde10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0053c90 tx=0x7f8fa0053cf0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.016+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 reap_dead start 2024-09-12T17:27:59.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.016+0000 7f8fa7b6a640 1 -- 172.21.15.170:0/3649214826 reap_dead start 2024-09-12T17:27:59.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.016+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 shutdown_connections 2024-09-12T17:27:59.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.016+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 >> 172.21.15.170:0/3649214826 conn(0x55b9a5fd2c50 msgr2=0x55b9a5fd0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:59.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.016+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 shutdown_connections 2024-09-12T17:27:59.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.016+0000 7f8facc0e800 1 -- 172.21.15.170:0/3649214826 wait complete. 2024-09-12T17:27:59.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.016+0000 7f8facc0e800 1 -- 172.21.15.170:0/4224052115 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8e8003c730 msgr2=0x7f8e8003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.016+0000 7f8facc0e800 1 --2- 172.21.15.170:0/4224052115 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8e8003c730 0x7f8e8003ebf0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8f98096410 tx=0x7f8f9805fe70 comp rx=0 tx=0).stop 2024-09-12T17:27:59.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.016+0000 7f8facc0e800 1 -- 172.21.15.170:0/4224052115 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9a5fc9d30 msgr2=0x55b9a5fca150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.016+0000 7f8facc0e800 1 --2- 172.21.15.170:0/4224052115 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9a5fc9d30 0x55b9a5fca150 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x55b9a5e2a8f0 tx=0x7f8fa00167b0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.016+0000 7f8facc0e800 1 -- 172.21.15.170:0/4224052115 shutdown_connections 2024-09-12T17:27:59.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.016+0000 7f8facc0e800 1 --2- 172.21.15.170:0/4224052115 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8e8003c730 0x7f8e8003ebf0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.016+0000 7f8facc0e800 1 --2- 172.21.15.170:0/4224052115 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9a5fc9d30 0x55b9a5fca150 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.016+0000 7f8facc0e800 1 -- 172.21.15.170:0/4224052115 >> 172.21.15.170:0/4224052115 conn(0x55b9a5fbe0e0 msgr2=0x55b9a5fbe4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:59.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.016+0000 7f8facc0e800 1 -- 172.21.15.170:0/4224052115 shutdown_connections 2024-09-12T17:27:59.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.016+0000 7f8facc0e800 1 -- 172.21.15.170:0/4224052115 wait complete. 2024-09-12T17:27:59.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.016+0000 7f8facc0e800 1 -- 172.21.15.170:0/1686046252 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b9a5eb8020 msgr2=0x55b9a5fb6030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.016+0000 7f8facc0e800 1 --2- 172.21.15.170:0/1686046252 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b9a5eb8020 0x55b9a5fb6030 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.016+0000 7f8facc0e800 1 -- 172.21.15.170:0/1686046252 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b9a5fb8870 msgr2=0x55b9a5fbad10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.016+0000 7f8facc0e800 1 --2- 172.21.15.170:0/1686046252 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b9a5fb8870 0x55b9a5fbad10 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.017+0000 7f8facc0e800 1 -- 172.21.15.170:0/1686046252 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8e9003c730 msgr2=0x7f8e9003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.017+0000 7f8facc0e800 1 --2- 172.21.15.170:0/1686046252 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8e9003c730 0x7f8e9003ebf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c001d70 tx=0x7f8f9c0012d0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.017+0000 7f8facc0e800 1 -- 172.21.15.170:0/1686046252 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9a5eb6de0 msgr2=0x55b9a5e2ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.017+0000 7f8facc0e800 1 --2- 172.21.15.170:0/1686046252 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9a5eb6de0 0x55b9a5e2ad50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8f98025c20 tx=0x7f8f98002fb0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.017+0000 7f8facc0e800 1 -- 172.21.15.170:0/1686046252 shutdown_connections 2024-09-12T17:27:59.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.017+0000 7f8facc0e800 1 --2- 172.21.15.170:0/1686046252 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b9a5fb8870 0x55b9a5fbad10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.017+0000 7f8facc0e800 1 --2- 172.21.15.170:0/1686046252 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8e9003c730 0x7f8e9003ebf0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.017+0000 7f8facc0e800 1 --2- 172.21.15.170:0/1686046252 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b9a5eb8020 0x55b9a5fb6030 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.017+0000 7f8facc0e800 1 --2- 172.21.15.170:0/1686046252 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b9a5eb6de0 0x55b9a5e2ad50 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.017+0000 7f8facc0e800 1 -- 172.21.15.170:0/1686046252 >> 172.21.15.170:0/1686046252 conn(0x55b9a5eb21b0 msgr2=0x55b9a5fa06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:59.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.017+0000 7f8facc0e800 1 -- 172.21.15.170:0/1686046252 shutdown_connections 2024-09-12T17:27:59.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.017+0000 7f8facc0e800 1 -- 172.21.15.170:0/1686046252 wait complete. 2024-09-12T17:27:59.064 INFO:teuthology.orchestra.run.smithi170.stdout:{"entries":[],"summary":[]} 2024-09-12T17:27:59.064 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-12T17:27:59.064 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-12T17:27:59.064 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-12T17:27:59.065 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-12T17:27:59.149 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:59.149 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:59.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.148+0000 7fc2da923800 1 Processor -- start 2024-09-12T17:27:59.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.148+0000 7fc2da923800 1 -- start start 2024-09-12T17:27:59.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.148+0000 7fc2da923800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x56352a1d9600 0x56352a1db9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.148+0000 7fc2da923800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56352a082e40 con 0x56352a1dc020 2024-09-12T17:27:59.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.148+0000 7fc2da923800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x56352a04d680 con 0x56352a1d9600 2024-09-12T17:27:59.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.148+0000 7fc2d6613640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x56352a1d9600 0x56352a1db9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.148+0000 7fc2d5e12640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x56352a1dc020 0x56352a1de4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:48244/0 (socket says 172.21.15.170:48244) 2024-09-12T17:27:59.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.148+0000 7fc2d6613640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x56352a1d9600 0x56352a1db9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56426/0 (socket says 172.21.15.170:56426) 2024-09-12T17:27:59.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.148+0000 7fc2d5e12640 1 -- 172.21.15.170:0/4280541380 learned_addr learned my addr 172.21.15.170:0/4280541380 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:27:59.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.149+0000 7fc2d6613640 1 -- 172.21.15.170:0/4280541380 >> v1:172.21.15.47:6789/0 conn(0x56352a1dc020 legacy=0x56352a1de4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.149+0000 7fc2d6613640 1 -- 172.21.15.170:0/4280541380 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56352a0696b0 con 0x56352a1d9600 2024-09-12T17:27:59.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.150+0000 7fc2d6613640 1 --2- 172.21.15.170:0/4280541380 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56352a1d9600 0x56352a1db9f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8005fd0 tx=0x7fc2c8045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc42dae14158d0b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.151+0000 7fc2d5611640 1 -- 172.21.15.170:0/4280541380 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2c8058530 con 0x56352a1d9600 2024-09-12T17:27:59.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.151+0000 7fc2d5611640 1 -- 172.21.15.170:0/4280541380 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2c80586d0 con 0x56352a1d9600 2024-09-12T17:27:59.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.151+0000 7fc2d5611640 1 -- 172.21.15.170:0/4280541380 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2c80589d0 con 0x56352a1d9600 2024-09-12T17:27:59.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.151+0000 7fc2da923800 1 -- 172.21.15.170:0/4280541380 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56352a1d9600 msgr2=0x56352a1db9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.151+0000 7fc2da923800 1 --2- 172.21.15.170:0/4280541380 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56352a1d9600 0x56352a1db9f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8005fd0 tx=0x7fc2c8045c30 comp rx=0 tx=0).stop 2024-09-12T17:27:59.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.151+0000 7fc2da923800 1 -- 172.21.15.170:0/4280541380 shutdown_connections 2024-09-12T17:27:59.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.151+0000 7fc2da923800 1 --2- 172.21.15.170:0/4280541380 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56352a1d9600 0x56352a1db9f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.151+0000 7fc2da923800 1 -- 172.21.15.170:0/4280541380 >> 172.21.15.170:0/4280541380 conn(0x56352a1d31c0 msgr2=0x56352a1d5620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:59.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.151+0000 7fc2da923800 1 -- 172.21.15.170:0/4280541380 shutdown_connections 2024-09-12T17:27:59.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.151+0000 7fc2da923800 1 -- 172.21.15.170:0/4280541380 wait complete. 2024-09-12T17:27:59.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.165+0000 7fc2da923800 1 Processor -- start 2024-09-12T17:27:59.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.165+0000 7fc2da923800 1 -- start start 2024-09-12T17:27:59.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.165+0000 7fc2da923800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56352a1d9600 0x56352a2c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.165+0000 7fc2da923800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56352a071dd0 con 0x56352a1d9600 2024-09-12T17:27:59.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.165+0000 7fc2d6613640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56352a1d9600 0x56352a2c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.166+0000 7fc2d6613640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56352a1d9600 0x56352a2c86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56434/0 (socket says 172.21.15.170:56434) 2024-09-12T17:27:59.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.166+0000 7fc2d6613640 1 -- 172.21.15.170:0/555723228 learned_addr learned my addr 172.21.15.170:0/555723228 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:59.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.166+0000 7fc2d6613640 1 -- 172.21.15.170:0/555723228 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56352a08ae10 con 0x56352a1d9600 2024-09-12T17:27:59.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.166+0000 7fc2d6613640 1 --2- 172.21.15.170:0/555723228 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56352a1d9600 0x56352a2c86b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8025a60 tx=0x7fc2c8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=730ce252d98ba340 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.166+0000 7fc1c4608640 1 -- 172.21.15.170:0/555723228 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2c80589b0 con 0x56352a1d9600 2024-09-12T17:27:59.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.166+0000 7fc1c4608640 1 -- 172.21.15.170:0/555723228 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2c8068070 con 0x56352a1d9600 2024-09-12T17:27:59.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.166+0000 7fc1c4608640 1 -- 172.21.15.170:0/555723228 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2c8058c80 con 0x56352a1d9600 2024-09-12T17:27:59.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.167+0000 7fc2da923800 1 -- 172.21.15.170:0/555723228 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56352a1d9600 msgr2=0x56352a2c86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.167+0000 7fc2da923800 1 --2- 172.21.15.170:0/555723228 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56352a1d9600 0x56352a2c86b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8025a60 tx=0x7fc2c8051000 comp rx=0 tx=0).stop 2024-09-12T17:27:59.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.167+0000 7fc2da923800 1 -- 172.21.15.170:0/555723228 shutdown_connections 2024-09-12T17:27:59.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.167+0000 7fc2da923800 1 --2- 172.21.15.170:0/555723228 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56352a1d9600 0x56352a2c86b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.167+0000 7fc2da923800 1 -- 172.21.15.170:0/555723228 >> 172.21.15.170:0/555723228 conn(0x56352a1d31c0 msgr2=0x56352a2c4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:59.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.167+0000 7fc2da923800 1 -- 172.21.15.170:0/555723228 shutdown_connections 2024-09-12T17:27:59.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.167+0000 7fc2da923800 1 -- 172.21.15.170:0/555723228 wait complete. 2024-09-12T17:27:59.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.167+0000 7fc2da923800 1 Processor -- start 2024-09-12T17:27:59.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.167+0000 7fc2da923800 1 -- start start 2024-09-12T17:27:59.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.167+0000 7fc2da923800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56352a1d9600 0x56352a2cff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.167+0000 7fc2da923800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56352a1e0040 con 0x56352a1d9600 2024-09-12T17:27:59.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.168+0000 7fc2d6613640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56352a1d9600 0x56352a2cff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.168+0000 7fc2d6613640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56352a1d9600 0x56352a2cff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56442/0 (socket says 172.21.15.170:56442) 2024-09-12T17:27:59.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.168+0000 7fc2d6613640 1 -- 172.21.15.170:0/404050532 learned_addr learned my addr 172.21.15.170:0/404050532 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:59.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.168+0000 7fc2d6613640 1 -- 172.21.15.170:0/404050532 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56352a2d0460 con 0x56352a1d9600 2024-09-12T17:27:59.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.168+0000 7fc2d6613640 1 --2- 172.21.15.170:0/404050532 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56352a1d9600 0x56352a2cff00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8025a60 tx=0x7fc2c8003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.168+0000 7fc1c2e05640 1 -- 172.21.15.170:0/404050532 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2c8063650 con 0x56352a1d9600 2024-09-12T17:27:59.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.168+0000 7fc1c2e05640 1 -- 172.21.15.170:0/404050532 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2c80637f0 con 0x56352a1d9600 2024-09-12T17:27:59.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.168+0000 7fc1c2e05640 1 -- 172.21.15.170:0/404050532 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2c8063af0 con 0x56352a1d9600 2024-09-12T17:27:59.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.168+0000 7fc2da923800 1 -- 172.21.15.170:0/404050532 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56352a2d06f0 con 0x56352a1d9600 2024-09-12T17:27:59.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.169+0000 7fc2da923800 1 -- 172.21.15.170:0/404050532 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56352a2d1300 con 0x56352a1d9600 2024-09-12T17:27:59.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.169+0000 7fc1c2e05640 1 -- 172.21.15.170:0/404050532 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc2c8063c90 con 0x56352a1d9600 2024-09-12T17:27:59.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.169+0000 7fc1c2e05640 1 --2- 172.21.15.170:0/404050532 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc1bc03c780 0x7fc1bc03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.169+0000 7fc1c2e05640 1 -- 172.21.15.170:0/404050532 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fc2c8097b70 con 0x56352a1d9600 2024-09-12T17:27:59.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.170+0000 7fc2d5e12640 1 --2- 172.21.15.170:0/404050532 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc1bc03c780 0x7fc1bc03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.170+0000 7fc2da923800 1 --2- 172.21.15.170:0/404050532 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56352a1dc020 0x56352a2d7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.170+0000 7fc2da923800 1 -- 172.21.15.170:0/404050532 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56352a2d7a90 con 0x56352a1dc020 2024-09-12T17:27:59.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.170+0000 7fc2d6e14640 1 --2- 172.21.15.170:0/404050532 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56352a1dc020 0x56352a2d7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.170+0000 7fc2d5e12640 1 --2- 172.21.15.170:0/404050532 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc1bc03c780 0x7fc1bc03ec40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc001d70 tx=0x7fc2cc0012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.170+0000 7fc2d6e14640 1 --2- 172.21.15.170:0/404050532 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56352a1dc020 0x56352a2d7550 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.170+0000 7fc2d6e14640 1 -- 172.21.15.170:0/404050532 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2d00083e0 con 0x56352a1dc020 2024-09-12T17:27:59.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.170+0000 7fc2da923800 1 -- 172.21.15.170:0/404050532 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56352a2d7e30 con 0x56352a1dc020 2024-09-12T17:27:59.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.171+0000 7fc2d6e14640 1 -- 172.21.15.170:0/404050532 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc2d00083e0 con 0x56352a1dc020 2024-09-12T17:27:59.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.171+0000 7fc2da923800 1 --2- 172.21.15.170:0/404050532 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56352a2d98f0 0x56352a2dbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.171+0000 7fc2da923800 1 -- 172.21.15.170:0/404050532 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56352a2dc520 con 0x56352a2d98f0 2024-09-12T17:27:59.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.171+0000 7fc2d6613640 1 --2- 172.21.15.170:0/404050532 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56352a2d98f0 0x56352a2dbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.171+0000 7fc2d6613640 1 --2- 172.21.15.170:0/404050532 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56352a2d98f0 0x56352a2dbd90 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.171+0000 7fc2d6613640 1 -- 172.21.15.170:0/404050532 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc2c80743e0 con 0x56352a2d98f0 2024-09-12T17:27:59.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.171+0000 7fc2da923800 1 -- 172.21.15.170:0/404050532 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56352a2d8680 con 0x56352a1dc020 2024-09-12T17:27:59.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.172+0000 7fc2d6e14640 1 -- 172.21.15.170:0/404050532 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc2d00083e0 con 0x56352a1dc020 2024-09-12T17:27:59.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.172+0000 7fc2da923800 1 -- 172.21.15.170:0/404050532 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56352a2d8a60 con 0x56352a2d98f0 2024-09-12T17:27:59.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.172+0000 7fc2d6613640 1 -- 172.21.15.170:0/404050532 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc2c80743e0 con 0x56352a2d98f0 2024-09-12T17:27:59.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.172+0000 7fc2da923800 1 Processor -- start 2024-09-12T17:27:59.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.172+0000 7fc2da923800 1 -- start start 2024-09-12T17:27:59.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.172+0000 7fc2da923800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56352a1d8dc0 0x56352a1d7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.172+0000 7fc2da923800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56352a0cfa00 con 0x56352a1d8dc0 2024-09-12T17:27:59.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.173+0000 7fc2d6e14640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56352a1d8dc0 0x56352a1d7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.173+0000 7fc2d6e14640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56352a1d8dc0 0x56352a1d7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56446/0 (socket says 172.21.15.170:56446) 2024-09-12T17:27:59.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.173+0000 7fc2d6e14640 1 -- 172.21.15.170:0/3515233105 learned_addr learned my addr 172.21.15.170:0/3515233105 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:59.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.173+0000 7fc2d6e14640 1 -- 172.21.15.170:0/3515233105 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56352a1d92e0 con 0x56352a1d8dc0 2024-09-12T17:27:59.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.173+0000 7fc2d6e14640 1 --2- 172.21.15.170:0/3515233105 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56352a1d8dc0 0x56352a1d7630 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x56352a2d1df0 tx=0x7fc2d000bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.173+0000 7fc1bbfff640 1 -- 172.21.15.170:0/3515233105 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2d001c020 con 0x56352a1d8dc0 2024-09-12T17:27:59.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.173+0000 7fc1bbfff640 1 -- 172.21.15.170:0/3515233105 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2d0007c90 con 0x56352a1d8dc0 2024-09-12T17:27:59.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.173+0000 7fc1bbfff640 1 -- 172.21.15.170:0/3515233105 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2d0018440 con 0x56352a1d8dc0 2024-09-12T17:27:59.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.173+0000 7fc2da923800 1 -- 172.21.15.170:0/3515233105 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56352a1d7b70 con 0x56352a1d8dc0 2024-09-12T17:27:59.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.173+0000 7fc2da923800 1 -- 172.21.15.170:0/3515233105 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56352a1d8110 con 0x56352a1d8dc0 2024-09-12T17:27:59.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.174+0000 7fc1bbfff640 1 -- 172.21.15.170:0/3515233105 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc2d001f020 con 0x56352a1d8dc0 2024-09-12T17:27:59.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.174+0000 7fc1bbfff640 1 --2- 172.21.15.170:0/3515233105 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc1b003c730 0x7fc1b003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.175+0000 7fc1bbfff640 1 -- 172.21.15.170:0/3515233105 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fc2d0054df0 con 0x56352a1d8dc0 2024-09-12T17:27:59.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.175+0000 7fc2d6613640 1 --2- 172.21.15.170:0/3515233105 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc1b003c730 0x7fc1b003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.175+0000 7fc2da923800 1 Processor -- start 2024-09-12T17:27:59.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.175+0000 7fc2da923800 1 -- start start 2024-09-12T17:27:59.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.175+0000 7fc2d6613640 1 --2- 172.21.15.170:0/3515233105 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc1b003c730 0x7fc1b003ebf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8096110 tx=0x7fc2c807e470 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.175+0000 7fc2da923800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56352a2f9aa0 0x56352a2f9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.175+0000 7fc2da923800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56352a2c8e40 con 0x56352a2f9aa0 2024-09-12T17:27:59.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.175+0000 7fc2d6e14640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56352a2f9aa0 0x56352a2f9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.175+0000 7fc2d6e14640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56352a2f9aa0 0x56352a2f9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56450/0 (socket says 172.21.15.170:56450) 2024-09-12T17:27:59.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.175+0000 7fc2d6e14640 1 -- 172.21.15.170:0/1347236973 learned_addr learned my addr 172.21.15.170:0/1347236973 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:59.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.175+0000 7fc2d6e14640 1 -- 172.21.15.170:0/1347236973 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56352a2fa490 con 0x56352a2f9aa0 2024-09-12T17:27:59.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.176+0000 7fc2d6e14640 1 --2- 172.21.15.170:0/1347236973 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56352a2f9aa0 0x56352a2f9ea0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc2d00532d0 tx=0x7fc2d0015970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f87674aceff61201 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.176+0000 7fc1b9ffb640 1 -- 172.21.15.170:0/1347236973 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2d0050020 con 0x56352a2f9aa0 2024-09-12T17:27:59.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.176+0000 7fc1b9ffb640 1 -- 172.21.15.170:0/1347236973 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2d0028d50 con 0x56352a2f9aa0 2024-09-12T17:27:59.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.176+0000 7fc1b9ffb640 1 -- 172.21.15.170:0/1347236973 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2d00174d0 con 0x56352a2f9aa0 2024-09-12T17:27:59.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.176+0000 7fc2da923800 1 -- 172.21.15.170:0/1347236973 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56352a2f9aa0 msgr2=0x56352a2f9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.176+0000 7fc2da923800 1 --2- 172.21.15.170:0/1347236973 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56352a2f9aa0 0x56352a2f9ea0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc2d00532d0 tx=0x7fc2d0015970 comp rx=0 tx=0).stop 2024-09-12T17:27:59.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.176+0000 7fc2da923800 1 -- 172.21.15.170:0/1347236973 shutdown_connections 2024-09-12T17:27:59.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.176+0000 7fc2da923800 1 --2- 172.21.15.170:0/1347236973 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56352a2f9aa0 0x56352a2f9ea0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.176+0000 7fc2da923800 1 -- 172.21.15.170:0/1347236973 >> 172.21.15.170:0/1347236973 conn(0x56352a2f5ea0 msgr2=0x56352a2f40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:59.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.176+0000 7fc2da923800 1 -- 172.21.15.170:0/1347236973 shutdown_connections 2024-09-12T17:27:59.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.176+0000 7fc2da923800 1 -- 172.21.15.170:0/1347236973 wait complete. 2024-09-12T17:27:59.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.177+0000 7fc2da923800 1 Processor -- start 2024-09-12T17:27:59.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.177+0000 7fc2da923800 1 -- start start 2024-09-12T17:27:59.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.177+0000 7fc2da923800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56352a2f9aa0 0x56352a301070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.177+0000 7fc2da923800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56352a2faab0 con 0x56352a2f9aa0 2024-09-12T17:27:59.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.177+0000 7fc2d6e14640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56352a2f9aa0 0x56352a301070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.177+0000 7fc2d6e14640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56352a2f9aa0 0x56352a301070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56456/0 (socket says 172.21.15.170:56456) 2024-09-12T17:27:59.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.177+0000 7fc2d6e14640 1 -- 172.21.15.170:0/3795653785 learned_addr learned my addr 172.21.15.170:0/3795653785 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:59.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.177+0000 7fc2d6e14640 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56352a3015d0 con 0x56352a2f9aa0 2024-09-12T17:27:59.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.177+0000 7fc2d6e14640 1 --2- 172.21.15.170:0/3795653785 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56352a2f9aa0 0x56352a301070 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc2d00206f0 tx=0x7fc2d0053260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.178+0000 7fc1a7fff640 1 -- 172.21.15.170:0/3795653785 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2d002e070 con 0x56352a2f9aa0 2024-09-12T17:27:59.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.178+0000 7fc1a7fff640 1 -- 172.21.15.170:0/3795653785 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2d0028430 con 0x56352a2f9aa0 2024-09-12T17:27:59.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.178+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56352a301860 con 0x56352a2f9aa0 2024-09-12T17:27:59.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.178+0000 7fc1a7fff640 1 -- 172.21.15.170:0/3795653785 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2d004a040 con 0x56352a2f9aa0 2024-09-12T17:27:59.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.178+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56352a3021e0 con 0x56352a2f9aa0 2024-09-12T17:27:59.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.179+0000 7fc1a7fff640 1 -- 172.21.15.170:0/3795653785 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc2d0031070 con 0x56352a2f9aa0 2024-09-12T17:27:59.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.179+0000 7fc1a7fff640 1 --2- 172.21.15.170:0/3795653785 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc1a003c780 0x7fc1a003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.179+0000 7fc1a7fff640 1 -- 172.21.15.170:0/3795653785 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fc2d0034b00 con 0x56352a2f9aa0 2024-09-12T17:27:59.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.179+0000 7fc2d6613640 1 --2- 172.21.15.170:0/3795653785 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc1a003c780 0x7fc1a003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.179+0000 7fc2da923800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.179+0000 7fc2da923800 1 --2- 172.21.15.170:0/3795653785 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56352a30c940 0x56352a30ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.179+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56352a30f550 con 0x56352a30c940 2024-09-12T17:27:59.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.179+0000 7fc2d5e12640 1 --2- 172.21.15.170:0/3795653785 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56352a30c940 0x56352a30ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.179+0000 7fc2d6613640 1 --2- 172.21.15.170:0/3795653785 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc1a003c780 0x7fc1a003ec40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc2c80746f0 tx=0x7fc2c807e520 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.179+0000 7fc2d5e12640 1 --2- 172.21.15.170:0/3795653785 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56352a30c940 0x56352a30ee00 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.180+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2cc009050 con 0x56352a30c940 2024-09-12T17:27:59.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.180+0000 7fc2da923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.180+0000 7fc2da923800 20 realm 2024-09-12T17:27:59.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.180+0000 7fc2da923800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.180+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56352a30bce0 con 0x56352a30c940 2024-09-12T17:27:59.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.180+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2cc009050 con 0x56352a30c940 2024-09-12T17:27:59.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.180+0000 7fc2da923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.180+0000 7fc2da923800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:59.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.180+0000 7fc2da923800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.180+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56352a310030 con 0x56352a30c940 2024-09-12T17:27:59.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.180+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2cc009050 con 0x56352a30c940 2024-09-12T17:27:59.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.180+0000 7fc2da923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.180+0000 7fc2da923800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.180+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56352a310900 con 0x56352a30c940 2024-09-12T17:27:59.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.180+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc2cc009050 con 0x56352a30c940 2024-09-12T17:27:59.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.180+0000 7fc2da923800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:59.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.180+0000 7fc2da923800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.180+0000 7fc2da923800 1 --2- 172.21.15.170:0/3795653785 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56352a311240 0x56352a313630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.180+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56352a313d70 con 0x56352a311240 2024-09-12T17:27:59.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.181+0000 7fc2d6e14640 1 --2- 172.21.15.170:0/3795653785 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56352a311240 0x56352a313630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.181+0000 7fc2d6e14640 1 --2- 172.21.15.170:0/3795653785 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56352a311240 0x56352a313630 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.181+0000 7fc2d6e14640 1 -- 172.21.15.170:0/3795653785 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc2d003a070 con 0x56352a311240 2024-09-12T17:27:59.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.181+0000 7fc2da923800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:27:59.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.181+0000 7fc2da923800 20 searching for the correct realm 2024-09-12T17:27:59.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.181+0000 7fc2da923800 1 --2- 172.21.15.170:0/3795653785 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x56352a315df0 0x56352a3182b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.181+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56352a318980 con 0x56352a315df0 2024-09-12T17:27:59.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.181+0000 7fc2d6613640 1 --2- 172.21.15.170:0/3795653785 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x56352a315df0 0x56352a3182b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.181+0000 7fc2d6613640 1 --2- 172.21.15.170:0/3795653785 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x56352a315df0 0x56352a3182b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.182+0000 7fc2d6613640 1 -- 172.21.15.170:0/3795653785 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2c80743e0 con 0x56352a315df0 2024-09-12T17:27:59.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.182+0000 7fc2d6613640 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56352a318980 con 0x56352a311240 2024-09-12T17:27:59.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.182+0000 7fc2d6e14640 1 -- 172.21.15.170:0/3795653785 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d003a070 con 0x56352a311240 2024-09-12T17:27:59.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.182+0000 7fc2d6e14640 1 --2- 172.21.15.170:0/3795653785 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fc2d0033070 0x7fc2d00343f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.182+0000 7fc2d6e14640 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56352a318980 con 0x7fc2d0033070 2024-09-12T17:27:59.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.182+0000 7fc2d5e12640 1 --2- 172.21.15.170:0/3795653785 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fc2d0033070 0x7fc2d00343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.183+0000 7fc2d5e12640 1 --2- 172.21.15.170:0/3795653785 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fc2d0033070 0x7fc2d00343f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.183+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2cc009050 con 0x7fc2d0033070 2024-09-12T17:27:59.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.183+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56352a318980 con 0x56352a30c940 2024-09-12T17:27:59.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.183+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2cc009050 con 0x56352a30c940 2024-09-12T17:27:59.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.183+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56352a318980 con 0x56352a30c940 2024-09-12T17:27:59.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.184+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2cc029040 con 0x56352a30c940 2024-09-12T17:27:59.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.184+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56352a318980 con 0x7fc2d0033070 2024-09-12T17:27:59.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.184+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2cc029040 con 0x7fc2d0033070 2024-09-12T17:27:59.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.184+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56352a318980 con 0x7fc2d0033070 2024-09-12T17:27:59.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.184+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2cc029040 con 0x7fc2d0033070 2024-09-12T17:27:59.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.184+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56352a318980 con 0x56352a311240 2024-09-12T17:27:59.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.184+0000 7fc2d6e14640 1 -- 172.21.15.170:0/3795653785 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d003a070 con 0x56352a311240 2024-09-12T17:27:59.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.184+0000 7fc2d6e14640 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56352a318980 con 0x56352a315df0 2024-09-12T17:27:59.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.185+0000 7fc2d6613640 1 -- 172.21.15.170:0/3795653785 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2c80743e0 con 0x56352a315df0 2024-09-12T17:27:59.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.185+0000 7fc2d6613640 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56352a318980 con 0x56352a30c940 2024-09-12T17:27:59.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.185+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2cc029040 con 0x56352a30c940 2024-09-12T17:27:59.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.185+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56352a318980 con 0x7fc2d0033070 2024-09-12T17:27:59.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.185+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2cc029040 con 0x7fc2d0033070 2024-09-12T17:27:59.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.185+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56352a318980 con 0x56352a30c940 2024-09-12T17:27:59.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.185+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2cc029040 con 0x56352a30c940 2024-09-12T17:27:59.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.185+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56352a318980 con 0x56352a311240 2024-09-12T17:27:59.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.186+0000 7fc2d6e14640 1 -- 172.21.15.170:0/3795653785 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fc2d003a070 con 0x56352a311240 2024-09-12T17:27:59.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.186+0000 7fc2d6e14640 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56352a318980 con 0x56352a315df0 2024-09-12T17:27:59.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.186+0000 7fc2d6613640 1 -- 172.21.15.170:0/3795653785 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2c80743e0 con 0x56352a315df0 2024-09-12T17:27:59.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.186+0000 7fc2d6613640 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56352a318980 con 0x56352a315df0 2024-09-12T17:27:59.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.186+0000 7fc2d6613640 1 -- 172.21.15.170:0/3795653785 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2c80743e0 con 0x56352a315df0 2024-09-12T17:27:59.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.186+0000 7fc2d6613640 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56352a318980 con 0x7fc2d0033070 2024-09-12T17:27:59.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.186+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2cc029040 con 0x7fc2d0033070 2024-09-12T17:27:59.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.186+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56352a318980 con 0x56352a315df0 2024-09-12T17:27:59.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.187+0000 7fc2d6613640 1 -- 172.21.15.170:0/3795653785 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2c80743e0 con 0x56352a315df0 2024-09-12T17:27:59.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.187+0000 7fc2d6613640 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56352a318980 con 0x56352a315df0 2024-09-12T17:27:59.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.187+0000 7fc2d6613640 1 -- 172.21.15.170:0/3795653785 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2c80743e0 con 0x56352a315df0 2024-09-12T17:27:59.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.187+0000 7fc2d6613640 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56352a318980 con 0x56352a30c940 2024-09-12T17:27:59.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.187+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2cc029040 con 0x56352a30c940 2024-09-12T17:27:59.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.187+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56352a318980 con 0x56352a30c940 2024-09-12T17:27:59.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.187+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc2cc029040 con 0x56352a30c940 2024-09-12T17:27:59.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.187+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56352a318980 con 0x7fc2d0033070 2024-09-12T17:27:59.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.188+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2cc029040 con 0x7fc2d0033070 2024-09-12T17:27:59.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.188+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56352a318980 con 0x56352a315df0 2024-09-12T17:27:59.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.188+0000 7fc2d6613640 1 -- 172.21.15.170:0/3795653785 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2c80743e0 con 0x56352a315df0 2024-09-12T17:27:59.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.188+0000 7fc2d6613640 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56352a318980 con 0x56352a311240 2024-09-12T17:27:59.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.188+0000 7fc2d6e14640 1 -- 172.21.15.170:0/3795653785 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d003a070 con 0x56352a311240 2024-09-12T17:27:59.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.188+0000 7fc2d6e14640 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56352a318980 con 0x56352a30c940 2024-09-12T17:27:59.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.188+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2cc029040 con 0x56352a30c940 2024-09-12T17:27:59.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.188+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56352a318980 con 0x7fc2d0033070 2024-09-12T17:27:59.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.188+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2cc029040 con 0x7fc2d0033070 2024-09-12T17:27:59.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.188+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56352a318980 con 0x56352a315df0 2024-09-12T17:27:59.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.189+0000 7fc2d6613640 1 -- 172.21.15.170:0/3795653785 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2c80743e0 con 0x56352a315df0 2024-09-12T17:27:59.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.189+0000 7fc2d6613640 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56352a318980 con 0x7fc2d0033070 2024-09-12T17:27:59.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.189+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2cc029040 con 0x7fc2d0033070 2024-09-12T17:27:59.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.189+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56352a318980 con 0x56352a311240 2024-09-12T17:27:59.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.189+0000 7fc2d6e14640 1 -- 172.21.15.170:0/3795653785 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d003a070 con 0x56352a311240 2024-09-12T17:27:59.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.189+0000 7fc2d6e14640 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56352a318980 con 0x56352a315df0 2024-09-12T17:27:59.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.189+0000 7fc2d6613640 1 -- 172.21.15.170:0/3795653785 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2c80743e0 con 0x56352a315df0 2024-09-12T17:27:59.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.189+0000 7fc2d6613640 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56352a318980 con 0x7fc2d0033070 2024-09-12T17:27:59.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.190+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2cc029040 con 0x7fc2d0033070 2024-09-12T17:27:59.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.190+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56352a318980 con 0x56352a30c940 2024-09-12T17:27:59.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.190+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc2cc029040 con 0x56352a30c940 2024-09-12T17:27:59.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.190+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56352a318980 con 0x56352a311240 2024-09-12T17:27:59.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.190+0000 7fc2d6e14640 1 -- 172.21.15.170:0/3795653785 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc2d003a070 con 0x56352a311240 2024-09-12T17:27:59.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.190+0000 7fc2da923800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:27:59.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.190+0000 7fc2da923800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:59.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.190+0000 7fc2da923800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:59.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.190+0000 7fc2da923800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:59.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.190+0000 7fc2da923800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:59.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.190+0000 7fc2da923800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:27:59.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.190+0000 7fc2da923800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.190+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56352a3147f0 con 0x56352a30c940 2024-09-12T17:27:59.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.190+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2cc029040 con 0x56352a30c940 2024-09-12T17:27:59.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.190+0000 7fc2da923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.190+0000 7fc2da923800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.190+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56352a3143d0 con 0x56352a30c940 2024-09-12T17:27:59.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.191+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc2cc029040 con 0x56352a30c940 2024-09-12T17:27:59.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.191+0000 7fc2da923800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:59.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.191+0000 7fc2da923800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.191+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56352a315150 con 0x56352a311240 2024-09-12T17:27:59.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.191+0000 7fc2d6e14640 1 -- 172.21.15.170:0/3795653785 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc2d003a070 con 0x56352a311240 2024-09-12T17:27:59.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.191+0000 7fc2da923800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:27:59.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.191+0000 7fc2da923800 20 zone default found 2024-09-12T17:27:59.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.191+0000 7fc2da923800 4 Realm: () 2024-09-12T17:27:59.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.191+0000 7fc2da923800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:27:59.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.191+0000 7fc2da923800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:27:59.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.191+0000 7fc2da923800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:59.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.191+0000 7fc2da923800 20 zonegroup default 2024-09-12T17:27:59.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.191+0000 7fc2da923800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.191+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56352a314cd0 con 0x7fc2d0033070 2024-09-12T17:27:59.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.191+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc2cc029040 con 0x7fc2d0033070 2024-09-12T17:27:59.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.191+0000 7fc2da923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.191+0000 7fc2da923800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.191+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56352a31b1d0 con 0x56352a315df0 2024-09-12T17:27:59.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.192+0000 7fc2d6613640 1 -- 172.21.15.170:0/3795653785 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc2c80743e0 con 0x56352a315df0 2024-09-12T17:27:59.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.192+0000 7fc2da923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.192+0000 7fc2da923800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.192+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56352a31b590 con 0x56352a315df0 2024-09-12T17:27:59.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.192+0000 7fc2d6613640 1 -- 172.21.15.170:0/3795653785 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc2c80743e0 con 0x56352a315df0 2024-09-12T17:27:59.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.192+0000 7fc2da923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.192+0000 7fc2da923800 20 started sync module instance, tier type = 2024-09-12T17:27:59.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.192+0000 7fc2da923800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:27:59.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.192+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56352a31a660 con 0x56352a311240 2024-09-12T17:27:59.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.193+0000 7fc2d6e14640 1 -- 172.21.15.170:0/3795653785 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d003a070 con 0x56352a311240 2024-09-12T17:27:59.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.193+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94786341153712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56352a31a660 con 0x56352a311240 2024-09-12T17:27:59.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.193+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56352a31c050 con 0x56352a30c940 2024-09-12T17:27:59.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.194+0000 7fc2d6e14640 1 -- 172.21.15.170:0/3795653785 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94786341153712] v29'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d003a070 con 0x56352a311240 2024-09-12T17:27:59.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.194+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2cc029040 con 0x56352a30c940 2024-09-12T17:27:59.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.194+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94786341157728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56352a31a660 con 0x56352a30c940 2024-09-12T17:27:59.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.194+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56352a31cb20 con 0x56352a315df0 2024-09-12T17:27:59.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.195+0000 7fc2d6613640 1 -- 172.21.15.170:0/3795653785 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2c80743e0 con 0x56352a315df0 2024-09-12T17:27:59.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.195+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94786341160464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56352a31d3c0 con 0x56352a315df0 2024-09-12T17:27:59.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.195+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56352a31dec0 con 0x56352a311240 2024-09-12T17:27:59.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.195+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94786341157728] v29'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2cc029040 con 0x56352a30c940 2024-09-12T17:27:59.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.196+0000 7fc2d6613640 1 -- 172.21.15.170:0/3795653785 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94786341160464] v29'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2c80743e0 con 0x56352a315df0 2024-09-12T17:27:59.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.196+0000 7fc2d6e14640 1 -- 172.21.15.170:0/3795653785 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d003a070 con 0x56352a311240 2024-09-12T17:27:59.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.196+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94786341162768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56352a31a1b0 con 0x56352a311240 2024-09-12T17:27:59.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.196+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56352a31e760 con 0x56352a30c940 2024-09-12T17:27:59.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.197+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2cc029040 con 0x56352a30c940 2024-09-12T17:27:59.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.197+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94786341167792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56352a31e6d0 con 0x56352a30c940 2024-09-12T17:27:59.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.197+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56352a31f750 con 0x7fc2d0033070 2024-09-12T17:27:59.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.198+0000 7fc2d6e14640 1 -- 172.21.15.170:0/3795653785 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94786341162768] v29'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d003a070 con 0x56352a311240 2024-09-12T17:27:59.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.198+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2cc029040 con 0x7fc2d0033070 2024-09-12T17:27:59.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.198+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94786341167792] v29'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2cc029040 con 0x56352a30c940 2024-09-12T17:27:59.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.198+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94786341171744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56352a31f710 con 0x7fc2d0033070 2024-09-12T17:27:59.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.198+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56352a31eb50 con 0x7fc2d0033070 2024-09-12T17:27:59.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.199+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94786341171744] v29'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2cc029040 con 0x7fc2d0033070 2024-09-12T17:27:59.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.200+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(56 notify.6 [create] v29'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2cc029040 con 0x7fc2d0033070 2024-09-12T17:27:59.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.200+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94786341165488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56352a31fcb0 con 0x7fc2d0033070 2024-09-12T17:27:59.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.200+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56352a3205a0 con 0x7fc2d0033070 2024-09-12T17:27:59.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.201+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94786341165488] v29'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2cc029040 con 0x7fc2d0033070 2024-09-12T17:27:59.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.201+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(58 notify.7 [create] v29'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2cc029040 con 0x7fc2d0033070 2024-09-12T17:27:59.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.201+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94786341174448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56352a3200d0 con 0x7fc2d0033070 2024-09-12T17:27:59.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.201+0000 7fc2da923800 20 add_watcher() i=0 2024-09-12T17:27:59.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.201+0000 7fc2da923800 20 add_watcher() i=1 2024-09-12T17:27:59.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.201+0000 7fc2da923800 20 add_watcher() i=2 2024-09-12T17:27:59.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.201+0000 7fc2da923800 20 add_watcher() i=3 2024-09-12T17:27:59.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.201+0000 7fc2da923800 20 add_watcher() i=4 2024-09-12T17:27:59.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.201+0000 7fc2da923800 20 add_watcher() i=5 2024-09-12T17:27:59.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.201+0000 7fc2da923800 20 add_watcher() i=6 2024-09-12T17:27:59.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.202+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94786341174448] v29'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2cc029040 con 0x7fc2d0033070 2024-09-12T17:27:59.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.202+0000 7fc2da923800 20 add_watcher() i=7 2024-09-12T17:27:59.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.202+0000 7fc2da923800 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:59.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.202+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56352a323a40 con 0x56352a30c940 2024-09-12T17:27:59.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.202+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc2cc029040 con 0x56352a30c940 2024-09-12T17:27:59.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.202+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94786341176672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56352a320f40 con 0x56352a30c940 2024-09-12T17:27:59.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.203+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94786341176672] v29'48 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc2cc029040 con 0x56352a30c940 2024-09-12T17:27:59.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.203+0000 7fc18cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:59.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.203+0000 7fc2da923800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:59.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.203+0000 7fc2da923800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:59.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.203+0000 7fc2da923800 5 note: GC not initialized 2024-09-12T17:27:59.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.204+0000 7fc1077fe640 20 reqs_thread_entry: start 2024-09-12T17:27:59.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.204+0000 7fc2da923800 20 init_complete bucket index max shards: 11 2024-09-12T17:27:59.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.204+0000 7fc2da923800 20 Filter name: none 2024-09-12T17:27:59.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.204+0000 7fc1057fa640 20 reqs_thread_entry: start 2024-09-12T17:27:59.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.204+0000 7fc2da923800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.204+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56352a3565b0 con 0x56352a30c940 2024-09-12T17:27:59.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.204+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fc2cc029040 con 0x56352a30c940 2024-09-12T17:27:59.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.204+0000 7fc2da923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.237 INFO:teuthology.orchestra.run.smithi170.stderr:could not fetch user info: no user info saved 2024-09-12T17:27:59.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.205+0000 7fc18cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:59.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.205+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94786341176672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56352a356570 con 0x56352a30c940 2024-09-12T17:27:59.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.206+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94786341176672] v29'49 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc2cc029040 con 0x56352a30c940 2024-09-12T17:27:59.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.206+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94786341153712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56352a356570 con 0x56352a311240 2024-09-12T17:27:59.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.207+0000 7fc2d6e14640 1 -- 172.21.15.170:0/3795653785 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94786341153712] v29'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d003a070 con 0x56352a311240 2024-09-12T17:27:59.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.207+0000 7fc2da923800 20 remove_watcher() i=0 2024-09-12T17:27:59.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.207+0000 7fc2da923800 2 removed watcher, disabling cache 2024-09-12T17:27:59.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.207+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94786341157728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56352a356570 con 0x56352a30c940 2024-09-12T17:27:59.243 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T17:27:59.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.208+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94786341157728] v29'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2cc029040 con 0x56352a30c940 2024-09-12T17:27:59.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.208+0000 7fc2da923800 20 remove_watcher() i=1 2024-09-12T17:27:59.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.208+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94786341160464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56352a356570 con 0x56352a315df0 2024-09-12T17:27:59.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.209+0000 7fc2d6613640 1 -- 172.21.15.170:0/3795653785 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94786341160464] v29'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2c80743e0 con 0x56352a315df0 2024-09-12T17:27:59.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.209+0000 7fc2da923800 20 remove_watcher() i=2 2024-09-12T17:27:59.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.209+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94786341162768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56352a356570 con 0x56352a311240 2024-09-12T17:27:59.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.210+0000 7fc2d6e14640 1 -- 172.21.15.170:0/3795653785 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94786341162768] v29'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d003a070 con 0x56352a311240 2024-09-12T17:27:59.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.210+0000 7fc2da923800 20 remove_watcher() i=3 2024-09-12T17:27:59.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.210+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94786341167792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56352a356570 con 0x56352a30c940 2024-09-12T17:27:59.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.211+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94786341167792] v29'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2cc029040 con 0x56352a30c940 2024-09-12T17:27:59.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.211+0000 7fc2da923800 20 remove_watcher() i=4 2024-09-12T17:27:59.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.211+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94786341171744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56352a356570 con 0x7fc2d0033070 2024-09-12T17:27:59.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.212+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94786341171744] v29'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2cc029040 con 0x7fc2d0033070 2024-09-12T17:27:59.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.212+0000 7fc2da923800 20 remove_watcher() i=5 2024-09-12T17:27:59.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.212+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94786341165488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56352a356570 con 0x7fc2d0033070 2024-09-12T17:27:59.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.213+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94786341165488] v29'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2cc029040 con 0x7fc2d0033070 2024-09-12T17:27:59.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.213+0000 7fc2da923800 20 remove_watcher() i=6 2024-09-12T17:27:59.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.213+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94786341174448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56352a356570 con 0x7fc2d0033070 2024-09-12T17:27:59.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.214+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94786341174448] v29'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2cc029040 con 0x7fc2d0033070 2024-09-12T17:27:59.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.214+0000 7fc2da923800 20 remove_watcher() i=7 2024-09-12T17:27:59.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.214+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fc2d0033070 msgr2=0x7fc2d00343f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.214+0000 7fc2da923800 1 --2- 172.21.15.170:0/3795653785 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fc2d0033070 0x7fc2d00343f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.214+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56352a30c940 msgr2=0x56352a30ee00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.214+0000 7fc2da923800 1 --2- 172.21.15.170:0/3795653785 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56352a30c940 0x56352a30ee00 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.214+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56352a311240 msgr2=0x56352a313630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.214+0000 7fc2da923800 1 --2- 172.21.15.170:0/3795653785 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56352a311240 0x56352a313630 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.214+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x56352a315df0 msgr2=0x56352a3182b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.214+0000 7fc2da923800 1 --2- 172.21.15.170:0/3795653785 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x56352a315df0 0x56352a3182b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.214+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc1a003c780 msgr2=0x7fc1a003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.214+0000 7fc2da923800 1 --2- 172.21.15.170:0/3795653785 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc1a003c780 0x7fc1a003ec40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc2c80746f0 tx=0x7fc2c807e520 comp rx=0 tx=0).stop 2024-09-12T17:27:59.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.214+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56352a2f9aa0 msgr2=0x56352a301070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.214+0000 7fc2da923800 1 --2- 172.21.15.170:0/3795653785 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56352a2f9aa0 0x56352a301070 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc2d00206f0 tx=0x7fc2d0053260 comp rx=0 tx=0).stop 2024-09-12T17:27:59.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.214+0000 7fc2d5e12640 1 -- 172.21.15.170:0/3795653785 reap_dead start 2024-09-12T17:27:59.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.214+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 shutdown_connections 2024-09-12T17:27:59.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.214+0000 7fc2da923800 1 --2- 172.21.15.170:0/3795653785 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56352a2f9aa0 0x56352a301070 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.214+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 >> 172.21.15.170:0/3795653785 conn(0x56352a2f5ea0 msgr2=0x56352a2f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:59.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.214+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 shutdown_connections 2024-09-12T17:27:59.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.214+0000 7fc2da923800 1 -- 172.21.15.170:0/3795653785 wait complete. 2024-09-12T17:27:59.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.215+0000 7fc2da923800 1 -- 172.21.15.170:0/3515233105 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc1b003c730 msgr2=0x7fc1b003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.215+0000 7fc2da923800 1 --2- 172.21.15.170:0/3515233105 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc1b003c730 0x7fc1b003ebf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8096110 tx=0x7fc2c807e470 comp rx=0 tx=0).stop 2024-09-12T17:27:59.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.215+0000 7fc2da923800 1 -- 172.21.15.170:0/3515233105 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56352a1d8dc0 msgr2=0x56352a1d7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.215+0000 7fc2da923800 1 --2- 172.21.15.170:0/3515233105 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56352a1d8dc0 0x56352a1d7630 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x56352a2d1df0 tx=0x7fc2d000bf30 comp rx=0 tx=0).stop 2024-09-12T17:27:59.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.215+0000 7fc2da923800 1 -- 172.21.15.170:0/3515233105 shutdown_connections 2024-09-12T17:27:59.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.215+0000 7fc2da923800 1 --2- 172.21.15.170:0/3515233105 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc1b003c730 0x7fc1b003ebf0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.215+0000 7fc2da923800 1 --2- 172.21.15.170:0/3515233105 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56352a1d8dc0 0x56352a1d7630 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.215+0000 7fc2da923800 1 -- 172.21.15.170:0/3515233105 >> 172.21.15.170:0/3515233105 conn(0x56352a2df180 msgr2=0x56352a2df560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:59.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.215+0000 7fc2da923800 1 -- 172.21.15.170:0/3515233105 shutdown_connections 2024-09-12T17:27:59.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.215+0000 7fc2da923800 1 -- 172.21.15.170:0/3515233105 wait complete. 2024-09-12T17:27:59.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.215+0000 7fc2da923800 1 -- 172.21.15.170:0/404050532 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56352a1dc020 msgr2=0x56352a2d7550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.215+0000 7fc2da923800 1 --2- 172.21.15.170:0/404050532 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56352a1dc020 0x56352a2d7550 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.215+0000 7fc2da923800 1 -- 172.21.15.170:0/404050532 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56352a2d98f0 msgr2=0x56352a2dbd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.215+0000 7fc2da923800 1 --2- 172.21.15.170:0/404050532 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56352a2d98f0 0x56352a2dbd90 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.215+0000 7fc2da923800 1 -- 172.21.15.170:0/404050532 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc1bc03c780 msgr2=0x7fc1bc03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.215+0000 7fc2da923800 1 --2- 172.21.15.170:0/404050532 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc1bc03c780 0x7fc1bc03ec40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc001d70 tx=0x7fc2cc0012d0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.215+0000 7fc2da923800 1 -- 172.21.15.170:0/404050532 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56352a1d9600 msgr2=0x56352a2cff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.215+0000 7fc2da923800 1 --2- 172.21.15.170:0/404050532 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56352a1d9600 0x56352a2cff00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8025a60 tx=0x7fc2c8003330 comp rx=0 tx=0).stop 2024-09-12T17:27:59.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.215+0000 7fc2da923800 1 -- 172.21.15.170:0/404050532 shutdown_connections 2024-09-12T17:27:59.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.215+0000 7fc2da923800 1 --2- 172.21.15.170:0/404050532 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56352a2d98f0 0x56352a2dbd90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.215+0000 7fc2da923800 1 --2- 172.21.15.170:0/404050532 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc1bc03c780 0x7fc1bc03ec40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.215+0000 7fc2da923800 1 --2- 172.21.15.170:0/404050532 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56352a1dc020 0x56352a2d7550 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.215+0000 7fc2da923800 1 --2- 172.21.15.170:0/404050532 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56352a1d9600 0x56352a2cff00 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.215+0000 7fc2da923800 1 -- 172.21.15.170:0/404050532 >> 172.21.15.170:0/404050532 conn(0x56352a1d31c0 msgr2=0x56352a2c2820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:59.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.215+0000 7fc2da923800 1 -- 172.21.15.170:0/404050532 shutdown_connections 2024-09-12T17:27:59.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.215+0000 7fc2da923800 1 -- 172.21.15.170:0/404050532 wait complete. 2024-09-12T17:27:59.250 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-12T17:27:59.250 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-12T17:27:59.250 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-09-12T17:27:59.304 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:59.305 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:59.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.304+0000 7f1d27375800 1 Processor -- start 2024-09-12T17:27:59.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.304+0000 7f1d27375800 1 -- start start 2024-09-12T17:27:59.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.304+0000 7f1d27375800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55f86ad564a0 0x55f86ad58eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.304+0000 7f1d27375800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f86ac01e40 con 0x55f86ad593f0 2024-09-12T17:27:59.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.304+0000 7f1d27375800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x55f86abcc680 con 0x55f86ad564a0 2024-09-12T17:27:59.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.304+0000 7f1d24e66640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55f86ad564a0 0x55f86ad58eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.304+0000 7f1d1ffff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x55f86ad593f0 0x55f86ad5df00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:48252/0 (socket says 172.21.15.170:48252) 2024-09-12T17:27:59.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.304+0000 7f1d24e66640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55f86ad564a0 0x55f86ad58eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56460/0 (socket says 172.21.15.170:56460) 2024-09-12T17:27:59.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.304+0000 7f1d1ffff640 1 -- 172.21.15.170:0/175070512 learned_addr learned my addr 172.21.15.170:0/175070512 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:27:59.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.305+0000 7f1d24e66640 1 -- 172.21.15.170:0/175070512 >> v1:172.21.15.47:6789/0 conn(0x55f86ad593f0 legacy=0x55f86ad5df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.305+0000 7f1d24e66640 1 -- 172.21.15.170:0/175070512 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f86abe86b0 con 0x55f86ad564a0 2024-09-12T17:27:59.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.307+0000 7f1d24e66640 1 --2- 172.21.15.170:0/175070512 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f86ad564a0 0x55f86ad58eb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1d1800a470 tx=0x7f1d18045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71d319706d0ba905 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.307+0000 7f1d1f7fe640 1 -- 172.21.15.170:0/175070512 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d18053570 con 0x55f86ad564a0 2024-09-12T17:27:59.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.307+0000 7f1d1f7fe640 1 -- 172.21.15.170:0/175070512 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d18058070 con 0x55f86ad564a0 2024-09-12T17:27:59.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.307+0000 7f1d1f7fe640 1 -- 172.21.15.170:0/175070512 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d18053880 con 0x55f86ad564a0 2024-09-12T17:27:59.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.307+0000 7f1d27375800 1 -- 172.21.15.170:0/175070512 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f86ad564a0 msgr2=0x55f86ad58eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.307+0000 7f1d27375800 1 --2- 172.21.15.170:0/175070512 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f86ad564a0 0x55f86ad58eb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1d1800a470 tx=0x7f1d18045a20 comp rx=0 tx=0).stop 2024-09-12T17:27:59.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.308+0000 7f1d27375800 1 -- 172.21.15.170:0/175070512 shutdown_connections 2024-09-12T17:27:59.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.308+0000 7f1d27375800 1 --2- 172.21.15.170:0/175070512 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f86ad564a0 0x55f86ad58eb0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.308+0000 7f1d27375800 1 -- 172.21.15.170:0/175070512 >> 172.21.15.170:0/175070512 conn(0x55f86ad51980 msgr2=0x55f86ad53e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:59.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.308+0000 7f1d27375800 1 -- 172.21.15.170:0/175070512 shutdown_connections 2024-09-12T17:27:59.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.308+0000 7f1d27375800 1 -- 172.21.15.170:0/175070512 wait complete. 2024-09-12T17:27:59.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.322+0000 7f1d27375800 1 Processor -- start 2024-09-12T17:27:59.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.322+0000 7f1d27375800 1 -- start start 2024-09-12T17:27:59.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.322+0000 7f1d27375800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f86ad564a0 0x55f86ad58620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.322+0000 7f1d27375800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f86abf0dd0 con 0x55f86ad564a0 2024-09-12T17:27:59.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.322+0000 7f1d24e66640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f86ad564a0 0x55f86ad58620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.322+0000 7f1d24e66640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f86ad564a0 0x55f86ad58620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56474/0 (socket says 172.21.15.170:56474) 2024-09-12T17:27:59.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.322+0000 7f1d24e66640 1 -- 172.21.15.170:0/1228001379 learned_addr learned my addr 172.21.15.170:0/1228001379 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:59.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.322+0000 7f1d24e66640 1 -- 172.21.15.170:0/1228001379 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f86ac09e10 con 0x55f86ad564a0 2024-09-12T17:27:59.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.323+0000 7f1d24e66640 1 --2- 172.21.15.170:0/1228001379 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f86ad564a0 0x55f86ad58620 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1d18025c20 tx=0x7f1d18051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b63615d658d1db99 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.323+0000 7f1c12e05640 1 -- 172.21.15.170:0/1228001379 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d18053a20 con 0x55f86ad564a0 2024-09-12T17:27:59.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.323+0000 7f1c12e05640 1 -- 172.21.15.170:0/1228001379 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d18063070 con 0x55f86ad564a0 2024-09-12T17:27:59.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.323+0000 7f1c12e05640 1 -- 172.21.15.170:0/1228001379 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d18053cf0 con 0x55f86ad564a0 2024-09-12T17:27:59.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.324+0000 7f1d27375800 1 -- 172.21.15.170:0/1228001379 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f86ad564a0 msgr2=0x55f86ad58620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.324+0000 7f1d27375800 1 --2- 172.21.15.170:0/1228001379 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f86ad564a0 0x55f86ad58620 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1d18025c20 tx=0x7f1d18051000 comp rx=0 tx=0).stop 2024-09-12T17:27:59.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.324+0000 7f1d27375800 1 -- 172.21.15.170:0/1228001379 shutdown_connections 2024-09-12T17:27:59.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.324+0000 7f1d27375800 1 --2- 172.21.15.170:0/1228001379 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f86ad564a0 0x55f86ad58620 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.324+0000 7f1d27375800 1 -- 172.21.15.170:0/1228001379 >> 172.21.15.170:0/1228001379 conn(0x55f86ad51980 msgr2=0x55f86ae43330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:59.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.324+0000 7f1d27375800 1 -- 172.21.15.170:0/1228001379 shutdown_connections 2024-09-12T17:27:59.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.324+0000 7f1d27375800 1 -- 172.21.15.170:0/1228001379 wait complete. 2024-09-12T17:27:59.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.324+0000 7f1d27375800 1 Processor -- start 2024-09-12T17:27:59.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.324+0000 7f1d27375800 1 -- start start 2024-09-12T17:27:59.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.324+0000 7f1d27375800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f86ad564a0 0x55f86ae47920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.324+0000 7f1d27375800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f86ad59c60 con 0x55f86ad564a0 2024-09-12T17:27:59.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.324+0000 7f1d24e66640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f86ad564a0 0x55f86ae47920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.324+0000 7f1d24e66640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f86ad564a0 0x55f86ae47920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56482/0 (socket says 172.21.15.170:56482) 2024-09-12T17:27:59.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.324+0000 7f1d24e66640 1 -- 172.21.15.170:0/3799806694 learned_addr learned my addr 172.21.15.170:0/3799806694 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:59.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.325+0000 7f1d24e66640 1 -- 172.21.15.170:0/3799806694 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f86ae47e80 con 0x55f86ad564a0 2024-09-12T17:27:59.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.325+0000 7f1d24e66640 1 --2- 172.21.15.170:0/3799806694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f86ad564a0 0x55f86ae47920 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1d18025c20 tx=0x7f1d18002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.325+0000 7f1c11602640 1 -- 172.21.15.170:0/3799806694 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d18068660 con 0x55f86ad564a0 2024-09-12T17:27:59.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.325+0000 7f1c11602640 1 -- 172.21.15.170:0/3799806694 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d18068800 con 0x55f86ad564a0 2024-09-12T17:27:59.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.325+0000 7f1d27375800 1 -- 172.21.15.170:0/3799806694 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f86ae48110 con 0x55f86ad564a0 2024-09-12T17:27:59.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.325+0000 7f1c11602640 1 -- 172.21.15.170:0/3799806694 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d18068ae0 con 0x55f86ad564a0 2024-09-12T17:27:59.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.325+0000 7f1d27375800 1 -- 172.21.15.170:0/3799806694 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f86ae48d20 con 0x55f86ad564a0 2024-09-12T17:27:59.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.326+0000 7f1c11602640 1 -- 172.21.15.170:0/3799806694 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1d18068c80 con 0x55f86ad564a0 2024-09-12T17:27:59.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.326+0000 7f1c11602640 1 --2- 172.21.15.170:0/3799806694 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1c0c03c780 0x7f1c0c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.326+0000 7f1c11602640 1 -- 172.21.15.170:0/3799806694 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f1d18098100 con 0x55f86ad564a0 2024-09-12T17:27:59.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.326+0000 7f1d1ffff640 1 --2- 172.21.15.170:0/3799806694 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1c0c03c780 0x7f1c0c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.326+0000 7f1d27375800 1 --2- 172.21.15.170:0/3799806694 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55f86ad593f0 0x55f86ae4af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.326+0000 7f1d27375800 1 -- 172.21.15.170:0/3799806694 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae4b490 con 0x55f86ad593f0 2024-09-12T17:27:59.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.326+0000 7f1d25667640 1 --2- 172.21.15.170:0/3799806694 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55f86ad593f0 0x55f86ae4af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.327+0000 7f1d1ffff640 1 --2- 172.21.15.170:0/3799806694 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1c0c03c780 0x7f1c0c03ec40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1d10001d70 tx=0x7f1d100012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.327+0000 7f1d25667640 1 --2- 172.21.15.170:0/3799806694 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55f86ad593f0 0x55f86ae4af50 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.327+0000 7f1d25667640 1 -- 172.21.15.170:0/3799806694 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d2000a4d0 con 0x55f86ad593f0 2024-09-12T17:27:59.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.327+0000 7f1d27375800 1 -- 172.21.15.170:0/3799806694 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae5d830 con 0x55f86ad593f0 2024-09-12T17:27:59.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.327+0000 7f1d25667640 1 -- 172.21.15.170:0/3799806694 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1d2000a4d0 con 0x55f86ad593f0 2024-09-12T17:27:59.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.327+0000 7f1d27375800 1 --2- 172.21.15.170:0/3799806694 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55f86ae5f260 0x55f86ae616e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.327+0000 7f1d27375800 1 -- 172.21.15.170:0/3799806694 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae61e70 con 0x55f86ae5f260 2024-09-12T17:27:59.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.327+0000 7f1d24e66640 1 --2- 172.21.15.170:0/3799806694 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55f86ae5f260 0x55f86ae616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.328+0000 7f1d24e66640 1 --2- 172.21.15.170:0/3799806694 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55f86ae5f260 0x55f86ae616e0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.328+0000 7f1d24e66640 1 -- 172.21.15.170:0/3799806694 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1d18051070 con 0x55f86ae5f260 2024-09-12T17:27:59.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.328+0000 7f1d27375800 1 -- 172.21.15.170:0/3799806694 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae5e080 con 0x55f86ad593f0 2024-09-12T17:27:59.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.328+0000 7f1d25667640 1 -- 172.21.15.170:0/3799806694 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1d2000a4d0 con 0x55f86ad593f0 2024-09-12T17:27:59.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.328+0000 7f1d27375800 1 -- 172.21.15.170:0/3799806694 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae5e460 con 0x55f86ae5f260 2024-09-12T17:27:59.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.328+0000 7f1d24e66640 1 -- 172.21.15.170:0/3799806694 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1d18051070 con 0x55f86ae5f260 2024-09-12T17:27:59.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.329+0000 7f1d27375800 1 Processor -- start 2024-09-12T17:27:59.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.329+0000 7f1d27375800 1 -- start start 2024-09-12T17:27:59.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.329+0000 7f1d27375800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f86ae70700 0x55f86ae70b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.329+0000 7f1d27375800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f86ac4ea00 con 0x55f86ae70700 2024-09-12T17:27:59.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.329+0000 7f1d25667640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f86ae70700 0x55f86ae70b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.329+0000 7f1d25667640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f86ae70700 0x55f86ae70b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56496/0 (socket says 172.21.15.170:56496) 2024-09-12T17:27:59.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.329+0000 7f1d25667640 1 -- 172.21.15.170:0/2071536178 learned_addr learned my addr 172.21.15.170:0/2071536178 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:59.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.329+0000 7f1d25667640 1 -- 172.21.15.170:0/2071536178 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f86ae71160 con 0x55f86ae70700 2024-09-12T17:27:59.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.330+0000 7f1d25667640 1 --2- 172.21.15.170:0/2071536178 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f86ae70700 0x55f86ae70b20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x55f86ae48920 tx=0x7f1d200167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.330+0000 7f1c0a7fc640 1 -- 172.21.15.170:0/2071536178 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d20013640 con 0x55f86ae70700 2024-09-12T17:27:59.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.330+0000 7f1c0a7fc640 1 -- 172.21.15.170:0/2071536178 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d200137e0 con 0x55f86ae70700 2024-09-12T17:27:59.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.330+0000 7f1d27375800 1 -- 172.21.15.170:0/2071536178 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f86ae71990 con 0x55f86ae70700 2024-09-12T17:27:59.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.330+0000 7f1c0a7fc640 1 -- 172.21.15.170:0/2071536178 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d20013ae0 con 0x55f86ae70700 2024-09-12T17:27:59.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.330+0000 7f1d27375800 1 -- 172.21.15.170:0/2071536178 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f86ae71f30 con 0x55f86ae70700 2024-09-12T17:27:59.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.331+0000 7f1c0a7fc640 1 -- 172.21.15.170:0/2071536178 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1d20011040 con 0x55f86ae70700 2024-09-12T17:27:59.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.331+0000 7f1c0a7fc640 1 --2- 172.21.15.170:0/2071536178 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1bfc03c730 0x7f1bfc03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.331+0000 7f1c0a7fc640 1 -- 172.21.15.170:0/2071536178 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f1d2000e040 con 0x55f86ae70700 2024-09-12T17:27:59.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.331+0000 7f1d24e66640 1 --2- 172.21.15.170:0/2071536178 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1bfc03c730 0x7f1bfc03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.331+0000 7f1d27375800 1 Processor -- start 2024-09-12T17:27:59.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.331+0000 7f1d27375800 1 -- start start 2024-09-12T17:27:59.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.331+0000 7f1d24e66640 1 --2- 172.21.15.170:0/2071536178 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1bfc03c730 0x7f1bfc03ebf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x55f86ae49970 tx=0x7f1d1805d5c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.331+0000 7f1d27375800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f86ae7d220 0x55f86ae7d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.331+0000 7f1d27375800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f86ad56ec0 con 0x55f86ae7d220 2024-09-12T17:27:59.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.332+0000 7f1d25667640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f86ae7d220 0x55f86ae7d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.332+0000 7f1d25667640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f86ae7d220 0x55f86ae7d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56506/0 (socket says 172.21.15.170:56506) 2024-09-12T17:27:59.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.332+0000 7f1d25667640 1 -- 172.21.15.170:0/3517327379 learned_addr learned my addr 172.21.15.170:0/3517327379 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:59.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.332+0000 7f1d25667640 1 -- 172.21.15.170:0/3517327379 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f86ae7dc10 con 0x55f86ae7d220 2024-09-12T17:27:59.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.332+0000 7f1d25667640 1 --2- 172.21.15.170:0/3517327379 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f86ae7d220 0x55f86ae7d620 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1d20020000 tx=0x7f1d2001f400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42db75c7a0b66d58 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.332+0000 7f1bfbfff640 1 -- 172.21.15.170:0/3517327379 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d20021a90 con 0x55f86ae7d220 2024-09-12T17:27:59.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.332+0000 7f1bfbfff640 1 -- 172.21.15.170:0/3517327379 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d20021440 con 0x55f86ae7d220 2024-09-12T17:27:59.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.332+0000 7f1bfbfff640 1 -- 172.21.15.170:0/3517327379 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d20020bd0 con 0x55f86ae7d220 2024-09-12T17:27:59.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.333+0000 7f1d27375800 1 -- 172.21.15.170:0/3517327379 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f86ae7d220 msgr2=0x55f86ae7d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.333+0000 7f1d27375800 1 --2- 172.21.15.170:0/3517327379 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f86ae7d220 0x55f86ae7d620 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1d20020000 tx=0x7f1d2001f400 comp rx=0 tx=0).stop 2024-09-12T17:27:59.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.333+0000 7f1d27375800 1 -- 172.21.15.170:0/3517327379 shutdown_connections 2024-09-12T17:27:59.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.333+0000 7f1d27375800 1 --2- 172.21.15.170:0/3517327379 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f86ae7d220 0x55f86ae7d620 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.333+0000 7f1d27375800 1 -- 172.21.15.170:0/3517327379 >> 172.21.15.170:0/3517327379 conn(0x55f86ae79620 msgr2=0x55f86ae77860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:59.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.333+0000 7f1d27375800 1 -- 172.21.15.170:0/3517327379 shutdown_connections 2024-09-12T17:27:59.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.333+0000 7f1d27375800 1 -- 172.21.15.170:0/3517327379 wait complete. 2024-09-12T17:27:59.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.333+0000 7f1d27375800 1 Processor -- start 2024-09-12T17:27:59.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.333+0000 7f1d27375800 1 -- start start 2024-09-12T17:27:59.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.333+0000 7f1d27375800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f86ae7d220 0x55f86ae84810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.333+0000 7f1d27375800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f86ae7e230 con 0x55f86ae7d220 2024-09-12T17:27:59.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.333+0000 7f1d25667640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f86ae7d220 0x55f86ae84810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.333+0000 7f1d25667640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f86ae7d220 0x55f86ae84810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56514/0 (socket says 172.21.15.170:56514) 2024-09-12T17:27:59.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.333+0000 7f1d25667640 1 -- 172.21.15.170:0/1972793431 learned_addr learned my addr 172.21.15.170:0/1972793431 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:59.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.334+0000 7f1d25667640 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f86ae84d70 con 0x55f86ae7d220 2024-09-12T17:27:59.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.334+0000 7f1d25667640 1 --2- 172.21.15.170:0/1972793431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f86ae7d220 0x55f86ae84810 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1d200208e0 tx=0x7f1d20053cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.334+0000 7f1bfa7fc640 1 -- 172.21.15.170:0/1972793431 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d2001f630 con 0x55f86ae7d220 2024-09-12T17:27:59.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.334+0000 7f1bfa7fc640 1 -- 172.21.15.170:0/1972793431 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d2001f7d0 con 0x55f86ae7d220 2024-09-12T17:27:59.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.334+0000 7f1bfa7fc640 1 -- 172.21.15.170:0/1972793431 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d200551a0 con 0x55f86ae7d220 2024-09-12T17:27:59.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.334+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f86ae85000 con 0x55f86ae7d220 2024-09-12T17:27:59.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.334+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f86ae85980 con 0x55f86ae7d220 2024-09-12T17:27:59.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.335+0000 7f1bfa7fc640 1 -- 172.21.15.170:0/1972793431 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1d20014840 con 0x55f86ae7d220 2024-09-12T17:27:59.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.335+0000 7f1bfa7fc640 1 --2- 172.21.15.170:0/1972793431 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1bf003c780 0x7f1bf003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.335+0000 7f1bfa7fc640 1 -- 172.21.15.170:0/1972793431 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f1d20034ac0 con 0x55f86ae7d220 2024-09-12T17:27:59.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.335+0000 7f1d24e66640 1 --2- 172.21.15.170:0/1972793431 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1bf003c780 0x7f1bf003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.336+0000 7f1d24e66640 1 --2- 172.21.15.170:0/1972793431 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1bf003c780 0x7f1bf003ec40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1d18098070 tx=0x7f1d18088000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.336+0000 7f1d27375800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.336+0000 7f1d27375800 1 --2- 172.21.15.170:0/1972793431 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55f86ae900e0 0x55f86ae925a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.336+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae92cf0 con 0x55f86ae900e0 2024-09-12T17:27:59.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.336+0000 7f1d1ffff640 1 --2- 172.21.15.170:0/1972793431 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55f86ae900e0 0x55f86ae925a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.336+0000 7f1d1ffff640 1 --2- 172.21.15.170:0/1972793431 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55f86ae900e0 0x55f86ae925a0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.336+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d10009050 con 0x55f86ae900e0 2024-09-12T17:27:59.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.336+0000 7f1d27375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.336+0000 7f1d27375800 20 realm 2024-09-12T17:27:59.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.336+0000 7f1d27375800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.336+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae8f470 con 0x55f86ae900e0 2024-09-12T17:27:59.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.337+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d10009050 con 0x55f86ae900e0 2024-09-12T17:27:59.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.337+0000 7f1d27375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.337+0000 7f1d27375800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:59.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.337+0000 7f1d27375800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.337+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae937e0 con 0x55f86ae900e0 2024-09-12T17:27:59.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.337+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d10009050 con 0x55f86ae900e0 2024-09-12T17:27:59.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.337+0000 7f1d27375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.337+0000 7f1d27375800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.337+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae940b0 con 0x55f86ae900e0 2024-09-12T17:27:59.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.337+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1d10009050 con 0x55f86ae900e0 2024-09-12T17:27:59.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.337+0000 7f1d27375800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:59.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.337+0000 7f1d27375800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.337+0000 7f1d27375800 1 --2- 172.21.15.170:0/1972793431 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55f86ae94ad0 0x55f86ae96ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.337+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae97600 con 0x55f86ae94ad0 2024-09-12T17:27:59.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.337+0000 7f1d25667640 1 --2- 172.21.15.170:0/1972793431 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55f86ae94ad0 0x55f86ae96ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.337+0000 7f1d25667640 1 --2- 172.21.15.170:0/1972793431 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55f86ae94ad0 0x55f86ae96ec0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.338+0000 7f1d25667640 1 -- 172.21.15.170:0/1972793431 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1d2000a4d0 con 0x55f86ae94ad0 2024-09-12T17:27:59.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.338+0000 7f1d27375800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:27:59.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.338+0000 7f1d27375800 20 searching for the correct realm 2024-09-12T17:27:59.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.338+0000 7f1d27375800 1 --2- 172.21.15.170:0/1972793431 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55f86ae995b0 0x55f86ae9ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.338+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae9c0f0 con 0x55f86ae995b0 2024-09-12T17:27:59.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.338+0000 7f1d24e66640 1 --2- 172.21.15.170:0/1972793431 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55f86ae995b0 0x55f86ae9ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.338+0000 7f1d24e66640 1 --2- 172.21.15.170:0/1972793431 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55f86ae995b0 0x55f86ae9ba70 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.338+0000 7f1d24e66640 1 -- 172.21.15.170:0/1972793431 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d18051070 con 0x55f86ae995b0 2024-09-12T17:27:59.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.339+0000 7f1d24e66640 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae9c0f0 con 0x55f86ae94ad0 2024-09-12T17:27:59.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.339+0000 7f1d25667640 1 -- 172.21.15.170:0/1972793431 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d2000a4d0 con 0x55f86ae94ad0 2024-09-12T17:27:59.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.339+0000 7f1d25667640 1 --2- 172.21.15.170:0/1972793431 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f1d2004ec10 0x7f1d2003b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.339+0000 7f1d25667640 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae9c0f0 con 0x7f1d2004ec10 2024-09-12T17:27:59.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.339+0000 7f1d1ffff640 1 --2- 172.21.15.170:0/1972793431 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f1d2004ec10 0x7f1d2003b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.339+0000 7f1d1ffff640 1 --2- 172.21.15.170:0/1972793431 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f1d2004ec10 0x7f1d2003b790 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.340+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d10009050 con 0x7f1d2004ec10 2024-09-12T17:27:59.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.340+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae9c0f0 con 0x55f86ae900e0 2024-09-12T17:27:59.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.340+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d10009050 con 0x55f86ae900e0 2024-09-12T17:27:59.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.340+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae9c0f0 con 0x55f86ae900e0 2024-09-12T17:27:59.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.340+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d10029040 con 0x55f86ae900e0 2024-09-12T17:27:59.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.340+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae9c0f0 con 0x7f1d2004ec10 2024-09-12T17:27:59.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.340+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d10029040 con 0x7f1d2004ec10 2024-09-12T17:27:59.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.340+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae9c0f0 con 0x7f1d2004ec10 2024-09-12T17:27:59.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.340+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d10029040 con 0x7f1d2004ec10 2024-09-12T17:27:59.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.341+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae9c0f0 con 0x55f86ae94ad0 2024-09-12T17:27:59.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.341+0000 7f1d25667640 1 -- 172.21.15.170:0/1972793431 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d2000a4d0 con 0x55f86ae94ad0 2024-09-12T17:27:59.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.341+0000 7f1d25667640 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae9c0f0 con 0x55f86ae995b0 2024-09-12T17:27:59.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.341+0000 7f1d24e66640 1 -- 172.21.15.170:0/1972793431 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d18051070 con 0x55f86ae995b0 2024-09-12T17:27:59.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.341+0000 7f1d24e66640 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae9c0f0 con 0x55f86ae900e0 2024-09-12T17:27:59.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.341+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d10029040 con 0x55f86ae900e0 2024-09-12T17:27:59.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.341+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae9c0f0 con 0x7f1d2004ec10 2024-09-12T17:27:59.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.342+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d10029040 con 0x7f1d2004ec10 2024-09-12T17:27:59.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.342+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae9c0f0 con 0x55f86ae900e0 2024-09-12T17:27:59.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.342+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d10029040 con 0x55f86ae900e0 2024-09-12T17:27:59.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.342+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae9c0f0 con 0x55f86ae94ad0 2024-09-12T17:27:59.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.342+0000 7f1d25667640 1 -- 172.21.15.170:0/1972793431 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f1d2000a4d0 con 0x55f86ae94ad0 2024-09-12T17:27:59.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.342+0000 7f1d25667640 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae9c0f0 con 0x55f86ae995b0 2024-09-12T17:27:59.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.342+0000 7f1d24e66640 1 -- 172.21.15.170:0/1972793431 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d18051070 con 0x55f86ae995b0 2024-09-12T17:27:59.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.342+0000 7f1d24e66640 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae9c0f0 con 0x55f86ae995b0 2024-09-12T17:27:59.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.342+0000 7f1d24e66640 1 -- 172.21.15.170:0/1972793431 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d18051070 con 0x55f86ae995b0 2024-09-12T17:27:59.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.342+0000 7f1d24e66640 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae9c0f0 con 0x7f1d2004ec10 2024-09-12T17:27:59.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.343+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d10029040 con 0x7f1d2004ec10 2024-09-12T17:27:59.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.343+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae9c0f0 con 0x55f86ae995b0 2024-09-12T17:27:59.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.343+0000 7f1d24e66640 1 -- 172.21.15.170:0/1972793431 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d18051070 con 0x55f86ae995b0 2024-09-12T17:27:59.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.343+0000 7f1d24e66640 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae9c0f0 con 0x55f86ae995b0 2024-09-12T17:27:59.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.343+0000 7f1d24e66640 1 -- 172.21.15.170:0/1972793431 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d18051070 con 0x55f86ae995b0 2024-09-12T17:27:59.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.343+0000 7f1d24e66640 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae9c0f0 con 0x55f86ae900e0 2024-09-12T17:27:59.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.343+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d10029040 con 0x55f86ae900e0 2024-09-12T17:27:59.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.343+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae9c0f0 con 0x55f86ae900e0 2024-09-12T17:27:59.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.344+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1d10029040 con 0x55f86ae900e0 2024-09-12T17:27:59.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.344+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae9c0f0 con 0x7f1d2004ec10 2024-09-12T17:27:59.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.344+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d10029040 con 0x7f1d2004ec10 2024-09-12T17:27:59.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.344+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae9c0f0 con 0x55f86ae995b0 2024-09-12T17:27:59.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.344+0000 7f1d24e66640 1 -- 172.21.15.170:0/1972793431 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d18051070 con 0x55f86ae995b0 2024-09-12T17:27:59.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.344+0000 7f1d24e66640 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae9c0f0 con 0x55f86ae94ad0 2024-09-12T17:27:59.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.344+0000 7f1d25667640 1 -- 172.21.15.170:0/1972793431 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d2000a4d0 con 0x55f86ae94ad0 2024-09-12T17:27:59.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.344+0000 7f1d25667640 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae9c0f0 con 0x55f86ae900e0 2024-09-12T17:27:59.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.345+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d10029040 con 0x55f86ae900e0 2024-09-12T17:27:59.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.345+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae9c0f0 con 0x7f1d2004ec10 2024-09-12T17:27:59.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.345+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d10029040 con 0x7f1d2004ec10 2024-09-12T17:27:59.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.345+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae9c0f0 con 0x55f86ae995b0 2024-09-12T17:27:59.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.345+0000 7f1d24e66640 1 -- 172.21.15.170:0/1972793431 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d18051070 con 0x55f86ae995b0 2024-09-12T17:27:59.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.345+0000 7f1d24e66640 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae9c0f0 con 0x7f1d2004ec10 2024-09-12T17:27:59.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.345+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d10029040 con 0x7f1d2004ec10 2024-09-12T17:27:59.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.345+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae9c0f0 con 0x55f86ae94ad0 2024-09-12T17:27:59.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.346+0000 7f1d25667640 1 -- 172.21.15.170:0/1972793431 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d2000a4d0 con 0x55f86ae94ad0 2024-09-12T17:27:59.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.346+0000 7f1d25667640 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae9c0f0 con 0x55f86ae995b0 2024-09-12T17:27:59.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.346+0000 7f1d24e66640 1 -- 172.21.15.170:0/1972793431 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d18051070 con 0x55f86ae995b0 2024-09-12T17:27:59.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.346+0000 7f1d24e66640 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae9c0f0 con 0x7f1d2004ec10 2024-09-12T17:27:59.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.346+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d10029040 con 0x7f1d2004ec10 2024-09-12T17:27:59.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.346+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae9c0f0 con 0x55f86ae900e0 2024-09-12T17:27:59.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.346+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1d10029040 con 0x55f86ae900e0 2024-09-12T17:27:59.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.346+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae9c0f0 con 0x55f86ae94ad0 2024-09-12T17:27:59.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.347+0000 7f1d25667640 1 -- 172.21.15.170:0/1972793431 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1d20066040 con 0x55f86ae94ad0 2024-09-12T17:27:59.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.347+0000 7f1d27375800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:27:59.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.347+0000 7f1d27375800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:59.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.347+0000 7f1d27375800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:59.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.347+0000 7f1d27375800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:59.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.347+0000 7f1d27375800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:59.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.347+0000 7f1d27375800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:27:59.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.347+0000 7f1d27375800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.347+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae97fc0 con 0x55f86ae900e0 2024-09-12T17:27:59.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.347+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d10029040 con 0x55f86ae900e0 2024-09-12T17:27:59.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.347+0000 7f1d27375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.347+0000 7f1d27375800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.347+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae98860 con 0x55f86ae900e0 2024-09-12T17:27:59.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.347+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1d10029040 con 0x55f86ae900e0 2024-09-12T17:27:59.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.347+0000 7f1d27375800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:59.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.347+0000 7f1d27375800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.347+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae97c00 con 0x55f86ae94ad0 2024-09-12T17:27:59.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.348+0000 7f1d25667640 1 -- 172.21.15.170:0/1972793431 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1d20066040 con 0x55f86ae94ad0 2024-09-12T17:27:59.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.348+0000 7f1d27375800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:27:59.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.348+0000 7f1d27375800 20 zone default found 2024-09-12T17:27:59.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.348+0000 7f1d27375800 4 Realm: () 2024-09-12T17:27:59.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.348+0000 7f1d27375800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:27:59.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.348+0000 7f1d27375800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:27:59.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.348+0000 7f1d27375800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:59.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.348+0000 7f1d27375800 20 zonegroup default 2024-09-12T17:27:59.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.348+0000 7f1d27375800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.348+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae9ca20 con 0x7f1d2004ec10 2024-09-12T17:27:59.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.348+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1d10029040 con 0x7f1d2004ec10 2024-09-12T17:27:59.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.348+0000 7f1d27375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.348+0000 7f1d27375800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.348+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae9e8b0 con 0x55f86ae995b0 2024-09-12T17:27:59.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.348+0000 7f1d24e66640 1 -- 172.21.15.170:0/1972793431 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1d18051070 con 0x55f86ae995b0 2024-09-12T17:27:59.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.348+0000 7f1d27375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.348+0000 7f1d27375800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.348+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae9ed50 con 0x55f86ae995b0 2024-09-12T17:27:59.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.348+0000 7f1d24e66640 1 -- 172.21.15.170:0/1972793431 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1d18051070 con 0x55f86ae995b0 2024-09-12T17:27:59.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.348+0000 7f1d27375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.348+0000 7f1d27375800 20 started sync module instance, tier type = 2024-09-12T17:27:59.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.348+0000 7f1d27375800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:27:59.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.348+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae9dc50 con 0x55f86ae94ad0 2024-09-12T17:27:59.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.349+0000 7f1d25667640 1 -- 172.21.15.170:0/1972793431 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d20066040 con 0x55f86ae94ad0 2024-09-12T17:27:59.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.349+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94525433962560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae9f660 con 0x55f86ae94ad0 2024-09-12T17:27:59.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.349+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae9feb0 con 0x55f86ae900e0 2024-09-12T17:27:59.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.350+0000 7f1d25667640 1 -- 172.21.15.170:0/1972793431 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94525433962560] v29'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d20066040 con 0x55f86ae94ad0 2024-09-12T17:27:59.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.350+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d10029040 con 0x55f86ae900e0 2024-09-12T17:27:59.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.351+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94525433967024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f86ae9fbc0 con 0x55f86ae900e0 2024-09-12T17:27:59.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.351+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f86aea06e0 con 0x55f86ae995b0 2024-09-12T17:27:59.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.351+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94525433967024] v29'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d10029040 con 0x55f86ae900e0 2024-09-12T17:27:59.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.352+0000 7f1d24e66640 1 -- 172.21.15.170:0/1972793431 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d18051070 con 0x55f86ae995b0 2024-09-12T17:27:59.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.352+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94525433971120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f86aea06a0 con 0x55f86ae995b0 2024-09-12T17:27:59.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.352+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f86aea1190 con 0x55f86ae94ad0 2024-09-12T17:27:59.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.353+0000 7f1d25667640 1 -- 172.21.15.170:0/1972793431 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d20066040 con 0x55f86ae94ad0 2024-09-12T17:27:59.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.353+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94525433973920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f86aea1190 con 0x55f86ae94ad0 2024-09-12T17:27:59.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.353+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f86aea21b0 con 0x55f86ae900e0 2024-09-12T17:27:59.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.353+0000 7f1d24e66640 1 -- 172.21.15.170:0/1972793431 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94525433971120] v29'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d18051070 con 0x55f86ae995b0 2024-09-12T17:27:59.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.354+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d10029040 con 0x55f86ae900e0 2024-09-12T17:27:59.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.354+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94525433977984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f86aea2170 con 0x55f86ae900e0 2024-09-12T17:27:59.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.354+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f86aea2c00 con 0x7f1d2004ec10 2024-09-12T17:27:59.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.354+0000 7f1d25667640 1 -- 172.21.15.170:0/1972793431 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94525433973920] v29'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d20066040 con 0x55f86ae94ad0 2024-09-12T17:27:59.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.355+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d10029040 con 0x7f1d2004ec10 2024-09-12T17:27:59.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.355+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94525433980688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f86aea2c00 con 0x7f1d2004ec10 2024-09-12T17:27:59.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.355+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f86aea3610 con 0x7f1d2004ec10 2024-09-12T17:27:59.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.355+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94525433977984] v29'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d10029040 con 0x55f86ae900e0 2024-09-12T17:27:59.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.356+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94525433980688] v29'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d10029040 con 0x7f1d2004ec10 2024-09-12T17:27:59.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.356+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(56 notify.6 [create] v29'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d10029040 con 0x7f1d2004ec10 2024-09-12T17:27:59.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.356+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94525433976240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f86aea3160 con 0x7f1d2004ec10 2024-09-12T17:27:59.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.356+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f86aea3eb0 con 0x7f1d2004ec10 2024-09-12T17:27:59.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.357+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94525433976240] v29'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d10029040 con 0x7f1d2004ec10 2024-09-12T17:27:59.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.357+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(58 notify.7 [create] v29'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d10029040 con 0x7f1d2004ec10 2024-09-12T17:27:59.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.357+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94525433968144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f86aea3c90 con 0x7f1d2004ec10 2024-09-12T17:27:59.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.357+0000 7f1d27375800 20 add_watcher() i=0 2024-09-12T17:27:59.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.357+0000 7f1d27375800 20 add_watcher() i=1 2024-09-12T17:27:59.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.357+0000 7f1d27375800 20 add_watcher() i=2 2024-09-12T17:27:59.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.357+0000 7f1d27375800 20 add_watcher() i=3 2024-09-12T17:27:59.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.357+0000 7f1d27375800 20 add_watcher() i=4 2024-09-12T17:27:59.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.357+0000 7f1d27375800 20 add_watcher() i=5 2024-09-12T17:27:59.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.357+0000 7f1d27375800 20 add_watcher() i=6 2024-09-12T17:27:59.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.358+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94525433968144] v29'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d10029040 con 0x7f1d2004ec10 2024-09-12T17:27:59.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.358+0000 7f1d27375800 20 add_watcher() i=7 2024-09-12T17:27:59.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.358+0000 7f1d27375800 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:59.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.358+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f86aea6df0 con 0x55f86ae900e0 2024-09-12T17:27:59.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.358+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1d10029040 con 0x55f86ae900e0 2024-09-12T17:27:59.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.358+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94525433997216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f86aea3bb0 con 0x55f86ae900e0 2024-09-12T17:27:59.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.359+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94525433997216] v29'50 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1d10029040 con 0x55f86ae900e0 2024-09-12T17:27:59.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.359+0000 7f1bdafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:59.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.359+0000 7f1d27375800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:59.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.359+0000 7f1d27375800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:59.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.359+0000 7f1d27375800 5 note: GC not initialized 2024-09-12T17:27:59.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.359+0000 7f1bd9fe3640 20 reqs_thread_entry: start 2024-09-12T17:27:59.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.360+0000 7f1d27375800 20 init_complete bucket index max shards: 11 2024-09-12T17:27:59.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.360+0000 7f1d27375800 20 Filter name: none 2024-09-12T17:27:59.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.360+0000 7f1b4b7fe640 20 reqs_thread_entry: start 2024-09-12T17:27:59.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.360+0000 7f1d27375800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:27:59.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.360+0000 7f1d27375800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.360+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f86aed9f50 con 0x55f86ae900e0 2024-09-12T17:27:59.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.360+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f1d10029040 con 0x55f86ae900e0 2024-09-12T17:27:59.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.360+0000 7f1d27375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.360+0000 7f1d27375800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-12T17:27:59.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.360+0000 7f1d27375800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:27:59.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.360+0000 7f1d27375800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-12T17:27:59.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.360+0000 7f1d27375800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.360+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f86aed85f0 con 0x55f86ae900e0 2024-09-12T17:27:59.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.360+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f1d10029040 con 0x55f86ae900e0 2024-09-12T17:27:59.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.360+0000 7f1d27375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.360+0000 7f1d27375800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-09-12T17:27:59.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.360+0000 7f1d27375800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-12T17:27:59.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.360+0000 7f1d27375800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-09-12T17:27:59.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.360+0000 7f1d27375800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.360+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f86aed89e0 con 0x7f1d2004ec10 2024-09-12T17:27:59.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.361+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f1d10029040 con 0x7f1d2004ec10 2024-09-12T17:27:59.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.361+0000 7f1d27375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.361+0000 7f1d27375800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-09-12T17:27:59.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.361+0000 7f1d27375800 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-12T17:27:59.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.361+0000 7f1d27375800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-12T17:27:59.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.361+0000 7f1d27375800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-12T17:27:59.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.361+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f86aed9930 con 0x55f86ae900e0 2024-09-12T17:27:59.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.362+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~391] v29'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f1d10029040 con 0x55f86ae900e0 2024-09-12T17:27:59.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.362+0000 7f1d27375800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:27:59.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.362+0000 7f1d27375800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:27:59.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.362+0000 7f1d27375800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T17:27:59.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.362+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94525434203648 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f86aedd8c0 con 0x55f86ae900e0 2024-09-12T17:27:59.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.362+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== watch-notify(notify (1) cookie 94525433977984 notify 124554051584 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55f86aed93d0 con 0x55f86ae900e0 2024-09-12T17:27:59.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.362+0000 7f1bfbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051584 cookie 94525433977984 notifier 4288 bl.length()=567 2024-09-12T17:27:59.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.362+0000 7f1bfbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:27:59.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.362+0000 7f1bfbfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:27:59.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.362+0000 7f1bfbfff640 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f1be8003ea0 con 0x55f86ae900e0 2024-09-12T17:27:59.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.362+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(66 notify.4 [notify cookie 94525434203648 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1d10029040 con 0x55f86ae900e0 2024-09-12T17:27:59.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.363+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d10029040 con 0x55f86ae900e0 2024-09-12T17:27:59.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.363+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== watch-notify(notify_complete (2) cookie 94525434203648 notify 124554051584 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f86aed8bb0 con 0x55f86ae900e0 2024-09-12T17:27:59.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.363+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f86aedb340 con 0x55f86ae900e0 2024-09-12T17:27:59.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.364+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v29'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f1d10029040 con 0x55f86ae900e0 2024-09-12T17:27:59.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.364+0000 7f1d27375800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-12T17:27:59.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.364+0000 7f1d27375800 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-12T17:27:59.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.364+0000 7f1d27375800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-12T17:27:59.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.364+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94525434203520 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f86aedb340 con 0x55f86ae94ad0 2024-09-12T17:27:59.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.364+0000 7f1d25667640 1 -- 172.21.15.170:0/1972793431 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== watch-notify(notify (1) cookie 94525433973920 notify 124554051584 ret 0) ==== 211+0+0 (crc 0 0 0) 0x55f86ae85000 con 0x55f86ae94ad0 2024-09-12T17:27:59.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.364+0000 7f1bfb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051584 cookie 94525433973920 notifier 4288 bl.length()=169 2024-09-12T17:27:59.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.364+0000 7f1bfb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-12T17:27:59.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.364+0000 7f1bfb7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-12T17:27:59.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.364+0000 7f1bfb7fe640 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f1b58003400 con 0x55f86ae94ad0 2024-09-12T17:27:59.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.364+0000 7f1d25667640 1 -- 172.21.15.170:0/1972793431 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(69 notify.3 [notify cookie 94525434203520 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1d20066040 con 0x55f86ae94ad0 2024-09-12T17:27:59.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.365+0000 7f1d25667640 1 -- 172.21.15.170:0/1972793431 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d20066040 con 0x55f86ae94ad0 2024-09-12T17:27:59.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.365+0000 7f1d25667640 1 -- 172.21.15.170:0/1972793431 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== watch-notify(notify_complete (2) cookie 94525434203520 notify 124554051584 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f86ae84d70 con 0x55f86ae94ad0 2024-09-12T17:27:59.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.365+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f86aedb340 con 0x7f1d2004ec10 2024-09-12T17:27:59.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.366+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v29'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f1d10029040 con 0x7f1d2004ec10 2024-09-12T17:27:59.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.366+0000 7f1d27375800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-12T17:27:59.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.366+0000 7f1d27375800 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-12T17:27:59.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.366+0000 7f1d27375800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-12T17:27:59.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.366+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94525434203520 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f86aeddcf0 con 0x55f86ae94ad0 2024-09-12T17:27:59.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.366+0000 7f1d25667640 1 -- 172.21.15.170:0/1972793431 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== watch-notify(notify (1) cookie 94525433973920 notify 124554051585 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55f86ae84d70 con 0x55f86ae94ad0 2024-09-12T17:27:59.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.366+0000 7f1bfbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051585 cookie 94525433973920 notifier 4288 bl.length()=177 2024-09-12T17:27:59.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.366+0000 7f1bfbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-12T17:27:59.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.366+0000 7f1bfbfff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-12T17:27:59.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.367+0000 7f1bfbfff640 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f1be8003ea0 con 0x55f86ae94ad0 2024-09-12T17:27:59.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.367+0000 7f1d25667640 1 -- 172.21.15.170:0/1972793431 <== osd.2 v2:172.21.15.170:6808/3855567754 18 ==== osd_op_reply(72 notify.3 [notify cookie 94525434203520 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1d20066040 con 0x55f86ae94ad0 2024-09-12T17:27:59.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.367+0000 7f1d25667640 1 -- 172.21.15.170:0/1972793431 <== osd.2 v2:172.21.15.170:6808/3855567754 19 ==== watch-notify(notify_complete (2) cookie 94525434203520 notify 124554051585 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f86ae7dc10 con 0x55f86ae94ad0 2024-09-12T17:27:59.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.367+0000 7f1d25667640 1 -- 172.21.15.170:0/1972793431 <== osd.2 v2:172.21.15.170:6808/3855567754 20 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d20066040 con 0x55f86ae94ad0 2024-09-12T17:27:59.405 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T17:27:59.362376Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:27:59.362351Z","tags":[],"group_ids":[]} 2024-09-12T17:27:59.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.368+0000 7f1bdafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:59.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.368+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94525433997216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f86aed7d40 con 0x55f86ae900e0 2024-09-12T17:27:59.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.369+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94525433997216] v29'51 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1d10029040 con 0x55f86ae900e0 2024-09-12T17:27:59.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.369+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94525433962560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f86aed7d40 con 0x55f86ae94ad0 2024-09-12T17:27:59.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.370+0000 7f1d25667640 1 -- 172.21.15.170:0/1972793431 <== osd.2 v2:172.21.15.170:6808/3855567754 21 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94525433962560] v29'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d20066040 con 0x55f86ae94ad0 2024-09-12T17:27:59.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.370+0000 7f1d27375800 20 remove_watcher() i=0 2024-09-12T17:27:59.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.370+0000 7f1d27375800 2 removed watcher, disabling cache 2024-09-12T17:27:59.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.370+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94525433967024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f86aed7d40 con 0x55f86ae900e0 2024-09-12T17:27:59.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.371+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.1 v2:172.21.15.170:6800/1903654092 30 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94525433967024] v29'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d10029040 con 0x55f86ae900e0 2024-09-12T17:27:59.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.371+0000 7f1d27375800 20 remove_watcher() i=1 2024-09-12T17:27:59.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.371+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94525433971120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f86aed7d40 con 0x55f86ae995b0 2024-09-12T17:27:59.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.372+0000 7f1d24e66640 1 -- 172.21.15.170:0/1972793431 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94525433971120] v29'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d18051070 con 0x55f86ae995b0 2024-09-12T17:27:59.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.372+0000 7f1d27375800 20 remove_watcher() i=2 2024-09-12T17:27:59.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.372+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94525433973920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f86aed7d40 con 0x55f86ae94ad0 2024-09-12T17:27:59.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.373+0000 7f1d25667640 1 -- 172.21.15.170:0/1972793431 <== osd.2 v2:172.21.15.170:6808/3855567754 22 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94525433973920] v29'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d20066040 con 0x55f86ae94ad0 2024-09-12T17:27:59.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.373+0000 7f1d27375800 20 remove_watcher() i=3 2024-09-12T17:27:59.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.373+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94525433977984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f86aed7d40 con 0x55f86ae900e0 2024-09-12T17:27:59.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.374+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.1 v2:172.21.15.170:6800/1903654092 31 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94525433977984] v29'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d10029040 con 0x55f86ae900e0 2024-09-12T17:27:59.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.374+0000 7f1d27375800 20 remove_watcher() i=4 2024-09-12T17:27:59.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.374+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94525433980688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f86aed7d40 con 0x7f1d2004ec10 2024-09-12T17:27:59.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.375+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94525433980688] v29'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d10029040 con 0x7f1d2004ec10 2024-09-12T17:27:59.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.375+0000 7f1d27375800 20 remove_watcher() i=5 2024-09-12T17:27:59.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.375+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94525433976240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f86aed7d40 con 0x7f1d2004ec10 2024-09-12T17:27:59.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.376+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94525433976240] v29'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d10029040 con 0x7f1d2004ec10 2024-09-12T17:27:59.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.376+0000 7f1d27375800 20 remove_watcher() i=6 2024-09-12T17:27:59.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.376+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94525433968144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f86aed7d40 con 0x7f1d2004ec10 2024-09-12T17:27:59.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.377+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94525433968144] v29'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d10029040 con 0x7f1d2004ec10 2024-09-12T17:27:59.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.377+0000 7f1d27375800 20 remove_watcher() i=7 2024-09-12T17:27:59.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.377+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f1d2004ec10 msgr2=0x7f1d2003b790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.377+0000 7f1d27375800 1 --2- 172.21.15.170:0/1972793431 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f1d2004ec10 0x7f1d2003b790 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.377+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55f86ae900e0 msgr2=0x55f86ae925a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.377+0000 7f1d27375800 1 --2- 172.21.15.170:0/1972793431 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55f86ae900e0 0x55f86ae925a0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.377+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55f86ae94ad0 msgr2=0x55f86ae96ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.377+0000 7f1d27375800 1 --2- 172.21.15.170:0/1972793431 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55f86ae94ad0 0x55f86ae96ec0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.377+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55f86ae995b0 msgr2=0x55f86ae9ba70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.377+0000 7f1d27375800 1 --2- 172.21.15.170:0/1972793431 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55f86ae995b0 0x55f86ae9ba70 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.377+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1bf003c780 msgr2=0x7f1bf003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.377+0000 7f1d27375800 1 --2- 172.21.15.170:0/1972793431 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1bf003c780 0x7f1bf003ec40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1d18098070 tx=0x7f1d18088000 comp rx=0 tx=0).stop 2024-09-12T17:27:59.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.377+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f86ae7d220 msgr2=0x55f86ae84810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.377+0000 7f1d27375800 1 --2- 172.21.15.170:0/1972793431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f86ae7d220 0x55f86ae84810 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1d200208e0 tx=0x7f1d20053cf0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.377+0000 7f1d1ffff640 1 -- 172.21.15.170:0/1972793431 reap_dead start 2024-09-12T17:27:59.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.377+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 shutdown_connections 2024-09-12T17:27:59.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.377+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 >> 172.21.15.170:0/1972793431 conn(0x55f86ae79620 msgr2=0x55f86ae77830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:59.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.377+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 shutdown_connections 2024-09-12T17:27:59.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.377+0000 7f1d27375800 1 -- 172.21.15.170:0/1972793431 wait complete. 2024-09-12T17:27:59.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.377+0000 7f1d27375800 1 -- 172.21.15.170:0/2071536178 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1bfc03c730 msgr2=0x7f1bfc03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.377+0000 7f1d27375800 1 --2- 172.21.15.170:0/2071536178 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1bfc03c730 0x7f1bfc03ebf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x55f86ae49970 tx=0x7f1d1805d5c0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.377+0000 7f1d27375800 1 -- 172.21.15.170:0/2071536178 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f86ae70700 msgr2=0x55f86ae70b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.377+0000 7f1d27375800 1 --2- 172.21.15.170:0/2071536178 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f86ae70700 0x55f86ae70b20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x55f86ae48920 tx=0x7f1d200167b0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.378+0000 7f1d27375800 1 -- 172.21.15.170:0/2071536178 shutdown_connections 2024-09-12T17:27:59.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.378+0000 7f1d27375800 1 --2- 172.21.15.170:0/2071536178 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1bfc03c730 0x7f1bfc03ebf0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.378+0000 7f1d27375800 1 --2- 172.21.15.170:0/2071536178 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f86ae70700 0x55f86ae70b20 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.378+0000 7f1d27375800 1 -- 172.21.15.170:0/2071536178 >> 172.21.15.170:0/2071536178 conn(0x55f86ae64ab0 msgr2=0x55f86ae64e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:59.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.378+0000 7f1d27375800 1 -- 172.21.15.170:0/2071536178 shutdown_connections 2024-09-12T17:27:59.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.378+0000 7f1d27375800 1 -- 172.21.15.170:0/2071536178 wait complete. 2024-09-12T17:27:59.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.378+0000 7f1d27375800 1 -- 172.21.15.170:0/3799806694 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55f86ad593f0 msgr2=0x55f86ae4af50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.378+0000 7f1d27375800 1 --2- 172.21.15.170:0/3799806694 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55f86ad593f0 0x55f86ae4af50 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.378+0000 7f1d27375800 1 -- 172.21.15.170:0/3799806694 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55f86ae5f260 msgr2=0x55f86ae616e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.378+0000 7f1d27375800 1 --2- 172.21.15.170:0/3799806694 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55f86ae5f260 0x55f86ae616e0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.378+0000 7f1d27375800 1 -- 172.21.15.170:0/3799806694 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1c0c03c780 msgr2=0x7f1c0c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.378+0000 7f1d27375800 1 --2- 172.21.15.170:0/3799806694 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1c0c03c780 0x7f1c0c03ec40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1d10001d70 tx=0x7f1d100012d0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.378+0000 7f1d27375800 1 -- 172.21.15.170:0/3799806694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f86ad564a0 msgr2=0x55f86ae47920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.378+0000 7f1d27375800 1 --2- 172.21.15.170:0/3799806694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f86ad564a0 0x55f86ae47920 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1d18025c20 tx=0x7f1d18002fb0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.378+0000 7f1d27375800 1 -- 172.21.15.170:0/3799806694 shutdown_connections 2024-09-12T17:27:59.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.378+0000 7f1d27375800 1 --2- 172.21.15.170:0/3799806694 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55f86ae5f260 0x55f86ae616e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.378+0000 7f1d27375800 1 --2- 172.21.15.170:0/3799806694 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1c0c03c780 0x7f1c0c03ec40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.378+0000 7f1d27375800 1 --2- 172.21.15.170:0/3799806694 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55f86ad593f0 0x55f86ae4af50 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.378+0000 7f1d27375800 1 --2- 172.21.15.170:0/3799806694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f86ad564a0 0x55f86ae47920 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.378+0000 7f1d27375800 1 -- 172.21.15.170:0/3799806694 >> 172.21.15.170:0/3799806694 conn(0x55f86ad51980 msgr2=0x55f86ae42e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:59.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.378+0000 7f1d27375800 1 -- 172.21.15.170:0/3799806694 shutdown_connections 2024-09-12T17:27:59.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.378+0000 7f1d27375800 1 -- 172.21.15.170:0/3799806694 wait complete. 2024-09-12T17:27:59.416 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T17:27:59.362376Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:27:59.362351Z', 'tags': [], 'group_ids': []} 2024-09-12T17:27:59.416 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-12T17:27:59.416 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-12T17:27:59.417 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-09-12T17:27:59.465 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:59.465 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:59.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.465+0000 7fd9fbd2e800 1 Processor -- start 2024-09-12T17:27:59.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.465+0000 7fd9fbd2e800 1 -- start start 2024-09-12T17:27:59.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.465+0000 7fd9fbd2e800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5654880544c0 0x5654880548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.465+0000 7fd9fbd2e800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x565487effe40 con 0x565488054e00 2024-09-12T17:27:59.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.465+0000 7fd9fbd2e800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x565487eca680 con 0x5654880544c0 2024-09-12T17:27:59.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.465+0000 7fd9f7add640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5654880544c0 0x5654880548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.465+0000 7fd9effff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x565488054e00 0x5654880552b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:48262/0 (socket says 172.21.15.170:48262) 2024-09-12T17:27:59.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.465+0000 7fd9effff640 1 -- 172.21.15.170:0/3862450332 learned_addr learned my addr 172.21.15.170:0/3862450332 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:27:59.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.466+0000 7fd9f7add640 1 -- 172.21.15.170:0/3862450332 >> v1:172.21.15.47:6789/0 conn(0x565488054e00 legacy=0x5654880552b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.466+0000 7fd9f7add640 1 -- 172.21.15.170:0/3862450332 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x565487ee66b0 con 0x5654880544c0 2024-09-12T17:27:59.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.467+0000 7fd9f7add640 1 --2- 172.21.15.170:0/3862450332 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654880544c0 0x5654880548c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd9e800a470 tx=0x7fd9e8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e5d55f1aa1a060 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.468+0000 7fd9f72dc640 1 -- 172.21.15.170:0/3862450332 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9e8053570 con 0x5654880544c0 2024-09-12T17:27:59.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.468+0000 7fd9f72dc640 1 -- 172.21.15.170:0/3862450332 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9e8058070 con 0x5654880544c0 2024-09-12T17:27:59.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.468+0000 7fd9f72dc640 1 -- 172.21.15.170:0/3862450332 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9e8053880 con 0x5654880544c0 2024-09-12T17:27:59.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.468+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3862450332 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654880544c0 msgr2=0x5654880548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.468+0000 7fd9fbd2e800 1 --2- 172.21.15.170:0/3862450332 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654880544c0 0x5654880548c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd9e800a470 tx=0x7fd9e8045a20 comp rx=0 tx=0).stop 2024-09-12T17:27:59.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.468+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3862450332 shutdown_connections 2024-09-12T17:27:59.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.468+0000 7fd9fbd2e800 1 --2- 172.21.15.170:0/3862450332 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654880544c0 0x5654880548c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.468+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3862450332 >> 172.21.15.170:0/3862450332 conn(0x565488050210 msgr2=0x565488052650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:59.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.468+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3862450332 shutdown_connections 2024-09-12T17:27:59.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.468+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3862450332 wait complete. 2024-09-12T17:27:59.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.482+0000 7fd9fbd2e800 1 Processor -- start 2024-09-12T17:27:59.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.482+0000 7fd9fbd2e800 1 -- start start 2024-09-12T17:27:59.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.483+0000 7fd9fbd2e800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654880544c0 0x565488147830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.483+0000 7fd9fbd2e800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x565487eeedd0 con 0x5654880544c0 2024-09-12T17:27:59.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.483+0000 7fd9f7add640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654880544c0 0x565488147830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.483+0000 7fd9f7add640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654880544c0 0x565488147830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56532/0 (socket says 172.21.15.170:56532) 2024-09-12T17:27:59.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.483+0000 7fd9f7add640 1 -- 172.21.15.170:0/609747505 learned_addr learned my addr 172.21.15.170:0/609747505 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:59.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.483+0000 7fd9f7add640 1 -- 172.21.15.170:0/609747505 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565487f07e10 con 0x5654880544c0 2024-09-12T17:27:59.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.483+0000 7fd9f7add640 1 --2- 172.21.15.170:0/609747505 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654880544c0 0x565488147830 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8025c20 tx=0x7fd9e8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f1d15f620a74763 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.484+0000 7fd8e5e0b640 1 -- 172.21.15.170:0/609747505 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9e8053a20 con 0x5654880544c0 2024-09-12T17:27:59.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.484+0000 7fd8e5e0b640 1 -- 172.21.15.170:0/609747505 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9e8063070 con 0x5654880544c0 2024-09-12T17:27:59.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.484+0000 7fd8e5e0b640 1 -- 172.21.15.170:0/609747505 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9e8053cf0 con 0x5654880544c0 2024-09-12T17:27:59.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.484+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/609747505 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654880544c0 msgr2=0x565488147830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.484+0000 7fd9fbd2e800 1 --2- 172.21.15.170:0/609747505 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654880544c0 0x565488147830 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8025c20 tx=0x7fd9e8051000 comp rx=0 tx=0).stop 2024-09-12T17:27:59.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.484+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/609747505 shutdown_connections 2024-09-12T17:27:59.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.484+0000 7fd9fbd2e800 1 --2- 172.21.15.170:0/609747505 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654880544c0 0x565488147830 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.484+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/609747505 >> 172.21.15.170:0/609747505 conn(0x565488050210 msgr2=0x5654881431b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:59.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.484+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/609747505 shutdown_connections 2024-09-12T17:27:59.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.484+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/609747505 wait complete. 2024-09-12T17:27:59.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.485+0000 7fd9fbd2e800 1 Processor -- start 2024-09-12T17:27:59.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.485+0000 7fd9fbd2e800 1 -- start start 2024-09-12T17:27:59.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.485+0000 7fd9fbd2e800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654880544c0 0x56548814eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.485+0000 7fd9fbd2e800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x565488055d80 con 0x5654880544c0 2024-09-12T17:27:59.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.485+0000 7fd9f7add640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654880544c0 0x56548814eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.485+0000 7fd9f7add640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654880544c0 0x56548814eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56546/0 (socket says 172.21.15.170:56546) 2024-09-12T17:27:59.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.485+0000 7fd9f7add640 1 -- 172.21.15.170:0/642251202 learned_addr learned my addr 172.21.15.170:0/642251202 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:59.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.485+0000 7fd9f7add640 1 -- 172.21.15.170:0/642251202 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56548814f430 con 0x5654880544c0 2024-09-12T17:27:59.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.485+0000 7fd9f7add640 1 --2- 172.21.15.170:0/642251202 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654880544c0 0x56548814eed0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8025c20 tx=0x7fd9e8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.486+0000 7fd8dffff640 1 -- 172.21.15.170:0/642251202 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9e8068660 con 0x5654880544c0 2024-09-12T17:27:59.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.486+0000 7fd8dffff640 1 -- 172.21.15.170:0/642251202 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9e8068800 con 0x5654880544c0 2024-09-12T17:27:59.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.486+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/642251202 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56548814f6c0 con 0x5654880544c0 2024-09-12T17:27:59.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.486+0000 7fd8dffff640 1 -- 172.21.15.170:0/642251202 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9e8068ae0 con 0x5654880544c0 2024-09-12T17:27:59.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.486+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/642251202 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565488150040 con 0x5654880544c0 2024-09-12T17:27:59.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.486+0000 7fd8dffff640 1 -- 172.21.15.170:0/642251202 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fd9e8068c80 con 0x5654880544c0 2024-09-12T17:27:59.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.487+0000 7fd8dffff640 1 --2- 172.21.15.170:0/642251202 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd8e003c780 0x7fd8e003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.487+0000 7fd8dffff640 1 -- 172.21.15.170:0/642251202 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fd9e8098080 con 0x5654880544c0 2024-09-12T17:27:59.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.487+0000 7fd9effff640 1 --2- 172.21.15.170:0/642251202 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd8e003c780 0x7fd8e003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.487+0000 7fd9fbd2e800 1 --2- 172.21.15.170:0/642251202 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x565488054e00 0x565488156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.487+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/642251202 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x565488150c00 con 0x565488054e00 2024-09-12T17:27:59.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.487+0000 7fd9f82de640 1 --2- 172.21.15.170:0/642251202 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x565488054e00 0x565488156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.487+0000 7fd9effff640 1 --2- 172.21.15.170:0/642251202 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd8e003c780 0x7fd8e003ec40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0001d70 tx=0x7fd9e00012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.487+0000 7fd9f82de640 1 --2- 172.21.15.170:0/642251202 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x565488054e00 0x565488156520 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.487+0000 7fd9f82de640 1 -- 172.21.15.170:0/642251202 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd9f000a4d0 con 0x565488054e00 2024-09-12T17:27:59.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.488+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/642251202 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x565488150540 con 0x565488054e00 2024-09-12T17:27:59.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.488+0000 7fd9f82de640 1 -- 172.21.15.170:0/642251202 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd9f000a4d0 con 0x565488054e00 2024-09-12T17:27:59.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.488+0000 7fd9fbd2e800 1 --2- 172.21.15.170:0/642251202 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x565488158980 0x56548815ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.488+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/642251202 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56548815b440 con 0x565488158980 2024-09-12T17:27:59.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.488+0000 7fd9f7add640 1 --2- 172.21.15.170:0/642251202 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x565488158980 0x56548815ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.488+0000 7fd9f7add640 1 --2- 172.21.15.170:0/642251202 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x565488158980 0x56548815ad70 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.488+0000 7fd9f7add640 1 -- 172.21.15.170:0/642251202 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd9e8051070 con 0x565488158980 2024-09-12T17:27:59.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.488+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/642251202 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x565488157820 con 0x565488054e00 2024-09-12T17:27:59.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.489+0000 7fd9f82de640 1 -- 172.21.15.170:0/642251202 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd9f000a4d0 con 0x565488054e00 2024-09-12T17:27:59.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.489+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/642251202 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x565488157cc0 con 0x565488158980 2024-09-12T17:27:59.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.489+0000 7fd9f7add640 1 -- 172.21.15.170:0/642251202 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd9e8051070 con 0x565488158980 2024-09-12T17:27:59.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.489+0000 7fd9fbd2e800 1 Processor -- start 2024-09-12T17:27:59.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.489+0000 7fd9fbd2e800 1 -- start start 2024-09-12T17:27:59.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.489+0000 7fd9fbd2e800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565488169cf0 0x56548816a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.489+0000 7fd9fbd2e800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x565487f4ca00 con 0x565488169cf0 2024-09-12T17:27:59.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.490+0000 7fd9f82de640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565488169cf0 0x56548816a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.490+0000 7fd9f82de640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565488169cf0 0x56548816a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56558/0 (socket says 172.21.15.170:56558) 2024-09-12T17:27:59.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.490+0000 7fd9f82de640 1 -- 172.21.15.170:0/1801487233 learned_addr learned my addr 172.21.15.170:0/1801487233 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:59.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.490+0000 7fd9f82de640 1 -- 172.21.15.170:0/1801487233 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56548816a750 con 0x565488169cf0 2024-09-12T17:27:59.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.490+0000 7fd9f82de640 1 --2- 172.21.15.170:0/1801487233 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565488169cf0 0x56548816a110 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x56548814fc20 tx=0x7fd9f00167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.490+0000 7fd8dd7fa640 1 -- 172.21.15.170:0/1801487233 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9f0013640 con 0x565488169cf0 2024-09-12T17:27:59.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.490+0000 7fd8dd7fa640 1 -- 172.21.15.170:0/1801487233 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9f00137e0 con 0x565488169cf0 2024-09-12T17:27:59.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.490+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/1801487233 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56548816af80 con 0x565488169cf0 2024-09-12T17:27:59.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.490+0000 7fd8dd7fa640 1 -- 172.21.15.170:0/1801487233 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9f0013ae0 con 0x565488169cf0 2024-09-12T17:27:59.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.490+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/1801487233 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56548816b520 con 0x565488169cf0 2024-09-12T17:27:59.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.491+0000 7fd8dd7fa640 1 -- 172.21.15.170:0/1801487233 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fd9f0011040 con 0x565488169cf0 2024-09-12T17:27:59.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.491+0000 7fd8dd7fa640 1 --2- 172.21.15.170:0/1801487233 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd8d003c730 0x7fd8d003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.492+0000 7fd8dd7fa640 1 -- 172.21.15.170:0/1801487233 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fd9f000e040 con 0x565488169cf0 2024-09-12T17:27:59.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.492+0000 7fd9f7add640 1 --2- 172.21.15.170:0/1801487233 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd8d003c730 0x7fd8d003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.492+0000 7fd9fbd2e800 1 Processor -- start 2024-09-12T17:27:59.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.492+0000 7fd9fbd2e800 1 -- start start 2024-09-12T17:27:59.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.492+0000 7fd9f7add640 1 --2- 172.21.15.170:0/1801487233 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd8d003c730 0x7fd8d003ebf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x565488156b00 tx=0x7fd9e8045a20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.492+0000 7fd9fbd2e800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565488176830 0x565488176c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.492+0000 7fd9fbd2e800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x565488148020 con 0x565488176830 2024-09-12T17:27:59.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.492+0000 7fd9f82de640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565488176830 0x565488176c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.492+0000 7fd9f82de640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565488176830 0x565488176c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56572/0 (socket says 172.21.15.170:56572) 2024-09-12T17:27:59.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.492+0000 7fd9f82de640 1 -- 172.21.15.170:0/3312986134 learned_addr learned my addr 172.21.15.170:0/3312986134 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:59.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.492+0000 7fd9f82de640 1 -- 172.21.15.170:0/3312986134 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654881771e0 con 0x565488176830 2024-09-12T17:27:59.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.493+0000 7fd9f82de640 1 --2- 172.21.15.170:0/3312986134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565488176830 0x565488176c10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0016cd0 tx=0x7fd9f0014480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc2f90475c9978b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.493+0000 7fd8d6ffd640 1 -- 172.21.15.170:0/3312986134 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9f0021a90 con 0x565488176830 2024-09-12T17:27:59.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.493+0000 7fd8d6ffd640 1 -- 172.21.15.170:0/3312986134 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9f0055040 con 0x565488176830 2024-09-12T17:27:59.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.493+0000 7fd8d6ffd640 1 -- 172.21.15.170:0/3312986134 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9f001f470 con 0x565488176830 2024-09-12T17:27:59.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.493+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3312986134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565488176830 msgr2=0x565488176c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.493+0000 7fd9fbd2e800 1 --2- 172.21.15.170:0/3312986134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565488176830 0x565488176c10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0016cd0 tx=0x7fd9f0014480 comp rx=0 tx=0).stop 2024-09-12T17:27:59.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.493+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3312986134 shutdown_connections 2024-09-12T17:27:59.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.493+0000 7fd9fbd2e800 1 --2- 172.21.15.170:0/3312986134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565488176830 0x565488176c10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.493+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3312986134 >> 172.21.15.170:0/3312986134 conn(0x565488172c30 msgr2=0x565488170e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:59.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.493+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3312986134 shutdown_connections 2024-09-12T17:27:59.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.493+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3312986134 wait complete. 2024-09-12T17:27:59.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.494+0000 7fd9fbd2e800 1 Processor -- start 2024-09-12T17:27:59.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.494+0000 7fd9fbd2e800 1 -- start start 2024-09-12T17:27:59.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.494+0000 7fd9fbd2e800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565488176830 0x56548817de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.494+0000 7fd9fbd2e800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x565488177810 con 0x565488176830 2024-09-12T17:27:59.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.494+0000 7fd9f82de640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565488176830 0x56548817de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.494+0000 7fd9f82de640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565488176830 0x56548817de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56584/0 (socket says 172.21.15.170:56584) 2024-09-12T17:27:59.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.494+0000 7fd9f82de640 1 -- 172.21.15.170:0/3549133997 learned_addr learned my addr 172.21.15.170:0/3549133997 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:59.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.494+0000 7fd9f82de640 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56548817e360 con 0x565488176830 2024-09-12T17:27:59.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.494+0000 7fd9f82de640 1 --2- 172.21.15.170:0/3549133997 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565488176830 0x56548817de00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd9f002afd0 tx=0x7fd9f0053d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.495+0000 7fd8d57fa640 1 -- 172.21.15.170:0/3549133997 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9f0037070 con 0x565488176830 2024-09-12T17:27:59.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.495+0000 7fd8d57fa640 1 -- 172.21.15.170:0/3549133997 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9f0021440 con 0x565488176830 2024-09-12T17:27:59.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.495+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56548817e5f0 con 0x565488176830 2024-09-12T17:27:59.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.495+0000 7fd8d57fa640 1 -- 172.21.15.170:0/3549133997 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9f0020800 con 0x565488176830 2024-09-12T17:27:59.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.495+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56548817f180 con 0x565488176830 2024-09-12T17:27:59.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.495+0000 7fd8d57fa640 1 -- 172.21.15.170:0/3549133997 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fd9f003a070 con 0x565488176830 2024-09-12T17:27:59.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.495+0000 7fd8d57fa640 1 --2- 172.21.15.170:0/3549133997 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd8c003c780 0x7fd8c003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.496+0000 7fd8d57fa640 1 -- 172.21.15.170:0/3549133997 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fd9f003daf0 con 0x565488176830 2024-09-12T17:27:59.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.496+0000 7fd9f7add640 1 --2- 172.21.15.170:0/3549133997 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd8c003c780 0x7fd8c003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.496+0000 7fd9f7add640 1 --2- 172.21.15.170:0/3549133997 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd8c003c780 0x7fd8c003ec40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd9e805dac0 tx=0x7fd9e808c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.496+0000 7fd9fbd2e800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.496+0000 7fd9fbd2e800 1 --2- 172.21.15.170:0/3549133997 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5654881896c0 0x56548818bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.496+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56548818c2d0 con 0x5654881896c0 2024-09-12T17:27:59.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.496+0000 7fd9effff640 1 --2- 172.21.15.170:0/3549133997 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5654881896c0 0x56548818bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.497+0000 7fd9effff640 1 --2- 172.21.15.170:0/3549133997 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5654881896c0 0x56548818bb80 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.497+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd9e0009050 con 0x5654881896c0 2024-09-12T17:27:59.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.497+0000 7fd9fbd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.497+0000 7fd9fbd2e800 20 realm 2024-09-12T17:27:59.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.497+0000 7fd9fbd2e800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.497+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x565488188a10 con 0x5654881896c0 2024-09-12T17:27:59.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.497+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd9e0009050 con 0x5654881896c0 2024-09-12T17:27:59.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.497+0000 7fd9fbd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.497+0000 7fd9fbd2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:59.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.497+0000 7fd9fbd2e800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.497+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56548818cdc0 con 0x5654881896c0 2024-09-12T17:27:59.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.497+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd9e0009050 con 0x5654881896c0 2024-09-12T17:27:59.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.497+0000 7fd9fbd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.497+0000 7fd9fbd2e800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.497+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56548818d690 con 0x5654881896c0 2024-09-12T17:27:59.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.498+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd9e0009050 con 0x5654881896c0 2024-09-12T17:27:59.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.498+0000 7fd9fbd2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:59.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.498+0000 7fd9fbd2e800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.498+0000 7fd9fbd2e800 1 --2- 172.21.15.170:0/3549133997 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56548818e0b0 0x5654881904a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.498+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x565488190be0 con 0x56548818e0b0 2024-09-12T17:27:59.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.498+0000 7fd9f82de640 1 --2- 172.21.15.170:0/3549133997 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56548818e0b0 0x5654881904a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.498+0000 7fd9f82de640 1 --2- 172.21.15.170:0/3549133997 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56548818e0b0 0x5654881904a0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.498+0000 7fd9f82de640 1 -- 172.21.15.170:0/3549133997 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd9f0039030 con 0x56548818e0b0 2024-09-12T17:27:59.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.498+0000 7fd9fbd2e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:27:59.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.498+0000 7fd9fbd2e800 20 searching for the correct realm 2024-09-12T17:27:59.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.498+0000 7fd9fbd2e800 1 --2- 172.21.15.170:0/3549133997 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x565488192b90 0x565488195050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.498+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5654881956d0 con 0x565488192b90 2024-09-12T17:27:59.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.498+0000 7fd9f7add640 1 --2- 172.21.15.170:0/3549133997 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x565488192b90 0x565488195050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.499+0000 7fd9f7add640 1 --2- 172.21.15.170:0/3549133997 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x565488192b90 0x565488195050 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.499+0000 7fd9f7add640 1 -- 172.21.15.170:0/3549133997 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e8084050 con 0x565488192b90 2024-09-12T17:27:59.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.499+0000 7fd9f7add640 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5654881956d0 con 0x56548818e0b0 2024-09-12T17:27:59.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.499+0000 7fd9f82de640 1 -- 172.21.15.170:0/3549133997 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9f0039030 con 0x56548818e0b0 2024-09-12T17:27:59.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.499+0000 7fd9f82de640 1 --2- 172.21.15.170:0/3549133997 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fd9f003c060 0x7fd9f0046990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.499+0000 7fd9f82de640 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5654881956d0 con 0x7fd9f003c060 2024-09-12T17:27:59.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.499+0000 7fd9effff640 1 --2- 172.21.15.170:0/3549133997 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fd9f003c060 0x7fd9f0046990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.500+0000 7fd9effff640 1 --2- 172.21.15.170:0/3549133997 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fd9f003c060 0x7fd9f0046990 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.500+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e0009050 con 0x7fd9f003c060 2024-09-12T17:27:59.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.500+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5654881956d0 con 0x5654881896c0 2024-09-12T17:27:59.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.500+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e0009050 con 0x5654881896c0 2024-09-12T17:27:59.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.500+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5654881956d0 con 0x5654881896c0 2024-09-12T17:27:59.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.500+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e0029040 con 0x5654881896c0 2024-09-12T17:27:59.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.500+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5654881956d0 con 0x7fd9f003c060 2024-09-12T17:27:59.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.501+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e0029040 con 0x7fd9f003c060 2024-09-12T17:27:59.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.501+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5654881956d0 con 0x7fd9f003c060 2024-09-12T17:27:59.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.501+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e0029040 con 0x7fd9f003c060 2024-09-12T17:27:59.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.501+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5654881956d0 con 0x56548818e0b0 2024-09-12T17:27:59.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.501+0000 7fd9f82de640 1 -- 172.21.15.170:0/3549133997 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9f0039030 con 0x56548818e0b0 2024-09-12T17:27:59.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.501+0000 7fd9f82de640 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5654881956d0 con 0x565488192b90 2024-09-12T17:27:59.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.501+0000 7fd9f7add640 1 -- 172.21.15.170:0/3549133997 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e8084050 con 0x565488192b90 2024-09-12T17:27:59.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.501+0000 7fd9f7add640 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5654881956d0 con 0x5654881896c0 2024-09-12T17:27:59.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.502+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e0029040 con 0x5654881896c0 2024-09-12T17:27:59.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.502+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5654881956d0 con 0x7fd9f003c060 2024-09-12T17:27:59.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.502+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e0029040 con 0x7fd9f003c060 2024-09-12T17:27:59.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.502+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5654881956d0 con 0x5654881896c0 2024-09-12T17:27:59.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.502+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e0029040 con 0x5654881896c0 2024-09-12T17:27:59.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.502+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5654881956d0 con 0x56548818e0b0 2024-09-12T17:27:59.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.502+0000 7fd9f82de640 1 -- 172.21.15.170:0/3549133997 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fd9f0039030 con 0x56548818e0b0 2024-09-12T17:27:59.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.502+0000 7fd9f82de640 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5654881956d0 con 0x565488192b90 2024-09-12T17:27:59.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.503+0000 7fd9f7add640 1 -- 172.21.15.170:0/3549133997 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e8084050 con 0x565488192b90 2024-09-12T17:27:59.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.503+0000 7fd9f7add640 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5654881956d0 con 0x565488192b90 2024-09-12T17:27:59.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.503+0000 7fd9f7add640 1 -- 172.21.15.170:0/3549133997 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e8084050 con 0x565488192b90 2024-09-12T17:27:59.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.503+0000 7fd9f7add640 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5654881956d0 con 0x7fd9f003c060 2024-09-12T17:27:59.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.503+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e0029040 con 0x7fd9f003c060 2024-09-12T17:27:59.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.503+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5654881956d0 con 0x565488192b90 2024-09-12T17:27:59.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.503+0000 7fd9f7add640 1 -- 172.21.15.170:0/3549133997 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e8084050 con 0x565488192b90 2024-09-12T17:27:59.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.503+0000 7fd9f7add640 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5654881956d0 con 0x565488192b90 2024-09-12T17:27:59.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.503+0000 7fd9f7add640 1 -- 172.21.15.170:0/3549133997 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e8084050 con 0x565488192b90 2024-09-12T17:27:59.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.504+0000 7fd9f7add640 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5654881956d0 con 0x5654881896c0 2024-09-12T17:27:59.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.504+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e0029040 con 0x5654881896c0 2024-09-12T17:27:59.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.504+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5654881956d0 con 0x5654881896c0 2024-09-12T17:27:59.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.504+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd9e0029040 con 0x5654881896c0 2024-09-12T17:27:59.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.504+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5654881956d0 con 0x7fd9f003c060 2024-09-12T17:27:59.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.504+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e0029040 con 0x7fd9f003c060 2024-09-12T17:27:59.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.504+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5654881956d0 con 0x565488192b90 2024-09-12T17:27:59.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.505+0000 7fd9f7add640 1 -- 172.21.15.170:0/3549133997 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e8084050 con 0x565488192b90 2024-09-12T17:27:59.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.505+0000 7fd9f7add640 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5654881956d0 con 0x56548818e0b0 2024-09-12T17:27:59.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.505+0000 7fd9f82de640 1 -- 172.21.15.170:0/3549133997 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9f0039030 con 0x56548818e0b0 2024-09-12T17:27:59.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.505+0000 7fd9f82de640 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5654881956d0 con 0x5654881896c0 2024-09-12T17:27:59.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.505+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e0029040 con 0x5654881896c0 2024-09-12T17:27:59.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.505+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5654881956d0 con 0x7fd9f003c060 2024-09-12T17:27:59.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.505+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e0029040 con 0x7fd9f003c060 2024-09-12T17:27:59.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.506+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5654881956d0 con 0x565488192b90 2024-09-12T17:27:59.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.506+0000 7fd9f7add640 1 -- 172.21.15.170:0/3549133997 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e8084050 con 0x565488192b90 2024-09-12T17:27:59.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.506+0000 7fd9f7add640 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5654881956d0 con 0x7fd9f003c060 2024-09-12T17:27:59.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.506+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e0029040 con 0x7fd9f003c060 2024-09-12T17:27:59.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.506+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5654881956d0 con 0x56548818e0b0 2024-09-12T17:27:59.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.506+0000 7fd9f82de640 1 -- 172.21.15.170:0/3549133997 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9f0039030 con 0x56548818e0b0 2024-09-12T17:27:59.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.506+0000 7fd9f82de640 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5654881956d0 con 0x565488192b90 2024-09-12T17:27:59.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.506+0000 7fd9f7add640 1 -- 172.21.15.170:0/3549133997 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e8084050 con 0x565488192b90 2024-09-12T17:27:59.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.506+0000 7fd9f7add640 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5654881956d0 con 0x7fd9f003c060 2024-09-12T17:27:59.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.507+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e0029040 con 0x7fd9f003c060 2024-09-12T17:27:59.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.507+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5654881956d0 con 0x5654881896c0 2024-09-12T17:27:59.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.507+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd9e0029040 con 0x5654881896c0 2024-09-12T17:27:59.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.507+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5654881956d0 con 0x56548818e0b0 2024-09-12T17:27:59.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.507+0000 7fd9f82de640 1 -- 172.21.15.170:0/3549133997 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd9f0068040 con 0x56548818e0b0 2024-09-12T17:27:59.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.507+0000 7fd9fbd2e800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:27:59.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.507+0000 7fd9fbd2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:59.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.507+0000 7fd9fbd2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:59.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.507+0000 7fd9fbd2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:59.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.507+0000 7fd9fbd2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:59.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.507+0000 7fd9fbd2e800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:27:59.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.507+0000 7fd9fbd2e800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.507+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5654881915d0 con 0x5654881896c0 2024-09-12T17:27:59.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.508+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd9e0029040 con 0x5654881896c0 2024-09-12T17:27:59.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.508+0000 7fd9fbd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.508+0000 7fd9fbd2e800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.508+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x565488191e70 con 0x5654881896c0 2024-09-12T17:27:59.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.508+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd9e0029040 con 0x5654881896c0 2024-09-12T17:27:59.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.508+0000 7fd9fbd2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:59.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.508+0000 7fd9fbd2e800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.508+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x565488191210 con 0x56548818e0b0 2024-09-12T17:27:59.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.508+0000 7fd9f82de640 1 -- 172.21.15.170:0/3549133997 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd9f0068040 con 0x56548818e0b0 2024-09-12T17:27:59.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.508+0000 7fd9fbd2e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:27:59.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.508+0000 7fd9fbd2e800 20 zone default found 2024-09-12T17:27:59.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.508+0000 7fd9fbd2e800 4 Realm: () 2024-09-12T17:27:59.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.508+0000 7fd9fbd2e800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:27:59.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.508+0000 7fd9fbd2e800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:27:59.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.508+0000 7fd9fbd2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:59.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.508+0000 7fd9fbd2e800 20 zonegroup default 2024-09-12T17:27:59.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.508+0000 7fd9fbd2e800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.508+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x565488196000 con 0x7fd9f003c060 2024-09-12T17:27:59.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.508+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd9e0029040 con 0x7fd9f003c060 2024-09-12T17:27:59.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.508+0000 7fd9fbd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.508+0000 7fd9fbd2e800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.508+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x565488198240 con 0x565488192b90 2024-09-12T17:27:59.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.509+0000 7fd9f7add640 1 -- 172.21.15.170:0/3549133997 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd9e8084050 con 0x565488192b90 2024-09-12T17:27:59.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.509+0000 7fd9fbd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.509+0000 7fd9fbd2e800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.509+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5654881985e0 con 0x565488192b90 2024-09-12T17:27:59.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.509+0000 7fd9f7add640 1 -- 172.21.15.170:0/3549133997 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd9e8084050 con 0x565488192b90 2024-09-12T17:27:59.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.509+0000 7fd9fbd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.509+0000 7fd9fbd2e800 20 started sync module instance, tier type = 2024-09-12T17:27:59.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.509+0000 7fd9fbd2e800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:27:59.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.509+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5654881976d0 con 0x56548818e0b0 2024-09-12T17:27:59.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.510+0000 7fd9f82de640 1 -- 172.21.15.170:0/3549133997 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9f0068040 con 0x56548818e0b0 2024-09-12T17:27:59.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.510+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94921060612800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x565488197330 con 0x56548818e0b0 2024-09-12T17:27:59.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.510+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5654881994a0 con 0x5654881896c0 2024-09-12T17:27:59.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.511+0000 7fd9f82de640 1 -- 172.21.15.170:0/3549133997 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94921060612800] v29'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9f0068040 con 0x56548818e0b0 2024-09-12T17:27:59.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.511+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e0029040 con 0x5654881896c0 2024-09-12T17:27:59.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.511+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94921060616656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5654881994a0 con 0x5654881896c0 2024-09-12T17:27:59.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.511+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x565488199f50 con 0x565488192b90 2024-09-12T17:27:59.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.512+0000 7fd9f7add640 1 -- 172.21.15.170:0/3549133997 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e8084050 con 0x565488192b90 2024-09-12T17:27:59.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.512+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94921060620848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56548819a7f0 con 0x565488192b90 2024-09-12T17:27:59.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.512+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56548819b2d0 con 0x56548818e0b0 2024-09-12T17:27:59.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.513+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94921060616656] v29'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e0029040 con 0x5654881896c0 2024-09-12T17:27:59.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.513+0000 7fd9f82de640 1 -- 172.21.15.170:0/3549133997 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9f0068040 con 0x56548818e0b0 2024-09-12T17:27:59.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.513+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94921060625888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56548819b2d0 con 0x56548818e0b0 2024-09-12T17:27:59.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.513+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56548819bd60 con 0x5654881896c0 2024-09-12T17:27:59.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.513+0000 7fd9f7add640 1 -- 172.21.15.170:0/3549133997 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94921060620848] v29'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e8084050 con 0x565488192b90 2024-09-12T17:27:59.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.515+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e0029040 con 0x5654881896c0 2024-09-12T17:27:59.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.515+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94921060623168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56548819b2d0 con 0x5654881896c0 2024-09-12T17:27:59.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.515+0000 7fd9f82de640 1 -- 172.21.15.170:0/3549133997 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94921060625888] v29'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9f0068040 con 0x56548818e0b0 2024-09-12T17:27:59.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.515+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56548819c770 con 0x7fd9f003c060 2024-09-12T17:27:59.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.516+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e0029040 con 0x7fd9f003c060 2024-09-12T17:27:59.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.516+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94921060623168] v29'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e0029040 con 0x5654881896c0 2024-09-12T17:27:59.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.516+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94921060618304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56548819c770 con 0x7fd9f003c060 2024-09-12T17:27:59.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.516+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56548819cc80 con 0x7fd9f003c060 2024-09-12T17:27:59.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.517+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94921060618304] v29'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e0029040 con 0x7fd9f003c060 2024-09-12T17:27:59.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.517+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(56 notify.6 [create] v29'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e0029040 con 0x7fd9f003c060 2024-09-12T17:27:59.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.517+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94921060631232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56548819c6e0 con 0x7fd9f003c060 2024-09-12T17:27:59.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.517+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56548819d620 con 0x7fd9f003c060 2024-09-12T17:27:59.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.518+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(58 notify.7 [create] v29'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e0029040 con 0x7fd9f003c060 2024-09-12T17:27:59.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.518+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94921060631232] v29'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e0029040 con 0x7fd9f003c060 2024-09-12T17:27:59.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.518+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94921060634928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56548819d590 con 0x7fd9f003c060 2024-09-12T17:27:59.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.518+0000 7fd9fbd2e800 20 add_watcher() i=0 2024-09-12T17:27:59.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.518+0000 7fd9fbd2e800 20 add_watcher() i=1 2024-09-12T17:27:59.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.518+0000 7fd9fbd2e800 20 add_watcher() i=2 2024-09-12T17:27:59.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.518+0000 7fd9fbd2e800 20 add_watcher() i=3 2024-09-12T17:27:59.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.518+0000 7fd9fbd2e800 20 add_watcher() i=4 2024-09-12T17:27:59.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.518+0000 7fd9fbd2e800 20 add_watcher() i=5 2024-09-12T17:27:59.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.518+0000 7fd9fbd2e800 20 add_watcher() i=6 2024-09-12T17:27:59.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.519+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94921060634928] v29'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e0029040 con 0x7fd9f003c060 2024-09-12T17:27:59.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.519+0000 7fd9fbd2e800 20 add_watcher() i=7 2024-09-12T17:27:59.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.519+0000 7fd9fbd2e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:59.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.519+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56548819cd70 con 0x5654881896c0 2024-09-12T17:27:59.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.519+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd9e0029040 con 0x5654881896c0 2024-09-12T17:27:59.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.519+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94921060637168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56548819e2c0 con 0x5654881896c0 2024-09-12T17:27:59.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.520+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94921060637168] v29'52 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd9e0029040 con 0x5654881896c0 2024-09-12T17:27:59.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.520+0000 7fd8adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:59.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.520+0000 7fd9fbd2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:59.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.520+0000 7fd9fbd2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:59.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.520+0000 7fd9fbd2e800 5 note: GC not initialized 2024-09-12T17:27:59.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.520+0000 7fd8acfe1640 20 reqs_thread_entry: start 2024-09-12T17:27:59.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.521+0000 7fd9fbd2e800 20 init_complete bucket index max shards: 11 2024-09-12T17:27:59.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.521+0000 7fd9fbd2e800 20 Filter name: none 2024-09-12T17:27:59.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.521+0000 7fd8267fc640 20 reqs_thread_entry: start 2024-09-12T17:27:59.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.521+0000 7fd9fbd2e800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-12T17:27:59.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.521+0000 7fd9fbd2e800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.521+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5654881d3b10 con 0x7fd9f003c060 2024-09-12T17:27:59.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.521+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fd9e0029040 con 0x7fd9f003c060 2024-09-12T17:27:59.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.521+0000 7fd9fbd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.521+0000 7fd9fbd2e800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-12T17:27:59.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.521+0000 7fd9fbd2e800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T17:27:59.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.521+0000 7fd9fbd2e800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-12T17:27:59.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.521+0000 7fd9fbd2e800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.521+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5654881d21b0 con 0x5654881896c0 2024-09-12T17:27:59.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.522+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) ==== 197+0+23 (crc 0 0 0) 0x7fd9e0029040 con 0x5654881896c0 2024-09-12T17:27:59.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.522+0000 7fd9fbd2e800 20 rados_obj.operate() r=0 bl.length=7 2024-09-12T17:27:59.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.522+0000 7fd9fbd2e800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-09-12T17:27:59.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.522+0000 7fd9fbd2e800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-12T17:27:59.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.522+0000 7fd9fbd2e800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:27:59.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.522+0000 7fd9fbd2e800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.522+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5654881d25a0 con 0x5654881896c0 2024-09-12T17:27:59.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.522+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(64 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd9e0029040 con 0x5654881896c0 2024-09-12T17:27:59.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.522+0000 7fd9fbd2e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:27:59.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.522+0000 7fd9fbd2e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T17:27:59.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.522+0000 7fd9fbd2e800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:27:59.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.522+0000 7fd9fbd2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:27:59.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.522+0000 7fd9fbd2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-09-12T17:27:59.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.522+0000 7fd9fbd2e800 20 get_user_info_from_index found 0 xattrs 2024-09-12T17:27:59.537 INFO:teuthology.orchestra.run.smithi170.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-09-12T17:27:59.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.523+0000 7fd8adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:59.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.523+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94921060637168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x565488185b30 con 0x5654881896c0 2024-09-12T17:27:59.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.524+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94921060637168] v29'53 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd9e0029040 con 0x5654881896c0 2024-09-12T17:27:59.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.524+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94921060612800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x565488185b30 con 0x56548818e0b0 2024-09-12T17:27:59.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.525+0000 7fd9f82de640 1 -- 172.21.15.170:0/3549133997 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94921060612800] v29'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9f0068040 con 0x56548818e0b0 2024-09-12T17:27:59.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.525+0000 7fd9fbd2e800 20 remove_watcher() i=0 2024-09-12T17:27:59.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.525+0000 7fd9fbd2e800 2 removed watcher, disabling cache 2024-09-12T17:27:59.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.525+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94921060616656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x565488197ac0 con 0x5654881896c0 2024-09-12T17:27:59.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.526+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94921060616656] v29'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e0029040 con 0x5654881896c0 2024-09-12T17:27:59.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.526+0000 7fd9fbd2e800 20 remove_watcher() i=1 2024-09-12T17:27:59.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.526+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94921060620848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x565488197ac0 con 0x565488192b90 2024-09-12T17:27:59.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.527+0000 7fd9f7add640 1 -- 172.21.15.170:0/3549133997 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94921060620848] v29'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e8084050 con 0x565488192b90 2024-09-12T17:27:59.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.527+0000 7fd9fbd2e800 20 remove_watcher() i=2 2024-09-12T17:27:59.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.527+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94921060625888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x565488197ac0 con 0x56548818e0b0 2024-09-12T17:27:59.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.528+0000 7fd9f82de640 1 -- 172.21.15.170:0/3549133997 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94921060625888] v29'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9f0068040 con 0x56548818e0b0 2024-09-12T17:27:59.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.528+0000 7fd9fbd2e800 20 remove_watcher() i=3 2024-09-12T17:27:59.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.528+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94921060623168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56548819ade0 con 0x5654881896c0 2024-09-12T17:27:59.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.529+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94921060623168] v29'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e0029040 con 0x5654881896c0 2024-09-12T17:27:59.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.529+0000 7fd9fbd2e800 20 remove_watcher() i=4 2024-09-12T17:27:59.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.529+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94921060618304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x565488197ac0 con 0x7fd9f003c060 2024-09-12T17:27:59.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.530+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94921060618304] v29'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e0029040 con 0x7fd9f003c060 2024-09-12T17:27:59.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.530+0000 7fd9fbd2e800 20 remove_watcher() i=5 2024-09-12T17:27:59.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.530+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94921060631232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56548819ade0 con 0x7fd9f003c060 2024-09-12T17:27:59.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.531+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94921060631232] v29'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e0029040 con 0x7fd9f003c060 2024-09-12T17:27:59.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.531+0000 7fd9fbd2e800 20 remove_watcher() i=6 2024-09-12T17:27:59.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.531+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94921060634928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x565488197ac0 con 0x7fd9f003c060 2024-09-12T17:27:59.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.532+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94921060634928] v29'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e0029040 con 0x7fd9f003c060 2024-09-12T17:27:59.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.532+0000 7fd9fbd2e800 20 remove_watcher() i=7 2024-09-12T17:27:59.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.532+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fd9f003c060 msgr2=0x7fd9f0046990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.532+0000 7fd9fbd2e800 1 --2- 172.21.15.170:0/3549133997 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fd9f003c060 0x7fd9f0046990 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.532+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5654881896c0 msgr2=0x56548818bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.532+0000 7fd9fbd2e800 1 --2- 172.21.15.170:0/3549133997 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5654881896c0 0x56548818bb80 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.532+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56548818e0b0 msgr2=0x5654881904a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.532+0000 7fd9fbd2e800 1 --2- 172.21.15.170:0/3549133997 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56548818e0b0 0x5654881904a0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.532+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x565488192b90 msgr2=0x565488195050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.532+0000 7fd9fbd2e800 1 --2- 172.21.15.170:0/3549133997 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x565488192b90 0x565488195050 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.532+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd8c003c780 msgr2=0x7fd8c003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.532+0000 7fd9fbd2e800 1 --2- 172.21.15.170:0/3549133997 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd8c003c780 0x7fd8c003ec40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd9e805dac0 tx=0x7fd9e808c000 comp rx=0 tx=0).stop 2024-09-12T17:27:59.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.532+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565488176830 msgr2=0x56548817de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.532+0000 7fd9effff640 1 -- 172.21.15.170:0/3549133997 reap_dead start 2024-09-12T17:27:59.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.532+0000 7fd9fbd2e800 1 --2- 172.21.15.170:0/3549133997 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565488176830 0x56548817de00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd9f002afd0 tx=0x7fd9f0053d00 comp rx=0 tx=0).stop 2024-09-12T17:27:59.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.533+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 shutdown_connections 2024-09-12T17:27:59.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.533+0000 7fd9fbd2e800 1 --2- 172.21.15.170:0/3549133997 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565488176830 0x56548817de00 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.533+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 >> 172.21.15.170:0/3549133997 conn(0x565488172c30 msgr2=0x565488170e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:59.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.533+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 shutdown_connections 2024-09-12T17:27:59.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.533+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/3549133997 wait complete. 2024-09-12T17:27:59.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.533+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/1801487233 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd8d003c730 msgr2=0x7fd8d003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.533+0000 7fd9fbd2e800 1 --2- 172.21.15.170:0/1801487233 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd8d003c730 0x7fd8d003ebf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x565488156b00 tx=0x7fd9e8045a20 comp rx=0 tx=0).stop 2024-09-12T17:27:59.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.533+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/1801487233 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565488169cf0 msgr2=0x56548816a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.533+0000 7fd9fbd2e800 1 --2- 172.21.15.170:0/1801487233 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565488169cf0 0x56548816a110 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x56548814fc20 tx=0x7fd9f00167b0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.533+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/1801487233 shutdown_connections 2024-09-12T17:27:59.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.533+0000 7fd9fbd2e800 1 --2- 172.21.15.170:0/1801487233 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd8d003c730 0x7fd8d003ebf0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.533+0000 7fd9fbd2e800 1 --2- 172.21.15.170:0/1801487233 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565488169cf0 0x56548816a110 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.533+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/1801487233 >> 172.21.15.170:0/1801487233 conn(0x56548815e0a0 msgr2=0x56548815e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:59.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.533+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/1801487233 shutdown_connections 2024-09-12T17:27:59.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.533+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/1801487233 wait complete. 2024-09-12T17:27:59.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.533+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/642251202 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x565488054e00 msgr2=0x565488156520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.533+0000 7fd9fbd2e800 1 --2- 172.21.15.170:0/642251202 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x565488054e00 0x565488156520 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.533+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/642251202 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x565488158980 msgr2=0x56548815ad70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.533+0000 7fd9fbd2e800 1 --2- 172.21.15.170:0/642251202 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x565488158980 0x56548815ad70 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.533+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/642251202 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd8e003c780 msgr2=0x7fd8e003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.533+0000 7fd9fbd2e800 1 --2- 172.21.15.170:0/642251202 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd8e003c780 0x7fd8e003ec40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0001d70 tx=0x7fd9e00012d0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.533+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/642251202 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654880544c0 msgr2=0x56548814eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.533+0000 7fd9fbd2e800 1 --2- 172.21.15.170:0/642251202 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654880544c0 0x56548814eed0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8025c20 tx=0x7fd9e8002fb0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.533+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/642251202 shutdown_connections 2024-09-12T17:27:59.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.534+0000 7fd9fbd2e800 1 --2- 172.21.15.170:0/642251202 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x565488158980 0x56548815ad70 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.534+0000 7fd9fbd2e800 1 --2- 172.21.15.170:0/642251202 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd8e003c780 0x7fd8e003ec40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.534+0000 7fd9fbd2e800 1 --2- 172.21.15.170:0/642251202 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x565488054e00 0x565488156520 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.534+0000 7fd9fbd2e800 1 --2- 172.21.15.170:0/642251202 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654880544c0 0x56548814eed0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.534+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/642251202 >> 172.21.15.170:0/642251202 conn(0x565488050210 msgr2=0x5654881419a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:59.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.534+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/642251202 shutdown_connections 2024-09-12T17:27:59.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.534+0000 7fd9fbd2e800 1 -- 172.21.15.170:0/642251202 wait complete. 2024-09-12T17:27:59.548 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-09-12T17:27:59.549 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-12T17:27:59.549 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-12T17:27:59.549 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-12T17:27:59.594 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:59.594 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:59.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.593+0000 7f1119375800 1 Processor -- start 2024-09-12T17:27:59.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.593+0000 7f1119375800 1 -- start start 2024-09-12T17:27:59.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.593+0000 7f1119375800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5596490b8fb0 0x5596490c1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.593+0000 7f1119375800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559648f62e40 con 0x5596490b7490 2024-09-12T17:27:59.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.594+0000 7f1119375800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x559648f2d680 con 0x5596490b8fb0 2024-09-12T17:27:59.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.594+0000 7f111665e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5596490b8fb0 0x5596490c1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.594+0000 7f1116e5f640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x5596490b7490 0x5596490b7890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:48270/0 (socket says 172.21.15.170:48270) 2024-09-12T17:27:59.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.594+0000 7f1116e5f640 1 -- 172.21.15.170:0/1715140034 learned_addr learned my addr 172.21.15.170:0/1715140034 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:27:59.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.594+0000 7f111665e640 1 -- 172.21.15.170:0/1715140034 >> v1:172.21.15.47:6789/0 conn(0x5596490b7490 legacy=0x5596490b7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.594+0000 7f111665e640 1 -- 172.21.15.170:0/1715140034 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559648f496b0 con 0x5596490b8fb0 2024-09-12T17:27:59.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.596+0000 7f111665e640 1 --2- 172.21.15.170:0/1715140034 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596490b8fb0 0x5596490c1ad0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f110000a470 tx=0x7f1100045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76e779c252397bef server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.596+0000 7f1115e5d640 1 -- 172.21.15.170:0/1715140034 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1100053570 con 0x5596490b8fb0 2024-09-12T17:27:59.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.596+0000 7f1115e5d640 1 -- 172.21.15.170:0/1715140034 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1100058070 con 0x5596490b8fb0 2024-09-12T17:27:59.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.596+0000 7f1115e5d640 1 -- 172.21.15.170:0/1715140034 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1100053880 con 0x5596490b8fb0 2024-09-12T17:27:59.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.597+0000 7f1119375800 1 -- 172.21.15.170:0/1715140034 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596490b8fb0 msgr2=0x5596490c1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.597+0000 7f1119375800 1 --2- 172.21.15.170:0/1715140034 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596490b8fb0 0x5596490c1ad0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f110000a470 tx=0x7f1100045a20 comp rx=0 tx=0).stop 2024-09-12T17:27:59.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.597+0000 7f1119375800 1 -- 172.21.15.170:0/1715140034 shutdown_connections 2024-09-12T17:27:59.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.597+0000 7f1119375800 1 --2- 172.21.15.170:0/1715140034 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596490b8fb0 0x5596490c1ad0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.597+0000 7f1119375800 1 -- 172.21.15.170:0/1715140034 >> 172.21.15.170:0/1715140034 conn(0x5596490b31c0 msgr2=0x5596490b5620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:59.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.597+0000 7f1119375800 1 -- 172.21.15.170:0/1715140034 shutdown_connections 2024-09-12T17:27:59.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.597+0000 7f1119375800 1 -- 172.21.15.170:0/1715140034 wait complete. 2024-09-12T17:27:59.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.610+0000 7f1119375800 1 Processor -- start 2024-09-12T17:27:59.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.610+0000 7f1119375800 1 -- start start 2024-09-12T17:27:59.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.611+0000 7f1119375800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596490b7490 0x5596491aa860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.611+0000 7f1119375800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559648f51dd0 con 0x5596490b7490 2024-09-12T17:27:59.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.611+0000 7f1116e5f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596490b7490 0x5596491aa860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.611+0000 7f1116e5f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596490b7490 0x5596491aa860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56600/0 (socket says 172.21.15.170:56600) 2024-09-12T17:27:59.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.611+0000 7f1116e5f640 1 -- 172.21.15.170:0/3053068349 learned_addr learned my addr 172.21.15.170:0/3053068349 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:59.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.611+0000 7f1116e5f640 1 -- 172.21.15.170:0/3053068349 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559648f6ae10 con 0x5596490b7490 2024-09-12T17:27:59.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.611+0000 7f1116e5f640 1 --2- 172.21.15.170:0/3053068349 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596490b7490 0x5596491aa860 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1110001800 tx=0x7f1110001cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ec63c63f635542f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.611+0000 7f1004e09640 1 -- 172.21.15.170:0/3053068349 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1110004520 con 0x5596490b7490 2024-09-12T17:27:59.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.612+0000 7f1004e09640 1 -- 172.21.15.170:0/3053068349 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11100046c0 con 0x5596490b7490 2024-09-12T17:27:59.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.612+0000 7f1004e09640 1 -- 172.21.15.170:0/3053068349 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11100049e0 con 0x5596490b7490 2024-09-12T17:27:59.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.612+0000 7f1119375800 1 -- 172.21.15.170:0/3053068349 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596490b7490 msgr2=0x5596491aa860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.612+0000 7f1119375800 1 --2- 172.21.15.170:0/3053068349 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596490b7490 0x5596491aa860 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1110001800 tx=0x7f1110001cc0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.612+0000 7f1119375800 1 -- 172.21.15.170:0/3053068349 shutdown_connections 2024-09-12T17:27:59.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.612+0000 7f1119375800 1 --2- 172.21.15.170:0/3053068349 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596490b7490 0x5596491aa860 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.612+0000 7f1119375800 1 -- 172.21.15.170:0/3053068349 >> 172.21.15.170:0/3053068349 conn(0x5596490b31c0 msgr2=0x5596491a61e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:59.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.612+0000 7f1119375800 1 -- 172.21.15.170:0/3053068349 shutdown_connections 2024-09-12T17:27:59.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.612+0000 7f1119375800 1 -- 172.21.15.170:0/3053068349 wait complete. 2024-09-12T17:27:59.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.613+0000 7f1119375800 1 Processor -- start 2024-09-12T17:27:59.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.613+0000 7f1119375800 1 -- start start 2024-09-12T17:27:59.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.613+0000 7f1119375800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596490b7490 0x5596491b2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.613+0000 7f1119375800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5596490c22e0 con 0x5596490b7490 2024-09-12T17:27:59.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.613+0000 7f1116e5f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596490b7490 0x5596491b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.613+0000 7f1116e5f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596490b7490 0x5596491b2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56606/0 (socket says 172.21.15.170:56606) 2024-09-12T17:27:59.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.613+0000 7f1116e5f640 1 -- 172.21.15.170:0/2615516134 learned_addr learned my addr 172.21.15.170:0/2615516134 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:59.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.613+0000 7f1116e5f640 1 -- 172.21.15.170:0/2615516134 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596491b2770 con 0x5596490b7490 2024-09-12T17:27:59.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.614+0000 7f1116e5f640 1 --2- 172.21.15.170:0/2615516134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596490b7490 0x5596491b2210 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1110000f80 tx=0x7f1110001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.614+0000 7f1003606640 1 -- 172.21.15.170:0/2615516134 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1110022020 con 0x5596490b7490 2024-09-12T17:27:59.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.614+0000 7f1003606640 1 -- 172.21.15.170:0/2615516134 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1110014890 con 0x5596490b7490 2024-09-12T17:27:59.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.614+0000 7f1003606640 1 -- 172.21.15.170:0/2615516134 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1110014bb0 con 0x5596490b7490 2024-09-12T17:27:59.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.614+0000 7f1119375800 1 -- 172.21.15.170:0/2615516134 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5596491b2a00 con 0x5596490b7490 2024-09-12T17:27:59.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.614+0000 7f1119375800 1 -- 172.21.15.170:0/2615516134 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596491b3400 con 0x5596490b7490 2024-09-12T17:27:59.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.615+0000 7f1003606640 1 -- 172.21.15.170:0/2615516134 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1110025020 con 0x5596490b7490 2024-09-12T17:27:59.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.615+0000 7f1003606640 1 --2- 172.21.15.170:0/2615516134 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0ffc03c780 0x7f0ffc03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.615+0000 7f1003606640 1 -- 172.21.15.170:0/2615516134 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f1110018030 con 0x5596490b7490 2024-09-12T17:27:59.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.615+0000 7f111665e640 1 --2- 172.21.15.170:0/2615516134 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0ffc03c780 0x7f0ffc03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.615+0000 7f1119375800 1 --2- 172.21.15.170:0/2615516134 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5596490b8fb0 0x5596491b9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.615+0000 7f1119375800 1 -- 172.21.15.170:0/2615516134 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596491b9da0 con 0x5596490b8fb0 2024-09-12T17:27:59.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.615+0000 7f1117660640 1 --2- 172.21.15.170:0/2615516134 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5596490b8fb0 0x5596491b9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.615+0000 7f111665e640 1 --2- 172.21.15.170:0/2615516134 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0ffc03c780 0x7f0ffc03ec40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1100057000 tx=0x7f1100052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.615+0000 7f1117660640 1 --2- 172.21.15.170:0/2615516134 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5596490b8fb0 0x5596491b9860 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.616+0000 7f1117660640 1 -- 172.21.15.170:0/2615516134 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f11080083e0 con 0x5596490b8fb0 2024-09-12T17:27:59.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.616+0000 7f1119375800 1 -- 172.21.15.170:0/2615516134 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596491ba140 con 0x5596490b8fb0 2024-09-12T17:27:59.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.616+0000 7f1117660640 1 -- 172.21.15.170:0/2615516134 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f11080083e0 con 0x5596490b8fb0 2024-09-12T17:27:59.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.616+0000 7f1119375800 1 --2- 172.21.15.170:0/2615516134 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5596491bbc40 0x5596491be0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.616+0000 7f1119375800 1 -- 172.21.15.170:0/2615516134 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596491be850 con 0x5596491bbc40 2024-09-12T17:27:59.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.616+0000 7f1116e5f640 1 --2- 172.21.15.170:0/2615516134 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5596491bbc40 0x5596491be0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.616+0000 7f1116e5f640 1 --2- 172.21.15.170:0/2615516134 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5596491bbc40 0x5596491be0c0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.617+0000 7f1116e5f640 1 -- 172.21.15.170:0/2615516134 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f111001b070 con 0x5596491bbc40 2024-09-12T17:27:59.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.617+0000 7f1119375800 1 -- 172.21.15.170:0/2615516134 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596491ba990 con 0x5596490b8fb0 2024-09-12T17:27:59.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.617+0000 7f1117660640 1 -- 172.21.15.170:0/2615516134 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f11080083e0 con 0x5596490b8fb0 2024-09-12T17:27:59.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.617+0000 7f1119375800 1 -- 172.21.15.170:0/2615516134 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596491badc0 con 0x5596491bbc40 2024-09-12T17:27:59.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.617+0000 7f1116e5f640 1 -- 172.21.15.170:0/2615516134 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f111001b070 con 0x5596491bbc40 2024-09-12T17:27:59.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.618+0000 7f1119375800 1 Processor -- start 2024-09-12T17:27:59.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.618+0000 7f1119375800 1 -- start start 2024-09-12T17:27:59.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.618+0000 7f1119375800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596491cd140 0x5596491cd560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.618+0000 7f1119375800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559648fafa00 con 0x5596491cd140 2024-09-12T17:27:59.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.618+0000 7f1117660640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596491cd140 0x5596491cd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.618+0000 7f1117660640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596491cd140 0x5596491cd560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56618/0 (socket says 172.21.15.170:56618) 2024-09-12T17:27:59.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.618+0000 7f1117660640 1 -- 172.21.15.170:0/198717673 learned_addr learned my addr 172.21.15.170:0/198717673 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:59.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.619+0000 7f1117660640 1 -- 172.21.15.170:0/198717673 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596491cdba0 con 0x5596491cd140 2024-09-12T17:27:59.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.619+0000 7f1117660640 1 --2- 172.21.15.170:0/198717673 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596491cd140 0x5596491cd560 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x5596491b3210 tx=0x7f110800bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.619+0000 7f1000e01640 1 -- 172.21.15.170:0/198717673 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f110801c020 con 0x5596491cd140 2024-09-12T17:27:59.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.619+0000 7f1000e01640 1 -- 172.21.15.170:0/198717673 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1108007c90 con 0x5596491cd140 2024-09-12T17:27:59.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.619+0000 7f1119375800 1 -- 172.21.15.170:0/198717673 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5596491ce3d0 con 0x5596491cd140 2024-09-12T17:27:59.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.619+0000 7f1000e01640 1 -- 172.21.15.170:0/198717673 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1108018440 con 0x5596491cd140 2024-09-12T17:27:59.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.619+0000 7f1119375800 1 -- 172.21.15.170:0/198717673 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596491ce970 con 0x5596491cd140 2024-09-12T17:27:59.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.620+0000 7f1000e01640 1 -- 172.21.15.170:0/198717673 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f110801f020 con 0x5596491cd140 2024-09-12T17:27:59.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.620+0000 7f1000e01640 1 --2- 172.21.15.170:0/198717673 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0ff003c730 0x7f0ff003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.620+0000 7f1000e01640 1 -- 172.21.15.170:0/198717673 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f1108054dc0 con 0x5596491cd140 2024-09-12T17:27:59.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.620+0000 7f1116e5f640 1 --2- 172.21.15.170:0/198717673 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0ff003c730 0x7f0ff003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.620+0000 7f1119375800 1 Processor -- start 2024-09-12T17:27:59.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.620+0000 7f1119375800 1 -- start start 2024-09-12T17:27:59.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.620+0000 7f1116e5f640 1 --2- 172.21.15.170:0/198717673 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0ff003c730 0x7f0ff003ebf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x5596491bec20 tx=0x7f1110051e70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.621+0000 7f1119375800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596491d9c60 0x5596491da060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.621+0000 7f1119375800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5596491ab0b0 con 0x5596491d9c60 2024-09-12T17:27:59.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.621+0000 7f1117660640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596491d9c60 0x5596491da060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.621+0000 7f1117660640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596491d9c60 0x5596491da060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56628/0 (socket says 172.21.15.170:56628) 2024-09-12T17:27:59.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.621+0000 7f1117660640 1 -- 172.21.15.170:0/733392372 learned_addr learned my addr 172.21.15.170:0/733392372 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:59.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.621+0000 7f1117660640 1 -- 172.21.15.170:0/733392372 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596491da650 con 0x5596491d9c60 2024-09-12T17:27:59.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.621+0000 7f1117660640 1 --2- 172.21.15.170:0/733392372 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596491d9c60 0x5596491da060 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f11080532d0 tx=0x7f11080158b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a3fecfbacc085f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.621+0000 7f0ffa7fc640 1 -- 172.21.15.170:0/733392372 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1108050020 con 0x5596491d9c60 2024-09-12T17:27:59.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.621+0000 7f0ffa7fc640 1 -- 172.21.15.170:0/733392372 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1108015e70 con 0x5596491d9c60 2024-09-12T17:27:59.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.621+0000 7f0ffa7fc640 1 -- 172.21.15.170:0/733392372 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11080174d0 con 0x5596491d9c60 2024-09-12T17:27:59.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.622+0000 7f1119375800 1 -- 172.21.15.170:0/733392372 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596491d9c60 msgr2=0x5596491da060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.622+0000 7f1119375800 1 --2- 172.21.15.170:0/733392372 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596491d9c60 0x5596491da060 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f11080532d0 tx=0x7f11080158b0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.622+0000 7f1119375800 1 -- 172.21.15.170:0/733392372 shutdown_connections 2024-09-12T17:27:59.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.622+0000 7f1119375800 1 --2- 172.21.15.170:0/733392372 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596491d9c60 0x5596491da060 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.622+0000 7f1119375800 1 -- 172.21.15.170:0/733392372 >> 172.21.15.170:0/733392372 conn(0x5596491d6060 msgr2=0x5596491d42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:59.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.622+0000 7f1119375800 1 -- 172.21.15.170:0/733392372 shutdown_connections 2024-09-12T17:27:59.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.622+0000 7f1119375800 1 -- 172.21.15.170:0/733392372 wait complete. 2024-09-12T17:27:59.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.622+0000 7f1119375800 1 Processor -- start 2024-09-12T17:27:59.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.622+0000 7f1119375800 1 -- start start 2024-09-12T17:27:59.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.622+0000 7f1119375800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596491d9c60 0x5596491e11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.622+0000 7f1119375800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5596491dac70 con 0x5596491d9c60 2024-09-12T17:27:59.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.623+0000 7f1117660640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596491d9c60 0x5596491e11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.623+0000 7f1117660640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596491d9c60 0x5596491e11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56630/0 (socket says 172.21.15.170:56630) 2024-09-12T17:27:59.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.623+0000 7f1117660640 1 -- 172.21.15.170:0/2210252506 learned_addr learned my addr 172.21.15.170:0/2210252506 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:59.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.623+0000 7f1117660640 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596491e1730 con 0x5596491d9c60 2024-09-12T17:27:59.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.623+0000 7f1117660640 1 --2- 172.21.15.170:0/2210252506 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596491d9c60 0x5596491e11d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f11080154a0 tx=0x7f1108053230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.623+0000 7f0ff8ff9640 1 -- 172.21.15.170:0/2210252506 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f110804a040 con 0x5596491d9c60 2024-09-12T17:27:59.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.623+0000 7f0ff8ff9640 1 -- 172.21.15.170:0/2210252506 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1108016c50 con 0x5596491d9c60 2024-09-12T17:27:59.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.623+0000 7f0ff8ff9640 1 -- 172.21.15.170:0/2210252506 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f110800b030 con 0x5596491d9c60 2024-09-12T17:27:59.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.623+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5596491e19c0 con 0x5596491d9c60 2024-09-12T17:27:59.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.623+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596491e2340 con 0x5596491d9c60 2024-09-12T17:27:59.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.624+0000 7f0ff8ff9640 1 -- 172.21.15.170:0/2210252506 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1108033020 con 0x5596491d9c60 2024-09-12T17:27:59.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.624+0000 7f0ff8ff9640 1 --2- 172.21.15.170:0/2210252506 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0fe003c780 0x7f0fe003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.624+0000 7f0ff8ff9640 1 -- 172.21.15.170:0/2210252506 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f1108031020 con 0x5596491d9c60 2024-09-12T17:27:59.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.624+0000 7f1116e5f640 1 --2- 172.21.15.170:0/2210252506 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0fe003c780 0x7f0fe003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.625+0000 7f1119375800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.625+0000 7f1119375800 1 --2- 172.21.15.170:0/2210252506 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5596491ecab0 0x5596491eef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.625+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596491ef6c0 con 0x5596491ecab0 2024-09-12T17:27:59.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.625+0000 7f111665e640 1 --2- 172.21.15.170:0/2210252506 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5596491ecab0 0x5596491eef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.625+0000 7f1116e5f640 1 --2- 172.21.15.170:0/2210252506 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0fe003c780 0x7f0fe003ec40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1110011020 tx=0x7f1110045000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.625+0000 7f111665e640 1 --2- 172.21.15.170:0/2210252506 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5596491ecab0 0x5596491eef70 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.625+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1100051070 con 0x5596491ecab0 2024-09-12T17:27:59.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.625+0000 7f1119375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.625+0000 7f1119375800 20 realm 2024-09-12T17:27:59.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.625+0000 7f1119375800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.625+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596491efaf0 con 0x5596491ecab0 2024-09-12T17:27:59.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.625+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1100051070 con 0x5596491ecab0 2024-09-12T17:27:59.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.625+0000 7f1119375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.625+0000 7f1119375800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:59.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.625+0000 7f1119375800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.626+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596491f03c0 con 0x5596491ecab0 2024-09-12T17:27:59.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.626+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1100051070 con 0x5596491ecab0 2024-09-12T17:27:59.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.626+0000 7f1119375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.626+0000 7f1119375800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.626+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596491f0760 con 0x5596491ecab0 2024-09-12T17:27:59.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.626+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1100051070 con 0x5596491ecab0 2024-09-12T17:27:59.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.626+0000 7f1119375800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:59.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.626+0000 7f1119375800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.626+0000 7f1119375800 1 --2- 172.21.15.170:0/2210252506 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5596491f14c0 0x5596491f38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.626+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596491f3df0 con 0x5596491f14c0 2024-09-12T17:27:59.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.626+0000 7f1117660640 1 --2- 172.21.15.170:0/2210252506 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5596491f14c0 0x5596491f38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.626+0000 7f1117660640 1 --2- 172.21.15.170:0/2210252506 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5596491f14c0 0x5596491f38b0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.627+0000 7f1117660640 1 -- 172.21.15.170:0/2210252506 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f11080083e0 con 0x5596491f14c0 2024-09-12T17:27:59.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.627+0000 7f1119375800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:27:59.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.627+0000 7f1119375800 20 searching for the correct realm 2024-09-12T17:27:59.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.627+0000 7f1119375800 1 --2- 172.21.15.170:0/2210252506 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5596491f5e30 0x5596491f82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.627+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596491f89c0 con 0x5596491f5e30 2024-09-12T17:27:59.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.627+0000 7f1116e5f640 1 --2- 172.21.15.170:0/2210252506 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5596491f5e30 0x5596491f82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.627+0000 7f1116e5f640 1 --2- 172.21.15.170:0/2210252506 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5596491f5e30 0x5596491f82f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.627+0000 7f1116e5f640 1 -- 172.21.15.170:0/2210252506 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f111004e050 con 0x5596491f5e30 2024-09-12T17:27:59.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.627+0000 7f1116e5f640 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596491f89c0 con 0x5596491f14c0 2024-09-12T17:27:59.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.627+0000 7f1117660640 1 -- 172.21.15.170:0/2210252506 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11080083e0 con 0x5596491f14c0 2024-09-12T17:27:59.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.627+0000 7f1117660640 1 --2- 172.21.15.170:0/2210252506 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f1108021020 0x7f11080479c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.628+0000 7f1117660640 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596491f89c0 con 0x7f1108021020 2024-09-12T17:27:59.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.628+0000 7f111665e640 1 --2- 172.21.15.170:0/2210252506 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f1108021020 0x7f11080479c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.628+0000 7f111665e640 1 --2- 172.21.15.170:0/2210252506 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f1108021020 0x7f11080479c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.628+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1100051070 con 0x7f1108021020 2024-09-12T17:27:59.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.628+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596491f89c0 con 0x5596491ecab0 2024-09-12T17:27:59.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.629+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1100051070 con 0x5596491ecab0 2024-09-12T17:27:59.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.629+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596491f89c0 con 0x5596491ecab0 2024-09-12T17:27:59.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.629+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1100051070 con 0x5596491ecab0 2024-09-12T17:27:59.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.629+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596491f89c0 con 0x7f1108021020 2024-09-12T17:27:59.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.629+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1100051070 con 0x7f1108021020 2024-09-12T17:27:59.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.629+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596491f89c0 con 0x7f1108021020 2024-09-12T17:27:59.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.629+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1100051070 con 0x7f1108021020 2024-09-12T17:27:59.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.629+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596491f89c0 con 0x5596491f14c0 2024-09-12T17:27:59.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.629+0000 7f1117660640 1 -- 172.21.15.170:0/2210252506 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11080083e0 con 0x5596491f14c0 2024-09-12T17:27:59.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.630+0000 7f1117660640 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596491f89c0 con 0x5596491f5e30 2024-09-12T17:27:59.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.630+0000 7f1116e5f640 1 -- 172.21.15.170:0/2210252506 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f111004e050 con 0x5596491f5e30 2024-09-12T17:27:59.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.630+0000 7f1116e5f640 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596491f89c0 con 0x5596491ecab0 2024-09-12T17:27:59.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.630+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1100051070 con 0x5596491ecab0 2024-09-12T17:27:59.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.630+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596491f89c0 con 0x7f1108021020 2024-09-12T17:27:59.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.630+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1100051070 con 0x7f1108021020 2024-09-12T17:27:59.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.630+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596491f89c0 con 0x5596491ecab0 2024-09-12T17:27:59.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.631+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1100051070 con 0x5596491ecab0 2024-09-12T17:27:59.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.631+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596491f89c0 con 0x5596491f14c0 2024-09-12T17:27:59.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.631+0000 7f1117660640 1 -- 172.21.15.170:0/2210252506 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f11080083e0 con 0x5596491f14c0 2024-09-12T17:27:59.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.631+0000 7f1117660640 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596491f89c0 con 0x5596491f5e30 2024-09-12T17:27:59.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.631+0000 7f1116e5f640 1 -- 172.21.15.170:0/2210252506 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f111004e050 con 0x5596491f5e30 2024-09-12T17:27:59.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.631+0000 7f1116e5f640 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596491f89c0 con 0x5596491f5e30 2024-09-12T17:27:59.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.631+0000 7f1116e5f640 1 -- 172.21.15.170:0/2210252506 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f111004e050 con 0x5596491f5e30 2024-09-12T17:27:59.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.631+0000 7f1116e5f640 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596491f89c0 con 0x7f1108021020 2024-09-12T17:27:59.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.632+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1100051070 con 0x7f1108021020 2024-09-12T17:27:59.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.632+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596491f89c0 con 0x5596491f5e30 2024-09-12T17:27:59.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.632+0000 7f1116e5f640 1 -- 172.21.15.170:0/2210252506 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f111004e050 con 0x5596491f5e30 2024-09-12T17:27:59.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.632+0000 7f1116e5f640 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596491f89c0 con 0x5596491f5e30 2024-09-12T17:27:59.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.632+0000 7f1116e5f640 1 -- 172.21.15.170:0/2210252506 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f111004e050 con 0x5596491f5e30 2024-09-12T17:27:59.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.632+0000 7f1116e5f640 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596491f89c0 con 0x5596491ecab0 2024-09-12T17:27:59.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.633+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1100051070 con 0x5596491ecab0 2024-09-12T17:27:59.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.633+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596491f89c0 con 0x5596491ecab0 2024-09-12T17:27:59.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.633+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1100051070 con 0x5596491ecab0 2024-09-12T17:27:59.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.633+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596491f89c0 con 0x7f1108021020 2024-09-12T17:27:59.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.633+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1100051070 con 0x7f1108021020 2024-09-12T17:27:59.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.633+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596491f89c0 con 0x5596491f5e30 2024-09-12T17:27:59.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.633+0000 7f1116e5f640 1 -- 172.21.15.170:0/2210252506 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f111004e050 con 0x5596491f5e30 2024-09-12T17:27:59.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.633+0000 7f1116e5f640 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596491f89c0 con 0x5596491f14c0 2024-09-12T17:27:59.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.633+0000 7f1117660640 1 -- 172.21.15.170:0/2210252506 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11080083e0 con 0x5596491f14c0 2024-09-12T17:27:59.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.634+0000 7f1117660640 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596491f89c0 con 0x5596491ecab0 2024-09-12T17:27:59.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.634+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1100051070 con 0x5596491ecab0 2024-09-12T17:27:59.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.634+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596491f89c0 con 0x7f1108021020 2024-09-12T17:27:59.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.634+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1100051070 con 0x7f1108021020 2024-09-12T17:27:59.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.634+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596491f89c0 con 0x5596491f5e30 2024-09-12T17:27:59.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.634+0000 7f1116e5f640 1 -- 172.21.15.170:0/2210252506 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f111004e050 con 0x5596491f5e30 2024-09-12T17:27:59.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.634+0000 7f1116e5f640 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596491f89c0 con 0x7f1108021020 2024-09-12T17:27:59.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.635+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1100051070 con 0x7f1108021020 2024-09-12T17:27:59.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.635+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596491f89c0 con 0x5596491f14c0 2024-09-12T17:27:59.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.635+0000 7f1117660640 1 -- 172.21.15.170:0/2210252506 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11080083e0 con 0x5596491f14c0 2024-09-12T17:27:59.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.635+0000 7f1117660640 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596491f89c0 con 0x5596491f5e30 2024-09-12T17:27:59.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.635+0000 7f1116e5f640 1 -- 172.21.15.170:0/2210252506 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f111004e050 con 0x5596491f5e30 2024-09-12T17:27:59.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.635+0000 7f1116e5f640 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596491f89c0 con 0x7f1108021020 2024-09-12T17:27:59.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.635+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1100051070 con 0x7f1108021020 2024-09-12T17:27:59.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.635+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596491f89c0 con 0x5596491ecab0 2024-09-12T17:27:59.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.636+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1100051070 con 0x5596491ecab0 2024-09-12T17:27:59.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.636+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596491f89c0 con 0x5596491f14c0 2024-09-12T17:27:59.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.636+0000 7f1117660640 1 -- 172.21.15.170:0/2210252506 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f11080083e0 con 0x5596491f14c0 2024-09-12T17:27:59.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.636+0000 7f1119375800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:27:59.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.636+0000 7f1119375800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:59.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.636+0000 7f1119375800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:59.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.636+0000 7f1119375800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:59.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.636+0000 7f1119375800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:59.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.636+0000 7f1119375800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:27:59.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.636+0000 7f1119375800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.636+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596491f4830 con 0x5596491ecab0 2024-09-12T17:27:59.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.636+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1100051070 con 0x5596491ecab0 2024-09-12T17:27:59.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.636+0000 7f1119375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.636+0000 7f1119375800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.636+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596491f4410 con 0x5596491ecab0 2024-09-12T17:27:59.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.636+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1100051070 con 0x5596491ecab0 2024-09-12T17:27:59.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.636+0000 7f1119375800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:59.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.636+0000 7f1119375800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.636+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596491f5150 con 0x5596491f14c0 2024-09-12T17:27:59.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.637+0000 7f1117660640 1 -- 172.21.15.170:0/2210252506 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f11080083e0 con 0x5596491f14c0 2024-09-12T17:27:59.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.637+0000 7f1119375800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:27:59.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.637+0000 7f1119375800 20 zone default found 2024-09-12T17:27:59.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.637+0000 7f1119375800 4 Realm: () 2024-09-12T17:27:59.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.637+0000 7f1119375800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:27:59.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.637+0000 7f1119375800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:27:59.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.637+0000 7f1119375800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:59.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.637+0000 7f1119375800 20 zonegroup default 2024-09-12T17:27:59.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.637+0000 7f1119375800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.637+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596491f8e40 con 0x7f1108021020 2024-09-12T17:27:59.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.637+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1100051070 con 0x7f1108021020 2024-09-12T17:27:59.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.637+0000 7f1119375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.637+0000 7f1119375800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.637+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596491fb080 con 0x5596491f5e30 2024-09-12T17:27:59.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.637+0000 7f1116e5f640 1 -- 172.21.15.170:0/2210252506 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f111004e050 con 0x5596491f5e30 2024-09-12T17:27:59.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.637+0000 7f1119375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.637+0000 7f1119375800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.637+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596491fb420 con 0x5596491f5e30 2024-09-12T17:27:59.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.637+0000 7f1116e5f640 1 -- 172.21.15.170:0/2210252506 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f111004e050 con 0x5596491f5e30 2024-09-12T17:27:59.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.637+0000 7f1119375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.637+0000 7f1119375800 20 started sync module instance, tier type = 2024-09-12T17:27:59.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.637+0000 7f1119375800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:27:59.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.637+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596491fa4c0 con 0x5596491f14c0 2024-09-12T17:27:59.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.639+0000 7f1117660640 1 -- 172.21.15.170:0/2210252506 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11080083e0 con 0x5596491f14c0 2024-09-12T17:27:59.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.639+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94103960267200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596491fa4c0 con 0x5596491f14c0 2024-09-12T17:27:59.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.639+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596491fbde0 con 0x5596491ecab0 2024-09-12T17:27:59.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.640+0000 7f1117660640 1 -- 172.21.15.170:0/2210252506 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94103960267200] v29'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11080083e0 con 0x5596491f14c0 2024-09-12T17:27:59.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.640+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1100051070 con 0x5596491ecab0 2024-09-12T17:27:59.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.640+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94103960271632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596491fa4c0 con 0x5596491ecab0 2024-09-12T17:27:59.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.640+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596491fc830 con 0x5596491f5e30 2024-09-12T17:27:59.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.641+0000 7f1116e5f640 1 -- 172.21.15.170:0/2210252506 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f111004e050 con 0x5596491f5e30 2024-09-12T17:27:59.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.641+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94103960273728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596491fd0d0 con 0x5596491f5e30 2024-09-12T17:27:59.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.641+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596491fdbb0 con 0x5596491f14c0 2024-09-12T17:27:59.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.641+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94103960271632] v29'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1100051070 con 0x5596491ecab0 2024-09-12T17:27:59.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.642+0000 7f1116e5f640 1 -- 172.21.15.170:0/2210252506 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94103960273728] v29'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f111004e050 con 0x5596491f5e30 2024-09-12T17:27:59.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.642+0000 7f1117660640 1 -- 172.21.15.170:0/2210252506 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11080083e0 con 0x5596491f14c0 2024-09-12T17:27:59.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.642+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94103960276000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596491fa010 con 0x5596491f14c0 2024-09-12T17:27:59.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.642+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596491fe450 con 0x5596491ecab0 2024-09-12T17:27:59.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.643+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1100051070 con 0x5596491ecab0 2024-09-12T17:27:59.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.643+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94103960280992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596491fe400 con 0x5596491ecab0 2024-09-12T17:27:59.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.643+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596491ff400 con 0x7f1108021020 2024-09-12T17:27:59.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.643+0000 7f1117660640 1 -- 172.21.15.170:0/2210252506 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94103960276000] v29'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11080083e0 con 0x5596491f14c0 2024-09-12T17:27:59.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.644+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1100051070 con 0x7f1108021020 2024-09-12T17:27:59.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.644+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94103960278720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596491ff3c0 con 0x7f1108021020 2024-09-12T17:27:59.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.644+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596491ffe30 con 0x7f1108021020 2024-09-12T17:27:59.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.644+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94103960280992] v29'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1100051070 con 0x5596491ecab0 2024-09-12T17:27:59.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.645+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94103960278720] v29'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1100051070 con 0x7f1108021020 2024-09-12T17:27:59.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.645+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(56 notify.6 [create] v29'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1100051070 con 0x7f1108021020 2024-09-12T17:27:59.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.645+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94103960283200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596491ff3c0 con 0x7f1108021020 2024-09-12T17:27:59.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.645+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596492002e0 con 0x7f1108021020 2024-09-12T17:27:59.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.646+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(58 notify.7 [create] v29'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1100051070 con 0x7f1108021020 2024-09-12T17:27:59.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.646+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94103960283200] v29'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1100051070 con 0x7f1108021020 2024-09-12T17:27:59.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.646+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94103960288816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559649200700 con 0x7f1108021020 2024-09-12T17:27:59.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.646+0000 7f1119375800 20 add_watcher() i=0 2024-09-12T17:27:59.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.646+0000 7f1119375800 20 add_watcher() i=1 2024-09-12T17:27:59.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.646+0000 7f1119375800 20 add_watcher() i=2 2024-09-12T17:27:59.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.646+0000 7f1119375800 20 add_watcher() i=3 2024-09-12T17:27:59.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.646+0000 7f1119375800 20 add_watcher() i=4 2024-09-12T17:27:59.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.646+0000 7f1119375800 20 add_watcher() i=5 2024-09-12T17:27:59.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.646+0000 7f1119375800 20 add_watcher() i=6 2024-09-12T17:27:59.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.647+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94103960288816] v29'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1100051070 con 0x7f1108021020 2024-09-12T17:27:59.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.647+0000 7f1119375800 20 add_watcher() i=7 2024-09-12T17:27:59.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.647+0000 7f1119375800 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:59.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.647+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559649200700 con 0x5596491ecab0 2024-09-12T17:27:59.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.647+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1100051070 con 0x5596491ecab0 2024-09-12T17:27:59.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.647+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94103960289872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596492006e0 con 0x5596491ecab0 2024-09-12T17:27:59.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.648+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94103960289872] v29'54 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1100051070 con 0x5596491ecab0 2024-09-12T17:27:59.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.648+0000 7f0fcd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:59.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.648+0000 7f1119375800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:59.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.648+0000 7f1119375800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:59.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.648+0000 7f1119375800 5 note: GC not initialized 2024-09-12T17:27:59.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.649+0000 7f0f47fff640 20 reqs_thread_entry: start 2024-09-12T17:27:59.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.649+0000 7f1119375800 20 init_complete bucket index max shards: 11 2024-09-12T17:27:59.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.649+0000 7f1119375800 20 Filter name: none 2024-09-12T17:27:59.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.649+0000 7f0f45ffb640 20 reqs_thread_entry: start 2024-09-12T17:27:59.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.649+0000 7f1119375800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.649+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559649236270 con 0x5596491ecab0 2024-09-12T17:27:59.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.649+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1100051070 con 0x5596491ecab0 2024-09-12T17:27:59.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.649+0000 7f1119375800 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:27:59.686 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T17:27:59.362376Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:27:59.362351Z","tags":[],"group_ids":[]} 2024-09-12T17:27:59.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.650+0000 7f0fcd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:59.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.650+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94103960289872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559649235140 con 0x5596491ecab0 2024-09-12T17:27:59.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.651+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94103960289872] v29'55 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1100051070 con 0x5596491ecab0 2024-09-12T17:27:59.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.651+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94103960267200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559649200250 con 0x5596491f14c0 2024-09-12T17:27:59.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.652+0000 7f1117660640 1 -- 172.21.15.170:0/2210252506 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94103960267200] v29'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11080083e0 con 0x5596491f14c0 2024-09-12T17:27:59.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.652+0000 7f1119375800 20 remove_watcher() i=0 2024-09-12T17:27:59.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.652+0000 7f1119375800 2 removed watcher, disabling cache 2024-09-12T17:27:59.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.652+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94103960271632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596491fa9c0 con 0x5596491ecab0 2024-09-12T17:27:59.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.653+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94103960271632] v29'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1100051070 con 0x5596491ecab0 2024-09-12T17:27:59.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.653+0000 7f1119375800 20 remove_watcher() i=1 2024-09-12T17:27:59.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.653+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94103960273728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596491fbb10 con 0x5596491f5e30 2024-09-12T17:27:59.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.654+0000 7f1116e5f640 1 -- 172.21.15.170:0/2210252506 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94103960273728] v29'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f111004e050 con 0x5596491f5e30 2024-09-12T17:27:59.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.654+0000 7f1119375800 20 remove_watcher() i=2 2024-09-12T17:27:59.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.654+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94103960276000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596491fbb10 con 0x5596491f14c0 2024-09-12T17:27:59.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.655+0000 7f1117660640 1 -- 172.21.15.170:0/2210252506 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94103960276000] v29'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11080083e0 con 0x5596491f14c0 2024-09-12T17:27:59.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.655+0000 7f1119375800 20 remove_watcher() i=3 2024-09-12T17:27:59.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.655+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94103960280992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596491fbb10 con 0x5596491ecab0 2024-09-12T17:27:59.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.656+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94103960280992] v29'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1100051070 con 0x5596491ecab0 2024-09-12T17:27:59.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.656+0000 7f1119375800 20 remove_watcher() i=4 2024-09-12T17:27:59.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.656+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94103960278720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596491fdfa0 con 0x7f1108021020 2024-09-12T17:27:59.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.657+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94103960278720] v29'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1100051070 con 0x7f1108021020 2024-09-12T17:27:59.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.657+0000 7f1119375800 20 remove_watcher() i=5 2024-09-12T17:27:59.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.657+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94103960283200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596491fbb10 con 0x7f1108021020 2024-09-12T17:27:59.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.658+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94103960283200] v29'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1100051070 con 0x7f1108021020 2024-09-12T17:27:59.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.658+0000 7f1119375800 20 remove_watcher() i=6 2024-09-12T17:27:59.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.658+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94103960288816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596491fd6c0 con 0x7f1108021020 2024-09-12T17:27:59.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.659+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94103960288816] v29'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1100051070 con 0x7f1108021020 2024-09-12T17:27:59.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.659+0000 7f1119375800 20 remove_watcher() i=7 2024-09-12T17:27:59.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.659+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f1108021020 msgr2=0x7f11080479c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.659+0000 7f1119375800 1 --2- 172.21.15.170:0/2210252506 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f1108021020 0x7f11080479c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.659+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5596491ecab0 msgr2=0x5596491eef70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.659+0000 7f1119375800 1 --2- 172.21.15.170:0/2210252506 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5596491ecab0 0x5596491eef70 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.659+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5596491f14c0 msgr2=0x5596491f38b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.659+0000 7f1119375800 1 --2- 172.21.15.170:0/2210252506 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5596491f14c0 0x5596491f38b0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.659+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5596491f5e30 msgr2=0x5596491f82f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.659+0000 7f1119375800 1 --2- 172.21.15.170:0/2210252506 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5596491f5e30 0x5596491f82f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.659+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0fe003c780 msgr2=0x7f0fe003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.659+0000 7f1119375800 1 --2- 172.21.15.170:0/2210252506 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0fe003c780 0x7f0fe003ec40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1110011020 tx=0x7f1110045000 comp rx=0 tx=0).stop 2024-09-12T17:27:59.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.659+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596491d9c60 msgr2=0x5596491e11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.659+0000 7f111665e640 1 -- 172.21.15.170:0/2210252506 reap_dead start 2024-09-12T17:27:59.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.659+0000 7f1119375800 1 --2- 172.21.15.170:0/2210252506 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596491d9c60 0x5596491e11d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f11080154a0 tx=0x7f1108053230 comp rx=0 tx=0).stop 2024-09-12T17:27:59.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.660+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 shutdown_connections 2024-09-12T17:27:59.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.660+0000 7f1119375800 1 --2- 172.21.15.170:0/2210252506 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596491d9c60 0x5596491e11d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.660+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 >> 172.21.15.170:0/2210252506 conn(0x5596491d6060 msgr2=0x5596491d4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:59.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.660+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 shutdown_connections 2024-09-12T17:27:59.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.660+0000 7f1119375800 1 -- 172.21.15.170:0/2210252506 wait complete. 2024-09-12T17:27:59.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.660+0000 7f1119375800 1 -- 172.21.15.170:0/198717673 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0ff003c730 msgr2=0x7f0ff003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.660+0000 7f1119375800 1 --2- 172.21.15.170:0/198717673 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0ff003c730 0x7f0ff003ebf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x5596491bec20 tx=0x7f1110051e70 comp rx=0 tx=0).stop 2024-09-12T17:27:59.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.660+0000 7f1119375800 1 -- 172.21.15.170:0/198717673 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596491cd140 msgr2=0x5596491cd560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.660+0000 7f1119375800 1 --2- 172.21.15.170:0/198717673 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596491cd140 0x5596491cd560 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x5596491b3210 tx=0x7f110800bf30 comp rx=0 tx=0).stop 2024-09-12T17:27:59.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.660+0000 7f1119375800 1 -- 172.21.15.170:0/198717673 shutdown_connections 2024-09-12T17:27:59.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.660+0000 7f1119375800 1 --2- 172.21.15.170:0/198717673 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0ff003c730 0x7f0ff003ebf0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.660+0000 7f1119375800 1 --2- 172.21.15.170:0/198717673 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596491cd140 0x5596491cd560 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.660+0000 7f1119375800 1 -- 172.21.15.170:0/198717673 >> 172.21.15.170:0/198717673 conn(0x5596491c14f0 msgr2=0x5596491c18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:59.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.660+0000 7f1119375800 1 -- 172.21.15.170:0/198717673 shutdown_connections 2024-09-12T17:27:59.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.660+0000 7f1119375800 1 -- 172.21.15.170:0/198717673 wait complete. 2024-09-12T17:27:59.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.660+0000 7f1119375800 1 -- 172.21.15.170:0/2615516134 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5596490b8fb0 msgr2=0x5596491b9860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.660+0000 7f1119375800 1 --2- 172.21.15.170:0/2615516134 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5596490b8fb0 0x5596491b9860 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.660+0000 7f1119375800 1 -- 172.21.15.170:0/2615516134 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5596491bbc40 msgr2=0x5596491be0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.660+0000 7f1119375800 1 --2- 172.21.15.170:0/2615516134 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5596491bbc40 0x5596491be0c0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.660+0000 7f1119375800 1 -- 172.21.15.170:0/2615516134 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0ffc03c780 msgr2=0x7f0ffc03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.660+0000 7f1119375800 1 --2- 172.21.15.170:0/2615516134 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0ffc03c780 0x7f0ffc03ec40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1100057000 tx=0x7f1100052000 comp rx=0 tx=0).stop 2024-09-12T17:27:59.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.660+0000 7f1119375800 1 -- 172.21.15.170:0/2615516134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596490b7490 msgr2=0x5596491b2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.660+0000 7f1119375800 1 --2- 172.21.15.170:0/2615516134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596490b7490 0x5596491b2210 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1110000f80 tx=0x7f1110001250 comp rx=0 tx=0).stop 2024-09-12T17:27:59.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.660+0000 7f1119375800 1 -- 172.21.15.170:0/2615516134 shutdown_connections 2024-09-12T17:27:59.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.660+0000 7f1119375800 1 --2- 172.21.15.170:0/2615516134 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5596491bbc40 0x5596491be0c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.660+0000 7f1119375800 1 --2- 172.21.15.170:0/2615516134 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0ffc03c780 0x7f0ffc03ec40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.660+0000 7f1119375800 1 --2- 172.21.15.170:0/2615516134 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5596490b8fb0 0x5596491b9860 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.660+0000 7f1119375800 1 --2- 172.21.15.170:0/2615516134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596490b7490 0x5596491b2210 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.660+0000 7f1119375800 1 -- 172.21.15.170:0/2615516134 >> 172.21.15.170:0/2615516134 conn(0x5596490b31c0 msgr2=0x5596491abb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:59.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.661+0000 7f1119375800 1 -- 172.21.15.170:0/2615516134 shutdown_connections 2024-09-12T17:27:59.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.661+0000 7f1119375800 1 -- 172.21.15.170:0/2615516134 wait complete. 2024-09-12T17:27:59.701 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T17:27:59.362376Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:27:59.362351Z', 'tags': [], 'group_ids': []} 2024-09-12T17:27:59.701 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-12T17:27:59.701 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-12T17:27:59.701 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-12T17:27:59.746 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:59.746 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:59.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.745+0000 7f55b4925800 1 Processor -- start 2024-09-12T17:27:59.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.745+0000 7f55b4925800 1 -- start start 2024-09-12T17:27:59.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.745+0000 7f55b4925800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55d4cf9a8690 0x55d4cf9aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.746+0000 7f55b4925800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d4cf851e40 con 0x55d4cf9ab020 2024-09-12T17:27:59.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.746+0000 7f55b4925800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x55d4cf81c680 con 0x55d4cf9a8690 2024-09-12T17:27:59.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.746+0000 7f55b0533640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55d4cf9a8690 0x55d4cf9aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.746+0000 7f55a7fff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x55d4cf9ab020 0x55d4cf9ad4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:48272/0 (socket says 172.21.15.170:48272) 2024-09-12T17:27:59.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.746+0000 7f55a7fff640 1 -- 172.21.15.170:0/3468589791 learned_addr learned my addr 172.21.15.170:0/3468589791 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:27:59.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.746+0000 7f55b0533640 1 -- 172.21.15.170:0/3468589791 >> v1:172.21.15.47:6789/0 conn(0x55d4cf9ab020 legacy=0x55d4cf9ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.746+0000 7f55afd32640 1 -- 172.21.15.170:0/3468589791 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1718238201 0 0) 0x55d4cf851e40 con 0x55d4cf9ab020 2024-09-12T17:27:59.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.746+0000 7f55b0533640 1 -- 172.21.15.170:0/3468589791 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4cf8386b0 con 0x55d4cf9a8690 2024-09-12T17:27:59.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.748+0000 7f55b0533640 1 --2- 172.21.15.170:0/3468589791 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4cf9a8690 0x55d4cf9aaa80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f55a000a470 tx=0x7f55a0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5066d581dd370e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.748+0000 7f55afd32640 1 -- 172.21.15.170:0/3468589791 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55a0053570 con 0x55d4cf9a8690 2024-09-12T17:27:59.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.748+0000 7f55afd32640 1 -- 172.21.15.170:0/3468589791 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55a0058070 con 0x55d4cf9a8690 2024-09-12T17:27:59.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.748+0000 7f55afd32640 1 -- 172.21.15.170:0/3468589791 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55a0053880 con 0x55d4cf9a8690 2024-09-12T17:27:59.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.748+0000 7f55b4925800 1 -- 172.21.15.170:0/3468589791 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4cf9a8690 msgr2=0x55d4cf9aaa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.748+0000 7f55b4925800 1 --2- 172.21.15.170:0/3468589791 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4cf9a8690 0x55d4cf9aaa80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f55a000a470 tx=0x7f55a0045a20 comp rx=0 tx=0).stop 2024-09-12T17:27:59.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.749+0000 7f55b4925800 1 -- 172.21.15.170:0/3468589791 shutdown_connections 2024-09-12T17:27:59.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.749+0000 7f55b4925800 1 --2- 172.21.15.170:0/3468589791 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4cf9a8690 0x55d4cf9aaa80 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.749+0000 7f55b4925800 1 -- 172.21.15.170:0/3468589791 >> 172.21.15.170:0/3468589791 conn(0x55d4cf9a21f0 msgr2=0x55d4cf9a4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:59.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.749+0000 7f55b4925800 1 -- 172.21.15.170:0/3468589791 shutdown_connections 2024-09-12T17:27:59.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.749+0000 7f55b4925800 1 -- 172.21.15.170:0/3468589791 wait complete. 2024-09-12T17:27:59.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.762+0000 7f55b4925800 1 Processor -- start 2024-09-12T17:27:59.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.762+0000 7f55b4925800 1 -- start start 2024-09-12T17:27:59.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.762+0000 7f55b4925800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4cf9a8690 0x55d4cf9a7e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.762+0000 7f55b4925800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d4cf840dd0 con 0x55d4cf9a8690 2024-09-12T17:27:59.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.763+0000 7f55b0533640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4cf9a8690 0x55d4cf9a7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.763+0000 7f55b0533640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4cf9a8690 0x55d4cf9a7e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56648/0 (socket says 172.21.15.170:56648) 2024-09-12T17:27:59.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.763+0000 7f55b0533640 1 -- 172.21.15.170:0/647940294 learned_addr learned my addr 172.21.15.170:0/647940294 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:59.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.763+0000 7f55b0533640 1 -- 172.21.15.170:0/647940294 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4cf859e10 con 0x55d4cf9a8690 2024-09-12T17:27:59.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.763+0000 7f55b0533640 1 --2- 172.21.15.170:0/647940294 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4cf9a8690 0x55d4cf9a7e00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f55a0025c20 tx=0x7f55a0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65fe9710c2e6cd22 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.763+0000 7f549e60c640 1 -- 172.21.15.170:0/647940294 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55a0053a20 con 0x55d4cf9a8690 2024-09-12T17:27:59.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.763+0000 7f549e60c640 1 -- 172.21.15.170:0/647940294 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55a0063070 con 0x55d4cf9a8690 2024-09-12T17:27:59.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.763+0000 7f549e60c640 1 -- 172.21.15.170:0/647940294 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55a0053d30 con 0x55d4cf9a8690 2024-09-12T17:27:59.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.764+0000 7f55b4925800 1 -- 172.21.15.170:0/647940294 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4cf9a8690 msgr2=0x55d4cf9a7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.764+0000 7f55b4925800 1 --2- 172.21.15.170:0/647940294 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4cf9a8690 0x55d4cf9a7e00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f55a0025c20 tx=0x7f55a0051000 comp rx=0 tx=0).stop 2024-09-12T17:27:59.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.764+0000 7f55b4925800 1 -- 172.21.15.170:0/647940294 shutdown_connections 2024-09-12T17:27:59.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.764+0000 7f55b4925800 1 --2- 172.21.15.170:0/647940294 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4cf9a8690 0x55d4cf9a7e00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.764+0000 7f55b4925800 1 -- 172.21.15.170:0/647940294 >> 172.21.15.170:0/647940294 conn(0x55d4cf9a21f0 msgr2=0x55d4cfa92df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:59.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.764+0000 7f55b4925800 1 -- 172.21.15.170:0/647940294 shutdown_connections 2024-09-12T17:27:59.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.764+0000 7f55b4925800 1 -- 172.21.15.170:0/647940294 wait complete. 2024-09-12T17:27:59.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.764+0000 7f55b4925800 1 Processor -- start 2024-09-12T17:27:59.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.764+0000 7f55b4925800 1 -- start start 2024-09-12T17:27:59.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.765+0000 7f55b4925800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4cf9a8690 0x55d4cfaa0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.765+0000 7f55b4925800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d4cf9af040 con 0x55d4cf9a8690 2024-09-12T17:27:59.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.765+0000 7f55b0533640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4cf9a8690 0x55d4cfaa0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.765+0000 7f55b0533640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4cf9a8690 0x55d4cfaa0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56656/0 (socket says 172.21.15.170:56656) 2024-09-12T17:27:59.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.765+0000 7f55b0533640 1 -- 172.21.15.170:0/1740678650 learned_addr learned my addr 172.21.15.170:0/1740678650 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:59.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.765+0000 7f55b0533640 1 -- 172.21.15.170:0/1740678650 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4cfaa1500 con 0x55d4cf9a8690 2024-09-12T17:27:59.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.765+0000 7f55b0533640 1 --2- 172.21.15.170:0/1740678650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4cf9a8690 0x55d4cfaa0fa0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f55a0025c20 tx=0x7f55a0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.766+0000 7f549ce09640 1 -- 172.21.15.170:0/1740678650 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55a0078070 con 0x55d4cf9a8690 2024-09-12T17:27:59.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.766+0000 7f549ce09640 1 -- 172.21.15.170:0/1740678650 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55a0073470 con 0x55d4cf9a8690 2024-09-12T17:27:59.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.766+0000 7f55b4925800 1 -- 172.21.15.170:0/1740678650 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d4cfaa1790 con 0x55d4cf9a8690 2024-09-12T17:27:59.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.766+0000 7f549ce09640 1 -- 172.21.15.170:0/1740678650 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55a0073750 con 0x55d4cf9a8690 2024-09-12T17:27:59.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.766+0000 7f55b4925800 1 -- 172.21.15.170:0/1740678650 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4cfaa2300 con 0x55d4cf9a8690 2024-09-12T17:27:59.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.766+0000 7f549ce09640 1 -- 172.21.15.170:0/1740678650 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f55a007b070 con 0x55d4cf9a8690 2024-09-12T17:27:59.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.767+0000 7f549ce09640 1 --2- 172.21.15.170:0/1740678650 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f549803c780 0x7f549803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.767+0000 7f549ce09640 1 -- 172.21.15.170:0/1740678650 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f55a0097930 con 0x55d4cf9a8690 2024-09-12T17:27:59.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.767+0000 7f55a7fff640 1 --2- 172.21.15.170:0/1740678650 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f549803c780 0x7f549803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.767+0000 7f55b4925800 1 --2- 172.21.15.170:0/1740678650 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55d4cf9ab020 0x55d4cfaa8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.767+0000 7f55b4925800 1 -- 172.21.15.170:0/1740678650 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfaa2cc0 con 0x55d4cf9ab020 2024-09-12T17:27:59.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.767+0000 7f55b0d34640 1 --2- 172.21.15.170:0/1740678650 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55d4cf9ab020 0x55d4cfaa8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.767+0000 7f55a7fff640 1 --2- 172.21.15.170:0/1740678650 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f549803c780 0x7f549803ec40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5598000c00 tx=0x7f55980013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.767+0000 7f55b0d34640 1 --2- 172.21.15.170:0/1740678650 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55d4cf9ab020 0x55d4cfaa8550 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.767+0000 7f55b0d34640 1 -- 172.21.15.170:0/1740678650 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55a800a4d0 con 0x55d4cf9ab020 2024-09-12T17:27:59.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.767+0000 7f55b4925800 1 -- 172.21.15.170:0/1740678650 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfaa2670 con 0x55d4cf9ab020 2024-09-12T17:27:59.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.768+0000 7f55b0d34640 1 -- 172.21.15.170:0/1740678650 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f55a800a4d0 con 0x55d4cf9ab020 2024-09-12T17:27:59.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.768+0000 7f55b4925800 1 --2- 172.21.15.170:0/1740678650 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55d4cfaaa9c0 0x55d4cfaacdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.768+0000 7f55b4925800 1 -- 172.21.15.170:0/1740678650 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfaad480 con 0x55d4cfaaa9c0 2024-09-12T17:27:59.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.768+0000 7f55b0533640 1 --2- 172.21.15.170:0/1740678650 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55d4cfaaa9c0 0x55d4cfaacdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.768+0000 7f55b0533640 1 --2- 172.21.15.170:0/1740678650 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55d4cfaaa9c0 0x55d4cfaacdb0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.768+0000 7f55b0533640 1 -- 172.21.15.170:0/1740678650 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f55a007a030 con 0x55d4cfaaa9c0 2024-09-12T17:27:59.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.768+0000 7f55b4925800 1 -- 172.21.15.170:0/1740678650 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfaa9860 con 0x55d4cf9ab020 2024-09-12T17:27:59.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.769+0000 7f55b0d34640 1 -- 172.21.15.170:0/1740678650 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f55a800a4d0 con 0x55d4cf9ab020 2024-09-12T17:27:59.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.769+0000 7f55b4925800 1 -- 172.21.15.170:0/1740678650 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfaa9d00 con 0x55d4cfaaa9c0 2024-09-12T17:27:59.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.769+0000 7f55b0533640 1 -- 172.21.15.170:0/1740678650 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f55a007a030 con 0x55d4cfaaa9c0 2024-09-12T17:27:59.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.769+0000 7f55b4925800 1 Processor -- start 2024-09-12T17:27:59.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.769+0000 7f55b4925800 1 -- start start 2024-09-12T17:27:59.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.769+0000 7f55b4925800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4cfabbd10 0x55d4cfabc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.769+0000 7f55b4925800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d4cf89ea00 con 0x55d4cfabbd10 2024-09-12T17:27:59.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.770+0000 7f55b0d34640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4cfabbd10 0x55d4cfabc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.770+0000 7f55b0d34640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4cfabbd10 0x55d4cfabc130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56668/0 (socket says 172.21.15.170:56668) 2024-09-12T17:27:59.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.770+0000 7f55b0d34640 1 -- 172.21.15.170:0/2970775617 learned_addr learned my addr 172.21.15.170:0/2970775617 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:59.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.770+0000 7f55b0d34640 1 -- 172.21.15.170:0/2970775617 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4cfabc770 con 0x55d4cfabbd10 2024-09-12T17:27:59.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.770+0000 7f55b0d34640 1 --2- 172.21.15.170:0/2970775617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4cfabbd10 0x55d4cfabc130 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x55d4cfaa1f00 tx=0x7f55a80167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.771+0000 7f5495ffb640 1 -- 172.21.15.170:0/2970775617 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55a8013640 con 0x55d4cfabbd10 2024-09-12T17:27:59.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.771+0000 7f5495ffb640 1 -- 172.21.15.170:0/2970775617 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55a80137e0 con 0x55d4cfabbd10 2024-09-12T17:27:59.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.771+0000 7f55b4925800 1 -- 172.21.15.170:0/2970775617 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d4cfabcfa0 con 0x55d4cfabbd10 2024-09-12T17:27:59.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.771+0000 7f5495ffb640 1 -- 172.21.15.170:0/2970775617 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55a8013ac0 con 0x55d4cfabbd10 2024-09-12T17:27:59.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.771+0000 7f55b4925800 1 -- 172.21.15.170:0/2970775617 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4cfabd540 con 0x55d4cfabbd10 2024-09-12T17:27:59.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.771+0000 7f5495ffb640 1 -- 172.21.15.170:0/2970775617 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f55a8011040 con 0x55d4cfabbd10 2024-09-12T17:27:59.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.772+0000 7f5495ffb640 1 --2- 172.21.15.170:0/2970775617 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f548803c730 0x7f548803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.772+0000 7f5495ffb640 1 -- 172.21.15.170:0/2970775617 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f55a800e040 con 0x55d4cfabbd10 2024-09-12T17:27:59.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.772+0000 7f55b0533640 1 --2- 172.21.15.170:0/2970775617 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f548803c730 0x7f548803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.772+0000 7f55b4925800 1 Processor -- start 2024-09-12T17:27:59.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.772+0000 7f55b4925800 1 -- start start 2024-09-12T17:27:59.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.772+0000 7f55b0533640 1 --2- 172.21.15.170:0/2970775617 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f548803c730 0x7f548803ebf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f55a0045a60 tx=0x7f55a0068dc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.772+0000 7f55b4925800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4cfac87d0 0x55d4cfac8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.772+0000 7f55b4925800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d4cf9a66a0 con 0x55d4cfac87d0 2024-09-12T17:27:59.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.772+0000 7f55b0d34640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4cfac87d0 0x55d4cfac8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.772+0000 7f55b0d34640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4cfac87d0 0x55d4cfac8bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56678/0 (socket says 172.21.15.170:56678) 2024-09-12T17:27:59.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.772+0000 7f55b0d34640 1 -- 172.21.15.170:0/2249093240 learned_addr learned my addr 172.21.15.170:0/2249093240 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:59.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.773+0000 7f55b0d34640 1 -- 172.21.15.170:0/2249093240 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4cfac91c0 con 0x55d4cfac87d0 2024-09-12T17:27:59.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.773+0000 7f55b0d34640 1 --2- 172.21.15.170:0/2249093240 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4cfac87d0 0x55d4cfac8bd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f55a8020000 tx=0x7f55a80204d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caf163e7afe9b813 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.773+0000 7f548f7fe640 1 -- 172.21.15.170:0/2249093240 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55a8052070 con 0x55d4cfac87d0 2024-09-12T17:27:59.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.773+0000 7f548f7fe640 1 -- 172.21.15.170:0/2249093240 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55a804a020 con 0x55d4cfac87d0 2024-09-12T17:27:59.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.773+0000 7f548f7fe640 1 -- 172.21.15.170:0/2249093240 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55a8055040 con 0x55d4cfac87d0 2024-09-12T17:27:59.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.773+0000 7f55b4925800 1 -- 172.21.15.170:0/2249093240 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4cfac87d0 msgr2=0x55d4cfac8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.773+0000 7f55b4925800 1 --2- 172.21.15.170:0/2249093240 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4cfac87d0 0x55d4cfac8bd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f55a8020000 tx=0x7f55a80204d0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.773+0000 7f55b4925800 1 -- 172.21.15.170:0/2249093240 shutdown_connections 2024-09-12T17:27:59.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.773+0000 7f55b4925800 1 --2- 172.21.15.170:0/2249093240 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4cfac87d0 0x55d4cfac8bd0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.774+0000 7f55b4925800 1 -- 172.21.15.170:0/2249093240 >> 172.21.15.170:0/2249093240 conn(0x55d4cfac4bd0 msgr2=0x55d4cfac2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:59.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.774+0000 7f55b4925800 1 -- 172.21.15.170:0/2249093240 shutdown_connections 2024-09-12T17:27:59.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.774+0000 7f55b4925800 1 -- 172.21.15.170:0/2249093240 wait complete. 2024-09-12T17:27:59.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.774+0000 7f55b4925800 1 Processor -- start 2024-09-12T17:27:59.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.774+0000 7f55b4925800 1 -- start start 2024-09-12T17:27:59.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.774+0000 7f55b4925800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4cfac87d0 0x55d4cfacfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.774+0000 7f55b4925800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d4cfac97e0 con 0x55d4cfac87d0 2024-09-12T17:27:59.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.774+0000 7f55b0d34640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4cfac87d0 0x55d4cfacfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.774+0000 7f55b0d34640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4cfac87d0 0x55d4cfacfdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56692/0 (socket says 172.21.15.170:56692) 2024-09-12T17:27:59.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.774+0000 7f55b0d34640 1 -- 172.21.15.170:0/2077978059 learned_addr learned my addr 172.21.15.170:0/2077978059 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:59.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.774+0000 7f55b0d34640 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4cfad0330 con 0x55d4cfac87d0 2024-09-12T17:27:59.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.775+0000 7f55b0d34640 1 --2- 172.21.15.170:0/2077978059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4cfac87d0 0x55d4cfacfdd0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f55a80147b0 tx=0x7f55a8053d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.775+0000 7f548dffb640 1 -- 172.21.15.170:0/2077978059 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55a8037070 con 0x55d4cfac87d0 2024-09-12T17:27:59.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.775+0000 7f548dffb640 1 -- 172.21.15.170:0/2077978059 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55a801f500 con 0x55d4cfac87d0 2024-09-12T17:27:59.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.775+0000 7f548dffb640 1 -- 172.21.15.170:0/2077978059 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55a801f7e0 con 0x55d4cfac87d0 2024-09-12T17:27:59.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.775+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d4cfad05c0 con 0x55d4cfac87d0 2024-09-12T17:27:59.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.775+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4cfad0f40 con 0x55d4cfac87d0 2024-09-12T17:27:59.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.776+0000 7f548dffb640 1 -- 172.21.15.170:0/2077978059 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f55a803a070 con 0x55d4cfac87d0 2024-09-12T17:27:59.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.776+0000 7f548dffb640 1 --2- 172.21.15.170:0/2077978059 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f548003c730 0x7f548003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.776+0000 7f548dffb640 1 -- 172.21.15.170:0/2077978059 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f55a804b070 con 0x55d4cfac87d0 2024-09-12T17:27:59.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.776+0000 7f55b0533640 1 --2- 172.21.15.170:0/2077978059 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f548003c730 0x7f548003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.776+0000 7f55b0533640 1 --2- 172.21.15.170:0/2077978059 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f548003c730 0x7f548003ebf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x55d4cfaa8b30 tx=0x7f55a0093000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.776+0000 7f55b4925800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.776+0000 7f55b4925800 1 --2- 172.21.15.170:0/2077978059 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55d4cfadb6a0 0x55d4cfaddb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.776+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfade2b0 con 0x55d4cfadb6a0 2024-09-12T17:27:59.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.777+0000 7f55a7fff640 1 --2- 172.21.15.170:0/2077978059 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55d4cfadb6a0 0x55d4cfaddb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.777+0000 7f55a7fff640 1 --2- 172.21.15.170:0/2077978059 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55d4cfadb6a0 0x55d4cfaddb60 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.777+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f559800f5f0 con 0x55d4cfadb6a0 2024-09-12T17:27:59.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.777+0000 7f55b4925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.777+0000 7f55b4925800 20 realm 2024-09-12T17:27:59.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.777+0000 7f55b4925800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.777+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfada9f0 con 0x55d4cfadb6a0 2024-09-12T17:27:59.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.777+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f559800f5f0 con 0x55d4cfadb6a0 2024-09-12T17:27:59.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.777+0000 7f55b4925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.777+0000 7f55b4925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:59.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.777+0000 7f55b4925800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.777+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfadeda0 con 0x55d4cfadb6a0 2024-09-12T17:27:59.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.777+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f559800f5f0 con 0x55d4cfadb6a0 2024-09-12T17:27:59.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.777+0000 7f55b4925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.777+0000 7f55b4925800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.777+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfadf670 con 0x55d4cfadb6a0 2024-09-12T17:27:59.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.778+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f559800f5f0 con 0x55d4cfadb6a0 2024-09-12T17:27:59.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.778+0000 7f55b4925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:59.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.778+0000 7f55b4925800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.778+0000 7f55b4925800 1 --2- 172.21.15.170:0/2077978059 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55d4cfae0090 0x55d4cfae2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.778+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfae2bf0 con 0x55d4cfae0090 2024-09-12T17:27:59.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.778+0000 7f55b0d34640 1 --2- 172.21.15.170:0/2077978059 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55d4cfae0090 0x55d4cfae2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.778+0000 7f55b0d34640 1 --2- 172.21.15.170:0/2077978059 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55d4cfae0090 0x55d4cfae2480 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.778+0000 7f55b0d34640 1 -- 172.21.15.170:0/2077978059 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f55a8039030 con 0x55d4cfae0090 2024-09-12T17:27:59.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.778+0000 7f55b4925800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:27:59.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.778+0000 7f55b4925800 20 searching for the correct realm 2024-09-12T17:27:59.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.778+0000 7f55b4925800 1 --2- 172.21.15.170:0/2077978059 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55d4cfae4ba0 0x55d4cfae7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.778+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfae7730 con 0x55d4cfae4ba0 2024-09-12T17:27:59.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.779+0000 7f55b0533640 1 --2- 172.21.15.170:0/2077978059 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55d4cfae4ba0 0x55d4cfae7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.779+0000 7f55b0533640 1 --2- 172.21.15.170:0/2077978059 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55d4cfae4ba0 0x55d4cfae7060 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.779+0000 7f55b0533640 1 -- 172.21.15.170:0/2077978059 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55a00a1070 con 0x55d4cfae4ba0 2024-09-12T17:27:59.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.779+0000 7f55b0533640 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f55a0098c60 con 0x55d4cfae0090 2024-09-12T17:27:59.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.779+0000 7f55b0d34640 1 -- 172.21.15.170:0/2077978059 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55a8039030 con 0x55d4cfae0090 2024-09-12T17:27:59.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.779+0000 7f55b0d34640 1 --2- 172.21.15.170:0/2077978059 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f55a803c060 0x7f55a80125f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.779+0000 7f55b0d34640 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f55a0098c60 con 0x7f55a803c060 2024-09-12T17:27:59.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.780+0000 7f55a7fff640 1 --2- 172.21.15.170:0/2077978059 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f55a803c060 0x7f55a80125f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.780+0000 7f55a7fff640 1 --2- 172.21.15.170:0/2077978059 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f55a803c060 0x7f55a80125f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.780+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f559800f5f0 con 0x7f55a803c060 2024-09-12T17:27:59.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.780+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f55a0098c60 con 0x55d4cfadb6a0 2024-09-12T17:27:59.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.780+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f559800f5f0 con 0x55d4cfadb6a0 2024-09-12T17:27:59.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.780+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f55a0098c60 con 0x55d4cfadb6a0 2024-09-12T17:27:59.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.781+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f559802b040 con 0x55d4cfadb6a0 2024-09-12T17:27:59.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.781+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f55a0098c60 con 0x7f55a803c060 2024-09-12T17:27:59.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.781+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f559802b040 con 0x7f55a803c060 2024-09-12T17:27:59.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.781+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f55a0098c60 con 0x7f55a803c060 2024-09-12T17:27:59.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.781+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f559802b040 con 0x7f55a803c060 2024-09-12T17:27:59.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.781+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f55a0098c60 con 0x55d4cfae0090 2024-09-12T17:27:59.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.781+0000 7f55b0d34640 1 -- 172.21.15.170:0/2077978059 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55a8039030 con 0x55d4cfae0090 2024-09-12T17:27:59.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.781+0000 7f55b0d34640 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f55a0098c60 con 0x55d4cfae4ba0 2024-09-12T17:27:59.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.781+0000 7f55b0533640 1 -- 172.21.15.170:0/2077978059 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55a00a1070 con 0x55d4cfae4ba0 2024-09-12T17:27:59.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.782+0000 7f55b0533640 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f55a0098c60 con 0x55d4cfadb6a0 2024-09-12T17:27:59.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.782+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f559802b040 con 0x55d4cfadb6a0 2024-09-12T17:27:59.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.782+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f55a0098c60 con 0x7f55a803c060 2024-09-12T17:27:59.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.782+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f559802b040 con 0x7f55a803c060 2024-09-12T17:27:59.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.782+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f55a0098c60 con 0x55d4cfadb6a0 2024-09-12T17:27:59.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.782+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f559802b040 con 0x55d4cfadb6a0 2024-09-12T17:27:59.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.782+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f55a0098c60 con 0x55d4cfae0090 2024-09-12T17:27:59.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.782+0000 7f55b0d34640 1 -- 172.21.15.170:0/2077978059 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f55a8039030 con 0x55d4cfae0090 2024-09-12T17:27:59.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.782+0000 7f55b0d34640 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f55a0098c60 con 0x55d4cfae4ba0 2024-09-12T17:27:59.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.783+0000 7f55b0533640 1 -- 172.21.15.170:0/2077978059 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55a00a1070 con 0x55d4cfae4ba0 2024-09-12T17:27:59.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.783+0000 7f55b0533640 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f55a0098c60 con 0x55d4cfae4ba0 2024-09-12T17:27:59.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.783+0000 7f55b0533640 1 -- 172.21.15.170:0/2077978059 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55a00a1070 con 0x55d4cfae4ba0 2024-09-12T17:27:59.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.783+0000 7f55b0533640 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f55a0098c60 con 0x7f55a803c060 2024-09-12T17:27:59.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.783+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f559802b040 con 0x7f55a803c060 2024-09-12T17:27:59.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.783+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f55a0098c60 con 0x55d4cfae4ba0 2024-09-12T17:27:59.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.783+0000 7f55b0533640 1 -- 172.21.15.170:0/2077978059 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55a00a1070 con 0x55d4cfae4ba0 2024-09-12T17:27:59.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.783+0000 7f55b0533640 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f55a0098c60 con 0x55d4cfae4ba0 2024-09-12T17:27:59.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.784+0000 7f55b0533640 1 -- 172.21.15.170:0/2077978059 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55a00a1070 con 0x55d4cfae4ba0 2024-09-12T17:27:59.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.784+0000 7f55b0533640 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f55a0098c60 con 0x55d4cfadb6a0 2024-09-12T17:27:59.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.784+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f559802b040 con 0x55d4cfadb6a0 2024-09-12T17:27:59.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.784+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f55a0098c60 con 0x55d4cfadb6a0 2024-09-12T17:27:59.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.784+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f559802b040 con 0x55d4cfadb6a0 2024-09-12T17:27:59.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.784+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f55a0098c60 con 0x7f55a803c060 2024-09-12T17:27:59.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.784+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f559802b040 con 0x7f55a803c060 2024-09-12T17:27:59.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.784+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f55a0098c60 con 0x55d4cfae4ba0 2024-09-12T17:27:59.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.784+0000 7f55b0533640 1 -- 172.21.15.170:0/2077978059 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55a00a1070 con 0x55d4cfae4ba0 2024-09-12T17:27:59.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.784+0000 7f55b0533640 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f55a0098c60 con 0x55d4cfae0090 2024-09-12T17:27:59.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.785+0000 7f55b0d34640 1 -- 172.21.15.170:0/2077978059 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55a8039030 con 0x55d4cfae0090 2024-09-12T17:27:59.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.785+0000 7f55b0d34640 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f55a0098c60 con 0x55d4cfadb6a0 2024-09-12T17:27:59.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.785+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f559802b040 con 0x55d4cfadb6a0 2024-09-12T17:27:59.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.785+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f55a0098c60 con 0x7f55a803c060 2024-09-12T17:27:59.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.785+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f559803b040 con 0x7f55a803c060 2024-09-12T17:27:59.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.785+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f55a0098c60 con 0x55d4cfae4ba0 2024-09-12T17:27:59.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.786+0000 7f55b0533640 1 -- 172.21.15.170:0/2077978059 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55a00a1070 con 0x55d4cfae4ba0 2024-09-12T17:27:59.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.786+0000 7f55b0533640 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f55a0098c60 con 0x7f55a803c060 2024-09-12T17:27:59.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.786+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f559803b040 con 0x7f55a803c060 2024-09-12T17:27:59.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.786+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f55a0098c60 con 0x55d4cfae0090 2024-09-12T17:27:59.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.786+0000 7f55b0d34640 1 -- 172.21.15.170:0/2077978059 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55a8039030 con 0x55d4cfae0090 2024-09-12T17:27:59.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.786+0000 7f55b0d34640 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f55a0098c60 con 0x55d4cfae4ba0 2024-09-12T17:27:59.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.786+0000 7f55b0533640 1 -- 172.21.15.170:0/2077978059 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55a00a1070 con 0x55d4cfae4ba0 2024-09-12T17:27:59.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.786+0000 7f55b0533640 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f55a0098c60 con 0x7f55a803c060 2024-09-12T17:27:59.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.787+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f559803b040 con 0x7f55a803c060 2024-09-12T17:27:59.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.787+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f55a0098c60 con 0x55d4cfadb6a0 2024-09-12T17:27:59.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.787+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f559803b040 con 0x55d4cfadb6a0 2024-09-12T17:27:59.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.787+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f55a0098c60 con 0x55d4cfae0090 2024-09-12T17:27:59.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.787+0000 7f55b0d34640 1 -- 172.21.15.170:0/2077978059 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f55a8039030 con 0x55d4cfae0090 2024-09-12T17:27:59.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.787+0000 7f55b4925800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:27:59.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.787+0000 7f55b4925800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:59.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.787+0000 7f55b4925800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:59.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.787+0000 7f55b4925800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:59.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.787+0000 7f55b4925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:59.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.787+0000 7f55b4925800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:27:59.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.787+0000 7f55b4925800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.787+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfae34b0 con 0x55d4cfadb6a0 2024-09-12T17:27:59.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.788+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f559803b040 con 0x55d4cfadb6a0 2024-09-12T17:27:59.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.788+0000 7f55b4925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.788+0000 7f55b4925800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.788+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfae38a0 con 0x55d4cfadb6a0 2024-09-12T17:27:59.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.788+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f559803b040 con 0x55d4cfadb6a0 2024-09-12T17:27:59.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.788+0000 7f55b4925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:59.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.788+0000 7f55b4925800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.788+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfae3cc0 con 0x55d4cfae0090 2024-09-12T17:27:59.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.788+0000 7f55b0d34640 1 -- 172.21.15.170:0/2077978059 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f55a8039030 con 0x55d4cfae0090 2024-09-12T17:27:59.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.788+0000 7f55b4925800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:27:59.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.788+0000 7f55b4925800 20 zone default found 2024-09-12T17:27:59.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.788+0000 7f55b4925800 4 Realm: () 2024-09-12T17:27:59.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.788+0000 7f55b4925800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:27:59.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.788+0000 7f55b4925800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:27:59.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.788+0000 7f55b4925800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:59.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.788+0000 7f55b4925800 20 zonegroup default 2024-09-12T17:27:59.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.788+0000 7f55b4925800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.788+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfae7bb0 con 0x7f55a803c060 2024-09-12T17:27:59.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.788+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f559803b040 con 0x7f55a803c060 2024-09-12T17:27:59.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.788+0000 7f55b4925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.788+0000 7f55b4925800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.788+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfae99c0 con 0x55d4cfae4ba0 2024-09-12T17:27:59.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.789+0000 7f55b0533640 1 -- 172.21.15.170:0/2077978059 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f55a00a1070 con 0x55d4cfae4ba0 2024-09-12T17:27:59.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.789+0000 7f55b4925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.789+0000 7f55b4925800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.789+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfae9e20 con 0x55d4cfae4ba0 2024-09-12T17:27:59.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.789+0000 7f55b0533640 1 -- 172.21.15.170:0/2077978059 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f55a00a1070 con 0x55d4cfae4ba0 2024-09-12T17:27:59.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.789+0000 7f55b4925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.789+0000 7f55b4925800 20 started sync module instance, tier type = 2024-09-12T17:27:59.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.789+0000 7f55b4925800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:27:59.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.789+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfae8e60 con 0x55d4cfae0090 2024-09-12T17:27:59.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.790+0000 7f55b0d34640 1 -- 172.21.15.170:0/2077978059 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55a8039030 con 0x55d4cfae0090 2024-09-12T17:27:59.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.790+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94372505749936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfaea280 con 0x55d4cfae0090 2024-09-12T17:27:59.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.790+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfaeaad0 con 0x55d4cfadb6a0 2024-09-12T17:27:59.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.791+0000 7f55b0d34640 1 -- 172.21.15.170:0/2077978059 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94372505749936] v29'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55a8039030 con 0x55d4cfae0090 2024-09-12T17:27:59.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.791+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f559803b040 con 0x55d4cfadb6a0 2024-09-12T17:27:59.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.791+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94372505756288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfaeab50 con 0x55d4cfadb6a0 2024-09-12T17:27:59.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.791+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfaeb3a0 con 0x55d4cfae4ba0 2024-09-12T17:27:59.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.792+0000 7f55b0533640 1 -- 172.21.15.170:0/2077978059 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55a00a1070 con 0x55d4cfae4ba0 2024-09-12T17:27:59.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.792+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94372505759056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfaeb370 con 0x55d4cfae4ba0 2024-09-12T17:27:59.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.792+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfaec390 con 0x55d4cfae0090 2024-09-12T17:27:59.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.792+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94372505756288] v29'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f559803b040 con 0x55d4cfadb6a0 2024-09-12T17:27:59.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.793+0000 7f55b0d34640 1 -- 172.21.15.170:0/2077978059 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55a8039030 con 0x55d4cfae0090 2024-09-12T17:27:59.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.793+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94372505763424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfaec350 con 0x55d4cfae0090 2024-09-12T17:27:59.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.793+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfaece10 con 0x55d4cfadb6a0 2024-09-12T17:27:59.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.793+0000 7f55b0533640 1 -- 172.21.15.170:0/2077978059 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94372505759056] v29'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55a00a1070 con 0x55d4cfae4ba0 2024-09-12T17:27:59.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.794+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f559803b040 con 0x55d4cfadb6a0 2024-09-12T17:27:59.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.794+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94372505766176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfaece10 con 0x55d4cfadb6a0 2024-09-12T17:27:59.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.794+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfaed820 con 0x7f55a803c060 2024-09-12T17:27:59.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.794+0000 7f55b0d34640 1 -- 172.21.15.170:0/2077978059 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94372505763424] v29'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55a8039030 con 0x55d4cfae0090 2024-09-12T17:27:59.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.795+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f559803b040 con 0x7f55a803c060 2024-09-12T17:27:59.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.795+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94372505757344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfaed820 con 0x7f55a803c060 2024-09-12T17:27:59.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.795+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfaee270 con 0x7f55a803c060 2024-09-12T17:27:59.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.795+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94372505766176] v29'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f559803b040 con 0x55d4cfadb6a0 2024-09-12T17:27:59.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.796+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v29'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f559803b040 con 0x7f55a803c060 2024-09-12T17:27:59.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.796+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94372505761680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfaee230 con 0x7f55a803c060 2024-09-12T17:27:59.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.796+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfaeec30 con 0x7f55a803c060 2024-09-12T17:27:59.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.796+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94372505757344] v29'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f559803b040 con 0x7f55a803c060 2024-09-12T17:27:59.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.797+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94372505761680] v29'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f559803b040 con 0x7f55a803c060 2024-09-12T17:27:59.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.797+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(58 notify.7 [create] v29'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f559803b040 con 0x7f55a803c060 2024-09-12T17:27:59.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.797+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94372505768816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfaee740 con 0x7f55a803c060 2024-09-12T17:27:59.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.797+0000 7f55b4925800 20 add_watcher() i=0 2024-09-12T17:27:59.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.797+0000 7f55b4925800 20 add_watcher() i=1 2024-09-12T17:27:59.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.797+0000 7f55b4925800 20 add_watcher() i=2 2024-09-12T17:27:59.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.797+0000 7f55b4925800 20 add_watcher() i=3 2024-09-12T17:27:59.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.797+0000 7f55b4925800 20 add_watcher() i=4 2024-09-12T17:27:59.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.797+0000 7f55b4925800 20 add_watcher() i=5 2024-09-12T17:27:59.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.797+0000 7f55b4925800 20 add_watcher() i=6 2024-09-12T17:27:59.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.798+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94372505768816] v29'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f559803b040 con 0x7f55a803c060 2024-09-12T17:27:59.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.798+0000 7f55b4925800 20 add_watcher() i=7 2024-09-12T17:27:59.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.798+0000 7f55b4925800 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:59.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.798+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfaf1c20 con 0x55d4cfadb6a0 2024-09-12T17:27:59.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.798+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f559803b040 con 0x55d4cfadb6a0 2024-09-12T17:27:59.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.798+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94372505773888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfaef010 con 0x55d4cfadb6a0 2024-09-12T17:27:59.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.799+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94372505773888] v29'56 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f559803b040 con 0x55d4cfadb6a0 2024-09-12T17:27:59.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.799+0000 7f5466fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:59.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.799+0000 7f55b4925800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:59.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.799+0000 7f55b4925800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:59.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.800+0000 7f55b4925800 5 note: GC not initialized 2024-09-12T17:27:59.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.800+0000 7f5465fe3640 20 reqs_thread_entry: start 2024-09-12T17:27:59.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.800+0000 7f55b4925800 20 init_complete bucket index max shards: 11 2024-09-12T17:27:59.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.800+0000 7f55b4925800 20 Filter name: none 2024-09-12T17:27:59.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.800+0000 7f545effd640 20 reqs_thread_entry: start 2024-09-12T17:27:59.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.800+0000 7f55b4925800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:27:59.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.800+0000 7f55b4925800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.800+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfb24b10 con 0x55d4cfadb6a0 2024-09-12T17:27:59.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.800+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f559803b040 con 0x55d4cfadb6a0 2024-09-12T17:27:59.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.800+0000 7f55b4925800 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:27:59.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.800+0000 7f55b4925800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T17:27:59.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.800+0000 7f55b4925800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:27:59.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.800+0000 7f55b4925800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:27:59.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.800+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfb27440 con 0x55d4cfae0090 2024-09-12T17:27:59.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.801+0000 7f55b0d34640 1 -- 172.21.15.170:0/2077978059 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f55a8039030 con 0x55d4cfae0090 2024-09-12T17:27:59.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.801+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfb2abf0 con 0x55d4cfadb6a0 2024-09-12T17:27:59.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.802+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v29'2 uv2 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f559803b040 con 0x55d4cfadb6a0 2024-09-12T17:27:59.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.802+0000 7f55b4925800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:27:59.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.802+0000 7f55b4925800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:27:59.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.802+0000 7f55b4925800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T17:27:59.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.802+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94372506019280 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfb26430 con 0x55d4cfadb6a0 2024-09-12T17:27:59.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.802+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== watch-notify(notify (1) cookie 94372505766176 notify 124554051585 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f5598018040 con 0x55d4cfadb6a0 2024-09-12T17:27:59.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.802+0000 7f548f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051585 cookie 94372505766176 notifier 4309 bl.length()=567 2024-09-12T17:27:59.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.802+0000 7f548f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:27:59.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.802+0000 7f548f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:27:59.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.802+0000 7f548f7fe640 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f5474003ea0 con 0x55d4cfadb6a0 2024-09-12T17:27:59.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.802+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(65 notify.4 [notify cookie 94372506019280 out=8b] v0'0 uv33 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f559803b040 con 0x55d4cfadb6a0 2024-09-12T17:27:59.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.802+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f559803b040 con 0x55d4cfadb6a0 2024-09-12T17:27:59.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.802+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== watch-notify(notify_complete (2) cookie 94372506019280 notify 124554051585 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f559801dae0 con 0x55d4cfadb6a0 2024-09-12T17:27:59.848 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T17:27:59.362376Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:27:59.362351Z","tags":[],"group_ids":[]} 2024-09-12T17:27:59.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.803+0000 7f5466fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:59.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.803+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94372505773888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfb22990 con 0x55d4cfadb6a0 2024-09-12T17:27:59.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.804+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94372505773888] v29'57 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f559803b040 con 0x55d4cfadb6a0 2024-09-12T17:27:59.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.804+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94372505749936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfb22990 con 0x55d4cfae0090 2024-09-12T17:27:59.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.805+0000 7f55b0d34640 1 -- 172.21.15.170:0/2077978059 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94372505749936] v29'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55a8039030 con 0x55d4cfae0090 2024-09-12T17:27:59.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.805+0000 7f55b4925800 20 remove_watcher() i=0 2024-09-12T17:27:59.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.805+0000 7f55b4925800 2 removed watcher, disabling cache 2024-09-12T17:27:59.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.805+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94372505756288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfb22990 con 0x55d4cfadb6a0 2024-09-12T17:27:59.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.806+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94372505756288] v29'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f559803b040 con 0x55d4cfadb6a0 2024-09-12T17:27:59.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.806+0000 7f55b4925800 20 remove_watcher() i=1 2024-09-12T17:27:59.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.806+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94372505759056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfb22990 con 0x55d4cfae4ba0 2024-09-12T17:27:59.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.807+0000 7f55b0533640 1 -- 172.21.15.170:0/2077978059 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94372505759056] v29'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55a00a1070 con 0x55d4cfae4ba0 2024-09-12T17:27:59.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.807+0000 7f55b4925800 20 remove_watcher() i=2 2024-09-12T17:27:59.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.807+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94372505763424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfb22990 con 0x55d4cfae0090 2024-09-12T17:27:59.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.808+0000 7f55b0d34640 1 -- 172.21.15.170:0/2077978059 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94372505763424] v29'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55a8039030 con 0x55d4cfae0090 2024-09-12T17:27:59.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.808+0000 7f55b4925800 20 remove_watcher() i=3 2024-09-12T17:27:59.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.808+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94372505766176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfb22990 con 0x55d4cfadb6a0 2024-09-12T17:27:59.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.809+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94372505766176] v29'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f559803b040 con 0x55d4cfadb6a0 2024-09-12T17:27:59.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.809+0000 7f55b4925800 20 remove_watcher() i=4 2024-09-12T17:27:59.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.809+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94372505757344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfb22990 con 0x7f55a803c060 2024-09-12T17:27:59.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.810+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94372505757344] v29'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f559803b040 con 0x7f55a803c060 2024-09-12T17:27:59.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.810+0000 7f55b4925800 20 remove_watcher() i=5 2024-09-12T17:27:59.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.810+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94372505761680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfb22990 con 0x7f55a803c060 2024-09-12T17:27:59.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.811+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94372505761680] v29'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f559803b040 con 0x7f55a803c060 2024-09-12T17:27:59.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.811+0000 7f55b4925800 20 remove_watcher() i=6 2024-09-12T17:27:59.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.811+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94372505768816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4cfb22990 con 0x7f55a803c060 2024-09-12T17:27:59.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.812+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94372505768816] v29'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f559803b040 con 0x7f55a803c060 2024-09-12T17:27:59.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.812+0000 7f55b4925800 20 remove_watcher() i=7 2024-09-12T17:27:59.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.812+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f55a803c060 msgr2=0x7f55a80125f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.812+0000 7f55b4925800 1 --2- 172.21.15.170:0/2077978059 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f55a803c060 0x7f55a80125f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.812+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55d4cfadb6a0 msgr2=0x55d4cfaddb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.812+0000 7f55b4925800 1 --2- 172.21.15.170:0/2077978059 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55d4cfadb6a0 0x55d4cfaddb60 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.812+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55d4cfae0090 msgr2=0x55d4cfae2480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.812+0000 7f55b4925800 1 --2- 172.21.15.170:0/2077978059 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55d4cfae0090 0x55d4cfae2480 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.812+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55d4cfae4ba0 msgr2=0x55d4cfae7060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.812+0000 7f55b4925800 1 --2- 172.21.15.170:0/2077978059 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55d4cfae4ba0 0x55d4cfae7060 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.812+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f548003c730 msgr2=0x7f548003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.812+0000 7f55b4925800 1 --2- 172.21.15.170:0/2077978059 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f548003c730 0x7f548003ebf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x55d4cfaa8b30 tx=0x7f55a0093000 comp rx=0 tx=0).stop 2024-09-12T17:27:59.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.812+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4cfac87d0 msgr2=0x55d4cfacfdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.812+0000 7f55a7fff640 1 -- 172.21.15.170:0/2077978059 reap_dead start 2024-09-12T17:27:59.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.812+0000 7f55b4925800 1 --2- 172.21.15.170:0/2077978059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4cfac87d0 0x55d4cfacfdd0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f55a80147b0 tx=0x7f55a8053d30 comp rx=0 tx=0).stop 2024-09-12T17:27:59.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.813+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 shutdown_connections 2024-09-12T17:27:59.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.813+0000 7f55b4925800 1 --2- 172.21.15.170:0/2077978059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4cfac87d0 0x55d4cfacfdd0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.813+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 >> 172.21.15.170:0/2077978059 conn(0x55d4cfac4bd0 msgr2=0x55d4cfac2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:59.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.813+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 shutdown_connections 2024-09-12T17:27:59.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.813+0000 7f55b4925800 1 -- 172.21.15.170:0/2077978059 wait complete. 2024-09-12T17:27:59.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.813+0000 7f55b4925800 1 -- 172.21.15.170:0/2970775617 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f548803c730 msgr2=0x7f548803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.813+0000 7f55b4925800 1 --2- 172.21.15.170:0/2970775617 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f548803c730 0x7f548803ebf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f55a0045a60 tx=0x7f55a0068dc0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.813+0000 7f55b4925800 1 -- 172.21.15.170:0/2970775617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4cfabbd10 msgr2=0x55d4cfabc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.813+0000 7f55b4925800 1 --2- 172.21.15.170:0/2970775617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4cfabbd10 0x55d4cfabc130 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x55d4cfaa1f00 tx=0x7f55a80167b0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.813+0000 7f55b4925800 1 -- 172.21.15.170:0/2970775617 shutdown_connections 2024-09-12T17:27:59.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.813+0000 7f55b4925800 1 --2- 172.21.15.170:0/2970775617 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f548803c730 0x7f548803ebf0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.813+0000 7f55b4925800 1 --2- 172.21.15.170:0/2970775617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4cfabbd10 0x55d4cfabc130 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.813+0000 7f55b4925800 1 -- 172.21.15.170:0/2970775617 >> 172.21.15.170:0/2970775617 conn(0x55d4cfab00c0 msgr2=0x55d4cfab04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:59.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.813+0000 7f55b4925800 1 -- 172.21.15.170:0/2970775617 shutdown_connections 2024-09-12T17:27:59.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.813+0000 7f55b4925800 1 -- 172.21.15.170:0/2970775617 wait complete. 2024-09-12T17:27:59.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.813+0000 7f55b4925800 1 -- 172.21.15.170:0/1740678650 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55d4cf9ab020 msgr2=0x55d4cfaa8550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.813+0000 7f55b4925800 1 --2- 172.21.15.170:0/1740678650 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55d4cf9ab020 0x55d4cfaa8550 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.813+0000 7f55b4925800 1 -- 172.21.15.170:0/1740678650 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55d4cfaaa9c0 msgr2=0x55d4cfaacdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.813+0000 7f55b4925800 1 --2- 172.21.15.170:0/1740678650 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55d4cfaaa9c0 0x55d4cfaacdb0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.813+0000 7f55b4925800 1 -- 172.21.15.170:0/1740678650 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f549803c780 msgr2=0x7f549803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.813+0000 7f55b4925800 1 --2- 172.21.15.170:0/1740678650 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f549803c780 0x7f549803ec40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5598000c00 tx=0x7f55980013b0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.813+0000 7f55b4925800 1 -- 172.21.15.170:0/1740678650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4cf9a8690 msgr2=0x55d4cfaa0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.813+0000 7f55b4925800 1 --2- 172.21.15.170:0/1740678650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4cf9a8690 0x55d4cfaa0fa0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f55a0025c20 tx=0x7f55a0002fb0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.814+0000 7f55b4925800 1 -- 172.21.15.170:0/1740678650 shutdown_connections 2024-09-12T17:27:59.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.814+0000 7f55b4925800 1 --2- 172.21.15.170:0/1740678650 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55d4cfaaa9c0 0x55d4cfaacdb0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.814+0000 7f55b4925800 1 --2- 172.21.15.170:0/1740678650 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f549803c780 0x7f549803ec40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.814+0000 7f55b4925800 1 --2- 172.21.15.170:0/1740678650 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55d4cf9ab020 0x55d4cfaa8550 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.814+0000 7f55b4925800 1 --2- 172.21.15.170:0/1740678650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4cf9a8690 0x55d4cfaa0fa0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.814+0000 7f55b4925800 1 -- 172.21.15.170:0/1740678650 >> 172.21.15.170:0/1740678650 conn(0x55d4cf9a21f0 msgr2=0x55d4cfa92940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:59.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.814+0000 7f55b4925800 1 -- 172.21.15.170:0/1740678650 shutdown_connections 2024-09-12T17:27:59.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.814+0000 7f55b4925800 1 -- 172.21.15.170:0/1740678650 wait complete. 2024-09-12T17:27:59.864 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T17:27:59.362376Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:27:59.362351Z', 'tags': [], 'group_ids': []} 2024-09-12T17:27:59.864 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-12T17:27:59.864 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-12T17:27:59.865 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-12T17:27:59.909 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:59.909 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:59.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.909+0000 7ff110b40800 1 Processor -- start 2024-09-12T17:27:59.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.909+0000 7ff110b40800 1 -- start start 2024-09-12T17:27:59.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.909+0000 7ff110b40800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55fed30e5700 0x55fed30e7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.909+0000 7ff110b40800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fed2f8ee40 con 0x55fed30e8030 2024-09-12T17:27:59.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.909+0000 7ff110b40800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x55fed2f59680 con 0x55fed30e5700 2024-09-12T17:27:59.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.909+0000 7ff10c8ed640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55fed30e5700 0x55fed30e7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.909+0000 7ff1040ec640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x55fed30e8030 0x55fed30ea4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:48284/0 (socket says 172.21.15.170:48284) 2024-09-12T17:27:59.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.909+0000 7ff1040ec640 1 -- 172.21.15.170:0/2175439843 learned_addr learned my addr 172.21.15.170:0/2175439843 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:27:59.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.910+0000 7ff10c8ed640 1 -- 172.21.15.170:0/2175439843 >> v1:172.21.15.47:6789/0 conn(0x55fed30e8030 legacy=0x55fed30ea4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.910+0000 7ff10c8ed640 1 -- 172.21.15.170:0/2175439843 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fed2f756b0 con 0x55fed30e5700 2024-09-12T17:27:59.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.911+0000 7ff10c8ed640 1 --2- 172.21.15.170:0/2175439843 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed30e5700 0x55fed30e7af0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc00a470 tx=0x7ff0fc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1732339d64ede42 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.911+0000 7ff107fff640 1 -- 172.21.15.170:0/2175439843 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0fc053570 con 0x55fed30e5700 2024-09-12T17:27:59.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.911+0000 7ff107fff640 1 -- 172.21.15.170:0/2175439843 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0fc058070 con 0x55fed30e5700 2024-09-12T17:27:59.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.911+0000 7ff107fff640 1 -- 172.21.15.170:0/2175439843 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0fc053880 con 0x55fed30e5700 2024-09-12T17:27:59.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.912+0000 7ff110b40800 1 -- 172.21.15.170:0/2175439843 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed30e5700 msgr2=0x55fed30e7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.912+0000 7ff110b40800 1 --2- 172.21.15.170:0/2175439843 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed30e5700 0x55fed30e7af0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc00a470 tx=0x7ff0fc045a20 comp rx=0 tx=0).stop 2024-09-12T17:27:59.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.912+0000 7ff110b40800 1 -- 172.21.15.170:0/2175439843 shutdown_connections 2024-09-12T17:27:59.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.912+0000 7ff110b40800 1 --2- 172.21.15.170:0/2175439843 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed30e5700 0x55fed30e7af0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.912+0000 7ff110b40800 1 -- 172.21.15.170:0/2175439843 >> 172.21.15.170:0/2175439843 conn(0x55fed30df1c0 msgr2=0x55fed30e1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:59.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.912+0000 7ff110b40800 1 -- 172.21.15.170:0/2175439843 shutdown_connections 2024-09-12T17:27:59.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.912+0000 7ff110b40800 1 -- 172.21.15.170:0/2175439843 wait complete. 2024-09-12T17:27:59.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.926+0000 7ff110b40800 1 Processor -- start 2024-09-12T17:27:59.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.926+0000 7ff110b40800 1 -- start start 2024-09-12T17:27:59.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.926+0000 7ff110b40800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed30e5700 0x55fed30e4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.926+0000 7ff110b40800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55fed2f7ddd0 con 0x55fed30e5700 2024-09-12T17:27:59.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.926+0000 7ff10c8ed640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed30e5700 0x55fed30e4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.926+0000 7ff10c8ed640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed30e5700 0x55fed30e4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56706/0 (socket says 172.21.15.170:56706) 2024-09-12T17:27:59.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.926+0000 7ff10c8ed640 1 -- 172.21.15.170:0/2618022084 learned_addr learned my addr 172.21.15.170:0/2618022084 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:59.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.927+0000 7ff10c8ed640 1 -- 172.21.15.170:0/2618022084 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fed2f96e10 con 0x55fed30e5700 2024-09-12T17:27:59.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.927+0000 7ff10c8ed640 1 --2- 172.21.15.170:0/2618022084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed30e5700 0x55fed30e4eb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc025c20 tx=0x7ff0fc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9a02cdddf4601e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.927+0000 7feffae0d640 1 -- 172.21.15.170:0/2618022084 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0fc053a20 con 0x55fed30e5700 2024-09-12T17:27:59.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.927+0000 7feffae0d640 1 -- 172.21.15.170:0/2618022084 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0fc063070 con 0x55fed30e5700 2024-09-12T17:27:59.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.927+0000 7feffae0d640 1 -- 172.21.15.170:0/2618022084 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0fc053cf0 con 0x55fed30e5700 2024-09-12T17:27:59.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.928+0000 7ff110b40800 1 -- 172.21.15.170:0/2618022084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed30e5700 msgr2=0x55fed30e4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.928+0000 7ff110b40800 1 --2- 172.21.15.170:0/2618022084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed30e5700 0x55fed30e4eb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc025c20 tx=0x7ff0fc051000 comp rx=0 tx=0).stop 2024-09-12T17:27:59.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.928+0000 7ff110b40800 1 -- 172.21.15.170:0/2618022084 shutdown_connections 2024-09-12T17:27:59.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.928+0000 7ff110b40800 1 --2- 172.21.15.170:0/2618022084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed30e5700 0x55fed30e4eb0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.928+0000 7ff110b40800 1 -- 172.21.15.170:0/2618022084 >> 172.21.15.170:0/2618022084 conn(0x55fed30df1c0 msgr2=0x55fed31d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:59.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.928+0000 7ff110b40800 1 -- 172.21.15.170:0/2618022084 shutdown_connections 2024-09-12T17:27:59.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.928+0000 7ff110b40800 1 -- 172.21.15.170:0/2618022084 wait complete. 2024-09-12T17:27:59.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.928+0000 7ff110b40800 1 Processor -- start 2024-09-12T17:27:59.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.928+0000 7ff110b40800 1 -- start start 2024-09-12T17:27:59.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.928+0000 7ff110b40800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed30e5700 0x55fed31de180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.928+0000 7ff110b40800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55fed30ec030 con 0x55fed30e5700 2024-09-12T17:27:59.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.929+0000 7ff10c8ed640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed30e5700 0x55fed31de180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.929+0000 7ff10c8ed640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed30e5700 0x55fed31de180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56710/0 (socket says 172.21.15.170:56710) 2024-09-12T17:27:59.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.929+0000 7ff10c8ed640 1 -- 172.21.15.170:0/98056428 learned_addr learned my addr 172.21.15.170:0/98056428 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:59.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.929+0000 7ff10c8ed640 1 -- 172.21.15.170:0/98056428 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fed31de6e0 con 0x55fed30e5700 2024-09-12T17:27:59.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.929+0000 7ff10c8ed640 1 --2- 172.21.15.170:0/98056428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed30e5700 0x55fed31de180 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc025c20 tx=0x7ff0fc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.929+0000 7feff960a640 1 -- 172.21.15.170:0/98056428 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0fc068660 con 0x55fed30e5700 2024-09-12T17:27:59.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.929+0000 7feff960a640 1 -- 172.21.15.170:0/98056428 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0fc068800 con 0x55fed30e5700 2024-09-12T17:27:59.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.929+0000 7ff110b40800 1 -- 172.21.15.170:0/98056428 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fed31de970 con 0x55fed30e5700 2024-09-12T17:27:59.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.929+0000 7feff960a640 1 -- 172.21.15.170:0/98056428 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0fc068ae0 con 0x55fed30e5700 2024-09-12T17:27:59.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.929+0000 7ff110b40800 1 -- 172.21.15.170:0/98056428 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fed31df580 con 0x55fed30e5700 2024-09-12T17:27:59.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.930+0000 7feff960a640 1 -- 172.21.15.170:0/98056428 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ff0fc068c80 con 0x55fed30e5700 2024-09-12T17:27:59.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.930+0000 7feff960a640 1 --2- 172.21.15.170:0/98056428 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7feff403c730 0x7feff403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.930+0000 7feff960a640 1 -- 172.21.15.170:0/98056428 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7ff0fc098080 con 0x55fed30e5700 2024-09-12T17:27:59.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.930+0000 7ff1040ec640 1 --2- 172.21.15.170:0/98056428 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7feff403c730 0x7feff403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.930+0000 7ff110b40800 1 --2- 172.21.15.170:0/98056428 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55fed30e8030 0x55fed31e57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.930+0000 7ff110b40800 1 -- 172.21.15.170:0/98056428 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed31e5d10 con 0x55fed30e8030 2024-09-12T17:27:59.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.931+0000 7ff10d0ee640 1 --2- 172.21.15.170:0/98056428 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55fed30e8030 0x55fed31e57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.931+0000 7ff1040ec640 1 --2- 172.21.15.170:0/98056428 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7feff403c730 0x7feff403ebf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff0f4001d70 tx=0x7ff0f40012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.931+0000 7ff10d0ee640 1 --2- 172.21.15.170:0/98056428 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55fed30e8030 0x55fed31e57d0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.931+0000 7ff10d0ee640 1 -- 172.21.15.170:0/98056428 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff10800a4d0 con 0x55fed30e8030 2024-09-12T17:27:59.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.931+0000 7ff110b40800 1 -- 172.21.15.170:0/98056428 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed31e60b0 con 0x55fed30e8030 2024-09-12T17:27:59.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.931+0000 7ff10d0ee640 1 -- 172.21.15.170:0/98056428 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff10800a4d0 con 0x55fed30e8030 2024-09-12T17:27:59.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.931+0000 7ff110b40800 1 --2- 172.21.15.170:0/98056428 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55fed31e7b70 0x55fed31ea010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.931+0000 7ff110b40800 1 -- 172.21.15.170:0/98056428 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed31ea7a0 con 0x55fed31e7b70 2024-09-12T17:27:59.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.932+0000 7ff10c8ed640 1 --2- 172.21.15.170:0/98056428 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55fed31e7b70 0x55fed31ea010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.932+0000 7ff10c8ed640 1 --2- 172.21.15.170:0/98056428 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55fed31e7b70 0x55fed31ea010 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.932+0000 7ff10c8ed640 1 -- 172.21.15.170:0/98056428 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff0fc051070 con 0x55fed31e7b70 2024-09-12T17:27:59.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.932+0000 7ff110b40800 1 -- 172.21.15.170:0/98056428 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed31e6900 con 0x55fed30e8030 2024-09-12T17:27:59.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.932+0000 7ff10d0ee640 1 -- 172.21.15.170:0/98056428 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff10800a4d0 con 0x55fed30e8030 2024-09-12T17:27:59.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.932+0000 7ff110b40800 1 -- 172.21.15.170:0/98056428 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed31e6ce0 con 0x55fed31e7b70 2024-09-12T17:27:59.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.933+0000 7ff10c8ed640 1 -- 172.21.15.170:0/98056428 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff0fc051070 con 0x55fed31e7b70 2024-09-12T17:27:59.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.933+0000 7ff110b40800 1 Processor -- start 2024-09-12T17:27:59.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.933+0000 7ff110b40800 1 -- start start 2024-09-12T17:27:59.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.933+0000 7ff110b40800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed31f9030 0x55fed31f9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.933+0000 7ff110b40800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55fed2fdba00 con 0x55fed31f9030 2024-09-12T17:27:59.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.934+0000 7ff10d0ee640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed31f9030 0x55fed31f9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.934+0000 7ff10d0ee640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed31f9030 0x55fed31f9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56722/0 (socket says 172.21.15.170:56722) 2024-09-12T17:27:59.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.934+0000 7ff10d0ee640 1 -- 172.21.15.170:0/2349792643 learned_addr learned my addr 172.21.15.170:0/2349792643 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:59.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.934+0000 7ff10d0ee640 1 -- 172.21.15.170:0/2349792643 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fed31f9a90 con 0x55fed31f9030 2024-09-12T17:27:59.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.934+0000 7ff10d0ee640 1 --2- 172.21.15.170:0/2349792643 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed31f9030 0x55fed31f9450 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x55fed31df180 tx=0x7ff1080167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.934+0000 7feff27fc640 1 -- 172.21.15.170:0/2349792643 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff108013640 con 0x55fed31f9030 2024-09-12T17:27:59.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.934+0000 7feff27fc640 1 -- 172.21.15.170:0/2349792643 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1080137e0 con 0x55fed31f9030 2024-09-12T17:27:59.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.934+0000 7ff110b40800 1 -- 172.21.15.170:0/2349792643 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fed31fa2c0 con 0x55fed31f9030 2024-09-12T17:27:59.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.934+0000 7feff27fc640 1 -- 172.21.15.170:0/2349792643 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff108013ae0 con 0x55fed31f9030 2024-09-12T17:27:59.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.934+0000 7ff110b40800 1 -- 172.21.15.170:0/2349792643 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fed31fa860 con 0x55fed31f9030 2024-09-12T17:27:59.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.935+0000 7feff27fc640 1 -- 172.21.15.170:0/2349792643 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ff108011040 con 0x55fed31f9030 2024-09-12T17:27:59.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.935+0000 7feff27fc640 1 --2- 172.21.15.170:0/2349792643 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fefe403c730 0x7fefe403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.935+0000 7feff27fc640 1 -- 172.21.15.170:0/2349792643 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7ff10800e040 con 0x55fed31f9030 2024-09-12T17:27:59.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.935+0000 7ff10c8ed640 1 --2- 172.21.15.170:0/2349792643 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fefe403c730 0x7fefe403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.936+0000 7ff110b40800 1 Processor -- start 2024-09-12T17:27:59.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.936+0000 7ff10c8ed640 1 --2- 172.21.15.170:0/2349792643 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fefe403c730 0x7fefe403ebf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x55fed31e0280 tx=0x7ff0fc05d5c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.936+0000 7ff110b40800 1 -- start start 2024-09-12T17:27:59.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.936+0000 7ff110b40800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed3205af0 0x55fed3205ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.936+0000 7ff110b40800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55fed30e3750 con 0x55fed3205af0 2024-09-12T17:27:59.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.936+0000 7ff10d0ee640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed3205af0 0x55fed3205ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.936+0000 7ff10d0ee640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed3205af0 0x55fed3205ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56728/0 (socket says 172.21.15.170:56728) 2024-09-12T17:27:59.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.936+0000 7ff10d0ee640 1 -- 172.21.15.170:0/3423782681 learned_addr learned my addr 172.21.15.170:0/3423782681 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:59.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.936+0000 7ff10d0ee640 1 -- 172.21.15.170:0/3423782681 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fed32064e0 con 0x55fed3205af0 2024-09-12T17:27:59.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.937+0000 7ff10d0ee640 1 --2- 172.21.15.170:0/3423782681 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed3205af0 0x55fed3205ef0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff108053d70 tx=0x7ff1080203a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d18726fbba07a042 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.937+0000 7fefe3fff640 1 -- 172.21.15.170:0/3423782681 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1080143c0 con 0x55fed3205af0 2024-09-12T17:27:59.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.937+0000 7fefe3fff640 1 -- 172.21.15.170:0/3423782681 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff108055050 con 0x55fed3205af0 2024-09-12T17:27:59.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.937+0000 7fefe3fff640 1 -- 172.21.15.170:0/3423782681 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff108021a40 con 0x55fed3205af0 2024-09-12T17:27:59.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.937+0000 7ff110b40800 1 -- 172.21.15.170:0/3423782681 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed3205af0 msgr2=0x55fed3205ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:27:59.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.937+0000 7ff110b40800 1 --2- 172.21.15.170:0/3423782681 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed3205af0 0x55fed3205ef0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff108053d70 tx=0x7ff1080203a0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.937+0000 7ff110b40800 1 -- 172.21.15.170:0/3423782681 shutdown_connections 2024-09-12T17:27:59.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.937+0000 7ff110b40800 1 --2- 172.21.15.170:0/3423782681 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed3205af0 0x55fed3205ef0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:27:59.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.937+0000 7ff110b40800 1 -- 172.21.15.170:0/3423782681 >> 172.21.15.170:0/3423782681 conn(0x55fed3201ef0 msgr2=0x55fed3200130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:27:59.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.937+0000 7ff110b40800 1 -- 172.21.15.170:0/3423782681 shutdown_connections 2024-09-12T17:27:59.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.937+0000 7ff110b40800 1 -- 172.21.15.170:0/3423782681 wait complete. 2024-09-12T17:27:59.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.937+0000 7ff110b40800 1 Processor -- start 2024-09-12T17:27:59.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.937+0000 7ff110b40800 1 -- start start 2024-09-12T17:27:59.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.938+0000 7ff110b40800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed3205af0 0x55fed320d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.938+0000 7ff110b40800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55fed3206b00 con 0x55fed3205af0 2024-09-12T17:27:59.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.938+0000 7ff10d0ee640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed3205af0 0x55fed320d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.938+0000 7ff10d0ee640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed3205af0 0x55fed320d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56732/0 (socket says 172.21.15.170:56732) 2024-09-12T17:27:59.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.938+0000 7ff10d0ee640 1 -- 172.21.15.170:0/1531358810 learned_addr learned my addr 172.21.15.170:0/1531358810 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:27:59.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.938+0000 7ff10d0ee640 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fed320d630 con 0x55fed3205af0 2024-09-12T17:27:59.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.938+0000 7ff10d0ee640 1 --2- 172.21.15.170:0/1531358810 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed3205af0 0x55fed320d0d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff1080203e0 tx=0x7ff108053d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.938+0000 7fefe27fc640 1 -- 172.21.15.170:0/1531358810 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff10801fbd0 con 0x55fed3205af0 2024-09-12T17:27:59.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.938+0000 7fefe27fc640 1 -- 172.21.15.170:0/1531358810 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1080143c0 con 0x55fed3205af0 2024-09-12T17:27:59.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.938+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fed320d8c0 con 0x55fed3205af0 2024-09-12T17:27:59.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.938+0000 7fefe27fc640 1 -- 172.21.15.170:0/1531358810 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff108021a40 con 0x55fed3205af0 2024-09-12T17:27:59.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.938+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fed320e450 con 0x55fed3205af0 2024-09-12T17:27:59.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.939+0000 7fefe27fc640 1 -- 172.21.15.170:0/1531358810 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ff10804d070 con 0x55fed3205af0 2024-09-12T17:27:59.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.939+0000 7fefe27fc640 1 --2- 172.21.15.170:0/1531358810 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fefd803c780 0x7fefd803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.939+0000 7fefe27fc640 1 -- 172.21.15.170:0/1531358810 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7ff10804a050 con 0x55fed3205af0 2024-09-12T17:27:59.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.940+0000 7ff10c8ed640 1 --2- 172.21.15.170:0/1531358810 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fefd803c780 0x7fefd803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.940+0000 7ff110b40800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.940+0000 7ff110b40800 1 --2- 172.21.15.170:0/1531358810 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55fed3218a10 0x55fed321aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.940+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed321b620 con 0x55fed3218a10 2024-09-12T17:27:59.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.940+0000 7ff10c8ed640 1 --2- 172.21.15.170:0/1531358810 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fefd803c780 0x7fefd803ec40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc05d670 tx=0x7ff0fc087000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.940+0000 7ff1040ec640 1 --2- 172.21.15.170:0/1531358810 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55fed3218a10 0x55fed321aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.940+0000 7ff1040ec640 1 --2- 172.21.15.170:0/1531358810 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55fed3218a10 0x55fed321aed0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.940+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0f4009050 con 0x55fed3218a10 2024-09-12T17:27:59.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.941+0000 7ff110b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.941+0000 7ff110b40800 20 realm 2024-09-12T17:27:59.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.941+0000 7ff110b40800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.941+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed3217d60 con 0x55fed3218a10 2024-09-12T17:27:59.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.941+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0f4009050 con 0x55fed3218a10 2024-09-12T17:27:59.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.941+0000 7ff110b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.941+0000 7ff110b40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:59.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.941+0000 7ff110b40800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.941+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed321c100 con 0x55fed3218a10 2024-09-12T17:27:59.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.941+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0f4009050 con 0x55fed3218a10 2024-09-12T17:27:59.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.941+0000 7ff110b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.941+0000 7ff110b40800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.941+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed321c9d0 con 0x55fed3218a10 2024-09-12T17:27:59.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.941+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff0f4009050 con 0x55fed3218a10 2024-09-12T17:27:59.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.941+0000 7ff110b40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:59.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.941+0000 7ff110b40800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.941+0000 7ff110b40800 1 --2- 172.21.15.170:0/1531358810 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55fed321d310 0x55fed321f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.941+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed321fe40 con 0x55fed321d310 2024-09-12T17:27:59.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.941+0000 7ff10d0ee640 1 --2- 172.21.15.170:0/1531358810 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55fed321d310 0x55fed321f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.942+0000 7ff10d0ee640 1 --2- 172.21.15.170:0/1531358810 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55fed321d310 0x55fed321f700 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.942+0000 7ff10d0ee640 1 -- 172.21.15.170:0/1531358810 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff108039020 con 0x55fed321d310 2024-09-12T17:27:59.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.942+0000 7ff110b40800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:27:59.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.942+0000 7ff110b40800 20 searching for the correct realm 2024-09-12T17:27:59.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.942+0000 7ff110b40800 1 --2- 172.21.15.170:0/1531358810 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55fed3221ec0 0x55fed3224380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.942+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed3224a50 con 0x55fed3221ec0 2024-09-12T17:27:59.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.942+0000 7ff10c8ed640 1 --2- 172.21.15.170:0/1531358810 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55fed3221ec0 0x55fed3224380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.942+0000 7ff10c8ed640 1 --2- 172.21.15.170:0/1531358810 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55fed3221ec0 0x55fed3224380 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.942+0000 7ff10c8ed640 1 -- 172.21.15.170:0/1531358810 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0fc051070 con 0x55fed3221ec0 2024-09-12T17:27:59.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.942+0000 7ff10c8ed640 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed3224a50 con 0x55fed321d310 2024-09-12T17:27:59.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.943+0000 7ff10d0ee640 1 -- 172.21.15.170:0/1531358810 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff108039020 con 0x55fed321d310 2024-09-12T17:27:59.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.943+0000 7ff10d0ee640 1 --2- 172.21.15.170:0/1531358810 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7ff1080329d0 0x7ff1080343f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:27:59.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.943+0000 7ff10d0ee640 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed3224a50 con 0x7ff1080329d0 2024-09-12T17:27:59.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.943+0000 7ff1040ec640 1 --2- 172.21.15.170:0/1531358810 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7ff1080329d0 0x7ff1080343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:27:59.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.943+0000 7ff1040ec640 1 --2- 172.21.15.170:0/1531358810 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7ff1080329d0 0x7ff1080343f0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:27:59.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.943+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f4009050 con 0x7ff1080329d0 2024-09-12T17:27:59.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.943+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed3224a50 con 0x55fed3218a10 2024-09-12T17:27:59.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.944+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f4009050 con 0x55fed3218a10 2024-09-12T17:27:59.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.944+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed3224a50 con 0x55fed3218a10 2024-09-12T17:27:59.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.944+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f4029040 con 0x55fed3218a10 2024-09-12T17:27:59.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.944+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed3224a50 con 0x7ff1080329d0 2024-09-12T17:27:59.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.944+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f4029040 con 0x7ff1080329d0 2024-09-12T17:27:59.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.944+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed3224a50 con 0x7ff1080329d0 2024-09-12T17:27:59.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.944+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f4029040 con 0x7ff1080329d0 2024-09-12T17:27:59.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.944+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed3224a50 con 0x55fed321d310 2024-09-12T17:27:59.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.945+0000 7ff10d0ee640 1 -- 172.21.15.170:0/1531358810 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff108039020 con 0x55fed321d310 2024-09-12T17:27:59.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.945+0000 7ff10d0ee640 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed3224a50 con 0x55fed3221ec0 2024-09-12T17:27:59.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.945+0000 7ff10c8ed640 1 -- 172.21.15.170:0/1531358810 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0fc051070 con 0x55fed3221ec0 2024-09-12T17:27:59.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.945+0000 7ff10c8ed640 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed3224a50 con 0x55fed3218a10 2024-09-12T17:27:59.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.945+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f4029040 con 0x55fed3218a10 2024-09-12T17:27:59.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.945+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed3224a50 con 0x7ff1080329d0 2024-09-12T17:27:59.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.945+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f4029040 con 0x7ff1080329d0 2024-09-12T17:27:59.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.945+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed3224a50 con 0x55fed3218a10 2024-09-12T17:27:59.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.946+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f4029040 con 0x55fed3218a10 2024-09-12T17:27:59.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.946+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed3224a50 con 0x55fed321d310 2024-09-12T17:27:59.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.946+0000 7ff10d0ee640 1 -- 172.21.15.170:0/1531358810 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7ff108039020 con 0x55fed321d310 2024-09-12T17:27:59.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.946+0000 7ff10d0ee640 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed3224a50 con 0x55fed3221ec0 2024-09-12T17:27:59.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.946+0000 7ff10c8ed640 1 -- 172.21.15.170:0/1531358810 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0fc051070 con 0x55fed3221ec0 2024-09-12T17:27:59.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.946+0000 7ff10c8ed640 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed3224a50 con 0x55fed3221ec0 2024-09-12T17:27:59.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.946+0000 7ff10c8ed640 1 -- 172.21.15.170:0/1531358810 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0fc051070 con 0x55fed3221ec0 2024-09-12T17:27:59.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.946+0000 7ff10c8ed640 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed3224a50 con 0x7ff1080329d0 2024-09-12T17:27:59.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.946+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f4029040 con 0x7ff1080329d0 2024-09-12T17:27:59.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.946+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed3224a50 con 0x55fed3221ec0 2024-09-12T17:27:59.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.947+0000 7ff10c8ed640 1 -- 172.21.15.170:0/1531358810 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0fc051070 con 0x55fed3221ec0 2024-09-12T17:27:59.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.947+0000 7ff10c8ed640 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed3224a50 con 0x55fed3221ec0 2024-09-12T17:27:59.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.947+0000 7ff10c8ed640 1 -- 172.21.15.170:0/1531358810 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0fc051070 con 0x55fed3221ec0 2024-09-12T17:27:59.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.947+0000 7ff10c8ed640 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed3224a50 con 0x55fed3218a10 2024-09-12T17:27:59.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.947+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f4029040 con 0x55fed3218a10 2024-09-12T17:27:59.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.947+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed3224a50 con 0x55fed3218a10 2024-09-12T17:27:59.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.947+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff0f4029040 con 0x55fed3218a10 2024-09-12T17:27:59.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.947+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed3224a50 con 0x7ff1080329d0 2024-09-12T17:27:59.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.948+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f4029040 con 0x7ff1080329d0 2024-09-12T17:27:59.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.948+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed3224a50 con 0x55fed3221ec0 2024-09-12T17:27:59.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.948+0000 7ff10c8ed640 1 -- 172.21.15.170:0/1531358810 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0fc051070 con 0x55fed3221ec0 2024-09-12T17:27:59.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.948+0000 7ff10c8ed640 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed3224a50 con 0x55fed321d310 2024-09-12T17:27:59.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.948+0000 7ff10d0ee640 1 -- 172.21.15.170:0/1531358810 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff108039020 con 0x55fed321d310 2024-09-12T17:27:59.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.948+0000 7ff10d0ee640 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed3224a50 con 0x55fed3218a10 2024-09-12T17:27:59.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.948+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f4029040 con 0x55fed3218a10 2024-09-12T17:27:59.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.948+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed3224a50 con 0x7ff1080329d0 2024-09-12T17:27:59.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.949+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f4029040 con 0x7ff1080329d0 2024-09-12T17:27:59.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.949+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed3224a50 con 0x55fed3221ec0 2024-09-12T17:27:59.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.949+0000 7ff10c8ed640 1 -- 172.21.15.170:0/1531358810 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0fc051070 con 0x55fed3221ec0 2024-09-12T17:27:59.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.949+0000 7ff10c8ed640 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed3224a50 con 0x7ff1080329d0 2024-09-12T17:27:59.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.949+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f4029040 con 0x7ff1080329d0 2024-09-12T17:27:59.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.949+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed3224a50 con 0x55fed321d310 2024-09-12T17:27:59.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.949+0000 7ff10d0ee640 1 -- 172.21.15.170:0/1531358810 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff108039020 con 0x55fed321d310 2024-09-12T17:27:59.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.949+0000 7ff10d0ee640 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed3224a50 con 0x55fed3221ec0 2024-09-12T17:27:59.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.950+0000 7ff10c8ed640 1 -- 172.21.15.170:0/1531358810 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0fc051070 con 0x55fed3221ec0 2024-09-12T17:27:59.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.950+0000 7ff10c8ed640 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed3224a50 con 0x7ff1080329d0 2024-09-12T17:27:59.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.950+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f4029040 con 0x7ff1080329d0 2024-09-12T17:27:59.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.950+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed3224a50 con 0x55fed3218a10 2024-09-12T17:27:59.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.950+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff0f4029040 con 0x55fed3218a10 2024-09-12T17:27:59.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.950+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fed3224a50 con 0x55fed321d310 2024-09-12T17:27:59.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.950+0000 7ff10d0ee640 1 -- 172.21.15.170:0/1531358810 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff108068040 con 0x55fed321d310 2024-09-12T17:27:59.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.950+0000 7ff110b40800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:27:59.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.950+0000 7ff110b40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:59.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.950+0000 7ff110b40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:59.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.950+0000 7ff110b40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:59.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.950+0000 7ff110b40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:59.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.950+0000 7ff110b40800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:27:59.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.950+0000 7ff110b40800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.950+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed32208c0 con 0x55fed3218a10 2024-09-12T17:27:59.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.951+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0f4029040 con 0x55fed3218a10 2024-09-12T17:27:59.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.951+0000 7ff110b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.951+0000 7ff110b40800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.951+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed3220d10 con 0x55fed3218a10 2024-09-12T17:27:59.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.951+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff0f4029040 con 0x55fed3218a10 2024-09-12T17:27:59.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.951+0000 7ff110b40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:59.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.951+0000 7ff110b40800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.951+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed32211f0 con 0x55fed321d310 2024-09-12T17:27:59.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.951+0000 7ff10d0ee640 1 -- 172.21.15.170:0/1531358810 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff108068040 con 0x55fed321d310 2024-09-12T17:27:59.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.951+0000 7ff110b40800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:27:59.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.951+0000 7ff110b40800 20 zone default found 2024-09-12T17:27:59.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.951+0000 7ff110b40800 4 Realm: () 2024-09-12T17:27:59.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.951+0000 7ff110b40800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:27:59.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.951+0000 7ff110b40800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:27:59.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.951+0000 7ff110b40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:59.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.951+0000 7ff110b40800 20 zonegroup default 2024-09-12T17:27:59.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.951+0000 7ff110b40800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.951+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed3220480 con 0x7ff1080329d0 2024-09-12T17:27:59.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.951+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff0f4029040 con 0x7ff1080329d0 2024-09-12T17:27:59.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.951+0000 7ff110b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.951+0000 7ff110b40800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.951+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed3227160 con 0x55fed3221ec0 2024-09-12T17:27:59.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.952+0000 7ff10c8ed640 1 -- 172.21.15.170:0/1531358810 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff0fc051070 con 0x55fed3221ec0 2024-09-12T17:27:59.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.952+0000 7ff110b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.952+0000 7ff110b40800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.952+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed32275d0 con 0x55fed3221ec0 2024-09-12T17:27:59.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.952+0000 7ff10c8ed640 1 -- 172.21.15.170:0/1531358810 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff0fc051070 con 0x55fed3221ec0 2024-09-12T17:27:59.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.952+0000 7ff110b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:59.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.952+0000 7ff110b40800 20 started sync module instance, tier type = 2024-09-12T17:27:59.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.952+0000 7ff110b40800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:27:59.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.952+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed3225f60 con 0x55fed321d310 2024-09-12T17:27:59.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.953+0000 7ff10d0ee640 1 -- 172.21.15.170:0/1531358810 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff108068040 con 0x55fed321d310 2024-09-12T17:27:59.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.953+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94552952300368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed3225bc0 con 0x55fed321d310 2024-09-12T17:27:59.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.953+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed32284e0 con 0x55fed3218a10 2024-09-12T17:27:59.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.954+0000 7ff10d0ee640 1 -- 172.21.15.170:0/1531358810 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94552952300368] v29'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff108068040 con 0x55fed321d310 2024-09-12T17:27:59.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.954+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f4029040 con 0x55fed3218a10 2024-09-12T17:27:59.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.954+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94552952306192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed32284e0 con 0x55fed3218a10 2024-09-12T17:27:59.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.954+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed3228f50 con 0x55fed3221ec0 2024-09-12T17:27:59.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.955+0000 7ff10c8ed640 1 -- 172.21.15.170:0/1531358810 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0fc051070 con 0x55fed3221ec0 2024-09-12T17:27:59.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.955+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94552952310336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed32297f0 con 0x55fed3221ec0 2024-09-12T17:27:59.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.955+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed322a2f0 con 0x55fed321d310 2024-09-12T17:27:59.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.955+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94552952306192] v29'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f4029040 con 0x55fed3218a10 2024-09-12T17:27:59.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.956+0000 7ff10c8ed640 1 -- 172.21.15.170:0/1531358810 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94552952310336] v29'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0fc051070 con 0x55fed3221ec0 2024-09-12T17:27:59.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.956+0000 7ff10d0ee640 1 -- 172.21.15.170:0/1531358810 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff108068040 con 0x55fed321d310 2024-09-12T17:27:59.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.956+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94552952315360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed3229340 con 0x55fed321d310 2024-09-12T17:27:59.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.956+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed322ab90 con 0x55fed3218a10 2024-09-12T17:27:59.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.957+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f4029040 con 0x55fed3218a10 2024-09-12T17:27:59.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.958+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94552952317664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed322afb0 con 0x55fed3218a10 2024-09-12T17:27:59.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.958+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed322b800 con 0x7ff1080329d0 2024-09-12T17:27:59.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.958+0000 7ff10d0ee640 1 -- 172.21.15.170:0/1531358810 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94552952315360] v29'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff108068040 con 0x55fed321d310 2024-09-12T17:27:59.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.958+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f4029040 con 0x7ff1080329d0 2024-09-12T17:27:59.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.959+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94552952317664] v29'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f4029040 con 0x55fed3218a10 2024-09-12T17:27:59.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.959+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94552952319920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed322bbf0 con 0x7ff1080329d0 2024-09-12T17:27:59.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.959+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed322ab00 con 0x7ff1080329d0 2024-09-12T17:27:59.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.959+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v29'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f4029040 con 0x7ff1080329d0 2024-09-12T17:27:59.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.959+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94552952318720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed322c0e0 con 0x7ff1080329d0 2024-09-12T17:27:59.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.959+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed322cbd0 con 0x7ff1080329d0 2024-09-12T17:27:59.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.960+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94552952319920] v29'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f4029040 con 0x7ff1080329d0 2024-09-12T17:27:59.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.960+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94552952318720] v29'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f4029040 con 0x7ff1080329d0 2024-09-12T17:27:59.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.960+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(58 notify.7 [create] v29'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f4029040 con 0x7ff1080329d0 2024-09-12T17:27:59.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.960+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94552952325792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed322bba0 con 0x7ff1080329d0 2024-09-12T17:27:59.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.960+0000 7ff110b40800 20 add_watcher() i=0 2024-09-12T17:27:59.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.960+0000 7ff110b40800 20 add_watcher() i=1 2024-09-12T17:27:59.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.960+0000 7ff110b40800 20 add_watcher() i=2 2024-09-12T17:27:59.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.960+0000 7ff110b40800 20 add_watcher() i=3 2024-09-12T17:27:59.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.960+0000 7ff110b40800 20 add_watcher() i=4 2024-09-12T17:27:59.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.960+0000 7ff110b40800 20 add_watcher() i=5 2024-09-12T17:27:59.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.960+0000 7ff110b40800 20 add_watcher() i=6 2024-09-12T17:27:59.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.961+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94552952325792] v29'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f4029040 con 0x7ff1080329d0 2024-09-12T17:27:59.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.961+0000 7ff110b40800 20 add_watcher() i=7 2024-09-12T17:27:59.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.961+0000 7ff110b40800 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:59.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.961+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed322fbc0 con 0x55fed3218a10 2024-09-12T17:27:59.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.962+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff0f4029040 con 0x55fed3218a10 2024-09-12T17:27:59.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.962+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94552952320976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed322d040 con 0x55fed3218a10 2024-09-12T17:27:59.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.963+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94552952320976] v29'58 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff0f4029040 con 0x55fed3218a10 2024-09-12T17:27:59.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.963+0000 7fefc37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:59.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.963+0000 7ff110b40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:59.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.963+0000 7ff110b40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:59.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.963+0000 7ff110b40800 5 note: GC not initialized 2024-09-12T17:27:59.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.963+0000 7fefc27e4640 20 reqs_thread_entry: start 2024-09-12T17:27:59.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.963+0000 7ff110b40800 20 init_complete bucket index max shards: 11 2024-09-12T17:27:59.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.963+0000 7ff110b40800 20 Filter name: none 2024-09-12T17:27:59.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.963+0000 7fefbb7fe640 20 reqs_thread_entry: start 2024-09-12T17:27:59.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.964+0000 7ff110b40800 20 rados->read ofs=0 len=0 2024-09-12T17:27:59.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.964+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fed3262630 con 0x55fed3218a10 2024-09-12T17:27:59.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.964+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff0f4029040 con 0x55fed3218a10 2024-09-12T17:27:59.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.964+0000 7ff110b40800 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:27:59.992 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T17:27:59.362376Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:27:59.362351Z","tags":[],"group_ids":[]} 2024-09-12T17:27:59.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.965+0000 7fefc37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:59.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.965+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94552952320976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed32614c0 con 0x55fed3218a10 2024-09-12T17:27:59.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.966+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94552952320976] v29'59 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff0f4029040 con 0x55fed3218a10 2024-09-12T17:27:59.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.966+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94552952300368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed322b3d0 con 0x55fed321d310 2024-09-12T17:27:59.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.967+0000 7ff10d0ee640 1 -- 172.21.15.170:0/1531358810 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94552952300368] v29'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff108068040 con 0x55fed321d310 2024-09-12T17:27:59.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.967+0000 7ff110b40800 20 remove_watcher() i=0 2024-09-12T17:27:59.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.967+0000 7ff110b40800 2 removed watcher, disabling cache 2024-09-12T17:27:59.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.967+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94552952306192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed3226350 con 0x55fed3218a10 2024-09-12T17:27:59.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.968+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94552952306192] v29'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f4029040 con 0x55fed3218a10 2024-09-12T17:27:59.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.968+0000 7ff110b40800 20 remove_watcher() i=1 2024-09-12T17:27:59.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.968+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94552952310336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed3226350 con 0x55fed3221ec0 2024-09-12T17:27:59.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.969+0000 7ff10c8ed640 1 -- 172.21.15.170:0/1531358810 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94552952310336] v29'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0fc051070 con 0x55fed3221ec0 2024-09-12T17:27:59.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.969+0000 7ff110b40800 20 remove_watcher() i=2 2024-09-12T17:27:59.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.969+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94552952315360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed3226350 con 0x55fed321d310 2024-09-12T17:27:59.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.970+0000 7ff10d0ee640 1 -- 172.21.15.170:0/1531358810 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94552952315360] v29'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff108068040 con 0x55fed321d310 2024-09-12T17:27:59.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.970+0000 7ff110b40800 20 remove_watcher() i=3 2024-09-12T17:27:59.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.970+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94552952317664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed3229de0 con 0x55fed3218a10 2024-09-12T17:27:59.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.971+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94552952317664] v29'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f4029040 con 0x55fed3218a10 2024-09-12T17:27:59.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.971+0000 7ff110b40800 20 remove_watcher() i=4 2024-09-12T17:27:59.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.971+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94552952319920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed3226350 con 0x7ff1080329d0 2024-09-12T17:27:59.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.972+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94552952319920] v29'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f4029040 con 0x7ff1080329d0 2024-09-12T17:27:59.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.972+0000 7ff110b40800 20 remove_watcher() i=5 2024-09-12T17:27:59.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.972+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94552952318720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed322b430 con 0x7ff1080329d0 2024-09-12T17:27:59.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.973+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94552952318720] v29'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f4029040 con 0x7ff1080329d0 2024-09-12T17:28:00.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.973+0000 7ff110b40800 20 remove_watcher() i=6 2024-09-12T17:28:00.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.973+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94552952325792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fed3226350 con 0x7ff1080329d0 2024-09-12T17:28:00.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.974+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94552952325792] v29'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f4029040 con 0x7ff1080329d0 2024-09-12T17:28:00.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.974+0000 7ff110b40800 20 remove_watcher() i=7 2024-09-12T17:28:00.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.974+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7ff1080329d0 msgr2=0x7ff1080343f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.974+0000 7ff110b40800 1 --2- 172.21.15.170:0/1531358810 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7ff1080329d0 0x7ff1080343f0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.974+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55fed3218a10 msgr2=0x55fed321aed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.974+0000 7ff110b40800 1 --2- 172.21.15.170:0/1531358810 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55fed3218a10 0x55fed321aed0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.974+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55fed321d310 msgr2=0x55fed321f700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.974+0000 7ff110b40800 1 --2- 172.21.15.170:0/1531358810 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55fed321d310 0x55fed321f700 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.974+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55fed3221ec0 msgr2=0x55fed3224380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.974+0000 7ff110b40800 1 --2- 172.21.15.170:0/1531358810 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55fed3221ec0 0x55fed3224380 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.974+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fefd803c780 msgr2=0x7fefd803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.974+0000 7ff110b40800 1 --2- 172.21.15.170:0/1531358810 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fefd803c780 0x7fefd803ec40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc05d670 tx=0x7ff0fc087000 comp rx=0 tx=0).stop 2024-09-12T17:28:00.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.974+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed3205af0 msgr2=0x55fed320d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.974+0000 7ff110b40800 1 --2- 172.21.15.170:0/1531358810 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed3205af0 0x55fed320d0d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff1080203e0 tx=0x7ff108053d00 comp rx=0 tx=0).stop 2024-09-12T17:28:00.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.974+0000 7ff1040ec640 1 -- 172.21.15.170:0/1531358810 reap_dead start 2024-09-12T17:28:00.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.974+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 shutdown_connections 2024-09-12T17:28:00.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.974+0000 7ff110b40800 1 --2- 172.21.15.170:0/1531358810 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed3205af0 0x55fed320d0d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.974+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 >> 172.21.15.170:0/1531358810 conn(0x55fed3201ef0 msgr2=0x55fed3200100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:00.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.974+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 shutdown_connections 2024-09-12T17:28:00.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.974+0000 7ff110b40800 1 -- 172.21.15.170:0/1531358810 wait complete. 2024-09-12T17:28:00.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.974+0000 7ff110b40800 1 -- 172.21.15.170:0/2349792643 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fefe403c730 msgr2=0x7fefe403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.974+0000 7ff110b40800 1 --2- 172.21.15.170:0/2349792643 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fefe403c730 0x7fefe403ebf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x55fed31e0280 tx=0x7ff0fc05d5c0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.974+0000 7ff110b40800 1 -- 172.21.15.170:0/2349792643 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed31f9030 msgr2=0x55fed31f9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.974+0000 7ff110b40800 1 --2- 172.21.15.170:0/2349792643 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed31f9030 0x55fed31f9450 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x55fed31df180 tx=0x7ff1080167b0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.974+0000 7ff110b40800 1 -- 172.21.15.170:0/2349792643 shutdown_connections 2024-09-12T17:28:00.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.974+0000 7ff110b40800 1 --2- 172.21.15.170:0/2349792643 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fefe403c730 0x7fefe403ebf0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.974+0000 7ff110b40800 1 --2- 172.21.15.170:0/2349792643 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed31f9030 0x55fed31f9450 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.974+0000 7ff110b40800 1 -- 172.21.15.170:0/2349792643 >> 172.21.15.170:0/2349792643 conn(0x55fed31ed3e0 msgr2=0x55fed31ed7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:00.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.975+0000 7ff110b40800 1 -- 172.21.15.170:0/2349792643 shutdown_connections 2024-09-12T17:28:00.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.975+0000 7ff110b40800 1 -- 172.21.15.170:0/2349792643 wait complete. 2024-09-12T17:28:00.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.975+0000 7ff110b40800 1 -- 172.21.15.170:0/98056428 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55fed30e8030 msgr2=0x55fed31e57d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.975+0000 7ff110b40800 1 --2- 172.21.15.170:0/98056428 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55fed30e8030 0x55fed31e57d0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.975+0000 7ff110b40800 1 -- 172.21.15.170:0/98056428 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55fed31e7b70 msgr2=0x55fed31ea010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.975+0000 7ff110b40800 1 --2- 172.21.15.170:0/98056428 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55fed31e7b70 0x55fed31ea010 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.975+0000 7ff110b40800 1 -- 172.21.15.170:0/98056428 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7feff403c730 msgr2=0x7feff403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.975+0000 7ff110b40800 1 --2- 172.21.15.170:0/98056428 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7feff403c730 0x7feff403ebf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff0f4001d70 tx=0x7ff0f40012d0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.975+0000 7ff110b40800 1 -- 172.21.15.170:0/98056428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed30e5700 msgr2=0x55fed31de180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.975+0000 7ff110b40800 1 --2- 172.21.15.170:0/98056428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed30e5700 0x55fed31de180 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc025c20 tx=0x7ff0fc002fb0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.975+0000 7ff110b40800 1 -- 172.21.15.170:0/98056428 shutdown_connections 2024-09-12T17:28:00.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.975+0000 7ff110b40800 1 --2- 172.21.15.170:0/98056428 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55fed31e7b70 0x55fed31ea010 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.975+0000 7ff110b40800 1 --2- 172.21.15.170:0/98056428 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7feff403c730 0x7feff403ebf0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.975+0000 7ff110b40800 1 --2- 172.21.15.170:0/98056428 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55fed30e8030 0x55fed31e57d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.975+0000 7ff110b40800 1 --2- 172.21.15.170:0/98056428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fed30e5700 0x55fed31de180 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.975+0000 7ff110b40800 1 -- 172.21.15.170:0/98056428 >> 172.21.15.170:0/98056428 conn(0x55fed30df1c0 msgr2=0x55fed31cfb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:00.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.975+0000 7ff110b40800 1 -- 172.21.15.170:0/98056428 shutdown_connections 2024-09-12T17:28:00.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:27:59.975+0000 7ff110b40800 1 -- 172.21.15.170:0/98056428 wait complete. 2024-09-12T17:28:00.003 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T17:27:59.362376Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:27:59.362351Z', 'tags': [], 'group_ids': []} 2024-09-12T17:28:00.004 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-12T17:28:00.004 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-12T17:28:00.004 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-12T17:28:00.048 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:00.049 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:00.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.048+0000 7faf6512c800 1 Processor -- start 2024-09-12T17:28:00.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.048+0000 7faf6512c800 1 -- start start 2024-09-12T17:28:00.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.048+0000 7faf6512c800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x555e1b7d8600 0x555e1b7da9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.048+0000 7faf6512c800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555e1b681e40 con 0x555e1b7db020 2024-09-12T17:28:00.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.048+0000 7faf6512c800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x555e1b64c680 con 0x555e1b7d8600 2024-09-12T17:28:00.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.048+0000 7faf60d3e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x555e1b7d8600 0x555e1b7da9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.048+0000 7faf5bfff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x555e1b7db020 0x555e1b7dd4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:48288/0 (socket says 172.21.15.170:48288) 2024-09-12T17:28:00.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.048+0000 7faf5bfff640 1 -- 172.21.15.170:0/2765343069 learned_addr learned my addr 172.21.15.170:0/2765343069 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:28:00.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.049+0000 7faf60d3e640 1 -- 172.21.15.170:0/2765343069 >> v1:172.21.15.47:6789/0 conn(0x555e1b7db020 legacy=0x555e1b7dd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.049+0000 7faf5b7fe640 1 -- 172.21.15.170:0/2765343069 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3093653115 0 0) 0x555e1b681e40 con 0x555e1b7db020 2024-09-12T17:28:00.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.049+0000 7faf60d3e640 1 -- 172.21.15.170:0/2765343069 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e1b6686b0 con 0x555e1b7d8600 2024-09-12T17:28:00.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.050+0000 7faf60d3e640 1 --2- 172.21.15.170:0/2765343069 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555e1b7d8600 0x555e1b7da9f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7faf5400a470 tx=0x7faf54045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b943769d13356b9b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.051+0000 7faf5b7fe640 1 -- 172.21.15.170:0/2765343069 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf54053570 con 0x555e1b7d8600 2024-09-12T17:28:00.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.051+0000 7faf5b7fe640 1 -- 172.21.15.170:0/2765343069 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf54058070 con 0x555e1b7d8600 2024-09-12T17:28:00.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.051+0000 7faf5b7fe640 1 -- 172.21.15.170:0/2765343069 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf54053880 con 0x555e1b7d8600 2024-09-12T17:28:00.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.051+0000 7faf6512c800 1 -- 172.21.15.170:0/2765343069 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555e1b7d8600 msgr2=0x555e1b7da9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.051+0000 7faf6512c800 1 --2- 172.21.15.170:0/2765343069 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555e1b7d8600 0x555e1b7da9f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7faf5400a470 tx=0x7faf54045a20 comp rx=0 tx=0).stop 2024-09-12T17:28:00.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.051+0000 7faf6512c800 1 -- 172.21.15.170:0/2765343069 shutdown_connections 2024-09-12T17:28:00.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.051+0000 7faf6512c800 1 --2- 172.21.15.170:0/2765343069 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555e1b7d8600 0x555e1b7da9f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.051+0000 7faf6512c800 1 -- 172.21.15.170:0/2765343069 >> 172.21.15.170:0/2765343069 conn(0x555e1b7d21c0 msgr2=0x555e1b7d4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:00.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.051+0000 7faf6512c800 1 -- 172.21.15.170:0/2765343069 shutdown_connections 2024-09-12T17:28:00.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.051+0000 7faf6512c800 1 -- 172.21.15.170:0/2765343069 wait complete. 2024-09-12T17:28:00.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.065+0000 7faf6512c800 1 Processor -- start 2024-09-12T17:28:00.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.065+0000 7faf6512c800 1 -- start start 2024-09-12T17:28:00.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.065+0000 7faf6512c800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555e1b7d8600 0x555e1b8c7470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.065+0000 7faf6512c800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555e1b670dd0 con 0x555e1b7d8600 2024-09-12T17:28:00.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.066+0000 7faf60d3e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555e1b7d8600 0x555e1b8c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.066+0000 7faf60d3e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555e1b7d8600 0x555e1b8c7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56744/0 (socket says 172.21.15.170:56744) 2024-09-12T17:28:00.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.066+0000 7faf60d3e640 1 -- 172.21.15.170:0/2261455955 learned_addr learned my addr 172.21.15.170:0/2261455955 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:00.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.066+0000 7faf60d3e640 1 -- 172.21.15.170:0/2261455955 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e1b689e10 con 0x555e1b7d8600 2024-09-12T17:28:00.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.066+0000 7faf60d3e640 1 --2- 172.21.15.170:0/2261455955 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555e1b7d8600 0x555e1b8c7470 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7faf5400a470 tx=0x7faf54051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc107585c8e95f6d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.066+0000 7fae4ee05640 1 -- 172.21.15.170:0/2261455955 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf54053570 con 0x555e1b7d8600 2024-09-12T17:28:00.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.066+0000 7fae4ee05640 1 -- 172.21.15.170:0/2261455955 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf54063030 con 0x555e1b7d8600 2024-09-12T17:28:00.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.066+0000 7fae4ee05640 1 -- 172.21.15.170:0/2261455955 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf54053840 con 0x555e1b7d8600 2024-09-12T17:28:00.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.067+0000 7faf6512c800 1 -- 172.21.15.170:0/2261455955 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555e1b7d8600 msgr2=0x555e1b8c7470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.067+0000 7faf6512c800 1 --2- 172.21.15.170:0/2261455955 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555e1b7d8600 0x555e1b8c7470 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7faf5400a470 tx=0x7faf54051000 comp rx=0 tx=0).stop 2024-09-12T17:28:00.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.067+0000 7faf6512c800 1 -- 172.21.15.170:0/2261455955 shutdown_connections 2024-09-12T17:28:00.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.067+0000 7faf6512c800 1 --2- 172.21.15.170:0/2261455955 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555e1b7d8600 0x555e1b8c7470 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.067+0000 7faf6512c800 1 -- 172.21.15.170:0/2261455955 >> 172.21.15.170:0/2261455955 conn(0x555e1b7d21c0 msgr2=0x555e1b8c2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:00.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.067+0000 7faf6512c800 1 -- 172.21.15.170:0/2261455955 shutdown_connections 2024-09-12T17:28:00.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.067+0000 7faf6512c800 1 -- 172.21.15.170:0/2261455955 wait complete. 2024-09-12T17:28:00.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.068+0000 7faf6512c800 1 Processor -- start 2024-09-12T17:28:00.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.068+0000 7faf6512c800 1 -- start start 2024-09-12T17:28:00.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.068+0000 7faf6512c800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555e1b7d8600 0x555e1b7d7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.068+0000 7faf6512c800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555e1b7df040 con 0x555e1b7d8600 2024-09-12T17:28:00.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.068+0000 7faf60d3e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555e1b7d8600 0x555e1b7d7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.068+0000 7faf60d3e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555e1b7d8600 0x555e1b7d7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56752/0 (socket says 172.21.15.170:56752) 2024-09-12T17:28:00.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.068+0000 7faf60d3e640 1 -- 172.21.15.170:0/2894389969 learned_addr learned my addr 172.21.15.170:0/2894389969 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:00.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.068+0000 7faf60d3e640 1 -- 172.21.15.170:0/2894389969 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e1b7d8280 con 0x555e1b7d8600 2024-09-12T17:28:00.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.068+0000 7faf60d3e640 1 --2- 172.21.15.170:0/2894389969 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555e1b7d8600 0x555e1b7d7d20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7faf5400a470 tx=0x7faf54002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.069+0000 7fae4d602640 1 -- 172.21.15.170:0/2894389969 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf54078070 con 0x555e1b7d8600 2024-09-12T17:28:00.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.069+0000 7fae4d602640 1 -- 172.21.15.170:0/2894389969 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf54068420 con 0x555e1b7d8600 2024-09-12T17:28:00.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.069+0000 7faf6512c800 1 -- 172.21.15.170:0/2894389969 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555e1b7d6630 con 0x555e1b7d8600 2024-09-12T17:28:00.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.069+0000 7fae4d602640 1 -- 172.21.15.170:0/2894389969 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf54068700 con 0x555e1b7d8600 2024-09-12T17:28:00.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.069+0000 7faf6512c800 1 -- 172.21.15.170:0/2894389969 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e1b7d6c50 con 0x555e1b7d8600 2024-09-12T17:28:00.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.069+0000 7fae4d602640 1 -- 172.21.15.170:0/2894389969 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7faf5407b070 con 0x555e1b7d8600 2024-09-12T17:28:00.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.070+0000 7fae4d602640 1 --2- 172.21.15.170:0/2894389969 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fae4803c780 0x7fae4803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.070+0000 7fae4d602640 1 -- 172.21.15.170:0/2894389969 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7faf54097700 con 0x555e1b7d8600 2024-09-12T17:28:00.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.070+0000 7faf5bfff640 1 --2- 172.21.15.170:0/2894389969 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fae4803c780 0x7fae4803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.070+0000 7faf6512c800 1 --2- 172.21.15.170:0/2894389969 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x555e1b7db020 0x555e1b8d8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.070+0000 7faf6512c800 1 -- 172.21.15.170:0/2894389969 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555e1b8d8790 con 0x555e1b7db020 2024-09-12T17:28:00.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.070+0000 7faf6153f640 1 --2- 172.21.15.170:0/2894389969 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x555e1b7db020 0x555e1b8d8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.070+0000 7faf5bfff640 1 --2- 172.21.15.170:0/2894389969 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fae4803c780 0x7fae4803ec40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faf4c000c00 tx=0x7faf4c0013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.070+0000 7faf6153f640 1 --2- 172.21.15.170:0/2894389969 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x555e1b7db020 0x555e1b8d8250 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.071+0000 7faf6153f640 1 -- 172.21.15.170:0/2894389969 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf5c00a4d0 con 0x555e1b7db020 2024-09-12T17:28:00.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.071+0000 7faf6512c800 1 -- 172.21.15.170:0/2894389969 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555e1b7d7130 con 0x555e1b7db020 2024-09-12T17:28:00.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.071+0000 7faf6153f640 1 -- 172.21.15.170:0/2894389969 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faf5c00a4d0 con 0x555e1b7db020 2024-09-12T17:28:00.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.071+0000 7faf6512c800 1 --2- 172.21.15.170:0/2894389969 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x555e1b8daa80 0x555e1b8dce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.071+0000 7faf6512c800 1 -- 172.21.15.170:0/2894389969 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555e1b8dd540 con 0x555e1b8daa80 2024-09-12T17:28:00.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.071+0000 7faf60d3e640 1 --2- 172.21.15.170:0/2894389969 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x555e1b8daa80 0x555e1b8dce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.071+0000 7faf60d3e640 1 --2- 172.21.15.170:0/2894389969 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x555e1b8daa80 0x555e1b8dce70 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.072+0000 7faf60d3e640 1 -- 172.21.15.170:0/2894389969 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7faf5407a030 con 0x555e1b8daa80 2024-09-12T17:28:00.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.072+0000 7faf6512c800 1 -- 172.21.15.170:0/2894389969 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555e1b8d9860 con 0x555e1b7db020 2024-09-12T17:28:00.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.072+0000 7faf6153f640 1 -- 172.21.15.170:0/2894389969 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faf5c00a4d0 con 0x555e1b7db020 2024-09-12T17:28:00.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.072+0000 7faf6512c800 1 -- 172.21.15.170:0/2894389969 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555e1b8d9d00 con 0x555e1b8daa80 2024-09-12T17:28:00.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.072+0000 7faf60d3e640 1 -- 172.21.15.170:0/2894389969 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7faf5407a030 con 0x555e1b8daa80 2024-09-12T17:28:00.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.072+0000 7faf6512c800 1 Processor -- start 2024-09-12T17:28:00.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.073+0000 7faf6512c800 1 -- start start 2024-09-12T17:28:00.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.073+0000 7faf6512c800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555e1b8ebd10 0x555e1b8ec130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.073+0000 7faf6512c800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555e1b6cea00 con 0x555e1b8ebd10 2024-09-12T17:28:00.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.073+0000 7faf6153f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555e1b8ebd10 0x555e1b8ec130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.073+0000 7faf6153f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555e1b8ebd10 0x555e1b8ec130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56760/0 (socket says 172.21.15.170:56760) 2024-09-12T17:28:00.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.073+0000 7faf6153f640 1 -- 172.21.15.170:0/1755570606 learned_addr learned my addr 172.21.15.170:0/1755570606 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:00.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.073+0000 7faf6153f640 1 -- 172.21.15.170:0/1755570606 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e1b8ec770 con 0x555e1b8ebd10 2024-09-12T17:28:00.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.073+0000 7faf6153f640 1 --2- 172.21.15.170:0/1755570606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555e1b8ebd10 0x555e1b8ec130 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x555e1b7d78c0 tx=0x7faf5c0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.073+0000 7fae467fc640 1 -- 172.21.15.170:0/1755570606 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf5c013640 con 0x555e1b8ebd10 2024-09-12T17:28:00.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.074+0000 7fae467fc640 1 -- 172.21.15.170:0/1755570606 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf5c0137e0 con 0x555e1b8ebd10 2024-09-12T17:28:00.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.074+0000 7faf6512c800 1 -- 172.21.15.170:0/1755570606 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555e1b8ecfa0 con 0x555e1b8ebd10 2024-09-12T17:28:00.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.074+0000 7fae467fc640 1 -- 172.21.15.170:0/1755570606 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf5c013ac0 con 0x555e1b8ebd10 2024-09-12T17:28:00.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.074+0000 7faf6512c800 1 -- 172.21.15.170:0/1755570606 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e1b8ed540 con 0x555e1b8ebd10 2024-09-12T17:28:00.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.074+0000 7fae467fc640 1 -- 172.21.15.170:0/1755570606 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7faf5c011040 con 0x555e1b8ebd10 2024-09-12T17:28:00.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.075+0000 7fae467fc640 1 --2- 172.21.15.170:0/1755570606 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fae3803c730 0x7fae3803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.075+0000 7fae467fc640 1 -- 172.21.15.170:0/1755570606 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7faf5c00e040 con 0x555e1b8ebd10 2024-09-12T17:28:00.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.075+0000 7faf60d3e640 1 --2- 172.21.15.170:0/1755570606 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fae3803c730 0x7fae3803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.075+0000 7faf6512c800 1 Processor -- start 2024-09-12T17:28:00.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.075+0000 7faf60d3e640 1 --2- 172.21.15.170:0/1755570606 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fae3803c730 0x7fae3803ebf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x555e1b8d8c20 tx=0x7faf540872b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.075+0000 7faf6512c800 1 -- start start 2024-09-12T17:28:00.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.075+0000 7faf6512c800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555e1b8f87d0 0x555e1b8f8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.075+0000 7faf6512c800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555e1b8c7c60 con 0x555e1b8f87d0 2024-09-12T17:28:00.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.075+0000 7faf6153f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555e1b8f87d0 0x555e1b8f8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.075+0000 7faf6153f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555e1b8f87d0 0x555e1b8f8bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56766/0 (socket says 172.21.15.170:56766) 2024-09-12T17:28:00.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.075+0000 7faf6153f640 1 -- 172.21.15.170:0/4019121070 learned_addr learned my addr 172.21.15.170:0/4019121070 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:00.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.076+0000 7faf6153f640 1 -- 172.21.15.170:0/4019121070 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e1b8f91c0 con 0x555e1b8f87d0 2024-09-12T17:28:00.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.076+0000 7faf6153f640 1 --2- 172.21.15.170:0/4019121070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555e1b8f87d0 0x555e1b8f8bd0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faf5c020000 tx=0x7faf5c0204d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeea673a02984bf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.076+0000 7fae37fff640 1 -- 172.21.15.170:0/4019121070 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf5c052070 con 0x555e1b8f87d0 2024-09-12T17:28:00.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.076+0000 7fae37fff640 1 -- 172.21.15.170:0/4019121070 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf5c04a020 con 0x555e1b8f87d0 2024-09-12T17:28:00.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.076+0000 7fae37fff640 1 -- 172.21.15.170:0/4019121070 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf5c021440 con 0x555e1b8f87d0 2024-09-12T17:28:00.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.076+0000 7faf6512c800 1 -- 172.21.15.170:0/4019121070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555e1b8f87d0 msgr2=0x555e1b8f8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.076+0000 7faf6512c800 1 --2- 172.21.15.170:0/4019121070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555e1b8f87d0 0x555e1b8f8bd0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faf5c020000 tx=0x7faf5c0204d0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.076+0000 7faf6512c800 1 -- 172.21.15.170:0/4019121070 shutdown_connections 2024-09-12T17:28:00.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.076+0000 7faf6512c800 1 --2- 172.21.15.170:0/4019121070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555e1b8f87d0 0x555e1b8f8bd0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.076+0000 7faf6512c800 1 -- 172.21.15.170:0/4019121070 >> 172.21.15.170:0/4019121070 conn(0x555e1b8f4bd0 msgr2=0x555e1b8f2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:00.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.076+0000 7faf6512c800 1 -- 172.21.15.170:0/4019121070 shutdown_connections 2024-09-12T17:28:00.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.076+0000 7faf6512c800 1 -- 172.21.15.170:0/4019121070 wait complete. 2024-09-12T17:28:00.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.077+0000 7faf6512c800 1 Processor -- start 2024-09-12T17:28:00.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.077+0000 7faf6512c800 1 -- start start 2024-09-12T17:28:00.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.077+0000 7faf6512c800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555e1b8f87d0 0x555e1b8ffde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.077+0000 7faf6512c800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555e1b8f97e0 con 0x555e1b8f87d0 2024-09-12T17:28:00.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.077+0000 7faf6153f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555e1b8f87d0 0x555e1b8ffde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.077+0000 7faf6153f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555e1b8f87d0 0x555e1b8ffde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56774/0 (socket says 172.21.15.170:56774) 2024-09-12T17:28:00.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.077+0000 7faf6153f640 1 -- 172.21.15.170:0/2133211729 learned_addr learned my addr 172.21.15.170:0/2133211729 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:00.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.078+0000 7faf6153f640 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e1b900340 con 0x555e1b8f87d0 2024-09-12T17:28:00.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.078+0000 7faf6153f640 1 --2- 172.21.15.170:0/2133211729 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555e1b8f87d0 0x555e1b8ffde0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7faf5c053cd0 tx=0x7faf5c053d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.078+0000 7fae367fc640 1 -- 172.21.15.170:0/2133211729 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf5c038070 con 0x555e1b8f87d0 2024-09-12T17:28:00.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.078+0000 7fae367fc640 1 -- 172.21.15.170:0/2133211729 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf5c01f500 con 0x555e1b8f87d0 2024-09-12T17:28:00.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.078+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555e1b9005d0 con 0x555e1b8f87d0 2024-09-12T17:28:00.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.078+0000 7fae367fc640 1 -- 172.21.15.170:0/2133211729 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf5c01f7e0 con 0x555e1b8f87d0 2024-09-12T17:28:00.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.078+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e1b900f50 con 0x555e1b8f87d0 2024-09-12T17:28:00.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.079+0000 7fae367fc640 1 -- 172.21.15.170:0/2133211729 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7faf5c03b070 con 0x555e1b8f87d0 2024-09-12T17:28:00.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.079+0000 7fae367fc640 1 --2- 172.21.15.170:0/2133211729 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fae2c03c730 0x7fae2c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.079+0000 7fae367fc640 1 -- 172.21.15.170:0/2133211729 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7faf5c04b070 con 0x555e1b8f87d0 2024-09-12T17:28:00.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.079+0000 7faf60d3e640 1 --2- 172.21.15.170:0/2133211729 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fae2c03c730 0x7fae2c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.080+0000 7faf60d3e640 1 --2- 172.21.15.170:0/2133211729 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fae2c03c730 0x7fae2c03ebf0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7faf54095f80 tx=0x7faf54092000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.080+0000 7faf6512c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.080+0000 7faf6512c800 1 --2- 172.21.15.170:0/2133211729 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x555e1b90b690 0x555e1b90db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.080+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555e1b90e2a0 con 0x555e1b90b690 2024-09-12T17:28:00.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.080+0000 7faf5bfff640 1 --2- 172.21.15.170:0/2133211729 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x555e1b90b690 0x555e1b90db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.080+0000 7faf5bfff640 1 --2- 172.21.15.170:0/2133211729 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x555e1b90b690 0x555e1b90db50 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.080+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf4c00f5f0 con 0x555e1b90b690 2024-09-12T17:28:00.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.080+0000 7faf6512c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.080+0000 7faf6512c800 20 realm 2024-09-12T17:28:00.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.080+0000 7faf6512c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.080+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555e1b90a9e0 con 0x555e1b90b690 2024-09-12T17:28:00.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.081+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf4c00f5f0 con 0x555e1b90b690 2024-09-12T17:28:00.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.081+0000 7faf6512c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.081+0000 7faf6512c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:00.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.081+0000 7faf6512c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.081+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555e1b90ed90 con 0x555e1b90b690 2024-09-12T17:28:00.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.081+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf4c00f5f0 con 0x555e1b90b690 2024-09-12T17:28:00.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.081+0000 7faf6512c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.081+0000 7faf6512c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.081+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555e1b90f660 con 0x555e1b90b690 2024-09-12T17:28:00.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.081+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faf4c00f5f0 con 0x555e1b90b690 2024-09-12T17:28:00.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.081+0000 7faf6512c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:00.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.081+0000 7faf6512c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.081+0000 7faf6512c800 1 --2- 172.21.15.170:0/2133211729 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x555e1b910080 0x555e1b912470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.081+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555e1b912be0 con 0x555e1b910080 2024-09-12T17:28:00.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.081+0000 7faf6153f640 1 --2- 172.21.15.170:0/2133211729 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x555e1b910080 0x555e1b912470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.081+0000 7faf6153f640 1 --2- 172.21.15.170:0/2133211729 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x555e1b910080 0x555e1b912470 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.082+0000 7faf6153f640 1 -- 172.21.15.170:0/2133211729 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7faf5c03a030 con 0x555e1b910080 2024-09-12T17:28:00.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.082+0000 7faf6512c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:00.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.082+0000 7faf6512c800 20 searching for the correct realm 2024-09-12T17:28:00.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.082+0000 7faf6512c800 1 --2- 172.21.15.170:0/2133211729 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x555e1b914b90 0x555e1b917050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.082+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555e1b917720 con 0x555e1b914b90 2024-09-12T17:28:00.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.082+0000 7faf60d3e640 1 --2- 172.21.15.170:0/2133211729 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x555e1b914b90 0x555e1b917050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.082+0000 7faf60d3e640 1 --2- 172.21.15.170:0/2133211729 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x555e1b914b90 0x555e1b917050 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.082+0000 7faf60d3e640 1 -- 172.21.15.170:0/2133211729 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf5408a050 con 0x555e1b914b90 2024-09-12T17:28:00.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.082+0000 7faf60d3e640 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555e1b917720 con 0x555e1b910080 2024-09-12T17:28:00.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.083+0000 7faf6153f640 1 -- 172.21.15.170:0/2133211729 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf5c03a030 con 0x555e1b910080 2024-09-12T17:28:00.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.083+0000 7faf6153f640 1 --2- 172.21.15.170:0/2133211729 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7faf5c03d060 0x7faf5c03c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.083+0000 7faf6153f640 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555e1b917720 con 0x7faf5c03d060 2024-09-12T17:28:00.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.083+0000 7faf5bfff640 1 --2- 172.21.15.170:0/2133211729 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7faf5c03d060 0x7faf5c03c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.083+0000 7faf5bfff640 1 --2- 172.21.15.170:0/2133211729 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7faf5c03d060 0x7faf5c03c7a0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.084+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf4c00f5f0 con 0x7faf5c03d060 2024-09-12T17:28:00.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.084+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555e1b917720 con 0x555e1b90b690 2024-09-12T17:28:00.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.084+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf4c00f5f0 con 0x555e1b90b690 2024-09-12T17:28:00.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.084+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555e1b917720 con 0x555e1b90b690 2024-09-12T17:28:00.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.084+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf4c02b040 con 0x555e1b90b690 2024-09-12T17:28:00.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.084+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555e1b917720 con 0x7faf5c03d060 2024-09-12T17:28:00.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.084+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf4c02b040 con 0x7faf5c03d060 2024-09-12T17:28:00.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.084+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555e1b917720 con 0x7faf5c03d060 2024-09-12T17:28:00.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.084+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf4c02b040 con 0x7faf5c03d060 2024-09-12T17:28:00.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.084+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555e1b917720 con 0x555e1b910080 2024-09-12T17:28:00.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.085+0000 7faf6153f640 1 -- 172.21.15.170:0/2133211729 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf5c03a030 con 0x555e1b910080 2024-09-12T17:28:00.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.085+0000 7faf6153f640 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555e1b917720 con 0x555e1b914b90 2024-09-12T17:28:00.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.085+0000 7faf60d3e640 1 -- 172.21.15.170:0/2133211729 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf5408a050 con 0x555e1b914b90 2024-09-12T17:28:00.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.085+0000 7faf60d3e640 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555e1b917720 con 0x555e1b90b690 2024-09-12T17:28:00.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.085+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf4c02b040 con 0x555e1b90b690 2024-09-12T17:28:00.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.085+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555e1b917720 con 0x7faf5c03d060 2024-09-12T17:28:00.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.085+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf4c02b040 con 0x7faf5c03d060 2024-09-12T17:28:00.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.085+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555e1b917720 con 0x555e1b90b690 2024-09-12T17:28:00.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.086+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf4c02b040 con 0x555e1b90b690 2024-09-12T17:28:00.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.086+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555e1b917720 con 0x555e1b910080 2024-09-12T17:28:00.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.086+0000 7faf6153f640 1 -- 172.21.15.170:0/2133211729 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7faf5c03a030 con 0x555e1b910080 2024-09-12T17:28:00.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.086+0000 7faf6153f640 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555e1b917720 con 0x555e1b914b90 2024-09-12T17:28:00.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.086+0000 7faf60d3e640 1 -- 172.21.15.170:0/2133211729 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf5408a050 con 0x555e1b914b90 2024-09-12T17:28:00.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.086+0000 7faf60d3e640 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555e1b917720 con 0x555e1b914b90 2024-09-12T17:28:00.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.086+0000 7faf60d3e640 1 -- 172.21.15.170:0/2133211729 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf5408a050 con 0x555e1b914b90 2024-09-12T17:28:00.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.086+0000 7faf60d3e640 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555e1b917720 con 0x7faf5c03d060 2024-09-12T17:28:00.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.087+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf4c02b040 con 0x7faf5c03d060 2024-09-12T17:28:00.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.087+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555e1b917720 con 0x555e1b914b90 2024-09-12T17:28:00.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.087+0000 7faf60d3e640 1 -- 172.21.15.170:0/2133211729 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf5408a050 con 0x555e1b914b90 2024-09-12T17:28:00.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.087+0000 7faf60d3e640 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555e1b917720 con 0x555e1b914b90 2024-09-12T17:28:00.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.087+0000 7faf60d3e640 1 -- 172.21.15.170:0/2133211729 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf5408a050 con 0x555e1b914b90 2024-09-12T17:28:00.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.087+0000 7faf60d3e640 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555e1b917720 con 0x555e1b90b690 2024-09-12T17:28:00.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.087+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf4c02b040 con 0x555e1b90b690 2024-09-12T17:28:00.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.087+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555e1b917720 con 0x555e1b90b690 2024-09-12T17:28:00.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.087+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7faf4c02b040 con 0x555e1b90b690 2024-09-12T17:28:00.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.087+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555e1b917720 con 0x7faf5c03d060 2024-09-12T17:28:00.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.088+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf4c02b040 con 0x7faf5c03d060 2024-09-12T17:28:00.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.088+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555e1b917720 con 0x555e1b914b90 2024-09-12T17:28:00.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.088+0000 7faf60d3e640 1 -- 172.21.15.170:0/2133211729 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf5408a050 con 0x555e1b914b90 2024-09-12T17:28:00.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.088+0000 7faf60d3e640 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555e1b917720 con 0x555e1b910080 2024-09-12T17:28:00.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.088+0000 7faf6153f640 1 -- 172.21.15.170:0/2133211729 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf5c03a030 con 0x555e1b910080 2024-09-12T17:28:00.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.088+0000 7faf6153f640 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555e1b917720 con 0x555e1b90b690 2024-09-12T17:28:00.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.088+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf4c02b040 con 0x555e1b90b690 2024-09-12T17:28:00.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.088+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555e1b917720 con 0x7faf5c03d060 2024-09-12T17:28:00.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.089+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf4c03b040 con 0x7faf5c03d060 2024-09-12T17:28:00.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.089+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555e1b917720 con 0x555e1b914b90 2024-09-12T17:28:00.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.089+0000 7faf60d3e640 1 -- 172.21.15.170:0/2133211729 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf5408a050 con 0x555e1b914b90 2024-09-12T17:28:00.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.089+0000 7faf60d3e640 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555e1b917720 con 0x7faf5c03d060 2024-09-12T17:28:00.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.089+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf4c03b040 con 0x7faf5c03d060 2024-09-12T17:28:00.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.089+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555e1b917720 con 0x555e1b910080 2024-09-12T17:28:00.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.089+0000 7faf6153f640 1 -- 172.21.15.170:0/2133211729 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf5c03a030 con 0x555e1b910080 2024-09-12T17:28:00.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.090+0000 7faf6153f640 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555e1b917720 con 0x555e1b914b90 2024-09-12T17:28:00.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.090+0000 7faf60d3e640 1 -- 172.21.15.170:0/2133211729 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf5408a050 con 0x555e1b914b90 2024-09-12T17:28:00.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.090+0000 7faf60d3e640 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555e1b917720 con 0x7faf5c03d060 2024-09-12T17:28:00.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.090+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf4c03b040 con 0x7faf5c03d060 2024-09-12T17:28:00.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.090+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555e1b917720 con 0x555e1b90b690 2024-09-12T17:28:00.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.090+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7faf4c03b040 con 0x555e1b90b690 2024-09-12T17:28:00.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.090+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555e1b917720 con 0x555e1b910080 2024-09-12T17:28:00.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.090+0000 7faf6153f640 1 -- 172.21.15.170:0/2133211729 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7faf5c069040 con 0x555e1b910080 2024-09-12T17:28:00.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.091+0000 7faf6512c800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:00.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.091+0000 7faf6512c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:00.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.091+0000 7faf6512c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:00.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.091+0000 7faf6512c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:00.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.091+0000 7faf6512c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:00.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.091+0000 7faf6512c800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:00.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.091+0000 7faf6512c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.091+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555e1b9135a0 con 0x555e1b90b690 2024-09-12T17:28:00.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.091+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf4c03b040 con 0x555e1b90b690 2024-09-12T17:28:00.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.091+0000 7faf6512c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.091+0000 7faf6512c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.091+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555e1b913e40 con 0x555e1b90b690 2024-09-12T17:28:00.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.091+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faf4c03b040 con 0x555e1b90b690 2024-09-12T17:28:00.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.091+0000 7faf6512c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:00.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.091+0000 7faf6512c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.091+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555e1b9131e0 con 0x555e1b910080 2024-09-12T17:28:00.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.091+0000 7faf6153f640 1 -- 172.21.15.170:0/2133211729 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7faf5c069040 con 0x555e1b910080 2024-09-12T17:28:00.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.091+0000 7faf6512c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:00.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.091+0000 7faf6512c800 20 zone default found 2024-09-12T17:28:00.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.091+0000 7faf6512c800 4 Realm: () 2024-09-12T17:28:00.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.091+0000 7faf6512c800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:00.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.091+0000 7faf6512c800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:00.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.091+0000 7faf6512c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:00.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.091+0000 7faf6512c800 20 zonegroup default 2024-09-12T17:28:00.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.091+0000 7faf6512c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.091+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555e1b918050 con 0x7faf5c03d060 2024-09-12T17:28:00.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.092+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7faf4c03b040 con 0x7faf5c03d060 2024-09-12T17:28:00.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.092+0000 7faf6512c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.092+0000 7faf6512c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.092+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555e1b919d20 con 0x555e1b914b90 2024-09-12T17:28:00.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.092+0000 7faf60d3e640 1 -- 172.21.15.170:0/2133211729 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faf5408a050 con 0x555e1b914b90 2024-09-12T17:28:00.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.092+0000 7faf6512c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.092+0000 7faf6512c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.092+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555e1b91a1c0 con 0x555e1b914b90 2024-09-12T17:28:00.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.092+0000 7faf60d3e640 1 -- 172.21.15.170:0/2133211729 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faf5408a050 con 0x555e1b914b90 2024-09-12T17:28:00.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.092+0000 7faf6512c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.092+0000 7faf6512c800 20 started sync module instance, tier type = 2024-09-12T17:28:00.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.092+0000 7faf6512c800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:00.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.092+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555e1b918af0 con 0x555e1b910080 2024-09-12T17:28:00.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.093+0000 7faf6153f640 1 -- 172.21.15.170:0/2133211729 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf5c069040 con 0x555e1b910080 2024-09-12T17:28:00.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.093+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93862677811184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555e1b918af0 con 0x555e1b910080 2024-09-12T17:28:00.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.093+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555e1b91acc0 con 0x555e1b90b690 2024-09-12T17:28:00.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.094+0000 7faf6153f640 1 -- 172.21.15.170:0/2133211729 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93862677811184] v29'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf5c069040 con 0x555e1b910080 2024-09-12T17:28:00.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.094+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf4c03b040 con 0x555e1b90b690 2024-09-12T17:28:00.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.094+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93862677817232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555e1b918af0 con 0x555e1b90b690 2024-09-12T17:28:00.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.094+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555e1b91b740 con 0x555e1b914b90 2024-09-12T17:28:00.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.095+0000 7faf60d3e640 1 -- 172.21.15.170:0/2133211729 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf5408a050 con 0x555e1b914b90 2024-09-12T17:28:00.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.095+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93862677819984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555e1b91c010 con 0x555e1b914b90 2024-09-12T17:28:00.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.095+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555e1b91caf0 con 0x555e1b910080 2024-09-12T17:28:00.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.095+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93862677817232] v29'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf4c03b040 con 0x555e1b90b690 2024-09-12T17:28:00.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.096+0000 7faf60d3e640 1 -- 172.21.15.170:0/2133211729 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93862677819984] v29'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf5408a050 con 0x555e1b914b90 2024-09-12T17:28:00.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.096+0000 7faf6153f640 1 -- 172.21.15.170:0/2133211729 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf5c069040 con 0x555e1b910080 2024-09-12T17:28:00.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.096+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93862677822304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555e1b91c600 con 0x555e1b910080 2024-09-12T17:28:00.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.097+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555e1b91d530 con 0x555e1b90b690 2024-09-12T17:28:00.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.097+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf4c03b040 con 0x555e1b90b690 2024-09-12T17:28:00.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.097+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93862677827712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555e1b91d950 con 0x555e1b90b690 2024-09-12T17:28:00.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.097+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555e1b91e3c0 con 0x7faf5c03d060 2024-09-12T17:28:00.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.098+0000 7faf6153f640 1 -- 172.21.15.170:0/2133211729 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93862677822304] v29'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf5c069040 con 0x555e1b910080 2024-09-12T17:28:00.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.098+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf4c03b040 con 0x7faf5c03d060 2024-09-12T17:28:00.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.098+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93862677831312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555e1b91e380 con 0x7faf5c03d060 2024-09-12T17:28:00.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.098+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555e1b91edf0 con 0x7faf5c03d060 2024-09-12T17:28:00.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.099+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93862677827712] v29'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf4c03b040 con 0x555e1b90b690 2024-09-12T17:28:00.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.099+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93862677831312] v29'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf4c03b040 con 0x7faf5c03d060 2024-09-12T17:28:00.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.100+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(56 notify.6 [create] v29'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf4c03b040 con 0x7faf5c03d060 2024-09-12T17:28:00.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.100+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93862677808704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555e1b91d4a0 con 0x7faf5c03d060 2024-09-12T17:28:00.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.100+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555e1b91f2a0 con 0x7faf5c03d060 2024-09-12T17:28:00.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.101+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93862677808704] v29'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf4c03b040 con 0x7faf5c03d060 2024-09-12T17:28:00.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.101+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(58 notify.7 [create] v29'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf4c03b040 con 0x7faf5c03d060 2024-09-12T17:28:00.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.101+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93862677834016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555e1b91f2a0 con 0x7faf5c03d060 2024-09-12T17:28:00.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.101+0000 7faf6512c800 20 add_watcher() i=0 2024-09-12T17:28:00.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.101+0000 7faf6512c800 20 add_watcher() i=1 2024-09-12T17:28:00.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.101+0000 7faf6512c800 20 add_watcher() i=2 2024-09-12T17:28:00.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.101+0000 7faf6512c800 20 add_watcher() i=3 2024-09-12T17:28:00.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.101+0000 7faf6512c800 20 add_watcher() i=4 2024-09-12T17:28:00.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.101+0000 7faf6512c800 20 add_watcher() i=5 2024-09-12T17:28:00.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.101+0000 7faf6512c800 20 add_watcher() i=6 2024-09-12T17:28:00.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.102+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93862677834016] v29'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf4c03b040 con 0x7faf5c03d060 2024-09-12T17:28:00.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.102+0000 7faf6512c800 20 add_watcher() i=7 2024-09-12T17:28:00.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.102+0000 7faf6512c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:00.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.102+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555e1b9226a0 con 0x555e1b90b690 2024-09-12T17:28:00.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.102+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7faf4c03b040 con 0x555e1b90b690 2024-09-12T17:28:00.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.102+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93862677835712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555e1b91fbf0 con 0x555e1b90b690 2024-09-12T17:28:00.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.103+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93862677835712] v29'60 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faf4c03b040 con 0x555e1b90b690 2024-09-12T17:28:00.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.103+0000 7fae16fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:00.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.103+0000 7faf6512c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:00.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.103+0000 7faf6512c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:00.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.103+0000 7faf6512c800 5 note: GC not initialized 2024-09-12T17:28:00.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.103+0000 7fae15fe3640 20 reqs_thread_entry: start 2024-09-12T17:28:00.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.103+0000 7faf6512c800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:00.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.103+0000 7faf6512c800 20 Filter name: none 2024-09-12T17:28:00.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.104+0000 7fad877fe640 20 reqs_thread_entry: start 2024-09-12T17:28:00.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.104+0000 7faf6512c800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:28:00.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.104+0000 7faf6512c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.104+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555e1b9557d0 con 0x555e1b90b690 2024-09-12T17:28:00.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.104+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7faf4c03b040 con 0x555e1b90b690 2024-09-12T17:28:00.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.104+0000 7faf6512c800 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:28:00.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.104+0000 7faf6512c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T17:28:00.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.104+0000 7faf6512c800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:28:00.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.104+0000 7faf6512c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:00.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.104+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555e1b958100 con 0x555e1b910080 2024-09-12T17:28:00.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.104+0000 7faf6153f640 1 -- 172.21.15.170:0/2133211729 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7faf5c069040 con 0x555e1b910080 2024-09-12T17:28:00.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.104+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555e1b95b880 con 0x555e1b90b690 2024-09-12T17:28:00.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.105+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v29'3 uv3 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7faf4c03b040 con 0x555e1b90b690 2024-09-12T17:28:00.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.105+0000 7faf6512c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:28:00.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.105+0000 7faf6512c800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:28:00.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.105+0000 7faf6512c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T17:28:00.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.105+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93862678082144 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555e1b9570f0 con 0x555e1b90b690 2024-09-12T17:28:00.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.106+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== watch-notify(notify (1) cookie 93862677827712 notify 124554051586 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7faf4c018040 con 0x555e1b90b690 2024-09-12T17:28:00.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.106+0000 7fae37fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051586 cookie 93862677827712 notifier 4323 bl.length()=567 2024-09-12T17:28:00.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.106+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(65 notify.4 [notify cookie 93862678082144 out=8b] v0'0 uv39 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7faf4c03b040 con 0x555e1b90b690 2024-09-12T17:28:00.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.106+0000 7fae37fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:28:00.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.106+0000 7fae37fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:28:00.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.106+0000 7fae37fff640 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fae24003ea0 con 0x555e1b90b690 2024-09-12T17:28:00.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.106+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf4c03b040 con 0x555e1b90b690 2024-09-12T17:28:00.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.106+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== watch-notify(notify_complete (2) cookie 93862678082144 notify 124554051586 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7faf4c01db40 con 0x555e1b90b690 2024-09-12T17:28:00.143 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T17:27:59.362376Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:27:59.362351Z","tags":[],"group_ids":[]} 2024-09-12T17:28:00.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.107+0000 7fae16fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:00.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.107+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93862677835712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555e1b9536b0 con 0x555e1b90b690 2024-09-12T17:28:00.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.108+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 93862677835712] v29'61 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faf4c03b040 con 0x555e1b90b690 2024-09-12T17:28:00.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.108+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93862677811184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555e1b9536b0 con 0x555e1b910080 2024-09-12T17:28:00.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.109+0000 7faf6153f640 1 -- 172.21.15.170:0/2133211729 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 93862677811184] v29'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf5c069040 con 0x555e1b910080 2024-09-12T17:28:00.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.109+0000 7faf6512c800 20 remove_watcher() i=0 2024-09-12T17:28:00.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.109+0000 7faf6512c800 2 removed watcher, disabling cache 2024-09-12T17:28:00.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.109+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93862677817232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555e1b9536b0 con 0x555e1b90b690 2024-09-12T17:28:00.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.110+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 93862677817232] v29'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf4c03b040 con 0x555e1b90b690 2024-09-12T17:28:00.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.110+0000 7faf6512c800 20 remove_watcher() i=1 2024-09-12T17:28:00.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.110+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93862677819984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555e1b9536b0 con 0x555e1b914b90 2024-09-12T17:28:00.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.111+0000 7faf60d3e640 1 -- 172.21.15.170:0/2133211729 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 93862677819984] v29'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf5408a050 con 0x555e1b914b90 2024-09-12T17:28:00.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.111+0000 7faf6512c800 20 remove_watcher() i=2 2024-09-12T17:28:00.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.111+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93862677822304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555e1b9536b0 con 0x555e1b910080 2024-09-12T17:28:00.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.112+0000 7faf6153f640 1 -- 172.21.15.170:0/2133211729 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 93862677822304] v29'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf5c069040 con 0x555e1b910080 2024-09-12T17:28:00.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.112+0000 7faf6512c800 20 remove_watcher() i=3 2024-09-12T17:28:00.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.112+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93862677827712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555e1b9536b0 con 0x555e1b90b690 2024-09-12T17:28:00.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.113+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 93862677827712] v29'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf4c03b040 con 0x555e1b90b690 2024-09-12T17:28:00.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.113+0000 7faf6512c800 20 remove_watcher() i=4 2024-09-12T17:28:00.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.113+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93862677831312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555e1b9536b0 con 0x7faf5c03d060 2024-09-12T17:28:00.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.114+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 93862677831312] v29'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf4c03b040 con 0x7faf5c03d060 2024-09-12T17:28:00.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.114+0000 7faf6512c800 20 remove_watcher() i=5 2024-09-12T17:28:00.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.114+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93862677808704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555e1b9536b0 con 0x7faf5c03d060 2024-09-12T17:28:00.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.115+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 93862677808704] v29'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf4c03b040 con 0x7faf5c03d060 2024-09-12T17:28:00.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.115+0000 7faf6512c800 20 remove_watcher() i=6 2024-09-12T17:28:00.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.115+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93862677834016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555e1b9536b0 con 0x7faf5c03d060 2024-09-12T17:28:00.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.116+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 93862677834016] v29'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf4c03b040 con 0x7faf5c03d060 2024-09-12T17:28:00.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.116+0000 7faf6512c800 20 remove_watcher() i=7 2024-09-12T17:28:00.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.116+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7faf5c03d060 msgr2=0x7faf5c03c7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.116+0000 7faf6512c800 1 --2- 172.21.15.170:0/2133211729 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7faf5c03d060 0x7faf5c03c7a0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.116+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x555e1b90b690 msgr2=0x555e1b90db50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.116+0000 7faf6512c800 1 --2- 172.21.15.170:0/2133211729 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x555e1b90b690 0x555e1b90db50 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.116+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x555e1b910080 msgr2=0x555e1b912470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.116+0000 7faf6512c800 1 --2- 172.21.15.170:0/2133211729 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x555e1b910080 0x555e1b912470 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.116+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x555e1b914b90 msgr2=0x555e1b917050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.116+0000 7faf6512c800 1 --2- 172.21.15.170:0/2133211729 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x555e1b914b90 0x555e1b917050 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.116+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fae2c03c730 msgr2=0x7fae2c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.116+0000 7faf6512c800 1 --2- 172.21.15.170:0/2133211729 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fae2c03c730 0x7fae2c03ebf0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7faf54095f80 tx=0x7faf54092000 comp rx=0 tx=0).stop 2024-09-12T17:28:00.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.116+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555e1b8f87d0 msgr2=0x555e1b8ffde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.116+0000 7faf6512c800 1 --2- 172.21.15.170:0/2133211729 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555e1b8f87d0 0x555e1b8ffde0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7faf5c053cd0 tx=0x7faf5c053d30 comp rx=0 tx=0).stop 2024-09-12T17:28:00.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.116+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 reap_dead start 2024-09-12T17:28:00.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.116+0000 7faf5bfff640 1 -- 172.21.15.170:0/2133211729 reap_dead start 2024-09-12T17:28:00.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.116+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 shutdown_connections 2024-09-12T17:28:00.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.116+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 >> 172.21.15.170:0/2133211729 conn(0x555e1b8f4bd0 msgr2=0x555e1b8f2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:00.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.116+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 shutdown_connections 2024-09-12T17:28:00.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.116+0000 7faf6512c800 1 -- 172.21.15.170:0/2133211729 wait complete. 2024-09-12T17:28:00.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.117+0000 7faf6512c800 1 -- 172.21.15.170:0/1755570606 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fae3803c730 msgr2=0x7fae3803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.117+0000 7faf6512c800 1 --2- 172.21.15.170:0/1755570606 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fae3803c730 0x7fae3803ebf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x555e1b8d8c20 tx=0x7faf540872b0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.117+0000 7faf6512c800 1 -- 172.21.15.170:0/1755570606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555e1b8ebd10 msgr2=0x555e1b8ec130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.117+0000 7faf6512c800 1 --2- 172.21.15.170:0/1755570606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555e1b8ebd10 0x555e1b8ec130 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x555e1b7d78c0 tx=0x7faf5c0167b0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.117+0000 7faf6512c800 1 -- 172.21.15.170:0/1755570606 shutdown_connections 2024-09-12T17:28:00.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.117+0000 7faf6512c800 1 --2- 172.21.15.170:0/1755570606 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fae3803c730 0x7fae3803ebf0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.117+0000 7faf6512c800 1 --2- 172.21.15.170:0/1755570606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555e1b8ebd10 0x555e1b8ec130 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.117+0000 7faf6512c800 1 -- 172.21.15.170:0/1755570606 >> 172.21.15.170:0/1755570606 conn(0x555e1b8e00c0 msgr2=0x555e1b8e04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:00.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.117+0000 7faf6512c800 1 -- 172.21.15.170:0/1755570606 shutdown_connections 2024-09-12T17:28:00.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.117+0000 7faf6512c800 1 -- 172.21.15.170:0/1755570606 wait complete. 2024-09-12T17:28:00.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.117+0000 7faf6512c800 1 -- 172.21.15.170:0/2894389969 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x555e1b7db020 msgr2=0x555e1b8d8250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.117+0000 7faf6512c800 1 --2- 172.21.15.170:0/2894389969 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x555e1b7db020 0x555e1b8d8250 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.117+0000 7faf6512c800 1 -- 172.21.15.170:0/2894389969 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x555e1b8daa80 msgr2=0x555e1b8dce70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.117+0000 7faf6512c800 1 --2- 172.21.15.170:0/2894389969 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x555e1b8daa80 0x555e1b8dce70 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.117+0000 7faf6512c800 1 -- 172.21.15.170:0/2894389969 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fae4803c780 msgr2=0x7fae4803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.117+0000 7faf6512c800 1 --2- 172.21.15.170:0/2894389969 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fae4803c780 0x7fae4803ec40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faf4c000c00 tx=0x7faf4c0013b0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.117+0000 7faf6512c800 1 -- 172.21.15.170:0/2894389969 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555e1b7d8600 msgr2=0x555e1b7d7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.117+0000 7faf6512c800 1 --2- 172.21.15.170:0/2894389969 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555e1b7d8600 0x555e1b7d7d20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7faf5400a470 tx=0x7faf54002fb0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.117+0000 7faf6512c800 1 -- 172.21.15.170:0/2894389969 shutdown_connections 2024-09-12T17:28:00.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.117+0000 7faf6512c800 1 --2- 172.21.15.170:0/2894389969 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x555e1b8daa80 0x555e1b8dce70 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.117+0000 7faf6512c800 1 --2- 172.21.15.170:0/2894389969 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fae4803c780 0x7fae4803ec40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.117+0000 7faf6512c800 1 --2- 172.21.15.170:0/2894389969 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x555e1b7db020 0x555e1b8d8250 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.117+0000 7faf6512c800 1 --2- 172.21.15.170:0/2894389969 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555e1b7d8600 0x555e1b7d7d20 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.117+0000 7faf6512c800 1 -- 172.21.15.170:0/2894389969 >> 172.21.15.170:0/2894389969 conn(0x555e1b7d21c0 msgr2=0x555e1b8c15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:00.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.117+0000 7faf6512c800 1 -- 172.21.15.170:0/2894389969 shutdown_connections 2024-09-12T17:28:00.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.117+0000 7faf6512c800 1 -- 172.21.15.170:0/2894389969 wait complete. 2024-09-12T17:28:00.157 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T17:27:59.362376Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:27:59.362351Z', 'tags': [], 'group_ids': []} 2024-09-12T17:28:00.157 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-12T17:28:00.157 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-12T17:28:00.157 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-12T17:28:00.202 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:00.202 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:00.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.201+0000 7ff518940800 1 Processor -- start 2024-09-12T17:28:00.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.201+0000 7ff518940800 1 -- start start 2024-09-12T17:28:00.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.202+0000 7ff518940800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x56198ab51fe0 0x56198ab5ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.202+0000 7ff518940800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56198a9fbe40 con 0x56198ab504c0 2024-09-12T17:28:00.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.202+0000 7ff518940800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x56198a9c6680 con 0x56198ab51fe0 2024-09-12T17:28:00.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.202+0000 7ff513ebf640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x56198ab51fe0 0x56198ab5ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.202+0000 7ff5146c0640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x56198ab504c0 0x56198ab508c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:48300/0 (socket says 172.21.15.170:48300) 2024-09-12T17:28:00.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.202+0000 7ff5146c0640 1 -- 172.21.15.170:0/4024187481 learned_addr learned my addr 172.21.15.170:0/4024187481 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:28:00.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.202+0000 7ff513ebf640 1 -- 172.21.15.170:0/4024187481 >> v1:172.21.15.47:6789/0 conn(0x56198ab504c0 legacy=0x56198ab508c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.202+0000 7ff513ebf640 1 -- 172.21.15.170:0/4024187481 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56198a9e26b0 con 0x56198ab51fe0 2024-09-12T17:28:00.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.202+0000 7ff5136be640 1 -- 172.21.15.170:0/4024187481 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 621955138 0 0) 0x56198a9fbe40 con 0x56198ab504c0 2024-09-12T17:28:00.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.204+0000 7ff513ebf640 1 --2- 172.21.15.170:0/4024187481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198ab51fe0 0x56198ab5ab00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc00a470 tx=0x7ff4fc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5d593743a33b2d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.204+0000 7ff5136be640 1 -- 172.21.15.170:0/4024187481 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4fc053570 con 0x56198ab51fe0 2024-09-12T17:28:00.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.204+0000 7ff5136be640 1 -- 172.21.15.170:0/4024187481 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4fc058070 con 0x56198ab51fe0 2024-09-12T17:28:00.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.204+0000 7ff5136be640 1 -- 172.21.15.170:0/4024187481 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4fc053880 con 0x56198ab51fe0 2024-09-12T17:28:00.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.205+0000 7ff518940800 1 -- 172.21.15.170:0/4024187481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198ab51fe0 msgr2=0x56198ab5ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.205+0000 7ff518940800 1 --2- 172.21.15.170:0/4024187481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198ab51fe0 0x56198ab5ab00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc00a470 tx=0x7ff4fc045a20 comp rx=0 tx=0).stop 2024-09-12T17:28:00.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.205+0000 7ff518940800 1 -- 172.21.15.170:0/4024187481 shutdown_connections 2024-09-12T17:28:00.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.205+0000 7ff518940800 1 --2- 172.21.15.170:0/4024187481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198ab51fe0 0x56198ab5ab00 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.205+0000 7ff518940800 1 -- 172.21.15.170:0/4024187481 >> 172.21.15.170:0/4024187481 conn(0x56198ab4c1f0 msgr2=0x56198ab4e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:00.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.205+0000 7ff518940800 1 -- 172.21.15.170:0/4024187481 shutdown_connections 2024-09-12T17:28:00.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.205+0000 7ff518940800 1 -- 172.21.15.170:0/4024187481 wait complete. 2024-09-12T17:28:00.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.219+0000 7ff518940800 1 Processor -- start 2024-09-12T17:28:00.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.219+0000 7ff518940800 1 -- start start 2024-09-12T17:28:00.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.219+0000 7ff518940800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198ab504c0 0x56198ac43690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.219+0000 7ff518940800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56198a9eadd0 con 0x56198ab504c0 2024-09-12T17:28:00.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.219+0000 7ff5146c0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198ab504c0 0x56198ac43690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.219+0000 7ff5146c0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198ab504c0 0x56198ac43690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56784/0 (socket says 172.21.15.170:56784) 2024-09-12T17:28:00.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.219+0000 7ff5146c0640 1 -- 172.21.15.170:0/2263983101 learned_addr learned my addr 172.21.15.170:0/2263983101 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:00.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.219+0000 7ff5146c0640 1 -- 172.21.15.170:0/2263983101 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56198aa03e10 con 0x56198ab504c0 2024-09-12T17:28:00.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.219+0000 7ff5146c0640 1 --2- 172.21.15.170:0/2263983101 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198ab504c0 0x56198ac43690 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff50c006fa0 tx=0x7ff50c001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c42893b477536960 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.220+0000 7ff40260c640 1 -- 172.21.15.170:0/2263983101 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff50c003450 con 0x56198ab504c0 2024-09-12T17:28:00.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.220+0000 7ff40260c640 1 -- 172.21.15.170:0/2263983101 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff50c003610 con 0x56198ab504c0 2024-09-12T17:28:00.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.220+0000 7ff40260c640 1 -- 172.21.15.170:0/2263983101 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff50c003970 con 0x56198ab504c0 2024-09-12T17:28:00.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.220+0000 7ff518940800 1 -- 172.21.15.170:0/2263983101 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198ab504c0 msgr2=0x56198ac43690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.220+0000 7ff518940800 1 --2- 172.21.15.170:0/2263983101 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198ab504c0 0x56198ac43690 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff50c006fa0 tx=0x7ff50c001b00 comp rx=0 tx=0).stop 2024-09-12T17:28:00.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.220+0000 7ff518940800 1 -- 172.21.15.170:0/2263983101 shutdown_connections 2024-09-12T17:28:00.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.220+0000 7ff518940800 1 --2- 172.21.15.170:0/2263983101 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198ab504c0 0x56198ac43690 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.220+0000 7ff518940800 1 -- 172.21.15.170:0/2263983101 >> 172.21.15.170:0/2263983101 conn(0x56198ab4c1f0 msgr2=0x56198ac3f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:00.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.220+0000 7ff518940800 1 -- 172.21.15.170:0/2263983101 shutdown_connections 2024-09-12T17:28:00.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.220+0000 7ff518940800 1 -- 172.21.15.170:0/2263983101 wait complete. 2024-09-12T17:28:00.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.221+0000 7ff518940800 1 Processor -- start 2024-09-12T17:28:00.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.221+0000 7ff518940800 1 -- start start 2024-09-12T17:28:00.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.221+0000 7ff518940800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198ab504c0 0x56198ac4afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.221+0000 7ff518940800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56198ab5b340 con 0x56198ab504c0 2024-09-12T17:28:00.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.221+0000 7ff5146c0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198ab504c0 0x56198ac4afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.221+0000 7ff5146c0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198ab504c0 0x56198ac4afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56792/0 (socket says 172.21.15.170:56792) 2024-09-12T17:28:00.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.221+0000 7ff5146c0640 1 -- 172.21.15.170:0/447534499 learned_addr learned my addr 172.21.15.170:0/447534499 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:00.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.221+0000 7ff5146c0640 1 -- 172.21.15.170:0/447534499 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56198ac4b510 con 0x56198ab504c0 2024-09-12T17:28:00.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.221+0000 7ff5146c0640 1 --2- 172.21.15.170:0/447534499 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198ab504c0 0x56198ac4afb0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff50c001330 tx=0x7ff50c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.222+0000 7ff400e09640 1 -- 172.21.15.170:0/447534499 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff50c014a10 con 0x56198ab504c0 2024-09-12T17:28:00.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.222+0000 7ff400e09640 1 -- 172.21.15.170:0/447534499 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff50c014bb0 con 0x56198ab504c0 2024-09-12T17:28:00.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.222+0000 7ff400e09640 1 -- 172.21.15.170:0/447534499 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff50c01e3f0 con 0x56198ab504c0 2024-09-12T17:28:00.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.222+0000 7ff518940800 1 -- 172.21.15.170:0/447534499 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56198ac4b7a0 con 0x56198ab504c0 2024-09-12T17:28:00.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.222+0000 7ff518940800 1 -- 172.21.15.170:0/447534499 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56198ac4c1a0 con 0x56198ab504c0 2024-09-12T17:28:00.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.223+0000 7ff400e09640 1 -- 172.21.15.170:0/447534499 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ff50c010070 con 0x56198ab504c0 2024-09-12T17:28:00.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.223+0000 7ff400e09640 1 --2- 172.21.15.170:0/447534499 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff3fc03c780 0x7ff3fc03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.223+0000 7ff400e09640 1 -- 172.21.15.170:0/447534499 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7ff50c018070 con 0x56198ab504c0 2024-09-12T17:28:00.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.223+0000 7ff513ebf640 1 --2- 172.21.15.170:0/447534499 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff3fc03c780 0x7ff3fc03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.223+0000 7ff518940800 1 --2- 172.21.15.170:0/447534499 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56198ab51fe0 0x56198ac52600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.223+0000 7ff518940800 1 -- 172.21.15.170:0/447534499 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56198ac52b40 con 0x56198ab51fe0 2024-09-12T17:28:00.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.223+0000 7ff514ec1640 1 --2- 172.21.15.170:0/447534499 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56198ab51fe0 0x56198ac52600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.223+0000 7ff513ebf640 1 --2- 172.21.15.170:0/447534499 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff3fc03c780 0x7ff3fc03ec40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc057000 tx=0x7ff4fc052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.223+0000 7ff514ec1640 1 --2- 172.21.15.170:0/447534499 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56198ab51fe0 0x56198ac52600 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.224+0000 7ff514ec1640 1 -- 172.21.15.170:0/447534499 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff5040083e0 con 0x56198ab51fe0 2024-09-12T17:28:00.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.224+0000 7ff518940800 1 -- 172.21.15.170:0/447534499 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56198ac52ee0 con 0x56198ab51fe0 2024-09-12T17:28:00.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.224+0000 7ff514ec1640 1 -- 172.21.15.170:0/447534499 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff5040083e0 con 0x56198ab51fe0 2024-09-12T17:28:00.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.224+0000 7ff518940800 1 --2- 172.21.15.170:0/447534499 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56198ac549a0 0x56198ac56e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.224+0000 7ff518940800 1 -- 172.21.15.170:0/447534499 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56198ac575b0 con 0x56198ac549a0 2024-09-12T17:28:00.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.224+0000 7ff5146c0640 1 --2- 172.21.15.170:0/447534499 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56198ac549a0 0x56198ac56e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.224+0000 7ff5146c0640 1 --2- 172.21.15.170:0/447534499 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56198ac549a0 0x56198ac56e20 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.225+0000 7ff5146c0640 1 -- 172.21.15.170:0/447534499 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff50c01b070 con 0x56198ac549a0 2024-09-12T17:28:00.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.225+0000 7ff518940800 1 -- 172.21.15.170:0/447534499 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56198ac53730 con 0x56198ab51fe0 2024-09-12T17:28:00.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.225+0000 7ff514ec1640 1 -- 172.21.15.170:0/447534499 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff5040083e0 con 0x56198ab51fe0 2024-09-12T17:28:00.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.225+0000 7ff518940800 1 -- 172.21.15.170:0/447534499 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56198ac53b10 con 0x56198ac549a0 2024-09-12T17:28:00.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.225+0000 7ff5146c0640 1 -- 172.21.15.170:0/447534499 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff50c01b070 con 0x56198ac549a0 2024-09-12T17:28:00.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.226+0000 7ff518940800 1 Processor -- start 2024-09-12T17:28:00.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.226+0000 7ff518940800 1 -- start start 2024-09-12T17:28:00.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.226+0000 7ff518940800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198ac65e80 0x56198ac662a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.226+0000 7ff518940800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56198aa48a00 con 0x56198ac65e80 2024-09-12T17:28:00.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.226+0000 7ff514ec1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198ac65e80 0x56198ac662a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.226+0000 7ff514ec1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198ac65e80 0x56198ac662a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56804/0 (socket says 172.21.15.170:56804) 2024-09-12T17:28:00.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.226+0000 7ff514ec1640 1 -- 172.21.15.170:0/1757564178 learned_addr learned my addr 172.21.15.170:0/1757564178 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:00.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.227+0000 7ff514ec1640 1 -- 172.21.15.170:0/1757564178 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56198ac668e0 con 0x56198ac65e80 2024-09-12T17:28:00.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.227+0000 7ff514ec1640 1 --2- 172.21.15.170:0/1757564178 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198ac65e80 0x56198ac662a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x56198ac4cea0 tx=0x7ff50400bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.227+0000 7ff3f9ffb640 1 -- 172.21.15.170:0/1757564178 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff50401c020 con 0x56198ac65e80 2024-09-12T17:28:00.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.227+0000 7ff3f9ffb640 1 -- 172.21.15.170:0/1757564178 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff504007c90 con 0x56198ac65e80 2024-09-12T17:28:00.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.227+0000 7ff518940800 1 -- 172.21.15.170:0/1757564178 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56198ac67110 con 0x56198ac65e80 2024-09-12T17:28:00.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.227+0000 7ff3f9ffb640 1 -- 172.21.15.170:0/1757564178 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff504018440 con 0x56198ac65e80 2024-09-12T17:28:00.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.227+0000 7ff518940800 1 -- 172.21.15.170:0/1757564178 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56198ac676b0 con 0x56198ac65e80 2024-09-12T17:28:00.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.228+0000 7ff3f9ffb640 1 -- 172.21.15.170:0/1757564178 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ff50401f020 con 0x56198ac65e80 2024-09-12T17:28:00.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.228+0000 7ff3f9ffb640 1 --2- 172.21.15.170:0/1757564178 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff3ec03c730 0x7ff3ec03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.228+0000 7ff3f9ffb640 1 -- 172.21.15.170:0/1757564178 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7ff504054df0 con 0x56198ac65e80 2024-09-12T17:28:00.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.228+0000 7ff5146c0640 1 --2- 172.21.15.170:0/1757564178 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff3ec03c730 0x7ff3ec03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.229+0000 7ff518940800 1 Processor -- start 2024-09-12T17:28:00.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.229+0000 7ff5146c0640 1 --2- 172.21.15.170:0/1757564178 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff3ec03c730 0x7ff3ec03ebf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x56198ac57950 tx=0x7ff50c014e90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.229+0000 7ff518940800 1 -- start start 2024-09-12T17:28:00.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.229+0000 7ff518940800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198ac728a0 0x56198ac72ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.229+0000 7ff518940800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56198ac43ee0 con 0x56198ac728a0 2024-09-12T17:28:00.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.229+0000 7ff514ec1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198ac728a0 0x56198ac72ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.229+0000 7ff514ec1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198ac728a0 0x56198ac72ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56806/0 (socket says 172.21.15.170:56806) 2024-09-12T17:28:00.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.229+0000 7ff514ec1640 1 -- 172.21.15.170:0/3188858788 learned_addr learned my addr 172.21.15.170:0/3188858788 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:00.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.229+0000 7ff514ec1640 1 -- 172.21.15.170:0/3188858788 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56198ac73290 con 0x56198ac728a0 2024-09-12T17:28:00.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.229+0000 7ff514ec1640 1 --2- 172.21.15.170:0/3188858788 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198ac728a0 0x56198ac72ca0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff504053300 tx=0x7ff504015f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd88473705d88a80 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.230+0000 7ff3f37fe640 1 -- 172.21.15.170:0/3188858788 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff504050070 con 0x56198ac728a0 2024-09-12T17:28:00.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.230+0000 7ff3f37fe640 1 -- 172.21.15.170:0/3188858788 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5040156f0 con 0x56198ac728a0 2024-09-12T17:28:00.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.230+0000 7ff3f37fe640 1 -- 172.21.15.170:0/3188858788 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff504043030 con 0x56198ac728a0 2024-09-12T17:28:00.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.230+0000 7ff518940800 1 -- 172.21.15.170:0/3188858788 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198ac728a0 msgr2=0x56198ac72ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.230+0000 7ff518940800 1 --2- 172.21.15.170:0/3188858788 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198ac728a0 0x56198ac72ca0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff504053300 tx=0x7ff504015f20 comp rx=0 tx=0).stop 2024-09-12T17:28:00.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.230+0000 7ff518940800 1 -- 172.21.15.170:0/3188858788 shutdown_connections 2024-09-12T17:28:00.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.230+0000 7ff518940800 1 --2- 172.21.15.170:0/3188858788 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198ac728a0 0x56198ac72ca0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.230+0000 7ff518940800 1 -- 172.21.15.170:0/3188858788 >> 172.21.15.170:0/3188858788 conn(0x56198ac6ece0 msgr2=0x56198ac6cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:00.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.230+0000 7ff518940800 1 -- 172.21.15.170:0/3188858788 shutdown_connections 2024-09-12T17:28:00.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.230+0000 7ff518940800 1 -- 172.21.15.170:0/3188858788 wait complete. 2024-09-12T17:28:00.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.230+0000 7ff518940800 1 Processor -- start 2024-09-12T17:28:00.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.230+0000 7ff518940800 1 -- start start 2024-09-12T17:28:00.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.231+0000 7ff518940800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198ac728a0 0x56198ac79ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.231+0000 7ff518940800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56198ac738b0 con 0x56198ac728a0 2024-09-12T17:28:00.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.231+0000 7ff514ec1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198ac728a0 0x56198ac79ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.231+0000 7ff514ec1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198ac728a0 0x56198ac79ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56810/0 (socket says 172.21.15.170:56810) 2024-09-12T17:28:00.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.231+0000 7ff514ec1640 1 -- 172.21.15.170:0/1924919700 learned_addr learned my addr 172.21.15.170:0/1924919700 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:00.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.231+0000 7ff514ec1640 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56198ac7a400 con 0x56198ac728a0 2024-09-12T17:28:00.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.231+0000 7ff514ec1640 1 --2- 172.21.15.170:0/1924919700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198ac728a0 0x56198ac79ea0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff5040206f0 tx=0x7ff504053260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.232+0000 7ff3f1ffb640 1 -- 172.21.15.170:0/1924919700 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff504050050 con 0x56198ac728a0 2024-09-12T17:28:00.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.232+0000 7ff3f1ffb640 1 -- 172.21.15.170:0/1924919700 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff50400b230 con 0x56198ac728a0 2024-09-12T17:28:00.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.232+0000 7ff3f1ffb640 1 -- 172.21.15.170:0/1924919700 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff504013320 con 0x56198ac728a0 2024-09-12T17:28:00.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.232+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56198ac7a690 con 0x56198ac728a0 2024-09-12T17:28:00.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.232+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56198ac7b010 con 0x56198ac728a0 2024-09-12T17:28:00.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.232+0000 7ff3f1ffb640 1 -- 172.21.15.170:0/1924919700 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ff504031030 con 0x56198ac728a0 2024-09-12T17:28:00.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.233+0000 7ff3f1ffb640 1 --2- 172.21.15.170:0/1924919700 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff3e403c780 0x7ff3e403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.233+0000 7ff3f1ffb640 1 -- 172.21.15.170:0/1924919700 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7ff50402f070 con 0x56198ac728a0 2024-09-12T17:28:00.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.233+0000 7ff5146c0640 1 --2- 172.21.15.170:0/1924919700 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff3e403c780 0x7ff3e403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.233+0000 7ff518940800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.233+0000 7ff518940800 1 --2- 172.21.15.170:0/1924919700 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56198ac85720 0x56198ac87be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.233+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56198ac88330 con 0x56198ac85720 2024-09-12T17:28:00.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.233+0000 7ff513ebf640 1 --2- 172.21.15.170:0/1924919700 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56198ac85720 0x56198ac87be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.233+0000 7ff5146c0640 1 --2- 172.21.15.170:0/1924919700 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff3e403c780 0x7ff3e403ec40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff50c010f40 tx=0x7ff50c046000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.233+0000 7ff513ebf640 1 --2- 172.21.15.170:0/1924919700 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56198ac85720 0x56198ac87be0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.234+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff4fc051070 con 0x56198ac85720 2024-09-12T17:28:00.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.234+0000 7ff518940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.234+0000 7ff518940800 20 realm 2024-09-12T17:28:00.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.234+0000 7ff518940800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.234+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56198ac88760 con 0x56198ac85720 2024-09-12T17:28:00.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.234+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff4fc051070 con 0x56198ac85720 2024-09-12T17:28:00.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.234+0000 7ff518940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.234+0000 7ff518940800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:00.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.234+0000 7ff518940800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.234+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56198ac89030 con 0x56198ac85720 2024-09-12T17:28:00.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.234+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff4fc051070 con 0x56198ac85720 2024-09-12T17:28:00.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.234+0000 7ff518940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.234+0000 7ff518940800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.234+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56198ac893d0 con 0x56198ac85720 2024-09-12T17:28:00.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.234+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff4fc051070 con 0x56198ac85720 2024-09-12T17:28:00.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.234+0000 7ff518940800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:00.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.234+0000 7ff518940800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.234+0000 7ff518940800 1 --2- 172.21.15.170:0/1924919700 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56198ac8a130 0x56198ac8c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.234+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56198ac8ca60 con 0x56198ac8a130 2024-09-12T17:28:00.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.234+0000 7ff514ec1640 1 --2- 172.21.15.170:0/1924919700 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56198ac8a130 0x56198ac8c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.235+0000 7ff514ec1640 1 --2- 172.21.15.170:0/1924919700 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56198ac8a130 0x56198ac8c520 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.235+0000 7ff514ec1640 1 -- 172.21.15.170:0/1924919700 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff5040083e0 con 0x56198ac8a130 2024-09-12T17:28:00.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.235+0000 7ff518940800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:00.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.235+0000 7ff518940800 20 searching for the correct realm 2024-09-12T17:28:00.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.235+0000 7ff518940800 1 --2- 172.21.15.170:0/1924919700 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x56198ac8eaa0 0x56198ac90f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.235+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56198ac91630 con 0x56198ac8eaa0 2024-09-12T17:28:00.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.235+0000 7ff5146c0640 1 --2- 172.21.15.170:0/1924919700 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x56198ac8eaa0 0x56198ac90f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.235+0000 7ff5146c0640 1 --2- 172.21.15.170:0/1924919700 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x56198ac8eaa0 0x56198ac90f60 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.236+0000 7ff5146c0640 1 -- 172.21.15.170:0/1924919700 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff50c01b070 con 0x56198ac8eaa0 2024-09-12T17:28:00.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.236+0000 7ff5146c0640 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56198ac91630 con 0x56198ac8a130 2024-09-12T17:28:00.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.236+0000 7ff514ec1640 1 -- 172.21.15.170:0/1924919700 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5040083e0 con 0x56198ac8a130 2024-09-12T17:28:00.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.236+0000 7ff514ec1640 1 --2- 172.21.15.170:0/1924919700 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7ff504021020 0x7ff504052270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.236+0000 7ff514ec1640 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56198ac91630 con 0x7ff504021020 2024-09-12T17:28:00.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.236+0000 7ff513ebf640 1 --2- 172.21.15.170:0/1924919700 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7ff504021020 0x7ff504052270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.236+0000 7ff513ebf640 1 --2- 172.21.15.170:0/1924919700 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7ff504021020 0x7ff504052270 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.237+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4fc051070 con 0x7ff504021020 2024-09-12T17:28:00.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.237+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56198ac91630 con 0x56198ac85720 2024-09-12T17:28:00.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.237+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4fc051070 con 0x56198ac85720 2024-09-12T17:28:00.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.237+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56198ac91630 con 0x56198ac85720 2024-09-12T17:28:00.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.237+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4fc051070 con 0x56198ac85720 2024-09-12T17:28:00.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.237+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56198ac91630 con 0x7ff504021020 2024-09-12T17:28:00.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.237+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4fc051070 con 0x7ff504021020 2024-09-12T17:28:00.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.237+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56198ac91630 con 0x7ff504021020 2024-09-12T17:28:00.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.238+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4fc051070 con 0x7ff504021020 2024-09-12T17:28:00.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.238+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56198ac91630 con 0x56198ac8a130 2024-09-12T17:28:00.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.238+0000 7ff514ec1640 1 -- 172.21.15.170:0/1924919700 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5040083e0 con 0x56198ac8a130 2024-09-12T17:28:00.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.238+0000 7ff514ec1640 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56198ac91630 con 0x56198ac8eaa0 2024-09-12T17:28:00.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.238+0000 7ff5146c0640 1 -- 172.21.15.170:0/1924919700 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff50c01b070 con 0x56198ac8eaa0 2024-09-12T17:28:00.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.238+0000 7ff5146c0640 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56198ac91630 con 0x56198ac85720 2024-09-12T17:28:00.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.238+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4fc051070 con 0x56198ac85720 2024-09-12T17:28:00.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.238+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56198ac91630 con 0x7ff504021020 2024-09-12T17:28:00.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.239+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4fc051070 con 0x7ff504021020 2024-09-12T17:28:00.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.239+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56198ac91630 con 0x56198ac85720 2024-09-12T17:28:00.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.239+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4fc051070 con 0x56198ac85720 2024-09-12T17:28:00.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.239+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56198ac91630 con 0x56198ac8a130 2024-09-12T17:28:00.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.239+0000 7ff514ec1640 1 -- 172.21.15.170:0/1924919700 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7ff5040083e0 con 0x56198ac8a130 2024-09-12T17:28:00.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.239+0000 7ff514ec1640 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56198ac91630 con 0x56198ac8eaa0 2024-09-12T17:28:00.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.239+0000 7ff5146c0640 1 -- 172.21.15.170:0/1924919700 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff50c01b070 con 0x56198ac8eaa0 2024-09-12T17:28:00.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.239+0000 7ff5146c0640 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56198ac91630 con 0x56198ac8eaa0 2024-09-12T17:28:00.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.239+0000 7ff5146c0640 1 -- 172.21.15.170:0/1924919700 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff50c01b070 con 0x56198ac8eaa0 2024-09-12T17:28:00.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.239+0000 7ff5146c0640 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56198ac91630 con 0x7ff504021020 2024-09-12T17:28:00.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.240+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4fc051070 con 0x7ff504021020 2024-09-12T17:28:00.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.240+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56198ac91630 con 0x56198ac8eaa0 2024-09-12T17:28:00.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.240+0000 7ff5146c0640 1 -- 172.21.15.170:0/1924919700 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff50c01b070 con 0x56198ac8eaa0 2024-09-12T17:28:00.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.240+0000 7ff5146c0640 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56198ac91630 con 0x56198ac8eaa0 2024-09-12T17:28:00.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.240+0000 7ff5146c0640 1 -- 172.21.15.170:0/1924919700 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff50c01b070 con 0x56198ac8eaa0 2024-09-12T17:28:00.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.240+0000 7ff5146c0640 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56198ac91630 con 0x56198ac85720 2024-09-12T17:28:00.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.240+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4fc051070 con 0x56198ac85720 2024-09-12T17:28:00.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.240+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56198ac91630 con 0x56198ac85720 2024-09-12T17:28:00.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.240+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff4fc051070 con 0x56198ac85720 2024-09-12T17:28:00.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.240+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56198ac91630 con 0x7ff504021020 2024-09-12T17:28:00.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.241+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4fc051070 con 0x7ff504021020 2024-09-12T17:28:00.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.241+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56198ac91630 con 0x56198ac8eaa0 2024-09-12T17:28:00.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.241+0000 7ff5146c0640 1 -- 172.21.15.170:0/1924919700 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff50c01b070 con 0x56198ac8eaa0 2024-09-12T17:28:00.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.241+0000 7ff5146c0640 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56198ac91630 con 0x56198ac8a130 2024-09-12T17:28:00.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.241+0000 7ff514ec1640 1 -- 172.21.15.170:0/1924919700 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5040083e0 con 0x56198ac8a130 2024-09-12T17:28:00.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.241+0000 7ff514ec1640 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56198ac91630 con 0x56198ac85720 2024-09-12T17:28:00.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.241+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4fc051070 con 0x56198ac85720 2024-09-12T17:28:00.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.241+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56198ac91630 con 0x7ff504021020 2024-09-12T17:28:00.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.242+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4fc051070 con 0x7ff504021020 2024-09-12T17:28:00.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.242+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56198ac91630 con 0x56198ac8eaa0 2024-09-12T17:28:00.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.242+0000 7ff5146c0640 1 -- 172.21.15.170:0/1924919700 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff50c01b070 con 0x56198ac8eaa0 2024-09-12T17:28:00.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.242+0000 7ff5146c0640 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56198ac91630 con 0x7ff504021020 2024-09-12T17:28:00.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.242+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4fc051070 con 0x7ff504021020 2024-09-12T17:28:00.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.242+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56198ac91630 con 0x56198ac8a130 2024-09-12T17:28:00.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.242+0000 7ff514ec1640 1 -- 172.21.15.170:0/1924919700 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5040083e0 con 0x56198ac8a130 2024-09-12T17:28:00.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.242+0000 7ff514ec1640 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56198ac91630 con 0x56198ac8eaa0 2024-09-12T17:28:00.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.243+0000 7ff5146c0640 1 -- 172.21.15.170:0/1924919700 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff50c01b070 con 0x56198ac8eaa0 2024-09-12T17:28:00.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.243+0000 7ff5146c0640 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56198ac91630 con 0x7ff504021020 2024-09-12T17:28:00.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.243+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4fc051070 con 0x7ff504021020 2024-09-12T17:28:00.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.243+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56198ac91630 con 0x56198ac85720 2024-09-12T17:28:00.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.243+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff4fc051070 con 0x56198ac85720 2024-09-12T17:28:00.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.243+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56198ac91630 con 0x56198ac8a130 2024-09-12T17:28:00.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.243+0000 7ff514ec1640 1 -- 172.21.15.170:0/1924919700 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff5040083e0 con 0x56198ac8a130 2024-09-12T17:28:00.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.243+0000 7ff518940800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:00.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.243+0000 7ff518940800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:00.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.243+0000 7ff518940800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:00.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.243+0000 7ff518940800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:00.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.243+0000 7ff518940800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:00.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.243+0000 7ff518940800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:00.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.243+0000 7ff518940800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.243+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56198ac8d4a0 con 0x56198ac85720 2024-09-12T17:28:00.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.244+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff4fc051070 con 0x56198ac85720 2024-09-12T17:28:00.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.244+0000 7ff518940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.244+0000 7ff518940800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.244+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56198ac8d080 con 0x56198ac85720 2024-09-12T17:28:00.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.244+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff4fc051070 con 0x56198ac85720 2024-09-12T17:28:00.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.244+0000 7ff518940800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:00.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.244+0000 7ff518940800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.244+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56198ac8ddc0 con 0x56198ac8a130 2024-09-12T17:28:00.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.244+0000 7ff514ec1640 1 -- 172.21.15.170:0/1924919700 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff5040083e0 con 0x56198ac8a130 2024-09-12T17:28:00.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.244+0000 7ff518940800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:00.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.244+0000 7ff518940800 20 zone default found 2024-09-12T17:28:00.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.244+0000 7ff518940800 4 Realm: () 2024-09-12T17:28:00.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.244+0000 7ff518940800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:00.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.244+0000 7ff518940800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:00.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.244+0000 7ff518940800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:00.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.244+0000 7ff518940800 20 zonegroup default 2024-09-12T17:28:00.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.244+0000 7ff518940800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.244+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56198ac91ab0 con 0x7ff504021020 2024-09-12T17:28:00.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.244+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff4fc051070 con 0x7ff504021020 2024-09-12T17:28:00.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.244+0000 7ff518940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.244+0000 7ff518940800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.245+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56198ac93cf0 con 0x56198ac8eaa0 2024-09-12T17:28:00.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.245+0000 7ff5146c0640 1 -- 172.21.15.170:0/1924919700 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff50c01b070 con 0x56198ac8eaa0 2024-09-12T17:28:00.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.245+0000 7ff518940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.245+0000 7ff518940800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.245+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56198ac94090 con 0x56198ac8eaa0 2024-09-12T17:28:00.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.245+0000 7ff5146c0640 1 -- 172.21.15.170:0/1924919700 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff50c01b070 con 0x56198ac8eaa0 2024-09-12T17:28:00.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.245+0000 7ff518940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.245+0000 7ff518940800 20 started sync module instance, tier type = 2024-09-12T17:28:00.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.245+0000 7ff518940800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:00.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.245+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56198ac93130 con 0x56198ac8a130 2024-09-12T17:28:00.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.246+0000 7ff514ec1640 1 -- 172.21.15.170:0/1924919700 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5040083e0 con 0x56198ac8a130 2024-09-12T17:28:00.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.246+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94667702613280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56198ac93130 con 0x56198ac8a130 2024-09-12T17:28:00.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.246+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56198ac94a50 con 0x56198ac85720 2024-09-12T17:28:00.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.247+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4fc051070 con 0x56198ac85720 2024-09-12T17:28:00.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.247+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94667702617504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56198ac94e70 con 0x56198ac85720 2024-09-12T17:28:00.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.247+0000 7ff514ec1640 1 -- 172.21.15.170:0/1924919700 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94667702613280] v29'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5040083e0 con 0x56198ac8a130 2024-09-12T17:28:00.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.247+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56198ac92c80 con 0x56198ac8eaa0 2024-09-12T17:28:00.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.248+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94667702617504] v29'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4fc051070 con 0x56198ac85720 2024-09-12T17:28:00.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.248+0000 7ff5146c0640 1 -- 172.21.15.170:0/1924919700 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff50c01b070 con 0x56198ac8eaa0 2024-09-12T17:28:00.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.248+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94667702621280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56198ac94e70 con 0x56198ac8eaa0 2024-09-12T17:28:00.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.248+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56198ac95f70 con 0x56198ac8a130 2024-09-12T17:28:00.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.249+0000 7ff5146c0640 1 -- 172.21.15.170:0/1924919700 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94667702621280] v29'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff50c01b070 con 0x56198ac8eaa0 2024-09-12T17:28:00.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.249+0000 7ff514ec1640 1 -- 172.21.15.170:0/1924919700 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5040083e0 con 0x56198ac8a130 2024-09-12T17:28:00.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.249+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94667702619040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56198ac95f70 con 0x56198ac8a130 2024-09-12T17:28:00.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.249+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56198ac96970 con 0x56198ac85720 2024-09-12T17:28:00.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.250+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4fc051070 con 0x56198ac85720 2024-09-12T17:28:00.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.251+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94667702625408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56198ac968e0 con 0x56198ac85720 2024-09-12T17:28:00.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.251+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56198ac97900 con 0x7ff504021020 2024-09-12T17:28:00.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.251+0000 7ff514ec1640 1 -- 172.21.15.170:0/1924919700 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94667702619040] v29'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5040083e0 con 0x56198ac8a130 2024-09-12T17:28:00.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.252+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94667702625408] v29'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4fc051070 con 0x56198ac85720 2024-09-12T17:28:00.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.252+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4fc051070 con 0x7ff504021020 2024-09-12T17:28:00.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.252+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94667702622912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56198ac97900 con 0x7ff504021020 2024-09-12T17:28:00.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.252+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56198ac96e70 con 0x7ff504021020 2024-09-12T17:28:00.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.252+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v29'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4fc051070 con 0x7ff504021020 2024-09-12T17:28:00.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.253+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94667702631136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56198ac96e70 con 0x7ff504021020 2024-09-12T17:28:00.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.253+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56198ac98d00 con 0x7ff504021020 2024-09-12T17:28:00.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.253+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94667702622912] v29'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4fc051070 con 0x7ff504021020 2024-09-12T17:28:00.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.253+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(58 notify.7 [create] v29'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4fc051070 con 0x7ff504021020 2024-09-12T17:28:00.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.254+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94667702629344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56198ac98cc0 con 0x7ff504021020 2024-09-12T17:28:00.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.254+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94667702631136] v29'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4fc051070 con 0x7ff504021020 2024-09-12T17:28:00.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.254+0000 7ff518940800 20 add_watcher() i=0 2024-09-12T17:28:00.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.254+0000 7ff518940800 20 add_watcher() i=1 2024-09-12T17:28:00.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.254+0000 7ff518940800 20 add_watcher() i=2 2024-09-12T17:28:00.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.254+0000 7ff518940800 20 add_watcher() i=3 2024-09-12T17:28:00.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.254+0000 7ff518940800 20 add_watcher() i=4 2024-09-12T17:28:00.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.254+0000 7ff518940800 20 add_watcher() i=5 2024-09-12T17:28:00.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.254+0000 7ff518940800 20 add_watcher() i=6 2024-09-12T17:28:00.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.255+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94667702629344] v29'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4fc051070 con 0x7ff504021020 2024-09-12T17:28:00.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.255+0000 7ff518940800 20 add_watcher() i=7 2024-09-12T17:28:00.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.255+0000 7ff518940800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:00.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.255+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56198ac9bcf0 con 0x56198ac85720 2024-09-12T17:28:00.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.255+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff4fc051070 con 0x56198ac85720 2024-09-12T17:28:00.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.255+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94667702634512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56198ac99110 con 0x56198ac85720 2024-09-12T17:28:00.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.256+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94667702634512] v29'62 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff4fc051070 con 0x56198ac85720 2024-09-12T17:28:00.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.256+0000 7ff3cafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:00.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.256+0000 7ff518940800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:00.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.256+0000 7ff518940800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:00.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.256+0000 7ff518940800 5 note: GC not initialized 2024-09-12T17:28:00.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.256+0000 7ff3c9fe3640 20 reqs_thread_entry: start 2024-09-12T17:28:00.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.256+0000 7ff518940800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:00.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.256+0000 7ff518940800 20 Filter name: none 2024-09-12T17:28:00.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.257+0000 7ff3c2ffd640 20 reqs_thread_entry: start 2024-09-12T17:28:00.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.257+0000 7ff518940800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.257+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56198acce750 con 0x56198ac85720 2024-09-12T17:28:00.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.257+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff4fc051070 con 0x56198ac85720 2024-09-12T17:28:00.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.257+0000 7ff518940800 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:28:00.271 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T17:27:59.362376Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:27:59.362351Z","tags":[],"group_ids":[]} 2024-09-12T17:28:00.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.258+0000 7ff3cafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:00.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.258+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94667702634512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56198accd620 con 0x56198ac85720 2024-09-12T17:28:00.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.259+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94667702634512] v29'63 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff4fc051070 con 0x56198ac85720 2024-09-12T17:28:00.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.259+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94667702613280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56198ac98810 con 0x56198ac8a130 2024-09-12T17:28:00.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.260+0000 7ff514ec1640 1 -- 172.21.15.170:0/1924919700 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94667702613280] v29'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5040083e0 con 0x56198ac8a130 2024-09-12T17:28:00.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.260+0000 7ff518940800 20 remove_watcher() i=0 2024-09-12T17:28:00.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.260+0000 7ff518940800 2 removed watcher, disabling cache 2024-09-12T17:28:00.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.260+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94667702617504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56198ac98810 con 0x56198ac85720 2024-09-12T17:28:00.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.261+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94667702617504] v29'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4fc051070 con 0x56198ac85720 2024-09-12T17:28:00.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.261+0000 7ff518940800 20 remove_watcher() i=1 2024-09-12T17:28:00.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.261+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94667702621280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56198ac945a0 con 0x56198ac8eaa0 2024-09-12T17:28:00.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.262+0000 7ff5146c0640 1 -- 172.21.15.170:0/1924919700 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94667702621280] v29'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff50c01b070 con 0x56198ac8eaa0 2024-09-12T17:28:00.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.262+0000 7ff518940800 20 remove_watcher() i=2 2024-09-12T17:28:00.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.262+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94667702619040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56198ac98810 con 0x56198ac8a130 2024-09-12T17:28:00.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.263+0000 7ff514ec1640 1 -- 172.21.15.170:0/1924919700 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94667702619040] v29'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5040083e0 con 0x56198ac8a130 2024-09-12T17:28:00.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.263+0000 7ff518940800 20 remove_watcher() i=3 2024-09-12T17:28:00.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.263+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94667702625408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56198ac945a0 con 0x56198ac85720 2024-09-12T17:28:00.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.264+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94667702625408] v29'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4fc051070 con 0x56198ac85720 2024-09-12T17:28:00.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.264+0000 7ff518940800 20 remove_watcher() i=4 2024-09-12T17:28:00.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.264+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94667702622912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56198ac94ba0 con 0x7ff504021020 2024-09-12T17:28:00.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.265+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94667702622912] v29'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4fc051070 con 0x7ff504021020 2024-09-12T17:28:00.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.265+0000 7ff518940800 20 remove_watcher() i=5 2024-09-12T17:28:00.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.265+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94667702631136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56198ac98810 con 0x7ff504021020 2024-09-12T17:28:00.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.266+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94667702631136] v29'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4fc051070 con 0x7ff504021020 2024-09-12T17:28:00.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.266+0000 7ff518940800 20 remove_watcher() i=6 2024-09-12T17:28:00.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.266+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94667702629344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56198ac98810 con 0x7ff504021020 2024-09-12T17:28:00.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.266+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94667702629344] v29'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4fc051070 con 0x7ff504021020 2024-09-12T17:28:00.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.266+0000 7ff518940800 20 remove_watcher() i=7 2024-09-12T17:28:00.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.267+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7ff504021020 msgr2=0x7ff504052270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.267+0000 7ff518940800 1 --2- 172.21.15.170:0/1924919700 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7ff504021020 0x7ff504052270 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.267+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56198ac85720 msgr2=0x56198ac87be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.267+0000 7ff518940800 1 --2- 172.21.15.170:0/1924919700 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56198ac85720 0x56198ac87be0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.267+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56198ac8a130 msgr2=0x56198ac8c520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.267+0000 7ff518940800 1 --2- 172.21.15.170:0/1924919700 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56198ac8a130 0x56198ac8c520 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.267+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x56198ac8eaa0 msgr2=0x56198ac90f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.267+0000 7ff518940800 1 --2- 172.21.15.170:0/1924919700 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x56198ac8eaa0 0x56198ac90f60 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.267+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff3e403c780 msgr2=0x7ff3e403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.267+0000 7ff518940800 1 --2- 172.21.15.170:0/1924919700 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff3e403c780 0x7ff3e403ec40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff50c010f40 tx=0x7ff50c046000 comp rx=0 tx=0).stop 2024-09-12T17:28:00.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.267+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198ac728a0 msgr2=0x56198ac79ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.267+0000 7ff513ebf640 1 -- 172.21.15.170:0/1924919700 reap_dead start 2024-09-12T17:28:00.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.267+0000 7ff518940800 1 --2- 172.21.15.170:0/1924919700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198ac728a0 0x56198ac79ea0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff5040206f0 tx=0x7ff504053260 comp rx=0 tx=0).stop 2024-09-12T17:28:00.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.267+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 shutdown_connections 2024-09-12T17:28:00.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.267+0000 7ff518940800 1 --2- 172.21.15.170:0/1924919700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198ac728a0 0x56198ac79ea0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.267+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 >> 172.21.15.170:0/1924919700 conn(0x56198ac6ece0 msgr2=0x56198ac6cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:00.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.267+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 shutdown_connections 2024-09-12T17:28:00.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.267+0000 7ff518940800 1 -- 172.21.15.170:0/1924919700 wait complete. 2024-09-12T17:28:00.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.267+0000 7ff518940800 1 -- 172.21.15.170:0/1757564178 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff3ec03c730 msgr2=0x7ff3ec03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.267+0000 7ff518940800 1 --2- 172.21.15.170:0/1757564178 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff3ec03c730 0x7ff3ec03ebf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x56198ac57950 tx=0x7ff50c014e90 comp rx=0 tx=0).stop 2024-09-12T17:28:00.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.267+0000 7ff518940800 1 -- 172.21.15.170:0/1757564178 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198ac65e80 msgr2=0x56198ac662a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.267+0000 7ff518940800 1 --2- 172.21.15.170:0/1757564178 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198ac65e80 0x56198ac662a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x56198ac4cea0 tx=0x7ff50400bf30 comp rx=0 tx=0).stop 2024-09-12T17:28:00.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.267+0000 7ff518940800 1 -- 172.21.15.170:0/1757564178 shutdown_connections 2024-09-12T17:28:00.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.267+0000 7ff518940800 1 --2- 172.21.15.170:0/1757564178 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff3ec03c730 0x7ff3ec03ebf0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.267+0000 7ff518940800 1 --2- 172.21.15.170:0/1757564178 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198ac65e80 0x56198ac662a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.267+0000 7ff518940800 1 -- 172.21.15.170:0/1757564178 >> 172.21.15.170:0/1757564178 conn(0x56198ac5a230 msgr2=0x56198ac5a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:00.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.267+0000 7ff518940800 1 -- 172.21.15.170:0/1757564178 shutdown_connections 2024-09-12T17:28:00.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.267+0000 7ff518940800 1 -- 172.21.15.170:0/1757564178 wait complete. 2024-09-12T17:28:00.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.268+0000 7ff518940800 1 -- 172.21.15.170:0/447534499 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56198ab51fe0 msgr2=0x56198ac52600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.268+0000 7ff518940800 1 --2- 172.21.15.170:0/447534499 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56198ab51fe0 0x56198ac52600 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.268+0000 7ff518940800 1 -- 172.21.15.170:0/447534499 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56198ac549a0 msgr2=0x56198ac56e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.268+0000 7ff518940800 1 --2- 172.21.15.170:0/447534499 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56198ac549a0 0x56198ac56e20 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.268+0000 7ff518940800 1 -- 172.21.15.170:0/447534499 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff3fc03c780 msgr2=0x7ff3fc03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.268+0000 7ff518940800 1 --2- 172.21.15.170:0/447534499 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff3fc03c780 0x7ff3fc03ec40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc057000 tx=0x7ff4fc052000 comp rx=0 tx=0).stop 2024-09-12T17:28:00.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.268+0000 7ff518940800 1 -- 172.21.15.170:0/447534499 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198ab504c0 msgr2=0x56198ac4afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.268+0000 7ff518940800 1 --2- 172.21.15.170:0/447534499 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198ab504c0 0x56198ac4afb0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff50c001330 tx=0x7ff50c001250 comp rx=0 tx=0).stop 2024-09-12T17:28:00.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.268+0000 7ff518940800 1 -- 172.21.15.170:0/447534499 shutdown_connections 2024-09-12T17:28:00.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.268+0000 7ff518940800 1 --2- 172.21.15.170:0/447534499 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56198ac549a0 0x56198ac56e20 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.268+0000 7ff518940800 1 --2- 172.21.15.170:0/447534499 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff3fc03c780 0x7ff3fc03ec40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.268+0000 7ff518940800 1 --2- 172.21.15.170:0/447534499 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56198ab51fe0 0x56198ac52600 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.268+0000 7ff518940800 1 --2- 172.21.15.170:0/447534499 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56198ab504c0 0x56198ac4afb0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.268+0000 7ff518940800 1 -- 172.21.15.170:0/447534499 >> 172.21.15.170:0/447534499 conn(0x56198ab4c1f0 msgr2=0x56198ac44970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:00.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.268+0000 7ff518940800 1 -- 172.21.15.170:0/447534499 shutdown_connections 2024-09-12T17:28:00.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.268+0000 7ff518940800 1 -- 172.21.15.170:0/447534499 wait complete. 2024-09-12T17:28:00.283 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T17:27:59.362376Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:27:59.362351Z', 'tags': [], 'group_ids': []} 2024-09-12T17:28:00.283 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-12T17:28:00.283 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-12T17:28:00.283 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-09-12T17:28:00.332 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:00.332 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:00.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.331+0000 7fcb8cc20800 1 Processor -- start 2024-09-12T17:28:00.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.331+0000 7fcb8cc20800 1 -- start start 2024-09-12T17:28:00.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.332+0000 7fcb8cc20800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55a8df6c36d0 0x55a8df6c5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.332+0000 7fcb8cc20800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a8df56ce40 con 0x55a8df6c6060 2024-09-12T17:28:00.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.332+0000 7fcb8cc20800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x55a8df537680 con 0x55a8df6c36d0 2024-09-12T17:28:00.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.332+0000 7fcb8a711640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55a8df6c36d0 0x55a8df6c5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.332+0000 7fcb89f10640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x55a8df6c6060 0x55a8df6c8500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:48304/0 (socket says 172.21.15.170:48304) 2024-09-12T17:28:00.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.332+0000 7fcb8a711640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55a8df6c36d0 0x55a8df6c5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56812/0 (socket says 172.21.15.170:56812) 2024-09-12T17:28:00.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.332+0000 7fcb89f10640 1 -- 172.21.15.170:0/2664176354 learned_addr learned my addr 172.21.15.170:0/2664176354 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:28:00.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.332+0000 7fcb8a711640 1 -- 172.21.15.170:0/2664176354 >> v1:172.21.15.47:6789/0 conn(0x55a8df6c6060 legacy=0x55a8df6c8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.332+0000 7fcb8970f640 1 -- 172.21.15.170:0/2664176354 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2005790538 0 0) 0x55a8df56ce40 con 0x55a8df6c6060 2024-09-12T17:28:00.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.332+0000 7fcb8a711640 1 -- 172.21.15.170:0/2664176354 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8df5536b0 con 0x55a8df6c36d0 2024-09-12T17:28:00.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.334+0000 7fcb8a711640 1 --2- 172.21.15.170:0/2664176354 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8df6c36d0 0x55a8df6c5ac0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c005fd0 tx=0x7fcb7c045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2881e916afd490da server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.334+0000 7fcb8970f640 1 -- 172.21.15.170:0/2664176354 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb7c058530 con 0x55a8df6c36d0 2024-09-12T17:28:00.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.334+0000 7fcb8970f640 1 -- 172.21.15.170:0/2664176354 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb7c0586d0 con 0x55a8df6c36d0 2024-09-12T17:28:00.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.334+0000 7fcb8970f640 1 -- 172.21.15.170:0/2664176354 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb7c0589d0 con 0x55a8df6c36d0 2024-09-12T17:28:00.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.335+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2664176354 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8df6c36d0 msgr2=0x55a8df6c5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.335+0000 7fcb8cc20800 1 --2- 172.21.15.170:0/2664176354 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8df6c36d0 0x55a8df6c5ac0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c005fd0 tx=0x7fcb7c045c30 comp rx=0 tx=0).stop 2024-09-12T17:28:00.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.335+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2664176354 shutdown_connections 2024-09-12T17:28:00.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.335+0000 7fcb8cc20800 1 --2- 172.21.15.170:0/2664176354 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8df6c36d0 0x55a8df6c5ac0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.335+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2664176354 >> 172.21.15.170:0/2664176354 conn(0x55a8df6bd210 msgr2=0x55a8df6bf650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:00.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.335+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2664176354 shutdown_connections 2024-09-12T17:28:00.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.335+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2664176354 wait complete. 2024-09-12T17:28:00.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.349+0000 7fcb8cc20800 1 Processor -- start 2024-09-12T17:28:00.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.349+0000 7fcb8cc20800 1 -- start start 2024-09-12T17:28:00.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.349+0000 7fcb8cc20800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8df6c36d0 0x55a8df7b2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.349+0000 7fcb8cc20800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a8df55bdd0 con 0x55a8df6c36d0 2024-09-12T17:28:00.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.349+0000 7fcb8a711640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8df6c36d0 0x55a8df7b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.349+0000 7fcb8a711640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8df6c36d0 0x55a8df7b2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56820/0 (socket says 172.21.15.170:56820) 2024-09-12T17:28:00.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.349+0000 7fcb8a711640 1 -- 172.21.15.170:0/1076111963 learned_addr learned my addr 172.21.15.170:0/1076111963 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:00.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.350+0000 7fcb8a711640 1 -- 172.21.15.170:0/1076111963 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8df574e10 con 0x55a8df6c36d0 2024-09-12T17:28:00.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.350+0000 7fcb8a711640 1 --2- 172.21.15.170:0/1076111963 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8df6c36d0 0x55a8df7b2520 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c025a60 tx=0x7fcb7c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9767b3a7d4eb4d69 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.350+0000 7fca78608640 1 -- 172.21.15.170:0/1076111963 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb7c058a30 con 0x55a8df6c36d0 2024-09-12T17:28:00.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.350+0000 7fca78608640 1 -- 172.21.15.170:0/1076111963 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb7c068070 con 0x55a8df6c36d0 2024-09-12T17:28:00.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.350+0000 7fca78608640 1 -- 172.21.15.170:0/1076111963 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb7c058d00 con 0x55a8df6c36d0 2024-09-12T17:28:00.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.351+0000 7fcb8cc20800 1 -- 172.21.15.170:0/1076111963 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8df6c36d0 msgr2=0x55a8df7b2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.351+0000 7fcb8cc20800 1 --2- 172.21.15.170:0/1076111963 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8df6c36d0 0x55a8df7b2520 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c025a60 tx=0x7fcb7c051000 comp rx=0 tx=0).stop 2024-09-12T17:28:00.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.351+0000 7fcb8cc20800 1 -- 172.21.15.170:0/1076111963 shutdown_connections 2024-09-12T17:28:00.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.351+0000 7fcb8cc20800 1 --2- 172.21.15.170:0/1076111963 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8df6c36d0 0x55a8df7b2520 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.351+0000 7fcb8cc20800 1 -- 172.21.15.170:0/1076111963 >> 172.21.15.170:0/1076111963 conn(0x55a8df6bd210 msgr2=0x55a8df7adea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:00.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.351+0000 7fcb8cc20800 1 -- 172.21.15.170:0/1076111963 shutdown_connections 2024-09-12T17:28:00.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.351+0000 7fcb8cc20800 1 -- 172.21.15.170:0/1076111963 wait complete. 2024-09-12T17:28:00.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.351+0000 7fcb8cc20800 1 Processor -- start 2024-09-12T17:28:00.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.351+0000 7fcb8cc20800 1 -- start start 2024-09-12T17:28:00.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.351+0000 7fcb8cc20800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8df6c36d0 0x55a8df7b9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.351+0000 7fcb8cc20800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a8df6ca060 con 0x55a8df6c36d0 2024-09-12T17:28:00.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.351+0000 7fcb8a711640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8df6c36d0 0x55a8df7b9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.351+0000 7fcb8a711640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8df6c36d0 0x55a8df7b9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56828/0 (socket says 172.21.15.170:56828) 2024-09-12T17:28:00.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.351+0000 7fcb8a711640 1 -- 172.21.15.170:0/2596063199 learned_addr learned my addr 172.21.15.170:0/2596063199 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:00.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.352+0000 7fcb8a711640 1 -- 172.21.15.170:0/2596063199 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8df7ba310 con 0x55a8df6c36d0 2024-09-12T17:28:00.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.352+0000 7fcb8a711640 1 --2- 172.21.15.170:0/2596063199 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8df6c36d0 0x55a8df7b9db0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c005bf0 tx=0x7fcb7c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.352+0000 7fca76e05640 1 -- 172.21.15.170:0/2596063199 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb7c063710 con 0x55a8df6c36d0 2024-09-12T17:28:00.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.352+0000 7fca76e05640 1 -- 172.21.15.170:0/2596063199 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb7c0638d0 con 0x55a8df6c36d0 2024-09-12T17:28:00.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.352+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2596063199 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a8df7ba5a0 con 0x55a8df6c36d0 2024-09-12T17:28:00.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.352+0000 7fca76e05640 1 -- 172.21.15.170:0/2596063199 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb7c063bf0 con 0x55a8df6c36d0 2024-09-12T17:28:00.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.352+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2596063199 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8df7bafa0 con 0x55a8df6c36d0 2024-09-12T17:28:00.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.353+0000 7fca76e05640 1 -- 172.21.15.170:0/2596063199 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fcb7c04f3f0 con 0x55a8df6c36d0 2024-09-12T17:28:00.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.353+0000 7fca76e05640 1 --2- 172.21.15.170:0/2596063199 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fca7003c730 0x7fca7003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.353+0000 7fca76e05640 1 -- 172.21.15.170:0/2596063199 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fcb7c097d60 con 0x55a8df6c36d0 2024-09-12T17:28:00.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.353+0000 7fcb89f10640 1 --2- 172.21.15.170:0/2596063199 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fca7003c730 0x7fca7003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.353+0000 7fcb8cc20800 1 --2- 172.21.15.170:0/2596063199 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a8df6c6060 0x55a8df7c1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.353+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2596063199 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a8df7bbb60 con 0x55a8df6c6060 2024-09-12T17:28:00.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.354+0000 7fcb8af12640 1 --2- 172.21.15.170:0/2596063199 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a8df6c6060 0x55a8df7c1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.354+0000 7fcb89f10640 1 --2- 172.21.15.170:0/2596063199 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fca7003c730 0x7fca7003ebf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcb80000c00 tx=0x7fcb800013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.354+0000 7fcb8af12640 1 --2- 172.21.15.170:0/2596063199 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a8df6c6060 0x55a8df7c1400 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.354+0000 7fcb8af12640 1 -- 172.21.15.170:0/2596063199 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb840083e0 con 0x55a8df6c6060 2024-09-12T17:28:00.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.354+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2596063199 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a8df7bb430 con 0x55a8df6c6060 2024-09-12T17:28:00.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.354+0000 7fcb8af12640 1 -- 172.21.15.170:0/2596063199 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcb840083e0 con 0x55a8df6c6060 2024-09-12T17:28:00.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.354+0000 7fcb8cc20800 1 --2- 172.21.15.170:0/2596063199 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a8df7c3890 0x55a8df7c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.354+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2596063199 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a8df7c6350 con 0x55a8df7c3890 2024-09-12T17:28:00.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.354+0000 7fcb8a711640 1 --2- 172.21.15.170:0/2596063199 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a8df7c3890 0x55a8df7c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.355+0000 7fcb8a711640 1 --2- 172.21.15.170:0/2596063199 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a8df7c3890 0x55a8df7c5c80 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.355+0000 7fcb8a711640 1 -- 172.21.15.170:0/2596063199 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcb7c04fc00 con 0x55a8df7c3890 2024-09-12T17:28:00.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.355+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2596063199 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a8df7c2730 con 0x55a8df6c6060 2024-09-12T17:28:00.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.355+0000 7fcb8af12640 1 -- 172.21.15.170:0/2596063199 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcb840083e0 con 0x55a8df6c6060 2024-09-12T17:28:00.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.355+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2596063199 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a8df7c2c10 con 0x55a8df7c3890 2024-09-12T17:28:00.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.356+0000 7fcb8a711640 1 -- 172.21.15.170:0/2596063199 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcb7c04fc00 con 0x55a8df7c3890 2024-09-12T17:28:00.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.356+0000 7fcb8cc20800 1 Processor -- start 2024-09-12T17:28:00.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.356+0000 7fcb8cc20800 1 -- start start 2024-09-12T17:28:00.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.356+0000 7fcb8cc20800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8df6c2e70 0x55a8df6c16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.356+0000 7fcb8cc20800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a8df5b9a00 con 0x55a8df6c2e70 2024-09-12T17:28:00.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.356+0000 7fcb8af12640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8df6c2e70 0x55a8df6c16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.356+0000 7fcb8af12640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8df6c2e70 0x55a8df6c16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56840/0 (socket says 172.21.15.170:56840) 2024-09-12T17:28:00.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.356+0000 7fcb8af12640 1 -- 172.21.15.170:0/3023341347 learned_addr learned my addr 172.21.15.170:0/3023341347 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:00.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.357+0000 7fcb8af12640 1 -- 172.21.15.170:0/3023341347 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8df6c3390 con 0x55a8df6c2e70 2024-09-12T17:28:00.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.357+0000 7fcb8af12640 1 --2- 172.21.15.170:0/3023341347 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8df6c2e70 0x55a8df6c16e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x55a8df7bb3a0 tx=0x7fcb8400bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.357+0000 7fca6ffff640 1 -- 172.21.15.170:0/3023341347 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb8401c020 con 0x55a8df6c2e70 2024-09-12T17:28:00.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.357+0000 7fca6ffff640 1 -- 172.21.15.170:0/3023341347 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb84007c90 con 0x55a8df6c2e70 2024-09-12T17:28:00.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.357+0000 7fcb8cc20800 1 -- 172.21.15.170:0/3023341347 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a8df6c1c20 con 0x55a8df6c2e70 2024-09-12T17:28:00.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.357+0000 7fca6ffff640 1 -- 172.21.15.170:0/3023341347 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb84018440 con 0x55a8df6c2e70 2024-09-12T17:28:00.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.357+0000 7fcb8cc20800 1 -- 172.21.15.170:0/3023341347 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8df6c2170 con 0x55a8df6c2e70 2024-09-12T17:28:00.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.358+0000 7fca6ffff640 1 -- 172.21.15.170:0/3023341347 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fcb8401f020 con 0x55a8df6c2e70 2024-09-12T17:28:00.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.358+0000 7fca6ffff640 1 --2- 172.21.15.170:0/3023341347 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fca6403c730 0x7fca6403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.358+0000 7fca6ffff640 1 -- 172.21.15.170:0/3023341347 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fcb84054de0 con 0x55a8df6c2e70 2024-09-12T17:28:00.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.358+0000 7fcb8a711640 1 --2- 172.21.15.170:0/3023341347 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fca6403c730 0x7fca6403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.358+0000 7fcb8cc20800 1 Processor -- start 2024-09-12T17:28:00.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.358+0000 7fcb8cc20800 1 -- start start 2024-09-12T17:28:00.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.358+0000 7fcb8a711640 1 --2- 172.21.15.170:0/3023341347 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fca6403c730 0x7fca6403ebf0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c04ff90 tx=0x7fcb7c096560 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.359+0000 7fcb8cc20800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8df7e38b0 0x55a8df7e3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.359+0000 7fcb8cc20800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a8df7b2cb0 con 0x55a8df7e38b0 2024-09-12T17:28:00.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.359+0000 7fcb8af12640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8df7e38b0 0x55a8df7e3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.359+0000 7fcb8af12640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8df7e38b0 0x55a8df7e3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56852/0 (socket says 172.21.15.170:56852) 2024-09-12T17:28:00.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.359+0000 7fcb8af12640 1 -- 172.21.15.170:0/2730355639 learned_addr learned my addr 172.21.15.170:0/2730355639 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:00.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.359+0000 7fcb8af12640 1 -- 172.21.15.170:0/2730355639 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8df7e42a0 con 0x55a8df7e38b0 2024-09-12T17:28:00.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.359+0000 7fcb8af12640 1 --2- 172.21.15.170:0/2730355639 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8df7e38b0 0x55a8df7e3cb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fcb840532f0 tx=0x7fcb840534c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdb9ace0fb267f8d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.359+0000 7fca6dffb640 1 -- 172.21.15.170:0/2730355639 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb84016c50 con 0x55a8df7e38b0 2024-09-12T17:28:00.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.359+0000 7fca6dffb640 1 -- 172.21.15.170:0/2730355639 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb84016df0 con 0x55a8df7e38b0 2024-09-12T17:28:00.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.359+0000 7fca6dffb640 1 -- 172.21.15.170:0/2730355639 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb84044280 con 0x55a8df7e38b0 2024-09-12T17:28:00.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.360+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2730355639 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8df7e38b0 msgr2=0x55a8df7e3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.360+0000 7fcb8cc20800 1 --2- 172.21.15.170:0/2730355639 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8df7e38b0 0x55a8df7e3cb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fcb840532f0 tx=0x7fcb840534c0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.360+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2730355639 shutdown_connections 2024-09-12T17:28:00.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.360+0000 7fcb8cc20800 1 --2- 172.21.15.170:0/2730355639 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8df7e38b0 0x55a8df7e3cb0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.360+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2730355639 >> 172.21.15.170:0/2730355639 conn(0x55a8df7dfcb0 msgr2=0x55a8df7ddef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:00.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.360+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2730355639 shutdown_connections 2024-09-12T17:28:00.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.360+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2730355639 wait complete. 2024-09-12T17:28:00.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.360+0000 7fcb8cc20800 1 Processor -- start 2024-09-12T17:28:00.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.360+0000 7fcb8cc20800 1 -- start start 2024-09-12T17:28:00.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.360+0000 7fcb8cc20800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8df7e38b0 0x55a8df7eaec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.360+0000 7fcb8cc20800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a8df7e48c0 con 0x55a8df7e38b0 2024-09-12T17:28:00.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.360+0000 7fcb8af12640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8df7e38b0 0x55a8df7eaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.360+0000 7fcb8af12640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8df7e38b0 0x55a8df7eaec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56860/0 (socket says 172.21.15.170:56860) 2024-09-12T17:28:00.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.360+0000 7fcb8af12640 1 -- 172.21.15.170:0/2247996332 learned_addr learned my addr 172.21.15.170:0/2247996332 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:00.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.361+0000 7fcb8af12640 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8df7eb420 con 0x55a8df7e38b0 2024-09-12T17:28:00.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.361+0000 7fcb8af12640 1 --2- 172.21.15.170:0/2247996332 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8df7e38b0 0x55a8df7eaec0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcb84015aa0 tx=0x7fcb84053250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.361+0000 7fca5bfff640 1 -- 172.21.15.170:0/2247996332 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb84016c50 con 0x55a8df7e38b0 2024-09-12T17:28:00.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.361+0000 7fca5bfff640 1 -- 172.21.15.170:0/2247996332 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb8402f020 con 0x55a8df7e38b0 2024-09-12T17:28:00.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.361+0000 7fca5bfff640 1 -- 172.21.15.170:0/2247996332 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb84013b10 con 0x55a8df7e38b0 2024-09-12T17:28:00.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.361+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a8df7eb6b0 con 0x55a8df7e38b0 2024-09-12T17:28:00.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.361+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8df7ec030 con 0x55a8df7e38b0 2024-09-12T17:28:00.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.362+0000 7fca5bfff640 1 -- 172.21.15.170:0/2247996332 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fcb84016040 con 0x55a8df7e38b0 2024-09-12T17:28:00.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.362+0000 7fca5bfff640 1 --2- 172.21.15.170:0/2247996332 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fca5403c730 0x7fca5403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.362+0000 7fca5bfff640 1 -- 172.21.15.170:0/2247996332 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fcb84030030 con 0x55a8df7e38b0 2024-09-12T17:28:00.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.363+0000 7fcb8a711640 1 --2- 172.21.15.170:0/2247996332 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fca5403c730 0x7fca5403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.363+0000 7fcb8a711640 1 --2- 172.21.15.170:0/2247996332 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fca5403c730 0x7fca5403ebf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x55a8df7c1a00 tx=0x7fcb7c090000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.363+0000 7fcb8cc20800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.363+0000 7fcb8cc20800 1 --2- 172.21.15.170:0/2247996332 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a8df7f67f0 0x55a8df7f8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.363+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a8df7f9400 con 0x55a8df7f67f0 2024-09-12T17:28:00.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.363+0000 7fcb89f10640 1 --2- 172.21.15.170:0/2247996332 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a8df7f67f0 0x55a8df7f8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.363+0000 7fcb89f10640 1 --2- 172.21.15.170:0/2247996332 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a8df7f67f0 0x55a8df7f8cb0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.364+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb8000f5f0 con 0x55a8df7f67f0 2024-09-12T17:28:00.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.364+0000 7fcb8cc20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.364+0000 7fcb8cc20800 20 realm 2024-09-12T17:28:00.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.364+0000 7fcb8cc20800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.364+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a8df7f5b40 con 0x55a8df7f67f0 2024-09-12T17:28:00.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.364+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb8000f5f0 con 0x55a8df7f67f0 2024-09-12T17:28:00.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.364+0000 7fcb8cc20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.364+0000 7fcb8cc20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:00.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.364+0000 7fcb8cc20800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.364+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a8df7f9ef0 con 0x55a8df7f67f0 2024-09-12T17:28:00.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.364+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb8000f5f0 con 0x55a8df7f67f0 2024-09-12T17:28:00.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.364+0000 7fcb8cc20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.364+0000 7fcb8cc20800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.364+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a8df7fa7c0 con 0x55a8df7f67f0 2024-09-12T17:28:00.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.364+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcb8000f5f0 con 0x55a8df7f67f0 2024-09-12T17:28:00.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.364+0000 7fcb8cc20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:00.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.364+0000 7fcb8cc20800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.364+0000 7fcb8cc20800 1 --2- 172.21.15.170:0/2247996332 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a8df7fb1e0 0x55a8df7fd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.364+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a8df7fdd40 con 0x55a8df7fb1e0 2024-09-12T17:28:00.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.365+0000 7fcb8af12640 1 --2- 172.21.15.170:0/2247996332 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a8df7fb1e0 0x55a8df7fd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.365+0000 7fcb8af12640 1 --2- 172.21.15.170:0/2247996332 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a8df7fb1e0 0x55a8df7fd5d0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.365+0000 7fcb8af12640 1 -- 172.21.15.170:0/2247996332 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcb840083e0 con 0x55a8df7fb1e0 2024-09-12T17:28:00.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.365+0000 7fcb8cc20800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:00.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.365+0000 7fcb8cc20800 20 searching for the correct realm 2024-09-12T17:28:00.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.365+0000 7fcb8cc20800 1 --2- 172.21.15.170:0/2247996332 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55a8df7ffcf0 0x55a8df8021b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.365+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a8df802880 con 0x55a8df7ffcf0 2024-09-12T17:28:00.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.365+0000 7fcb8a711640 1 --2- 172.21.15.170:0/2247996332 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55a8df7ffcf0 0x55a8df8021b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.365+0000 7fcb8a711640 1 --2- 172.21.15.170:0/2247996332 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55a8df7ffcf0 0x55a8df8021b0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.366+0000 7fcb8a711640 1 -- 172.21.15.170:0/2247996332 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb7c088040 con 0x55a8df7ffcf0 2024-09-12T17:28:00.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.366+0000 7fcb8a711640 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a8df802880 con 0x55a8df7fb1e0 2024-09-12T17:28:00.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.366+0000 7fcb8af12640 1 -- 172.21.15.170:0/2247996332 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb840083e0 con 0x55a8df7fb1e0 2024-09-12T17:28:00.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.366+0000 7fcb8af12640 1 --2- 172.21.15.170:0/2247996332 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fcb84021020 0x7fcb84044890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.366+0000 7fcb8af12640 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a8df802880 con 0x7fcb84021020 2024-09-12T17:28:00.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.366+0000 7fcb89f10640 1 --2- 172.21.15.170:0/2247996332 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fcb84021020 0x7fcb84044890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.367+0000 7fcb89f10640 1 --2- 172.21.15.170:0/2247996332 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fcb84021020 0x7fcb84044890 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.367+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb8000f5f0 con 0x7fcb84021020 2024-09-12T17:28:00.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.367+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a8df802880 con 0x55a8df7f67f0 2024-09-12T17:28:00.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.367+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb8000f5f0 con 0x55a8df7f67f0 2024-09-12T17:28:00.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.367+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a8df802880 con 0x55a8df7f67f0 2024-09-12T17:28:00.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.367+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb8002b040 con 0x55a8df7f67f0 2024-09-12T17:28:00.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.367+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a8df802880 con 0x7fcb84021020 2024-09-12T17:28:00.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.368+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb8002b040 con 0x7fcb84021020 2024-09-12T17:28:00.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.368+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a8df802880 con 0x7fcb84021020 2024-09-12T17:28:00.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.368+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb8002b040 con 0x7fcb84021020 2024-09-12T17:28:00.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.368+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a8df802880 con 0x55a8df7fb1e0 2024-09-12T17:28:00.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.368+0000 7fcb8af12640 1 -- 172.21.15.170:0/2247996332 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb840083e0 con 0x55a8df7fb1e0 2024-09-12T17:28:00.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.368+0000 7fcb8af12640 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a8df802880 con 0x55a8df7ffcf0 2024-09-12T17:28:00.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.368+0000 7fcb8a711640 1 -- 172.21.15.170:0/2247996332 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb7c088040 con 0x55a8df7ffcf0 2024-09-12T17:28:00.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.368+0000 7fcb8a711640 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a8df802880 con 0x55a8df7f67f0 2024-09-12T17:28:00.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.369+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb8002b040 con 0x55a8df7f67f0 2024-09-12T17:28:00.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.369+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a8df802880 con 0x7fcb84021020 2024-09-12T17:28:00.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.369+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb8002b040 con 0x7fcb84021020 2024-09-12T17:28:00.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.369+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a8df802880 con 0x55a8df7f67f0 2024-09-12T17:28:00.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.369+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb8002b040 con 0x55a8df7f67f0 2024-09-12T17:28:00.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.369+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a8df802880 con 0x55a8df7fb1e0 2024-09-12T17:28:00.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.369+0000 7fcb8af12640 1 -- 172.21.15.170:0/2247996332 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fcb840083e0 con 0x55a8df7fb1e0 2024-09-12T17:28:00.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.369+0000 7fcb8af12640 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fcb840610a0 con 0x55a8df7ffcf0 2024-09-12T17:28:00.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.369+0000 7fcb8a711640 1 -- 172.21.15.170:0/2247996332 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb7c088040 con 0x55a8df7ffcf0 2024-09-12T17:28:00.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.369+0000 7fcb8a711640 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fcb840610a0 con 0x55a8df7ffcf0 2024-09-12T17:28:00.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.370+0000 7fcb8a711640 1 -- 172.21.15.170:0/2247996332 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb7c088040 con 0x55a8df7ffcf0 2024-09-12T17:28:00.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.370+0000 7fcb8a711640 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fcb840610a0 con 0x7fcb84021020 2024-09-12T17:28:00.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.370+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb8002b040 con 0x7fcb84021020 2024-09-12T17:28:00.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.370+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fcb840610a0 con 0x55a8df7ffcf0 2024-09-12T17:28:00.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.370+0000 7fcb8a711640 1 -- 172.21.15.170:0/2247996332 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb7c088040 con 0x55a8df7ffcf0 2024-09-12T17:28:00.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.370+0000 7fcb8a711640 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fcb840610a0 con 0x55a8df7ffcf0 2024-09-12T17:28:00.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.370+0000 7fcb8a711640 1 -- 172.21.15.170:0/2247996332 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb7c088040 con 0x55a8df7ffcf0 2024-09-12T17:28:00.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.370+0000 7fcb8a711640 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fcb840610a0 con 0x55a8df7f67f0 2024-09-12T17:28:00.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.371+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb8002b040 con 0x55a8df7f67f0 2024-09-12T17:28:00.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.371+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fcb840610a0 con 0x55a8df7f67f0 2024-09-12T17:28:00.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.371+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcb8002b040 con 0x55a8df7f67f0 2024-09-12T17:28:00.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.371+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fcb840610a0 con 0x7fcb84021020 2024-09-12T17:28:00.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.371+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb8002b040 con 0x7fcb84021020 2024-09-12T17:28:00.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.371+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fcb840610a0 con 0x55a8df7ffcf0 2024-09-12T17:28:00.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.371+0000 7fcb8a711640 1 -- 172.21.15.170:0/2247996332 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb7c088040 con 0x55a8df7ffcf0 2024-09-12T17:28:00.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.371+0000 7fcb8a711640 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fcb840610a0 con 0x55a8df7fb1e0 2024-09-12T17:28:00.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.372+0000 7fcb8af12640 1 -- 172.21.15.170:0/2247996332 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb840083e0 con 0x55a8df7fb1e0 2024-09-12T17:28:00.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.372+0000 7fcb8af12640 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fcb840610a0 con 0x55a8df7f67f0 2024-09-12T17:28:00.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.372+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb8002b040 con 0x55a8df7f67f0 2024-09-12T17:28:00.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.372+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fcb840610a0 con 0x7fcb84021020 2024-09-12T17:28:00.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.372+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb8003b040 con 0x7fcb84021020 2024-09-12T17:28:00.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.372+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fcb840610a0 con 0x55a8df7ffcf0 2024-09-12T17:28:00.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.372+0000 7fcb8a711640 1 -- 172.21.15.170:0/2247996332 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb7c088040 con 0x55a8df7ffcf0 2024-09-12T17:28:00.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.372+0000 7fcb8a711640 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fcb840610a0 con 0x7fcb84021020 2024-09-12T17:28:00.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.373+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb8003b040 con 0x7fcb84021020 2024-09-12T17:28:00.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.373+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fcb840610a0 con 0x55a8df7fb1e0 2024-09-12T17:28:00.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.373+0000 7fcb8af12640 1 -- 172.21.15.170:0/2247996332 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb8405b040 con 0x55a8df7fb1e0 2024-09-12T17:28:00.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.373+0000 7fcb8af12640 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fcb840610a0 con 0x55a8df7ffcf0 2024-09-12T17:28:00.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.373+0000 7fcb8a711640 1 -- 172.21.15.170:0/2247996332 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb7c088040 con 0x55a8df7ffcf0 2024-09-12T17:28:00.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.373+0000 7fcb8a711640 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fcb840610a0 con 0x7fcb84021020 2024-09-12T17:28:00.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.373+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb8003b040 con 0x7fcb84021020 2024-09-12T17:28:00.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.373+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fcb840610a0 con 0x55a8df7f67f0 2024-09-12T17:28:00.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.374+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcb8003b040 con 0x55a8df7f67f0 2024-09-12T17:28:00.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.374+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fcb840610a0 con 0x55a8df7fb1e0 2024-09-12T17:28:00.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.374+0000 7fcb8af12640 1 -- 172.21.15.170:0/2247996332 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcb8405b040 con 0x55a8df7fb1e0 2024-09-12T17:28:00.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.374+0000 7fcb8cc20800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:00.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.374+0000 7fcb8cc20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:00.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.374+0000 7fcb8cc20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:00.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.374+0000 7fcb8cc20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:00.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.374+0000 7fcb8cc20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:00.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.374+0000 7fcb8cc20800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:00.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.374+0000 7fcb8cc20800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.374+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a8df7fe730 con 0x55a8df7f67f0 2024-09-12T17:28:00.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.374+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb8003b040 con 0x55a8df7f67f0 2024-09-12T17:28:00.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.374+0000 7fcb8cc20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.374+0000 7fcb8cc20800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.374+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a8df7fefd0 con 0x55a8df7f67f0 2024-09-12T17:28:00.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.374+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcb8003b040 con 0x55a8df7f67f0 2024-09-12T17:28:00.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.375+0000 7fcb8cc20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:00.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.375+0000 7fcb8cc20800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.375+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a8df7fe370 con 0x55a8df7fb1e0 2024-09-12T17:28:00.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.375+0000 7fcb8af12640 1 -- 172.21.15.170:0/2247996332 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcb8405b040 con 0x55a8df7fb1e0 2024-09-12T17:28:00.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.375+0000 7fcb8cc20800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:00.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.375+0000 7fcb8cc20800 20 zone default found 2024-09-12T17:28:00.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.375+0000 7fcb8cc20800 4 Realm: () 2024-09-12T17:28:00.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.375+0000 7fcb8cc20800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:00.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.375+0000 7fcb8cc20800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:00.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.375+0000 7fcb8cc20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:00.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.375+0000 7fcb8cc20800 20 zonegroup default 2024-09-12T17:28:00.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.375+0000 7fcb8cc20800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.375+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a8df802d00 con 0x7fcb84021020 2024-09-12T17:28:00.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.375+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcb8003b040 con 0x7fcb84021020 2024-09-12T17:28:00.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.375+0000 7fcb8cc20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.375+0000 7fcb8cc20800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.375+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a8df804ae0 con 0x55a8df7ffcf0 2024-09-12T17:28:00.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.375+0000 7fcb8a711640 1 -- 172.21.15.170:0/2247996332 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcb7c088040 con 0x55a8df7ffcf0 2024-09-12T17:28:00.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.375+0000 7fcb8cc20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.375+0000 7fcb8cc20800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.375+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a8df804f60 con 0x55a8df7ffcf0 2024-09-12T17:28:00.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.376+0000 7fcb8a711640 1 -- 172.21.15.170:0/2247996332 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcb7c088040 con 0x55a8df7ffcf0 2024-09-12T17:28:00.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.376+0000 7fcb8cc20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.376+0000 7fcb8cc20800 20 started sync module instance, tier type = 2024-09-12T17:28:00.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.376+0000 7fcb8cc20800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:00.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.376+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a8df803f80 con 0x55a8df7fb1e0 2024-09-12T17:28:00.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.377+0000 7fcb8af12640 1 -- 172.21.15.170:0/2247996332 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb8405b040 con 0x55a8df7fb1e0 2024-09-12T17:28:00.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.377+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94183792592000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a8df803f80 con 0x55a8df7fb1e0 2024-09-12T17:28:00.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.377+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a8df805a60 con 0x55a8df7f67f0 2024-09-12T17:28:00.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.378+0000 7fcb8af12640 1 -- 172.21.15.170:0/2247996332 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94183792592000] v29'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb8405b040 con 0x55a8df7fb1e0 2024-09-12T17:28:00.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.378+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb8003b040 con 0x55a8df7f67f0 2024-09-12T17:28:00.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.378+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94183792596272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a8df803f80 con 0x55a8df7f67f0 2024-09-12T17:28:00.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.378+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a8df8064f0 con 0x55a8df7ffcf0 2024-09-12T17:28:00.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.379+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94183792596272] v29'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb8003b040 con 0x55a8df7f67f0 2024-09-12T17:28:00.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.379+0000 7fcb8a711640 1 -- 172.21.15.170:0/2247996332 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb7c088040 con 0x55a8df7ffcf0 2024-09-12T17:28:00.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.379+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94183792589520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a8df803ef0 con 0x55a8df7ffcf0 2024-09-12T17:28:00.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.379+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a8df8073e0 con 0x55a8df7fb1e0 2024-09-12T17:28:00.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.380+0000 7fcb8a711640 1 -- 172.21.15.170:0/2247996332 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94183792589520] v29'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb7c088040 con 0x55a8df7ffcf0 2024-09-12T17:28:00.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.380+0000 7fcb8af12640 1 -- 172.21.15.170:0/2247996332 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb8405b040 con 0x55a8df7fb1e0 2024-09-12T17:28:00.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.380+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94183792602928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a8df807350 con 0x55a8df7fb1e0 2024-09-12T17:28:00.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.380+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a8df8082a0 con 0x55a8df7f67f0 2024-09-12T17:28:00.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.381+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb8003b040 con 0x55a8df7f67f0 2024-09-12T17:28:00.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.381+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94183792606704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a8df808210 con 0x55a8df7f67f0 2024-09-12T17:28:00.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.381+0000 7fcb8af12640 1 -- 172.21.15.170:0/2247996332 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94183792602928] v29'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb8405b040 con 0x55a8df7fb1e0 2024-09-12T17:28:00.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.382+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a8df8077f0 con 0x7fcb84021020 2024-09-12T17:28:00.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.382+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb8003b040 con 0x7fcb84021020 2024-09-12T17:28:00.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.383+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94183792610480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a8df8077f0 con 0x7fcb84021020 2024-09-12T17:28:00.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.383+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a8df809be0 con 0x7fcb84021020 2024-09-12T17:28:00.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.383+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94183792606704] v29'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb8003b040 con 0x55a8df7f67f0 2024-09-12T17:28:00.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.383+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v29'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb8003b040 con 0x7fcb84021020 2024-09-12T17:28:00.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.384+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94183792608912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a8df809ba0 con 0x7fcb84021020 2024-09-12T17:28:00.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.384+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a8df80a5a0 con 0x7fcb84021020 2024-09-12T17:28:00.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.384+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94183792610480] v29'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb8003b040 con 0x7fcb84021020 2024-09-12T17:28:00.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.385+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94183792608912] v29'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb8003b040 con 0x7fcb84021020 2024-09-12T17:28:00.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.385+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(58 notify.7 [create] v29'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb8003b040 con 0x7fcb84021020 2024-09-12T17:28:00.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.385+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94183792611536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a8df80a0b0 con 0x7fcb84021020 2024-09-12T17:28:00.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.385+0000 7fcb8cc20800 20 add_watcher() i=0 2024-09-12T17:28:00.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.385+0000 7fcb8cc20800 20 add_watcher() i=1 2024-09-12T17:28:00.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.385+0000 7fcb8cc20800 20 add_watcher() i=2 2024-09-12T17:28:00.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.385+0000 7fcb8cc20800 20 add_watcher() i=3 2024-09-12T17:28:00.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.385+0000 7fcb8cc20800 20 add_watcher() i=4 2024-09-12T17:28:00.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.385+0000 7fcb8cc20800 20 add_watcher() i=5 2024-09-12T17:28:00.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.385+0000 7fcb8cc20800 20 add_watcher() i=6 2024-09-12T17:28:00.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.386+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94183792611536] v29'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb8003b040 con 0x7fcb84021020 2024-09-12T17:28:00.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.386+0000 7fcb8cc20800 20 add_watcher() i=7 2024-09-12T17:28:00.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.386+0000 7fcb8cc20800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:00.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.386+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a8df80d590 con 0x55a8df7f67f0 2024-09-12T17:28:00.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.386+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcb8003b040 con 0x55a8df7f67f0 2024-09-12T17:28:00.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.386+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94183792615600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a8df80a980 con 0x55a8df7f67f0 2024-09-12T17:28:00.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.387+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94183792615600] v29'64 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcb8003b040 con 0x55a8df7f67f0 2024-09-12T17:28:00.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.387+0000 7fca417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:00.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.387+0000 7fcb8cc20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:00.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.387+0000 7fcb8cc20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:00.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.387+0000 7fcb8cc20800 5 note: GC not initialized 2024-09-12T17:28:00.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.387+0000 7fca3b7fe640 20 reqs_thread_entry: start 2024-09-12T17:28:00.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.387+0000 7fcb8cc20800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:00.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.388+0000 7fcb8cc20800 20 Filter name: none 2024-09-12T17:28:00.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.388+0000 7fca397fa640 20 reqs_thread_entry: start 2024-09-12T17:28:00.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.388+0000 7fcb8cc20800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:28:00.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.388+0000 7fcb8cc20800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.388+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a8df840530 con 0x55a8df7f67f0 2024-09-12T17:28:00.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.388+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fcb8003b040 con 0x55a8df7f67f0 2024-09-12T17:28:00.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.388+0000 7fcb8cc20800 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:28:00.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.388+0000 7fcb8cc20800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T17:28:00.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.388+0000 7fcb8cc20800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:28:00.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.388+0000 7fcb8cc20800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:00.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.388+0000 7fcb8cc20800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-12T17:28:00.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.388+0000 7fcb8cc20800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.388+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a8df840e40 con 0x7fcb84021020 2024-09-12T17:28:00.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.389+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fcb8003b040 con 0x7fcb84021020 2024-09-12T17:28:00.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.389+0000 7fcb8cc20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.389+0000 7fcb8cc20800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-12T17:28:00.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.389+0000 7fcb8cc20800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T17:28:00.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.389+0000 7fcb8cc20800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-12T17:28:00.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.389+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~502 in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a8df8467f0 con 0x55a8df7f67f0 2024-09-12T17:28:00.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.390+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~502] v29'4 uv4 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fcb8003b040 con 0x55a8df7f67f0 2024-09-12T17:28:00.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.390+0000 7fcb8cc20800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:28:00.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.390+0000 7fcb8cc20800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:28:00.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.390+0000 7fcb8cc20800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T17:28:00.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.390+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94183792861616 in=690b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a8df841e90 con 0x55a8df7f67f0 2024-09-12T17:28:00.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.390+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== watch-notify(notify (1) cookie 94183792606704 notify 124554051587 ret 0) ==== 720+0+0 (crc 0 0 0) 0x7fcb80018040 con 0x55a8df7f67f0 2024-09-12T17:28:00.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.390+0000 7fca6dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051587 cookie 94183792606704 notifier 4337 bl.length()=678 2024-09-12T17:28:00.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.390+0000 7fca6dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:28:00.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.390+0000 7fca6dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:28:00.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.390+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(65 notify.4 [notify cookie 94183792861616 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcb8003b040 con 0x55a8df7f67f0 2024-09-12T17:28:00.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.390+0000 7fca6dffb640 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fca50003ea0 con 0x55a8df7f67f0 2024-09-12T17:28:00.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.390+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb8003b040 con 0x55a8df7f67f0 2024-09-12T17:28:00.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.390+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== watch-notify(notify_complete (2) cookie 94183792861616 notify 124554051587 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fcb8001dbf0 con 0x55a8df7f67f0 2024-09-12T17:28:00.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.391+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a8df8461b0 con 0x7fcb84021020 2024-09-12T17:28:00.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.392+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v29'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fcb8003b040 con 0x7fcb84021020 2024-09-12T17:28:00.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.392+0000 7fcb8cc20800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-12T17:28:00.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.392+0000 7fcb8cc20800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T17:28:00.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.392+0000 7fcb8cc20800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-12T17:28:00.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.392+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94183792861616 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a8df841fd0 con 0x55a8df7ffcf0 2024-09-12T17:28:00.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.392+0000 7fcb8a711640 1 -- 172.21.15.170:0/2247996332 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== watch-notify(notify (1) cookie 94183792589520 notify 124554051584 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7fcb7c09d070 con 0x55a8df7ffcf0 2024-09-12T17:28:00.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.392+0000 7fca6dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051584 cookie 94183792589520 notifier 4337 bl.length()=177 2024-09-12T17:28:00.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.392+0000 7fca6dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-12T17:28:00.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.392+0000 7fca6dffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T17:28:00.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.392+0000 7fca6dffb640 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fca50003ea0 con 0x55a8df7ffcf0 2024-09-12T17:28:00.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.392+0000 7fcb8a711640 1 -- 172.21.15.170:0/2247996332 <== osd.3 v2:172.21.15.170:6816/2664906588 15 ==== osd_op_reply(68 notify.2 [notify cookie 94183792861616 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcb7c088040 con 0x55a8df7ffcf0 2024-09-12T17:28:00.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.392+0000 7fcb8a711640 1 -- 172.21.15.170:0/2247996332 <== osd.3 v2:172.21.15.170:6816/2664906588 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb7c088040 con 0x55a8df7ffcf0 2024-09-12T17:28:00.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.392+0000 7fcb8a711640 1 -- 172.21.15.170:0/2247996332 <== osd.3 v2:172.21.15.170:6816/2664906588 17 ==== watch-notify(notify_complete (2) cookie 94183792861616 notify 124554051584 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fcb7c095040 con 0x55a8df7ffcf0 2024-09-12T17:28:00.409 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T17:27:59.362376Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-12T17:28:00.390138Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:27:59.362351Z","tags":[],"group_ids":[]} 2024-09-12T17:28:00.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.393+0000 7fca417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:00.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.393+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94183792615600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a8df841a20 con 0x55a8df7f67f0 2024-09-12T17:28:00.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.394+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94183792615600] v29'65 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcb8003b040 con 0x55a8df7f67f0 2024-09-12T17:28:00.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.394+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94183792592000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a8df83e340 con 0x55a8df7fb1e0 2024-09-12T17:28:00.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.395+0000 7fcb8af12640 1 -- 172.21.15.170:0/2247996332 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94183792592000] v29'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb8405b040 con 0x55a8df7fb1e0 2024-09-12T17:28:00.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.395+0000 7fcb8cc20800 20 remove_watcher() i=0 2024-09-12T17:28:00.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.395+0000 7fcb8cc20800 2 removed watcher, disabling cache 2024-09-12T17:28:00.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.395+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94183792596272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a8df83e340 con 0x55a8df7f67f0 2024-09-12T17:28:00.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.396+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94183792596272] v29'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb8003b040 con 0x55a8df7f67f0 2024-09-12T17:28:00.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.396+0000 7fcb8cc20800 20 remove_watcher() i=1 2024-09-12T17:28:00.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.396+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94183792589520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a8df83e340 con 0x55a8df7ffcf0 2024-09-12T17:28:00.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.397+0000 7fcb8a711640 1 -- 172.21.15.170:0/2247996332 <== osd.3 v2:172.21.15.170:6816/2664906588 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94183792589520] v29'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb7c088040 con 0x55a8df7ffcf0 2024-09-12T17:28:00.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.397+0000 7fcb8cc20800 20 remove_watcher() i=2 2024-09-12T17:28:00.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.397+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94183792602928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a8df83e340 con 0x55a8df7fb1e0 2024-09-12T17:28:00.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.398+0000 7fcb8af12640 1 -- 172.21.15.170:0/2247996332 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94183792602928] v29'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb8405b040 con 0x55a8df7fb1e0 2024-09-12T17:28:00.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.398+0000 7fcb8cc20800 20 remove_watcher() i=3 2024-09-12T17:28:00.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.398+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94183792606704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a8df83e340 con 0x55a8df7f67f0 2024-09-12T17:28:00.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.399+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94183792606704] v29'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb8003b040 con 0x55a8df7f67f0 2024-09-12T17:28:00.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.399+0000 7fcb8cc20800 20 remove_watcher() i=4 2024-09-12T17:28:00.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.399+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94183792610480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a8df83e340 con 0x7fcb84021020 2024-09-12T17:28:00.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.401+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94183792610480] v29'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb8003b040 con 0x7fcb84021020 2024-09-12T17:28:00.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.401+0000 7fcb8cc20800 20 remove_watcher() i=5 2024-09-12T17:28:00.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.401+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94183792608912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a8df83e340 con 0x7fcb84021020 2024-09-12T17:28:00.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.402+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94183792608912] v29'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb8003b040 con 0x7fcb84021020 2024-09-12T17:28:00.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.402+0000 7fcb8cc20800 20 remove_watcher() i=6 2024-09-12T17:28:00.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.402+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94183792611536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a8df83e340 con 0x7fcb84021020 2024-09-12T17:28:00.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.403+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94183792611536] v29'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb8003b040 con 0x7fcb84021020 2024-09-12T17:28:00.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.403+0000 7fcb8cc20800 20 remove_watcher() i=7 2024-09-12T17:28:00.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.403+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fcb84021020 msgr2=0x7fcb84044890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.403+0000 7fcb8cc20800 1 --2- 172.21.15.170:0/2247996332 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fcb84021020 0x7fcb84044890 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.403+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a8df7f67f0 msgr2=0x55a8df7f8cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.403+0000 7fcb8cc20800 1 --2- 172.21.15.170:0/2247996332 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a8df7f67f0 0x55a8df7f8cb0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.403+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a8df7fb1e0 msgr2=0x55a8df7fd5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.403+0000 7fcb8cc20800 1 --2- 172.21.15.170:0/2247996332 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a8df7fb1e0 0x55a8df7fd5d0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.403+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55a8df7ffcf0 msgr2=0x55a8df8021b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.403+0000 7fcb8cc20800 1 --2- 172.21.15.170:0/2247996332 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55a8df7ffcf0 0x55a8df8021b0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.403+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fca5403c730 msgr2=0x7fca5403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.403+0000 7fcb8cc20800 1 --2- 172.21.15.170:0/2247996332 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fca5403c730 0x7fca5403ebf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x55a8df7c1a00 tx=0x7fcb7c090000 comp rx=0 tx=0).stop 2024-09-12T17:28:00.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.403+0000 7fcb89f10640 1 -- 172.21.15.170:0/2247996332 reap_dead start 2024-09-12T17:28:00.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.403+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8df7e38b0 msgr2=0x55a8df7eaec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.403+0000 7fcb8cc20800 1 --2- 172.21.15.170:0/2247996332 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8df7e38b0 0x55a8df7eaec0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcb84015aa0 tx=0x7fcb84053250 comp rx=0 tx=0).stop 2024-09-12T17:28:00.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.403+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 shutdown_connections 2024-09-12T17:28:00.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.403+0000 7fcb8cc20800 1 --2- 172.21.15.170:0/2247996332 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8df7e38b0 0x55a8df7eaec0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.403+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 >> 172.21.15.170:0/2247996332 conn(0x55a8df7dfcb0 msgr2=0x55a8df7ddec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:00.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.403+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 shutdown_connections 2024-09-12T17:28:00.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.403+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2247996332 wait complete. 2024-09-12T17:28:00.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.403+0000 7fcb8cc20800 1 -- 172.21.15.170:0/3023341347 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fca6403c730 msgr2=0x7fca6403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.403+0000 7fcb8cc20800 1 --2- 172.21.15.170:0/3023341347 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fca6403c730 0x7fca6403ebf0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c04ff90 tx=0x7fcb7c096560 comp rx=0 tx=0).stop 2024-09-12T17:28:00.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.403+0000 7fcb8cc20800 1 -- 172.21.15.170:0/3023341347 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8df6c2e70 msgr2=0x55a8df6c16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.403+0000 7fcb8cc20800 1 --2- 172.21.15.170:0/3023341347 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8df6c2e70 0x55a8df6c16e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x55a8df7bb3a0 tx=0x7fcb8400bf30 comp rx=0 tx=0).stop 2024-09-12T17:28:00.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.403+0000 7fcb8cc20800 1 -- 172.21.15.170:0/3023341347 shutdown_connections 2024-09-12T17:28:00.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.404+0000 7fcb8cc20800 1 --2- 172.21.15.170:0/3023341347 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fca6403c730 0x7fca6403ebf0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.404+0000 7fcb8cc20800 1 --2- 172.21.15.170:0/3023341347 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8df6c2e70 0x55a8df6c16e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.404+0000 7fcb8cc20800 1 -- 172.21.15.170:0/3023341347 >> 172.21.15.170:0/3023341347 conn(0x55a8df7c8fb0 msgr2=0x55a8df7c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:00.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.404+0000 7fcb8cc20800 1 -- 172.21.15.170:0/3023341347 shutdown_connections 2024-09-12T17:28:00.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.404+0000 7fcb8cc20800 1 -- 172.21.15.170:0/3023341347 wait complete. 2024-09-12T17:28:00.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.404+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2596063199 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a8df6c6060 msgr2=0x55a8df7c1400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.404+0000 7fcb8cc20800 1 --2- 172.21.15.170:0/2596063199 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a8df6c6060 0x55a8df7c1400 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.404+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2596063199 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a8df7c3890 msgr2=0x55a8df7c5c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.404+0000 7fcb8cc20800 1 --2- 172.21.15.170:0/2596063199 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a8df7c3890 0x55a8df7c5c80 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.404+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2596063199 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fca7003c730 msgr2=0x7fca7003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.404+0000 7fcb8cc20800 1 --2- 172.21.15.170:0/2596063199 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fca7003c730 0x7fca7003ebf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcb80000c00 tx=0x7fcb800013b0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.404+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2596063199 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8df6c36d0 msgr2=0x55a8df7b9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.404+0000 7fcb8cc20800 1 --2- 172.21.15.170:0/2596063199 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8df6c36d0 0x55a8df7b9db0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c005bf0 tx=0x7fcb7c003330 comp rx=0 tx=0).stop 2024-09-12T17:28:00.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.404+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2596063199 shutdown_connections 2024-09-12T17:28:00.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.404+0000 7fcb8cc20800 1 --2- 172.21.15.170:0/2596063199 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a8df7c3890 0x55a8df7c5c80 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.404+0000 7fcb8cc20800 1 --2- 172.21.15.170:0/2596063199 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fca7003c730 0x7fca7003ebf0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.404+0000 7fcb8cc20800 1 --2- 172.21.15.170:0/2596063199 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a8df6c6060 0x55a8df7c1400 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.404+0000 7fcb8cc20800 1 --2- 172.21.15.170:0/2596063199 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8df6c36d0 0x55a8df7b9db0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.404+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2596063199 >> 172.21.15.170:0/2596063199 conn(0x55a8df6bd210 msgr2=0x55a8df7b36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:00.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.404+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2596063199 shutdown_connections 2024-09-12T17:28:00.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.404+0000 7fcb8cc20800 1 -- 172.21.15.170:0/2596063199 wait complete. 2024-09-12T17:28:00.421 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T17:27:59.362376Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-12T17:28:00.390138Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:27:59.362351Z', 'tags': [], 'group_ids': []} 2024-09-12T17:28:00.422 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-12T17:28:00.422 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-12T17:28:00.422 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-12T17:28:00.466 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:00.466 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:00.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.465+0000 7fc7b6b35800 1 Processor -- start 2024-09-12T17:28:00.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.466+0000 7fc7b6b35800 1 -- start start 2024-09-12T17:28:00.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.466+0000 7fc7b6b35800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x555c96f543f0 0x555c96f547f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.466+0000 7fc7b6b35800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555c96dffe40 con 0x555c96f54d30 2024-09-12T17:28:00.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.466+0000 7fc7b6b35800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x555c96dca680 con 0x555c96f543f0 2024-09-12T17:28:00.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.466+0000 7fc7b28e4640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x555c96f543f0 0x555c96f547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.466+0000 7fc7aa0e3640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x555c96f54d30 0x555c96f551c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:48312/0 (socket says 172.21.15.170:48312) 2024-09-12T17:28:00.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.466+0000 7fc7b28e4640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x555c96f543f0 0x555c96f547f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56864/0 (socket says 172.21.15.170:56864) 2024-09-12T17:28:00.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.466+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1223978094 learned_addr learned my addr 172.21.15.170:0/1223978094 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:28:00.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.466+0000 7fc7b28e4640 1 -- 172.21.15.170:0/1223978094 >> v1:172.21.15.47:6789/0 conn(0x555c96f54d30 legacy=0x555c96f551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.466+0000 7fc7b28e4640 1 -- 172.21.15.170:0/1223978094 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c96de66b0 con 0x555c96f543f0 2024-09-12T17:28:00.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.468+0000 7fc7b28e4640 1 --2- 172.21.15.170:0/1223978094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c96f543f0 0x555c96f547f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc7a400a470 tx=0x7fc7a4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b696f928092e7ad server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.468+0000 7fc7b20e3640 1 -- 172.21.15.170:0/1223978094 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7a4053570 con 0x555c96f543f0 2024-09-12T17:28:00.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.468+0000 7fc7b20e3640 1 -- 172.21.15.170:0/1223978094 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7a4058070 con 0x555c96f543f0 2024-09-12T17:28:00.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.468+0000 7fc7b20e3640 1 -- 172.21.15.170:0/1223978094 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7a4053880 con 0x555c96f543f0 2024-09-12T17:28:00.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.469+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1223978094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c96f543f0 msgr2=0x555c96f547f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.469+0000 7fc7b6b35800 1 --2- 172.21.15.170:0/1223978094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c96f543f0 0x555c96f547f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc7a400a470 tx=0x7fc7a4045a20 comp rx=0 tx=0).stop 2024-09-12T17:28:00.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.469+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1223978094 shutdown_connections 2024-09-12T17:28:00.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.469+0000 7fc7b6b35800 1 --2- 172.21.15.170:0/1223978094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c96f543f0 0x555c96f547f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.469+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1223978094 >> 172.21.15.170:0/1223978094 conn(0x555c96f501c0 msgr2=0x555c96f52620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:00.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.469+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1223978094 shutdown_connections 2024-09-12T17:28:00.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.469+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1223978094 wait complete. 2024-09-12T17:28:00.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.483+0000 7fc7b6b35800 1 Processor -- start 2024-09-12T17:28:00.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.483+0000 7fc7b6b35800 1 -- start start 2024-09-12T17:28:00.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.483+0000 7fc7b6b35800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c96f543f0 0x555c97047830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.483+0000 7fc7b6b35800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555c96deedd0 con 0x555c96f543f0 2024-09-12T17:28:00.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.483+0000 7fc7b28e4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c96f543f0 0x555c97047830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.483+0000 7fc7b28e4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c96f543f0 0x555c97047830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56876/0 (socket says 172.21.15.170:56876) 2024-09-12T17:28:00.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.483+0000 7fc7b28e4640 1 -- 172.21.15.170:0/3313354100 learned_addr learned my addr 172.21.15.170:0/3313354100 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:00.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.483+0000 7fc7b28e4640 1 -- 172.21.15.170:0/3313354100 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c96e07e10 con 0x555c96f543f0 2024-09-12T17:28:00.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.484+0000 7fc7b28e4640 1 --2- 172.21.15.170:0/3313354100 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c96f543f0 0x555c97047830 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4005870 tx=0x7fc7a4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c5929c71227eb5f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.484+0000 7fc6a0e09640 1 -- 172.21.15.170:0/3313354100 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7a4053aa0 con 0x555c96f543f0 2024-09-12T17:28:00.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.484+0000 7fc6a0e09640 1 -- 172.21.15.170:0/3313354100 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7a4063070 con 0x555c96f543f0 2024-09-12T17:28:00.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.484+0000 7fc6a0e09640 1 -- 172.21.15.170:0/3313354100 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7a4053d70 con 0x555c96f543f0 2024-09-12T17:28:00.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.484+0000 7fc7b6b35800 1 -- 172.21.15.170:0/3313354100 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c96f543f0 msgr2=0x555c97047830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.484+0000 7fc7b6b35800 1 --2- 172.21.15.170:0/3313354100 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c96f543f0 0x555c97047830 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4005870 tx=0x7fc7a4051000 comp rx=0 tx=0).stop 2024-09-12T17:28:00.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.485+0000 7fc7b6b35800 1 -- 172.21.15.170:0/3313354100 shutdown_connections 2024-09-12T17:28:00.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.485+0000 7fc7b6b35800 1 --2- 172.21.15.170:0/3313354100 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c96f543f0 0x555c97047830 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.485+0000 7fc7b6b35800 1 -- 172.21.15.170:0/3313354100 >> 172.21.15.170:0/3313354100 conn(0x555c96f501c0 msgr2=0x555c970431b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:00.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.485+0000 7fc7b6b35800 1 -- 172.21.15.170:0/3313354100 shutdown_connections 2024-09-12T17:28:00.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.485+0000 7fc7b6b35800 1 -- 172.21.15.170:0/3313354100 wait complete. 2024-09-12T17:28:00.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.485+0000 7fc7b6b35800 1 Processor -- start 2024-09-12T17:28:00.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.485+0000 7fc7b6b35800 1 -- start start 2024-09-12T17:28:00.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.485+0000 7fc7b6b35800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c96f543f0 0x555c9704f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.485+0000 7fc7b6b35800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555c96f55d20 con 0x555c96f543f0 2024-09-12T17:28:00.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.485+0000 7fc7b28e4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c96f543f0 0x555c9704f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.485+0000 7fc7b28e4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c96f543f0 0x555c9704f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56892/0 (socket says 172.21.15.170:56892) 2024-09-12T17:28:00.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.485+0000 7fc7b28e4640 1 -- 172.21.15.170:0/497983779 learned_addr learned my addr 172.21.15.170:0/497983779 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:00.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.485+0000 7fc7b28e4640 1 -- 172.21.15.170:0/497983779 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c9704f670 con 0x555c96f543f0 2024-09-12T17:28:00.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.486+0000 7fc7b28e4640 1 --2- 172.21.15.170:0/497983779 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c96f543f0 0x555c9704f110 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4025c20 tx=0x7fc7a4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.486+0000 7fc69f606640 1 -- 172.21.15.170:0/497983779 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7a4077070 con 0x555c96f543f0 2024-09-12T17:28:00.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.486+0000 7fc69f606640 1 -- 172.21.15.170:0/497983779 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7a4068470 con 0x555c96f543f0 2024-09-12T17:28:00.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.486+0000 7fc69f606640 1 -- 172.21.15.170:0/497983779 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7a4053e60 con 0x555c96f543f0 2024-09-12T17:28:00.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.486+0000 7fc7b6b35800 1 -- 172.21.15.170:0/497983779 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555c9704f900 con 0x555c96f543f0 2024-09-12T17:28:00.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.486+0000 7fc7b6b35800 1 -- 172.21.15.170:0/497983779 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c97050300 con 0x555c96f543f0 2024-09-12T17:28:00.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.487+0000 7fc69f606640 1 -- 172.21.15.170:0/497983779 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc7a407a070 con 0x555c96f543f0 2024-09-12T17:28:00.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.487+0000 7fc69f606640 1 --2- 172.21.15.170:0/497983779 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc69803c780 0x7fc69803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.487+0000 7fc69f606640 1 -- 172.21.15.170:0/497983779 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fc7a406f070 con 0x555c96f543f0 2024-09-12T17:28:00.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.487+0000 7fc7aa0e3640 1 --2- 172.21.15.170:0/497983779 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc69803c780 0x7fc69803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.487+0000 7fc7b6b35800 1 --2- 172.21.15.170:0/497983779 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x555c96f54d30 0x555c97056760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.487+0000 7fc7b6b35800 1 -- 172.21.15.170:0/497983779 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555c97050ee0 con 0x555c96f54d30 2024-09-12T17:28:00.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.487+0000 7fc7b30e5640 1 --2- 172.21.15.170:0/497983779 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x555c96f54d30 0x555c97056760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.487+0000 7fc7aa0e3640 1 --2- 172.21.15.170:0/497983779 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc69803c780 0x7fc69803ec40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc79c001d70 tx=0x7fc79c0012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.487+0000 7fc7b30e5640 1 --2- 172.21.15.170:0/497983779 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x555c96f54d30 0x555c97056760 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.488+0000 7fc7b30e5640 1 -- 172.21.15.170:0/497983779 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7ac00a4d0 con 0x555c96f54d30 2024-09-12T17:28:00.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.488+0000 7fc7b6b35800 1 -- 172.21.15.170:0/497983779 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555c970571e0 con 0x555c96f54d30 2024-09-12T17:28:00.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.488+0000 7fc7b30e5640 1 -- 172.21.15.170:0/497983779 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc7ac00a4d0 con 0x555c96f54d30 2024-09-12T17:28:00.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.488+0000 7fc7b6b35800 1 --2- 172.21.15.170:0/497983779 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x555c97058af0 0x555c9705af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.488+0000 7fc7b6b35800 1 -- 172.21.15.170:0/497983779 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555c9705b720 con 0x555c97058af0 2024-09-12T17:28:00.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.488+0000 7fc7b28e4640 1 --2- 172.21.15.170:0/497983779 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x555c97058af0 0x555c9705af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.488+0000 7fc7b28e4640 1 --2- 172.21.15.170:0/497983779 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x555c97058af0 0x555c9705af90 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.489+0000 7fc7b28e4640 1 -- 172.21.15.170:0/497983779 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc7a4079030 con 0x555c97058af0 2024-09-12T17:28:00.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.489+0000 7fc7b6b35800 1 -- 172.21.15.170:0/497983779 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555c97057a30 con 0x555c96f54d30 2024-09-12T17:28:00.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.489+0000 7fc7b30e5640 1 -- 172.21.15.170:0/497983779 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc7ac00a4d0 con 0x555c96f54d30 2024-09-12T17:28:00.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.489+0000 7fc7b6b35800 1 -- 172.21.15.170:0/497983779 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555c97057dd0 con 0x555c97058af0 2024-09-12T17:28:00.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.489+0000 7fc7b28e4640 1 -- 172.21.15.170:0/497983779 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc7a4079030 con 0x555c97058af0 2024-09-12T17:28:00.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.490+0000 7fc7b6b35800 1 Processor -- start 2024-09-12T17:28:00.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.490+0000 7fc7b6b35800 1 -- start start 2024-09-12T17:28:00.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.490+0000 7fc7b6b35800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c97069f70 0x555c9706a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.490+0000 7fc7b6b35800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555c96e4ca00 con 0x555c97069f70 2024-09-12T17:28:00.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.490+0000 7fc7b30e5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c97069f70 0x555c9706a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.490+0000 7fc7b30e5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c97069f70 0x555c9706a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56904/0 (socket says 172.21.15.170:56904) 2024-09-12T17:28:00.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.490+0000 7fc7b30e5640 1 -- 172.21.15.170:0/2149993234 learned_addr learned my addr 172.21.15.170:0/2149993234 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:00.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.490+0000 7fc7b30e5640 1 -- 172.21.15.170:0/2149993234 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c9706a9d0 con 0x555c97069f70 2024-09-12T17:28:00.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.491+0000 7fc7b30e5640 1 --2- 172.21.15.170:0/2149993234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c97069f70 0x555c9706a390 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x555c97050110 tx=0x7fc7ac018e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.491+0000 7fc69ce01640 1 -- 172.21.15.170:0/2149993234 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7ac016ca0 con 0x555c97069f70 2024-09-12T17:28:00.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.491+0000 7fc69ce01640 1 -- 172.21.15.170:0/2149993234 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7ac016e40 con 0x555c97069f70 2024-09-12T17:28:00.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.491+0000 7fc7b6b35800 1 -- 172.21.15.170:0/2149993234 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555c9706b200 con 0x555c97069f70 2024-09-12T17:28:00.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.491+0000 7fc69ce01640 1 -- 172.21.15.170:0/2149993234 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7ac0135a0 con 0x555c97069f70 2024-09-12T17:28:00.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.491+0000 7fc7b6b35800 1 -- 172.21.15.170:0/2149993234 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c9706b7a0 con 0x555c97069f70 2024-09-12T17:28:00.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.492+0000 7fc69ce01640 1 -- 172.21.15.170:0/2149993234 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc7ac011040 con 0x555c97069f70 2024-09-12T17:28:00.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.492+0000 7fc69ce01640 1 --2- 172.21.15.170:0/2149993234 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc68c03c780 0x7fc68c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.492+0000 7fc69ce01640 1 -- 172.21.15.170:0/2149993234 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fc7ac00e040 con 0x555c97069f70 2024-09-12T17:28:00.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.492+0000 7fc7b28e4640 1 --2- 172.21.15.170:0/2149993234 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc68c03c780 0x7fc68c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.492+0000 7fc7b6b35800 1 Processor -- start 2024-09-12T17:28:00.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.492+0000 7fc7b28e4640 1 --2- 172.21.15.170:0/2149993234 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc68c03c780 0x7fc68c03ec40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc7a405d790 tx=0x7fc7a405f7b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.492+0000 7fc7b6b35800 1 -- start start 2024-09-12T17:28:00.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.492+0000 7fc7b6b35800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c97076a10 0x555c97076e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.492+0000 7fc7b6b35800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555c97048020 con 0x555c97076a10 2024-09-12T17:28:00.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.493+0000 7fc7b30e5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c97076a10 0x555c97076e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.493+0000 7fc7b30e5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c97076a10 0x555c97076e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56918/0 (socket says 172.21.15.170:56918) 2024-09-12T17:28:00.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.493+0000 7fc7b30e5640 1 -- 172.21.15.170:0/1592416967 learned_addr learned my addr 172.21.15.170:0/1592416967 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:00.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.493+0000 7fc7b30e5640 1 -- 172.21.15.170:0/1592416967 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c97077400 con 0x555c97076a10 2024-09-12T17:28:00.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.493+0000 7fc7b30e5640 1 --2- 172.21.15.170:0/1592416967 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c97076a10 0x555c97076e10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac019fd0 tx=0x7fc7ac01f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7ee98f54340a153 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.493+0000 7fc6967fc640 1 -- 172.21.15.170:0/1592416967 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7ac02a440 con 0x555c97076a10 2024-09-12T17:28:00.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.493+0000 7fc6967fc640 1 -- 172.21.15.170:0/1592416967 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7ac013c60 con 0x555c97076a10 2024-09-12T17:28:00.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.493+0000 7fc6967fc640 1 -- 172.21.15.170:0/1592416967 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7ac02a5e0 con 0x555c97076a10 2024-09-12T17:28:00.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.494+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1592416967 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c97076a10 msgr2=0x555c97076e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.494+0000 7fc7b6b35800 1 --2- 172.21.15.170:0/1592416967 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c97076a10 0x555c97076e10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac019fd0 tx=0x7fc7ac01f450 comp rx=0 tx=0).stop 2024-09-12T17:28:00.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.494+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1592416967 shutdown_connections 2024-09-12T17:28:00.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.494+0000 7fc7b6b35800 1 --2- 172.21.15.170:0/1592416967 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c97076a10 0x555c97076e10 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.494+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1592416967 >> 172.21.15.170:0/1592416967 conn(0x555c97072e30 msgr2=0x555c97071070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:00.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.494+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1592416967 shutdown_connections 2024-09-12T17:28:00.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.494+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1592416967 wait complete. 2024-09-12T17:28:00.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.494+0000 7fc7b6b35800 1 Processor -- start 2024-09-12T17:28:00.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.494+0000 7fc7b6b35800 1 -- start start 2024-09-12T17:28:00.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.494+0000 7fc7b6b35800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c97076a10 0x555c9707e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.494+0000 7fc7b6b35800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555c97077a20 con 0x555c97076a10 2024-09-12T17:28:00.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.494+0000 7fc7b30e5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c97076a10 0x555c9707e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.494+0000 7fc7b30e5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c97076a10 0x555c9707e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56926/0 (socket says 172.21.15.170:56926) 2024-09-12T17:28:00.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.494+0000 7fc7b30e5640 1 -- 172.21.15.170:0/1901039845 learned_addr learned my addr 172.21.15.170:0/1901039845 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:00.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.495+0000 7fc7b30e5640 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c9707e5c0 con 0x555c97076a10 2024-09-12T17:28:00.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.495+0000 7fc7b30e5640 1 --2- 172.21.15.170:0/1901039845 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c97076a10 0x555c9707e060 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac019fd0 tx=0x7fc7ac042040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.495+0000 7fc694ff9640 1 -- 172.21.15.170:0/1901039845 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7ac012ac0 con 0x555c97076a10 2024-09-12T17:28:00.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.495+0000 7fc694ff9640 1 -- 172.21.15.170:0/1901039845 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7ac012c60 con 0x555c97076a10 2024-09-12T17:28:00.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.495+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555c9707e850 con 0x555c97076a10 2024-09-12T17:28:00.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.495+0000 7fc694ff9640 1 -- 172.21.15.170:0/1901039845 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7ac0523d0 con 0x555c97076a10 2024-09-12T17:28:00.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.495+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c9707f1d0 con 0x555c97076a10 2024-09-12T17:28:00.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.496+0000 7fc694ff9640 1 -- 172.21.15.170:0/1901039845 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc7ac052570 con 0x555c97076a10 2024-09-12T17:28:00.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.496+0000 7fc694ff9640 1 --2- 172.21.15.170:0/1901039845 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc67c03c730 0x7fc67c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.496+0000 7fc694ff9640 1 -- 172.21.15.170:0/1901039845 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fc7ac017450 con 0x555c97076a10 2024-09-12T17:28:00.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.496+0000 7fc7b6b35800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.496+0000 7fc7b28e4640 1 --2- 172.21.15.170:0/1901039845 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc67c03c730 0x7fc67c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.496+0000 7fc7b6b35800 1 --2- 172.21.15.170:0/1901039845 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x555c97089b20 0x555c9708bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.496+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555c9708c6e0 con 0x555c97089b20 2024-09-12T17:28:00.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.496+0000 7fc7aa0e3640 1 --2- 172.21.15.170:0/1901039845 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x555c97089b20 0x555c9708bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.497+0000 7fc7b28e4640 1 --2- 172.21.15.170:0/1901039845 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc67c03c730 0x7fc67c03ebf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4053730 tx=0x7fc7a4091000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.497+0000 7fc7aa0e3640 1 --2- 172.21.15.170:0/1901039845 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x555c97089b20 0x555c9708bf90 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.497+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc79c009050 con 0x555c97089b20 2024-09-12T17:28:00.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.497+0000 7fc7b6b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.497+0000 7fc7b6b35800 20 realm 2024-09-12T17:28:00.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.497+0000 7fc7b6b35800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.497+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555c97088ef0 con 0x555c97089b20 2024-09-12T17:28:00.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.497+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc79c009050 con 0x555c97089b20 2024-09-12T17:28:00.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.497+0000 7fc7b6b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.497+0000 7fc7b6b35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:00.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.497+0000 7fc7b6b35800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.497+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555c9708d1c0 con 0x555c97089b20 2024-09-12T17:28:00.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.498+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc79c009050 con 0x555c97089b20 2024-09-12T17:28:00.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.498+0000 7fc7b6b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.498+0000 7fc7b6b35800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.498+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555c9708da90 con 0x555c97089b20 2024-09-12T17:28:00.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.498+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc79c009050 con 0x555c97089b20 2024-09-12T17:28:00.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.498+0000 7fc7b6b35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:00.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.498+0000 7fc7b6b35800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.498+0000 7fc7b6b35800 1 --2- 172.21.15.170:0/1901039845 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x555c9708e3d0 0x555c970907c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.498+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555c97090f00 con 0x555c9708e3d0 2024-09-12T17:28:00.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.498+0000 7fc7b30e5640 1 --2- 172.21.15.170:0/1901039845 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x555c9708e3d0 0x555c970907c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.498+0000 7fc7b30e5640 1 --2- 172.21.15.170:0/1901039845 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x555c9708e3d0 0x555c970907c0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.498+0000 7fc7b30e5640 1 -- 172.21.15.170:0/1901039845 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc7ac040d70 con 0x555c9708e3d0 2024-09-12T17:28:00.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.498+0000 7fc7b6b35800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:00.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.499+0000 7fc7b6b35800 20 searching for the correct realm 2024-09-12T17:28:00.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.499+0000 7fc7b6b35800 1 --2- 172.21.15.170:0/1901039845 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x555c97092f80 0x555c97095440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.499+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c97095b10 con 0x555c97092f80 2024-09-12T17:28:00.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.499+0000 7fc7b28e4640 1 --2- 172.21.15.170:0/1901039845 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x555c97092f80 0x555c97095440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.499+0000 7fc7b28e4640 1 --2- 172.21.15.170:0/1901039845 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x555c97092f80 0x555c97095440 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.499+0000 7fc7b28e4640 1 -- 172.21.15.170:0/1901039845 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7a4079030 con 0x555c97092f80 2024-09-12T17:28:00.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.499+0000 7fc7b28e4640 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c97095b10 con 0x555c9708e3d0 2024-09-12T17:28:00.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.499+0000 7fc7b30e5640 1 -- 172.21.15.170:0/1901039845 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7ac040d70 con 0x555c9708e3d0 2024-09-12T17:28:00.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.499+0000 7fc7b30e5640 1 --2- 172.21.15.170:0/1901039845 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fc7ac013070 0x7fc7ac03c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.499+0000 7fc7b30e5640 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c97095b10 con 0x7fc7ac013070 2024-09-12T17:28:00.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.500+0000 7fc7aa0e3640 1 --2- 172.21.15.170:0/1901039845 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fc7ac013070 0x7fc7ac03c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.500+0000 7fc7aa0e3640 1 --2- 172.21.15.170:0/1901039845 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fc7ac013070 0x7fc7ac03c000 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.500+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79c009050 con 0x7fc7ac013070 2024-09-12T17:28:00.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.500+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c97095b10 con 0x555c97089b20 2024-09-12T17:28:00.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.500+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79c009050 con 0x555c97089b20 2024-09-12T17:28:00.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.500+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c97095b10 con 0x555c97089b20 2024-09-12T17:28:00.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.501+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79c029040 con 0x555c97089b20 2024-09-12T17:28:00.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.501+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c97095b10 con 0x7fc7ac013070 2024-09-12T17:28:00.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.501+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79c029040 con 0x7fc7ac013070 2024-09-12T17:28:00.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.501+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c97095b10 con 0x7fc7ac013070 2024-09-12T17:28:00.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.501+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79c029040 con 0x7fc7ac013070 2024-09-12T17:28:00.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.501+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c97095b10 con 0x555c9708e3d0 2024-09-12T17:28:00.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.501+0000 7fc7b30e5640 1 -- 172.21.15.170:0/1901039845 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7ac040d70 con 0x555c9708e3d0 2024-09-12T17:28:00.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.501+0000 7fc7b30e5640 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c97095b10 con 0x555c97092f80 2024-09-12T17:28:00.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.501+0000 7fc7b28e4640 1 -- 172.21.15.170:0/1901039845 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7a4079030 con 0x555c97092f80 2024-09-12T17:28:00.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.502+0000 7fc7b28e4640 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c97095b10 con 0x555c97089b20 2024-09-12T17:28:00.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.502+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79c029040 con 0x555c97089b20 2024-09-12T17:28:00.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.502+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c97095b10 con 0x7fc7ac013070 2024-09-12T17:28:00.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.502+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79c029040 con 0x7fc7ac013070 2024-09-12T17:28:00.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.502+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c97095b10 con 0x555c97089b20 2024-09-12T17:28:00.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.502+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79c029040 con 0x555c97089b20 2024-09-12T17:28:00.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.502+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c97095b10 con 0x555c9708e3d0 2024-09-12T17:28:00.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.502+0000 7fc7b30e5640 1 -- 172.21.15.170:0/1901039845 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fc7ac040d70 con 0x555c9708e3d0 2024-09-12T17:28:00.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.502+0000 7fc7b30e5640 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c97095b10 con 0x555c97092f80 2024-09-12T17:28:00.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.503+0000 7fc7b28e4640 1 -- 172.21.15.170:0/1901039845 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7a4079030 con 0x555c97092f80 2024-09-12T17:28:00.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.503+0000 7fc7b28e4640 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c97095b10 con 0x555c97092f80 2024-09-12T17:28:00.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.503+0000 7fc7b28e4640 1 -- 172.21.15.170:0/1901039845 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7a4079030 con 0x555c97092f80 2024-09-12T17:28:00.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.503+0000 7fc7b28e4640 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c97095b10 con 0x7fc7ac013070 2024-09-12T17:28:00.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.503+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79c029040 con 0x7fc7ac013070 2024-09-12T17:28:00.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.503+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c97095b10 con 0x555c97092f80 2024-09-12T17:28:00.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.503+0000 7fc7b28e4640 1 -- 172.21.15.170:0/1901039845 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7a4079030 con 0x555c97092f80 2024-09-12T17:28:00.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.503+0000 7fc7b28e4640 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c97095b10 con 0x555c97092f80 2024-09-12T17:28:00.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.504+0000 7fc7b28e4640 1 -- 172.21.15.170:0/1901039845 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7a4079030 con 0x555c97092f80 2024-09-12T17:28:00.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.504+0000 7fc7b28e4640 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c97095b10 con 0x555c97089b20 2024-09-12T17:28:00.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.504+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79c029040 con 0x555c97089b20 2024-09-12T17:28:00.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.504+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c97095b10 con 0x555c97089b20 2024-09-12T17:28:00.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.504+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc79c029040 con 0x555c97089b20 2024-09-12T17:28:00.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.504+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c97095b10 con 0x7fc7ac013070 2024-09-12T17:28:00.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.505+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79c029040 con 0x7fc7ac013070 2024-09-12T17:28:00.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.505+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c97095b10 con 0x555c97092f80 2024-09-12T17:28:00.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.505+0000 7fc7b28e4640 1 -- 172.21.15.170:0/1901039845 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7a4079030 con 0x555c97092f80 2024-09-12T17:28:00.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.505+0000 7fc7b28e4640 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c97095b10 con 0x555c9708e3d0 2024-09-12T17:28:00.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.505+0000 7fc7b30e5640 1 -- 172.21.15.170:0/1901039845 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7ac040d70 con 0x555c9708e3d0 2024-09-12T17:28:00.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.505+0000 7fc7b30e5640 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c97095b10 con 0x555c97089b20 2024-09-12T17:28:00.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.505+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79c029040 con 0x555c97089b20 2024-09-12T17:28:00.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.505+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c97095b10 con 0x7fc7ac013070 2024-09-12T17:28:00.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.506+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79c029040 con 0x7fc7ac013070 2024-09-12T17:28:00.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.506+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c97095b10 con 0x555c97092f80 2024-09-12T17:28:00.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.506+0000 7fc7b28e4640 1 -- 172.21.15.170:0/1901039845 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7a4079030 con 0x555c97092f80 2024-09-12T17:28:00.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.506+0000 7fc7b28e4640 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c97095b10 con 0x7fc7ac013070 2024-09-12T17:28:00.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.506+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79c029040 con 0x7fc7ac013070 2024-09-12T17:28:00.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.506+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c97095b10 con 0x555c9708e3d0 2024-09-12T17:28:00.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.506+0000 7fc7b30e5640 1 -- 172.21.15.170:0/1901039845 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7ac062040 con 0x555c9708e3d0 2024-09-12T17:28:00.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.506+0000 7fc7b30e5640 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c97095b10 con 0x555c97092f80 2024-09-12T17:28:00.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.507+0000 7fc7b28e4640 1 -- 172.21.15.170:0/1901039845 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7a4079030 con 0x555c97092f80 2024-09-12T17:28:00.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.507+0000 7fc7b28e4640 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c97095b10 con 0x7fc7ac013070 2024-09-12T17:28:00.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.507+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79c029040 con 0x7fc7ac013070 2024-09-12T17:28:00.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.507+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c97095b10 con 0x555c97089b20 2024-09-12T17:28:00.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.507+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc79c029040 con 0x555c97089b20 2024-09-12T17:28:00.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.507+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555c97095b10 con 0x555c9708e3d0 2024-09-12T17:28:00.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.507+0000 7fc7b30e5640 1 -- 172.21.15.170:0/1901039845 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc7ac062040 con 0x555c9708e3d0 2024-09-12T17:28:00.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.507+0000 7fc7b6b35800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:00.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.507+0000 7fc7b6b35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:00.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.507+0000 7fc7b6b35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:00.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.507+0000 7fc7b6b35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:00.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.507+0000 7fc7b6b35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:00.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.507+0000 7fc7b6b35800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:00.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.507+0000 7fc7b6b35800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.507+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555c97091980 con 0x555c97089b20 2024-09-12T17:28:00.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.508+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc79c029040 con 0x555c97089b20 2024-09-12T17:28:00.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.508+0000 7fc7b6b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.508+0000 7fc7b6b35800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.508+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555c97091590 con 0x555c97089b20 2024-09-12T17:28:00.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.508+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc79c029040 con 0x555c97089b20 2024-09-12T17:28:00.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.508+0000 7fc7b6b35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:00.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.508+0000 7fc7b6b35800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.508+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555c970922f0 con 0x555c9708e3d0 2024-09-12T17:28:00.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.508+0000 7fc7b30e5640 1 -- 172.21.15.170:0/1901039845 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc7ac062040 con 0x555c9708e3d0 2024-09-12T17:28:00.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.508+0000 7fc7b6b35800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:00.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.508+0000 7fc7b6b35800 20 zone default found 2024-09-12T17:28:00.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.508+0000 7fc7b6b35800 4 Realm: () 2024-09-12T17:28:00.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.508+0000 7fc7b6b35800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:00.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.508+0000 7fc7b6b35800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:00.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.508+0000 7fc7b6b35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:00.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.508+0000 7fc7b6b35800 20 zonegroup default 2024-09-12T17:28:00.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.508+0000 7fc7b6b35800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.508+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555c97091e60 con 0x7fc7ac013070 2024-09-12T17:28:00.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.509+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc79c029040 con 0x7fc7ac013070 2024-09-12T17:28:00.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.509+0000 7fc7b6b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.509+0000 7fc7b6b35800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.509+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555c97098360 con 0x555c97092f80 2024-09-12T17:28:00.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.509+0000 7fc7b28e4640 1 -- 172.21.15.170:0/1901039845 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc7a4079030 con 0x555c97092f80 2024-09-12T17:28:00.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.509+0000 7fc7b6b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.509+0000 7fc7b6b35800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.509+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555c97098750 con 0x555c97092f80 2024-09-12T17:28:00.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.509+0000 7fc7b28e4640 1 -- 172.21.15.170:0/1901039845 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc7a4079030 con 0x555c97092f80 2024-09-12T17:28:00.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.509+0000 7fc7b6b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.509+0000 7fc7b6b35800 20 started sync module instance, tier type = 2024-09-12T17:28:00.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.509+0000 7fc7b6b35800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:00.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.509+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c970977a0 con 0x555c9708e3d0 2024-09-12T17:28:00.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.510+0000 7fc7b30e5640 1 -- 172.21.15.170:0/1901039845 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7ac062040 con 0x555c9708e3d0 2024-09-12T17:28:00.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.510+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93856159331056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c97098bb0 con 0x555c9708e3d0 2024-09-12T17:28:00.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.510+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c97099400 con 0x555c97089b20 2024-09-12T17:28:00.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.511+0000 7fc7b30e5640 1 -- 172.21.15.170:0/1901039845 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93856159331056] v29'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7ac062040 con 0x555c9708e3d0 2024-09-12T17:28:00.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.511+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79c029040 con 0x555c97089b20 2024-09-12T17:28:00.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.511+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93856159338320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c97099820 con 0x555c97089b20 2024-09-12T17:28:00.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.511+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c9709a070 con 0x555c97092f80 2024-09-12T17:28:00.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.512+0000 7fc7b28e4640 1 -- 172.21.15.170:0/1901039845 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7a4079030 con 0x555c97092f80 2024-09-12T17:28:00.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.513+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93856159341088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c9709a040 con 0x555c97092f80 2024-09-12T17:28:00.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.513+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c9709b060 con 0x555c9708e3d0 2024-09-12T17:28:00.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.513+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93856159338320] v29'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79c029040 con 0x555c97089b20 2024-09-12T17:28:00.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.513+0000 7fc7b28e4640 1 -- 172.21.15.170:0/1901039845 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93856159341088] v29'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7a4079030 con 0x555c97092f80 2024-09-12T17:28:00.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.514+0000 7fc7b30e5640 1 -- 172.21.15.170:0/1901039845 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7ac062040 con 0x555c9708e3d0 2024-09-12T17:28:00.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.514+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93856159343712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c9709b020 con 0x555c9708e3d0 2024-09-12T17:28:00.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.514+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c9709b900 con 0x555c97089b20 2024-09-12T17:28:00.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.515+0000 7fc7b30e5640 1 -- 172.21.15.170:0/1901039845 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93856159343712] v29'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7ac062040 con 0x555c9708e3d0 2024-09-12T17:28:00.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.515+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79c029040 con 0x555c97089b20 2024-09-12T17:28:00.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.515+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93856159345456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c9709b020 con 0x555c97089b20 2024-09-12T17:28:00.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.515+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c9709bf80 con 0x7fc7ac013070 2024-09-12T17:28:00.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.516+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79c029040 con 0x7fc7ac013070 2024-09-12T17:28:00.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.516+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93856159349360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c9709bf40 con 0x7fc7ac013070 2024-09-12T17:28:00.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.516+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c9709cee0 con 0x7fc7ac013070 2024-09-12T17:28:00.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.516+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93856159345456] v29'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79c029040 con 0x555c97089b20 2024-09-12T17:28:00.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.517+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v29'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79c029040 con 0x7fc7ac013070 2024-09-12T17:28:00.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.517+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93856159353328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c9709cee0 con 0x7fc7ac013070 2024-09-12T17:28:00.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.517+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c9709d8f0 con 0x7fc7ac013070 2024-09-12T17:28:00.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.517+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93856159349360] v29'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79c029040 con 0x7fc7ac013070 2024-09-12T17:28:00.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.518+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(58 notify.7 [create] v29'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79c029040 con 0x7fc7ac013070 2024-09-12T17:28:00.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.518+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93856159351520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c9709d8f0 con 0x7fc7ac013070 2024-09-12T17:28:00.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.518+0000 7fc7b6b35800 20 add_watcher() i=0 2024-09-12T17:28:00.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.518+0000 7fc7b6b35800 20 add_watcher() i=1 2024-09-12T17:28:00.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.518+0000 7fc7b6b35800 20 add_watcher() i=2 2024-09-12T17:28:00.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.518+0000 7fc7b6b35800 20 add_watcher() i=3 2024-09-12T17:28:00.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.518+0000 7fc7b6b35800 20 add_watcher() i=4 2024-09-12T17:28:00.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.518+0000 7fc7b6b35800 20 add_watcher() i=5 2024-09-12T17:28:00.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.518+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93856159353328] v29'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79c029040 con 0x7fc7ac013070 2024-09-12T17:28:00.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.518+0000 7fc7b6b35800 20 add_watcher() i=6 2024-09-12T17:28:00.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.519+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93856159351520] v29'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79c029040 con 0x7fc7ac013070 2024-09-12T17:28:00.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.519+0000 7fc7b6b35800 20 add_watcher() i=7 2024-09-12T17:28:00.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.519+0000 7fc7b6b35800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:00.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.519+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555c970a0920 con 0x555c97089b20 2024-09-12T17:28:00.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.519+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc79c029040 con 0x555c97089b20 2024-09-12T17:28:00.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.519+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93856159355968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c9709dd10 con 0x555c97089b20 2024-09-12T17:28:00.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.520+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93856159355968] v29'66 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc79c029040 con 0x555c97089b20 2024-09-12T17:28:00.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.520+0000 7fc6697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:00.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.520+0000 7fc7b6b35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:00.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.520+0000 7fc7b6b35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:00.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.520+0000 7fc7b6b35800 5 note: GC not initialized 2024-09-12T17:28:00.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.520+0000 7fc5e3fff640 20 reqs_thread_entry: start 2024-09-12T17:28:00.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.520+0000 7fc7b6b35800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:00.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.521+0000 7fc7b6b35800 20 Filter name: none 2024-09-12T17:28:00.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.521+0000 7fc5e1ffb640 20 reqs_thread_entry: start 2024-09-12T17:28:00.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.521+0000 7fc7b6b35800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.521+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555c970d3390 con 0x555c97089b20 2024-09-12T17:28:00.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.521+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7fc79c029040 con 0x555c97089b20 2024-09-12T17:28:00.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.521+0000 7fc7b6b35800 20 rados_obj.operate() r=0 bl.length=502 2024-09-12T17:28:00.533 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T17:27:59.362376Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-12T17:28:00.390138Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:27:59.362351Z","tags":[],"group_ids":[]} 2024-09-12T17:28:00.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.522+0000 7fc6697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:00.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.522+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93856159355968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c970d1e80 con 0x555c97089b20 2024-09-12T17:28:00.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.523+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93856159355968] v29'67 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc79c029040 con 0x555c97089b20 2024-09-12T17:28:00.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.523+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93856159331056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c970d12b0 con 0x555c9708e3d0 2024-09-12T17:28:00.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.524+0000 7fc7b30e5640 1 -- 172.21.15.170:0/1901039845 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93856159331056] v29'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7ac062040 con 0x555c9708e3d0 2024-09-12T17:28:00.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.524+0000 7fc7b6b35800 20 remove_watcher() i=0 2024-09-12T17:28:00.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.524+0000 7fc7b6b35800 2 removed watcher, disabling cache 2024-09-12T17:28:00.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.524+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93856159338320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c970d12b0 con 0x555c97089b20 2024-09-12T17:28:00.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.525+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93856159338320] v29'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79c029040 con 0x555c97089b20 2024-09-12T17:28:00.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.525+0000 7fc7b6b35800 20 remove_watcher() i=1 2024-09-12T17:28:00.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.525+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93856159341088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c970d12b0 con 0x555c97092f80 2024-09-12T17:28:00.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.526+0000 7fc7b28e4640 1 -- 172.21.15.170:0/1901039845 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93856159341088] v29'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7a4079030 con 0x555c97092f80 2024-09-12T17:28:00.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.526+0000 7fc7b6b35800 20 remove_watcher() i=2 2024-09-12T17:28:00.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.526+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93856159343712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c970d12b0 con 0x555c9708e3d0 2024-09-12T17:28:00.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.527+0000 7fc7b30e5640 1 -- 172.21.15.170:0/1901039845 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93856159343712] v29'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7ac062040 con 0x555c9708e3d0 2024-09-12T17:28:00.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.527+0000 7fc7b6b35800 20 remove_watcher() i=3 2024-09-12T17:28:00.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.527+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93856159345456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c970d12b0 con 0x555c97089b20 2024-09-12T17:28:00.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.528+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93856159345456] v29'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79c029040 con 0x555c97089b20 2024-09-12T17:28:00.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.528+0000 7fc7b6b35800 20 remove_watcher() i=4 2024-09-12T17:28:00.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.528+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93856159349360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c970d12b0 con 0x7fc7ac013070 2024-09-12T17:28:00.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.529+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93856159349360] v29'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79c029040 con 0x7fc7ac013070 2024-09-12T17:28:00.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.529+0000 7fc7b6b35800 20 remove_watcher() i=5 2024-09-12T17:28:00.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.529+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93856159353328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c970d12b0 con 0x7fc7ac013070 2024-09-12T17:28:00.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.530+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93856159353328] v29'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79c029040 con 0x7fc7ac013070 2024-09-12T17:28:00.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.530+0000 7fc7b6b35800 20 remove_watcher() i=6 2024-09-12T17:28:00.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.530+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93856159351520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555c970d12b0 con 0x7fc7ac013070 2024-09-12T17:28:00.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.531+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93856159351520] v29'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79c029040 con 0x7fc7ac013070 2024-09-12T17:28:00.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.531+0000 7fc7b6b35800 20 remove_watcher() i=7 2024-09-12T17:28:00.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.531+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fc7ac013070 msgr2=0x7fc7ac03c000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.531+0000 7fc7b6b35800 1 --2- 172.21.15.170:0/1901039845 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fc7ac013070 0x7fc7ac03c000 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.531+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x555c97089b20 msgr2=0x555c9708bf90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.531+0000 7fc7b6b35800 1 --2- 172.21.15.170:0/1901039845 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x555c97089b20 0x555c9708bf90 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.531+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x555c9708e3d0 msgr2=0x555c970907c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.531+0000 7fc7b6b35800 1 --2- 172.21.15.170:0/1901039845 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x555c9708e3d0 0x555c970907c0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.531+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x555c97092f80 msgr2=0x555c97095440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.531+0000 7fc7b6b35800 1 --2- 172.21.15.170:0/1901039845 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x555c97092f80 0x555c97095440 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.531+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc67c03c730 msgr2=0x7fc67c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.531+0000 7fc7b6b35800 1 --2- 172.21.15.170:0/1901039845 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc67c03c730 0x7fc67c03ebf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4053730 tx=0x7fc7a4091000 comp rx=0 tx=0).stop 2024-09-12T17:28:00.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.531+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c97076a10 msgr2=0x555c9707e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.531+0000 7fc7aa0e3640 1 -- 172.21.15.170:0/1901039845 reap_dead start 2024-09-12T17:28:00.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.531+0000 7fc7b6b35800 1 --2- 172.21.15.170:0/1901039845 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c97076a10 0x555c9707e060 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac019fd0 tx=0x7fc7ac042040 comp rx=0 tx=0).stop 2024-09-12T17:28:00.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.531+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 shutdown_connections 2024-09-12T17:28:00.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.531+0000 7fc7b6b35800 1 --2- 172.21.15.170:0/1901039845 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c97076a10 0x555c9707e060 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.531+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 >> 172.21.15.170:0/1901039845 conn(0x555c97072e30 msgr2=0x555c97071040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:00.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.531+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 shutdown_connections 2024-09-12T17:28:00.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.531+0000 7fc7b6b35800 1 -- 172.21.15.170:0/1901039845 wait complete. 2024-09-12T17:28:00.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.532+0000 7fc7b6b35800 1 -- 172.21.15.170:0/2149993234 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc68c03c780 msgr2=0x7fc68c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.532+0000 7fc7b6b35800 1 --2- 172.21.15.170:0/2149993234 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc68c03c780 0x7fc68c03ec40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc7a405d790 tx=0x7fc7a405f7b0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.532+0000 7fc7b6b35800 1 -- 172.21.15.170:0/2149993234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c97069f70 msgr2=0x555c9706a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.532+0000 7fc7b6b35800 1 --2- 172.21.15.170:0/2149993234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c97069f70 0x555c9706a390 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x555c97050110 tx=0x7fc7ac018e90 comp rx=0 tx=0).stop 2024-09-12T17:28:00.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.532+0000 7fc7b6b35800 1 -- 172.21.15.170:0/2149993234 shutdown_connections 2024-09-12T17:28:00.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.532+0000 7fc7b6b35800 1 --2- 172.21.15.170:0/2149993234 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc68c03c780 0x7fc68c03ec40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.532+0000 7fc7b6b35800 1 --2- 172.21.15.170:0/2149993234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c97069f70 0x555c9706a390 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.532+0000 7fc7b6b35800 1 -- 172.21.15.170:0/2149993234 >> 172.21.15.170:0/2149993234 conn(0x555c9705e320 msgr2=0x555c9705e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:00.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.532+0000 7fc7b6b35800 1 -- 172.21.15.170:0/2149993234 shutdown_connections 2024-09-12T17:28:00.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.532+0000 7fc7b6b35800 1 -- 172.21.15.170:0/2149993234 wait complete. 2024-09-12T17:28:00.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.532+0000 7fc7b6b35800 1 -- 172.21.15.170:0/497983779 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x555c96f54d30 msgr2=0x555c97056760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.532+0000 7fc7b6b35800 1 --2- 172.21.15.170:0/497983779 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x555c96f54d30 0x555c97056760 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.532+0000 7fc7b6b35800 1 -- 172.21.15.170:0/497983779 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x555c97058af0 msgr2=0x555c9705af90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.532+0000 7fc7b6b35800 1 --2- 172.21.15.170:0/497983779 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x555c97058af0 0x555c9705af90 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.532+0000 7fc7b6b35800 1 -- 172.21.15.170:0/497983779 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc69803c780 msgr2=0x7fc69803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.532+0000 7fc7b6b35800 1 --2- 172.21.15.170:0/497983779 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc69803c780 0x7fc69803ec40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc79c001d70 tx=0x7fc79c0012d0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.532+0000 7fc7b6b35800 1 -- 172.21.15.170:0/497983779 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c96f543f0 msgr2=0x555c9704f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.532+0000 7fc7b6b35800 1 --2- 172.21.15.170:0/497983779 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c96f543f0 0x555c9704f110 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4025c20 tx=0x7fc7a4002fb0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.532+0000 7fc7b6b35800 1 -- 172.21.15.170:0/497983779 shutdown_connections 2024-09-12T17:28:00.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.532+0000 7fc7b6b35800 1 --2- 172.21.15.170:0/497983779 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x555c97058af0 0x555c9705af90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.532+0000 7fc7b6b35800 1 --2- 172.21.15.170:0/497983779 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc69803c780 0x7fc69803ec40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.532+0000 7fc7b6b35800 1 --2- 172.21.15.170:0/497983779 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x555c96f54d30 0x555c97056760 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.532+0000 7fc7b6b35800 1 --2- 172.21.15.170:0/497983779 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555c96f543f0 0x555c9704f110 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.532+0000 7fc7b6b35800 1 -- 172.21.15.170:0/497983779 >> 172.21.15.170:0/497983779 conn(0x555c96f501c0 msgr2=0x555c970419a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:00.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.532+0000 7fc7b6b35800 1 -- 172.21.15.170:0/497983779 shutdown_connections 2024-09-12T17:28:00.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.532+0000 7fc7b6b35800 1 -- 172.21.15.170:0/497983779 wait complete. 2024-09-12T17:28:00.545 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T17:27:59.362376Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-12T17:28:00.390138Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:27:59.362351Z', 'tags': [], 'group_ids': []} 2024-09-12T17:28:00.545 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-12T17:28:00.545 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-12T17:28:00.545 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-09-12T17:28:00.591 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:00.592 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:00.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.591+0000 7f985772a800 1 Processor -- start 2024-09-12T17:28:00.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.591+0000 7f985772a800 1 -- start start 2024-09-12T17:28:00.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.591+0000 7f985772a800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x56143ac2af10 0x56143ac2b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.591+0000 7f985772a800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56143aad4e40 con 0x56143ac2a310 2024-09-12T17:28:00.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.591+0000 7f985772a800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x56143aa9f680 con 0x56143ac2af10 2024-09-12T17:28:00.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.591+0000 7f9852cd9640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x56143ac2af10 0x56143ac2b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.591+0000 7f98534da640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x56143ac2a310 0x56143ac2a710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:48318/0 (socket says 172.21.15.170:48318) 2024-09-12T17:28:00.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.591+0000 7f9852cd9640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x56143ac2af10 0x56143ac2b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56938/0 (socket says 172.21.15.170:56938) 2024-09-12T17:28:00.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.591+0000 7f98534da640 1 -- 172.21.15.170:0/3282023131 learned_addr learned my addr 172.21.15.170:0/3282023131 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:28:00.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.592+0000 7f9852cd9640 1 -- 172.21.15.170:0/3282023131 >> v1:172.21.15.47:6789/0 conn(0x56143ac2a310 legacy=0x56143ac2a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.592+0000 7f9852cd9640 1 -- 172.21.15.170:0/3282023131 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56143aabb6b0 con 0x56143ac2af10 2024-09-12T17:28:00.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.593+0000 7f9852cd9640 1 --2- 172.21.15.170:0/3282023131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56143ac2af10 0x56143ac2b3c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f983c00a470 tx=0x7f983c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=730881379a967ec8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.594+0000 7f98524d8640 1 -- 172.21.15.170:0/3282023131 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f983c053570 con 0x56143ac2af10 2024-09-12T17:28:00.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.594+0000 7f98524d8640 1 -- 172.21.15.170:0/3282023131 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f983c058070 con 0x56143ac2af10 2024-09-12T17:28:00.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.594+0000 7f98524d8640 1 -- 172.21.15.170:0/3282023131 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f983c053880 con 0x56143ac2af10 2024-09-12T17:28:00.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.594+0000 7f985772a800 1 -- 172.21.15.170:0/3282023131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56143ac2af10 msgr2=0x56143ac2b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.594+0000 7f985772a800 1 --2- 172.21.15.170:0/3282023131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56143ac2af10 0x56143ac2b3c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f983c00a470 tx=0x7f983c045a20 comp rx=0 tx=0).stop 2024-09-12T17:28:00.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.594+0000 7f985772a800 1 -- 172.21.15.170:0/3282023131 shutdown_connections 2024-09-12T17:28:00.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.594+0000 7f985772a800 1 --2- 172.21.15.170:0/3282023131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56143ac2af10 0x56143ac2b3c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.594+0000 7f985772a800 1 -- 172.21.15.170:0/3282023131 >> 172.21.15.170:0/3282023131 conn(0x56143ac24930 msgr2=0x56143ac26db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:00.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.594+0000 7f985772a800 1 -- 172.21.15.170:0/3282023131 shutdown_connections 2024-09-12T17:28:00.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.594+0000 7f985772a800 1 -- 172.21.15.170:0/3282023131 wait complete. 2024-09-12T17:28:00.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.608+0000 7f985772a800 1 Processor -- start 2024-09-12T17:28:00.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.608+0000 7f985772a800 1 -- start start 2024-09-12T17:28:00.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.608+0000 7f985772a800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56143ac2a310 0x56143ad1c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.608+0000 7f985772a800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56143aac3dd0 con 0x56143ac2a310 2024-09-12T17:28:00.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.608+0000 7f98534da640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56143ac2a310 0x56143ad1c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.608+0000 7f98534da640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56143ac2a310 0x56143ad1c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56950/0 (socket says 172.21.15.170:56950) 2024-09-12T17:28:00.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.608+0000 7f98534da640 1 -- 172.21.15.170:0/560754353 learned_addr learned my addr 172.21.15.170:0/560754353 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:00.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.609+0000 7f98534da640 1 -- 172.21.15.170:0/560754353 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56143aadce10 con 0x56143ac2a310 2024-09-12T17:28:00.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.609+0000 7f98534da640 1 --2- 172.21.15.170:0/560754353 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56143ac2a310 0x56143ad1c8e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f984c001800 tx=0x7f984c001cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3971fbc9ef05d93 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.609+0000 7f974160a640 1 -- 172.21.15.170:0/560754353 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f984c004520 con 0x56143ac2a310 2024-09-12T17:28:00.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.609+0000 7f974160a640 1 -- 172.21.15.170:0/560754353 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f984c0046c0 con 0x56143ac2a310 2024-09-12T17:28:00.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.609+0000 7f974160a640 1 -- 172.21.15.170:0/560754353 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f984c0049e0 con 0x56143ac2a310 2024-09-12T17:28:00.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.610+0000 7f985772a800 1 -- 172.21.15.170:0/560754353 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56143ac2a310 msgr2=0x56143ad1c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.610+0000 7f985772a800 1 --2- 172.21.15.170:0/560754353 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56143ac2a310 0x56143ad1c8e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f984c001800 tx=0x7f984c001cc0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.610+0000 7f985772a800 1 -- 172.21.15.170:0/560754353 shutdown_connections 2024-09-12T17:28:00.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.610+0000 7f985772a800 1 --2- 172.21.15.170:0/560754353 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56143ac2a310 0x56143ad1c8e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.610+0000 7f985772a800 1 -- 172.21.15.170:0/560754353 >> 172.21.15.170:0/560754353 conn(0x56143ac24930 msgr2=0x56143ad13e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:00.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.610+0000 7f985772a800 1 -- 172.21.15.170:0/560754353 shutdown_connections 2024-09-12T17:28:00.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.610+0000 7f985772a800 1 -- 172.21.15.170:0/560754353 wait complete. 2024-09-12T17:28:00.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.610+0000 7f985772a800 1 Processor -- start 2024-09-12T17:28:00.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.610+0000 7f985772a800 1 -- start start 2024-09-12T17:28:00.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.610+0000 7f985772a800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56143ac2a310 0x56143ad24290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.610+0000 7f985772a800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56143ac28d80 con 0x56143ac2a310 2024-09-12T17:28:00.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.610+0000 7f98534da640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56143ac2a310 0x56143ad24290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.610+0000 7f98534da640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56143ac2a310 0x56143ad24290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56964/0 (socket says 172.21.15.170:56964) 2024-09-12T17:28:00.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.610+0000 7f98534da640 1 -- 172.21.15.170:0/1545658252 learned_addr learned my addr 172.21.15.170:0/1545658252 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:00.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.611+0000 7f98534da640 1 -- 172.21.15.170:0/1545658252 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56143ad247f0 con 0x56143ac2a310 2024-09-12T17:28:00.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.611+0000 7f98534da640 1 --2- 172.21.15.170:0/1545658252 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56143ac2a310 0x56143ad24290 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f984c000f80 tx=0x7f984c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.611+0000 7f973fe07640 1 -- 172.21.15.170:0/1545658252 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f984c022020 con 0x56143ac2a310 2024-09-12T17:28:00.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.611+0000 7f973fe07640 1 -- 172.21.15.170:0/1545658252 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f984c014890 con 0x56143ac2a310 2024-09-12T17:28:00.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.611+0000 7f985772a800 1 -- 172.21.15.170:0/1545658252 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56143ad24a80 con 0x56143ac2a310 2024-09-12T17:28:00.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.611+0000 7f973fe07640 1 -- 172.21.15.170:0/1545658252 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f984c014bb0 con 0x56143ac2a310 2024-09-12T17:28:00.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.611+0000 7f985772a800 1 -- 172.21.15.170:0/1545658252 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56143ad25480 con 0x56143ac2a310 2024-09-12T17:28:00.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.612+0000 7f973fe07640 1 -- 172.21.15.170:0/1545658252 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f984c025020 con 0x56143ac2a310 2024-09-12T17:28:00.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.612+0000 7f973fe07640 1 --2- 172.21.15.170:0/1545658252 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f973803c780 0x7f973803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.612+0000 7f973fe07640 1 -- 172.21.15.170:0/1545658252 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f984c018030 con 0x56143ac2a310 2024-09-12T17:28:00.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.612+0000 7f9852cd9640 1 --2- 172.21.15.170:0/1545658252 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f973803c780 0x7f973803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.612+0000 7f985772a800 1 --2- 172.21.15.170:0/1545658252 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56143ac2af10 0x56143ad2b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.612+0000 7f985772a800 1 -- 172.21.15.170:0/1545658252 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56143ad2be20 con 0x56143ac2af10 2024-09-12T17:28:00.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.612+0000 7f9853cdb640 1 --2- 172.21.15.170:0/1545658252 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56143ac2af10 0x56143ad2b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.613+0000 7f9852cd9640 1 --2- 172.21.15.170:0/1545658252 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f973803c780 0x7f973803ec40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f983c057000 tx=0x7f983c052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.613+0000 7f9853cdb640 1 --2- 172.21.15.170:0/1545658252 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56143ac2af10 0x56143ad2b8e0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.613+0000 7f9853cdb640 1 -- 172.21.15.170:0/1545658252 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98440083e0 con 0x56143ac2af10 2024-09-12T17:28:00.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.613+0000 7f985772a800 1 -- 172.21.15.170:0/1545658252 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56143ad2c1c0 con 0x56143ac2af10 2024-09-12T17:28:00.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.613+0000 7f9853cdb640 1 -- 172.21.15.170:0/1545658252 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f98440083e0 con 0x56143ac2af10 2024-09-12T17:28:00.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.613+0000 7f985772a800 1 --2- 172.21.15.170:0/1545658252 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56143ad2dcc0 0x56143ad30140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.613+0000 7f985772a800 1 -- 172.21.15.170:0/1545658252 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56143ad308d0 con 0x56143ad2dcc0 2024-09-12T17:28:00.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.613+0000 7f98534da640 1 --2- 172.21.15.170:0/1545658252 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56143ad2dcc0 0x56143ad30140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.614+0000 7f98534da640 1 --2- 172.21.15.170:0/1545658252 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56143ad2dcc0 0x56143ad30140 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.614+0000 7f98534da640 1 -- 172.21.15.170:0/1545658252 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f984c01b070 con 0x56143ad2dcc0 2024-09-12T17:28:00.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.614+0000 7f985772a800 1 -- 172.21.15.170:0/1545658252 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56143ad2ca10 con 0x56143ac2af10 2024-09-12T17:28:00.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.614+0000 7f9853cdb640 1 -- 172.21.15.170:0/1545658252 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f98440083e0 con 0x56143ac2af10 2024-09-12T17:28:00.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.614+0000 7f985772a800 1 -- 172.21.15.170:0/1545658252 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56143ad2ce40 con 0x56143ad2dcc0 2024-09-12T17:28:00.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.615+0000 7f98534da640 1 -- 172.21.15.170:0/1545658252 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f984c01b070 con 0x56143ad2dcc0 2024-09-12T17:28:00.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.615+0000 7f985772a800 1 Processor -- start 2024-09-12T17:28:00.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.615+0000 7f985772a800 1 -- start start 2024-09-12T17:28:00.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.615+0000 7f985772a800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56143ad3f1c0 0x56143ad3f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.615+0000 7f985772a800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56143ab21a00 con 0x56143ad3f1c0 2024-09-12T17:28:00.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.615+0000 7f9853cdb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56143ad3f1c0 0x56143ad3f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.615+0000 7f9853cdb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56143ad3f1c0 0x56143ad3f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56980/0 (socket says 172.21.15.170:56980) 2024-09-12T17:28:00.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.615+0000 7f9853cdb640 1 -- 172.21.15.170:0/4235353000 learned_addr learned my addr 172.21.15.170:0/4235353000 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:00.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.616+0000 7f9853cdb640 1 -- 172.21.15.170:0/4235353000 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56143ad3fc20 con 0x56143ad3f1c0 2024-09-12T17:28:00.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.616+0000 7f9853cdb640 1 --2- 172.21.15.170:0/4235353000 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56143ad3f1c0 0x56143ad3f5e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x56143ad25290 tx=0x7f984400bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.616+0000 7f973d602640 1 -- 172.21.15.170:0/4235353000 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f984401c020 con 0x56143ad3f1c0 2024-09-12T17:28:00.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.616+0000 7f973d602640 1 -- 172.21.15.170:0/4235353000 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9844007c90 con 0x56143ad3f1c0 2024-09-12T17:28:00.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.616+0000 7f985772a800 1 -- 172.21.15.170:0/4235353000 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56143ad40450 con 0x56143ad3f1c0 2024-09-12T17:28:00.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.616+0000 7f973d602640 1 -- 172.21.15.170:0/4235353000 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9844018440 con 0x56143ad3f1c0 2024-09-12T17:28:00.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.616+0000 7f985772a800 1 -- 172.21.15.170:0/4235353000 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56143ad409f0 con 0x56143ad3f1c0 2024-09-12T17:28:00.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.617+0000 7f973d602640 1 -- 172.21.15.170:0/4235353000 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f984401f020 con 0x56143ad3f1c0 2024-09-12T17:28:00.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.617+0000 7f973d602640 1 --2- 172.21.15.170:0/4235353000 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f972c03c730 0x7f972c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.617+0000 7f973d602640 1 -- 172.21.15.170:0/4235353000 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f9844054d00 con 0x56143ad3f1c0 2024-09-12T17:28:00.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.617+0000 7f98534da640 1 --2- 172.21.15.170:0/4235353000 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f972c03c730 0x7f972c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.617+0000 7f985772a800 1 Processor -- start 2024-09-12T17:28:00.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.617+0000 7f985772a800 1 -- start start 2024-09-12T17:28:00.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.617+0000 7f98534da640 1 --2- 172.21.15.170:0/4235353000 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f972c03c730 0x7f972c03ebf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x56143ad30ca0 tx=0x7f984c051e70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.618+0000 7f985772a800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56143ad4bc80 0x56143ad4c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.618+0000 7f985772a800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56143ad1d130 con 0x56143ad4bc80 2024-09-12T17:28:00.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.618+0000 7f9853cdb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56143ad4bc80 0x56143ad4c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.618+0000 7f9853cdb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56143ad4bc80 0x56143ad4c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56990/0 (socket says 172.21.15.170:56990) 2024-09-12T17:28:00.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.618+0000 7f9853cdb640 1 -- 172.21.15.170:0/4049001637 learned_addr learned my addr 172.21.15.170:0/4049001637 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:00.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.618+0000 7f9853cdb640 1 -- 172.21.15.170:0/4049001637 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56143ad4c670 con 0x56143ad4bc80 2024-09-12T17:28:00.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.618+0000 7f9853cdb640 1 --2- 172.21.15.170:0/4049001637 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56143ad4bc80 0x56143ad4c080 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f98440532d0 tx=0x7f98440158b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a93a76dcd5bbec03 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.618+0000 7f9736ffd640 1 -- 172.21.15.170:0/4049001637 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9844050070 con 0x56143ad4bc80 2024-09-12T17:28:00.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.618+0000 7f9736ffd640 1 -- 172.21.15.170:0/4049001637 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98440174d0 con 0x56143ad4bc80 2024-09-12T17:28:00.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.618+0000 7f9736ffd640 1 -- 172.21.15.170:0/4049001637 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9844044260 con 0x56143ad4bc80 2024-09-12T17:28:00.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.619+0000 7f985772a800 1 -- 172.21.15.170:0/4049001637 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56143ad4bc80 msgr2=0x56143ad4c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.619+0000 7f985772a800 1 --2- 172.21.15.170:0/4049001637 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56143ad4bc80 0x56143ad4c080 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f98440532d0 tx=0x7f98440158b0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.619+0000 7f985772a800 1 -- 172.21.15.170:0/4049001637 shutdown_connections 2024-09-12T17:28:00.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.619+0000 7f985772a800 1 --2- 172.21.15.170:0/4049001637 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56143ad4bc80 0x56143ad4c080 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.619+0000 7f985772a800 1 -- 172.21.15.170:0/4049001637 >> 172.21.15.170:0/4049001637 conn(0x56143ad48080 msgr2=0x56143ad462c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:00.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.619+0000 7f985772a800 1 -- 172.21.15.170:0/4049001637 shutdown_connections 2024-09-12T17:28:00.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.619+0000 7f985772a800 1 -- 172.21.15.170:0/4049001637 wait complete. 2024-09-12T17:28:00.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.619+0000 7f985772a800 1 Processor -- start 2024-09-12T17:28:00.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.619+0000 7f985772a800 1 -- start start 2024-09-12T17:28:00.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.619+0000 7f985772a800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56143ad4bc80 0x56143ad53180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.619+0000 7f985772a800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56143ad4cc60 con 0x56143ad4bc80 2024-09-12T17:28:00.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.619+0000 7f9853cdb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56143ad4bc80 0x56143ad53180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.620+0000 7f9853cdb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56143ad4bc80 0x56143ad53180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56998/0 (socket says 172.21.15.170:56998) 2024-09-12T17:28:00.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.620+0000 7f9853cdb640 1 -- 172.21.15.170:0/2490054831 learned_addr learned my addr 172.21.15.170:0/2490054831 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:00.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.620+0000 7f9853cdb640 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56143ad536e0 con 0x56143ad4bc80 2024-09-12T17:28:00.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.620+0000 7f9853cdb640 1 --2- 172.21.15.170:0/2490054831 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56143ad4bc80 0x56143ad53180 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f98440206f0 tx=0x7f9844053230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.620+0000 7f97357fa640 1 -- 172.21.15.170:0/2490054831 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98440189d0 con 0x56143ad4bc80 2024-09-12T17:28:00.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.620+0000 7f97357fa640 1 -- 172.21.15.170:0/2490054831 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f984402e070 con 0x56143ad4bc80 2024-09-12T17:28:00.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.620+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56143ad53970 con 0x56143ad4bc80 2024-09-12T17:28:00.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.620+0000 7f97357fa640 1 -- 172.21.15.170:0/2490054831 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9844018ca0 con 0x56143ad4bc80 2024-09-12T17:28:00.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.620+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56143ad54500 con 0x56143ad4bc80 2024-09-12T17:28:00.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.621+0000 7f97357fa640 1 -- 172.21.15.170:0/2490054831 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f9844016040 con 0x56143ad4bc80 2024-09-12T17:28:00.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.621+0000 7f97357fa640 1 --2- 172.21.15.170:0/2490054831 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f971c03c730 0x7f971c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.621+0000 7f97357fa640 1 -- 172.21.15.170:0/2490054831 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f984404b040 con 0x56143ad4bc80 2024-09-12T17:28:00.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.621+0000 7f98534da640 1 --2- 172.21.15.170:0/2490054831 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f971c03c730 0x7f971c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.622+0000 7f98534da640 1 --2- 172.21.15.170:0/2490054831 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f971c03c730 0x7f971c03ebf0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x56143ad26380 tx=0x7f984c047000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.622+0000 7f985772a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.622+0000 7f985772a800 1 --2- 172.21.15.170:0/2490054831 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56143ad5eb20 0x56143ad60fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.622+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56143ad61730 con 0x56143ad5eb20 2024-09-12T17:28:00.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.622+0000 7f9852cd9640 1 --2- 172.21.15.170:0/2490054831 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56143ad5eb20 0x56143ad60fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.622+0000 7f9852cd9640 1 --2- 172.21.15.170:0/2490054831 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56143ad5eb20 0x56143ad60fe0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.623+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f983c051070 con 0x56143ad5eb20 2024-09-12T17:28:00.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.623+0000 7f985772a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.623+0000 7f985772a800 20 realm 2024-09-12T17:28:00.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.623+0000 7f985772a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.623+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56143ad61b60 con 0x56143ad5eb20 2024-09-12T17:28:00.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.623+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f983c051070 con 0x56143ad5eb20 2024-09-12T17:28:00.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.623+0000 7f985772a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.623+0000 7f985772a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:00.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.623+0000 7f985772a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.623+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56143ad62430 con 0x56143ad5eb20 2024-09-12T17:28:00.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.623+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f983c051070 con 0x56143ad5eb20 2024-09-12T17:28:00.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.623+0000 7f985772a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.623+0000 7f985772a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.623+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56143ad627d0 con 0x56143ad5eb20 2024-09-12T17:28:00.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.623+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f983c051070 con 0x56143ad5eb20 2024-09-12T17:28:00.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.623+0000 7f985772a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:00.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.623+0000 7f985772a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.623+0000 7f985772a800 1 --2- 172.21.15.170:0/2490054831 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56143ad63530 0x56143ad65920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.624+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56143ad65f30 con 0x56143ad63530 2024-09-12T17:28:00.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.624+0000 7f9853cdb640 1 --2- 172.21.15.170:0/2490054831 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56143ad63530 0x56143ad65920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.624+0000 7f9853cdb640 1 --2- 172.21.15.170:0/2490054831 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56143ad63530 0x56143ad65920 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.624+0000 7f9853cdb640 1 -- 172.21.15.170:0/2490054831 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f98440083e0 con 0x56143ad63530 2024-09-12T17:28:00.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.624+0000 7f985772a800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:00.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.624+0000 7f985772a800 20 searching for the correct realm 2024-09-12T17:28:00.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.624+0000 7f985772a800 1 --2- 172.21.15.170:0/2490054831 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x56143ad67ee0 0x56143ad6a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.624+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56143ad6aa20 con 0x56143ad67ee0 2024-09-12T17:28:00.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.624+0000 7f98534da640 1 --2- 172.21.15.170:0/2490054831 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x56143ad67ee0 0x56143ad6a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.625+0000 7f98534da640 1 --2- 172.21.15.170:0/2490054831 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x56143ad67ee0 0x56143ad6a3a0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.625+0000 7f98534da640 1 -- 172.21.15.170:0/2490054831 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f984c01b070 con 0x56143ad67ee0 2024-09-12T17:28:00.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.625+0000 7f98534da640 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56143ad6aa20 con 0x56143ad63530 2024-09-12T17:28:00.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.625+0000 7f9853cdb640 1 -- 172.21.15.170:0/2490054831 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98440083e0 con 0x56143ad63530 2024-09-12T17:28:00.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.625+0000 7f9853cdb640 1 --2- 172.21.15.170:0/2490054831 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f9844021020 0x7f9844021400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.625+0000 7f9853cdb640 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56143ad6aa20 con 0x7f9844021020 2024-09-12T17:28:00.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.625+0000 7f9852cd9640 1 --2- 172.21.15.170:0/2490054831 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f9844021020 0x7f9844021400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.626+0000 7f9852cd9640 1 --2- 172.21.15.170:0/2490054831 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f9844021020 0x7f9844021400 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.626+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f983c051070 con 0x7f9844021020 2024-09-12T17:28:00.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.626+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56143ad6aa20 con 0x56143ad5eb20 2024-09-12T17:28:00.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.626+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f983c051070 con 0x56143ad5eb20 2024-09-12T17:28:00.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.626+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56143ad6aa20 con 0x56143ad5eb20 2024-09-12T17:28:00.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.626+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f983c051070 con 0x56143ad5eb20 2024-09-12T17:28:00.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.626+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56143ad6aa20 con 0x7f9844021020 2024-09-12T17:28:00.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.627+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f983c051070 con 0x7f9844021020 2024-09-12T17:28:00.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.627+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56143ad6aa20 con 0x7f9844021020 2024-09-12T17:28:00.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.627+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f983c051070 con 0x7f9844021020 2024-09-12T17:28:00.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.627+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56143ad6aa20 con 0x56143ad63530 2024-09-12T17:28:00.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.627+0000 7f9853cdb640 1 -- 172.21.15.170:0/2490054831 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98440083e0 con 0x56143ad63530 2024-09-12T17:28:00.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.627+0000 7f9853cdb640 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56143ad6aa20 con 0x56143ad67ee0 2024-09-12T17:28:00.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.627+0000 7f98534da640 1 -- 172.21.15.170:0/2490054831 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f984c01b070 con 0x56143ad67ee0 2024-09-12T17:28:00.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.627+0000 7f98534da640 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56143ad6aa20 con 0x56143ad5eb20 2024-09-12T17:28:00.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.628+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f983c051070 con 0x56143ad5eb20 2024-09-12T17:28:00.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.628+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56143ad6aa20 con 0x7f9844021020 2024-09-12T17:28:00.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.628+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f983c051070 con 0x7f9844021020 2024-09-12T17:28:00.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.628+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56143ad6aa20 con 0x56143ad5eb20 2024-09-12T17:28:00.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.628+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f983c051070 con 0x56143ad5eb20 2024-09-12T17:28:00.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.628+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56143ad6aa20 con 0x56143ad63530 2024-09-12T17:28:00.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.628+0000 7f9853cdb640 1 -- 172.21.15.170:0/2490054831 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f98440083e0 con 0x56143ad63530 2024-09-12T17:28:00.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.628+0000 7f9853cdb640 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56143ad6aa20 con 0x56143ad67ee0 2024-09-12T17:28:00.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.628+0000 7f98534da640 1 -- 172.21.15.170:0/2490054831 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f984c01b070 con 0x56143ad67ee0 2024-09-12T17:28:00.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.629+0000 7f98534da640 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56143ad6aa20 con 0x56143ad67ee0 2024-09-12T17:28:00.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.629+0000 7f98534da640 1 -- 172.21.15.170:0/2490054831 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f984c01b070 con 0x56143ad67ee0 2024-09-12T17:28:00.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.629+0000 7f98534da640 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56143ad6aa20 con 0x7f9844021020 2024-09-12T17:28:00.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.629+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f983c051070 con 0x7f9844021020 2024-09-12T17:28:00.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.629+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56143ad6aa20 con 0x56143ad67ee0 2024-09-12T17:28:00.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.629+0000 7f98534da640 1 -- 172.21.15.170:0/2490054831 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f984c01b070 con 0x56143ad67ee0 2024-09-12T17:28:00.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.629+0000 7f98534da640 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56143ad6aa20 con 0x56143ad67ee0 2024-09-12T17:28:00.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.629+0000 7f98534da640 1 -- 172.21.15.170:0/2490054831 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f984c01b070 con 0x56143ad67ee0 2024-09-12T17:28:00.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.629+0000 7f98534da640 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56143ad6aa20 con 0x56143ad5eb20 2024-09-12T17:28:00.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.630+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f983c051070 con 0x56143ad5eb20 2024-09-12T17:28:00.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.630+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56143ad6aa20 con 0x56143ad5eb20 2024-09-12T17:28:00.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.630+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f983c051070 con 0x56143ad5eb20 2024-09-12T17:28:00.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.630+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56143ad6aa20 con 0x7f9844021020 2024-09-12T17:28:00.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.630+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f983c051070 con 0x7f9844021020 2024-09-12T17:28:00.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.630+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56143ad6aa20 con 0x56143ad67ee0 2024-09-12T17:28:00.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.630+0000 7f98534da640 1 -- 172.21.15.170:0/2490054831 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f984c01b070 con 0x56143ad67ee0 2024-09-12T17:28:00.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.630+0000 7f98534da640 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56143ad6aa20 con 0x56143ad63530 2024-09-12T17:28:00.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.631+0000 7f9853cdb640 1 -- 172.21.15.170:0/2490054831 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98440083e0 con 0x56143ad63530 2024-09-12T17:28:00.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.631+0000 7f9853cdb640 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56143ad6aa20 con 0x56143ad5eb20 2024-09-12T17:28:00.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.631+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f983c051070 con 0x56143ad5eb20 2024-09-12T17:28:00.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.631+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56143ad6aa20 con 0x7f9844021020 2024-09-12T17:28:00.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.631+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f983c051070 con 0x7f9844021020 2024-09-12T17:28:00.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.631+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56143ad6aa20 con 0x56143ad67ee0 2024-09-12T17:28:00.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.631+0000 7f98534da640 1 -- 172.21.15.170:0/2490054831 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f984c01b070 con 0x56143ad67ee0 2024-09-12T17:28:00.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.631+0000 7f98534da640 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56143ad6aa20 con 0x7f9844021020 2024-09-12T17:28:00.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.632+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f983c051070 con 0x7f9844021020 2024-09-12T17:28:00.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.632+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56143ad6aa20 con 0x56143ad63530 2024-09-12T17:28:00.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.632+0000 7f9853cdb640 1 -- 172.21.15.170:0/2490054831 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98440083e0 con 0x56143ad63530 2024-09-12T17:28:00.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.632+0000 7f9853cdb640 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56143ad6aa20 con 0x56143ad67ee0 2024-09-12T17:28:00.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.632+0000 7f98534da640 1 -- 172.21.15.170:0/2490054831 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f984c01b070 con 0x56143ad67ee0 2024-09-12T17:28:00.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.632+0000 7f98534da640 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56143ad6aa20 con 0x7f9844021020 2024-09-12T17:28:00.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.632+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f983c051070 con 0x7f9844021020 2024-09-12T17:28:00.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.632+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56143ad6aa20 con 0x56143ad5eb20 2024-09-12T17:28:00.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.633+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f983c051070 con 0x56143ad5eb20 2024-09-12T17:28:00.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.633+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56143ad6aa20 con 0x56143ad63530 2024-09-12T17:28:00.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.633+0000 7f9853cdb640 1 -- 172.21.15.170:0/2490054831 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f98440083e0 con 0x56143ad63530 2024-09-12T17:28:00.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.633+0000 7f985772a800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:00.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.633+0000 7f985772a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:00.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.633+0000 7f985772a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:00.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.633+0000 7f985772a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:00.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.633+0000 7f985772a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:00.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.633+0000 7f985772a800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:00.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.633+0000 7f985772a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.633+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56143ad66920 con 0x56143ad5eb20 2024-09-12T17:28:00.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.633+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f983c051070 con 0x56143ad5eb20 2024-09-12T17:28:00.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.633+0000 7f985772a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.633+0000 7f985772a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.633+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56143ad671c0 con 0x56143ad5eb20 2024-09-12T17:28:00.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.633+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f983c051070 con 0x56143ad5eb20 2024-09-12T17:28:00.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.633+0000 7f985772a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:00.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.633+0000 7f985772a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.633+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56143ad66560 con 0x56143ad63530 2024-09-12T17:28:00.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.634+0000 7f9853cdb640 1 -- 172.21.15.170:0/2490054831 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f98440083e0 con 0x56143ad63530 2024-09-12T17:28:00.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.634+0000 7f985772a800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:00.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.634+0000 7f985772a800 20 zone default found 2024-09-12T17:28:00.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.634+0000 7f985772a800 4 Realm: () 2024-09-12T17:28:00.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.634+0000 7f985772a800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:00.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.634+0000 7f985772a800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:00.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.634+0000 7f985772a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:00.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.634+0000 7f985772a800 20 zonegroup default 2024-09-12T17:28:00.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.634+0000 7f985772a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.634+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56143ad6b350 con 0x7f9844021020 2024-09-12T17:28:00.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.634+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f983c051070 con 0x7f9844021020 2024-09-12T17:28:00.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.634+0000 7f985772a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.634+0000 7f985772a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.634+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56143ad6d590 con 0x56143ad67ee0 2024-09-12T17:28:00.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.634+0000 7f98534da640 1 -- 172.21.15.170:0/2490054831 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f984c01b070 con 0x56143ad67ee0 2024-09-12T17:28:00.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.634+0000 7f985772a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.634+0000 7f985772a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.634+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56143ad6d930 con 0x56143ad67ee0 2024-09-12T17:28:00.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.635+0000 7f98534da640 1 -- 172.21.15.170:0/2490054831 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f984c01b070 con 0x56143ad67ee0 2024-09-12T17:28:00.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.635+0000 7f985772a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.635+0000 7f985772a800 20 started sync module instance, tier type = 2024-09-12T17:28:00.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.635+0000 7f985772a800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:00.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.635+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56143ad6ca20 con 0x56143ad63530 2024-09-12T17:28:00.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.636+0000 7f9853cdb640 1 -- 172.21.15.170:0/2490054831 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98440083e0 con 0x56143ad63530 2024-09-12T17:28:00.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.636+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94644886490944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56143ad6ca20 con 0x56143ad63530 2024-09-12T17:28:00.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.636+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56143ad6e3d0 con 0x56143ad5eb20 2024-09-12T17:28:00.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.637+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f983c051070 con 0x56143ad5eb20 2024-09-12T17:28:00.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.637+0000 7f9853cdb640 1 -- 172.21.15.170:0/2490054831 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94644886490944] v29'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98440083e0 con 0x56143ad63530 2024-09-12T17:28:00.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.637+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94644886494944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56143ad6ca20 con 0x56143ad5eb20 2024-09-12T17:28:00.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.637+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56143ad6ee90 con 0x56143ad67ee0 2024-09-12T17:28:00.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.638+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94644886494944] v29'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f983c051070 con 0x56143ad5eb20 2024-09-12T17:28:00.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.638+0000 7f98534da640 1 -- 172.21.15.170:0/2490054831 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f984c01b070 con 0x56143ad67ee0 2024-09-12T17:28:00.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.638+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94644886488432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56143ad6c990 con 0x56143ad67ee0 2024-09-12T17:28:00.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.638+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56143ad6fd50 con 0x56143ad63530 2024-09-12T17:28:00.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.639+0000 7f98534da640 1 -- 172.21.15.170:0/2490054831 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94644886488432] v29'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f984c01b070 con 0x56143ad67ee0 2024-09-12T17:28:00.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.639+0000 7f9853cdb640 1 -- 172.21.15.170:0/2490054831 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98440083e0 con 0x56143ad63530 2024-09-12T17:28:00.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.639+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94644886501536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56143ad6fcc0 con 0x56143ad63530 2024-09-12T17:28:00.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.639+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56143ad70c10 con 0x56143ad5eb20 2024-09-12T17:28:00.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.640+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f983c051070 con 0x56143ad5eb20 2024-09-12T17:28:00.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.640+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94644886505312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56143ad71030 con 0x56143ad5eb20 2024-09-12T17:28:00.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.640+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56143ad71b20 con 0x7f9844021020 2024-09-12T17:28:00.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.640+0000 7f9853cdb640 1 -- 172.21.15.170:0/2490054831 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94644886501536] v29'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98440083e0 con 0x56143ad63530 2024-09-12T17:28:00.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.641+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f983c051070 con 0x7f9844021020 2024-09-12T17:28:00.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.641+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94644886509040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56143ad71ae0 con 0x7f9844021020 2024-09-12T17:28:00.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.641+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56143ad72530 con 0x7f9844021020 2024-09-12T17:28:00.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.641+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94644886505312] v29'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f983c051070 con 0x56143ad5eb20 2024-09-12T17:28:00.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.642+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94644886509040] v29'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f983c051070 con 0x7f9844021020 2024-09-12T17:28:00.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.642+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(56 notify.6 [create] v29'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f983c051070 con 0x7f9844021020 2024-09-12T17:28:00.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.642+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94644886503744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56143ad72080 con 0x7f9844021020 2024-09-12T17:28:00.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.642+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56143ad72a40 con 0x7f9844021020 2024-09-12T17:28:00.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.643+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94644886503744] v29'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f983c051070 con 0x7f9844021020 2024-09-12T17:28:00.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.643+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(58 notify.7 [create] v29'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f983c051070 con 0x7f9844021020 2024-09-12T17:28:00.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.643+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94644886506368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56143ad72a40 con 0x7f9844021020 2024-09-12T17:28:00.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.643+0000 7f985772a800 20 add_watcher() i=0 2024-09-12T17:28:00.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.643+0000 7f985772a800 20 add_watcher() i=1 2024-09-12T17:28:00.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.643+0000 7f985772a800 20 add_watcher() i=2 2024-09-12T17:28:00.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.643+0000 7f985772a800 20 add_watcher() i=3 2024-09-12T17:28:00.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.643+0000 7f985772a800 20 add_watcher() i=4 2024-09-12T17:28:00.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.643+0000 7f985772a800 20 add_watcher() i=5 2024-09-12T17:28:00.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.643+0000 7f985772a800 20 add_watcher() i=6 2024-09-12T17:28:00.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.644+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94644886506368] v29'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f983c051070 con 0x7f9844021020 2024-09-12T17:28:00.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.644+0000 7f985772a800 20 add_watcher() i=7 2024-09-12T17:28:00.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.644+0000 7f985772a800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:00.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.644+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56143ad75d90 con 0x56143ad5eb20 2024-09-12T17:28:00.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.645+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f983c051070 con 0x56143ad5eb20 2024-09-12T17:28:00.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.645+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94644886513408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56143ad72fd0 con 0x56143ad5eb20 2024-09-12T17:28:00.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.646+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94644886513408] v29'68 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f983c051070 con 0x56143ad5eb20 2024-09-12T17:28:00.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.646+0000 7f9709fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:00.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.646+0000 7f985772a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:00.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.646+0000 7f985772a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:00.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.646+0000 7f985772a800 5 note: GC not initialized 2024-09-12T17:28:00.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.646+0000 7f9708fe1640 20 reqs_thread_entry: start 2024-09-12T17:28:00.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.646+0000 7f985772a800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:00.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.646+0000 7f985772a800 20 Filter name: none 2024-09-12T17:28:00.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.646+0000 7f96827fc640 20 reqs_thread_entry: start 2024-09-12T17:28:00.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.647+0000 7f985772a800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:28:00.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.647+0000 7f985772a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.647+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56143ada8e80 con 0x56143ad5eb20 2024-09-12T17:28:00.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.647+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f983c051070 con 0x56143ad5eb20 2024-09-12T17:28:00.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.647+0000 7f985772a800 20 rados_obj.operate() r=0 bl.length=502 2024-09-12T17:28:00.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.647+0000 7f985772a800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T17:28:00.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.647+0000 7f985772a800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:28:00.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.647+0000 7f985772a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:00.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.647+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56143adaf360 con 0x56143ad5eb20 2024-09-12T17:28:00.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.648+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v29'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f983c051070 con 0x56143ad5eb20 2024-09-12T17:28:00.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.648+0000 7f985772a800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:28:00.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.648+0000 7f985772a800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:28:00.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.648+0000 7f985772a800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T17:28:00.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.648+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94644886760864 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56143adaaa60 con 0x56143ad5eb20 2024-09-12T17:28:00.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.648+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== watch-notify(notify (1) cookie 94644886505312 notify 124554051588 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f983c082040 con 0x56143ad5eb20 2024-09-12T17:28:00.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.648+0000 7f9736ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051588 cookie 94644886505312 notifier 4351 bl.length()=567 2024-09-12T17:28:00.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.648+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(64 notify.4 [notify cookie 94644886760864 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f983c051070 con 0x56143ad5eb20 2024-09-12T17:28:00.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.648+0000 7f9736ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:28:00.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.648+0000 7f9736ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:28:00.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.648+0000 7f9736ffd640 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f9718003ea0 con 0x56143ad5eb20 2024-09-12T17:28:00.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.649+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f983c051070 con 0x56143ad5eb20 2024-09-12T17:28:00.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.649+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== watch-notify(notify_complete (2) cookie 94644886760864 notify 124554051588 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56143aabb6b0 con 0x56143ad5eb20 2024-09-12T17:28:00.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.649+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:66 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56143adaeda0 con 0x7f9844021020 2024-09-12T17:28:00.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.650+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(66 p5YnriCv1nAtykxBrupQ [delete] v29'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f983c051070 con 0x7f9844021020 2024-09-12T17:28:00.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.650+0000 7f985772a800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-12T17:28:00.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.650+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94644886760864 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56143adaa5b0 con 0x56143ad67ee0 2024-09-12T17:28:00.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.650+0000 7f98534da640 1 -- 172.21.15.170:0/2490054831 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== watch-notify(notify (1) cookie 94644886488432 notify 124554051585 ret 0) ==== 212+0+0 (crc 0 0 0) 0x56143ad25480 con 0x56143ad67ee0 2024-09-12T17:28:00.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.650+0000 7f9736ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051585 cookie 94644886488432 notifier 4351 bl.length()=170 2024-09-12T17:28:00.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.650+0000 7f9736ffd640 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f9718003ea0 con 0x56143ad67ee0 2024-09-12T17:28:00.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.650+0000 7f98534da640 1 -- 172.21.15.170:0/2490054831 <== osd.3 v2:172.21.15.170:6816/2664906588 15 ==== osd_op_reply(67 notify.2 [notify cookie 94644886760864 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f984c01b070 con 0x56143ad67ee0 2024-09-12T17:28:00.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.650+0000 7f98534da640 1 -- 172.21.15.170:0/2490054831 <== osd.3 v2:172.21.15.170:6816/2664906588 16 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f984c01b070 con 0x56143ad67ee0 2024-09-12T17:28:00.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.651+0000 7f98534da640 1 -- 172.21.15.170:0/2490054831 <== osd.3 v2:172.21.15.170:6816/2664906588 17 ==== watch-notify(notify_complete (2) cookie 94644886760864 notify 124554051585 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56143ad24a80 con 0x56143ad67ee0 2024-09-12T17:28:00.662 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T17:27:59.362376Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:27:59.362351Z","tags":[],"group_ids":[]} 2024-09-12T17:28:00.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.651+0000 7f9709fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:00.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.651+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94644886513408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56143ada6cd0 con 0x56143ad5eb20 2024-09-12T17:28:00.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.652+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94644886513408] v29'69 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f983c051070 con 0x56143ad5eb20 2024-09-12T17:28:00.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.652+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94644886490944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56143ada6cd0 con 0x56143ad63530 2024-09-12T17:28:00.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.653+0000 7f9853cdb640 1 -- 172.21.15.170:0/2490054831 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94644886490944] v29'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98440083e0 con 0x56143ad63530 2024-09-12T17:28:00.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.653+0000 7f985772a800 20 remove_watcher() i=0 2024-09-12T17:28:00.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.653+0000 7f985772a800 2 removed watcher, disabling cache 2024-09-12T17:28:00.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.653+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94644886494944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56143ada6cd0 con 0x56143ad5eb20 2024-09-12T17:28:00.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.655+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94644886494944] v29'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f983c051070 con 0x56143ad5eb20 2024-09-12T17:28:00.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.655+0000 7f985772a800 20 remove_watcher() i=1 2024-09-12T17:28:00.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.655+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94644886488432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56143ada6cd0 con 0x56143ad67ee0 2024-09-12T17:28:00.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.656+0000 7f98534da640 1 -- 172.21.15.170:0/2490054831 <== osd.3 v2:172.21.15.170:6816/2664906588 18 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94644886488432] v29'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f984c01b070 con 0x56143ad67ee0 2024-09-12T17:28:00.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.656+0000 7f985772a800 20 remove_watcher() i=2 2024-09-12T17:28:00.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.656+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94644886501536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56143ada6cd0 con 0x56143ad63530 2024-09-12T17:28:00.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.657+0000 7f9853cdb640 1 -- 172.21.15.170:0/2490054831 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94644886501536] v29'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98440083e0 con 0x56143ad63530 2024-09-12T17:28:00.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.657+0000 7f985772a800 20 remove_watcher() i=3 2024-09-12T17:28:00.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.657+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94644886505312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56143ada6cd0 con 0x56143ad5eb20 2024-09-12T17:28:00.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.658+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94644886505312] v29'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f983c051070 con 0x56143ad5eb20 2024-09-12T17:28:00.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.658+0000 7f985772a800 20 remove_watcher() i=4 2024-09-12T17:28:00.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.658+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94644886509040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56143ada6cd0 con 0x7f9844021020 2024-09-12T17:28:00.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.659+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94644886509040] v29'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f983c051070 con 0x7f9844021020 2024-09-12T17:28:00.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.659+0000 7f985772a800 20 remove_watcher() i=5 2024-09-12T17:28:00.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.659+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94644886503744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56143ada6cd0 con 0x7f9844021020 2024-09-12T17:28:00.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.660+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94644886503744] v29'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f983c051070 con 0x7f9844021020 2024-09-12T17:28:00.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.660+0000 7f985772a800 20 remove_watcher() i=6 2024-09-12T17:28:00.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.660+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94644886506368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56143ada6cd0 con 0x7f9844021020 2024-09-12T17:28:00.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.661+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94644886506368] v29'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f983c051070 con 0x7f9844021020 2024-09-12T17:28:00.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.661+0000 7f985772a800 20 remove_watcher() i=7 2024-09-12T17:28:00.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.661+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f9844021020 msgr2=0x7f9844021400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.661+0000 7f985772a800 1 --2- 172.21.15.170:0/2490054831 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f9844021020 0x7f9844021400 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.661+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56143ad5eb20 msgr2=0x56143ad60fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.661+0000 7f985772a800 1 --2- 172.21.15.170:0/2490054831 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56143ad5eb20 0x56143ad60fe0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.661+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56143ad63530 msgr2=0x56143ad65920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.661+0000 7f985772a800 1 --2- 172.21.15.170:0/2490054831 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56143ad63530 0x56143ad65920 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.661+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x56143ad67ee0 msgr2=0x56143ad6a3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.661+0000 7f985772a800 1 --2- 172.21.15.170:0/2490054831 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x56143ad67ee0 0x56143ad6a3a0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.661+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f971c03c730 msgr2=0x7f971c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.661+0000 7f985772a800 1 --2- 172.21.15.170:0/2490054831 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f971c03c730 0x7f971c03ebf0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x56143ad26380 tx=0x7f984c047000 comp rx=0 tx=0).stop 2024-09-12T17:28:00.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.661+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56143ad4bc80 msgr2=0x56143ad53180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.661+0000 7f985772a800 1 --2- 172.21.15.170:0/2490054831 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56143ad4bc80 0x56143ad53180 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f98440206f0 tx=0x7f9844053230 comp rx=0 tx=0).stop 2024-09-12T17:28:00.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.661+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 reap_dead start 2024-09-12T17:28:00.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.661+0000 7f9852cd9640 1 -- 172.21.15.170:0/2490054831 reap_dead start 2024-09-12T17:28:00.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.661+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 shutdown_connections 2024-09-12T17:28:00.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.661+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 >> 172.21.15.170:0/2490054831 conn(0x56143ad48080 msgr2=0x56143ad46290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:00.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.661+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 shutdown_connections 2024-09-12T17:28:00.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.661+0000 7f985772a800 1 -- 172.21.15.170:0/2490054831 wait complete. 2024-09-12T17:28:00.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.662+0000 7f985772a800 1 -- 172.21.15.170:0/4235353000 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f972c03c730 msgr2=0x7f972c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.662+0000 7f985772a800 1 --2- 172.21.15.170:0/4235353000 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f972c03c730 0x7f972c03ebf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x56143ad30ca0 tx=0x7f984c051e70 comp rx=0 tx=0).stop 2024-09-12T17:28:00.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.662+0000 7f985772a800 1 -- 172.21.15.170:0/4235353000 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56143ad3f1c0 msgr2=0x56143ad3f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.662+0000 7f985772a800 1 --2- 172.21.15.170:0/4235353000 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56143ad3f1c0 0x56143ad3f5e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x56143ad25290 tx=0x7f984400bf30 comp rx=0 tx=0).stop 2024-09-12T17:28:00.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.662+0000 7f985772a800 1 -- 172.21.15.170:0/4235353000 shutdown_connections 2024-09-12T17:28:00.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.662+0000 7f985772a800 1 --2- 172.21.15.170:0/4235353000 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f972c03c730 0x7f972c03ebf0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.662+0000 7f985772a800 1 --2- 172.21.15.170:0/4235353000 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56143ad3f1c0 0x56143ad3f5e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.662+0000 7f985772a800 1 -- 172.21.15.170:0/4235353000 >> 172.21.15.170:0/4235353000 conn(0x56143ad33570 msgr2=0x56143ad33950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:00.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.662+0000 7f985772a800 1 -- 172.21.15.170:0/4235353000 shutdown_connections 2024-09-12T17:28:00.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.662+0000 7f985772a800 1 -- 172.21.15.170:0/4235353000 wait complete. 2024-09-12T17:28:00.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.662+0000 7f985772a800 1 -- 172.21.15.170:0/1545658252 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56143ac2af10 msgr2=0x56143ad2b8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.662+0000 7f985772a800 1 --2- 172.21.15.170:0/1545658252 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56143ac2af10 0x56143ad2b8e0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.662+0000 7f985772a800 1 -- 172.21.15.170:0/1545658252 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56143ad2dcc0 msgr2=0x56143ad30140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.662+0000 7f985772a800 1 --2- 172.21.15.170:0/1545658252 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56143ad2dcc0 0x56143ad30140 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.662+0000 7f985772a800 1 -- 172.21.15.170:0/1545658252 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f973803c780 msgr2=0x7f973803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.662+0000 7f985772a800 1 --2- 172.21.15.170:0/1545658252 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f973803c780 0x7f973803ec40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f983c057000 tx=0x7f983c052000 comp rx=0 tx=0).stop 2024-09-12T17:28:00.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.662+0000 7f985772a800 1 -- 172.21.15.170:0/1545658252 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56143ac2a310 msgr2=0x56143ad24290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.662+0000 7f985772a800 1 --2- 172.21.15.170:0/1545658252 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56143ac2a310 0x56143ad24290 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f984c000f80 tx=0x7f984c001250 comp rx=0 tx=0).stop 2024-09-12T17:28:00.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.662+0000 7f985772a800 1 -- 172.21.15.170:0/1545658252 shutdown_connections 2024-09-12T17:28:00.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.662+0000 7f985772a800 1 --2- 172.21.15.170:0/1545658252 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56143ad2dcc0 0x56143ad30140 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.662+0000 7f985772a800 1 --2- 172.21.15.170:0/1545658252 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f973803c780 0x7f973803ec40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.662+0000 7f985772a800 1 --2- 172.21.15.170:0/1545658252 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56143ac2af10 0x56143ad2b8e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.662+0000 7f985772a800 1 --2- 172.21.15.170:0/1545658252 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56143ac2a310 0x56143ad24290 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.662+0000 7f985772a800 1 -- 172.21.15.170:0/1545658252 >> 172.21.15.170:0/1545658252 conn(0x56143ac24930 msgr2=0x56143ad1dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:00.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.662+0000 7f985772a800 1 -- 172.21.15.170:0/1545658252 shutdown_connections 2024-09-12T17:28:00.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.662+0000 7f985772a800 1 -- 172.21.15.170:0/1545658252 wait complete. 2024-09-12T17:28:00.674 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T17:27:59.362376Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:27:59.362351Z', 'tags': [], 'group_ids': []} 2024-09-12T17:28:00.674 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-12T17:28:00.674 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-12T17:28:00.674 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-09-12T17:28:00.721 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:00.721 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:00.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.720+0000 7f8ddd12c800 1 Processor -- start 2024-09-12T17:28:00.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.720+0000 7f8ddd12c800 1 -- start start 2024-09-12T17:28:00.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.720+0000 7f8ddd12c800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55eab347e730 0x55eab3480b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.720+0000 7f8ddd12c800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55eab3327e40 con 0x55eab3481060 2024-09-12T17:28:00.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.720+0000 7f8ddd12c800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x55eab32f2680 con 0x55eab347e730 2024-09-12T17:28:00.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.721+0000 7f8dd8d3e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55eab347e730 0x55eab3480b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.721+0000 7f8dd8d3e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55eab347e730 0x55eab3480b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57014/0 (socket says 172.21.15.170:57014) 2024-09-12T17:28:00.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.721+0000 7f8dd853d640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x55eab3481060 0x55eab34834f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:48320/0 (socket says 172.21.15.170:48320) 2024-09-12T17:28:00.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.721+0000 7f8dd8d3e640 1 -- 172.21.15.170:0/2199352719 learned_addr learned my addr 172.21.15.170:0/2199352719 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:00.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.721+0000 7f8dd8d3e640 1 -- 172.21.15.170:0/2199352719 >> v1:172.21.15.47:6789/0 conn(0x55eab3481060 legacy=0x55eab34834f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.721+0000 7f8dd8d3e640 1 -- 172.21.15.170:0/2199352719 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eab330e6b0 con 0x55eab347e730 2024-09-12T17:28:00.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.723+0000 7f8dd8d3e640 1 --2- 172.21.15.170:0/2199352719 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eab347e730 0x55eab3480b20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8005fd0 tx=0x7f8dc8045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18935cce03169868 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.723+0000 7f8dd7d3c640 1 -- 172.21.15.170:0/2199352719 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dc804e600 con 0x55eab347e730 2024-09-12T17:28:00.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.723+0000 7f8dd7d3c640 1 -- 172.21.15.170:0/2199352719 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dc804e7a0 con 0x55eab347e730 2024-09-12T17:28:00.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.723+0000 7f8dd7d3c640 1 -- 172.21.15.170:0/2199352719 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dc804eaa0 con 0x55eab347e730 2024-09-12T17:28:00.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.723+0000 7f8ddd12c800 1 -- 172.21.15.170:0/2199352719 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eab347e730 msgr2=0x55eab3480b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.723+0000 7f8ddd12c800 1 --2- 172.21.15.170:0/2199352719 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eab347e730 0x55eab3480b20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8005fd0 tx=0x7f8dc8045cf0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.723+0000 7f8ddd12c800 1 -- 172.21.15.170:0/2199352719 shutdown_connections 2024-09-12T17:28:00.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.723+0000 7f8ddd12c800 1 --2- 172.21.15.170:0/2199352719 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eab347e730 0x55eab3480b20 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.723+0000 7f8ddd12c800 1 -- 172.21.15.170:0/2199352719 >> 172.21.15.170:0/2199352719 conn(0x55eab34781d0 msgr2=0x55eab347a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:00.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.723+0000 7f8ddd12c800 1 -- 172.21.15.170:0/2199352719 shutdown_connections 2024-09-12T17:28:00.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.723+0000 7f8ddd12c800 1 -- 172.21.15.170:0/2199352719 wait complete. 2024-09-12T17:28:00.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.737+0000 7f8ddd12c800 1 Processor -- start 2024-09-12T17:28:00.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.737+0000 7f8ddd12c800 1 -- start start 2024-09-12T17:28:00.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.737+0000 7f8ddd12c800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eab347e730 0x55eab356d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.737+0000 7f8ddd12c800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55eab3316dd0 con 0x55eab347e730 2024-09-12T17:28:00.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.738+0000 7f8dd8d3e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eab347e730 0x55eab356d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.738+0000 7f8dd8d3e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eab347e730 0x55eab356d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57016/0 (socket says 172.21.15.170:57016) 2024-09-12T17:28:00.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.738+0000 7f8dd8d3e640 1 -- 172.21.15.170:0/1130516025 learned_addr learned my addr 172.21.15.170:0/1130516025 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:00.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.738+0000 7f8dd8d3e640 1 -- 172.21.15.170:0/1130516025 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eab332fe10 con 0x55eab347e730 2024-09-12T17:28:00.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.738+0000 7f8dd8d3e640 1 --2- 172.21.15.170:0/1130516025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eab347e730 0x55eab356d690 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8005fd0 tx=0x7f8dc8050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84e0d348751d804d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.739+0000 7f8cc6e0d640 1 -- 172.21.15.170:0/1130516025 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dc804eb40 con 0x55eab347e730 2024-09-12T17:28:00.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.739+0000 7f8cc6e0d640 1 -- 172.21.15.170:0/1130516025 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dc8066070 con 0x55eab347e730 2024-09-12T17:28:00.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.739+0000 7f8cc6e0d640 1 -- 172.21.15.170:0/1130516025 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dc804ee50 con 0x55eab347e730 2024-09-12T17:28:00.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.739+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1130516025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eab347e730 msgr2=0x55eab356d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.739+0000 7f8ddd12c800 1 --2- 172.21.15.170:0/1130516025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eab347e730 0x55eab356d690 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8005fd0 tx=0x7f8dc8050000 comp rx=0 tx=0).stop 2024-09-12T17:28:00.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.739+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1130516025 shutdown_connections 2024-09-12T17:28:00.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.739+0000 7f8ddd12c800 1 --2- 172.21.15.170:0/1130516025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eab347e730 0x55eab356d690 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.739+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1130516025 >> 172.21.15.170:0/1130516025 conn(0x55eab34781d0 msgr2=0x55eab3569010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:00.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.739+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1130516025 shutdown_connections 2024-09-12T17:28:00.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.739+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1130516025 wait complete. 2024-09-12T17:28:00.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.740+0000 7f8ddd12c800 1 Processor -- start 2024-09-12T17:28:00.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.740+0000 7f8ddd12c800 1 -- start start 2024-09-12T17:28:00.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.740+0000 7f8ddd12c800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eab347e730 0x55eab3574f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.740+0000 7f8ddd12c800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55eab3485050 con 0x55eab347e730 2024-09-12T17:28:00.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.740+0000 7f8dd8d3e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eab347e730 0x55eab3574f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.740+0000 7f8dd8d3e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eab347e730 0x55eab3574f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57024/0 (socket says 172.21.15.170:57024) 2024-09-12T17:28:00.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.740+0000 7f8dd8d3e640 1 -- 172.21.15.170:0/1108800224 learned_addr learned my addr 172.21.15.170:0/1108800224 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:00.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.740+0000 7f8dd8d3e640 1 -- 172.21.15.170:0/1108800224 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eab3575460 con 0x55eab347e730 2024-09-12T17:28:00.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.740+0000 7f8dd8d3e640 1 --2- 172.21.15.170:0/1108800224 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eab347e730 0x55eab3574f00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8063040 tx=0x7f8dc8003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.741+0000 7f8cc560a640 1 -- 172.21.15.170:0/1108800224 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dc806d550 con 0x55eab347e730 2024-09-12T17:28:00.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.741+0000 7f8cc560a640 1 -- 172.21.15.170:0/1108800224 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dc8071030 con 0x55eab347e730 2024-09-12T17:28:00.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.741+0000 7f8cc560a640 1 -- 172.21.15.170:0/1108800224 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dc806d820 con 0x55eab347e730 2024-09-12T17:28:00.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.741+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1108800224 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eab35756f0 con 0x55eab347e730 2024-09-12T17:28:00.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.741+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1108800224 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eab35760f0 con 0x55eab347e730 2024-09-12T17:28:00.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.742+0000 7f8cc560a640 1 -- 172.21.15.170:0/1108800224 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8dc806d9c0 con 0x55eab347e730 2024-09-12T17:28:00.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.742+0000 7f8cc560a640 1 --2- 172.21.15.170:0/1108800224 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8cc003c780 0x7f8cc003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.742+0000 7f8cc560a640 1 -- 172.21.15.170:0/1108800224 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f8dc8097fd0 con 0x55eab347e730 2024-09-12T17:28:00.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.742+0000 7f8dd853d640 1 --2- 172.21.15.170:0/1108800224 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8cc003c780 0x7f8cc003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.742+0000 7f8ddd12c800 1 --2- 172.21.15.170:0/1108800224 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55eab3481060 0x55eab357c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.742+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1108800224 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55eab3576ce0 con 0x55eab3481060 2024-09-12T17:28:00.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.742+0000 7f8dd953f640 1 --2- 172.21.15.170:0/1108800224 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55eab3481060 0x55eab357c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.742+0000 7f8dd853d640 1 --2- 172.21.15.170:0/1108800224 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8cc003c780 0x7f8cc003ec40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc001e30 tx=0x7f8dcc001390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.743+0000 7f8dd953f640 1 --2- 172.21.15.170:0/1108800224 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55eab3481060 0x55eab357c550 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.743+0000 7f8dd953f640 1 -- 172.21.15.170:0/1108800224 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8dd00083e0 con 0x55eab3481060 2024-09-12T17:28:00.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.743+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1108800224 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55eab357cfd0 con 0x55eab3481060 2024-09-12T17:28:00.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.743+0000 7f8dd953f640 1 -- 172.21.15.170:0/1108800224 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8dd00083e0 con 0x55eab3481060 2024-09-12T17:28:00.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.743+0000 7f8ddd12c800 1 --2- 172.21.15.170:0/1108800224 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55eab357e8e0 0x55eab3580d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.743+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1108800224 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55eab3581510 con 0x55eab357e8e0 2024-09-12T17:28:00.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.743+0000 7f8dd8d3e640 1 --2- 172.21.15.170:0/1108800224 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55eab357e8e0 0x55eab3580d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.744+0000 7f8dd8d3e640 1 --2- 172.21.15.170:0/1108800224 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55eab357e8e0 0x55eab3580d80 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.744+0000 7f8dd8d3e640 1 -- 172.21.15.170:0/1108800224 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8dc807d070 con 0x55eab357e8e0 2024-09-12T17:28:00.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.744+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1108800224 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55eab357d820 con 0x55eab3481060 2024-09-12T17:28:00.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.744+0000 7f8dd953f640 1 -- 172.21.15.170:0/1108800224 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8dd00083e0 con 0x55eab3481060 2024-09-12T17:28:00.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.744+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1108800224 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55eab357dc00 con 0x55eab357e8e0 2024-09-12T17:28:00.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.745+0000 7f8dd8d3e640 1 -- 172.21.15.170:0/1108800224 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8dc807d070 con 0x55eab357e8e0 2024-09-12T17:28:00.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.745+0000 7f8ddd12c800 1 Processor -- start 2024-09-12T17:28:00.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.745+0000 7f8ddd12c800 1 -- start start 2024-09-12T17:28:00.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.745+0000 7f8ddd12c800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eab358fe00 0x55eab3590220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.745+0000 7f8ddd12c800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55eab3374a00 con 0x55eab358fe00 2024-09-12T17:28:00.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.745+0000 7f8dd953f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eab358fe00 0x55eab3590220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.745+0000 7f8dd953f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eab358fe00 0x55eab3590220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57028/0 (socket says 172.21.15.170:57028) 2024-09-12T17:28:00.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.745+0000 7f8dd953f640 1 -- 172.21.15.170:0/2135102061 learned_addr learned my addr 172.21.15.170:0/2135102061 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:00.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.746+0000 7f8dd953f640 1 -- 172.21.15.170:0/2135102061 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eab3590860 con 0x55eab358fe00 2024-09-12T17:28:00.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.746+0000 7f8dd953f640 1 --2- 172.21.15.170:0/2135102061 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eab358fe00 0x55eab3590220 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x55eab35764f0 tx=0x7f8dd000bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.746+0000 7f8cbe7fc640 1 -- 172.21.15.170:0/2135102061 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dd001c020 con 0x55eab358fe00 2024-09-12T17:28:00.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.746+0000 7f8cbe7fc640 1 -- 172.21.15.170:0/2135102061 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dd0007c90 con 0x55eab358fe00 2024-09-12T17:28:00.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.746+0000 7f8ddd12c800 1 -- 172.21.15.170:0/2135102061 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eab3591090 con 0x55eab358fe00 2024-09-12T17:28:00.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.746+0000 7f8cbe7fc640 1 -- 172.21.15.170:0/2135102061 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dd0018440 con 0x55eab358fe00 2024-09-12T17:28:00.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.746+0000 7f8ddd12c800 1 -- 172.21.15.170:0/2135102061 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eab3591630 con 0x55eab358fe00 2024-09-12T17:28:00.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.747+0000 7f8cbe7fc640 1 -- 172.21.15.170:0/2135102061 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8dd001f020 con 0x55eab358fe00 2024-09-12T17:28:00.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.747+0000 7f8cbe7fc640 1 --2- 172.21.15.170:0/2135102061 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8cb003c780 0x7f8cb003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.747+0000 7f8cbe7fc640 1 -- 172.21.15.170:0/2135102061 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f8dd0054d90 con 0x55eab358fe00 2024-09-12T17:28:00.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.747+0000 7f8dd8d3e640 1 --2- 172.21.15.170:0/2135102061 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8cb003c780 0x7f8cb003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.747+0000 7f8ddd12c800 1 Processor -- start 2024-09-12T17:28:00.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.747+0000 7f8dd8d3e640 1 --2- 172.21.15.170:0/2135102061 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8cb003c780 0x7f8cb003ec40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x55eab35818b0 tx=0x7f8dc8058160 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.747+0000 7f8ddd12c800 1 -- start start 2024-09-12T17:28:00.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.748+0000 7f8ddd12c800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eab347c730 0x55eab347cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.748+0000 7f8ddd12c800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55eab356de20 con 0x55eab347c730 2024-09-12T17:28:00.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.748+0000 7f8dd953f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eab347c730 0x55eab347cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.748+0000 7f8dd953f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eab347c730 0x55eab347cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57042/0 (socket says 172.21.15.170:57042) 2024-09-12T17:28:00.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.748+0000 7f8dd953f640 1 -- 172.21.15.170:0/879450277 learned_addr learned my addr 172.21.15.170:0/879450277 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:00.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.748+0000 7f8dd953f640 1 -- 172.21.15.170:0/879450277 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eab347d120 con 0x55eab347c730 2024-09-12T17:28:00.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.748+0000 7f8dd953f640 1 --2- 172.21.15.170:0/879450277 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eab347c730 0x55eab347cb30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0017f90 tx=0x7f8dd00175a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aa5afa1fcc507d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.748+0000 7f8caffff640 1 -- 172.21.15.170:0/879450277 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dd0050030 con 0x55eab347c730 2024-09-12T17:28:00.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.748+0000 7f8caffff640 1 -- 172.21.15.170:0/879450277 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dd0044130 con 0x55eab347c730 2024-09-12T17:28:00.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.748+0000 7f8caffff640 1 -- 172.21.15.170:0/879450277 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dd0016c50 con 0x55eab347c730 2024-09-12T17:28:00.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.749+0000 7f8ddd12c800 1 -- 172.21.15.170:0/879450277 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eab347c730 msgr2=0x55eab347cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.749+0000 7f8ddd12c800 1 --2- 172.21.15.170:0/879450277 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eab347c730 0x55eab347cb30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0017f90 tx=0x7f8dd00175a0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.749+0000 7f8ddd12c800 1 -- 172.21.15.170:0/879450277 shutdown_connections 2024-09-12T17:28:00.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.749+0000 7f8ddd12c800 1 --2- 172.21.15.170:0/879450277 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eab347c730 0x55eab347cb30 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.749+0000 7f8ddd12c800 1 -- 172.21.15.170:0/879450277 >> 172.21.15.170:0/879450277 conn(0x55eab3598cc0 msgr2=0x55eab3596f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:00.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.749+0000 7f8ddd12c800 1 -- 172.21.15.170:0/879450277 shutdown_connections 2024-09-12T17:28:00.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.749+0000 7f8ddd12c800 1 -- 172.21.15.170:0/879450277 wait complete. 2024-09-12T17:28:00.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.749+0000 7f8ddd12c800 1 Processor -- start 2024-09-12T17:28:00.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.749+0000 7f8ddd12c800 1 -- start start 2024-09-12T17:28:00.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.750+0000 7f8ddd12c800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eab347c730 0x55eab35a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.750+0000 7f8ddd12c800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55eab347d790 con 0x55eab347c730 2024-09-12T17:28:00.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.750+0000 7f8dd953f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eab347c730 0x55eab35a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.750+0000 7f8dd953f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eab347c730 0x55eab35a6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57056/0 (socket says 172.21.15.170:57056) 2024-09-12T17:28:00.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.750+0000 7f8dd953f640 1 -- 172.21.15.170:0/1278692686 learned_addr learned my addr 172.21.15.170:0/1278692686 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:00.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.750+0000 7f8dd953f640 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eab35a6660 con 0x55eab347c730 2024-09-12T17:28:00.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.750+0000 7f8dd953f640 1 --2- 172.21.15.170:0/1278692686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eab347c730 0x55eab35a6100 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0015c90 tx=0x7f8dd0053200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.750+0000 7f8cae7fc640 1 -- 172.21.15.170:0/1278692686 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dd0030070 con 0x55eab347c730 2024-09-12T17:28:00.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.750+0000 7f8cae7fc640 1 -- 172.21.15.170:0/1278692686 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dd0013bf0 con 0x55eab347c730 2024-09-12T17:28:00.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.750+0000 7f8cae7fc640 1 -- 172.21.15.170:0/1278692686 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dd0050050 con 0x55eab347c730 2024-09-12T17:28:00.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.750+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eab35a68f0 con 0x55eab347c730 2024-09-12T17:28:00.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.750+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eab35a7270 con 0x55eab347c730 2024-09-12T17:28:00.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.751+0000 7f8cae7fc640 1 -- 172.21.15.170:0/1278692686 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8dd0016040 con 0x55eab347c730 2024-09-12T17:28:00.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.751+0000 7f8cae7fc640 1 --2- 172.21.15.170:0/1278692686 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8ca403c780 0x7f8ca403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.751+0000 7f8cae7fc640 1 -- 172.21.15.170:0/1278692686 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f8dd0051070 con 0x55eab347c730 2024-09-12T17:28:00.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.751+0000 7f8dd8d3e640 1 --2- 172.21.15.170:0/1278692686 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8ca403c780 0x7f8ca403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.752+0000 7f8dd8d3e640 1 --2- 172.21.15.170:0/1278692686 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8ca403c780 0x7f8ca403ec40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8dc804e5a0 tx=0x7f8dc8088000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.752+0000 7f8ddd12c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.752+0000 7f8ddd12c800 1 --2- 172.21.15.170:0/1278692686 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55eab35b1a00 0x55eab35b3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.752+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55eab35b4610 con 0x55eab35b1a00 2024-09-12T17:28:00.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.752+0000 7f8dd853d640 1 --2- 172.21.15.170:0/1278692686 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55eab35b1a00 0x55eab35b3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.752+0000 7f8dd853d640 1 --2- 172.21.15.170:0/1278692686 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55eab35b1a00 0x55eab35b3ec0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.753+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8dcc00f610 con 0x55eab35b1a00 2024-09-12T17:28:00.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.753+0000 7f8ddd12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.753+0000 7f8ddd12c800 20 realm 2024-09-12T17:28:00.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.753+0000 7f8ddd12c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.753+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55eab35b0d50 con 0x55eab35b1a00 2024-09-12T17:28:00.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.753+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8dcc00f610 con 0x55eab35b1a00 2024-09-12T17:28:00.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.753+0000 7f8ddd12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.753+0000 7f8ddd12c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:00.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.753+0000 7f8ddd12c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.753+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55eab35b5100 con 0x55eab35b1a00 2024-09-12T17:28:00.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.753+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8dcc00f610 con 0x55eab35b1a00 2024-09-12T17:28:00.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.753+0000 7f8ddd12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.753+0000 7f8ddd12c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.753+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55eab35b59d0 con 0x55eab35b1a00 2024-09-12T17:28:00.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.753+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8dcc00f610 con 0x55eab35b1a00 2024-09-12T17:28:00.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.753+0000 7f8ddd12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:00.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.753+0000 7f8ddd12c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.753+0000 7f8ddd12c800 1 --2- 172.21.15.170:0/1278692686 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55eab35b63f0 0x55eab35b87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.753+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55eab35b8f20 con 0x55eab35b63f0 2024-09-12T17:28:00.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.753+0000 7f8dd953f640 1 --2- 172.21.15.170:0/1278692686 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55eab35b63f0 0x55eab35b87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.754+0000 7f8dd953f640 1 --2- 172.21.15.170:0/1278692686 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55eab35b63f0 0x55eab35b87e0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.754+0000 7f8dd953f640 1 -- 172.21.15.170:0/1278692686 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8dd00083e0 con 0x55eab35b63f0 2024-09-12T17:28:00.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.754+0000 7f8ddd12c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:00.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.754+0000 7f8ddd12c800 20 searching for the correct realm 2024-09-12T17:28:00.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.754+0000 7f8ddd12c800 1 --2- 172.21.15.170:0/1278692686 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55eab35baed0 0x55eab35bd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.754+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eab35bda10 con 0x55eab35baed0 2024-09-12T17:28:00.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.754+0000 7f8dd8d3e640 1 --2- 172.21.15.170:0/1278692686 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55eab35baed0 0x55eab35bd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.754+0000 7f8dd8d3e640 1 --2- 172.21.15.170:0/1278692686 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55eab35baed0 0x55eab35bd390 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.755+0000 7f8dd8d3e640 1 -- 172.21.15.170:0/1278692686 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dc807d070 con 0x55eab35baed0 2024-09-12T17:28:00.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.755+0000 7f8dd8d3e640 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eab35bda10 con 0x55eab35b63f0 2024-09-12T17:28:00.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.755+0000 7f8dd953f640 1 -- 172.21.15.170:0/1278692686 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dd00083e0 con 0x55eab35b63f0 2024-09-12T17:28:00.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.755+0000 7f8dd953f640 1 --2- 172.21.15.170:0/1278692686 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f8dd0021020 0x7f8dd0020ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.755+0000 7f8dd953f640 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eab35bda10 con 0x7f8dd0021020 2024-09-12T17:28:00.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.755+0000 7f8dd853d640 1 --2- 172.21.15.170:0/1278692686 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f8dd0021020 0x7f8dd0020ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.755+0000 7f8dd853d640 1 --2- 172.21.15.170:0/1278692686 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f8dd0021020 0x7f8dd0020ac0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.756+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dcc00f610 con 0x7f8dd0021020 2024-09-12T17:28:00.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.756+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eab35bda10 con 0x55eab35b1a00 2024-09-12T17:28:00.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.756+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dcc00f610 con 0x55eab35b1a00 2024-09-12T17:28:00.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.756+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eab35bda10 con 0x55eab35b1a00 2024-09-12T17:28:00.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.756+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dcc02b040 con 0x55eab35b1a00 2024-09-12T17:28:00.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.756+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eab35bda10 con 0x7f8dd0021020 2024-09-12T17:28:00.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.756+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dcc02b040 con 0x7f8dd0021020 2024-09-12T17:28:00.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.756+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eab35bda10 con 0x7f8dd0021020 2024-09-12T17:28:00.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.757+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dcc02b040 con 0x7f8dd0021020 2024-09-12T17:28:00.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.757+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eab35bda10 con 0x55eab35b63f0 2024-09-12T17:28:00.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.757+0000 7f8dd953f640 1 -- 172.21.15.170:0/1278692686 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dd00083e0 con 0x55eab35b63f0 2024-09-12T17:28:00.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.757+0000 7f8dd953f640 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eab35bda10 con 0x55eab35baed0 2024-09-12T17:28:00.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.757+0000 7f8dd8d3e640 1 -- 172.21.15.170:0/1278692686 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dc807d070 con 0x55eab35baed0 2024-09-12T17:28:00.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.757+0000 7f8dd8d3e640 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eab35bda10 con 0x55eab35b1a00 2024-09-12T17:28:00.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.757+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dcc02b040 con 0x55eab35b1a00 2024-09-12T17:28:00.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.757+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eab35bda10 con 0x7f8dd0021020 2024-09-12T17:28:00.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.758+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dcc02b040 con 0x7f8dd0021020 2024-09-12T17:28:00.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.758+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eab35bda10 con 0x55eab35b1a00 2024-09-12T17:28:00.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.758+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dcc02b040 con 0x55eab35b1a00 2024-09-12T17:28:00.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.758+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eab35bda10 con 0x55eab35b63f0 2024-09-12T17:28:00.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.758+0000 7f8dd953f640 1 -- 172.21.15.170:0/1278692686 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f8dd00083e0 con 0x55eab35b63f0 2024-09-12T17:28:00.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.758+0000 7f8dd953f640 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eab35bda10 con 0x55eab35baed0 2024-09-12T17:28:00.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.758+0000 7f8dd8d3e640 1 -- 172.21.15.170:0/1278692686 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dc807d070 con 0x55eab35baed0 2024-09-12T17:28:00.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.758+0000 7f8dd8d3e640 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eab35bda10 con 0x55eab35baed0 2024-09-12T17:28:00.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.758+0000 7f8dd8d3e640 1 -- 172.21.15.170:0/1278692686 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dc807d070 con 0x55eab35baed0 2024-09-12T17:28:00.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.759+0000 7f8dd8d3e640 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eab35bda10 con 0x7f8dd0021020 2024-09-12T17:28:00.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.759+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dcc02b040 con 0x7f8dd0021020 2024-09-12T17:28:00.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.759+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eab35bda10 con 0x55eab35baed0 2024-09-12T17:28:00.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.759+0000 7f8dd8d3e640 1 -- 172.21.15.170:0/1278692686 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dc807d070 con 0x55eab35baed0 2024-09-12T17:28:00.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.759+0000 7f8dd8d3e640 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eab35bda10 con 0x55eab35baed0 2024-09-12T17:28:00.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.759+0000 7f8dd8d3e640 1 -- 172.21.15.170:0/1278692686 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dc807d070 con 0x55eab35baed0 2024-09-12T17:28:00.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.759+0000 7f8dd8d3e640 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eab35bda10 con 0x55eab35b1a00 2024-09-12T17:28:00.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.759+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dcc02b040 con 0x55eab35b1a00 2024-09-12T17:28:00.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.759+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eab35bda10 con 0x55eab35b1a00 2024-09-12T17:28:00.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.760+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8dcc02b040 con 0x55eab35b1a00 2024-09-12T17:28:00.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.760+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eab35bda10 con 0x7f8dd0021020 2024-09-12T17:28:00.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.760+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dcc02b040 con 0x7f8dd0021020 2024-09-12T17:28:00.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.760+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eab35bda10 con 0x55eab35baed0 2024-09-12T17:28:00.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.760+0000 7f8dd8d3e640 1 -- 172.21.15.170:0/1278692686 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dc807d070 con 0x55eab35baed0 2024-09-12T17:28:00.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.760+0000 7f8dd8d3e640 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eab35bda10 con 0x55eab35b63f0 2024-09-12T17:28:00.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.760+0000 7f8dd953f640 1 -- 172.21.15.170:0/1278692686 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dd00083e0 con 0x55eab35b63f0 2024-09-12T17:28:00.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.760+0000 7f8dd953f640 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eab35bda10 con 0x55eab35b1a00 2024-09-12T17:28:00.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.761+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dcc02b040 con 0x55eab35b1a00 2024-09-12T17:28:00.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.761+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eab35bda10 con 0x7f8dd0021020 2024-09-12T17:28:00.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.761+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dcc03b040 con 0x7f8dd0021020 2024-09-12T17:28:00.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.761+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eab35bda10 con 0x55eab35baed0 2024-09-12T17:28:00.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.761+0000 7f8dd8d3e640 1 -- 172.21.15.170:0/1278692686 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dc807d070 con 0x55eab35baed0 2024-09-12T17:28:00.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.761+0000 7f8dd8d3e640 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eab35bda10 con 0x7f8dd0021020 2024-09-12T17:28:00.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.761+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dcc03b040 con 0x7f8dd0021020 2024-09-12T17:28:00.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.761+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eab35bda10 con 0x55eab35b63f0 2024-09-12T17:28:00.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.761+0000 7f8dd953f640 1 -- 172.21.15.170:0/1278692686 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dd00083e0 con 0x55eab35b63f0 2024-09-12T17:28:00.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.761+0000 7f8dd953f640 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eab35bda10 con 0x55eab35baed0 2024-09-12T17:28:00.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.762+0000 7f8dd8d3e640 1 -- 172.21.15.170:0/1278692686 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dc807d070 con 0x55eab35baed0 2024-09-12T17:28:00.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.762+0000 7f8dd8d3e640 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eab35bda10 con 0x7f8dd0021020 2024-09-12T17:28:00.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.762+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dcc03b040 con 0x7f8dd0021020 2024-09-12T17:28:00.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.762+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eab35bda10 con 0x55eab35b1a00 2024-09-12T17:28:00.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.762+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8dcc03b040 con 0x55eab35b1a00 2024-09-12T17:28:00.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.762+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55eab35bda10 con 0x55eab35b63f0 2024-09-12T17:28:00.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.762+0000 7f8dd953f640 1 -- 172.21.15.170:0/1278692686 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8dd00083e0 con 0x55eab35b63f0 2024-09-12T17:28:00.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.762+0000 7f8ddd12c800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:00.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.762+0000 7f8ddd12c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:00.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.762+0000 7f8ddd12c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:00.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.762+0000 7f8ddd12c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:00.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.762+0000 7f8ddd12c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:00.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.762+0000 7f8ddd12c800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:00.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.762+0000 7f8ddd12c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.762+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55eab35b98e0 con 0x55eab35b1a00 2024-09-12T17:28:00.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.763+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8dcc03b040 con 0x55eab35b1a00 2024-09-12T17:28:00.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.763+0000 7f8ddd12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.763+0000 7f8ddd12c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.763+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55eab35ba180 con 0x55eab35b1a00 2024-09-12T17:28:00.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.763+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8dcc03b040 con 0x55eab35b1a00 2024-09-12T17:28:00.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.763+0000 7f8ddd12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:00.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.763+0000 7f8ddd12c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.763+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55eab35b9520 con 0x55eab35b63f0 2024-09-12T17:28:00.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.763+0000 7f8dd953f640 1 -- 172.21.15.170:0/1278692686 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8dd00083e0 con 0x55eab35b63f0 2024-09-12T17:28:00.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.763+0000 7f8ddd12c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:00.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.763+0000 7f8ddd12c800 20 zone default found 2024-09-12T17:28:00.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.763+0000 7f8ddd12c800 4 Realm: () 2024-09-12T17:28:00.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.763+0000 7f8ddd12c800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:00.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.763+0000 7f8ddd12c800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:00.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.763+0000 7f8ddd12c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:00.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.763+0000 7f8ddd12c800 20 zonegroup default 2024-09-12T17:28:00.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.763+0000 7f8ddd12c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.763+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55eab35be340 con 0x7f8dd0021020 2024-09-12T17:28:00.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.764+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8dcc03b040 con 0x7f8dd0021020 2024-09-12T17:28:00.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.764+0000 7f8ddd12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.764+0000 7f8ddd12c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.764+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55eab35c0040 con 0x55eab35baed0 2024-09-12T17:28:00.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.764+0000 7f8dd8d3e640 1 -- 172.21.15.170:0/1278692686 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8dc807d070 con 0x55eab35baed0 2024-09-12T17:28:00.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.764+0000 7f8ddd12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.764+0000 7f8ddd12c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.764+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55eab35c04d0 con 0x55eab35baed0 2024-09-12T17:28:00.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.764+0000 7f8dd8d3e640 1 -- 172.21.15.170:0/1278692686 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8dc807d070 con 0x55eab35baed0 2024-09-12T17:28:00.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.764+0000 7f8ddd12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.764+0000 7f8ddd12c800 20 started sync module instance, tier type = 2024-09-12T17:28:00.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.764+0000 7f8ddd12c800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:00.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.764+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eab35bee10 con 0x55eab35b63f0 2024-09-12T17:28:00.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.765+0000 7f8dd953f640 1 -- 172.21.15.170:0/1278692686 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dd00083e0 con 0x55eab35b63f0 2024-09-12T17:28:00.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.765+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94466519855920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eab35bee10 con 0x55eab35b63f0 2024-09-12T17:28:00.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.765+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eab35c1050 con 0x55eab35b1a00 2024-09-12T17:28:00.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.766+0000 7f8dd953f640 1 -- 172.21.15.170:0/1278692686 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94466519855920] v29'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dd00083e0 con 0x55eab35b63f0 2024-09-12T17:28:00.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.767+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dcc03b040 con 0x55eab35b1a00 2024-09-12T17:28:00.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.767+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94466519862048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eab35bee10 con 0x55eab35b1a00 2024-09-12T17:28:00.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.767+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eab35c1b00 con 0x55eab35baed0 2024-09-12T17:28:00.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.768+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94466519862048] v29'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dcc03b040 con 0x55eab35b1a00 2024-09-12T17:28:00.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.768+0000 7f8dd8d3e640 1 -- 172.21.15.170:0/1278692686 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dc807d070 con 0x55eab35baed0 2024-09-12T17:28:00.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.768+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94466519853408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eab35bed80 con 0x55eab35baed0 2024-09-12T17:28:00.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.768+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eab35c29c0 con 0x55eab35b63f0 2024-09-12T17:28:00.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.769+0000 7f8dd8d3e640 1 -- 172.21.15.170:0/1278692686 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94466519853408] v29'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dc807d070 con 0x55eab35baed0 2024-09-12T17:28:00.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.769+0000 7f8dd953f640 1 -- 172.21.15.170:0/1278692686 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dd00083e0 con 0x55eab35b63f0 2024-09-12T17:28:00.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.769+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94466519868688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eab35c2930 con 0x55eab35b63f0 2024-09-12T17:28:00.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.769+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eab35c3780 con 0x55eab35b1a00 2024-09-12T17:28:00.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.770+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dcc03b040 con 0x55eab35b1a00 2024-09-12T17:28:00.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.770+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94466519872096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eab35c3780 con 0x55eab35b1a00 2024-09-12T17:28:00.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.770+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eab35c4700 con 0x7f8dd0021020 2024-09-12T17:28:00.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.770+0000 7f8dd953f640 1 -- 172.21.15.170:0/1278692686 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94466519868688] v29'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dd00083e0 con 0x55eab35b63f0 2024-09-12T17:28:00.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.771+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dcc03b040 con 0x7f8dd0021020 2024-09-12T17:28:00.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.771+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94466519876080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eab35c46c0 con 0x7f8dd0021020 2024-09-12T17:28:00.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.771+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eab35c46c0 con 0x7f8dd0021020 2024-09-12T17:28:00.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.771+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94466519872096] v29'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dcc03b040 con 0x55eab35b1a00 2024-09-12T17:28:00.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.772+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v29'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dcc03b040 con 0x7f8dd0021020 2024-09-12T17:28:00.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.772+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94466519874320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eab35c5140 con 0x7f8dd0021020 2024-09-12T17:28:00.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.772+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eab35c5b40 con 0x7f8dd0021020 2024-09-12T17:28:00.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.772+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94466519876080] v29'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dcc03b040 con 0x7f8dd0021020 2024-09-12T17:28:00.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.773+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94466519874320] v29'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dcc03b040 con 0x7f8dd0021020 2024-09-12T17:28:00.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.773+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(58 notify.7 [create] v29'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dcc03b040 con 0x7f8dd0021020 2024-09-12T17:28:00.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.773+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94466519870896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eab35c4c90 con 0x7f8dd0021020 2024-09-12T17:28:00.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.773+0000 7f8ddd12c800 20 add_watcher() i=0 2024-09-12T17:28:00.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.773+0000 7f8ddd12c800 20 add_watcher() i=1 2024-09-12T17:28:00.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.773+0000 7f8ddd12c800 20 add_watcher() i=2 2024-09-12T17:28:00.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.773+0000 7f8ddd12c800 20 add_watcher() i=3 2024-09-12T17:28:00.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.773+0000 7f8ddd12c800 20 add_watcher() i=4 2024-09-12T17:28:00.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.773+0000 7f8ddd12c800 20 add_watcher() i=5 2024-09-12T17:28:00.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.773+0000 7f8ddd12c800 20 add_watcher() i=6 2024-09-12T17:28:00.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.774+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94466519870896] v29'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dcc03b040 con 0x7f8dd0021020 2024-09-12T17:28:00.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.774+0000 7f8ddd12c800 20 add_watcher() i=7 2024-09-12T17:28:00.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.774+0000 7f8ddd12c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:00.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.774+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55eab35c8c40 con 0x55eab35b1a00 2024-09-12T17:28:00.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.774+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8dcc03b040 con 0x55eab35b1a00 2024-09-12T17:28:00.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.774+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94466519881296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eab35c60c0 con 0x55eab35b1a00 2024-09-12T17:28:00.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.775+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94466519881296] v29'70 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8dcc03b040 con 0x55eab35b1a00 2024-09-12T17:28:00.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.775+0000 7f8c8f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:00.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.776+0000 7f8ddd12c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:00.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.776+0000 7f8ddd12c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:00.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.776+0000 7f8ddd12c800 5 note: GC not initialized 2024-09-12T17:28:00.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.776+0000 7f8c8e7e4640 20 reqs_thread_entry: start 2024-09-12T17:28:00.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.776+0000 7f8ddd12c800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:00.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.776+0000 7f8ddd12c800 20 Filter name: none 2024-09-12T17:28:00.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.776+0000 7f8c87fff640 20 reqs_thread_entry: start 2024-09-12T17:28:00.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.776+0000 7f8ddd12c800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:28:00.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.776+0000 7f8ddd12c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.776+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55eab35fba50 con 0x55eab35b1a00 2024-09-12T17:28:00.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.776+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f8dcc03b040 con 0x55eab35b1a00 2024-09-12T17:28:00.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.777+0000 7f8ddd12c800 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:28:00.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.777+0000 7f8ddd12c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T17:28:00.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.777+0000 7f8ddd12c800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:28:00.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.777+0000 7f8ddd12c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:00.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.777+0000 7f8ddd12c800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-09-12T17:28:00.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.777+0000 7f8ddd12c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.777+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55eab35fc360 con 0x55eab35b1a00 2024-09-12T17:28:00.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.777+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f8dcc03b040 con 0x55eab35b1a00 2024-09-12T17:28:00.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.777+0000 7f8ddd12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.777+0000 7f8ddd12c800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-09-12T17:28:00.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.777+0000 7f8ddd12c800 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-12T17:28:00.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.777+0000 7f8ddd12c800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-09-12T17:28:00.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.777+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eab3601c90 con 0x55eab35b1a00 2024-09-12T17:28:00.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.778+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~556] v29'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f8dcc03b040 con 0x55eab35b1a00 2024-09-12T17:28:00.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.778+0000 7f8ddd12c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:28:00.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.778+0000 7f8ddd12c800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:28:00.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.778+0000 7f8ddd12c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T17:28:00.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.778+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94466520127120 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55eab35fd370 con 0x55eab35b1a00 2024-09-12T17:28:00.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.778+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== watch-notify(notify (1) cookie 94466519872096 notify 124554051589 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f8dcc018040 con 0x55eab35b1a00 2024-09-12T17:28:00.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.778+0000 7f8caffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051589 cookie 94466519872096 notifier 4358 bl.length()=732 2024-09-12T17:28:00.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.778+0000 7f8caffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:28:00.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.778+0000 7f8caffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:28:00.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.778+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(65 notify.4 [notify cookie 94466520127120 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8dcc03b040 con 0x55eab35b1a00 2024-09-12T17:28:00.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.778+0000 7f8caffff640 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f8c9c003ea0 con 0x55eab35b1a00 2024-09-12T17:28:00.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.779+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dcc03b040 con 0x55eab35b1a00 2024-09-12T17:28:00.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.779+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== watch-notify(notify_complete (2) cookie 94466520127120 notify 124554051589 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8dcc009050 con 0x55eab35b1a00 2024-09-12T17:28:00.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.779+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eab3601690 con 0x55eab35b1a00 2024-09-12T17:28:00.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.780+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v29'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f8dcc03b040 con 0x55eab35b1a00 2024-09-12T17:28:00.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.780+0000 7f8ddd12c800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-12T17:28:00.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.780+0000 7f8ddd12c800 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-12T17:28:00.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.780+0000 7f8ddd12c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-12T17:28:00.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.780+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94466520127120 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55eab35fcec0 con 0x55eab35b63f0 2024-09-12T17:28:00.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.780+0000 7f8dd953f640 1 -- 172.21.15.170:0/1278692686 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== watch-notify(notify (1) cookie 94466519855920 notify 124554051586 ret 0) ==== 208+0+0 (crc 0 0 0) 0x55eab35a68f0 con 0x55eab35b63f0 2024-09-12T17:28:00.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.780+0000 7f8caf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051586 cookie 94466519855920 notifier 4358 bl.length()=166 2024-09-12T17:28:00.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.780+0000 7f8caf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-12T17:28:00.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.780+0000 7f8caf7fe640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-12T17:28:00.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.780+0000 7f8caf7fe640 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f8c00003400 con 0x55eab35b63f0 2024-09-12T17:28:00.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.780+0000 7f8dd953f640 1 -- 172.21.15.170:0/1278692686 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(68 notify.0 [notify cookie 94466520127120 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8dd00083e0 con 0x55eab35b63f0 2024-09-12T17:28:00.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.780+0000 7f8dd953f640 1 -- 172.21.15.170:0/1278692686 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dd00083e0 con 0x55eab35b63f0 2024-09-12T17:28:00.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.780+0000 7f8dd953f640 1 -- 172.21.15.170:0/1278692686 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== watch-notify(notify_complete (2) cookie 94466520127120 notify 124554051586 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55eab35a6660 con 0x55eab35b63f0 2024-09-12T17:28:00.794 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T17:27:59.362376Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"8fbU3wvytA8mcTtadacbQbWY9GhuHtZRcGj6If0q","active":true,"create_date":"2024-09-12T17:28:00.778209Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:27:59.362351Z","tags":[],"group_ids":[]} 2024-09-12T17:28:00.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.781+0000 7f8c8f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:00.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.781+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94466519881296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eab35f98d0 con 0x55eab35b1a00 2024-09-12T17:28:00.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.782+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94466519881296] v29'71 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8dcc03b040 con 0x55eab35b1a00 2024-09-12T17:28:00.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.782+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94466519855920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eab35f98d0 con 0x55eab35b63f0 2024-09-12T17:28:00.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.783+0000 7f8dd953f640 1 -- 172.21.15.170:0/1278692686 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94466519855920] v29'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dd00083e0 con 0x55eab35b63f0 2024-09-12T17:28:00.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.783+0000 7f8ddd12c800 20 remove_watcher() i=0 2024-09-12T17:28:00.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.783+0000 7f8ddd12c800 2 removed watcher, disabling cache 2024-09-12T17:28:00.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.783+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94466519862048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eab35f98d0 con 0x55eab35b1a00 2024-09-12T17:28:00.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.784+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.1 v2:172.21.15.170:6800/1903654092 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94466519862048] v29'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dcc03b040 con 0x55eab35b1a00 2024-09-12T17:28:00.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.784+0000 7f8ddd12c800 20 remove_watcher() i=1 2024-09-12T17:28:00.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.784+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94466519853408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eab35f98d0 con 0x55eab35baed0 2024-09-12T17:28:00.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.785+0000 7f8dd8d3e640 1 -- 172.21.15.170:0/1278692686 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94466519853408] v29'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dc807d070 con 0x55eab35baed0 2024-09-12T17:28:00.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.785+0000 7f8ddd12c800 20 remove_watcher() i=2 2024-09-12T17:28:00.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.785+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94466519868688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eab35f98d0 con 0x55eab35b63f0 2024-09-12T17:28:00.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.786+0000 7f8dd953f640 1 -- 172.21.15.170:0/1278692686 <== osd.2 v2:172.21.15.170:6808/3855567754 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94466519868688] v29'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dd00083e0 con 0x55eab35b63f0 2024-09-12T17:28:00.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.786+0000 7f8ddd12c800 20 remove_watcher() i=3 2024-09-12T17:28:00.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.786+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94466519872096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eab35f98d0 con 0x55eab35b1a00 2024-09-12T17:28:00.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.787+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.1 v2:172.21.15.170:6800/1903654092 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94466519872096] v29'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dcc03b040 con 0x55eab35b1a00 2024-09-12T17:28:00.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.787+0000 7f8ddd12c800 20 remove_watcher() i=4 2024-09-12T17:28:00.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.787+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94466519876080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eab35f98d0 con 0x7f8dd0021020 2024-09-12T17:28:00.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.788+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94466519876080] v29'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dcc03b040 con 0x7f8dd0021020 2024-09-12T17:28:00.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.788+0000 7f8ddd12c800 20 remove_watcher() i=5 2024-09-12T17:28:00.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.788+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94466519874320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eab35f98d0 con 0x7f8dd0021020 2024-09-12T17:28:00.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.789+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94466519874320] v29'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dcc03b040 con 0x7f8dd0021020 2024-09-12T17:28:00.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.789+0000 7f8ddd12c800 20 remove_watcher() i=6 2024-09-12T17:28:00.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.789+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94466519870896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55eab35f98d0 con 0x7f8dd0021020 2024-09-12T17:28:00.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.790+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94466519870896] v29'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dcc03b040 con 0x7f8dd0021020 2024-09-12T17:28:00.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.790+0000 7f8ddd12c800 20 remove_watcher() i=7 2024-09-12T17:28:00.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.790+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f8dd0021020 msgr2=0x7f8dd0020ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.790+0000 7f8ddd12c800 1 --2- 172.21.15.170:0/1278692686 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f8dd0021020 0x7f8dd0020ac0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.790+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55eab35b1a00 msgr2=0x55eab35b3ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.790+0000 7f8ddd12c800 1 --2- 172.21.15.170:0/1278692686 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55eab35b1a00 0x55eab35b3ec0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.790+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55eab35b63f0 msgr2=0x55eab35b87e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.790+0000 7f8ddd12c800 1 --2- 172.21.15.170:0/1278692686 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55eab35b63f0 0x55eab35b87e0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.790+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55eab35baed0 msgr2=0x55eab35bd390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.791+0000 7f8ddd12c800 1 --2- 172.21.15.170:0/1278692686 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55eab35baed0 0x55eab35bd390 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.791+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8ca403c780 msgr2=0x7f8ca403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.791+0000 7f8ddd12c800 1 --2- 172.21.15.170:0/1278692686 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8ca403c780 0x7f8ca403ec40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8dc804e5a0 tx=0x7f8dc8088000 comp rx=0 tx=0).stop 2024-09-12T17:28:00.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.791+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eab347c730 msgr2=0x55eab35a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.791+0000 7f8dd853d640 1 -- 172.21.15.170:0/1278692686 reap_dead start 2024-09-12T17:28:00.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.791+0000 7f8ddd12c800 1 --2- 172.21.15.170:0/1278692686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eab347c730 0x55eab35a6100 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0015c90 tx=0x7f8dd0053200 comp rx=0 tx=0).stop 2024-09-12T17:28:00.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.791+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 shutdown_connections 2024-09-12T17:28:00.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.791+0000 7f8ddd12c800 1 --2- 172.21.15.170:0/1278692686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eab347c730 0x55eab35a6100 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.791+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 >> 172.21.15.170:0/1278692686 conn(0x55eab3598cc0 msgr2=0x55eab3596ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:00.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.791+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 shutdown_connections 2024-09-12T17:28:00.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.791+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1278692686 wait complete. 2024-09-12T17:28:00.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.791+0000 7f8ddd12c800 1 -- 172.21.15.170:0/2135102061 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8cb003c780 msgr2=0x7f8cb003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.791+0000 7f8ddd12c800 1 --2- 172.21.15.170:0/2135102061 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8cb003c780 0x7f8cb003ec40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x55eab35818b0 tx=0x7f8dc8058160 comp rx=0 tx=0).stop 2024-09-12T17:28:00.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.791+0000 7f8ddd12c800 1 -- 172.21.15.170:0/2135102061 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eab358fe00 msgr2=0x55eab3590220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.791+0000 7f8ddd12c800 1 --2- 172.21.15.170:0/2135102061 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eab358fe00 0x55eab3590220 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x55eab35764f0 tx=0x7f8dd000bf30 comp rx=0 tx=0).stop 2024-09-12T17:28:00.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.791+0000 7f8ddd12c800 1 -- 172.21.15.170:0/2135102061 shutdown_connections 2024-09-12T17:28:00.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.791+0000 7f8ddd12c800 1 --2- 172.21.15.170:0/2135102061 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8cb003c780 0x7f8cb003ec40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.791+0000 7f8ddd12c800 1 --2- 172.21.15.170:0/2135102061 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eab358fe00 0x55eab3590220 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.791+0000 7f8ddd12c800 1 -- 172.21.15.170:0/2135102061 >> 172.21.15.170:0/2135102061 conn(0x55eab35841b0 msgr2=0x55eab3584590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:00.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.791+0000 7f8ddd12c800 1 -- 172.21.15.170:0/2135102061 shutdown_connections 2024-09-12T17:28:00.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.791+0000 7f8ddd12c800 1 -- 172.21.15.170:0/2135102061 wait complete. 2024-09-12T17:28:00.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.791+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1108800224 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55eab3481060 msgr2=0x55eab357c550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.791+0000 7f8ddd12c800 1 --2- 172.21.15.170:0/1108800224 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55eab3481060 0x55eab357c550 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.791+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1108800224 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55eab357e8e0 msgr2=0x55eab3580d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.791+0000 7f8ddd12c800 1 --2- 172.21.15.170:0/1108800224 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55eab357e8e0 0x55eab3580d80 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.792+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1108800224 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8cc003c780 msgr2=0x7f8cc003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.792+0000 7f8ddd12c800 1 --2- 172.21.15.170:0/1108800224 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8cc003c780 0x7f8cc003ec40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc001e30 tx=0x7f8dcc001390 comp rx=0 tx=0).stop 2024-09-12T17:28:00.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.792+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1108800224 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eab347e730 msgr2=0x55eab3574f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.792+0000 7f8ddd12c800 1 --2- 172.21.15.170:0/1108800224 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eab347e730 0x55eab3574f00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8063040 tx=0x7f8dc8003330 comp rx=0 tx=0).stop 2024-09-12T17:28:00.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.792+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1108800224 shutdown_connections 2024-09-12T17:28:00.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.792+0000 7f8ddd12c800 1 --2- 172.21.15.170:0/1108800224 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55eab357e8e0 0x55eab3580d80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.792+0000 7f8ddd12c800 1 --2- 172.21.15.170:0/1108800224 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8cc003c780 0x7f8cc003ec40 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.792+0000 7f8ddd12c800 1 --2- 172.21.15.170:0/1108800224 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55eab3481060 0x55eab357c550 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.792+0000 7f8ddd12c800 1 --2- 172.21.15.170:0/1108800224 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55eab347e730 0x55eab3574f00 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.792+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1108800224 >> 172.21.15.170:0/1108800224 conn(0x55eab34781d0 msgr2=0x55eab356e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:00.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.792+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1108800224 shutdown_connections 2024-09-12T17:28:00.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.792+0000 7f8ddd12c800 1 -- 172.21.15.170:0/1108800224 wait complete. 2024-09-12T17:28:00.812 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T17:27:59.362376Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': '8fbU3wvytA8mcTtadacbQbWY9GhuHtZRcGj6If0q', 'active': True, 'create_date': '2024-09-12T17:28:00.778209Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:27:59.362351Z', 'tags': [], 'group_ids': []} 2024-09-12T17:28:00.812 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-12T17:28:00.812 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-12T17:28:00.812 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-09-12T17:28:00.861 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:00.861 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:00.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.861+0000 7fda61919800 1 Processor -- start 2024-09-12T17:28:00.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.861+0000 7fda61919800 1 -- start start 2024-09-12T17:28:00.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.861+0000 7fda61919800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5566532952e0 0x55665329ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.861+0000 7fda61919800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55665313de40 con 0x556653294010 2024-09-12T17:28:00.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.861+0000 7fda61919800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x556653108680 con 0x5566532952e0 2024-09-12T17:28:00.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.861+0000 7fda5ec02640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5566532952e0 0x55665329ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.861+0000 7fda5f403640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x556653294010 0x556653294bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:48326/0 (socket says 172.21.15.170:48326) 2024-09-12T17:28:00.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.861+0000 7fda5ec02640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5566532952e0 0x55665329ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57066/0 (socket says 172.21.15.170:57066) 2024-09-12T17:28:00.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.861+0000 7fda5f403640 1 -- 172.21.15.170:0/2988100172 learned_addr learned my addr 172.21.15.170:0/2988100172 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:28:00.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.862+0000 7fda5ec02640 1 -- 172.21.15.170:0/2988100172 >> v1:172.21.15.47:6789/0 conn(0x556653294010 legacy=0x556653294bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.862+0000 7fda5ec02640 1 -- 172.21.15.170:0/2988100172 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566531246b0 con 0x5566532952e0 2024-09-12T17:28:00.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.863+0000 7fda5ec02640 1 --2- 172.21.15.170:0/2988100172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5566532952e0 0x55665329ae80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fda5400a470 tx=0x7fda54045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=101202c3dc9f6acb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.864+0000 7fda5e401640 1 -- 172.21.15.170:0/2988100172 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda54053570 con 0x5566532952e0 2024-09-12T17:28:00.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.864+0000 7fda5e401640 1 -- 172.21.15.170:0/2988100172 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda54058070 con 0x5566532952e0 2024-09-12T17:28:00.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.864+0000 7fda5e401640 1 -- 172.21.15.170:0/2988100172 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda54053880 con 0x5566532952e0 2024-09-12T17:28:00.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.864+0000 7fda61919800 1 -- 172.21.15.170:0/2988100172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5566532952e0 msgr2=0x55665329ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.864+0000 7fda61919800 1 --2- 172.21.15.170:0/2988100172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5566532952e0 0x55665329ae80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fda5400a470 tx=0x7fda54045a20 comp rx=0 tx=0).stop 2024-09-12T17:28:00.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.864+0000 7fda61919800 1 -- 172.21.15.170:0/2988100172 shutdown_connections 2024-09-12T17:28:00.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.864+0000 7fda61919800 1 --2- 172.21.15.170:0/2988100172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5566532952e0 0x55665329ae80 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.864+0000 7fda61919800 1 -- 172.21.15.170:0/2988100172 >> 172.21.15.170:0/2988100172 conn(0x55665328f3e0 msgr2=0x556653291840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:00.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.864+0000 7fda61919800 1 -- 172.21.15.170:0/2988100172 shutdown_connections 2024-09-12T17:28:00.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.864+0000 7fda61919800 1 -- 172.21.15.170:0/2988100172 wait complete. 2024-09-12T17:28:00.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.878+0000 7fda61919800 1 Processor -- start 2024-09-12T17:28:00.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.878+0000 7fda61919800 1 -- start start 2024-09-12T17:28:00.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.878+0000 7fda61919800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556653294010 0x5566532096d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.878+0000 7fda61919800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55665312cdd0 con 0x556653294010 2024-09-12T17:28:00.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.879+0000 7fda5f403640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556653294010 0x5566532096d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.879+0000 7fda5f403640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556653294010 0x5566532096d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57078/0 (socket says 172.21.15.170:57078) 2024-09-12T17:28:00.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.879+0000 7fda5f403640 1 -- 172.21.15.170:0/4183895662 learned_addr learned my addr 172.21.15.170:0/4183895662 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:00.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.879+0000 7fda5f403640 1 -- 172.21.15.170:0/4183895662 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556653145e10 con 0x556653294010 2024-09-12T17:28:00.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.879+0000 7fda5f403640 1 --2- 172.21.15.170:0/4183895662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556653294010 0x5566532096d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fda50001e40 tx=0x7fda50001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df4b2cf083bdc633 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.879+0000 7fd94d60a640 1 -- 172.21.15.170:0/4183895662 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda50012020 con 0x556653294010 2024-09-12T17:28:00.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.879+0000 7fd94d60a640 1 -- 172.21.15.170:0/4183895662 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda5000e5a0 con 0x556653294010 2024-09-12T17:28:00.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.879+0000 7fd94d60a640 1 -- 172.21.15.170:0/4183895662 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda5000e8a0 con 0x556653294010 2024-09-12T17:28:00.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.880+0000 7fda61919800 1 -- 172.21.15.170:0/4183895662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556653294010 msgr2=0x5566532096d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.880+0000 7fda61919800 1 --2- 172.21.15.170:0/4183895662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556653294010 0x5566532096d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fda50001e40 tx=0x7fda50001e70 comp rx=0 tx=0).stop 2024-09-12T17:28:00.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.880+0000 7fda61919800 1 -- 172.21.15.170:0/4183895662 shutdown_connections 2024-09-12T17:28:00.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.880+0000 7fda61919800 1 --2- 172.21.15.170:0/4183895662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556653294010 0x5566532096d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.880+0000 7fda61919800 1 -- 172.21.15.170:0/4183895662 >> 172.21.15.170:0/4183895662 conn(0x55665328f3e0 msgr2=0x55665337eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:00.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.880+0000 7fda61919800 1 -- 172.21.15.170:0/4183895662 shutdown_connections 2024-09-12T17:28:00.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.880+0000 7fda61919800 1 -- 172.21.15.170:0/4183895662 wait complete. 2024-09-12T17:28:00.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.880+0000 7fda61919800 1 Processor -- start 2024-09-12T17:28:00.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.880+0000 7fda61919800 1 -- start start 2024-09-12T17:28:00.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.880+0000 7fda61919800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556653294010 0x55665338d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.880+0000 7fda61919800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5566532959d0 con 0x556653294010 2024-09-12T17:28:00.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.881+0000 7fda5f403640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556653294010 0x55665338d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.881+0000 7fda5f403640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556653294010 0x55665338d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57094/0 (socket says 172.21.15.170:57094) 2024-09-12T17:28:00.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.881+0000 7fda5f403640 1 -- 172.21.15.170:0/3588593916 learned_addr learned my addr 172.21.15.170:0/3588593916 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:00.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.881+0000 7fda5f403640 1 -- 172.21.15.170:0/3588593916 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55665338d720 con 0x556653294010 2024-09-12T17:28:00.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.881+0000 7fda5f403640 1 --2- 172.21.15.170:0/3588593916 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556653294010 0x55665338d1c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fda500012b0 tx=0x7fda50000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.881+0000 7fd94be07640 1 -- 172.21.15.170:0/3588593916 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda50012030 con 0x556653294010 2024-09-12T17:28:00.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.881+0000 7fd94be07640 1 -- 172.21.15.170:0/3588593916 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda5001a750 con 0x556653294010 2024-09-12T17:28:00.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.881+0000 7fda61919800 1 -- 172.21.15.170:0/3588593916 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55665338d9b0 con 0x556653294010 2024-09-12T17:28:00.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.881+0000 7fd94be07640 1 -- 172.21.15.170:0/3588593916 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda5001aa70 con 0x556653294010 2024-09-12T17:28:00.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.881+0000 7fda61919800 1 -- 172.21.15.170:0/3588593916 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55665338e3b0 con 0x556653294010 2024-09-12T17:28:00.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.882+0000 7fd94be07640 1 -- 172.21.15.170:0/3588593916 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fda50015020 con 0x556653294010 2024-09-12T17:28:00.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.882+0000 7fd94be07640 1 --2- 172.21.15.170:0/3588593916 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd94403c780 0x7fd94403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.882+0000 7fd94be07640 1 -- 172.21.15.170:0/3588593916 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fda50020030 con 0x556653294010 2024-09-12T17:28:00.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.882+0000 7fda5ec02640 1 --2- 172.21.15.170:0/3588593916 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd94403c780 0x7fd94403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.883+0000 7fda61919800 1 --2- 172.21.15.170:0/3588593916 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5566532952e0 0x556653394810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.883+0000 7fda61919800 1 -- 172.21.15.170:0/3588593916 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55665338ef70 con 0x5566532952e0 2024-09-12T17:28:00.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.883+0000 7fda5fc04640 1 --2- 172.21.15.170:0/3588593916 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5566532952e0 0x556653394810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.883+0000 7fda5ec02640 1 --2- 172.21.15.170:0/3588593916 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd94403c780 0x7fd94403ec40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fda54057000 tx=0x7fda54052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.883+0000 7fda5fc04640 1 --2- 172.21.15.170:0/3588593916 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5566532952e0 0x556653394810 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.883+0000 7fda5fc04640 1 -- 172.21.15.170:0/3588593916 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda5800a4d0 con 0x5566532952e0 2024-09-12T17:28:00.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.883+0000 7fda61919800 1 -- 172.21.15.170:0/3588593916 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55665338e860 con 0x5566532952e0 2024-09-12T17:28:00.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.884+0000 7fda5fc04640 1 -- 172.21.15.170:0/3588593916 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fda5800a4d0 con 0x5566532952e0 2024-09-12T17:28:00.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.884+0000 7fda61919800 1 --2- 172.21.15.170:0/3588593916 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556653396ce0 0x5566533990d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.884+0000 7fda61919800 1 -- 172.21.15.170:0/3588593916 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5566533997a0 con 0x556653396ce0 2024-09-12T17:28:00.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.884+0000 7fda5f403640 1 --2- 172.21.15.170:0/3588593916 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556653396ce0 0x5566533990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.884+0000 7fda5f403640 1 --2- 172.21.15.170:0/3588593916 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556653396ce0 0x5566533990d0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.884+0000 7fda5f403640 1 -- 172.21.15.170:0/3588593916 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fda50018ce0 con 0x556653396ce0 2024-09-12T17:28:00.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.884+0000 7fda61919800 1 -- 172.21.15.170:0/3588593916 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556653395b80 con 0x5566532952e0 2024-09-12T17:28:00.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.884+0000 7fda5fc04640 1 -- 172.21.15.170:0/3588593916 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fda5800a4d0 con 0x5566532952e0 2024-09-12T17:28:00.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.885+0000 7fda61919800 1 -- 172.21.15.170:0/3588593916 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556653396020 con 0x556653396ce0 2024-09-12T17:28:00.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.885+0000 7fda5f403640 1 -- 172.21.15.170:0/3588593916 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fda50018ce0 con 0x556653396ce0 2024-09-12T17:28:00.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.885+0000 7fda61919800 1 Processor -- start 2024-09-12T17:28:00.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.885+0000 7fda61919800 1 -- start start 2024-09-12T17:28:00.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.885+0000 7fda61919800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5566533a8030 0x5566533a8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.885+0000 7fda61919800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55665318aa00 con 0x5566533a8030 2024-09-12T17:28:00.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.886+0000 7fda5fc04640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5566533a8030 0x5566533a8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.886+0000 7fda5fc04640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5566533a8030 0x5566533a8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57104/0 (socket says 172.21.15.170:57104) 2024-09-12T17:28:00.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.886+0000 7fda5fc04640 1 -- 172.21.15.170:0/1201087933 learned_addr learned my addr 172.21.15.170:0/1201087933 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:00.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.886+0000 7fda5fc04640 1 -- 172.21.15.170:0/1201087933 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566533a8a90 con 0x5566533a8030 2024-09-12T17:28:00.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.886+0000 7fda5fc04640 1 --2- 172.21.15.170:0/1201087933 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5566533a8030 0x5566533a8450 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x55665338e1c0 tx=0x7fda580167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.886+0000 7fd949602640 1 -- 172.21.15.170:0/1201087933 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda58013640 con 0x5566533a8030 2024-09-12T17:28:00.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.886+0000 7fd949602640 1 -- 172.21.15.170:0/1201087933 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda580137e0 con 0x5566533a8030 2024-09-12T17:28:00.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.886+0000 7fda61919800 1 -- 172.21.15.170:0/1201087933 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5566533a92c0 con 0x5566533a8030 2024-09-12T17:28:00.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.886+0000 7fd949602640 1 -- 172.21.15.170:0/1201087933 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda58013ae0 con 0x5566533a8030 2024-09-12T17:28:00.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.886+0000 7fda61919800 1 -- 172.21.15.170:0/1201087933 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566533a9860 con 0x5566533a8030 2024-09-12T17:28:00.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.887+0000 7fd949602640 1 -- 172.21.15.170:0/1201087933 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fda58011040 con 0x5566533a8030 2024-09-12T17:28:00.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.887+0000 7fd949602640 1 --2- 172.21.15.170:0/1201087933 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd93803c730 0x7fd93803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.887+0000 7fd949602640 1 -- 172.21.15.170:0/1201087933 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fda5800e040 con 0x5566533a8030 2024-09-12T17:28:00.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.887+0000 7fda5f403640 1 --2- 172.21.15.170:0/1201087933 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd93803c730 0x7fd93803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.888+0000 7fda61919800 1 Processor -- start 2024-09-12T17:28:00.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.888+0000 7fda5f403640 1 --2- 172.21.15.170:0/1201087933 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd93803c730 0x7fd93803ebf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x556653394e60 tx=0x7fda50051f50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.888+0000 7fda61919800 1 -- start start 2024-09-12T17:28:00.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.888+0000 7fda61919800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5566533b4b50 0x5566533b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.888+0000 7fda61919800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556653207f70 con 0x5566533b4b50 2024-09-12T17:28:00.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.888+0000 7fda5fc04640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5566533b4b50 0x5566533b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.888+0000 7fda5fc04640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5566533b4b50 0x5566533b4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57114/0 (socket says 172.21.15.170:57114) 2024-09-12T17:28:00.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.888+0000 7fda5fc04640 1 -- 172.21.15.170:0/3261003561 learned_addr learned my addr 172.21.15.170:0/3261003561 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:00.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.888+0000 7fda5fc04640 1 -- 172.21.15.170:0/3261003561 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566533b5540 con 0x5566533b4b50 2024-09-12T17:28:00.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.888+0000 7fda5fc04640 1 --2- 172.21.15.170:0/3261003561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5566533b4b50 0x5566533b4f50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fda58053d60 tx=0x7fda5801fc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d218d61e70c2e850 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.889+0000 7fd942ffd640 1 -- 172.21.15.170:0/3261003561 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda58021a40 con 0x5566533b4b50 2024-09-12T17:28:00.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.889+0000 7fd942ffd640 1 -- 172.21.15.170:0/3261003561 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda58021440 con 0x5566533b4b50 2024-09-12T17:28:00.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.889+0000 7fd942ffd640 1 -- 172.21.15.170:0/3261003561 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda5801f340 con 0x5566533b4b50 2024-09-12T17:28:00.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.889+0000 7fda61919800 1 -- 172.21.15.170:0/3261003561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5566533b4b50 msgr2=0x5566533b4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.889+0000 7fda61919800 1 --2- 172.21.15.170:0/3261003561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5566533b4b50 0x5566533b4f50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fda58053d60 tx=0x7fda5801fc40 comp rx=0 tx=0).stop 2024-09-12T17:28:00.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.889+0000 7fda61919800 1 -- 172.21.15.170:0/3261003561 shutdown_connections 2024-09-12T17:28:00.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.889+0000 7fda61919800 1 --2- 172.21.15.170:0/3261003561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5566533b4b50 0x5566533b4f50 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.889+0000 7fda61919800 1 -- 172.21.15.170:0/3261003561 >> 172.21.15.170:0/3261003561 conn(0x5566533b0f50 msgr2=0x5566533af190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:00.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.889+0000 7fda61919800 1 -- 172.21.15.170:0/3261003561 shutdown_connections 2024-09-12T17:28:00.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.889+0000 7fda61919800 1 -- 172.21.15.170:0/3261003561 wait complete. 2024-09-12T17:28:00.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.889+0000 7fda61919800 1 Processor -- start 2024-09-12T17:28:00.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.889+0000 7fda61919800 1 -- start start 2024-09-12T17:28:00.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.890+0000 7fda61919800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5566533b4b50 0x5566533bc110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.890+0000 7fda61919800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5566533b5b60 con 0x5566533b4b50 2024-09-12T17:28:00.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.890+0000 7fda5fc04640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5566533b4b50 0x5566533bc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.890+0000 7fda5fc04640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5566533b4b50 0x5566533bc110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57128/0 (socket says 172.21.15.170:57128) 2024-09-12T17:28:00.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.890+0000 7fda5fc04640 1 -- 172.21.15.170:0/1787785444 learned_addr learned my addr 172.21.15.170:0/1787785444 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:00.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.890+0000 7fda5fc04640 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566533bc670 con 0x5566533b4b50 2024-09-12T17:28:00.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.890+0000 7fda5fc04640 1 --2- 172.21.15.170:0/1787785444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5566533b4b50 0x5566533bc110 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fda58053c60 tx=0x7fda58053cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.890+0000 7fd9417fa640 1 -- 172.21.15.170:0/1787785444 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda58020800 con 0x5566533b4b50 2024-09-12T17:28:00.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.890+0000 7fd9417fa640 1 -- 172.21.15.170:0/1787785444 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda580209a0 con 0x5566533b4b50 2024-09-12T17:28:00.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.890+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5566533bc900 con 0x5566533b4b50 2024-09-12T17:28:00.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.890+0000 7fd9417fa640 1 -- 172.21.15.170:0/1787785444 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda58020ca0 con 0x5566533b4b50 2024-09-12T17:28:00.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.890+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566533bd280 con 0x5566533b4b50 2024-09-12T17:28:00.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.891+0000 7fd9417fa640 1 -- 172.21.15.170:0/1787785444 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fda5803b060 con 0x5566533b4b50 2024-09-12T17:28:00.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.891+0000 7fd9417fa640 1 --2- 172.21.15.170:0/1787785444 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd92803c780 0x7fd92803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.891+0000 7fd9417fa640 1 -- 172.21.15.170:0/1787785444 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fda58035aa0 con 0x5566533b4b50 2024-09-12T17:28:00.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.891+0000 7fda5f403640 1 --2- 172.21.15.170:0/1787785444 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd92803c780 0x7fd92803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.892+0000 7fda5f403640 1 --2- 172.21.15.170:0/1787785444 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd92803c780 0x7fd92803ec40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fda50017df0 tx=0x7fda50030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.892+0000 7fda61919800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.892+0000 7fda61919800 1 --2- 172.21.15.170:0/1787785444 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5566533c7aa0 0x5566533c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.892+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5566533ca6b0 con 0x5566533c7aa0 2024-09-12T17:28:00.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.892+0000 7fda5ec02640 1 --2- 172.21.15.170:0/1787785444 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5566533c7aa0 0x5566533c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.892+0000 7fda5ec02640 1 --2- 172.21.15.170:0/1787785444 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5566533c7aa0 0x5566533c9f60 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.893+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda54051070 con 0x5566533c7aa0 2024-09-12T17:28:00.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.893+0000 7fda61919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.893+0000 7fda61919800 20 realm 2024-09-12T17:28:00.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.893+0000 7fda61919800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.893+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5566533caae0 con 0x5566533c7aa0 2024-09-12T17:28:00.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.893+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda54051070 con 0x5566533c7aa0 2024-09-12T17:28:00.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.893+0000 7fda61919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.893+0000 7fda61919800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:00.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.893+0000 7fda61919800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.893+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5566533cb3b0 con 0x5566533c7aa0 2024-09-12T17:28:00.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.893+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda54051070 con 0x5566533c7aa0 2024-09-12T17:28:00.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.893+0000 7fda61919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.893+0000 7fda61919800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.893+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5566533cb750 con 0x5566533c7aa0 2024-09-12T17:28:00.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.893+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fda54051070 con 0x5566533c7aa0 2024-09-12T17:28:00.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.893+0000 7fda61919800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:00.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.893+0000 7fda61919800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.893+0000 7fda61919800 1 --2- 172.21.15.170:0/1787785444 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5566533cc4b0 0x5566533ce8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.893+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5566533ceeb0 con 0x5566533cc4b0 2024-09-12T17:28:00.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.894+0000 7fda5fc04640 1 --2- 172.21.15.170:0/1787785444 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5566533cc4b0 0x5566533ce8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.894+0000 7fda5fc04640 1 --2- 172.21.15.170:0/1787785444 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5566533cc4b0 0x5566533ce8a0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.894+0000 7fda5fc04640 1 -- 172.21.15.170:0/1787785444 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fda5800a4d0 con 0x5566533cc4b0 2024-09-12T17:28:00.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.894+0000 7fda61919800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:00.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.894+0000 7fda61919800 20 searching for the correct realm 2024-09-12T17:28:00.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.894+0000 7fda61919800 1 --2- 172.21.15.170:0/1787785444 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5566533d0e60 0x5566533d3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.894+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5566533d39a0 con 0x5566533d0e60 2024-09-12T17:28:00.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.894+0000 7fda5f403640 1 --2- 172.21.15.170:0/1787785444 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5566533d0e60 0x5566533d3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.895+0000 7fda5f403640 1 --2- 172.21.15.170:0/1787785444 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5566533d0e60 0x5566533d3320 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.895+0000 7fda5f403640 1 -- 172.21.15.170:0/1787785444 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda5005a040 con 0x5566533d0e60 2024-09-12T17:28:00.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.895+0000 7fda5f403640 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5566533d39a0 con 0x5566533cc4b0 2024-09-12T17:28:00.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.895+0000 7fda5fc04640 1 -- 172.21.15.170:0/1787785444 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda5800a4d0 con 0x5566533cc4b0 2024-09-12T17:28:00.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.895+0000 7fda5fc04640 1 --2- 172.21.15.170:0/1787785444 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fda5803d070 0x7fda58055970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:00.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.895+0000 7fda5fc04640 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5566533d39a0 con 0x7fda5803d070 2024-09-12T17:28:00.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.895+0000 7fda5ec02640 1 --2- 172.21.15.170:0/1787785444 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fda5803d070 0x7fda58055970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:00.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.896+0000 7fda5ec02640 1 --2- 172.21.15.170:0/1787785444 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fda5803d070 0x7fda58055970 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:00.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.896+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda54051070 con 0x7fda5803d070 2024-09-12T17:28:00.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.896+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5566533d39a0 con 0x5566533c7aa0 2024-09-12T17:28:00.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.896+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda54051070 con 0x5566533c7aa0 2024-09-12T17:28:00.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.896+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5566533d39a0 con 0x5566533c7aa0 2024-09-12T17:28:00.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.896+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda54051070 con 0x5566533c7aa0 2024-09-12T17:28:00.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.896+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5566533d39a0 con 0x7fda5803d070 2024-09-12T17:28:00.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.897+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda54051070 con 0x7fda5803d070 2024-09-12T17:28:00.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.897+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5566533d39a0 con 0x7fda5803d070 2024-09-12T17:28:00.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.897+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda54051070 con 0x7fda5803d070 2024-09-12T17:28:00.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.897+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5566533d39a0 con 0x5566533cc4b0 2024-09-12T17:28:00.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.897+0000 7fda5fc04640 1 -- 172.21.15.170:0/1787785444 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda5800a4d0 con 0x5566533cc4b0 2024-09-12T17:28:00.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.897+0000 7fda5fc04640 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5566533d39a0 con 0x5566533d0e60 2024-09-12T17:28:00.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.897+0000 7fda5f403640 1 -- 172.21.15.170:0/1787785444 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda5005a040 con 0x5566533d0e60 2024-09-12T17:28:00.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.897+0000 7fda5f403640 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5566533d39a0 con 0x5566533c7aa0 2024-09-12T17:28:00.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.898+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda54051070 con 0x5566533c7aa0 2024-09-12T17:28:00.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.898+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5566533d39a0 con 0x7fda5803d070 2024-09-12T17:28:00.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.898+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda54051070 con 0x7fda5803d070 2024-09-12T17:28:00.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.898+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5566533d39a0 con 0x5566533c7aa0 2024-09-12T17:28:00.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.898+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda54051070 con 0x5566533c7aa0 2024-09-12T17:28:00.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.898+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5566533d39a0 con 0x5566533cc4b0 2024-09-12T17:28:00.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.898+0000 7fda5fc04640 1 -- 172.21.15.170:0/1787785444 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fda5800a4d0 con 0x5566533cc4b0 2024-09-12T17:28:00.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.898+0000 7fda5fc04640 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5566533d39a0 con 0x5566533d0e60 2024-09-12T17:28:00.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.898+0000 7fda5f403640 1 -- 172.21.15.170:0/1787785444 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda5005a040 con 0x5566533d0e60 2024-09-12T17:28:00.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.899+0000 7fda5f403640 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5566533d39a0 con 0x5566533d0e60 2024-09-12T17:28:00.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.899+0000 7fda5f403640 1 -- 172.21.15.170:0/1787785444 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda5005a040 con 0x5566533d0e60 2024-09-12T17:28:00.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.899+0000 7fda5f403640 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5566533d39a0 con 0x7fda5803d070 2024-09-12T17:28:00.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.899+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda54051070 con 0x7fda5803d070 2024-09-12T17:28:00.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.899+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5566533d39a0 con 0x5566533d0e60 2024-09-12T17:28:00.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.899+0000 7fda5f403640 1 -- 172.21.15.170:0/1787785444 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda5005a040 con 0x5566533d0e60 2024-09-12T17:28:00.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.899+0000 7fda5f403640 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5566533d39a0 con 0x5566533d0e60 2024-09-12T17:28:00.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.899+0000 7fda5f403640 1 -- 172.21.15.170:0/1787785444 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda5005a040 con 0x5566533d0e60 2024-09-12T17:28:00.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.899+0000 7fda5f403640 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5566533d39a0 con 0x5566533c7aa0 2024-09-12T17:28:00.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.900+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda54051070 con 0x5566533c7aa0 2024-09-12T17:28:00.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.900+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5566533d39a0 con 0x5566533c7aa0 2024-09-12T17:28:00.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.900+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fda54051070 con 0x5566533c7aa0 2024-09-12T17:28:00.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.900+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5566533d39a0 con 0x7fda5803d070 2024-09-12T17:28:00.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.900+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda54051070 con 0x7fda5803d070 2024-09-12T17:28:00.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.900+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5566533d39a0 con 0x5566533d0e60 2024-09-12T17:28:00.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.900+0000 7fda5f403640 1 -- 172.21.15.170:0/1787785444 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda5005a040 con 0x5566533d0e60 2024-09-12T17:28:00.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.900+0000 7fda5f403640 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5566533d39a0 con 0x5566533cc4b0 2024-09-12T17:28:00.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.901+0000 7fda5fc04640 1 -- 172.21.15.170:0/1787785444 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda5800a4d0 con 0x5566533cc4b0 2024-09-12T17:28:00.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.901+0000 7fda5fc04640 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5566533d39a0 con 0x5566533c7aa0 2024-09-12T17:28:00.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.901+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda54051070 con 0x5566533c7aa0 2024-09-12T17:28:00.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.901+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5566533d39a0 con 0x7fda5803d070 2024-09-12T17:28:00.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.901+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda54051070 con 0x7fda5803d070 2024-09-12T17:28:00.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.901+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5566533d39a0 con 0x5566533d0e60 2024-09-12T17:28:00.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.901+0000 7fda5f403640 1 -- 172.21.15.170:0/1787785444 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda5005a040 con 0x5566533d0e60 2024-09-12T17:28:00.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.902+0000 7fda5f403640 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5566533d39a0 con 0x7fda5803d070 2024-09-12T17:28:00.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.902+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda54051070 con 0x7fda5803d070 2024-09-12T17:28:00.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.902+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5566533d39a0 con 0x5566533cc4b0 2024-09-12T17:28:00.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.902+0000 7fda5fc04640 1 -- 172.21.15.170:0/1787785444 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda5800a4d0 con 0x5566533cc4b0 2024-09-12T17:28:00.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.902+0000 7fda5fc04640 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5566533d39a0 con 0x5566533d0e60 2024-09-12T17:28:00.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.902+0000 7fda5f403640 1 -- 172.21.15.170:0/1787785444 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda5005a040 con 0x5566533d0e60 2024-09-12T17:28:00.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.902+0000 7fda5f403640 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5566533d39a0 con 0x7fda5803d070 2024-09-12T17:28:00.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.903+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda54051070 con 0x7fda5803d070 2024-09-12T17:28:00.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.903+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5566533d39a0 con 0x5566533c7aa0 2024-09-12T17:28:00.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.903+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fda54051070 con 0x5566533c7aa0 2024-09-12T17:28:00.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.903+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5566533d39a0 con 0x5566533cc4b0 2024-09-12T17:28:00.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.903+0000 7fda5fc04640 1 -- 172.21.15.170:0/1787785444 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fda5800a4d0 con 0x5566533cc4b0 2024-09-12T17:28:00.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.903+0000 7fda61919800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:00.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.903+0000 7fda61919800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:00.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.903+0000 7fda61919800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:00.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.903+0000 7fda61919800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:00.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.903+0000 7fda61919800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:00.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.903+0000 7fda61919800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:00.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.903+0000 7fda61919800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.903+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5566533cf8a0 con 0x5566533c7aa0 2024-09-12T17:28:00.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.903+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda54051070 con 0x5566533c7aa0 2024-09-12T17:28:00.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.904+0000 7fda61919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.904+0000 7fda61919800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.904+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5566533d0140 con 0x5566533c7aa0 2024-09-12T17:28:00.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.904+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fda54051070 con 0x5566533c7aa0 2024-09-12T17:28:00.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.904+0000 7fda61919800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:00.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.904+0000 7fda61919800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.904+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5566533cf4e0 con 0x5566533cc4b0 2024-09-12T17:28:00.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.904+0000 7fda5fc04640 1 -- 172.21.15.170:0/1787785444 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fda5800a4d0 con 0x5566533cc4b0 2024-09-12T17:28:00.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.904+0000 7fda61919800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:00.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.904+0000 7fda61919800 20 zone default found 2024-09-12T17:28:00.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.904+0000 7fda61919800 4 Realm: () 2024-09-12T17:28:00.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.904+0000 7fda61919800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:00.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.904+0000 7fda61919800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:00.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.904+0000 7fda61919800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:00.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.904+0000 7fda61919800 20 zonegroup default 2024-09-12T17:28:00.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.904+0000 7fda61919800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.904+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5566533d42d0 con 0x7fda5803d070 2024-09-12T17:28:00.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.904+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fda54051070 con 0x7fda5803d070 2024-09-12T17:28:00.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.904+0000 7fda61919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.904+0000 7fda61919800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.904+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5566533d6510 con 0x5566533d0e60 2024-09-12T17:28:00.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.905+0000 7fda5f403640 1 -- 172.21.15.170:0/1787785444 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fda5005a040 con 0x5566533d0e60 2024-09-12T17:28:00.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.905+0000 7fda61919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.905+0000 7fda61919800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.905+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5566533d68b0 con 0x5566533d0e60 2024-09-12T17:28:00.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.905+0000 7fda5f403640 1 -- 172.21.15.170:0/1787785444 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fda5005a040 con 0x5566533d0e60 2024-09-12T17:28:00.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.905+0000 7fda61919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:00.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.905+0000 7fda61919800 20 started sync module instance, tier type = 2024-09-12T17:28:00.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.905+0000 7fda61919800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:00.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.905+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5566533d59f0 con 0x5566533cc4b0 2024-09-12T17:28:00.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.906+0000 7fda5fc04640 1 -- 172.21.15.170:0/1787785444 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda5800a4d0 con 0x5566533cc4b0 2024-09-12T17:28:00.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.906+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93897971555808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5566533d7150 con 0x5566533cc4b0 2024-09-12T17:28:00.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.906+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5566533d79a0 con 0x5566533c7aa0 2024-09-12T17:28:00.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.907+0000 7fda5fc04640 1 -- 172.21.15.170:0/1787785444 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93897971555808] v29'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda5800a4d0 con 0x5566533cc4b0 2024-09-12T17:28:00.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.907+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda54051070 con 0x5566533c7aa0 2024-09-12T17:28:00.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.907+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93897971559584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5566533d76b0 con 0x5566533c7aa0 2024-09-12T17:28:00.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.907+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5566533d81d0 con 0x5566533d0e60 2024-09-12T17:28:00.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.908+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93897971559584] v29'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda54051070 con 0x5566533c7aa0 2024-09-12T17:28:00.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.909+0000 7fda5f403640 1 -- 172.21.15.170:0/1787785444 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda5005a040 con 0x5566533d0e60 2024-09-12T17:28:00.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.909+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93897971563680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5566533d85c0 con 0x5566533d0e60 2024-09-12T17:28:00.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.909+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5566533d9010 con 0x5566533cc4b0 2024-09-12T17:28:00.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.910+0000 7fda5f403640 1 -- 172.21.15.170:0/1787785444 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93897971563680] v29'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda5005a040 con 0x5566533d0e60 2024-09-12T17:28:00.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.910+0000 7fda5fc04640 1 -- 172.21.15.170:0/1787785444 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda5800a4d0 con 0x5566533cc4b0 2024-09-12T17:28:00.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.910+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93897971567360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5566533d9400 con 0x5566533cc4b0 2024-09-12T17:28:00.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.910+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5566533d9e20 con 0x5566533c7aa0 2024-09-12T17:28:00.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.911+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda54051070 con 0x5566533c7aa0 2024-09-12T17:28:00.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.911+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93897971570960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5566533d9de0 con 0x5566533c7aa0 2024-09-12T17:28:00.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.911+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5566533dade0 con 0x7fda5803d070 2024-09-12T17:28:00.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.911+0000 7fda5fc04640 1 -- 172.21.15.170:0/1787785444 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93897971567360] v29'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda5800a4d0 con 0x5566533cc4b0 2024-09-12T17:28:00.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.912+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93897971570960] v29'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda54051070 con 0x5566533c7aa0 2024-09-12T17:28:00.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.912+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda54051070 con 0x7fda5803d070 2024-09-12T17:28:00.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.912+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93897971560704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5566533d9fc0 con 0x7fda5803d070 2024-09-12T17:28:00.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.912+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5566533db680 con 0x7fda5803d070 2024-09-12T17:28:00.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.913+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v29'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda54051070 con 0x7fda5803d070 2024-09-12T17:28:00.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.913+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93897971577296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5566533d9fc0 con 0x7fda5803d070 2024-09-12T17:28:00.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.913+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5566533dc1a0 con 0x7fda5803d070 2024-09-12T17:28:00.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.913+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93897971560704] v29'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda54051070 con 0x7fda5803d070 2024-09-12T17:28:00.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.914+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93897971577296] v29'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda54051070 con 0x7fda5803d070 2024-09-12T17:28:00.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.914+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(58 notify.7 [create] v29'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda54051070 con 0x7fda5803d070 2024-09-12T17:28:00.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.914+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93897971580016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5566533db5f0 con 0x7fda5803d070 2024-09-12T17:28:00.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.914+0000 7fda61919800 20 add_watcher() i=0 2024-09-12T17:28:00.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.914+0000 7fda61919800 20 add_watcher() i=1 2024-09-12T17:28:00.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.914+0000 7fda61919800 20 add_watcher() i=2 2024-09-12T17:28:00.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.914+0000 7fda61919800 20 add_watcher() i=3 2024-09-12T17:28:00.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.914+0000 7fda61919800 20 add_watcher() i=4 2024-09-12T17:28:00.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.914+0000 7fda61919800 20 add_watcher() i=5 2024-09-12T17:28:00.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.914+0000 7fda61919800 20 add_watcher() i=6 2024-09-12T17:28:00.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.915+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93897971580016] v29'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda54051070 con 0x7fda5803d070 2024-09-12T17:28:00.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.915+0000 7fda61919800 20 add_watcher() i=7 2024-09-12T17:28:00.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.915+0000 7fda61919800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:00.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.915+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5566533df190 con 0x5566533c7aa0 2024-09-12T17:28:00.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.915+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fda54051070 con 0x5566533c7aa0 2024-09-12T17:28:00.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.915+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93897971575008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5566533dc610 con 0x5566533c7aa0 2024-09-12T17:28:00.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.916+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93897971575008] v29'72 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fda54051070 con 0x5566533c7aa0 2024-09-12T17:28:00.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.916+0000 7fd915fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:00.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.916+0000 7fda61919800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:00.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.916+0000 7fda61919800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:00.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.916+0000 7fda61919800 5 note: GC not initialized 2024-09-12T17:28:00.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.917+0000 7fd914fe1640 20 reqs_thread_entry: start 2024-09-12T17:28:00.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.917+0000 7fda61919800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:00.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.917+0000 7fda61919800 20 Filter name: none 2024-09-12T17:28:00.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.917+0000 7fd88e7fc640 20 reqs_thread_entry: start 2024-09-12T17:28:00.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.917+0000 7fda61919800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:28:00.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.917+0000 7fda61919800 20 rados->read ofs=0 len=0 2024-09-12T17:28:00.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.917+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5566534120b0 con 0x5566533c7aa0 2024-09-12T17:28:00.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.917+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fda54051070 con 0x5566533c7aa0 2024-09-12T17:28:00.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.917+0000 7fda61919800 20 rados_obj.operate() r=0 bl.length=556 2024-09-12T17:28:00.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.917+0000 7fda61919800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T17:28:00.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.917+0000 7fda61919800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:28:00.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.917+0000 7fda61919800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:00.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.918+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5566534186b0 con 0x5566533c7aa0 2024-09-12T17:28:00.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.919+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v29'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fda54051070 con 0x5566533c7aa0 2024-09-12T17:28:00.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.919+0000 7fda61919800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:28:00.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.919+0000 7fda61919800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:28:00.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.919+0000 7fda61919800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T17:28:00.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.919+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93897971826864 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556653413d90 con 0x5566533c7aa0 2024-09-12T17:28:00.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.919+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== watch-notify(notify (1) cookie 93897971570960 notify 124554051590 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7fda54082040 con 0x5566533c7aa0 2024-09-12T17:28:00.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.919+0000 7fd942ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051590 cookie 93897971570960 notifier 4365 bl.length()=732 2024-09-12T17:28:00.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.919+0000 7fd942ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:28:00.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.919+0000 7fd942ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:28:00.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.919+0000 7fd942ffd640 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fd924003ea0 con 0x5566533c7aa0 2024-09-12T17:28:00.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.919+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(64 notify.4 [notify cookie 93897971826864 out=8b] v0'0 uv57 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fda54051070 con 0x5566533c7aa0 2024-09-12T17:28:00.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.919+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda54051070 con 0x5566533c7aa0 2024-09-12T17:28:00.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.919+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== watch-notify(notify_complete (2) cookie 93897971826864 notify 124554051590 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5566531246b0 con 0x5566533c7aa0 2024-09-12T17:28:00.952 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T17:27:59.362376Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:27:59.362351Z","tags":[],"group_ids":[]} 2024-09-12T17:28:00.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.920+0000 7fd915fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:00.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.920+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93897971575008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5566534138e0 con 0x5566533c7aa0 2024-09-12T17:28:00.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.921+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93897971575008] v29'73 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fda54051070 con 0x5566533c7aa0 2024-09-12T17:28:00.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.921+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93897971555808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55665340ff10 con 0x5566533cc4b0 2024-09-12T17:28:00.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.922+0000 7fda5fc04640 1 -- 172.21.15.170:0/1787785444 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93897971555808] v29'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda5800a4d0 con 0x5566533cc4b0 2024-09-12T17:28:00.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.922+0000 7fda61919800 20 remove_watcher() i=0 2024-09-12T17:28:00.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.922+0000 7fda61919800 2 removed watcher, disabling cache 2024-09-12T17:28:00.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.922+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93897971559584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55665340ff10 con 0x5566533c7aa0 2024-09-12T17:28:00.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.923+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93897971559584] v29'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda54051070 con 0x5566533c7aa0 2024-09-12T17:28:00.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.923+0000 7fda61919800 20 remove_watcher() i=1 2024-09-12T17:28:00.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.923+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93897971563680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55665340ff10 con 0x5566533d0e60 2024-09-12T17:28:00.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.924+0000 7fda5f403640 1 -- 172.21.15.170:0/1787785444 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93897971563680] v29'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda5005a040 con 0x5566533d0e60 2024-09-12T17:28:00.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.924+0000 7fda61919800 20 remove_watcher() i=2 2024-09-12T17:28:00.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.924+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93897971567360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5566533d7ca0 con 0x5566533cc4b0 2024-09-12T17:28:00.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.925+0000 7fda5fc04640 1 -- 172.21.15.170:0/1787785444 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93897971567360] v29'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda5800a4d0 con 0x5566533cc4b0 2024-09-12T17:28:00.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.925+0000 7fda61919800 20 remove_watcher() i=3 2024-09-12T17:28:00.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.925+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93897971570960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5566533d8b00 con 0x5566533c7aa0 2024-09-12T17:28:00.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.926+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93897971570960] v29'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda54051070 con 0x5566533c7aa0 2024-09-12T17:28:00.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.926+0000 7fda61919800 20 remove_watcher() i=4 2024-09-12T17:28:00.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.926+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93897971560704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5566533d7ca0 con 0x7fda5803d070 2024-09-12T17:28:00.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.927+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93897971560704] v29'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda54051070 con 0x7fda5803d070 2024-09-12T17:28:00.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.927+0000 7fda61919800 20 remove_watcher() i=5 2024-09-12T17:28:00.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.927+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93897971577296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5566533d7ca0 con 0x7fda5803d070 2024-09-12T17:28:00.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.928+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93897971577296] v29'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda54051070 con 0x7fda5803d070 2024-09-12T17:28:00.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.928+0000 7fda61919800 20 remove_watcher() i=6 2024-09-12T17:28:00.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.928+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93897971580016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5566533d7ca0 con 0x7fda5803d070 2024-09-12T17:28:00.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.929+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93897971580016] v29'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda54051070 con 0x7fda5803d070 2024-09-12T17:28:00.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.929+0000 7fda61919800 20 remove_watcher() i=7 2024-09-12T17:28:00.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.929+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fda5803d070 msgr2=0x7fda58055970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.929+0000 7fda61919800 1 --2- 172.21.15.170:0/1787785444 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fda5803d070 0x7fda58055970 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.929+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5566533c7aa0 msgr2=0x5566533c9f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.929+0000 7fda61919800 1 --2- 172.21.15.170:0/1787785444 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5566533c7aa0 0x5566533c9f60 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.929+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5566533cc4b0 msgr2=0x5566533ce8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.929+0000 7fda61919800 1 --2- 172.21.15.170:0/1787785444 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5566533cc4b0 0x5566533ce8a0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.929+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5566533d0e60 msgr2=0x5566533d3320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.929+0000 7fda61919800 1 --2- 172.21.15.170:0/1787785444 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5566533d0e60 0x5566533d3320 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.930+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd92803c780 msgr2=0x7fd92803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.930+0000 7fda61919800 1 --2- 172.21.15.170:0/1787785444 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd92803c780 0x7fd92803ec40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fda50017df0 tx=0x7fda50030000 comp rx=0 tx=0).stop 2024-09-12T17:28:00.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.930+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5566533b4b50 msgr2=0x5566533bc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.930+0000 7fda5ec02640 1 -- 172.21.15.170:0/1787785444 reap_dead start 2024-09-12T17:28:00.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.930+0000 7fda61919800 1 --2- 172.21.15.170:0/1787785444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5566533b4b50 0x5566533bc110 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fda58053c60 tx=0x7fda58053cc0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.930+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 shutdown_connections 2024-09-12T17:28:00.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.930+0000 7fda61919800 1 --2- 172.21.15.170:0/1787785444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5566533b4b50 0x5566533bc110 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.930+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 >> 172.21.15.170:0/1787785444 conn(0x5566533b0f50 msgr2=0x5566533af160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:00.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.930+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 shutdown_connections 2024-09-12T17:28:00.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.930+0000 7fda61919800 1 -- 172.21.15.170:0/1787785444 wait complete. 2024-09-12T17:28:00.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.930+0000 7fda61919800 1 -- 172.21.15.170:0/1201087933 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd93803c730 msgr2=0x7fd93803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.930+0000 7fda61919800 1 --2- 172.21.15.170:0/1201087933 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd93803c730 0x7fd93803ebf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x556653394e60 tx=0x7fda50051f50 comp rx=0 tx=0).stop 2024-09-12T17:28:00.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.930+0000 7fda61919800 1 -- 172.21.15.170:0/1201087933 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5566533a8030 msgr2=0x5566533a8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.930+0000 7fda61919800 1 --2- 172.21.15.170:0/1201087933 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5566533a8030 0x5566533a8450 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x55665338e1c0 tx=0x7fda580167b0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.930+0000 7fda61919800 1 -- 172.21.15.170:0/1201087933 shutdown_connections 2024-09-12T17:28:00.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.930+0000 7fda61919800 1 --2- 172.21.15.170:0/1201087933 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd93803c730 0x7fd93803ebf0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.930+0000 7fda61919800 1 --2- 172.21.15.170:0/1201087933 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5566533a8030 0x5566533a8450 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.930+0000 7fda61919800 1 -- 172.21.15.170:0/1201087933 >> 172.21.15.170:0/1201087933 conn(0x55665339c3e0 msgr2=0x55665339c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:00.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.930+0000 7fda61919800 1 -- 172.21.15.170:0/1201087933 shutdown_connections 2024-09-12T17:28:00.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.930+0000 7fda61919800 1 -- 172.21.15.170:0/1201087933 wait complete. 2024-09-12T17:28:00.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.930+0000 7fda61919800 1 -- 172.21.15.170:0/3588593916 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5566532952e0 msgr2=0x556653394810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.930+0000 7fda61919800 1 --2- 172.21.15.170:0/3588593916 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5566532952e0 0x556653394810 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.930+0000 7fda61919800 1 -- 172.21.15.170:0/3588593916 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556653396ce0 msgr2=0x5566533990d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.930+0000 7fda61919800 1 --2- 172.21.15.170:0/3588593916 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556653396ce0 0x5566533990d0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.931+0000 7fda61919800 1 -- 172.21.15.170:0/3588593916 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd94403c780 msgr2=0x7fd94403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.931+0000 7fda61919800 1 --2- 172.21.15.170:0/3588593916 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd94403c780 0x7fd94403ec40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fda54057000 tx=0x7fda54052000 comp rx=0 tx=0).stop 2024-09-12T17:28:00.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.931+0000 7fda61919800 1 -- 172.21.15.170:0/3588593916 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556653294010 msgr2=0x55665338d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:00.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.931+0000 7fda61919800 1 --2- 172.21.15.170:0/3588593916 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556653294010 0x55665338d1c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fda500012b0 tx=0x7fda50000ed0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.931+0000 7fda61919800 1 -- 172.21.15.170:0/3588593916 shutdown_connections 2024-09-12T17:28:00.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.931+0000 7fda61919800 1 --2- 172.21.15.170:0/3588593916 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556653396ce0 0x5566533990d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.931+0000 7fda61919800 1 --2- 172.21.15.170:0/3588593916 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd94403c780 0x7fd94403ec40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.931+0000 7fda61919800 1 --2- 172.21.15.170:0/3588593916 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5566532952e0 0x556653394810 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.931+0000 7fda61919800 1 --2- 172.21.15.170:0/3588593916 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556653294010 0x55665338d1c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:00.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.931+0000 7fda61919800 1 -- 172.21.15.170:0/3588593916 >> 172.21.15.170:0/3588593916 conn(0x55665328f3e0 msgr2=0x55665337eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:00.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.931+0000 7fda61919800 1 -- 172.21.15.170:0/3588593916 shutdown_connections 2024-09-12T17:28:00.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:00.931+0000 7fda61919800 1 -- 172.21.15.170:0/3588593916 wait complete. 2024-09-12T17:28:00.964 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T17:27:59.362376Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:27:59.362351Z', 'tags': [], 'group_ids': []} 2024-09-12T17:28:00.964 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-12T17:28:00.964 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-12T17:28:00.964 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-12T17:28:01.009 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:01.009 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:01.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.008+0000 7f72f98bb800 1 Processor -- start 2024-09-12T17:28:01.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.008+0000 7f72f98bb800 1 -- start start 2024-09-12T17:28:01.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.008+0000 7f72f98bb800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55cb470186f0 0x55cb4701aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.008+0000 7f72f98bb800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cb46ec1e40 con 0x55cb4701b020 2024-09-12T17:28:01.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.008+0000 7f72f98bb800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x55cb46e8c680 con 0x55cb470186f0 2024-09-12T17:28:01.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.009+0000 7f72f73a5640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55cb470186f0 0x55cb4701aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.009+0000 7f72f6ba4640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x55cb4701b020 0x55cb4701d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:48330/0 (socket says 172.21.15.170:48330) 2024-09-12T17:28:01.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.009+0000 7f72f6ba4640 1 -- 172.21.15.170:0/661620975 learned_addr learned my addr 172.21.15.170:0/661620975 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:28:01.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.009+0000 7f72f73a5640 1 -- 172.21.15.170:0/661620975 >> v1:172.21.15.47:6789/0 conn(0x55cb4701b020 legacy=0x55cb4701d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.009+0000 7f72f73a5640 1 -- 172.21.15.170:0/661620975 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb46ea86b0 con 0x55cb470186f0 2024-09-12T17:28:01.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.011+0000 7f72f73a5640 1 --2- 172.21.15.170:0/661620975 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb470186f0 0x55cb4701aae0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f72e800a470 tx=0x7f72e8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6023022cb43d1138 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.011+0000 7f72f63a3640 1 -- 172.21.15.170:0/661620975 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72e8053570 con 0x55cb470186f0 2024-09-12T17:28:01.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.011+0000 7f72f63a3640 1 -- 172.21.15.170:0/661620975 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72e8058070 con 0x55cb470186f0 2024-09-12T17:28:01.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.011+0000 7f72f63a3640 1 -- 172.21.15.170:0/661620975 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72e8053880 con 0x55cb470186f0 2024-09-12T17:28:01.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.011+0000 7f72f98bb800 1 -- 172.21.15.170:0/661620975 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb470186f0 msgr2=0x55cb4701aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.011+0000 7f72f98bb800 1 --2- 172.21.15.170:0/661620975 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb470186f0 0x55cb4701aae0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f72e800a470 tx=0x7f72e8045a20 comp rx=0 tx=0).stop 2024-09-12T17:28:01.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.011+0000 7f72f98bb800 1 -- 172.21.15.170:0/661620975 shutdown_connections 2024-09-12T17:28:01.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.011+0000 7f72f98bb800 1 --2- 172.21.15.170:0/661620975 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb470186f0 0x55cb4701aae0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.011+0000 7f72f98bb800 1 -- 172.21.15.170:0/661620975 >> 172.21.15.170:0/661620975 conn(0x55cb470121b0 msgr2=0x55cb47014610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:01.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.011+0000 7f72f98bb800 1 -- 172.21.15.170:0/661620975 shutdown_connections 2024-09-12T17:28:01.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.011+0000 7f72f98bb800 1 -- 172.21.15.170:0/661620975 wait complete. 2024-09-12T17:28:01.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.025+0000 7f72f98bb800 1 Processor -- start 2024-09-12T17:28:01.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.025+0000 7f72f98bb800 1 -- start start 2024-09-12T17:28:01.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.025+0000 7f72f98bb800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb470186f0 0x55cb47017e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.025+0000 7f72f98bb800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55cb46eb0dd0 con 0x55cb470186f0 2024-09-12T17:28:01.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.026+0000 7f72f73a5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb470186f0 0x55cb47017e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.026+0000 7f72f73a5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb470186f0 0x55cb47017e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57142/0 (socket says 172.21.15.170:57142) 2024-09-12T17:28:01.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.026+0000 7f72f73a5640 1 -- 172.21.15.170:0/3643484690 learned_addr learned my addr 172.21.15.170:0/3643484690 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:01.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.026+0000 7f72f73a5640 1 -- 172.21.15.170:0/3643484690 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb46ec9e10 con 0x55cb470186f0 2024-09-12T17:28:01.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.026+0000 7f72f73a5640 1 --2- 172.21.15.170:0/3643484690 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb470186f0 0x55cb47017e80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f72e8025c20 tx=0x7f72e8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd1e5d36747d488e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.026+0000 7f71e560a640 1 -- 172.21.15.170:0/3643484690 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72e8053a20 con 0x55cb470186f0 2024-09-12T17:28:01.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.026+0000 7f71e560a640 1 -- 172.21.15.170:0/3643484690 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72e8063070 con 0x55cb470186f0 2024-09-12T17:28:01.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.026+0000 7f71e560a640 1 -- 172.21.15.170:0/3643484690 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72e8053cf0 con 0x55cb470186f0 2024-09-12T17:28:01.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.027+0000 7f72f98bb800 1 -- 172.21.15.170:0/3643484690 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb470186f0 msgr2=0x55cb47017e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.027+0000 7f72f98bb800 1 --2- 172.21.15.170:0/3643484690 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb470186f0 0x55cb47017e80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f72e8025c20 tx=0x7f72e8051000 comp rx=0 tx=0).stop 2024-09-12T17:28:01.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.027+0000 7f72f98bb800 1 -- 172.21.15.170:0/3643484690 shutdown_connections 2024-09-12T17:28:01.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.027+0000 7f72f98bb800 1 --2- 172.21.15.170:0/3643484690 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb470186f0 0x55cb47017e80 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.027+0000 7f72f98bb800 1 -- 172.21.15.170:0/3643484690 >> 172.21.15.170:0/3643484690 conn(0x55cb470121b0 msgr2=0x55cb47103020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:01.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.027+0000 7f72f98bb800 1 -- 172.21.15.170:0/3643484690 shutdown_connections 2024-09-12T17:28:01.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.027+0000 7f72f98bb800 1 -- 172.21.15.170:0/3643484690 wait complete. 2024-09-12T17:28:01.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.027+0000 7f72f98bb800 1 Processor -- start 2024-09-12T17:28:01.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.027+0000 7f72f98bb800 1 -- start start 2024-09-12T17:28:01.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.028+0000 7f72f98bb800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb470186f0 0x55cb47111160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.028+0000 7f72f98bb800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55cb4701f020 con 0x55cb470186f0 2024-09-12T17:28:01.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.028+0000 7f72f73a5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb470186f0 0x55cb47111160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.028+0000 7f72f73a5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb470186f0 0x55cb47111160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57158/0 (socket says 172.21.15.170:57158) 2024-09-12T17:28:01.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.028+0000 7f72f73a5640 1 -- 172.21.15.170:0/1741359063 learned_addr learned my addr 172.21.15.170:0/1741359063 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:01.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.028+0000 7f72f73a5640 1 -- 172.21.15.170:0/1741359063 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb471116c0 con 0x55cb470186f0 2024-09-12T17:28:01.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.028+0000 7f72f73a5640 1 --2- 172.21.15.170:0/1741359063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb470186f0 0x55cb47111160 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f72e8025c20 tx=0x7f72e8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.028+0000 7f71e3e07640 1 -- 172.21.15.170:0/1741359063 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72e8068660 con 0x55cb470186f0 2024-09-12T17:28:01.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.028+0000 7f71e3e07640 1 -- 172.21.15.170:0/1741359063 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72e8068800 con 0x55cb470186f0 2024-09-12T17:28:01.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.028+0000 7f71e3e07640 1 -- 172.21.15.170:0/1741359063 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72e8068ae0 con 0x55cb470186f0 2024-09-12T17:28:01.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.029+0000 7f72f98bb800 1 -- 172.21.15.170:0/1741359063 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cb47111950 con 0x55cb470186f0 2024-09-12T17:28:01.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.029+0000 7f72f98bb800 1 -- 172.21.15.170:0/1741359063 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb47112560 con 0x55cb470186f0 2024-09-12T17:28:01.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.029+0000 7f71e3e07640 1 -- 172.21.15.170:0/1741359063 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f72e8068c80 con 0x55cb470186f0 2024-09-12T17:28:01.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.030+0000 7f71e3e07640 1 --2- 172.21.15.170:0/1741359063 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f71dc03c780 0x7f71dc03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.030+0000 7f71e3e07640 1 -- 172.21.15.170:0/1741359063 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f72e8098100 con 0x55cb470186f0 2024-09-12T17:28:01.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.030+0000 7f72f6ba4640 1 --2- 172.21.15.170:0/1741359063 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f71dc03c780 0x7f71dc03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.030+0000 7f72f98bb800 1 --2- 172.21.15.170:0/1741359063 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55cb4701b020 0x55cb471187b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.030+0000 7f72f98bb800 1 -- 172.21.15.170:0/1741359063 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cb47112f20 con 0x55cb4701b020 2024-09-12T17:28:01.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.030+0000 7f72f7ba6640 1 --2- 172.21.15.170:0/1741359063 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55cb4701b020 0x55cb471187b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.030+0000 7f72f6ba4640 1 --2- 172.21.15.170:0/1741359063 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f71dc03c780 0x7f71dc03ec40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f72ec001d70 tx=0x7f72ec0012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.030+0000 7f72f7ba6640 1 --2- 172.21.15.170:0/1741359063 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55cb4701b020 0x55cb471187b0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.030+0000 7f72f7ba6640 1 -- 172.21.15.170:0/1741359063 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72f000a4d0 con 0x55cb4701b020 2024-09-12T17:28:01.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.031+0000 7f72f98bb800 1 -- 172.21.15.170:0/1741359063 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cb47119210 con 0x55cb4701b020 2024-09-12T17:28:01.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.031+0000 7f72f7ba6640 1 -- 172.21.15.170:0/1741359063 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f72f000a4d0 con 0x55cb4701b020 2024-09-12T17:28:01.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.031+0000 7f72f98bb800 1 --2- 172.21.15.170:0/1741359063 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55cb4711ab20 0x55cb4711cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.031+0000 7f72f98bb800 1 -- 172.21.15.170:0/1741359063 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cb4711d750 con 0x55cb4711ab20 2024-09-12T17:28:01.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.031+0000 7f72f73a5640 1 --2- 172.21.15.170:0/1741359063 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55cb4711ab20 0x55cb4711cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.031+0000 7f72f73a5640 1 --2- 172.21.15.170:0/1741359063 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55cb4711ab20 0x55cb4711cfc0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.031+0000 7f72f73a5640 1 -- 172.21.15.170:0/1741359063 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f72e8051070 con 0x55cb4711ab20 2024-09-12T17:28:01.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.031+0000 7f72f98bb800 1 -- 172.21.15.170:0/1741359063 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cb47119a60 con 0x55cb4701b020 2024-09-12T17:28:01.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.032+0000 7f72f7ba6640 1 -- 172.21.15.170:0/1741359063 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f72f000a4d0 con 0x55cb4701b020 2024-09-12T17:28:01.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.032+0000 7f72f98bb800 1 -- 172.21.15.170:0/1741359063 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cb47119e40 con 0x55cb4711ab20 2024-09-12T17:28:01.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.032+0000 7f72f73a5640 1 -- 172.21.15.170:0/1741359063 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f72e8051070 con 0x55cb4711ab20 2024-09-12T17:28:01.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.032+0000 7f72f98bb800 1 Processor -- start 2024-09-12T17:28:01.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.032+0000 7f72f98bb800 1 -- start start 2024-09-12T17:28:01.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.032+0000 7f72f98bb800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb4712bfe0 0x55cb4712c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.032+0000 7f72f98bb800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55cb46f0ea00 con 0x55cb4712bfe0 2024-09-12T17:28:01.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.033+0000 7f72f7ba6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb4712bfe0 0x55cb4712c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.033+0000 7f72f7ba6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb4712bfe0 0x55cb4712c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57168/0 (socket says 172.21.15.170:57168) 2024-09-12T17:28:01.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.033+0000 7f72f7ba6640 1 -- 172.21.15.170:0/1263880463 learned_addr learned my addr 172.21.15.170:0/1263880463 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:01.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.033+0000 7f72f7ba6640 1 -- 172.21.15.170:0/1263880463 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb4712ca40 con 0x55cb4712bfe0 2024-09-12T17:28:01.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.033+0000 7f72f7ba6640 1 --2- 172.21.15.170:0/1263880463 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb4712bfe0 0x55cb4712c400 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x55cb47112160 tx=0x7f72f00167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.033+0000 7f71e1602640 1 -- 172.21.15.170:0/1263880463 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72f0021570 con 0x55cb4712bfe0 2024-09-12T17:28:01.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.033+0000 7f71e1602640 1 -- 172.21.15.170:0/1263880463 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72f0021710 con 0x55cb4712bfe0 2024-09-12T17:28:01.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.033+0000 7f72f98bb800 1 -- 172.21.15.170:0/1263880463 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cb4712d270 con 0x55cb4712bfe0 2024-09-12T17:28:01.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.033+0000 7f71e1602640 1 -- 172.21.15.170:0/1263880463 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72f00219f0 con 0x55cb4712bfe0 2024-09-12T17:28:01.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.034+0000 7f72f98bb800 1 -- 172.21.15.170:0/1263880463 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb4712d810 con 0x55cb4712bfe0 2024-09-12T17:28:01.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.034+0000 7f71e1602640 1 -- 172.21.15.170:0/1263880463 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f72f0011040 con 0x55cb4712bfe0 2024-09-12T17:28:01.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.035+0000 7f71e1602640 1 --2- 172.21.15.170:0/1263880463 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f71d003c730 0x7f71d003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.035+0000 7f71e1602640 1 -- 172.21.15.170:0/1263880463 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f72f000e040 con 0x55cb4712bfe0 2024-09-12T17:28:01.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.035+0000 7f72f73a5640 1 --2- 172.21.15.170:0/1263880463 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f71d003c730 0x7f71d003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.035+0000 7f72f98bb800 1 Processor -- start 2024-09-12T17:28:01.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.035+0000 7f72f73a5640 1 --2- 172.21.15.170:0/1263880463 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f71d003c730 0x7f71d003ebf0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x55cb47112a50 tx=0x7f72e805d5c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.035+0000 7f72f98bb800 1 -- start start 2024-09-12T17:28:01.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.035+0000 7f72f98bb800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb47138ac0 0x55cb47138ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.035+0000 7f72f98bb800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55cb47016720 con 0x55cb47138ac0 2024-09-12T17:28:01.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.035+0000 7f72f7ba6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb47138ac0 0x55cb47138ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.035+0000 7f72f7ba6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb47138ac0 0x55cb47138ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57172/0 (socket says 172.21.15.170:57172) 2024-09-12T17:28:01.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.035+0000 7f72f7ba6640 1 -- 172.21.15.170:0/4042956365 learned_addr learned my addr 172.21.15.170:0/4042956365 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:01.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.036+0000 7f72f7ba6640 1 -- 172.21.15.170:0/4042956365 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb471394b0 con 0x55cb47138ac0 2024-09-12T17:28:01.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.036+0000 7f72f7ba6640 1 --2- 172.21.15.170:0/4042956365 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb47138ac0 0x55cb47138ec0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f72f0053dc0 tx=0x7f72f0054090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce1ebd4dcfc50677 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.036+0000 7f71daffd640 1 -- 172.21.15.170:0/4042956365 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72f001fa30 con 0x55cb47138ac0 2024-09-12T17:28:01.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.036+0000 7f71daffd640 1 -- 172.21.15.170:0/4042956365 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72f0051030 con 0x55cb47138ac0 2024-09-12T17:28:01.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.036+0000 7f71daffd640 1 -- 172.21.15.170:0/4042956365 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72f0021b90 con 0x55cb47138ac0 2024-09-12T17:28:01.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.036+0000 7f72f98bb800 1 -- 172.21.15.170:0/4042956365 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb47138ac0 msgr2=0x55cb47138ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.036+0000 7f72f98bb800 1 --2- 172.21.15.170:0/4042956365 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb47138ac0 0x55cb47138ec0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f72f0053dc0 tx=0x7f72f0054090 comp rx=0 tx=0).stop 2024-09-12T17:28:01.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.036+0000 7f72f98bb800 1 -- 172.21.15.170:0/4042956365 shutdown_connections 2024-09-12T17:28:01.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.036+0000 7f72f98bb800 1 --2- 172.21.15.170:0/4042956365 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb47138ac0 0x55cb47138ec0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.036+0000 7f72f98bb800 1 -- 172.21.15.170:0/4042956365 >> 172.21.15.170:0/4042956365 conn(0x55cb47134ec0 msgr2=0x55cb47133100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:01.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.036+0000 7f72f98bb800 1 -- 172.21.15.170:0/4042956365 shutdown_connections 2024-09-12T17:28:01.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.036+0000 7f72f98bb800 1 -- 172.21.15.170:0/4042956365 wait complete. 2024-09-12T17:28:01.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.037+0000 7f72f98bb800 1 Processor -- start 2024-09-12T17:28:01.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.037+0000 7f72f98bb800 1 -- start start 2024-09-12T17:28:01.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.037+0000 7f72f98bb800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb47138ac0 0x55cb47140090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.037+0000 7f72f98bb800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55cb47139ad0 con 0x55cb47138ac0 2024-09-12T17:28:01.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.037+0000 7f72f7ba6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb47138ac0 0x55cb47140090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.037+0000 7f72f7ba6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb47138ac0 0x55cb47140090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57178/0 (socket says 172.21.15.170:57178) 2024-09-12T17:28:01.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.037+0000 7f72f7ba6640 1 -- 172.21.15.170:0/1565561744 learned_addr learned my addr 172.21.15.170:0/1565561744 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:01.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.037+0000 7f72f7ba6640 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb471405f0 con 0x55cb47138ac0 2024-09-12T17:28:01.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.038+0000 7f72f7ba6640 1 --2- 172.21.15.170:0/1565561744 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb47138ac0 0x55cb47140090 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f72f0014fd0 tx=0x7f72f0053d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.038+0000 7f71d97fa640 1 -- 172.21.15.170:0/1565561744 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72f001f340 con 0x55cb47138ac0 2024-09-12T17:28:01.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.038+0000 7f71d97fa640 1 -- 172.21.15.170:0/1565561744 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72f001f500 con 0x55cb47138ac0 2024-09-12T17:28:01.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.038+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cb47140880 con 0x55cb47138ac0 2024-09-12T17:28:01.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.038+0000 7f71d97fa640 1 -- 172.21.15.170:0/1565561744 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72f0029ab0 con 0x55cb47138ac0 2024-09-12T17:28:01.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.038+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb47140880 con 0x55cb47138ac0 2024-09-12T17:28:01.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.038+0000 7f71d97fa640 1 -- 172.21.15.170:0/1565561744 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f72f0029c50 con 0x55cb47138ac0 2024-09-12T17:28:01.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.039+0000 7f71d97fa640 1 --2- 172.21.15.170:0/1565561744 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f71c003c780 0x7f71c003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.039+0000 7f71d97fa640 1 -- 172.21.15.170:0/1565561744 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f72f0034ae0 con 0x55cb47138ac0 2024-09-12T17:28:01.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.039+0000 7f72f73a5640 1 --2- 172.21.15.170:0/1565561744 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f71c003c780 0x7f71c003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.039+0000 7f72f98bb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.039+0000 7f72f98bb800 1 --2- 172.21.15.170:0/1565561744 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55cb4714b7d0 0x55cb4714dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.039+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cb4714e3e0 con 0x55cb4714b7d0 2024-09-12T17:28:01.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.039+0000 7f72f6ba4640 1 --2- 172.21.15.170:0/1565561744 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55cb4714b7d0 0x55cb4714dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.039+0000 7f72f73a5640 1 --2- 172.21.15.170:0/1565561744 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f71c003c780 0x7f71c003ec40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f72e8098070 tx=0x7f72e8088000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.039+0000 7f72f6ba4640 1 --2- 172.21.15.170:0/1565561744 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55cb4714b7d0 0x55cb4714dc90 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.040+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72ec009050 con 0x55cb4714b7d0 2024-09-12T17:28:01.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.040+0000 7f72f98bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.040+0000 7f72f98bb800 20 realm 2024-09-12T17:28:01.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.040+0000 7f72f98bb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.040+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cb4714ab20 con 0x55cb4714b7d0 2024-09-12T17:28:01.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.040+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72ec009050 con 0x55cb4714b7d0 2024-09-12T17:28:01.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.040+0000 7f72f98bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.040+0000 7f72f98bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:01.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.040+0000 7f72f98bb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.040+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cb4714eec0 con 0x55cb4714b7d0 2024-09-12T17:28:01.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.040+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72ec009050 con 0x55cb4714b7d0 2024-09-12T17:28:01.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.040+0000 7f72f98bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.040+0000 7f72f98bb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.040+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cb4714f790 con 0x55cb4714b7d0 2024-09-12T17:28:01.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.040+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f72ec009050 con 0x55cb4714b7d0 2024-09-12T17:28:01.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.040+0000 7f72f98bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:01.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.040+0000 7f72f98bb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.040+0000 7f72f98bb800 1 --2- 172.21.15.170:0/1565561744 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55cb471500d0 0x55cb471524c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.040+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cb47152c00 con 0x55cb471500d0 2024-09-12T17:28:01.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.041+0000 7f72f7ba6640 1 --2- 172.21.15.170:0/1565561744 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55cb471500d0 0x55cb471524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.041+0000 7f72f7ba6640 1 --2- 172.21.15.170:0/1565561744 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55cb471500d0 0x55cb471524c0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.041+0000 7f72f7ba6640 1 -- 172.21.15.170:0/1565561744 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f72f0039020 con 0x55cb471500d0 2024-09-12T17:28:01.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.041+0000 7f72f98bb800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:01.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.041+0000 7f72f98bb800 20 searching for the correct realm 2024-09-12T17:28:01.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.041+0000 7f72f98bb800 1 --2- 172.21.15.170:0/1565561744 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55cb47154c80 0x55cb47157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.041+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cb47157810 con 0x55cb47154c80 2024-09-12T17:28:01.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.041+0000 7f72f73a5640 1 --2- 172.21.15.170:0/1565561744 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55cb47154c80 0x55cb47157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.041+0000 7f72f73a5640 1 --2- 172.21.15.170:0/1565561744 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55cb47154c80 0x55cb47157140 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.042+0000 7f72f73a5640 1 -- 172.21.15.170:0/1565561744 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72e8051070 con 0x55cb47154c80 2024-09-12T17:28:01.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.042+0000 7f72f73a5640 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cb47157810 con 0x55cb471500d0 2024-09-12T17:28:01.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.042+0000 7f72f7ba6640 1 -- 172.21.15.170:0/1565561744 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72f0039020 con 0x55cb471500d0 2024-09-12T17:28:01.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.042+0000 7f72f7ba6640 1 --2- 172.21.15.170:0/1565561744 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f72f0047b80 0x7f72f0055230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.042+0000 7f72f7ba6640 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cb47157810 con 0x7f72f0047b80 2024-09-12T17:28:01.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.042+0000 7f72f6ba4640 1 --2- 172.21.15.170:0/1565561744 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f72f0047b80 0x7f72f0055230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.043+0000 7f72f6ba4640 1 --2- 172.21.15.170:0/1565561744 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f72f0047b80 0x7f72f0055230 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.043+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ec009050 con 0x7f72f0047b80 2024-09-12T17:28:01.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.043+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cb47157810 con 0x55cb4714b7d0 2024-09-12T17:28:01.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.043+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ec009050 con 0x55cb4714b7d0 2024-09-12T17:28:01.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.043+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cb47157810 con 0x55cb4714b7d0 2024-09-12T17:28:01.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.043+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ec029040 con 0x55cb4714b7d0 2024-09-12T17:28:01.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.043+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cb47157810 con 0x7f72f0047b80 2024-09-12T17:28:01.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.044+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ec029040 con 0x7f72f0047b80 2024-09-12T17:28:01.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.044+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cb47157810 con 0x7f72f0047b80 2024-09-12T17:28:01.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.044+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ec029040 con 0x7f72f0047b80 2024-09-12T17:28:01.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.044+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cb47157810 con 0x55cb471500d0 2024-09-12T17:28:01.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.044+0000 7f72f7ba6640 1 -- 172.21.15.170:0/1565561744 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72f0039020 con 0x55cb471500d0 2024-09-12T17:28:01.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.044+0000 7f72f7ba6640 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cb47157810 con 0x55cb47154c80 2024-09-12T17:28:01.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.044+0000 7f72f73a5640 1 -- 172.21.15.170:0/1565561744 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72e8051070 con 0x55cb47154c80 2024-09-12T17:28:01.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.044+0000 7f72f73a5640 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cb47157810 con 0x55cb4714b7d0 2024-09-12T17:28:01.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.044+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ec029040 con 0x55cb4714b7d0 2024-09-12T17:28:01.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.044+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cb47157810 con 0x7f72f0047b80 2024-09-12T17:28:01.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.045+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ec029040 con 0x7f72f0047b80 2024-09-12T17:28:01.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.045+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cb47157810 con 0x55cb4714b7d0 2024-09-12T17:28:01.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.045+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ec029040 con 0x55cb4714b7d0 2024-09-12T17:28:01.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.045+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cb47157810 con 0x55cb471500d0 2024-09-12T17:28:01.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.045+0000 7f72f7ba6640 1 -- 172.21.15.170:0/1565561744 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f72f0039020 con 0x55cb471500d0 2024-09-12T17:28:01.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.045+0000 7f72f7ba6640 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cb47157810 con 0x55cb47154c80 2024-09-12T17:28:01.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.045+0000 7f72f73a5640 1 -- 172.21.15.170:0/1565561744 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72e8051070 con 0x55cb47154c80 2024-09-12T17:28:01.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.045+0000 7f72f73a5640 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cb47157810 con 0x55cb47154c80 2024-09-12T17:28:01.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.046+0000 7f72f73a5640 1 -- 172.21.15.170:0/1565561744 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72e8051070 con 0x55cb47154c80 2024-09-12T17:28:01.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.046+0000 7f72f73a5640 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cb47157810 con 0x7f72f0047b80 2024-09-12T17:28:01.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.046+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ec029040 con 0x7f72f0047b80 2024-09-12T17:28:01.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.046+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cb47157810 con 0x55cb47154c80 2024-09-12T17:28:01.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.046+0000 7f72f73a5640 1 -- 172.21.15.170:0/1565561744 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72e8051070 con 0x55cb47154c80 2024-09-12T17:28:01.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.046+0000 7f72f73a5640 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cb47157810 con 0x55cb47154c80 2024-09-12T17:28:01.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.046+0000 7f72f73a5640 1 -- 172.21.15.170:0/1565561744 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72e8051070 con 0x55cb47154c80 2024-09-12T17:28:01.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.046+0000 7f72f73a5640 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cb47157810 con 0x55cb4714b7d0 2024-09-12T17:28:01.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.046+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ec029040 con 0x55cb4714b7d0 2024-09-12T17:28:01.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.046+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cb47157810 con 0x55cb4714b7d0 2024-09-12T17:28:01.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.047+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f72ec029040 con 0x55cb4714b7d0 2024-09-12T17:28:01.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.047+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cb47157810 con 0x7f72f0047b80 2024-09-12T17:28:01.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.047+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ec029040 con 0x7f72f0047b80 2024-09-12T17:28:01.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.047+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cb47157810 con 0x55cb47154c80 2024-09-12T17:28:01.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.047+0000 7f72f73a5640 1 -- 172.21.15.170:0/1565561744 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72e8051070 con 0x55cb47154c80 2024-09-12T17:28:01.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.047+0000 7f72f73a5640 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cb47157810 con 0x55cb471500d0 2024-09-12T17:28:01.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.047+0000 7f72f7ba6640 1 -- 172.21.15.170:0/1565561744 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72f0039020 con 0x55cb471500d0 2024-09-12T17:28:01.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.047+0000 7f72f7ba6640 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cb47157810 con 0x55cb4714b7d0 2024-09-12T17:28:01.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.048+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ec029040 con 0x55cb4714b7d0 2024-09-12T17:28:01.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.048+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cb47157810 con 0x7f72f0047b80 2024-09-12T17:28:01.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.048+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ec029040 con 0x7f72f0047b80 2024-09-12T17:28:01.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.048+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cb47157810 con 0x55cb47154c80 2024-09-12T17:28:01.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.048+0000 7f72f73a5640 1 -- 172.21.15.170:0/1565561744 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72e8051070 con 0x55cb47154c80 2024-09-12T17:28:01.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.048+0000 7f72f73a5640 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cb47157810 con 0x7f72f0047b80 2024-09-12T17:28:01.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.048+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ec029040 con 0x7f72f0047b80 2024-09-12T17:28:01.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.048+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cb47157810 con 0x55cb471500d0 2024-09-12T17:28:01.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.049+0000 7f72f7ba6640 1 -- 172.21.15.170:0/1565561744 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72f0039020 con 0x55cb471500d0 2024-09-12T17:28:01.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.049+0000 7f72f7ba6640 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cb47157810 con 0x55cb47154c80 2024-09-12T17:28:01.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.049+0000 7f72f73a5640 1 -- 172.21.15.170:0/1565561744 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72e8051070 con 0x55cb47154c80 2024-09-12T17:28:01.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.049+0000 7f72f73a5640 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cb47157810 con 0x7f72f0047b80 2024-09-12T17:28:01.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.049+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ec029040 con 0x7f72f0047b80 2024-09-12T17:28:01.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.049+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cb47157810 con 0x55cb4714b7d0 2024-09-12T17:28:01.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.050+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f72ec029040 con 0x55cb4714b7d0 2024-09-12T17:28:01.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.050+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cb47157810 con 0x55cb471500d0 2024-09-12T17:28:01.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.050+0000 7f72f7ba6640 1 -- 172.21.15.170:0/1565561744 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f72f0039020 con 0x55cb471500d0 2024-09-12T17:28:01.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.050+0000 7f72f98bb800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:01.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.050+0000 7f72f98bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:01.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.050+0000 7f72f98bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:01.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.050+0000 7f72f98bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:01.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.050+0000 7f72f98bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:01.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.050+0000 7f72f98bb800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:01.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.050+0000 7f72f98bb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.050+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cb47153680 con 0x55cb4714b7d0 2024-09-12T17:28:01.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.050+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72ec029040 con 0x55cb4714b7d0 2024-09-12T17:28:01.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.050+0000 7f72f98bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.050+0000 7f72f98bb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.050+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cb47153ad0 con 0x55cb4714b7d0 2024-09-12T17:28:01.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.050+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f72ec029040 con 0x55cb4714b7d0 2024-09-12T17:28:01.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.050+0000 7f72f98bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:01.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.050+0000 7f72f98bb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.050+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cb47153fb0 con 0x55cb471500d0 2024-09-12T17:28:01.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.051+0000 7f72f7ba6640 1 -- 172.21.15.170:0/1565561744 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f72f0039020 con 0x55cb471500d0 2024-09-12T17:28:01.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.051+0000 7f72f98bb800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:01.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.051+0000 7f72f98bb800 20 zone default found 2024-09-12T17:28:01.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.051+0000 7f72f98bb800 4 Realm: () 2024-09-12T17:28:01.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.051+0000 7f72f98bb800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:01.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.051+0000 7f72f98bb800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:01.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.051+0000 7f72f98bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:01.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.051+0000 7f72f98bb800 20 zonegroup default 2024-09-12T17:28:01.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.051+0000 7f72f98bb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.051+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cb47153210 con 0x7f72f0047b80 2024-09-12T17:28:01.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.051+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f72ec029040 con 0x7f72f0047b80 2024-09-12T17:28:01.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.051+0000 7f72f98bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.051+0000 7f72f98bb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.051+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cb47159ec0 con 0x55cb47154c80 2024-09-12T17:28:01.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.051+0000 7f72f73a5640 1 -- 172.21.15.170:0/1565561744 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f72e8051070 con 0x55cb47154c80 2024-09-12T17:28:01.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.051+0000 7f72f98bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.051+0000 7f72f98bb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.051+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cb4715a380 con 0x55cb47154c80 2024-09-12T17:28:01.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.051+0000 7f72f73a5640 1 -- 172.21.15.170:0/1565561744 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f72e8051070 con 0x55cb47154c80 2024-09-12T17:28:01.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.051+0000 7f72f98bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.051+0000 7f72f98bb800 20 started sync module instance, tier type = 2024-09-12T17:28:01.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.051+0000 7f72f98bb800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:01.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.052+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cb47158cc0 con 0x55cb471500d0 2024-09-12T17:28:01.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.053+0000 7f72f7ba6640 1 -- 172.21.15.170:0/1565561744 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72f0039020 con 0x55cb471500d0 2024-09-12T17:28:01.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.053+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94331559317680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cb4715ac90 con 0x55cb471500d0 2024-09-12T17:28:01.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.053+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cb4715b4e0 con 0x55cb4714b7d0 2024-09-12T17:28:01.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.054+0000 7f72f7ba6640 1 -- 172.21.15.170:0/1565561744 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94331559317680] v29'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72f0039020 con 0x55cb471500d0 2024-09-12T17:28:01.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.054+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ec029040 con 0x55cb4714b7d0 2024-09-12T17:28:01.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.054+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94331559323888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cb4715b240 con 0x55cb4714b7d0 2024-09-12T17:28:01.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.054+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cb4715bd60 con 0x55cb47154c80 2024-09-12T17:28:01.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.055+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94331559323888] v29'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ec029040 con 0x55cb4714b7d0 2024-09-12T17:28:01.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.055+0000 7f72f73a5640 1 -- 172.21.15.170:0/1565561744 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72e8051070 con 0x55cb47154c80 2024-09-12T17:28:01.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.055+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94331559327792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cb4715bd20 con 0x55cb47154c80 2024-09-12T17:28:01.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.055+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cb4715c7b0 con 0x55cb471500d0 2024-09-12T17:28:01.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.056+0000 7f72f73a5640 1 -- 172.21.15.170:0/1565561744 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94331559327792] v29'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72e8051070 con 0x55cb47154c80 2024-09-12T17:28:01.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.056+0000 7f72f7ba6640 1 -- 172.21.15.170:0/1565561744 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72f0039020 con 0x55cb471500d0 2024-09-12T17:28:01.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.056+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94331559324944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cb4715c770 con 0x55cb471500d0 2024-09-12T17:28:01.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.056+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cb4715d240 con 0x55cb4714b7d0 2024-09-12T17:28:01.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.057+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ec029040 con 0x55cb4714b7d0 2024-09-12T17:28:01.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.057+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94331559333136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cb4715d200 con 0x55cb4714b7d0 2024-09-12T17:28:01.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.057+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cb4715e1e0 con 0x7f72f0047b80 2024-09-12T17:28:01.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.057+0000 7f72f7ba6640 1 -- 172.21.15.170:0/1565561744 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94331559324944] v29'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72f0039020 con 0x55cb471500d0 2024-09-12T17:28:01.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.058+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ec029040 con 0x7f72f0047b80 2024-09-12T17:28:01.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.058+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94331559330496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cb4715e1e0 con 0x7f72f0047b80 2024-09-12T17:28:01.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.058+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cb4715ec20 con 0x7f72f0047b80 2024-09-12T17:28:01.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.058+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94331559333136] v29'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ec029040 con 0x55cb4714b7d0 2024-09-12T17:28:01.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.059+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94331559330496] v29'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ec029040 con 0x7f72f0047b80 2024-09-12T17:28:01.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.060+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(56 notify.6 [create] v29'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ec029040 con 0x7f72f0047b80 2024-09-12T17:28:01.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.060+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94331559337264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cb4715e770 con 0x7f72f0047b80 2024-09-12T17:28:01.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.060+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cb4715f130 con 0x7f72f0047b80 2024-09-12T17:28:01.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.060+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94331559337264] v29'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ec029040 con 0x7f72f0047b80 2024-09-12T17:28:01.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.061+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(58 notify.7 [create] v29'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ec029040 con 0x7f72f0047b80 2024-09-12T17:28:01.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.061+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94331559335472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cb4715f130 con 0x7f72f0047b80 2024-09-12T17:28:01.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.061+0000 7f72f98bb800 20 add_watcher() i=0 2024-09-12T17:28:01.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.061+0000 7f72f98bb800 20 add_watcher() i=1 2024-09-12T17:28:01.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.061+0000 7f72f98bb800 20 add_watcher() i=2 2024-09-12T17:28:01.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.061+0000 7f72f98bb800 20 add_watcher() i=3 2024-09-12T17:28:01.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.061+0000 7f72f98bb800 20 add_watcher() i=4 2024-09-12T17:28:01.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.061+0000 7f72f98bb800 20 add_watcher() i=5 2024-09-12T17:28:01.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.061+0000 7f72f98bb800 20 add_watcher() i=6 2024-09-12T17:28:01.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.062+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94331559335472] v29'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ec029040 con 0x7f72f0047b80 2024-09-12T17:28:01.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.062+0000 7f72f98bb800 20 add_watcher() i=7 2024-09-12T17:28:01.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.062+0000 7f72f98bb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:01.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.062+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cb47162420 con 0x55cb4714b7d0 2024-09-12T17:28:01.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.062+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f72ec029040 con 0x55cb4714b7d0 2024-09-12T17:28:01.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.062+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94331559341552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cb4715f6c0 con 0x55cb4714b7d0 2024-09-12T17:28:01.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.063+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94331559341552] v29'74 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f72ec029040 con 0x55cb4714b7d0 2024-09-12T17:28:01.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.063+0000 7f71ae7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:01.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.063+0000 7f72f98bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:01.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.063+0000 7f72f98bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:01.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.063+0000 7f72f98bb800 5 note: GC not initialized 2024-09-12T17:28:01.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.063+0000 7f71ad7e2640 20 reqs_thread_entry: start 2024-09-12T17:28:01.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.063+0000 7f72f98bb800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:01.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.064+0000 7f72f98bb800 20 Filter name: none 2024-09-12T17:28:01.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.064+0000 7f71a6ffd640 20 reqs_thread_entry: start 2024-09-12T17:28:01.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.064+0000 7f72f98bb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.064+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cb47195090 con 0x55cb4714b7d0 2024-09-12T17:28:01.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.064+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f72ec029040 con 0x55cb4714b7d0 2024-09-12T17:28:01.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.064+0000 7f72f98bb800 20 rados_obj.operate() r=0 bl.length=556 2024-09-12T17:28:01.078 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T17:27:59.362376Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:27:59.362351Z","tags":[],"group_ids":[]} 2024-09-12T17:28:01.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.065+0000 7f71ae7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:01.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.065+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94331559341552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cb47193ba0 con 0x55cb4714b7d0 2024-09-12T17:28:01.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.066+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94331559341552] v29'75 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f72ec029040 con 0x55cb4714b7d0 2024-09-12T17:28:01.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.066+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94331559317680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cb4715edf0 con 0x55cb471500d0 2024-09-12T17:28:01.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.067+0000 7f72f7ba6640 1 -- 172.21.15.170:0/1565561744 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94331559317680] v29'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72f0039020 con 0x55cb471500d0 2024-09-12T17:28:01.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.067+0000 7f72f98bb800 20 remove_watcher() i=0 2024-09-12T17:28:01.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.067+0000 7f72f98bb800 2 removed watcher, disabling cache 2024-09-12T17:28:01.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.067+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94331559323888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cb4715edf0 con 0x55cb4714b7d0 2024-09-12T17:28:01.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.068+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94331559323888] v29'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ec029040 con 0x55cb4714b7d0 2024-09-12T17:28:01.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.068+0000 7f72f98bb800 20 remove_watcher() i=1 2024-09-12T17:28:01.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.068+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94331559327792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cb4715a8f0 con 0x55cb47154c80 2024-09-12T17:28:01.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.069+0000 7f72f73a5640 1 -- 172.21.15.170:0/1565561744 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94331559327792] v29'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72e8051070 con 0x55cb47154c80 2024-09-12T17:28:01.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.069+0000 7f72f98bb800 20 remove_watcher() i=2 2024-09-12T17:28:01.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.069+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94331559324944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cb4715edf0 con 0x55cb471500d0 2024-09-12T17:28:01.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.070+0000 7f72f7ba6640 1 -- 172.21.15.170:0/1565561744 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94331559324944] v29'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72f0039020 con 0x55cb471500d0 2024-09-12T17:28:01.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.070+0000 7f72f98bb800 20 remove_watcher() i=3 2024-09-12T17:28:01.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.070+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94331559333136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cb4715b830 con 0x55cb4714b7d0 2024-09-12T17:28:01.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.071+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94331559333136] v29'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ec029040 con 0x55cb4714b7d0 2024-09-12T17:28:01.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.071+0000 7f72f98bb800 20 remove_watcher() i=4 2024-09-12T17:28:01.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.071+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94331559330496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cb4715edf0 con 0x7f72f0047b80 2024-09-12T17:28:01.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.072+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94331559330496] v29'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ec029040 con 0x7f72f0047b80 2024-09-12T17:28:01.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.072+0000 7f72f98bb800 20 remove_watcher() i=5 2024-09-12T17:28:01.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.072+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94331559337264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cb4715b830 con 0x7f72f0047b80 2024-09-12T17:28:01.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.073+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94331559337264] v29'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ec029040 con 0x7f72f0047b80 2024-09-12T17:28:01.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.073+0000 7f72f98bb800 20 remove_watcher() i=6 2024-09-12T17:28:01.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.073+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94331559335472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cb4715edf0 con 0x7f72f0047b80 2024-09-12T17:28:01.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.074+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94331559335472] v29'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ec029040 con 0x7f72f0047b80 2024-09-12T17:28:01.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.074+0000 7f72f98bb800 20 remove_watcher() i=7 2024-09-12T17:28:01.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.074+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f72f0047b80 msgr2=0x7f72f0055230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.074+0000 7f72f98bb800 1 --2- 172.21.15.170:0/1565561744 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f72f0047b80 0x7f72f0055230 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.074+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55cb4714b7d0 msgr2=0x55cb4714dc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.074+0000 7f72f98bb800 1 --2- 172.21.15.170:0/1565561744 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55cb4714b7d0 0x55cb4714dc90 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.074+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55cb471500d0 msgr2=0x55cb471524c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.074+0000 7f72f98bb800 1 --2- 172.21.15.170:0/1565561744 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55cb471500d0 0x55cb471524c0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.074+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55cb47154c80 msgr2=0x55cb47157140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.074+0000 7f72f98bb800 1 --2- 172.21.15.170:0/1565561744 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55cb47154c80 0x55cb47157140 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.074+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f71c003c780 msgr2=0x7f71c003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.074+0000 7f72f98bb800 1 --2- 172.21.15.170:0/1565561744 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f71c003c780 0x7f71c003ec40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f72e8098070 tx=0x7f72e8088000 comp rx=0 tx=0).stop 2024-09-12T17:28:01.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.074+0000 7f72f6ba4640 1 -- 172.21.15.170:0/1565561744 reap_dead start 2024-09-12T17:28:01.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.074+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb47138ac0 msgr2=0x55cb47140090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.074+0000 7f72f98bb800 1 --2- 172.21.15.170:0/1565561744 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb47138ac0 0x55cb47140090 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f72f0014fd0 tx=0x7f72f0053d50 comp rx=0 tx=0).stop 2024-09-12T17:28:01.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.074+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 shutdown_connections 2024-09-12T17:28:01.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.074+0000 7f72f98bb800 1 --2- 172.21.15.170:0/1565561744 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb47138ac0 0x55cb47140090 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.074+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 >> 172.21.15.170:0/1565561744 conn(0x55cb47134ec0 msgr2=0x55cb471330d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:01.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.074+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 shutdown_connections 2024-09-12T17:28:01.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.074+0000 7f72f98bb800 1 -- 172.21.15.170:0/1565561744 wait complete. 2024-09-12T17:28:01.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.075+0000 7f72f98bb800 1 -- 172.21.15.170:0/1263880463 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f71d003c730 msgr2=0x7f71d003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.075+0000 7f72f98bb800 1 --2- 172.21.15.170:0/1263880463 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f71d003c730 0x7f71d003ebf0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x55cb47112a50 tx=0x7f72e805d5c0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.075+0000 7f72f98bb800 1 -- 172.21.15.170:0/1263880463 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb4712bfe0 msgr2=0x55cb4712c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.075+0000 7f72f98bb800 1 --2- 172.21.15.170:0/1263880463 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb4712bfe0 0x55cb4712c400 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x55cb47112160 tx=0x7f72f00167b0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.075+0000 7f72f98bb800 1 -- 172.21.15.170:0/1263880463 shutdown_connections 2024-09-12T17:28:01.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.075+0000 7f72f98bb800 1 --2- 172.21.15.170:0/1263880463 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f71d003c730 0x7f71d003ebf0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.075+0000 7f72f98bb800 1 --2- 172.21.15.170:0/1263880463 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb4712bfe0 0x55cb4712c400 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.075+0000 7f72f98bb800 1 -- 172.21.15.170:0/1263880463 >> 172.21.15.170:0/1263880463 conn(0x55cb47120390 msgr2=0x55cb47120770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:01.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.075+0000 7f72f98bb800 1 -- 172.21.15.170:0/1263880463 shutdown_connections 2024-09-12T17:28:01.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.075+0000 7f72f98bb800 1 -- 172.21.15.170:0/1263880463 wait complete. 2024-09-12T17:28:01.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.075+0000 7f72f98bb800 1 -- 172.21.15.170:0/1741359063 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55cb4701b020 msgr2=0x55cb471187b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.075+0000 7f72f98bb800 1 --2- 172.21.15.170:0/1741359063 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55cb4701b020 0x55cb471187b0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.075+0000 7f72f98bb800 1 -- 172.21.15.170:0/1741359063 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55cb4711ab20 msgr2=0x55cb4711cfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.075+0000 7f72f98bb800 1 --2- 172.21.15.170:0/1741359063 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55cb4711ab20 0x55cb4711cfc0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.075+0000 7f72f98bb800 1 -- 172.21.15.170:0/1741359063 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f71dc03c780 msgr2=0x7f71dc03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.075+0000 7f72f98bb800 1 --2- 172.21.15.170:0/1741359063 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f71dc03c780 0x7f71dc03ec40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f72ec001d70 tx=0x7f72ec0012d0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.075+0000 7f72f98bb800 1 -- 172.21.15.170:0/1741359063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb470186f0 msgr2=0x55cb47111160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.075+0000 7f72f98bb800 1 --2- 172.21.15.170:0/1741359063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb470186f0 0x55cb47111160 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f72e8025c20 tx=0x7f72e8002fb0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.075+0000 7f72f98bb800 1 -- 172.21.15.170:0/1741359063 shutdown_connections 2024-09-12T17:28:01.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.075+0000 7f72f98bb800 1 --2- 172.21.15.170:0/1741359063 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55cb4711ab20 0x55cb4711cfc0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.075+0000 7f72f98bb800 1 --2- 172.21.15.170:0/1741359063 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f71dc03c780 0x7f71dc03ec40 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.075+0000 7f72f98bb800 1 --2- 172.21.15.170:0/1741359063 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55cb4701b020 0x55cb471187b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.075+0000 7f72f98bb800 1 --2- 172.21.15.170:0/1741359063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cb470186f0 0x55cb47111160 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.075+0000 7f72f98bb800 1 -- 172.21.15.170:0/1741359063 >> 172.21.15.170:0/1741359063 conn(0x55cb470121b0 msgr2=0x55cb47102b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:01.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.075+0000 7f72f98bb800 1 -- 172.21.15.170:0/1741359063 shutdown_connections 2024-09-12T17:28:01.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.075+0000 7f72f98bb800 1 -- 172.21.15.170:0/1741359063 wait complete. 2024-09-12T17:28:01.089 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T17:27:59.362376Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:27:59.362351Z', 'tags': [], 'group_ids': []} 2024-09-12T17:28:01.089 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-12T17:28:01.089 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-12T17:28:01.090 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-12T17:28:01.134 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:01.134 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:01.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.133+0000 7f1105b33800 1 Processor -- start 2024-09-12T17:28:01.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.133+0000 7f1105b33800 1 -- start start 2024-09-12T17:28:01.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.133+0000 7f1105b33800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55a6ca6234a0 0x55a6ca6238a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.133+0000 7f1105b33800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a6ca4cee40 con 0x55a6ca623de0 2024-09-12T17:28:01.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.133+0000 7f1105b33800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x55a6ca499680 con 0x55a6ca6234a0 2024-09-12T17:28:01.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.134+0000 7f1101876640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55a6ca6234a0 0x55a6ca6238a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.134+0000 7f10fbfff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x55a6ca623de0 0x55a6ca624290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:48344/0 (socket says 172.21.15.170:48344) 2024-09-12T17:28:01.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.134+0000 7f1101876640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55a6ca6234a0 0x55a6ca6238a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57194/0 (socket says 172.21.15.170:57194) 2024-09-12T17:28:01.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.134+0000 7f10fbfff640 1 -- 172.21.15.170:0/3146057686 learned_addr learned my addr 172.21.15.170:0/3146057686 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:28:01.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.134+0000 7f1101876640 1 -- 172.21.15.170:0/3146057686 >> v1:172.21.15.47:6789/0 conn(0x55a6ca623de0 legacy=0x55a6ca624290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.134+0000 7f1101876640 1 -- 172.21.15.170:0/3146057686 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6ca4b56b0 con 0x55a6ca6234a0 2024-09-12T17:28:01.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.136+0000 7f1101876640 1 --2- 172.21.15.170:0/3146057686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a6ca6234a0 0x55a6ca6238a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f10f400a470 tx=0x7f10f4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81330c1a77f51d95 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.136+0000 7f1101075640 1 -- 172.21.15.170:0/3146057686 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10f4053570 con 0x55a6ca6234a0 2024-09-12T17:28:01.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.136+0000 7f1101075640 1 -- 172.21.15.170:0/3146057686 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10f4058070 con 0x55a6ca6234a0 2024-09-12T17:28:01.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.136+0000 7f1101075640 1 -- 172.21.15.170:0/3146057686 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10f4053880 con 0x55a6ca6234a0 2024-09-12T17:28:01.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.136+0000 7f1105b33800 1 -- 172.21.15.170:0/3146057686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a6ca6234a0 msgr2=0x55a6ca6238a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.136+0000 7f1105b33800 1 --2- 172.21.15.170:0/3146057686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a6ca6234a0 0x55a6ca6238a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f10f400a470 tx=0x7f10f4045a20 comp rx=0 tx=0).stop 2024-09-12T17:28:01.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.136+0000 7f1105b33800 1 -- 172.21.15.170:0/3146057686 shutdown_connections 2024-09-12T17:28:01.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.136+0000 7f1105b33800 1 --2- 172.21.15.170:0/3146057686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a6ca6234a0 0x55a6ca6238a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.136+0000 7f1105b33800 1 -- 172.21.15.170:0/3146057686 >> 172.21.15.170:0/3146057686 conn(0x55a6ca61f1f0 msgr2=0x55a6ca621630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:01.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.136+0000 7f1105b33800 1 -- 172.21.15.170:0/3146057686 shutdown_connections 2024-09-12T17:28:01.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.136+0000 7f1105b33800 1 -- 172.21.15.170:0/3146057686 wait complete. 2024-09-12T17:28:01.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.150+0000 7f1105b33800 1 Processor -- start 2024-09-12T17:28:01.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.150+0000 7f1105b33800 1 -- start start 2024-09-12T17:28:01.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.150+0000 7f1105b33800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a6ca6234a0 0x55a6ca716810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.150+0000 7f1105b33800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a6ca4bddd0 con 0x55a6ca6234a0 2024-09-12T17:28:01.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.151+0000 7f1101876640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a6ca6234a0 0x55a6ca716810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.151+0000 7f1101876640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a6ca6234a0 0x55a6ca716810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57210/0 (socket says 172.21.15.170:57210) 2024-09-12T17:28:01.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.151+0000 7f1101876640 1 -- 172.21.15.170:0/3545066877 learned_addr learned my addr 172.21.15.170:0/3545066877 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:01.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.151+0000 7f1101876640 1 -- 172.21.15.170:0/3545066877 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6ca4d6e10 con 0x55a6ca6234a0 2024-09-12T17:28:01.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.151+0000 7f1101876640 1 --2- 172.21.15.170:0/3545066877 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a6ca6234a0 0x55a6ca716810 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f10f4025c20 tx=0x7f10f4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=132c0a52940388aa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.151+0000 7f0fefe07640 1 -- 172.21.15.170:0/3545066877 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10f4053a20 con 0x55a6ca6234a0 2024-09-12T17:28:01.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.151+0000 7f0fefe07640 1 -- 172.21.15.170:0/3545066877 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10f4063070 con 0x55a6ca6234a0 2024-09-12T17:28:01.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.151+0000 7f0fefe07640 1 -- 172.21.15.170:0/3545066877 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10f4053cf0 con 0x55a6ca6234a0 2024-09-12T17:28:01.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.152+0000 7f1105b33800 1 -- 172.21.15.170:0/3545066877 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a6ca6234a0 msgr2=0x55a6ca716810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.152+0000 7f1105b33800 1 --2- 172.21.15.170:0/3545066877 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a6ca6234a0 0x55a6ca716810 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f10f4025c20 tx=0x7f10f4051000 comp rx=0 tx=0).stop 2024-09-12T17:28:01.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.152+0000 7f1105b33800 1 -- 172.21.15.170:0/3545066877 shutdown_connections 2024-09-12T17:28:01.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.152+0000 7f1105b33800 1 --2- 172.21.15.170:0/3545066877 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a6ca6234a0 0x55a6ca716810 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.152+0000 7f1105b33800 1 -- 172.21.15.170:0/3545066877 >> 172.21.15.170:0/3545066877 conn(0x55a6ca61f1f0 msgr2=0x55a6ca712190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:01.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.152+0000 7f1105b33800 1 -- 172.21.15.170:0/3545066877 shutdown_connections 2024-09-12T17:28:01.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.152+0000 7f1105b33800 1 -- 172.21.15.170:0/3545066877 wait complete. 2024-09-12T17:28:01.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.152+0000 7f1105b33800 1 Processor -- start 2024-09-12T17:28:01.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.152+0000 7f1105b33800 1 -- start start 2024-09-12T17:28:01.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.152+0000 7f1105b33800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a6ca6234a0 0x55a6ca71e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.152+0000 7f1105b33800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a6ca624d60 con 0x55a6ca6234a0 2024-09-12T17:28:01.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.153+0000 7f1101876640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a6ca6234a0 0x55a6ca71e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.153+0000 7f1101876640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a6ca6234a0 0x55a6ca71e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57212/0 (socket says 172.21.15.170:57212) 2024-09-12T17:28:01.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.153+0000 7f1101876640 1 -- 172.21.15.170:0/512257330 learned_addr learned my addr 172.21.15.170:0/512257330 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:01.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.153+0000 7f1101876640 1 -- 172.21.15.170:0/512257330 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6ca71e6a0 con 0x55a6ca6234a0 2024-09-12T17:28:01.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.153+0000 7f1101876640 1 --2- 172.21.15.170:0/512257330 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a6ca6234a0 0x55a6ca71e140 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f10f4025c20 tx=0x7f10f4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.153+0000 7f0fee604640 1 -- 172.21.15.170:0/512257330 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10f4068660 con 0x55a6ca6234a0 2024-09-12T17:28:01.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.153+0000 7f0fee604640 1 -- 172.21.15.170:0/512257330 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10f4068800 con 0x55a6ca6234a0 2024-09-12T17:28:01.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.153+0000 7f0fee604640 1 -- 172.21.15.170:0/512257330 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10f4068ae0 con 0x55a6ca6234a0 2024-09-12T17:28:01.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.153+0000 7f1105b33800 1 -- 172.21.15.170:0/512257330 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a6ca71e930 con 0x55a6ca6234a0 2024-09-12T17:28:01.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.154+0000 7f1105b33800 1 -- 172.21.15.170:0/512257330 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6ca71f540 con 0x55a6ca6234a0 2024-09-12T17:28:01.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.154+0000 7f0fee604640 1 -- 172.21.15.170:0/512257330 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f10f4068c80 con 0x55a6ca6234a0 2024-09-12T17:28:01.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.154+0000 7f0fee604640 1 --2- 172.21.15.170:0/512257330 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0fe803c780 0x7f0fe803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.154+0000 7f0fee604640 1 -- 172.21.15.170:0/512257330 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f10f4098100 con 0x55a6ca6234a0 2024-09-12T17:28:01.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.155+0000 7f10fbfff640 1 --2- 172.21.15.170:0/512257330 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0fe803c780 0x7f0fe803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.155+0000 7f1105b33800 1 --2- 172.21.15.170:0/512257330 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a6ca623de0 0x55a6ca725790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.155+0000 7f1105b33800 1 -- 172.21.15.170:0/512257330 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca725cd0 con 0x55a6ca623de0 2024-09-12T17:28:01.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.155+0000 7f1102077640 1 --2- 172.21.15.170:0/512257330 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a6ca623de0 0x55a6ca725790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.155+0000 7f10fbfff640 1 --2- 172.21.15.170:0/512257330 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0fe803c780 0x7f0fe803ec40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f10ec001d70 tx=0x7f10ec0012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.155+0000 7f1102077640 1 --2- 172.21.15.170:0/512257330 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a6ca623de0 0x55a6ca725790 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.155+0000 7f1102077640 1 -- 172.21.15.170:0/512257330 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f10fc00a4d0 con 0x55a6ca623de0 2024-09-12T17:28:01.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.155+0000 7f1105b33800 1 -- 172.21.15.170:0/512257330 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca726070 con 0x55a6ca623de0 2024-09-12T17:28:01.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.156+0000 7f1102077640 1 -- 172.21.15.170:0/512257330 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f10fc00a4d0 con 0x55a6ca623de0 2024-09-12T17:28:01.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.156+0000 7f1105b33800 1 --2- 172.21.15.170:0/512257330 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a6ca727af0 0x55a6ca729f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.156+0000 7f1105b33800 1 -- 172.21.15.170:0/512257330 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca72a720 con 0x55a6ca727af0 2024-09-12T17:28:01.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.156+0000 7f1101876640 1 --2- 172.21.15.170:0/512257330 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a6ca727af0 0x55a6ca729f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.156+0000 7f1101876640 1 --2- 172.21.15.170:0/512257330 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a6ca727af0 0x55a6ca729f90 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.156+0000 7f1101876640 1 -- 172.21.15.170:0/512257330 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f10f4051070 con 0x55a6ca727af0 2024-09-12T17:28:01.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.156+0000 7f1105b33800 1 -- 172.21.15.170:0/512257330 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca7268c0 con 0x55a6ca623de0 2024-09-12T17:28:01.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.157+0000 7f1102077640 1 -- 172.21.15.170:0/512257330 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f10fc00a4d0 con 0x55a6ca623de0 2024-09-12T17:28:01.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.157+0000 7f1105b33800 1 -- 172.21.15.170:0/512257330 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca726ca0 con 0x55a6ca727af0 2024-09-12T17:28:01.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.157+0000 7f1101876640 1 -- 172.21.15.170:0/512257330 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f10f4051070 con 0x55a6ca727af0 2024-09-12T17:28:01.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.157+0000 7f1105b33800 1 Processor -- start 2024-09-12T17:28:01.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.157+0000 7f1105b33800 1 -- start start 2024-09-12T17:28:01.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.157+0000 7f1105b33800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a6ca738f50 0x55a6ca739370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.157+0000 7f1105b33800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a6ca51ba00 con 0x55a6ca738f50 2024-09-12T17:28:01.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.158+0000 7f1102077640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a6ca738f50 0x55a6ca739370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.158+0000 7f1102077640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a6ca738f50 0x55a6ca739370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57226/0 (socket says 172.21.15.170:57226) 2024-09-12T17:28:01.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.158+0000 7f1102077640 1 -- 172.21.15.170:0/650565036 learned_addr learned my addr 172.21.15.170:0/650565036 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:01.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.158+0000 7f1102077640 1 -- 172.21.15.170:0/650565036 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6ca7399b0 con 0x55a6ca738f50 2024-09-12T17:28:01.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.158+0000 7f1102077640 1 --2- 172.21.15.170:0/650565036 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a6ca738f50 0x55a6ca739370 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x55a6ca71f140 tx=0x7f10fc0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.158+0000 7f0fe77fe640 1 -- 172.21.15.170:0/650565036 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10fc013640 con 0x55a6ca738f50 2024-09-12T17:28:01.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.158+0000 7f0fe77fe640 1 -- 172.21.15.170:0/650565036 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10fc0137e0 con 0x55a6ca738f50 2024-09-12T17:28:01.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.158+0000 7f1105b33800 1 -- 172.21.15.170:0/650565036 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a6ca73a1e0 con 0x55a6ca738f50 2024-09-12T17:28:01.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.158+0000 7f0fe77fe640 1 -- 172.21.15.170:0/650565036 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10fc013ae0 con 0x55a6ca738f50 2024-09-12T17:28:01.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.159+0000 7f1105b33800 1 -- 172.21.15.170:0/650565036 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6ca73a780 con 0x55a6ca738f50 2024-09-12T17:28:01.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.159+0000 7f0fe77fe640 1 -- 172.21.15.170:0/650565036 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f10fc011040 con 0x55a6ca738f50 2024-09-12T17:28:01.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.159+0000 7f0fe77fe640 1 --2- 172.21.15.170:0/650565036 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0fdc03c780 0x7f0fdc03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.159+0000 7f0fe77fe640 1 -- 172.21.15.170:0/650565036 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f10fc00e040 con 0x55a6ca738f50 2024-09-12T17:28:01.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.160+0000 7f1101876640 1 --2- 172.21.15.170:0/650565036 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0fdc03c780 0x7f0fdc03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.160+0000 7f1105b33800 1 Processor -- start 2024-09-12T17:28:01.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.160+0000 7f1105b33800 1 -- start start 2024-09-12T17:28:01.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.160+0000 7f1101876640 1 --2- 172.21.15.170:0/650565036 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0fdc03c780 0x7f0fdc03ec40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x55a6ca720200 tx=0x7f10f405d5c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.160+0000 7f1105b33800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a6ca745a30 0x55a6ca745e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.160+0000 7f1105b33800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a6ca717000 con 0x55a6ca745a30 2024-09-12T17:28:01.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.160+0000 7f1102077640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a6ca745a30 0x55a6ca745e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.160+0000 7f1102077640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a6ca745a30 0x55a6ca745e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57240/0 (socket says 172.21.15.170:57240) 2024-09-12T17:28:01.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.160+0000 7f1102077640 1 -- 172.21.15.170:0/218982038 learned_addr learned my addr 172.21.15.170:0/218982038 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:01.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.161+0000 7f1102077640 1 -- 172.21.15.170:0/218982038 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6ca746420 con 0x55a6ca745a30 2024-09-12T17:28:01.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.161+0000 7f1102077640 1 --2- 172.21.15.170:0/218982038 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a6ca745a30 0x55a6ca745e30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f10fc016cd0 tx=0x7f10fc0203a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a21d836376c65718 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.161+0000 7f0fe57fa640 1 -- 172.21.15.170:0/218982038 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10fc04a070 con 0x55a6ca745a30 2024-09-12T17:28:01.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.161+0000 7f0fe57fa640 1 -- 172.21.15.170:0/218982038 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10fc055040 con 0x55a6ca745a30 2024-09-12T17:28:01.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.161+0000 7f0fe57fa640 1 -- 172.21.15.170:0/218982038 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10fc052070 con 0x55a6ca745a30 2024-09-12T17:28:01.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.161+0000 7f1105b33800 1 -- 172.21.15.170:0/218982038 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a6ca745a30 msgr2=0x55a6ca745e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.161+0000 7f1105b33800 1 --2- 172.21.15.170:0/218982038 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a6ca745a30 0x55a6ca745e30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f10fc016cd0 tx=0x7f10fc0203a0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.161+0000 7f1105b33800 1 -- 172.21.15.170:0/218982038 shutdown_connections 2024-09-12T17:28:01.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.161+0000 7f1105b33800 1 --2- 172.21.15.170:0/218982038 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a6ca745a30 0x55a6ca745e30 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.161+0000 7f1105b33800 1 -- 172.21.15.170:0/218982038 >> 172.21.15.170:0/218982038 conn(0x55a6ca741e30 msgr2=0x55a6ca740070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:01.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.161+0000 7f1105b33800 1 -- 172.21.15.170:0/218982038 shutdown_connections 2024-09-12T17:28:01.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.161+0000 7f1105b33800 1 -- 172.21.15.170:0/218982038 wait complete. 2024-09-12T17:28:01.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.162+0000 7f1105b33800 1 Processor -- start 2024-09-12T17:28:01.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.162+0000 7f1105b33800 1 -- start start 2024-09-12T17:28:01.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.162+0000 7f1105b33800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a6ca745a30 0x55a6ca74d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.162+0000 7f1105b33800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a6ca746a40 con 0x55a6ca745a30 2024-09-12T17:28:01.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.162+0000 7f1102077640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a6ca745a30 0x55a6ca74d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.162+0000 7f1102077640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a6ca745a30 0x55a6ca74d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57246/0 (socket says 172.21.15.170:57246) 2024-09-12T17:28:01.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.162+0000 7f1102077640 1 -- 172.21.15.170:0/1336399890 learned_addr learned my addr 172.21.15.170:0/1336399890 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:01.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.162+0000 7f1102077640 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6ca74d5a0 con 0x55a6ca745a30 2024-09-12T17:28:01.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.162+0000 7f1102077640 1 --2- 172.21.15.170:0/1336399890 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a6ca745a30 0x55a6ca74d040 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f10fc0203e0 tx=0x7f10fc053d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.163+0000 7f0fd37fe640 1 -- 172.21.15.170:0/1336399890 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10fc04a040 con 0x55a6ca745a30 2024-09-12T17:28:01.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.163+0000 7f0fd37fe640 1 -- 172.21.15.170:0/1336399890 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10fc021910 con 0x55a6ca745a30 2024-09-12T17:28:01.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.163+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a6ca74d830 con 0x55a6ca745a30 2024-09-12T17:28:01.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.163+0000 7f0fd37fe640 1 -- 172.21.15.170:0/1336399890 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10fc052040 con 0x55a6ca745a30 2024-09-12T17:28:01.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.163+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6ca74e1b0 con 0x55a6ca745a30 2024-09-12T17:28:01.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.163+0000 7f0fd37fe640 1 -- 172.21.15.170:0/1336399890 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f10fc01f340 con 0x55a6ca745a30 2024-09-12T17:28:01.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.164+0000 7f0fd37fe640 1 --2- 172.21.15.170:0/1336399890 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0fcc03c780 0x7f0fcc03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.164+0000 7f0fd37fe640 1 -- 172.21.15.170:0/1336399890 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f10fc017650 con 0x55a6ca745a30 2024-09-12T17:28:01.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.164+0000 7f1101876640 1 --2- 172.21.15.170:0/1336399890 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0fcc03c780 0x7f0fcc03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.164+0000 7f1105b33800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.164+0000 7f1105b33800 1 --2- 172.21.15.170:0/1336399890 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a6ca758930 0x55a6ca75adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.164+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca75b540 con 0x55a6ca758930 2024-09-12T17:28:01.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.164+0000 7f10fbfff640 1 --2- 172.21.15.170:0/1336399890 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a6ca758930 0x55a6ca75adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.164+0000 7f1101876640 1 --2- 172.21.15.170:0/1336399890 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0fcc03c780 0x7f0fcc03ec40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f10f4098070 tx=0x7f10f4088000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.164+0000 7f10fbfff640 1 --2- 172.21.15.170:0/1336399890 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a6ca758930 0x55a6ca75adf0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.165+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f10ec009050 con 0x55a6ca758930 2024-09-12T17:28:01.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.165+0000 7f1105b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.165+0000 7f1105b33800 20 realm 2024-09-12T17:28:01.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.165+0000 7f1105b33800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.165+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca757cc0 con 0x55a6ca758930 2024-09-12T17:28:01.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.165+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f10ec009050 con 0x55a6ca758930 2024-09-12T17:28:01.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.165+0000 7f1105b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.165+0000 7f1105b33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:01.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.165+0000 7f1105b33800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.165+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca75c020 con 0x55a6ca758930 2024-09-12T17:28:01.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.165+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f10ec009050 con 0x55a6ca758930 2024-09-12T17:28:01.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.165+0000 7f1105b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.165+0000 7f1105b33800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.165+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca75c8f0 con 0x55a6ca758930 2024-09-12T17:28:01.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.165+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f10ec009050 con 0x55a6ca758930 2024-09-12T17:28:01.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.165+0000 7f1105b33800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:01.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.165+0000 7f1105b33800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.165+0000 7f1105b33800 1 --2- 172.21.15.170:0/1336399890 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a6ca75d230 0x55a6ca75f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.165+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca75fd60 con 0x55a6ca75d230 2024-09-12T17:28:01.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.165+0000 7f1102077640 1 --2- 172.21.15.170:0/1336399890 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a6ca75d230 0x55a6ca75f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.166+0000 7f1102077640 1 --2- 172.21.15.170:0/1336399890 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a6ca75d230 0x55a6ca75f620 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.166+0000 7f1102077640 1 -- 172.21.15.170:0/1336399890 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f10fc032070 con 0x55a6ca75d230 2024-09-12T17:28:01.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.166+0000 7f1105b33800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:01.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.166+0000 7f1105b33800 20 searching for the correct realm 2024-09-12T17:28:01.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.166+0000 7f1105b33800 1 --2- 172.21.15.170:0/1336399890 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55a6ca761de0 0x55a6ca7642a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.166+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca764970 con 0x55a6ca761de0 2024-09-12T17:28:01.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.166+0000 7f1101876640 1 --2- 172.21.15.170:0/1336399890 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55a6ca761de0 0x55a6ca7642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.166+0000 7f1101876640 1 --2- 172.21.15.170:0/1336399890 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55a6ca761de0 0x55a6ca7642a0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.167+0000 7f1101876640 1 -- 172.21.15.170:0/1336399890 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10f4051070 con 0x55a6ca761de0 2024-09-12T17:28:01.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.167+0000 7f1101876640 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca764970 con 0x55a6ca75d230 2024-09-12T17:28:01.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.167+0000 7f1102077640 1 -- 172.21.15.170:0/1336399890 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10fc032070 con 0x55a6ca75d230 2024-09-12T17:28:01.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.167+0000 7f1102077640 1 --2- 172.21.15.170:0/1336399890 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f10fc04e410 0x7f10fc056940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.167+0000 7f1102077640 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca764970 con 0x7f10fc04e410 2024-09-12T17:28:01.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.167+0000 7f10fbfff640 1 --2- 172.21.15.170:0/1336399890 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f10fc04e410 0x7f10fc056940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.167+0000 7f10fbfff640 1 --2- 172.21.15.170:0/1336399890 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f10fc04e410 0x7f10fc056940 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.168+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10ec009050 con 0x7f10fc04e410 2024-09-12T17:28:01.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.168+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca764970 con 0x55a6ca758930 2024-09-12T17:28:01.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.168+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10ec009050 con 0x55a6ca758930 2024-09-12T17:28:01.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.168+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca764970 con 0x55a6ca758930 2024-09-12T17:28:01.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.168+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10ec029040 con 0x55a6ca758930 2024-09-12T17:28:01.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.168+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca764970 con 0x7f10fc04e410 2024-09-12T17:28:01.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.168+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10ec029040 con 0x7f10fc04e410 2024-09-12T17:28:01.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.168+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca764970 con 0x7f10fc04e410 2024-09-12T17:28:01.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.169+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10ec029040 con 0x7f10fc04e410 2024-09-12T17:28:01.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.169+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca764970 con 0x55a6ca75d230 2024-09-12T17:28:01.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.169+0000 7f1102077640 1 -- 172.21.15.170:0/1336399890 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10fc032070 con 0x55a6ca75d230 2024-09-12T17:28:01.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.169+0000 7f1102077640 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca764970 con 0x55a6ca761de0 2024-09-12T17:28:01.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.169+0000 7f1101876640 1 -- 172.21.15.170:0/1336399890 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10f4051070 con 0x55a6ca761de0 2024-09-12T17:28:01.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.169+0000 7f1101876640 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca764970 con 0x55a6ca758930 2024-09-12T17:28:01.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.169+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10ec029040 con 0x55a6ca758930 2024-09-12T17:28:01.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.169+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca764970 con 0x7f10fc04e410 2024-09-12T17:28:01.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.170+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10ec029040 con 0x7f10fc04e410 2024-09-12T17:28:01.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.170+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca764970 con 0x55a6ca758930 2024-09-12T17:28:01.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.170+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10ec029040 con 0x55a6ca758930 2024-09-12T17:28:01.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.170+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca764970 con 0x55a6ca75d230 2024-09-12T17:28:01.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.170+0000 7f1102077640 1 -- 172.21.15.170:0/1336399890 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f10fc032070 con 0x55a6ca75d230 2024-09-12T17:28:01.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.170+0000 7f1102077640 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca764970 con 0x55a6ca761de0 2024-09-12T17:28:01.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.170+0000 7f1101876640 1 -- 172.21.15.170:0/1336399890 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10f4051070 con 0x55a6ca761de0 2024-09-12T17:28:01.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.170+0000 7f1101876640 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca764970 con 0x55a6ca761de0 2024-09-12T17:28:01.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.170+0000 7f1101876640 1 -- 172.21.15.170:0/1336399890 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10f4051070 con 0x55a6ca761de0 2024-09-12T17:28:01.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.171+0000 7f1101876640 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca764970 con 0x7f10fc04e410 2024-09-12T17:28:01.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.171+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10ec029040 con 0x7f10fc04e410 2024-09-12T17:28:01.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.171+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca764970 con 0x55a6ca761de0 2024-09-12T17:28:01.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.171+0000 7f1101876640 1 -- 172.21.15.170:0/1336399890 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10f4051070 con 0x55a6ca761de0 2024-09-12T17:28:01.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.171+0000 7f1101876640 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca764970 con 0x55a6ca761de0 2024-09-12T17:28:01.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.171+0000 7f1101876640 1 -- 172.21.15.170:0/1336399890 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10f4051070 con 0x55a6ca761de0 2024-09-12T17:28:01.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.171+0000 7f1101876640 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca764970 con 0x55a6ca758930 2024-09-12T17:28:01.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.171+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10ec029040 con 0x55a6ca758930 2024-09-12T17:28:01.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.171+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca764970 con 0x55a6ca758930 2024-09-12T17:28:01.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.172+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f10ec029040 con 0x55a6ca758930 2024-09-12T17:28:01.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.172+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca764970 con 0x7f10fc04e410 2024-09-12T17:28:01.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.172+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10ec029040 con 0x7f10fc04e410 2024-09-12T17:28:01.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.172+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca764970 con 0x55a6ca761de0 2024-09-12T17:28:01.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.172+0000 7f1101876640 1 -- 172.21.15.170:0/1336399890 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10f4051070 con 0x55a6ca761de0 2024-09-12T17:28:01.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.172+0000 7f1101876640 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca764970 con 0x55a6ca75d230 2024-09-12T17:28:01.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.172+0000 7f1102077640 1 -- 172.21.15.170:0/1336399890 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10fc032070 con 0x55a6ca75d230 2024-09-12T17:28:01.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.172+0000 7f1102077640 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca764970 con 0x55a6ca758930 2024-09-12T17:28:01.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.173+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10ec029040 con 0x55a6ca758930 2024-09-12T17:28:01.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.173+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca764970 con 0x7f10fc04e410 2024-09-12T17:28:01.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.173+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10ec029040 con 0x7f10fc04e410 2024-09-12T17:28:01.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.173+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca764970 con 0x55a6ca761de0 2024-09-12T17:28:01.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.173+0000 7f1101876640 1 -- 172.21.15.170:0/1336399890 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10f4051070 con 0x55a6ca761de0 2024-09-12T17:28:01.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.173+0000 7f1101876640 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca764970 con 0x7f10fc04e410 2024-09-12T17:28:01.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.173+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10ec029040 con 0x7f10fc04e410 2024-09-12T17:28:01.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.173+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca764970 con 0x55a6ca75d230 2024-09-12T17:28:01.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.174+0000 7f1102077640 1 -- 172.21.15.170:0/1336399890 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10fc032070 con 0x55a6ca75d230 2024-09-12T17:28:01.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.174+0000 7f1102077640 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca764970 con 0x55a6ca761de0 2024-09-12T17:28:01.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.174+0000 7f1101876640 1 -- 172.21.15.170:0/1336399890 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10f4051070 con 0x55a6ca761de0 2024-09-12T17:28:01.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.174+0000 7f1101876640 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca764970 con 0x7f10fc04e410 2024-09-12T17:28:01.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.174+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10ec029040 con 0x7f10fc04e410 2024-09-12T17:28:01.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.174+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca764970 con 0x55a6ca758930 2024-09-12T17:28:01.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.174+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f10ec029040 con 0x55a6ca758930 2024-09-12T17:28:01.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.174+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca764970 con 0x55a6ca75d230 2024-09-12T17:28:01.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.175+0000 7f1102077640 1 -- 172.21.15.170:0/1336399890 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f10fc068040 con 0x55a6ca75d230 2024-09-12T17:28:01.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.175+0000 7f1105b33800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:01.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.175+0000 7f1105b33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:01.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.175+0000 7f1105b33800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:01.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.175+0000 7f1105b33800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:01.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.175+0000 7f1105b33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:01.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.175+0000 7f1105b33800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:01.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.175+0000 7f1105b33800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.175+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca7607e0 con 0x55a6ca758930 2024-09-12T17:28:01.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.175+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f10ec029040 con 0x55a6ca758930 2024-09-12T17:28:01.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.175+0000 7f1105b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.175+0000 7f1105b33800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.175+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca760c00 con 0x55a6ca758930 2024-09-12T17:28:01.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.175+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f10ec029040 con 0x55a6ca758930 2024-09-12T17:28:01.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.175+0000 7f1105b33800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:01.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.175+0000 7f1105b33800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.175+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca7610e0 con 0x55a6ca75d230 2024-09-12T17:28:01.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.176+0000 7f1102077640 1 -- 172.21.15.170:0/1336399890 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f10fc068040 con 0x55a6ca75d230 2024-09-12T17:28:01.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.176+0000 7f1105b33800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:01.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.176+0000 7f1105b33800 20 zone default found 2024-09-12T17:28:01.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.176+0000 7f1105b33800 4 Realm: () 2024-09-12T17:28:01.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.176+0000 7f1105b33800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:01.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.176+0000 7f1105b33800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:01.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.176+0000 7f1105b33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:01.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.176+0000 7f1105b33800 20 zonegroup default 2024-09-12T17:28:01.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.176+0000 7f1105b33800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.176+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca760370 con 0x7f10fc04e410 2024-09-12T17:28:01.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.176+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f10ec029040 con 0x7f10fc04e410 2024-09-12T17:28:01.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.176+0000 7f1105b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.176+0000 7f1105b33800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.176+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca767020 con 0x55a6ca761de0 2024-09-12T17:28:01.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.176+0000 7f1101876640 1 -- 172.21.15.170:0/1336399890 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f10f4051070 con 0x55a6ca761de0 2024-09-12T17:28:01.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.176+0000 7f1105b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.176+0000 7f1105b33800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.176+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca7674b0 con 0x55a6ca761de0 2024-09-12T17:28:01.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.177+0000 7f1101876640 1 -- 172.21.15.170:0/1336399890 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f10f4051070 con 0x55a6ca761de0 2024-09-12T17:28:01.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.177+0000 7f1105b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.177+0000 7f1105b33800 20 started sync module instance, tier type = 2024-09-12T17:28:01.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.177+0000 7f1105b33800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:01.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.177+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca765e20 con 0x55a6ca75d230 2024-09-12T17:28:01.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.178+0000 7f1102077640 1 -- 172.21.15.170:0/1336399890 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10fc068040 con 0x55a6ca75d230 2024-09-12T17:28:01.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.178+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94174849688080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca767dc0 con 0x55a6ca75d230 2024-09-12T17:28:01.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.178+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca768610 con 0x55a6ca758930 2024-09-12T17:28:01.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.179+0000 7f1102077640 1 -- 172.21.15.170:0/1336399890 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94174849688080] v29'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10fc068040 con 0x55a6ca75d230 2024-09-12T17:28:01.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.179+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10ec029040 con 0x55a6ca758930 2024-09-12T17:28:01.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.179+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94174849694240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca768370 con 0x55a6ca758930 2024-09-12T17:28:01.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.179+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca768e70 con 0x55a6ca761de0 2024-09-12T17:28:01.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.180+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94174849694240] v29'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10ec029040 con 0x55a6ca758930 2024-09-12T17:28:01.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.180+0000 7f1101876640 1 -- 172.21.15.170:0/1336399890 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10f4051070 con 0x55a6ca761de0 2024-09-12T17:28:01.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.180+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94174849698144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca768e30 con 0x55a6ca761de0 2024-09-12T17:28:01.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.180+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca7698f0 con 0x55a6ca75d230 2024-09-12T17:28:01.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.181+0000 7f1101876640 1 -- 172.21.15.170:0/1336399890 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94174849698144] v29'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10f4051070 con 0x55a6ca761de0 2024-09-12T17:28:01.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.181+0000 7f1102077640 1 -- 172.21.15.170:0/1336399890 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10fc068040 con 0x55a6ca75d230 2024-09-12T17:28:01.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.181+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94174849700864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca7698f0 con 0x55a6ca75d230 2024-09-12T17:28:01.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.181+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca76a3d0 con 0x55a6ca758930 2024-09-12T17:28:01.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.182+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10ec029040 con 0x55a6ca758930 2024-09-12T17:28:01.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.182+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94174849703600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca76a3d0 con 0x55a6ca758930 2024-09-12T17:28:01.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.183+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca76b380 con 0x7f10fc04e410 2024-09-12T17:28:01.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.183+0000 7f1102077640 1 -- 172.21.15.170:0/1336399890 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94174849700864] v29'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10fc068040 con 0x55a6ca75d230 2024-09-12T17:28:01.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.184+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94174849703600] v29'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10ec029040 con 0x55a6ca758930 2024-09-12T17:28:01.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.184+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10ec029040 con 0x7f10fc04e410 2024-09-12T17:28:01.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.184+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94174849695296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca76b380 con 0x7f10fc04e410 2024-09-12T17:28:01.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.184+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca76a880 con 0x7f10fc04e410 2024-09-12T17:28:01.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.185+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94174849695296] v29'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10ec029040 con 0x7f10fc04e410 2024-09-12T17:28:01.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.185+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(56 notify.6 [create] v29'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10ec029040 con 0x7f10fc04e410 2024-09-12T17:28:01.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.185+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94174849706048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca76b770 con 0x7f10fc04e410 2024-09-12T17:28:01.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.185+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca76c1e0 con 0x7f10fc04e410 2024-09-12T17:28:01.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.186+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94174849706048] v29'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10ec029040 con 0x7f10fc04e410 2024-09-12T17:28:01.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.186+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(58 notify.7 [create] v29'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10ec029040 con 0x7f10fc04e410 2024-09-12T17:28:01.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.186+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94174849711280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca76c1a0 con 0x7f10fc04e410 2024-09-12T17:28:01.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.186+0000 7f1105b33800 20 add_watcher() i=0 2024-09-12T17:28:01.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.186+0000 7f1105b33800 20 add_watcher() i=1 2024-09-12T17:28:01.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.186+0000 7f1105b33800 20 add_watcher() i=2 2024-09-12T17:28:01.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.186+0000 7f1105b33800 20 add_watcher() i=3 2024-09-12T17:28:01.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.186+0000 7f1105b33800 20 add_watcher() i=4 2024-09-12T17:28:01.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.186+0000 7f1105b33800 20 add_watcher() i=5 2024-09-12T17:28:01.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.186+0000 7f1105b33800 20 add_watcher() i=6 2024-09-12T17:28:01.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.187+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94174849711280] v29'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10ec029040 con 0x7f10fc04e410 2024-09-12T17:28:01.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.187+0000 7f1105b33800 20 add_watcher() i=7 2024-09-12T17:28:01.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.187+0000 7f1105b33800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:01.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.187+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca76f600 con 0x55a6ca758930 2024-09-12T17:28:01.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.187+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f10ec029040 con 0x55a6ca758930 2024-09-12T17:28:01.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.187+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94174849707616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca76cb90 con 0x55a6ca758930 2024-09-12T17:28:01.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.188+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94174849707616] v29'76 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f10ec029040 con 0x55a6ca758930 2024-09-12T17:28:01.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.188+0000 7f0fb37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:01.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.188+0000 7f1105b33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:01.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.188+0000 7f1105b33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:01.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.188+0000 7f1105b33800 5 note: GC not initialized 2024-09-12T17:28:01.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.188+0000 7f0fb27fc640 20 reqs_thread_entry: start 2024-09-12T17:28:01.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.188+0000 7f1105b33800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:01.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.189+0000 7f1105b33800 20 Filter name: none 2024-09-12T17:28:01.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.189+0000 7f0f23fff640 20 reqs_thread_entry: start 2024-09-12T17:28:01.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.189+0000 7f1105b33800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.189+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca7a2220 con 0x55a6ca758930 2024-09-12T17:28:01.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.189+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f10ec029040 con 0x55a6ca758930 2024-09-12T17:28:01.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.189+0000 7f1105b33800 20 rados_obj.operate() r=0 bl.length=556 2024-09-12T17:28:01.201 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T17:27:59.362376Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:27:59.362351Z","tags":[],"group_ids":[]} 2024-09-12T17:28:01.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.190+0000 7f0fb37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:01.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.190+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94174849707616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca7a0d10 con 0x55a6ca758930 2024-09-12T17:28:01.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.191+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94174849707616] v29'77 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f10ec029040 con 0x55a6ca758930 2024-09-12T17:28:01.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.191+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94174849688080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca7a0140 con 0x55a6ca75d230 2024-09-12T17:28:01.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.192+0000 7f1102077640 1 -- 172.21.15.170:0/1336399890 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94174849688080] v29'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10fc068040 con 0x55a6ca75d230 2024-09-12T17:28:01.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.192+0000 7f1105b33800 20 remove_watcher() i=0 2024-09-12T17:28:01.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.192+0000 7f1105b33800 2 removed watcher, disabling cache 2024-09-12T17:28:01.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.192+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94174849694240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca7a0140 con 0x55a6ca758930 2024-09-12T17:28:01.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.193+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94174849694240] v29'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10ec029040 con 0x55a6ca758930 2024-09-12T17:28:01.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.193+0000 7f1105b33800 20 remove_watcher() i=1 2024-09-12T17:28:01.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.193+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94174849698144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca7a0140 con 0x55a6ca761de0 2024-09-12T17:28:01.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.194+0000 7f1101876640 1 -- 172.21.15.170:0/1336399890 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94174849698144] v29'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10f4051070 con 0x55a6ca761de0 2024-09-12T17:28:01.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.194+0000 7f1105b33800 20 remove_watcher() i=2 2024-09-12T17:28:01.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.194+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94174849700864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca7a0140 con 0x55a6ca75d230 2024-09-12T17:28:01.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.195+0000 7f1102077640 1 -- 172.21.15.170:0/1336399890 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94174849700864] v29'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10fc068040 con 0x55a6ca75d230 2024-09-12T17:28:01.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.195+0000 7f1105b33800 20 remove_watcher() i=3 2024-09-12T17:28:01.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.195+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94174849703600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca7a0140 con 0x55a6ca758930 2024-09-12T17:28:01.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.196+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94174849703600] v29'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10ec029040 con 0x55a6ca758930 2024-09-12T17:28:01.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.196+0000 7f1105b33800 20 remove_watcher() i=4 2024-09-12T17:28:01.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.196+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94174849695296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca7a0140 con 0x7f10fc04e410 2024-09-12T17:28:01.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.197+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94174849695296] v29'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10ec029040 con 0x7f10fc04e410 2024-09-12T17:28:01.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.197+0000 7f1105b33800 20 remove_watcher() i=5 2024-09-12T17:28:01.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.197+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94174849706048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca7a0140 con 0x7f10fc04e410 2024-09-12T17:28:01.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.198+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94174849706048] v29'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10ec029040 con 0x7f10fc04e410 2024-09-12T17:28:01.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.198+0000 7f1105b33800 20 remove_watcher() i=6 2024-09-12T17:28:01.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.198+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94174849711280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a6ca7a0140 con 0x7f10fc04e410 2024-09-12T17:28:01.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.199+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94174849711280] v29'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10ec029040 con 0x7f10fc04e410 2024-09-12T17:28:01.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.199+0000 7f1105b33800 20 remove_watcher() i=7 2024-09-12T17:28:01.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.199+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f10fc04e410 msgr2=0x7f10fc056940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.199+0000 7f1105b33800 1 --2- 172.21.15.170:0/1336399890 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f10fc04e410 0x7f10fc056940 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.199+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a6ca758930 msgr2=0x55a6ca75adf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.199+0000 7f1105b33800 1 --2- 172.21.15.170:0/1336399890 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a6ca758930 0x55a6ca75adf0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.199+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a6ca75d230 msgr2=0x55a6ca75f620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.199+0000 7f1105b33800 1 --2- 172.21.15.170:0/1336399890 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a6ca75d230 0x55a6ca75f620 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.199+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55a6ca761de0 msgr2=0x55a6ca7642a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.199+0000 7f1105b33800 1 --2- 172.21.15.170:0/1336399890 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55a6ca761de0 0x55a6ca7642a0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.199+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0fcc03c780 msgr2=0x7f0fcc03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.199+0000 7f1105b33800 1 --2- 172.21.15.170:0/1336399890 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0fcc03c780 0x7f0fcc03ec40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f10f4098070 tx=0x7f10f4088000 comp rx=0 tx=0).stop 2024-09-12T17:28:01.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.199+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a6ca745a30 msgr2=0x55a6ca74d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.199+0000 7f1105b33800 1 --2- 172.21.15.170:0/1336399890 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a6ca745a30 0x55a6ca74d040 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f10fc0203e0 tx=0x7f10fc053d00 comp rx=0 tx=0).stop 2024-09-12T17:28:01.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.199+0000 7f10fbfff640 1 -- 172.21.15.170:0/1336399890 reap_dead start 2024-09-12T17:28:01.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.199+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 shutdown_connections 2024-09-12T17:28:01.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.199+0000 7f1105b33800 1 --2- 172.21.15.170:0/1336399890 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a6ca745a30 0x55a6ca74d040 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.199+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 >> 172.21.15.170:0/1336399890 conn(0x55a6ca741e30 msgr2=0x55a6ca740040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:01.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.199+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 shutdown_connections 2024-09-12T17:28:01.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.199+0000 7f1105b33800 1 -- 172.21.15.170:0/1336399890 wait complete. 2024-09-12T17:28:01.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.199+0000 7f1105b33800 1 -- 172.21.15.170:0/650565036 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0fdc03c780 msgr2=0x7f0fdc03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.199+0000 7f1105b33800 1 --2- 172.21.15.170:0/650565036 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0fdc03c780 0x7f0fdc03ec40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x55a6ca720200 tx=0x7f10f405d5c0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.199+0000 7f1105b33800 1 -- 172.21.15.170:0/650565036 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a6ca738f50 msgr2=0x55a6ca739370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.199+0000 7f1105b33800 1 --2- 172.21.15.170:0/650565036 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a6ca738f50 0x55a6ca739370 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x55a6ca71f140 tx=0x7f10fc0167b0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.200+0000 7f1105b33800 1 -- 172.21.15.170:0/650565036 shutdown_connections 2024-09-12T17:28:01.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.200+0000 7f1105b33800 1 --2- 172.21.15.170:0/650565036 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0fdc03c780 0x7f0fdc03ec40 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.200+0000 7f1105b33800 1 --2- 172.21.15.170:0/650565036 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a6ca738f50 0x55a6ca739370 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.200+0000 7f1105b33800 1 -- 172.21.15.170:0/650565036 >> 172.21.15.170:0/650565036 conn(0x55a6ca72d300 msgr2=0x55a6ca72d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:01.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.200+0000 7f1105b33800 1 -- 172.21.15.170:0/650565036 shutdown_connections 2024-09-12T17:28:01.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.200+0000 7f1105b33800 1 -- 172.21.15.170:0/650565036 wait complete. 2024-09-12T17:28:01.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.200+0000 7f1105b33800 1 -- 172.21.15.170:0/512257330 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a6ca623de0 msgr2=0x55a6ca725790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.200+0000 7f1105b33800 1 --2- 172.21.15.170:0/512257330 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a6ca623de0 0x55a6ca725790 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.200+0000 7f1105b33800 1 -- 172.21.15.170:0/512257330 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a6ca727af0 msgr2=0x55a6ca729f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.200+0000 7f1105b33800 1 --2- 172.21.15.170:0/512257330 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a6ca727af0 0x55a6ca729f90 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.200+0000 7f1105b33800 1 -- 172.21.15.170:0/512257330 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0fe803c780 msgr2=0x7f0fe803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.200+0000 7f1105b33800 1 --2- 172.21.15.170:0/512257330 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0fe803c780 0x7f0fe803ec40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f10ec001d70 tx=0x7f10ec0012d0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.200+0000 7f1105b33800 1 -- 172.21.15.170:0/512257330 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a6ca6234a0 msgr2=0x55a6ca71e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.200+0000 7f1105b33800 1 --2- 172.21.15.170:0/512257330 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a6ca6234a0 0x55a6ca71e140 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f10f4025c20 tx=0x7f10f4002fb0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.200+0000 7f1105b33800 1 -- 172.21.15.170:0/512257330 shutdown_connections 2024-09-12T17:28:01.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.200+0000 7f1105b33800 1 --2- 172.21.15.170:0/512257330 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a6ca727af0 0x55a6ca729f90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.200+0000 7f1105b33800 1 --2- 172.21.15.170:0/512257330 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f0fe803c780 0x7f0fe803ec40 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.200+0000 7f1105b33800 1 --2- 172.21.15.170:0/512257330 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a6ca623de0 0x55a6ca725790 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.200+0000 7f1105b33800 1 --2- 172.21.15.170:0/512257330 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a6ca6234a0 0x55a6ca71e140 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.200+0000 7f1105b33800 1 -- 172.21.15.170:0/512257330 >> 172.21.15.170:0/512257330 conn(0x55a6ca61f1f0 msgr2=0x55a6ca710980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:01.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.200+0000 7f1105b33800 1 -- 172.21.15.170:0/512257330 shutdown_connections 2024-09-12T17:28:01.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.200+0000 7f1105b33800 1 -- 172.21.15.170:0/512257330 wait complete. 2024-09-12T17:28:01.213 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T17:27:59.362376Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:27:59.362351Z', 'tags': [], 'group_ids': []} 2024-09-12T17:28:01.213 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-12T17:28:01.213 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-12T17:28:01.213 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-09-12T17:28:01.261 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:01.261 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:01.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.260+0000 7f99558bb800 1 Processor -- start 2024-09-12T17:28:01.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.260+0000 7f99558bb800 1 -- start start 2024-09-12T17:28:01.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.260+0000 7f99558bb800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x557d08431220 0x557d084336e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.260+0000 7f99558bb800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557d082d6e40 con 0x557d0842d6b0 2024-09-12T17:28:01.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.260+0000 7f99558bb800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x557d082a1680 con 0x557d08431220 2024-09-12T17:28:01.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.260+0000 7f994bfff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x557d08431220 0x557d084336e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.261+0000 7f99533a5640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x557d0842d6b0 0x557d0842faa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:48354/0 (socket says 172.21.15.170:48354) 2024-09-12T17:28:01.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.261+0000 7f99533a5640 1 -- 172.21.15.170:0/3791062404 learned_addr learned my addr 172.21.15.170:0/3791062404 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:28:01.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.261+0000 7f994bfff640 1 -- 172.21.15.170:0/3791062404 >> v1:172.21.15.47:6789/0 conn(0x557d0842d6b0 legacy=0x557d0842faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.261+0000 7f994bfff640 1 -- 172.21.15.170:0/3791062404 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d082bd6b0 con 0x557d08431220 2024-09-12T17:28:01.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.263+0000 7f994bfff640 1 --2- 172.21.15.170:0/3791062404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d08431220 0x557d084336e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f993c00a470 tx=0x7f993c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c0e7a3cc4be5421 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.263+0000 7f9952ba4640 1 -- 172.21.15.170:0/3791062404 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f993c053570 con 0x557d08431220 2024-09-12T17:28:01.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.263+0000 7f9952ba4640 1 -- 172.21.15.170:0/3791062404 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f993c058070 con 0x557d08431220 2024-09-12T17:28:01.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.263+0000 7f9952ba4640 1 -- 172.21.15.170:0/3791062404 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f993c053880 con 0x557d08431220 2024-09-12T17:28:01.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.263+0000 7f99558bb800 1 -- 172.21.15.170:0/3791062404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d08431220 msgr2=0x557d084336e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.263+0000 7f99558bb800 1 --2- 172.21.15.170:0/3791062404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d08431220 0x557d084336e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f993c00a470 tx=0x7f993c045a20 comp rx=0 tx=0).stop 2024-09-12T17:28:01.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.263+0000 7f99558bb800 1 -- 172.21.15.170:0/3791062404 shutdown_connections 2024-09-12T17:28:01.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.263+0000 7f99558bb800 1 --2- 172.21.15.170:0/3791062404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d08431220 0x557d084336e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.263+0000 7f99558bb800 1 -- 172.21.15.170:0/3791062404 >> 172.21.15.170:0/3791062404 conn(0x557d08427210 msgr2=0x557d08429650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:01.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.263+0000 7f99558bb800 1 -- 172.21.15.170:0/3791062404 shutdown_connections 2024-09-12T17:28:01.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.263+0000 7f99558bb800 1 -- 172.21.15.170:0/3791062404 wait complete. 2024-09-12T17:28:01.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.277+0000 7f99558bb800 1 Processor -- start 2024-09-12T17:28:01.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.277+0000 7f99558bb800 1 -- start start 2024-09-12T17:28:01.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.277+0000 7f99558bb800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0842d6b0 0x557d0851c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.277+0000 7f99558bb800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557d082c5dd0 con 0x557d0842d6b0 2024-09-12T17:28:01.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.278+0000 7f99533a5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0842d6b0 0x557d0851c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.278+0000 7f99533a5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0842d6b0 0x557d0851c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57258/0 (socket says 172.21.15.170:57258) 2024-09-12T17:28:01.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.278+0000 7f99533a5640 1 -- 172.21.15.170:0/2461471682 learned_addr learned my addr 172.21.15.170:0/2461471682 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:01.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.278+0000 7f99533a5640 1 -- 172.21.15.170:0/2461471682 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d082dee10 con 0x557d0842d6b0 2024-09-12T17:28:01.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.278+0000 7f99533a5640 1 --2- 172.21.15.170:0/2461471682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0842d6b0 0x557d0851c6d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9944001e40 tx=0x7f9944001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b09ad94bc9f77650 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.278+0000 7f984160a640 1 -- 172.21.15.170:0/2461471682 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9944012020 con 0x557d0842d6b0 2024-09-12T17:28:01.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.278+0000 7f984160a640 1 -- 172.21.15.170:0/2461471682 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f994400e5a0 con 0x557d0842d6b0 2024-09-12T17:28:01.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.278+0000 7f984160a640 1 -- 172.21.15.170:0/2461471682 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f994400e8a0 con 0x557d0842d6b0 2024-09-12T17:28:01.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.279+0000 7f99558bb800 1 -- 172.21.15.170:0/2461471682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0842d6b0 msgr2=0x557d0851c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.279+0000 7f99558bb800 1 --2- 172.21.15.170:0/2461471682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0842d6b0 0x557d0851c6d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9944001e40 tx=0x7f9944001e70 comp rx=0 tx=0).stop 2024-09-12T17:28:01.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.279+0000 7f99558bb800 1 -- 172.21.15.170:0/2461471682 shutdown_connections 2024-09-12T17:28:01.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.279+0000 7f99558bb800 1 --2- 172.21.15.170:0/2461471682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0842d6b0 0x557d0851c6d0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.279+0000 7f99558bb800 1 -- 172.21.15.170:0/2461471682 >> 172.21.15.170:0/2461471682 conn(0x557d08427210 msgr2=0x557d08518050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:01.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.279+0000 7f99558bb800 1 -- 172.21.15.170:0/2461471682 shutdown_connections 2024-09-12T17:28:01.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.279+0000 7f99558bb800 1 -- 172.21.15.170:0/2461471682 wait complete. 2024-09-12T17:28:01.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.279+0000 7f99558bb800 1 Processor -- start 2024-09-12T17:28:01.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.279+0000 7f99558bb800 1 -- start start 2024-09-12T17:28:01.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.279+0000 7f99558bb800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0842d6b0 0x557d08524080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.279+0000 7f99558bb800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557d08434060 con 0x557d0842d6b0 2024-09-12T17:28:01.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.280+0000 7f99533a5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0842d6b0 0x557d08524080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.280+0000 7f99533a5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0842d6b0 0x557d08524080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57272/0 (socket says 172.21.15.170:57272) 2024-09-12T17:28:01.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.280+0000 7f99533a5640 1 -- 172.21.15.170:0/3855822241 learned_addr learned my addr 172.21.15.170:0/3855822241 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:01.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.280+0000 7f99533a5640 1 -- 172.21.15.170:0/3855822241 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d085245e0 con 0x557d0842d6b0 2024-09-12T17:28:01.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.280+0000 7f99533a5640 1 --2- 172.21.15.170:0/3855822241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0842d6b0 0x557d08524080 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f994400c010 tx=0x7f9944000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.280+0000 7f983fe07640 1 -- 172.21.15.170:0/3855822241 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9944012030 con 0x557d0842d6b0 2024-09-12T17:28:01.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.280+0000 7f983fe07640 1 -- 172.21.15.170:0/3855822241 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99440014a0 con 0x557d0842d6b0 2024-09-12T17:28:01.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.280+0000 7f99558bb800 1 -- 172.21.15.170:0/3855822241 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d08524870 con 0x557d0842d6b0 2024-09-12T17:28:01.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.280+0000 7f983fe07640 1 -- 172.21.15.170:0/3855822241 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f994401a7a0 con 0x557d0842d6b0 2024-09-12T17:28:01.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.280+0000 7f99558bb800 1 -- 172.21.15.170:0/3855822241 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d08525270 con 0x557d0842d6b0 2024-09-12T17:28:01.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.281+0000 7f983fe07640 1 -- 172.21.15.170:0/3855822241 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f9944015020 con 0x557d0842d6b0 2024-09-12T17:28:01.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.281+0000 7f983fe07640 1 --2- 172.21.15.170:0/3855822241 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f983803c730 0x7f983803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.281+0000 7f983fe07640 1 -- 172.21.15.170:0/3855822241 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f9944020030 con 0x557d0842d6b0 2024-09-12T17:28:01.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.281+0000 7f994bfff640 1 --2- 172.21.15.170:0/3855822241 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f983803c730 0x7f983803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.281+0000 7f99558bb800 1 --2- 172.21.15.170:0/3855822241 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x557d08431220 0x557d0852b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.281+0000 7f99558bb800 1 -- 172.21.15.170:0/3855822241 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557d0852bc10 con 0x557d08431220 2024-09-12T17:28:01.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.282+0000 7f9953ba6640 1 --2- 172.21.15.170:0/3855822241 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x557d08431220 0x557d0852b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.282+0000 7f994bfff640 1 --2- 172.21.15.170:0/3855822241 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f983803c730 0x7f983803ebf0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f993c057000 tx=0x7f993c052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.282+0000 7f9953ba6640 1 --2- 172.21.15.170:0/3855822241 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x557d08431220 0x557d0852b6d0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.282+0000 7f9953ba6640 1 -- 172.21.15.170:0/3855822241 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f994c00a4d0 con 0x557d08431220 2024-09-12T17:28:01.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.282+0000 7f99558bb800 1 -- 172.21.15.170:0/3855822241 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557d0852bfb0 con 0x557d08431220 2024-09-12T17:28:01.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.282+0000 7f9953ba6640 1 -- 172.21.15.170:0/3855822241 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f994c00a4d0 con 0x557d08431220 2024-09-12T17:28:01.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.282+0000 7f99558bb800 1 --2- 172.21.15.170:0/3855822241 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x557d0852da70 0x557d0852ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.282+0000 7f99558bb800 1 -- 172.21.15.170:0/3855822241 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557d085306a0 con 0x557d0852da70 2024-09-12T17:28:01.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.283+0000 7f99533a5640 1 --2- 172.21.15.170:0/3855822241 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x557d0852da70 0x557d0852ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.283+0000 7f99533a5640 1 --2- 172.21.15.170:0/3855822241 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x557d0852da70 0x557d0852ff10 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.283+0000 7f99533a5640 1 -- 172.21.15.170:0/3855822241 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f994401ab20 con 0x557d0852da70 2024-09-12T17:28:01.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.283+0000 7f99558bb800 1 -- 172.21.15.170:0/3855822241 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557d0852c800 con 0x557d08431220 2024-09-12T17:28:01.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.283+0000 7f9953ba6640 1 -- 172.21.15.170:0/3855822241 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f994c00a4d0 con 0x557d08431220 2024-09-12T17:28:01.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.283+0000 7f99558bb800 1 -- 172.21.15.170:0/3855822241 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557d0852cbe0 con 0x557d0852da70 2024-09-12T17:28:01.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.284+0000 7f99533a5640 1 -- 172.21.15.170:0/3855822241 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f994401ab20 con 0x557d0852da70 2024-09-12T17:28:01.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.284+0000 7f99558bb800 1 Processor -- start 2024-09-12T17:28:01.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.284+0000 7f99558bb800 1 -- start start 2024-09-12T17:28:01.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.284+0000 7f99558bb800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0842ce70 0x557d0842b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.284+0000 7f99558bb800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557d08323a00 con 0x557d0842ce70 2024-09-12T17:28:01.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.284+0000 7f9953ba6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0842ce70 0x557d0842b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.284+0000 7f9953ba6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0842ce70 0x557d0842b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57282/0 (socket says 172.21.15.170:57282) 2024-09-12T17:28:01.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.284+0000 7f9953ba6640 1 -- 172.21.15.170:0/1485344988 learned_addr learned my addr 172.21.15.170:0/1485344988 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:01.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.285+0000 7f9953ba6640 1 -- 172.21.15.170:0/1485344988 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d0842d390 con 0x557d0842ce70 2024-09-12T17:28:01.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.285+0000 7f9953ba6640 1 --2- 172.21.15.170:0/1485344988 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0842ce70 0x557d0842b6e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x557d08524f10 tx=0x7f994c0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.285+0000 7f983d602640 1 -- 172.21.15.170:0/1485344988 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f994c013640 con 0x557d0842ce70 2024-09-12T17:28:01.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.285+0000 7f983d602640 1 -- 172.21.15.170:0/1485344988 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f994c0137e0 con 0x557d0842ce70 2024-09-12T17:28:01.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.285+0000 7f983d602640 1 -- 172.21.15.170:0/1485344988 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f994c013ae0 con 0x557d0842ce70 2024-09-12T17:28:01.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.285+0000 7f99558bb800 1 -- 172.21.15.170:0/1485344988 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d0842bc20 con 0x557d0842ce70 2024-09-12T17:28:01.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.285+0000 7f99558bb800 1 -- 172.21.15.170:0/1485344988 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d0842c1c0 con 0x557d0842ce70 2024-09-12T17:28:01.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.286+0000 7f983d602640 1 -- 172.21.15.170:0/1485344988 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f994c011040 con 0x557d0842ce70 2024-09-12T17:28:01.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.286+0000 7f983d602640 1 --2- 172.21.15.170:0/1485344988 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f982c03c730 0x7f982c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.286+0000 7f983d602640 1 -- 172.21.15.170:0/1485344988 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f994c00e040 con 0x557d0842ce70 2024-09-12T17:28:01.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.286+0000 7f99533a5640 1 --2- 172.21.15.170:0/1485344988 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f982c03c730 0x7f982c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.286+0000 7f99558bb800 1 Processor -- start 2024-09-12T17:28:01.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.287+0000 7f99533a5640 1 --2- 172.21.15.170:0/1485344988 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f982c03c730 0x7f982c03ebf0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f994400c720 tx=0x7f9944043050 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.287+0000 7f99558bb800 1 -- start start 2024-09-12T17:28:01.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.287+0000 7f99558bb800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0854dc60 0x557d0854e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.287+0000 7f99558bb800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557d0851cf20 con 0x557d0854dc60 2024-09-12T17:28:01.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.287+0000 7f9953ba6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0854dc60 0x557d0854e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.287+0000 7f9953ba6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0854dc60 0x557d0854e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57286/0 (socket says 172.21.15.170:57286) 2024-09-12T17:28:01.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.287+0000 7f9953ba6640 1 -- 172.21.15.170:0/1866728257 learned_addr learned my addr 172.21.15.170:0/1866728257 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:01.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.287+0000 7f9953ba6640 1 -- 172.21.15.170:0/1866728257 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d0854e650 con 0x557d0854dc60 2024-09-12T17:28:01.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.287+0000 7f9953ba6640 1 --2- 172.21.15.170:0/1866728257 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0854dc60 0x557d0854e060 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f994c020000 tx=0x7f994c01f400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d91877084601800 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.287+0000 7f9836ffd640 1 -- 172.21.15.170:0/1866728257 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f994c055040 con 0x557d0854dc60 2024-09-12T17:28:01.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.287+0000 7f9836ffd640 1 -- 172.21.15.170:0/1866728257 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f994c021960 con 0x557d0854dc60 2024-09-12T17:28:01.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.287+0000 7f9836ffd640 1 -- 172.21.15.170:0/1866728257 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f994c021440 con 0x557d0854dc60 2024-09-12T17:28:01.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.288+0000 7f99558bb800 1 -- 172.21.15.170:0/1866728257 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0854dc60 msgr2=0x557d0854e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.288+0000 7f99558bb800 1 --2- 172.21.15.170:0/1866728257 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0854dc60 0x557d0854e060 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f994c020000 tx=0x7f994c01f400 comp rx=0 tx=0).stop 2024-09-12T17:28:01.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.288+0000 7f99558bb800 1 -- 172.21.15.170:0/1866728257 shutdown_connections 2024-09-12T17:28:01.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.288+0000 7f99558bb800 1 --2- 172.21.15.170:0/1866728257 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0854dc60 0x557d0854e060 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.288+0000 7f99558bb800 1 -- 172.21.15.170:0/1866728257 >> 172.21.15.170:0/1866728257 conn(0x557d0854a060 msgr2=0x557d085482a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:01.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.288+0000 7f99558bb800 1 -- 172.21.15.170:0/1866728257 shutdown_connections 2024-09-12T17:28:01.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.288+0000 7f99558bb800 1 -- 172.21.15.170:0/1866728257 wait complete. 2024-09-12T17:28:01.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.288+0000 7f99558bb800 1 Processor -- start 2024-09-12T17:28:01.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.288+0000 7f99558bb800 1 -- start start 2024-09-12T17:28:01.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.288+0000 7f99558bb800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0854dc60 0x557d08555210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.288+0000 7f99558bb800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557d0854ec70 con 0x557d0854dc60 2024-09-12T17:28:01.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.289+0000 7f9953ba6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0854dc60 0x557d08555210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.289+0000 7f9953ba6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0854dc60 0x557d08555210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57290/0 (socket says 172.21.15.170:57290) 2024-09-12T17:28:01.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.289+0000 7f9953ba6640 1 -- 172.21.15.170:0/611002954 learned_addr learned my addr 172.21.15.170:0/611002954 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:01.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.289+0000 7f9953ba6640 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d08555770 con 0x557d0854dc60 2024-09-12T17:28:01.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.289+0000 7f9953ba6640 1 --2- 172.21.15.170:0/611002954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0854dc60 0x557d08555210 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f994c0208e0 tx=0x7f994c053cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.289+0000 7f98357fa640 1 -- 172.21.15.170:0/611002954 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f994c055050 con 0x557d0854dc60 2024-09-12T17:28:01.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.289+0000 7f98357fa640 1 -- 172.21.15.170:0/611002954 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f994c053f60 con 0x557d0854dc60 2024-09-12T17:28:01.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.289+0000 7f98357fa640 1 -- 172.21.15.170:0/611002954 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f994c01f710 con 0x557d0854dc60 2024-09-12T17:28:01.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.289+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d08555a00 con 0x557d0854dc60 2024-09-12T17:28:01.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.289+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d08556380 con 0x557d0854dc60 2024-09-12T17:28:01.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.290+0000 7f98357fa640 1 -- 172.21.15.170:0/611002954 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f994c0551f0 con 0x557d0854dc60 2024-09-12T17:28:01.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.290+0000 7f98357fa640 1 --2- 172.21.15.170:0/611002954 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f981c03c7d0 0x7f981c03ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.290+0000 7f98357fa640 1 -- 172.21.15.170:0/611002954 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f994c04d040 con 0x557d0854dc60 2024-09-12T17:28:01.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.290+0000 7f99533a5640 1 --2- 172.21.15.170:0/611002954 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f981c03c7d0 0x7f981c03ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.291+0000 7f99533a5640 1 --2- 172.21.15.170:0/611002954 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f981c03c7d0 0x7f981c03ec90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f994404b520 tx=0x7f9944030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.291+0000 7f99558bb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.291+0000 7f99558bb800 1 --2- 172.21.15.170:0/611002954 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x557d08560b60 0x557d08563020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.291+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557d08563770 con 0x557d08560b60 2024-09-12T17:28:01.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.291+0000 7f994bfff640 1 --2- 172.21.15.170:0/611002954 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x557d08560b60 0x557d08563020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.291+0000 7f994bfff640 1 --2- 172.21.15.170:0/611002954 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x557d08560b60 0x557d08563020 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.291+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f993c051070 con 0x557d08560b60 2024-09-12T17:28:01.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.291+0000 7f99558bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.291+0000 7f99558bb800 20 realm 2024-09-12T17:28:01.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.291+0000 7f99558bb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.291+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557d08563ba0 con 0x557d08560b60 2024-09-12T17:28:01.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.292+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f993c051070 con 0x557d08560b60 2024-09-12T17:28:01.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.292+0000 7f99558bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.292+0000 7f99558bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:01.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.292+0000 7f99558bb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.292+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557d08564470 con 0x557d08560b60 2024-09-12T17:28:01.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.292+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f993c051070 con 0x557d08560b60 2024-09-12T17:28:01.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.292+0000 7f99558bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.292+0000 7f99558bb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.292+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557d08564810 con 0x557d08560b60 2024-09-12T17:28:01.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.292+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f993c051070 con 0x557d08560b60 2024-09-12T17:28:01.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.292+0000 7f99558bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:01.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.292+0000 7f99558bb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.292+0000 7f99558bb800 1 --2- 172.21.15.170:0/611002954 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x557d08565570 0x557d08567960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.292+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557d08567f70 con 0x557d08565570 2024-09-12T17:28:01.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.292+0000 7f9953ba6640 1 --2- 172.21.15.170:0/611002954 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x557d08565570 0x557d08567960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.292+0000 7f9953ba6640 1 --2- 172.21.15.170:0/611002954 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x557d08565570 0x557d08567960 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.293+0000 7f9953ba6640 1 -- 172.21.15.170:0/611002954 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f994c00a4d0 con 0x557d08565570 2024-09-12T17:28:01.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.293+0000 7f99558bb800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:01.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.293+0000 7f99558bb800 20 searching for the correct realm 2024-09-12T17:28:01.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.293+0000 7f99558bb800 1 --2- 172.21.15.170:0/611002954 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x557d08569f20 0x557d0856c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.293+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557d0856ca60 con 0x557d08569f20 2024-09-12T17:28:01.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.293+0000 7f99533a5640 1 --2- 172.21.15.170:0/611002954 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x557d08569f20 0x557d0856c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.293+0000 7f99533a5640 1 --2- 172.21.15.170:0/611002954 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x557d08569f20 0x557d0856c3e0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.293+0000 7f99533a5640 1 -- 172.21.15.170:0/611002954 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994401ab20 con 0x557d08569f20 2024-09-12T17:28:01.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.293+0000 7f99533a5640 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557d0856ca60 con 0x557d08565570 2024-09-12T17:28:01.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.294+0000 7f9953ba6640 1 -- 172.21.15.170:0/611002954 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c00a4d0 con 0x557d08565570 2024-09-12T17:28:01.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.294+0000 7f9953ba6640 1 --2- 172.21.15.170:0/611002954 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f994c033070 0x7f994c0343f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.294+0000 7f9953ba6640 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557d0856ca60 con 0x7f994c033070 2024-09-12T17:28:01.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.294+0000 7f994bfff640 1 --2- 172.21.15.170:0/611002954 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f994c033070 0x7f994c0343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.294+0000 7f994bfff640 1 --2- 172.21.15.170:0/611002954 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f994c033070 0x7f994c0343f0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.294+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c051070 con 0x7f994c033070 2024-09-12T17:28:01.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.294+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557d0856ca60 con 0x557d08560b60 2024-09-12T17:28:01.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.295+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c051070 con 0x557d08560b60 2024-09-12T17:28:01.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.295+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557d0856ca60 con 0x557d08560b60 2024-09-12T17:28:01.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.295+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c051070 con 0x557d08560b60 2024-09-12T17:28:01.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.295+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557d0856ca60 con 0x7f994c033070 2024-09-12T17:28:01.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.295+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c051070 con 0x7f994c033070 2024-09-12T17:28:01.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.295+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557d0856ca60 con 0x7f994c033070 2024-09-12T17:28:01.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.295+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c051070 con 0x7f994c033070 2024-09-12T17:28:01.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.295+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557d0856ca60 con 0x557d08565570 2024-09-12T17:28:01.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.296+0000 7f9953ba6640 1 -- 172.21.15.170:0/611002954 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c00a4d0 con 0x557d08565570 2024-09-12T17:28:01.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.296+0000 7f9953ba6640 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557d0856ca60 con 0x557d08569f20 2024-09-12T17:28:01.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.296+0000 7f99533a5640 1 -- 172.21.15.170:0/611002954 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994401ab20 con 0x557d08569f20 2024-09-12T17:28:01.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.296+0000 7f99533a5640 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557d0856ca60 con 0x557d08560b60 2024-09-12T17:28:01.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.296+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c051070 con 0x557d08560b60 2024-09-12T17:28:01.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.296+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557d0856ca60 con 0x7f994c033070 2024-09-12T17:28:01.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.297+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c051070 con 0x7f994c033070 2024-09-12T17:28:01.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.297+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557d0856ca60 con 0x557d08560b60 2024-09-12T17:28:01.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.297+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c051070 con 0x557d08560b60 2024-09-12T17:28:01.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.297+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557d0856ca60 con 0x557d08565570 2024-09-12T17:28:01.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.297+0000 7f9953ba6640 1 -- 172.21.15.170:0/611002954 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f994c00a4d0 con 0x557d08565570 2024-09-12T17:28:01.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.297+0000 7f9953ba6640 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557d0856ca60 con 0x557d08569f20 2024-09-12T17:28:01.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.297+0000 7f99533a5640 1 -- 172.21.15.170:0/611002954 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994401ab20 con 0x557d08569f20 2024-09-12T17:28:01.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.297+0000 7f99533a5640 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557d0856ca60 con 0x557d08569f20 2024-09-12T17:28:01.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.297+0000 7f99533a5640 1 -- 172.21.15.170:0/611002954 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994401ab20 con 0x557d08569f20 2024-09-12T17:28:01.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.297+0000 7f99533a5640 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557d0856ca60 con 0x7f994c033070 2024-09-12T17:28:01.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.298+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c051070 con 0x7f994c033070 2024-09-12T17:28:01.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.298+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557d0856ca60 con 0x557d08569f20 2024-09-12T17:28:01.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.298+0000 7f99533a5640 1 -- 172.21.15.170:0/611002954 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994401ab20 con 0x557d08569f20 2024-09-12T17:28:01.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.298+0000 7f99533a5640 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557d0856ca60 con 0x557d08569f20 2024-09-12T17:28:01.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.298+0000 7f99533a5640 1 -- 172.21.15.170:0/611002954 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994401ab20 con 0x557d08569f20 2024-09-12T17:28:01.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.298+0000 7f99533a5640 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557d0856ca60 con 0x557d08560b60 2024-09-12T17:28:01.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.298+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c051070 con 0x557d08560b60 2024-09-12T17:28:01.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.298+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557d0856ca60 con 0x557d08560b60 2024-09-12T17:28:01.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.298+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f993c051070 con 0x557d08560b60 2024-09-12T17:28:01.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.298+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557d0856ca60 con 0x7f994c033070 2024-09-12T17:28:01.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.299+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c051070 con 0x7f994c033070 2024-09-12T17:28:01.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.299+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557d0856ca60 con 0x557d08569f20 2024-09-12T17:28:01.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.299+0000 7f99533a5640 1 -- 172.21.15.170:0/611002954 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994401ab20 con 0x557d08569f20 2024-09-12T17:28:01.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.299+0000 7f99533a5640 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557d0856ca60 con 0x557d08565570 2024-09-12T17:28:01.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.299+0000 7f9953ba6640 1 -- 172.21.15.170:0/611002954 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c00a4d0 con 0x557d08565570 2024-09-12T17:28:01.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.299+0000 7f9953ba6640 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557d0856ca60 con 0x557d08560b60 2024-09-12T17:28:01.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.299+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c051070 con 0x557d08560b60 2024-09-12T17:28:01.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.299+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557d0856ca60 con 0x7f994c033070 2024-09-12T17:28:01.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.300+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c051070 con 0x7f994c033070 2024-09-12T17:28:01.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.300+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557d0856ca60 con 0x557d08569f20 2024-09-12T17:28:01.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.300+0000 7f99533a5640 1 -- 172.21.15.170:0/611002954 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994401ab20 con 0x557d08569f20 2024-09-12T17:28:01.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.300+0000 7f99533a5640 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557d0856ca60 con 0x7f994c033070 2024-09-12T17:28:01.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.300+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c051070 con 0x7f994c033070 2024-09-12T17:28:01.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.300+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557d0856ca60 con 0x557d08565570 2024-09-12T17:28:01.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.300+0000 7f9953ba6640 1 -- 172.21.15.170:0/611002954 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c00a4d0 con 0x557d08565570 2024-09-12T17:28:01.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.300+0000 7f9953ba6640 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557d0856ca60 con 0x557d08569f20 2024-09-12T17:28:01.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.301+0000 7f99533a5640 1 -- 172.21.15.170:0/611002954 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994401ab20 con 0x557d08569f20 2024-09-12T17:28:01.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.301+0000 7f99533a5640 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557d0856ca60 con 0x7f994c033070 2024-09-12T17:28:01.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.301+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c051070 con 0x7f994c033070 2024-09-12T17:28:01.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.301+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557d0856ca60 con 0x557d08560b60 2024-09-12T17:28:01.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.302+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f993c051070 con 0x557d08560b60 2024-09-12T17:28:01.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.302+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557d0856ca60 con 0x557d08565570 2024-09-12T17:28:01.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.302+0000 7f9953ba6640 1 -- 172.21.15.170:0/611002954 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f994c067040 con 0x557d08565570 2024-09-12T17:28:01.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.302+0000 7f99558bb800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:01.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.302+0000 7f99558bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:01.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.302+0000 7f99558bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:01.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.302+0000 7f99558bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:01.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.302+0000 7f99558bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:01.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.302+0000 7f99558bb800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:01.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.302+0000 7f99558bb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.302+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557d08568960 con 0x557d08560b60 2024-09-12T17:28:01.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.302+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f993c051070 con 0x557d08560b60 2024-09-12T17:28:01.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.302+0000 7f99558bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.302+0000 7f99558bb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.302+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557d08569200 con 0x557d08560b60 2024-09-12T17:28:01.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.302+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f993c051070 con 0x557d08560b60 2024-09-12T17:28:01.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.302+0000 7f99558bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:01.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.302+0000 7f99558bb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.302+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557d085685a0 con 0x557d08565570 2024-09-12T17:28:01.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.303+0000 7f9953ba6640 1 -- 172.21.15.170:0/611002954 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f994c067040 con 0x557d08565570 2024-09-12T17:28:01.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.303+0000 7f99558bb800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:01.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.303+0000 7f99558bb800 20 zone default found 2024-09-12T17:28:01.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.303+0000 7f99558bb800 4 Realm: () 2024-09-12T17:28:01.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.303+0000 7f99558bb800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:01.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.303+0000 7f99558bb800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:01.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.303+0000 7f99558bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:01.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.303+0000 7f99558bb800 20 zonegroup default 2024-09-12T17:28:01.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.303+0000 7f99558bb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.303+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557d0856d390 con 0x7f994c033070 2024-09-12T17:28:01.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.303+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f993c051070 con 0x7f994c033070 2024-09-12T17:28:01.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.303+0000 7f99558bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.303+0000 7f99558bb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.303+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557d0856f5d0 con 0x557d08569f20 2024-09-12T17:28:01.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.303+0000 7f99533a5640 1 -- 172.21.15.170:0/611002954 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f994401ab20 con 0x557d08569f20 2024-09-12T17:28:01.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.303+0000 7f99558bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.304+0000 7f99558bb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.304+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557d0856f970 con 0x557d08569f20 2024-09-12T17:28:01.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.304+0000 7f99533a5640 1 -- 172.21.15.170:0/611002954 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f994401ab20 con 0x557d08569f20 2024-09-12T17:28:01.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.304+0000 7f99558bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.304+0000 7f99558bb800 20 started sync module instance, tier type = 2024-09-12T17:28:01.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.304+0000 7f99558bb800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:01.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.304+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d0856eab0 con 0x557d08565570 2024-09-12T17:28:01.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.305+0000 7f9953ba6640 1 -- 172.21.15.170:0/611002954 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994c067040 con 0x557d08565570 2024-09-12T17:28:01.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.305+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93995499188144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d0856eab0 con 0x557d08565570 2024-09-12T17:28:01.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.305+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d08570480 con 0x557d08560b60 2024-09-12T17:28:01.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.306+0000 7f9953ba6640 1 -- 172.21.15.170:0/611002954 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93995499188144] v29'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994c067040 con 0x557d08565570 2024-09-12T17:28:01.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.306+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c051070 con 0x557d08560b60 2024-09-12T17:28:01.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.306+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93995499192144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d0856eab0 con 0x557d08560b60 2024-09-12T17:28:01.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.306+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d08570f30 con 0x557d08569f20 2024-09-12T17:28:01.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.307+0000 7f99533a5640 1 -- 172.21.15.170:0/611002954 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994401ab20 con 0x557d08569f20 2024-09-12T17:28:01.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.307+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93995499194896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d085717d0 con 0x557d08569f20 2024-09-12T17:28:01.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.307+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d085722b0 con 0x557d08565570 2024-09-12T17:28:01.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.307+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93995499192144] v29'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c051070 con 0x557d08560b60 2024-09-12T17:28:01.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.308+0000 7f99533a5640 1 -- 172.21.15.170:0/611002954 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93995499194896] v29'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994401ab20 con 0x557d08569f20 2024-09-12T17:28:01.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.308+0000 7f9953ba6640 1 -- 172.21.15.170:0/611002954 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994c067040 con 0x557d08565570 2024-09-12T17:28:01.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.308+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93995499197216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d0856e600 con 0x557d08565570 2024-09-12T17:28:01.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.308+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d08572b90 con 0x557d08560b60 2024-09-12T17:28:01.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.310+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c051070 con 0x557d08560b60 2024-09-12T17:28:01.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.310+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93995499202208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d08572b20 con 0x557d08560b60 2024-09-12T17:28:01.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.310+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d08573b40 con 0x7f994c033070 2024-09-12T17:28:01.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.310+0000 7f9953ba6640 1 -- 172.21.15.170:0/611002954 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93995499197216] v29'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994c067040 con 0x557d08565570 2024-09-12T17:28:01.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.311+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93995499202208] v29'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c051070 con 0x557d08560b60 2024-09-12T17:28:01.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.311+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c051070 con 0x7f994c033070 2024-09-12T17:28:01.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.311+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93995499199936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d08572d00 con 0x7f994c033070 2024-09-12T17:28:01.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.311+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d085743e0 con 0x7f994c033070 2024-09-12T17:28:01.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.312+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93995499199936] v29'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c051070 con 0x7f994c033070 2024-09-12T17:28:01.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.312+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(56 notify.6 [create] v29'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c051070 con 0x7f994c033070 2024-09-12T17:28:01.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.312+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93995499206176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d08572d00 con 0x7f994c033070 2024-09-12T17:28:01.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.312+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d08574a00 con 0x7f994c033070 2024-09-12T17:28:01.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.313+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93995499206176] v29'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c051070 con 0x7f994c033070 2024-09-12T17:28:01.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.313+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(58 notify.7 [create] v29'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c051070 con 0x7f994c033070 2024-09-12T17:28:01.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.313+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93995499208416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d08574a00 con 0x7f994c033070 2024-09-12T17:28:01.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.313+0000 7f99558bb800 20 add_watcher() i=0 2024-09-12T17:28:01.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.313+0000 7f99558bb800 20 add_watcher() i=1 2024-09-12T17:28:01.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.313+0000 7f99558bb800 20 add_watcher() i=2 2024-09-12T17:28:01.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.313+0000 7f99558bb800 20 add_watcher() i=3 2024-09-12T17:28:01.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.313+0000 7f99558bb800 20 add_watcher() i=4 2024-09-12T17:28:01.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.313+0000 7f99558bb800 20 add_watcher() i=5 2024-09-12T17:28:01.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.313+0000 7f99558bb800 20 add_watcher() i=6 2024-09-12T17:28:01.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.314+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93995499208416] v29'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c051070 con 0x7f994c033070 2024-09-12T17:28:01.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.314+0000 7f99558bb800 20 add_watcher() i=7 2024-09-12T17:28:01.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.314+0000 7f99558bb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:01.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.314+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557d08577e00 con 0x557d08560b60 2024-09-12T17:28:01.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.314+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f993c051070 con 0x557d08560b60 2024-09-12T17:28:01.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.314+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93995499210528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d08575320 con 0x557d08560b60 2024-09-12T17:28:01.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.315+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93995499210528] v29'78 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f993c051070 con 0x557d08560b60 2024-09-12T17:28:01.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.315+0000 7f980a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:01.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.315+0000 7f99558bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:01.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.315+0000 7f99558bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:01.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.315+0000 7f99558bb800 5 note: GC not initialized 2024-09-12T17:28:01.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.316+0000 7f98097e2640 20 reqs_thread_entry: start 2024-09-12T17:28:01.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.316+0000 7f99558bb800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:01.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.316+0000 7f99558bb800 20 Filter name: none 2024-09-12T17:28:01.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.316+0000 7f98027fc640 20 reqs_thread_entry: start 2024-09-12T17:28:01.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.316+0000 7f99558bb800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:28:01.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.316+0000 7f99558bb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.316+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557d085aae20 con 0x557d08560b60 2024-09-12T17:28:01.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.316+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f993c051070 con 0x557d08560b60 2024-09-12T17:28:01.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.316+0000 7f99558bb800 20 rados_obj.operate() r=0 bl.length=556 2024-09-12T17:28:01.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.316+0000 7f99558bb800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T17:28:01.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.316+0000 7f99558bb800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:28:01.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.316+0000 7f99558bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:01.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.316+0000 7f99558bb800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-09-12T17:28:01.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.316+0000 7f99558bb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.316+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557d085aba10 con 0x557d08565570 2024-09-12T17:28:01.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.317+0000 7f9953ba6640 1 -- 172.21.15.170:0/611002954 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f994c067040 con 0x557d08565570 2024-09-12T17:28:01.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.317+0000 7f99558bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.317+0000 7f99558bb800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-09-12T17:28:01.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.317+0000 7f99558bb800 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-12T17:28:01.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.317+0000 7f99558bb800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-09-12T17:28:01.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.317+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~673 in=673b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d085b16f0 con 0x557d08560b60 2024-09-12T17:28:01.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.318+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~673] v29'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f993c051070 con 0x557d08560b60 2024-09-12T17:28:01.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.318+0000 7f99558bb800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:28:01.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.318+0000 7f99558bb800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:28:01.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.318+0000 7f99558bb800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T17:28:01.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.318+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93995499458864 in=861b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557d085ae300 con 0x557d08560b60 2024-09-12T17:28:01.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.318+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== watch-notify(notify (1) cookie 93995499202208 notify 124554051591 ret 0) ==== 891+0+0 (crc 0 0 0) 0x7f993c082040 con 0x557d08560b60 2024-09-12T17:28:01.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.318+0000 7f9836ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051591 cookie 93995499202208 notifier 4386 bl.length()=849 2024-09-12T17:28:01.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.318+0000 7f9836ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:28:01.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.318+0000 7f9836ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:28:01.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.318+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(65 notify.4 [notify cookie 93995499458864 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f993c051070 con 0x557d08560b60 2024-09-12T17:28:01.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.318+0000 7f9836ffd640 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f9818003ea0 con 0x557d08560b60 2024-09-12T17:28:01.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.318+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c051070 con 0x557d08560b60 2024-09-12T17:28:01.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.318+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== watch-notify(notify_complete (2) cookie 93995499458864 notify 124554051591 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557d082bd6b0 con 0x557d08560b60 2024-09-12T17:28:01.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.318+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d085b1130 con 0x557d08565570 2024-09-12T17:28:01.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.320+0000 7f9953ba6640 1 -- 172.21.15.170:0/611002954 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v29'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f994c067040 con 0x557d08565570 2024-09-12T17:28:01.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.320+0000 7f99558bb800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-12T17:28:01.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.320+0000 7f99558bb800 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-12T17:28:01.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.320+0000 7f99558bb800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-12T17:28:01.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.320+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93995499458864 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557d085abe30 con 0x557d08565570 2024-09-12T17:28:01.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.320+0000 7f9953ba6640 1 -- 172.21.15.170:0/611002954 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== watch-notify(notify (1) cookie 93995499188144 notify 124554051587 ret 0) ==== 208+0+0 (crc 0 0 0) 0x557d08555a00 con 0x557d08565570 2024-09-12T17:28:01.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.320+0000 7f9836ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051587 cookie 93995499188144 notifier 4386 bl.length()=166 2024-09-12T17:28:01.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.320+0000 7f9836ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-12T17:28:01.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.320+0000 7f9836ffd640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-12T17:28:01.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.320+0000 7f9836ffd640 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f9818003ea0 con 0x557d08565570 2024-09-12T17:28:01.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.320+0000 7f9953ba6640 1 -- 172.21.15.170:0/611002954 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(68 notify.0 [notify cookie 93995499458864 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f994c067040 con 0x557d08565570 2024-09-12T17:28:01.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.320+0000 7f9953ba6640 1 -- 172.21.15.170:0/611002954 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994c067040 con 0x557d08565570 2024-09-12T17:28:01.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.321+0000 7f9953ba6640 1 -- 172.21.15.170:0/611002954 <== osd.2 v2:172.21.15.170:6808/3855567754 18 ==== watch-notify(notify_complete (2) cookie 93995499458864 notify 124554051587 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557d08555770 con 0x557d08565570 2024-09-12T17:28:01.339 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T17:27:59.362376Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-12T17:28:01.319035Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:27:59.362351Z","tags":[],"group_ids":[]} 2024-09-12T17:28:01.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.321+0000 7f980a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:01.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.321+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93995499210528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d085a8c80 con 0x557d08560b60 2024-09-12T17:28:01.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.322+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93995499210528] v29'79 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f993c051070 con 0x557d08560b60 2024-09-12T17:28:01.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.322+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93995499188144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d085a8c80 con 0x557d08565570 2024-09-12T17:28:01.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.323+0000 7f9953ba6640 1 -- 172.21.15.170:0/611002954 <== osd.2 v2:172.21.15.170:6808/3855567754 19 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93995499188144] v29'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994c067040 con 0x557d08565570 2024-09-12T17:28:01.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.323+0000 7f99558bb800 20 remove_watcher() i=0 2024-09-12T17:28:01.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.323+0000 7f99558bb800 2 removed watcher, disabling cache 2024-09-12T17:28:01.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.323+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93995499192144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d085a8c80 con 0x557d08560b60 2024-09-12T17:28:01.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.324+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93995499192144] v29'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c051070 con 0x557d08560b60 2024-09-12T17:28:01.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.324+0000 7f99558bb800 20 remove_watcher() i=1 2024-09-12T17:28:01.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.324+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93995499194896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d085a8c80 con 0x557d08569f20 2024-09-12T17:28:01.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.325+0000 7f99533a5640 1 -- 172.21.15.170:0/611002954 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93995499194896] v29'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994401ab20 con 0x557d08569f20 2024-09-12T17:28:01.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.326+0000 7f99558bb800 20 remove_watcher() i=2 2024-09-12T17:28:01.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.326+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93995499197216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d085a8c80 con 0x557d08565570 2024-09-12T17:28:01.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.326+0000 7f9953ba6640 1 -- 172.21.15.170:0/611002954 <== osd.2 v2:172.21.15.170:6808/3855567754 20 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93995499197216] v29'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994c067040 con 0x557d08565570 2024-09-12T17:28:01.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.326+0000 7f99558bb800 20 remove_watcher() i=3 2024-09-12T17:28:01.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.327+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93995499202208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d085a8c80 con 0x557d08560b60 2024-09-12T17:28:01.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.328+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93995499202208] v29'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c051070 con 0x557d08560b60 2024-09-12T17:28:01.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.328+0000 7f99558bb800 20 remove_watcher() i=4 2024-09-12T17:28:01.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.328+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93995499199936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d085a8c80 con 0x7f994c033070 2024-09-12T17:28:01.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.329+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93995499199936] v29'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c051070 con 0x7f994c033070 2024-09-12T17:28:01.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.329+0000 7f99558bb800 20 remove_watcher() i=5 2024-09-12T17:28:01.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.329+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93995499206176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d085a8c80 con 0x7f994c033070 2024-09-12T17:28:01.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.330+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93995499206176] v29'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c051070 con 0x7f994c033070 2024-09-12T17:28:01.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.330+0000 7f99558bb800 20 remove_watcher() i=6 2024-09-12T17:28:01.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.330+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93995499208416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d085a8c80 con 0x7f994c033070 2024-09-12T17:28:01.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.331+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93995499208416] v29'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c051070 con 0x7f994c033070 2024-09-12T17:28:01.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.331+0000 7f99558bb800 20 remove_watcher() i=7 2024-09-12T17:28:01.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.331+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f994c033070 msgr2=0x7f994c0343f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.331+0000 7f99558bb800 1 --2- 172.21.15.170:0/611002954 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f994c033070 0x7f994c0343f0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.331+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x557d08560b60 msgr2=0x557d08563020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.331+0000 7f99558bb800 1 --2- 172.21.15.170:0/611002954 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x557d08560b60 0x557d08563020 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.331+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x557d08565570 msgr2=0x557d08567960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.331+0000 7f99558bb800 1 --2- 172.21.15.170:0/611002954 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x557d08565570 0x557d08567960 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.331+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x557d08569f20 msgr2=0x557d0856c3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.331+0000 7f99558bb800 1 --2- 172.21.15.170:0/611002954 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x557d08569f20 0x557d0856c3e0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.331+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f981c03c7d0 msgr2=0x7f981c03ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.331+0000 7f99558bb800 1 --2- 172.21.15.170:0/611002954 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f981c03c7d0 0x7f981c03ec90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f994404b520 tx=0x7f9944030000 comp rx=0 tx=0).stop 2024-09-12T17:28:01.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.331+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0854dc60 msgr2=0x557d08555210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.331+0000 7f994bfff640 1 -- 172.21.15.170:0/611002954 reap_dead start 2024-09-12T17:28:01.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.331+0000 7f99558bb800 1 --2- 172.21.15.170:0/611002954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0854dc60 0x557d08555210 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f994c0208e0 tx=0x7f994c053cf0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.331+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 shutdown_connections 2024-09-12T17:28:01.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.331+0000 7f99558bb800 1 --2- 172.21.15.170:0/611002954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0854dc60 0x557d08555210 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.331+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 >> 172.21.15.170:0/611002954 conn(0x557d0854a060 msgr2=0x557d08548270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:01.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.331+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 shutdown_connections 2024-09-12T17:28:01.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.331+0000 7f99558bb800 1 -- 172.21.15.170:0/611002954 wait complete. 2024-09-12T17:28:01.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.332+0000 7f99558bb800 1 -- 172.21.15.170:0/1485344988 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f982c03c730 msgr2=0x7f982c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.332+0000 7f99558bb800 1 --2- 172.21.15.170:0/1485344988 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f982c03c730 0x7f982c03ebf0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f994400c720 tx=0x7f9944043050 comp rx=0 tx=0).stop 2024-09-12T17:28:01.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.332+0000 7f99558bb800 1 -- 172.21.15.170:0/1485344988 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0842ce70 msgr2=0x557d0842b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.332+0000 7f99558bb800 1 --2- 172.21.15.170:0/1485344988 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0842ce70 0x557d0842b6e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x557d08524f10 tx=0x7f994c0167b0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.332+0000 7f99558bb800 1 -- 172.21.15.170:0/1485344988 shutdown_connections 2024-09-12T17:28:01.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.332+0000 7f99558bb800 1 --2- 172.21.15.170:0/1485344988 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f982c03c730 0x7f982c03ebf0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.332+0000 7f99558bb800 1 --2- 172.21.15.170:0/1485344988 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0842ce70 0x557d0842b6e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.332+0000 7f99558bb800 1 -- 172.21.15.170:0/1485344988 >> 172.21.15.170:0/1485344988 conn(0x557d085332e0 msgr2=0x557d085336c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:01.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.332+0000 7f99558bb800 1 -- 172.21.15.170:0/1485344988 shutdown_connections 2024-09-12T17:28:01.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.332+0000 7f99558bb800 1 -- 172.21.15.170:0/1485344988 wait complete. 2024-09-12T17:28:01.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.332+0000 7f99558bb800 1 -- 172.21.15.170:0/3855822241 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x557d08431220 msgr2=0x557d0852b6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.332+0000 7f99558bb800 1 --2- 172.21.15.170:0/3855822241 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x557d08431220 0x557d0852b6d0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.332+0000 7f99558bb800 1 -- 172.21.15.170:0/3855822241 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x557d0852da70 msgr2=0x557d0852ff10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.332+0000 7f99558bb800 1 --2- 172.21.15.170:0/3855822241 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x557d0852da70 0x557d0852ff10 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.332+0000 7f99558bb800 1 -- 172.21.15.170:0/3855822241 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f983803c730 msgr2=0x7f983803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.332+0000 7f99558bb800 1 --2- 172.21.15.170:0/3855822241 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f983803c730 0x7f983803ebf0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f993c057000 tx=0x7f993c052000 comp rx=0 tx=0).stop 2024-09-12T17:28:01.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.332+0000 7f99558bb800 1 -- 172.21.15.170:0/3855822241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0842d6b0 msgr2=0x557d08524080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.332+0000 7f99558bb800 1 --2- 172.21.15.170:0/3855822241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0842d6b0 0x557d08524080 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f994400c010 tx=0x7f9944000ed0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.332+0000 7f99558bb800 1 -- 172.21.15.170:0/3855822241 shutdown_connections 2024-09-12T17:28:01.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.332+0000 7f99558bb800 1 --2- 172.21.15.170:0/3855822241 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x557d0852da70 0x557d0852ff10 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.332+0000 7f99558bb800 1 --2- 172.21.15.170:0/3855822241 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f983803c730 0x7f983803ebf0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.332+0000 7f99558bb800 1 --2- 172.21.15.170:0/3855822241 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x557d08431220 0x557d0852b6d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.332+0000 7f99558bb800 1 --2- 172.21.15.170:0/3855822241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557d0842d6b0 0x557d08524080 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.332+0000 7f99558bb800 1 -- 172.21.15.170:0/3855822241 >> 172.21.15.170:0/3855822241 conn(0x557d08427210 msgr2=0x557d0851d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:01.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.332+0000 7f99558bb800 1 -- 172.21.15.170:0/3855822241 shutdown_connections 2024-09-12T17:28:01.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.332+0000 7f99558bb800 1 -- 172.21.15.170:0/3855822241 wait complete. 2024-09-12T17:28:01.350 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T17:27:59.362376Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-12T17:28:01.319035Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:27:59.362351Z', 'tags': [], 'group_ids': []} 2024-09-12T17:28:01.351 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-12T17:28:01.351 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-12T17:28:01.351 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-12T17:28:01.395 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:01.395 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:01.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.394+0000 7faa80126800 1 Processor -- start 2024-09-12T17:28:01.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.394+0000 7faa80126800 1 -- start start 2024-09-12T17:28:01.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.394+0000 7faa80126800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55a3599c1200 0x55a3599c36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.394+0000 7faa80126800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a359866e40 con 0x55a3599bd600 2024-09-12T17:28:01.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.394+0000 7faa80126800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x55a359831680 con 0x55a3599c1200 2024-09-12T17:28:01.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.394+0000 7faa7b5d8640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55a3599c1200 0x55a3599c36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.394+0000 7faa7bdd9640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x55a3599bd600 0x55a3599bf9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:48358/0 (socket says 172.21.15.170:48358) 2024-09-12T17:28:01.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.394+0000 7faa7bdd9640 1 -- 172.21.15.170:0/3180197516 learned_addr learned my addr 172.21.15.170:0/3180197516 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:28:01.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.394+0000 7faa7b5d8640 1 -- 172.21.15.170:0/3180197516 >> v1:172.21.15.47:6789/0 conn(0x55a3599bd600 legacy=0x55a3599bf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.394+0000 7faa7add7640 1 -- 172.21.15.170:0/3180197516 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4064224399 0 0) 0x55a359866e40 con 0x55a3599bd600 2024-09-12T17:28:01.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.394+0000 7faa7b5d8640 1 -- 172.21.15.170:0/3180197516 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a35984d6b0 con 0x55a3599c1200 2024-09-12T17:28:01.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.396+0000 7faa7b5d8640 1 --2- 172.21.15.170:0/3180197516 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3599c1200 0x55a3599c36c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7faa6400a470 tx=0x7faa64045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c27d396f4c99bf12 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.396+0000 7faa7add7640 1 -- 172.21.15.170:0/3180197516 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa64053570 con 0x55a3599c1200 2024-09-12T17:28:01.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.396+0000 7faa7add7640 1 -- 172.21.15.170:0/3180197516 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa64058070 con 0x55a3599c1200 2024-09-12T17:28:01.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.396+0000 7faa7add7640 1 -- 172.21.15.170:0/3180197516 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa64053880 con 0x55a3599c1200 2024-09-12T17:28:01.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.397+0000 7faa80126800 1 -- 172.21.15.170:0/3180197516 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3599c1200 msgr2=0x55a3599c36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.397+0000 7faa80126800 1 --2- 172.21.15.170:0/3180197516 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3599c1200 0x55a3599c36c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7faa6400a470 tx=0x7faa64045a20 comp rx=0 tx=0).stop 2024-09-12T17:28:01.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.397+0000 7faa80126800 1 -- 172.21.15.170:0/3180197516 shutdown_connections 2024-09-12T17:28:01.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.397+0000 7faa80126800 1 --2- 172.21.15.170:0/3180197516 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3599c1200 0x55a3599c36c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.397+0000 7faa80126800 1 -- 172.21.15.170:0/3180197516 >> 172.21.15.170:0/3180197516 conn(0x55a3599b71c0 msgr2=0x55a3599b9620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:01.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.397+0000 7faa80126800 1 -- 172.21.15.170:0/3180197516 shutdown_connections 2024-09-12T17:28:01.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.397+0000 7faa80126800 1 -- 172.21.15.170:0/3180197516 wait complete. 2024-09-12T17:28:01.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.410+0000 7faa80126800 1 Processor -- start 2024-09-12T17:28:01.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.410+0000 7faa80126800 1 -- start start 2024-09-12T17:28:01.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.411+0000 7faa80126800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3599bd600 0x55a359aac4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.411+0000 7faa80126800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a359855dd0 con 0x55a3599bd600 2024-09-12T17:28:01.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.411+0000 7faa7bdd9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3599bd600 0x55a359aac4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.411+0000 7faa7bdd9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3599bd600 0x55a359aac4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57306/0 (socket says 172.21.15.170:57306) 2024-09-12T17:28:01.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.411+0000 7faa7bdd9640 1 -- 172.21.15.170:0/1403939932 learned_addr learned my addr 172.21.15.170:0/1403939932 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:01.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.411+0000 7faa7bdd9640 1 -- 172.21.15.170:0/1403939932 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a35986ee10 con 0x55a3599bd600 2024-09-12T17:28:01.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.411+0000 7faa7bdd9640 1 --2- 172.21.15.170:0/1403939932 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3599bd600 0x55a359aac4d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7faa74006fa0 tx=0x7faa74001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99922bdf30b6762d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.411+0000 7fa969e0b640 1 -- 172.21.15.170:0/1403939932 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa74003450 con 0x55a3599bd600 2024-09-12T17:28:01.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.412+0000 7fa969e0b640 1 -- 172.21.15.170:0/1403939932 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa74003610 con 0x55a3599bd600 2024-09-12T17:28:01.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.412+0000 7fa969e0b640 1 -- 172.21.15.170:0/1403939932 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa74003970 con 0x55a3599bd600 2024-09-12T17:28:01.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.412+0000 7faa80126800 1 -- 172.21.15.170:0/1403939932 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3599bd600 msgr2=0x55a359aac4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.412+0000 7faa80126800 1 --2- 172.21.15.170:0/1403939932 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3599bd600 0x55a359aac4d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7faa74006fa0 tx=0x7faa74001b00 comp rx=0 tx=0).stop 2024-09-12T17:28:01.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.412+0000 7faa80126800 1 -- 172.21.15.170:0/1403939932 shutdown_connections 2024-09-12T17:28:01.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.412+0000 7faa80126800 1 --2- 172.21.15.170:0/1403939932 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3599bd600 0x55a359aac4d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.412+0000 7faa80126800 1 -- 172.21.15.170:0/1403939932 >> 172.21.15.170:0/1403939932 conn(0x55a3599b71c0 msgr2=0x55a359aa7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:01.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.412+0000 7faa80126800 1 -- 172.21.15.170:0/1403939932 shutdown_connections 2024-09-12T17:28:01.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.412+0000 7faa80126800 1 -- 172.21.15.170:0/1403939932 wait complete. 2024-09-12T17:28:01.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.413+0000 7faa80126800 1 Processor -- start 2024-09-12T17:28:01.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.413+0000 7faa80126800 1 -- start start 2024-09-12T17:28:01.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.413+0000 7faa80126800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3599bd600 0x55a359ab3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.413+0000 7faa80126800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a3599c4040 con 0x55a3599bd600 2024-09-12T17:28:01.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.413+0000 7faa7bdd9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3599bd600 0x55a359ab3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.413+0000 7faa7bdd9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3599bd600 0x55a359ab3de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57312/0 (socket says 172.21.15.170:57312) 2024-09-12T17:28:01.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.413+0000 7faa7bdd9640 1 -- 172.21.15.170:0/3948071063 learned_addr learned my addr 172.21.15.170:0/3948071063 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:01.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.414+0000 7faa7bdd9640 1 -- 172.21.15.170:0/3948071063 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a359ab4340 con 0x55a3599bd600 2024-09-12T17:28:01.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.414+0000 7faa7bdd9640 1 --2- 172.21.15.170:0/3948071063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3599bd600 0x55a359ab3de0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7faa74001330 tx=0x7faa74001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.414+0000 7fa963fff640 1 -- 172.21.15.170:0/3948071063 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa74014a10 con 0x55a3599bd600 2024-09-12T17:28:01.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.414+0000 7fa963fff640 1 -- 172.21.15.170:0/3948071063 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa74014bb0 con 0x55a3599bd600 2024-09-12T17:28:01.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.414+0000 7faa80126800 1 -- 172.21.15.170:0/3948071063 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a359ab45d0 con 0x55a3599bd600 2024-09-12T17:28:01.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.414+0000 7fa963fff640 1 -- 172.21.15.170:0/3948071063 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa7401e3f0 con 0x55a3599bd600 2024-09-12T17:28:01.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.414+0000 7faa80126800 1 -- 172.21.15.170:0/3948071063 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a359ab4fd0 con 0x55a3599bd600 2024-09-12T17:28:01.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.415+0000 7fa963fff640 1 -- 172.21.15.170:0/3948071063 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7faa74010070 con 0x55a3599bd600 2024-09-12T17:28:01.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.415+0000 7fa963fff640 1 --2- 172.21.15.170:0/3948071063 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa96403c780 0x7fa96403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.415+0000 7fa963fff640 1 -- 172.21.15.170:0/3948071063 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7faa74018070 con 0x55a3599bd600 2024-09-12T17:28:01.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.415+0000 7faa7b5d8640 1 --2- 172.21.15.170:0/3948071063 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa96403c780 0x7fa96403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.415+0000 7faa80126800 1 --2- 172.21.15.170:0/3948071063 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a3599c1200 0x55a359abb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.415+0000 7faa80126800 1 -- 172.21.15.170:0/3948071063 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a359abb970 con 0x55a3599c1200 2024-09-12T17:28:01.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.415+0000 7faa7c5da640 1 --2- 172.21.15.170:0/3948071063 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a3599c1200 0x55a359abb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.416+0000 7faa7b5d8640 1 --2- 172.21.15.170:0/3948071063 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa96403c780 0x7fa96403ec40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7faa64057000 tx=0x7faa64052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.416+0000 7faa7c5da640 1 --2- 172.21.15.170:0/3948071063 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a3599c1200 0x55a359abb430 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.416+0000 7faa7c5da640 1 -- 172.21.15.170:0/3948071063 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faa6c0083e0 con 0x55a3599c1200 2024-09-12T17:28:01.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.416+0000 7faa80126800 1 -- 172.21.15.170:0/3948071063 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a359abbd10 con 0x55a3599c1200 2024-09-12T17:28:01.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.416+0000 7faa7c5da640 1 -- 172.21.15.170:0/3948071063 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faa6c0083e0 con 0x55a3599c1200 2024-09-12T17:28:01.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.416+0000 7faa80126800 1 --2- 172.21.15.170:0/3948071063 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a359abd7d0 0x55a359abfc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.416+0000 7faa80126800 1 -- 172.21.15.170:0/3948071063 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a359ac03e0 con 0x55a359abd7d0 2024-09-12T17:28:01.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.416+0000 7faa7bdd9640 1 --2- 172.21.15.170:0/3948071063 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a359abd7d0 0x55a359abfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.417+0000 7faa7bdd9640 1 --2- 172.21.15.170:0/3948071063 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a359abd7d0 0x55a359abfc50 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.417+0000 7faa7bdd9640 1 -- 172.21.15.170:0/3948071063 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7faa7401b070 con 0x55a359abd7d0 2024-09-12T17:28:01.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.417+0000 7faa80126800 1 -- 172.21.15.170:0/3948071063 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a359abc560 con 0x55a3599c1200 2024-09-12T17:28:01.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.417+0000 7faa7c5da640 1 -- 172.21.15.170:0/3948071063 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faa6c0083e0 con 0x55a3599c1200 2024-09-12T17:28:01.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.417+0000 7faa80126800 1 -- 172.21.15.170:0/3948071063 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a359abc940 con 0x55a359abd7d0 2024-09-12T17:28:01.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.418+0000 7faa7bdd9640 1 -- 172.21.15.170:0/3948071063 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7faa7401b070 con 0x55a359abd7d0 2024-09-12T17:28:01.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.418+0000 7faa80126800 1 Processor -- start 2024-09-12T17:28:01.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.418+0000 7faa80126800 1 -- start start 2024-09-12T17:28:01.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.418+0000 7faa80126800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3599bcda0 0x55a3599bb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.418+0000 7faa80126800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a3598b3a00 con 0x55a3599bcda0 2024-09-12T17:28:01.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.418+0000 7faa7c5da640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3599bcda0 0x55a3599bb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.418+0000 7faa7c5da640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3599bcda0 0x55a3599bb610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57316/0 (socket says 172.21.15.170:57316) 2024-09-12T17:28:01.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.418+0000 7faa7c5da640 1 -- 172.21.15.170:0/2829878949 learned_addr learned my addr 172.21.15.170:0/2829878949 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:01.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.419+0000 7faa7c5da640 1 -- 172.21.15.170:0/2829878949 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3599bd2c0 con 0x55a3599bcda0 2024-09-12T17:28:01.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.419+0000 7faa7c5da640 1 --2- 172.21.15.170:0/2829878949 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3599bcda0 0x55a3599bb610 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x55a359ab5cd0 tx=0x7faa6c00bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.419+0000 7fa9617fa640 1 -- 172.21.15.170:0/2829878949 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa6c01c020 con 0x55a3599bcda0 2024-09-12T17:28:01.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.419+0000 7fa9617fa640 1 -- 172.21.15.170:0/2829878949 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa6c007c90 con 0x55a3599bcda0 2024-09-12T17:28:01.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.419+0000 7faa80126800 1 -- 172.21.15.170:0/2829878949 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a3599bbb50 con 0x55a3599bcda0 2024-09-12T17:28:01.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.419+0000 7fa9617fa640 1 -- 172.21.15.170:0/2829878949 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa6c018440 con 0x55a3599bcda0 2024-09-12T17:28:01.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.419+0000 7faa80126800 1 -- 172.21.15.170:0/2829878949 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3599bc0a0 con 0x55a3599bcda0 2024-09-12T17:28:01.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.420+0000 7fa9617fa640 1 -- 172.21.15.170:0/2829878949 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7faa6c01f020 con 0x55a3599bcda0 2024-09-12T17:28:01.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.420+0000 7fa9617fa640 1 --2- 172.21.15.170:0/2829878949 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa95403c730 0x7fa95403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.420+0000 7fa9617fa640 1 -- 172.21.15.170:0/2829878949 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7faa6c054df0 con 0x55a3599bcda0 2024-09-12T17:28:01.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.420+0000 7faa7bdd9640 1 --2- 172.21.15.170:0/2829878949 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa95403c730 0x7fa95403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.420+0000 7faa80126800 1 Processor -- start 2024-09-12T17:28:01.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.421+0000 7faa7bdd9640 1 --2- 172.21.15.170:0/2829878949 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa95403c730 0x7fa95403ebf0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x55a359ac0780 tx=0x7faa74014e90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.421+0000 7faa80126800 1 -- start start 2024-09-12T17:28:01.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.421+0000 7faa80126800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a359add900 0x55a359addd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.421+0000 7faa80126800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a359aacd20 con 0x55a359add900 2024-09-12T17:28:01.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.421+0000 7faa7c5da640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a359add900 0x55a359addd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.421+0000 7faa7c5da640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a359add900 0x55a359addd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57324/0 (socket says 172.21.15.170:57324) 2024-09-12T17:28:01.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.421+0000 7faa7c5da640 1 -- 172.21.15.170:0/1304478248 learned_addr learned my addr 172.21.15.170:0/1304478248 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:01.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.421+0000 7faa7c5da640 1 -- 172.21.15.170:0/1304478248 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a359ade2f0 con 0x55a359add900 2024-09-12T17:28:01.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.421+0000 7faa7c5da640 1 --2- 172.21.15.170:0/1304478248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a359add900 0x55a359addd00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7faa6c053300 tx=0x7faa6c015f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eeb8ee55a381664 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.421+0000 7fa95affd640 1 -- 172.21.15.170:0/1304478248 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa6c050070 con 0x55a359add900 2024-09-12T17:28:01.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.421+0000 7fa95affd640 1 -- 172.21.15.170:0/1304478248 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa6c0156f0 con 0x55a359add900 2024-09-12T17:28:01.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.421+0000 7fa95affd640 1 -- 172.21.15.170:0/1304478248 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa6c043030 con 0x55a359add900 2024-09-12T17:28:01.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.422+0000 7faa80126800 1 -- 172.21.15.170:0/1304478248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a359add900 msgr2=0x55a359addd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.422+0000 7faa80126800 1 --2- 172.21.15.170:0/1304478248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a359add900 0x55a359addd00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7faa6c053300 tx=0x7faa6c015f20 comp rx=0 tx=0).stop 2024-09-12T17:28:01.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.422+0000 7faa80126800 1 -- 172.21.15.170:0/1304478248 shutdown_connections 2024-09-12T17:28:01.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.422+0000 7faa80126800 1 --2- 172.21.15.170:0/1304478248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a359add900 0x55a359addd00 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.422+0000 7faa80126800 1 -- 172.21.15.170:0/1304478248 >> 172.21.15.170:0/1304478248 conn(0x55a359ad9d00 msgr2=0x55a359ad7f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:01.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.422+0000 7faa80126800 1 -- 172.21.15.170:0/1304478248 shutdown_connections 2024-09-12T17:28:01.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.422+0000 7faa80126800 1 -- 172.21.15.170:0/1304478248 wait complete. 2024-09-12T17:28:01.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.422+0000 7faa80126800 1 Processor -- start 2024-09-12T17:28:01.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.422+0000 7faa80126800 1 -- start start 2024-09-12T17:28:01.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.422+0000 7faa80126800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a359add900 0x55a359ae4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.422+0000 7faa80126800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a359ade910 con 0x55a359add900 2024-09-12T17:28:01.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.423+0000 7faa7c5da640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a359add900 0x55a359ae4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.423+0000 7faa7c5da640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a359add900 0x55a359ae4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57338/0 (socket says 172.21.15.170:57338) 2024-09-12T17:28:01.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.423+0000 7faa7c5da640 1 -- 172.21.15.170:0/1127971110 learned_addr learned my addr 172.21.15.170:0/1127971110 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:01.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.423+0000 7faa7c5da640 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a359ae5430 con 0x55a359add900 2024-09-12T17:28:01.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.423+0000 7faa7c5da640 1 --2- 172.21.15.170:0/1127971110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a359add900 0x55a359ae4ed0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7faa6c0206f0 tx=0x7faa6c053260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.423+0000 7fa9597fa640 1 -- 172.21.15.170:0/1127971110 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa6c050050 con 0x55a359add900 2024-09-12T17:28:01.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.423+0000 7fa9597fa640 1 -- 172.21.15.170:0/1127971110 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa6c00b230 con 0x55a359add900 2024-09-12T17:28:01.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.423+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a359ae56c0 con 0x55a359add900 2024-09-12T17:28:01.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.423+0000 7fa9597fa640 1 -- 172.21.15.170:0/1127971110 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa6c013320 con 0x55a359add900 2024-09-12T17:28:01.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.423+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a359ae6040 con 0x55a359add900 2024-09-12T17:28:01.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.424+0000 7fa9597fa640 1 -- 172.21.15.170:0/1127971110 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7faa6c031030 con 0x55a359add900 2024-09-12T17:28:01.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.424+0000 7fa9597fa640 1 --2- 172.21.15.170:0/1127971110 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa94403c780 0x7fa94403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.424+0000 7fa9597fa640 1 -- 172.21.15.170:0/1127971110 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7faa6c02f070 con 0x55a359add900 2024-09-12T17:28:01.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.424+0000 7faa7bdd9640 1 --2- 172.21.15.170:0/1127971110 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa94403c780 0x7fa94403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.425+0000 7faa7bdd9640 1 --2- 172.21.15.170:0/1127971110 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa94403c780 0x7fa94403ec40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7faa74010f40 tx=0x7faa74046000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.425+0000 7faa80126800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.425+0000 7faa80126800 1 --2- 172.21.15.170:0/1127971110 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a359af07b0 0x55a359af2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.425+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a359af33c0 con 0x55a359af07b0 2024-09-12T17:28:01.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.425+0000 7faa7b5d8640 1 --2- 172.21.15.170:0/1127971110 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a359af07b0 0x55a359af2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.425+0000 7faa7b5d8640 1 --2- 172.21.15.170:0/1127971110 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a359af07b0 0x55a359af2c70 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.425+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faa64051070 con 0x55a359af07b0 2024-09-12T17:28:01.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.426+0000 7faa80126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.426+0000 7faa80126800 20 realm 2024-09-12T17:28:01.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.426+0000 7faa80126800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.426+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a359af37f0 con 0x55a359af07b0 2024-09-12T17:28:01.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.426+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faa64051070 con 0x55a359af07b0 2024-09-12T17:28:01.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.426+0000 7faa80126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.426+0000 7faa80126800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:01.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.426+0000 7faa80126800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.426+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a359af40c0 con 0x55a359af07b0 2024-09-12T17:28:01.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.426+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faa64051070 con 0x55a359af07b0 2024-09-12T17:28:01.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.426+0000 7faa80126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.426+0000 7faa80126800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.426+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a359af4460 con 0x55a359af07b0 2024-09-12T17:28:01.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.426+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faa64051070 con 0x55a359af07b0 2024-09-12T17:28:01.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.426+0000 7faa80126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:01.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.426+0000 7faa80126800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.426+0000 7faa80126800 1 --2- 172.21.15.170:0/1127971110 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a359af51c0 0x55a359af75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.426+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a359af7af0 con 0x55a359af51c0 2024-09-12T17:28:01.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.426+0000 7faa7c5da640 1 --2- 172.21.15.170:0/1127971110 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a359af51c0 0x55a359af75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.427+0000 7faa7c5da640 1 --2- 172.21.15.170:0/1127971110 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a359af51c0 0x55a359af75b0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.427+0000 7faa7c5da640 1 -- 172.21.15.170:0/1127971110 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7faa6c0083e0 con 0x55a359af51c0 2024-09-12T17:28:01.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.427+0000 7faa80126800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:01.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.427+0000 7faa80126800 20 searching for the correct realm 2024-09-12T17:28:01.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.427+0000 7faa80126800 1 --2- 172.21.15.170:0/1127971110 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55a359af9b30 0x55a359afbff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.427+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a359afc6c0 con 0x55a359af9b30 2024-09-12T17:28:01.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.427+0000 7faa7bdd9640 1 --2- 172.21.15.170:0/1127971110 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55a359af9b30 0x55a359afbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.427+0000 7faa7bdd9640 1 --2- 172.21.15.170:0/1127971110 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55a359af9b30 0x55a359afbff0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.428+0000 7faa7bdd9640 1 -- 172.21.15.170:0/1127971110 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa7401b070 con 0x55a359af9b30 2024-09-12T17:28:01.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.428+0000 7faa7bdd9640 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a359afc6c0 con 0x55a359af51c0 2024-09-12T17:28:01.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.428+0000 7faa7c5da640 1 -- 172.21.15.170:0/1127971110 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa6c0083e0 con 0x55a359af51c0 2024-09-12T17:28:01.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.428+0000 7faa7c5da640 1 --2- 172.21.15.170:0/1127971110 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7faa6c021020 0x7faa6c03aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.428+0000 7faa7c5da640 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a359afc6c0 con 0x7faa6c021020 2024-09-12T17:28:01.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.428+0000 7faa7b5d8640 1 --2- 172.21.15.170:0/1127971110 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7faa6c021020 0x7faa6c03aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.429+0000 7faa7b5d8640 1 --2- 172.21.15.170:0/1127971110 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7faa6c021020 0x7faa6c03aa10 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.429+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa64051070 con 0x7faa6c021020 2024-09-12T17:28:01.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.429+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a359afc6c0 con 0x55a359af07b0 2024-09-12T17:28:01.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.429+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa64051070 con 0x55a359af07b0 2024-09-12T17:28:01.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.429+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a359afc6c0 con 0x55a359af07b0 2024-09-12T17:28:01.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.429+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa64051070 con 0x55a359af07b0 2024-09-12T17:28:01.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.429+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a359afc6c0 con 0x7faa6c021020 2024-09-12T17:28:01.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.429+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa64051070 con 0x7faa6c021020 2024-09-12T17:28:01.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.429+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a359afc6c0 con 0x7faa6c021020 2024-09-12T17:28:01.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.430+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa64051070 con 0x7faa6c021020 2024-09-12T17:28:01.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.430+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a359afc6c0 con 0x55a359af51c0 2024-09-12T17:28:01.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.430+0000 7faa7c5da640 1 -- 172.21.15.170:0/1127971110 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa6c0083e0 con 0x55a359af51c0 2024-09-12T17:28:01.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.430+0000 7faa7c5da640 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a359afc6c0 con 0x55a359af9b30 2024-09-12T17:28:01.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.430+0000 7faa7bdd9640 1 -- 172.21.15.170:0/1127971110 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa7401b070 con 0x55a359af9b30 2024-09-12T17:28:01.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.430+0000 7faa7bdd9640 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a359afc6c0 con 0x55a359af07b0 2024-09-12T17:28:01.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.430+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa64051070 con 0x55a359af07b0 2024-09-12T17:28:01.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.430+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a359afc6c0 con 0x7faa6c021020 2024-09-12T17:28:01.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.431+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa64051070 con 0x7faa6c021020 2024-09-12T17:28:01.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.431+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a359afc6c0 con 0x55a359af07b0 2024-09-12T17:28:01.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.431+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa64051070 con 0x55a359af07b0 2024-09-12T17:28:01.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.431+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a359afc6c0 con 0x55a359af51c0 2024-09-12T17:28:01.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.431+0000 7faa7c5da640 1 -- 172.21.15.170:0/1127971110 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7faa6c0083e0 con 0x55a359af51c0 2024-09-12T17:28:01.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.431+0000 7faa7c5da640 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a359afc6c0 con 0x55a359af9b30 2024-09-12T17:28:01.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.431+0000 7faa7bdd9640 1 -- 172.21.15.170:0/1127971110 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa7401b070 con 0x55a359af9b30 2024-09-12T17:28:01.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.431+0000 7faa7bdd9640 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a359afc6c0 con 0x55a359af9b30 2024-09-12T17:28:01.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.432+0000 7faa7bdd9640 1 -- 172.21.15.170:0/1127971110 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa7401b070 con 0x55a359af9b30 2024-09-12T17:28:01.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.432+0000 7faa7bdd9640 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a359afc6c0 con 0x7faa6c021020 2024-09-12T17:28:01.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.432+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa64051070 con 0x7faa6c021020 2024-09-12T17:28:01.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.432+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a359afc6c0 con 0x55a359af9b30 2024-09-12T17:28:01.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.432+0000 7faa7bdd9640 1 -- 172.21.15.170:0/1127971110 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa7401b070 con 0x55a359af9b30 2024-09-12T17:28:01.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.432+0000 7faa7bdd9640 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a359afc6c0 con 0x55a359af9b30 2024-09-12T17:28:01.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.432+0000 7faa7bdd9640 1 -- 172.21.15.170:0/1127971110 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa7401b070 con 0x55a359af9b30 2024-09-12T17:28:01.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.432+0000 7faa7bdd9640 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a359afc6c0 con 0x55a359af07b0 2024-09-12T17:28:01.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.432+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa64051070 con 0x55a359af07b0 2024-09-12T17:28:01.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.432+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a359afc6c0 con 0x55a359af07b0 2024-09-12T17:28:01.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.433+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7faa64051070 con 0x55a359af07b0 2024-09-12T17:28:01.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.433+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a359afc6c0 con 0x7faa6c021020 2024-09-12T17:28:01.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.433+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa64051070 con 0x7faa6c021020 2024-09-12T17:28:01.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.433+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a359afc6c0 con 0x55a359af9b30 2024-09-12T17:28:01.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.433+0000 7faa7bdd9640 1 -- 172.21.15.170:0/1127971110 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa7401b070 con 0x55a359af9b30 2024-09-12T17:28:01.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.433+0000 7faa7bdd9640 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a359afc6c0 con 0x55a359af51c0 2024-09-12T17:28:01.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.433+0000 7faa7c5da640 1 -- 172.21.15.170:0/1127971110 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa6c0083e0 con 0x55a359af51c0 2024-09-12T17:28:01.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.433+0000 7faa7c5da640 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7faa6c060040 con 0x55a359af07b0 2024-09-12T17:28:01.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.434+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa64051070 con 0x55a359af07b0 2024-09-12T17:28:01.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.434+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7faa6c060040 con 0x7faa6c021020 2024-09-12T17:28:01.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.434+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa64051070 con 0x7faa6c021020 2024-09-12T17:28:01.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.434+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7faa6c060040 con 0x55a359af9b30 2024-09-12T17:28:01.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.434+0000 7faa7bdd9640 1 -- 172.21.15.170:0/1127971110 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa7401b070 con 0x55a359af9b30 2024-09-12T17:28:01.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.435+0000 7faa7bdd9640 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7faa6c060040 con 0x7faa6c021020 2024-09-12T17:28:01.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.435+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa64051070 con 0x7faa6c021020 2024-09-12T17:28:01.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.435+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7faa6c060040 con 0x55a359af51c0 2024-09-12T17:28:01.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.435+0000 7faa7c5da640 1 -- 172.21.15.170:0/1127971110 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa6c0083e0 con 0x55a359af51c0 2024-09-12T17:28:01.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.435+0000 7faa7c5da640 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7faa6c060040 con 0x55a359af9b30 2024-09-12T17:28:01.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.435+0000 7faa7bdd9640 1 -- 172.21.15.170:0/1127971110 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa7401b070 con 0x55a359af9b30 2024-09-12T17:28:01.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.435+0000 7faa7bdd9640 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7faa6c060040 con 0x7faa6c021020 2024-09-12T17:28:01.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.436+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa64051070 con 0x7faa6c021020 2024-09-12T17:28:01.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.436+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7faa6c060040 con 0x55a359af07b0 2024-09-12T17:28:01.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.436+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7faa64051070 con 0x55a359af07b0 2024-09-12T17:28:01.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.436+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7faa6c060040 con 0x55a359af51c0 2024-09-12T17:28:01.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.436+0000 7faa7c5da640 1 -- 172.21.15.170:0/1127971110 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7faa6c0083e0 con 0x55a359af51c0 2024-09-12T17:28:01.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.436+0000 7faa80126800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:01.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.436+0000 7faa80126800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:01.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.436+0000 7faa80126800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:01.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.436+0000 7faa80126800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:01.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.436+0000 7faa80126800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:01.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.436+0000 7faa80126800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:01.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.436+0000 7faa80126800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.436+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a359af8530 con 0x55a359af07b0 2024-09-12T17:28:01.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.436+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faa64051070 con 0x55a359af07b0 2024-09-12T17:28:01.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.436+0000 7faa80126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.436+0000 7faa80126800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.436+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a359af8110 con 0x55a359af07b0 2024-09-12T17:28:01.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.436+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faa64051070 con 0x55a359af07b0 2024-09-12T17:28:01.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.436+0000 7faa80126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:01.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.436+0000 7faa80126800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.436+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a359af8e50 con 0x55a359af51c0 2024-09-12T17:28:01.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.437+0000 7faa7c5da640 1 -- 172.21.15.170:0/1127971110 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7faa6c0083e0 con 0x55a359af51c0 2024-09-12T17:28:01.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.437+0000 7faa80126800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:01.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.437+0000 7faa80126800 20 zone default found 2024-09-12T17:28:01.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.437+0000 7faa80126800 4 Realm: () 2024-09-12T17:28:01.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.437+0000 7faa80126800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:01.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.437+0000 7faa80126800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:01.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.437+0000 7faa80126800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:01.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.437+0000 7faa80126800 20 zonegroup default 2024-09-12T17:28:01.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.437+0000 7faa80126800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.437+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a359afcb40 con 0x7faa6c021020 2024-09-12T17:28:01.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.437+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7faa64051070 con 0x7faa6c021020 2024-09-12T17:28:01.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.437+0000 7faa80126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.437+0000 7faa80126800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.437+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a359afea60 con 0x55a359af9b30 2024-09-12T17:28:01.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.437+0000 7faa7bdd9640 1 -- 172.21.15.170:0/1127971110 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faa7401b070 con 0x55a359af9b30 2024-09-12T17:28:01.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.437+0000 7faa80126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.437+0000 7faa80126800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.437+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a359afeeb0 con 0x55a359af9b30 2024-09-12T17:28:01.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.438+0000 7faa7bdd9640 1 -- 172.21.15.170:0/1127971110 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faa7401b070 con 0x55a359af9b30 2024-09-12T17:28:01.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.438+0000 7faa80126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.438+0000 7faa80126800 20 started sync module instance, tier type = 2024-09-12T17:28:01.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.438+0000 7faa80126800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:01.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.438+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a359afdd70 con 0x55a359af51c0 2024-09-12T17:28:01.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.439+0000 7faa7c5da640 1 -- 172.21.15.170:0/1127971110 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa6c0083e0 con 0x55a359af51c0 2024-09-12T17:28:01.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.439+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94160072729200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a359afdd70 con 0x55a359af51c0 2024-09-12T17:28:01.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.439+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a359aff9e0 con 0x55a359af07b0 2024-09-12T17:28:01.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.440+0000 7faa7c5da640 1 -- 172.21.15.170:0/1127971110 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94160072729200] v29'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa6c0083e0 con 0x55a359af51c0 2024-09-12T17:28:01.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.440+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa64051070 con 0x55a359af07b0 2024-09-12T17:28:01.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.440+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94160072733904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a359afdd70 con 0x55a359af07b0 2024-09-12T17:28:01.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.440+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a359b004a0 con 0x55a359af9b30 2024-09-12T17:28:01.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.441+0000 7faa7bdd9640 1 -- 172.21.15.170:0/1127971110 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa7401b070 con 0x55a359af9b30 2024-09-12T17:28:01.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.441+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94160072736624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a359b00460 con 0x55a359af9b30 2024-09-12T17:28:01.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.441+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a359b01460 con 0x55a359af51c0 2024-09-12T17:28:01.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.441+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94160072733904] v29'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa64051070 con 0x55a359af07b0 2024-09-12T17:28:01.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.442+0000 7faa7bdd9640 1 -- 172.21.15.170:0/1127971110 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94160072736624] v29'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa7401b070 con 0x55a359af9b30 2024-09-12T17:28:01.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.442+0000 7faa7c5da640 1 -- 172.21.15.170:0/1127971110 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa6c0083e0 con 0x55a359af51c0 2024-09-12T17:28:01.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.442+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94160072738960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a359afd8c0 con 0x55a359af51c0 2024-09-12T17:28:01.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.442+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a359b01a80 con 0x55a359af07b0 2024-09-12T17:28:01.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.443+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa64051070 con 0x55a359af07b0 2024-09-12T17:28:01.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.443+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94160072742352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a359b01ea0 con 0x55a359af07b0 2024-09-12T17:28:01.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.443+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a359b02940 con 0x7faa6c021020 2024-09-12T17:28:01.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.443+0000 7faa7c5da640 1 -- 172.21.15.170:0/1127971110 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94160072738960] v29'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa6c0083e0 con 0x55a359af51c0 2024-09-12T17:28:01.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.444+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94160072742352] v29'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa64051070 con 0x55a359af07b0 2024-09-12T17:28:01.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.444+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa64051070 con 0x7faa6c021020 2024-09-12T17:28:01.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.444+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94160072746000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a359b019f0 con 0x7faa6c021020 2024-09-12T17:28:01.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.444+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a359b031e0 con 0x7faa6c021020 2024-09-12T17:28:01.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.445+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v29'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa64051070 con 0x7faa6c021020 2024-09-12T17:28:01.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.445+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94160072748176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a359b03560 con 0x7faa6c021020 2024-09-12T17:28:01.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.445+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a359b03db0 con 0x7faa6c021020 2024-09-12T17:28:01.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.446+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94160072746000] v29'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa64051070 con 0x7faa6c021020 2024-09-12T17:28:01.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.446+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94160072748176] v29'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa64051070 con 0x7faa6c021020 2024-09-12T17:28:01.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.446+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(58 notify.7 [create] v29'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa64051070 con 0x7faa6c021020 2024-09-12T17:28:01.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.446+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94160072749232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a359b03980 con 0x7faa6c021020 2024-09-12T17:28:01.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.446+0000 7faa80126800 20 add_watcher() i=0 2024-09-12T17:28:01.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.446+0000 7faa80126800 20 add_watcher() i=1 2024-09-12T17:28:01.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.446+0000 7faa80126800 20 add_watcher() i=2 2024-09-12T17:28:01.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.446+0000 7faa80126800 20 add_watcher() i=3 2024-09-12T17:28:01.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.446+0000 7faa80126800 20 add_watcher() i=4 2024-09-12T17:28:01.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.446+0000 7faa80126800 20 add_watcher() i=5 2024-09-12T17:28:01.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.446+0000 7faa80126800 20 add_watcher() i=6 2024-09-12T17:28:01.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.447+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94160072749232] v29'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa64051070 con 0x7faa6c021020 2024-09-12T17:28:01.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.447+0000 7faa80126800 20 add_watcher() i=7 2024-09-12T17:28:01.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.447+0000 7faa80126800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:01.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.447+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a359b06b20 con 0x55a359af07b0 2024-09-12T17:28:01.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.448+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7faa64051070 con 0x55a359af07b0 2024-09-12T17:28:01.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.448+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94160072762672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a359b03980 con 0x55a359af07b0 2024-09-12T17:28:01.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.449+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94160072762672] v29'80 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faa64051070 con 0x55a359af07b0 2024-09-12T17:28:01.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.449+0000 7fa931fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:01.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.449+0000 7faa80126800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:01.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.449+0000 7faa80126800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:01.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.449+0000 7faa80126800 5 note: GC not initialized 2024-09-12T17:28:01.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.449+0000 7fa930fe1640 20 reqs_thread_entry: start 2024-09-12T17:28:01.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.449+0000 7faa80126800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:01.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.449+0000 7faa80126800 20 Filter name: none 2024-09-12T17:28:01.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.449+0000 7fa8aa7fc640 20 reqs_thread_entry: start 2024-09-12T17:28:01.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.449+0000 7faa80126800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.449+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a359b39730 con 0x55a359af07b0 2024-09-12T17:28:01.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.450+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7faa64051070 con 0x55a359af07b0 2024-09-12T17:28:01.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.450+0000 7faa80126800 20 rados_obj.operate() r=0 bl.length=673 2024-09-12T17:28:01.469 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T17:27:59.362376Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-12T17:28:01.319035Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:27:59.362351Z","tags":[],"group_ids":[]} 2024-09-12T17:28:01.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.451+0000 7fa931fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:01.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.451+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94160072762672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a359aedb80 con 0x55a359af07b0 2024-09-12T17:28:01.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.452+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94160072762672] v29'81 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faa64051070 con 0x55a359af07b0 2024-09-12T17:28:01.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.452+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94160072729200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a359b06530 con 0x55a359af51c0 2024-09-12T17:28:01.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.453+0000 7faa7c5da640 1 -- 172.21.15.170:0/1127971110 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94160072729200] v29'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa6c0083e0 con 0x55a359af51c0 2024-09-12T17:28:01.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.453+0000 7faa80126800 20 remove_watcher() i=0 2024-09-12T17:28:01.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.453+0000 7faa80126800 2 removed watcher, disabling cache 2024-09-12T17:28:01.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.453+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94160072733904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a359afe270 con 0x55a359af07b0 2024-09-12T17:28:01.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.454+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94160072733904] v29'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa64051070 con 0x55a359af07b0 2024-09-12T17:28:01.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.454+0000 7faa80126800 20 remove_watcher() i=1 2024-09-12T17:28:01.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.454+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94160072736624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a359afe270 con 0x55a359af9b30 2024-09-12T17:28:01.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.455+0000 7faa7bdd9640 1 -- 172.21.15.170:0/1127971110 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94160072736624] v29'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa7401b070 con 0x55a359af9b30 2024-09-12T17:28:01.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.455+0000 7faa80126800 20 remove_watcher() i=2 2024-09-12T17:28:01.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.455+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94160072738960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a359afe270 con 0x55a359af51c0 2024-09-12T17:28:01.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.456+0000 7faa7c5da640 1 -- 172.21.15.170:0/1127971110 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94160072738960] v29'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa6c0083e0 con 0x55a359af51c0 2024-09-12T17:28:01.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.456+0000 7faa80126800 20 remove_watcher() i=3 2024-09-12T17:28:01.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.456+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94160072742352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a359b00890 con 0x55a359af07b0 2024-09-12T17:28:01.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.457+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94160072742352] v29'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa64051070 con 0x55a359af07b0 2024-09-12T17:28:01.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.457+0000 7faa80126800 20 remove_watcher() i=4 2024-09-12T17:28:01.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.457+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94160072746000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a359afe270 con 0x7faa6c021020 2024-09-12T17:28:01.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.458+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94160072746000] v29'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa64051070 con 0x7faa6c021020 2024-09-12T17:28:01.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.458+0000 7faa80126800 20 remove_watcher() i=5 2024-09-12T17:28:01.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.458+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94160072748176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a359b015d0 con 0x7faa6c021020 2024-09-12T17:28:01.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.459+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94160072748176] v29'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa64051070 con 0x7faa6c021020 2024-09-12T17:28:01.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.459+0000 7faa80126800 20 remove_watcher() i=6 2024-09-12T17:28:01.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.459+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94160072749232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a359b00890 con 0x7faa6c021020 2024-09-12T17:28:01.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.460+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94160072749232] v29'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa64051070 con 0x7faa6c021020 2024-09-12T17:28:01.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.460+0000 7faa80126800 20 remove_watcher() i=7 2024-09-12T17:28:01.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.460+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7faa6c021020 msgr2=0x7faa6c03aa10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.460+0000 7faa80126800 1 --2- 172.21.15.170:0/1127971110 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7faa6c021020 0x7faa6c03aa10 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.460+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a359af07b0 msgr2=0x55a359af2c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.460+0000 7faa80126800 1 --2- 172.21.15.170:0/1127971110 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a359af07b0 0x55a359af2c70 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.460+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a359af51c0 msgr2=0x55a359af75b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.460+0000 7faa80126800 1 --2- 172.21.15.170:0/1127971110 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a359af51c0 0x55a359af75b0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.460+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55a359af9b30 msgr2=0x55a359afbff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.460+0000 7faa80126800 1 --2- 172.21.15.170:0/1127971110 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55a359af9b30 0x55a359afbff0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.460+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa94403c780 msgr2=0x7fa94403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.460+0000 7faa80126800 1 --2- 172.21.15.170:0/1127971110 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa94403c780 0x7fa94403ec40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7faa74010f40 tx=0x7faa74046000 comp rx=0 tx=0).stop 2024-09-12T17:28:01.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.460+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a359add900 msgr2=0x55a359ae4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.460+0000 7faa80126800 1 --2- 172.21.15.170:0/1127971110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a359add900 0x55a359ae4ed0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7faa6c0206f0 tx=0x7faa6c053260 comp rx=0 tx=0).stop 2024-09-12T17:28:01.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.460+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 reap_dead start 2024-09-12T17:28:01.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.460+0000 7faa7b5d8640 1 -- 172.21.15.170:0/1127971110 reap_dead start 2024-09-12T17:28:01.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.460+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 shutdown_connections 2024-09-12T17:28:01.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.460+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 >> 172.21.15.170:0/1127971110 conn(0x55a359ad9d00 msgr2=0x55a359ad7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:01.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.460+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 shutdown_connections 2024-09-12T17:28:01.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.460+0000 7faa80126800 1 -- 172.21.15.170:0/1127971110 wait complete. 2024-09-12T17:28:01.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.461+0000 7faa80126800 1 -- 172.21.15.170:0/2829878949 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa95403c730 msgr2=0x7fa95403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.461+0000 7faa80126800 1 --2- 172.21.15.170:0/2829878949 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa95403c730 0x7fa95403ebf0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x55a359ac0780 tx=0x7faa74014e90 comp rx=0 tx=0).stop 2024-09-12T17:28:01.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.461+0000 7faa80126800 1 -- 172.21.15.170:0/2829878949 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3599bcda0 msgr2=0x55a3599bb610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.461+0000 7faa80126800 1 --2- 172.21.15.170:0/2829878949 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3599bcda0 0x55a3599bb610 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x55a359ab5cd0 tx=0x7faa6c00bf30 comp rx=0 tx=0).stop 2024-09-12T17:28:01.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.461+0000 7faa80126800 1 -- 172.21.15.170:0/2829878949 shutdown_connections 2024-09-12T17:28:01.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.461+0000 7faa80126800 1 --2- 172.21.15.170:0/2829878949 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa95403c730 0x7fa95403ebf0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.461+0000 7faa80126800 1 --2- 172.21.15.170:0/2829878949 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3599bcda0 0x55a3599bb610 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.461+0000 7faa80126800 1 -- 172.21.15.170:0/2829878949 >> 172.21.15.170:0/2829878949 conn(0x55a359ac3060 msgr2=0x55a359ac3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:01.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.461+0000 7faa80126800 1 -- 172.21.15.170:0/2829878949 shutdown_connections 2024-09-12T17:28:01.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.461+0000 7faa80126800 1 -- 172.21.15.170:0/2829878949 wait complete. 2024-09-12T17:28:01.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.461+0000 7faa80126800 1 -- 172.21.15.170:0/3948071063 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a3599c1200 msgr2=0x55a359abb430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.461+0000 7faa80126800 1 --2- 172.21.15.170:0/3948071063 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a3599c1200 0x55a359abb430 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.461+0000 7faa80126800 1 -- 172.21.15.170:0/3948071063 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a359abd7d0 msgr2=0x55a359abfc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.461+0000 7faa80126800 1 --2- 172.21.15.170:0/3948071063 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a359abd7d0 0x55a359abfc50 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.461+0000 7faa80126800 1 -- 172.21.15.170:0/3948071063 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa96403c780 msgr2=0x7fa96403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.461+0000 7faa80126800 1 --2- 172.21.15.170:0/3948071063 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa96403c780 0x7fa96403ec40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7faa64057000 tx=0x7faa64052000 comp rx=0 tx=0).stop 2024-09-12T17:28:01.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.461+0000 7faa80126800 1 -- 172.21.15.170:0/3948071063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3599bd600 msgr2=0x55a359ab3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.461+0000 7faa80126800 1 --2- 172.21.15.170:0/3948071063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3599bd600 0x55a359ab3de0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7faa74001330 tx=0x7faa74001250 comp rx=0 tx=0).stop 2024-09-12T17:28:01.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.461+0000 7faa80126800 1 -- 172.21.15.170:0/3948071063 shutdown_connections 2024-09-12T17:28:01.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.461+0000 7faa80126800 1 --2- 172.21.15.170:0/3948071063 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a359abd7d0 0x55a359abfc50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.461+0000 7faa80126800 1 --2- 172.21.15.170:0/3948071063 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa96403c780 0x7fa96403ec40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.461+0000 7faa80126800 1 --2- 172.21.15.170:0/3948071063 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a3599c1200 0x55a359abb430 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.461+0000 7faa80126800 1 --2- 172.21.15.170:0/3948071063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a3599bd600 0x55a359ab3de0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.461+0000 7faa80126800 1 -- 172.21.15.170:0/3948071063 >> 172.21.15.170:0/3948071063 conn(0x55a3599b71c0 msgr2=0x55a359aad7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:01.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.461+0000 7faa80126800 1 -- 172.21.15.170:0/3948071063 shutdown_connections 2024-09-12T17:28:01.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.461+0000 7faa80126800 1 -- 172.21.15.170:0/3948071063 wait complete. 2024-09-12T17:28:01.481 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T17:27:59.362376Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-12T17:28:01.319035Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:27:59.362351Z', 'tags': [], 'group_ids': []} 2024-09-12T17:28:01.482 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-12T17:28:01.482 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-12T17:28:01.482 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-09-12T17:28:01.528 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:01.529 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:01.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.527+0000 7f4208742800 1 Processor -- start 2024-09-12T17:28:01.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.527+0000 7f4208742800 1 -- start start 2024-09-12T17:28:01.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.527+0000 7f4208742800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x558f691cde00 0x558f691ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.527+0000 7f4208742800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558f69078e40 con 0x558f691cf040 2024-09-12T17:28:01.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.527+0000 7f4208742800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x558f69043680 con 0x558f691cde00 2024-09-12T17:28:01.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.527+0000 7f4204486640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x558f691cde00 0x558f691ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.527+0000 7f4203c85640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x558f691cf040 0x558f691d3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:48364/0 (socket says 172.21.15.170:48364) 2024-09-12T17:28:01.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.527+0000 7f4203c85640 1 -- 172.21.15.170:0/2876036503 learned_addr learned my addr 172.21.15.170:0/2876036503 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:28:01.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.528+0000 7f4204486640 1 -- 172.21.15.170:0/2876036503 >> v1:172.21.15.47:6789/0 conn(0x558f691cf040 legacy=0x558f691d3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.528+0000 7f4204486640 1 -- 172.21.15.170:0/2876036503 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f6905f6b0 con 0x558f691cde00 2024-09-12T17:28:01.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.528+0000 7f4203484640 1 -- 172.21.15.170:0/2876036503 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1228375221 0 0) 0x558f69078e40 con 0x558f691cf040 2024-09-12T17:28:01.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.529+0000 7f4204486640 1 --2- 172.21.15.170:0/2876036503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558f691cde00 0x558f691ceb00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f41f400a470 tx=0x7f41f4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73169dfbd7635d24 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.529+0000 7f4203484640 1 -- 172.21.15.170:0/2876036503 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41f4053570 con 0x558f691cde00 2024-09-12T17:28:01.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.530+0000 7f4203484640 1 -- 172.21.15.170:0/2876036503 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41f4058070 con 0x558f691cde00 2024-09-12T17:28:01.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.530+0000 7f4203484640 1 -- 172.21.15.170:0/2876036503 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41f4053880 con 0x558f691cde00 2024-09-12T17:28:01.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.530+0000 7f4208742800 1 -- 172.21.15.170:0/2876036503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558f691cde00 msgr2=0x558f691ceb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.530+0000 7f4208742800 1 --2- 172.21.15.170:0/2876036503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558f691cde00 0x558f691ceb00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f41f400a470 tx=0x7f41f4045a20 comp rx=0 tx=0).stop 2024-09-12T17:28:01.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.530+0000 7f4208742800 1 -- 172.21.15.170:0/2876036503 shutdown_connections 2024-09-12T17:28:01.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.530+0000 7f4208742800 1 --2- 172.21.15.170:0/2876036503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558f691cde00 0x558f691ceb00 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.530+0000 7f4208742800 1 -- 172.21.15.170:0/2876036503 >> 172.21.15.170:0/2876036503 conn(0x558f691c91d0 msgr2=0x558f691cb630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:01.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.530+0000 7f4208742800 1 -- 172.21.15.170:0/2876036503 shutdown_connections 2024-09-12T17:28:01.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.530+0000 7f4208742800 1 -- 172.21.15.170:0/2876036503 wait complete. 2024-09-12T17:28:01.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.544+0000 7f4208742800 1 Processor -- start 2024-09-12T17:28:01.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.544+0000 7f4208742800 1 -- start start 2024-09-12T17:28:01.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.544+0000 7f4208742800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558f691cde00 0x558f69141dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.544+0000 7f4208742800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558f69067dd0 con 0x558f691cde00 2024-09-12T17:28:01.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.544+0000 7f4204486640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558f691cde00 0x558f69141dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.545+0000 7f4204486640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558f691cde00 0x558f69141dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57348/0 (socket says 172.21.15.170:57348) 2024-09-12T17:28:01.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.545+0000 7f4204486640 1 -- 172.21.15.170:0/439706721 learned_addr learned my addr 172.21.15.170:0/439706721 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:01.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.545+0000 7f4204486640 1 -- 172.21.15.170:0/439706721 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f69080e10 con 0x558f691cde00 2024-09-12T17:28:01.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.545+0000 7f4204486640 1 --2- 172.21.15.170:0/439706721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558f691cde00 0x558f69141dc0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f41f400a470 tx=0x7f41f4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf60442334b50052 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.545+0000 7f40f260c640 1 -- 172.21.15.170:0/439706721 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41f4053570 con 0x558f691cde00 2024-09-12T17:28:01.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.545+0000 7f40f260c640 1 -- 172.21.15.170:0/439706721 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41f4063030 con 0x558f691cde00 2024-09-12T17:28:01.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.545+0000 7f40f260c640 1 -- 172.21.15.170:0/439706721 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41f4053840 con 0x558f691cde00 2024-09-12T17:28:01.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.546+0000 7f4208742800 1 -- 172.21.15.170:0/439706721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558f691cde00 msgr2=0x558f69141dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.546+0000 7f4208742800 1 --2- 172.21.15.170:0/439706721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558f691cde00 0x558f69141dc0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f41f400a470 tx=0x7f41f4051000 comp rx=0 tx=0).stop 2024-09-12T17:28:01.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.546+0000 7f4208742800 1 -- 172.21.15.170:0/439706721 shutdown_connections 2024-09-12T17:28:01.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.546+0000 7f4208742800 1 --2- 172.21.15.170:0/439706721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558f691cde00 0x558f69141dc0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.546+0000 7f4208742800 1 -- 172.21.15.170:0/439706721 >> 172.21.15.170:0/439706721 conn(0x558f691c91d0 msgr2=0x558f692b8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:01.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.546+0000 7f4208742800 1 -- 172.21.15.170:0/439706721 shutdown_connections 2024-09-12T17:28:01.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.546+0000 7f4208742800 1 -- 172.21.15.170:0/439706721 wait complete. 2024-09-12T17:28:01.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.546+0000 7f4208742800 1 Processor -- start 2024-09-12T17:28:01.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.546+0000 7f4208742800 1 -- start start 2024-09-12T17:28:01.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.546+0000 7f4208742800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558f691cde00 0x558f692be770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.546+0000 7f4208742800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558f691cf730 con 0x558f691cde00 2024-09-12T17:28:01.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.547+0000 7f4204486640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558f691cde00 0x558f692be770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.547+0000 7f4204486640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558f691cde00 0x558f692be770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57362/0 (socket says 172.21.15.170:57362) 2024-09-12T17:28:01.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.547+0000 7f4204486640 1 -- 172.21.15.170:0/30176600 learned_addr learned my addr 172.21.15.170:0/30176600 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:01.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.547+0000 7f4204486640 1 -- 172.21.15.170:0/30176600 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f692becd0 con 0x558f691cde00 2024-09-12T17:28:01.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.547+0000 7f4204486640 1 --2- 172.21.15.170:0/30176600 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558f691cde00 0x558f692be770 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f41f400a470 tx=0x7f41f4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.547+0000 7f40f0e09640 1 -- 172.21.15.170:0/30176600 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41f4078070 con 0x558f691cde00 2024-09-12T17:28:01.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.547+0000 7f40f0e09640 1 -- 172.21.15.170:0/30176600 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41f4068420 con 0x558f691cde00 2024-09-12T17:28:01.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.547+0000 7f4208742800 1 -- 172.21.15.170:0/30176600 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558f692bd080 con 0x558f691cde00 2024-09-12T17:28:01.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.547+0000 7f40f0e09640 1 -- 172.21.15.170:0/30176600 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41f4068700 con 0x558f691cde00 2024-09-12T17:28:01.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.547+0000 7f4208742800 1 -- 172.21.15.170:0/30176600 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f692bd6a0 con 0x558f691cde00 2024-09-12T17:28:01.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.548+0000 7f40f0e09640 1 -- 172.21.15.170:0/30176600 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f41f407b070 con 0x558f691cde00 2024-09-12T17:28:01.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.548+0000 7f40f0e09640 1 --2- 172.21.15.170:0/30176600 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f40ec03c730 0x7f40ec03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.548+0000 7f40f0e09640 1 -- 172.21.15.170:0/30176600 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f41f4097770 con 0x558f691cde00 2024-09-12T17:28:01.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.548+0000 7f4203c85640 1 --2- 172.21.15.170:0/30176600 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f40ec03c730 0x7f40ec03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.549+0000 7f4208742800 1 --2- 172.21.15.170:0/30176600 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x558f691cf040 0x558f692cf280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.549+0000 7f4208742800 1 -- 172.21.15.170:0/30176600 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558f692cf800 con 0x558f691cf040 2024-09-12T17:28:01.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.549+0000 7f4204c87640 1 --2- 172.21.15.170:0/30176600 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x558f691cf040 0x558f692cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.549+0000 7f4203c85640 1 --2- 172.21.15.170:0/30176600 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f40ec03c730 0x7f40ec03ebf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f41f8000c00 tx=0x7f41f80013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.549+0000 7f4204c87640 1 --2- 172.21.15.170:0/30176600 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x558f691cf040 0x558f692cf280 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.549+0000 7f4204c87640 1 -- 172.21.15.170:0/30176600 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f41fc00a4d0 con 0x558f691cf040 2024-09-12T17:28:01.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.549+0000 7f4208742800 1 -- 172.21.15.170:0/30176600 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558f692bdb80 con 0x558f691cf040 2024-09-12T17:28:01.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.549+0000 7f4204c87640 1 -- 172.21.15.170:0/30176600 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f41fc00a4d0 con 0x558f691cf040 2024-09-12T17:28:01.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.550+0000 7f4208742800 1 --2- 172.21.15.170:0/30176600 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x558f692d1b10 0x558f692d3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.550+0000 7f4208742800 1 -- 172.21.15.170:0/30176600 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558f692d45d0 con 0x558f692d1b10 2024-09-12T17:28:01.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.550+0000 7f4204486640 1 --2- 172.21.15.170:0/30176600 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x558f692d1b10 0x558f692d3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.550+0000 7f4204486640 1 --2- 172.21.15.170:0/30176600 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x558f692d1b10 0x558f692d3f00 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.550+0000 7f4204486640 1 -- 172.21.15.170:0/30176600 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f41f407a030 con 0x558f692d1b10 2024-09-12T17:28:01.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.550+0000 7f4208742800 1 -- 172.21.15.170:0/30176600 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558f692d08f0 con 0x558f691cf040 2024-09-12T17:28:01.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.550+0000 7f4204c87640 1 -- 172.21.15.170:0/30176600 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f41fc00a4d0 con 0x558f691cf040 2024-09-12T17:28:01.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.551+0000 7f4208742800 1 -- 172.21.15.170:0/30176600 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558f692d0d90 con 0x558f692d1b10 2024-09-12T17:28:01.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.551+0000 7f4204486640 1 -- 172.21.15.170:0/30176600 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f41f407a030 con 0x558f692d1b10 2024-09-12T17:28:01.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.551+0000 7f4208742800 1 Processor -- start 2024-09-12T17:28:01.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.551+0000 7f4208742800 1 -- start start 2024-09-12T17:28:01.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.551+0000 7f4208742800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558f692e2dc0 0x558f692e31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.551+0000 7f4208742800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558f690c5a00 con 0x558f692e2dc0 2024-09-12T17:28:01.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.552+0000 7f4204c87640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558f692e2dc0 0x558f692e31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.552+0000 7f4204c87640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558f692e2dc0 0x558f692e31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57366/0 (socket says 172.21.15.170:57366) 2024-09-12T17:28:01.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.552+0000 7f4204c87640 1 -- 172.21.15.170:0/2475309653 learned_addr learned my addr 172.21.15.170:0/2475309653 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:01.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.552+0000 7f4204c87640 1 -- 172.21.15.170:0/2475309653 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f692e3820 con 0x558f692e2dc0 2024-09-12T17:28:01.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.552+0000 7f4204c87640 1 --2- 172.21.15.170:0/2475309653 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558f692e2dc0 0x558f692e31e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x558f692be310 tx=0x7f41fc0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.552+0000 7f40e9ffb640 1 -- 172.21.15.170:0/2475309653 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41fc013640 con 0x558f692e2dc0 2024-09-12T17:28:01.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.552+0000 7f40e9ffb640 1 -- 172.21.15.170:0/2475309653 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41fc0137e0 con 0x558f692e2dc0 2024-09-12T17:28:01.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.552+0000 7f4208742800 1 -- 172.21.15.170:0/2475309653 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558f692e4050 con 0x558f692e2dc0 2024-09-12T17:28:01.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.552+0000 7f40e9ffb640 1 -- 172.21.15.170:0/2475309653 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41fc013ae0 con 0x558f692e2dc0 2024-09-12T17:28:01.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.552+0000 7f4208742800 1 -- 172.21.15.170:0/2475309653 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f692e45f0 con 0x558f692e2dc0 2024-09-12T17:28:01.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.553+0000 7f40e9ffb640 1 -- 172.21.15.170:0/2475309653 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f41fc011040 con 0x558f692e2dc0 2024-09-12T17:28:01.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.553+0000 7f40e9ffb640 1 --2- 172.21.15.170:0/2475309653 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f40dc03c730 0x7f40dc03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.553+0000 7f40e9ffb640 1 -- 172.21.15.170:0/2475309653 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f41fc00e040 con 0x558f692e2dc0 2024-09-12T17:28:01.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.553+0000 7f4204486640 1 --2- 172.21.15.170:0/2475309653 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f40dc03c730 0x7f40dc03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.554+0000 7f4208742800 1 Processor -- start 2024-09-12T17:28:01.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.554+0000 7f4208742800 1 -- start start 2024-09-12T17:28:01.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.554+0000 7f4204486640 1 --2- 172.21.15.170:0/2475309653 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f40dc03c730 0x7f40dc03ebf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x558f692cfcb0 tx=0x7f41f4052650 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.554+0000 7f4208742800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558f692ef900 0x558f692efce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.554+0000 7f4208742800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558f692c1110 con 0x558f692ef900 2024-09-12T17:28:01.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.554+0000 7f4204c87640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558f692ef900 0x558f692efce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.554+0000 7f4204c87640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558f692ef900 0x558f692efce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57376/0 (socket says 172.21.15.170:57376) 2024-09-12T17:28:01.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.554+0000 7f4204c87640 1 -- 172.21.15.170:0/3480480290 learned_addr learned my addr 172.21.15.170:0/3480480290 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:01.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.554+0000 7f4204c87640 1 -- 172.21.15.170:0/3480480290 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f692f02d0 con 0x558f692ef900 2024-09-12T17:28:01.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.554+0000 7f4204c87640 1 --2- 172.21.15.170:0/3480480290 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558f692ef900 0x558f692efce0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f41fc053d60 tx=0x7f41fc01fc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2db682509b718ef5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.554+0000 7f40e37fe640 1 -- 172.21.15.170:0/3480480290 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41fc021910 con 0x558f692ef900 2024-09-12T17:28:01.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.554+0000 7f40e37fe640 1 -- 172.21.15.170:0/3480480290 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41fc021440 con 0x558f692ef900 2024-09-12T17:28:01.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.554+0000 7f40e37fe640 1 -- 172.21.15.170:0/3480480290 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41fc021ab0 con 0x558f692ef900 2024-09-12T17:28:01.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.555+0000 7f4208742800 1 -- 172.21.15.170:0/3480480290 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558f692ef900 msgr2=0x558f692efce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.555+0000 7f4208742800 1 --2- 172.21.15.170:0/3480480290 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558f692ef900 0x558f692efce0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f41fc053d60 tx=0x7f41fc01fc40 comp rx=0 tx=0).stop 2024-09-12T17:28:01.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.555+0000 7f4208742800 1 -- 172.21.15.170:0/3480480290 shutdown_connections 2024-09-12T17:28:01.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.555+0000 7f4208742800 1 --2- 172.21.15.170:0/3480480290 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558f692ef900 0x558f692efce0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.555+0000 7f4208742800 1 -- 172.21.15.170:0/3480480290 >> 172.21.15.170:0/3480480290 conn(0x558f692ebd00 msgr2=0x558f692e9f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:01.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.555+0000 7f4208742800 1 -- 172.21.15.170:0/3480480290 shutdown_connections 2024-09-12T17:28:01.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.555+0000 7f4208742800 1 -- 172.21.15.170:0/3480480290 wait complete. 2024-09-12T17:28:01.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.555+0000 7f4208742800 1 Processor -- start 2024-09-12T17:28:01.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.555+0000 7f4208742800 1 -- start start 2024-09-12T17:28:01.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.555+0000 7f4208742800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558f692ef900 0x558f692f6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.555+0000 7f4208742800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558f692f0910 con 0x558f692ef900 2024-09-12T17:28:01.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.556+0000 7f4204c87640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558f692ef900 0x558f692f6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.556+0000 7f4204c87640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558f692ef900 0x558f692f6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57384/0 (socket says 172.21.15.170:57384) 2024-09-12T17:28:01.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.556+0000 7f4204c87640 1 -- 172.21.15.170:0/3669335903 learned_addr learned my addr 172.21.15.170:0/3669335903 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:01.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.556+0000 7f4204c87640 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f692f7410 con 0x558f692ef900 2024-09-12T17:28:01.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.556+0000 7f4204c87640 1 --2- 172.21.15.170:0/3669335903 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558f692ef900 0x558f692f6eb0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f41fc053c60 tx=0x7f41fc053cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.556+0000 7f40e1ffb640 1 -- 172.21.15.170:0/3669335903 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41fc020800 con 0x558f692ef900 2024-09-12T17:28:01.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.556+0000 7f40e1ffb640 1 -- 172.21.15.170:0/3669335903 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41fc0209a0 con 0x558f692ef900 2024-09-12T17:28:01.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.556+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558f692f76a0 con 0x558f692ef900 2024-09-12T17:28:01.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.556+0000 7f40e1ffb640 1 -- 172.21.15.170:0/3669335903 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41fc020ca0 con 0x558f692ef900 2024-09-12T17:28:01.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.556+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f692f8230 con 0x558f692ef900 2024-09-12T17:28:01.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.557+0000 7f40e1ffb640 1 -- 172.21.15.170:0/3669335903 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f41fc0145e0 con 0x558f692ef900 2024-09-12T17:28:01.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.557+0000 7f40e1ffb640 1 --2- 172.21.15.170:0/3669335903 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f40d403c780 0x7f40d403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.557+0000 7f40e1ffb640 1 -- 172.21.15.170:0/3669335903 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f41fc04b040 con 0x558f692ef900 2024-09-12T17:28:01.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.557+0000 7f4204486640 1 --2- 172.21.15.170:0/3669335903 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f40d403c780 0x7f40d403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.558+0000 7f4204486640 1 --2- 172.21.15.170:0/3669335903 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f40d403c780 0x7f40d403ec40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f41f405f730 tx=0x7f41f4092000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.558+0000 7f4208742800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.558+0000 7f4208742800 1 --2- 172.21.15.170:0/3669335903 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x558f693027e0 0x558f69304ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.558+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558f693053f0 con 0x558f693027e0 2024-09-12T17:28:01.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.558+0000 7f4203c85640 1 --2- 172.21.15.170:0/3669335903 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x558f693027e0 0x558f69304ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.558+0000 7f4203c85640 1 --2- 172.21.15.170:0/3669335903 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x558f693027e0 0x558f69304ca0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.559+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f41f800f5f0 con 0x558f693027e0 2024-09-12T17:28:01.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.559+0000 7f4208742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.559+0000 7f4208742800 20 realm 2024-09-12T17:28:01.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.559+0000 7f4208742800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.559+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558f69301b30 con 0x558f693027e0 2024-09-12T17:28:01.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.559+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f41f800f5f0 con 0x558f693027e0 2024-09-12T17:28:01.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.559+0000 7f4208742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.559+0000 7f4208742800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:01.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.559+0000 7f4208742800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.559+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558f69305ee0 con 0x558f693027e0 2024-09-12T17:28:01.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.559+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f41f800f5f0 con 0x558f693027e0 2024-09-12T17:28:01.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.559+0000 7f4208742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.559+0000 7f4208742800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.559+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558f693067b0 con 0x558f693027e0 2024-09-12T17:28:01.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.559+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f41f800f5f0 con 0x558f693027e0 2024-09-12T17:28:01.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.559+0000 7f4208742800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:01.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.559+0000 7f4208742800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.559+0000 7f4208742800 1 --2- 172.21.15.170:0/3669335903 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x558f693071d0 0x558f693095c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.559+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558f69309d30 con 0x558f693071d0 2024-09-12T17:28:01.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.559+0000 7f4204c87640 1 --2- 172.21.15.170:0/3669335903 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x558f693071d0 0x558f693095c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.560+0000 7f4204c87640 1 --2- 172.21.15.170:0/3669335903 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x558f693071d0 0x558f693095c0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.560+0000 7f4204c87640 1 -- 172.21.15.170:0/3669335903 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f41fc032070 con 0x558f693071d0 2024-09-12T17:28:01.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.560+0000 7f4208742800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:01.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.560+0000 7f4208742800 20 searching for the correct realm 2024-09-12T17:28:01.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.560+0000 7f4208742800 1 --2- 172.21.15.170:0/3669335903 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x558f6930bce0 0x558f6930e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.560+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558f6930e870 con 0x558f6930bce0 2024-09-12T17:28:01.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.560+0000 7f4204486640 1 --2- 172.21.15.170:0/3669335903 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x558f6930bce0 0x558f6930e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.560+0000 7f4204486640 1 --2- 172.21.15.170:0/3669335903 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x558f6930bce0 0x558f6930e1a0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.561+0000 7f4204486640 1 -- 172.21.15.170:0/3669335903 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41f408a050 con 0x558f6930bce0 2024-09-12T17:28:01.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.561+0000 7f4204486640 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558f6930e870 con 0x558f693071d0 2024-09-12T17:28:01.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.561+0000 7f4204c87640 1 -- 172.21.15.170:0/3669335903 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41fc032070 con 0x558f693071d0 2024-09-12T17:28:01.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.561+0000 7f4204c87640 1 --2- 172.21.15.170:0/3669335903 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f41fc035070 0x7f41fc017450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.561+0000 7f4204c87640 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558f6930e870 con 0x7f41fc035070 2024-09-12T17:28:01.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.561+0000 7f4203c85640 1 --2- 172.21.15.170:0/3669335903 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f41fc035070 0x7f41fc017450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.562+0000 7f4203c85640 1 --2- 172.21.15.170:0/3669335903 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f41fc035070 0x7f41fc017450 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.562+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41f800f5f0 con 0x7f41fc035070 2024-09-12T17:28:01.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.562+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558f6930e870 con 0x558f693027e0 2024-09-12T17:28:01.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.562+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41f800f5f0 con 0x558f693027e0 2024-09-12T17:28:01.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.562+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558f6930e870 con 0x558f693027e0 2024-09-12T17:28:01.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.562+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41f802b040 con 0x558f693027e0 2024-09-12T17:28:01.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.562+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558f6930e870 con 0x7f41fc035070 2024-09-12T17:28:01.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.563+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41f802b040 con 0x7f41fc035070 2024-09-12T17:28:01.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.563+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558f6930e870 con 0x7f41fc035070 2024-09-12T17:28:01.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.563+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41f802b040 con 0x7f41fc035070 2024-09-12T17:28:01.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.563+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558f6930e870 con 0x558f693071d0 2024-09-12T17:28:01.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.563+0000 7f4204c87640 1 -- 172.21.15.170:0/3669335903 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41fc032070 con 0x558f693071d0 2024-09-12T17:28:01.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.563+0000 7f4204c87640 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558f6930e870 con 0x558f6930bce0 2024-09-12T17:28:01.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.563+0000 7f4204486640 1 -- 172.21.15.170:0/3669335903 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41f408a050 con 0x558f6930bce0 2024-09-12T17:28:01.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.563+0000 7f4204486640 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558f6930e870 con 0x558f693027e0 2024-09-12T17:28:01.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.564+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41f802b040 con 0x558f693027e0 2024-09-12T17:28:01.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.564+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558f6930e870 con 0x7f41fc035070 2024-09-12T17:28:01.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.564+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41f802b040 con 0x7f41fc035070 2024-09-12T17:28:01.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.564+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558f6930e870 con 0x558f693027e0 2024-09-12T17:28:01.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.564+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41f802b040 con 0x558f693027e0 2024-09-12T17:28:01.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.564+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558f6930e870 con 0x558f693071d0 2024-09-12T17:28:01.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.564+0000 7f4204c87640 1 -- 172.21.15.170:0/3669335903 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f41fc032070 con 0x558f693071d0 2024-09-12T17:28:01.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.564+0000 7f4204c87640 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558f6930e870 con 0x558f6930bce0 2024-09-12T17:28:01.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.565+0000 7f4204486640 1 -- 172.21.15.170:0/3669335903 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41f408a050 con 0x558f6930bce0 2024-09-12T17:28:01.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.565+0000 7f4204486640 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558f6930e870 con 0x558f6930bce0 2024-09-12T17:28:01.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.565+0000 7f4204486640 1 -- 172.21.15.170:0/3669335903 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41f408a050 con 0x558f6930bce0 2024-09-12T17:28:01.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.565+0000 7f4204486640 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558f6930e870 con 0x7f41fc035070 2024-09-12T17:28:01.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.565+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41f802b040 con 0x7f41fc035070 2024-09-12T17:28:01.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.565+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558f6930e870 con 0x558f6930bce0 2024-09-12T17:28:01.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.565+0000 7f4204486640 1 -- 172.21.15.170:0/3669335903 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41f408a050 con 0x558f6930bce0 2024-09-12T17:28:01.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.565+0000 7f4204486640 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558f6930e870 con 0x558f6930bce0 2024-09-12T17:28:01.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.565+0000 7f4204486640 1 -- 172.21.15.170:0/3669335903 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41f408a050 con 0x558f6930bce0 2024-09-12T17:28:01.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.565+0000 7f4204486640 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558f6930e870 con 0x558f693027e0 2024-09-12T17:28:01.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.566+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41f802b040 con 0x558f693027e0 2024-09-12T17:28:01.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.566+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558f6930e870 con 0x558f693027e0 2024-09-12T17:28:01.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.566+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f41f802b040 con 0x558f693027e0 2024-09-12T17:28:01.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.566+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558f6930e870 con 0x7f41fc035070 2024-09-12T17:28:01.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.566+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41f802b040 con 0x7f41fc035070 2024-09-12T17:28:01.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.566+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558f6930e870 con 0x558f6930bce0 2024-09-12T17:28:01.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.566+0000 7f4204486640 1 -- 172.21.15.170:0/3669335903 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41f408a050 con 0x558f6930bce0 2024-09-12T17:28:01.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.566+0000 7f4204486640 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558f6930e870 con 0x558f693071d0 2024-09-12T17:28:01.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.567+0000 7f4204c87640 1 -- 172.21.15.170:0/3669335903 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41fc032070 con 0x558f693071d0 2024-09-12T17:28:01.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.567+0000 7f4204c87640 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558f6930e870 con 0x558f693027e0 2024-09-12T17:28:01.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.567+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41f802b040 con 0x558f693027e0 2024-09-12T17:28:01.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.567+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558f6930e870 con 0x7f41fc035070 2024-09-12T17:28:01.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.567+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41f803b040 con 0x7f41fc035070 2024-09-12T17:28:01.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.567+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558f6930e870 con 0x558f6930bce0 2024-09-12T17:28:01.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.568+0000 7f4204486640 1 -- 172.21.15.170:0/3669335903 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41f408a050 con 0x558f6930bce0 2024-09-12T17:28:01.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.568+0000 7f4204486640 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558f6930e870 con 0x7f41fc035070 2024-09-12T17:28:01.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.568+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41f803b040 con 0x7f41fc035070 2024-09-12T17:28:01.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.568+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558f6930e870 con 0x558f693071d0 2024-09-12T17:28:01.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.568+0000 7f4204c87640 1 -- 172.21.15.170:0/3669335903 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41fc032070 con 0x558f693071d0 2024-09-12T17:28:01.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.568+0000 7f4204c87640 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558f6930e870 con 0x558f6930bce0 2024-09-12T17:28:01.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.568+0000 7f4204486640 1 -- 172.21.15.170:0/3669335903 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41f408a050 con 0x558f6930bce0 2024-09-12T17:28:01.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.568+0000 7f4204486640 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558f6930e870 con 0x7f41fc035070 2024-09-12T17:28:01.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.568+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41f803b040 con 0x7f41fc035070 2024-09-12T17:28:01.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.568+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558f6930e870 con 0x558f693027e0 2024-09-12T17:28:01.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.569+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f41f803b040 con 0x558f693027e0 2024-09-12T17:28:01.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.569+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558f6930e870 con 0x558f693071d0 2024-09-12T17:28:01.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.569+0000 7f4204c87640 1 -- 172.21.15.170:0/3669335903 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f41fc032070 con 0x558f693071d0 2024-09-12T17:28:01.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.569+0000 7f4208742800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:01.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.569+0000 7f4208742800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:01.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.569+0000 7f4208742800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:01.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.569+0000 7f4208742800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:01.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.569+0000 7f4208742800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:01.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.569+0000 7f4208742800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:01.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.569+0000 7f4208742800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.569+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558f6930a6f0 con 0x558f693027e0 2024-09-12T17:28:01.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.569+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f41f803b040 con 0x558f693027e0 2024-09-12T17:28:01.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.569+0000 7f4208742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.569+0000 7f4208742800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.569+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558f6930af90 con 0x558f693027e0 2024-09-12T17:28:01.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.569+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f41f803b040 con 0x558f693027e0 2024-09-12T17:28:01.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.569+0000 7f4208742800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:01.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.569+0000 7f4208742800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.569+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558f6930a330 con 0x558f693071d0 2024-09-12T17:28:01.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.570+0000 7f4204c87640 1 -- 172.21.15.170:0/3669335903 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f41fc032070 con 0x558f693071d0 2024-09-12T17:28:01.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.570+0000 7f4208742800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:01.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.570+0000 7f4208742800 20 zone default found 2024-09-12T17:28:01.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.570+0000 7f4208742800 4 Realm: () 2024-09-12T17:28:01.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.570+0000 7f4208742800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:01.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.570+0000 7f4208742800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:01.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.570+0000 7f4208742800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:01.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.570+0000 7f4208742800 20 zonegroup default 2024-09-12T17:28:01.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.570+0000 7f4208742800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.570+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558f6930f1a0 con 0x7f41fc035070 2024-09-12T17:28:01.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.570+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f41f803b040 con 0x7f41fc035070 2024-09-12T17:28:01.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.570+0000 7f4208742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.570+0000 7f4208742800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.570+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558f69310e40 con 0x558f6930bce0 2024-09-12T17:28:01.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.570+0000 7f4204486640 1 -- 172.21.15.170:0/3669335903 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f41f408a050 con 0x558f6930bce0 2024-09-12T17:28:01.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.570+0000 7f4208742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.570+0000 7f4208742800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.570+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558f69311330 con 0x558f6930bce0 2024-09-12T17:28:01.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.571+0000 7f4204486640 1 -- 172.21.15.170:0/3669335903 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f41f408a050 con 0x558f6930bce0 2024-09-12T17:28:01.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.571+0000 7f4208742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.571+0000 7f4208742800 20 started sync module instance, tier type = 2024-09-12T17:28:01.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.571+0000 7f4208742800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:01.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.571+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558f6930fc40 con 0x558f693071d0 2024-09-12T17:28:01.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.572+0000 7f4204c87640 1 -- 172.21.15.170:0/3669335903 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41fc032070 con 0x558f693071d0 2024-09-12T17:28:01.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.572+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94074433503280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558f69311c40 con 0x558f693071d0 2024-09-12T17:28:01.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.572+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558f69312490 con 0x558f693027e0 2024-09-12T17:28:01.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.573+0000 7f4204c87640 1 -- 172.21.15.170:0/3669335903 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94074433503280] v29'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41fc032070 con 0x558f693071d0 2024-09-12T17:28:01.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.573+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41f803b040 con 0x558f693027e0 2024-09-12T17:28:01.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.573+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94074433509264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558f69312100 con 0x558f693027e0 2024-09-12T17:28:01.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.573+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558f69312c20 con 0x558f6930bce0 2024-09-12T17:28:01.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.574+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94074433509264] v29'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41f803b040 con 0x558f693027e0 2024-09-12T17:28:01.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.574+0000 7f4204486640 1 -- 172.21.15.170:0/3669335903 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41f408a050 con 0x558f6930bce0 2024-09-12T17:28:01.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.574+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94074433513200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558f69313010 con 0x558f6930bce0 2024-09-12T17:28:01.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.574+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558f69313a30 con 0x558f693071d0 2024-09-12T17:28:01.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.575+0000 7f4204486640 1 -- 172.21.15.170:0/3669335903 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94074433513200] v29'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41f408a050 con 0x558f6930bce0 2024-09-12T17:28:01.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.575+0000 7f4204c87640 1 -- 172.21.15.170:0/3669335903 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41fc032070 con 0x558f693071d0 2024-09-12T17:28:01.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.575+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94074433516832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558f69313e20 con 0x558f693071d0 2024-09-12T17:28:01.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.575+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558f69314840 con 0x558f693027e0 2024-09-12T17:28:01.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.576+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41f803b040 con 0x558f693027e0 2024-09-12T17:28:01.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.576+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94074433520432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558f69314800 con 0x558f693027e0 2024-09-12T17:28:01.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.576+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558f69315800 con 0x7f41fc035070 2024-09-12T17:28:01.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.576+0000 7f4204c87640 1 -- 172.21.15.170:0/3669335903 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94074433516832] v29'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41fc032070 con 0x558f693071d0 2024-09-12T17:28:01.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.577+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41f803b040 con 0x7f41fc035070 2024-09-12T17:28:01.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.577+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94074433524528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558f69315800 con 0x7f41fc035070 2024-09-12T17:28:01.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.577+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94074433520432] v29'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41f803b040 con 0x558f693027e0 2024-09-12T17:28:01.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.577+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558f69316210 con 0x7f41fc035070 2024-09-12T17:28:01.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.578+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94074433524528] v29'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41f803b040 con 0x7f41fc035070 2024-09-12T17:28:01.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.578+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(56 notify.6 [create] v29'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41f803b040 con 0x7f41fc035070 2024-09-12T17:28:01.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.578+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94074433510320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558f69315d60 con 0x7f41fc035070 2024-09-12T17:28:01.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.578+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558f69316720 con 0x7f41fc035070 2024-09-12T17:28:01.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.579+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94074433510320] v29'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41f803b040 con 0x7f41fc035070 2024-09-12T17:28:01.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.579+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(58 notify.7 [create] v29'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41f803b040 con 0x7f41fc035070 2024-09-12T17:28:01.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.579+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94074433522656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558f69316720 con 0x7f41fc035070 2024-09-12T17:28:01.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.580+0000 7f4208742800 20 add_watcher() i=0 2024-09-12T17:28:01.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.580+0000 7f4208742800 20 add_watcher() i=1 2024-09-12T17:28:01.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.580+0000 7f4208742800 20 add_watcher() i=2 2024-09-12T17:28:01.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.580+0000 7f4208742800 20 add_watcher() i=3 2024-09-12T17:28:01.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.580+0000 7f4208742800 20 add_watcher() i=4 2024-09-12T17:28:01.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.580+0000 7f4208742800 20 add_watcher() i=5 2024-09-12T17:28:01.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.580+0000 7f4208742800 20 add_watcher() i=6 2024-09-12T17:28:01.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.580+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94074433522656] v29'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41f803b040 con 0x7f41fc035070 2024-09-12T17:28:01.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.580+0000 7f4208742800 20 add_watcher() i=7 2024-09-12T17:28:01.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.580+0000 7f4208742800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:01.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.580+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558f69319a50 con 0x558f693027e0 2024-09-12T17:28:01.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.581+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f41f803b040 con 0x558f693027e0 2024-09-12T17:28:01.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.581+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94074433528800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558f69316cb0 con 0x558f693027e0 2024-09-12T17:28:01.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.582+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94074433528800] v29'82 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f41f803b040 con 0x558f693027e0 2024-09-12T17:28:01.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.582+0000 7f40ba7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:01.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.582+0000 7f4208742800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:01.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.582+0000 7f4208742800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:01.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.582+0000 7f4208742800 5 note: GC not initialized 2024-09-12T17:28:01.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.582+0000 7f40b97e2640 20 reqs_thread_entry: start 2024-09-12T17:28:01.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.582+0000 7f4208742800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:01.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.582+0000 7f4208742800 20 Filter name: none 2024-09-12T17:28:01.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.582+0000 7f402affd640 20 reqs_thread_entry: start 2024-09-12T17:28:01.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.583+0000 7f4208742800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:28:01.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.583+0000 7f4208742800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.583+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558f6934cbb0 con 0x558f693027e0 2024-09-12T17:28:01.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.583+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f41f803b040 con 0x558f693027e0 2024-09-12T17:28:01.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.583+0000 7f4208742800 20 rados_obj.operate() r=0 bl.length=673 2024-09-12T17:28:01.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.583+0000 7f4208742800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T17:28:01.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.583+0000 7f4208742800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:28:01.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.583+0000 7f4208742800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:01.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.583+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558f69353570 con 0x558f693027e0 2024-09-12T17:28:01.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.584+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~582] v29'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f41f803b040 con 0x558f693027e0 2024-09-12T17:28:01.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.584+0000 7f4208742800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:28:01.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.584+0000 7f4208742800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:28:01.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.584+0000 7f4208742800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T17:28:01.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.584+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94074433777584 in=770b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558f6934ec50 con 0x558f693027e0 2024-09-12T17:28:01.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.584+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== watch-notify(notify (1) cookie 94074433520432 notify 124554051592 ret 0) ==== 800+0+0 (crc 0 0 0) 0x7f41f8018040 con 0x558f693027e0 2024-09-12T17:28:01.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.584+0000 7f40e37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051592 cookie 94074433520432 notifier 4400 bl.length()=758 2024-09-12T17:28:01.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.584+0000 7f40e37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:28:01.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.584+0000 7f40e37fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:28:01.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.584+0000 7f40e37fe640 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f40c8003ea0 con 0x558f693027e0 2024-09-12T17:28:01.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.584+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(64 notify.4 [notify cookie 94074433777584 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f41f803b040 con 0x558f693027e0 2024-09-12T17:28:01.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.585+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41f803b040 con 0x558f693027e0 2024-09-12T17:28:01.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.585+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== watch-notify(notify_complete (2) cookie 94074433777584 notify 124554051592 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f41f801d810 con 0x558f693027e0 2024-09-12T17:28:01.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.585+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:66 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558f69352fb0 con 0x558f693027e0 2024-09-12T17:28:01.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.586+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(66 foo:foo1 [delete] v29'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41f803b040 con 0x558f693027e0 2024-09-12T17:28:01.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.586+0000 7f4208742800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-12T17:28:01.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.586+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94074433777584 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558f6934e7a0 con 0x558f693071d0 2024-09-12T17:28:01.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.586+0000 7f4204c87640 1 -- 172.21.15.170:0/3669335903 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== watch-notify(notify (1) cookie 94074433503280 notify 124554051588 ret 0) ==== 201+0+0 (crc 0 0 0) 0x558f692f76a0 con 0x558f693071d0 2024-09-12T17:28:01.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.586+0000 7f40e2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051588 cookie 94074433503280 notifier 4400 bl.length()=159 2024-09-12T17:28:01.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.586+0000 7f4204c87640 1 -- 172.21.15.170:0/3669335903 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(67 notify.0 [notify cookie 94074433777584 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f41fc032070 con 0x558f693071d0 2024-09-12T17:28:01.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.586+0000 7f40e2ffd640 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f40380032c0 con 0x558f693071d0 2024-09-12T17:28:01.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.586+0000 7f4204c87640 1 -- 172.21.15.170:0/3669335903 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41fc032070 con 0x558f693071d0 2024-09-12T17:28:01.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.586+0000 7f4204c87640 1 -- 172.21.15.170:0/3669335903 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== watch-notify(notify_complete (2) cookie 94074433777584 notify 124554051588 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558f692f7410 con 0x558f693071d0 2024-09-12T17:28:01.626 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T17:27:59.362376Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-12T17:28:01.319035Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:27:59.362351Z","tags":[],"group_ids":[]} 2024-09-12T17:28:01.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.587+0000 7f40ba7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:01.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.587+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94074433528800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558f6934aa50 con 0x558f693027e0 2024-09-12T17:28:01.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.588+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94074433528800] v29'83 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f41f803b040 con 0x558f693027e0 2024-09-12T17:28:01.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.588+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94074433503280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558f6934aa50 con 0x558f693071d0 2024-09-12T17:28:01.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.589+0000 7f4204c87640 1 -- 172.21.15.170:0/3669335903 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94074433503280] v29'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41fc032070 con 0x558f693071d0 2024-09-12T17:28:01.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.589+0000 7f4208742800 20 remove_watcher() i=0 2024-09-12T17:28:01.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.589+0000 7f4208742800 2 removed watcher, disabling cache 2024-09-12T17:28:01.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.589+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94074433509264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558f6934aa50 con 0x558f693027e0 2024-09-12T17:28:01.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.591+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94074433509264] v29'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41f803b040 con 0x558f693027e0 2024-09-12T17:28:01.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.591+0000 7f4208742800 20 remove_watcher() i=1 2024-09-12T17:28:01.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.591+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94074433513200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558f6934aa50 con 0x558f6930bce0 2024-09-12T17:28:01.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.592+0000 7f4204486640 1 -- 172.21.15.170:0/3669335903 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94074433513200] v29'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41f408a050 con 0x558f6930bce0 2024-09-12T17:28:01.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.592+0000 7f4208742800 20 remove_watcher() i=2 2024-09-12T17:28:01.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.592+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94074433516832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558f6934aa50 con 0x558f693071d0 2024-09-12T17:28:01.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.593+0000 7f4204c87640 1 -- 172.21.15.170:0/3669335903 <== osd.2 v2:172.21.15.170:6808/3855567754 18 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94074433516832] v29'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41fc032070 con 0x558f693071d0 2024-09-12T17:28:01.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.593+0000 7f4208742800 20 remove_watcher() i=3 2024-09-12T17:28:01.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.593+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94074433520432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558f6934aa50 con 0x558f693027e0 2024-09-12T17:28:01.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.594+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.1 v2:172.21.15.170:6800/1903654092 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94074433520432] v29'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41f803b040 con 0x558f693027e0 2024-09-12T17:28:01.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.594+0000 7f4208742800 20 remove_watcher() i=4 2024-09-12T17:28:01.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.594+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94074433524528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558f6934aa50 con 0x7f41fc035070 2024-09-12T17:28:01.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.595+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94074433524528] v29'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41f803b040 con 0x7f41fc035070 2024-09-12T17:28:01.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.595+0000 7f4208742800 20 remove_watcher() i=5 2024-09-12T17:28:01.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.595+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94074433510320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558f6934aa50 con 0x7f41fc035070 2024-09-12T17:28:01.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.595+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94074433510320] v29'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41f803b040 con 0x7f41fc035070 2024-09-12T17:28:01.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.596+0000 7f4208742800 20 remove_watcher() i=6 2024-09-12T17:28:01.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.596+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94074433522656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558f6934aa50 con 0x7f41fc035070 2024-09-12T17:28:01.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.597+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94074433522656] v29'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41f803b040 con 0x7f41fc035070 2024-09-12T17:28:01.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.597+0000 7f4208742800 20 remove_watcher() i=7 2024-09-12T17:28:01.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.597+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f41fc035070 msgr2=0x7f41fc017450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.597+0000 7f4208742800 1 --2- 172.21.15.170:0/3669335903 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f41fc035070 0x7f41fc017450 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.597+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x558f693027e0 msgr2=0x558f69304ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.597+0000 7f4208742800 1 --2- 172.21.15.170:0/3669335903 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x558f693027e0 0x558f69304ca0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.597+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x558f693071d0 msgr2=0x558f693095c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.597+0000 7f4208742800 1 --2- 172.21.15.170:0/3669335903 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x558f693071d0 0x558f693095c0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.597+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x558f6930bce0 msgr2=0x558f6930e1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.597+0000 7f4208742800 1 --2- 172.21.15.170:0/3669335903 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x558f6930bce0 0x558f6930e1a0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.597+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f40d403c780 msgr2=0x7f40d403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.597+0000 7f4208742800 1 --2- 172.21.15.170:0/3669335903 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f40d403c780 0x7f40d403ec40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f41f405f730 tx=0x7f41f4092000 comp rx=0 tx=0).stop 2024-09-12T17:28:01.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.597+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558f692ef900 msgr2=0x558f692f6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.597+0000 7f4208742800 1 --2- 172.21.15.170:0/3669335903 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558f692ef900 0x558f692f6eb0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f41fc053c60 tx=0x7f41fc053cc0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.597+0000 7f4203c85640 1 -- 172.21.15.170:0/3669335903 reap_dead start 2024-09-12T17:28:01.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.597+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 shutdown_connections 2024-09-12T17:28:01.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.597+0000 7f4208742800 1 --2- 172.21.15.170:0/3669335903 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558f692ef900 0x558f692f6eb0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.597+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 >> 172.21.15.170:0/3669335903 conn(0x558f692ebd00 msgr2=0x558f692e9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:01.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.597+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 shutdown_connections 2024-09-12T17:28:01.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.597+0000 7f4208742800 1 -- 172.21.15.170:0/3669335903 wait complete. 2024-09-12T17:28:01.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.597+0000 7f4208742800 1 -- 172.21.15.170:0/2475309653 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f40dc03c730 msgr2=0x7f40dc03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.597+0000 7f4208742800 1 --2- 172.21.15.170:0/2475309653 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f40dc03c730 0x7f40dc03ebf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x558f692cfcb0 tx=0x7f41f4052650 comp rx=0 tx=0).stop 2024-09-12T17:28:01.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.597+0000 7f4208742800 1 -- 172.21.15.170:0/2475309653 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558f692e2dc0 msgr2=0x558f692e31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.597+0000 7f4208742800 1 --2- 172.21.15.170:0/2475309653 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558f692e2dc0 0x558f692e31e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x558f692be310 tx=0x7f41fc0167b0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.597+0000 7f4208742800 1 -- 172.21.15.170:0/2475309653 shutdown_connections 2024-09-12T17:28:01.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.597+0000 7f4208742800 1 --2- 172.21.15.170:0/2475309653 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f40dc03c730 0x7f40dc03ebf0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.597+0000 7f4208742800 1 --2- 172.21.15.170:0/2475309653 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558f692e2dc0 0x558f692e31e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.597+0000 7f4208742800 1 -- 172.21.15.170:0/2475309653 >> 172.21.15.170:0/2475309653 conn(0x558f692d7170 msgr2=0x558f692d7550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:01.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.597+0000 7f4208742800 1 -- 172.21.15.170:0/2475309653 shutdown_connections 2024-09-12T17:28:01.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.597+0000 7f4208742800 1 -- 172.21.15.170:0/2475309653 wait complete. 2024-09-12T17:28:01.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.598+0000 7f4208742800 1 -- 172.21.15.170:0/30176600 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x558f691cf040 msgr2=0x558f692cf280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.598+0000 7f4208742800 1 --2- 172.21.15.170:0/30176600 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x558f691cf040 0x558f692cf280 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.598+0000 7f4208742800 1 -- 172.21.15.170:0/30176600 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x558f692d1b10 msgr2=0x558f692d3f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.598+0000 7f4208742800 1 --2- 172.21.15.170:0/30176600 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x558f692d1b10 0x558f692d3f00 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.598+0000 7f4208742800 1 -- 172.21.15.170:0/30176600 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f40ec03c730 msgr2=0x7f40ec03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.598+0000 7f4208742800 1 --2- 172.21.15.170:0/30176600 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f40ec03c730 0x7f40ec03ebf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f41f8000c00 tx=0x7f41f80013b0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.598+0000 7f4208742800 1 -- 172.21.15.170:0/30176600 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558f691cde00 msgr2=0x558f692be770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.598+0000 7f4208742800 1 --2- 172.21.15.170:0/30176600 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558f691cde00 0x558f692be770 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f41f400a470 tx=0x7f41f4002fb0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.598+0000 7f4208742800 1 -- 172.21.15.170:0/30176600 shutdown_connections 2024-09-12T17:28:01.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.598+0000 7f4208742800 1 --2- 172.21.15.170:0/30176600 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x558f692d1b10 0x558f692d3f00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.598+0000 7f4208742800 1 --2- 172.21.15.170:0/30176600 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f40ec03c730 0x7f40ec03ebf0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.598+0000 7f4208742800 1 --2- 172.21.15.170:0/30176600 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x558f691cf040 0x558f692cf280 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.598+0000 7f4208742800 1 --2- 172.21.15.170:0/30176600 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558f691cde00 0x558f692be770 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.598+0000 7f4208742800 1 -- 172.21.15.170:0/30176600 >> 172.21.15.170:0/30176600 conn(0x558f691c91d0 msgr2=0x558f692b7510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:01.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.598+0000 7f4208742800 1 -- 172.21.15.170:0/30176600 shutdown_connections 2024-09-12T17:28:01.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.598+0000 7f4208742800 1 -- 172.21.15.170:0/30176600 wait complete. 2024-09-12T17:28:01.638 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T17:27:59.362376Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-12T17:28:01.319035Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:27:59.362351Z', 'tags': [], 'group_ids': []} 2024-09-12T17:28:01.638 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-12T17:28:01.638 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-12T17:28:01.638 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-09-12T17:28:01.683 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:01.683 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:01.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.681+0000 7f2b96b2e800 1 Processor -- start 2024-09-12T17:28:01.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.681+0000 7f2b96b2e800 1 -- start start 2024-09-12T17:28:01.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.681+0000 7f2b96b2e800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55dd6477cfd0 0x55dd64785af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.682+0000 7f2b96b2e800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55dd64626e40 con 0x55dd6477b4b0 2024-09-12T17:28:01.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.682+0000 7f2b96b2e800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x55dd645f1680 con 0x55dd6477cfd0 2024-09-12T17:28:01.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.682+0000 7f2b920dc640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55dd6477cfd0 0x55dd64785af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.682+0000 7f2b928dd640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x55dd6477b4b0 0x55dd6477b8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:48368/0 (socket says 172.21.15.170:48368) 2024-09-12T17:28:01.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.682+0000 7f2b928dd640 1 -- 172.21.15.170:0/2705731652 learned_addr learned my addr 172.21.15.170:0/2705731652 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:28:01.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.682+0000 7f2b920dc640 1 -- 172.21.15.170:0/2705731652 >> v1:172.21.15.47:6789/0 conn(0x55dd6477b4b0 legacy=0x55dd6477b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.682+0000 7f2b920dc640 1 -- 172.21.15.170:0/2705731652 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd6460d6b0 con 0x55dd6477cfd0 2024-09-12T17:28:01.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.684+0000 7f2b920dc640 1 --2- 172.21.15.170:0/2705731652 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dd6477cfd0 0x55dd64785af0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c00a470 tx=0x7f2b7c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=879dede20463bffb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.684+0000 7f2b918db640 1 -- 172.21.15.170:0/2705731652 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b7c053570 con 0x55dd6477cfd0 2024-09-12T17:28:01.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.684+0000 7f2b918db640 1 -- 172.21.15.170:0/2705731652 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b7c058070 con 0x55dd6477cfd0 2024-09-12T17:28:01.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.684+0000 7f2b918db640 1 -- 172.21.15.170:0/2705731652 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b7c053880 con 0x55dd6477cfd0 2024-09-12T17:28:01.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.685+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2705731652 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dd6477cfd0 msgr2=0x55dd64785af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.685+0000 7f2b96b2e800 1 --2- 172.21.15.170:0/2705731652 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dd6477cfd0 0x55dd64785af0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c00a470 tx=0x7f2b7c045a20 comp rx=0 tx=0).stop 2024-09-12T17:28:01.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.685+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2705731652 shutdown_connections 2024-09-12T17:28:01.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.685+0000 7f2b96b2e800 1 --2- 172.21.15.170:0/2705731652 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dd6477cfd0 0x55dd64785af0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.685+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2705731652 >> 172.21.15.170:0/2705731652 conn(0x55dd647771c0 msgr2=0x55dd64779620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:01.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.685+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2705731652 shutdown_connections 2024-09-12T17:28:01.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.685+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2705731652 wait complete. 2024-09-12T17:28:01.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.698+0000 7f2b96b2e800 1 Processor -- start 2024-09-12T17:28:01.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.699+0000 7f2b96b2e800 1 -- start start 2024-09-12T17:28:01.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.699+0000 7f2b96b2e800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dd6477b4b0 0x55dd6486e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.699+0000 7f2b96b2e800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55dd64615dd0 con 0x55dd6477b4b0 2024-09-12T17:28:01.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.699+0000 7f2b928dd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dd6477b4b0 0x55dd6486e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.699+0000 7f2b928dd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dd6477b4b0 0x55dd6486e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57392/0 (socket says 172.21.15.170:57392) 2024-09-12T17:28:01.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.699+0000 7f2b928dd640 1 -- 172.21.15.170:0/3040715642 learned_addr learned my addr 172.21.15.170:0/3040715642 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:01.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.699+0000 7f2b928dd640 1 -- 172.21.15.170:0/3040715642 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd6462ee10 con 0x55dd6477b4b0 2024-09-12T17:28:01.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.700+0000 7f2b928dd640 1 --2- 172.21.15.170:0/3040715642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dd6477b4b0 0x55dd6486e870 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2b84001800 tx=0x7f2b84001cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95593b0ad50416eb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.700+0000 7f2a80e09640 1 -- 172.21.15.170:0/3040715642 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b84004520 con 0x55dd6477b4b0 2024-09-12T17:28:01.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.700+0000 7f2a80e09640 1 -- 172.21.15.170:0/3040715642 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b840046c0 con 0x55dd6477b4b0 2024-09-12T17:28:01.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.700+0000 7f2a80e09640 1 -- 172.21.15.170:0/3040715642 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b840049e0 con 0x55dd6477b4b0 2024-09-12T17:28:01.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.701+0000 7f2b96b2e800 1 -- 172.21.15.170:0/3040715642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dd6477b4b0 msgr2=0x55dd6486e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.701+0000 7f2b96b2e800 1 --2- 172.21.15.170:0/3040715642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dd6477b4b0 0x55dd6486e870 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2b84001800 tx=0x7f2b84001cc0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.701+0000 7f2b96b2e800 1 -- 172.21.15.170:0/3040715642 shutdown_connections 2024-09-12T17:28:01.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.701+0000 7f2b96b2e800 1 --2- 172.21.15.170:0/3040715642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dd6477b4b0 0x55dd6486e870 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.701+0000 7f2b96b2e800 1 -- 172.21.15.170:0/3040715642 >> 172.21.15.170:0/3040715642 conn(0x55dd647771c0 msgr2=0x55dd6486a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:01.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.701+0000 7f2b96b2e800 1 -- 172.21.15.170:0/3040715642 shutdown_connections 2024-09-12T17:28:01.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.701+0000 7f2b96b2e800 1 -- 172.21.15.170:0/3040715642 wait complete. 2024-09-12T17:28:01.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.701+0000 7f2b96b2e800 1 Processor -- start 2024-09-12T17:28:01.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.701+0000 7f2b96b2e800 1 -- start start 2024-09-12T17:28:01.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.701+0000 7f2b96b2e800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dd6477b4b0 0x55dd64876220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.701+0000 7f2b96b2e800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55dd64786330 con 0x55dd6477b4b0 2024-09-12T17:28:01.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.701+0000 7f2b928dd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dd6477b4b0 0x55dd64876220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.701+0000 7f2b928dd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dd6477b4b0 0x55dd64876220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57404/0 (socket says 172.21.15.170:57404) 2024-09-12T17:28:01.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.701+0000 7f2b928dd640 1 -- 172.21.15.170:0/3908494869 learned_addr learned my addr 172.21.15.170:0/3908494869 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:01.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.702+0000 7f2b928dd640 1 -- 172.21.15.170:0/3908494869 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd64876780 con 0x55dd6477b4b0 2024-09-12T17:28:01.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.702+0000 7f2b928dd640 1 --2- 172.21.15.170:0/3908494869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dd6477b4b0 0x55dd64876220 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2b84000f80 tx=0x7f2b84001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.702+0000 7f2a7f606640 1 -- 172.21.15.170:0/3908494869 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b84022020 con 0x55dd6477b4b0 2024-09-12T17:28:01.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.702+0000 7f2a7f606640 1 -- 172.21.15.170:0/3908494869 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b84014890 con 0x55dd6477b4b0 2024-09-12T17:28:01.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.702+0000 7f2b96b2e800 1 -- 172.21.15.170:0/3908494869 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dd64876a10 con 0x55dd6477b4b0 2024-09-12T17:28:01.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.702+0000 7f2a7f606640 1 -- 172.21.15.170:0/3908494869 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b84014bb0 con 0x55dd6477b4b0 2024-09-12T17:28:01.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.702+0000 7f2b96b2e800 1 -- 172.21.15.170:0/3908494869 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd64877410 con 0x55dd6477b4b0 2024-09-12T17:28:01.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.703+0000 7f2a7f606640 1 -- 172.21.15.170:0/3908494869 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2b84025020 con 0x55dd6477b4b0 2024-09-12T17:28:01.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.703+0000 7f2a7f606640 1 --2- 172.21.15.170:0/3908494869 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2a7803c780 0x7f2a7803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.703+0000 7f2a7f606640 1 -- 172.21.15.170:0/3908494869 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f2b84018030 con 0x55dd6477b4b0 2024-09-12T17:28:01.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.703+0000 7f2b920dc640 1 --2- 172.21.15.170:0/3908494869 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2a7803c780 0x7f2a7803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.703+0000 7f2b96b2e800 1 --2- 172.21.15.170:0/3908494869 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55dd6477cfd0 0x55dd6487d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.703+0000 7f2b96b2e800 1 -- 172.21.15.170:0/3908494869 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd6487ddb0 con 0x55dd6477cfd0 2024-09-12T17:28:01.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.703+0000 7f2b930de640 1 --2- 172.21.15.170:0/3908494869 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55dd6477cfd0 0x55dd6487d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.704+0000 7f2b920dc640 1 --2- 172.21.15.170:0/3908494869 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2a7803c780 0x7f2a7803ec40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c057000 tx=0x7f2b7c052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.704+0000 7f2b930de640 1 --2- 172.21.15.170:0/3908494869 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55dd6477cfd0 0x55dd6487d870 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.704+0000 7f2b930de640 1 -- 172.21.15.170:0/3908494869 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b8c0083e0 con 0x55dd6477cfd0 2024-09-12T17:28:01.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.704+0000 7f2b96b2e800 1 -- 172.21.15.170:0/3908494869 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd6487e150 con 0x55dd6477cfd0 2024-09-12T17:28:01.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.704+0000 7f2b930de640 1 -- 172.21.15.170:0/3908494869 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2b8c0083e0 con 0x55dd6477cfd0 2024-09-12T17:28:01.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.704+0000 7f2b96b2e800 1 --2- 172.21.15.170:0/3908494869 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55dd6487fc50 0x55dd648820d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.704+0000 7f2b96b2e800 1 -- 172.21.15.170:0/3908494869 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd64882860 con 0x55dd6487fc50 2024-09-12T17:28:01.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.704+0000 7f2b928dd640 1 --2- 172.21.15.170:0/3908494869 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55dd6487fc50 0x55dd648820d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.705+0000 7f2b928dd640 1 --2- 172.21.15.170:0/3908494869 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55dd6487fc50 0x55dd648820d0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.705+0000 7f2b928dd640 1 -- 172.21.15.170:0/3908494869 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2b8401b070 con 0x55dd6487fc50 2024-09-12T17:28:01.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.705+0000 7f2b96b2e800 1 -- 172.21.15.170:0/3908494869 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd6487e9a0 con 0x55dd6477cfd0 2024-09-12T17:28:01.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.705+0000 7f2b930de640 1 -- 172.21.15.170:0/3908494869 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2b8c0083e0 con 0x55dd6477cfd0 2024-09-12T17:28:01.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.705+0000 7f2b96b2e800 1 -- 172.21.15.170:0/3908494869 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd6487edd0 con 0x55dd6487fc50 2024-09-12T17:28:01.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.706+0000 7f2b928dd640 1 -- 172.21.15.170:0/3908494869 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2b8401b070 con 0x55dd6487fc50 2024-09-12T17:28:01.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.706+0000 7f2b96b2e800 1 Processor -- start 2024-09-12T17:28:01.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.706+0000 7f2b96b2e800 1 -- start start 2024-09-12T17:28:01.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.706+0000 7f2b96b2e800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dd64891150 0x55dd64891570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.706+0000 7f2b96b2e800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55dd64673a00 con 0x55dd64891150 2024-09-12T17:28:01.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.707+0000 7f2b930de640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dd64891150 0x55dd64891570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.707+0000 7f2b930de640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dd64891150 0x55dd64891570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57420/0 (socket says 172.21.15.170:57420) 2024-09-12T17:28:01.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.707+0000 7f2b930de640 1 -- 172.21.15.170:0/1120048494 learned_addr learned my addr 172.21.15.170:0/1120048494 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:01.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.707+0000 7f2b930de640 1 -- 172.21.15.170:0/1120048494 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd64891bb0 con 0x55dd64891150 2024-09-12T17:28:01.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.707+0000 7f2b930de640 1 --2- 172.21.15.170:0/1120048494 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dd64891150 0x55dd64891570 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x55dd64877220 tx=0x7f2b8c00bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.707+0000 7f2a7ce01640 1 -- 172.21.15.170:0/1120048494 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b8c01c020 con 0x55dd64891150 2024-09-12T17:28:01.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.707+0000 7f2a7ce01640 1 -- 172.21.15.170:0/1120048494 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b8c007c90 con 0x55dd64891150 2024-09-12T17:28:01.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.707+0000 7f2b96b2e800 1 -- 172.21.15.170:0/1120048494 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dd648923e0 con 0x55dd64891150 2024-09-12T17:28:01.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.707+0000 7f2a7ce01640 1 -- 172.21.15.170:0/1120048494 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b8c018440 con 0x55dd64891150 2024-09-12T17:28:01.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.707+0000 7f2b96b2e800 1 -- 172.21.15.170:0/1120048494 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd64892980 con 0x55dd64891150 2024-09-12T17:28:01.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.708+0000 7f2a7ce01640 1 -- 172.21.15.170:0/1120048494 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2b8c01f020 con 0x55dd64891150 2024-09-12T17:28:01.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.708+0000 7f2a7ce01640 1 --2- 172.21.15.170:0/1120048494 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2a6c03c730 0x7f2a6c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.708+0000 7f2a7ce01640 1 -- 172.21.15.170:0/1120048494 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f2b8c054dc0 con 0x55dd64891150 2024-09-12T17:28:01.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.708+0000 7f2b928dd640 1 --2- 172.21.15.170:0/1120048494 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2a6c03c730 0x7f2a6c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.709+0000 7f2b96b2e800 1 Processor -- start 2024-09-12T17:28:01.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.709+0000 7f2b96b2e800 1 -- start start 2024-09-12T17:28:01.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.709+0000 7f2b928dd640 1 --2- 172.21.15.170:0/1120048494 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2a6c03c730 0x7f2a6c03ebf0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x55dd64882c30 tx=0x7f2b84051e70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.709+0000 7f2b96b2e800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dd6489dc70 0x55dd6489e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.709+0000 7f2b96b2e800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55dd6486f0c0 con 0x55dd6489dc70 2024-09-12T17:28:01.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.709+0000 7f2b930de640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dd6489dc70 0x55dd6489e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.709+0000 7f2b930de640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dd6489dc70 0x55dd6489e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57424/0 (socket says 172.21.15.170:57424) 2024-09-12T17:28:01.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.709+0000 7f2b930de640 1 -- 172.21.15.170:0/3493695029 learned_addr learned my addr 172.21.15.170:0/3493695029 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:01.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.710+0000 7f2b930de640 1 -- 172.21.15.170:0/3493695029 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd6489e660 con 0x55dd6489dc70 2024-09-12T17:28:01.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.710+0000 7f2b930de640 1 --2- 172.21.15.170:0/3493695029 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dd6489dc70 0x55dd6489e070 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0532d0 tx=0x7f2b8c0158b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc73d4683f31bb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.710+0000 7f2a767fc640 1 -- 172.21.15.170:0/3493695029 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b8c050020 con 0x55dd6489dc70 2024-09-12T17:28:01.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.710+0000 7f2a767fc640 1 -- 172.21.15.170:0/3493695029 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b8c015e70 con 0x55dd6489dc70 2024-09-12T17:28:01.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.710+0000 7f2a767fc640 1 -- 172.21.15.170:0/3493695029 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b8c0174d0 con 0x55dd6489dc70 2024-09-12T17:28:01.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.710+0000 7f2b96b2e800 1 -- 172.21.15.170:0/3493695029 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dd6489dc70 msgr2=0x55dd6489e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.710+0000 7f2b96b2e800 1 --2- 172.21.15.170:0/3493695029 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dd6489dc70 0x55dd6489e070 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0532d0 tx=0x7f2b8c0158b0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.710+0000 7f2b96b2e800 1 -- 172.21.15.170:0/3493695029 shutdown_connections 2024-09-12T17:28:01.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.710+0000 7f2b96b2e800 1 --2- 172.21.15.170:0/3493695029 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dd6489dc70 0x55dd6489e070 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.710+0000 7f2b96b2e800 1 -- 172.21.15.170:0/3493695029 >> 172.21.15.170:0/3493695029 conn(0x55dd6489a070 msgr2=0x55dd648982b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:01.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.710+0000 7f2b96b2e800 1 -- 172.21.15.170:0/3493695029 shutdown_connections 2024-09-12T17:28:01.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.710+0000 7f2b96b2e800 1 -- 172.21.15.170:0/3493695029 wait complete. 2024-09-12T17:28:01.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.711+0000 7f2b96b2e800 1 Processor -- start 2024-09-12T17:28:01.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.711+0000 7f2b96b2e800 1 -- start start 2024-09-12T17:28:01.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.711+0000 7f2b96b2e800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dd6489dc70 0x55dd648a51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.711+0000 7f2b96b2e800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55dd6489ec80 con 0x55dd6489dc70 2024-09-12T17:28:01.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.711+0000 7f2b930de640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dd6489dc70 0x55dd648a51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.711+0000 7f2b930de640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dd6489dc70 0x55dd648a51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57428/0 (socket says 172.21.15.170:57428) 2024-09-12T17:28:01.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.711+0000 7f2b930de640 1 -- 172.21.15.170:0/2081877750 learned_addr learned my addr 172.21.15.170:0/2081877750 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:01.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.711+0000 7f2b930de640 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd648a5740 con 0x55dd6489dc70 2024-09-12T17:28:01.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.712+0000 7f2b930de640 1 --2- 172.21.15.170:0/2081877750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dd6489dc70 0x55dd648a51e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0154a0 tx=0x7f2b8c053230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.712+0000 7f2a74ff9640 1 -- 172.21.15.170:0/2081877750 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b8c04a040 con 0x55dd6489dc70 2024-09-12T17:28:01.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.712+0000 7f2a74ff9640 1 -- 172.21.15.170:0/2081877750 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b8c016c50 con 0x55dd6489dc70 2024-09-12T17:28:01.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.712+0000 7f2a74ff9640 1 -- 172.21.15.170:0/2081877750 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b8c00b030 con 0x55dd6489dc70 2024-09-12T17:28:01.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.712+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dd648a59d0 con 0x55dd6489dc70 2024-09-12T17:28:01.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.712+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd648a6350 con 0x55dd6489dc70 2024-09-12T17:28:01.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.713+0000 7f2a74ff9640 1 -- 172.21.15.170:0/2081877750 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2b8c033020 con 0x55dd6489dc70 2024-09-12T17:28:01.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.713+0000 7f2a74ff9640 1 --2- 172.21.15.170:0/2081877750 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2a5c03c780 0x7f2a5c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.713+0000 7f2a74ff9640 1 -- 172.21.15.170:0/2081877750 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f2b8c031020 con 0x55dd6489dc70 2024-09-12T17:28:01.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.713+0000 7f2b928dd640 1 --2- 172.21.15.170:0/2081877750 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2a5c03c780 0x7f2a5c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.713+0000 7f2b928dd640 1 --2- 172.21.15.170:0/2081877750 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2a5c03c780 0x7f2a5c03ec40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x55dd64878310 tx=0x7f2b84047000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.713+0000 7f2b96b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.713+0000 7f2b96b2e800 1 --2- 172.21.15.170:0/2081877750 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55dd648b0b10 0x55dd648b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.713+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd648b3720 con 0x55dd648b0b10 2024-09-12T17:28:01.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.714+0000 7f2b920dc640 1 --2- 172.21.15.170:0/2081877750 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55dd648b0b10 0x55dd648b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.714+0000 7f2b920dc640 1 --2- 172.21.15.170:0/2081877750 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55dd648b0b10 0x55dd648b2fd0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.714+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b7c051070 con 0x55dd648b0b10 2024-09-12T17:28:01.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.714+0000 7f2b96b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.714+0000 7f2b96b2e800 20 realm 2024-09-12T17:28:01.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.714+0000 7f2b96b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.714+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd648b3b50 con 0x55dd648b0b10 2024-09-12T17:28:01.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.714+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b7c051070 con 0x55dd648b0b10 2024-09-12T17:28:01.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.714+0000 7f2b96b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.714+0000 7f2b96b2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:01.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.714+0000 7f2b96b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.714+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd648b4420 con 0x55dd648b0b10 2024-09-12T17:28:01.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.715+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b7c051070 con 0x55dd648b0b10 2024-09-12T17:28:01.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.715+0000 7f2b96b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.715+0000 7f2b96b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.715+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd648b47c0 con 0x55dd648b0b10 2024-09-12T17:28:01.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.715+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2b7c051070 con 0x55dd648b0b10 2024-09-12T17:28:01.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.715+0000 7f2b96b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:01.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.715+0000 7f2b96b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.715+0000 7f2b96b2e800 1 --2- 172.21.15.170:0/2081877750 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55dd648b5520 0x55dd648b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.715+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd648b7f20 con 0x55dd648b5520 2024-09-12T17:28:01.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.715+0000 7f2b930de640 1 --2- 172.21.15.170:0/2081877750 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55dd648b5520 0x55dd648b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.715+0000 7f2b930de640 1 --2- 172.21.15.170:0/2081877750 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55dd648b5520 0x55dd648b7910 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.716+0000 7f2b930de640 1 -- 172.21.15.170:0/2081877750 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2b8c0083e0 con 0x55dd648b5520 2024-09-12T17:28:01.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.716+0000 7f2b96b2e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:01.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.716+0000 7f2b96b2e800 20 searching for the correct realm 2024-09-12T17:28:01.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.716+0000 7f2b96b2e800 1 --2- 172.21.15.170:0/2081877750 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55dd648b9ed0 0x55dd648bc390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.716+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd648bca10 con 0x55dd648b9ed0 2024-09-12T17:28:01.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.716+0000 7f2b928dd640 1 --2- 172.21.15.170:0/2081877750 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55dd648b9ed0 0x55dd648bc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.716+0000 7f2b928dd640 1 --2- 172.21.15.170:0/2081877750 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55dd648b9ed0 0x55dd648bc390 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.716+0000 7f2b928dd640 1 -- 172.21.15.170:0/2081877750 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b8401b070 con 0x55dd648b9ed0 2024-09-12T17:28:01.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.716+0000 7f2b928dd640 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd648bca10 con 0x55dd648b5520 2024-09-12T17:28:01.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.716+0000 7f2b930de640 1 -- 172.21.15.170:0/2081877750 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b8c0083e0 con 0x55dd648b5520 2024-09-12T17:28:01.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.717+0000 7f2b930de640 1 --2- 172.21.15.170:0/2081877750 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f2b8c021020 0x7f2b8c0479c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.717+0000 7f2b930de640 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd648bca10 con 0x7f2b8c021020 2024-09-12T17:28:01.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.717+0000 7f2b920dc640 1 --2- 172.21.15.170:0/2081877750 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f2b8c021020 0x7f2b8c0479c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.717+0000 7f2b920dc640 1 --2- 172.21.15.170:0/2081877750 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f2b8c021020 0x7f2b8c0479c0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.717+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b7c051070 con 0x7f2b8c021020 2024-09-12T17:28:01.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.717+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd648bca10 con 0x55dd648b0b10 2024-09-12T17:28:01.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.717+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b7c051070 con 0x55dd648b0b10 2024-09-12T17:28:01.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.718+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd648bca10 con 0x55dd648b0b10 2024-09-12T17:28:01.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.718+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b7c051070 con 0x55dd648b0b10 2024-09-12T17:28:01.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.718+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd648bca10 con 0x7f2b8c021020 2024-09-12T17:28:01.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.718+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b7c051070 con 0x7f2b8c021020 2024-09-12T17:28:01.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.718+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd648bca10 con 0x7f2b8c021020 2024-09-12T17:28:01.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.718+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b7c051070 con 0x7f2b8c021020 2024-09-12T17:28:01.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.718+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd648bca10 con 0x55dd648b5520 2024-09-12T17:28:01.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.718+0000 7f2b930de640 1 -- 172.21.15.170:0/2081877750 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b8c0083e0 con 0x55dd648b5520 2024-09-12T17:28:01.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.718+0000 7f2b930de640 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd648bca10 con 0x55dd648b9ed0 2024-09-12T17:28:01.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.719+0000 7f2b928dd640 1 -- 172.21.15.170:0/2081877750 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b8401b070 con 0x55dd648b9ed0 2024-09-12T17:28:01.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.719+0000 7f2b928dd640 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd648bca10 con 0x55dd648b0b10 2024-09-12T17:28:01.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.719+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b7c051070 con 0x55dd648b0b10 2024-09-12T17:28:01.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.719+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd648bca10 con 0x7f2b8c021020 2024-09-12T17:28:01.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.719+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b7c051070 con 0x7f2b8c021020 2024-09-12T17:28:01.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.719+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd648bca10 con 0x55dd648b0b10 2024-09-12T17:28:01.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.719+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b7c051070 con 0x55dd648b0b10 2024-09-12T17:28:01.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.719+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd648bca10 con 0x55dd648b5520 2024-09-12T17:28:01.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.720+0000 7f2b930de640 1 -- 172.21.15.170:0/2081877750 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f2b8c0083e0 con 0x55dd648b5520 2024-09-12T17:28:01.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.720+0000 7f2b930de640 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd648bca10 con 0x55dd648b9ed0 2024-09-12T17:28:01.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.720+0000 7f2b928dd640 1 -- 172.21.15.170:0/2081877750 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b8401b070 con 0x55dd648b9ed0 2024-09-12T17:28:01.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.720+0000 7f2b928dd640 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd648bca10 con 0x55dd648b9ed0 2024-09-12T17:28:01.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.720+0000 7f2b928dd640 1 -- 172.21.15.170:0/2081877750 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b8401b070 con 0x55dd648b9ed0 2024-09-12T17:28:01.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.720+0000 7f2b928dd640 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd648bca10 con 0x7f2b8c021020 2024-09-12T17:28:01.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.720+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b7c051070 con 0x7f2b8c021020 2024-09-12T17:28:01.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.720+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd648bca10 con 0x55dd648b9ed0 2024-09-12T17:28:01.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.721+0000 7f2b928dd640 1 -- 172.21.15.170:0/2081877750 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b8401b070 con 0x55dd648b9ed0 2024-09-12T17:28:01.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.721+0000 7f2b928dd640 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd648bca10 con 0x55dd648b9ed0 2024-09-12T17:28:01.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.721+0000 7f2b928dd640 1 -- 172.21.15.170:0/2081877750 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b8401b070 con 0x55dd648b9ed0 2024-09-12T17:28:01.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.721+0000 7f2b928dd640 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd648bca10 con 0x55dd648b0b10 2024-09-12T17:28:01.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.721+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b7c051070 con 0x55dd648b0b10 2024-09-12T17:28:01.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.721+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd648bca10 con 0x55dd648b0b10 2024-09-12T17:28:01.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.721+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2b7c051070 con 0x55dd648b0b10 2024-09-12T17:28:01.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.721+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd648bca10 con 0x7f2b8c021020 2024-09-12T17:28:01.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.721+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b7c051070 con 0x7f2b8c021020 2024-09-12T17:28:01.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.721+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd648bca10 con 0x55dd648b9ed0 2024-09-12T17:28:01.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.722+0000 7f2b928dd640 1 -- 172.21.15.170:0/2081877750 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b8401b070 con 0x55dd648b9ed0 2024-09-12T17:28:01.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.722+0000 7f2b928dd640 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd648bca10 con 0x55dd648b5520 2024-09-12T17:28:01.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.722+0000 7f2b930de640 1 -- 172.21.15.170:0/2081877750 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b8c0083e0 con 0x55dd648b5520 2024-09-12T17:28:01.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.722+0000 7f2b930de640 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd648bca10 con 0x55dd648b0b10 2024-09-12T17:28:01.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.722+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b7c051070 con 0x55dd648b0b10 2024-09-12T17:28:01.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.722+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd648bca10 con 0x7f2b8c021020 2024-09-12T17:28:01.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.722+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b7c051070 con 0x7f2b8c021020 2024-09-12T17:28:01.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.722+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd648bca10 con 0x55dd648b9ed0 2024-09-12T17:28:01.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.723+0000 7f2b928dd640 1 -- 172.21.15.170:0/2081877750 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b8401b070 con 0x55dd648b9ed0 2024-09-12T17:28:01.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.723+0000 7f2b928dd640 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd648bca10 con 0x7f2b8c021020 2024-09-12T17:28:01.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.723+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b7c051070 con 0x7f2b8c021020 2024-09-12T17:28:01.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.723+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd648bca10 con 0x55dd648b5520 2024-09-12T17:28:01.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.723+0000 7f2b930de640 1 -- 172.21.15.170:0/2081877750 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b8c0083e0 con 0x55dd648b5520 2024-09-12T17:28:01.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.723+0000 7f2b930de640 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd648bca10 con 0x55dd648b9ed0 2024-09-12T17:28:01.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.723+0000 7f2b928dd640 1 -- 172.21.15.170:0/2081877750 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b8401b070 con 0x55dd648b9ed0 2024-09-12T17:28:01.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.723+0000 7f2b928dd640 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd648bca10 con 0x7f2b8c021020 2024-09-12T17:28:01.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.724+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b7c051070 con 0x7f2b8c021020 2024-09-12T17:28:01.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.724+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd648bca10 con 0x55dd648b0b10 2024-09-12T17:28:01.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.724+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2b7c051070 con 0x55dd648b0b10 2024-09-12T17:28:01.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.724+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55dd648bca10 con 0x55dd648b5520 2024-09-12T17:28:01.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.724+0000 7f2b930de640 1 -- 172.21.15.170:0/2081877750 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2b8c0083e0 con 0x55dd648b5520 2024-09-12T17:28:01.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.724+0000 7f2b96b2e800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:01.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.724+0000 7f2b96b2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:01.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.724+0000 7f2b96b2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:01.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.724+0000 7f2b96b2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:01.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.724+0000 7f2b96b2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:01.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.724+0000 7f2b96b2e800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:01.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.724+0000 7f2b96b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.724+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd648b8910 con 0x55dd648b0b10 2024-09-12T17:28:01.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.724+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b7c051070 con 0x55dd648b0b10 2024-09-12T17:28:01.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.724+0000 7f2b96b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.724+0000 7f2b96b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.724+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd648b91b0 con 0x55dd648b0b10 2024-09-12T17:28:01.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.725+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2b7c051070 con 0x55dd648b0b10 2024-09-12T17:28:01.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.725+0000 7f2b96b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:01.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.725+0000 7f2b96b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.725+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd648b8550 con 0x55dd648b5520 2024-09-12T17:28:01.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.725+0000 7f2b930de640 1 -- 172.21.15.170:0/2081877750 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2b8c0083e0 con 0x55dd648b5520 2024-09-12T17:28:01.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.725+0000 7f2b96b2e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:01.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.725+0000 7f2b96b2e800 20 zone default found 2024-09-12T17:28:01.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.725+0000 7f2b96b2e800 4 Realm: () 2024-09-12T17:28:01.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.725+0000 7f2b96b2e800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:01.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.725+0000 7f2b96b2e800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:01.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.725+0000 7f2b96b2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:01.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.725+0000 7f2b96b2e800 20 zonegroup default 2024-09-12T17:28:01.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.725+0000 7f2b96b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.725+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd648bcef0 con 0x7f2b8c021020 2024-09-12T17:28:01.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.725+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2b7c051070 con 0x7f2b8c021020 2024-09-12T17:28:01.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.725+0000 7f2b96b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.725+0000 7f2b96b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.725+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd648bf1d0 con 0x55dd648b9ed0 2024-09-12T17:28:01.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.726+0000 7f2b928dd640 1 -- 172.21.15.170:0/2081877750 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2b8401b070 con 0x55dd648b9ed0 2024-09-12T17:28:01.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.726+0000 7f2b96b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.726+0000 7f2b96b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.726+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd648bf570 con 0x55dd648b9ed0 2024-09-12T17:28:01.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.726+0000 7f2b928dd640 1 -- 172.21.15.170:0/2081877750 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2b8401b070 con 0x55dd648b9ed0 2024-09-12T17:28:01.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.726+0000 7f2b96b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.726+0000 7f2b96b2e800 20 started sync module instance, tier type = 2024-09-12T17:28:01.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.726+0000 7f2b96b2e800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:01.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.726+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd648be660 con 0x55dd648b5520 2024-09-12T17:28:01.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.727+0000 7f2b930de640 1 -- 172.21.15.170:0/2081877750 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b8c0083e0 con 0x55dd648b5520 2024-09-12T17:28:01.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.727+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94409363024736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd648be660 con 0x55dd648b5520 2024-09-12T17:28:01.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.727+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd648c0050 con 0x55dd648b0b10 2024-09-12T17:28:01.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.728+0000 7f2b930de640 1 -- 172.21.15.170:0/2081877750 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94409363024736] v29'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b8c0083e0 con 0x55dd648b5520 2024-09-12T17:28:01.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.728+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b7c051070 con 0x55dd648b0b10 2024-09-12T17:28:01.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.728+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94409363028800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd648be660 con 0x55dd648b0b10 2024-09-12T17:28:01.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.728+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd648c0b10 con 0x55dd648b9ed0 2024-09-12T17:28:01.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.729+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94409363028800] v29'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b7c051070 con 0x55dd648b0b10 2024-09-12T17:28:01.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.729+0000 7f2b928dd640 1 -- 172.21.15.170:0/2081877750 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b8401b070 con 0x55dd648b9ed0 2024-09-12T17:28:01.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.729+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94409363022256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd648be5d0 con 0x55dd648b9ed0 2024-09-12T17:28:01.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.729+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd648c19d0 con 0x55dd648b5520 2024-09-12T17:28:01.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.730+0000 7f2b930de640 1 -- 172.21.15.170:0/2081877750 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b8c0083e0 con 0x55dd648b5520 2024-09-12T17:28:01.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.731+0000 7f2b928dd640 1 -- 172.21.15.170:0/2081877750 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94409363022256] v29'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b8401b070 con 0x55dd648b9ed0 2024-09-12T17:28:01.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.731+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94409363035904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd648c1dc0 con 0x55dd648b5520 2024-09-12T17:28:01.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.731+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd648c27c0 con 0x55dd648b0b10 2024-09-12T17:28:01.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.731+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b7c051070 con 0x55dd648b0b10 2024-09-12T17:28:01.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.732+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94409363038928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd648c2730 con 0x55dd648b0b10 2024-09-12T17:28:01.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.732+0000 7f2b930de640 1 -- 172.21.15.170:0/2081877750 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94409363035904] v29'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b8c0083e0 con 0x55dd648b5520 2024-09-12T17:28:01.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.732+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd648c37b0 con 0x7f2b8c021020 2024-09-12T17:28:01.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.733+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b7c051070 con 0x7f2b8c021020 2024-09-12T17:28:01.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.733+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94409363042944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd648c3770 con 0x7f2b8c021020 2024-09-12T17:28:01.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.733+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94409363038928] v29'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b7c051070 con 0x55dd648b0b10 2024-09-12T17:28:01.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.733+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd648c2bb0 con 0x7f2b8c021020 2024-09-12T17:28:01.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.734+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v29'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b7c051070 con 0x7f2b8c021020 2024-09-12T17:28:01.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.734+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94409363041200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd648c41c0 con 0x7f2b8c021020 2024-09-12T17:28:01.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.734+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd648c4b80 con 0x7f2b8c021020 2024-09-12T17:28:01.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.734+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94409363042944] v29'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b7c051070 con 0x7f2b8c021020 2024-09-12T17:28:01.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.735+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94409363041200] v29'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b7c051070 con 0x7f2b8c021020 2024-09-12T17:28:01.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.735+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(58 notify.7 [create] v29'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b7c051070 con 0x7f2b8c021020 2024-09-12T17:28:01.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.735+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94409363045648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd648c4130 con 0x7f2b8c021020 2024-09-12T17:28:01.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.735+0000 7f2b96b2e800 20 add_watcher() i=0 2024-09-12T17:28:01.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.735+0000 7f2b96b2e800 20 add_watcher() i=1 2024-09-12T17:28:01.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.735+0000 7f2b96b2e800 20 add_watcher() i=2 2024-09-12T17:28:01.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.735+0000 7f2b96b2e800 20 add_watcher() i=3 2024-09-12T17:28:01.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.735+0000 7f2b96b2e800 20 add_watcher() i=4 2024-09-12T17:28:01.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.735+0000 7f2b96b2e800 20 add_watcher() i=5 2024-09-12T17:28:01.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.735+0000 7f2b96b2e800 20 add_watcher() i=6 2024-09-12T17:28:01.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.736+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94409363045648] v29'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b7c051070 con 0x7f2b8c021020 2024-09-12T17:28:01.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.736+0000 7f2b96b2e800 20 add_watcher() i=7 2024-09-12T17:28:01.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.736+0000 7f2b96b2e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:01.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.736+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd648c7bb0 con 0x55dd648b0b10 2024-09-12T17:28:01.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.736+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2b7c051070 con 0x55dd648b0b10 2024-09-12T17:28:01.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.736+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94409363048144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd648c4fa0 con 0x55dd648b0b10 2024-09-12T17:28:01.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.737+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94409363048144] v29'84 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2b7c051070 con 0x55dd648b0b10 2024-09-12T17:28:01.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.737+0000 7f2a497e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:01.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.738+0000 7f2b96b2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:01.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.738+0000 7f2b96b2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:01.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.738+0000 7f2b96b2e800 5 note: GC not initialized 2024-09-12T17:28:01.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.738+0000 7f29c3fff640 20 reqs_thread_entry: start 2024-09-12T17:28:01.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.738+0000 7f2b96b2e800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:01.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.738+0000 7f2b96b2e800 20 Filter name: none 2024-09-12T17:28:01.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.738+0000 7f29c1ffb640 20 reqs_thread_entry: start 2024-09-12T17:28:01.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.738+0000 7f2b96b2e800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:28:01.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.738+0000 7f2b96b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.738+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd648faa50 con 0x55dd648b0b10 2024-09-12T17:28:01.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.738+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 foo [call out=48b,read 0~582 out=582b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+705 (crc 0 0 0) 0x7f2b7c051070 con 0x55dd648b0b10 2024-09-12T17:28:01.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.738+0000 7f2b96b2e800 20 rados_obj.operate() r=0 bl.length=582 2024-09-12T17:28:01.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.739+0000 7f2b96b2e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T17:28:01.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.739+0000 7f2b96b2e800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:28:01.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.739+0000 7f2b96b2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:01.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.739+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd64900f10 con 0x55dd648b0b10 2024-09-12T17:28:01.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.740+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v29'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f2b7c051070 con 0x55dd648b0b10 2024-09-12T17:28:01.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.740+0000 7f2b96b2e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:28:01.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.740+0000 7f2b96b2e800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:28:01.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.740+0000 7f2b96b2e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T17:28:01.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.740+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94409363294480 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55dd648fc8a0 con 0x55dd648b0b10 2024-09-12T17:28:01.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.740+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== watch-notify(notify (1) cookie 94409363038928 notify 124554051593 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f2b7c082040 con 0x55dd648b0b10 2024-09-12T17:28:01.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.740+0000 7f2a767fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051593 cookie 94409363038928 notifier 4407 bl.length()=732 2024-09-12T17:28:01.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.740+0000 7f2a767fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:28:01.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.740+0000 7f2a767fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:28:01.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.740+0000 7f2a767fc640 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f2a58003ea0 con 0x55dd648b0b10 2024-09-12T17:28:01.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.740+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(64 notify.4 [notify cookie 94409363294480 out=8b] v0'0 uv75 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2b7c051070 con 0x55dd648b0b10 2024-09-12T17:28:01.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.740+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b7c051070 con 0x55dd648b0b10 2024-09-12T17:28:01.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.740+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== watch-notify(notify_complete (2) cookie 94409363294480 notify 124554051593 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55dd6460d6b0 con 0x55dd648b0b10 2024-09-12T17:28:01.757 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T17:27:59.362376Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-12T17:28:01.319035Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:27:59.362351Z","tags":[],"group_ids":[]} 2024-09-12T17:28:01.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.741+0000 7f2a497e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:01.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.741+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94409363048144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd648f88f0 con 0x55dd648b0b10 2024-09-12T17:28:01.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.742+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94409363048144] v29'85 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2b7c051070 con 0x55dd648b0b10 2024-09-12T17:28:01.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.742+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94409363024736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd648f88f0 con 0x55dd648b5520 2024-09-12T17:28:01.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.743+0000 7f2b930de640 1 -- 172.21.15.170:0/2081877750 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94409363024736] v29'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b8c0083e0 con 0x55dd648b5520 2024-09-12T17:28:01.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.743+0000 7f2b96b2e800 20 remove_watcher() i=0 2024-09-12T17:28:01.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.743+0000 7f2b96b2e800 2 removed watcher, disabling cache 2024-09-12T17:28:01.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.743+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94409363028800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd648f88f0 con 0x55dd648b0b10 2024-09-12T17:28:01.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.744+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94409363028800] v29'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b7c051070 con 0x55dd648b0b10 2024-09-12T17:28:01.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.745+0000 7f2b96b2e800 20 remove_watcher() i=1 2024-09-12T17:28:01.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.745+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94409363022256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd648f88f0 con 0x55dd648b9ed0 2024-09-12T17:28:01.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.746+0000 7f2b928dd640 1 -- 172.21.15.170:0/2081877750 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94409363022256] v29'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b8401b070 con 0x55dd648b9ed0 2024-09-12T17:28:01.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.746+0000 7f2b96b2e800 20 remove_watcher() i=2 2024-09-12T17:28:01.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.746+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94409363035904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd648f88f0 con 0x55dd648b5520 2024-09-12T17:28:01.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.747+0000 7f2b930de640 1 -- 172.21.15.170:0/2081877750 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94409363035904] v29'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b8c0083e0 con 0x55dd648b5520 2024-09-12T17:28:01.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.747+0000 7f2b96b2e800 20 remove_watcher() i=3 2024-09-12T17:28:01.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.747+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94409363038928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd648f88f0 con 0x55dd648b0b10 2024-09-12T17:28:01.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.748+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94409363038928] v29'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b7c051070 con 0x55dd648b0b10 2024-09-12T17:28:01.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.748+0000 7f2b96b2e800 20 remove_watcher() i=4 2024-09-12T17:28:01.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.748+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94409363042944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd648f88f0 con 0x7f2b8c021020 2024-09-12T17:28:01.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.749+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94409363042944] v29'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b7c051070 con 0x7f2b8c021020 2024-09-12T17:28:01.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.749+0000 7f2b96b2e800 20 remove_watcher() i=5 2024-09-12T17:28:01.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.749+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94409363041200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd648f88f0 con 0x7f2b8c021020 2024-09-12T17:28:01.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.750+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94409363041200] v29'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b7c051070 con 0x7f2b8c021020 2024-09-12T17:28:01.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.750+0000 7f2b96b2e800 20 remove_watcher() i=6 2024-09-12T17:28:01.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.750+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94409363045648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55dd648f88f0 con 0x7f2b8c021020 2024-09-12T17:28:01.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.751+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94409363045648] v29'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b7c051070 con 0x7f2b8c021020 2024-09-12T17:28:01.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.751+0000 7f2b96b2e800 20 remove_watcher() i=7 2024-09-12T17:28:01.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.751+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f2b8c021020 msgr2=0x7f2b8c0479c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.751+0000 7f2b96b2e800 1 --2- 172.21.15.170:0/2081877750 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f2b8c021020 0x7f2b8c0479c0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.751+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55dd648b0b10 msgr2=0x55dd648b2fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.751+0000 7f2b96b2e800 1 --2- 172.21.15.170:0/2081877750 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55dd648b0b10 0x55dd648b2fd0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.751+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55dd648b5520 msgr2=0x55dd648b7910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.751+0000 7f2b96b2e800 1 --2- 172.21.15.170:0/2081877750 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55dd648b5520 0x55dd648b7910 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.751+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55dd648b9ed0 msgr2=0x55dd648bc390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.751+0000 7f2b96b2e800 1 --2- 172.21.15.170:0/2081877750 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55dd648b9ed0 0x55dd648bc390 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.751+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2a5c03c780 msgr2=0x7f2a5c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.751+0000 7f2b96b2e800 1 --2- 172.21.15.170:0/2081877750 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2a5c03c780 0x7f2a5c03ec40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x55dd64878310 tx=0x7f2b84047000 comp rx=0 tx=0).stop 2024-09-12T17:28:01.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.751+0000 7f2b920dc640 1 -- 172.21.15.170:0/2081877750 reap_dead start 2024-09-12T17:28:01.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.751+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dd6489dc70 msgr2=0x55dd648a51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.751+0000 7f2b96b2e800 1 --2- 172.21.15.170:0/2081877750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dd6489dc70 0x55dd648a51e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0154a0 tx=0x7f2b8c053230 comp rx=0 tx=0).stop 2024-09-12T17:28:01.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.751+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 shutdown_connections 2024-09-12T17:28:01.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.751+0000 7f2b96b2e800 1 --2- 172.21.15.170:0/2081877750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dd6489dc70 0x55dd648a51e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.751+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 >> 172.21.15.170:0/2081877750 conn(0x55dd6489a070 msgr2=0x55dd64898280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:01.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.751+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 shutdown_connections 2024-09-12T17:28:01.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.751+0000 7f2b96b2e800 1 -- 172.21.15.170:0/2081877750 wait complete. 2024-09-12T17:28:01.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.751+0000 7f2b96b2e800 1 -- 172.21.15.170:0/1120048494 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2a6c03c730 msgr2=0x7f2a6c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.751+0000 7f2b96b2e800 1 --2- 172.21.15.170:0/1120048494 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2a6c03c730 0x7f2a6c03ebf0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x55dd64882c30 tx=0x7f2b84051e70 comp rx=0 tx=0).stop 2024-09-12T17:28:01.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.751+0000 7f2b96b2e800 1 -- 172.21.15.170:0/1120048494 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dd64891150 msgr2=0x55dd64891570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.751+0000 7f2b96b2e800 1 --2- 172.21.15.170:0/1120048494 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dd64891150 0x55dd64891570 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x55dd64877220 tx=0x7f2b8c00bf30 comp rx=0 tx=0).stop 2024-09-12T17:28:01.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.751+0000 7f2b96b2e800 1 -- 172.21.15.170:0/1120048494 shutdown_connections 2024-09-12T17:28:01.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.751+0000 7f2b96b2e800 1 --2- 172.21.15.170:0/1120048494 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2a6c03c730 0x7f2a6c03ebf0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.751+0000 7f2b96b2e800 1 --2- 172.21.15.170:0/1120048494 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dd64891150 0x55dd64891570 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.751+0000 7f2b96b2e800 1 -- 172.21.15.170:0/1120048494 >> 172.21.15.170:0/1120048494 conn(0x55dd64885500 msgr2=0x55dd648858e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:01.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.751+0000 7f2b96b2e800 1 -- 172.21.15.170:0/1120048494 shutdown_connections 2024-09-12T17:28:01.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.751+0000 7f2b96b2e800 1 -- 172.21.15.170:0/1120048494 wait complete. 2024-09-12T17:28:01.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.752+0000 7f2b96b2e800 1 -- 172.21.15.170:0/3908494869 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55dd6477cfd0 msgr2=0x55dd6487d870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.752+0000 7f2b96b2e800 1 --2- 172.21.15.170:0/3908494869 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55dd6477cfd0 0x55dd6487d870 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.752+0000 7f2b96b2e800 1 -- 172.21.15.170:0/3908494869 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55dd6487fc50 msgr2=0x55dd648820d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.752+0000 7f2b96b2e800 1 --2- 172.21.15.170:0/3908494869 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55dd6487fc50 0x55dd648820d0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.752+0000 7f2b96b2e800 1 -- 172.21.15.170:0/3908494869 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2a7803c780 msgr2=0x7f2a7803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.752+0000 7f2b96b2e800 1 --2- 172.21.15.170:0/3908494869 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2a7803c780 0x7f2a7803ec40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c057000 tx=0x7f2b7c052000 comp rx=0 tx=0).stop 2024-09-12T17:28:01.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.752+0000 7f2b96b2e800 1 -- 172.21.15.170:0/3908494869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dd6477b4b0 msgr2=0x55dd64876220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.752+0000 7f2b96b2e800 1 --2- 172.21.15.170:0/3908494869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dd6477b4b0 0x55dd64876220 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2b84000f80 tx=0x7f2b84001250 comp rx=0 tx=0).stop 2024-09-12T17:28:01.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.752+0000 7f2b96b2e800 1 -- 172.21.15.170:0/3908494869 shutdown_connections 2024-09-12T17:28:01.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.752+0000 7f2b96b2e800 1 --2- 172.21.15.170:0/3908494869 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55dd6487fc50 0x55dd648820d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.752+0000 7f2b96b2e800 1 --2- 172.21.15.170:0/3908494869 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2a7803c780 0x7f2a7803ec40 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.752+0000 7f2b96b2e800 1 --2- 172.21.15.170:0/3908494869 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55dd6477cfd0 0x55dd6487d870 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.752+0000 7f2b96b2e800 1 --2- 172.21.15.170:0/3908494869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dd6477b4b0 0x55dd64876220 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.752+0000 7f2b96b2e800 1 -- 172.21.15.170:0/3908494869 >> 172.21.15.170:0/3908494869 conn(0x55dd647771c0 msgr2=0x55dd6486fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:01.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.752+0000 7f2b96b2e800 1 -- 172.21.15.170:0/3908494869 shutdown_connections 2024-09-12T17:28:01.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.752+0000 7f2b96b2e800 1 -- 172.21.15.170:0/3908494869 wait complete. 2024-09-12T17:28:01.770 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T17:27:59.362376Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-12T17:28:01.319035Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:27:59.362351Z', 'tags': [], 'group_ids': []} 2024-09-12T17:28:01.770 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-12T17:28:01.770 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-12T17:28:01.770 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-09-12T17:28:01.818 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:01.818 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:01.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.816+0000 7f219fd31800 1 Processor -- start 2024-09-12T17:28:01.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.817+0000 7f219fd31800 1 -- start start 2024-09-12T17:28:01.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.817+0000 7f219fd31800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55b640272620 0x55b640274a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.817+0000 7f219fd31800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b64011be40 con 0x55b640275040 2024-09-12T17:28:01.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.817+0000 7f219fd31800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x55b6400e6680 con 0x55b640272620 2024-09-12T17:28:01.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.817+0000 7f219ba1a640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55b640272620 0x55b640274a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.817+0000 7f219ba1a640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55b640272620 0x55b640274a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57440/0 (socket says 172.21.15.170:57440) 2024-09-12T17:28:01.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.817+0000 7f219ba1a640 1 -- 172.21.15.170:0/3128421954 learned_addr learned my addr 172.21.15.170:0/3128421954 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:01.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.817+0000 7f219b219640 1 --1- 172.21.15.170:0/3128421954 >> v1:172.21.15.47:6789/0 conn(0x55b640275040 0x55b640277500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:48374/0 (socket says 172.21.15.170:48374) 2024-09-12T17:28:01.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.817+0000 7f219ba1a640 1 -- 172.21.15.170:0/3128421954 >> v1:172.21.15.47:6789/0 conn(0x55b640275040 legacy=0x55b640277500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.817+0000 7f219ba1a640 1 -- 172.21.15.170:0/3128421954 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6401026b0 con 0x55b640272620 2024-09-12T17:28:01.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.817+0000 7f219aa18640 1 -- 172.21.15.170:0/3128421954 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 302081115 0 0) 0x55b64011be40 con 0x55b640275040 2024-09-12T17:28:01.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.819+0000 7f219ba1a640 1 --2- 172.21.15.170:0/3128421954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b640272620 0x55b640274a10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f218c00a520 tx=0x7f218c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a50cbf703ba85cdd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.819+0000 7f219aa18640 1 -- 172.21.15.170:0/3128421954 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f218c055070 con 0x55b640272620 2024-09-12T17:28:01.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.819+0000 7f219aa18640 1 -- 172.21.15.170:0/3128421954 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f218c0515b0 con 0x55b640272620 2024-09-12T17:28:01.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.819+0000 7f219aa18640 1 -- 172.21.15.170:0/3128421954 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f218c0518d0 con 0x55b640272620 2024-09-12T17:28:01.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.820+0000 7f219fd31800 1 -- 172.21.15.170:0/3128421954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b640272620 msgr2=0x55b640274a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.820+0000 7f219fd31800 1 --2- 172.21.15.170:0/3128421954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b640272620 0x55b640274a10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f218c00a520 tx=0x7f218c045ba0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.820+0000 7f219fd31800 1 -- 172.21.15.170:0/3128421954 shutdown_connections 2024-09-12T17:28:01.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.820+0000 7f219fd31800 1 --2- 172.21.15.170:0/3128421954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b640272620 0x55b640274a10 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.820+0000 7f219fd31800 1 -- 172.21.15.170:0/3128421954 >> 172.21.15.170:0/3128421954 conn(0x55b64026c1e0 msgr2=0x55b64026e640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:01.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.820+0000 7f219fd31800 1 -- 172.21.15.170:0/3128421954 shutdown_connections 2024-09-12T17:28:01.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.820+0000 7f219fd31800 1 -- 172.21.15.170:0/3128421954 wait complete. 2024-09-12T17:28:01.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.834+0000 7f219fd31800 1 Processor -- start 2024-09-12T17:28:01.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.834+0000 7f219fd31800 1 -- start start 2024-09-12T17:28:01.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.834+0000 7f219fd31800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b640272620 0x55b6403614f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.834+0000 7f219fd31800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b64010add0 con 0x55b640272620 2024-09-12T17:28:01.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.834+0000 7f219ba1a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b640272620 0x55b6403614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.834+0000 7f219ba1a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b640272620 0x55b6403614f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57442/0 (socket says 172.21.15.170:57442) 2024-09-12T17:28:01.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.834+0000 7f219ba1a640 1 -- 172.21.15.170:0/483072509 learned_addr learned my addr 172.21.15.170:0/483072509 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:01.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.835+0000 7f219ba1a640 1 -- 172.21.15.170:0/483072509 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b640123e10 con 0x55b640272620 2024-09-12T17:28:01.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.835+0000 7f219ba1a640 1 --2- 172.21.15.170:0/483072509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b640272620 0x55b6403614f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f218c025da0 tx=0x7f218c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6030ef68d8a9589e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.835+0000 7f2089e0b640 1 -- 172.21.15.170:0/483072509 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f218c051950 con 0x55b640272620 2024-09-12T17:28:01.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.835+0000 7f2089e0b640 1 -- 172.21.15.170:0/483072509 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f218c051af0 con 0x55b640272620 2024-09-12T17:28:01.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.835+0000 7f2089e0b640 1 -- 172.21.15.170:0/483072509 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f218c051dd0 con 0x55b640272620 2024-09-12T17:28:01.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.836+0000 7f219fd31800 1 -- 172.21.15.170:0/483072509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b640272620 msgr2=0x55b6403614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.836+0000 7f219fd31800 1 --2- 172.21.15.170:0/483072509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b640272620 0x55b6403614f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f218c025da0 tx=0x7f218c051000 comp rx=0 tx=0).stop 2024-09-12T17:28:01.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.836+0000 7f219fd31800 1 -- 172.21.15.170:0/483072509 shutdown_connections 2024-09-12T17:28:01.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.836+0000 7f219fd31800 1 --2- 172.21.15.170:0/483072509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b640272620 0x55b6403614f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.836+0000 7f219fd31800 1 -- 172.21.15.170:0/483072509 >> 172.21.15.170:0/483072509 conn(0x55b64026c1e0 msgr2=0x55b64035ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:01.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.836+0000 7f219fd31800 1 -- 172.21.15.170:0/483072509 shutdown_connections 2024-09-12T17:28:01.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.836+0000 7f219fd31800 1 -- 172.21.15.170:0/483072509 wait complete. 2024-09-12T17:28:01.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.836+0000 7f219fd31800 1 Processor -- start 2024-09-12T17:28:01.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.836+0000 7f219fd31800 1 -- start start 2024-09-12T17:28:01.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.836+0000 7f219fd31800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b640272620 0x55b640368c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.836+0000 7f219fd31800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b640279060 con 0x55b640272620 2024-09-12T17:28:01.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.837+0000 7f219ba1a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b640272620 0x55b640368c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.837+0000 7f219ba1a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b640272620 0x55b640368c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57448/0 (socket says 172.21.15.170:57448) 2024-09-12T17:28:01.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.837+0000 7f219ba1a640 1 -- 172.21.15.170:0/13014166 learned_addr learned my addr 172.21.15.170:0/13014166 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:01.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.837+0000 7f219ba1a640 1 -- 172.21.15.170:0/13014166 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6403691f0 con 0x55b640272620 2024-09-12T17:28:01.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.837+0000 7f219ba1a640 1 --2- 172.21.15.170:0/13014166 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b640272620 0x55b640368c90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f218c025da0 tx=0x7f218c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.837+0000 7f2083fff640 1 -- 172.21.15.170:0/13014166 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f218c05a600 con 0x55b640272620 2024-09-12T17:28:01.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.837+0000 7f2083fff640 1 -- 172.21.15.170:0/13014166 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f218c073070 con 0x55b640272620 2024-09-12T17:28:01.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.837+0000 7f219fd31800 1 -- 172.21.15.170:0/13014166 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b640369480 con 0x55b640272620 2024-09-12T17:28:01.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.837+0000 7f2083fff640 1 -- 172.21.15.170:0/13014166 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f218c05a910 con 0x55b640272620 2024-09-12T17:28:01.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.837+0000 7f219fd31800 1 -- 172.21.15.170:0/13014166 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b64036a090 con 0x55b640272620 2024-09-12T17:28:01.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.838+0000 7f2083fff640 1 -- 172.21.15.170:0/13014166 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f218c058070 con 0x55b640272620 2024-09-12T17:28:01.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.838+0000 7f2083fff640 1 --2- 172.21.15.170:0/13014166 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f208403c780 0x7f208403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.838+0000 7f2083fff640 1 -- 172.21.15.170:0/13014166 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f218c06b040 con 0x55b640272620 2024-09-12T17:28:01.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.838+0000 7f219b219640 1 --2- 172.21.15.170:0/13014166 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f208403c780 0x7f208403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.839+0000 7f219fd31800 1 --2- 172.21.15.170:0/13014166 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b640275040 0x55b6403702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.839+0000 7f219fd31800 1 -- 172.21.15.170:0/13014166 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b640370820 con 0x55b640275040 2024-09-12T17:28:01.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.839+0000 7f219c21b640 1 --2- 172.21.15.170:0/13014166 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b640275040 0x55b6403702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.839+0000 7f219b219640 1 --2- 172.21.15.170:0/13014166 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f208403c780 0x7f208403ec40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2190000c00 tx=0x7f21900013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.839+0000 7f219c21b640 1 --2- 172.21.15.170:0/13014166 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b640275040 0x55b6403702e0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.839+0000 7f219c21b640 1 -- 172.21.15.170:0/13014166 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f219400a4d0 con 0x55b640275040 2024-09-12T17:28:01.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.839+0000 7f219fd31800 1 -- 172.21.15.170:0/13014166 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b640370bc0 con 0x55b640275040 2024-09-12T17:28:01.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.839+0000 7f219c21b640 1 -- 172.21.15.170:0/13014166 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f219400a4d0 con 0x55b640275040 2024-09-12T17:28:01.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.840+0000 7f219fd31800 1 --2- 172.21.15.170:0/13014166 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b6403726c0 0x55b640374b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.840+0000 7f219fd31800 1 -- 172.21.15.170:0/13014166 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b6403752f0 con 0x55b6403726c0 2024-09-12T17:28:01.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.840+0000 7f219ba1a640 1 --2- 172.21.15.170:0/13014166 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b6403726c0 0x55b640374b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.840+0000 7f219ba1a640 1 --2- 172.21.15.170:0/13014166 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b6403726c0 0x55b640374b60 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.840+0000 7f219ba1a640 1 -- 172.21.15.170:0/13014166 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f218c057030 con 0x55b6403726c0 2024-09-12T17:28:01.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.840+0000 7f219fd31800 1 -- 172.21.15.170:0/13014166 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b640371410 con 0x55b640275040 2024-09-12T17:28:01.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.840+0000 7f219c21b640 1 -- 172.21.15.170:0/13014166 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f219400a4d0 con 0x55b640275040 2024-09-12T17:28:01.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.840+0000 7f219fd31800 1 -- 172.21.15.170:0/13014166 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b640371860 con 0x55b6403726c0 2024-09-12T17:28:01.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.841+0000 7f219ba1a640 1 -- 172.21.15.170:0/13014166 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f218c057030 con 0x55b6403726c0 2024-09-12T17:28:01.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.841+0000 7f219fd31800 1 Processor -- start 2024-09-12T17:28:01.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.841+0000 7f219fd31800 1 -- start start 2024-09-12T17:28:01.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.841+0000 7f219fd31800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b640271dc0 0x55b640270630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.841+0000 7f219fd31800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b640168a00 con 0x55b640271dc0 2024-09-12T17:28:01.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.842+0000 7f219c21b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b640271dc0 0x55b640270630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.842+0000 7f219c21b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b640271dc0 0x55b640270630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57452/0 (socket says 172.21.15.170:57452) 2024-09-12T17:28:01.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.842+0000 7f219c21b640 1 -- 172.21.15.170:0/4164767533 learned_addr learned my addr 172.21.15.170:0/4164767533 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:01.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.842+0000 7f219c21b640 1 -- 172.21.15.170:0/4164767533 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6402722e0 con 0x55b640271dc0 2024-09-12T17:28:01.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.842+0000 7f219c21b640 1 --2- 172.21.15.170:0/4164767533 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b640271dc0 0x55b640270630 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x55b640369c90 tx=0x7f21940167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.842+0000 7f20817fa640 1 -- 172.21.15.170:0/4164767533 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2194013640 con 0x55b640271dc0 2024-09-12T17:28:01.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.842+0000 7f20817fa640 1 -- 172.21.15.170:0/4164767533 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21940137e0 con 0x55b640271dc0 2024-09-12T17:28:01.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.842+0000 7f219fd31800 1 -- 172.21.15.170:0/4164767533 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b640270b70 con 0x55b640271dc0 2024-09-12T17:28:01.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.842+0000 7f20817fa640 1 -- 172.21.15.170:0/4164767533 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2194013ae0 con 0x55b640271dc0 2024-09-12T17:28:01.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.842+0000 7f219fd31800 1 -- 172.21.15.170:0/4164767533 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6402710c0 con 0x55b640271dc0 2024-09-12T17:28:01.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.843+0000 7f20817fa640 1 -- 172.21.15.170:0/4164767533 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2194011040 con 0x55b640271dc0 2024-09-12T17:28:01.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.843+0000 7f20817fa640 1 --2- 172.21.15.170:0/4164767533 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f207403c730 0x7f207403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.843+0000 7f20817fa640 1 -- 172.21.15.170:0/4164767533 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f219400e040 con 0x55b640271dc0 2024-09-12T17:28:01.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.843+0000 7f219ba1a640 1 --2- 172.21.15.170:0/4164767533 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f207403c730 0x7f207403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.844+0000 7f219fd31800 1 Processor -- start 2024-09-12T17:28:01.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.844+0000 7f219ba1a640 1 --2- 172.21.15.170:0/4164767533 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f207403c730 0x7f207403ebf0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f218c065fd0 tx=0x7f218c095a10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.844+0000 7f219fd31800 1 -- start start 2024-09-12T17:28:01.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.844+0000 7f219fd31800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b640392880 0x55b640392c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.844+0000 7f219fd31800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b640361c80 con 0x55b640392880 2024-09-12T17:28:01.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.844+0000 7f219c21b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b640392880 0x55b640392c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.844+0000 7f219c21b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b640392880 0x55b640392c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57466/0 (socket says 172.21.15.170:57466) 2024-09-12T17:28:01.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.844+0000 7f219c21b640 1 -- 172.21.15.170:0/3640084444 learned_addr learned my addr 172.21.15.170:0/3640084444 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:01.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.845+0000 7f219c21b640 1 -- 172.21.15.170:0/3640084444 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b640393270 con 0x55b640392880 2024-09-12T17:28:01.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.845+0000 7f219c21b640 1 --2- 172.21.15.170:0/3640084444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b640392880 0x55b640392c80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2194005a30 tx=0x7f219401fee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d125d2a4cfbcb9b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.845+0000 7f207affd640 1 -- 172.21.15.170:0/3640084444 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f219401f340 con 0x55b640392880 2024-09-12T17:28:01.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.845+0000 7f207affd640 1 -- 172.21.15.170:0/3640084444 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2194013c80 con 0x55b640392880 2024-09-12T17:28:01.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.845+0000 7f207affd640 1 -- 172.21.15.170:0/3640084444 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f219401f4e0 con 0x55b640392880 2024-09-12T17:28:01.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.845+0000 7f219fd31800 1 -- 172.21.15.170:0/3640084444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b640392880 msgr2=0x55b640392c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.845+0000 7f219fd31800 1 --2- 172.21.15.170:0/3640084444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b640392880 0x55b640392c80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2194005a30 tx=0x7f219401fee0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.845+0000 7f219fd31800 1 -- 172.21.15.170:0/3640084444 shutdown_connections 2024-09-12T17:28:01.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.845+0000 7f219fd31800 1 --2- 172.21.15.170:0/3640084444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b640392880 0x55b640392c80 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.845+0000 7f219fd31800 1 -- 172.21.15.170:0/3640084444 >> 172.21.15.170:0/3640084444 conn(0x55b64038ec80 msgr2=0x55b64038cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:01.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.845+0000 7f219fd31800 1 -- 172.21.15.170:0/3640084444 shutdown_connections 2024-09-12T17:28:01.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.845+0000 7f219fd31800 1 -- 172.21.15.170:0/3640084444 wait complete. 2024-09-12T17:28:01.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.846+0000 7f219fd31800 1 Processor -- start 2024-09-12T17:28:01.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.846+0000 7f219fd31800 1 -- start start 2024-09-12T17:28:01.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.846+0000 7f219fd31800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b640392880 0x55b640399e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.846+0000 7f219fd31800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b640393890 con 0x55b640392880 2024-09-12T17:28:01.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.846+0000 7f219c21b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b640392880 0x55b640399e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.846+0000 7f219c21b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b640392880 0x55b640399e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57468/0 (socket says 172.21.15.170:57468) 2024-09-12T17:28:01.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.846+0000 7f219c21b640 1 -- 172.21.15.170:0/3830434695 learned_addr learned my addr 172.21.15.170:0/3830434695 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:01.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.846+0000 7f219c21b640 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b64039a3f0 con 0x55b640392880 2024-09-12T17:28:01.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.846+0000 7f219c21b640 1 --2- 172.21.15.170:0/3830434695 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b640392880 0x55b640399e90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2194005a30 tx=0x7f2194053d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.847+0000 7f20797fa640 1 -- 172.21.15.170:0/3830434695 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2194013e30 con 0x55b640392880 2024-09-12T17:28:01.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.847+0000 7f20797fa640 1 -- 172.21.15.170:0/3830434695 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2194020a10 con 0x55b640392880 2024-09-12T17:28:01.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.847+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b64039a680 con 0x55b640392880 2024-09-12T17:28:01.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.847+0000 7f20797fa640 1 -- 172.21.15.170:0/3830434695 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2194020cf0 con 0x55b640392880 2024-09-12T17:28:01.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.847+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b64039b000 con 0x55b640392880 2024-09-12T17:28:01.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.847+0000 7f20797fa640 1 -- 172.21.15.170:0/3830434695 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f21940145e0 con 0x55b640392880 2024-09-12T17:28:01.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.848+0000 7f20797fa640 1 --2- 172.21.15.170:0/3830434695 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f206403c780 0x7f206403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.848+0000 7f20797fa640 1 -- 172.21.15.170:0/3830434695 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f2194033aa0 con 0x55b640392880 2024-09-12T17:28:01.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.848+0000 7f219ba1a640 1 --2- 172.21.15.170:0/3830434695 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f206403c780 0x7f206403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.848+0000 7f219ba1a640 1 --2- 172.21.15.170:0/3830434695 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f206403c780 0x7f206403ec40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f218c064b80 tx=0x7f218c092000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.848+0000 7f219fd31800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.848+0000 7f219fd31800 1 --2- 172.21.15.170:0/3830434695 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b6403a5760 0x55b6403a7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.848+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b6403a8370 con 0x55b6403a5760 2024-09-12T17:28:01.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.848+0000 7f219b219640 1 --2- 172.21.15.170:0/3830434695 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b6403a5760 0x55b6403a7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.849+0000 7f219b219640 1 --2- 172.21.15.170:0/3830434695 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b6403a5760 0x55b6403a7c20 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.849+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f219000f5f0 con 0x55b6403a5760 2024-09-12T17:28:01.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.849+0000 7f219fd31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.849+0000 7f219fd31800 20 realm 2024-09-12T17:28:01.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.849+0000 7f219fd31800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.849+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b6403a4ab0 con 0x55b6403a5760 2024-09-12T17:28:01.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.849+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f219000f5f0 con 0x55b6403a5760 2024-09-12T17:28:01.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.849+0000 7f219fd31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.849+0000 7f219fd31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:01.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.849+0000 7f219fd31800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.849+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b6403a8e60 con 0x55b6403a5760 2024-09-12T17:28:01.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.849+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f219000f5f0 con 0x55b6403a5760 2024-09-12T17:28:01.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.849+0000 7f219fd31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.849+0000 7f219fd31800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.849+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b6403a9730 con 0x55b6403a5760 2024-09-12T17:28:01.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.850+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f219000f5f0 con 0x55b6403a5760 2024-09-12T17:28:01.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.850+0000 7f219fd31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:01.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.850+0000 7f219fd31800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.850+0000 7f219fd31800 1 --2- 172.21.15.170:0/3830434695 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b6403aa150 0x55b6403ac540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.850+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b6403accb0 con 0x55b6403aa150 2024-09-12T17:28:01.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.850+0000 7f219c21b640 1 --2- 172.21.15.170:0/3830434695 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b6403aa150 0x55b6403ac540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.850+0000 7f219c21b640 1 --2- 172.21.15.170:0/3830434695 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b6403aa150 0x55b6403ac540 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.850+0000 7f219c21b640 1 -- 172.21.15.170:0/3830434695 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f219400a4d0 con 0x55b6403aa150 2024-09-12T17:28:01.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.850+0000 7f219fd31800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:01.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.850+0000 7f219fd31800 20 searching for the correct realm 2024-09-12T17:28:01.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.850+0000 7f219fd31800 1 --2- 172.21.15.170:0/3830434695 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55b6403aec60 0x55b6403b1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.850+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b17f0 con 0x55b6403aec60 2024-09-12T17:28:01.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.850+0000 7f219ba1a640 1 --2- 172.21.15.170:0/3830434695 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55b6403aec60 0x55b6403b1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.851+0000 7f219ba1a640 1 --2- 172.21.15.170:0/3830434695 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55b6403aec60 0x55b6403b1120 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.851+0000 7f219ba1a640 1 -- 172.21.15.170:0/3830434695 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f218c057030 con 0x55b6403aec60 2024-09-12T17:28:01.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.851+0000 7f219ba1a640 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b17f0 con 0x55b6403aa150 2024-09-12T17:28:01.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.851+0000 7f219c21b640 1 -- 172.21.15.170:0/3830434695 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219400a4d0 con 0x55b6403aa150 2024-09-12T17:28:01.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.851+0000 7f219c21b640 1 --2- 172.21.15.170:0/3830434695 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f219403b3f0 0x7f2194056980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.851+0000 7f219c21b640 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b17f0 con 0x7f219403b3f0 2024-09-12T17:28:01.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.851+0000 7f219b219640 1 --2- 172.21.15.170:0/3830434695 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f219403b3f0 0x7f2194056980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.852+0000 7f219b219640 1 --2- 172.21.15.170:0/3830434695 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f219403b3f0 0x7f2194056980 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.852+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219000f5f0 con 0x7f219403b3f0 2024-09-12T17:28:01.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.852+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b17f0 con 0x55b6403a5760 2024-09-12T17:28:01.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.852+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219000f5f0 con 0x55b6403a5760 2024-09-12T17:28:01.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.852+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b17f0 con 0x55b6403a5760 2024-09-12T17:28:01.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.852+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219002b040 con 0x55b6403a5760 2024-09-12T17:28:01.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.852+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b17f0 con 0x7f219403b3f0 2024-09-12T17:28:01.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.853+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219002b040 con 0x7f219403b3f0 2024-09-12T17:28:01.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.853+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b17f0 con 0x7f219403b3f0 2024-09-12T17:28:01.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.853+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219002b040 con 0x7f219403b3f0 2024-09-12T17:28:01.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.853+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b17f0 con 0x55b6403aa150 2024-09-12T17:28:01.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.853+0000 7f219c21b640 1 -- 172.21.15.170:0/3830434695 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219400a4d0 con 0x55b6403aa150 2024-09-12T17:28:01.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.853+0000 7f219c21b640 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b17f0 con 0x55b6403aec60 2024-09-12T17:28:01.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.853+0000 7f219ba1a640 1 -- 172.21.15.170:0/3830434695 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f218c057030 con 0x55b6403aec60 2024-09-12T17:28:01.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.853+0000 7f219ba1a640 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b17f0 con 0x55b6403a5760 2024-09-12T17:28:01.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.854+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219002b040 con 0x55b6403a5760 2024-09-12T17:28:01.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.854+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b17f0 con 0x7f219403b3f0 2024-09-12T17:28:01.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.854+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219002b040 con 0x7f219403b3f0 2024-09-12T17:28:01.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.854+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b17f0 con 0x55b6403a5760 2024-09-12T17:28:01.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.854+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219002b040 con 0x55b6403a5760 2024-09-12T17:28:01.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.854+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b17f0 con 0x55b6403aa150 2024-09-12T17:28:01.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.854+0000 7f219c21b640 1 -- 172.21.15.170:0/3830434695 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f219400a4d0 con 0x55b6403aa150 2024-09-12T17:28:01.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.854+0000 7f219c21b640 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b17f0 con 0x55b6403aec60 2024-09-12T17:28:01.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.854+0000 7f219ba1a640 1 -- 172.21.15.170:0/3830434695 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f218c057030 con 0x55b6403aec60 2024-09-12T17:28:01.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.854+0000 7f219ba1a640 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b17f0 con 0x55b6403aec60 2024-09-12T17:28:01.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.855+0000 7f219ba1a640 1 -- 172.21.15.170:0/3830434695 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f218c057030 con 0x55b6403aec60 2024-09-12T17:28:01.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.855+0000 7f219ba1a640 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b17f0 con 0x7f219403b3f0 2024-09-12T17:28:01.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.855+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219002b040 con 0x7f219403b3f0 2024-09-12T17:28:01.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.855+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b17f0 con 0x55b6403aec60 2024-09-12T17:28:01.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.855+0000 7f219ba1a640 1 -- 172.21.15.170:0/3830434695 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f218c057030 con 0x55b6403aec60 2024-09-12T17:28:01.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.855+0000 7f219ba1a640 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b17f0 con 0x55b6403aec60 2024-09-12T17:28:01.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.855+0000 7f219ba1a640 1 -- 172.21.15.170:0/3830434695 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f218c057030 con 0x55b6403aec60 2024-09-12T17:28:01.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.855+0000 7f219ba1a640 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b17f0 con 0x55b6403a5760 2024-09-12T17:28:01.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.856+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219002b040 con 0x55b6403a5760 2024-09-12T17:28:01.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.856+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b17f0 con 0x55b6403a5760 2024-09-12T17:28:01.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.856+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f219002b040 con 0x55b6403a5760 2024-09-12T17:28:01.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.856+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b17f0 con 0x7f219403b3f0 2024-09-12T17:28:01.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.856+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219002b040 con 0x7f219403b3f0 2024-09-12T17:28:01.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.856+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b17f0 con 0x55b6403aec60 2024-09-12T17:28:01.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.856+0000 7f219ba1a640 1 -- 172.21.15.170:0/3830434695 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f218c057030 con 0x55b6403aec60 2024-09-12T17:28:01.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.856+0000 7f219ba1a640 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b17f0 con 0x55b6403aa150 2024-09-12T17:28:01.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.856+0000 7f219c21b640 1 -- 172.21.15.170:0/3830434695 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219400a4d0 con 0x55b6403aa150 2024-09-12T17:28:01.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.857+0000 7f219c21b640 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b17f0 con 0x55b6403a5760 2024-09-12T17:28:01.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.857+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219002b040 con 0x55b6403a5760 2024-09-12T17:28:01.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.857+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b17f0 con 0x7f219403b3f0 2024-09-12T17:28:01.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.857+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219003b040 con 0x7f219403b3f0 2024-09-12T17:28:01.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.857+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b17f0 con 0x55b6403aec60 2024-09-12T17:28:01.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.857+0000 7f219ba1a640 1 -- 172.21.15.170:0/3830434695 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f218c057030 con 0x55b6403aec60 2024-09-12T17:28:01.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.857+0000 7f219ba1a640 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b17f0 con 0x7f219403b3f0 2024-09-12T17:28:01.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.857+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219003b040 con 0x7f219403b3f0 2024-09-12T17:28:01.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.857+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b17f0 con 0x55b6403aa150 2024-09-12T17:28:01.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.858+0000 7f219c21b640 1 -- 172.21.15.170:0/3830434695 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2194062040 con 0x55b6403aa150 2024-09-12T17:28:01.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.858+0000 7f219c21b640 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b17f0 con 0x55b6403aec60 2024-09-12T17:28:01.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.858+0000 7f219ba1a640 1 -- 172.21.15.170:0/3830434695 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f218c057030 con 0x55b6403aec60 2024-09-12T17:28:01.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.858+0000 7f219ba1a640 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b17f0 con 0x7f219403b3f0 2024-09-12T17:28:01.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.858+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219003b040 con 0x7f219403b3f0 2024-09-12T17:28:01.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.858+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b17f0 con 0x55b6403a5760 2024-09-12T17:28:01.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.858+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f219003b040 con 0x55b6403a5760 2024-09-12T17:28:01.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.858+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b17f0 con 0x55b6403aa150 2024-09-12T17:28:01.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.859+0000 7f219c21b640 1 -- 172.21.15.170:0/3830434695 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2194062040 con 0x55b6403aa150 2024-09-12T17:28:01.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.859+0000 7f219fd31800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:01.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.859+0000 7f219fd31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:01.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.859+0000 7f219fd31800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:01.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.859+0000 7f219fd31800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:01.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.859+0000 7f219fd31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:01.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.859+0000 7f219fd31800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:01.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.859+0000 7f219fd31800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.859+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b6403ad670 con 0x55b6403a5760 2024-09-12T17:28:01.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.859+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f219003b040 con 0x55b6403a5760 2024-09-12T17:28:01.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.859+0000 7f219fd31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.859+0000 7f219fd31800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.859+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b6403adf10 con 0x55b6403a5760 2024-09-12T17:28:01.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.859+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f219003b040 con 0x55b6403a5760 2024-09-12T17:28:01.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.859+0000 7f219fd31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:01.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.859+0000 7f219fd31800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.859+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b6403ad2b0 con 0x55b6403aa150 2024-09-12T17:28:01.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.859+0000 7f219c21b640 1 -- 172.21.15.170:0/3830434695 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2194062040 con 0x55b6403aa150 2024-09-12T17:28:01.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.859+0000 7f219fd31800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:01.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.859+0000 7f219fd31800 20 zone default found 2024-09-12T17:28:01.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.859+0000 7f219fd31800 4 Realm: () 2024-09-12T17:28:01.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.859+0000 7f219fd31800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:01.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.859+0000 7f219fd31800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:01.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.859+0000 7f219fd31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:01.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.859+0000 7f219fd31800 20 zonegroup default 2024-09-12T17:28:01.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.859+0000 7f219fd31800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.859+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b2120 con 0x7f219403b3f0 2024-09-12T17:28:01.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.860+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f219003b040 con 0x7f219403b3f0 2024-09-12T17:28:01.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.860+0000 7f219fd31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.860+0000 7f219fd31800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.860+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b3dc0 con 0x55b6403aec60 2024-09-12T17:28:01.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.860+0000 7f219ba1a640 1 -- 172.21.15.170:0/3830434695 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f218c057030 con 0x55b6403aec60 2024-09-12T17:28:01.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.860+0000 7f219fd31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.860+0000 7f219fd31800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.860+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b42b0 con 0x55b6403aec60 2024-09-12T17:28:01.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.860+0000 7f219ba1a640 1 -- 172.21.15.170:0/3830434695 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f218c057030 con 0x55b6403aec60 2024-09-12T17:28:01.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.860+0000 7f219fd31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:01.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.860+0000 7f219fd31800 20 started sync module instance, tier type = 2024-09-12T17:28:01.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.860+0000 7f219fd31800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:01.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.860+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b2bc0 con 0x55b6403aa150 2024-09-12T17:28:01.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.861+0000 7f219c21b640 1 -- 172.21.15.170:0/3830434695 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2194062040 con 0x55b6403aa150 2024-09-12T17:28:01.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.861+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94241250029488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b4bc0 con 0x55b6403aa150 2024-09-12T17:28:01.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.861+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b5410 con 0x55b6403a5760 2024-09-12T17:28:01.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.862+0000 7f219c21b640 1 -- 172.21.15.170:0/3830434695 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94241250029488] v29'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2194062040 con 0x55b6403aa150 2024-09-12T17:28:01.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.863+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f219003b040 con 0x55b6403a5760 2024-09-12T17:28:01.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.863+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94241250035472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b5060 con 0x55b6403a5760 2024-09-12T17:28:01.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.863+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b5b80 con 0x55b6403aec60 2024-09-12T17:28:01.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.864+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94241250035472] v29'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f219003b040 con 0x55b6403a5760 2024-09-12T17:28:01.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.864+0000 7f219ba1a640 1 -- 172.21.15.170:0/3830434695 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f218c057030 con 0x55b6403aec60 2024-09-12T17:28:01.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.864+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94241250039376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b5f70 con 0x55b6403aec60 2024-09-12T17:28:01.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.864+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b69b0 con 0x55b6403aa150 2024-09-12T17:28:01.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.865+0000 7f219ba1a640 1 -- 172.21.15.170:0/3830434695 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94241250039376] v29'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f218c057030 con 0x55b6403aec60 2024-09-12T17:28:01.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.865+0000 7f219c21b640 1 -- 172.21.15.170:0/3830434695 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2194062040 con 0x55b6403aa150 2024-09-12T17:28:01.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.865+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94241250043008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b6970 con 0x55b6403aa150 2024-09-12T17:28:01.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.865+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b7460 con 0x55b6403a5760 2024-09-12T17:28:01.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.866+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f219003b040 con 0x55b6403a5760 2024-09-12T17:28:01.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.866+0000 7f219c21b640 1 -- 172.21.15.170:0/3830434695 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94241250043008] v29'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2194062040 con 0x55b6403aa150 2024-09-12T17:28:01.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.866+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94241250036528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b7460 con 0x55b6403a5760 2024-09-12T17:28:01.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.866+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b7eb0 con 0x7f219403b3f0 2024-09-12T17:28:01.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.867+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f219003b040 con 0x7f219403b3f0 2024-09-12T17:28:01.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.867+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94241250048448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b8310 con 0x7f219403b3f0 2024-09-12T17:28:01.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.867+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b8e10 con 0x7f219403b3f0 2024-09-12T17:28:01.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.867+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94241250036528] v29'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f219003b040 con 0x55b6403a5760 2024-09-12T17:28:01.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.868+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94241250048448] v29'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f219003b040 con 0x7f219403b3f0 2024-09-12T17:28:01.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.868+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(56 notify.6 [create] v29'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f219003b040 con 0x7f219403b3f0 2024-09-12T17:28:01.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.868+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94241250049504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b6f70 con 0x7f219403b3f0 2024-09-12T17:28:01.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.868+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b93f0 con 0x7f219403b3f0 2024-09-12T17:28:01.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.869+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94241250049504] v29'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f219003b040 con 0x7f219403b3f0 2024-09-12T17:28:01.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.869+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(58 notify.7 [create] v29'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f219003b040 con 0x7f219403b3f0 2024-09-12T17:28:01.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.869+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94241250052352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b93f0 con 0x7f219403b3f0 2024-09-12T17:28:01.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.869+0000 7f219fd31800 20 add_watcher() i=0 2024-09-12T17:28:01.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.869+0000 7f219fd31800 20 add_watcher() i=1 2024-09-12T17:28:01.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.869+0000 7f219fd31800 20 add_watcher() i=2 2024-09-12T17:28:01.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.869+0000 7f219fd31800 20 add_watcher() i=3 2024-09-12T17:28:01.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.869+0000 7f219fd31800 20 add_watcher() i=4 2024-09-12T17:28:01.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.869+0000 7f219fd31800 20 add_watcher() i=5 2024-09-12T17:28:01.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.869+0000 7f219fd31800 20 add_watcher() i=6 2024-09-12T17:28:01.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.870+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94241250052352] v29'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f219003b040 con 0x7f219403b3f0 2024-09-12T17:28:01.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.870+0000 7f219fd31800 20 add_watcher() i=7 2024-09-12T17:28:01.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.870+0000 7f219fd31800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:01.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.870+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b6403bc640 con 0x55b6403a5760 2024-09-12T17:28:01.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.871+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f219003b040 con 0x55b6403a5760 2024-09-12T17:28:01.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.871+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94241250054320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b6403b9980 con 0x55b6403a5760 2024-09-12T17:28:01.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.872+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94241250054320] v29'86 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f219003b040 con 0x55b6403a5760 2024-09-12T17:28:01.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.872+0000 7f2051fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:01.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.872+0000 7f219fd31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:01.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.872+0000 7f219fd31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:01.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.872+0000 7f219fd31800 5 note: GC not initialized 2024-09-12T17:28:01.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.872+0000 7f2050fe1640 20 reqs_thread_entry: start 2024-09-12T17:28:01.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.872+0000 7f219fd31800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:01.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.872+0000 7f219fd31800 20 Filter name: none 2024-09-12T17:28:01.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.872+0000 7f1fca7fc640 20 reqs_thread_entry: start 2024-09-12T17:28:01.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.872+0000 7f219fd31800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:28:01.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.872+0000 7f219fd31800 20 rados->read ofs=0 len=0 2024-09-12T17:28:01.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.872+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b6403ef6c0 con 0x55b6403a5760 2024-09-12T17:28:01.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.873+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f219003b040 con 0x55b6403a5760 2024-09-12T17:28:01.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.873+0000 7f219fd31800 20 rados_obj.operate() r=0 bl.length=556 2024-09-12T17:28:01.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.873+0000 7f219fd31800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T17:28:01.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.873+0000 7f219fd31800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:28:01.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.873+0000 7f219fd31800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:01.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.873+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b6403f5cc0 con 0x55b6403a5760 2024-09-12T17:28:01.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.874+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v29'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f219003b040 con 0x55b6403a5760 2024-09-12T17:28:01.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.874+0000 7f219fd31800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:28:01.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.874+0000 7f219fd31800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:28:01.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.874+0000 7f219fd31800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T17:28:01.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.874+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94241250301696 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b6403f1360 con 0x55b6403a5760 2024-09-12T17:28:01.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.874+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== watch-notify(notify (1) cookie 94241250036528 notify 124554051594 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f2190018040 con 0x55b6403a5760 2024-09-12T17:28:01.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.874+0000 7f207affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051594 cookie 94241250036528 notifier 4414 bl.length()=567 2024-09-12T17:28:01.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.874+0000 7f207affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:28:01.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.874+0000 7f207affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:28:01.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.874+0000 7f207affd640 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f2060003ea0 con 0x55b6403a5760 2024-09-12T17:28:01.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.874+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(64 notify.4 [notify cookie 94241250301696 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f219003b040 con 0x55b6403a5760 2024-09-12T17:28:01.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.875+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f219003b040 con 0x55b6403a5760 2024-09-12T17:28:01.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.875+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== watch-notify(notify_complete (2) cookie 94241250301696 notify 124554051594 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f219001dae0 con 0x55b6403a5760 2024-09-12T17:28:01.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.875+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:66 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b6403f5700 con 0x55b6403aa150 2024-09-12T17:28:01.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.876+0000 7f219c21b640 1 -- 172.21.15.170:0/3830434695 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(66 foo:foo2 [delete] v29'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2194062040 con 0x55b6403aa150 2024-09-12T17:28:01.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.876+0000 7f219fd31800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-12T17:28:01.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.876+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94241250301696 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b6403f0eb0 con 0x55b6403aa150 2024-09-12T17:28:01.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.876+0000 7f219c21b640 1 -- 172.21.15.170:0/3830434695 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== watch-notify(notify (1) cookie 94241250029488 notify 124554051589 ret 0) ==== 201+0+0 (crc 0 0 0) 0x55b64039a680 con 0x55b6403aa150 2024-09-12T17:28:01.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.876+0000 7f207a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051589 cookie 94241250029488 notifier 4414 bl.length()=159 2024-09-12T17:28:01.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.876+0000 7f207a7fc640 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f1fd00032c0 con 0x55b6403aa150 2024-09-12T17:28:01.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.876+0000 7f219c21b640 1 -- 172.21.15.170:0/3830434695 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(67 notify.0 [notify cookie 94241250301696 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2194062040 con 0x55b6403aa150 2024-09-12T17:28:01.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.877+0000 7f219c21b640 1 -- 172.21.15.170:0/3830434695 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2194062040 con 0x55b6403aa150 2024-09-12T17:28:01.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.877+0000 7f219c21b640 1 -- 172.21.15.170:0/3830434695 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== watch-notify(notify_complete (2) cookie 94241250301696 notify 124554051589 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f219405d040 con 0x55b6403aa150 2024-09-12T17:28:01.900 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T17:27:59.362376Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:27:59.362351Z","tags":[],"group_ids":[]} 2024-09-12T17:28:01.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.877+0000 7f2051fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:01.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.878+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94241250054320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b6403ed580 con 0x55b6403a5760 2024-09-12T17:28:01.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.878+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94241250054320] v29'87 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f219003b040 con 0x55b6403a5760 2024-09-12T17:28:01.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.879+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94241250029488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b6403ed580 con 0x55b6403aa150 2024-09-12T17:28:01.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.879+0000 7f219c21b640 1 -- 172.21.15.170:0/3830434695 <== osd.2 v2:172.21.15.170:6808/3855567754 18 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94241250029488] v29'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2194062040 con 0x55b6403aa150 2024-09-12T17:28:01.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.879+0000 7f219fd31800 20 remove_watcher() i=0 2024-09-12T17:28:01.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.879+0000 7f219fd31800 2 removed watcher, disabling cache 2024-09-12T17:28:01.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.879+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94241250035472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b6403ed580 con 0x55b6403a5760 2024-09-12T17:28:01.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.880+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94241250035472] v29'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f219003b040 con 0x55b6403a5760 2024-09-12T17:28:01.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.880+0000 7f219fd31800 20 remove_watcher() i=1 2024-09-12T17:28:01.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.880+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94241250039376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b6403ed580 con 0x55b6403aec60 2024-09-12T17:28:01.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.882+0000 7f219ba1a640 1 -- 172.21.15.170:0/3830434695 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94241250039376] v29'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f218c057030 con 0x55b6403aec60 2024-09-12T17:28:01.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.882+0000 7f219fd31800 20 remove_watcher() i=2 2024-09-12T17:28:01.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.882+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94241250043008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b6403ed580 con 0x55b6403aa150 2024-09-12T17:28:01.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.883+0000 7f219c21b640 1 -- 172.21.15.170:0/3830434695 <== osd.2 v2:172.21.15.170:6808/3855567754 19 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94241250043008] v29'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2194062040 con 0x55b6403aa150 2024-09-12T17:28:01.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.883+0000 7f219fd31800 20 remove_watcher() i=3 2024-09-12T17:28:01.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.883+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94241250036528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b6403ed580 con 0x55b6403a5760 2024-09-12T17:28:01.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.884+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94241250036528] v29'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f219003b040 con 0x55b6403a5760 2024-09-12T17:28:01.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.884+0000 7f219fd31800 20 remove_watcher() i=4 2024-09-12T17:28:01.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.884+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94241250048448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b6403ed580 con 0x7f219403b3f0 2024-09-12T17:28:01.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.885+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94241250048448] v29'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f219003b040 con 0x7f219403b3f0 2024-09-12T17:28:01.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.885+0000 7f219fd31800 20 remove_watcher() i=5 2024-09-12T17:28:01.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.885+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94241250049504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b6403ed580 con 0x7f219403b3f0 2024-09-12T17:28:01.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.886+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94241250049504] v29'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f219003b040 con 0x7f219403b3f0 2024-09-12T17:28:01.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.886+0000 7f219fd31800 20 remove_watcher() i=6 2024-09-12T17:28:01.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.886+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94241250052352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b6403ed580 con 0x7f219403b3f0 2024-09-12T17:28:01.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.887+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94241250052352] v29'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f219003b040 con 0x7f219403b3f0 2024-09-12T17:28:01.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.887+0000 7f219fd31800 20 remove_watcher() i=7 2024-09-12T17:28:01.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.887+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f219403b3f0 msgr2=0x7f2194056980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.887+0000 7f219fd31800 1 --2- 172.21.15.170:0/3830434695 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f219403b3f0 0x7f2194056980 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.887+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b6403a5760 msgr2=0x55b6403a7c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.887+0000 7f219fd31800 1 --2- 172.21.15.170:0/3830434695 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b6403a5760 0x55b6403a7c20 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.887+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b6403aa150 msgr2=0x55b6403ac540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.887+0000 7f219fd31800 1 --2- 172.21.15.170:0/3830434695 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b6403aa150 0x55b6403ac540 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.887+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55b6403aec60 msgr2=0x55b6403b1120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.887+0000 7f219fd31800 1 --2- 172.21.15.170:0/3830434695 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55b6403aec60 0x55b6403b1120 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.887+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f206403c780 msgr2=0x7f206403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.887+0000 7f219fd31800 1 --2- 172.21.15.170:0/3830434695 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f206403c780 0x7f206403ec40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f218c064b80 tx=0x7f218c092000 comp rx=0 tx=0).stop 2024-09-12T17:28:01.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.887+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b640392880 msgr2=0x55b640399e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.887+0000 7f219b219640 1 -- 172.21.15.170:0/3830434695 reap_dead start 2024-09-12T17:28:01.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.887+0000 7f219fd31800 1 --2- 172.21.15.170:0/3830434695 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b640392880 0x55b640399e90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2194005a30 tx=0x7f2194053d00 comp rx=0 tx=0).stop 2024-09-12T17:28:01.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.887+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 shutdown_connections 2024-09-12T17:28:01.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.887+0000 7f219fd31800 1 --2- 172.21.15.170:0/3830434695 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b640392880 0x55b640399e90 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.887+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 >> 172.21.15.170:0/3830434695 conn(0x55b64038ec80 msgr2=0x55b64038ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:01.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.887+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 shutdown_connections 2024-09-12T17:28:01.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.887+0000 7f219fd31800 1 -- 172.21.15.170:0/3830434695 wait complete. 2024-09-12T17:28:01.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.887+0000 7f219fd31800 1 -- 172.21.15.170:0/4164767533 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f207403c730 msgr2=0x7f207403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.887+0000 7f219fd31800 1 --2- 172.21.15.170:0/4164767533 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f207403c730 0x7f207403ebf0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f218c065fd0 tx=0x7f218c095a10 comp rx=0 tx=0).stop 2024-09-12T17:28:01.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.887+0000 7f219fd31800 1 -- 172.21.15.170:0/4164767533 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b640271dc0 msgr2=0x55b640270630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.887+0000 7f219fd31800 1 --2- 172.21.15.170:0/4164767533 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b640271dc0 0x55b640270630 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x55b640369c90 tx=0x7f21940167b0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.887+0000 7f219fd31800 1 -- 172.21.15.170:0/4164767533 shutdown_connections 2024-09-12T17:28:01.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.887+0000 7f219fd31800 1 --2- 172.21.15.170:0/4164767533 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f207403c730 0x7f207403ebf0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.887+0000 7f219fd31800 1 --2- 172.21.15.170:0/4164767533 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b640271dc0 0x55b640270630 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.887+0000 7f219fd31800 1 -- 172.21.15.170:0/4164767533 >> 172.21.15.170:0/4164767533 conn(0x55b640377f50 msgr2=0x55b640378330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:01.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.888+0000 7f219fd31800 1 -- 172.21.15.170:0/4164767533 shutdown_connections 2024-09-12T17:28:01.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.888+0000 7f219fd31800 1 -- 172.21.15.170:0/4164767533 wait complete. 2024-09-12T17:28:01.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.888+0000 7f219fd31800 1 -- 172.21.15.170:0/13014166 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b640275040 msgr2=0x55b6403702e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.888+0000 7f219fd31800 1 --2- 172.21.15.170:0/13014166 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b640275040 0x55b6403702e0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.888+0000 7f219fd31800 1 -- 172.21.15.170:0/13014166 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b6403726c0 msgr2=0x55b640374b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.888+0000 7f219fd31800 1 --2- 172.21.15.170:0/13014166 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b6403726c0 0x55b640374b60 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.888+0000 7f219fd31800 1 -- 172.21.15.170:0/13014166 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f208403c780 msgr2=0x7f208403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.888+0000 7f219fd31800 1 --2- 172.21.15.170:0/13014166 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f208403c780 0x7f208403ec40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2190000c00 tx=0x7f21900013b0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.888+0000 7f219fd31800 1 -- 172.21.15.170:0/13014166 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b640272620 msgr2=0x55b640368c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.888+0000 7f219fd31800 1 --2- 172.21.15.170:0/13014166 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b640272620 0x55b640368c90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f218c025da0 tx=0x7f218c002fb0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.888+0000 7f219fd31800 1 -- 172.21.15.170:0/13014166 shutdown_connections 2024-09-12T17:28:01.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.888+0000 7f219fd31800 1 --2- 172.21.15.170:0/13014166 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b6403726c0 0x55b640374b60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.888+0000 7f219fd31800 1 --2- 172.21.15.170:0/13014166 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f208403c780 0x7f208403ec40 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.888+0000 7f219fd31800 1 --2- 172.21.15.170:0/13014166 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b640275040 0x55b6403702e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.888+0000 7f219fd31800 1 --2- 172.21.15.170:0/13014166 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b640272620 0x55b640368c90 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.888+0000 7f219fd31800 1 -- 172.21.15.170:0/13014166 >> 172.21.15.170:0/13014166 conn(0x55b64026c1e0 msgr2=0x55b64035b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:01.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.888+0000 7f219fd31800 1 -- 172.21.15.170:0/13014166 shutdown_connections 2024-09-12T17:28:01.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.888+0000 7f219fd31800 1 -- 172.21.15.170:0/13014166 wait complete. 2024-09-12T17:28:01.913 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T17:27:59.362376Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:27:59.362351Z', 'tags': [], 'group_ids': []} 2024-09-12T17:28:01.913 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-12T17:28:01.913 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-12T17:28:01.913 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-12T17:28:01.958 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:01.958 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:01.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.956+0000 7fe19a320800 1 Processor -- start 2024-09-12T17:28:01.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.956+0000 7fe19a320800 1 -- start start 2024-09-12T17:28:01.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.957+0000 7fe19a320800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x56254120e310 0x56254120e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.957+0000 7fe19a320800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5625410b9e40 con 0x562541213040 2024-09-12T17:28:01.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.957+0000 7fe19a320800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x562541084680 con 0x56254120e310 2024-09-12T17:28:01.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.957+0000 7fe196068640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x56254120e310 0x56254120e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.957+0000 7fe195867640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x562541213040 0x5625412154e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:48378/0 (socket says 172.21.15.170:48378) 2024-09-12T17:28:01.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.957+0000 7fe195867640 1 -- 172.21.15.170:0/257889113 learned_addr learned my addr 172.21.15.170:0/257889113 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:28:01.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.957+0000 7fe196068640 1 -- 172.21.15.170:0/257889113 >> v1:172.21.15.47:6789/0 conn(0x562541213040 legacy=0x5625412154e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.957+0000 7fe196068640 1 -- 172.21.15.170:0/257889113 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625410a06b0 con 0x56254120e310 2024-09-12T17:28:01.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.959+0000 7fe196068640 1 --2- 172.21.15.170:0/257889113 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56254120e310 0x56254120e710 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe18800a470 tx=0x7fe188045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70cd9b21d1d4c56 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.959+0000 7fe195066640 1 -- 172.21.15.170:0/257889113 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe188053570 con 0x56254120e310 2024-09-12T17:28:01.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.959+0000 7fe195066640 1 -- 172.21.15.170:0/257889113 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe188058070 con 0x56254120e310 2024-09-12T17:28:01.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.959+0000 7fe195066640 1 -- 172.21.15.170:0/257889113 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe188053880 con 0x56254120e310 2024-09-12T17:28:01.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.960+0000 7fe19a320800 1 -- 172.21.15.170:0/257889113 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56254120e310 msgr2=0x56254120e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.960+0000 7fe19a320800 1 --2- 172.21.15.170:0/257889113 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56254120e310 0x56254120e710 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe18800a470 tx=0x7fe188045a20 comp rx=0 tx=0).stop 2024-09-12T17:28:01.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.960+0000 7fe19a320800 1 -- 172.21.15.170:0/257889113 shutdown_connections 2024-09-12T17:28:01.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.960+0000 7fe19a320800 1 --2- 172.21.15.170:0/257889113 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56254120e310 0x56254120e710 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.960+0000 7fe19a320800 1 -- 172.21.15.170:0/257889113 >> 172.21.15.170:0/257889113 conn(0x562541209920 msgr2=0x56254120bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:01.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.960+0000 7fe19a320800 1 -- 172.21.15.170:0/257889113 shutdown_connections 2024-09-12T17:28:01.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.960+0000 7fe19a320800 1 -- 172.21.15.170:0/257889113 wait complete. 2024-09-12T17:28:01.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.973+0000 7fe19a320800 1 Processor -- start 2024-09-12T17:28:01.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.974+0000 7fe19a320800 1 -- start start 2024-09-12T17:28:01.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.974+0000 7fe19a320800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56254120e310 0x5625412ff6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.974+0000 7fe19a320800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5625410a8dd0 con 0x56254120e310 2024-09-12T17:28:01.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.974+0000 7fe196068640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56254120e310 0x5625412ff6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.974+0000 7fe196068640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56254120e310 0x5625412ff6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57492/0 (socket says 172.21.15.170:57492) 2024-09-12T17:28:01.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.974+0000 7fe196068640 1 -- 172.21.15.170:0/3260972041 learned_addr learned my addr 172.21.15.170:0/3260972041 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:01.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.974+0000 7fe196068640 1 -- 172.21.15.170:0/3260972041 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625410c1e10 con 0x56254120e310 2024-09-12T17:28:01.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.974+0000 7fe196068640 1 --2- 172.21.15.170:0/3260972041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56254120e310 0x5625412ff6a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe188025c20 tx=0x7fe188051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=952644b5323b2180 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.975+0000 7fe084608640 1 -- 172.21.15.170:0/3260972041 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe188053a20 con 0x56254120e310 2024-09-12T17:28:01.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.975+0000 7fe084608640 1 -- 172.21.15.170:0/3260972041 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe188063070 con 0x56254120e310 2024-09-12T17:28:01.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.975+0000 7fe084608640 1 -- 172.21.15.170:0/3260972041 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe188053cf0 con 0x56254120e310 2024-09-12T17:28:01.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.975+0000 7fe19a320800 1 -- 172.21.15.170:0/3260972041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56254120e310 msgr2=0x5625412ff6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:01.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.975+0000 7fe19a320800 1 --2- 172.21.15.170:0/3260972041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56254120e310 0x5625412ff6a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe188025c20 tx=0x7fe188051000 comp rx=0 tx=0).stop 2024-09-12T17:28:01.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.975+0000 7fe19a320800 1 -- 172.21.15.170:0/3260972041 shutdown_connections 2024-09-12T17:28:01.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.975+0000 7fe19a320800 1 --2- 172.21.15.170:0/3260972041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56254120e310 0x5625412ff6a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:01.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.975+0000 7fe19a320800 1 -- 172.21.15.170:0/3260972041 >> 172.21.15.170:0/3260972041 conn(0x562541209920 msgr2=0x5625412fb020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:01.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.975+0000 7fe19a320800 1 -- 172.21.15.170:0/3260972041 shutdown_connections 2024-09-12T17:28:01.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.975+0000 7fe19a320800 1 -- 172.21.15.170:0/3260972041 wait complete. 2024-09-12T17:28:01.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.976+0000 7fe19a320800 1 Processor -- start 2024-09-12T17:28:01.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.976+0000 7fe19a320800 1 -- start start 2024-09-12T17:28:01.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.976+0000 7fe19a320800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56254120e310 0x562541306f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.976+0000 7fe19a320800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562541217040 con 0x56254120e310 2024-09-12T17:28:01.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.976+0000 7fe196068640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56254120e310 0x562541306f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.976+0000 7fe196068640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56254120e310 0x562541306f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57500/0 (socket says 172.21.15.170:57500) 2024-09-12T17:28:01.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.976+0000 7fe196068640 1 -- 172.21.15.170:0/804705662 learned_addr learned my addr 172.21.15.170:0/804705662 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:01.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.976+0000 7fe196068640 1 -- 172.21.15.170:0/804705662 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625413074f0 con 0x56254120e310 2024-09-12T17:28:01.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.977+0000 7fe196068640 1 --2- 172.21.15.170:0/804705662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56254120e310 0x562541306f90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe188025c20 tx=0x7fe188002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.977+0000 7fe082e05640 1 -- 172.21.15.170:0/804705662 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe188068660 con 0x56254120e310 2024-09-12T17:28:01.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.977+0000 7fe082e05640 1 -- 172.21.15.170:0/804705662 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe188068800 con 0x56254120e310 2024-09-12T17:28:01.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.977+0000 7fe19a320800 1 -- 172.21.15.170:0/804705662 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562541307780 con 0x56254120e310 2024-09-12T17:28:01.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.977+0000 7fe082e05640 1 -- 172.21.15.170:0/804705662 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe188068ae0 con 0x56254120e310 2024-09-12T17:28:01.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.977+0000 7fe19a320800 1 -- 172.21.15.170:0/804705662 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562541308390 con 0x56254120e310 2024-09-12T17:28:01.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.978+0000 7fe082e05640 1 -- 172.21.15.170:0/804705662 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe188068c80 con 0x56254120e310 2024-09-12T17:28:01.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.978+0000 7fe082e05640 1 --2- 172.21.15.170:0/804705662 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe07c03c730 0x7fe07c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.978+0000 7fe082e05640 1 -- 172.21.15.170:0/804705662 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fe188098140 con 0x56254120e310 2024-09-12T17:28:01.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.978+0000 7fe195867640 1 --2- 172.21.15.170:0/804705662 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe07c03c730 0x7fe07c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.978+0000 7fe19a320800 1 --2- 172.21.15.170:0/804705662 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x562541213040 0x56254130e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.978+0000 7fe19a320800 1 -- 172.21.15.170:0/804705662 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56254130eb20 con 0x562541213040 2024-09-12T17:28:01.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.978+0000 7fe196869640 1 --2- 172.21.15.170:0/804705662 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x562541213040 0x56254130e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.978+0000 7fe195867640 1 --2- 172.21.15.170:0/804705662 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe07c03c730 0x7fe07c03ebf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe18c001d70 tx=0x7fe18c0012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.978+0000 7fe196869640 1 --2- 172.21.15.170:0/804705662 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x562541213040 0x56254130e5e0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.979+0000 7fe196869640 1 -- 172.21.15.170:0/804705662 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe19000a4d0 con 0x562541213040 2024-09-12T17:28:01.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.979+0000 7fe19a320800 1 -- 172.21.15.170:0/804705662 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56254130eec0 con 0x562541213040 2024-09-12T17:28:01.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.979+0000 7fe196869640 1 -- 172.21.15.170:0/804705662 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe19000a4d0 con 0x562541213040 2024-09-12T17:28:01.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.979+0000 7fe19a320800 1 --2- 172.21.15.170:0/804705662 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x562541310980 0x562541312e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.979+0000 7fe19a320800 1 -- 172.21.15.170:0/804705662 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625413135b0 con 0x562541310980 2024-09-12T17:28:01.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.979+0000 7fe196068640 1 --2- 172.21.15.170:0/804705662 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x562541310980 0x562541312e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.979+0000 7fe196068640 1 --2- 172.21.15.170:0/804705662 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x562541310980 0x562541312e20 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.980+0000 7fe196068640 1 -- 172.21.15.170:0/804705662 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe188051070 con 0x562541310980 2024-09-12T17:28:01.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.980+0000 7fe19a320800 1 -- 172.21.15.170:0/804705662 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56254130f710 con 0x562541213040 2024-09-12T17:28:01.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.980+0000 7fe196869640 1 -- 172.21.15.170:0/804705662 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe19000a4d0 con 0x562541213040 2024-09-12T17:28:01.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.980+0000 7fe19a320800 1 -- 172.21.15.170:0/804705662 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56254130faf0 con 0x562541310980 2024-09-12T17:28:01.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.980+0000 7fe196068640 1 -- 172.21.15.170:0/804705662 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe188051070 con 0x562541310980 2024-09-12T17:28:01.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.980+0000 7fe19a320800 1 Processor -- start 2024-09-12T17:28:01.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.980+0000 7fe19a320800 1 -- start start 2024-09-12T17:28:01.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.981+0000 7fe19a320800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562541321e20 0x562541322240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:01.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.981+0000 7fe19a320800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562541106a00 con 0x562541321e20 2024-09-12T17:28:01.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.981+0000 7fe196869640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562541321e20 0x562541322240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:01.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.981+0000 7fe196869640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562541321e20 0x562541322240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57512/0 (socket says 172.21.15.170:57512) 2024-09-12T17:28:01.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.981+0000 7fe196869640 1 -- 172.21.15.170:0/3117339418 learned_addr learned my addr 172.21.15.170:0/3117339418 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:01.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.981+0000 7fe196869640 1 -- 172.21.15.170:0/3117339418 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562541322880 con 0x562541321e20 2024-09-12T17:28:01.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.981+0000 7fe196869640 1 --2- 172.21.15.170:0/3117339418 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562541321e20 0x562541322240 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x562541307f90 tx=0x7fe1900167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:01.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.981+0000 7fe07bfff640 1 -- 172.21.15.170:0/3117339418 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe190013640 con 0x562541321e20 2024-09-12T17:28:01.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.981+0000 7fe07bfff640 1 -- 172.21.15.170:0/3117339418 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1900137e0 con 0x562541321e20 2024-09-12T17:28:01.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.981+0000 7fe19a320800 1 -- 172.21.15.170:0/3117339418 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5625413230b0 con 0x562541321e20 2024-09-12T17:28:01.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.982+0000 7fe07bfff640 1 -- 172.21.15.170:0/3117339418 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe190013b00 con 0x562541321e20 2024-09-12T17:28:01.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.982+0000 7fe19a320800 1 -- 172.21.15.170:0/3117339418 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562541323650 con 0x562541321e20 2024-09-12T17:28:02.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.982+0000 7fe07bfff640 1 -- 172.21.15.170:0/3117339418 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe190011040 con 0x562541321e20 2024-09-12T17:28:02.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.983+0000 7fe07bfff640 1 --2- 172.21.15.170:0/3117339418 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe07003c730 0x7fe07003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.983+0000 7fe07bfff640 1 -- 172.21.15.170:0/3117339418 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fe19000e040 con 0x562541321e20 2024-09-12T17:28:02.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.983+0000 7fe196068640 1 --2- 172.21.15.170:0/3117339418 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe07003c730 0x7fe07003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.983+0000 7fe19a320800 1 Processor -- start 2024-09-12T17:28:02.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.983+0000 7fe196068640 1 --2- 172.21.15.170:0/3117339418 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe07003c730 0x7fe07003ebf0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe188096580 tx=0x7fe188005390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.983+0000 7fe19a320800 1 -- start start 2024-09-12T17:28:02.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.983+0000 7fe19a320800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562541210020 0x562541210420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.983+0000 7fe19a320800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5625412ffe90 con 0x562541210020 2024-09-12T17:28:02.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.983+0000 7fe196869640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562541210020 0x562541210420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.983+0000 7fe196869640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562541210020 0x562541210420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57514/0 (socket says 172.21.15.170:57514) 2024-09-12T17:28:02.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.983+0000 7fe196869640 1 -- 172.21.15.170:0/3855882976 learned_addr learned my addr 172.21.15.170:0/3855882976 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:02.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.984+0000 7fe196869640 1 -- 172.21.15.170:0/3855882976 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562541210960 con 0x562541210020 2024-09-12T17:28:02.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.984+0000 7fe196869640 1 --2- 172.21.15.170:0/3855882976 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562541210020 0x562541210420 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe190020000 tx=0x7fe190029510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1826d402d9b97b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.984+0000 7fe079ffb640 1 -- 172.21.15.170:0/3855882976 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe190013ca0 con 0x562541210020 2024-09-12T17:28:02.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.984+0000 7fe079ffb640 1 -- 172.21.15.170:0/3855882976 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe190049030 con 0x562541210020 2024-09-12T17:28:02.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.984+0000 7fe079ffb640 1 -- 172.21.15.170:0/3855882976 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe19002a3f0 con 0x562541210020 2024-09-12T17:28:02.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.984+0000 7fe19a320800 1 -- 172.21.15.170:0/3855882976 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562541210020 msgr2=0x562541210420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.984+0000 7fe19a320800 1 --2- 172.21.15.170:0/3855882976 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562541210020 0x562541210420 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe190020000 tx=0x7fe190029510 comp rx=0 tx=0).stop 2024-09-12T17:28:02.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.984+0000 7fe19a320800 1 -- 172.21.15.170:0/3855882976 shutdown_connections 2024-09-12T17:28:02.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.984+0000 7fe19a320800 1 --2- 172.21.15.170:0/3855882976 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562541210020 0x562541210420 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.984+0000 7fe19a320800 1 -- 172.21.15.170:0/3855882976 >> 172.21.15.170:0/3855882976 conn(0x56254132ace0 msgr2=0x562541328f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:02.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.984+0000 7fe19a320800 1 -- 172.21.15.170:0/3855882976 shutdown_connections 2024-09-12T17:28:02.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.984+0000 7fe19a320800 1 -- 172.21.15.170:0/3855882976 wait complete. 2024-09-12T17:28:02.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.985+0000 7fe19a320800 1 Processor -- start 2024-09-12T17:28:02.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.985+0000 7fe19a320800 1 -- start start 2024-09-12T17:28:02.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.985+0000 7fe19a320800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562541210020 0x5625413380a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.985+0000 7fe19a320800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56254120eee0 con 0x562541210020 2024-09-12T17:28:02.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.985+0000 7fe196869640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562541210020 0x5625413380a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.985+0000 7fe196869640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562541210020 0x5625413380a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57528/0 (socket says 172.21.15.170:57528) 2024-09-12T17:28:02.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.985+0000 7fe196869640 1 -- 172.21.15.170:0/343613719 learned_addr learned my addr 172.21.15.170:0/343613719 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:02.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.986+0000 7fe196869640 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562541338600 con 0x562541210020 2024-09-12T17:28:02.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.986+0000 7fe196869640 1 --2- 172.21.15.170:0/343613719 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562541210020 0x5625413380a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe190020000 tx=0x7fe19004f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.986+0000 7fe067fff640 1 -- 172.21.15.170:0/343613719 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe190038070 con 0x562541210020 2024-09-12T17:28:02.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.986+0000 7fe067fff640 1 -- 172.21.15.170:0/343613719 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe190051030 con 0x562541210020 2024-09-12T17:28:02.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.986+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562541338890 con 0x562541210020 2024-09-12T17:28:02.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.986+0000 7fe067fff640 1 -- 172.21.15.170:0/343613719 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe19001f340 con 0x562541210020 2024-09-12T17:28:02.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.986+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562541339210 con 0x562541210020 2024-09-12T17:28:02.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.987+0000 7fe067fff640 1 -- 172.21.15.170:0/343613719 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe19003b070 con 0x562541210020 2024-09-12T17:28:02.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.987+0000 7fe067fff640 1 --2- 172.21.15.170:0/343613719 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe06003c730 0x7fe06003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.987+0000 7fe067fff640 1 -- 172.21.15.170:0/343613719 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fe19003eaf0 con 0x562541210020 2024-09-12T17:28:02.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.987+0000 7fe196068640 1 --2- 172.21.15.170:0/343613719 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe06003c730 0x7fe06003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.987+0000 7fe19a320800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.987+0000 7fe19a320800 1 --2- 172.21.15.170:0/343613719 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x562541343920 0x562541345de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.987+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562541346530 con 0x562541343920 2024-09-12T17:28:02.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.987+0000 7fe195867640 1 --2- 172.21.15.170:0/343613719 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x562541343920 0x562541345de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.987+0000 7fe196068640 1 --2- 172.21.15.170:0/343613719 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe06003c730 0x7fe06003ebf0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe1880966e0 tx=0x7fe188087000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.988+0000 7fe195867640 1 --2- 172.21.15.170:0/343613719 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x562541343920 0x562541345de0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.988+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe18c009050 con 0x562541343920 2024-09-12T17:28:02.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.988+0000 7fe19a320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:02.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.988+0000 7fe19a320800 20 realm 2024-09-12T17:28:02.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.988+0000 7fe19a320800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.988+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562541342c70 con 0x562541343920 2024-09-12T17:28:02.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.988+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe18c009050 con 0x562541343920 2024-09-12T17:28:02.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.988+0000 7fe19a320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:02.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.988+0000 7fe19a320800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:02.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.988+0000 7fe19a320800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.988+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562541347010 con 0x562541343920 2024-09-12T17:28:02.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.988+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe18c009050 con 0x562541343920 2024-09-12T17:28:02.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.988+0000 7fe19a320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:02.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.988+0000 7fe19a320800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.988+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625413478e0 con 0x562541343920 2024-09-12T17:28:02.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.989+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe18c009050 con 0x562541343920 2024-09-12T17:28:02.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.989+0000 7fe19a320800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:02.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.989+0000 7fe19a320800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.989+0000 7fe19a320800 1 --2- 172.21.15.170:0/343613719 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x562541348220 0x56254134a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.989+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56254134ad50 con 0x562541348220 2024-09-12T17:28:02.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.989+0000 7fe196869640 1 --2- 172.21.15.170:0/343613719 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x562541348220 0x56254134a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.989+0000 7fe196869640 1 --2- 172.21.15.170:0/343613719 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x562541348220 0x56254134a610 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.989+0000 7fe196869640 1 -- 172.21.15.170:0/343613719 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe19003a030 con 0x562541348220 2024-09-12T17:28:02.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.989+0000 7fe19a320800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:02.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.989+0000 7fe19a320800 20 searching for the correct realm 2024-09-12T17:28:02.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.989+0000 7fe19a320800 1 --2- 172.21.15.170:0/343613719 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x56254134cdd0 0x56254134f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.989+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56254134f960 con 0x56254134cdd0 2024-09-12T17:28:02.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.989+0000 7fe196068640 1 --2- 172.21.15.170:0/343613719 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x56254134cdd0 0x56254134f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.990+0000 7fe196068640 1 --2- 172.21.15.170:0/343613719 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x56254134cdd0 0x56254134f290 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.990+0000 7fe196068640 1 -- 172.21.15.170:0/343613719 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe188051070 con 0x56254134cdd0 2024-09-12T17:28:02.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.990+0000 7fe196068640 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56254134f960 con 0x562541348220 2024-09-12T17:28:02.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.990+0000 7fe196869640 1 -- 172.21.15.170:0/343613719 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe19003a030 con 0x562541348220 2024-09-12T17:28:02.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.990+0000 7fe196869640 1 --2- 172.21.15.170:0/343613719 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fe19003d060 0x7fe190033a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.990+0000 7fe196869640 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56254134f960 con 0x7fe19003d060 2024-09-12T17:28:02.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.990+0000 7fe195867640 1 --2- 172.21.15.170:0/343613719 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fe19003d060 0x7fe190033a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.991+0000 7fe195867640 1 --2- 172.21.15.170:0/343613719 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fe19003d060 0x7fe190033a00 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.991+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18c009050 con 0x7fe19003d060 2024-09-12T17:28:02.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.991+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56254134f960 con 0x562541343920 2024-09-12T17:28:02.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.991+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18c009050 con 0x562541343920 2024-09-12T17:28:02.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.991+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56254134f960 con 0x562541343920 2024-09-12T17:28:02.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.991+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18c029040 con 0x562541343920 2024-09-12T17:28:02.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.991+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56254134f960 con 0x7fe19003d060 2024-09-12T17:28:02.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.991+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18c029040 con 0x7fe19003d060 2024-09-12T17:28:02.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.991+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56254134f960 con 0x7fe19003d060 2024-09-12T17:28:02.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.992+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18c029040 con 0x7fe19003d060 2024-09-12T17:28:02.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.992+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56254134f960 con 0x562541348220 2024-09-12T17:28:02.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.992+0000 7fe196869640 1 -- 172.21.15.170:0/343613719 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe19003a030 con 0x562541348220 2024-09-12T17:28:02.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.992+0000 7fe196869640 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56254134f960 con 0x56254134cdd0 2024-09-12T17:28:02.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.992+0000 7fe196068640 1 -- 172.21.15.170:0/343613719 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe188051070 con 0x56254134cdd0 2024-09-12T17:28:02.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.992+0000 7fe196068640 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56254134f960 con 0x562541343920 2024-09-12T17:28:02.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.992+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18c029040 con 0x562541343920 2024-09-12T17:28:02.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.992+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56254134f960 con 0x7fe19003d060 2024-09-12T17:28:02.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.993+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18c029040 con 0x7fe19003d060 2024-09-12T17:28:02.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.993+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56254134f960 con 0x562541343920 2024-09-12T17:28:02.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.993+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18c029040 con 0x562541343920 2024-09-12T17:28:02.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.993+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56254134f960 con 0x562541348220 2024-09-12T17:28:02.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.993+0000 7fe196869640 1 -- 172.21.15.170:0/343613719 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fe19003a030 con 0x562541348220 2024-09-12T17:28:02.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.993+0000 7fe196869640 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56254134f960 con 0x56254134cdd0 2024-09-12T17:28:02.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.993+0000 7fe196068640 1 -- 172.21.15.170:0/343613719 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe188051070 con 0x56254134cdd0 2024-09-12T17:28:02.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.993+0000 7fe196068640 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56254134f960 con 0x56254134cdd0 2024-09-12T17:28:02.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.993+0000 7fe196068640 1 -- 172.21.15.170:0/343613719 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe188051070 con 0x56254134cdd0 2024-09-12T17:28:02.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.993+0000 7fe196068640 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56254134f960 con 0x7fe19003d060 2024-09-12T17:28:02.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.994+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18c029040 con 0x7fe19003d060 2024-09-12T17:28:02.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.994+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56254134f960 con 0x56254134cdd0 2024-09-12T17:28:02.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.994+0000 7fe196068640 1 -- 172.21.15.170:0/343613719 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe188051070 con 0x56254134cdd0 2024-09-12T17:28:02.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.994+0000 7fe196068640 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56254134f960 con 0x56254134cdd0 2024-09-12T17:28:02.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.994+0000 7fe196068640 1 -- 172.21.15.170:0/343613719 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe188051070 con 0x56254134cdd0 2024-09-12T17:28:02.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.994+0000 7fe196068640 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56254134f960 con 0x562541343920 2024-09-12T17:28:02.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.994+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18c029040 con 0x562541343920 2024-09-12T17:28:02.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.994+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56254134f960 con 0x562541343920 2024-09-12T17:28:02.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.995+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe18c029040 con 0x562541343920 2024-09-12T17:28:02.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.995+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56254134f960 con 0x7fe19003d060 2024-09-12T17:28:02.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.995+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18c029040 con 0x7fe19003d060 2024-09-12T17:28:02.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.995+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56254134f960 con 0x56254134cdd0 2024-09-12T17:28:02.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.995+0000 7fe196068640 1 -- 172.21.15.170:0/343613719 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe188051070 con 0x56254134cdd0 2024-09-12T17:28:02.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.995+0000 7fe196068640 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56254134f960 con 0x562541348220 2024-09-12T17:28:02.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.995+0000 7fe196869640 1 -- 172.21.15.170:0/343613719 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe19003a030 con 0x562541348220 2024-09-12T17:28:02.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.995+0000 7fe196869640 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56254134f960 con 0x562541343920 2024-09-12T17:28:02.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.996+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18c029040 con 0x562541343920 2024-09-12T17:28:02.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.996+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56254134f960 con 0x7fe19003d060 2024-09-12T17:28:02.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.996+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18c029040 con 0x7fe19003d060 2024-09-12T17:28:02.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.996+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56254134f960 con 0x56254134cdd0 2024-09-12T17:28:02.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.996+0000 7fe196068640 1 -- 172.21.15.170:0/343613719 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe188051070 con 0x56254134cdd0 2024-09-12T17:28:02.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.996+0000 7fe196068640 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56254134f960 con 0x7fe19003d060 2024-09-12T17:28:02.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.997+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18c029040 con 0x7fe19003d060 2024-09-12T17:28:02.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.997+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56254134f960 con 0x562541348220 2024-09-12T17:28:02.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.997+0000 7fe196869640 1 -- 172.21.15.170:0/343613719 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe19003a030 con 0x562541348220 2024-09-12T17:28:02.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.997+0000 7fe196869640 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56254134f960 con 0x56254134cdd0 2024-09-12T17:28:02.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.997+0000 7fe196068640 1 -- 172.21.15.170:0/343613719 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe188051070 con 0x56254134cdd0 2024-09-12T17:28:02.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.997+0000 7fe196068640 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56254134f960 con 0x7fe19003d060 2024-09-12T17:28:02.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.997+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe18c029040 con 0x7fe19003d060 2024-09-12T17:28:02.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.997+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56254134f960 con 0x562541343920 2024-09-12T17:28:02.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.998+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe18c029040 con 0x562541343920 2024-09-12T17:28:02.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.998+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56254134f960 con 0x562541348220 2024-09-12T17:28:02.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.998+0000 7fe196869640 1 -- 172.21.15.170:0/343613719 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe190068040 con 0x562541348220 2024-09-12T17:28:02.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.998+0000 7fe19a320800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:02.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.998+0000 7fe19a320800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:02.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.998+0000 7fe19a320800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:02.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.998+0000 7fe19a320800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:02.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.998+0000 7fe19a320800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:02.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.998+0000 7fe19a320800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:02.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.998+0000 7fe19a320800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.998+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56254134b7d0 con 0x562541343920 2024-09-12T17:28:02.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.998+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe18c029040 con 0x562541343920 2024-09-12T17:28:02.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.998+0000 7fe19a320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:02.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.998+0000 7fe19a320800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.998+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56254134b3b0 con 0x562541343920 2024-09-12T17:28:02.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.998+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe18c029040 con 0x562541343920 2024-09-12T17:28:02.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.998+0000 7fe19a320800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:02.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.998+0000 7fe19a320800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.998+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56254134c130 con 0x562541348220 2024-09-12T17:28:02.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.998+0000 7fe196869640 1 -- 172.21.15.170:0/343613719 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe190068040 con 0x562541348220 2024-09-12T17:28:02.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.998+0000 7fe19a320800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:02.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.999+0000 7fe19a320800 20 zone default found 2024-09-12T17:28:02.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.999+0000 7fe19a320800 4 Realm: () 2024-09-12T17:28:02.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.999+0000 7fe19a320800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:02.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.999+0000 7fe19a320800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:02.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.999+0000 7fe19a320800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:02.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.999+0000 7fe19a320800 20 zonegroup default 2024-09-12T17:28:02.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.999+0000 7fe19a320800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.999+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56254134bcd0 con 0x7fe19003d060 2024-09-12T17:28:02.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.999+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe18c029040 con 0x7fe19003d060 2024-09-12T17:28:02.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.999+0000 7fe19a320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:02.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.999+0000 7fe19a320800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.999+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625413521b0 con 0x56254134cdd0 2024-09-12T17:28:02.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.999+0000 7fe196068640 1 -- 172.21.15.170:0/343613719 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe188051070 con 0x56254134cdd0 2024-09-12T17:28:02.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.999+0000 7fe19a320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:02.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.999+0000 7fe19a320800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.999+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562541352580 con 0x56254134cdd0 2024-09-12T17:28:02.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.999+0000 7fe196068640 1 -- 172.21.15.170:0/343613719 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe188051070 con 0x56254134cdd0 2024-09-12T17:28:02.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.999+0000 7fe19a320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:02.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.999+0000 7fe19a320800 20 started sync module instance, tier type = 2024-09-12T17:28:02.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.999+0000 7fe19a320800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:02.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:01.999+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562541351640 con 0x562541348220 2024-09-12T17:28:02.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.001+0000 7fe196869640 1 -- 172.21.15.170:0/343613719 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe190068040 con 0x562541348220 2024-09-12T17:28:02.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.001+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94718007778112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562541351640 con 0x562541348220 2024-09-12T17:28:02.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.001+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625413530c0 con 0x562541343920 2024-09-12T17:28:02.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.002+0000 7fe196869640 1 -- 172.21.15.170:0/343613719 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94718007778112] v29'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe190068040 con 0x562541348220 2024-09-12T17:28:02.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.002+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18c029040 con 0x562541343920 2024-09-12T17:28:02.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.002+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94718007782320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562541351640 con 0x562541343920 2024-09-12T17:28:02.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.002+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562541353b70 con 0x56254134cdd0 2024-09-12T17:28:02.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.003+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94718007782320] v29'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18c029040 con 0x562541343920 2024-09-12T17:28:02.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.003+0000 7fe196068640 1 -- 172.21.15.170:0/343613719 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe188051070 con 0x56254134cdd0 2024-09-12T17:28:02.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.003+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94718007785040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562541351640 con 0x56254134cdd0 2024-09-12T17:28:02.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.003+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625413545e0 con 0x562541348220 2024-09-12T17:28:02.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.004+0000 7fe196869640 1 -- 172.21.15.170:0/343613719 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe190068040 con 0x562541348220 2024-09-12T17:28:02.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.004+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94718007787728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625413545e0 con 0x562541348220 2024-09-12T17:28:02.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.004+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625413555c0 con 0x562541343920 2024-09-12T17:28:02.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.004+0000 7fe196068640 1 -- 172.21.15.170:0/343613719 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94718007785040] v29'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe188051070 con 0x56254134cdd0 2024-09-12T17:28:02.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.005+0000 7fe196869640 1 -- 172.21.15.170:0/343613719 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94718007787728] v29'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe190068040 con 0x562541348220 2024-09-12T17:28:02.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.005+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18c029040 con 0x562541343920 2024-09-12T17:28:02.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.005+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94718007790080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625413550d0 con 0x562541343920 2024-09-12T17:28:02.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.005+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562541355e90 con 0x7fe19003d060 2024-09-12T17:28:02.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.007+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18c029040 con 0x7fe19003d060 2024-09-12T17:28:02.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.007+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94718007793728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562541356110 con 0x7fe19003d060 2024-09-12T17:28:02.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.007+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562541356ad0 con 0x7fe19003d060 2024-09-12T17:28:02.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.007+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94718007790080] v29'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18c029040 con 0x562541343920 2024-09-12T17:28:02.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.007+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94718007793728] v29'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18c029040 con 0x7fe19003d060 2024-09-12T17:28:02.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.008+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(56 notify.6 [create] v29'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18c029040 con 0x7fe19003d060 2024-09-12T17:28:02.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.008+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94718007794784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562541356080 con 0x7fe19003d060 2024-09-12T17:28:02.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.008+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562541356f80 con 0x7fe19003d060 2024-09-12T17:28:02.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.009+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94718007794784] v29'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18c029040 con 0x7fe19003d060 2024-09-12T17:28:02.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.009+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(58 notify.7 [create] v29'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18c029040 con 0x7fe19003d060 2024-09-12T17:28:02.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.009+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94718007797280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562541356ef0 con 0x7fe19003d060 2024-09-12T17:28:02.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.009+0000 7fe19a320800 20 add_watcher() i=0 2024-09-12T17:28:02.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.009+0000 7fe19a320800 20 add_watcher() i=1 2024-09-12T17:28:02.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.009+0000 7fe19a320800 20 add_watcher() i=2 2024-09-12T17:28:02.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.009+0000 7fe19a320800 20 add_watcher() i=3 2024-09-12T17:28:02.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.009+0000 7fe19a320800 20 add_watcher() i=4 2024-09-12T17:28:02.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.009+0000 7fe19a320800 20 add_watcher() i=5 2024-09-12T17:28:02.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.009+0000 7fe19a320800 20 add_watcher() i=6 2024-09-12T17:28:02.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.010+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94718007797280] v29'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18c029040 con 0x7fe19003d060 2024-09-12T17:28:02.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.010+0000 7fe19a320800 20 add_watcher() i=7 2024-09-12T17:28:02.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.010+0000 7fe19a320800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:02.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.010+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56254135a1d0 con 0x562541343920 2024-09-12T17:28:02.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.010+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe18c029040 con 0x562541343920 2024-09-12T17:28:02.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.010+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94718007798704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562541357480 con 0x562541343920 2024-09-12T17:28:02.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.011+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94718007798704] v29'88 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe18c029040 con 0x562541343920 2024-09-12T17:28:02.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.011+0000 7fe04cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:02.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.011+0000 7fe19a320800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:02.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.011+0000 7fe19a320800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:02.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.011+0000 7fe19a320800 5 note: GC not initialized 2024-09-12T17:28:02.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.011+0000 7fdfc77fe640 20 reqs_thread_entry: start 2024-09-12T17:28:02.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.012+0000 7fe19a320800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:02.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.012+0000 7fe19a320800 20 Filter name: none 2024-09-12T17:28:02.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.012+0000 7fdfc57fa640 20 reqs_thread_entry: start 2024-09-12T17:28:02.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.012+0000 7fe19a320800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.012+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56254138ce40 con 0x562541343920 2024-09-12T17:28:02.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.012+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe18c029040 con 0x562541343920 2024-09-12T17:28:02.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.012+0000 7fe19a320800 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:28:02.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.012+0000 7fe19a320800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.012+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56254138d700 con 0x562541343920 2024-09-12T17:28:02.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.012+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe18c029040 con 0x562541343920 2024-09-12T17:28:02.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.012+0000 7fe19a320800 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:28:02.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.012+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56254138e710 con 0x562541348220 2024-09-12T17:28:02.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.013+0000 7fe196869640 1 -- 172.21.15.170:0/343613719 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fe190068040 con 0x562541348220 2024-09-12T17:28:02.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.013+0000 7fe04cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:02.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.013+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94718007798704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56254138ad80 con 0x562541343920 2024-09-12T17:28:02.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.015+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94718007798704] v29'89 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe18c029040 con 0x562541343920 2024-09-12T17:28:02.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.015+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94718007778112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56254138ad80 con 0x562541348220 2024-09-12T17:28:02.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.015+0000 7fe196869640 1 -- 172.21.15.170:0/343613719 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94718007778112] v29'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe190068040 con 0x562541348220 2024-09-12T17:28:02.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.016+0000 7fe19a320800 20 remove_watcher() i=0 2024-09-12T17:28:02.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.016+0000 7fe19a320800 2 removed watcher, disabling cache 2024-09-12T17:28:02.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.016+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94718007782320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56254138ad80 con 0x562541343920 2024-09-12T17:28:02.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.017+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94718007782320] v29'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18c029040 con 0x562541343920 2024-09-12T17:28:02.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.017+0000 7fe19a320800 20 remove_watcher() i=1 2024-09-12T17:28:02.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.017+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94718007785040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56254138ad80 con 0x56254134cdd0 2024-09-12T17:28:02.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.018+0000 7fe196068640 1 -- 172.21.15.170:0/343613719 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94718007785040] v29'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe188051070 con 0x56254134cdd0 2024-09-12T17:28:02.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.018+0000 7fe19a320800 20 remove_watcher() i=2 2024-09-12T17:28:02.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.018+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94718007787728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56254138ad80 con 0x562541348220 2024-09-12T17:28:02.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.019+0000 7fe196869640 1 -- 172.21.15.170:0/343613719 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94718007787728] v29'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe190068040 con 0x562541348220 2024-09-12T17:28:02.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.019+0000 7fe19a320800 20 remove_watcher() i=3 2024-09-12T17:28:02.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.019+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94718007790080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56254138ad80 con 0x562541343920 2024-09-12T17:28:02.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.020+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94718007790080] v29'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18c029040 con 0x562541343920 2024-09-12T17:28:02.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.020+0000 7fe19a320800 20 remove_watcher() i=4 2024-09-12T17:28:02.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.020+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94718007793728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56254138ad80 con 0x7fe19003d060 2024-09-12T17:28:02.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.021+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94718007793728] v29'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18c029040 con 0x7fe19003d060 2024-09-12T17:28:02.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.021+0000 7fe19a320800 20 remove_watcher() i=5 2024-09-12T17:28:02.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.021+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94718007794784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56254138ad80 con 0x7fe19003d060 2024-09-12T17:28:02.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.022+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94718007794784] v29'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18c029040 con 0x7fe19003d060 2024-09-12T17:28:02.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.022+0000 7fe19a320800 20 remove_watcher() i=6 2024-09-12T17:28:02.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.022+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94718007797280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56254138ad80 con 0x7fe19003d060 2024-09-12T17:28:02.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.023+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94718007797280] v29'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe18c029040 con 0x7fe19003d060 2024-09-12T17:28:02.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.023+0000 7fe19a320800 20 remove_watcher() i=7 2024-09-12T17:28:02.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.023+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fe19003d060 msgr2=0x7fe190033a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.023+0000 7fe19a320800 1 --2- 172.21.15.170:0/343613719 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fe19003d060 0x7fe190033a00 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.023+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x562541343920 msgr2=0x562541345de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.023+0000 7fe19a320800 1 --2- 172.21.15.170:0/343613719 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x562541343920 0x562541345de0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.023+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x562541348220 msgr2=0x56254134a610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.023+0000 7fe19a320800 1 --2- 172.21.15.170:0/343613719 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x562541348220 0x56254134a610 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.023+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x56254134cdd0 msgr2=0x56254134f290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.023+0000 7fe19a320800 1 --2- 172.21.15.170:0/343613719 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x56254134cdd0 0x56254134f290 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.023+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe06003c730 msgr2=0x7fe06003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.023+0000 7fe19a320800 1 --2- 172.21.15.170:0/343613719 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe06003c730 0x7fe06003ebf0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe1880966e0 tx=0x7fe188087000 comp rx=0 tx=0).stop 2024-09-12T17:28:02.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.023+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562541210020 msgr2=0x5625413380a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.023+0000 7fe19a320800 1 --2- 172.21.15.170:0/343613719 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562541210020 0x5625413380a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe190020000 tx=0x7fe19004f070 comp rx=0 tx=0).stop 2024-09-12T17:28:02.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.023+0000 7fe195867640 1 -- 172.21.15.170:0/343613719 reap_dead start 2024-09-12T17:28:02.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.023+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 shutdown_connections 2024-09-12T17:28:02.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.023+0000 7fe19a320800 1 --2- 172.21.15.170:0/343613719 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562541210020 0x5625413380a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.023+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 >> 172.21.15.170:0/343613719 conn(0x56254132ace0 msgr2=0x562541328ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:02.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.023+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 shutdown_connections 2024-09-12T17:28:02.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.023+0000 7fe19a320800 1 -- 172.21.15.170:0/343613719 wait complete. 2024-09-12T17:28:02.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.023+0000 7fe19a320800 1 -- 172.21.15.170:0/3117339418 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe07003c730 msgr2=0x7fe07003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.023+0000 7fe19a320800 1 --2- 172.21.15.170:0/3117339418 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe07003c730 0x7fe07003ebf0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe188096580 tx=0x7fe188005390 comp rx=0 tx=0).stop 2024-09-12T17:28:02.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.023+0000 7fe19a320800 1 -- 172.21.15.170:0/3117339418 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562541321e20 msgr2=0x562541322240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.023+0000 7fe19a320800 1 --2- 172.21.15.170:0/3117339418 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562541321e20 0x562541322240 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x562541307f90 tx=0x7fe1900167b0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.023+0000 7fe19a320800 1 -- 172.21.15.170:0/3117339418 shutdown_connections 2024-09-12T17:28:02.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.023+0000 7fe19a320800 1 --2- 172.21.15.170:0/3117339418 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe07003c730 0x7fe07003ebf0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.023+0000 7fe19a320800 1 --2- 172.21.15.170:0/3117339418 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562541321e20 0x562541322240 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.023+0000 7fe19a320800 1 -- 172.21.15.170:0/3117339418 >> 172.21.15.170:0/3117339418 conn(0x5625413161d0 msgr2=0x5625413165b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:02.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.024+0000 7fe19a320800 1 -- 172.21.15.170:0/3117339418 shutdown_connections 2024-09-12T17:28:02.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.024+0000 7fe19a320800 1 -- 172.21.15.170:0/3117339418 wait complete. 2024-09-12T17:28:02.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.024+0000 7fe19a320800 1 -- 172.21.15.170:0/804705662 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x562541213040 msgr2=0x56254130e5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.024+0000 7fe19a320800 1 --2- 172.21.15.170:0/804705662 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x562541213040 0x56254130e5e0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.024+0000 7fe19a320800 1 -- 172.21.15.170:0/804705662 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x562541310980 msgr2=0x562541312e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.024+0000 7fe19a320800 1 --2- 172.21.15.170:0/804705662 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x562541310980 0x562541312e20 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.024+0000 7fe19a320800 1 -- 172.21.15.170:0/804705662 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe07c03c730 msgr2=0x7fe07c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.024+0000 7fe19a320800 1 --2- 172.21.15.170:0/804705662 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe07c03c730 0x7fe07c03ebf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe18c001d70 tx=0x7fe18c0012d0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.024+0000 7fe19a320800 1 -- 172.21.15.170:0/804705662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56254120e310 msgr2=0x562541306f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.024+0000 7fe19a320800 1 --2- 172.21.15.170:0/804705662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56254120e310 0x562541306f90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe188025c20 tx=0x7fe188002fb0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.024+0000 7fe19a320800 1 -- 172.21.15.170:0/804705662 shutdown_connections 2024-09-12T17:28:02.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.024+0000 7fe19a320800 1 --2- 172.21.15.170:0/804705662 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x562541310980 0x562541312e20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.024+0000 7fe19a320800 1 --2- 172.21.15.170:0/804705662 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe07c03c730 0x7fe07c03ebf0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.024+0000 7fe19a320800 1 --2- 172.21.15.170:0/804705662 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x562541213040 0x56254130e5e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.024+0000 7fe19a320800 1 --2- 172.21.15.170:0/804705662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56254120e310 0x562541306f90 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.024+0000 7fe19a320800 1 -- 172.21.15.170:0/804705662 >> 172.21.15.170:0/804705662 conn(0x562541209920 msgr2=0x5625412f9810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:02.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.024+0000 7fe19a320800 1 -- 172.21.15.170:0/804705662 shutdown_connections 2024-09-12T17:28:02.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.024+0000 7fe19a320800 1 -- 172.21.15.170:0/804705662 wait complete. 2024-09-12T17:28:02.046 INFO:teuthology.orchestra.run.smithi170.stdout:[] 2024-09-12T17:28:02.046 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T17:28:02.046 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-12T17:28:02.047 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-12T17:28:02.047 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-12T17:28:02.091 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:02.091 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:02.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.089+0000 7f32af132800 1 Processor -- start 2024-09-12T17:28:02.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.089+0000 7f32af132800 1 -- start start 2024-09-12T17:28:02.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.090+0000 7f32af132800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x564a41435200 0x564a4143ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.090+0000 7f32af132800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564a412dee40 con 0x564a41433df0 2024-09-12T17:28:02.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.090+0000 7f32af132800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x564a412a9680 con 0x564a41435200 2024-09-12T17:28:02.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.090+0000 7f32a3fff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x564a41435200 0x564a4143ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.090+0000 7f32aadbc640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x564a41433df0 0x564a41434af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:48384/0 (socket says 172.21.15.170:48384) 2024-09-12T17:28:02.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.090+0000 7f32aadbc640 1 -- 172.21.15.170:0/3641074642 learned_addr learned my addr 172.21.15.170:0/3641074642 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:28:02.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.090+0000 7f32a3fff640 1 -- 172.21.15.170:0/3641074642 >> v1:172.21.15.47:6789/0 conn(0x564a41433df0 legacy=0x564a41434af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.090+0000 7f32a3fff640 1 -- 172.21.15.170:0/3641074642 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a412c56b0 con 0x564a41435200 2024-09-12T17:28:02.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.092+0000 7f32a3fff640 1 --2- 172.21.15.170:0/3641074642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564a41435200 0x564a4143ada0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f329400a470 tx=0x7f3294045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ef329d700b4d733 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.092+0000 7f32aa5bb640 1 -- 172.21.15.170:0/3641074642 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3294053570 con 0x564a41435200 2024-09-12T17:28:02.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.092+0000 7f32aa5bb640 1 -- 172.21.15.170:0/3641074642 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3294058070 con 0x564a41435200 2024-09-12T17:28:02.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.092+0000 7f32aa5bb640 1 -- 172.21.15.170:0/3641074642 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3294053880 con 0x564a41435200 2024-09-12T17:28:02.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.092+0000 7f32af132800 1 -- 172.21.15.170:0/3641074642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564a41435200 msgr2=0x564a4143ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.092+0000 7f32af132800 1 --2- 172.21.15.170:0/3641074642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564a41435200 0x564a4143ada0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f329400a470 tx=0x7f3294045a20 comp rx=0 tx=0).stop 2024-09-12T17:28:02.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.093+0000 7f32af132800 1 -- 172.21.15.170:0/3641074642 shutdown_connections 2024-09-12T17:28:02.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.093+0000 7f32af132800 1 --2- 172.21.15.170:0/3641074642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564a41435200 0x564a4143ada0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.093+0000 7f32af132800 1 -- 172.21.15.170:0/3641074642 >> 172.21.15.170:0/3641074642 conn(0x564a4142f1c0 msgr2=0x564a41431620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:02.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.093+0000 7f32af132800 1 -- 172.21.15.170:0/3641074642 shutdown_connections 2024-09-12T17:28:02.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.093+0000 7f32af132800 1 -- 172.21.15.170:0/3641074642 wait complete. 2024-09-12T17:28:02.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.106+0000 7f32af132800 1 Processor -- start 2024-09-12T17:28:02.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.106+0000 7f32af132800 1 -- start start 2024-09-12T17:28:02.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.106+0000 7f32af132800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564a41433df0 0x564a413a7d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.107+0000 7f32af132800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564a412cddd0 con 0x564a41433df0 2024-09-12T17:28:02.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.107+0000 7f32aadbc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564a41433df0 0x564a413a7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.107+0000 7f32aadbc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564a41433df0 0x564a413a7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57558/0 (socket says 172.21.15.170:57558) 2024-09-12T17:28:02.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.107+0000 7f32aadbc640 1 -- 172.21.15.170:0/4256643250 learned_addr learned my addr 172.21.15.170:0/4256643250 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:02.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.107+0000 7f32aadbc640 1 -- 172.21.15.170:0/4256643250 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a412e6e10 con 0x564a41433df0 2024-09-12T17:28:02.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.107+0000 7f32aadbc640 1 --2- 172.21.15.170:0/4256643250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564a41433df0 0x564a413a7d50 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f329c001e40 tx=0x7f329c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61550b982785ce05 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.107+0000 7f3198e09640 1 -- 172.21.15.170:0/4256643250 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f329c012020 con 0x564a41433df0 2024-09-12T17:28:02.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.107+0000 7f3198e09640 1 -- 172.21.15.170:0/4256643250 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f329c00e5a0 con 0x564a41433df0 2024-09-12T17:28:02.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.107+0000 7f3198e09640 1 -- 172.21.15.170:0/4256643250 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f329c00e8a0 con 0x564a41433df0 2024-09-12T17:28:02.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.108+0000 7f32af132800 1 -- 172.21.15.170:0/4256643250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564a41433df0 msgr2=0x564a413a7d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.108+0000 7f32af132800 1 --2- 172.21.15.170:0/4256643250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564a41433df0 0x564a413a7d50 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f329c001e40 tx=0x7f329c001e70 comp rx=0 tx=0).stop 2024-09-12T17:28:02.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.108+0000 7f32af132800 1 -- 172.21.15.170:0/4256643250 shutdown_connections 2024-09-12T17:28:02.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.108+0000 7f32af132800 1 --2- 172.21.15.170:0/4256643250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564a41433df0 0x564a413a7d50 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.108+0000 7f32af132800 1 -- 172.21.15.170:0/4256643250 >> 172.21.15.170:0/4256643250 conn(0x564a4142f1c0 msgr2=0x564a4151eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:02.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.108+0000 7f32af132800 1 -- 172.21.15.170:0/4256643250 shutdown_connections 2024-09-12T17:28:02.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.108+0000 7f32af132800 1 -- 172.21.15.170:0/4256643250 wait complete. 2024-09-12T17:28:02.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.108+0000 7f32af132800 1 Processor -- start 2024-09-12T17:28:02.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.108+0000 7f32af132800 1 -- start start 2024-09-12T17:28:02.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.109+0000 7f32af132800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564a41433df0 0x564a4152bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.109+0000 7f32af132800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564a414358f0 con 0x564a41433df0 2024-09-12T17:28:02.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.109+0000 7f32aadbc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564a41433df0 0x564a4152bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.109+0000 7f32aadbc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564a41433df0 0x564a4152bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57572/0 (socket says 172.21.15.170:57572) 2024-09-12T17:28:02.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.109+0000 7f32aadbc640 1 -- 172.21.15.170:0/2354342415 learned_addr learned my addr 172.21.15.170:0/2354342415 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:02.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.109+0000 7f32aadbc640 1 -- 172.21.15.170:0/2354342415 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a4152c550 con 0x564a41433df0 2024-09-12T17:28:02.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.109+0000 7f32aadbc640 1 --2- 172.21.15.170:0/2354342415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564a41433df0 0x564a4152bff0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f329c00c010 tx=0x7f329c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.109+0000 7f3197606640 1 -- 172.21.15.170:0/2354342415 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f329c012030 con 0x564a41433df0 2024-09-12T17:28:02.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.109+0000 7f3197606640 1 -- 172.21.15.170:0/2354342415 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f329c0014a0 con 0x564a41433df0 2024-09-12T17:28:02.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.109+0000 7f3197606640 1 -- 172.21.15.170:0/2354342415 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f329c01a7a0 con 0x564a41433df0 2024-09-12T17:28:02.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.109+0000 7f32af132800 1 -- 172.21.15.170:0/2354342415 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564a4152c7e0 con 0x564a41433df0 2024-09-12T17:28:02.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.109+0000 7f32af132800 1 -- 172.21.15.170:0/2354342415 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a4152d1e0 con 0x564a41433df0 2024-09-12T17:28:02.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.110+0000 7f3197606640 1 -- 172.21.15.170:0/2354342415 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f329c015020 con 0x564a41433df0 2024-09-12T17:28:02.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.111+0000 7f3197606640 1 --2- 172.21.15.170:0/2354342415 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f319003c730 0x7f319003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.111+0000 7f3197606640 1 -- 172.21.15.170:0/2354342415 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f329c020030 con 0x564a41433df0 2024-09-12T17:28:02.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.111+0000 7f32a3fff640 1 --2- 172.21.15.170:0/2354342415 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f319003c730 0x7f319003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.111+0000 7f32af132800 1 --2- 172.21.15.170:0/2354342415 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564a41435200 0x564a41533640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.111+0000 7f32af132800 1 -- 172.21.15.170:0/2354342415 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564a41533b80 con 0x564a41435200 2024-09-12T17:28:02.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.111+0000 7f32ab5bd640 1 --2- 172.21.15.170:0/2354342415 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564a41435200 0x564a41533640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.111+0000 7f32a3fff640 1 --2- 172.21.15.170:0/2354342415 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f319003c730 0x7f319003ebf0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3294057000 tx=0x7f3294052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.111+0000 7f32ab5bd640 1 --2- 172.21.15.170:0/2354342415 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564a41435200 0x564a41533640 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.111+0000 7f32ab5bd640 1 -- 172.21.15.170:0/2354342415 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32a400a4d0 con 0x564a41435200 2024-09-12T17:28:02.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.111+0000 7f32af132800 1 -- 172.21.15.170:0/2354342415 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564a41533f20 con 0x564a41435200 2024-09-12T17:28:02.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.112+0000 7f32ab5bd640 1 -- 172.21.15.170:0/2354342415 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f32a400a4d0 con 0x564a41435200 2024-09-12T17:28:02.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.112+0000 7f32af132800 1 --2- 172.21.15.170:0/2354342415 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564a415359e0 0x564a41537e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.112+0000 7f32af132800 1 -- 172.21.15.170:0/2354342415 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564a41538610 con 0x564a415359e0 2024-09-12T17:28:02.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.112+0000 7f32aadbc640 1 --2- 172.21.15.170:0/2354342415 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564a415359e0 0x564a41537e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.112+0000 7f32aadbc640 1 --2- 172.21.15.170:0/2354342415 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564a415359e0 0x564a41537e80 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.112+0000 7f32aadbc640 1 -- 172.21.15.170:0/2354342415 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f329c01ab20 con 0x564a415359e0 2024-09-12T17:28:02.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.112+0000 7f32af132800 1 -- 172.21.15.170:0/2354342415 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564a41534770 con 0x564a41435200 2024-09-12T17:28:02.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.113+0000 7f32ab5bd640 1 -- 172.21.15.170:0/2354342415 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f32a400a4d0 con 0x564a41435200 2024-09-12T17:28:02.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.113+0000 7f32af132800 1 -- 172.21.15.170:0/2354342415 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564a41534b50 con 0x564a415359e0 2024-09-12T17:28:02.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.113+0000 7f32aadbc640 1 -- 172.21.15.170:0/2354342415 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f329c01ab20 con 0x564a415359e0 2024-09-12T17:28:02.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.113+0000 7f32af132800 1 Processor -- start 2024-09-12T17:28:02.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.113+0000 7f32af132800 1 -- start start 2024-09-12T17:28:02.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.114+0000 7f32af132800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564a41524a00 0x564a41523270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.114+0000 7f32af132800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564a4132ba00 con 0x564a41524a00 2024-09-12T17:28:02.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.114+0000 7f32ab5bd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564a41524a00 0x564a41523270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.114+0000 7f32ab5bd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564a41524a00 0x564a41523270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57588/0 (socket says 172.21.15.170:57588) 2024-09-12T17:28:02.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.114+0000 7f32ab5bd640 1 -- 172.21.15.170:0/2080134237 learned_addr learned my addr 172.21.15.170:0/2080134237 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:02.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.114+0000 7f32ab5bd640 1 -- 172.21.15.170:0/2080134237 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a41524f20 con 0x564a41524a00 2024-09-12T17:28:02.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.114+0000 7f32ab5bd640 1 --2- 172.21.15.170:0/2080134237 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564a41524a00 0x564a41523270 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x564a4152ce80 tx=0x7f32a40167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.114+0000 7f3194e01640 1 -- 172.21.15.170:0/2080134237 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32a4013640 con 0x564a41524a00 2024-09-12T17:28:02.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.114+0000 7f3194e01640 1 -- 172.21.15.170:0/2080134237 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32a40137e0 con 0x564a41524a00 2024-09-12T17:28:02.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.114+0000 7f32af132800 1 -- 172.21.15.170:0/2080134237 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564a415237b0 con 0x564a41524a00 2024-09-12T17:28:02.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.114+0000 7f3194e01640 1 -- 172.21.15.170:0/2080134237 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32a4013ae0 con 0x564a41524a00 2024-09-12T17:28:02.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.114+0000 7f32af132800 1 -- 172.21.15.170:0/2080134237 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a41523d00 con 0x564a41524a00 2024-09-12T17:28:02.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.115+0000 7f3194e01640 1 -- 172.21.15.170:0/2080134237 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f32a4011040 con 0x564a41524a00 2024-09-12T17:28:02.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.115+0000 7f3194e01640 1 --2- 172.21.15.170:0/2080134237 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f318403c730 0x7f318403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.115+0000 7f3194e01640 1 -- 172.21.15.170:0/2080134237 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f32a400e040 con 0x564a41524a00 2024-09-12T17:28:02.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.116+0000 7f32aadbc640 1 --2- 172.21.15.170:0/2080134237 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f318403c730 0x7f318403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.116+0000 7f32af132800 1 Processor -- start 2024-09-12T17:28:02.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.116+0000 7f32aadbc640 1 --2- 172.21.15.170:0/2080134237 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f318403c730 0x7f318403ebf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f329c00c720 tx=0x7f329c043050 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.116+0000 7f32af132800 1 -- start start 2024-09-12T17:28:02.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.116+0000 7f32af132800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564a41555bb0 0x564a41555fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.116+0000 7f32af132800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564a41527320 con 0x564a41555bb0 2024-09-12T17:28:02.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.116+0000 7f32ab5bd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564a41555bb0 0x564a41555fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.116+0000 7f32ab5bd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564a41555bb0 0x564a41555fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57604/0 (socket says 172.21.15.170:57604) 2024-09-12T17:28:02.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.116+0000 7f32ab5bd640 1 -- 172.21.15.170:0/3642899034 learned_addr learned my addr 172.21.15.170:0/3642899034 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:02.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.117+0000 7f32ab5bd640 1 -- 172.21.15.170:0/3642899034 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a415565a0 con 0x564a41555bb0 2024-09-12T17:28:02.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.117+0000 7f32ab5bd640 1 --2- 172.21.15.170:0/3642899034 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564a41555bb0 0x564a41555fb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f32a4020000 tx=0x7f32a401f400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=220f2f681da6924c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.117+0000 7f318e7fc640 1 -- 172.21.15.170:0/3642899034 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32a4055040 con 0x564a41555bb0 2024-09-12T17:28:02.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.117+0000 7f318e7fc640 1 -- 172.21.15.170:0/3642899034 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32a4021960 con 0x564a41555bb0 2024-09-12T17:28:02.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.117+0000 7f318e7fc640 1 -- 172.21.15.170:0/3642899034 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32a4021440 con 0x564a41555bb0 2024-09-12T17:28:02.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.117+0000 7f32af132800 1 -- 172.21.15.170:0/3642899034 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564a41555bb0 msgr2=0x564a41555fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.117+0000 7f32af132800 1 --2- 172.21.15.170:0/3642899034 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564a41555bb0 0x564a41555fb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f32a4020000 tx=0x7f32a401f400 comp rx=0 tx=0).stop 2024-09-12T17:28:02.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.117+0000 7f32af132800 1 -- 172.21.15.170:0/3642899034 shutdown_connections 2024-09-12T17:28:02.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.117+0000 7f32af132800 1 --2- 172.21.15.170:0/3642899034 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564a41555bb0 0x564a41555fb0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.117+0000 7f32af132800 1 -- 172.21.15.170:0/3642899034 >> 172.21.15.170:0/3642899034 conn(0x564a41551fb0 msgr2=0x564a415501f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:02.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.117+0000 7f32af132800 1 -- 172.21.15.170:0/3642899034 shutdown_connections 2024-09-12T17:28:02.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.117+0000 7f32af132800 1 -- 172.21.15.170:0/3642899034 wait complete. 2024-09-12T17:28:02.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.118+0000 7f32af132800 1 Processor -- start 2024-09-12T17:28:02.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.118+0000 7f32af132800 1 -- start start 2024-09-12T17:28:02.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.118+0000 7f32af132800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564a41555bb0 0x564a4155d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.118+0000 7f32af132800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564a41556bc0 con 0x564a41555bb0 2024-09-12T17:28:02.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.118+0000 7f32ab5bd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564a41555bb0 0x564a4155d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.118+0000 7f32ab5bd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564a41555bb0 0x564a4155d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57614/0 (socket says 172.21.15.170:57614) 2024-09-12T17:28:02.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.118+0000 7f32ab5bd640 1 -- 172.21.15.170:0/3813744924 learned_addr learned my addr 172.21.15.170:0/3813744924 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:02.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.118+0000 7f32ab5bd640 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a4155d6c0 con 0x564a41555bb0 2024-09-12T17:28:02.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.119+0000 7f32ab5bd640 1 --2- 172.21.15.170:0/3813744924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564a41555bb0 0x564a4155d160 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f32a40208e0 tx=0x7f32a4053cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.119+0000 7f318cff9640 1 -- 172.21.15.170:0/3813744924 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32a4055050 con 0x564a41555bb0 2024-09-12T17:28:02.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.119+0000 7f318cff9640 1 -- 172.21.15.170:0/3813744924 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32a4053f60 con 0x564a41555bb0 2024-09-12T17:28:02.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.119+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564a4155d950 con 0x564a41555bb0 2024-09-12T17:28:02.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.119+0000 7f318cff9640 1 -- 172.21.15.170:0/3813744924 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32a401f710 con 0x564a41555bb0 2024-09-12T17:28:02.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.119+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a4155e2d0 con 0x564a41555bb0 2024-09-12T17:28:02.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.119+0000 7f318cff9640 1 -- 172.21.15.170:0/3813744924 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f32a40551f0 con 0x564a41555bb0 2024-09-12T17:28:02.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.120+0000 7f318cff9640 1 --2- 172.21.15.170:0/3813744924 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f317403c780 0x7f317403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.120+0000 7f318cff9640 1 -- 172.21.15.170:0/3813744924 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f32a404d040 con 0x564a41555bb0 2024-09-12T17:28:02.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.120+0000 7f32aadbc640 1 --2- 172.21.15.170:0/3813744924 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f317403c780 0x7f317403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.120+0000 7f32af132800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.120+0000 7f32af132800 1 --2- 172.21.15.170:0/3813744924 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564a41568a60 0x564a4156af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.120+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564a4156b670 con 0x564a41568a60 2024-09-12T17:28:02.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.120+0000 7f32aadbc640 1 --2- 172.21.15.170:0/3813744924 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f317403c780 0x7f317403ec40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f329c04b520 tx=0x7f329c030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.120+0000 7f32a3fff640 1 --2- 172.21.15.170:0/3813744924 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564a41568a60 0x564a4156af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.120+0000 7f32a3fff640 1 --2- 172.21.15.170:0/3813744924 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564a41568a60 0x564a4156af20 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.121+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3294051070 con 0x564a41568a60 2024-09-12T17:28:02.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.121+0000 7f32af132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:02.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.121+0000 7f32af132800 20 realm 2024-09-12T17:28:02.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.121+0000 7f32af132800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.121+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564a4156baa0 con 0x564a41568a60 2024-09-12T17:28:02.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.121+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3294051070 con 0x564a41568a60 2024-09-12T17:28:02.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.121+0000 7f32af132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:02.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.121+0000 7f32af132800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:02.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.121+0000 7f32af132800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.121+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564a4156c370 con 0x564a41568a60 2024-09-12T17:28:02.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.121+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3294051070 con 0x564a41568a60 2024-09-12T17:28:02.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.121+0000 7f32af132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:02.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.121+0000 7f32af132800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.121+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564a4156c710 con 0x564a41568a60 2024-09-12T17:28:02.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.121+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3294051070 con 0x564a41568a60 2024-09-12T17:28:02.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.121+0000 7f32af132800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:02.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.121+0000 7f32af132800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.121+0000 7f32af132800 1 --2- 172.21.15.170:0/3813744924 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564a4156d470 0x564a4156f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.121+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564a4156fda0 con 0x564a4156d470 2024-09-12T17:28:02.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.122+0000 7f32ab5bd640 1 --2- 172.21.15.170:0/3813744924 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564a4156d470 0x564a4156f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.122+0000 7f32ab5bd640 1 --2- 172.21.15.170:0/3813744924 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564a4156d470 0x564a4156f860 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.122+0000 7f32ab5bd640 1 -- 172.21.15.170:0/3813744924 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f32a400a4d0 con 0x564a4156d470 2024-09-12T17:28:02.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.122+0000 7f32af132800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:02.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.122+0000 7f32af132800 20 searching for the correct realm 2024-09-12T17:28:02.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.122+0000 7f32af132800 1 --2- 172.21.15.170:0/3813744924 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x564a41571de0 0x564a415742a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.122+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564a41574970 con 0x564a41571de0 2024-09-12T17:28:02.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.122+0000 7f32aadbc640 1 --2- 172.21.15.170:0/3813744924 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x564a41571de0 0x564a415742a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.122+0000 7f32aadbc640 1 --2- 172.21.15.170:0/3813744924 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x564a41571de0 0x564a415742a0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.123+0000 7f32aadbc640 1 -- 172.21.15.170:0/3813744924 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f329c01ab20 con 0x564a41571de0 2024-09-12T17:28:02.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.123+0000 7f32aadbc640 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564a41574970 con 0x564a4156d470 2024-09-12T17:28:02.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.123+0000 7f32ab5bd640 1 -- 172.21.15.170:0/3813744924 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32a400a4d0 con 0x564a4156d470 2024-09-12T17:28:02.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.123+0000 7f32ab5bd640 1 --2- 172.21.15.170:0/3813744924 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f32a4033070 0x7f32a40327d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.123+0000 7f32ab5bd640 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564a41574970 con 0x7f32a4033070 2024-09-12T17:28:02.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.123+0000 7f32a3fff640 1 --2- 172.21.15.170:0/3813744924 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f32a4033070 0x7f32a40327d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.123+0000 7f32a3fff640 1 --2- 172.21.15.170:0/3813744924 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f32a4033070 0x7f32a40327d0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.124+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3294051070 con 0x7f32a4033070 2024-09-12T17:28:02.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.124+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564a41574970 con 0x564a41568a60 2024-09-12T17:28:02.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.124+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3294051070 con 0x564a41568a60 2024-09-12T17:28:02.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.124+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564a41574970 con 0x564a41568a60 2024-09-12T17:28:02.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.124+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3294051070 con 0x564a41568a60 2024-09-12T17:28:02.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.124+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564a41574970 con 0x7f32a4033070 2024-09-12T17:28:02.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.124+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3294051070 con 0x7f32a4033070 2024-09-12T17:28:02.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.124+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564a41574970 con 0x7f32a4033070 2024-09-12T17:28:02.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.125+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3294051070 con 0x7f32a4033070 2024-09-12T17:28:02.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.125+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564a41574970 con 0x564a4156d470 2024-09-12T17:28:02.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.125+0000 7f32ab5bd640 1 -- 172.21.15.170:0/3813744924 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32a400a4d0 con 0x564a4156d470 2024-09-12T17:28:02.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.125+0000 7f32ab5bd640 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564a41574970 con 0x564a41571de0 2024-09-12T17:28:02.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.125+0000 7f32aadbc640 1 -- 172.21.15.170:0/3813744924 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f329c01ab20 con 0x564a41571de0 2024-09-12T17:28:02.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.125+0000 7f32aadbc640 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564a41574970 con 0x564a41568a60 2024-09-12T17:28:02.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.125+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3294051070 con 0x564a41568a60 2024-09-12T17:28:02.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.125+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564a41574970 con 0x7f32a4033070 2024-09-12T17:28:02.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.126+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3294051070 con 0x7f32a4033070 2024-09-12T17:28:02.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.126+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564a41574970 con 0x564a41568a60 2024-09-12T17:28:02.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.126+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3294051070 con 0x564a41568a60 2024-09-12T17:28:02.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.126+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564a41574970 con 0x564a4156d470 2024-09-12T17:28:02.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.126+0000 7f32ab5bd640 1 -- 172.21.15.170:0/3813744924 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f32a400a4d0 con 0x564a4156d470 2024-09-12T17:28:02.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.126+0000 7f32ab5bd640 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564a41574970 con 0x564a41571de0 2024-09-12T17:28:02.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.126+0000 7f32aadbc640 1 -- 172.21.15.170:0/3813744924 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f329c01ab20 con 0x564a41571de0 2024-09-12T17:28:02.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.126+0000 7f32aadbc640 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564a41574970 con 0x564a41571de0 2024-09-12T17:28:02.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.127+0000 7f32aadbc640 1 -- 172.21.15.170:0/3813744924 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f329c01ab20 con 0x564a41571de0 2024-09-12T17:28:02.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.127+0000 7f32aadbc640 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564a41574970 con 0x7f32a4033070 2024-09-12T17:28:02.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.127+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3294051070 con 0x7f32a4033070 2024-09-12T17:28:02.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.127+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564a41574970 con 0x564a41571de0 2024-09-12T17:28:02.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.127+0000 7f32aadbc640 1 -- 172.21.15.170:0/3813744924 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f329c01ab20 con 0x564a41571de0 2024-09-12T17:28:02.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.127+0000 7f32aadbc640 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564a41574970 con 0x564a41571de0 2024-09-12T17:28:02.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.127+0000 7f32aadbc640 1 -- 172.21.15.170:0/3813744924 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f329c01ab20 con 0x564a41571de0 2024-09-12T17:28:02.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.127+0000 7f32aadbc640 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564a41574970 con 0x564a41568a60 2024-09-12T17:28:02.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.128+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3294051070 con 0x564a41568a60 2024-09-12T17:28:02.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.128+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564a41574970 con 0x564a41568a60 2024-09-12T17:28:02.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.128+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3294051070 con 0x564a41568a60 2024-09-12T17:28:02.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.128+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564a41574970 con 0x7f32a4033070 2024-09-12T17:28:02.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.128+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3294051070 con 0x7f32a4033070 2024-09-12T17:28:02.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.128+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564a41574970 con 0x564a41571de0 2024-09-12T17:28:02.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.128+0000 7f32aadbc640 1 -- 172.21.15.170:0/3813744924 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f329c01ab20 con 0x564a41571de0 2024-09-12T17:28:02.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.128+0000 7f32aadbc640 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564a41574970 con 0x564a4156d470 2024-09-12T17:28:02.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.128+0000 7f32ab5bd640 1 -- 172.21.15.170:0/3813744924 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32a400a4d0 con 0x564a4156d470 2024-09-12T17:28:02.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.128+0000 7f32ab5bd640 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564a41574970 con 0x564a41568a60 2024-09-12T17:28:02.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.129+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3294051070 con 0x564a41568a60 2024-09-12T17:28:02.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.129+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564a41574970 con 0x7f32a4033070 2024-09-12T17:28:02.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.129+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3294051070 con 0x7f32a4033070 2024-09-12T17:28:02.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.129+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564a41574970 con 0x564a41571de0 2024-09-12T17:28:02.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.129+0000 7f32aadbc640 1 -- 172.21.15.170:0/3813744924 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f329c01ab20 con 0x564a41571de0 2024-09-12T17:28:02.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.129+0000 7f32aadbc640 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564a41574970 con 0x7f32a4033070 2024-09-12T17:28:02.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.129+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3294051070 con 0x7f32a4033070 2024-09-12T17:28:02.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.129+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564a41574970 con 0x564a4156d470 2024-09-12T17:28:02.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.130+0000 7f32ab5bd640 1 -- 172.21.15.170:0/3813744924 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32a400a4d0 con 0x564a4156d470 2024-09-12T17:28:02.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.130+0000 7f32ab5bd640 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564a41574970 con 0x564a41571de0 2024-09-12T17:28:02.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.130+0000 7f32aadbc640 1 -- 172.21.15.170:0/3813744924 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f329c01ab20 con 0x564a41571de0 2024-09-12T17:28:02.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.130+0000 7f32aadbc640 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564a41574970 con 0x7f32a4033070 2024-09-12T17:28:02.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.130+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3294051070 con 0x7f32a4033070 2024-09-12T17:28:02.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.130+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564a41574970 con 0x564a41568a60 2024-09-12T17:28:02.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.130+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3294051070 con 0x564a41568a60 2024-09-12T17:28:02.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.130+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564a41574970 con 0x564a4156d470 2024-09-12T17:28:02.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.131+0000 7f32ab5bd640 1 -- 172.21.15.170:0/3813744924 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f32a400a4d0 con 0x564a4156d470 2024-09-12T17:28:02.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.131+0000 7f32af132800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:02.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.131+0000 7f32af132800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:02.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.131+0000 7f32af132800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:02.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.131+0000 7f32af132800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:02.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.131+0000 7f32af132800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:02.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.131+0000 7f32af132800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:02.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.131+0000 7f32af132800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.131+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564a41570810 con 0x564a41568a60 2024-09-12T17:28:02.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.131+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3294051070 con 0x564a41568a60 2024-09-12T17:28:02.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.131+0000 7f32af132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:02.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.131+0000 7f32af132800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.131+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564a415703f0 con 0x564a41568a60 2024-09-12T17:28:02.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.131+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3294051070 con 0x564a41568a60 2024-09-12T17:28:02.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.131+0000 7f32af132800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:02.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.131+0000 7f32af132800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.131+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564a41571130 con 0x564a4156d470 2024-09-12T17:28:02.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.131+0000 7f32ab5bd640 1 -- 172.21.15.170:0/3813744924 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f32a400a4d0 con 0x564a4156d470 2024-09-12T17:28:02.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.131+0000 7f32af132800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:02.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.131+0000 7f32af132800 20 zone default found 2024-09-12T17:28:02.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.131+0000 7f32af132800 4 Realm: () 2024-09-12T17:28:02.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.131+0000 7f32af132800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:02.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.131+0000 7f32af132800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:02.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.131+0000 7f32af132800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:02.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.131+0000 7f32af132800 20 zonegroup default 2024-09-12T17:28:02.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.131+0000 7f32af132800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.131+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564a415752a0 con 0x7f32a4033070 2024-09-12T17:28:02.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.132+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3294051070 con 0x7f32a4033070 2024-09-12T17:28:02.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.132+0000 7f32af132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:02.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.132+0000 7f32af132800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.132+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564a41577130 con 0x564a41571de0 2024-09-12T17:28:02.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.132+0000 7f32aadbc640 1 -- 172.21.15.170:0/3813744924 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f329c01ab20 con 0x564a41571de0 2024-09-12T17:28:02.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.132+0000 7f32af132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:02.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.132+0000 7f32af132800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.132+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564a41577590 con 0x564a41571de0 2024-09-12T17:28:02.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.133+0000 7f32aadbc640 1 -- 172.21.15.170:0/3813744924 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f329c01ab20 con 0x564a41571de0 2024-09-12T17:28:02.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.133+0000 7f32af132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:02.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.133+0000 7f32af132800 20 started sync module instance, tier type = 2024-09-12T17:28:02.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.133+0000 7f32af132800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:02.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.133+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564a415764d0 con 0x564a4156d470 2024-09-12T17:28:02.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.134+0000 7f32ab5bd640 1 -- 172.21.15.170:0/3813744924 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32a400a4d0 con 0x564a4156d470 2024-09-12T17:28:02.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.134+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94876923816400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564a415779f0 con 0x564a4156d470 2024-09-12T17:28:02.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.134+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564a41578240 con 0x564a41568a60 2024-09-12T17:28:02.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.135+0000 7f32ab5bd640 1 -- 172.21.15.170:0/3813744924 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94876923816400] v29'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32a400a4d0 con 0x564a4156d470 2024-09-12T17:28:02.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.135+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3294051070 con 0x564a41568a60 2024-09-12T17:28:02.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.135+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94876923820528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564a415782c0 con 0x564a41568a60 2024-09-12T17:28:02.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.135+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564a41578c80 con 0x564a41571de0 2024-09-12T17:28:02.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.136+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94876923820528] v29'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3294051070 con 0x564a41568a60 2024-09-12T17:28:02.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.136+0000 7f32aadbc640 1 -- 172.21.15.170:0/3813744924 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f329c01ab20 con 0x564a41571de0 2024-09-12T17:28:02.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.136+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94876923821584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564a41578230 con 0x564a41571de0 2024-09-12T17:28:02.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.136+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564a41579af0 con 0x564a4156d470 2024-09-12T17:28:02.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.137+0000 7f32aadbc640 1 -- 172.21.15.170:0/3813744924 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94876923821584] v29'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f329c01ab20 con 0x564a41571de0 2024-09-12T17:28:02.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.137+0000 7f32ab5bd640 1 -- 172.21.15.170:0/3813744924 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32a400a4d0 con 0x564a4156d470 2024-09-12T17:28:02.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.137+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94876923826208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564a41579af0 con 0x564a4156d470 2024-09-12T17:28:02.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.137+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564a4157a4f0 con 0x564a41568a60 2024-09-12T17:28:02.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.138+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3294051070 con 0x564a41568a60 2024-09-12T17:28:02.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.138+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94876923830272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564a4157a460 con 0x564a41568a60 2024-09-12T17:28:02.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.138+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564a4157b4e0 con 0x7f32a4033070 2024-09-12T17:28:02.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.138+0000 7f32ab5bd640 1 -- 172.21.15.170:0/3813744924 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94876923826208] v29'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32a400a4d0 con 0x564a4156d470 2024-09-12T17:28:02.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.139+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3294051070 con 0x7f32a4033070 2024-09-12T17:28:02.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.139+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94876923834288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564a4157b4a0 con 0x7f32a4033070 2024-09-12T17:28:02.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.139+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564a4157bef0 con 0x7f32a4033070 2024-09-12T17:28:02.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.139+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94876923830272] v29'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3294051070 con 0x564a41568a60 2024-09-12T17:28:02.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.140+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94876923834288] v29'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3294051070 con 0x7f32a4033070 2024-09-12T17:28:02.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.141+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(56 notify.6 [create] v29'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3294051070 con 0x7f32a4033070 2024-09-12T17:28:02.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.141+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94876923827776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564a4157ba40 con 0x7f32a4033070 2024-09-12T17:28:02.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.141+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564a4157c400 con 0x7f32a4033070 2024-09-12T17:28:02.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.142+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(58 notify.7 [create] v29'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3294051070 con 0x7f32a4033070 2024-09-12T17:28:02.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.142+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94876923838288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564a4157c820 con 0x7f32a4033070 2024-09-12T17:28:02.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.142+0000 7f32af132800 20 add_watcher() i=0 2024-09-12T17:28:02.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.142+0000 7f32af132800 20 add_watcher() i=1 2024-09-12T17:28:02.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.142+0000 7f32af132800 20 add_watcher() i=2 2024-09-12T17:28:02.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.142+0000 7f32af132800 20 add_watcher() i=3 2024-09-12T17:28:02.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.142+0000 7f32af132800 20 add_watcher() i=4 2024-09-12T17:28:02.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.142+0000 7f32af132800 20 add_watcher() i=5 2024-09-12T17:28:02.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.142+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94876923827776] v29'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3294051070 con 0x7f32a4033070 2024-09-12T17:28:02.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.142+0000 7f32af132800 20 add_watcher() i=6 2024-09-12T17:28:02.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.142+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94876923838288] v29'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3294051070 con 0x7f32a4033070 2024-09-12T17:28:02.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.142+0000 7f32af132800 20 add_watcher() i=7 2024-09-12T17:28:02.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.142+0000 7f32af132800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:02.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.142+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564a4157a8e0 con 0x564a41568a60 2024-09-12T17:28:02.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.143+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3294051070 con 0x564a41568a60 2024-09-12T17:28:02.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.143+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94876923839344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564a4157a8e0 con 0x564a41568a60 2024-09-12T17:28:02.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.144+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94876923839344] v29'90 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3294051070 con 0x564a41568a60 2024-09-12T17:28:02.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.144+0000 7f31617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:02.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.144+0000 7f32af132800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:02.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.144+0000 7f32af132800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:02.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.144+0000 7f32af132800 5 note: GC not initialized 2024-09-12T17:28:02.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.144+0000 7f30dbfff640 20 reqs_thread_entry: start 2024-09-12T17:28:02.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.144+0000 7f32af132800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:02.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.144+0000 7f32af132800 20 Filter name: none 2024-09-12T17:28:02.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.145+0000 7f30d9ffb640 20 reqs_thread_entry: start 2024-09-12T17:28:02.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.145+0000 7f32af132800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.145+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564a415b2350 con 0x564a41568a60 2024-09-12T17:28:02.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.145+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3294051070 con 0x564a41568a60 2024-09-12T17:28:02.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.145+0000 7f32af132800 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:28:02.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.145+0000 7f32af132800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.145+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564a415b2c10 con 0x564a41568a60 2024-09-12T17:28:02.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.145+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3294051070 con 0x564a41568a60 2024-09-12T17:28:02.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.145+0000 7f32af132800 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:28:02.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.145+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564a415b3c20 con 0x564a4156d470 2024-09-12T17:28:02.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.146+0000 7f32ab5bd640 1 -- 172.21.15.170:0/3813744924 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f32a400a4d0 con 0x564a4156d470 2024-09-12T17:28:02.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.146+0000 7f31617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:02.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.146+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94876923839344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564a415b0270 con 0x564a41568a60 2024-09-12T17:28:02.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.147+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94876923839344] v29'91 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3294051070 con 0x564a41568a60 2024-09-12T17:28:02.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.147+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94876923816400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564a415b0270 con 0x564a4156d470 2024-09-12T17:28:02.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.148+0000 7f32ab5bd640 1 -- 172.21.15.170:0/3813744924 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94876923816400] v29'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32a400a4d0 con 0x564a4156d470 2024-09-12T17:28:02.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.148+0000 7f32af132800 20 remove_watcher() i=0 2024-09-12T17:28:02.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.148+0000 7f32af132800 2 removed watcher, disabling cache 2024-09-12T17:28:02.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.148+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94876923820528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564a415b0270 con 0x564a41568a60 2024-09-12T17:28:02.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.149+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94876923820528] v29'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3294051070 con 0x564a41568a60 2024-09-12T17:28:02.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.149+0000 7f32af132800 20 remove_watcher() i=1 2024-09-12T17:28:02.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.149+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94876923821584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564a415b0270 con 0x564a41571de0 2024-09-12T17:28:02.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.150+0000 7f32aadbc640 1 -- 172.21.15.170:0/3813744924 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94876923821584] v29'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f329c01ab20 con 0x564a41571de0 2024-09-12T17:28:02.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.150+0000 7f32af132800 20 remove_watcher() i=2 2024-09-12T17:28:02.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.150+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94876923826208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564a415b0270 con 0x564a4156d470 2024-09-12T17:28:02.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.151+0000 7f32ab5bd640 1 -- 172.21.15.170:0/3813744924 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94876923826208] v29'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32a400a4d0 con 0x564a4156d470 2024-09-12T17:28:02.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.151+0000 7f32af132800 20 remove_watcher() i=3 2024-09-12T17:28:02.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.151+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94876923830272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564a415b0270 con 0x564a41568a60 2024-09-12T17:28:02.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.152+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94876923830272] v29'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3294051070 con 0x564a41568a60 2024-09-12T17:28:02.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.152+0000 7f32af132800 20 remove_watcher() i=4 2024-09-12T17:28:02.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.152+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94876923834288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564a415b0270 con 0x7f32a4033070 2024-09-12T17:28:02.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.153+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94876923834288] v29'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3294051070 con 0x7f32a4033070 2024-09-12T17:28:02.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.153+0000 7f32af132800 20 remove_watcher() i=5 2024-09-12T17:28:02.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.153+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94876923827776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564a415b0270 con 0x7f32a4033070 2024-09-12T17:28:02.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.154+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94876923827776] v29'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3294051070 con 0x7f32a4033070 2024-09-12T17:28:02.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.154+0000 7f32af132800 20 remove_watcher() i=6 2024-09-12T17:28:02.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.154+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94876923838288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564a415b0270 con 0x7f32a4033070 2024-09-12T17:28:02.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.155+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94876923838288] v29'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3294051070 con 0x7f32a4033070 2024-09-12T17:28:02.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.155+0000 7f32af132800 20 remove_watcher() i=7 2024-09-12T17:28:02.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.156+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f32a4033070 msgr2=0x7f32a40327d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.156+0000 7f32af132800 1 --2- 172.21.15.170:0/3813744924 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f32a4033070 0x7f32a40327d0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.156+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564a41568a60 msgr2=0x564a4156af20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.156+0000 7f32af132800 1 --2- 172.21.15.170:0/3813744924 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564a41568a60 0x564a4156af20 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.156+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564a4156d470 msgr2=0x564a4156f860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.156+0000 7f32af132800 1 --2- 172.21.15.170:0/3813744924 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564a4156d470 0x564a4156f860 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.156+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x564a41571de0 msgr2=0x564a415742a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.156+0000 7f32af132800 1 --2- 172.21.15.170:0/3813744924 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x564a41571de0 0x564a415742a0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.156+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f317403c780 msgr2=0x7f317403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.156+0000 7f32af132800 1 --2- 172.21.15.170:0/3813744924 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f317403c780 0x7f317403ec40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f329c04b520 tx=0x7f329c030000 comp rx=0 tx=0).stop 2024-09-12T17:28:02.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.156+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564a41555bb0 msgr2=0x564a4155d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.156+0000 7f32af132800 1 --2- 172.21.15.170:0/3813744924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564a41555bb0 0x564a4155d160 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f32a40208e0 tx=0x7f32a4053cf0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.156+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 reap_dead start 2024-09-12T17:28:02.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.156+0000 7f32a3fff640 1 -- 172.21.15.170:0/3813744924 reap_dead start 2024-09-12T17:28:02.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.156+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 shutdown_connections 2024-09-12T17:28:02.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.156+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 >> 172.21.15.170:0/3813744924 conn(0x564a41551fb0 msgr2=0x564a415501c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:02.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.156+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 shutdown_connections 2024-09-12T17:28:02.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.156+0000 7f32af132800 1 -- 172.21.15.170:0/3813744924 wait complete. 2024-09-12T17:28:02.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.156+0000 7f32af132800 1 -- 172.21.15.170:0/2080134237 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f318403c730 msgr2=0x7f318403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.156+0000 7f32af132800 1 --2- 172.21.15.170:0/2080134237 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f318403c730 0x7f318403ebf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f329c00c720 tx=0x7f329c043050 comp rx=0 tx=0).stop 2024-09-12T17:28:02.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.156+0000 7f32af132800 1 -- 172.21.15.170:0/2080134237 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564a41524a00 msgr2=0x564a41523270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.156+0000 7f32af132800 1 --2- 172.21.15.170:0/2080134237 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564a41524a00 0x564a41523270 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x564a4152ce80 tx=0x7f32a40167b0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.156+0000 7f32af132800 1 -- 172.21.15.170:0/2080134237 shutdown_connections 2024-09-12T17:28:02.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.156+0000 7f32af132800 1 --2- 172.21.15.170:0/2080134237 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f318403c730 0x7f318403ebf0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.156+0000 7f32af132800 1 --2- 172.21.15.170:0/2080134237 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564a41524a00 0x564a41523270 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.156+0000 7f32af132800 1 -- 172.21.15.170:0/2080134237 >> 172.21.15.170:0/2080134237 conn(0x564a4153b250 msgr2=0x564a4153b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:02.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.156+0000 7f32af132800 1 -- 172.21.15.170:0/2080134237 shutdown_connections 2024-09-12T17:28:02.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.156+0000 7f32af132800 1 -- 172.21.15.170:0/2080134237 wait complete. 2024-09-12T17:28:02.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.157+0000 7f32af132800 1 -- 172.21.15.170:0/2354342415 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564a41435200 msgr2=0x564a41533640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.157+0000 7f32af132800 1 --2- 172.21.15.170:0/2354342415 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564a41435200 0x564a41533640 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.157+0000 7f32af132800 1 -- 172.21.15.170:0/2354342415 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564a415359e0 msgr2=0x564a41537e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.157+0000 7f32af132800 1 --2- 172.21.15.170:0/2354342415 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564a415359e0 0x564a41537e80 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.157+0000 7f32af132800 1 -- 172.21.15.170:0/2354342415 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f319003c730 msgr2=0x7f319003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.157+0000 7f32af132800 1 --2- 172.21.15.170:0/2354342415 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f319003c730 0x7f319003ebf0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3294057000 tx=0x7f3294052000 comp rx=0 tx=0).stop 2024-09-12T17:28:02.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.157+0000 7f32af132800 1 -- 172.21.15.170:0/2354342415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564a41433df0 msgr2=0x564a4152bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.157+0000 7f32af132800 1 --2- 172.21.15.170:0/2354342415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564a41433df0 0x564a4152bff0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f329c00c010 tx=0x7f329c000ed0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.157+0000 7f32af132800 1 -- 172.21.15.170:0/2354342415 shutdown_connections 2024-09-12T17:28:02.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.157+0000 7f32af132800 1 --2- 172.21.15.170:0/2354342415 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564a415359e0 0x564a41537e80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.157+0000 7f32af132800 1 --2- 172.21.15.170:0/2354342415 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f319003c730 0x7f319003ebf0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.157+0000 7f32af132800 1 --2- 172.21.15.170:0/2354342415 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564a41435200 0x564a41533640 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.157+0000 7f32af132800 1 --2- 172.21.15.170:0/2354342415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564a41433df0 0x564a4152bff0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.157+0000 7f32af132800 1 -- 172.21.15.170:0/2354342415 >> 172.21.15.170:0/2354342415 conn(0x564a4142f1c0 msgr2=0x564a4151d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:02.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.157+0000 7f32af132800 1 -- 172.21.15.170:0/2354342415 shutdown_connections 2024-09-12T17:28:02.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.157+0000 7f32af132800 1 -- 172.21.15.170:0/2354342415 wait complete. 2024-09-12T17:28:02.182 INFO:teuthology.orchestra.run.smithi170.stdout:[] 2024-09-12T17:28:02.182 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T17:28:02.197 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:28:02.197 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-12T17:28:02.198 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-12T17:28:02.198 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-12T17:28:02.242 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:02.243 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:02.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.241+0000 7f2e1aebb800 1 Processor -- start 2024-09-12T17:28:02.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.241+0000 7f2e1aebb800 1 -- start start 2024-09-12T17:28:02.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.241+0000 7f2e1aebb800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x558014284df0 0x558014285af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.241+0000 7f2e1aebb800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55801412fe40 con 0x558014286030 2024-09-12T17:28:02.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.241+0000 7f2e1aebb800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x5580140fa680 con 0x558014284df0 2024-09-12T17:28:02.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.241+0000 7f2e189a5640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x558014284df0 0x558014285af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.241+0000 7f2e189a5640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x558014284df0 0x558014285af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57622/0 (socket says 172.21.15.170:57622) 2024-09-12T17:28:02.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.241+0000 7f2e189a5640 1 -- 172.21.15.170:0/1207563236 learned_addr learned my addr 172.21.15.170:0/1207563236 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:02.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.241+0000 7f2e13fff640 1 --1- 172.21.15.170:0/1207563236 >> v1:172.21.15.47:6789/0 conn(0x558014286030 0x55801428ad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:48394/0 (socket says 172.21.15.170:48394) 2024-09-12T17:28:02.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.242+0000 7f2e189a5640 1 -- 172.21.15.170:0/1207563236 >> v1:172.21.15.47:6789/0 conn(0x558014286030 legacy=0x55801428ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.242+0000 7f2e189a5640 1 -- 172.21.15.170:0/1207563236 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580141166b0 con 0x558014284df0 2024-09-12T17:28:02.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.243+0000 7f2e189a5640 1 --2- 172.21.15.170:0/1207563236 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558014284df0 0x558014285af0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c00a520 tx=0x7f2e0c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e22ce5565a7c28e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.243+0000 7f2e137fe640 1 -- 172.21.15.170:0/1207563236 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e0c055070 con 0x558014284df0 2024-09-12T17:28:02.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.243+0000 7f2e137fe640 1 -- 172.21.15.170:0/1207563236 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e0c0515b0 con 0x558014284df0 2024-09-12T17:28:02.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.243+0000 7f2e137fe640 1 -- 172.21.15.170:0/1207563236 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e0c0518d0 con 0x558014284df0 2024-09-12T17:28:02.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.244+0000 7f2e1aebb800 1 -- 172.21.15.170:0/1207563236 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558014284df0 msgr2=0x558014285af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.244+0000 7f2e1aebb800 1 --2- 172.21.15.170:0/1207563236 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558014284df0 0x558014285af0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c00a520 tx=0x7f2e0c045ba0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.244+0000 7f2e1aebb800 1 -- 172.21.15.170:0/1207563236 shutdown_connections 2024-09-12T17:28:02.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.244+0000 7f2e1aebb800 1 --2- 172.21.15.170:0/1207563236 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558014284df0 0x558014285af0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.244+0000 7f2e1aebb800 1 -- 172.21.15.170:0/1207563236 >> 172.21.15.170:0/1207563236 conn(0x5580142801c0 msgr2=0x558014282620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:02.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.244+0000 7f2e1aebb800 1 -- 172.21.15.170:0/1207563236 shutdown_connections 2024-09-12T17:28:02.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.244+0000 7f2e1aebb800 1 -- 172.21.15.170:0/1207563236 wait complete. 2024-09-12T17:28:02.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.258+0000 7f2e1aebb800 1 Processor -- start 2024-09-12T17:28:02.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.258+0000 7f2e1aebb800 1 -- start start 2024-09-12T17:28:02.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.258+0000 7f2e1aebb800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558014284df0 0x5580141f8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.258+0000 7f2e1aebb800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55801411edd0 con 0x558014284df0 2024-09-12T17:28:02.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.258+0000 7f2e189a5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558014284df0 0x5580141f8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.258+0000 7f2e189a5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558014284df0 0x5580141f8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57626/0 (socket says 172.21.15.170:57626) 2024-09-12T17:28:02.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.258+0000 7f2e189a5640 1 -- 172.21.15.170:0/3167592104 learned_addr learned my addr 172.21.15.170:0/3167592104 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:02.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.259+0000 7f2e189a5640 1 -- 172.21.15.170:0/3167592104 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558014137e10 con 0x558014284df0 2024-09-12T17:28:02.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.259+0000 7f2e189a5640 1 --2- 172.21.15.170:0/3167592104 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558014284df0 0x5580141f8d10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0460d0 tx=0x7f2e0c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9be4954b887b35c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.259+0000 7f2d06e05640 1 -- 172.21.15.170:0/3167592104 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e0c0519d0 con 0x558014284df0 2024-09-12T17:28:02.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.259+0000 7f2d06e05640 1 -- 172.21.15.170:0/3167592104 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e0c051b70 con 0x558014284df0 2024-09-12T17:28:02.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.259+0000 7f2d06e05640 1 -- 172.21.15.170:0/3167592104 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e0c051e50 con 0x558014284df0 2024-09-12T17:28:02.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.260+0000 7f2e1aebb800 1 -- 172.21.15.170:0/3167592104 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558014284df0 msgr2=0x5580141f8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.260+0000 7f2e1aebb800 1 --2- 172.21.15.170:0/3167592104 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558014284df0 0x5580141f8d10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0460d0 tx=0x7f2e0c051000 comp rx=0 tx=0).stop 2024-09-12T17:28:02.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.260+0000 7f2e1aebb800 1 -- 172.21.15.170:0/3167592104 shutdown_connections 2024-09-12T17:28:02.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.260+0000 7f2e1aebb800 1 --2- 172.21.15.170:0/3167592104 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558014284df0 0x5580141f8d10 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.260+0000 7f2e1aebb800 1 -- 172.21.15.170:0/3167592104 >> 172.21.15.170:0/3167592104 conn(0x5580142801c0 msgr2=0x55801436fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:02.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.260+0000 7f2e1aebb800 1 -- 172.21.15.170:0/3167592104 shutdown_connections 2024-09-12T17:28:02.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.260+0000 7f2e1aebb800 1 -- 172.21.15.170:0/3167592104 wait complete. 2024-09-12T17:28:02.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.260+0000 7f2e1aebb800 1 Processor -- start 2024-09-12T17:28:02.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.260+0000 7f2e1aebb800 1 -- start start 2024-09-12T17:28:02.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.260+0000 7f2e1aebb800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558014284df0 0x55801437f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.260+0000 7f2e1aebb800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558014286720 con 0x558014284df0 2024-09-12T17:28:02.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.261+0000 7f2e189a5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558014284df0 0x55801437f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.261+0000 7f2e189a5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558014284df0 0x55801437f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57642/0 (socket says 172.21.15.170:57642) 2024-09-12T17:28:02.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.261+0000 7f2e189a5640 1 -- 172.21.15.170:0/2749897108 learned_addr learned my addr 172.21.15.170:0/2749897108 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:02.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.261+0000 7f2e189a5640 1 -- 172.21.15.170:0/2749897108 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55801437f610 con 0x558014284df0 2024-09-12T17:28:02.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.261+0000 7f2e189a5640 1 --2- 172.21.15.170:0/2749897108 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558014284df0 0x55801437f0b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0460d0 tx=0x7f2e0c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.261+0000 7f2d05602640 1 -- 172.21.15.170:0/2749897108 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e0c073020 con 0x558014284df0 2024-09-12T17:28:02.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.261+0000 7f2d05602640 1 -- 172.21.15.170:0/2749897108 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e0c06f580 con 0x558014284df0 2024-09-12T17:28:02.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.261+0000 7f2e1aebb800 1 -- 172.21.15.170:0/2749897108 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55801437f8a0 con 0x558014284df0 2024-09-12T17:28:02.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.261+0000 7f2d05602640 1 -- 172.21.15.170:0/2749897108 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e0c06f8a0 con 0x558014284df0 2024-09-12T17:28:02.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.261+0000 7f2e1aebb800 1 -- 172.21.15.170:0/2749897108 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558014380460 con 0x558014284df0 2024-09-12T17:28:02.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.262+0000 7f2d05602640 1 -- 172.21.15.170:0/2749897108 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2e0c076020 con 0x558014284df0 2024-09-12T17:28:02.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.262+0000 7f2d05602640 1 --2- 172.21.15.170:0/2749897108 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2d0003c730 0x7f2d0003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.262+0000 7f2d05602640 1 -- 172.21.15.170:0/2749897108 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f2e0c06b040 con 0x558014284df0 2024-09-12T17:28:02.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.262+0000 7f2e13fff640 1 --2- 172.21.15.170:0/2749897108 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2d0003c730 0x7f2d0003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.262+0000 7f2e1aebb800 1 --2- 172.21.15.170:0/2749897108 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x558014286030 0x5580143866b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.262+0000 7f2e1aebb800 1 -- 172.21.15.170:0/2749897108 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558014386bf0 con 0x558014286030 2024-09-12T17:28:02.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.263+0000 7f2e191a6640 1 --2- 172.21.15.170:0/2749897108 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x558014286030 0x5580143866b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.263+0000 7f2e13fff640 1 --2- 172.21.15.170:0/2749897108 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2d0003c730 0x7f2d0003ebf0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2e04001e30 tx=0x7f2e04001390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.263+0000 7f2e191a6640 1 --2- 172.21.15.170:0/2749897108 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x558014286030 0x5580143866b0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.263+0000 7f2e191a6640 1 -- 172.21.15.170:0/2749897108 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e1400a4d0 con 0x558014286030 2024-09-12T17:28:02.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.263+0000 7f2e1aebb800 1 -- 172.21.15.170:0/2749897108 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558014386f90 con 0x558014286030 2024-09-12T17:28:02.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.263+0000 7f2e191a6640 1 -- 172.21.15.170:0/2749897108 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2e1400a4d0 con 0x558014286030 2024-09-12T17:28:02.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.263+0000 7f2e1aebb800 1 --2- 172.21.15.170:0/2749897108 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x558014388a90 0x55801438af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.263+0000 7f2e1aebb800 1 -- 172.21.15.170:0/2749897108 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55801438b6c0 con 0x558014388a90 2024-09-12T17:28:02.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.263+0000 7f2e189a5640 1 --2- 172.21.15.170:0/2749897108 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x558014388a90 0x55801438af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.264+0000 7f2e189a5640 1 --2- 172.21.15.170:0/2749897108 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x558014388a90 0x55801438af30 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.264+0000 7f2e189a5640 1 -- 172.21.15.170:0/2749897108 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2e0c057030 con 0x558014388a90 2024-09-12T17:28:02.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.264+0000 7f2e1aebb800 1 -- 172.21.15.170:0/2749897108 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580143877e0 con 0x558014286030 2024-09-12T17:28:02.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.264+0000 7f2e191a6640 1 -- 172.21.15.170:0/2749897108 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2e1400a4d0 con 0x558014286030 2024-09-12T17:28:02.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.264+0000 7f2e1aebb800 1 -- 172.21.15.170:0/2749897108 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558014387c00 con 0x558014388a90 2024-09-12T17:28:02.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.265+0000 7f2e189a5640 1 -- 172.21.15.170:0/2749897108 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2e0c057030 con 0x558014388a90 2024-09-12T17:28:02.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.265+0000 7f2e1aebb800 1 Processor -- start 2024-09-12T17:28:02.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.265+0000 7f2e1aebb800 1 -- start start 2024-09-12T17:28:02.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.265+0000 7f2e1aebb800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558014399f50 0x55801439a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.265+0000 7f2e1aebb800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55801417ca00 con 0x558014399f50 2024-09-12T17:28:02.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.265+0000 7f2e191a6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558014399f50 0x55801439a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.265+0000 7f2e191a6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558014399f50 0x55801439a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57658/0 (socket says 172.21.15.170:57658) 2024-09-12T17:28:02.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.265+0000 7f2e191a6640 1 -- 172.21.15.170:0/2060403738 learned_addr learned my addr 172.21.15.170:0/2060403738 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:02.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.266+0000 7f2e191a6640 1 -- 172.21.15.170:0/2060403738 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55801439a9b0 con 0x558014399f50 2024-09-12T17:28:02.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.266+0000 7f2e191a6640 1 --2- 172.21.15.170:0/2060403738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558014399f50 0x55801439a370 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x558014380060 tx=0x7f2e140167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.266+0000 7f2cfe7fc640 1 -- 172.21.15.170:0/2060403738 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e14013640 con 0x558014399f50 2024-09-12T17:28:02.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.266+0000 7f2cfe7fc640 1 -- 172.21.15.170:0/2060403738 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e140137e0 con 0x558014399f50 2024-09-12T17:28:02.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.266+0000 7f2e1aebb800 1 -- 172.21.15.170:0/2060403738 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55801439b1e0 con 0x558014399f50 2024-09-12T17:28:02.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.266+0000 7f2cfe7fc640 1 -- 172.21.15.170:0/2060403738 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e14013ae0 con 0x558014399f50 2024-09-12T17:28:02.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.266+0000 7f2e1aebb800 1 -- 172.21.15.170:0/2060403738 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55801439b780 con 0x558014399f50 2024-09-12T17:28:02.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.267+0000 7f2cfe7fc640 1 -- 172.21.15.170:0/2060403738 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2e14011040 con 0x558014399f50 2024-09-12T17:28:02.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.267+0000 7f2cfe7fc640 1 --2- 172.21.15.170:0/2060403738 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2cf003c780 0x7f2cf003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.267+0000 7f2cfe7fc640 1 -- 172.21.15.170:0/2060403738 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f2e1400e040 con 0x558014399f50 2024-09-12T17:28:02.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.267+0000 7f2e189a5640 1 --2- 172.21.15.170:0/2060403738 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2cf003c780 0x7f2cf003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.267+0000 7f2e1aebb800 1 Processor -- start 2024-09-12T17:28:02.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.268+0000 7f2e189a5640 1 --2- 172.21.15.170:0/2060403738 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2cf003c780 0x7f2cf003ec40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c005570 tx=0x7f2e0c050600 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.268+0000 7f2e1aebb800 1 -- start start 2024-09-12T17:28:02.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.268+0000 7f2e1aebb800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580143a6a10 0x5580143a6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.268+0000 7f2e1aebb800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5580141f9390 con 0x5580143a6a10 2024-09-12T17:28:02.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.268+0000 7f2e191a6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580143a6a10 0x5580143a6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.268+0000 7f2e191a6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580143a6a10 0x5580143a6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57668/0 (socket says 172.21.15.170:57668) 2024-09-12T17:28:02.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.268+0000 7f2e191a6640 1 -- 172.21.15.170:0/980236844 learned_addr learned my addr 172.21.15.170:0/980236844 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:02.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.268+0000 7f2e191a6640 1 -- 172.21.15.170:0/980236844 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580143a7400 con 0x5580143a6a10 2024-09-12T17:28:02.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.268+0000 7f2e191a6640 1 --2- 172.21.15.170:0/980236844 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580143a6a10 0x5580143a6e10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2e1402afd0 tx=0x7f2e1401fb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e193855f31e7e3fb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.268+0000 7f2ceffff640 1 -- 172.21.15.170:0/980236844 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e14021960 con 0x5580143a6a10 2024-09-12T17:28:02.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.269+0000 7f2ceffff640 1 -- 172.21.15.170:0/980236844 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e14013c80 con 0x5580143a6a10 2024-09-12T17:28:02.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.269+0000 7f2ceffff640 1 -- 172.21.15.170:0/980236844 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e14021b00 con 0x5580143a6a10 2024-09-12T17:28:02.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.269+0000 7f2e1aebb800 1 -- 172.21.15.170:0/980236844 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580143a6a10 msgr2=0x5580143a6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.269+0000 7f2e1aebb800 1 --2- 172.21.15.170:0/980236844 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580143a6a10 0x5580143a6e10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2e1402afd0 tx=0x7f2e1401fb90 comp rx=0 tx=0).stop 2024-09-12T17:28:02.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.269+0000 7f2e1aebb800 1 -- 172.21.15.170:0/980236844 shutdown_connections 2024-09-12T17:28:02.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.269+0000 7f2e1aebb800 1 --2- 172.21.15.170:0/980236844 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580143a6a10 0x5580143a6e10 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.269+0000 7f2e1aebb800 1 -- 172.21.15.170:0/980236844 >> 172.21.15.170:0/980236844 conn(0x5580143a2e30 msgr2=0x5580143a1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:02.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.269+0000 7f2e1aebb800 1 -- 172.21.15.170:0/980236844 shutdown_connections 2024-09-12T17:28:02.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.269+0000 7f2e1aebb800 1 -- 172.21.15.170:0/980236844 wait complete. 2024-09-12T17:28:02.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.269+0000 7f2e1aebb800 1 Processor -- start 2024-09-12T17:28:02.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.269+0000 7f2e1aebb800 1 -- start start 2024-09-12T17:28:02.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.269+0000 7f2e1aebb800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580143a6a10 0x5580143adfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.269+0000 7f2e1aebb800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5580143a79f0 con 0x5580143a6a10 2024-09-12T17:28:02.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.270+0000 7f2e191a6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580143a6a10 0x5580143adfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.270+0000 7f2e191a6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580143a6a10 0x5580143adfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57678/0 (socket says 172.21.15.170:57678) 2024-09-12T17:28:02.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.270+0000 7f2e191a6640 1 -- 172.21.15.170:0/104851466 learned_addr learned my addr 172.21.15.170:0/104851466 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:02.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.270+0000 7f2e191a6640 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580143ae540 con 0x5580143a6a10 2024-09-12T17:28:02.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.270+0000 7f2e191a6640 1 --2- 172.21.15.170:0/104851466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580143a6a10 0x5580143adfe0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2e1401fbd0 tx=0x7f2e14053c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.270+0000 7f2cee7fc640 1 -- 172.21.15.170:0/104851466 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e140143c0 con 0x5580143a6a10 2024-09-12T17:28:02.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.270+0000 7f2cee7fc640 1 -- 172.21.15.170:0/104851466 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e14020800 con 0x5580143a6a10 2024-09-12T17:28:02.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.270+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5580143ae7d0 con 0x5580143a6a10 2024-09-12T17:28:02.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.270+0000 7f2cee7fc640 1 -- 172.21.15.170:0/104851466 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e14020b00 con 0x5580143a6a10 2024-09-12T17:28:02.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.270+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580143af150 con 0x5580143a6a10 2024-09-12T17:28:02.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.271+0000 7f2cee7fc640 1 -- 172.21.15.170:0/104851466 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2e1403b060 con 0x5580143a6a10 2024-09-12T17:28:02.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.271+0000 7f2cee7fc640 1 --2- 172.21.15.170:0/104851466 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2ce403c780 0x7f2ce403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.271+0000 7f2cee7fc640 1 -- 172.21.15.170:0/104851466 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f2e14035aa0 con 0x5580143a6a10 2024-09-12T17:28:02.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.271+0000 7f2e189a5640 1 --2- 172.21.15.170:0/104851466 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2ce403c780 0x7f2ce403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.272+0000 7f2e1aebb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.272+0000 7f2e1aebb800 1 --2- 172.21.15.170:0/104851466 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5580143b9970 0x5580143bbe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.272+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580143bc580 con 0x5580143b9970 2024-09-12T17:28:02.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.272+0000 7f2e13fff640 1 --2- 172.21.15.170:0/104851466 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5580143b9970 0x5580143bbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.272+0000 7f2e189a5640 1 --2- 172.21.15.170:0/104851466 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2ce403c780 0x7f2ce403ec40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c065fd0 tx=0x7f2e0c086000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.272+0000 7f2e13fff640 1 --2- 172.21.15.170:0/104851466 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5580143b9970 0x5580143bbe30 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.272+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e0400f610 con 0x5580143b9970 2024-09-12T17:28:02.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.272+0000 7f2e1aebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:02.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.272+0000 7f2e1aebb800 20 realm 2024-09-12T17:28:02.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.272+0000 7f2e1aebb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.272+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580143b8cc0 con 0x5580143b9970 2024-09-12T17:28:02.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.272+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e0400f610 con 0x5580143b9970 2024-09-12T17:28:02.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.272+0000 7f2e1aebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:02.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.272+0000 7f2e1aebb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:02.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.273+0000 7f2e1aebb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.273+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580143bd060 con 0x5580143b9970 2024-09-12T17:28:02.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.273+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e0400f610 con 0x5580143b9970 2024-09-12T17:28:02.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.273+0000 7f2e1aebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:02.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.273+0000 7f2e1aebb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.273+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580143bd930 con 0x5580143b9970 2024-09-12T17:28:02.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.273+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2e0400f610 con 0x5580143b9970 2024-09-12T17:28:02.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.273+0000 7f2e1aebb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:02.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.273+0000 7f2e1aebb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.273+0000 7f2e1aebb800 1 --2- 172.21.15.170:0/104851466 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5580143be270 0x5580143c0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.273+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580143c0da0 con 0x5580143be270 2024-09-12T17:28:02.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.273+0000 7f2e191a6640 1 --2- 172.21.15.170:0/104851466 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5580143be270 0x5580143c0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.273+0000 7f2e191a6640 1 --2- 172.21.15.170:0/104851466 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5580143be270 0x5580143c0660 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.274+0000 7f2e191a6640 1 -- 172.21.15.170:0/104851466 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2e1400a4d0 con 0x5580143be270 2024-09-12T17:28:02.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.274+0000 7f2e1aebb800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:02.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.274+0000 7f2e1aebb800 20 searching for the correct realm 2024-09-12T17:28:02.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.274+0000 7f2e1aebb800 1 --2- 172.21.15.170:0/104851466 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5580143c2e20 0x5580143c52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.274+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580143c59b0 con 0x5580143c2e20 2024-09-12T17:28:02.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.274+0000 7f2e189a5640 1 --2- 172.21.15.170:0/104851466 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5580143c2e20 0x5580143c52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.274+0000 7f2e189a5640 1 --2- 172.21.15.170:0/104851466 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5580143c2e20 0x5580143c52e0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.274+0000 7f2e189a5640 1 -- 172.21.15.170:0/104851466 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e0c057030 con 0x5580143c2e20 2024-09-12T17:28:02.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.274+0000 7f2e189a5640 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580143c59b0 con 0x5580143be270 2024-09-12T17:28:02.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.275+0000 7f2e191a6640 1 -- 172.21.15.170:0/104851466 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1400a4d0 con 0x5580143be270 2024-09-12T17:28:02.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.275+0000 7f2e191a6640 1 --2- 172.21.15.170:0/104851466 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f2e1403d070 0x7f2e1404ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.275+0000 7f2e191a6640 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580143c59b0 con 0x7f2e1403d070 2024-09-12T17:28:02.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.275+0000 7f2e13fff640 1 --2- 172.21.15.170:0/104851466 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f2e1403d070 0x7f2e1404ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.275+0000 7f2e13fff640 1 --2- 172.21.15.170:0/104851466 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f2e1403d070 0x7f2e1404ea30 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.275+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e0400f610 con 0x7f2e1403d070 2024-09-12T17:28:02.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.275+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580143c59b0 con 0x5580143b9970 2024-09-12T17:28:02.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.276+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e0400f610 con 0x5580143b9970 2024-09-12T17:28:02.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.276+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580143c59b0 con 0x5580143b9970 2024-09-12T17:28:02.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.276+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e0402b040 con 0x5580143b9970 2024-09-12T17:28:02.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.276+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580143c59b0 con 0x7f2e1403d070 2024-09-12T17:28:02.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.276+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e0402b040 con 0x7f2e1403d070 2024-09-12T17:28:02.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.276+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580143c59b0 con 0x7f2e1403d070 2024-09-12T17:28:02.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.276+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e0402b040 con 0x7f2e1403d070 2024-09-12T17:28:02.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.276+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580143c59b0 con 0x5580143be270 2024-09-12T17:28:02.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.277+0000 7f2e191a6640 1 -- 172.21.15.170:0/104851466 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1400a4d0 con 0x5580143be270 2024-09-12T17:28:02.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.277+0000 7f2e191a6640 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580143c59b0 con 0x5580143c2e20 2024-09-12T17:28:02.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.277+0000 7f2e189a5640 1 -- 172.21.15.170:0/104851466 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e0c057030 con 0x5580143c2e20 2024-09-12T17:28:02.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.277+0000 7f2e189a5640 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580143c59b0 con 0x5580143b9970 2024-09-12T17:28:02.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.277+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e0402b040 con 0x5580143b9970 2024-09-12T17:28:02.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.277+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580143c59b0 con 0x7f2e1403d070 2024-09-12T17:28:02.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.277+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e0402b040 con 0x7f2e1403d070 2024-09-12T17:28:02.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.277+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580143c59b0 con 0x5580143b9970 2024-09-12T17:28:02.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.278+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e0402b040 con 0x5580143b9970 2024-09-12T17:28:02.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.278+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580143c59b0 con 0x5580143be270 2024-09-12T17:28:02.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.278+0000 7f2e191a6640 1 -- 172.21.15.170:0/104851466 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f2e1400a4d0 con 0x5580143be270 2024-09-12T17:28:02.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.278+0000 7f2e191a6640 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580143c59b0 con 0x5580143c2e20 2024-09-12T17:28:02.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.278+0000 7f2e189a5640 1 -- 172.21.15.170:0/104851466 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e0c057030 con 0x5580143c2e20 2024-09-12T17:28:02.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.278+0000 7f2e189a5640 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580143c59b0 con 0x5580143c2e20 2024-09-12T17:28:02.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.278+0000 7f2e189a5640 1 -- 172.21.15.170:0/104851466 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e0c057030 con 0x5580143c2e20 2024-09-12T17:28:02.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.278+0000 7f2e189a5640 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580143c59b0 con 0x7f2e1403d070 2024-09-12T17:28:02.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.279+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e0402b040 con 0x7f2e1403d070 2024-09-12T17:28:02.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.279+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580143c59b0 con 0x5580143c2e20 2024-09-12T17:28:02.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.279+0000 7f2e189a5640 1 -- 172.21.15.170:0/104851466 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e0c057030 con 0x5580143c2e20 2024-09-12T17:28:02.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.279+0000 7f2e189a5640 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580143c59b0 con 0x5580143c2e20 2024-09-12T17:28:02.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.279+0000 7f2e189a5640 1 -- 172.21.15.170:0/104851466 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e0c057030 con 0x5580143c2e20 2024-09-12T17:28:02.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.279+0000 7f2e189a5640 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580143c59b0 con 0x5580143b9970 2024-09-12T17:28:02.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.279+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e0402b040 con 0x5580143b9970 2024-09-12T17:28:02.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.279+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580143c59b0 con 0x5580143b9970 2024-09-12T17:28:02.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.279+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2e0402b040 con 0x5580143b9970 2024-09-12T17:28:02.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.279+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580143c59b0 con 0x7f2e1403d070 2024-09-12T17:28:02.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.280+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e0402b040 con 0x7f2e1403d070 2024-09-12T17:28:02.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.280+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580143c59b0 con 0x5580143c2e20 2024-09-12T17:28:02.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.280+0000 7f2e189a5640 1 -- 172.21.15.170:0/104851466 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e0c057030 con 0x5580143c2e20 2024-09-12T17:28:02.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.280+0000 7f2e189a5640 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580143c59b0 con 0x5580143be270 2024-09-12T17:28:02.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.280+0000 7f2e191a6640 1 -- 172.21.15.170:0/104851466 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1400a4d0 con 0x5580143be270 2024-09-12T17:28:02.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.280+0000 7f2e191a6640 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580143c59b0 con 0x5580143b9970 2024-09-12T17:28:02.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.280+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e0402b040 con 0x5580143b9970 2024-09-12T17:28:02.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.280+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580143c59b0 con 0x7f2e1403d070 2024-09-12T17:28:02.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.281+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e0403b040 con 0x7f2e1403d070 2024-09-12T17:28:02.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.281+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580143c59b0 con 0x5580143c2e20 2024-09-12T17:28:02.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.281+0000 7f2e189a5640 1 -- 172.21.15.170:0/104851466 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e0c057030 con 0x5580143c2e20 2024-09-12T17:28:02.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.281+0000 7f2e189a5640 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580143c59b0 con 0x7f2e1403d070 2024-09-12T17:28:02.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.281+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e0403b040 con 0x7f2e1403d070 2024-09-12T17:28:02.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.281+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580143c59b0 con 0x5580143be270 2024-09-12T17:28:02.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.281+0000 7f2e191a6640 1 -- 172.21.15.170:0/104851466 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1400a4d0 con 0x5580143be270 2024-09-12T17:28:02.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.281+0000 7f2e191a6640 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580143c59b0 con 0x5580143c2e20 2024-09-12T17:28:02.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.282+0000 7f2e189a5640 1 -- 172.21.15.170:0/104851466 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e0c057030 con 0x5580143c2e20 2024-09-12T17:28:02.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.282+0000 7f2e189a5640 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580143c59b0 con 0x7f2e1403d070 2024-09-12T17:28:02.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.282+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e0403b040 con 0x7f2e1403d070 2024-09-12T17:28:02.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.282+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580143c59b0 con 0x5580143b9970 2024-09-12T17:28:02.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.282+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2e0403b040 con 0x5580143b9970 2024-09-12T17:28:02.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.282+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5580143c59b0 con 0x5580143be270 2024-09-12T17:28:02.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.282+0000 7f2e191a6640 1 -- 172.21.15.170:0/104851466 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2e14067040 con 0x5580143be270 2024-09-12T17:28:02.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.282+0000 7f2e1aebb800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:02.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.282+0000 7f2e1aebb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:02.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.282+0000 7f2e1aebb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:02.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.282+0000 7f2e1aebb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:02.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.282+0000 7f2e1aebb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:02.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.282+0000 7f2e1aebb800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:02.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.282+0000 7f2e1aebb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.282+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580143c1820 con 0x5580143b9970 2024-09-12T17:28:02.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.283+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e0403b040 con 0x5580143b9970 2024-09-12T17:28:02.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.283+0000 7f2e1aebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:02.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.283+0000 7f2e1aebb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.283+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580143c1430 con 0x5580143b9970 2024-09-12T17:28:02.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.283+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2e0403b040 con 0x5580143b9970 2024-09-12T17:28:02.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.283+0000 7f2e1aebb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:02.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.283+0000 7f2e1aebb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.283+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580143c2190 con 0x5580143be270 2024-09-12T17:28:02.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.283+0000 7f2e191a6640 1 -- 172.21.15.170:0/104851466 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2e14067040 con 0x5580143be270 2024-09-12T17:28:02.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.283+0000 7f2e1aebb800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:02.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.283+0000 7f2e1aebb800 20 zone default found 2024-09-12T17:28:02.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.283+0000 7f2e1aebb800 4 Realm: () 2024-09-12T17:28:02.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.283+0000 7f2e1aebb800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:02.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.283+0000 7f2e1aebb800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:02.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.283+0000 7f2e1aebb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:02.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.283+0000 7f2e1aebb800 20 zonegroup default 2024-09-12T17:28:02.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.283+0000 7f2e1aebb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.283+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580143c1d00 con 0x7f2e1403d070 2024-09-12T17:28:02.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.283+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2e0403b040 con 0x7f2e1403d070 2024-09-12T17:28:02.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.283+0000 7f2e1aebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:02.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.283+0000 7f2e1aebb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.283+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580143c7d80 con 0x5580143c2e20 2024-09-12T17:28:02.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.284+0000 7f2e189a5640 1 -- 172.21.15.170:0/104851466 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2e0c057030 con 0x5580143c2e20 2024-09-12T17:28:02.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.284+0000 7f2e1aebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:02.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.284+0000 7f2e1aebb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.284+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580143c8260 con 0x5580143c2e20 2024-09-12T17:28:02.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.284+0000 7f2e189a5640 1 -- 172.21.15.170:0/104851466 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2e0c057030 con 0x5580143c2e20 2024-09-12T17:28:02.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.284+0000 7f2e1aebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:02.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.284+0000 7f2e1aebb800 20 started sync module instance, tier type = 2024-09-12T17:28:02.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.284+0000 7f2e1aebb800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:02.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.284+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580143c71f0 con 0x5580143be270 2024-09-12T17:28:02.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.285+0000 7f2e191a6640 1 -- 172.21.15.170:0/104851466 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e14067040 con 0x5580143be270 2024-09-12T17:28:02.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.285+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94008583681824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580143c71f0 con 0x5580143be270 2024-09-12T17:28:02.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.285+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580143c8d40 con 0x5580143b9970 2024-09-12T17:28:02.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.286+0000 7f2e191a6640 1 -- 172.21.15.170:0/104851466 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94008583681824] v29'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e14067040 con 0x5580143be270 2024-09-12T17:28:02.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.286+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e0403b040 con 0x5580143b9970 2024-09-12T17:28:02.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.287+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94008583686192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580143c71f0 con 0x5580143b9970 2024-09-12T17:28:02.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.287+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580143c97c0 con 0x5580143c2e20 2024-09-12T17:28:02.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.287+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94008583686192] v29'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e0403b040 con 0x5580143b9970 2024-09-12T17:28:02.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.288+0000 7f2e189a5640 1 -- 172.21.15.170:0/104851466 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e0c057030 con 0x5580143c2e20 2024-09-12T17:28:02.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.288+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94008583679296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580143c7160 con 0x5580143c2e20 2024-09-12T17:28:02.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.288+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580143ca680 con 0x5580143be270 2024-09-12T17:28:02.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.289+0000 7f2e191a6640 1 -- 172.21.15.170:0/104851466 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e14067040 con 0x5580143be270 2024-09-12T17:28:02.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.289+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94008583693232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580143cade0 con 0x5580143be270 2024-09-12T17:28:02.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.289+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580143cb900 con 0x5580143b9970 2024-09-12T17:28:02.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.289+0000 7f2e189a5640 1 -- 172.21.15.170:0/104851466 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94008583679296] v29'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e0c057030 con 0x5580143c2e20 2024-09-12T17:28:02.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.290+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e0403b040 con 0x5580143b9970 2024-09-12T17:28:02.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.290+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94008583697360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580143cb8c0 con 0x5580143b9970 2024-09-12T17:28:02.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.290+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580143cc360 con 0x7f2e1403d070 2024-09-12T17:28:02.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.290+0000 7f2e191a6640 1 -- 172.21.15.170:0/104851466 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94008583693232] v29'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e14067040 con 0x5580143be270 2024-09-12T17:28:02.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.291+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e0403b040 con 0x7f2e1403d070 2024-09-12T17:28:02.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.291+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94008583697360] v29'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e0403b040 con 0x5580143b9970 2024-09-12T17:28:02.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.291+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94008583700112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580143cc360 con 0x7f2e1403d070 2024-09-12T17:28:02.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.291+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580143cc8c0 con 0x7f2e1403d070 2024-09-12T17:28:02.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.292+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94008583700112] v29'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e0403b040 con 0x7f2e1403d070 2024-09-12T17:28:02.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.292+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(56 notify.6 [create] v29'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e0403b040 con 0x7f2e1403d070 2024-09-12T17:28:02.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.292+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94008583691184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580143cc8c0 con 0x7f2e1403d070 2024-09-12T17:28:02.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.292+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580143cd280 con 0x7f2e1403d070 2024-09-12T17:28:02.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.293+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(58 notify.7 [create] v29'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e0403b040 con 0x7f2e1403d070 2024-09-12T17:28:02.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.293+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94008583704016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580143cd6a0 con 0x7f2e1403d070 2024-09-12T17:28:02.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.293+0000 7f2e1aebb800 20 add_watcher() i=0 2024-09-12T17:28:02.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.293+0000 7f2e1aebb800 20 add_watcher() i=1 2024-09-12T17:28:02.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.293+0000 7f2e1aebb800 20 add_watcher() i=2 2024-09-12T17:28:02.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.293+0000 7f2e1aebb800 20 add_watcher() i=3 2024-09-12T17:28:02.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.293+0000 7f2e1aebb800 20 add_watcher() i=4 2024-09-12T17:28:02.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.293+0000 7f2e1aebb800 20 add_watcher() i=5 2024-09-12T17:28:02.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.293+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94008583691184] v29'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e0403b040 con 0x7f2e1403d070 2024-09-12T17:28:02.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.293+0000 7f2e1aebb800 20 add_watcher() i=6 2024-09-12T17:28:02.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.294+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94008583704016] v29'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e0403b040 con 0x7f2e1403d070 2024-09-12T17:28:02.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.294+0000 7f2e1aebb800 20 add_watcher() i=7 2024-09-12T17:28:02.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.294+0000 7f2e1aebb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:02.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.294+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580143cd6a0 con 0x5580143b9970 2024-09-12T17:28:02.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.294+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2e0403b040 con 0x5580143b9970 2024-09-12T17:28:02.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.294+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94008583705072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580143cd610 con 0x5580143b9970 2024-09-12T17:28:02.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.295+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94008583705072] v29'92 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2e0403b040 con 0x5580143b9970 2024-09-12T17:28:02.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.295+0000 7f2ccf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:02.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.296+0000 7f2e1aebb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:02.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.296+0000 7f2e1aebb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:02.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.296+0000 7f2e1aebb800 5 note: GC not initialized 2024-09-12T17:28:02.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.296+0000 7f2cce7e4640 20 reqs_thread_entry: start 2024-09-12T17:28:02.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.296+0000 7f2e1aebb800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:02.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.296+0000 7f2e1aebb800 20 Filter name: none 2024-09-12T17:28:02.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.296+0000 7f2cc7fff640 20 reqs_thread_entry: start 2024-09-12T17:28:02.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.296+0000 7f2e1aebb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.296+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5580144032a0 con 0x5580143b9970 2024-09-12T17:28:02.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.296+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2e0403b040 con 0x5580143b9970 2024-09-12T17:28:02.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.296+0000 7f2e1aebb800 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:28:02.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.296+0000 7f2e1aebb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.296+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558014403b60 con 0x5580143b9970 2024-09-12T17:28:02.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.297+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2e0403b040 con 0x5580143b9970 2024-09-12T17:28:02.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.297+0000 7f2e1aebb800 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:28:02.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.297+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558014404b70 con 0x5580143be270 2024-09-12T17:28:02.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.297+0000 7f2e191a6640 1 -- 172.21.15.170:0/104851466 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f2e14067040 con 0x5580143be270 2024-09-12T17:28:02.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.298+0000 7f2ccf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:02.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.298+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94008583705072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580144011a0 con 0x5580143b9970 2024-09-12T17:28:02.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.299+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94008583705072] v29'93 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2e0403b040 con 0x5580143b9970 2024-09-12T17:28:02.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.299+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94008583681824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580144011a0 con 0x5580143be270 2024-09-12T17:28:02.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.300+0000 7f2e191a6640 1 -- 172.21.15.170:0/104851466 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94008583681824] v29'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e14067040 con 0x5580143be270 2024-09-12T17:28:02.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.300+0000 7f2e1aebb800 20 remove_watcher() i=0 2024-09-12T17:28:02.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.300+0000 7f2e1aebb800 2 removed watcher, disabling cache 2024-09-12T17:28:02.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.300+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94008583686192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580144011a0 con 0x5580143b9970 2024-09-12T17:28:02.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.301+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94008583686192] v29'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e0403b040 con 0x5580143b9970 2024-09-12T17:28:02.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.301+0000 7f2e1aebb800 20 remove_watcher() i=1 2024-09-12T17:28:02.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.301+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94008583679296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580144011a0 con 0x5580143c2e20 2024-09-12T17:28:02.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.302+0000 7f2e189a5640 1 -- 172.21.15.170:0/104851466 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94008583679296] v29'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e0c057030 con 0x5580143c2e20 2024-09-12T17:28:02.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.302+0000 7f2e1aebb800 20 remove_watcher() i=2 2024-09-12T17:28:02.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.302+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94008583693232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580143c8830 con 0x5580143be270 2024-09-12T17:28:02.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.303+0000 7f2e191a6640 1 -- 172.21.15.170:0/104851466 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94008583693232] v29'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e14067040 con 0x5580143be270 2024-09-12T17:28:02.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.303+0000 7f2e1aebb800 20 remove_watcher() i=3 2024-09-12T17:28:02.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.303+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94008583697360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580143c6d40 con 0x5580143b9970 2024-09-12T17:28:02.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.304+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94008583697360] v29'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e0403b040 con 0x5580143b9970 2024-09-12T17:28:02.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.304+0000 7f2e1aebb800 20 remove_watcher() i=4 2024-09-12T17:28:02.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.304+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94008583700112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580143ca3b0 con 0x7f2e1403d070 2024-09-12T17:28:02.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.305+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94008583700112] v29'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e0403b040 con 0x7f2e1403d070 2024-09-12T17:28:02.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.305+0000 7f2e1aebb800 20 remove_watcher() i=5 2024-09-12T17:28:02.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.305+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94008583691184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580143c8830 con 0x7f2e1403d070 2024-09-12T17:28:02.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.306+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94008583691184] v29'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e0403b040 con 0x7f2e1403d070 2024-09-12T17:28:02.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.306+0000 7f2e1aebb800 20 remove_watcher() i=6 2024-09-12T17:28:02.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.306+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94008583704016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5580143cb3d0 con 0x7f2e1403d070 2024-09-12T17:28:02.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.307+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94008583704016] v29'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e0403b040 con 0x7f2e1403d070 2024-09-12T17:28:02.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.307+0000 7f2e1aebb800 20 remove_watcher() i=7 2024-09-12T17:28:02.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.307+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f2e1403d070 msgr2=0x7f2e1404ea30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.307+0000 7f2e1aebb800 1 --2- 172.21.15.170:0/104851466 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f2e1403d070 0x7f2e1404ea30 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.307+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5580143b9970 msgr2=0x5580143bbe30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.307+0000 7f2e1aebb800 1 --2- 172.21.15.170:0/104851466 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5580143b9970 0x5580143bbe30 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.307+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5580143be270 msgr2=0x5580143c0660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.307+0000 7f2e1aebb800 1 --2- 172.21.15.170:0/104851466 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5580143be270 0x5580143c0660 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.307+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5580143c2e20 msgr2=0x5580143c52e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.307+0000 7f2e1aebb800 1 --2- 172.21.15.170:0/104851466 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5580143c2e20 0x5580143c52e0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.307+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2ce403c780 msgr2=0x7f2ce403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.307+0000 7f2e1aebb800 1 --2- 172.21.15.170:0/104851466 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2ce403c780 0x7f2ce403ec40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c065fd0 tx=0x7f2e0c086000 comp rx=0 tx=0).stop 2024-09-12T17:28:02.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.307+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580143a6a10 msgr2=0x5580143adfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.307+0000 7f2e1aebb800 1 --2- 172.21.15.170:0/104851466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5580143a6a10 0x5580143adfe0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2e1401fbd0 tx=0x7f2e14053c60 comp rx=0 tx=0).stop 2024-09-12T17:28:02.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.307+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 reap_dead start 2024-09-12T17:28:02.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.307+0000 7f2e13fff640 1 -- 172.21.15.170:0/104851466 reap_dead start 2024-09-12T17:28:02.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.307+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 shutdown_connections 2024-09-12T17:28:02.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.307+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 >> 172.21.15.170:0/104851466 conn(0x5580143a2e30 msgr2=0x5580143a1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:02.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.307+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 shutdown_connections 2024-09-12T17:28:02.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.307+0000 7f2e1aebb800 1 -- 172.21.15.170:0/104851466 wait complete. 2024-09-12T17:28:02.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.308+0000 7f2e1aebb800 1 -- 172.21.15.170:0/2060403738 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2cf003c780 msgr2=0x7f2cf003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.308+0000 7f2e1aebb800 1 --2- 172.21.15.170:0/2060403738 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2cf003c780 0x7f2cf003ec40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c005570 tx=0x7f2e0c050600 comp rx=0 tx=0).stop 2024-09-12T17:28:02.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.308+0000 7f2e1aebb800 1 -- 172.21.15.170:0/2060403738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558014399f50 msgr2=0x55801439a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.308+0000 7f2e1aebb800 1 --2- 172.21.15.170:0/2060403738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558014399f50 0x55801439a370 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x558014380060 tx=0x7f2e140167b0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.308+0000 7f2e1aebb800 1 -- 172.21.15.170:0/2060403738 shutdown_connections 2024-09-12T17:28:02.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.308+0000 7f2e1aebb800 1 --2- 172.21.15.170:0/2060403738 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2cf003c780 0x7f2cf003ec40 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.308+0000 7f2e1aebb800 1 --2- 172.21.15.170:0/2060403738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558014399f50 0x55801439a370 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.308+0000 7f2e1aebb800 1 -- 172.21.15.170:0/2060403738 >> 172.21.15.170:0/2060403738 conn(0x55801438e300 msgr2=0x55801438e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:02.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.308+0000 7f2e1aebb800 1 -- 172.21.15.170:0/2060403738 shutdown_connections 2024-09-12T17:28:02.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.308+0000 7f2e1aebb800 1 -- 172.21.15.170:0/2060403738 wait complete. 2024-09-12T17:28:02.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.308+0000 7f2e1aebb800 1 -- 172.21.15.170:0/2749897108 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x558014286030 msgr2=0x5580143866b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.308+0000 7f2e1aebb800 1 --2- 172.21.15.170:0/2749897108 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x558014286030 0x5580143866b0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.308+0000 7f2e1aebb800 1 -- 172.21.15.170:0/2749897108 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x558014388a90 msgr2=0x55801438af30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.308+0000 7f2e1aebb800 1 --2- 172.21.15.170:0/2749897108 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x558014388a90 0x55801438af30 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.308+0000 7f2e1aebb800 1 -- 172.21.15.170:0/2749897108 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2d0003c730 msgr2=0x7f2d0003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.308+0000 7f2e1aebb800 1 --2- 172.21.15.170:0/2749897108 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2d0003c730 0x7f2d0003ebf0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2e04001e30 tx=0x7f2e04001390 comp rx=0 tx=0).stop 2024-09-12T17:28:02.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.308+0000 7f2e1aebb800 1 -- 172.21.15.170:0/2749897108 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558014284df0 msgr2=0x55801437f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.308+0000 7f2e1aebb800 1 --2- 172.21.15.170:0/2749897108 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558014284df0 0x55801437f0b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0460d0 tx=0x7f2e0c002fb0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.308+0000 7f2e1aebb800 1 -- 172.21.15.170:0/2749897108 shutdown_connections 2024-09-12T17:28:02.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.308+0000 7f2e1aebb800 1 --2- 172.21.15.170:0/2749897108 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x558014388a90 0x55801438af30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.308+0000 7f2e1aebb800 1 --2- 172.21.15.170:0/2749897108 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2d0003c730 0x7f2d0003ebf0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.308+0000 7f2e1aebb800 1 --2- 172.21.15.170:0/2749897108 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x558014286030 0x5580143866b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.308+0000 7f2e1aebb800 1 --2- 172.21.15.170:0/2749897108 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558014284df0 0x55801437f0b0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.308+0000 7f2e1aebb800 1 -- 172.21.15.170:0/2749897108 >> 172.21.15.170:0/2749897108 conn(0x5580142801c0 msgr2=0x55801436e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:02.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.308+0000 7f2e1aebb800 1 -- 172.21.15.170:0/2749897108 shutdown_connections 2024-09-12T17:28:02.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.308+0000 7f2e1aebb800 1 -- 172.21.15.170:0/2749897108 wait complete. 2024-09-12T17:28:02.323 INFO:teuthology.orchestra.run.smithi170.stdout:["myfoo"] 2024-09-12T17:28:02.324 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-12T17:28:02.331 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:28:02.331 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-12T17:28:02.331 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-12T17:28:02.331 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-12T17:28:02.374 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:02.374 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:02.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.372+0000 7fc885d46800 1 Processor -- start 2024-09-12T17:28:02.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.372+0000 7fc885d46800 1 -- start start 2024-09-12T17:28:02.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.373+0000 7fc885d46800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x564e44606490 0x564e44606890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.373+0000 7fc885d46800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564e444b1e40 con 0x564e44606dd0 2024-09-12T17:28:02.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.373+0000 7fc885d46800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x564e4447c680 con 0x564e44606490 2024-09-12T17:28:02.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.373+0000 7fc883837640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x564e44606490 0x564e44606890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.373+0000 7fc883837640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x564e44606490 0x564e44606890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57686/0 (socket says 172.21.15.170:57686) 2024-09-12T17:28:02.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.373+0000 7fc87bfff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x564e44606dd0 0x564e44607280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:48398/0 (socket says 172.21.15.170:48398) 2024-09-12T17:28:02.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.373+0000 7fc883837640 1 -- 172.21.15.170:0/2716798317 learned_addr learned my addr 172.21.15.170:0/2716798317 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:02.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.373+0000 7fc883837640 1 -- 172.21.15.170:0/2716798317 >> v1:172.21.15.47:6789/0 conn(0x564e44606dd0 legacy=0x564e44607280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.373+0000 7fc883837640 1 -- 172.21.15.170:0/2716798317 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e444986b0 con 0x564e44606490 2024-09-12T17:28:02.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.375+0000 7fc883837640 1 --2- 172.21.15.170:0/2716798317 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e44606490 0x564e44606890 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc87400a520 tx=0x7fc874045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e28fe91922067ec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.375+0000 7fc883036640 1 -- 172.21.15.170:0/2716798317 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc874055070 con 0x564e44606490 2024-09-12T17:28:02.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.375+0000 7fc883036640 1 -- 172.21.15.170:0/2716798317 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8740515b0 con 0x564e44606490 2024-09-12T17:28:02.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.375+0000 7fc883036640 1 -- 172.21.15.170:0/2716798317 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8740518d0 con 0x564e44606490 2024-09-12T17:28:02.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.376+0000 7fc885d46800 1 -- 172.21.15.170:0/2716798317 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e44606490 msgr2=0x564e44606890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.376+0000 7fc885d46800 1 --2- 172.21.15.170:0/2716798317 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e44606490 0x564e44606890 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc87400a520 tx=0x7fc874045ba0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.376+0000 7fc885d46800 1 -- 172.21.15.170:0/2716798317 shutdown_connections 2024-09-12T17:28:02.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.376+0000 7fc885d46800 1 --2- 172.21.15.170:0/2716798317 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e44606490 0x564e44606890 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.376+0000 7fc885d46800 1 -- 172.21.15.170:0/2716798317 >> 172.21.15.170:0/2716798317 conn(0x564e446021e0 msgr2=0x564e44604620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:02.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.376+0000 7fc885d46800 1 -- 172.21.15.170:0/2716798317 shutdown_connections 2024-09-12T17:28:02.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.376+0000 7fc885d46800 1 -- 172.21.15.170:0/2716798317 wait complete. 2024-09-12T17:28:02.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.390+0000 7fc885d46800 1 Processor -- start 2024-09-12T17:28:02.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.390+0000 7fc885d46800 1 -- start start 2024-09-12T17:28:02.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.390+0000 7fc885d46800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e44606490 0x564e446f9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.390+0000 7fc885d46800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564e444a0dd0 con 0x564e44606490 2024-09-12T17:28:02.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.390+0000 7fc883837640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e44606490 0x564e446f9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.390+0000 7fc883837640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e44606490 0x564e446f9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57690/0 (socket says 172.21.15.170:57690) 2024-09-12T17:28:02.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.390+0000 7fc883837640 1 -- 172.21.15.170:0/2067193991 learned_addr learned my addr 172.21.15.170:0/2067193991 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:02.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.390+0000 7fc883837640 1 -- 172.21.15.170:0/2067193991 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e444b9e10 con 0x564e44606490 2024-09-12T17:28:02.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.391+0000 7fc883837640 1 --2- 172.21.15.170:0/2067193991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e44606490 0x564e446f9800 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc8740460d0 tx=0x7fc874051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b705afded0babd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.391+0000 7fc771e0b640 1 -- 172.21.15.170:0/2067193991 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8740519d0 con 0x564e44606490 2024-09-12T17:28:02.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.391+0000 7fc771e0b640 1 -- 172.21.15.170:0/2067193991 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc874051b70 con 0x564e44606490 2024-09-12T17:28:02.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.391+0000 7fc771e0b640 1 -- 172.21.15.170:0/2067193991 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc874051e50 con 0x564e44606490 2024-09-12T17:28:02.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.391+0000 7fc885d46800 1 -- 172.21.15.170:0/2067193991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e44606490 msgr2=0x564e446f9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.391+0000 7fc885d46800 1 --2- 172.21.15.170:0/2067193991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e44606490 0x564e446f9800 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc8740460d0 tx=0x7fc874051000 comp rx=0 tx=0).stop 2024-09-12T17:28:02.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.391+0000 7fc885d46800 1 -- 172.21.15.170:0/2067193991 shutdown_connections 2024-09-12T17:28:02.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.392+0000 7fc885d46800 1 --2- 172.21.15.170:0/2067193991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e44606490 0x564e446f9800 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.392+0000 7fc885d46800 1 -- 172.21.15.170:0/2067193991 >> 172.21.15.170:0/2067193991 conn(0x564e446021e0 msgr2=0x564e446f5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:02.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.392+0000 7fc885d46800 1 -- 172.21.15.170:0/2067193991 shutdown_connections 2024-09-12T17:28:02.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.392+0000 7fc885d46800 1 -- 172.21.15.170:0/2067193991 wait complete. 2024-09-12T17:28:02.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.392+0000 7fc885d46800 1 Processor -- start 2024-09-12T17:28:02.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.392+0000 7fc885d46800 1 -- start start 2024-09-12T17:28:02.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.392+0000 7fc885d46800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e44606dd0 0x564e44701290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.392+0000 7fc885d46800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564e44607d50 con 0x564e44606dd0 2024-09-12T17:28:02.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.392+0000 7fc883837640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e44606dd0 0x564e44701290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.392+0000 7fc883837640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e44606dd0 0x564e44701290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57696/0 (socket says 172.21.15.170:57696) 2024-09-12T17:28:02.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.392+0000 7fc883837640 1 -- 172.21.15.170:0/2309746836 learned_addr learned my addr 172.21.15.170:0/2309746836 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:02.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.392+0000 7fc883837640 1 -- 172.21.15.170:0/2309746836 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e447017f0 con 0x564e44606dd0 2024-09-12T17:28:02.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.393+0000 7fc883837640 1 --2- 172.21.15.170:0/2309746836 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e44606dd0 0x564e44701290 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc8740460d0 tx=0x7fc874002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.393+0000 7fc76bfff640 1 -- 172.21.15.170:0/2309746836 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc874072020 con 0x564e44606dd0 2024-09-12T17:28:02.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.393+0000 7fc76bfff640 1 -- 172.21.15.170:0/2309746836 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc87405a450 con 0x564e44606dd0 2024-09-12T17:28:02.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.393+0000 7fc885d46800 1 -- 172.21.15.170:0/2309746836 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564e44701a80 con 0x564e44606dd0 2024-09-12T17:28:02.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.393+0000 7fc76bfff640 1 -- 172.21.15.170:0/2309746836 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc87405a770 con 0x564e44606dd0 2024-09-12T17:28:02.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.393+0000 7fc885d46800 1 -- 172.21.15.170:0/2309746836 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e44702690 con 0x564e44606dd0 2024-09-12T17:28:02.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.394+0000 7fc76bfff640 1 -- 172.21.15.170:0/2309746836 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc874075020 con 0x564e44606dd0 2024-09-12T17:28:02.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.394+0000 7fc76bfff640 1 --2- 172.21.15.170:0/2309746836 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc76c03c730 0x7fc76c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.394+0000 7fc76bfff640 1 -- 172.21.15.170:0/2309746836 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fc87406b040 con 0x564e44606dd0 2024-09-12T17:28:02.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.394+0000 7fc87bfff640 1 --2- 172.21.15.170:0/2309746836 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc76c03c730 0x7fc76c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.394+0000 7fc885d46800 1 --2- 172.21.15.170:0/2309746836 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564e447068d0 0x564e44708cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.394+0000 7fc885d46800 1 -- 172.21.15.170:0/2309746836 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564e44709200 con 0x564e447068d0 2024-09-12T17:28:02.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.394+0000 7fc884038640 1 --2- 172.21.15.170:0/2309746836 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564e447068d0 0x564e44708cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.394+0000 7fc87bfff640 1 --2- 172.21.15.170:0/2309746836 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc76c03c730 0x7fc76c03ebf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc86c001e30 tx=0x7fc86c001390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.394+0000 7fc884038640 1 --2- 172.21.15.170:0/2309746836 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564e447068d0 0x564e44708cc0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.395+0000 7fc884038640 1 -- 172.21.15.170:0/2309746836 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc87c00a4d0 con 0x564e447068d0 2024-09-12T17:28:02.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.395+0000 7fc885d46800 1 -- 172.21.15.170:0/2309746836 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564e447095a0 con 0x564e447068d0 2024-09-12T17:28:02.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.395+0000 7fc884038640 1 -- 172.21.15.170:0/2309746836 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc87c00a4d0 con 0x564e447068d0 2024-09-12T17:28:02.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.395+0000 7fc885d46800 1 --2- 172.21.15.170:0/2309746836 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564e4470b0a0 0x564e4470d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.395+0000 7fc885d46800 1 -- 172.21.15.170:0/2309746836 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564e4470dcd0 con 0x564e4470b0a0 2024-09-12T17:28:02.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.395+0000 7fc883837640 1 --2- 172.21.15.170:0/2309746836 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564e4470b0a0 0x564e4470d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.395+0000 7fc883837640 1 --2- 172.21.15.170:0/2309746836 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564e4470b0a0 0x564e4470d540 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.396+0000 7fc883837640 1 -- 172.21.15.170:0/2309746836 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc874057030 con 0x564e4470b0a0 2024-09-12T17:28:02.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.396+0000 7fc885d46800 1 -- 172.21.15.170:0/2309746836 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564e44709df0 con 0x564e447068d0 2024-09-12T17:28:02.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.396+0000 7fc884038640 1 -- 172.21.15.170:0/2309746836 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc87c00a4d0 con 0x564e447068d0 2024-09-12T17:28:02.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.396+0000 7fc885d46800 1 -- 172.21.15.170:0/2309746836 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564e4470a250 con 0x564e4470b0a0 2024-09-12T17:28:02.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.396+0000 7fc883837640 1 -- 172.21.15.170:0/2309746836 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc874057030 con 0x564e4470b0a0 2024-09-12T17:28:02.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.396+0000 7fc885d46800 1 Processor -- start 2024-09-12T17:28:02.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.397+0000 7fc885d46800 1 -- start start 2024-09-12T17:28:02.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.397+0000 7fc885d46800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e4471c5c0 0x564e4471c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.397+0000 7fc885d46800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564e444fea00 con 0x564e4471c5c0 2024-09-12T17:28:02.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.397+0000 7fc884038640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e4471c5c0 0x564e4471c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.397+0000 7fc884038640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e4471c5c0 0x564e4471c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57708/0 (socket says 172.21.15.170:57708) 2024-09-12T17:28:02.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.397+0000 7fc884038640 1 -- 172.21.15.170:0/2014173470 learned_addr learned my addr 172.21.15.170:0/2014173470 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:02.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.397+0000 7fc884038640 1 -- 172.21.15.170:0/2014173470 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e4471d020 con 0x564e4471c5c0 2024-09-12T17:28:02.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.398+0000 7fc884038640 1 --2- 172.21.15.170:0/2014173470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e4471c5c0 0x564e4471c9e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x564e44702290 tx=0x7fc87c0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.398+0000 7fc7697fa640 1 -- 172.21.15.170:0/2014173470 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc87c013640 con 0x564e4471c5c0 2024-09-12T17:28:02.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.398+0000 7fc7697fa640 1 -- 172.21.15.170:0/2014173470 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc87c0137e0 con 0x564e4471c5c0 2024-09-12T17:28:02.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.398+0000 7fc885d46800 1 -- 172.21.15.170:0/2014173470 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564e4471d850 con 0x564e4471c5c0 2024-09-12T17:28:02.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.398+0000 7fc7697fa640 1 -- 172.21.15.170:0/2014173470 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc87c013b00 con 0x564e4471c5c0 2024-09-12T17:28:02.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.398+0000 7fc885d46800 1 -- 172.21.15.170:0/2014173470 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e4471ddf0 con 0x564e4471c5c0 2024-09-12T17:28:02.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.399+0000 7fc7697fa640 1 -- 172.21.15.170:0/2014173470 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc87c011040 con 0x564e4471c5c0 2024-09-12T17:28:02.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.399+0000 7fc7697fa640 1 --2- 172.21.15.170:0/2014173470 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc75c03c730 0x7fc75c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.399+0000 7fc7697fa640 1 -- 172.21.15.170:0/2014173470 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fc87c00e040 con 0x564e4471c5c0 2024-09-12T17:28:02.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.399+0000 7fc883837640 1 --2- 172.21.15.170:0/2014173470 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc75c03c730 0x7fc75c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.399+0000 7fc885d46800 1 Processor -- start 2024-09-12T17:28:02.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.399+0000 7fc885d46800 1 -- start start 2024-09-12T17:28:02.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.399+0000 7fc883837640 1 --2- 172.21.15.170:0/2014173470 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc75c03c730 0x7fc75c03ebf0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x564e4470e070 tx=0x7fc874093370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.399+0000 7fc885d46800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e44729080 0x564e44729480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.399+0000 7fc885d46800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564e446f9f90 con 0x564e44729080 2024-09-12T17:28:02.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.399+0000 7fc884038640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e44729080 0x564e44729480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.400+0000 7fc884038640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e44729080 0x564e44729480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57720/0 (socket says 172.21.15.170:57720) 2024-09-12T17:28:02.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.400+0000 7fc884038640 1 -- 172.21.15.170:0/2528798541 learned_addr learned my addr 172.21.15.170:0/2528798541 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:02.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.400+0000 7fc884038640 1 -- 172.21.15.170:0/2528798541 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e44729a70 con 0x564e44729080 2024-09-12T17:28:02.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.400+0000 7fc884038640 1 --2- 172.21.15.170:0/2528798541 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e44729080 0x564e44729480 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc87c053ce0 tx=0x7fc87c01ff20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3fb93ece36e2161 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.400+0000 7fc762ffd640 1 -- 172.21.15.170:0/2528798541 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc87c02a910 con 0x564e44729080 2024-09-12T17:28:02.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.400+0000 7fc762ffd640 1 -- 172.21.15.170:0/2528798541 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc87c013ca0 con 0x564e44729080 2024-09-12T17:28:02.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.400+0000 7fc762ffd640 1 -- 172.21.15.170:0/2528798541 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc87c02aab0 con 0x564e44729080 2024-09-12T17:28:02.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.400+0000 7fc885d46800 1 -- 172.21.15.170:0/2528798541 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e44729080 msgr2=0x564e44729480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.400+0000 7fc885d46800 1 --2- 172.21.15.170:0/2528798541 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e44729080 0x564e44729480 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc87c053ce0 tx=0x7fc87c01ff20 comp rx=0 tx=0).stop 2024-09-12T17:28:02.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.400+0000 7fc885d46800 1 -- 172.21.15.170:0/2528798541 shutdown_connections 2024-09-12T17:28:02.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.400+0000 7fc885d46800 1 --2- 172.21.15.170:0/2528798541 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e44729080 0x564e44729480 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.401+0000 7fc885d46800 1 -- 172.21.15.170:0/2528798541 >> 172.21.15.170:0/2528798541 conn(0x564e44725480 msgr2=0x564e447236c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:02.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.401+0000 7fc885d46800 1 -- 172.21.15.170:0/2528798541 shutdown_connections 2024-09-12T17:28:02.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.401+0000 7fc885d46800 1 -- 172.21.15.170:0/2528798541 wait complete. 2024-09-12T17:28:02.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.401+0000 7fc885d46800 1 Processor -- start 2024-09-12T17:28:02.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.401+0000 7fc885d46800 1 -- start start 2024-09-12T17:28:02.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.401+0000 7fc885d46800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e44729080 0x564e44730680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.401+0000 7fc885d46800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564e4472a090 con 0x564e44729080 2024-09-12T17:28:02.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.401+0000 7fc884038640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e44729080 0x564e44730680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.401+0000 7fc884038640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e44729080 0x564e44730680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57724/0 (socket says 172.21.15.170:57724) 2024-09-12T17:28:02.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.401+0000 7fc884038640 1 -- 172.21.15.170:0/1999572454 learned_addr learned my addr 172.21.15.170:0/1999572454 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:02.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.402+0000 7fc884038640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e44730be0 con 0x564e44729080 2024-09-12T17:28:02.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.402+0000 7fc884038640 1 --2- 172.21.15.170:0/1999572454 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e44729080 0x564e44730680 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc87c00afe0 tx=0x7fc87c053d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.402+0000 7fc7617fa640 1 -- 172.21.15.170:0/1999572454 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc87c02aca0 con 0x564e44729080 2024-09-12T17:28:02.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.402+0000 7fc7617fa640 1 -- 172.21.15.170:0/1999572454 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc87c0203a0 con 0x564e44729080 2024-09-12T17:28:02.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.402+0000 7fc7617fa640 1 -- 172.21.15.170:0/1999572454 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc87c020680 con 0x564e44729080 2024-09-12T17:28:02.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.402+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564e44730e70 con 0x564e44729080 2024-09-12T17:28:02.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.402+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e447317f0 con 0x564e44729080 2024-09-12T17:28:02.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.403+0000 7fc7617fa640 1 -- 172.21.15.170:0/1999572454 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc87c020820 con 0x564e44729080 2024-09-12T17:28:02.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.403+0000 7fc7617fa640 1 --2- 172.21.15.170:0/1999572454 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc74c03c780 0x7fc74c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.403+0000 7fc7617fa640 1 -- 172.21.15.170:0/1999572454 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fc87c04a070 con 0x564e44729080 2024-09-12T17:28:02.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.403+0000 7fc883837640 1 --2- 172.21.15.170:0/1999572454 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc74c03c780 0x7fc74c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.403+0000 7fc883837640 1 --2- 172.21.15.170:0/1999572454 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc74c03c780 0x7fc74c03ec40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc874005350 tx=0x7fc874087000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.403+0000 7fc885d46800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.403+0000 7fc885d46800 1 --2- 172.21.15.170:0/1999572454 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564e4473bfd0 0x564e4473e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.403+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564e4473ebe0 con 0x564e4473bfd0 2024-09-12T17:28:02.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.404+0000 7fc87bfff640 1 --2- 172.21.15.170:0/1999572454 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564e4473bfd0 0x564e4473e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.404+0000 7fc87bfff640 1 --2- 172.21.15.170:0/1999572454 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564e4473bfd0 0x564e4473e490 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.404+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc86c00f610 con 0x564e4473bfd0 2024-09-12T17:28:02.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.404+0000 7fc885d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:02.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.404+0000 7fc885d46800 20 realm 2024-09-12T17:28:02.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.404+0000 7fc885d46800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.404+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564e4473b320 con 0x564e4473bfd0 2024-09-12T17:28:02.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.404+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc86c00f610 con 0x564e4473bfd0 2024-09-12T17:28:02.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.404+0000 7fc885d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:02.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.404+0000 7fc885d46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:02.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.404+0000 7fc885d46800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.404+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564e4473f6c0 con 0x564e4473bfd0 2024-09-12T17:28:02.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.404+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc86c00f610 con 0x564e4473bfd0 2024-09-12T17:28:02.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.404+0000 7fc885d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:02.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.404+0000 7fc885d46800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.404+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564e4473ff90 con 0x564e4473bfd0 2024-09-12T17:28:02.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.405+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc86c00f610 con 0x564e4473bfd0 2024-09-12T17:28:02.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.405+0000 7fc885d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:02.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.405+0000 7fc885d46800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.405+0000 7fc885d46800 1 --2- 172.21.15.170:0/1999572454 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564e447408d0 0x564e44742cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.405+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564e44743400 con 0x564e447408d0 2024-09-12T17:28:02.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.405+0000 7fc884038640 1 --2- 172.21.15.170:0/1999572454 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564e447408d0 0x564e44742cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.405+0000 7fc884038640 1 --2- 172.21.15.170:0/1999572454 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564e447408d0 0x564e44742cc0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.405+0000 7fc884038640 1 -- 172.21.15.170:0/1999572454 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc87c03a070 con 0x564e447408d0 2024-09-12T17:28:02.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.405+0000 7fc885d46800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:02.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.405+0000 7fc885d46800 20 searching for the correct realm 2024-09-12T17:28:02.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.405+0000 7fc885d46800 1 --2- 172.21.15.170:0/1999572454 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x564e44745480 0x564e44747940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.405+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44748010 con 0x564e44745480 2024-09-12T17:28:02.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.406+0000 7fc883837640 1 --2- 172.21.15.170:0/1999572454 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x564e44745480 0x564e44747940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.406+0000 7fc883837640 1 --2- 172.21.15.170:0/1999572454 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x564e44745480 0x564e44747940 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.406+0000 7fc883837640 1 -- 172.21.15.170:0/1999572454 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc874057030 con 0x564e44745480 2024-09-12T17:28:02.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.406+0000 7fc883837640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44748010 con 0x564e447408d0 2024-09-12T17:28:02.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.406+0000 7fc884038640 1 -- 172.21.15.170:0/1999572454 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc87c03a070 con 0x564e447408d0 2024-09-12T17:28:02.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.406+0000 7fc884038640 1 --2- 172.21.15.170:0/1999572454 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fc87c04e070 0x7fc87c0080c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.406+0000 7fc884038640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44748010 con 0x7fc87c04e070 2024-09-12T17:28:02.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.407+0000 7fc87bfff640 1 --2- 172.21.15.170:0/1999572454 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fc87c04e070 0x7fc87c0080c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.407+0000 7fc87bfff640 1 --2- 172.21.15.170:0/1999572454 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fc87c04e070 0x7fc87c0080c0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.407+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c00f610 con 0x7fc87c04e070 2024-09-12T17:28:02.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.407+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44748010 con 0x564e4473bfd0 2024-09-12T17:28:02.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.407+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c00f610 con 0x564e4473bfd0 2024-09-12T17:28:02.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.407+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44748010 con 0x564e4473bfd0 2024-09-12T17:28:02.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.408+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c02b040 con 0x564e4473bfd0 2024-09-12T17:28:02.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.408+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44748010 con 0x7fc87c04e070 2024-09-12T17:28:02.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.408+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c02b040 con 0x7fc87c04e070 2024-09-12T17:28:02.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.408+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44748010 con 0x7fc87c04e070 2024-09-12T17:28:02.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.408+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c02b040 con 0x7fc87c04e070 2024-09-12T17:28:02.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.408+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44748010 con 0x564e447408d0 2024-09-12T17:28:02.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.409+0000 7fc884038640 1 -- 172.21.15.170:0/1999572454 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc87c03a070 con 0x564e447408d0 2024-09-12T17:28:02.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.409+0000 7fc884038640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44748010 con 0x564e44745480 2024-09-12T17:28:02.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.409+0000 7fc883837640 1 -- 172.21.15.170:0/1999572454 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc874057030 con 0x564e44745480 2024-09-12T17:28:02.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.409+0000 7fc883837640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44748010 con 0x564e4473bfd0 2024-09-12T17:28:02.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.409+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c02b040 con 0x564e4473bfd0 2024-09-12T17:28:02.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.409+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44748010 con 0x7fc87c04e070 2024-09-12T17:28:02.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.409+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c02b040 con 0x7fc87c04e070 2024-09-12T17:28:02.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.409+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44748010 con 0x564e4473bfd0 2024-09-12T17:28:02.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.409+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c02b040 con 0x564e4473bfd0 2024-09-12T17:28:02.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.410+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44748010 con 0x564e447408d0 2024-09-12T17:28:02.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.410+0000 7fc884038640 1 -- 172.21.15.170:0/1999572454 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fc87c03a070 con 0x564e447408d0 2024-09-12T17:28:02.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.410+0000 7fc884038640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44748010 con 0x564e44745480 2024-09-12T17:28:02.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.410+0000 7fc883837640 1 -- 172.21.15.170:0/1999572454 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc874057030 con 0x564e44745480 2024-09-12T17:28:02.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.410+0000 7fc883837640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44748010 con 0x564e44745480 2024-09-12T17:28:02.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.410+0000 7fc883837640 1 -- 172.21.15.170:0/1999572454 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc874057030 con 0x564e44745480 2024-09-12T17:28:02.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.410+0000 7fc883837640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44748010 con 0x7fc87c04e070 2024-09-12T17:28:02.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.410+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c02b040 con 0x7fc87c04e070 2024-09-12T17:28:02.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.410+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44748010 con 0x564e44745480 2024-09-12T17:28:02.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.411+0000 7fc883837640 1 -- 172.21.15.170:0/1999572454 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc874057030 con 0x564e44745480 2024-09-12T17:28:02.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.411+0000 7fc883837640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44748010 con 0x564e44745480 2024-09-12T17:28:02.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.411+0000 7fc883837640 1 -- 172.21.15.170:0/1999572454 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc874057030 con 0x564e44745480 2024-09-12T17:28:02.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.411+0000 7fc883837640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44748010 con 0x564e4473bfd0 2024-09-12T17:28:02.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.411+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c02b040 con 0x564e4473bfd0 2024-09-12T17:28:02.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.411+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44748010 con 0x564e4473bfd0 2024-09-12T17:28:02.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.411+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc86c02b040 con 0x564e4473bfd0 2024-09-12T17:28:02.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.411+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44748010 con 0x7fc87c04e070 2024-09-12T17:28:02.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.412+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c02b040 con 0x7fc87c04e070 2024-09-12T17:28:02.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.412+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44748010 con 0x564e44745480 2024-09-12T17:28:02.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.412+0000 7fc883837640 1 -- 172.21.15.170:0/1999572454 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc874057030 con 0x564e44745480 2024-09-12T17:28:02.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.412+0000 7fc883837640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44748010 con 0x564e447408d0 2024-09-12T17:28:02.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.412+0000 7fc884038640 1 -- 172.21.15.170:0/1999572454 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc87c03a070 con 0x564e447408d0 2024-09-12T17:28:02.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.412+0000 7fc884038640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44748010 con 0x564e4473bfd0 2024-09-12T17:28:02.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.412+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c02b040 con 0x564e4473bfd0 2024-09-12T17:28:02.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.412+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44748010 con 0x7fc87c04e070 2024-09-12T17:28:02.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.413+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c03b040 con 0x7fc87c04e070 2024-09-12T17:28:02.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.413+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44748010 con 0x564e44745480 2024-09-12T17:28:02.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.413+0000 7fc883837640 1 -- 172.21.15.170:0/1999572454 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc874057030 con 0x564e44745480 2024-09-12T17:28:02.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.413+0000 7fc883837640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44748010 con 0x7fc87c04e070 2024-09-12T17:28:02.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.413+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c03b040 con 0x7fc87c04e070 2024-09-12T17:28:02.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.413+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44748010 con 0x564e447408d0 2024-09-12T17:28:02.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.413+0000 7fc884038640 1 -- 172.21.15.170:0/1999572454 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc87c03a070 con 0x564e447408d0 2024-09-12T17:28:02.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.413+0000 7fc884038640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44748010 con 0x564e44745480 2024-09-12T17:28:02.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.414+0000 7fc883837640 1 -- 172.21.15.170:0/1999572454 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc874057030 con 0x564e44745480 2024-09-12T17:28:02.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.414+0000 7fc883837640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44748010 con 0x7fc87c04e070 2024-09-12T17:28:02.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.414+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c03b040 con 0x7fc87c04e070 2024-09-12T17:28:02.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.414+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44748010 con 0x564e4473bfd0 2024-09-12T17:28:02.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.414+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc86c03b040 con 0x564e4473bfd0 2024-09-12T17:28:02.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.414+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44748010 con 0x564e447408d0 2024-09-12T17:28:02.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.414+0000 7fc884038640 1 -- 172.21.15.170:0/1999572454 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc87c03a070 con 0x564e447408d0 2024-09-12T17:28:02.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.414+0000 7fc885d46800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:02.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.414+0000 7fc885d46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:02.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.414+0000 7fc885d46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:02.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.414+0000 7fc885d46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:02.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.414+0000 7fc885d46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:02.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.414+0000 7fc885d46800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:02.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.414+0000 7fc885d46800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.414+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564e44743e80 con 0x564e4473bfd0 2024-09-12T17:28:02.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.415+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc86c03b040 con 0x564e4473bfd0 2024-09-12T17:28:02.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.415+0000 7fc885d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:02.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.415+0000 7fc885d46800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.415+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564e44743a60 con 0x564e4473bfd0 2024-09-12T17:28:02.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.415+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc86c03b040 con 0x564e4473bfd0 2024-09-12T17:28:02.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.415+0000 7fc885d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:02.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.415+0000 7fc885d46800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.415+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564e447447e0 con 0x564e447408d0 2024-09-12T17:28:02.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.415+0000 7fc884038640 1 -- 172.21.15.170:0/1999572454 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc87c03a070 con 0x564e447408d0 2024-09-12T17:28:02.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.415+0000 7fc885d46800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:02.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.415+0000 7fc885d46800 20 zone default found 2024-09-12T17:28:02.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.415+0000 7fc885d46800 4 Realm: () 2024-09-12T17:28:02.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.415+0000 7fc885d46800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:02.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.415+0000 7fc885d46800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:02.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.415+0000 7fc885d46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:02.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.415+0000 7fc885d46800 20 zonegroup default 2024-09-12T17:28:02.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.415+0000 7fc885d46800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.415+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564e44744360 con 0x7fc87c04e070 2024-09-12T17:28:02.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.416+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc86c03b040 con 0x7fc87c04e070 2024-09-12T17:28:02.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.416+0000 7fc885d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:02.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.416+0000 7fc885d46800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.416+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564e4474a3e0 con 0x564e44745480 2024-09-12T17:28:02.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.416+0000 7fc883837640 1 -- 172.21.15.170:0/1999572454 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc874057030 con 0x564e44745480 2024-09-12T17:28:02.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.416+0000 7fc885d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:02.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.416+0000 7fc885d46800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.416+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564e4474a890 con 0x564e44745480 2024-09-12T17:28:02.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.416+0000 7fc883837640 1 -- 172.21.15.170:0/1999572454 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc874057030 con 0x564e44745480 2024-09-12T17:28:02.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.416+0000 7fc885d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:02.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.416+0000 7fc885d46800 20 started sync module instance, tier type = 2024-09-12T17:28:02.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.416+0000 7fc885d46800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:02.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.416+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564e44749850 con 0x564e447408d0 2024-09-12T17:28:02.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.417+0000 7fc884038640 1 -- 172.21.15.170:0/1999572454 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc87c03a070 con 0x564e447408d0 2024-09-12T17:28:02.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.417+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94894155930688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564e447494b0 con 0x564e447408d0 2024-09-12T17:28:02.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.417+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564e4474b7c0 con 0x564e4473bfd0 2024-09-12T17:28:02.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.418+0000 7fc884038640 1 -- 172.21.15.170:0/1999572454 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94894155930688] v29'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc87c03a070 con 0x564e447408d0 2024-09-12T17:28:02.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.418+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86c03b040 con 0x564e4473bfd0 2024-09-12T17:28:02.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.418+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94894155934960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564e4474b7c0 con 0x564e4473bfd0 2024-09-12T17:28:02.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.419+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564e4474c1c0 con 0x564e44745480 2024-09-12T17:28:02.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.419+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94894155934960] v29'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86c03b040 con 0x564e4473bfd0 2024-09-12T17:28:02.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.420+0000 7fc883837640 1 -- 172.21.15.170:0/1999572454 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc874057030 con 0x564e44745480 2024-09-12T17:28:02.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.420+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94894155936528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564e4474b730 con 0x564e44745480 2024-09-12T17:28:02.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.420+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564e4474d080 con 0x564e447408d0 2024-09-12T17:28:02.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.421+0000 7fc883837640 1 -- 172.21.15.170:0/1999572454 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94894155936528] v29'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc874057030 con 0x564e44745480 2024-09-12T17:28:02.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.421+0000 7fc884038640 1 -- 172.21.15.170:0/1999572454 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc87c03a070 con 0x564e447408d0 2024-09-12T17:28:02.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.421+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94894155942864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564e4474d4a0 con 0x564e447408d0 2024-09-12T17:28:02.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.421+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564e4474de60 con 0x564e4473bfd0 2024-09-12T17:28:02.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.422+0000 7fc884038640 1 -- 172.21.15.170:0/1999572454 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94894155942864] v29'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc87c03a070 con 0x564e447408d0 2024-09-12T17:28:02.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.422+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86c03b040 con 0x564e4473bfd0 2024-09-12T17:28:02.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.422+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94894155944400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564e4474de60 con 0x564e4473bfd0 2024-09-12T17:28:02.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.422+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564e4474e820 con 0x7fc87c04e070 2024-09-12T17:28:02.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.423+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94894155944400] v29'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86c03b040 con 0x564e4473bfd0 2024-09-12T17:28:02.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.423+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86c03b040 con 0x7fc87c04e070 2024-09-12T17:28:02.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.423+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94894155949392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564e4474de60 con 0x7fc87c04e070 2024-09-12T17:28:02.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.423+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564e4474f230 con 0x7fc87c04e070 2024-09-12T17:28:02.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.424+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94894155949392] v29'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86c03b040 con 0x7fc87c04e070 2024-09-12T17:28:02.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.424+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(56 notify.6 [create] v29'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86c03b040 con 0x7fc87c04e070 2024-09-12T17:28:02.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.424+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94894155946896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564e4474f230 con 0x7fc87c04e070 2024-09-12T17:28:02.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.424+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564e4474fbf0 con 0x7fc87c04e070 2024-09-12T17:28:02.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.425+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(58 notify.7 [create] v29'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86c03b040 con 0x7fc87c04e070 2024-09-12T17:28:02.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.425+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94894155953984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564e44750010 con 0x7fc87c04e070 2024-09-12T17:28:02.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.425+0000 7fc885d46800 20 add_watcher() i=0 2024-09-12T17:28:02.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.425+0000 7fc885d46800 20 add_watcher() i=1 2024-09-12T17:28:02.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.425+0000 7fc885d46800 20 add_watcher() i=2 2024-09-12T17:28:02.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.425+0000 7fc885d46800 20 add_watcher() i=3 2024-09-12T17:28:02.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.425+0000 7fc885d46800 20 add_watcher() i=4 2024-09-12T17:28:02.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.425+0000 7fc885d46800 20 add_watcher() i=5 2024-09-12T17:28:02.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.425+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94894155946896] v29'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86c03b040 con 0x7fc87c04e070 2024-09-12T17:28:02.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.425+0000 7fc885d46800 20 add_watcher() i=6 2024-09-12T17:28:02.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.426+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94894155953984] v29'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86c03b040 con 0x7fc87c04e070 2024-09-12T17:28:02.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.426+0000 7fc885d46800 20 add_watcher() i=7 2024-09-12T17:28:02.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.426+0000 7fc885d46800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:02.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.426+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564e44750010 con 0x564e4473bfd0 2024-09-12T17:28:02.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.426+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc86c03b040 con 0x564e4473bfd0 2024-09-12T17:28:02.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.427+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94894155955040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564e4474ff80 con 0x564e4473bfd0 2024-09-12T17:28:02.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.427+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94894155955040] v29'94 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc86c03b040 con 0x564e4473bfd0 2024-09-12T17:28:02.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.428+0000 7fc739fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:02.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.428+0000 7fc885d46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:02.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.428+0000 7fc885d46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:02.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.428+0000 7fc885d46800 5 note: GC not initialized 2024-09-12T17:28:02.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.428+0000 7fc738fe1640 20 reqs_thread_entry: start 2024-09-12T17:28:02.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.428+0000 7fc885d46800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:02.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.428+0000 7fc885d46800 20 Filter name: none 2024-09-12T17:28:02.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.428+0000 7fc6b27fc640 20 reqs_thread_entry: start 2024-09-12T17:28:02.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.428+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44785910 con 0x564e44745480 2024-09-12T17:28:02.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.428+0000 7fc883837640 1 -- 172.21.15.170:0/1999572454 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc874057030 con 0x564e44745480 2024-09-12T17:28:02.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.428+0000 7fc883837640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44785910 con 0x564e44745480 2024-09-12T17:28:02.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.429+0000 7fc883837640 1 -- 172.21.15.170:0/1999572454 <== osd.3 v2:172.21.15.170:6816/2664906588 15 ==== osd_op_reply(63 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc874057030 con 0x564e44745480 2024-09-12T17:28:02.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.429+0000 7fc883837640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44785910 con 0x564e4473bfd0 2024-09-12T17:28:02.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.429+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v29'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c03b040 con 0x564e4473bfd0 2024-09-12T17:28:02.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.429+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44743a60 con 0x564e4473bfd0 2024-09-12T17:28:02.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.429+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v29'11 uv11 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c03b040 con 0x564e4473bfd0 2024-09-12T17:28:02.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.429+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44743a60 con 0x564e447408d0 2024-09-12T17:28:02.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.429+0000 7fc884038640 1 -- 172.21.15.170:0/1999572454 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc87c03a070 con 0x564e447408d0 2024-09-12T17:28:02.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.429+0000 7fc884038640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44749850 con 0x564e44745480 2024-09-12T17:28:02.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.430+0000 7fc883837640 1 -- 172.21.15.170:0/1999572454 <== osd.3 v2:172.21.15.170:6816/2664906588 16 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc874057030 con 0x564e44745480 2024-09-12T17:28:02.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.430+0000 7fc883837640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44749850 con 0x564e4473bfd0 2024-09-12T17:28:02.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.430+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c03b040 con 0x564e4473bfd0 2024-09-12T17:28:02.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.430+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44749850 con 0x564e44745480 2024-09-12T17:28:02.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.430+0000 7fc883837640 1 -- 172.21.15.170:0/1999572454 <== osd.3 v2:172.21.15.170:6816/2664906588 17 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc874057030 con 0x564e44745480 2024-09-12T17:28:02.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.430+0000 7fc883837640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44749850 con 0x564e447408d0 2024-09-12T17:28:02.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.430+0000 7fc884038640 1 -- 172.21.15.170:0/1999572454 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v29'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc87c03a070 con 0x564e447408d0 2024-09-12T17:28:02.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.430+0000 7fc884038640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44749850 con 0x564e44745480 2024-09-12T17:28:02.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.431+0000 7fc883837640 1 -- 172.21.15.170:0/1999572454 <== osd.3 v2:172.21.15.170:6816/2664906588 18 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc874057030 con 0x564e44745480 2024-09-12T17:28:02.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.431+0000 7fc883837640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44749850 con 0x564e4473bfd0 2024-09-12T17:28:02.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.431+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c03b040 con 0x564e4473bfd0 2024-09-12T17:28:02.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.431+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44749850 con 0x7fc87c04e070 2024-09-12T17:28:02.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.431+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c03b040 con 0x7fc87c04e070 2024-09-12T17:28:02.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.431+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44749850 con 0x7fc87c04e070 2024-09-12T17:28:02.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.432+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(74 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c03b040 con 0x7fc87c04e070 2024-09-12T17:28:02.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.432+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44749850 con 0x564e44745480 2024-09-12T17:28:02.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.432+0000 7fc883837640 1 -- 172.21.15.170:0/1999572454 <== osd.3 v2:172.21.15.170:6816/2664906588 19 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc874057030 con 0x564e44745480 2024-09-12T17:28:02.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.432+0000 7fc883837640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44749850 con 0x7fc87c04e070 2024-09-12T17:28:02.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.432+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(76 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c03b040 con 0x7fc87c04e070 2024-09-12T17:28:02.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.432+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44749850 con 0x7fc87c04e070 2024-09-12T17:28:02.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.432+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(77 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c03b040 con 0x7fc87c04e070 2024-09-12T17:28:02.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.432+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44749850 con 0x7fc87c04e070 2024-09-12T17:28:02.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.433+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== osd_op_reply(78 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c03b040 con 0x7fc87c04e070 2024-09-12T17:28:02.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.433+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44749850 con 0x564e44745480 2024-09-12T17:28:02.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.433+0000 7fc883837640 1 -- 172.21.15.170:0/1999572454 <== osd.3 v2:172.21.15.170:6816/2664906588 20 ==== osd_op_reply(79 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc874057030 con 0x564e44745480 2024-09-12T17:28:02.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.433+0000 7fc883837640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44749850 con 0x564e447408d0 2024-09-12T17:28:02.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.433+0000 7fc884038640 1 -- 172.21.15.170:0/1999572454 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(80 [pgnls start_epoch 29 out=70b] v29'2 uv2 ondisk = 1) ==== 144+0+70 (crc 0 0 0) 0x7fc87c03a070 con 0x564e447408d0 2024-09-12T17:28:02.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.433+0000 7fc884038640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44749850 con 0x564e4473bfd0 2024-09-12T17:28:02.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.433+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(81 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c03b040 con 0x564e4473bfd0 2024-09-12T17:28:02.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.433+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44749850 con 0x564e4473bfd0 2024-09-12T17:28:02.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.434+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(82 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c03b040 con 0x564e4473bfd0 2024-09-12T17:28:02.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.434+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44749850 con 0x564e44745480 2024-09-12T17:28:02.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.434+0000 7fc883837640 1 -- 172.21.15.170:0/1999572454 <== osd.3 v2:172.21.15.170:6816/2664906588 21 ==== osd_op_reply(83 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc874057030 con 0x564e44745480 2024-09-12T17:28:02.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.434+0000 7fc883837640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44749850 con 0x564e447408d0 2024-09-12T17:28:02.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.434+0000 7fc884038640 1 -- 172.21.15.170:0/1999572454 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(84 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc87c03a070 con 0x564e447408d0 2024-09-12T17:28:02.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.434+0000 7fc884038640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44749850 con 0x7fc87c04e070 2024-09-12T17:28:02.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.434+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.0 v2:172.21.15.47:6800/3978157098 22 ==== osd_op_reply(85 [pgnls start_epoch 29 out=127b] v29'1 uv1 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7fc86c03b040 con 0x7fc87c04e070 2024-09-12T17:28:02.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.434+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44749850 con 0x564e4473bfd0 2024-09-12T17:28:02.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.435+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(86 [pgnls start_epoch 29 out=49b] v29'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c03b040 con 0x564e4473bfd0 2024-09-12T17:28:02.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.435+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44749850 con 0x7fc87c04e070 2024-09-12T17:28:02.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.435+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.0 v2:172.21.15.47:6800/3978157098 23 ==== osd_op_reply(87 [pgnls start_epoch 29 out=49b] v29'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c03b040 con 0x7fc87c04e070 2024-09-12T17:28:02.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.435+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44749850 con 0x564e44745480 2024-09-12T17:28:02.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.435+0000 7fc883837640 1 -- 172.21.15.170:0/1999572454 <== osd.3 v2:172.21.15.170:6816/2664906588 22 ==== osd_op_reply(88 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc874057030 con 0x564e44745480 2024-09-12T17:28:02.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.435+0000 7fc883837640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44749850 con 0x564e447408d0 2024-09-12T17:28:02.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.435+0000 7fc884038640 1 -- 172.21.15.170:0/1999572454 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== osd_op_reply(89 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc87c03a070 con 0x564e447408d0 2024-09-12T17:28:02.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.435+0000 7fc884038640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44749850 con 0x7fc87c04e070 2024-09-12T17:28:02.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.436+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.0 v2:172.21.15.47:6800/3978157098 24 ==== osd_op_reply(90 [pgnls start_epoch 29 out=49b] v29'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c03b040 con 0x7fc87c04e070 2024-09-12T17:28:02.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.436+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44749850 con 0x564e4473bfd0 2024-09-12T17:28:02.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.436+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(91 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c03b040 con 0x564e4473bfd0 2024-09-12T17:28:02.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.436+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44749850 con 0x564e44745480 2024-09-12T17:28:02.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.436+0000 7fc883837640 1 -- 172.21.15.170:0/1999572454 <== osd.3 v2:172.21.15.170:6816/2664906588 23 ==== osd_op_reply(92 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc874057030 con 0x564e44745480 2024-09-12T17:28:02.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.436+0000 7fc883837640 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564e44749850 con 0x564e447408d0 2024-09-12T17:28:02.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.436+0000 7fc884038640 1 -- 172.21.15.170:0/1999572454 <== osd.2 v2:172.21.15.170:6808/3855567754 18 ==== osd_op_reply(93 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc87c03a070 con 0x564e447408d0 2024-09-12T17:28:02.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.436+0000 7fc885d46800 20 RGWRados::pool_iterate: got myfoo 2024-09-12T17:28:02.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.436+0000 7fc885d46800 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 2024-09-12T17:28:02.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.438+0000 7fc739fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:02.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.438+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94894155955040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564e44743a60 con 0x564e4473bfd0 2024-09-12T17:28:02.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.439+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94894155955040] v29'95 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc86c03b040 con 0x564e4473bfd0 2024-09-12T17:28:02.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.439+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94894155930688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564e44783af0 con 0x564e447408d0 2024-09-12T17:28:02.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.440+0000 7fc884038640 1 -- 172.21.15.170:0/1999572454 <== osd.2 v2:172.21.15.170:6808/3855567754 19 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94894155930688] v29'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc87c03a070 con 0x564e447408d0 2024-09-12T17:28:02.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.440+0000 7fc885d46800 20 remove_watcher() i=0 2024-09-12T17:28:02.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.440+0000 7fc885d46800 2 removed watcher, disabling cache 2024-09-12T17:28:02.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.440+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94894155934960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564e44783af0 con 0x564e4473bfd0 2024-09-12T17:28:02.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.441+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.1 v2:172.21.15.170:6800/1903654092 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94894155934960] v29'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86c03b040 con 0x564e4473bfd0 2024-09-12T17:28:02.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.441+0000 7fc885d46800 20 remove_watcher() i=1 2024-09-12T17:28:02.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.441+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94894155936528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564e44783af0 con 0x564e44745480 2024-09-12T17:28:02.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.442+0000 7fc883837640 1 -- 172.21.15.170:0/1999572454 <== osd.3 v2:172.21.15.170:6816/2664906588 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94894155936528] v29'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc874057030 con 0x564e44745480 2024-09-12T17:28:02.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.442+0000 7fc885d46800 20 remove_watcher() i=2 2024-09-12T17:28:02.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.442+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94894155942864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564e44749c40 con 0x564e447408d0 2024-09-12T17:28:02.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.443+0000 7fc884038640 1 -- 172.21.15.170:0/1999572454 <== osd.2 v2:172.21.15.170:6808/3855567754 20 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94894155942864] v29'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc87c03a070 con 0x564e447408d0 2024-09-12T17:28:02.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.443+0000 7fc885d46800 20 remove_watcher() i=3 2024-09-12T17:28:02.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.443+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94894155944400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564e4474b310 con 0x564e4473bfd0 2024-09-12T17:28:02.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.444+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.1 v2:172.21.15.170:6800/1903654092 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94894155944400] v29'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86c03b040 con 0x564e4473bfd0 2024-09-12T17:28:02.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.444+0000 7fc885d46800 20 remove_watcher() i=4 2024-09-12T17:28:02.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.444+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94894155949392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564e4474cbd0 con 0x7fc87c04e070 2024-09-12T17:28:02.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.445+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.0 v2:172.21.15.47:6800/3978157098 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94894155949392] v29'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86c03b040 con 0x7fc87c04e070 2024-09-12T17:28:02.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.445+0000 7fc885d46800 20 remove_watcher() i=5 2024-09-12T17:28:02.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.445+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94894155946896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564e4474d1d0 con 0x7fc87c04e070 2024-09-12T17:28:02.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.446+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.0 v2:172.21.15.47:6800/3978157098 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94894155946896] v29'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86c03b040 con 0x7fc87c04e070 2024-09-12T17:28:02.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.446+0000 7fc885d46800 20 remove_watcher() i=6 2024-09-12T17:28:02.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.446+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94894155953984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564e4474b310 con 0x7fc87c04e070 2024-09-12T17:28:02.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.447+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 <== osd.0 v2:172.21.15.47:6800/3978157098 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94894155953984] v29'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86c03b040 con 0x7fc87c04e070 2024-09-12T17:28:02.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.447+0000 7fc885d46800 20 remove_watcher() i=7 2024-09-12T17:28:02.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.447+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fc87c04e070 msgr2=0x7fc87c0080c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.447+0000 7fc885d46800 1 --2- 172.21.15.170:0/1999572454 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fc87c04e070 0x7fc87c0080c0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.447+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564e4473bfd0 msgr2=0x564e4473e490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.447+0000 7fc885d46800 1 --2- 172.21.15.170:0/1999572454 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564e4473bfd0 0x564e4473e490 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.447+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564e447408d0 msgr2=0x564e44742cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.447+0000 7fc885d46800 1 --2- 172.21.15.170:0/1999572454 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564e447408d0 0x564e44742cc0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.447+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x564e44745480 msgr2=0x564e44747940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.447+0000 7fc885d46800 1 --2- 172.21.15.170:0/1999572454 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x564e44745480 0x564e44747940 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.447+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc74c03c780 msgr2=0x7fc74c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.447+0000 7fc885d46800 1 --2- 172.21.15.170:0/1999572454 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc74c03c780 0x7fc74c03ec40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc874005350 tx=0x7fc874087000 comp rx=0 tx=0).stop 2024-09-12T17:28:02.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.447+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e44729080 msgr2=0x564e44730680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.447+0000 7fc885d46800 1 --2- 172.21.15.170:0/1999572454 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e44729080 0x564e44730680 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc87c00afe0 tx=0x7fc87c053d10 comp rx=0 tx=0).stop 2024-09-12T17:28:02.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.447+0000 7fc87bfff640 1 -- 172.21.15.170:0/1999572454 reap_dead start 2024-09-12T17:28:02.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.447+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 shutdown_connections 2024-09-12T17:28:02.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.447+0000 7fc885d46800 1 --2- 172.21.15.170:0/1999572454 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e44729080 0x564e44730680 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.447+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 >> 172.21.15.170:0/1999572454 conn(0x564e44725480 msgr2=0x564e44723690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:02.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.447+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 shutdown_connections 2024-09-12T17:28:02.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.447+0000 7fc885d46800 1 -- 172.21.15.170:0/1999572454 wait complete. 2024-09-12T17:28:02.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.448+0000 7fc885d46800 1 -- 172.21.15.170:0/2014173470 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc75c03c730 msgr2=0x7fc75c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.448+0000 7fc885d46800 1 --2- 172.21.15.170:0/2014173470 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc75c03c730 0x7fc75c03ebf0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x564e4470e070 tx=0x7fc874093370 comp rx=0 tx=0).stop 2024-09-12T17:28:02.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.448+0000 7fc885d46800 1 -- 172.21.15.170:0/2014173470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e4471c5c0 msgr2=0x564e4471c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.448+0000 7fc885d46800 1 --2- 172.21.15.170:0/2014173470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e4471c5c0 0x564e4471c9e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x564e44702290 tx=0x7fc87c0167b0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.448+0000 7fc885d46800 1 -- 172.21.15.170:0/2014173470 shutdown_connections 2024-09-12T17:28:02.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.448+0000 7fc885d46800 1 --2- 172.21.15.170:0/2014173470 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc75c03c730 0x7fc75c03ebf0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.448+0000 7fc885d46800 1 --2- 172.21.15.170:0/2014173470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e4471c5c0 0x564e4471c9e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.448+0000 7fc885d46800 1 -- 172.21.15.170:0/2014173470 >> 172.21.15.170:0/2014173470 conn(0x564e44710970 msgr2=0x564e44710d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:02.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.448+0000 7fc885d46800 1 -- 172.21.15.170:0/2014173470 shutdown_connections 2024-09-12T17:28:02.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.448+0000 7fc885d46800 1 -- 172.21.15.170:0/2014173470 wait complete. 2024-09-12T17:28:02.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.448+0000 7fc885d46800 1 -- 172.21.15.170:0/2309746836 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564e447068d0 msgr2=0x564e44708cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.448+0000 7fc885d46800 1 --2- 172.21.15.170:0/2309746836 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564e447068d0 0x564e44708cc0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.448+0000 7fc885d46800 1 -- 172.21.15.170:0/2309746836 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564e4470b0a0 msgr2=0x564e4470d540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.448+0000 7fc885d46800 1 --2- 172.21.15.170:0/2309746836 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564e4470b0a0 0x564e4470d540 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.448+0000 7fc885d46800 1 -- 172.21.15.170:0/2309746836 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc76c03c730 msgr2=0x7fc76c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.448+0000 7fc885d46800 1 --2- 172.21.15.170:0/2309746836 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc76c03c730 0x7fc76c03ebf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc86c001e30 tx=0x7fc86c001390 comp rx=0 tx=0).stop 2024-09-12T17:28:02.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.448+0000 7fc885d46800 1 -- 172.21.15.170:0/2309746836 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e44606dd0 msgr2=0x564e44701290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.448+0000 7fc885d46800 1 --2- 172.21.15.170:0/2309746836 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e44606dd0 0x564e44701290 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc8740460d0 tx=0x7fc874002fb0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.448+0000 7fc885d46800 1 -- 172.21.15.170:0/2309746836 shutdown_connections 2024-09-12T17:28:02.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.448+0000 7fc885d46800 1 --2- 172.21.15.170:0/2309746836 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564e4470b0a0 0x564e4470d540 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.448+0000 7fc885d46800 1 --2- 172.21.15.170:0/2309746836 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fc76c03c730 0x7fc76c03ebf0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.448+0000 7fc885d46800 1 --2- 172.21.15.170:0/2309746836 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564e447068d0 0x564e44708cc0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.448+0000 7fc885d46800 1 --2- 172.21.15.170:0/2309746836 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e44606dd0 0x564e44701290 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.448+0000 7fc885d46800 1 -- 172.21.15.170:0/2309746836 >> 172.21.15.170:0/2309746836 conn(0x564e446021e0 msgr2=0x564e446faa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:02.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.448+0000 7fc885d46800 1 -- 172.21.15.170:0/2309746836 shutdown_connections 2024-09-12T17:28:02.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.448+0000 7fc885d46800 1 -- 172.21.15.170:0/2309746836 wait complete. 2024-09-12T17:28:02.469 INFO:teuthology.orchestra.run.smithi170.stdout:["myfoo"] 2024-09-12T17:28:02.469 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-12T17:28:02.479 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:28:02.489 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:28:02.498 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:28:02.541 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-09-12T17:28:02.568 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:28:02.594 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:28:02.620 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:28:02.621 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-12T17:28:02.621 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-12T17:28:02.621 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-12T17:28:02.665 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:02.666 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:02.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.664+0000 7fbc4a80e800 1 Processor -- start 2024-09-12T17:28:02.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.664+0000 7fbc4a80e800 1 -- start start 2024-09-12T17:28:02.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.664+0000 7fbc4a80e800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x564477142df0 0x564477143af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.664+0000 7fbc4a80e800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564476fede40 con 0x564477144030 2024-09-12T17:28:02.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.664+0000 7fbc4a80e800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x564476fb8680 con 0x564477142df0 2024-09-12T17:28:02.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.664+0000 7fbc45e59640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x564477142df0 0x564477143af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.664+0000 7fbc3ffff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x564477144030 0x564477148d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:48414/0 (socket says 172.21.15.170:48414) 2024-09-12T17:28:02.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.664+0000 7fbc3ffff640 1 -- 172.21.15.170:0/621330394 learned_addr learned my addr 172.21.15.170:0/621330394 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:28:02.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.665+0000 7fbc45e59640 1 -- 172.21.15.170:0/621330394 >> v1:172.21.15.47:6789/0 conn(0x564477144030 legacy=0x564477148d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.665+0000 7fbc45e59640 1 -- 172.21.15.170:0/621330394 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564476fd46b0 con 0x564477142df0 2024-09-12T17:28:02.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.667+0000 7fbc45e59640 1 --2- 172.21.15.170:0/621330394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564477142df0 0x564477143af0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fbc3800a600 tx=0x7fbc38047cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f637b1c3ac147d5a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.667+0000 7fbc45658640 1 -- 172.21.15.170:0/621330394 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc38056070 con 0x564477142df0 2024-09-12T17:28:02.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.667+0000 7fbc45658640 1 -- 172.21.15.170:0/621330394 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc3800a200 con 0x564477142df0 2024-09-12T17:28:02.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.667+0000 7fbc45658640 1 -- 172.21.15.170:0/621330394 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc38008590 con 0x564477142df0 2024-09-12T17:28:02.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.667+0000 7fbc4a80e800 1 -- 172.21.15.170:0/621330394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564477142df0 msgr2=0x564477143af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.667+0000 7fbc4a80e800 1 --2- 172.21.15.170:0/621330394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564477142df0 0x564477143af0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fbc3800a600 tx=0x7fbc38047cb0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.667+0000 7fbc4a80e800 1 -- 172.21.15.170:0/621330394 shutdown_connections 2024-09-12T17:28:02.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.667+0000 7fbc4a80e800 1 --2- 172.21.15.170:0/621330394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564477142df0 0x564477143af0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.667+0000 7fbc4a80e800 1 -- 172.21.15.170:0/621330394 >> 172.21.15.170:0/621330394 conn(0x56447713e1c0 msgr2=0x564477140620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:02.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.668+0000 7fbc4a80e800 1 -- 172.21.15.170:0/621330394 shutdown_connections 2024-09-12T17:28:02.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.668+0000 7fbc4a80e800 1 -- 172.21.15.170:0/621330394 wait complete. 2024-09-12T17:28:02.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.681+0000 7fbc4a80e800 1 Processor -- start 2024-09-12T17:28:02.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.681+0000 7fbc4a80e800 1 -- start start 2024-09-12T17:28:02.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.681+0000 7fbc4a80e800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564477142df0 0x564477231460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.681+0000 7fbc4a80e800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564476fdcdd0 con 0x564477142df0 2024-09-12T17:28:02.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.682+0000 7fbc45e59640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564477142df0 0x564477231460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.682+0000 7fbc45e59640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564477142df0 0x564477231460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57742/0 (socket says 172.21.15.170:57742) 2024-09-12T17:28:02.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.682+0000 7fbc45e59640 1 -- 172.21.15.170:0/1557071153 learned_addr learned my addr 172.21.15.170:0/1557071153 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:02.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.682+0000 7fbc45e59640 1 -- 172.21.15.170:0/1557071153 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564476ff5e10 con 0x564477142df0 2024-09-12T17:28:02.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.682+0000 7fbc45e59640 1 --2- 172.21.15.170:0/1557071153 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564477142df0 0x564477231460 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fbc38027ae0 tx=0x7fbc38053000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1e7f9b901da8dbe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.682+0000 7fbb33e07640 1 -- 172.21.15.170:0/1557071153 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc38009810 con 0x564477142df0 2024-09-12T17:28:02.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.682+0000 7fbb33e07640 1 -- 172.21.15.170:0/1557071153 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc380099b0 con 0x564477142df0 2024-09-12T17:28:02.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.682+0000 7fbb33e07640 1 -- 172.21.15.170:0/1557071153 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc38009cb0 con 0x564477142df0 2024-09-12T17:28:02.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.683+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1557071153 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564477142df0 msgr2=0x564477231460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.683+0000 7fbc4a80e800 1 --2- 172.21.15.170:0/1557071153 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564477142df0 0x564477231460 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fbc38027ae0 tx=0x7fbc38053000 comp rx=0 tx=0).stop 2024-09-12T17:28:02.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.683+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1557071153 shutdown_connections 2024-09-12T17:28:02.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.683+0000 7fbc4a80e800 1 --2- 172.21.15.170:0/1557071153 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564477142df0 0x564477231460 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.683+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1557071153 >> 172.21.15.170:0/1557071153 conn(0x56447713e1c0 msgr2=0x56447722cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:02.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.683+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1557071153 shutdown_connections 2024-09-12T17:28:02.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.683+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1557071153 wait complete. 2024-09-12T17:28:02.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.683+0000 7fbc4a80e800 1 Processor -- start 2024-09-12T17:28:02.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.684+0000 7fbc4a80e800 1 -- start start 2024-09-12T17:28:02.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.684+0000 7fbc4a80e800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564477142df0 0x56447723d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.684+0000 7fbc4a80e800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564477144720 con 0x564477142df0 2024-09-12T17:28:02.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.684+0000 7fbc45e59640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564477142df0 0x56447723d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.684+0000 7fbc45e59640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564477142df0 0x56447723d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57752/0 (socket says 172.21.15.170:57752) 2024-09-12T17:28:02.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.684+0000 7fbc45e59640 1 -- 172.21.15.170:0/384935897 learned_addr learned my addr 172.21.15.170:0/384935897 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:02.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.684+0000 7fbc45e59640 1 -- 172.21.15.170:0/384935897 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56447723d670 con 0x564477142df0 2024-09-12T17:28:02.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.684+0000 7fbc45e59640 1 --2- 172.21.15.170:0/384935897 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564477142df0 0x56447723d110 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fbc3800a1d0 tx=0x7fbc38002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.685+0000 7fbb32604640 1 -- 172.21.15.170:0/384935897 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc38009240 con 0x564477142df0 2024-09-12T17:28:02.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.685+0000 7fbb32604640 1 -- 172.21.15.170:0/384935897 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc380093e0 con 0x564477142df0 2024-09-12T17:28:02.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.685+0000 7fbb32604640 1 -- 172.21.15.170:0/384935897 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc38052670 con 0x564477142df0 2024-09-12T17:28:02.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.685+0000 7fbc4a80e800 1 -- 172.21.15.170:0/384935897 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56447723d900 con 0x564477142df0 2024-09-12T17:28:02.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.685+0000 7fbc4a80e800 1 -- 172.21.15.170:0/384935897 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56447723e510 con 0x564477142df0 2024-09-12T17:28:02.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.686+0000 7fbb32604640 1 -- 172.21.15.170:0/384935897 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fbc38059070 con 0x564477142df0 2024-09-12T17:28:02.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.686+0000 7fbb32604640 1 --2- 172.21.15.170:0/384935897 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbb2c03c780 0x7fbb2c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.686+0000 7fbb32604640 1 -- 172.21.15.170:0/384935897 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fbc38062070 con 0x564477142df0 2024-09-12T17:28:02.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.686+0000 7fbc3ffff640 1 --2- 172.21.15.170:0/384935897 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbb2c03c780 0x7fbb2c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.686+0000 7fbc4a80e800 1 --2- 172.21.15.170:0/384935897 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564477144030 0x564477244760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.686+0000 7fbc4a80e800 1 -- 172.21.15.170:0/384935897 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564477244ca0 con 0x564477144030 2024-09-12T17:28:02.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.686+0000 7fbc4665a640 1 --2- 172.21.15.170:0/384935897 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564477144030 0x564477244760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.686+0000 7fbc3ffff640 1 --2- 172.21.15.170:0/384935897 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbb2c03c780 0x7fbb2c03ec40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbc30001d70 tx=0x7fbc300012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.686+0000 7fbc4665a640 1 --2- 172.21.15.170:0/384935897 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564477144030 0x564477244760 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.687+0000 7fbc4665a640 1 -- 172.21.15.170:0/384935897 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc4000a4d0 con 0x564477144030 2024-09-12T17:28:02.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.687+0000 7fbc4a80e800 1 -- 172.21.15.170:0/384935897 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564477245040 con 0x564477144030 2024-09-12T17:28:02.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.687+0000 7fbc4665a640 1 -- 172.21.15.170:0/384935897 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbc4000a4d0 con 0x564477144030 2024-09-12T17:28:02.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.687+0000 7fbc4a80e800 1 --2- 172.21.15.170:0/384935897 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564477246b00 0x564477248f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.687+0000 7fbc4a80e800 1 -- 172.21.15.170:0/384935897 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564477249710 con 0x564477246b00 2024-09-12T17:28:02.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.687+0000 7fbc45e59640 1 --2- 172.21.15.170:0/384935897 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564477246b00 0x564477248f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.687+0000 7fbc45e59640 1 --2- 172.21.15.170:0/384935897 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564477246b00 0x564477248f80 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.688+0000 7fbc45e59640 1 -- 172.21.15.170:0/384935897 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbc3806b070 con 0x564477246b00 2024-09-12T17:28:02.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.688+0000 7fbc4a80e800 1 -- 172.21.15.170:0/384935897 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564477245890 con 0x564477144030 2024-09-12T17:28:02.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.688+0000 7fbc4665a640 1 -- 172.21.15.170:0/384935897 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbc4000a4d0 con 0x564477144030 2024-09-12T17:28:02.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.688+0000 7fbc4a80e800 1 -- 172.21.15.170:0/384935897 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564477245c30 con 0x564477246b00 2024-09-12T17:28:02.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.688+0000 7fbc45e59640 1 -- 172.21.15.170:0/384935897 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbc3806b070 con 0x564477246b00 2024-09-12T17:28:02.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.688+0000 7fbc4a80e800 1 Processor -- start 2024-09-12T17:28:02.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.689+0000 7fbc4a80e800 1 -- start start 2024-09-12T17:28:02.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.689+0000 7fbc4a80e800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564477257f00 0x564477258320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.689+0000 7fbc4a80e800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56447703aa00 con 0x564477257f00 2024-09-12T17:28:02.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.689+0000 7fbc4665a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564477257f00 0x564477258320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.689+0000 7fbc4665a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564477257f00 0x564477258320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57762/0 (socket says 172.21.15.170:57762) 2024-09-12T17:28:02.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.689+0000 7fbc4665a640 1 -- 172.21.15.170:0/210008757 learned_addr learned my addr 172.21.15.170:0/210008757 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:02.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.689+0000 7fbc4665a640 1 -- 172.21.15.170:0/210008757 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564477258960 con 0x564477257f00 2024-09-12T17:28:02.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.690+0000 7fbc4665a640 1 --2- 172.21.15.170:0/210008757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564477257f00 0x564477258320 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x56447723e110 tx=0x7fbc400167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.690+0000 7fbb2b7fe640 1 -- 172.21.15.170:0/210008757 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc40013640 con 0x564477257f00 2024-09-12T17:28:02.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.690+0000 7fbb2b7fe640 1 -- 172.21.15.170:0/210008757 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc400137e0 con 0x564477257f00 2024-09-12T17:28:02.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.690+0000 7fbc4a80e800 1 -- 172.21.15.170:0/210008757 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564477259190 con 0x564477257f00 2024-09-12T17:28:02.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.690+0000 7fbb2b7fe640 1 -- 172.21.15.170:0/210008757 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc40013ae0 con 0x564477257f00 2024-09-12T17:28:02.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.690+0000 7fbc4a80e800 1 -- 172.21.15.170:0/210008757 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564477259730 con 0x564477257f00 2024-09-12T17:28:02.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.691+0000 7fbb2b7fe640 1 -- 172.21.15.170:0/210008757 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fbc40011040 con 0x564477257f00 2024-09-12T17:28:02.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.691+0000 7fbb2b7fe640 1 --2- 172.21.15.170:0/210008757 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbb2003c730 0x7fbb2003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.691+0000 7fbb2b7fe640 1 -- 172.21.15.170:0/210008757 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fbc4000e040 con 0x564477257f00 2024-09-12T17:28:02.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.691+0000 7fbc45e59640 1 --2- 172.21.15.170:0/210008757 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbb2003c730 0x7fbb2003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.691+0000 7fbc4a80e800 1 Processor -- start 2024-09-12T17:28:02.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.691+0000 7fbc45e59640 1 --2- 172.21.15.170:0/210008757 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbb2003c730 0x7fbb2003ebf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbc38007810 tx=0x7fbc3806ef90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.691+0000 7fbc4a80e800 1 -- start start 2024-09-12T17:28:02.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.691+0000 7fbc4a80e800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5644772649a0 0x564477264da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.691+0000 7fbc4a80e800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564477231bf0 con 0x5644772649a0 2024-09-12T17:28:02.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.692+0000 7fbc4665a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5644772649a0 0x564477264da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.692+0000 7fbc4665a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5644772649a0 0x564477264da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57770/0 (socket says 172.21.15.170:57770) 2024-09-12T17:28:02.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.692+0000 7fbc4665a640 1 -- 172.21.15.170:0/2086454703 learned_addr learned my addr 172.21.15.170:0/2086454703 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:02.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.692+0000 7fbc4665a640 1 -- 172.21.15.170:0/2086454703 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564477265390 con 0x5644772649a0 2024-09-12T17:28:02.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.692+0000 7fbc4665a640 1 --2- 172.21.15.170:0/2086454703 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5644772649a0 0x564477264da0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fbc40053da0 tx=0x7fbc40020460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0f82249c148dc2c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.692+0000 7fbb297fa640 1 -- 172.21.15.170:0/2086454703 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc400143c0 con 0x5644772649a0 2024-09-12T17:28:02.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.692+0000 7fbb297fa640 1 -- 172.21.15.170:0/2086454703 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc40055050 con 0x5644772649a0 2024-09-12T17:28:02.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.692+0000 7fbb297fa640 1 -- 172.21.15.170:0/2086454703 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc40021a40 con 0x5644772649a0 2024-09-12T17:28:02.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.692+0000 7fbc4a80e800 1 -- 172.21.15.170:0/2086454703 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5644772649a0 msgr2=0x564477264da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.692+0000 7fbc4a80e800 1 --2- 172.21.15.170:0/2086454703 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5644772649a0 0x564477264da0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fbc40053da0 tx=0x7fbc40020460 comp rx=0 tx=0).stop 2024-09-12T17:28:02.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.693+0000 7fbc4a80e800 1 -- 172.21.15.170:0/2086454703 shutdown_connections 2024-09-12T17:28:02.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.693+0000 7fbc4a80e800 1 --2- 172.21.15.170:0/2086454703 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5644772649a0 0x564477264da0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.693+0000 7fbc4a80e800 1 -- 172.21.15.170:0/2086454703 >> 172.21.15.170:0/2086454703 conn(0x564477260dc0 msgr2=0x56447725f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:02.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.693+0000 7fbc4a80e800 1 -- 172.21.15.170:0/2086454703 shutdown_connections 2024-09-12T17:28:02.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.693+0000 7fbc4a80e800 1 -- 172.21.15.170:0/2086454703 wait complete. 2024-09-12T17:28:02.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.693+0000 7fbc4a80e800 1 Processor -- start 2024-09-12T17:28:02.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.693+0000 7fbc4a80e800 1 -- start start 2024-09-12T17:28:02.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.693+0000 7fbc4a80e800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5644772649a0 0x56447726bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.693+0000 7fbc4a80e800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564477265980 con 0x5644772649a0 2024-09-12T17:28:02.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.693+0000 7fbc4665a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5644772649a0 0x56447726bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.693+0000 7fbc4665a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5644772649a0 0x56447726bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57778/0 (socket says 172.21.15.170:57778) 2024-09-12T17:28:02.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.693+0000 7fbc4665a640 1 -- 172.21.15.170:0/1946338728 learned_addr learned my addr 172.21.15.170:0/1946338728 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:02.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.694+0000 7fbc4665a640 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56447726c4a0 con 0x5644772649a0 2024-09-12T17:28:02.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.694+0000 7fbc4665a640 1 --2- 172.21.15.170:0/1946338728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5644772649a0 0x56447726bf40 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fbc40053ca0 tx=0x7fbc40053d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.694+0000 7fbb177fe640 1 -- 172.21.15.170:0/1946338728 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc4001fbd0 con 0x5644772649a0 2024-09-12T17:28:02.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.694+0000 7fbb177fe640 1 -- 172.21.15.170:0/1946338728 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc400143c0 con 0x5644772649a0 2024-09-12T17:28:02.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.694+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56447726c730 con 0x5644772649a0 2024-09-12T17:28:02.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.694+0000 7fbb177fe640 1 -- 172.21.15.170:0/1946338728 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc40020950 con 0x5644772649a0 2024-09-12T17:28:02.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.694+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56447726d0b0 con 0x5644772649a0 2024-09-12T17:28:02.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.695+0000 7fbb177fe640 1 -- 172.21.15.170:0/1946338728 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fbc4003b060 con 0x5644772649a0 2024-09-12T17:28:02.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.695+0000 7fbb177fe640 1 --2- 172.21.15.170:0/1946338728 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbb1003c780 0x7fbb1003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.695+0000 7fbb177fe640 1 -- 172.21.15.170:0/1946338728 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fbc4004a040 con 0x5644772649a0 2024-09-12T17:28:02.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.695+0000 7fbc45e59640 1 --2- 172.21.15.170:0/1946338728 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbb1003c780 0x7fbb1003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.695+0000 7fbc4a80e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.695+0000 7fbc4a80e800 1 --2- 172.21.15.170:0/1946338728 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564477277870 0x564477279d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.695+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56447727a480 con 0x564477277870 2024-09-12T17:28:02.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.695+0000 7fbc3ffff640 1 --2- 172.21.15.170:0/1946338728 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564477277870 0x564477279d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.696+0000 7fbc45e59640 1 --2- 172.21.15.170:0/1946338728 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbb1003c780 0x7fbb1003ec40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbc380075e0 tx=0x7fbc3808c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.696+0000 7fbc3ffff640 1 --2- 172.21.15.170:0/1946338728 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564477277870 0x564477279d30 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.696+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc30009050 con 0x564477277870 2024-09-12T17:28:02.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.696+0000 7fbc4a80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:02.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.696+0000 7fbc4a80e800 20 realm 2024-09-12T17:28:02.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.696+0000 7fbc4a80e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.696+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564477276bc0 con 0x564477277870 2024-09-12T17:28:02.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.696+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc30009050 con 0x564477277870 2024-09-12T17:28:02.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.696+0000 7fbc4a80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:02.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.696+0000 7fbc4a80e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:02.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.696+0000 7fbc4a80e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.696+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56447727af60 con 0x564477277870 2024-09-12T17:28:02.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.696+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc30009050 con 0x564477277870 2024-09-12T17:28:02.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.696+0000 7fbc4a80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:02.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.696+0000 7fbc4a80e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.696+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56447727b830 con 0x564477277870 2024-09-12T17:28:02.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.697+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbc30009050 con 0x564477277870 2024-09-12T17:28:02.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.697+0000 7fbc4a80e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:02.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.697+0000 7fbc4a80e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.697+0000 7fbc4a80e800 1 --2- 172.21.15.170:0/1946338728 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56447727c170 0x56447727e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.697+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56447727eca0 con 0x56447727c170 2024-09-12T17:28:02.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.697+0000 7fbc4665a640 1 --2- 172.21.15.170:0/1946338728 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56447727c170 0x56447727e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.697+0000 7fbc4665a640 1 --2- 172.21.15.170:0/1946338728 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56447727c170 0x56447727e560 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.697+0000 7fbc4665a640 1 -- 172.21.15.170:0/1946338728 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbc4000a4d0 con 0x56447727c170 2024-09-12T17:28:02.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.697+0000 7fbc4a80e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:02.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.697+0000 7fbc4a80e800 20 searching for the correct realm 2024-09-12T17:28:02.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.697+0000 7fbc4a80e800 1 --2- 172.21.15.170:0/1946338728 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x564477280d20 0x5644772831e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.697+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5644772838b0 con 0x564477280d20 2024-09-12T17:28:02.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.698+0000 7fbc45e59640 1 --2- 172.21.15.170:0/1946338728 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x564477280d20 0x5644772831e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.698+0000 7fbc45e59640 1 --2- 172.21.15.170:0/1946338728 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x564477280d20 0x5644772831e0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.698+0000 7fbc45e59640 1 -- 172.21.15.170:0/1946338728 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc3806b070 con 0x564477280d20 2024-09-12T17:28:02.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.698+0000 7fbc45e59640 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5644772838b0 con 0x56447727c170 2024-09-12T17:28:02.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.698+0000 7fbc4665a640 1 -- 172.21.15.170:0/1946338728 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc4000a4d0 con 0x56447727c170 2024-09-12T17:28:02.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.698+0000 7fbc4665a640 1 --2- 172.21.15.170:0/1946338728 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fbc4003d070 0x7fbc4003ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.698+0000 7fbc4665a640 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5644772838b0 con 0x7fbc4003d070 2024-09-12T17:28:02.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.698+0000 7fbc3ffff640 1 --2- 172.21.15.170:0/1946338728 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fbc4003d070 0x7fbc4003ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.699+0000 7fbc3ffff640 1 --2- 172.21.15.170:0/1946338728 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fbc4003d070 0x7fbc4003ca70 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.699+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc30009050 con 0x7fbc4003d070 2024-09-12T17:28:02.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.699+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5644772838b0 con 0x564477277870 2024-09-12T17:28:02.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.699+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc30009050 con 0x564477277870 2024-09-12T17:28:02.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.699+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5644772838b0 con 0x564477277870 2024-09-12T17:28:02.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.700+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc30029040 con 0x564477277870 2024-09-12T17:28:02.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.700+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5644772838b0 con 0x7fbc4003d070 2024-09-12T17:28:02.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.700+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc30029040 con 0x7fbc4003d070 2024-09-12T17:28:02.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.700+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5644772838b0 con 0x7fbc4003d070 2024-09-12T17:28:02.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.700+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc30029040 con 0x7fbc4003d070 2024-09-12T17:28:02.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.700+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5644772838b0 con 0x56447727c170 2024-09-12T17:28:02.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.700+0000 7fbc4665a640 1 -- 172.21.15.170:0/1946338728 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc4000a4d0 con 0x56447727c170 2024-09-12T17:28:02.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.700+0000 7fbc4665a640 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5644772838b0 con 0x564477280d20 2024-09-12T17:28:02.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.701+0000 7fbc45e59640 1 -- 172.21.15.170:0/1946338728 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc3806b070 con 0x564477280d20 2024-09-12T17:28:02.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.701+0000 7fbc45e59640 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5644772838b0 con 0x564477277870 2024-09-12T17:28:02.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.701+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc30029040 con 0x564477277870 2024-09-12T17:28:02.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.701+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5644772838b0 con 0x7fbc4003d070 2024-09-12T17:28:02.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.701+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc30029040 con 0x7fbc4003d070 2024-09-12T17:28:02.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.701+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5644772838b0 con 0x564477277870 2024-09-12T17:28:02.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.701+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc30029040 con 0x564477277870 2024-09-12T17:28:02.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.701+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5644772838b0 con 0x56447727c170 2024-09-12T17:28:02.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.701+0000 7fbc4665a640 1 -- 172.21.15.170:0/1946338728 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fbc4000a4d0 con 0x56447727c170 2024-09-12T17:28:02.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.701+0000 7fbc4665a640 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5644772838b0 con 0x564477280d20 2024-09-12T17:28:02.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.702+0000 7fbc45e59640 1 -- 172.21.15.170:0/1946338728 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc3806b070 con 0x564477280d20 2024-09-12T17:28:02.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.702+0000 7fbc45e59640 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5644772838b0 con 0x564477280d20 2024-09-12T17:28:02.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.702+0000 7fbc45e59640 1 -- 172.21.15.170:0/1946338728 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc3806b070 con 0x564477280d20 2024-09-12T17:28:02.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.702+0000 7fbc45e59640 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5644772838b0 con 0x7fbc4003d070 2024-09-12T17:28:02.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.702+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc30029040 con 0x7fbc4003d070 2024-09-12T17:28:02.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.702+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5644772838b0 con 0x564477280d20 2024-09-12T17:28:02.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.702+0000 7fbc45e59640 1 -- 172.21.15.170:0/1946338728 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc3806b070 con 0x564477280d20 2024-09-12T17:28:02.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.702+0000 7fbc45e59640 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5644772838b0 con 0x564477280d20 2024-09-12T17:28:02.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.703+0000 7fbc45e59640 1 -- 172.21.15.170:0/1946338728 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc3806b070 con 0x564477280d20 2024-09-12T17:28:02.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.703+0000 7fbc45e59640 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5644772838b0 con 0x564477277870 2024-09-12T17:28:02.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.703+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc30029040 con 0x564477277870 2024-09-12T17:28:02.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.703+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5644772838b0 con 0x564477277870 2024-09-12T17:28:02.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.703+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbc30029040 con 0x564477277870 2024-09-12T17:28:02.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.703+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5644772838b0 con 0x7fbc4003d070 2024-09-12T17:28:02.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.703+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc30029040 con 0x7fbc4003d070 2024-09-12T17:28:02.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.703+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5644772838b0 con 0x564477280d20 2024-09-12T17:28:02.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.704+0000 7fbc45e59640 1 -- 172.21.15.170:0/1946338728 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc3806b070 con 0x564477280d20 2024-09-12T17:28:02.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.704+0000 7fbc45e59640 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5644772838b0 con 0x56447727c170 2024-09-12T17:28:02.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.704+0000 7fbc4665a640 1 -- 172.21.15.170:0/1946338728 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc4000a4d0 con 0x56447727c170 2024-09-12T17:28:02.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.704+0000 7fbc4665a640 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5644772838b0 con 0x564477277870 2024-09-12T17:28:02.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.704+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc30029040 con 0x564477277870 2024-09-12T17:28:02.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.704+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5644772838b0 con 0x7fbc4003d070 2024-09-12T17:28:02.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.704+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc30029040 con 0x7fbc4003d070 2024-09-12T17:28:02.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.704+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5644772838b0 con 0x564477280d20 2024-09-12T17:28:02.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.705+0000 7fbc45e59640 1 -- 172.21.15.170:0/1946338728 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc3806b070 con 0x564477280d20 2024-09-12T17:28:02.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.705+0000 7fbc45e59640 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5644772838b0 con 0x7fbc4003d070 2024-09-12T17:28:02.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.705+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc30029040 con 0x7fbc4003d070 2024-09-12T17:28:02.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.705+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5644772838b0 con 0x56447727c170 2024-09-12T17:28:02.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.705+0000 7fbc4665a640 1 -- 172.21.15.170:0/1946338728 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc4000a4d0 con 0x56447727c170 2024-09-12T17:28:02.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.705+0000 7fbc4665a640 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5644772838b0 con 0x564477280d20 2024-09-12T17:28:02.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.705+0000 7fbc45e59640 1 -- 172.21.15.170:0/1946338728 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc3806b070 con 0x564477280d20 2024-09-12T17:28:02.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.705+0000 7fbc45e59640 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5644772838b0 con 0x7fbc4003d070 2024-09-12T17:28:02.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.706+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc30029040 con 0x7fbc4003d070 2024-09-12T17:28:02.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.706+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5644772838b0 con 0x564477277870 2024-09-12T17:28:02.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.706+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbc30029040 con 0x564477277870 2024-09-12T17:28:02.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.706+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5644772838b0 con 0x56447727c170 2024-09-12T17:28:02.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.706+0000 7fbc4665a640 1 -- 172.21.15.170:0/1946338728 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbc4000a4d0 con 0x56447727c170 2024-09-12T17:28:02.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.706+0000 7fbc4a80e800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:02.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.706+0000 7fbc4a80e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:02.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.706+0000 7fbc4a80e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:02.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.706+0000 7fbc4a80e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:02.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.706+0000 7fbc4a80e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:02.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.706+0000 7fbc4a80e800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:02.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.706+0000 7fbc4a80e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.706+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56447727f720 con 0x564477277870 2024-09-12T17:28:02.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.706+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc30029040 con 0x564477277870 2024-09-12T17:28:02.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.706+0000 7fbc4a80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:02.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.706+0000 7fbc4a80e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.706+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56447727f300 con 0x564477277870 2024-09-12T17:28:02.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.707+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbc30029040 con 0x564477277870 2024-09-12T17:28:02.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.707+0000 7fbc4a80e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:02.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.707+0000 7fbc4a80e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.707+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564477280080 con 0x56447727c170 2024-09-12T17:28:02.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.707+0000 7fbc4665a640 1 -- 172.21.15.170:0/1946338728 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbc4000a4d0 con 0x56447727c170 2024-09-12T17:28:02.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.707+0000 7fbc4a80e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:02.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.707+0000 7fbc4a80e800 20 zone default found 2024-09-12T17:28:02.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.707+0000 7fbc4a80e800 4 Realm: () 2024-09-12T17:28:02.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.707+0000 7fbc4a80e800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:02.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.707+0000 7fbc4a80e800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:02.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.707+0000 7fbc4a80e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:02.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.707+0000 7fbc4a80e800 20 zonegroup default 2024-09-12T17:28:02.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.707+0000 7fbc4a80e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.707+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56447727fc20 con 0x7fbc4003d070 2024-09-12T17:28:02.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.707+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbc30029040 con 0x7fbc4003d070 2024-09-12T17:28:02.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.707+0000 7fbc4a80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:02.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.707+0000 7fbc4a80e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.707+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564477286100 con 0x564477280d20 2024-09-12T17:28:02.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.708+0000 7fbc45e59640 1 -- 172.21.15.170:0/1946338728 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbc3806b070 con 0x564477280d20 2024-09-12T17:28:02.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.708+0000 7fbc4a80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:02.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.708+0000 7fbc4a80e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.708+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5644772864a0 con 0x564477280d20 2024-09-12T17:28:02.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.708+0000 7fbc45e59640 1 -- 172.21.15.170:0/1946338728 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbc3806b070 con 0x564477280d20 2024-09-12T17:28:02.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.708+0000 7fbc4a80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:02.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.708+0000 7fbc4a80e800 20 started sync module instance, tier type = 2024-09-12T17:28:02.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.708+0000 7fbc4a80e800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:02.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.708+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564477285590 con 0x56447727c170 2024-09-12T17:28:02.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.709+0000 7fbc4665a640 1 -- 172.21.15.170:0/1946338728 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc4000a4d0 con 0x56447727c170 2024-09-12T17:28:02.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.709+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94852056897968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564477286db0 con 0x56447727c170 2024-09-12T17:28:02.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.709+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564477287600 con 0x564477277870 2024-09-12T17:28:02.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.710+0000 7fbc4665a640 1 -- 172.21.15.170:0/1946338728 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94852056897968] v29'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc4000a4d0 con 0x56447727c170 2024-09-12T17:28:02.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.710+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc30029040 con 0x564477277870 2024-09-12T17:28:02.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.710+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94852056902160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564477287360 con 0x564477277870 2024-09-12T17:28:02.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.710+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564477287e80 con 0x564477280d20 2024-09-12T17:28:02.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.711+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94852056902160] v29'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc30029040 con 0x564477277870 2024-09-12T17:28:02.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.711+0000 7fbc45e59640 1 -- 172.21.15.170:0/1946338728 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc3806b070 con 0x564477280d20 2024-09-12T17:28:02.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.711+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94852056906064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564477288270 con 0x564477280d20 2024-09-12T17:28:02.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.711+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564477288cc0 con 0x56447727c170 2024-09-12T17:28:02.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.712+0000 7fbc45e59640 1 -- 172.21.15.170:0/1946338728 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94852056906064] v29'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc3806b070 con 0x564477280d20 2024-09-12T17:28:02.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.712+0000 7fbc4665a640 1 -- 172.21.15.170:0/1946338728 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc4000a4d0 con 0x56447727c170 2024-09-12T17:28:02.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.712+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94852056909744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5644772890b0 con 0x56447727c170 2024-09-12T17:28:02.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.712+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564477289ad0 con 0x564477277870 2024-09-12T17:28:02.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.713+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc30029040 con 0x564477277870 2024-09-12T17:28:02.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.713+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94852056913344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564477289a90 con 0x564477277870 2024-09-12T17:28:02.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.713+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56447728aa80 con 0x7fbc4003d070 2024-09-12T17:28:02.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.714+0000 7fbc4665a640 1 -- 172.21.15.170:0/1946338728 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94852056909744] v29'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc4000a4d0 con 0x56447727c170 2024-09-12T17:28:02.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.714+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94852056913344] v29'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc30029040 con 0x564477277870 2024-09-12T17:28:02.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.714+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc30029040 con 0x7fbc4003d070 2024-09-12T17:28:02.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.715+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94852056917392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564477289c70 con 0x7fbc4003d070 2024-09-12T17:28:02.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.715+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56447728b350 con 0x7fbc4003d070 2024-09-12T17:28:02.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.715+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94852056917392] v29'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc30029040 con 0x7fbc4003d070 2024-09-12T17:28:02.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.716+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(56 notify.6 [create] v29'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc30029040 con 0x7fbc4003d070 2024-09-12T17:28:02.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.716+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94852056903216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564477289c70 con 0x7fbc4003d070 2024-09-12T17:28:02.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.716+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56447728b970 con 0x7fbc4003d070 2024-09-12T17:28:02.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.717+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(58 notify.7 [create] v29'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc30029040 con 0x7fbc4003d070 2024-09-12T17:28:02.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.717+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94852056903216] v29'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc30029040 con 0x7fbc4003d070 2024-09-12T17:28:02.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.717+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94852056921280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56447728b8e0 con 0x7fbc4003d070 2024-09-12T17:28:02.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.717+0000 7fbc4a80e800 20 add_watcher() i=0 2024-09-12T17:28:02.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.717+0000 7fbc4a80e800 20 add_watcher() i=1 2024-09-12T17:28:02.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.717+0000 7fbc4a80e800 20 add_watcher() i=2 2024-09-12T17:28:02.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.717+0000 7fbc4a80e800 20 add_watcher() i=3 2024-09-12T17:28:02.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.717+0000 7fbc4a80e800 20 add_watcher() i=4 2024-09-12T17:28:02.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.717+0000 7fbc4a80e800 20 add_watcher() i=5 2024-09-12T17:28:02.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.717+0000 7fbc4a80e800 20 add_watcher() i=6 2024-09-12T17:28:02.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.718+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94852056921280] v29'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc30029040 con 0x7fbc4003d070 2024-09-12T17:28:02.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.718+0000 7fbc4a80e800 20 add_watcher() i=7 2024-09-12T17:28:02.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.718+0000 7fbc4a80e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:02.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.718+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56447728ed10 con 0x564477277870 2024-09-12T17:28:02.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.718+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbc30029040 con 0x564477277870 2024-09-12T17:28:02.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.718+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94852056919712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56447728c230 con 0x564477277870 2024-09-12T17:28:02.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.719+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94852056919712] v29'96 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbc30029040 con 0x564477277870 2024-09-12T17:28:02.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.719+0000 7fbaf7fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:02.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.719+0000 7fbc4a80e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:02.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.719+0000 7fbc4a80e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:02.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.719+0000 7fbc4a80e800 5 note: GC not initialized 2024-09-12T17:28:02.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.719+0000 7fbaf6ffd640 20 reqs_thread_entry: start 2024-09-12T17:28:02.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.719+0000 7fbc4a80e800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:02.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.720+0000 7fbc4a80e800 20 Filter name: none 2024-09-12T17:28:02.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.720+0000 7fbaf4ff9640 20 reqs_thread_entry: start 2024-09-12T17:28:02.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.720+0000 7fbc4a80e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.720+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5644772c1f10 con 0x56447727c170 2024-09-12T17:28:02.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.720+0000 7fbc4665a640 1 -- 172.21.15.170:0/1946338728 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fbc4000a4d0 con 0x56447727c170 2024-09-12T17:28:02.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.720+0000 7fbc4a80e800 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T17:28:02.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.720+0000 7fbc4a80e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.720+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:63 8.1d 8:baccd554:root::.bucket.meta.myfoo%3a7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5644772c27a0 con 0x7fbc4003d070 2024-09-12T17:28:02.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.721+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(63 .bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fbc30029040 con 0x7fbc4003d070 2024-09-12T17:28:02.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.721+0000 7fbc4a80e800 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T17:28:02.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.721+0000 7fbc4a80e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:28:02.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.721+0000 7fbc4a80e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.721+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5644772c1220 con 0x56447727c170 2024-09-12T17:28:02.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.721+0000 7fbc4665a640 1 -- 172.21.15.170:0/1946338728 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fbc4000a4d0 con 0x56447727c170 2024-09-12T17:28:02.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.721+0000 7fbc4a80e800 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T17:28:02.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.721+0000 7fbc4a80e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.721+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:65 8.1d 8:baccd554:root::.bucket.meta.myfoo%3a7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5644772c3dd0 con 0x7fbc4003d070 2024-09-12T17:28:02.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.721+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(65 .bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fbc30029040 con 0x7fbc4003d070 2024-09-12T17:28:02.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.721+0000 7fbc4a80e800 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T17:28:02.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.721+0000 7fbc4a80e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:28:02.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.721+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:66 4.33 4:cf7a7992:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5644772c3740 con 0x7fbc4003d070 2024-09-12T17:28:02.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.721+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:67 4.a 4:523b0550:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5644772c84c0 con 0x56447727c170 2024-09-12T17:28:02.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.721+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:68 4.2e 4:74d1473b:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5644772cb040 con 0x564477280d20 2024-09-12T17:28:02.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.721+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:69 4.12 4:4b79d0ba:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5644772cd930 con 0x564477277870 2024-09-12T17:28:02.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.722+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:70 4.20 4:058cb7b5:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5644772d0310 con 0x564477277870 2024-09-12T17:28:02.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.722+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:71 4.3 4:c2f55514:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5644772d31d0 con 0x564477277870 2024-09-12T17:28:02.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.722+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:72 4.3e 4:7f412122:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5644772d5e90 con 0x56447727c170 2024-09-12T17:28:02.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.722+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(66 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fbc30029040 con 0x7fbc4003d070 2024-09-12T17:28:02.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.722+0000 7fbc4665a640 1 -- 172.21.15.170:0/1946338728 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(67 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fbc4006d040 con 0x56447727c170 2024-09-12T17:28:02.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.722+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:73 4.9 4:916cfff6:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5644772cb040 con 0x564477277870 2024-09-12T17:28:02.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.722+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:74 4.3f 4:fe994f63:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5644772d6230 con 0x56447727c170 2024-09-12T17:28:02.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.722+0000 7fbc45e59640 1 -- 172.21.15.170:0/1946338728 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(68 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fbc3806b070 con 0x564477280d20 2024-09-12T17:28:02.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.722+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:75 4.3f 4:fcb62fad:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5644772d8e00 con 0x56447727c170 2024-09-12T17:28:02.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.722+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(69 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fbc30029040 con 0x564477277870 2024-09-12T17:28:02.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.722+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(70 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fbc30029040 con 0x564477277870 2024-09-12T17:28:02.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.722+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(71 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fbc30029040 con 0x564477277870 2024-09-12T17:28:02.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.722+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:76 4.16 4:6840e132:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5644772cab80 con 0x564477280d20 2024-09-12T17:28:02.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.722+0000 7fbc4665a640 1 -- 172.21.15.170:0/1946338728 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(72 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fbc4006d040 con 0x56447727c170 2024-09-12T17:28:02.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.722+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(73 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fbc30029040 con 0x564477277870 2024-09-12T17:28:02.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.722+0000 7fbc45e59640 1 -- 172.21.15.170:0/1946338728 <== osd.3 v2:172.21.15.170:6816/2664906588 15 ==== osd_op_reply(76 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fbc3806b070 con 0x564477280d20 2024-09-12T17:28:02.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.723+0000 7fbc4665a640 1 -- 172.21.15.170:0/1946338728 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== osd_op_reply(74 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fbc4006d040 con 0x56447727c170 2024-09-12T17:28:02.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.723+0000 7fbc4665a640 1 -- 172.21.15.170:0/1946338728 <== osd.2 v2:172.21.15.170:6808/3855567754 18 ==== osd_op_reply(75 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.9 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fbc4006d040 con 0x56447727c170 2024-09-12T17:28:02.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.724+0000 7fbaf7fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:02.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.724+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94852056919712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5644772bf8d0 con 0x564477277870 2024-09-12T17:28:02.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.725+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94852056919712] v29'97 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbc30029040 con 0x564477277870 2024-09-12T17:28:02.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.725+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94852056897968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5644772bf8d0 con 0x56447727c170 2024-09-12T17:28:02.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.726+0000 7fbc4665a640 1 -- 172.21.15.170:0/1946338728 <== osd.2 v2:172.21.15.170:6808/3855567754 19 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94852056897968] v29'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc4006d040 con 0x56447727c170 2024-09-12T17:28:02.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.726+0000 7fbc4a80e800 20 remove_watcher() i=0 2024-09-12T17:28:02.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.726+0000 7fbc4a80e800 2 removed watcher, disabling cache 2024-09-12T17:28:02.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.726+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94852056902160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5644772bf8d0 con 0x564477277870 2024-09-12T17:28:02.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.727+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94852056902160] v29'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc30029040 con 0x564477277870 2024-09-12T17:28:02.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.727+0000 7fbc4a80e800 20 remove_watcher() i=1 2024-09-12T17:28:02.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.727+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94852056906064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5644772bf8d0 con 0x564477280d20 2024-09-12T17:28:02.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.728+0000 7fbc45e59640 1 -- 172.21.15.170:0/1946338728 <== osd.3 v2:172.21.15.170:6816/2664906588 16 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94852056906064] v29'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc3806b070 con 0x564477280d20 2024-09-12T17:28:02.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.728+0000 7fbc4a80e800 20 remove_watcher() i=2 2024-09-12T17:28:02.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.728+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94852056909744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5644772bf8d0 con 0x56447727c170 2024-09-12T17:28:02.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.729+0000 7fbc4665a640 1 -- 172.21.15.170:0/1946338728 <== osd.2 v2:172.21.15.170:6808/3855567754 20 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94852056909744] v29'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc4006d040 con 0x56447727c170 2024-09-12T17:28:02.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.729+0000 7fbc4a80e800 20 remove_watcher() i=3 2024-09-12T17:28:02.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.729+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94852056913344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5644772bf8d0 con 0x564477277870 2024-09-12T17:28:02.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.730+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94852056913344] v29'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc30029040 con 0x564477277870 2024-09-12T17:28:02.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.730+0000 7fbc4a80e800 20 remove_watcher() i=4 2024-09-12T17:28:02.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.730+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94852056917392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5644772bf8d0 con 0x7fbc4003d070 2024-09-12T17:28:02.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.731+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94852056917392] v29'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc30029040 con 0x7fbc4003d070 2024-09-12T17:28:02.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.731+0000 7fbc4a80e800 20 remove_watcher() i=5 2024-09-12T17:28:02.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.731+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94852056903216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5644772bf8d0 con 0x7fbc4003d070 2024-09-12T17:28:02.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.732+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94852056903216] v29'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc30029040 con 0x7fbc4003d070 2024-09-12T17:28:02.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.732+0000 7fbc4a80e800 20 remove_watcher() i=6 2024-09-12T17:28:02.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.732+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94852056921280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5644772bf8d0 con 0x7fbc4003d070 2024-09-12T17:28:02.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.733+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 <== osd.0 v2:172.21.15.47:6800/3978157098 22 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94852056921280] v29'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc30029040 con 0x7fbc4003d070 2024-09-12T17:28:02.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.733+0000 7fbc4a80e800 20 remove_watcher() i=7 2024-09-12T17:28:02.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.733+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fbc4003d070 msgr2=0x7fbc4003ca70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.733+0000 7fbc4a80e800 1 --2- 172.21.15.170:0/1946338728 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fbc4003d070 0x7fbc4003ca70 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.733+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564477277870 msgr2=0x564477279d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.733+0000 7fbc4a80e800 1 --2- 172.21.15.170:0/1946338728 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564477277870 0x564477279d30 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.733+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56447727c170 msgr2=0x56447727e560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.733+0000 7fbc4a80e800 1 --2- 172.21.15.170:0/1946338728 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56447727c170 0x56447727e560 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.733+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x564477280d20 msgr2=0x5644772831e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.733+0000 7fbc4a80e800 1 --2- 172.21.15.170:0/1946338728 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x564477280d20 0x5644772831e0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.733+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbb1003c780 msgr2=0x7fbb1003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.733+0000 7fbc4a80e800 1 --2- 172.21.15.170:0/1946338728 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbb1003c780 0x7fbb1003ec40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbc380075e0 tx=0x7fbc3808c000 comp rx=0 tx=0).stop 2024-09-12T17:28:02.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.733+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5644772649a0 msgr2=0x56447726bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.733+0000 7fbc4a80e800 1 --2- 172.21.15.170:0/1946338728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5644772649a0 0x56447726bf40 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fbc40053ca0 tx=0x7fbc40053d00 comp rx=0 tx=0).stop 2024-09-12T17:28:02.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.733+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 reap_dead start 2024-09-12T17:28:02.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.733+0000 7fbc3ffff640 1 -- 172.21.15.170:0/1946338728 reap_dead start 2024-09-12T17:28:02.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.733+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 shutdown_connections 2024-09-12T17:28:02.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.733+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 >> 172.21.15.170:0/1946338728 conn(0x564477260dc0 msgr2=0x56447725efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:02.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.733+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 shutdown_connections 2024-09-12T17:28:02.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.733+0000 7fbc4a80e800 1 -- 172.21.15.170:0/1946338728 wait complete. 2024-09-12T17:28:02.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.733+0000 7fbc4a80e800 1 -- 172.21.15.170:0/210008757 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbb2003c730 msgr2=0x7fbb2003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.733+0000 7fbc4a80e800 1 --2- 172.21.15.170:0/210008757 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbb2003c730 0x7fbb2003ebf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbc38007810 tx=0x7fbc3806ef90 comp rx=0 tx=0).stop 2024-09-12T17:28:02.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.733+0000 7fbc4a80e800 1 -- 172.21.15.170:0/210008757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564477257f00 msgr2=0x564477258320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.733+0000 7fbc4a80e800 1 --2- 172.21.15.170:0/210008757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564477257f00 0x564477258320 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x56447723e110 tx=0x7fbc400167b0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.734+0000 7fbc4a80e800 1 -- 172.21.15.170:0/210008757 shutdown_connections 2024-09-12T17:28:02.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.734+0000 7fbc4a80e800 1 --2- 172.21.15.170:0/210008757 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbb2003c730 0x7fbb2003ebf0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.734+0000 7fbc4a80e800 1 --2- 172.21.15.170:0/210008757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564477257f00 0x564477258320 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.734+0000 7fbc4a80e800 1 -- 172.21.15.170:0/210008757 >> 172.21.15.170:0/210008757 conn(0x56447724c2b0 msgr2=0x56447724c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:02.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.734+0000 7fbc4a80e800 1 -- 172.21.15.170:0/210008757 shutdown_connections 2024-09-12T17:28:02.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.734+0000 7fbc4a80e800 1 -- 172.21.15.170:0/210008757 wait complete. 2024-09-12T17:28:02.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.734+0000 7fbc4a80e800 1 -- 172.21.15.170:0/384935897 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564477144030 msgr2=0x564477244760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.734+0000 7fbc4a80e800 1 --2- 172.21.15.170:0/384935897 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564477144030 0x564477244760 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.734+0000 7fbc4a80e800 1 -- 172.21.15.170:0/384935897 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564477246b00 msgr2=0x564477248f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.734+0000 7fbc4a80e800 1 --2- 172.21.15.170:0/384935897 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564477246b00 0x564477248f80 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.734+0000 7fbc4a80e800 1 -- 172.21.15.170:0/384935897 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbb2c03c780 msgr2=0x7fbb2c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.734+0000 7fbc4a80e800 1 --2- 172.21.15.170:0/384935897 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbb2c03c780 0x7fbb2c03ec40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbc30001d70 tx=0x7fbc300012d0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.734+0000 7fbc4a80e800 1 -- 172.21.15.170:0/384935897 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564477142df0 msgr2=0x56447723d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.734+0000 7fbc4a80e800 1 --2- 172.21.15.170:0/384935897 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564477142df0 0x56447723d110 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fbc3800a1d0 tx=0x7fbc38002fb0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.734+0000 7fbc4a80e800 1 -- 172.21.15.170:0/384935897 shutdown_connections 2024-09-12T17:28:02.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.734+0000 7fbc4a80e800 1 --2- 172.21.15.170:0/384935897 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564477246b00 0x564477248f80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.734+0000 7fbc4a80e800 1 --2- 172.21.15.170:0/384935897 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbb2c03c780 0x7fbb2c03ec40 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.734+0000 7fbc4a80e800 1 --2- 172.21.15.170:0/384935897 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564477144030 0x564477244760 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.734+0000 7fbc4a80e800 1 --2- 172.21.15.170:0/384935897 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564477142df0 0x56447723d110 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.734+0000 7fbc4a80e800 1 -- 172.21.15.170:0/384935897 >> 172.21.15.170:0/384935897 conn(0x56447713e1c0 msgr2=0x564477232620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:02.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.734+0000 7fbc4a80e800 1 -- 172.21.15.170:0/384935897 shutdown_connections 2024-09-12T17:28:02.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.734+0000 7fbc4a80e800 1 -- 172.21.15.170:0/384935897 wait complete. 2024-09-12T17:28:02.759 INFO:teuthology.orchestra.run.smithi170.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"dc43fae2-274b-4ee4-ac82-d8ac27e45bf4","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1","marker":"7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-12T17:28:02.192296Z","creation_time":"2024-09-12T17:28:02.189371Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":1} 2024-09-12T17:28:02.759 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'dc43fae2-274b-4ee4-ac82-d8ac27e45bf4', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1', 'marker': '7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-12T17:28:02.192296Z', 'creation_time': '2024-09-12T17:28:02.189371Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-12T17:28:02.759 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-12T17:28:02.759 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-12T17:28:02.760 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-12T17:28:02.846 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:02.846 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:02.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.842+0000 7f15f1546800 1 Processor -- start 2024-09-12T17:28:02.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.842+0000 7f15f1546800 1 -- start start 2024-09-12T17:28:02.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.842+0000 7f15f1546800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5557f3fc8200 0x5557f3fcdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.842+0000 7f15f1546800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5557f3e71e40 con 0x5557f3fc6df0 2024-09-12T17:28:02.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.842+0000 7f15f1546800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x5557f3e3c680 con 0x5557f3fc8200 2024-09-12T17:28:02.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.843+0000 7f15e6836640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5557f3fc8200 0x5557f3fcdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.843+0000 7f15ef037640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x5557f3fc6df0 0x5557f3fc7af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:48418/0 (socket says 172.21.15.170:48418) 2024-09-12T17:28:02.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.843+0000 7f15ef037640 1 -- 172.21.15.170:0/1576130022 learned_addr learned my addr 172.21.15.170:0/1576130022 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:28:02.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.843+0000 7f15e6836640 1 --2- 172.21.15.170:0/1576130022 >> v2:172.21.15.47:3300/0 conn(0x5557f3fc8200 0x5557f3fcdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57788/0 (socket says 172.21.15.170:57788) 2024-09-12T17:28:02.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.843+0000 7f15e6836640 1 -- 172.21.15.170:0/1576130022 >> v1:172.21.15.47:6789/0 conn(0x5557f3fc6df0 legacy=0x5557f3fc7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.843+0000 7f15e6836640 1 -- 172.21.15.170:0/1576130022 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557f3e586b0 con 0x5557f3fc8200 2024-09-12T17:28:02.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.845+0000 7f15e6836640 1 --2- 172.21.15.170:0/1576130022 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557f3fc8200 0x5557f3fcdda0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f15d800a470 tx=0x7f15d8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=191b3c08b1985102 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.845+0000 7f15ee836640 1 -- 172.21.15.170:0/1576130022 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15d8053570 con 0x5557f3fc8200 2024-09-12T17:28:02.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.845+0000 7f15ee836640 1 -- 172.21.15.170:0/1576130022 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15d8058070 con 0x5557f3fc8200 2024-09-12T17:28:02.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.845+0000 7f15ee836640 1 -- 172.21.15.170:0/1576130022 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15d8053880 con 0x5557f3fc8200 2024-09-12T17:28:02.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.845+0000 7f15f1546800 1 -- 172.21.15.170:0/1576130022 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557f3fc8200 msgr2=0x5557f3fcdda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.845+0000 7f15f1546800 1 --2- 172.21.15.170:0/1576130022 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557f3fc8200 0x5557f3fcdda0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f15d800a470 tx=0x7f15d8045a20 comp rx=0 tx=0).stop 2024-09-12T17:28:02.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.845+0000 7f15f1546800 1 -- 172.21.15.170:0/1576130022 shutdown_connections 2024-09-12T17:28:02.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.846+0000 7f15f1546800 1 --2- 172.21.15.170:0/1576130022 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557f3fc8200 0x5557f3fcdda0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.846+0000 7f15f1546800 1 -- 172.21.15.170:0/1576130022 >> 172.21.15.170:0/1576130022 conn(0x5557f3fc21c0 msgr2=0x5557f3fc4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:02.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.846+0000 7f15f1546800 1 -- 172.21.15.170:0/1576130022 shutdown_connections 2024-09-12T17:28:02.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.846+0000 7f15f1546800 1 -- 172.21.15.170:0/1576130022 wait complete. 2024-09-12T17:28:02.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.859+0000 7f15f1546800 1 Processor -- start 2024-09-12T17:28:02.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.860+0000 7f15f1546800 1 -- start start 2024-09-12T17:28:02.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.860+0000 7f15f1546800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557f3fc6df0 0x5557f40b7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.860+0000 7f15f1546800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5557f3e60dd0 con 0x5557f3fc6df0 2024-09-12T17:28:02.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.860+0000 7f15ef037640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557f3fc6df0 0x5557f40b7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.860+0000 7f15ef037640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557f3fc6df0 0x5557f40b7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57804/0 (socket says 172.21.15.170:57804) 2024-09-12T17:28:02.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.860+0000 7f15ef037640 1 -- 172.21.15.170:0/3876932880 learned_addr learned my addr 172.21.15.170:0/3876932880 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:02.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.860+0000 7f15ef037640 1 -- 172.21.15.170:0/3876932880 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557f3e79e10 con 0x5557f3fc6df0 2024-09-12T17:28:02.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.860+0000 7f15ef037640 1 --2- 172.21.15.170:0/3876932880 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557f3fc6df0 0x5557f40b7660 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f15e0001df0 tx=0x7f15e000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8835e5bb7425b1f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.861+0000 7f14dd60a640 1 -- 172.21.15.170:0/3876932880 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15e0012020 con 0x5557f3fc6df0 2024-09-12T17:28:02.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.861+0000 7f14dd60a640 1 -- 172.21.15.170:0/3876932880 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15e000e470 con 0x5557f3fc6df0 2024-09-12T17:28:02.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.861+0000 7f14dd60a640 1 -- 172.21.15.170:0/3876932880 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15e000e7f0 con 0x5557f3fc6df0 2024-09-12T17:28:02.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.861+0000 7f15f1546800 1 -- 172.21.15.170:0/3876932880 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557f3fc6df0 msgr2=0x5557f40b7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.861+0000 7f15f1546800 1 --2- 172.21.15.170:0/3876932880 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557f3fc6df0 0x5557f40b7660 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f15e0001df0 tx=0x7f15e000b6c0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.861+0000 7f15f1546800 1 -- 172.21.15.170:0/3876932880 shutdown_connections 2024-09-12T17:28:02.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.861+0000 7f15f1546800 1 --2- 172.21.15.170:0/3876932880 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557f3fc6df0 0x5557f40b7660 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.861+0000 7f15f1546800 1 -- 172.21.15.170:0/3876932880 >> 172.21.15.170:0/3876932880 conn(0x5557f3fc21c0 msgr2=0x5557f40b2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:02.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.861+0000 7f15f1546800 1 -- 172.21.15.170:0/3876932880 shutdown_connections 2024-09-12T17:28:02.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.861+0000 7f15f1546800 1 -- 172.21.15.170:0/3876932880 wait complete. 2024-09-12T17:28:02.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.862+0000 7f15f1546800 1 Processor -- start 2024-09-12T17:28:02.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.862+0000 7f15f1546800 1 -- start start 2024-09-12T17:28:02.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.862+0000 7f15f1546800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557f3fc6df0 0x5557f3fd0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.862+0000 7f15f1546800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5557f3fc88f0 con 0x5557f3fc6df0 2024-09-12T17:28:02.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.862+0000 7f15ef037640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557f3fc6df0 0x5557f3fd0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.862+0000 7f15ef037640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557f3fc6df0 0x5557f3fd0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57820/0 (socket says 172.21.15.170:57820) 2024-09-12T17:28:02.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.862+0000 7f15ef037640 1 -- 172.21.15.170:0/3504007914 learned_addr learned my addr 172.21.15.170:0/3504007914 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:02.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.862+0000 7f15ef037640 1 -- 172.21.15.170:0/3504007914 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557f3fd1180 con 0x5557f3fc6df0 2024-09-12T17:28:02.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.862+0000 7f15ef037640 1 --2- 172.21.15.170:0/3504007914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557f3fc6df0 0x5557f3fd0c20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x5557f40b85f0 tx=0x7f15e0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.863+0000 7f14dbe07640 1 -- 172.21.15.170:0/3504007914 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15e0012030 con 0x5557f3fc6df0 2024-09-12T17:28:02.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.863+0000 7f14dbe07640 1 -- 172.21.15.170:0/3504007914 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15e0001450 con 0x5557f3fc6df0 2024-09-12T17:28:02.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.863+0000 7f14dbe07640 1 -- 172.21.15.170:0/3504007914 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15e001a7a0 con 0x5557f3fc6df0 2024-09-12T17:28:02.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.863+0000 7f15f1546800 1 -- 172.21.15.170:0/3504007914 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5557f3fcf530 con 0x5557f3fc6df0 2024-09-12T17:28:02.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.863+0000 7f15f1546800 1 -- 172.21.15.170:0/3504007914 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557f3fcfaf0 con 0x5557f3fc6df0 2024-09-12T17:28:02.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.863+0000 7f14dbe07640 1 -- 172.21.15.170:0/3504007914 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f15e0015020 con 0x5557f3fc6df0 2024-09-12T17:28:02.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.864+0000 7f14dbe07640 1 --2- 172.21.15.170:0/3504007914 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f14d403c780 0x7f14d403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.864+0000 7f14dbe07640 1 -- 172.21.15.170:0/3504007914 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f15e0020030 con 0x5557f3fc6df0 2024-09-12T17:28:02.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.864+0000 7f15e6836640 1 --2- 172.21.15.170:0/3504007914 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f14d403c780 0x7f14d403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.864+0000 7f15f1546800 1 --2- 172.21.15.170:0/3504007914 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5557f3fc8200 0x5557f40c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.864+0000 7f15f1546800 1 -- 172.21.15.170:0/3504007914 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5557f40c8a70 con 0x5557f3fc8200 2024-09-12T17:28:02.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.864+0000 7f15ef838640 1 --2- 172.21.15.170:0/3504007914 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5557f3fc8200 0x5557f40c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.864+0000 7f15e6836640 1 --2- 172.21.15.170:0/3504007914 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f14d403c780 0x7f14d403ec40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f15d8057000 tx=0x7f15d8052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.864+0000 7f15ef838640 1 --2- 172.21.15.170:0/3504007914 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5557f3fc8200 0x5557f40c8530 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.865+0000 7f15ef838640 1 -- 172.21.15.170:0/3504007914 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f15e800a4d0 con 0x5557f3fc8200 2024-09-12T17:28:02.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.865+0000 7f15f1546800 1 -- 172.21.15.170:0/3504007914 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5557f3fd0000 con 0x5557f3fc8200 2024-09-12T17:28:02.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.865+0000 7f15ef838640 1 -- 172.21.15.170:0/3504007914 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f15e800a4d0 con 0x5557f3fc8200 2024-09-12T17:28:02.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.865+0000 7f15f1546800 1 --2- 172.21.15.170:0/3504007914 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5557f40cada0 0x5557f40cd190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.865+0000 7f15f1546800 1 -- 172.21.15.170:0/3504007914 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5557f40cd860 con 0x5557f40cada0 2024-09-12T17:28:02.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.865+0000 7f15ef037640 1 --2- 172.21.15.170:0/3504007914 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5557f40cada0 0x5557f40cd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.865+0000 7f15ef037640 1 --2- 172.21.15.170:0/3504007914 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5557f40cada0 0x5557f40cd190 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.865+0000 7f15ef037640 1 -- 172.21.15.170:0/3504007914 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f15e00187b0 con 0x5557f40cada0 2024-09-12T17:28:02.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.866+0000 7f15f1546800 1 -- 172.21.15.170:0/3504007914 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5557f40c9c40 con 0x5557f3fc8200 2024-09-12T17:28:02.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.866+0000 7f15ef838640 1 -- 172.21.15.170:0/3504007914 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f15e800a4d0 con 0x5557f3fc8200 2024-09-12T17:28:02.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.866+0000 7f15f1546800 1 -- 172.21.15.170:0/3504007914 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5557f40ca0e0 con 0x5557f40cada0 2024-09-12T17:28:02.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.866+0000 7f15ef037640 1 -- 172.21.15.170:0/3504007914 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f15e00187b0 con 0x5557f40cada0 2024-09-12T17:28:02.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.866+0000 7f15f1546800 1 Processor -- start 2024-09-12T17:28:02.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.866+0000 7f15f1546800 1 -- start start 2024-09-12T17:28:02.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.867+0000 7f15f1546800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557f40dc110 0x5557f40dc530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.867+0000 7f15f1546800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5557f3ebea00 con 0x5557f40dc110 2024-09-12T17:28:02.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.867+0000 7f15ef838640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557f40dc110 0x5557f40dc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.867+0000 7f15ef838640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557f40dc110 0x5557f40dc530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57822/0 (socket says 172.21.15.170:57822) 2024-09-12T17:28:02.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.867+0000 7f15ef838640 1 -- 172.21.15.170:0/2836193769 learned_addr learned my addr 172.21.15.170:0/2836193769 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:02.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.867+0000 7f15ef838640 1 -- 172.21.15.170:0/2836193769 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557f40dcb70 con 0x5557f40dc110 2024-09-12T17:28:02.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.867+0000 7f15ef838640 1 --2- 172.21.15.170:0/2836193769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557f40dc110 0x5557f40dc530 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x5557f3fcfd10 tx=0x7f15e80167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.867+0000 7f14d9602640 1 -- 172.21.15.170:0/2836193769 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15e8013640 con 0x5557f40dc110 2024-09-12T17:28:02.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.867+0000 7f14d9602640 1 -- 172.21.15.170:0/2836193769 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15e80137e0 con 0x5557f40dc110 2024-09-12T17:28:02.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.867+0000 7f15f1546800 1 -- 172.21.15.170:0/2836193769 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5557f40dd3a0 con 0x5557f40dc110 2024-09-12T17:28:02.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.867+0000 7f14d9602640 1 -- 172.21.15.170:0/2836193769 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15e8013ac0 con 0x5557f40dc110 2024-09-12T17:28:02.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.868+0000 7f15f1546800 1 -- 172.21.15.170:0/2836193769 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557f40dd940 con 0x5557f40dc110 2024-09-12T17:28:02.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.868+0000 7f14d9602640 1 -- 172.21.15.170:0/2836193769 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f15e8011040 con 0x5557f40dc110 2024-09-12T17:28:02.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.869+0000 7f14d9602640 1 --2- 172.21.15.170:0/2836193769 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f14c803c780 0x7f14c803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.869+0000 7f14d9602640 1 -- 172.21.15.170:0/2836193769 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f15e800e040 con 0x5557f40dc110 2024-09-12T17:28:02.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.869+0000 7f15ef037640 1 --2- 172.21.15.170:0/2836193769 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f14c803c780 0x7f14c803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.869+0000 7f15f1546800 1 Processor -- start 2024-09-12T17:28:02.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.869+0000 7f15ef037640 1 --2- 172.21.15.170:0/2836193769 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f14c803c780 0x7f14c803ec40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x5557f40c8f40 tx=0x7f15e004d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.869+0000 7f15f1546800 1 -- start start 2024-09-12T17:28:02.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.869+0000 7f15f1546800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557f40e8b90 0x5557f40e8f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.869+0000 7f15f1546800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5557f40b7eb0 con 0x5557f40e8b90 2024-09-12T17:28:02.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.869+0000 7f15ef838640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557f40e8b90 0x5557f40e8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.869+0000 7f15ef838640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557f40e8b90 0x5557f40e8f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57832/0 (socket says 172.21.15.170:57832) 2024-09-12T17:28:02.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.869+0000 7f15ef838640 1 -- 172.21.15.170:0/2788960231 learned_addr learned my addr 172.21.15.170:0/2788960231 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:02.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.870+0000 7f15ef838640 1 -- 172.21.15.170:0/2788960231 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557f40e9580 con 0x5557f40e8b90 2024-09-12T17:28:02.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.870+0000 7f15ef838640 1 --2- 172.21.15.170:0/2788960231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557f40e8b90 0x5557f40e8f90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f15e8013dd0 tx=0x7f15e8013f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdfe09b20a68473d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.870+0000 7f14d2ffd640 1 -- 172.21.15.170:0/2788960231 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15e8021a90 con 0x5557f40e8b90 2024-09-12T17:28:02.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.870+0000 7f14d2ffd640 1 -- 172.21.15.170:0/2788960231 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15e8021440 con 0x5557f40e8b90 2024-09-12T17:28:02.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.870+0000 7f14d2ffd640 1 -- 172.21.15.170:0/2788960231 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15e8020bd0 con 0x5557f40e8b90 2024-09-12T17:28:02.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.870+0000 7f15f1546800 1 -- 172.21.15.170:0/2788960231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557f40e8b90 msgr2=0x5557f40e8f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.870+0000 7f15f1546800 1 --2- 172.21.15.170:0/2788960231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557f40e8b90 0x5557f40e8f90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f15e8013dd0 tx=0x7f15e8013f00 comp rx=0 tx=0).stop 2024-09-12T17:28:02.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.870+0000 7f15f1546800 1 -- 172.21.15.170:0/2788960231 shutdown_connections 2024-09-12T17:28:02.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.870+0000 7f15f1546800 1 --2- 172.21.15.170:0/2788960231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557f40e8b90 0x5557f40e8f90 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.870+0000 7f15f1546800 1 -- 172.21.15.170:0/2788960231 >> 172.21.15.170:0/2788960231 conn(0x5557f40e4f90 msgr2=0x5557f40e31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:02.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.870+0000 7f15f1546800 1 -- 172.21.15.170:0/2788960231 shutdown_connections 2024-09-12T17:28:02.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.871+0000 7f15f1546800 1 -- 172.21.15.170:0/2788960231 wait complete. 2024-09-12T17:28:02.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.871+0000 7f15f1546800 1 Processor -- start 2024-09-12T17:28:02.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.871+0000 7f15f1546800 1 -- start start 2024-09-12T17:28:02.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.871+0000 7f15f1546800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557f40e8b90 0x5557f40f00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.871+0000 7f15f1546800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5557f40e9b70 con 0x5557f40e8b90 2024-09-12T17:28:02.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.871+0000 7f15ef838640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557f40e8b90 0x5557f40f00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.871+0000 7f15ef838640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557f40e8b90 0x5557f40f00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57836/0 (socket says 172.21.15.170:57836) 2024-09-12T17:28:02.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.871+0000 7f15ef838640 1 -- 172.21.15.170:0/3531863366 learned_addr learned my addr 172.21.15.170:0/3531863366 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:02.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.871+0000 7f15ef838640 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557f40f0600 con 0x5557f40e8b90 2024-09-12T17:28:02.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.872+0000 7f15ef838640 1 --2- 172.21.15.170:0/3531863366 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557f40e8b90 0x5557f40f00a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f15e8013dd0 tx=0x7f15e8053ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.872+0000 7f14d17fa640 1 -- 172.21.15.170:0/3531863366 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15e8037070 con 0x5557f40e8b90 2024-09-12T17:28:02.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.872+0000 7f14d17fa640 1 -- 172.21.15.170:0/3531863366 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15e80215f0 con 0x5557f40e8b90 2024-09-12T17:28:02.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.872+0000 7f14d17fa640 1 -- 172.21.15.170:0/3531863366 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15e804a040 con 0x5557f40e8b90 2024-09-12T17:28:02.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.872+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5557f40f0890 con 0x5557f40e8b90 2024-09-12T17:28:02.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.872+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557f40f1420 con 0x5557f40e8b90 2024-09-12T17:28:02.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.873+0000 7f14d17fa640 1 -- 172.21.15.170:0/3531863366 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f15e803a070 con 0x5557f40e8b90 2024-09-12T17:28:02.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.873+0000 7f14d17fa640 1 --2- 172.21.15.170:0/3531863366 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f14b803c780 0x7f14b803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.873+0000 7f14d17fa640 1 -- 172.21.15.170:0/3531863366 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f15e803daf0 con 0x5557f40e8b90 2024-09-12T17:28:02.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.873+0000 7f15ef037640 1 --2- 172.21.15.170:0/3531863366 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f14b803c780 0x7f14b803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.873+0000 7f15f1546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.873+0000 7f15f1546800 1 --2- 172.21.15.170:0/3531863366 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5557f40fba10 0x5557f40fdea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.873+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5557f40fe5f0 con 0x5557f40fba10 2024-09-12T17:28:02.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.873+0000 7f15e6836640 1 --2- 172.21.15.170:0/3531863366 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5557f40fba10 0x5557f40fdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.873+0000 7f15ef037640 1 --2- 172.21.15.170:0/3531863366 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f14b803c780 0x7f14b803ec40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f15e0018ac0 tx=0x7f15e0049000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.874+0000 7f15e6836640 1 --2- 172.21.15.170:0/3531863366 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5557f40fba10 0x5557f40fdea0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.874+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f15d8051070 con 0x5557f40fba10 2024-09-12T17:28:02.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.874+0000 7f15f1546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:02.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.874+0000 7f15f1546800 20 realm 2024-09-12T17:28:02.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.874+0000 7f15f1546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.874+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5557f40fea20 con 0x5557f40fba10 2024-09-12T17:28:02.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.874+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f15d8051070 con 0x5557f40fba10 2024-09-12T17:28:02.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.874+0000 7f15f1546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:02.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.874+0000 7f15f1546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:02.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.874+0000 7f15f1546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.874+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5557f40ff2f0 con 0x5557f40fba10 2024-09-12T17:28:02.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.874+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f15d8051070 con 0x5557f40fba10 2024-09-12T17:28:02.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.874+0000 7f15f1546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:02.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.874+0000 7f15f1546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.874+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5557f40ff690 con 0x5557f40fba10 2024-09-12T17:28:02.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.875+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f15d8051070 con 0x5557f40fba10 2024-09-12T17:28:02.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.875+0000 7f15f1546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:02.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.875+0000 7f15f1546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.875+0000 7f15f1546800 1 --2- 172.21.15.170:0/3531863366 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5557f41003f0 0x5557f41027e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.875+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5557f4102d20 con 0x5557f41003f0 2024-09-12T17:28:02.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.875+0000 7f15ef838640 1 --2- 172.21.15.170:0/3531863366 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5557f41003f0 0x5557f41027e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.875+0000 7f15ef838640 1 --2- 172.21.15.170:0/3531863366 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5557f41003f0 0x5557f41027e0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.875+0000 7f15ef838640 1 -- 172.21.15.170:0/3531863366 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f15e8039030 con 0x5557f41003f0 2024-09-12T17:28:02.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.875+0000 7f15f1546800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:02.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.875+0000 7f15f1546800 20 searching for the correct realm 2024-09-12T17:28:02.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.875+0000 7f15f1546800 1 --2- 172.21.15.170:0/3531863366 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5557f4104d60 0x5557f4107220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.875+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5557f41078f0 con 0x5557f4104d60 2024-09-12T17:28:02.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.875+0000 7f15ef037640 1 --2- 172.21.15.170:0/3531863366 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5557f4104d60 0x5557f4107220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.876+0000 7f15ef037640 1 --2- 172.21.15.170:0/3531863366 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5557f4104d60 0x5557f4107220 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.876+0000 7f15ef037640 1 -- 172.21.15.170:0/3531863366 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15e0049070 con 0x5557f4104d60 2024-09-12T17:28:02.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.876+0000 7f15ef037640 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5557f41078f0 con 0x5557f41003f0 2024-09-12T17:28:02.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.876+0000 7f15ef838640 1 -- 172.21.15.170:0/3531863366 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15e8039030 con 0x5557f41003f0 2024-09-12T17:28:02.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.876+0000 7f15ef838640 1 --2- 172.21.15.170:0/3531863366 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f15e803c060 0x7f15e8036a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.876+0000 7f15ef838640 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5557f41078f0 con 0x7f15e803c060 2024-09-12T17:28:02.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.876+0000 7f15e6836640 1 --2- 172.21.15.170:0/3531863366 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f15e803c060 0x7f15e8036a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.877+0000 7f15e6836640 1 --2- 172.21.15.170:0/3531863366 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f15e803c060 0x7f15e8036a20 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.877+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15d8051070 con 0x7f15e803c060 2024-09-12T17:28:02.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.877+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5557f41078f0 con 0x5557f40fba10 2024-09-12T17:28:02.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.877+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15d8051070 con 0x5557f40fba10 2024-09-12T17:28:02.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.877+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5557f41078f0 con 0x5557f40fba10 2024-09-12T17:28:02.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.877+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15d8051070 con 0x5557f40fba10 2024-09-12T17:28:02.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.877+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5557f41078f0 con 0x7f15e803c060 2024-09-12T17:28:02.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.878+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15d8051070 con 0x7f15e803c060 2024-09-12T17:28:02.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.878+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5557f41078f0 con 0x7f15e803c060 2024-09-12T17:28:02.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.878+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15d8051070 con 0x7f15e803c060 2024-09-12T17:28:02.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.878+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5557f41078f0 con 0x5557f41003f0 2024-09-12T17:28:02.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.878+0000 7f15ef838640 1 -- 172.21.15.170:0/3531863366 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15e8039030 con 0x5557f41003f0 2024-09-12T17:28:02.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.878+0000 7f15ef838640 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5557f41078f0 con 0x5557f4104d60 2024-09-12T17:28:02.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.878+0000 7f15ef037640 1 -- 172.21.15.170:0/3531863366 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15e0049070 con 0x5557f4104d60 2024-09-12T17:28:02.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.878+0000 7f15ef037640 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5557f41078f0 con 0x5557f40fba10 2024-09-12T17:28:02.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.879+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15d8051070 con 0x5557f40fba10 2024-09-12T17:28:02.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.879+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5557f41078f0 con 0x7f15e803c060 2024-09-12T17:28:02.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.879+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15d8051070 con 0x7f15e803c060 2024-09-12T17:28:02.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.879+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5557f41078f0 con 0x5557f40fba10 2024-09-12T17:28:02.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.879+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15d8051070 con 0x5557f40fba10 2024-09-12T17:28:02.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.879+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5557f41078f0 con 0x5557f41003f0 2024-09-12T17:28:02.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.879+0000 7f15ef838640 1 -- 172.21.15.170:0/3531863366 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f15e8039030 con 0x5557f41003f0 2024-09-12T17:28:02.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.879+0000 7f15ef838640 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5557f41078f0 con 0x5557f4104d60 2024-09-12T17:28:02.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.879+0000 7f15ef037640 1 -- 172.21.15.170:0/3531863366 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15e0049070 con 0x5557f4104d60 2024-09-12T17:28:02.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.879+0000 7f15ef037640 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5557f41078f0 con 0x5557f4104d60 2024-09-12T17:28:02.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.880+0000 7f15ef037640 1 -- 172.21.15.170:0/3531863366 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15e0049070 con 0x5557f4104d60 2024-09-12T17:28:02.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.880+0000 7f15ef037640 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5557f41078f0 con 0x7f15e803c060 2024-09-12T17:28:02.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.880+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15d8051070 con 0x7f15e803c060 2024-09-12T17:28:02.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.880+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5557f41078f0 con 0x5557f4104d60 2024-09-12T17:28:02.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.881+0000 7f15ef037640 1 -- 172.21.15.170:0/3531863366 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15e0049070 con 0x5557f4104d60 2024-09-12T17:28:02.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.881+0000 7f15ef037640 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5557f41078f0 con 0x5557f4104d60 2024-09-12T17:28:02.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.881+0000 7f15ef037640 1 -- 172.21.15.170:0/3531863366 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15e0049070 con 0x5557f4104d60 2024-09-12T17:28:02.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.881+0000 7f15ef037640 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5557f41078f0 con 0x5557f40fba10 2024-09-12T17:28:02.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.881+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15d8051070 con 0x5557f40fba10 2024-09-12T17:28:02.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.881+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5557f41078f0 con 0x5557f40fba10 2024-09-12T17:28:02.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.881+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f15d8051070 con 0x5557f40fba10 2024-09-12T17:28:02.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.881+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5557f41078f0 con 0x7f15e803c060 2024-09-12T17:28:02.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.881+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15d8051070 con 0x7f15e803c060 2024-09-12T17:28:02.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.881+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5557f41078f0 con 0x5557f4104d60 2024-09-12T17:28:02.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.882+0000 7f15ef037640 1 -- 172.21.15.170:0/3531863366 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15e0049070 con 0x5557f4104d60 2024-09-12T17:28:02.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.882+0000 7f15ef037640 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5557f41078f0 con 0x5557f41003f0 2024-09-12T17:28:02.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.882+0000 7f15ef838640 1 -- 172.21.15.170:0/3531863366 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15e8039030 con 0x5557f41003f0 2024-09-12T17:28:02.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.882+0000 7f15ef838640 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5557f41078f0 con 0x5557f40fba10 2024-09-12T17:28:02.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.882+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15d8051070 con 0x5557f40fba10 2024-09-12T17:28:02.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.882+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5557f41078f0 con 0x7f15e803c060 2024-09-12T17:28:02.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.882+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15d8051070 con 0x7f15e803c060 2024-09-12T17:28:02.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.882+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5557f41078f0 con 0x5557f4104d60 2024-09-12T17:28:02.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.883+0000 7f15ef037640 1 -- 172.21.15.170:0/3531863366 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15e0049070 con 0x5557f4104d60 2024-09-12T17:28:02.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.883+0000 7f15ef037640 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5557f41078f0 con 0x7f15e803c060 2024-09-12T17:28:02.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.883+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15d8051070 con 0x7f15e803c060 2024-09-12T17:28:02.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.883+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5557f41078f0 con 0x5557f41003f0 2024-09-12T17:28:02.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.883+0000 7f15ef838640 1 -- 172.21.15.170:0/3531863366 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15e8066040 con 0x5557f41003f0 2024-09-12T17:28:02.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.883+0000 7f15ef838640 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5557f41078f0 con 0x5557f4104d60 2024-09-12T17:28:02.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.883+0000 7f15ef037640 1 -- 172.21.15.170:0/3531863366 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15e0049070 con 0x5557f4104d60 2024-09-12T17:28:02.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.883+0000 7f15ef037640 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5557f41078f0 con 0x7f15e803c060 2024-09-12T17:28:02.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.884+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15d8051070 con 0x7f15e803c060 2024-09-12T17:28:02.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.884+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5557f41078f0 con 0x5557f40fba10 2024-09-12T17:28:02.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.884+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f15d8051070 con 0x5557f40fba10 2024-09-12T17:28:02.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.884+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5557f41078f0 con 0x5557f41003f0 2024-09-12T17:28:02.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.884+0000 7f15ef838640 1 -- 172.21.15.170:0/3531863366 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f15e8066040 con 0x5557f41003f0 2024-09-12T17:28:02.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.884+0000 7f15f1546800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:02.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.884+0000 7f15f1546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:02.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.884+0000 7f15f1546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:02.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.884+0000 7f15f1546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:02.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.884+0000 7f15f1546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:02.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.884+0000 7f15f1546800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:02.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.884+0000 7f15f1546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.884+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5557f41037c0 con 0x5557f40fba10 2024-09-12T17:28:02.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.884+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f15d8051070 con 0x5557f40fba10 2024-09-12T17:28:02.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.884+0000 7f15f1546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:02.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.884+0000 7f15f1546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.884+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5557f41033a0 con 0x5557f40fba10 2024-09-12T17:28:02.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.885+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f15d8051070 con 0x5557f40fba10 2024-09-12T17:28:02.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.885+0000 7f15f1546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:02.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.885+0000 7f15f1546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.885+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5557f41040e0 con 0x5557f41003f0 2024-09-12T17:28:02.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.885+0000 7f15ef838640 1 -- 172.21.15.170:0/3531863366 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f15e8066040 con 0x5557f41003f0 2024-09-12T17:28:02.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.885+0000 7f15f1546800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:02.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.885+0000 7f15f1546800 20 zone default found 2024-09-12T17:28:02.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.885+0000 7f15f1546800 4 Realm: () 2024-09-12T17:28:02.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.885+0000 7f15f1546800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:02.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.885+0000 7f15f1546800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:02.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.885+0000 7f15f1546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:02.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.885+0000 7f15f1546800 20 zonegroup default 2024-09-12T17:28:02.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.885+0000 7f15f1546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.885+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5557f4103cb0 con 0x7f15e803c060 2024-09-12T17:28:02.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.885+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f15d8051070 con 0x7f15e803c060 2024-09-12T17:28:02.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.885+0000 7f15f1546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:02.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.885+0000 7f15f1546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.885+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5557f410a160 con 0x5557f4104d60 2024-09-12T17:28:02.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.885+0000 7f15ef037640 1 -- 172.21.15.170:0/3531863366 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f15e0049070 con 0x5557f4104d60 2024-09-12T17:28:02.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.886+0000 7f15f1546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:02.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.886+0000 7f15f1546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.886+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5557f410a500 con 0x5557f4104d60 2024-09-12T17:28:02.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.886+0000 7f15ef037640 1 -- 172.21.15.170:0/3531863366 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f15e0049070 con 0x5557f4104d60 2024-09-12T17:28:02.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.886+0000 7f15f1546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:02.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.886+0000 7f15f1546800 20 started sync module instance, tier type = 2024-09-12T17:28:02.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.886+0000 7f15f1546800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:02.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.886+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5557f41095f0 con 0x5557f41003f0 2024-09-12T17:28:02.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.887+0000 7f15ef838640 1 -- 172.21.15.170:0/3531863366 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15e8066040 con 0x5557f41003f0 2024-09-12T17:28:02.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.887+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93836245244432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5557f4109250 con 0x5557f41003f0 2024-09-12T17:28:02.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.887+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5557f410b430 con 0x5557f40fba10 2024-09-12T17:28:02.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.888+0000 7f15ef838640 1 -- 172.21.15.170:0/3531863366 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93836245244432] v29'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15e8066040 con 0x5557f41003f0 2024-09-12T17:28:02.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.888+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15d8051070 con 0x5557f40fba10 2024-09-12T17:28:02.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.888+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93836245249920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5557f410b820 con 0x5557f40fba10 2024-09-12T17:28:02.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.888+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5557f410c220 con 0x5557f4104d60 2024-09-12T17:28:02.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.889+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93836245249920] v29'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15d8051070 con 0x5557f40fba10 2024-09-12T17:28:02.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.889+0000 7f15ef037640 1 -- 172.21.15.170:0/3531863366 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15e0049070 con 0x5557f4104d60 2024-09-12T17:28:02.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.889+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93836245248352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5557f410c640 con 0x5557f4104d60 2024-09-12T17:28:02.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.889+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5557f410d040 con 0x5557f41003f0 2024-09-12T17:28:02.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.890+0000 7f15ef037640 1 -- 172.21.15.170:0/3531863366 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93836245248352] v29'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15e0049070 con 0x5557f4104d60 2024-09-12T17:28:02.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.890+0000 7f15ef838640 1 -- 172.21.15.170:0/3531863366 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15e8066040 con 0x5557f41003f0 2024-09-12T17:28:02.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.890+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93836245253424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5557f410d460 con 0x5557f41003f0 2024-09-12T17:28:02.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.890+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5557f410dea0 con 0x5557f40fba10 2024-09-12T17:28:02.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.891+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15d8051070 con 0x5557f40fba10 2024-09-12T17:28:02.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.891+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93836245260656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5557f410de60 con 0x5557f40fba10 2024-09-12T17:28:02.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.891+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5557f410ee60 con 0x7f15e803c060 2024-09-12T17:28:02.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.891+0000 7f15ef838640 1 -- 172.21.15.170:0/3531863366 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93836245253424] v29'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15e8066040 con 0x5557f41003f0 2024-09-12T17:28:02.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.892+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93836245260656] v29'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15d8051070 con 0x5557f40fba10 2024-09-12T17:28:02.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.892+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15d8051070 con 0x7f15e803c060 2024-09-12T17:28:02.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.892+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93836245264784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5557f410ee60 con 0x7f15e803c060 2024-09-12T17:28:02.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.892+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5557f410f2b0 con 0x7f15e803c060 2024-09-12T17:28:02.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.893+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93836245264784] v29'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15d8051070 con 0x7f15e803c060 2024-09-12T17:28:02.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.894+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(56 notify.6 [create] v29'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15d8051070 con 0x7f15e803c060 2024-09-12T17:28:02.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.894+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93836245257040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5557f410ee60 con 0x7f15e803c060 2024-09-12T17:28:02.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.894+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5557f410fd40 con 0x7f15e803c060 2024-09-12T17:28:02.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.894+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(58 notify.7 [create] v29'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15d8051070 con 0x7f15e803c060 2024-09-12T17:28:02.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.894+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93836245257040] v29'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15d8051070 con 0x7f15e803c060 2024-09-12T17:28:02.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.895+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93836245268624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5557f410fcb0 con 0x7f15e803c060 2024-09-12T17:28:02.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.895+0000 7f15f1546800 20 add_watcher() i=0 2024-09-12T17:28:02.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.895+0000 7f15f1546800 20 add_watcher() i=1 2024-09-12T17:28:02.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.895+0000 7f15f1546800 20 add_watcher() i=2 2024-09-12T17:28:02.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.895+0000 7f15f1546800 20 add_watcher() i=3 2024-09-12T17:28:02.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.895+0000 7f15f1546800 20 add_watcher() i=4 2024-09-12T17:28:02.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.895+0000 7f15f1546800 20 add_watcher() i=5 2024-09-12T17:28:02.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.895+0000 7f15f1546800 20 add_watcher() i=6 2024-09-12T17:28:02.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.895+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93836245268624] v29'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15d8051070 con 0x7f15e803c060 2024-09-12T17:28:02.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.895+0000 7f15f1546800 20 add_watcher() i=7 2024-09-12T17:28:02.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.895+0000 7f15f1546800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:02.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.895+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5557f4113140 con 0x5557f40fba10 2024-09-12T17:28:02.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.896+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f15d8051070 con 0x5557f40fba10 2024-09-12T17:28:02.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.896+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93836245267056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5557f41105f0 con 0x5557f40fba10 2024-09-12T17:28:02.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.897+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93836245267056] v29'98 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f15d8051070 con 0x5557f40fba10 2024-09-12T17:28:02.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.897+0000 7f14a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:02.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.897+0000 7f15f1546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:02.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.897+0000 7f15f1546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:02.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.897+0000 7f15f1546800 5 note: GC not initialized 2024-09-12T17:28:02.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.897+0000 7f14a4fe1640 20 reqs_thread_entry: start 2024-09-12T17:28:02.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.897+0000 7f15f1546800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:02.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.898+0000 7f15f1546800 20 Filter name: none 2024-09-12T17:28:02.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.898+0000 7f141e7fc640 20 reqs_thread_entry: start 2024-09-12T17:28:02.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.898+0000 7f15f1546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.898+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5557f4145c90 con 0x5557f40fba10 2024-09-12T17:28:02.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.898+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f15d8051070 con 0x5557f40fba10 2024-09-12T17:28:02.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.898+0000 7f15f1546800 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:28:02.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.898+0000 7f15f1546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.898+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5557f4146550 con 0x5557f40fba10 2024-09-12T17:28:02.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.898+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f15d8051070 con 0x5557f40fba10 2024-09-12T17:28:02.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.898+0000 7f15f1546800 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:28:02.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.898+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5557f4147560 con 0x5557f41003f0 2024-09-12T17:28:02.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.899+0000 7f15ef838640 1 -- 172.21.15.170:0/3531863366 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f15e8066040 con 0x5557f41003f0 2024-09-12T17:28:02.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.899+0000 7f15f1546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.899+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:65 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5557f4144e30 con 0x5557f41003f0 2024-09-12T17:28:02.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.899+0000 7f15ef838640 1 -- 172.21.15.170:0/3531863366 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(65 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f15e8066040 con 0x5557f41003f0 2024-09-12T17:28:02.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.899+0000 7f15f1546800 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T17:28:02.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.899+0000 7f15f1546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:02.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.899+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:66 8.1d 8:baccd554:root::.bucket.meta.myfoo%3a7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5557f4147560 con 0x7f15e803c060 2024-09-12T17:28:02.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.899+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(66 .bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f15d8051070 con 0x7f15e803c060 2024-09-12T17:28:02.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.899+0000 7f15f1546800 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T17:28:02.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.899+0000 7f15f1546800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:28:02.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.900+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:67 4.33 4:cf7a7992:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5557f4147050 con 0x7f15e803c060 2024-09-12T17:28:02.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.900+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:68 4.a 4:523b0550:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5557f414bef0 con 0x5557f41003f0 2024-09-12T17:28:02.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.900+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:69 4.2e 4:74d1473b:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5557f414e760 con 0x5557f4104d60 2024-09-12T17:28:02.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.900+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:70 4.12 4:4b79d0ba:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5557f4151010 con 0x5557f40fba10 2024-09-12T17:28:02.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.900+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:71 4.20 4:058cb7b5:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5557f41539d0 con 0x5557f40fba10 2024-09-12T17:28:02.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.900+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:72 4.3 4:c2f55514:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5557f4156360 con 0x5557f40fba10 2024-09-12T17:28:02.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.900+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:73 4.3e 4:7f412122:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5557f4158d90 con 0x5557f41003f0 2024-09-12T17:28:02.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.900+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:74 4.9 4:916cfff6:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5557f4158d90 con 0x5557f40fba10 2024-09-12T17:28:02.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.900+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(67 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f15d8051070 con 0x7f15e803c060 2024-09-12T17:28:02.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.900+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:75 4.3f 4:fe994f63:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5557f4147a00 con 0x5557f41003f0 2024-09-12T17:28:02.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.900+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:76 4.3f 4:fcb62fad:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5557f4149380 con 0x5557f41003f0 2024-09-12T17:28:02.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.900+0000 7f15ef037640 1 -- 172.21.15.170:0/3531863366 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(69 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f15e0049070 con 0x5557f4104d60 2024-09-12T17:28:02.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.900+0000 7f15ef838640 1 -- 172.21.15.170:0/3531863366 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(68 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f15e8066040 con 0x5557f41003f0 2024-09-12T17:28:02.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.900+0000 7f15ef838640 1 -- 172.21.15.170:0/3531863366 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(73 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f15e8066040 con 0x5557f41003f0 2024-09-12T17:28:02.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.900+0000 7f15ef838640 1 -- 172.21.15.170:0/3531863366 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== osd_op_reply(75 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f15e8066040 con 0x5557f41003f0 2024-09-12T17:28:02.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.900+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(70 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f15d8051070 con 0x5557f40fba10 2024-09-12T17:28:02.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.900+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(71 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f15d8051070 con 0x5557f40fba10 2024-09-12T17:28:02.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.900+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(74 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f15d8051070 con 0x5557f40fba10 2024-09-12T17:28:02.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.900+0000 7f15ef838640 1 -- 172.21.15.170:0/3531863366 <== osd.2 v2:172.21.15.170:6808/3855567754 18 ==== osd_op_reply(76 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.9 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f15e8066040 con 0x5557f41003f0 2024-09-12T17:28:02.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.900+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(72 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f15d8051070 con 0x5557f40fba10 2024-09-12T17:28:02.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.900+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:77 4.16 4:6840e132:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5557f415e810 con 0x5557f4104d60 2024-09-12T17:28:02.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.901+0000 7f15ef037640 1 -- 172.21.15.170:0/3531863366 <== osd.3 v2:172.21.15.170:6816/2664906588 15 ==== osd_op_reply(77 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f15e0049070 con 0x5557f4104d60 2024-09-12T17:28:02.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.902+0000 7f14a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:02.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.902+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93836245267056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5557f4143b90 con 0x5557f40fba10 2024-09-12T17:28:02.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.903+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 93836245267056] v29'99 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f15d8051070 con 0x5557f40fba10 2024-09-12T17:28:02.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.903+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93836245244432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5557f4143b90 con 0x5557f41003f0 2024-09-12T17:28:02.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.904+0000 7f15ef838640 1 -- 172.21.15.170:0/3531863366 <== osd.2 v2:172.21.15.170:6808/3855567754 19 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 93836245244432] v29'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15e8066040 con 0x5557f41003f0 2024-09-12T17:28:02.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.904+0000 7f15f1546800 20 remove_watcher() i=0 2024-09-12T17:28:02.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.904+0000 7f15f1546800 2 removed watcher, disabling cache 2024-09-12T17:28:02.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.904+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93836245249920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5557f4143b90 con 0x5557f40fba10 2024-09-12T17:28:02.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.905+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 93836245249920] v29'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15d8051070 con 0x5557f40fba10 2024-09-12T17:28:02.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.905+0000 7f15f1546800 20 remove_watcher() i=1 2024-09-12T17:28:02.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.905+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93836245248352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5557f4143b90 con 0x5557f4104d60 2024-09-12T17:28:02.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.906+0000 7f15ef037640 1 -- 172.21.15.170:0/3531863366 <== osd.3 v2:172.21.15.170:6816/2664906588 16 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 93836245248352] v29'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15e0049070 con 0x5557f4104d60 2024-09-12T17:28:02.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.906+0000 7f15f1546800 20 remove_watcher() i=2 2024-09-12T17:28:02.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.906+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93836245253424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5557f4143b90 con 0x5557f41003f0 2024-09-12T17:28:02.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.907+0000 7f15ef838640 1 -- 172.21.15.170:0/3531863366 <== osd.2 v2:172.21.15.170:6808/3855567754 20 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 93836245253424] v29'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15e8066040 con 0x5557f41003f0 2024-09-12T17:28:02.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.907+0000 7f15f1546800 20 remove_watcher() i=3 2024-09-12T17:28:02.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.907+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93836245260656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5557f4143b90 con 0x5557f40fba10 2024-09-12T17:28:02.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.908+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 93836245260656] v29'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15d8051070 con 0x5557f40fba10 2024-09-12T17:28:02.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.908+0000 7f15f1546800 20 remove_watcher() i=4 2024-09-12T17:28:02.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.908+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93836245264784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5557f4143b90 con 0x7f15e803c060 2024-09-12T17:28:02.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.909+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 93836245264784] v29'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15d8051070 con 0x7f15e803c060 2024-09-12T17:28:02.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.909+0000 7f15f1546800 20 remove_watcher() i=5 2024-09-12T17:28:02.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.909+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93836245257040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5557f4143b90 con 0x7f15e803c060 2024-09-12T17:28:02.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.910+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 93836245257040] v29'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15d8051070 con 0x7f15e803c060 2024-09-12T17:28:02.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.910+0000 7f15f1546800 20 remove_watcher() i=6 2024-09-12T17:28:02.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.910+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93836245268624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5557f4143b90 con 0x7f15e803c060 2024-09-12T17:28:02.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.911+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 93836245268624] v29'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15d8051070 con 0x7f15e803c060 2024-09-12T17:28:02.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.911+0000 7f15f1546800 20 remove_watcher() i=7 2024-09-12T17:28:02.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.911+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f15e803c060 msgr2=0x7f15e8036a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.911+0000 7f15f1546800 1 --2- 172.21.15.170:0/3531863366 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f15e803c060 0x7f15e8036a20 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.911+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5557f40fba10 msgr2=0x5557f40fdea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.911+0000 7f15f1546800 1 --2- 172.21.15.170:0/3531863366 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5557f40fba10 0x5557f40fdea0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.911+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5557f41003f0 msgr2=0x5557f41027e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.911+0000 7f15f1546800 1 --2- 172.21.15.170:0/3531863366 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5557f41003f0 0x5557f41027e0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.911+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5557f4104d60 msgr2=0x5557f4107220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.911+0000 7f15f1546800 1 --2- 172.21.15.170:0/3531863366 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5557f4104d60 0x5557f4107220 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.911+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f14b803c780 msgr2=0x7f14b803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.911+0000 7f15f1546800 1 --2- 172.21.15.170:0/3531863366 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f14b803c780 0x7f14b803ec40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f15e0018ac0 tx=0x7f15e0049000 comp rx=0 tx=0).stop 2024-09-12T17:28:02.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.911+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557f40e8b90 msgr2=0x5557f40f00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.911+0000 7f15e6836640 1 -- 172.21.15.170:0/3531863366 reap_dead start 2024-09-12T17:28:02.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.911+0000 7f15f1546800 1 --2- 172.21.15.170:0/3531863366 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557f40e8b90 0x5557f40f00a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f15e8013dd0 tx=0x7f15e8053ca0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.911+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 shutdown_connections 2024-09-12T17:28:02.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.911+0000 7f15f1546800 1 --2- 172.21.15.170:0/3531863366 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557f40e8b90 0x5557f40f00a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.911+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 >> 172.21.15.170:0/3531863366 conn(0x5557f40e4f90 msgr2=0x5557f40e31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:02.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.911+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 shutdown_connections 2024-09-12T17:28:02.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.911+0000 7f15f1546800 1 -- 172.21.15.170:0/3531863366 wait complete. 2024-09-12T17:28:02.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.911+0000 7f15f1546800 1 -- 172.21.15.170:0/2836193769 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f14c803c780 msgr2=0x7f14c803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.911+0000 7f15f1546800 1 --2- 172.21.15.170:0/2836193769 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f14c803c780 0x7f14c803ec40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x5557f40c8f40 tx=0x7f15e004d040 comp rx=0 tx=0).stop 2024-09-12T17:28:02.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.911+0000 7f15f1546800 1 -- 172.21.15.170:0/2836193769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557f40dc110 msgr2=0x5557f40dc530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.911+0000 7f15f1546800 1 --2- 172.21.15.170:0/2836193769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557f40dc110 0x5557f40dc530 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x5557f3fcfd10 tx=0x7f15e80167b0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.911+0000 7f15f1546800 1 -- 172.21.15.170:0/2836193769 shutdown_connections 2024-09-12T17:28:02.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.911+0000 7f15f1546800 1 --2- 172.21.15.170:0/2836193769 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f14c803c780 0x7f14c803ec40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.911+0000 7f15f1546800 1 --2- 172.21.15.170:0/2836193769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557f40dc110 0x5557f40dc530 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.911+0000 7f15f1546800 1 -- 172.21.15.170:0/2836193769 >> 172.21.15.170:0/2836193769 conn(0x5557f40d04c0 msgr2=0x5557f40d08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:02.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.911+0000 7f15f1546800 1 -- 172.21.15.170:0/2836193769 shutdown_connections 2024-09-12T17:28:02.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.911+0000 7f15f1546800 1 -- 172.21.15.170:0/2836193769 wait complete. 2024-09-12T17:28:02.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.912+0000 7f15f1546800 1 -- 172.21.15.170:0/3504007914 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5557f3fc8200 msgr2=0x5557f40c8530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.912+0000 7f15f1546800 1 --2- 172.21.15.170:0/3504007914 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5557f3fc8200 0x5557f40c8530 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.912+0000 7f15f1546800 1 -- 172.21.15.170:0/3504007914 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5557f40cada0 msgr2=0x5557f40cd190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.912+0000 7f15f1546800 1 --2- 172.21.15.170:0/3504007914 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5557f40cada0 0x5557f40cd190 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.912+0000 7f15f1546800 1 -- 172.21.15.170:0/3504007914 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f14d403c780 msgr2=0x7f14d403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.912+0000 7f15f1546800 1 --2- 172.21.15.170:0/3504007914 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f14d403c780 0x7f14d403ec40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f15d8057000 tx=0x7f15d8052000 comp rx=0 tx=0).stop 2024-09-12T17:28:02.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.912+0000 7f15f1546800 1 -- 172.21.15.170:0/3504007914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557f3fc6df0 msgr2=0x5557f3fd0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.912+0000 7f15f1546800 1 --2- 172.21.15.170:0/3504007914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557f3fc6df0 0x5557f3fd0c20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x5557f40b85f0 tx=0x7f15e0000bc0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.912+0000 7f15f1546800 1 -- 172.21.15.170:0/3504007914 shutdown_connections 2024-09-12T17:28:02.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.912+0000 7f15f1546800 1 --2- 172.21.15.170:0/3504007914 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5557f40cada0 0x5557f40cd190 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.912+0000 7f15f1546800 1 --2- 172.21.15.170:0/3504007914 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f14d403c780 0x7f14d403ec40 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.912+0000 7f15f1546800 1 --2- 172.21.15.170:0/3504007914 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5557f3fc8200 0x5557f40c8530 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.912+0000 7f15f1546800 1 --2- 172.21.15.170:0/3504007914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557f3fc6df0 0x5557f3fd0c20 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.912+0000 7f15f1546800 1 -- 172.21.15.170:0/3504007914 >> 172.21.15.170:0/3504007914 conn(0x5557f3fc21c0 msgr2=0x5557f40b8940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:02.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.912+0000 7f15f1546800 1 -- 172.21.15.170:0/3504007914 shutdown_connections 2024-09-12T17:28:02.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.912+0000 7f15f1546800 1 -- 172.21.15.170:0/3504007914 wait complete. 2024-09-12T17:28:02.933 INFO:teuthology.orchestra.run.smithi170.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"dc43fae2-274b-4ee4-ac82-d8ac27e45bf4","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1","marker":"7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-12T17:28:02.192296Z","creation_time":"2024-09-12T17:28:02.189371Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":1}] 2024-09-12T17:28:02.933 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'dc43fae2-274b-4ee4-ac82-d8ac27e45bf4', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1', 'marker': '7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-12T17:28:02.192296Z', 'creation_time': '2024-09-12T17:28:02.189371Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1}] 2024-09-12T17:28:02.939 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-12T17:28:02.940 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-12T17:28:02.940 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-12T17:28:02.940 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-12T17:28:02.984 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:02.984 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:02.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.983+0000 7fd39bf26800 1 Processor -- start 2024-09-12T17:28:02.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.983+0000 7fd39bf26800 1 -- start start 2024-09-12T17:28:02.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.983+0000 7fd39bf26800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5596c3224fb0 0x5596c322dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:02.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.983+0000 7fd39bf26800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5596c30cee40 con 0x5596c3223490 2024-09-12T17:28:02.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.983+0000 7fd39bf26800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x5596c3099680 con 0x5596c3224fb0 2024-09-12T17:28:02.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.983+0000 7fd38f35c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5596c3224fb0 0x5596c322dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:02.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.983+0000 7fd397b5d640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x5596c3223490 0x5596c3223890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:48424/0 (socket says 172.21.15.170:48424) 2024-09-12T17:28:02.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.983+0000 7fd38f35c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5596c3224fb0 0x5596c322dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57842/0 (socket says 172.21.15.170:57842) 2024-09-12T17:28:02.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.983+0000 7fd397b5d640 1 -- 172.21.15.170:0/2006983034 learned_addr learned my addr 172.21.15.170:0/2006983034 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:28:02.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.983+0000 7fd38f35c640 1 -- 172.21.15.170:0/2006983034 >> v1:172.21.15.47:6789/0 conn(0x5596c3223490 legacy=0x5596c3223890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.983+0000 7fd39735c640 1 -- 172.21.15.170:0/2006983034 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2041496670 0 0) 0x5596c30cee40 con 0x5596c3223490 2024-09-12T17:28:02.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.983+0000 7fd38f35c640 1 -- 172.21.15.170:0/2006983034 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596c30b56b0 con 0x5596c3224fb0 2024-09-12T17:28:02.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.985+0000 7fd38f35c640 1 --2- 172.21.15.170:0/2006983034 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596c3224fb0 0x5596c322dad0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd38000a470 tx=0x7fd380045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ae0a7c19ac9d5d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:02.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.985+0000 7fd39735c640 1 -- 172.21.15.170:0/2006983034 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd380053570 con 0x5596c3224fb0 2024-09-12T17:28:02.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.985+0000 7fd39735c640 1 -- 172.21.15.170:0/2006983034 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd380058070 con 0x5596c3224fb0 2024-09-12T17:28:02.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.985+0000 7fd39735c640 1 -- 172.21.15.170:0/2006983034 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd380053880 con 0x5596c3224fb0 2024-09-12T17:28:02.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.986+0000 7fd39bf26800 1 -- 172.21.15.170:0/2006983034 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596c3224fb0 msgr2=0x5596c322dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:02.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.986+0000 7fd39bf26800 1 --2- 172.21.15.170:0/2006983034 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596c3224fb0 0x5596c322dad0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd38000a470 tx=0x7fd380045a20 comp rx=0 tx=0).stop 2024-09-12T17:28:02.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.986+0000 7fd39bf26800 1 -- 172.21.15.170:0/2006983034 shutdown_connections 2024-09-12T17:28:02.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.986+0000 7fd39bf26800 1 --2- 172.21.15.170:0/2006983034 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596c3224fb0 0x5596c322dad0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:02.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.986+0000 7fd39bf26800 1 -- 172.21.15.170:0/2006983034 >> 172.21.15.170:0/2006983034 conn(0x5596c321f1c0 msgr2=0x5596c3221620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:02.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.986+0000 7fd39bf26800 1 -- 172.21.15.170:0/2006983034 shutdown_connections 2024-09-12T17:28:02.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:02.986+0000 7fd39bf26800 1 -- 172.21.15.170:0/2006983034 wait complete. 2024-09-12T17:28:03.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.000+0000 7fd39bf26800 1 Processor -- start 2024-09-12T17:28:03.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.000+0000 7fd39bf26800 1 -- start start 2024-09-12T17:28:03.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.000+0000 7fd39bf26800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596c3223490 0x5596c33166c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.000+0000 7fd39bf26800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5596c30bddd0 con 0x5596c3223490 2024-09-12T17:28:03.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.000+0000 7fd397b5d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596c3223490 0x5596c33166c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.000+0000 7fd397b5d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596c3223490 0x5596c33166c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57852/0 (socket says 172.21.15.170:57852) 2024-09-12T17:28:03.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.000+0000 7fd397b5d640 1 -- 172.21.15.170:0/2625655544 learned_addr learned my addr 172.21.15.170:0/2625655544 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:03.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.001+0000 7fd397b5d640 1 -- 172.21.15.170:0/2625655544 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596c30d6e10 con 0x5596c3223490 2024-09-12T17:28:03.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.001+0000 7fd397b5d640 1 --2- 172.21.15.170:0/2625655544 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596c3223490 0x5596c33166c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd388001ea0 tx=0x7fd38800b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e7823ee491fdc89 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.001+0000 7fd285e0b640 1 -- 172.21.15.170:0/2625655544 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd388008070 con 0x5596c3223490 2024-09-12T17:28:03.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.001+0000 7fd285e0b640 1 -- 172.21.15.170:0/2625655544 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd38800d500 con 0x5596c3223490 2024-09-12T17:28:03.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.001+0000 7fd285e0b640 1 -- 172.21.15.170:0/2625655544 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd38800d880 con 0x5596c3223490 2024-09-12T17:28:03.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.002+0000 7fd39bf26800 1 -- 172.21.15.170:0/2625655544 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596c3223490 msgr2=0x5596c33166c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.002+0000 7fd39bf26800 1 --2- 172.21.15.170:0/2625655544 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596c3223490 0x5596c33166c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd388001ea0 tx=0x7fd38800b6a0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.002+0000 7fd39bf26800 1 -- 172.21.15.170:0/2625655544 shutdown_connections 2024-09-12T17:28:03.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.002+0000 7fd39bf26800 1 --2- 172.21.15.170:0/2625655544 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596c3223490 0x5596c33166c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.002+0000 7fd39bf26800 1 -- 172.21.15.170:0/2625655544 >> 172.21.15.170:0/2625655544 conn(0x5596c321f1c0 msgr2=0x5596c3312040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:03.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.002+0000 7fd39bf26800 1 -- 172.21.15.170:0/2625655544 shutdown_connections 2024-09-12T17:28:03.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.002+0000 7fd39bf26800 1 -- 172.21.15.170:0/2625655544 wait complete. 2024-09-12T17:28:03.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.002+0000 7fd39bf26800 1 Processor -- start 2024-09-12T17:28:03.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.002+0000 7fd39bf26800 1 -- start start 2024-09-12T17:28:03.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.002+0000 7fd39bf26800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596c3223490 0x5596c331e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.002+0000 7fd39bf26800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5596c322e2e0 con 0x5596c3223490 2024-09-12T17:28:03.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.002+0000 7fd397b5d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596c3223490 0x5596c331e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.002+0000 7fd397b5d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596c3223490 0x5596c331e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57854/0 (socket says 172.21.15.170:57854) 2024-09-12T17:28:03.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.002+0000 7fd397b5d640 1 -- 172.21.15.170:0/2689621632 learned_addr learned my addr 172.21.15.170:0/2689621632 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:03.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.003+0000 7fd397b5d640 1 -- 172.21.15.170:0/2689621632 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596c331e570 con 0x5596c3223490 2024-09-12T17:28:03.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.003+0000 7fd397b5d640 1 --2- 172.21.15.170:0/2689621632 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596c3223490 0x5596c331e010 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd3880012f0 tx=0x7fd388000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.003+0000 7fd27ffff640 1 -- 172.21.15.170:0/2689621632 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd38800f9d0 con 0x5596c3223490 2024-09-12T17:28:03.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.003+0000 7fd27ffff640 1 -- 172.21.15.170:0/2689621632 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd38800fb70 con 0x5596c3223490 2024-09-12T17:28:03.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.003+0000 7fd39bf26800 1 -- 172.21.15.170:0/2689621632 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5596c331e800 con 0x5596c3223490 2024-09-12T17:28:03.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.003+0000 7fd27ffff640 1 -- 172.21.15.170:0/2689621632 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd38800fe50 con 0x5596c3223490 2024-09-12T17:28:03.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.003+0000 7fd39bf26800 1 -- 172.21.15.170:0/2689621632 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596c331f200 con 0x5596c3223490 2024-09-12T17:28:03.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.004+0000 7fd27ffff640 1 -- 172.21.15.170:0/2689621632 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fd388017040 con 0x5596c3223490 2024-09-12T17:28:03.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.004+0000 7fd27ffff640 1 --2- 172.21.15.170:0/2689621632 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd28003c920 0x7fd28003ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.004+0000 7fd27ffff640 1 -- 172.21.15.170:0/2689621632 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fd388015020 con 0x5596c3223490 2024-09-12T17:28:03.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.004+0000 7fd38f35c640 1 --2- 172.21.15.170:0/2689621632 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd28003c920 0x7fd28003ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.004+0000 7fd39bf26800 1 --2- 172.21.15.170:0/2689621632 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5596c3224fb0 0x5596c3325660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.004+0000 7fd39bf26800 1 -- 172.21.15.170:0/2689621632 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596c3325ba0 con 0x5596c3224fb0 2024-09-12T17:28:03.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.004+0000 7fd39835e640 1 --2- 172.21.15.170:0/2689621632 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5596c3224fb0 0x5596c3325660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.005+0000 7fd38f35c640 1 --2- 172.21.15.170:0/2689621632 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd28003c920 0x7fd28003ede0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd380057000 tx=0x7fd380052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.005+0000 7fd39835e640 1 --2- 172.21.15.170:0/2689621632 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5596c3224fb0 0x5596c3325660 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.005+0000 7fd39835e640 1 -- 172.21.15.170:0/2689621632 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd39000a4d0 con 0x5596c3224fb0 2024-09-12T17:28:03.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.005+0000 7fd39bf26800 1 -- 172.21.15.170:0/2689621632 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596c3325f40 con 0x5596c3224fb0 2024-09-12T17:28:03.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.005+0000 7fd39835e640 1 -- 172.21.15.170:0/2689621632 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd39000a4d0 con 0x5596c3224fb0 2024-09-12T17:28:03.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.005+0000 7fd39bf26800 1 --2- 172.21.15.170:0/2689621632 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5596c3327a40 0x5596c3329ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.005+0000 7fd39bf26800 1 -- 172.21.15.170:0/2689621632 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596c332a650 con 0x5596c3327a40 2024-09-12T17:28:03.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.005+0000 7fd397b5d640 1 --2- 172.21.15.170:0/2689621632 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5596c3327a40 0x5596c3329ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.006+0000 7fd397b5d640 1 --2- 172.21.15.170:0/2689621632 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5596c3327a40 0x5596c3329ec0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.006+0000 7fd397b5d640 1 -- 172.21.15.170:0/2689621632 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd38802d070 con 0x5596c3327a40 2024-09-12T17:28:03.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.006+0000 7fd39bf26800 1 -- 172.21.15.170:0/2689621632 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596c3326790 con 0x5596c3224fb0 2024-09-12T17:28:03.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.006+0000 7fd39835e640 1 -- 172.21.15.170:0/2689621632 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd39000a4d0 con 0x5596c3224fb0 2024-09-12T17:28:03.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.006+0000 7fd39bf26800 1 -- 172.21.15.170:0/2689621632 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596c3326be0 con 0x5596c3327a40 2024-09-12T17:28:03.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.007+0000 7fd397b5d640 1 -- 172.21.15.170:0/2689621632 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd38802d070 con 0x5596c3327a40 2024-09-12T17:28:03.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.007+0000 7fd39bf26800 1 Processor -- start 2024-09-12T17:28:03.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.007+0000 7fd39bf26800 1 -- start start 2024-09-12T17:28:03.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.007+0000 7fd39bf26800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596c3338ee0 0x5596c3339300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.007+0000 7fd39bf26800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5596c311ba00 con 0x5596c3338ee0 2024-09-12T17:28:03.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.007+0000 7fd39835e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596c3338ee0 0x5596c3339300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.007+0000 7fd39835e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596c3338ee0 0x5596c3339300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57858/0 (socket says 172.21.15.170:57858) 2024-09-12T17:28:03.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.007+0000 7fd39835e640 1 -- 172.21.15.170:0/3737493297 learned_addr learned my addr 172.21.15.170:0/3737493297 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:03.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.008+0000 7fd39835e640 1 -- 172.21.15.170:0/3737493297 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596c3339940 con 0x5596c3338ee0 2024-09-12T17:28:03.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.008+0000 7fd39835e640 1 --2- 172.21.15.170:0/3737493297 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596c3338ee0 0x5596c3339300 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x5596c331f010 tx=0x7fd3900167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.008+0000 7fd27d7fa640 1 -- 172.21.15.170:0/3737493297 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd390013640 con 0x5596c3338ee0 2024-09-12T17:28:03.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.008+0000 7fd27d7fa640 1 -- 172.21.15.170:0/3737493297 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3900137e0 con 0x5596c3338ee0 2024-09-12T17:28:03.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.008+0000 7fd39bf26800 1 -- 172.21.15.170:0/3737493297 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5596c333a170 con 0x5596c3338ee0 2024-09-12T17:28:03.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.008+0000 7fd27d7fa640 1 -- 172.21.15.170:0/3737493297 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd390013ae0 con 0x5596c3338ee0 2024-09-12T17:28:03.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.008+0000 7fd39bf26800 1 -- 172.21.15.170:0/3737493297 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596c333a710 con 0x5596c3338ee0 2024-09-12T17:28:03.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.009+0000 7fd27d7fa640 1 -- 172.21.15.170:0/3737493297 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fd390011040 con 0x5596c3338ee0 2024-09-12T17:28:03.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.009+0000 7fd27d7fa640 1 --2- 172.21.15.170:0/3737493297 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd27003c730 0x7fd27003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.009+0000 7fd27d7fa640 1 -- 172.21.15.170:0/3737493297 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fd39000e040 con 0x5596c3338ee0 2024-09-12T17:28:03.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.009+0000 7fd397b5d640 1 --2- 172.21.15.170:0/3737493297 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd27003c730 0x7fd27003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.009+0000 7fd39bf26800 1 Processor -- start 2024-09-12T17:28:03.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.009+0000 7fd397b5d640 1 --2- 172.21.15.170:0/3737493297 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd27003c730 0x7fd27003ebf0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd388052740 tx=0x7fd388001460 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.009+0000 7fd39bf26800 1 -- start start 2024-09-12T17:28:03.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.010+0000 7fd39bf26800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596c33459e0 0x5596c3345de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.010+0000 7fd39bf26800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5596c3316f10 con 0x5596c33459e0 2024-09-12T17:28:03.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.010+0000 7fd39835e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596c33459e0 0x5596c3345de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.010+0000 7fd39835e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596c33459e0 0x5596c3345de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57872/0 (socket says 172.21.15.170:57872) 2024-09-12T17:28:03.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.010+0000 7fd39835e640 1 -- 172.21.15.170:0/3371127291 learned_addr learned my addr 172.21.15.170:0/3371127291 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:03.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.010+0000 7fd39835e640 1 -- 172.21.15.170:0/3371127291 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596c33463d0 con 0x5596c33459e0 2024-09-12T17:28:03.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.010+0000 7fd39835e640 1 --2- 172.21.15.170:0/3371127291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596c33459e0 0x5596c3345de0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd390053d60 tx=0x7fd39001fe20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62dce9cf1f82307d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.010+0000 7fd276ffd640 1 -- 172.21.15.170:0/3371127291 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3900143c0 con 0x5596c33459e0 2024-09-12T17:28:03.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.010+0000 7fd276ffd640 1 -- 172.21.15.170:0/3371127291 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd390021910 con 0x5596c33459e0 2024-09-12T17:28:03.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.010+0000 7fd276ffd640 1 -- 172.21.15.170:0/3371127291 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd390021440 con 0x5596c33459e0 2024-09-12T17:28:03.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.011+0000 7fd39bf26800 1 -- 172.21.15.170:0/3371127291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596c33459e0 msgr2=0x5596c3345de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.011+0000 7fd39bf26800 1 --2- 172.21.15.170:0/3371127291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596c33459e0 0x5596c3345de0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd390053d60 tx=0x7fd39001fe20 comp rx=0 tx=0).stop 2024-09-12T17:28:03.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.011+0000 7fd39bf26800 1 -- 172.21.15.170:0/3371127291 shutdown_connections 2024-09-12T17:28:03.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.011+0000 7fd39bf26800 1 --2- 172.21.15.170:0/3371127291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596c33459e0 0x5596c3345de0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.011+0000 7fd39bf26800 1 -- 172.21.15.170:0/3371127291 >> 172.21.15.170:0/3371127291 conn(0x5596c3341e00 msgr2=0x5596c3340040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:03.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.011+0000 7fd39bf26800 1 -- 172.21.15.170:0/3371127291 shutdown_connections 2024-09-12T17:28:03.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.011+0000 7fd39bf26800 1 -- 172.21.15.170:0/3371127291 wait complete. 2024-09-12T17:28:03.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.011+0000 7fd39bf26800 1 Processor -- start 2024-09-12T17:28:03.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.011+0000 7fd39bf26800 1 -- start start 2024-09-12T17:28:03.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.011+0000 7fd39bf26800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596c33459e0 0x5596c334cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.011+0000 7fd39bf26800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5596c33469f0 con 0x5596c33459e0 2024-09-12T17:28:03.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.011+0000 7fd39835e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596c33459e0 0x5596c334cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.012+0000 7fd39835e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596c33459e0 0x5596c334cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57876/0 (socket says 172.21.15.170:57876) 2024-09-12T17:28:03.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.012+0000 7fd39835e640 1 -- 172.21.15.170:0/1737874067 learned_addr learned my addr 172.21.15.170:0/1737874067 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:03.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.012+0000 7fd39835e640 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596c334d550 con 0x5596c33459e0 2024-09-12T17:28:03.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.012+0000 7fd39835e640 1 --2- 172.21.15.170:0/1737874067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596c33459e0 0x5596c334cff0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd39001fe60 tx=0x7fd390053cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.012+0000 7fd2757fa640 1 -- 172.21.15.170:0/1737874067 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3900143c0 con 0x5596c33459e0 2024-09-12T17:28:03.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.012+0000 7fd2757fa640 1 -- 172.21.15.170:0/1737874067 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd390020800 con 0x5596c33459e0 2024-09-12T17:28:03.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.012+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5596c334d7e0 con 0x5596c33459e0 2024-09-12T17:28:03.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.012+0000 7fd2757fa640 1 -- 172.21.15.170:0/1737874067 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd390020b40 con 0x5596c33459e0 2024-09-12T17:28:03.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.012+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596c334e160 con 0x5596c33459e0 2024-09-12T17:28:03.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.013+0000 7fd2757fa640 1 -- 172.21.15.170:0/1737874067 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fd390020ce0 con 0x5596c33459e0 2024-09-12T17:28:03.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.013+0000 7fd2757fa640 1 --2- 172.21.15.170:0/1737874067 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd26003c780 0x7fd26003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.013+0000 7fd2757fa640 1 -- 172.21.15.170:0/1737874067 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fd3900535d0 con 0x5596c33459e0 2024-09-12T17:28:03.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.013+0000 7fd397b5d640 1 --2- 172.21.15.170:0/1737874067 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd26003c780 0x7fd26003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.013+0000 7fd39bf26800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.013+0000 7fd39bf26800 1 --2- 172.21.15.170:0/1737874067 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5596c3358820 0x5596c335ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.013+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596c335b430 con 0x5596c3358820 2024-09-12T17:28:03.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.014+0000 7fd38f35c640 1 --2- 172.21.15.170:0/1737874067 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5596c3358820 0x5596c335ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.014+0000 7fd397b5d640 1 --2- 172.21.15.170:0/1737874067 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd26003c780 0x7fd26003ec40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd3880540d0 tx=0x7fd388043000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.014+0000 7fd38f35c640 1 --2- 172.21.15.170:0/1737874067 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5596c3358820 0x5596c335ace0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.014+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd380051070 con 0x5596c3358820 2024-09-12T17:28:03.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.014+0000 7fd39bf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.014+0000 7fd39bf26800 20 realm 2024-09-12T17:28:03.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.014+0000 7fd39bf26800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.014+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596c335b860 con 0x5596c3358820 2024-09-12T17:28:03.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.014+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd380051070 con 0x5596c3358820 2024-09-12T17:28:03.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.014+0000 7fd39bf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.014+0000 7fd39bf26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:03.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.014+0000 7fd39bf26800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.014+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596c335c130 con 0x5596c3358820 2024-09-12T17:28:03.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.015+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd380051070 con 0x5596c3358820 2024-09-12T17:28:03.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.015+0000 7fd39bf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.015+0000 7fd39bf26800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.015+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596c335c4d0 con 0x5596c3358820 2024-09-12T17:28:03.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.015+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd380051070 con 0x5596c3358820 2024-09-12T17:28:03.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.015+0000 7fd39bf26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:03.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.015+0000 7fd39bf26800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.015+0000 7fd39bf26800 1 --2- 172.21.15.170:0/1737874067 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5596c335d230 0x5596c335f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.015+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596c335fb60 con 0x5596c335d230 2024-09-12T17:28:03.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.015+0000 7fd39835e640 1 --2- 172.21.15.170:0/1737874067 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5596c335d230 0x5596c335f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.015+0000 7fd39835e640 1 --2- 172.21.15.170:0/1737874067 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5596c335d230 0x5596c335f620 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.016+0000 7fd39835e640 1 -- 172.21.15.170:0/1737874067 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd39000a4d0 con 0x5596c335d230 2024-09-12T17:28:03.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.016+0000 7fd39bf26800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:03.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.016+0000 7fd39bf26800 20 searching for the correct realm 2024-09-12T17:28:03.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.016+0000 7fd39bf26800 1 --2- 172.21.15.170:0/1737874067 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5596c3361ba0 0x5596c3364060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.016+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596c3364730 con 0x5596c3361ba0 2024-09-12T17:28:03.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.016+0000 7fd397b5d640 1 --2- 172.21.15.170:0/1737874067 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5596c3361ba0 0x5596c3364060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.016+0000 7fd397b5d640 1 --2- 172.21.15.170:0/1737874067 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5596c3361ba0 0x5596c3364060 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.016+0000 7fd397b5d640 1 -- 172.21.15.170:0/1737874067 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd38802d070 con 0x5596c3361ba0 2024-09-12T17:28:03.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.016+0000 7fd397b5d640 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596c3364730 con 0x5596c335d230 2024-09-12T17:28:03.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.016+0000 7fd39835e640 1 -- 172.21.15.170:0/1737874067 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd39000a4d0 con 0x5596c335d230 2024-09-12T17:28:03.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.016+0000 7fd39835e640 1 --2- 172.21.15.170:0/1737874067 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fd3900145e0 0x7fd390056940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.016+0000 7fd39835e640 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596c3364730 con 0x7fd3900145e0 2024-09-12T17:28:03.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.017+0000 7fd38f35c640 1 --2- 172.21.15.170:0/1737874067 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fd3900145e0 0x7fd390056940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.017+0000 7fd38f35c640 1 --2- 172.21.15.170:0/1737874067 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fd3900145e0 0x7fd390056940 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.017+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd380051070 con 0x7fd3900145e0 2024-09-12T17:28:03.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.017+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596c3364730 con 0x5596c3358820 2024-09-12T17:28:03.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.018+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd380051070 con 0x5596c3358820 2024-09-12T17:28:03.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.018+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596c3364730 con 0x5596c3358820 2024-09-12T17:28:03.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.018+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd380051070 con 0x5596c3358820 2024-09-12T17:28:03.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.018+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596c3364730 con 0x7fd3900145e0 2024-09-12T17:28:03.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.018+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd380051070 con 0x7fd3900145e0 2024-09-12T17:28:03.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.018+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596c3364730 con 0x7fd3900145e0 2024-09-12T17:28:03.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.018+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd380051070 con 0x7fd3900145e0 2024-09-12T17:28:03.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.018+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596c3364730 con 0x5596c335d230 2024-09-12T17:28:03.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.018+0000 7fd39835e640 1 -- 172.21.15.170:0/1737874067 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd39000a4d0 con 0x5596c335d230 2024-09-12T17:28:03.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.018+0000 7fd39835e640 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596c3364730 con 0x5596c3361ba0 2024-09-12T17:28:03.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.019+0000 7fd397b5d640 1 -- 172.21.15.170:0/1737874067 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd38802d070 con 0x5596c3361ba0 2024-09-12T17:28:03.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.019+0000 7fd397b5d640 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596c3364730 con 0x5596c3358820 2024-09-12T17:28:03.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.019+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd380051070 con 0x5596c3358820 2024-09-12T17:28:03.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.019+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596c3364730 con 0x7fd3900145e0 2024-09-12T17:28:03.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.019+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd380051070 con 0x7fd3900145e0 2024-09-12T17:28:03.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.019+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596c3364730 con 0x5596c3358820 2024-09-12T17:28:03.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.019+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd380051070 con 0x5596c3358820 2024-09-12T17:28:03.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.019+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596c3364730 con 0x5596c335d230 2024-09-12T17:28:03.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.020+0000 7fd39835e640 1 -- 172.21.15.170:0/1737874067 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fd39000a4d0 con 0x5596c335d230 2024-09-12T17:28:03.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.020+0000 7fd39835e640 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5596c3364730 con 0x5596c3361ba0 2024-09-12T17:28:03.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.020+0000 7fd397b5d640 1 -- 172.21.15.170:0/1737874067 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd38802d070 con 0x5596c3361ba0 2024-09-12T17:28:03.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.020+0000 7fd397b5d640 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fd38803c040 con 0x5596c3361ba0 2024-09-12T17:28:03.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.020+0000 7fd397b5d640 1 -- 172.21.15.170:0/1737874067 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd388057040 con 0x5596c3361ba0 2024-09-12T17:28:03.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.020+0000 7fd397b5d640 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fd38803c040 con 0x7fd3900145e0 2024-09-12T17:28:03.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.020+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd380051070 con 0x7fd3900145e0 2024-09-12T17:28:03.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.020+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fd38803c040 con 0x5596c3361ba0 2024-09-12T17:28:03.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.021+0000 7fd397b5d640 1 -- 172.21.15.170:0/1737874067 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd388057040 con 0x5596c3361ba0 2024-09-12T17:28:03.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.021+0000 7fd397b5d640 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fd38803c040 con 0x5596c3361ba0 2024-09-12T17:28:03.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.021+0000 7fd397b5d640 1 -- 172.21.15.170:0/1737874067 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd388057040 con 0x5596c3361ba0 2024-09-12T17:28:03.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.021+0000 7fd397b5d640 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fd38803c040 con 0x5596c3358820 2024-09-12T17:28:03.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.021+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd380051070 con 0x5596c3358820 2024-09-12T17:28:03.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.021+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fd38803c040 con 0x5596c3358820 2024-09-12T17:28:03.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.021+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd380051070 con 0x5596c3358820 2024-09-12T17:28:03.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.021+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fd38803c040 con 0x7fd3900145e0 2024-09-12T17:28:03.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.022+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd380051070 con 0x7fd3900145e0 2024-09-12T17:28:03.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.022+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fd38803c040 con 0x5596c3361ba0 2024-09-12T17:28:03.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.022+0000 7fd397b5d640 1 -- 172.21.15.170:0/1737874067 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd388057040 con 0x5596c3361ba0 2024-09-12T17:28:03.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.022+0000 7fd397b5d640 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fd38803c040 con 0x5596c335d230 2024-09-12T17:28:03.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.022+0000 7fd39835e640 1 -- 172.21.15.170:0/1737874067 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd39000a4d0 con 0x5596c335d230 2024-09-12T17:28:03.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.022+0000 7fd39835e640 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fd38803c040 con 0x5596c3358820 2024-09-12T17:28:03.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.022+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd380051070 con 0x5596c3358820 2024-09-12T17:28:03.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.022+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fd38803c040 con 0x7fd3900145e0 2024-09-12T17:28:03.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.023+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd380051070 con 0x7fd3900145e0 2024-09-12T17:28:03.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.023+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fd38803c040 con 0x5596c3361ba0 2024-09-12T17:28:03.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.023+0000 7fd397b5d640 1 -- 172.21.15.170:0/1737874067 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd388057040 con 0x5596c3361ba0 2024-09-12T17:28:03.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.023+0000 7fd397b5d640 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fd38803c040 con 0x7fd3900145e0 2024-09-12T17:28:03.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.023+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd380051070 con 0x7fd3900145e0 2024-09-12T17:28:03.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.023+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fd38803c040 con 0x5596c335d230 2024-09-12T17:28:03.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.023+0000 7fd39835e640 1 -- 172.21.15.170:0/1737874067 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd39000a4d0 con 0x5596c335d230 2024-09-12T17:28:03.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.023+0000 7fd39835e640 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fd38803c040 con 0x5596c3361ba0 2024-09-12T17:28:03.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.024+0000 7fd397b5d640 1 -- 172.21.15.170:0/1737874067 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd388057040 con 0x5596c3361ba0 2024-09-12T17:28:03.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.024+0000 7fd397b5d640 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fd38803c040 con 0x7fd3900145e0 2024-09-12T17:28:03.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.024+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd380051070 con 0x7fd3900145e0 2024-09-12T17:28:03.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.024+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fd38803c040 con 0x5596c3358820 2024-09-12T17:28:03.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.024+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd380051070 con 0x5596c3358820 2024-09-12T17:28:03.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.024+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fd38803c040 con 0x5596c335d230 2024-09-12T17:28:03.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.024+0000 7fd39835e640 1 -- 172.21.15.170:0/1737874067 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd39000a4d0 con 0x5596c335d230 2024-09-12T17:28:03.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.024+0000 7fd39bf26800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:03.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.024+0000 7fd39bf26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:03.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.024+0000 7fd39bf26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:03.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.024+0000 7fd39bf26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:03.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.024+0000 7fd39bf26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:03.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.024+0000 7fd39bf26800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:03.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.024+0000 7fd39bf26800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.024+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596c33605d0 con 0x5596c3358820 2024-09-12T17:28:03.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.024+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd380051070 con 0x5596c3358820 2024-09-12T17:28:03.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.024+0000 7fd39bf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.024+0000 7fd39bf26800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.024+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596c33601b0 con 0x5596c3358820 2024-09-12T17:28:03.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.025+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd380051070 con 0x5596c3358820 2024-09-12T17:28:03.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.025+0000 7fd39bf26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:03.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.025+0000 7fd39bf26800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.025+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596c3360ef0 con 0x5596c335d230 2024-09-12T17:28:03.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.025+0000 7fd39835e640 1 -- 172.21.15.170:0/1737874067 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd39000a4d0 con 0x5596c335d230 2024-09-12T17:28:03.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.025+0000 7fd39bf26800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:03.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.025+0000 7fd39bf26800 20 zone default found 2024-09-12T17:28:03.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.025+0000 7fd39bf26800 4 Realm: () 2024-09-12T17:28:03.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.025+0000 7fd39bf26800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:03.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.025+0000 7fd39bf26800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:03.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.025+0000 7fd39bf26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:03.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.025+0000 7fd39bf26800 20 zonegroup default 2024-09-12T17:28:03.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.025+0000 7fd39bf26800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.025+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596c3360ad0 con 0x7fd3900145e0 2024-09-12T17:28:03.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.025+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd380051070 con 0x7fd3900145e0 2024-09-12T17:28:03.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.025+0000 7fd39bf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.025+0000 7fd39bf26800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.025+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596c3366f80 con 0x5596c3361ba0 2024-09-12T17:28:03.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.026+0000 7fd397b5d640 1 -- 172.21.15.170:0/1737874067 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd388057040 con 0x5596c3361ba0 2024-09-12T17:28:03.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.026+0000 7fd39bf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.026+0000 7fd39bf26800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.026+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596c3367320 con 0x5596c3361ba0 2024-09-12T17:28:03.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.026+0000 7fd397b5d640 1 -- 172.21.15.170:0/1737874067 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd388057040 con 0x5596c3361ba0 2024-09-12T17:28:03.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.026+0000 7fd39bf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.026+0000 7fd39bf26800 20 started sync module instance, tier type = 2024-09-12T17:28:03.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.026+0000 7fd39bf26800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:03.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.026+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596c3366410 con 0x5596c335d230 2024-09-12T17:28:03.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.027+0000 7fd39835e640 1 -- 172.21.15.170:0/1737874067 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd39000a4d0 con 0x5596c335d230 2024-09-12T17:28:03.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.027+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94106008578096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596c3366070 con 0x5596c335d230 2024-09-12T17:28:03.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.027+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596c3368250 con 0x5596c3358820 2024-09-12T17:28:03.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.028+0000 7fd39835e640 1 -- 172.21.15.170:0/1737874067 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94106008578096] v29'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd39000a4d0 con 0x5596c335d230 2024-09-12T17:28:03.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.028+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd380051070 con 0x5596c3358820 2024-09-12T17:28:03.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.028+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94106008582016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596c3368250 con 0x5596c3358820 2024-09-12T17:28:03.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.028+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596c3368ce0 con 0x5596c3361ba0 2024-09-12T17:28:03.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.029+0000 7fd397b5d640 1 -- 172.21.15.170:0/1737874067 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd388057040 con 0x5596c3361ba0 2024-09-12T17:28:03.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.029+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94106008586160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596c3369580 con 0x5596c3361ba0 2024-09-12T17:28:03.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.029+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596c336a060 con 0x5596c335d230 2024-09-12T17:28:03.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.029+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94106008582016] v29'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd380051070 con 0x5596c3358820 2024-09-12T17:28:03.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.030+0000 7fd397b5d640 1 -- 172.21.15.170:0/1737874067 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94106008586160] v29'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd388057040 con 0x5596c3361ba0 2024-09-12T17:28:03.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.030+0000 7fd39835e640 1 -- 172.21.15.170:0/1737874067 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd39000a4d0 con 0x5596c335d230 2024-09-12T17:28:03.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.030+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94106008591216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596c33690d0 con 0x5596c335d230 2024-09-12T17:28:03.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.030+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596c336a900 con 0x5596c3358820 2024-09-12T17:28:03.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.031+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd380051070 con 0x5596c3358820 2024-09-12T17:28:03.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.031+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94106008593488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596c336ad20 con 0x5596c3358820 2024-09-12T17:28:03.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.031+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596c336b570 con 0x7fd3900145e0 2024-09-12T17:28:03.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.031+0000 7fd39835e640 1 -- 172.21.15.170:0/1737874067 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94106008591216] v29'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd39000a4d0 con 0x5596c335d230 2024-09-12T17:28:03.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.032+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94106008593488] v29'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd380051070 con 0x5596c3358820 2024-09-12T17:28:03.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.032+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd380051070 con 0x7fd3900145e0 2024-09-12T17:28:03.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.032+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94106008594544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596c336b140 con 0x7fd3900145e0 2024-09-12T17:28:03.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.032+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596c336be10 con 0x7fd3900145e0 2024-09-12T17:28:03.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.033+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94106008594544] v29'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd380051070 con 0x7fd3900145e0 2024-09-12T17:28:03.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.034+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(56 notify.6 [create] v29'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd380051070 con 0x7fd3900145e0 2024-09-12T17:28:03.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.034+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94106008595600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596c336b0b0 con 0x7fd3900145e0 2024-09-12T17:28:03.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.034+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596c336c430 con 0x7fd3900145e0 2024-09-12T17:28:03.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.035+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94106008595600] v29'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd380051070 con 0x7fd3900145e0 2024-09-12T17:28:03.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.035+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(58 notify.7 [create] v29'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd380051070 con 0x7fd3900145e0 2024-09-12T17:28:03.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.035+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94106008598800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596c336c430 con 0x7fd3900145e0 2024-09-12T17:28:03.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.035+0000 7fd39bf26800 20 add_watcher() i=0 2024-09-12T17:28:03.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.035+0000 7fd39bf26800 20 add_watcher() i=1 2024-09-12T17:28:03.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.035+0000 7fd39bf26800 20 add_watcher() i=2 2024-09-12T17:28:03.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.035+0000 7fd39bf26800 20 add_watcher() i=3 2024-09-12T17:28:03.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.035+0000 7fd39bf26800 20 add_watcher() i=4 2024-09-12T17:28:03.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.035+0000 7fd39bf26800 20 add_watcher() i=5 2024-09-12T17:28:03.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.035+0000 7fd39bf26800 20 add_watcher() i=6 2024-09-12T17:28:03.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.036+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94106008598800] v29'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd380051070 con 0x7fd3900145e0 2024-09-12T17:28:03.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.036+0000 7fd39bf26800 20 add_watcher() i=7 2024-09-12T17:28:03.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.036+0000 7fd39bf26800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:03.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.036+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596c336f830 con 0x5596c3358820 2024-09-12T17:28:03.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.036+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd380051070 con 0x5596c3358820 2024-09-12T17:28:03.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.036+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94106008600912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596c336cd50 con 0x5596c3358820 2024-09-12T17:28:03.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.037+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94106008600912] v29'100 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd380051070 con 0x5596c3358820 2024-09-12T17:28:03.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.037+0000 7fd24dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:03.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.037+0000 7fd39bf26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:03.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.037+0000 7fd39bf26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:03.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.037+0000 7fd39bf26800 5 note: GC not initialized 2024-09-12T17:28:03.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.037+0000 7fd24cfe1640 20 reqs_thread_entry: start 2024-09-12T17:28:03.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.038+0000 7fd39bf26800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:03.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.038+0000 7fd39bf26800 20 Filter name: none 2024-09-12T17:28:03.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.038+0000 7fd1c67fc640 20 reqs_thread_entry: start 2024-09-12T17:28:03.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.038+0000 7fd39bf26800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.038+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596c33a2980 con 0x5596c335d230 2024-09-12T17:28:03.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.038+0000 7fd39835e640 1 -- 172.21.15.170:0/1737874067 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fd39000a4d0 con 0x5596c335d230 2024-09-12T17:28:03.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.038+0000 7fd39bf26800 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T17:28:03.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.038+0000 7fd39bf26800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.038+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:63 8.1d 8:baccd554:root::.bucket.meta.myfoo%3a7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596c33a3210 con 0x7fd3900145e0 2024-09-12T17:28:03.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.039+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(63 .bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fd380051070 con 0x7fd3900145e0 2024-09-12T17:28:03.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.039+0000 7fd39bf26800 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T17:28:03.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.039+0000 7fd39bf26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:28:03.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.039+0000 7fd39bf26800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.039+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596c33a1c90 con 0x5596c335d230 2024-09-12T17:28:03.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.039+0000 7fd39835e640 1 -- 172.21.15.170:0/1737874067 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fd39000a4d0 con 0x5596c335d230 2024-09-12T17:28:03.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.039+0000 7fd39bf26800 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T17:28:03.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.039+0000 7fd39bf26800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.039+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:65 8.1d 8:baccd554:root::.bucket.meta.myfoo%3a7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596c33a4870 con 0x7fd3900145e0 2024-09-12T17:28:03.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.040+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(65 .bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fd380051070 con 0x7fd3900145e0 2024-09-12T17:28:03.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.040+0000 7fd39bf26800 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T17:28:03.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.040+0000 7fd39bf26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:28:03.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.040+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:66 4.33 4:cf7a7992:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596c33a6380 con 0x7fd3900145e0 2024-09-12T17:28:03.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.040+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:67 4.a 4:523b0550:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596c33a8f20 con 0x5596c335d230 2024-09-12T17:28:03.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.040+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:68 4.2e 4:74d1473b:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596c33ab980 con 0x5596c3361ba0 2024-09-12T17:28:03.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.040+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:69 4.12 4:4b79d0ba:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596c33ae2b0 con 0x5596c3358820 2024-09-12T17:28:03.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.040+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:70 4.20 4:058cb7b5:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596c33b0b20 con 0x5596c3358820 2024-09-12T17:28:03.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.040+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:71 4.3 4:c2f55514:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596c33b34a0 con 0x5596c3358820 2024-09-12T17:28:03.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.040+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:72 4.3e 4:7f412122:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596c33b5d50 con 0x5596c335d230 2024-09-12T17:28:03.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.040+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:73 4.9 4:916cfff6:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596c33b8760 con 0x5596c3358820 2024-09-12T17:28:03.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.040+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:74 4.3f 4:fe994f63:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596c33bb620 con 0x5596c335d230 2024-09-12T17:28:03.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.040+0000 7fd39835e640 1 -- 172.21.15.170:0/1737874067 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(67 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd39000a4d0 con 0x5596c335d230 2024-09-12T17:28:03.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.040+0000 7fd397b5d640 1 -- 172.21.15.170:0/1737874067 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(68 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd388057040 con 0x5596c3361ba0 2024-09-12T17:28:03.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.040+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:75 4.3f 4:fcb62fad:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596c33a88f0 con 0x5596c335d230 2024-09-12T17:28:03.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.040+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:76 4.16 4:6840e132:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5596c33bbf40 con 0x5596c3361ba0 2024-09-12T17:28:03.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.040+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(66 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd380051070 con 0x7fd3900145e0 2024-09-12T17:28:03.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.040+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(69 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd380051070 con 0x5596c3358820 2024-09-12T17:28:03.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.040+0000 7fd39835e640 1 -- 172.21.15.170:0/1737874067 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(72 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd39000a4d0 con 0x5596c335d230 2024-09-12T17:28:03.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.040+0000 7fd39835e640 1 -- 172.21.15.170:0/1737874067 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== osd_op_reply(74 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd39000a4d0 con 0x5596c335d230 2024-09-12T17:28:03.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.040+0000 7fd39835e640 1 -- 172.21.15.170:0/1737874067 <== osd.2 v2:172.21.15.170:6808/3855567754 18 ==== osd_op_reply(75 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.9 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd39000a4d0 con 0x5596c335d230 2024-09-12T17:28:03.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.041+0000 7fd397b5d640 1 -- 172.21.15.170:0/1737874067 <== osd.3 v2:172.21.15.170:6816/2664906588 15 ==== osd_op_reply(76 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fd388057040 con 0x5596c3361ba0 2024-09-12T17:28:03.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.041+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(70 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd380051070 con 0x5596c3358820 2024-09-12T17:28:03.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.041+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(71 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.5 [call out=128b] v0'0 uv3 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fd380051070 con 0x5596c3358820 2024-09-12T17:28:03.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.041+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(73 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd380051070 con 0x5596c3358820 2024-09-12T17:28:03.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.041+0000 7fd24dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:03.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.041+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94106008600912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596c33a0340 con 0x5596c3358820 2024-09-12T17:28:03.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.042+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94106008600912] v29'101 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd380051070 con 0x5596c3358820 2024-09-12T17:28:03.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.043+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94106008578096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596c33a0340 con 0x5596c335d230 2024-09-12T17:28:03.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.044+0000 7fd39835e640 1 -- 172.21.15.170:0/1737874067 <== osd.2 v2:172.21.15.170:6808/3855567754 19 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94106008578096] v29'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd39000a4d0 con 0x5596c335d230 2024-09-12T17:28:03.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.044+0000 7fd39bf26800 20 remove_watcher() i=0 2024-09-12T17:28:03.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.044+0000 7fd39bf26800 2 removed watcher, disabling cache 2024-09-12T17:28:03.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.044+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94106008582016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596c33a0340 con 0x5596c3358820 2024-09-12T17:28:03.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.045+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94106008582016] v29'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd380051070 con 0x5596c3358820 2024-09-12T17:28:03.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.045+0000 7fd39bf26800 20 remove_watcher() i=1 2024-09-12T17:28:03.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.045+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94106008586160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596c33a0340 con 0x5596c3361ba0 2024-09-12T17:28:03.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.045+0000 7fd397b5d640 1 -- 172.21.15.170:0/1737874067 <== osd.3 v2:172.21.15.170:6816/2664906588 16 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94106008586160] v29'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd388057040 con 0x5596c3361ba0 2024-09-12T17:28:03.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.046+0000 7fd39bf26800 20 remove_watcher() i=2 2024-09-12T17:28:03.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.046+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94106008591216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596c33a0340 con 0x5596c335d230 2024-09-12T17:28:03.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.046+0000 7fd39835e640 1 -- 172.21.15.170:0/1737874067 <== osd.2 v2:172.21.15.170:6808/3855567754 20 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94106008591216] v29'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd39000a4d0 con 0x5596c335d230 2024-09-12T17:28:03.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.046+0000 7fd39bf26800 20 remove_watcher() i=3 2024-09-12T17:28:03.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.046+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94106008593488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596c33a0340 con 0x5596c3358820 2024-09-12T17:28:03.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.047+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94106008593488] v29'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd380051070 con 0x5596c3358820 2024-09-12T17:28:03.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.048+0000 7fd39bf26800 20 remove_watcher() i=4 2024-09-12T17:28:03.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.048+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94106008594544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596c33a0340 con 0x7fd3900145e0 2024-09-12T17:28:03.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.049+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94106008594544] v29'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd380051070 con 0x7fd3900145e0 2024-09-12T17:28:03.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.049+0000 7fd39bf26800 20 remove_watcher() i=5 2024-09-12T17:28:03.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.049+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94106008595600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596c33a0340 con 0x7fd3900145e0 2024-09-12T17:28:03.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.050+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94106008595600] v29'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd380051070 con 0x7fd3900145e0 2024-09-12T17:28:03.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.050+0000 7fd39bf26800 20 remove_watcher() i=6 2024-09-12T17:28:03.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.050+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94106008598800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5596c33a0340 con 0x7fd3900145e0 2024-09-12T17:28:03.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.051+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 <== osd.0 v2:172.21.15.47:6800/3978157098 22 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94106008598800] v29'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd380051070 con 0x7fd3900145e0 2024-09-12T17:28:03.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.051+0000 7fd39bf26800 20 remove_watcher() i=7 2024-09-12T17:28:03.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.051+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fd3900145e0 msgr2=0x7fd390056940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.051+0000 7fd39bf26800 1 --2- 172.21.15.170:0/1737874067 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fd3900145e0 0x7fd390056940 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.051+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5596c3358820 msgr2=0x5596c335ace0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.051+0000 7fd39bf26800 1 --2- 172.21.15.170:0/1737874067 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5596c3358820 0x5596c335ace0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.051+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5596c335d230 msgr2=0x5596c335f620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.051+0000 7fd39bf26800 1 --2- 172.21.15.170:0/1737874067 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5596c335d230 0x5596c335f620 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.051+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5596c3361ba0 msgr2=0x5596c3364060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.051+0000 7fd39bf26800 1 --2- 172.21.15.170:0/1737874067 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5596c3361ba0 0x5596c3364060 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.051+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd26003c780 msgr2=0x7fd26003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.051+0000 7fd39bf26800 1 --2- 172.21.15.170:0/1737874067 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd26003c780 0x7fd26003ec40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd3880540d0 tx=0x7fd388043000 comp rx=0 tx=0).stop 2024-09-12T17:28:03.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.051+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596c33459e0 msgr2=0x5596c334cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.051+0000 7fd38f35c640 1 -- 172.21.15.170:0/1737874067 reap_dead start 2024-09-12T17:28:03.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.051+0000 7fd39bf26800 1 --2- 172.21.15.170:0/1737874067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596c33459e0 0x5596c334cff0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd39001fe60 tx=0x7fd390053cc0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.051+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 shutdown_connections 2024-09-12T17:28:03.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.051+0000 7fd39bf26800 1 --2- 172.21.15.170:0/1737874067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596c33459e0 0x5596c334cff0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.051+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 >> 172.21.15.170:0/1737874067 conn(0x5596c3341e00 msgr2=0x5596c3340010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:03.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.051+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 shutdown_connections 2024-09-12T17:28:03.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.051+0000 7fd39bf26800 1 -- 172.21.15.170:0/1737874067 wait complete. 2024-09-12T17:28:03.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.051+0000 7fd39bf26800 1 -- 172.21.15.170:0/3737493297 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd27003c730 msgr2=0x7fd27003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.051+0000 7fd39bf26800 1 --2- 172.21.15.170:0/3737493297 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd27003c730 0x7fd27003ebf0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd388052740 tx=0x7fd388001460 comp rx=0 tx=0).stop 2024-09-12T17:28:03.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.051+0000 7fd39bf26800 1 -- 172.21.15.170:0/3737493297 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596c3338ee0 msgr2=0x5596c3339300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.051+0000 7fd39bf26800 1 --2- 172.21.15.170:0/3737493297 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596c3338ee0 0x5596c3339300 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x5596c331f010 tx=0x7fd3900167b0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.051+0000 7fd39bf26800 1 -- 172.21.15.170:0/3737493297 shutdown_connections 2024-09-12T17:28:03.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.051+0000 7fd39bf26800 1 --2- 172.21.15.170:0/3737493297 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd27003c730 0x7fd27003ebf0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.051+0000 7fd39bf26800 1 --2- 172.21.15.170:0/3737493297 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596c3338ee0 0x5596c3339300 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.051+0000 7fd39bf26800 1 -- 172.21.15.170:0/3737493297 >> 172.21.15.170:0/3737493297 conn(0x5596c332d290 msgr2=0x5596c332d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:03.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.051+0000 7fd39bf26800 1 -- 172.21.15.170:0/3737493297 shutdown_connections 2024-09-12T17:28:03.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.051+0000 7fd39bf26800 1 -- 172.21.15.170:0/3737493297 wait complete. 2024-09-12T17:28:03.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.052+0000 7fd39bf26800 1 -- 172.21.15.170:0/2689621632 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5596c3224fb0 msgr2=0x5596c3325660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.052+0000 7fd39bf26800 1 --2- 172.21.15.170:0/2689621632 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5596c3224fb0 0x5596c3325660 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.052+0000 7fd39bf26800 1 -- 172.21.15.170:0/2689621632 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5596c3327a40 msgr2=0x5596c3329ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.052+0000 7fd39bf26800 1 --2- 172.21.15.170:0/2689621632 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5596c3327a40 0x5596c3329ec0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.052+0000 7fd39bf26800 1 -- 172.21.15.170:0/2689621632 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd28003c920 msgr2=0x7fd28003ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.052+0000 7fd39bf26800 1 --2- 172.21.15.170:0/2689621632 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd28003c920 0x7fd28003ede0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd380057000 tx=0x7fd380052000 comp rx=0 tx=0).stop 2024-09-12T17:28:03.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.052+0000 7fd39bf26800 1 -- 172.21.15.170:0/2689621632 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596c3223490 msgr2=0x5596c331e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.052+0000 7fd39bf26800 1 --2- 172.21.15.170:0/2689621632 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596c3223490 0x5596c331e010 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd3880012f0 tx=0x7fd388000ed0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.052+0000 7fd39bf26800 1 -- 172.21.15.170:0/2689621632 shutdown_connections 2024-09-12T17:28:03.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.052+0000 7fd39bf26800 1 --2- 172.21.15.170:0/2689621632 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5596c3327a40 0x5596c3329ec0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.052+0000 7fd39bf26800 1 --2- 172.21.15.170:0/2689621632 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd28003c920 0x7fd28003ede0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.052+0000 7fd39bf26800 1 --2- 172.21.15.170:0/2689621632 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5596c3224fb0 0x5596c3325660 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.052+0000 7fd39bf26800 1 --2- 172.21.15.170:0/2689621632 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5596c3223490 0x5596c331e010 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.052+0000 7fd39bf26800 1 -- 172.21.15.170:0/2689621632 >> 172.21.15.170:0/2689621632 conn(0x5596c321f1c0 msgr2=0x5596c33179a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:03.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.052+0000 7fd39bf26800 1 -- 172.21.15.170:0/2689621632 shutdown_connections 2024-09-12T17:28:03.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.052+0000 7fd39bf26800 1 -- 172.21.15.170:0/2689621632 wait complete. 2024-09-12T17:28:03.080 INFO:teuthology.orchestra.run.smithi170.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"dc43fae2-274b-4ee4-ac82-d8ac27e45bf4","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1","marker":"7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-12T17:28:02.192296Z","creation_time":"2024-09-12T17:28:02.189371Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":1} 2024-09-12T17:28:03.080 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'dc43fae2-274b-4ee4-ac82-d8ac27e45bf4', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1', 'marker': '7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-12T17:28:02.192296Z', 'creation_time': '2024-09-12T17:28:02.189371Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-12T17:28:03.080 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-12T17:28:03.080 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-12T17:28:03.081 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-09-12T17:28:03.126 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:03.126 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:03.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.124+0000 7f5e8ad1f800 1 Processor -- start 2024-09-12T17:28:03.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.125+0000 7f5e8ad1f800 1 -- start start 2024-09-12T17:28:03.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.125+0000 7f5e8ad1f800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x561d2b2dd240 0x561d2b2df6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.125+0000 7f5e8ad1f800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561d2b182e40 con 0x561d2b2d9730 2024-09-12T17:28:03.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.125+0000 7f5e8ad1f800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x561d2b14d680 con 0x561d2b2dd240 2024-09-12T17:28:03.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.125+0000 7f5e7ffff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x561d2b2dd240 0x561d2b2df6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.125+0000 7f5e7ffff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x561d2b2dd240 0x561d2b2df6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57880/0 (socket says 172.21.15.170:57880) 2024-09-12T17:28:03.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.125+0000 7f5e86aa2640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x561d2b2d9730 0x561d2b2dbb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:48440/0 (socket says 172.21.15.170:48440) 2024-09-12T17:28:03.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.125+0000 7f5e7ffff640 1 -- 172.21.15.170:0/3489920283 learned_addr learned my addr 172.21.15.170:0/3489920283 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:03.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.125+0000 7f5e7ffff640 1 -- 172.21.15.170:0/3489920283 >> v1:172.21.15.47:6789/0 conn(0x561d2b2d9730 legacy=0x561d2b2dbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.125+0000 7f5e7ffff640 1 -- 172.21.15.170:0/3489920283 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d2b1696b0 con 0x561d2b2dd240 2024-09-12T17:28:03.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.127+0000 7f5e7ffff640 1 --2- 172.21.15.170:0/3489920283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d2b2dd240 0x561d2b2df6d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5e7000a520 tx=0x7f5e70045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8c05b6896645487 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.127+0000 7f5e862a1640 1 -- 172.21.15.170:0/3489920283 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e70055070 con 0x561d2b2dd240 2024-09-12T17:28:03.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.127+0000 7f5e862a1640 1 -- 172.21.15.170:0/3489920283 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e700515b0 con 0x561d2b2dd240 2024-09-12T17:28:03.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.127+0000 7f5e862a1640 1 -- 172.21.15.170:0/3489920283 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e700518d0 con 0x561d2b2dd240 2024-09-12T17:28:03.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.128+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/3489920283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d2b2dd240 msgr2=0x561d2b2df6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.128+0000 7f5e8ad1f800 1 --2- 172.21.15.170:0/3489920283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d2b2dd240 0x561d2b2df6d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5e7000a520 tx=0x7f5e70045ba0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.128+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/3489920283 shutdown_connections 2024-09-12T17:28:03.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.128+0000 7f5e8ad1f800 1 --2- 172.21.15.170:0/3489920283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d2b2dd240 0x561d2b2df6d0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.128+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/3489920283 >> 172.21.15.170:0/3489920283 conn(0x561d2b2d31d0 msgr2=0x561d2b2d5630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:03.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.128+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/3489920283 shutdown_connections 2024-09-12T17:28:03.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.128+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/3489920283 wait complete. 2024-09-12T17:28:03.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.141+0000 7f5e8ad1f800 1 Processor -- start 2024-09-12T17:28:03.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.141+0000 7f5e8ad1f800 1 -- start start 2024-09-12T17:28:03.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.142+0000 7f5e8ad1f800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d2b2d9730 0x561d2b3c8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.142+0000 7f5e8ad1f800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x561d2b171dd0 con 0x561d2b2d9730 2024-09-12T17:28:03.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.142+0000 7f5e86aa2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d2b2d9730 0x561d2b3c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.142+0000 7f5e86aa2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d2b2d9730 0x561d2b3c8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57896/0 (socket says 172.21.15.170:57896) 2024-09-12T17:28:03.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.142+0000 7f5e86aa2640 1 -- 172.21.15.170:0/3873915935 learned_addr learned my addr 172.21.15.170:0/3873915935 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:03.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.142+0000 7f5e86aa2640 1 -- 172.21.15.170:0/3873915935 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d2b18ae10 con 0x561d2b2d9730 2024-09-12T17:28:03.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.142+0000 7f5e86aa2640 1 --2- 172.21.15.170:0/3873915935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d2b2d9730 0x561d2b3c8690 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5e7800b260 tx=0x7f5e7800b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6b4110cd4ca11e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.143+0000 7f5d74e09640 1 -- 172.21.15.170:0/3873915935 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e7800be60 con 0x561d2b2d9730 2024-09-12T17:28:03.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.143+0000 7f5d74e09640 1 -- 172.21.15.170:0/3873915935 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e78006070 con 0x561d2b2d9730 2024-09-12T17:28:03.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.143+0000 7f5d74e09640 1 -- 172.21.15.170:0/3873915935 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e7800e710 con 0x561d2b2d9730 2024-09-12T17:28:03.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.143+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/3873915935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d2b2d9730 msgr2=0x561d2b3c8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.143+0000 7f5e8ad1f800 1 --2- 172.21.15.170:0/3873915935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d2b2d9730 0x561d2b3c8690 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5e7800b260 tx=0x7f5e7800b660 comp rx=0 tx=0).stop 2024-09-12T17:28:03.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.143+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/3873915935 shutdown_connections 2024-09-12T17:28:03.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.143+0000 7f5e8ad1f800 1 --2- 172.21.15.170:0/3873915935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d2b2d9730 0x561d2b3c8690 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.143+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/3873915935 >> 172.21.15.170:0/3873915935 conn(0x561d2b2d31d0 msgr2=0x561d2b3c4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:03.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.143+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/3873915935 shutdown_connections 2024-09-12T17:28:03.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.143+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/3873915935 wait complete. 2024-09-12T17:28:03.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.144+0000 7f5e8ad1f800 1 Processor -- start 2024-09-12T17:28:03.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.144+0000 7f5e8ad1f800 1 -- start start 2024-09-12T17:28:03.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.144+0000 7f5e8ad1f800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d2b2d9730 0x561d2b3d0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.144+0000 7f5e8ad1f800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x561d2b2e0050 con 0x561d2b2d9730 2024-09-12T17:28:03.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.144+0000 7f5e86aa2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d2b2d9730 0x561d2b3d0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.144+0000 7f5e86aa2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d2b2d9730 0x561d2b3d0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57908/0 (socket says 172.21.15.170:57908) 2024-09-12T17:28:03.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.144+0000 7f5e86aa2640 1 -- 172.21.15.170:0/1907112728 learned_addr learned my addr 172.21.15.170:0/1907112728 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:03.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.144+0000 7f5e86aa2640 1 -- 172.21.15.170:0/1907112728 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d2b3d05a0 con 0x561d2b2d9730 2024-09-12T17:28:03.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.144+0000 7f5e86aa2640 1 --2- 172.21.15.170:0/1907112728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d2b2d9730 0x561d2b3d0040 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x561d2b3c9620 tx=0x7f5e78000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.145+0000 7f5d73606640 1 -- 172.21.15.170:0/1907112728 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e7800ee10 con 0x561d2b2d9730 2024-09-12T17:28:03.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.145+0000 7f5d73606640 1 -- 172.21.15.170:0/1907112728 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e7800fa30 con 0x561d2b2d9730 2024-09-12T17:28:03.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.145+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/1907112728 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561d2b3d0830 con 0x561d2b2d9730 2024-09-12T17:28:03.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.145+0000 7f5d73606640 1 -- 172.21.15.170:0/1907112728 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e7800fd30 con 0x561d2b2d9730 2024-09-12T17:28:03.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.145+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/1907112728 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d2b3d1230 con 0x561d2b2d9730 2024-09-12T17:28:03.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.146+0000 7f5d73606640 1 -- 172.21.15.170:0/1907112728 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f5e78017070 con 0x561d2b2d9730 2024-09-12T17:28:03.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.146+0000 7f5d73606640 1 --2- 172.21.15.170:0/1907112728 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5d6c03c780 0x7f5d6c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.146+0000 7f5d73606640 1 -- 172.21.15.170:0/1907112728 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f5e78015020 con 0x561d2b2d9730 2024-09-12T17:28:03.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.146+0000 7f5e7ffff640 1 --2- 172.21.15.170:0/1907112728 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5d6c03c780 0x7f5d6c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.146+0000 7f5e8ad1f800 1 --2- 172.21.15.170:0/1907112728 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x561d2b2dd240 0x561d2b3d7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.146+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/1907112728 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d2b3d7bd0 con 0x561d2b2dd240 2024-09-12T17:28:03.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.146+0000 7f5e872a3640 1 --2- 172.21.15.170:0/1907112728 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x561d2b2dd240 0x561d2b3d7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.146+0000 7f5e7ffff640 1 --2- 172.21.15.170:0/1907112728 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5d6c03c780 0x7f5d6c03ec40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5e70057000 tx=0x7f5e70052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.146+0000 7f5e872a3640 1 --2- 172.21.15.170:0/1907112728 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x561d2b2dd240 0x561d2b3d7690 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.147+0000 7f5e872a3640 1 -- 172.21.15.170:0/1907112728 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e8000a4d0 con 0x561d2b2dd240 2024-09-12T17:28:03.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.147+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/1907112728 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d2b3d7f70 con 0x561d2b2dd240 2024-09-12T17:28:03.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.147+0000 7f5e872a3640 1 -- 172.21.15.170:0/1907112728 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5e8000a4d0 con 0x561d2b2dd240 2024-09-12T17:28:03.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.147+0000 7f5e8ad1f800 1 --2- 172.21.15.170:0/1907112728 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x561d2b3d9a30 0x561d2b3dbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.147+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/1907112728 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d2b3dc640 con 0x561d2b3d9a30 2024-09-12T17:28:03.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.147+0000 7f5e86aa2640 1 --2- 172.21.15.170:0/1907112728 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x561d2b3d9a30 0x561d2b3dbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.147+0000 7f5e86aa2640 1 --2- 172.21.15.170:0/1907112728 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x561d2b3d9a30 0x561d2b3dbeb0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.148+0000 7f5e86aa2640 1 -- 172.21.15.170:0/1907112728 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5e7802e070 con 0x561d2b3d9a30 2024-09-12T17:28:03.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.148+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/1907112728 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d2b3d87c0 con 0x561d2b2dd240 2024-09-12T17:28:03.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.148+0000 7f5e872a3640 1 -- 172.21.15.170:0/1907112728 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5e8000a4d0 con 0x561d2b2dd240 2024-09-12T17:28:03.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.148+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/1907112728 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d2b3d8b60 con 0x561d2b3d9a30 2024-09-12T17:28:03.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.148+0000 7f5e86aa2640 1 -- 172.21.15.170:0/1907112728 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5e7802e070 con 0x561d2b3d9a30 2024-09-12T17:28:03.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.149+0000 7f5e8ad1f800 1 Processor -- start 2024-09-12T17:28:03.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.149+0000 7f5e8ad1f800 1 -- start start 2024-09-12T17:28:03.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.149+0000 7f5e8ad1f800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d2b3eaed0 0x561d2b3eb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.149+0000 7f5e8ad1f800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x561d2b1cfa00 con 0x561d2b3eaed0 2024-09-12T17:28:03.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.149+0000 7f5e872a3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d2b3eaed0 0x561d2b3eb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.149+0000 7f5e872a3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d2b3eaed0 0x561d2b3eb2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57920/0 (socket says 172.21.15.170:57920) 2024-09-12T17:28:03.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.149+0000 7f5e872a3640 1 -- 172.21.15.170:0/3750871279 learned_addr learned my addr 172.21.15.170:0/3750871279 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:03.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.149+0000 7f5e872a3640 1 -- 172.21.15.170:0/3750871279 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d2b3eb930 con 0x561d2b3eaed0 2024-09-12T17:28:03.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.150+0000 7f5e872a3640 1 --2- 172.21.15.170:0/3750871279 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d2b3eaed0 0x561d2b3eb2f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x561d2b3d1040 tx=0x7f5e800167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.150+0000 7f5d70e01640 1 -- 172.21.15.170:0/3750871279 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e80013640 con 0x561d2b3eaed0 2024-09-12T17:28:03.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.150+0000 7f5d70e01640 1 -- 172.21.15.170:0/3750871279 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e800137e0 con 0x561d2b3eaed0 2024-09-12T17:28:03.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.150+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/3750871279 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561d2b3ec160 con 0x561d2b3eaed0 2024-09-12T17:28:03.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.150+0000 7f5d70e01640 1 -- 172.21.15.170:0/3750871279 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e80013ae0 con 0x561d2b3eaed0 2024-09-12T17:28:03.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.150+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/3750871279 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d2b3ec700 con 0x561d2b3eaed0 2024-09-12T17:28:03.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.151+0000 7f5d70e01640 1 -- 172.21.15.170:0/3750871279 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f5e80011040 con 0x561d2b3eaed0 2024-09-12T17:28:03.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.151+0000 7f5d70e01640 1 --2- 172.21.15.170:0/3750871279 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5d6003c730 0x7f5d6003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.151+0000 7f5d70e01640 1 -- 172.21.15.170:0/3750871279 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f5e8000e040 con 0x561d2b3eaed0 2024-09-12T17:28:03.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.151+0000 7f5e86aa2640 1 --2- 172.21.15.170:0/3750871279 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5d6003c730 0x7f5d6003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.151+0000 7f5e8ad1f800 1 Processor -- start 2024-09-12T17:28:03.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.151+0000 7f5e8ad1f800 1 -- start start 2024-09-12T17:28:03.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.151+0000 7f5e86aa2640 1 --2- 172.21.15.170:0/3750871279 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5d6003c730 0x7f5d6003ebf0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x561d2b3d2120 tx=0x7f5e780525b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.152+0000 7f5e8ad1f800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d2b2d7730 0x561d2b2d7b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.152+0000 7f5e8ad1f800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x561d2b3c8ee0 con 0x561d2b2d7730 2024-09-12T17:28:03.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.152+0000 7f5e872a3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d2b2d7730 0x561d2b2d7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.152+0000 7f5e872a3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d2b2d7730 0x561d2b2d7b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57934/0 (socket says 172.21.15.170:57934) 2024-09-12T17:28:03.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.152+0000 7f5e872a3640 1 -- 172.21.15.170:0/4228895295 learned_addr learned my addr 172.21.15.170:0/4228895295 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:03.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.152+0000 7f5e872a3640 1 -- 172.21.15.170:0/4228895295 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d2b2d8100 con 0x561d2b2d7730 2024-09-12T17:28:03.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.152+0000 7f5e872a3640 1 --2- 172.21.15.170:0/4228895295 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d2b2d7730 0x561d2b2d7b10 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f5e80053cb0 tx=0x7f5e80014480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=512de75574a6f915 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.153+0000 7f5d6a7fc640 1 -- 172.21.15.170:0/4228895295 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e80052070 con 0x561d2b2d7730 2024-09-12T17:28:03.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.153+0000 7f5d6a7fc640 1 -- 172.21.15.170:0/4228895295 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e80021a90 con 0x561d2b2d7730 2024-09-12T17:28:03.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.153+0000 7f5d6a7fc640 1 -- 172.21.15.170:0/4228895295 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e80013dd0 con 0x561d2b2d7730 2024-09-12T17:28:03.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.153+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/4228895295 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d2b2d7730 msgr2=0x561d2b2d7b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.153+0000 7f5e8ad1f800 1 --2- 172.21.15.170:0/4228895295 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d2b2d7730 0x561d2b2d7b10 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f5e80053cb0 tx=0x7f5e80014480 comp rx=0 tx=0).stop 2024-09-12T17:28:03.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.153+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/4228895295 shutdown_connections 2024-09-12T17:28:03.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.153+0000 7f5e8ad1f800 1 --2- 172.21.15.170:0/4228895295 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d2b2d7730 0x561d2b2d7b10 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.153+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/4228895295 >> 172.21.15.170:0/4228895295 conn(0x561d2b3f3e10 msgr2=0x561d2b3f2050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:03.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.153+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/4228895295 shutdown_connections 2024-09-12T17:28:03.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.153+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/4228895295 wait complete. 2024-09-12T17:28:03.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.153+0000 7f5e8ad1f800 1 Processor -- start 2024-09-12T17:28:03.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.153+0000 7f5e8ad1f800 1 -- start start 2024-09-12T17:28:03.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.154+0000 7f5e8ad1f800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d2b2d7730 0x561d2b401160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.154+0000 7f5e8ad1f800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x561d2b2d8790 con 0x561d2b2d7730 2024-09-12T17:28:03.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.154+0000 7f5e872a3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d2b2d7730 0x561d2b401160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.154+0000 7f5e872a3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d2b2d7730 0x561d2b401160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57950/0 (socket says 172.21.15.170:57950) 2024-09-12T17:28:03.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.154+0000 7f5e872a3640 1 -- 172.21.15.170:0/2921291800 learned_addr learned my addr 172.21.15.170:0/2921291800 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:03.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.154+0000 7f5e872a3640 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d2b4016c0 con 0x561d2b2d7730 2024-09-12T17:28:03.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.154+0000 7f5e872a3640 1 --2- 172.21.15.170:0/2921291800 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d2b2d7730 0x561d2b401160 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5e80014570 tx=0x7f5e80021f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.154+0000 7f5d68ff9640 1 -- 172.21.15.170:0/2921291800 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e8001f7c0 con 0x561d2b2d7730 2024-09-12T17:28:03.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.154+0000 7f5d68ff9640 1 -- 172.21.15.170:0/2921291800 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e8001f960 con 0x561d2b2d7730 2024-09-12T17:28:03.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.154+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561d2b401950 con 0x561d2b2d7730 2024-09-12T17:28:03.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.154+0000 7f5d68ff9640 1 -- 172.21.15.170:0/2921291800 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e80020930 con 0x561d2b2d7730 2024-09-12T17:28:03.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.154+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d2b4024e0 con 0x561d2b2d7730 2024-09-12T17:28:03.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.155+0000 7f5d68ff9640 1 -- 172.21.15.170:0/2921291800 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f5e80020ad0 con 0x561d2b2d7730 2024-09-12T17:28:03.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.156+0000 7f5d68ff9640 1 --2- 172.21.15.170:0/2921291800 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5d5003c780 0x7f5d5003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.156+0000 7f5d68ff9640 1 -- 172.21.15.170:0/2921291800 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f5e80047750 con 0x561d2b2d7730 2024-09-12T17:28:03.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.156+0000 7f5e86aa2640 1 --2- 172.21.15.170:0/2921291800 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5d5003c780 0x7f5d5003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.156+0000 7f5e8ad1f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.156+0000 7f5e8ad1f800 1 --2- 172.21.15.170:0/2921291800 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x561d2b40cad0 0x561d2b40ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.156+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d2b40f6b0 con 0x561d2b40cad0 2024-09-12T17:28:03.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.156+0000 7f5e7ffff640 1 --2- 172.21.15.170:0/2921291800 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x561d2b40cad0 0x561d2b40ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.156+0000 7f5e86aa2640 1 --2- 172.21.15.170:0/2921291800 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5d5003c780 0x7f5d5003ec40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5e7801bfd0 tx=0x7f5e78048000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.157+0000 7f5e7ffff640 1 --2- 172.21.15.170:0/2921291800 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x561d2b40cad0 0x561d2b40ef60 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.157+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e70057030 con 0x561d2b40cad0 2024-09-12T17:28:03.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.157+0000 7f5e8ad1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.157+0000 7f5e8ad1f800 20 realm 2024-09-12T17:28:03.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.157+0000 7f5e8ad1f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.157+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d2b40fae0 con 0x561d2b40cad0 2024-09-12T17:28:03.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.157+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e70057030 con 0x561d2b40cad0 2024-09-12T17:28:03.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.157+0000 7f5e8ad1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.157+0000 7f5e8ad1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:03.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.157+0000 7f5e8ad1f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.157+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d2b4103b0 con 0x561d2b40cad0 2024-09-12T17:28:03.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.157+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e70057030 con 0x561d2b40cad0 2024-09-12T17:28:03.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.157+0000 7f5e8ad1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.157+0000 7f5e8ad1f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.157+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d2b410750 con 0x561d2b40cad0 2024-09-12T17:28:03.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.157+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5e70057030 con 0x561d2b40cad0 2024-09-12T17:28:03.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.158+0000 7f5e8ad1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:03.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.158+0000 7f5e8ad1f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.158+0000 7f5e8ad1f800 1 --2- 172.21.15.170:0/2921291800 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x561d2b4114b0 0x561d2b4138a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.158+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d2b413de0 con 0x561d2b4114b0 2024-09-12T17:28:03.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.158+0000 7f5e872a3640 1 --2- 172.21.15.170:0/2921291800 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x561d2b4114b0 0x561d2b4138a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.158+0000 7f5e872a3640 1 --2- 172.21.15.170:0/2921291800 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x561d2b4114b0 0x561d2b4138a0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.158+0000 7f5e872a3640 1 -- 172.21.15.170:0/2921291800 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5e8003a070 con 0x561d2b4114b0 2024-09-12T17:28:03.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.158+0000 7f5e8ad1f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:03.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.158+0000 7f5e8ad1f800 20 searching for the correct realm 2024-09-12T17:28:03.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.158+0000 7f5e8ad1f800 1 --2- 172.21.15.170:0/2921291800 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x561d2b415e50 0x561d2b418310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.158+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561d2b4189e0 con 0x561d2b415e50 2024-09-12T17:28:03.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.158+0000 7f5e86aa2640 1 --2- 172.21.15.170:0/2921291800 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x561d2b415e50 0x561d2b418310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.159+0000 7f5e86aa2640 1 --2- 172.21.15.170:0/2921291800 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x561d2b415e50 0x561d2b418310 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.159+0000 7f5e86aa2640 1 -- 172.21.15.170:0/2921291800 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e78057040 con 0x561d2b415e50 2024-09-12T17:28:03.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.159+0000 7f5e86aa2640 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561d2b4189e0 con 0x561d2b4114b0 2024-09-12T17:28:03.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.159+0000 7f5e872a3640 1 -- 172.21.15.170:0/2921291800 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e8003a070 con 0x561d2b4114b0 2024-09-12T17:28:03.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.159+0000 7f5e872a3640 1 --2- 172.21.15.170:0/2921291800 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f5e80012a30 0x7f5e800123d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.159+0000 7f5e872a3640 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561d2b4189e0 con 0x7f5e80012a30 2024-09-12T17:28:03.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.159+0000 7f5e7ffff640 1 --2- 172.21.15.170:0/2921291800 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f5e80012a30 0x7f5e800123d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.160+0000 7f5e7ffff640 1 --2- 172.21.15.170:0/2921291800 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f5e80012a30 0x7f5e800123d0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.160+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e70057030 con 0x7f5e80012a30 2024-09-12T17:28:03.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.160+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561d2b4189e0 con 0x561d2b40cad0 2024-09-12T17:28:03.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.160+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e70057030 con 0x561d2b40cad0 2024-09-12T17:28:03.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.160+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561d2b4189e0 con 0x561d2b40cad0 2024-09-12T17:28:03.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.160+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e70057030 con 0x561d2b40cad0 2024-09-12T17:28:03.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.160+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561d2b4189e0 con 0x7f5e80012a30 2024-09-12T17:28:03.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.161+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e70057030 con 0x7f5e80012a30 2024-09-12T17:28:03.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.161+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561d2b4189e0 con 0x7f5e80012a30 2024-09-12T17:28:03.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.161+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e70057030 con 0x7f5e80012a30 2024-09-12T17:28:03.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.161+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561d2b4189e0 con 0x561d2b4114b0 2024-09-12T17:28:03.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.161+0000 7f5e872a3640 1 -- 172.21.15.170:0/2921291800 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e8003a070 con 0x561d2b4114b0 2024-09-12T17:28:03.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.161+0000 7f5e872a3640 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561d2b4189e0 con 0x561d2b415e50 2024-09-12T17:28:03.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.161+0000 7f5e86aa2640 1 -- 172.21.15.170:0/2921291800 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e78057040 con 0x561d2b415e50 2024-09-12T17:28:03.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.161+0000 7f5e86aa2640 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561d2b4189e0 con 0x561d2b40cad0 2024-09-12T17:28:03.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.162+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e70057030 con 0x561d2b40cad0 2024-09-12T17:28:03.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.162+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561d2b4189e0 con 0x7f5e80012a30 2024-09-12T17:28:03.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.162+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e70057030 con 0x7f5e80012a30 2024-09-12T17:28:03.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.162+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561d2b4189e0 con 0x561d2b40cad0 2024-09-12T17:28:03.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.162+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e70057030 con 0x561d2b40cad0 2024-09-12T17:28:03.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.162+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561d2b4189e0 con 0x561d2b4114b0 2024-09-12T17:28:03.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.162+0000 7f5e872a3640 1 -- 172.21.15.170:0/2921291800 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f5e8003a070 con 0x561d2b4114b0 2024-09-12T17:28:03.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.162+0000 7f5e872a3640 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561d2b4189e0 con 0x561d2b415e50 2024-09-12T17:28:03.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.162+0000 7f5e86aa2640 1 -- 172.21.15.170:0/2921291800 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e78057040 con 0x561d2b415e50 2024-09-12T17:28:03.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.163+0000 7f5e86aa2640 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561d2b4189e0 con 0x561d2b415e50 2024-09-12T17:28:03.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.163+0000 7f5e86aa2640 1 -- 172.21.15.170:0/2921291800 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e78057040 con 0x561d2b415e50 2024-09-12T17:28:03.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.163+0000 7f5e86aa2640 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561d2b4189e0 con 0x7f5e80012a30 2024-09-12T17:28:03.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.163+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e70057030 con 0x7f5e80012a30 2024-09-12T17:28:03.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.163+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561d2b4189e0 con 0x561d2b415e50 2024-09-12T17:28:03.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.163+0000 7f5e86aa2640 1 -- 172.21.15.170:0/2921291800 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e78057040 con 0x561d2b415e50 2024-09-12T17:28:03.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.163+0000 7f5e86aa2640 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561d2b4189e0 con 0x561d2b415e50 2024-09-12T17:28:03.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.163+0000 7f5e86aa2640 1 -- 172.21.15.170:0/2921291800 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e78057040 con 0x561d2b415e50 2024-09-12T17:28:03.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.163+0000 7f5e86aa2640 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561d2b4189e0 con 0x561d2b40cad0 2024-09-12T17:28:03.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.164+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e70057030 con 0x561d2b40cad0 2024-09-12T17:28:03.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.164+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561d2b4189e0 con 0x561d2b40cad0 2024-09-12T17:28:03.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.164+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5e70057030 con 0x561d2b40cad0 2024-09-12T17:28:03.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.164+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561d2b4189e0 con 0x7f5e80012a30 2024-09-12T17:28:03.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.164+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e70057030 con 0x7f5e80012a30 2024-09-12T17:28:03.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.164+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561d2b4189e0 con 0x561d2b415e50 2024-09-12T17:28:03.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.164+0000 7f5e86aa2640 1 -- 172.21.15.170:0/2921291800 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e78057040 con 0x561d2b415e50 2024-09-12T17:28:03.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.164+0000 7f5e86aa2640 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561d2b4189e0 con 0x561d2b4114b0 2024-09-12T17:28:03.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.165+0000 7f5e872a3640 1 -- 172.21.15.170:0/2921291800 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e8003a070 con 0x561d2b4114b0 2024-09-12T17:28:03.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.165+0000 7f5e872a3640 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561d2b4189e0 con 0x561d2b40cad0 2024-09-12T17:28:03.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.165+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e70057030 con 0x561d2b40cad0 2024-09-12T17:28:03.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.165+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561d2b4189e0 con 0x7f5e80012a30 2024-09-12T17:28:03.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.165+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e70057030 con 0x7f5e80012a30 2024-09-12T17:28:03.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.165+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561d2b4189e0 con 0x561d2b415e50 2024-09-12T17:28:03.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.165+0000 7f5e86aa2640 1 -- 172.21.15.170:0/2921291800 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e78057040 con 0x561d2b415e50 2024-09-12T17:28:03.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.165+0000 7f5e86aa2640 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561d2b4189e0 con 0x7f5e80012a30 2024-09-12T17:28:03.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.166+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e70057030 con 0x7f5e80012a30 2024-09-12T17:28:03.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.166+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561d2b4189e0 con 0x561d2b4114b0 2024-09-12T17:28:03.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.166+0000 7f5e872a3640 1 -- 172.21.15.170:0/2921291800 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e80061040 con 0x561d2b4114b0 2024-09-12T17:28:03.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.166+0000 7f5e872a3640 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561d2b4189e0 con 0x561d2b415e50 2024-09-12T17:28:03.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.166+0000 7f5e86aa2640 1 -- 172.21.15.170:0/2921291800 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e78057040 con 0x561d2b415e50 2024-09-12T17:28:03.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.166+0000 7f5e86aa2640 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561d2b4189e0 con 0x7f5e80012a30 2024-09-12T17:28:03.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.166+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e70057030 con 0x7f5e80012a30 2024-09-12T17:28:03.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.166+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561d2b4189e0 con 0x561d2b40cad0 2024-09-12T17:28:03.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.166+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5e70057030 con 0x561d2b40cad0 2024-09-12T17:28:03.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.166+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561d2b4189e0 con 0x561d2b4114b0 2024-09-12T17:28:03.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.167+0000 7f5e872a3640 1 -- 172.21.15.170:0/2921291800 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5e80061040 con 0x561d2b4114b0 2024-09-12T17:28:03.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.167+0000 7f5e8ad1f800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:03.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.167+0000 7f5e8ad1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:03.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.167+0000 7f5e8ad1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:03.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.167+0000 7f5e8ad1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:03.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.167+0000 7f5e8ad1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:03.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.167+0000 7f5e8ad1f800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:03.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.167+0000 7f5e8ad1f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.167+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d2b414880 con 0x561d2b40cad0 2024-09-12T17:28:03.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.167+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e70057030 con 0x561d2b40cad0 2024-09-12T17:28:03.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.167+0000 7f5e8ad1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.167+0000 7f5e8ad1f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.167+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d2b4144c0 con 0x561d2b40cad0 2024-09-12T17:28:03.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.167+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5e70057030 con 0x561d2b40cad0 2024-09-12T17:28:03.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.167+0000 7f5e8ad1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:03.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.167+0000 7f5e8ad1f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.167+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d2b4151a0 con 0x561d2b4114b0 2024-09-12T17:28:03.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.168+0000 7f5e872a3640 1 -- 172.21.15.170:0/2921291800 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5e80061040 con 0x561d2b4114b0 2024-09-12T17:28:03.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.168+0000 7f5e8ad1f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:03.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.168+0000 7f5e8ad1f800 20 zone default found 2024-09-12T17:28:03.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.168+0000 7f5e8ad1f800 4 Realm: () 2024-09-12T17:28:03.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.168+0000 7f5e8ad1f800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:03.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.168+0000 7f5e8ad1f800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:03.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.168+0000 7f5e8ad1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:03.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.168+0000 7f5e8ad1f800 20 zonegroup default 2024-09-12T17:28:03.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.168+0000 7f5e8ad1f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.168+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d2b414d80 con 0x7f5e80012a30 2024-09-12T17:28:03.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.168+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5e70057030 con 0x7f5e80012a30 2024-09-12T17:28:03.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.168+0000 7f5e8ad1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.168+0000 7f5e8ad1f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.168+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d2b41b230 con 0x561d2b415e50 2024-09-12T17:28:03.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.168+0000 7f5e86aa2640 1 -- 172.21.15.170:0/2921291800 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5e78057040 con 0x561d2b415e50 2024-09-12T17:28:03.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.168+0000 7f5e8ad1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.168+0000 7f5e8ad1f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.168+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d2b41b5d0 con 0x561d2b415e50 2024-09-12T17:28:03.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.168+0000 7f5e86aa2640 1 -- 172.21.15.170:0/2921291800 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5e78057040 con 0x561d2b415e50 2024-09-12T17:28:03.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.168+0000 7f5e8ad1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.168+0000 7f5e8ad1f800 20 started sync module instance, tier type = 2024-09-12T17:28:03.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.168+0000 7f5e8ad1f800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:03.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.168+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d2b41a6c0 con 0x561d2b4114b0 2024-09-12T17:28:03.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.169+0000 7f5e872a3640 1 -- 172.21.15.170:0/2921291800 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e80061040 con 0x561d2b4114b0 2024-09-12T17:28:03.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.169+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94683279764144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d2b41beb0 con 0x561d2b4114b0 2024-09-12T17:28:03.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.169+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d2b41c700 con 0x561d2b40cad0 2024-09-12T17:28:03.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.170+0000 7f5e872a3640 1 -- 172.21.15.170:0/2921291800 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94683279764144] v29'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e80061040 con 0x561d2b4114b0 2024-09-12T17:28:03.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.170+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e70057030 con 0x561d2b40cad0 2024-09-12T17:28:03.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.170+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94683279768336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d2b41c460 con 0x561d2b40cad0 2024-09-12T17:28:03.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.170+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d2b41cf80 con 0x561d2b415e50 2024-09-12T17:28:03.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.171+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94683279768336] v29'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e70057030 con 0x561d2b40cad0 2024-09-12T17:28:03.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.172+0000 7f5e86aa2640 1 -- 172.21.15.170:0/2921291800 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e78057040 con 0x561d2b415e50 2024-09-12T17:28:03.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.172+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94683279772240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d2b41d370 con 0x561d2b415e50 2024-09-12T17:28:03.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.172+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d2b41dd70 con 0x561d2b4114b0 2024-09-12T17:28:03.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.173+0000 7f5e86aa2640 1 -- 172.21.15.170:0/2921291800 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94683279772240] v29'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e78057040 con 0x561d2b415e50 2024-09-12T17:28:03.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.173+0000 7f5e872a3640 1 -- 172.21.15.170:0/2921291800 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e80061040 con 0x561d2b4114b0 2024-09-12T17:28:03.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.173+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94683279769392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d2b41e160 con 0x561d2b4114b0 2024-09-12T17:28:03.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.173+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d2b41eb60 con 0x561d2b40cad0 2024-09-12T17:28:03.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.174+0000 7f5e872a3640 1 -- 172.21.15.170:0/2921291800 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94683279769392] v29'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e80061040 con 0x561d2b4114b0 2024-09-12T17:28:03.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.174+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e70057030 con 0x561d2b40cad0 2024-09-12T17:28:03.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.174+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94683279775872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d2b41eb20 con 0x561d2b40cad0 2024-09-12T17:28:03.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.174+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d2b41f5a0 con 0x7f5e80012a30 2024-09-12T17:28:03.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.175+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94683279775872] v29'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e70057030 con 0x561d2b40cad0 2024-09-12T17:28:03.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.175+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e70057030 con 0x7f5e80012a30 2024-09-12T17:28:03.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.175+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94683279782608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d2b41eb20 con 0x7f5e80012a30 2024-09-12T17:28:03.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.175+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d2b41ffe0 con 0x7f5e80012a30 2024-09-12T17:28:03.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.176+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94683279782608] v29'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e70057030 con 0x7f5e80012a30 2024-09-12T17:28:03.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.176+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(56 notify.6 [create] v29'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e70057030 con 0x7f5e80012a30 2024-09-12T17:28:03.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.176+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94683279779920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d2b41ffe0 con 0x7f5e80012a30 2024-09-12T17:28:03.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.176+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d2b420a00 con 0x7f5e80012a30 2024-09-12T17:28:03.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.177+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(58 notify.7 [create] v29'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e70057030 con 0x7f5e80012a30 2024-09-12T17:28:03.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.177+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94683279779920] v29'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e70057030 con 0x7f5e80012a30 2024-09-12T17:28:03.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.177+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94683279787248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d2b420e70 con 0x7f5e80012a30 2024-09-12T17:28:03.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.177+0000 7f5e8ad1f800 20 add_watcher() i=0 2024-09-12T17:28:03.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.177+0000 7f5e8ad1f800 20 add_watcher() i=1 2024-09-12T17:28:03.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.177+0000 7f5e8ad1f800 20 add_watcher() i=2 2024-09-12T17:28:03.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.177+0000 7f5e8ad1f800 20 add_watcher() i=3 2024-09-12T17:28:03.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.177+0000 7f5e8ad1f800 20 add_watcher() i=4 2024-09-12T17:28:03.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.177+0000 7f5e8ad1f800 20 add_watcher() i=5 2024-09-12T17:28:03.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.177+0000 7f5e8ad1f800 20 add_watcher() i=6 2024-09-12T17:28:03.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.178+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94683279787248] v29'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e70057030 con 0x7f5e80012a30 2024-09-12T17:28:03.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.178+0000 7f5e8ad1f800 20 add_watcher() i=7 2024-09-12T17:28:03.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.178+0000 7f5e8ad1f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:03.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.178+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d2b420e70 con 0x561d2b40cad0 2024-09-12T17:28:03.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.178+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5e70057030 con 0x561d2b40cad0 2024-09-12T17:28:03.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.178+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94683279788480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d2b420e50 con 0x561d2b40cad0 2024-09-12T17:28:03.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.179+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94683279788480] v29'102 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5e70057030 con 0x561d2b40cad0 2024-09-12T17:28:03.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.179+0000 7f5d3d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:03.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.179+0000 7f5e8ad1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:03.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.179+0000 7f5e8ad1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:03.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.180+0000 7f5e8ad1f800 5 note: GC not initialized 2024-09-12T17:28:03.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.180+0000 7f5cb7fff640 20 reqs_thread_entry: start 2024-09-12T17:28:03.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.180+0000 7f5e8ad1f800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:03.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.180+0000 7f5e8ad1f800 20 Filter name: none 2024-09-12T17:28:03.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.180+0000 7f5cb5ffb640 20 reqs_thread_entry: start 2024-09-12T17:28:03.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.180+0000 7f5e8ad1f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.180+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d2b456aa0 con 0x561d2b40cad0 2024-09-12T17:28:03.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.180+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5e70057030 con 0x561d2b40cad0 2024-09-12T17:28:03.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.180+0000 7f5e8ad1f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:28:03.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.180+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d2b457ec0 con 0x561d2b4114b0 2024-09-12T17:28:03.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.181+0000 7f5e872a3640 1 -- 172.21.15.170:0/2921291800 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f5e80061040 con 0x561d2b4114b0 2024-09-12T17:28:03.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.181+0000 7f5e8ad1f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.181+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:64 8.1d 8:baccd554:root::.bucket.meta.myfoo%3a7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d2b457e90 con 0x7f5e80012a30 2024-09-12T17:28:03.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.181+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(64 .bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f5e70057030 con 0x7f5e80012a30 2024-09-12T17:28:03.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.181+0000 7f5e8ad1f800 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T17:28:03.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.181+0000 7f5e8ad1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:28:03.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.182+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:65 4.33 4:cf7a7992:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d2b4599d0 con 0x7f5e80012a30 2024-09-12T17:28:03.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.182+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:66 4.a 4:523b0550:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d2b45c680 con 0x561d2b4114b0 2024-09-12T17:28:03.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.182+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:67 4.2e 4:74d1473b:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d2b45f330 con 0x561d2b415e50 2024-09-12T17:28:03.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.182+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 4.12 4:4b79d0ba:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d2b45c680 con 0x561d2b40cad0 2024-09-12T17:28:03.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.182+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:69 4.20 4:058cb7b5:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d2b4643e0 con 0x561d2b40cad0 2024-09-12T17:28:03.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.182+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:70 4.3 4:c2f55514:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d2b4643e0 con 0x561d2b40cad0 2024-09-12T17:28:03.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.182+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:71 4.3e 4:7f412122:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d2b469600 con 0x561d2b4114b0 2024-09-12T17:28:03.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.182+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:72 4.9 4:916cfff6:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d2b46c3b0 con 0x561d2b40cad0 2024-09-12T17:28:03.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.182+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:73 4.3f 4:fe994f63:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d2b46f160 con 0x561d2b4114b0 2024-09-12T17:28:03.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.182+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:74 4.3f 4:fcb62fad:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d2b471e50 con 0x561d2b4114b0 2024-09-12T17:28:03.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.182+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:75 4.16 4:6840e132:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d2b474c00 con 0x561d2b415e50 2024-09-12T17:28:03.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.182+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(65 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e70089040 con 0x7f5e80012a30 2024-09-12T17:28:03.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.182+0000 7f5e872a3640 1 -- 172.21.15.170:0/2921291800 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(66 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e80061040 con 0x561d2b4114b0 2024-09-12T17:28:03.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.182+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(68 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e70089040 con 0x561d2b40cad0 2024-09-12T17:28:03.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.182+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(69 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e70089040 con 0x561d2b40cad0 2024-09-12T17:28:03.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.182+0000 7f5e86aa2640 1 -- 172.21.15.170:0/2921291800 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(67 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e78057040 con 0x561d2b415e50 2024-09-12T17:28:03.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.182+0000 7f5e86aa2640 1 -- 172.21.15.170:0/2921291800 <== osd.3 v2:172.21.15.170:6816/2664906588 15 ==== osd_op_reply(75 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f5e78057040 con 0x561d2b415e50 2024-09-12T17:28:03.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.182+0000 7f5e872a3640 1 -- 172.21.15.170:0/2921291800 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(71 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e80061040 con 0x561d2b4114b0 2024-09-12T17:28:03.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.182+0000 7f5e872a3640 1 -- 172.21.15.170:0/2921291800 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(73 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e80061040 con 0x561d2b4114b0 2024-09-12T17:28:03.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.182+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(70 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.5 [call out=128b] v0'0 uv3 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f5e70089040 con 0x561d2b40cad0 2024-09-12T17:28:03.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.183+0000 7f5e872a3640 1 -- 172.21.15.170:0/2921291800 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== osd_op_reply(74 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.9 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e80061040 con 0x561d2b4114b0 2024-09-12T17:28:03.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.183+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(72 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e70089040 con 0x561d2b40cad0 2024-09-12T17:28:03.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.183+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d2b469600 con 0x561d2b4114b0 2024-09-12T17:28:03.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.184+0000 7f5e872a3640 1 -- 172.21.15.170:0/2921291800 <== osd.2 v2:172.21.15.170:6808/3855567754 18 ==== osd_op_reply(76 foo.buckets [call] v29'15 uv15 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f5e80061040 con 0x561d2b4114b0 2024-09-12T17:28:03.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.184+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d2b469600 con 0x561d2b4114b0 2024-09-12T17:28:03.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.185+0000 7f5e872a3640 1 -- 172.21.15.170:0/2921291800 <== osd.2 v2:172.21.15.170:6808/3855567754 19 ==== osd_op_reply(77 foo.buckets [call] v29'16 uv16 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f5e80061040 con 0x561d2b4114b0 2024-09-12T17:28:03.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.185+0000 7f5e8ad1f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.185+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d2b469600 con 0x561d2b40cad0 2024-09-12T17:28:03.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.185+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(78 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5e70089040 con 0x561d2b40cad0 2024-09-12T17:28:03.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.185+0000 7f5e8ad1f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:28:03.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.185+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d2b469600 con 0x561d2b4114b0 2024-09-12T17:28:03.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.185+0000 7f5e872a3640 1 -- 172.21.15.170:0/2921291800 <== osd.2 v2:172.21.15.170:6808/3855567754 20 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) ==== 155+0+58 (crc 0 0 0) 0x7f5e80061040 con 0x561d2b4114b0 2024-09-12T17:28:03.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.186+0000 7f5d3d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:03.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.186+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94683279788480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d2b469600 con 0x561d2b40cad0 2024-09-12T17:28:03.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.187+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 94683279788480] v29'103 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5e70089040 con 0x561d2b40cad0 2024-09-12T17:28:03.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.187+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94683279764144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d2b469600 con 0x561d2b4114b0 2024-09-12T17:28:03.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.188+0000 7f5e872a3640 1 -- 172.21.15.170:0/2921291800 <== osd.2 v2:172.21.15.170:6808/3855567754 21 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 94683279764144] v29'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e80061040 con 0x561d2b4114b0 2024-09-12T17:28:03.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.188+0000 7f5e8ad1f800 20 remove_watcher() i=0 2024-09-12T17:28:03.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.188+0000 7f5e8ad1f800 2 removed watcher, disabling cache 2024-09-12T17:28:03.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.188+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94683279768336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d2b469600 con 0x561d2b40cad0 2024-09-12T17:28:03.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.189+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 94683279768336] v29'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e70089040 con 0x561d2b40cad0 2024-09-12T17:28:03.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.189+0000 7f5e8ad1f800 20 remove_watcher() i=1 2024-09-12T17:28:03.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.189+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94683279772240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d2b469600 con 0x561d2b415e50 2024-09-12T17:28:03.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.190+0000 7f5e86aa2640 1 -- 172.21.15.170:0/2921291800 <== osd.3 v2:172.21.15.170:6816/2664906588 16 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 94683279772240] v29'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e78057040 con 0x561d2b415e50 2024-09-12T17:28:03.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.190+0000 7f5e8ad1f800 20 remove_watcher() i=2 2024-09-12T17:28:03.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.190+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94683279769392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d2b41ca50 con 0x561d2b4114b0 2024-09-12T17:28:03.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.191+0000 7f5e872a3640 1 -- 172.21.15.170:0/2921291800 <== osd.2 v2:172.21.15.170:6808/3855567754 22 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 94683279769392] v29'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e80061040 con 0x561d2b4114b0 2024-09-12T17:28:03.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.191+0000 7f5e8ad1f800 20 remove_watcher() i=3 2024-09-12T17:28:03.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.191+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94683279775872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d2b41ca50 con 0x561d2b40cad0 2024-09-12T17:28:03.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.192+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 94683279775872] v29'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e70089040 con 0x561d2b40cad0 2024-09-12T17:28:03.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.192+0000 7f5e8ad1f800 20 remove_watcher() i=4 2024-09-12T17:28:03.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.192+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94683279782608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d2b41d880 con 0x7f5e80012a30 2024-09-12T17:28:03.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.193+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 94683279782608] v29'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e70089040 con 0x7f5e80012a30 2024-09-12T17:28:03.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.193+0000 7f5e8ad1f800 20 remove_watcher() i=5 2024-09-12T17:28:03.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.193+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94683279779920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d2b41d880 con 0x7f5e80012a30 2024-09-12T17:28:03.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.194+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 94683279779920] v29'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e70089040 con 0x7f5e80012a30 2024-09-12T17:28:03.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.194+0000 7f5e8ad1f800 20 remove_watcher() i=6 2024-09-12T17:28:03.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.194+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94683279787248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d2b41d880 con 0x7f5e80012a30 2024-09-12T17:28:03.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.195+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 94683279787248] v29'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e70089040 con 0x7f5e80012a30 2024-09-12T17:28:03.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.195+0000 7f5e8ad1f800 20 remove_watcher() i=7 2024-09-12T17:28:03.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.195+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f5e80012a30 msgr2=0x7f5e800123d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.195+0000 7f5e8ad1f800 1 --2- 172.21.15.170:0/2921291800 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f5e80012a30 0x7f5e800123d0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.195+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x561d2b40cad0 msgr2=0x561d2b40ef60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.195+0000 7f5e8ad1f800 1 --2- 172.21.15.170:0/2921291800 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x561d2b40cad0 0x561d2b40ef60 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.195+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x561d2b4114b0 msgr2=0x561d2b4138a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.195+0000 7f5e8ad1f800 1 --2- 172.21.15.170:0/2921291800 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x561d2b4114b0 0x561d2b4138a0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.195+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x561d2b415e50 msgr2=0x561d2b418310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.195+0000 7f5e8ad1f800 1 --2- 172.21.15.170:0/2921291800 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x561d2b415e50 0x561d2b418310 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.195+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5d5003c780 msgr2=0x7f5d5003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.195+0000 7f5e8ad1f800 1 --2- 172.21.15.170:0/2921291800 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5d5003c780 0x7f5d5003ec40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5e7801bfd0 tx=0x7f5e78048000 comp rx=0 tx=0).stop 2024-09-12T17:28:03.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.196+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d2b2d7730 msgr2=0x561d2b401160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.196+0000 7f5e8ad1f800 1 --2- 172.21.15.170:0/2921291800 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d2b2d7730 0x561d2b401160 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5e80014570 tx=0x7f5e80021f90 comp rx=0 tx=0).stop 2024-09-12T17:28:03.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.196+0000 7f5e7ffff640 1 -- 172.21.15.170:0/2921291800 reap_dead start 2024-09-12T17:28:03.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.196+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 shutdown_connections 2024-09-12T17:28:03.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.196+0000 7f5e8ad1f800 1 --2- 172.21.15.170:0/2921291800 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d2b2d7730 0x561d2b401160 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.196+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 >> 172.21.15.170:0/2921291800 conn(0x561d2b3f3e10 msgr2=0x561d2b3f2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:03.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.196+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 shutdown_connections 2024-09-12T17:28:03.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.196+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/2921291800 wait complete. 2024-09-12T17:28:03.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.196+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/3750871279 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5d6003c730 msgr2=0x7f5d6003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.196+0000 7f5e8ad1f800 1 --2- 172.21.15.170:0/3750871279 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5d6003c730 0x7f5d6003ebf0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x561d2b3d2120 tx=0x7f5e780525b0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.196+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/3750871279 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d2b3eaed0 msgr2=0x561d2b3eb2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.196+0000 7f5e8ad1f800 1 --2- 172.21.15.170:0/3750871279 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d2b3eaed0 0x561d2b3eb2f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x561d2b3d1040 tx=0x7f5e800167b0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.196+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/3750871279 shutdown_connections 2024-09-12T17:28:03.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.196+0000 7f5e8ad1f800 1 --2- 172.21.15.170:0/3750871279 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5d6003c730 0x7f5d6003ebf0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.196+0000 7f5e8ad1f800 1 --2- 172.21.15.170:0/3750871279 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d2b3eaed0 0x561d2b3eb2f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.196+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/3750871279 >> 172.21.15.170:0/3750871279 conn(0x561d2b3df280 msgr2=0x561d2b3df660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:03.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.196+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/3750871279 shutdown_connections 2024-09-12T17:28:03.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.196+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/3750871279 wait complete. 2024-09-12T17:28:03.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.196+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/1907112728 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x561d2b2dd240 msgr2=0x561d2b3d7690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.196+0000 7f5e8ad1f800 1 --2- 172.21.15.170:0/1907112728 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x561d2b2dd240 0x561d2b3d7690 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.196+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/1907112728 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x561d2b3d9a30 msgr2=0x561d2b3dbeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.196+0000 7f5e8ad1f800 1 --2- 172.21.15.170:0/1907112728 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x561d2b3d9a30 0x561d2b3dbeb0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.197+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/1907112728 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5d6c03c780 msgr2=0x7f5d6c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.197+0000 7f5e8ad1f800 1 --2- 172.21.15.170:0/1907112728 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5d6c03c780 0x7f5d6c03ec40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5e70057000 tx=0x7f5e70052000 comp rx=0 tx=0).stop 2024-09-12T17:28:03.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.197+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/1907112728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d2b2d9730 msgr2=0x561d2b3d0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.197+0000 7f5e8ad1f800 1 --2- 172.21.15.170:0/1907112728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d2b2d9730 0x561d2b3d0040 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x561d2b3c9620 tx=0x7f5e78000ed0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.197+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/1907112728 shutdown_connections 2024-09-12T17:28:03.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.197+0000 7f5e8ad1f800 1 --2- 172.21.15.170:0/1907112728 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x561d2b3d9a30 0x561d2b3dbeb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.197+0000 7f5e8ad1f800 1 --2- 172.21.15.170:0/1907112728 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5d6c03c780 0x7f5d6c03ec40 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.197+0000 7f5e8ad1f800 1 --2- 172.21.15.170:0/1907112728 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x561d2b2dd240 0x561d2b3d7690 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.197+0000 7f5e8ad1f800 1 --2- 172.21.15.170:0/1907112728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d2b2d9730 0x561d2b3d0040 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.197+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/1907112728 >> 172.21.15.170:0/1907112728 conn(0x561d2b2d31d0 msgr2=0x561d2b3c9970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:03.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.197+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/1907112728 shutdown_connections 2024-09-12T17:28:03.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.197+0000 7f5e8ad1f800 1 -- 172.21.15.170:0/1907112728 wait complete. 2024-09-12T17:28:03.213 INFO:teuthology.orchestra.run.smithi170.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-09-12T17:28:03.186007Z","last_stats_update":"2024-09-12T17:28:03.184963Z"} 2024-09-12T17:28:03.216 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-09-12T17:28:03.186007Z', 'last_stats_update': '2024-09-12T17:28:03.184963Z'} 2024-09-12T17:28:03.221 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:28:03.221 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-12T17:28:03.221 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-12T17:28:03.221 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-09-12T17:28:03.268 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:03.268 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:03.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.266+0000 7f3c4d12a800 1 Processor -- start 2024-09-12T17:28:03.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.266+0000 7f3c4d12a800 1 -- start start 2024-09-12T17:28:03.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.267+0000 7f3c4d12a800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55e4bd229200 0x55e4bd22b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.267+0000 7f3c4d12a800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e4bd0cee40 con 0x55e4bd225690 2024-09-12T17:28:03.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.267+0000 7f3c4d12a800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x55e4bd099680 con 0x55e4bd229200 2024-09-12T17:28:03.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.267+0000 7f3c4064e640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55e4bd229200 0x55e4bd22b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.267+0000 7f3c48e4f640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x55e4bd225690 0x55e4bd227a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:48452/0 (socket says 172.21.15.170:48452) 2024-09-12T17:28:03.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.267+0000 7f3c48e4f640 1 -- 172.21.15.170:0/2205396211 learned_addr learned my addr 172.21.15.170:0/2205396211 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:28:03.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.267+0000 7f3c4064e640 1 -- 172.21.15.170:0/2205396211 >> v1:172.21.15.47:6789/0 conn(0x55e4bd225690 legacy=0x55e4bd227a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.267+0000 7f3c4064e640 1 -- 172.21.15.170:0/2205396211 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4bd0b56b0 con 0x55e4bd229200 2024-09-12T17:28:03.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.269+0000 7f3c4064e640 1 --2- 172.21.15.170:0/2205396211 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4bd229200 0x55e4bd22b6c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3c3000a470 tx=0x7f3c30045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e0b58e93dc8f988 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.270+0000 7f3c43fff640 1 -- 172.21.15.170:0/2205396211 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c30053570 con 0x55e4bd229200 2024-09-12T17:28:03.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.270+0000 7f3c43fff640 1 -- 172.21.15.170:0/2205396211 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c30058070 con 0x55e4bd229200 2024-09-12T17:28:03.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.270+0000 7f3c43fff640 1 -- 172.21.15.170:0/2205396211 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c30053880 con 0x55e4bd229200 2024-09-12T17:28:03.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.270+0000 7f3c4d12a800 1 -- 172.21.15.170:0/2205396211 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4bd229200 msgr2=0x55e4bd22b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.270+0000 7f3c4d12a800 1 --2- 172.21.15.170:0/2205396211 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4bd229200 0x55e4bd22b6c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3c3000a470 tx=0x7f3c30045a20 comp rx=0 tx=0).stop 2024-09-12T17:28:03.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.270+0000 7f3c4d12a800 1 -- 172.21.15.170:0/2205396211 shutdown_connections 2024-09-12T17:28:03.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.270+0000 7f3c4d12a800 1 --2- 172.21.15.170:0/2205396211 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4bd229200 0x55e4bd22b6c0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.270+0000 7f3c4d12a800 1 -- 172.21.15.170:0/2205396211 >> 172.21.15.170:0/2205396211 conn(0x55e4bd21f1d0 msgr2=0x55e4bd221630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:03.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.270+0000 7f3c4d12a800 1 -- 172.21.15.170:0/2205396211 shutdown_connections 2024-09-12T17:28:03.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.270+0000 7f3c4d12a800 1 -- 172.21.15.170:0/2205396211 wait complete. 2024-09-12T17:28:03.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.284+0000 7f3c4d12a800 1 Processor -- start 2024-09-12T17:28:03.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.284+0000 7f3c4d12a800 1 -- start start 2024-09-12T17:28:03.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.284+0000 7f3c4d12a800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4bd225690 0x55e4bd224e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.284+0000 7f3c4d12a800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e4bd0bddd0 con 0x55e4bd225690 2024-09-12T17:28:03.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.285+0000 7f3c48e4f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4bd225690 0x55e4bd224e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.285+0000 7f3c48e4f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4bd225690 0x55e4bd224e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57974/0 (socket says 172.21.15.170:57974) 2024-09-12T17:28:03.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.285+0000 7f3c48e4f640 1 -- 172.21.15.170:0/100348808 learned_addr learned my addr 172.21.15.170:0/100348808 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:03.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.285+0000 7f3c48e4f640 1 -- 172.21.15.170:0/100348808 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4bd0d6e10 con 0x55e4bd225690 2024-09-12T17:28:03.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.285+0000 7f3c48e4f640 1 --2- 172.21.15.170:0/100348808 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4bd225690 0x55e4bd224e20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3c38001e40 tx=0x7f3c38001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91f1ea52fad8963d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.285+0000 7f3b36e0d640 1 -- 172.21.15.170:0/100348808 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c38012020 con 0x55e4bd225690 2024-09-12T17:28:03.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.285+0000 7f3b36e0d640 1 -- 172.21.15.170:0/100348808 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c3800e5a0 con 0x55e4bd225690 2024-09-12T17:28:03.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.285+0000 7f3b36e0d640 1 -- 172.21.15.170:0/100348808 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c3800e8a0 con 0x55e4bd225690 2024-09-12T17:28:03.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.286+0000 7f3c4d12a800 1 -- 172.21.15.170:0/100348808 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4bd225690 msgr2=0x55e4bd224e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.286+0000 7f3c4d12a800 1 --2- 172.21.15.170:0/100348808 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4bd225690 0x55e4bd224e20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3c38001e40 tx=0x7f3c38001e70 comp rx=0 tx=0).stop 2024-09-12T17:28:03.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.286+0000 7f3c4d12a800 1 -- 172.21.15.170:0/100348808 shutdown_connections 2024-09-12T17:28:03.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.286+0000 7f3c4d12a800 1 --2- 172.21.15.170:0/100348808 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4bd225690 0x55e4bd224e20 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.286+0000 7f3c4d12a800 1 -- 172.21.15.170:0/100348808 >> 172.21.15.170:0/100348808 conn(0x55e4bd21f1d0 msgr2=0x55e4bd310000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:03.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.286+0000 7f3c4d12a800 1 -- 172.21.15.170:0/100348808 shutdown_connections 2024-09-12T17:28:03.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.286+0000 7f3c4d12a800 1 -- 172.21.15.170:0/100348808 wait complete. 2024-09-12T17:28:03.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.286+0000 7f3c4d12a800 1 Processor -- start 2024-09-12T17:28:03.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.286+0000 7f3c4d12a800 1 -- start start 2024-09-12T17:28:03.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.287+0000 7f3c4d12a800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4bd225690 0x55e4bd31e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.287+0000 7f3c4d12a800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e4bd22c040 con 0x55e4bd225690 2024-09-12T17:28:03.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.287+0000 7f3c48e4f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4bd225690 0x55e4bd31e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.287+0000 7f3c48e4f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4bd225690 0x55e4bd31e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57976/0 (socket says 172.21.15.170:57976) 2024-09-12T17:28:03.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.287+0000 7f3c48e4f640 1 -- 172.21.15.170:0/1240941347 learned_addr learned my addr 172.21.15.170:0/1240941347 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:03.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.287+0000 7f3c48e4f640 1 -- 172.21.15.170:0/1240941347 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4bd31e770 con 0x55e4bd225690 2024-09-12T17:28:03.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.287+0000 7f3c48e4f640 1 --2- 172.21.15.170:0/1240941347 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4bd225690 0x55e4bd31e210 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3c3800c010 tx=0x7f3c38000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.287+0000 7f3b3560a640 1 -- 172.21.15.170:0/1240941347 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c38012030 con 0x55e4bd225690 2024-09-12T17:28:03.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.287+0000 7f3b3560a640 1 -- 172.21.15.170:0/1240941347 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c380014a0 con 0x55e4bd225690 2024-09-12T17:28:03.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.287+0000 7f3b3560a640 1 -- 172.21.15.170:0/1240941347 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c3801a7a0 con 0x55e4bd225690 2024-09-12T17:28:03.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.287+0000 7f3c4d12a800 1 -- 172.21.15.170:0/1240941347 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e4bd31ea00 con 0x55e4bd225690 2024-09-12T17:28:03.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.287+0000 7f3c4d12a800 1 -- 172.21.15.170:0/1240941347 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4bd31f400 con 0x55e4bd225690 2024-09-12T17:28:03.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.288+0000 7f3b3560a640 1 -- 172.21.15.170:0/1240941347 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3c38015020 con 0x55e4bd225690 2024-09-12T17:28:03.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.288+0000 7f3b3560a640 1 --2- 172.21.15.170:0/1240941347 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3b3003c780 0x7f3b3003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.288+0000 7f3b3560a640 1 -- 172.21.15.170:0/1240941347 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f3c38020030 con 0x55e4bd225690 2024-09-12T17:28:03.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.289+0000 7f3c4064e640 1 --2- 172.21.15.170:0/1240941347 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3b3003c780 0x7f3b3003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.289+0000 7f3c4d12a800 1 --2- 172.21.15.170:0/1240941347 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55e4bd229200 0x55e4bd325860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.289+0000 7f3c4d12a800 1 -- 172.21.15.170:0/1240941347 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd31ff90 con 0x55e4bd229200 2024-09-12T17:28:03.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.289+0000 7f3c49650640 1 --2- 172.21.15.170:0/1240941347 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55e4bd229200 0x55e4bd325860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.289+0000 7f3c4064e640 1 --2- 172.21.15.170:0/1240941347 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3b3003c780 0x7f3b3003ec40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3c30057000 tx=0x7f3c30052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.289+0000 7f3c49650640 1 --2- 172.21.15.170:0/1240941347 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55e4bd229200 0x55e4bd325860 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.289+0000 7f3c49650640 1 -- 172.21.15.170:0/1240941347 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c4400a4d0 con 0x55e4bd229200 2024-09-12T17:28:03.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.289+0000 7f3c4d12a800 1 -- 172.21.15.170:0/1240941347 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd31f890 con 0x55e4bd229200 2024-09-12T17:28:03.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.290+0000 7f3c49650640 1 -- 172.21.15.170:0/1240941347 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3c4400a4d0 con 0x55e4bd229200 2024-09-12T17:28:03.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.290+0000 7f3c4d12a800 1 --2- 172.21.15.170:0/1240941347 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55e4bd327cd0 0x55e4bd32a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.290+0000 7f3c4d12a800 1 -- 172.21.15.170:0/1240941347 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd32a790 con 0x55e4bd327cd0 2024-09-12T17:28:03.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.290+0000 7f3c48e4f640 1 --2- 172.21.15.170:0/1240941347 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55e4bd327cd0 0x55e4bd32a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.290+0000 7f3c48e4f640 1 --2- 172.21.15.170:0/1240941347 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55e4bd327cd0 0x55e4bd32a0c0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.290+0000 7f3c48e4f640 1 -- 172.21.15.170:0/1240941347 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3c380187b0 con 0x55e4bd327cd0 2024-09-12T17:28:03.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.290+0000 7f3c4d12a800 1 -- 172.21.15.170:0/1240941347 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd326b70 con 0x55e4bd229200 2024-09-12T17:28:03.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.290+0000 7f3c49650640 1 -- 172.21.15.170:0/1240941347 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3c4400a4d0 con 0x55e4bd229200 2024-09-12T17:28:03.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.290+0000 7f3c4d12a800 1 -- 172.21.15.170:0/1240941347 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd327010 con 0x55e4bd327cd0 2024-09-12T17:28:03.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.291+0000 7f3c48e4f640 1 -- 172.21.15.170:0/1240941347 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3c380187b0 con 0x55e4bd327cd0 2024-09-12T17:28:03.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.291+0000 7f3c4d12a800 1 Processor -- start 2024-09-12T17:28:03.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.291+0000 7f3c4d12a800 1 -- start start 2024-09-12T17:28:03.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.291+0000 7f3c4d12a800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4bd339040 0x55e4bd339460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.291+0000 7f3c4d12a800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e4bd11ba00 con 0x55e4bd339040 2024-09-12T17:28:03.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.292+0000 7f3c49650640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4bd339040 0x55e4bd339460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.292+0000 7f3c49650640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4bd339040 0x55e4bd339460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:57990/0 (socket says 172.21.15.170:57990) 2024-09-12T17:28:03.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.292+0000 7f3c49650640 1 -- 172.21.15.170:0/3225959265 learned_addr learned my addr 172.21.15.170:0/3225959265 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:03.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.292+0000 7f3c49650640 1 -- 172.21.15.170:0/3225959265 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4bd339aa0 con 0x55e4bd339040 2024-09-12T17:28:03.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.292+0000 7f3c49650640 1 --2- 172.21.15.170:0/3225959265 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4bd339040 0x55e4bd339460 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x55e4bd31f0a0 tx=0x7f3c440167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.292+0000 7f3b2e7fc640 1 -- 172.21.15.170:0/3225959265 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c44013640 con 0x55e4bd339040 2024-09-12T17:28:03.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.292+0000 7f3b2e7fc640 1 -- 172.21.15.170:0/3225959265 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c440137e0 con 0x55e4bd339040 2024-09-12T17:28:03.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.292+0000 7f3b2e7fc640 1 -- 172.21.15.170:0/3225959265 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c44013ac0 con 0x55e4bd339040 2024-09-12T17:28:03.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.292+0000 7f3c4d12a800 1 -- 172.21.15.170:0/3225959265 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e4bd33a2d0 con 0x55e4bd339040 2024-09-12T17:28:03.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.292+0000 7f3c4d12a800 1 -- 172.21.15.170:0/3225959265 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4bd33a870 con 0x55e4bd339040 2024-09-12T17:28:03.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.293+0000 7f3b2e7fc640 1 -- 172.21.15.170:0/3225959265 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3c44011040 con 0x55e4bd339040 2024-09-12T17:28:03.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.293+0000 7f3b2e7fc640 1 --2- 172.21.15.170:0/3225959265 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3b2003c730 0x7f3b2003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.293+0000 7f3b2e7fc640 1 -- 172.21.15.170:0/3225959265 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f3c4400e040 con 0x55e4bd339040 2024-09-12T17:28:03.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.293+0000 7f3c48e4f640 1 --2- 172.21.15.170:0/3225959265 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3b2003c730 0x7f3b2003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.294+0000 7f3c4d12a800 1 Processor -- start 2024-09-12T17:28:03.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.294+0000 7f3c48e4f640 1 --2- 172.21.15.170:0/3225959265 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3b2003c730 0x7f3b2003ebf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x55e4bd325e70 tx=0x7f3c38040040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.294+0000 7f3c4d12a800 1 -- start start 2024-09-12T17:28:03.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.294+0000 7f3c4d12a800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4bd345b00 0x55e4bd345f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.294+0000 7f3c4d12a800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e4bd2236c0 con 0x55e4bd345b00 2024-09-12T17:28:03.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.294+0000 7f3c49650640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4bd345b00 0x55e4bd345f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.294+0000 7f3c49650640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4bd345b00 0x55e4bd345f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:58002/0 (socket says 172.21.15.170:58002) 2024-09-12T17:28:03.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.294+0000 7f3c49650640 1 -- 172.21.15.170:0/1661153775 learned_addr learned my addr 172.21.15.170:0/1661153775 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:03.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.294+0000 7f3c49650640 1 -- 172.21.15.170:0/1661153775 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4bd3464f0 con 0x55e4bd345b00 2024-09-12T17:28:03.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.295+0000 7f3c49650640 1 --2- 172.21.15.170:0/1661153775 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4bd345b00 0x55e4bd345f00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3c44020000 tx=0x7f3c440204d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fbd391620e976a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.295+0000 7f3b1ffff640 1 -- 172.21.15.170:0/1661153775 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c44052070 con 0x55e4bd345b00 2024-09-12T17:28:03.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.295+0000 7f3b1ffff640 1 -- 172.21.15.170:0/1661153775 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c4404a020 con 0x55e4bd345b00 2024-09-12T17:28:03.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.295+0000 7f3b1ffff640 1 -- 172.21.15.170:0/1661153775 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c44021440 con 0x55e4bd345b00 2024-09-12T17:28:03.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.295+0000 7f3c4d12a800 1 -- 172.21.15.170:0/1661153775 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4bd345b00 msgr2=0x55e4bd345f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.295+0000 7f3c4d12a800 1 --2- 172.21.15.170:0/1661153775 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4bd345b00 0x55e4bd345f00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3c44020000 tx=0x7f3c440204d0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.295+0000 7f3c4d12a800 1 -- 172.21.15.170:0/1661153775 shutdown_connections 2024-09-12T17:28:03.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.295+0000 7f3c4d12a800 1 --2- 172.21.15.170:0/1661153775 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4bd345b00 0x55e4bd345f00 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.295+0000 7f3c4d12a800 1 -- 172.21.15.170:0/1661153775 >> 172.21.15.170:0/1661153775 conn(0x55e4bd341f00 msgr2=0x55e4bd340140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:03.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.295+0000 7f3c4d12a800 1 -- 172.21.15.170:0/1661153775 shutdown_connections 2024-09-12T17:28:03.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.295+0000 7f3c4d12a800 1 -- 172.21.15.170:0/1661153775 wait complete. 2024-09-12T17:28:03.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.295+0000 7f3c4d12a800 1 Processor -- start 2024-09-12T17:28:03.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.295+0000 7f3c4d12a800 1 -- start start 2024-09-12T17:28:03.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.296+0000 7f3c4d12a800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4bd345b00 0x55e4bd34d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.296+0000 7f3c4d12a800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e4bd346b10 con 0x55e4bd345b00 2024-09-12T17:28:03.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.296+0000 7f3c49650640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4bd345b00 0x55e4bd34d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.296+0000 7f3c49650640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4bd345b00 0x55e4bd34d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:58004/0 (socket says 172.21.15.170:58004) 2024-09-12T17:28:03.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.296+0000 7f3c49650640 1 -- 172.21.15.170:0/86524060 learned_addr learned my addr 172.21.15.170:0/86524060 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:03.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.296+0000 7f3c49650640 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4bd34d670 con 0x55e4bd345b00 2024-09-12T17:28:03.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.296+0000 7f3c49650640 1 --2- 172.21.15.170:0/86524060 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4bd345b00 0x55e4bd34d110 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f3c44053cd0 tx=0x7f3c44053d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.297+0000 7f3b1e7fc640 1 -- 172.21.15.170:0/86524060 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c44038070 con 0x55e4bd345b00 2024-09-12T17:28:03.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.297+0000 7f3b1e7fc640 1 -- 172.21.15.170:0/86524060 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c4401f500 con 0x55e4bd345b00 2024-09-12T17:28:03.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.297+0000 7f3b1e7fc640 1 -- 172.21.15.170:0/86524060 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c4401f7e0 con 0x55e4bd345b00 2024-09-12T17:28:03.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.297+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e4bd34d900 con 0x55e4bd345b00 2024-09-12T17:28:03.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.297+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4bd34e280 con 0x55e4bd345b00 2024-09-12T17:28:03.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.297+0000 7f3b1e7fc640 1 -- 172.21.15.170:0/86524060 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3c4403b070 con 0x55e4bd345b00 2024-09-12T17:28:03.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.298+0000 7f3b1e7fc640 1 --2- 172.21.15.170:0/86524060 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3b1403c730 0x7f3b1403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.298+0000 7f3b1e7fc640 1 -- 172.21.15.170:0/86524060 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f3c4404b070 con 0x55e4bd345b00 2024-09-12T17:28:03.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.298+0000 7f3c48e4f640 1 --2- 172.21.15.170:0/86524060 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3b1403c730 0x7f3b1403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.298+0000 7f3c48e4f640 1 --2- 172.21.15.170:0/86524060 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3b1403c730 0x7f3b1403ebf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3c38018ac0 tx=0x7f3c3804f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.298+0000 7f3c4d12a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.298+0000 7f3c4d12a800 1 --2- 172.21.15.170:0/86524060 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55e4bd3589d0 0x55e4bd35ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.298+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd35b5e0 con 0x55e4bd3589d0 2024-09-12T17:28:03.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.298+0000 7f3c4064e640 1 --2- 172.21.15.170:0/86524060 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55e4bd3589d0 0x55e4bd35ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.299+0000 7f3c4064e640 1 --2- 172.21.15.170:0/86524060 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55e4bd3589d0 0x55e4bd35ae90 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.299+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c30051070 con 0x55e4bd3589d0 2024-09-12T17:28:03.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.299+0000 7f3c4d12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.299+0000 7f3c4d12a800 20 realm 2024-09-12T17:28:03.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.299+0000 7f3c4d12a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.299+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd35ba10 con 0x55e4bd3589d0 2024-09-12T17:28:03.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.299+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c30051070 con 0x55e4bd3589d0 2024-09-12T17:28:03.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.299+0000 7f3c4d12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.299+0000 7f3c4d12a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:03.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.299+0000 7f3c4d12a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.299+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd35c2e0 con 0x55e4bd3589d0 2024-09-12T17:28:03.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.299+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c30051070 con 0x55e4bd3589d0 2024-09-12T17:28:03.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.299+0000 7f3c4d12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.299+0000 7f3c4d12a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.299+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd35c680 con 0x55e4bd3589d0 2024-09-12T17:28:03.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.300+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3c30051070 con 0x55e4bd3589d0 2024-09-12T17:28:03.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.300+0000 7f3c4d12a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:03.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.300+0000 7f3c4d12a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.300+0000 7f3c4d12a800 1 --2- 172.21.15.170:0/86524060 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55e4bd35d3e0 0x55e4bd35f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.300+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd35fde0 con 0x55e4bd35d3e0 2024-09-12T17:28:03.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.300+0000 7f3c49650640 1 --2- 172.21.15.170:0/86524060 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55e4bd35d3e0 0x55e4bd35f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.300+0000 7f3c49650640 1 --2- 172.21.15.170:0/86524060 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55e4bd35d3e0 0x55e4bd35f7d0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.300+0000 7f3c49650640 1 -- 172.21.15.170:0/86524060 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3c4403a030 con 0x55e4bd35d3e0 2024-09-12T17:28:03.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.300+0000 7f3c4d12a800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:03.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.300+0000 7f3c4d12a800 20 searching for the correct realm 2024-09-12T17:28:03.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.300+0000 7f3c4d12a800 1 --2- 172.21.15.170:0/86524060 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55e4bd361d90 0x55e4bd364250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.300+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3648d0 con 0x55e4bd361d90 2024-09-12T17:28:03.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.300+0000 7f3c48e4f640 1 --2- 172.21.15.170:0/86524060 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55e4bd361d90 0x55e4bd364250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.301+0000 7f3c48e4f640 1 --2- 172.21.15.170:0/86524060 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55e4bd361d90 0x55e4bd364250 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.301+0000 7f3c48e4f640 1 -- 172.21.15.170:0/86524060 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c38036040 con 0x55e4bd361d90 2024-09-12T17:28:03.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.301+0000 7f3c48e4f640 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3648d0 con 0x55e4bd35d3e0 2024-09-12T17:28:03.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.301+0000 7f3c49650640 1 -- 172.21.15.170:0/86524060 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c4403a030 con 0x55e4bd35d3e0 2024-09-12T17:28:03.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.301+0000 7f3c49650640 1 --2- 172.21.15.170:0/86524060 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f3c4403d060 0x7f3c4403c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.301+0000 7f3c49650640 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3648d0 con 0x7f3c4403d060 2024-09-12T17:28:03.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.301+0000 7f3c4064e640 1 --2- 172.21.15.170:0/86524060 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f3c4403d060 0x7f3c4403c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.302+0000 7f3c4064e640 1 --2- 172.21.15.170:0/86524060 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f3c4403d060 0x7f3c4403c7a0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.302+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c30051070 con 0x7f3c4403d060 2024-09-12T17:28:03.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.302+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3648d0 con 0x55e4bd3589d0 2024-09-12T17:28:03.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.302+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c30051070 con 0x55e4bd3589d0 2024-09-12T17:28:03.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.302+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3648d0 con 0x55e4bd3589d0 2024-09-12T17:28:03.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.303+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c30051070 con 0x55e4bd3589d0 2024-09-12T17:28:03.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.303+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3648d0 con 0x7f3c4403d060 2024-09-12T17:28:03.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.303+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c30051070 con 0x7f3c4403d060 2024-09-12T17:28:03.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.303+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3648d0 con 0x7f3c4403d060 2024-09-12T17:28:03.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.303+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c30051070 con 0x7f3c4403d060 2024-09-12T17:28:03.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.303+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3648d0 con 0x55e4bd35d3e0 2024-09-12T17:28:03.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.303+0000 7f3c49650640 1 -- 172.21.15.170:0/86524060 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c4403a030 con 0x55e4bd35d3e0 2024-09-12T17:28:03.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.303+0000 7f3c49650640 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3648d0 con 0x55e4bd361d90 2024-09-12T17:28:03.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.304+0000 7f3c48e4f640 1 -- 172.21.15.170:0/86524060 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c38036040 con 0x55e4bd361d90 2024-09-12T17:28:03.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.304+0000 7f3c48e4f640 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3648d0 con 0x55e4bd3589d0 2024-09-12T17:28:03.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.304+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c30051070 con 0x55e4bd3589d0 2024-09-12T17:28:03.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.304+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3648d0 con 0x7f3c4403d060 2024-09-12T17:28:03.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.304+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c30051070 con 0x7f3c4403d060 2024-09-12T17:28:03.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.304+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3648d0 con 0x55e4bd3589d0 2024-09-12T17:28:03.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.304+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c30051070 con 0x55e4bd3589d0 2024-09-12T17:28:03.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.304+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3648d0 con 0x55e4bd35d3e0 2024-09-12T17:28:03.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.304+0000 7f3c49650640 1 -- 172.21.15.170:0/86524060 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f3c4403a030 con 0x55e4bd35d3e0 2024-09-12T17:28:03.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.304+0000 7f3c49650640 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3648d0 con 0x55e4bd361d90 2024-09-12T17:28:03.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.305+0000 7f3c48e4f640 1 -- 172.21.15.170:0/86524060 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c38036040 con 0x55e4bd361d90 2024-09-12T17:28:03.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.305+0000 7f3c48e4f640 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3648d0 con 0x55e4bd361d90 2024-09-12T17:28:03.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.305+0000 7f3c48e4f640 1 -- 172.21.15.170:0/86524060 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c38036040 con 0x55e4bd361d90 2024-09-12T17:28:03.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.305+0000 7f3c48e4f640 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3648d0 con 0x7f3c4403d060 2024-09-12T17:28:03.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.305+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c30051070 con 0x7f3c4403d060 2024-09-12T17:28:03.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.305+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3648d0 con 0x55e4bd361d90 2024-09-12T17:28:03.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.305+0000 7f3c48e4f640 1 -- 172.21.15.170:0/86524060 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c38036040 con 0x55e4bd361d90 2024-09-12T17:28:03.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.305+0000 7f3c48e4f640 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3648d0 con 0x55e4bd361d90 2024-09-12T17:28:03.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.306+0000 7f3c48e4f640 1 -- 172.21.15.170:0/86524060 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c38036040 con 0x55e4bd361d90 2024-09-12T17:28:03.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.306+0000 7f3c48e4f640 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3648d0 con 0x55e4bd3589d0 2024-09-12T17:28:03.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.306+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c30051070 con 0x55e4bd3589d0 2024-09-12T17:28:03.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.306+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3648d0 con 0x55e4bd3589d0 2024-09-12T17:28:03.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.306+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3c30051070 con 0x55e4bd3589d0 2024-09-12T17:28:03.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.306+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3648d0 con 0x7f3c4403d060 2024-09-12T17:28:03.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.306+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c30051070 con 0x7f3c4403d060 2024-09-12T17:28:03.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.306+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3648d0 con 0x55e4bd361d90 2024-09-12T17:28:03.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.307+0000 7f3c48e4f640 1 -- 172.21.15.170:0/86524060 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c38036040 con 0x55e4bd361d90 2024-09-12T17:28:03.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.307+0000 7f3c48e4f640 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3648d0 con 0x55e4bd35d3e0 2024-09-12T17:28:03.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.307+0000 7f3c49650640 1 -- 172.21.15.170:0/86524060 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c4403a030 con 0x55e4bd35d3e0 2024-09-12T17:28:03.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.307+0000 7f3c49650640 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3648d0 con 0x55e4bd3589d0 2024-09-12T17:28:03.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.307+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c30051070 con 0x55e4bd3589d0 2024-09-12T17:28:03.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.307+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3648d0 con 0x7f3c4403d060 2024-09-12T17:28:03.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.307+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c30051070 con 0x7f3c4403d060 2024-09-12T17:28:03.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.307+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3648d0 con 0x55e4bd361d90 2024-09-12T17:28:03.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.308+0000 7f3c48e4f640 1 -- 172.21.15.170:0/86524060 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c38036040 con 0x55e4bd361d90 2024-09-12T17:28:03.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.308+0000 7f3c48e4f640 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3648d0 con 0x7f3c4403d060 2024-09-12T17:28:03.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.308+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c30051070 con 0x7f3c4403d060 2024-09-12T17:28:03.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.308+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3648d0 con 0x55e4bd35d3e0 2024-09-12T17:28:03.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.308+0000 7f3c49650640 1 -- 172.21.15.170:0/86524060 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c4403a030 con 0x55e4bd35d3e0 2024-09-12T17:28:03.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.308+0000 7f3c49650640 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3648d0 con 0x55e4bd361d90 2024-09-12T17:28:03.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.308+0000 7f3c48e4f640 1 -- 172.21.15.170:0/86524060 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c38036040 con 0x55e4bd361d90 2024-09-12T17:28:03.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.308+0000 7f3c48e4f640 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3648d0 con 0x7f3c4403d060 2024-09-12T17:28:03.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.309+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c30051070 con 0x7f3c4403d060 2024-09-12T17:28:03.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.309+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3648d0 con 0x55e4bd3589d0 2024-09-12T17:28:03.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.309+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3c30051070 con 0x55e4bd3589d0 2024-09-12T17:28:03.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.309+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3648d0 con 0x55e4bd35d3e0 2024-09-12T17:28:03.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.309+0000 7f3c49650640 1 -- 172.21.15.170:0/86524060 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3c44069040 con 0x55e4bd35d3e0 2024-09-12T17:28:03.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.309+0000 7f3c4d12a800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:03.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.309+0000 7f3c4d12a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:03.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.309+0000 7f3c4d12a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:03.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.309+0000 7f3c4d12a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:03.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.309+0000 7f3c4d12a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:03.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.309+0000 7f3c4d12a800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:03.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.309+0000 7f3c4d12a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.309+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3607a0 con 0x55e4bd3589d0 2024-09-12T17:28:03.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.310+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c30051070 con 0x55e4bd3589d0 2024-09-12T17:28:03.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.310+0000 7f3c4d12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.310+0000 7f3c4d12a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.310+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd361040 con 0x55e4bd3589d0 2024-09-12T17:28:03.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.310+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3c30051070 con 0x55e4bd3589d0 2024-09-12T17:28:03.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.310+0000 7f3c4d12a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:03.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.310+0000 7f3c4d12a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.310+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3603e0 con 0x55e4bd35d3e0 2024-09-12T17:28:03.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.310+0000 7f3c49650640 1 -- 172.21.15.170:0/86524060 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3c44069040 con 0x55e4bd35d3e0 2024-09-12T17:28:03.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.310+0000 7f3c4d12a800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:03.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.310+0000 7f3c4d12a800 20 zone default found 2024-09-12T17:28:03.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.310+0000 7f3c4d12a800 4 Realm: () 2024-09-12T17:28:03.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.310+0000 7f3c4d12a800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:03.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.310+0000 7f3c4d12a800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:03.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.310+0000 7f3c4d12a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:03.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.310+0000 7f3c4d12a800 20 zonegroup default 2024-09-12T17:28:03.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.310+0000 7f3c4d12a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.310+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd365200 con 0x7f3c4403d060 2024-09-12T17:28:03.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.310+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3c30051070 con 0x7f3c4403d060 2024-09-12T17:28:03.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.310+0000 7f3c4d12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.310+0000 7f3c4d12a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.310+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd367440 con 0x55e4bd361d90 2024-09-12T17:28:03.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.311+0000 7f3c48e4f640 1 -- 172.21.15.170:0/86524060 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3c38036040 con 0x55e4bd361d90 2024-09-12T17:28:03.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.311+0000 7f3c4d12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.311+0000 7f3c4d12a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.311+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3677e0 con 0x55e4bd361d90 2024-09-12T17:28:03.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.311+0000 7f3c48e4f640 1 -- 172.21.15.170:0/86524060 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3c38036040 con 0x55e4bd361d90 2024-09-12T17:28:03.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.311+0000 7f3c4d12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.311+0000 7f3c4d12a800 20 started sync module instance, tier type = 2024-09-12T17:28:03.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.311+0000 7f3c4d12a800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:03.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.311+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3668d0 con 0x55e4bd35d3e0 2024-09-12T17:28:03.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.312+0000 7f3c49650640 1 -- 172.21.15.170:0/86524060 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c44069040 con 0x55e4bd35d3e0 2024-09-12T17:28:03.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.312+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94440915365328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3668d0 con 0x55e4bd35d3e0 2024-09-12T17:28:03.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.312+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3682a0 con 0x55e4bd3589d0 2024-09-12T17:28:03.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.313+0000 7f3c49650640 1 -- 172.21.15.170:0/86524060 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94440915365328] v29'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c44069040 con 0x55e4bd35d3e0 2024-09-12T17:28:03.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.313+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c30051070 con 0x55e4bd3589d0 2024-09-12T17:28:03.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.313+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94440915369328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3668d0 con 0x55e4bd3589d0 2024-09-12T17:28:03.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.313+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd368d20 con 0x55e4bd361d90 2024-09-12T17:28:03.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.314+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94440915369328] v29'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c30051070 con 0x55e4bd3589d0 2024-09-12T17:28:03.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.314+0000 7f3c48e4f640 1 -- 172.21.15.170:0/86524060 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c38036040 con 0x55e4bd361d90 2024-09-12T17:28:03.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.314+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94440915362848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd366840 con 0x55e4bd361d90 2024-09-12T17:28:03.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.314+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd369c10 con 0x55e4bd35d3e0 2024-09-12T17:28:03.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.315+0000 7f3c48e4f640 1 -- 172.21.15.170:0/86524060 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94440915362848] v29'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c38036040 con 0x55e4bd361d90 2024-09-12T17:28:03.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.315+0000 7f3c49650640 1 -- 172.21.15.170:0/86524060 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c44069040 con 0x55e4bd35d3e0 2024-09-12T17:28:03.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.316+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94440915375968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd36a030 con 0x55e4bd35d3e0 2024-09-12T17:28:03.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.316+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd36a9f0 con 0x55e4bd3589d0 2024-09-12T17:28:03.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.317+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c30051070 con 0x55e4bd3589d0 2024-09-12T17:28:03.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.317+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94440915379520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd36a960 con 0x55e4bd3589d0 2024-09-12T17:28:03.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.317+0000 7f3c49650640 1 -- 172.21.15.170:0/86524060 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94440915375968] v29'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c44069040 con 0x55e4bd35d3e0 2024-09-12T17:28:03.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.317+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd36b4b0 con 0x7f3c4403d060 2024-09-12T17:28:03.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.318+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94440915379520] v29'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c30051070 con 0x55e4bd3589d0 2024-09-12T17:28:03.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.318+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c30051070 con 0x7f3c4403d060 2024-09-12T17:28:03.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.318+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94440915377024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd36b4b0 con 0x7f3c4403d060 2024-09-12T17:28:03.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.318+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd36bec0 con 0x7f3c4403d060 2024-09-12T17:28:03.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.319+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94440915377024] v29'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c30051070 con 0x7f3c4403d060 2024-09-12T17:28:03.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.319+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(56 notify.6 [create] v29'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c30051070 con 0x7f3c4403d060 2024-09-12T17:28:03.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.319+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94440915381648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd36bec0 con 0x7f3c4403d060 2024-09-12T17:28:03.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.319+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd36c880 con 0x7f3c4403d060 2024-09-12T17:28:03.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.320+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94440915381648] v29'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c30051070 con 0x7f3c4403d060 2024-09-12T17:28:03.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.320+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(58 notify.7 [create] v29'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c30051070 con 0x7f3c4403d060 2024-09-12T17:28:03.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.320+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94440915385328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd36c880 con 0x7f3c4403d060 2024-09-12T17:28:03.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.320+0000 7f3c4d12a800 20 add_watcher() i=0 2024-09-12T17:28:03.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.320+0000 7f3c4d12a800 20 add_watcher() i=1 2024-09-12T17:28:03.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.320+0000 7f3c4d12a800 20 add_watcher() i=2 2024-09-12T17:28:03.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.320+0000 7f3c4d12a800 20 add_watcher() i=3 2024-09-12T17:28:03.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.320+0000 7f3c4d12a800 20 add_watcher() i=4 2024-09-12T17:28:03.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.320+0000 7f3c4d12a800 20 add_watcher() i=5 2024-09-12T17:28:03.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.320+0000 7f3c4d12a800 20 add_watcher() i=6 2024-09-12T17:28:03.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.321+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94440915385328] v29'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c30051070 con 0x7f3c4403d060 2024-09-12T17:28:03.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.321+0000 7f3c4d12a800 20 add_watcher() i=7 2024-09-12T17:28:03.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.321+0000 7f3c4d12a800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:03.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.321+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd36fb90 con 0x55e4bd3589d0 2024-09-12T17:28:03.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.321+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3c30051070 con 0x55e4bd3589d0 2024-09-12T17:28:03.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.321+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94440915387712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd36ce10 con 0x55e4bd3589d0 2024-09-12T17:28:03.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.322+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94440915387712] v29'104 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3c30051070 con 0x55e4bd3589d0 2024-09-12T17:28:03.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.322+0000 7f3aff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:03.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.322+0000 7f3c4d12a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:03.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.322+0000 7f3c4d12a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:03.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.322+0000 7f3c4d12a800 5 note: GC not initialized 2024-09-12T17:28:03.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.323+0000 7f3afe7e4640 20 reqs_thread_entry: start 2024-09-12T17:28:03.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.323+0000 7f3c4d12a800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:03.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.323+0000 7f3c4d12a800 20 Filter name: none 2024-09-12T17:28:03.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.323+0000 7f3af77fe640 20 reqs_thread_entry: start 2024-09-12T17:28:03.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.323+0000 7f3c4d12a800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:28:03.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.323+0000 7f3c4d12a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.323+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3a2c30 con 0x55e4bd3589d0 2024-09-12T17:28:03.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.323+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3c30051070 con 0x55e4bd3589d0 2024-09-12T17:28:03.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.323+0000 7f3c4d12a800 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:28:03.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.323+0000 7f3c4d12a800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T17:28:03.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.323+0000 7f3c4d12a800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:28:03.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.323+0000 7f3c4d12a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:03.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.323+0000 7f3c4d12a800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T17:28:03.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.323+0000 7f3c4d12a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.323+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3a4bc0 con 0x55e4bd35d3e0 2024-09-12T17:28:03.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.324+0000 7f3c49650640 1 -- 172.21.15.170:0/86524060 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f3c44069040 con 0x55e4bd35d3e0 2024-09-12T17:28:03.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.324+0000 7f3c4d12a800 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T17:28:03.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.324+0000 7f3c4d12a800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-12T17:28:03.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.324+0000 7f3c4d12a800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:28:03.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.324+0000 7f3c4d12a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 : miss 2024-09-12T17:28:03.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.324+0000 7f3c4d12a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.324+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:64 8.1d 8:baccd554:root::.bucket.meta.myfoo%3a7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3a6450 con 0x7f3c4403d060 2024-09-12T17:28:03.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.325+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(64 .bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f3c30051070 con 0x7f3c4403d060 2024-09-12T17:28:03.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.325+0000 7f3c4d12a800 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T17:28:03.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.325+0000 7f3c4d12a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 info.flags=0x17 2024-09-12T17:28:03.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.325+0000 7f3c4d12a800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 to cache LRU end 2024-09-12T17:28:03.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.325+0000 7f3c4d12a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:03.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.325+0000 7f3c4d12a800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:28:03.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.325+0000 7f3c4d12a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 2024-09-12T17:28:03.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.325+0000 7f3c4d12a800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-12T17:28:03.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.325+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3a9b90 con 0x55e4bd35d3e0 2024-09-12T17:28:03.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.326+0000 7f3c49650640 1 -- 172.21.15.170:0/86524060 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(65 foo.buckets [call] v29'17 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f3c44069040 con 0x55e4bd35d3e0 2024-09-12T17:28:03.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.326+0000 7f3c4d12a800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-12T17:28:03.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.326+0000 7f3c4d12a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.326+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3a8b80 con 0x55e4bd35d3e0 2024-09-12T17:28:03.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.326+0000 7f3c49650640 1 -- 172.21.15.170:0/86524060 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f3c44069040 con 0x55e4bd35d3e0 2024-09-12T17:28:03.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.326+0000 7f3c4d12a800 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T17:28:03.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.326+0000 7f3c4d12a800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-12T17:28:03.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.326+0000 7f3c4d12a800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:28:03.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.326+0000 7f3c4d12a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:03.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.326+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3ad660 con 0x55e4bd35d3e0 2024-09-12T17:28:03.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.327+0000 7f3c49650640 1 -- 172.21.15.170:0/86524060 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v29'18 uv18 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f3c44069040 con 0x55e4bd35d3e0 2024-09-12T17:28:03.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.327+0000 7f3c4d12a800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-12T17:28:03.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.327+0000 7f3c4d12a800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:28:03.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.327+0000 7f3c4d12a800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-12T17:28:03.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.327+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94440915636352 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3aa960 con 0x7f3c4403d060 2024-09-12T17:28:03.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.328+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== watch-notify(notify (1) cookie 94440915381648 notify 124554051586 ret 0) ==== 380+0+0 (crc 0 0 0) 0x55e4bd3a6840 con 0x7f3c4403d060 2024-09-12T17:28:03.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.328+0000 7f3b1ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051586 cookie 94440915381648 notifier 4477 bl.length()=338 2024-09-12T17:28:03.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.328+0000 7f3b1ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-12T17:28:03.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.328+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(68 notify.6 [notify cookie 94440915636352 out=8b] v0'0 uv105 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3c30051070 con 0x7f3c4403d060 2024-09-12T17:28:03.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.328+0000 7f3b1ffff640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:28:03.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.328+0000 7f3b1ffff640 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f3b0c003ea0 con 0x7f3c4403d060 2024-09-12T17:28:03.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.328+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c30051070 con 0x7f3c4403d060 2024-09-12T17:28:03.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.328+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== watch-notify(notify_complete (2) cookie 94440915636352 notify 124554051586 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e4bd3a5980 con 0x7f3c4403d060 2024-09-12T17:28:03.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.329+0000 7f3aff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:03.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.329+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94440915387712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3a0ad0 con 0x55e4bd3589d0 2024-09-12T17:28:03.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.330+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94440915387712] v29'105 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3c30051070 con 0x55e4bd3589d0 2024-09-12T17:28:03.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.330+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94440915365328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3a0ad0 con 0x55e4bd35d3e0 2024-09-12T17:28:03.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.331+0000 7f3c49650640 1 -- 172.21.15.170:0/86524060 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94440915365328] v29'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c44069040 con 0x55e4bd35d3e0 2024-09-12T17:28:03.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.331+0000 7f3c4d12a800 20 remove_watcher() i=0 2024-09-12T17:28:03.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.331+0000 7f3c4d12a800 2 removed watcher, disabling cache 2024-09-12T17:28:03.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.331+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94440915369328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3a0ad0 con 0x55e4bd3589d0 2024-09-12T17:28:03.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.332+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94440915369328] v29'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c30051070 con 0x55e4bd3589d0 2024-09-12T17:28:03.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.332+0000 7f3c4d12a800 20 remove_watcher() i=1 2024-09-12T17:28:03.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.332+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94440915362848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3a0ad0 con 0x55e4bd361d90 2024-09-12T17:28:03.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.333+0000 7f3c48e4f640 1 -- 172.21.15.170:0/86524060 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94440915362848] v29'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c38036040 con 0x55e4bd361d90 2024-09-12T17:28:03.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.333+0000 7f3c4d12a800 20 remove_watcher() i=2 2024-09-12T17:28:03.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.333+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94440915375968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3a0ad0 con 0x55e4bd35d3e0 2024-09-12T17:28:03.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.334+0000 7f3c49650640 1 -- 172.21.15.170:0/86524060 <== osd.2 v2:172.21.15.170:6808/3855567754 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94440915375968] v29'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c44069040 con 0x55e4bd35d3e0 2024-09-12T17:28:03.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.334+0000 7f3c4d12a800 20 remove_watcher() i=3 2024-09-12T17:28:03.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.334+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94440915379520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3a0ad0 con 0x55e4bd3589d0 2024-09-12T17:28:03.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.335+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94440915379520] v29'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c30051070 con 0x55e4bd3589d0 2024-09-12T17:28:03.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.335+0000 7f3c4d12a800 20 remove_watcher() i=4 2024-09-12T17:28:03.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.335+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94440915377024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3a0ad0 con 0x7f3c4403d060 2024-09-12T17:28:03.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.336+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.0 v2:172.21.15.47:6800/3978157098 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94440915377024] v29'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c30051070 con 0x7f3c4403d060 2024-09-12T17:28:03.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.336+0000 7f3c4d12a800 20 remove_watcher() i=5 2024-09-12T17:28:03.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.336+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94440915381648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3a0ad0 con 0x7f3c4403d060 2024-09-12T17:28:03.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.337+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.0 v2:172.21.15.47:6800/3978157098 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94440915381648] v29'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c30051070 con 0x7f3c4403d060 2024-09-12T17:28:03.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.337+0000 7f3c4d12a800 20 remove_watcher() i=6 2024-09-12T17:28:03.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.337+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94440915385328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4bd3a0ad0 con 0x7f3c4403d060 2024-09-12T17:28:03.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.338+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 <== osd.0 v2:172.21.15.47:6800/3978157098 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94440915385328] v29'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c30051070 con 0x7f3c4403d060 2024-09-12T17:28:03.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.338+0000 7f3c4d12a800 20 remove_watcher() i=7 2024-09-12T17:28:03.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.338+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f3c4403d060 msgr2=0x7f3c4403c7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.338+0000 7f3c4d12a800 1 --2- 172.21.15.170:0/86524060 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f3c4403d060 0x7f3c4403c7a0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.338+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55e4bd3589d0 msgr2=0x55e4bd35ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.338+0000 7f3c4d12a800 1 --2- 172.21.15.170:0/86524060 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55e4bd3589d0 0x55e4bd35ae90 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.338+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55e4bd35d3e0 msgr2=0x55e4bd35f7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.338+0000 7f3c4d12a800 1 --2- 172.21.15.170:0/86524060 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55e4bd35d3e0 0x55e4bd35f7d0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.338+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55e4bd361d90 msgr2=0x55e4bd364250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.338+0000 7f3c4d12a800 1 --2- 172.21.15.170:0/86524060 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55e4bd361d90 0x55e4bd364250 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.338+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3b1403c730 msgr2=0x7f3b1403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.338+0000 7f3c4d12a800 1 --2- 172.21.15.170:0/86524060 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3b1403c730 0x7f3b1403ebf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3c38018ac0 tx=0x7f3c3804f000 comp rx=0 tx=0).stop 2024-09-12T17:28:03.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.338+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4bd345b00 msgr2=0x55e4bd34d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.338+0000 7f3c4064e640 1 -- 172.21.15.170:0/86524060 reap_dead start 2024-09-12T17:28:03.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.338+0000 7f3c4d12a800 1 --2- 172.21.15.170:0/86524060 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4bd345b00 0x55e4bd34d110 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f3c44053cd0 tx=0x7f3c44053d30 comp rx=0 tx=0).stop 2024-09-12T17:28:03.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.338+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 shutdown_connections 2024-09-12T17:28:03.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.338+0000 7f3c4d12a800 1 --2- 172.21.15.170:0/86524060 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4bd345b00 0x55e4bd34d110 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.338+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 >> 172.21.15.170:0/86524060 conn(0x55e4bd341f00 msgr2=0x55e4bd340110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:03.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.338+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 shutdown_connections 2024-09-12T17:28:03.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.338+0000 7f3c4d12a800 1 -- 172.21.15.170:0/86524060 wait complete. 2024-09-12T17:28:03.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.339+0000 7f3c4d12a800 1 -- 172.21.15.170:0/3225959265 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3b2003c730 msgr2=0x7f3b2003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.339+0000 7f3c4d12a800 1 --2- 172.21.15.170:0/3225959265 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3b2003c730 0x7f3b2003ebf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x55e4bd325e70 tx=0x7f3c38040040 comp rx=0 tx=0).stop 2024-09-12T17:28:03.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.339+0000 7f3c4d12a800 1 -- 172.21.15.170:0/3225959265 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4bd339040 msgr2=0x55e4bd339460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.339+0000 7f3c4d12a800 1 --2- 172.21.15.170:0/3225959265 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4bd339040 0x55e4bd339460 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x55e4bd31f0a0 tx=0x7f3c440167b0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.339+0000 7f3c4d12a800 1 -- 172.21.15.170:0/3225959265 shutdown_connections 2024-09-12T17:28:03.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.339+0000 7f3c4d12a800 1 --2- 172.21.15.170:0/3225959265 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3b2003c730 0x7f3b2003ebf0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.339+0000 7f3c4d12a800 1 --2- 172.21.15.170:0/3225959265 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4bd339040 0x55e4bd339460 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.339+0000 7f3c4d12a800 1 -- 172.21.15.170:0/3225959265 >> 172.21.15.170:0/3225959265 conn(0x55e4bd32d3f0 msgr2=0x55e4bd32d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:03.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.339+0000 7f3c4d12a800 1 -- 172.21.15.170:0/3225959265 shutdown_connections 2024-09-12T17:28:03.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.339+0000 7f3c4d12a800 1 -- 172.21.15.170:0/3225959265 wait complete. 2024-09-12T17:28:03.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.339+0000 7f3c4d12a800 1 -- 172.21.15.170:0/1240941347 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55e4bd229200 msgr2=0x55e4bd325860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.339+0000 7f3c4d12a800 1 --2- 172.21.15.170:0/1240941347 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55e4bd229200 0x55e4bd325860 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.339+0000 7f3c4d12a800 1 -- 172.21.15.170:0/1240941347 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55e4bd327cd0 msgr2=0x55e4bd32a0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.339+0000 7f3c4d12a800 1 --2- 172.21.15.170:0/1240941347 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55e4bd327cd0 0x55e4bd32a0c0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.339+0000 7f3c4d12a800 1 -- 172.21.15.170:0/1240941347 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3b3003c780 msgr2=0x7f3b3003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.339+0000 7f3c4d12a800 1 --2- 172.21.15.170:0/1240941347 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3b3003c780 0x7f3b3003ec40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3c30057000 tx=0x7f3c30052000 comp rx=0 tx=0).stop 2024-09-12T17:28:03.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.339+0000 7f3c4d12a800 1 -- 172.21.15.170:0/1240941347 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4bd225690 msgr2=0x55e4bd31e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.339+0000 7f3c4d12a800 1 --2- 172.21.15.170:0/1240941347 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4bd225690 0x55e4bd31e210 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3c3800c010 tx=0x7f3c38000ed0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.339+0000 7f3c4d12a800 1 -- 172.21.15.170:0/1240941347 shutdown_connections 2024-09-12T17:28:03.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.339+0000 7f3c4d12a800 1 --2- 172.21.15.170:0/1240941347 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55e4bd327cd0 0x55e4bd32a0c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.339+0000 7f3c4d12a800 1 --2- 172.21.15.170:0/1240941347 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3b3003c780 0x7f3b3003ec40 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.339+0000 7f3c4d12a800 1 --2- 172.21.15.170:0/1240941347 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55e4bd229200 0x55e4bd325860 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.339+0000 7f3c4d12a800 1 --2- 172.21.15.170:0/1240941347 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4bd225690 0x55e4bd31e210 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.339+0000 7f3c4d12a800 1 -- 172.21.15.170:0/1240941347 >> 172.21.15.170:0/1240941347 conn(0x55e4bd21f1d0 msgr2=0x55e4bd30fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:03.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.339+0000 7f3c4d12a800 1 -- 172.21.15.170:0/1240941347 shutdown_connections 2024-09-12T17:28:03.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.339+0000 7f3c4d12a800 1 -- 172.21.15.170:0/1240941347 wait complete. 2024-09-12T17:28:03.358 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-12T17:28:03.358 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-12T17:28:03.358 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-12T17:28:03.410 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:03.410 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:03.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.409+0000 7f971c975800 1 Processor -- start 2024-09-12T17:28:03.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.409+0000 7f971c975800 1 -- start start 2024-09-12T17:28:03.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.409+0000 7f971c975800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x558714bf0e30 0x558714bf1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.409+0000 7f971c975800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558714a9be40 con 0x558714bf2070 2024-09-12T17:28:03.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.409+0000 7f971c975800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x558714a66680 con 0x558714bf0e30 2024-09-12T17:28:03.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.409+0000 7f971a45f640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x558714bf0e30 0x558714bf1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.409+0000 7f971a45f640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x558714bf0e30 0x558714bf1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:58006/0 (socket says 172.21.15.170:58006) 2024-09-12T17:28:03.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.409+0000 7f971a45f640 1 -- 172.21.15.170:0/3871119687 learned_addr learned my addr 172.21.15.170:0/3871119687 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:03.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.409+0000 7f9719c5e640 1 --1- 172.21.15.170:0/3871119687 >> v1:172.21.15.47:6789/0 conn(0x558714bf2070 0x558714bf6dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:48464/0 (socket says 172.21.15.170:48464) 2024-09-12T17:28:03.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.410+0000 7f971a45f640 1 -- 172.21.15.170:0/3871119687 >> v1:172.21.15.47:6789/0 conn(0x558714bf2070 legacy=0x558714bf6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.410+0000 7f971945d640 1 -- 172.21.15.170:0/3871119687 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3808249040 0 0) 0x558714a9be40 con 0x558714bf2070 2024-09-12T17:28:03.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.410+0000 7f971a45f640 1 -- 172.21.15.170:0/3871119687 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558714a826b0 con 0x558714bf0e30 2024-09-12T17:28:03.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.411+0000 7f971a45f640 1 --2- 172.21.15.170:0/3871119687 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558714bf0e30 0x558714bf1b30 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9714005fd0 tx=0x7f9714045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=defda754c1f652cb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.411+0000 7f971945d640 1 -- 172.21.15.170:0/3871119687 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f971404e600 con 0x558714bf0e30 2024-09-12T17:28:03.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.412+0000 7f971945d640 1 -- 172.21.15.170:0/3871119687 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f971404e7a0 con 0x558714bf0e30 2024-09-12T17:28:03.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.412+0000 7f971945d640 1 -- 172.21.15.170:0/3871119687 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f971404eaa0 con 0x558714bf0e30 2024-09-12T17:28:03.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.412+0000 7f971c975800 1 -- 172.21.15.170:0/3871119687 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558714bf0e30 msgr2=0x558714bf1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.412+0000 7f971c975800 1 --2- 172.21.15.170:0/3871119687 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558714bf0e30 0x558714bf1b30 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9714005fd0 tx=0x7f9714045cf0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.412+0000 7f971c975800 1 -- 172.21.15.170:0/3871119687 shutdown_connections 2024-09-12T17:28:03.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.412+0000 7f971c975800 1 --2- 172.21.15.170:0/3871119687 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558714bf0e30 0x558714bf1b30 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.412+0000 7f971c975800 1 -- 172.21.15.170:0/3871119687 >> 172.21.15.170:0/3871119687 conn(0x558714bec200 msgr2=0x558714bee660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:03.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.412+0000 7f971c975800 1 -- 172.21.15.170:0/3871119687 shutdown_connections 2024-09-12T17:28:03.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.412+0000 7f971c975800 1 -- 172.21.15.170:0/3871119687 wait complete. 2024-09-12T17:28:03.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.426+0000 7f971c975800 1 Processor -- start 2024-09-12T17:28:03.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.426+0000 7f971c975800 1 -- start start 2024-09-12T17:28:03.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.426+0000 7f971c975800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558714bf0e30 0x558714b64df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.426+0000 7f971c975800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558714a8add0 con 0x558714bf0e30 2024-09-12T17:28:03.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.426+0000 7f971a45f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558714bf0e30 0x558714b64df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.426+0000 7f971a45f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558714bf0e30 0x558714b64df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:58022/0 (socket says 172.21.15.170:58022) 2024-09-12T17:28:03.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.426+0000 7f971a45f640 1 -- 172.21.15.170:0/84852751 learned_addr learned my addr 172.21.15.170:0/84852751 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:03.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.427+0000 7f971a45f640 1 -- 172.21.15.170:0/84852751 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558714aa3e10 con 0x558714bf0e30 2024-09-12T17:28:03.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.427+0000 7f971a45f640 1 --2- 172.21.15.170:0/84852751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558714bf0e30 0x558714b64df0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9714005fd0 tx=0x7f9714050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3171a4f1f24239f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.427+0000 7f9608608640 1 -- 172.21.15.170:0/84852751 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f971404ea80 con 0x558714bf0e30 2024-09-12T17:28:03.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.427+0000 7f9608608640 1 -- 172.21.15.170:0/84852751 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9714066070 con 0x558714bf0e30 2024-09-12T17:28:03.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.427+0000 7f9608608640 1 -- 172.21.15.170:0/84852751 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f971404edc0 con 0x558714bf0e30 2024-09-12T17:28:03.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.428+0000 7f971c975800 1 -- 172.21.15.170:0/84852751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558714bf0e30 msgr2=0x558714b64df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.428+0000 7f971c975800 1 --2- 172.21.15.170:0/84852751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558714bf0e30 0x558714b64df0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9714005fd0 tx=0x7f9714050000 comp rx=0 tx=0).stop 2024-09-12T17:28:03.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.428+0000 7f971c975800 1 -- 172.21.15.170:0/84852751 shutdown_connections 2024-09-12T17:28:03.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.428+0000 7f971c975800 1 --2- 172.21.15.170:0/84852751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558714bf0e30 0x558714b64df0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.428+0000 7f971c975800 1 -- 172.21.15.170:0/84852751 >> 172.21.15.170:0/84852751 conn(0x558714bec200 msgr2=0x558714cdbe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:03.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.428+0000 7f971c975800 1 -- 172.21.15.170:0/84852751 shutdown_connections 2024-09-12T17:28:03.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.428+0000 7f971c975800 1 -- 172.21.15.170:0/84852751 wait complete. 2024-09-12T17:28:03.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.428+0000 7f971c975800 1 Processor -- start 2024-09-12T17:28:03.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.428+0000 7f971c975800 1 -- start start 2024-09-12T17:28:03.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.428+0000 7f971c975800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558714bf0e30 0x558714ce8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.428+0000 7f971c975800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558714bf2760 con 0x558714bf0e30 2024-09-12T17:28:03.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.428+0000 7f971a45f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558714bf0e30 0x558714ce8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.428+0000 7f971a45f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558714bf0e30 0x558714ce8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:58024/0 (socket says 172.21.15.170:58024) 2024-09-12T17:28:03.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.428+0000 7f971a45f640 1 -- 172.21.15.170:0/3082972064 learned_addr learned my addr 172.21.15.170:0/3082972064 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:03.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.429+0000 7f971a45f640 1 -- 172.21.15.170:0/3082972064 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558714ce9330 con 0x558714bf0e30 2024-09-12T17:28:03.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.429+0000 7f971a45f640 1 --2- 172.21.15.170:0/3082972064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558714bf0e30 0x558714ce8dd0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9714005fd0 tx=0x7f9714003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.429+0000 7f9606e05640 1 -- 172.21.15.170:0/3082972064 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f971406d550 con 0x558714bf0e30 2024-09-12T17:28:03.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.429+0000 7f9606e05640 1 -- 172.21.15.170:0/3082972064 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9714071030 con 0x558714bf0e30 2024-09-12T17:28:03.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.429+0000 7f971c975800 1 -- 172.21.15.170:0/3082972064 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558714ce95c0 con 0x558714bf0e30 2024-09-12T17:28:03.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.429+0000 7f9606e05640 1 -- 172.21.15.170:0/3082972064 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f971406d860 con 0x558714bf0e30 2024-09-12T17:28:03.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.429+0000 7f971c975800 1 -- 172.21.15.170:0/3082972064 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558714ce9fc0 con 0x558714bf0e30 2024-09-12T17:28:03.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.430+0000 7f9606e05640 1 -- 172.21.15.170:0/3082972064 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f971406da00 con 0x558714bf0e30 2024-09-12T17:28:03.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.430+0000 7f9606e05640 1 --2- 172.21.15.170:0/3082972064 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f960003c780 0x7f960003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.430+0000 7f9606e05640 1 -- 172.21.15.170:0/3082972064 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f97140983b0 con 0x558714bf0e30 2024-09-12T17:28:03.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.430+0000 7f9719c5e640 1 --2- 172.21.15.170:0/3082972064 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f960003c780 0x7f960003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.430+0000 7f971c975800 1 --2- 172.21.15.170:0/3082972064 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x558714bf2070 0x558714cf0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.430+0000 7f971c975800 1 -- 172.21.15.170:0/3082972064 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558714cf0960 con 0x558714bf2070 2024-09-12T17:28:03.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.431+0000 7f971ac60640 1 --2- 172.21.15.170:0/3082972064 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x558714bf2070 0x558714cf0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.431+0000 7f9719c5e640 1 --2- 172.21.15.170:0/3082972064 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f960003c780 0x7f960003ec40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9704000c00 tx=0x7f97040013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.431+0000 7f971ac60640 1 --2- 172.21.15.170:0/3082972064 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x558714bf2070 0x558714cf0420 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.431+0000 7f971ac60640 1 -- 172.21.15.170:0/3082972064 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f970c0083e0 con 0x558714bf2070 2024-09-12T17:28:03.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.431+0000 7f971c975800 1 -- 172.21.15.170:0/3082972064 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558714cf0d00 con 0x558714bf2070 2024-09-12T17:28:03.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.431+0000 7f971ac60640 1 -- 172.21.15.170:0/3082972064 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f970c0083e0 con 0x558714bf2070 2024-09-12T17:28:03.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.431+0000 7f971c975800 1 --2- 172.21.15.170:0/3082972064 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x558714cf27c0 0x558714cf4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.431+0000 7f971c975800 1 -- 172.21.15.170:0/3082972064 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558714cf53d0 con 0x558714cf27c0 2024-09-12T17:28:03.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.432+0000 7f971a45f640 1 --2- 172.21.15.170:0/3082972064 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x558714cf27c0 0x558714cf4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.432+0000 7f971a45f640 1 --2- 172.21.15.170:0/3082972064 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x558714cf27c0 0x558714cf4c40 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.432+0000 7f971a45f640 1 -- 172.21.15.170:0/3082972064 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f971407d070 con 0x558714cf27c0 2024-09-12T17:28:03.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.432+0000 7f971c975800 1 -- 172.21.15.170:0/3082972064 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558714cf1550 con 0x558714bf2070 2024-09-12T17:28:03.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.432+0000 7f971ac60640 1 -- 172.21.15.170:0/3082972064 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f970c0083e0 con 0x558714bf2070 2024-09-12T17:28:03.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.432+0000 7f971c975800 1 -- 172.21.15.170:0/3082972064 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558714cf18f0 con 0x558714cf27c0 2024-09-12T17:28:03.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.433+0000 7f971a45f640 1 -- 172.21.15.170:0/3082972064 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f971407d070 con 0x558714cf27c0 2024-09-12T17:28:03.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.433+0000 7f971c975800 1 Processor -- start 2024-09-12T17:28:03.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.433+0000 7f971c975800 1 -- start start 2024-09-12T17:28:03.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.433+0000 7f971c975800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558714d03c60 0x558714d04080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.433+0000 7f971c975800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558714ae8a00 con 0x558714d03c60 2024-09-12T17:28:03.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.433+0000 7f971ac60640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558714d03c60 0x558714d04080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.433+0000 7f971ac60640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558714d03c60 0x558714d04080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:58040/0 (socket says 172.21.15.170:58040) 2024-09-12T17:28:03.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.433+0000 7f971ac60640 1 -- 172.21.15.170:0/1009726705 learned_addr learned my addr 172.21.15.170:0/1009726705 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:03.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.434+0000 7f971ac60640 1 -- 172.21.15.170:0/1009726705 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558714d046c0 con 0x558714d03c60 2024-09-12T17:28:03.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.434+0000 7f971ac60640 1 --2- 172.21.15.170:0/1009726705 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558714d03c60 0x558714d04080 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x558714ceace0 tx=0x7f970c00bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.434+0000 7f95fffff640 1 -- 172.21.15.170:0/1009726705 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f970c01c020 con 0x558714d03c60 2024-09-12T17:28:03.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.434+0000 7f95fffff640 1 -- 172.21.15.170:0/1009726705 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f970c007c90 con 0x558714d03c60 2024-09-12T17:28:03.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.434+0000 7f95fffff640 1 -- 172.21.15.170:0/1009726705 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f970c018440 con 0x558714d03c60 2024-09-12T17:28:03.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.434+0000 7f971c975800 1 -- 172.21.15.170:0/1009726705 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558714d04ef0 con 0x558714d03c60 2024-09-12T17:28:03.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.434+0000 7f971c975800 1 -- 172.21.15.170:0/1009726705 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558714d05490 con 0x558714d03c60 2024-09-12T17:28:03.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.435+0000 7f95fffff640 1 -- 172.21.15.170:0/1009726705 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f970c01f020 con 0x558714d03c60 2024-09-12T17:28:03.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.435+0000 7f95fffff640 1 --2- 172.21.15.170:0/1009726705 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f95f403c730 0x7f95f403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.435+0000 7f95fffff640 1 -- 172.21.15.170:0/1009726705 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f970c054df0 con 0x558714d03c60 2024-09-12T17:28:03.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.435+0000 7f971a45f640 1 --2- 172.21.15.170:0/1009726705 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f95f403c730 0x7f95f403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.435+0000 7f971c975800 1 Processor -- start 2024-09-12T17:28:03.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.435+0000 7f971a45f640 1 --2- 172.21.15.170:0/1009726705 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f95f403c730 0x7f95f403ebf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x558714cf5770 tx=0x7f97140753d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.435+0000 7f971c975800 1 -- start start 2024-09-12T17:28:03.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.436+0000 7f971c975800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558714d10780 0x558714d10b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.436+0000 7f971c975800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558714ce4180 con 0x558714d10780 2024-09-12T17:28:03.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.436+0000 7f971ac60640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558714d10780 0x558714d10b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.436+0000 7f971ac60640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558714d10780 0x558714d10b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:58046/0 (socket says 172.21.15.170:58046) 2024-09-12T17:28:03.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.436+0000 7f971ac60640 1 -- 172.21.15.170:0/4185006956 learned_addr learned my addr 172.21.15.170:0/4185006956 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:03.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.436+0000 7f971ac60640 1 -- 172.21.15.170:0/4185006956 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558714d11170 con 0x558714d10780 2024-09-12T17:28:03.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.436+0000 7f971ac60640 1 --2- 172.21.15.170:0/4185006956 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558714d10780 0x558714d10b80 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f970c0532d0 tx=0x7f970c015640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feb36665ed45a2e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.436+0000 7f95fdffb640 1 -- 172.21.15.170:0/4185006956 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f970c050020 con 0x558714d10780 2024-09-12T17:28:03.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.436+0000 7f95fdffb640 1 -- 172.21.15.170:0/4185006956 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f970c028d50 con 0x558714d10780 2024-09-12T17:28:03.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.436+0000 7f95fdffb640 1 -- 172.21.15.170:0/4185006956 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f970c0174d0 con 0x558714d10780 2024-09-12T17:28:03.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.437+0000 7f971c975800 1 -- 172.21.15.170:0/4185006956 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558714d10780 msgr2=0x558714d10b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.437+0000 7f971c975800 1 --2- 172.21.15.170:0/4185006956 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558714d10780 0x558714d10b80 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f970c0532d0 tx=0x7f970c015640 comp rx=0 tx=0).stop 2024-09-12T17:28:03.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.437+0000 7f971c975800 1 -- 172.21.15.170:0/4185006956 shutdown_connections 2024-09-12T17:28:03.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.437+0000 7f971c975800 1 --2- 172.21.15.170:0/4185006956 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558714d10780 0x558714d10b80 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.437+0000 7f971c975800 1 -- 172.21.15.170:0/4185006956 >> 172.21.15.170:0/4185006956 conn(0x558714d0cb80 msgr2=0x558714d0adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:03.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.437+0000 7f971c975800 1 -- 172.21.15.170:0/4185006956 shutdown_connections 2024-09-12T17:28:03.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.437+0000 7f971c975800 1 -- 172.21.15.170:0/4185006956 wait complete. 2024-09-12T17:28:03.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.437+0000 7f971c975800 1 Processor -- start 2024-09-12T17:28:03.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.437+0000 7f971c975800 1 -- start start 2024-09-12T17:28:03.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.437+0000 7f971c975800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558714d10780 0x558714d17d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.437+0000 7f971c975800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558714d11790 con 0x558714d10780 2024-09-12T17:28:03.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.437+0000 7f971ac60640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558714d10780 0x558714d17d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.437+0000 7f971ac60640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558714d10780 0x558714d17d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:58048/0 (socket says 172.21.15.170:58048) 2024-09-12T17:28:03.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.437+0000 7f971ac60640 1 -- 172.21.15.170:0/712948837 learned_addr learned my addr 172.21.15.170:0/712948837 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:03.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.438+0000 7f971ac60640 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558714d182c0 con 0x558714d10780 2024-09-12T17:28:03.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.438+0000 7f971ac60640 1 --2- 172.21.15.170:0/712948837 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558714d10780 0x558714d17d60 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f970c0521a0 tx=0x7f970c053260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.438+0000 7f95ebfff640 1 -- 172.21.15.170:0/712948837 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f970c04a040 con 0x558714d10780 2024-09-12T17:28:03.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.438+0000 7f95ebfff640 1 -- 172.21.15.170:0/712948837 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f970c03d020 con 0x558714d10780 2024-09-12T17:28:03.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.438+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558714d18550 con 0x558714d10780 2024-09-12T17:28:03.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.438+0000 7f95ebfff640 1 -- 172.21.15.170:0/712948837 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f970c00b030 con 0x558714d10780 2024-09-12T17:28:03.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.438+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558714d18ed0 con 0x558714d10780 2024-09-12T17:28:03.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.439+0000 7f95ebfff640 1 -- 172.21.15.170:0/712948837 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f970c016040 con 0x558714d10780 2024-09-12T17:28:03.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.439+0000 7f95ebfff640 1 --2- 172.21.15.170:0/712948837 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f95e403c780 0x7f95e403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.439+0000 7f95ebfff640 1 -- 172.21.15.170:0/712948837 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f970c03e030 con 0x558714d10780 2024-09-12T17:28:03.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.439+0000 7f971a45f640 1 --2- 172.21.15.170:0/712948837 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f95e403c780 0x7f95e403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.440+0000 7f971a45f640 1 --2- 172.21.15.170:0/712948837 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f95e403c780 0x7f95e403ec40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9714096bf0 tx=0x7f9714088000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.440+0000 7f971c975800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.440+0000 7f971c975800 1 --2- 172.21.15.170:0/712948837 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x558714d23650 0x558714d25b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.440+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558714d26260 con 0x558714d23650 2024-09-12T17:28:03.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.440+0000 7f9719c5e640 1 --2- 172.21.15.170:0/712948837 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x558714d23650 0x558714d25b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.440+0000 7f9719c5e640 1 --2- 172.21.15.170:0/712948837 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x558714d23650 0x558714d25b10 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.440+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f970400f5f0 con 0x558714d23650 2024-09-12T17:28:03.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.440+0000 7f971c975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.440+0000 7f971c975800 20 realm 2024-09-12T17:28:03.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.440+0000 7f971c975800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.440+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558714d229a0 con 0x558714d23650 2024-09-12T17:28:03.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.441+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f970400f5f0 con 0x558714d23650 2024-09-12T17:28:03.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.441+0000 7f971c975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.441+0000 7f971c975800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:03.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.441+0000 7f971c975800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.441+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558714d26d50 con 0x558714d23650 2024-09-12T17:28:03.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.441+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f970400f5f0 con 0x558714d23650 2024-09-12T17:28:03.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.441+0000 7f971c975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.441+0000 7f971c975800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.441+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558714d27620 con 0x558714d23650 2024-09-12T17:28:03.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.441+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f970400f5f0 con 0x558714d23650 2024-09-12T17:28:03.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.441+0000 7f971c975800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:03.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.441+0000 7f971c975800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.441+0000 7f971c975800 1 --2- 172.21.15.170:0/712948837 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x558714d28040 0x558714d2a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.441+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558714d2aba0 con 0x558714d28040 2024-09-12T17:28:03.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.441+0000 7f971ac60640 1 --2- 172.21.15.170:0/712948837 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x558714d28040 0x558714d2a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.442+0000 7f971ac60640 1 --2- 172.21.15.170:0/712948837 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x558714d28040 0x558714d2a430 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.442+0000 7f971ac60640 1 -- 172.21.15.170:0/712948837 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f970c032070 con 0x558714d28040 2024-09-12T17:28:03.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.442+0000 7f971c975800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:03.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.442+0000 7f971c975800 20 searching for the correct realm 2024-09-12T17:28:03.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.442+0000 7f971c975800 1 --2- 172.21.15.170:0/712948837 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x558714d2cb50 0x558714d2f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.442+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558714d2f6e0 con 0x558714d2cb50 2024-09-12T17:28:03.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.442+0000 7f971a45f640 1 --2- 172.21.15.170:0/712948837 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x558714d2cb50 0x558714d2f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.442+0000 7f971a45f640 1 --2- 172.21.15.170:0/712948837 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x558714d2cb50 0x558714d2f010 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.443+0000 7f971a45f640 1 -- 172.21.15.170:0/712948837 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f971407d070 con 0x558714d2cb50 2024-09-12T17:28:03.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.443+0000 7f971a45f640 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558714d2f6e0 con 0x558714d28040 2024-09-12T17:28:03.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.443+0000 7f971ac60640 1 -- 172.21.15.170:0/712948837 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f970c05a040 con 0x558714d28040 2024-09-12T17:28:03.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.443+0000 7f971ac60640 1 --2- 172.21.15.170:0/712948837 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f970c038040 0x7f970c044730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.443+0000 7f971ac60640 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558714d2f6e0 con 0x7f970c038040 2024-09-12T17:28:03.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.443+0000 7f9719c5e640 1 --2- 172.21.15.170:0/712948837 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f970c038040 0x7f970c044730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.444+0000 7f9719c5e640 1 --2- 172.21.15.170:0/712948837 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f970c038040 0x7f970c044730 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.444+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f970400f5f0 con 0x7f970c038040 2024-09-12T17:28:03.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.444+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558714d2f6e0 con 0x558714d23650 2024-09-12T17:28:03.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.444+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f970400f5f0 con 0x558714d23650 2024-09-12T17:28:03.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.444+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558714d2f6e0 con 0x558714d23650 2024-09-12T17:28:03.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.444+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f970402b040 con 0x558714d23650 2024-09-12T17:28:03.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.444+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558714d2f6e0 con 0x7f970c038040 2024-09-12T17:28:03.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.445+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f970402b040 con 0x7f970c038040 2024-09-12T17:28:03.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.445+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558714d2f6e0 con 0x7f970c038040 2024-09-12T17:28:03.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.445+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f970402b040 con 0x7f970c038040 2024-09-12T17:28:03.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.445+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558714d2f6e0 con 0x558714d28040 2024-09-12T17:28:03.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.445+0000 7f971ac60640 1 -- 172.21.15.170:0/712948837 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f970c05a040 con 0x558714d28040 2024-09-12T17:28:03.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.445+0000 7f971ac60640 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558714d2f6e0 con 0x558714d2cb50 2024-09-12T17:28:03.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.445+0000 7f971a45f640 1 -- 172.21.15.170:0/712948837 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f971407d070 con 0x558714d2cb50 2024-09-12T17:28:03.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.445+0000 7f971a45f640 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558714d2f6e0 con 0x558714d23650 2024-09-12T17:28:03.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.445+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f970402b040 con 0x558714d23650 2024-09-12T17:28:03.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.445+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558714d2f6e0 con 0x7f970c038040 2024-09-12T17:28:03.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.446+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f970402b040 con 0x7f970c038040 2024-09-12T17:28:03.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.446+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558714d2f6e0 con 0x558714d23650 2024-09-12T17:28:03.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.446+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f970402b040 con 0x558714d23650 2024-09-12T17:28:03.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.446+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558714d2f6e0 con 0x558714d28040 2024-09-12T17:28:03.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.446+0000 7f971ac60640 1 -- 172.21.15.170:0/712948837 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f970c05a040 con 0x558714d28040 2024-09-12T17:28:03.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.446+0000 7f971ac60640 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558714d2f6e0 con 0x558714d2cb50 2024-09-12T17:28:03.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.446+0000 7f971a45f640 1 -- 172.21.15.170:0/712948837 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f971407d070 con 0x558714d2cb50 2024-09-12T17:28:03.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.446+0000 7f971a45f640 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558714d2f6e0 con 0x558714d2cb50 2024-09-12T17:28:03.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.447+0000 7f971a45f640 1 -- 172.21.15.170:0/712948837 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f971407d070 con 0x558714d2cb50 2024-09-12T17:28:03.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.447+0000 7f971a45f640 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558714d2f6e0 con 0x7f970c038040 2024-09-12T17:28:03.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.447+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f970402b040 con 0x7f970c038040 2024-09-12T17:28:03.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.447+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558714d2f6e0 con 0x558714d2cb50 2024-09-12T17:28:03.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.447+0000 7f971a45f640 1 -- 172.21.15.170:0/712948837 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f971407d070 con 0x558714d2cb50 2024-09-12T17:28:03.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.447+0000 7f971a45f640 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558714d2f6e0 con 0x558714d2cb50 2024-09-12T17:28:03.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.447+0000 7f971a45f640 1 -- 172.21.15.170:0/712948837 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f971407d070 con 0x558714d2cb50 2024-09-12T17:28:03.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.447+0000 7f971a45f640 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558714d2f6e0 con 0x558714d23650 2024-09-12T17:28:03.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.448+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f970402b040 con 0x558714d23650 2024-09-12T17:28:03.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.448+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558714d2f6e0 con 0x558714d23650 2024-09-12T17:28:03.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.448+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f970402b040 con 0x558714d23650 2024-09-12T17:28:03.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.448+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558714d2f6e0 con 0x7f970c038040 2024-09-12T17:28:03.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.448+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f970402b040 con 0x7f970c038040 2024-09-12T17:28:03.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.448+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558714d2f6e0 con 0x558714d2cb50 2024-09-12T17:28:03.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.448+0000 7f971a45f640 1 -- 172.21.15.170:0/712948837 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f971407d070 con 0x558714d2cb50 2024-09-12T17:28:03.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.448+0000 7f971a45f640 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558714d2f6e0 con 0x558714d28040 2024-09-12T17:28:03.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.449+0000 7f971ac60640 1 -- 172.21.15.170:0/712948837 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f970c05a040 con 0x558714d28040 2024-09-12T17:28:03.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.449+0000 7f971ac60640 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558714d2f6e0 con 0x558714d23650 2024-09-12T17:28:03.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.449+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f970402b040 con 0x558714d23650 2024-09-12T17:28:03.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.449+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558714d2f6e0 con 0x7f970c038040 2024-09-12T17:28:03.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.449+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f970403b040 con 0x7f970c038040 2024-09-12T17:28:03.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.449+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558714d2f6e0 con 0x558714d2cb50 2024-09-12T17:28:03.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.449+0000 7f971a45f640 1 -- 172.21.15.170:0/712948837 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f971407d070 con 0x558714d2cb50 2024-09-12T17:28:03.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.449+0000 7f971a45f640 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558714d2f6e0 con 0x7f970c038040 2024-09-12T17:28:03.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.450+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f970403b040 con 0x7f970c038040 2024-09-12T17:28:03.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.450+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558714d2f6e0 con 0x558714d28040 2024-09-12T17:28:03.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.450+0000 7f971ac60640 1 -- 172.21.15.170:0/712948837 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f970c05a040 con 0x558714d28040 2024-09-12T17:28:03.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.450+0000 7f971ac60640 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558714d2f6e0 con 0x558714d2cb50 2024-09-12T17:28:03.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.450+0000 7f971a45f640 1 -- 172.21.15.170:0/712948837 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f971407d070 con 0x558714d2cb50 2024-09-12T17:28:03.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.450+0000 7f971a45f640 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558714d2f6e0 con 0x7f970c038040 2024-09-12T17:28:03.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.450+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f970403b040 con 0x7f970c038040 2024-09-12T17:28:03.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.450+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558714d2f6e0 con 0x558714d23650 2024-09-12T17:28:03.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.450+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f970403b040 con 0x558714d23650 2024-09-12T17:28:03.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.451+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558714d2f6e0 con 0x558714d28040 2024-09-12T17:28:03.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.451+0000 7f971ac60640 1 -- 172.21.15.170:0/712948837 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f970c05a040 con 0x558714d28040 2024-09-12T17:28:03.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.451+0000 7f971c975800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:03.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.451+0000 7f971c975800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:03.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.451+0000 7f971c975800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:03.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.451+0000 7f971c975800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:03.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.451+0000 7f971c975800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:03.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.451+0000 7f971c975800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:03.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.451+0000 7f971c975800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.451+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558714d2b590 con 0x558714d23650 2024-09-12T17:28:03.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.451+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f970403b040 con 0x558714d23650 2024-09-12T17:28:03.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.451+0000 7f971c975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.451+0000 7f971c975800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.451+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558714d2be30 con 0x558714d23650 2024-09-12T17:28:03.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.451+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f970403b040 con 0x558714d23650 2024-09-12T17:28:03.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.451+0000 7f971c975800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:03.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.451+0000 7f971c975800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.451+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558714d2b1d0 con 0x558714d28040 2024-09-12T17:28:03.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.451+0000 7f971ac60640 1 -- 172.21.15.170:0/712948837 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f970c05a040 con 0x558714d28040 2024-09-12T17:28:03.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.452+0000 7f971c975800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:03.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.452+0000 7f971c975800 20 zone default found 2024-09-12T17:28:03.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.452+0000 7f971c975800 4 Realm: () 2024-09-12T17:28:03.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.452+0000 7f971c975800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:03.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.452+0000 7f971c975800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:03.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.452+0000 7f971c975800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:03.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.452+0000 7f971c975800 20 zonegroup default 2024-09-12T17:28:03.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.452+0000 7f971c975800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.452+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558714d2fb60 con 0x7f970c038040 2024-09-12T17:28:03.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.452+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f970403b040 con 0x7f970c038040 2024-09-12T17:28:03.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.452+0000 7f971c975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.452+0000 7f971c975800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.452+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558714d31970 con 0x558714d2cb50 2024-09-12T17:28:03.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.452+0000 7f971a45f640 1 -- 172.21.15.170:0/712948837 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f971407d070 con 0x558714d2cb50 2024-09-12T17:28:03.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.452+0000 7f971c975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.452+0000 7f971c975800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.452+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558714d31e00 con 0x558714d2cb50 2024-09-12T17:28:03.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.452+0000 7f971a45f640 1 -- 172.21.15.170:0/712948837 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f971407d070 con 0x558714d2cb50 2024-09-12T17:28:03.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.452+0000 7f971c975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.452+0000 7f971c975800 20 started sync module instance, tier type = 2024-09-12T17:28:03.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.452+0000 7f971c975800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:03.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.452+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558714d30e10 con 0x558714d28040 2024-09-12T17:28:03.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.454+0000 7f971ac60640 1 -- 172.21.15.170:0/712948837 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f970c05a040 con 0x558714d28040 2024-09-12T17:28:03.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.454+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94038658323216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558714d30e10 con 0x558714d28040 2024-09-12T17:28:03.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.454+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558714d32930 con 0x558714d23650 2024-09-12T17:28:03.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.455+0000 7f971ac60640 1 -- 172.21.15.170:0/712948837 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94038658323216] v29'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f970c05a040 con 0x558714d28040 2024-09-12T17:28:03.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.455+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f970403b040 con 0x558714d23650 2024-09-12T17:28:03.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.455+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94038658327552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558714d30e10 con 0x558714d23650 2024-09-12T17:28:03.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.455+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558714d333a0 con 0x558714d2cb50 2024-09-12T17:28:03.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.456+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94038658327552] v29'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f970403b040 con 0x558714d23650 2024-09-12T17:28:03.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.456+0000 7f971a45f640 1 -- 172.21.15.170:0/712948837 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f971407d070 con 0x558714d2cb50 2024-09-12T17:28:03.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.456+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94038658320736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558714d30d80 con 0x558714d2cb50 2024-09-12T17:28:03.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.456+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558714d34290 con 0x558714d28040 2024-09-12T17:28:03.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.457+0000 7f971a45f640 1 -- 172.21.15.170:0/712948837 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94038658320736] v29'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f971407d070 con 0x558714d2cb50 2024-09-12T17:28:03.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.457+0000 7f971ac60640 1 -- 172.21.15.170:0/712948837 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f970c05a040 con 0x558714d28040 2024-09-12T17:28:03.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.457+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94038658334176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558714d34200 con 0x558714d28040 2024-09-12T17:28:03.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.457+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558714d35150 con 0x558714d23650 2024-09-12T17:28:03.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.458+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f970403b040 con 0x558714d23650 2024-09-12T17:28:03.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.458+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94038658337952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558714d350c0 con 0x558714d23650 2024-09-12T17:28:03.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.458+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558714d36100 con 0x7f970c038040 2024-09-12T17:28:03.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.458+0000 7f971ac60640 1 -- 172.21.15.170:0/712948837 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94038658334176] v29'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f970c05a040 con 0x558714d28040 2024-09-12T17:28:03.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.459+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94038658337952] v29'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f970403b040 con 0x558714d23650 2024-09-12T17:28:03.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.459+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f970403b040 con 0x7f970c038040 2024-09-12T17:28:03.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.459+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94038658336384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558714d35c10 con 0x7f970c038040 2024-09-12T17:28:03.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.459+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558714d369a0 con 0x7f970c038040 2024-09-12T17:28:03.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.460+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94038658336384] v29'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f970403b040 con 0x7f970c038040 2024-09-12T17:28:03.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.460+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(56 notify.6 [create] v29'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f970403b040 con 0x7f970c038040 2024-09-12T17:28:03.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.460+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94038658340048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558714d35c10 con 0x7f970c038040 2024-09-12T17:28:03.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.460+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558714d36fc0 con 0x7f970c038040 2024-09-12T17:28:03.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.461+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94038658340048] v29'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f970403b040 con 0x7f970c038040 2024-09-12T17:28:03.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.461+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(58 notify.7 [create] v29'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f970403b040 con 0x7f970c038040 2024-09-12T17:28:03.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.461+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94038658343840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558714d36fc0 con 0x7f970c038040 2024-09-12T17:28:03.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.461+0000 7f971c975800 20 add_watcher() i=0 2024-09-12T17:28:03.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.461+0000 7f971c975800 20 add_watcher() i=1 2024-09-12T17:28:03.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.461+0000 7f971c975800 20 add_watcher() i=2 2024-09-12T17:28:03.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.461+0000 7f971c975800 20 add_watcher() i=3 2024-09-12T17:28:03.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.461+0000 7f971c975800 20 add_watcher() i=4 2024-09-12T17:28:03.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.461+0000 7f971c975800 20 add_watcher() i=5 2024-09-12T17:28:03.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.461+0000 7f971c975800 20 add_watcher() i=6 2024-09-12T17:28:03.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.462+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94038658343840] v29'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f970403b040 con 0x7f970c038040 2024-09-12T17:28:03.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.462+0000 7f971c975800 20 add_watcher() i=7 2024-09-12T17:28:03.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.462+0000 7f971c975800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:03.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.462+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558714d3a2b0 con 0x558714d23650 2024-09-12T17:28:03.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.463+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f970403b040 con 0x558714d23650 2024-09-12T17:28:03.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.463+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94038658346112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558714d37550 con 0x558714d23650 2024-09-12T17:28:03.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.464+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94038658346112] v29'106 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f970403b040 con 0x558714d23650 2024-09-12T17:28:03.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.464+0000 7f95d0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:03.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.464+0000 7f971c975800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:03.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.464+0000 7f971c975800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:03.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.464+0000 7f971c975800 5 note: GC not initialized 2024-09-12T17:28:03.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.464+0000 7f954b7fe640 20 reqs_thread_entry: start 2024-09-12T17:28:03.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.464+0000 7f971c975800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:03.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.464+0000 7f971c975800 20 Filter name: none 2024-09-12T17:28:03.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.464+0000 7f95497fa640 20 reqs_thread_entry: start 2024-09-12T17:28:03.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.464+0000 7f971c975800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-12T17:28:03.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.464+0000 7f971c975800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.464+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558714d6d420 con 0x7f970c038040 2024-09-12T17:28:03.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.465+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f970403b040 con 0x7f970c038040 2024-09-12T17:28:03.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.465+0000 7f971c975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.465+0000 7f971c975800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-12T17:28:03.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.465+0000 7f971c975800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T17:28:03.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.465+0000 7f971c975800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-12T17:28:03.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.465+0000 7f971c975800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.465+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558714d6bac0 con 0x7f970c038040 2024-09-12T17:28:03.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.465+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f970403b040 con 0x7f970c038040 2024-09-12T17:28:03.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.465+0000 7f971c975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.465+0000 7f971c975800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-12T17:28:03.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.465+0000 7f971c975800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T17:28:03.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.465+0000 7f971c975800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-12T17:28:03.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.465+0000 7f971c975800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-12T17:28:03.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.465+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558714d6c390 con 0x7f970c038040 2024-09-12T17:28:03.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.466+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v29'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f970403b040 con 0x7f970c038040 2024-09-12T17:28:03.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.466+0000 7f971c975800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-12T17:28:03.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.466+0000 7f971c975800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T17:28:03.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.466+0000 7f971c975800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-12T17:28:03.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.466+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94038658563808 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558714d70d60 con 0x7f970c038040 2024-09-12T17:28:03.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.467+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== watch-notify(notify (1) cookie 94038658336384 notify 124554051587 ret 0) ==== 598+0+0 (crc 0 0 0) 0x558714d6c730 con 0x7f970c038040 2024-09-12T17:28:03.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.467+0000 7f95fdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051587 cookie 94038658336384 notifier 4484 bl.length()=556 2024-09-12T17:28:03.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.467+0000 7f95fdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-12T17:28:03.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.467+0000 7f95fdffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T17:28:03.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.467+0000 7f95fdffb640 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f95e0003ea0 con 0x7f970c038040 2024-09-12T17:28:03.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.467+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== osd_op_reply(65 notify.5 [notify cookie 94038658563808 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f970403b040 con 0x7f970c038040 2024-09-12T17:28:03.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.467+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.0 v2:172.21.15.47:6800/3978157098 22 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f970403b040 con 0x7f970c038040 2024-09-12T17:28:03.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.467+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.0 v2:172.21.15.47:6800/3978157098 23 ==== watch-notify(notify_complete (2) cookie 94038658563808 notify 124554051587 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558714d6cd70 con 0x7f970c038040 2024-09-12T17:28:03.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.467+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558714d6be90 con 0x7f970c038040 2024-09-12T17:28:03.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.468+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.0 v2:172.21.15.47:6800/3978157098 24 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v29'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f970403b040 con 0x7f970c038040 2024-09-12T17:28:03.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.468+0000 7f971c975800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-12T17:28:03.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.468+0000 7f971c975800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T17:28:03.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.468+0000 7f971c975800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-12T17:28:03.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.468+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94038658563728 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558714d70d40 con 0x558714d2cb50 2024-09-12T17:28:03.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.469+0000 7f971a45f640 1 -- 172.21.15.170:0/712948837 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== watch-notify(notify (1) cookie 94038658320736 notify 124554051592 ret 0) ==== 219+0+0 (crc 0 0 0) 0x558714ce9fc0 con 0x558714d2cb50 2024-09-12T17:28:03.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.469+0000 7f95fd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051592 cookie 94038658320736 notifier 4484 bl.length()=177 2024-09-12T17:28:03.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.469+0000 7f95fd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-12T17:28:03.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.469+0000 7f95fd7fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T17:28:03.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.469+0000 7f95fd7fa640 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f9550003400 con 0x558714d2cb50 2024-09-12T17:28:03.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.469+0000 7f971a45f640 1 -- 172.21.15.170:0/712948837 <== osd.3 v2:172.21.15.170:6816/2664906588 15 ==== osd_op_reply(68 notify.2 [notify cookie 94038658563728 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f971407d070 con 0x558714d2cb50 2024-09-12T17:28:03.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.469+0000 7f971a45f640 1 -- 172.21.15.170:0/712948837 <== osd.3 v2:172.21.15.170:6816/2664906588 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f971407d070 con 0x558714d2cb50 2024-09-12T17:28:03.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.469+0000 7f971a45f640 1 -- 172.21.15.170:0/712948837 <== osd.3 v2:172.21.15.170:6816/2664906588 17 ==== watch-notify(notify_complete (2) cookie 94038658563728 notify 124554051592 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558714ce95c0 con 0x558714d2cb50 2024-09-12T17:28:03.485 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-12T17:28:03.467473Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:28:03.467463Z","tags":[],"group_ids":[]} 2024-09-12T17:28:03.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.470+0000 7f95d0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:03.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.470+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94038658346112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558714d6b230 con 0x558714d23650 2024-09-12T17:28:03.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.471+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94038658346112] v29'107 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f970403b040 con 0x558714d23650 2024-09-12T17:28:03.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.471+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94038658323216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558714d6b230 con 0x558714d28040 2024-09-12T17:28:03.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.472+0000 7f971ac60640 1 -- 172.21.15.170:0/712948837 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94038658323216] v29'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f970c05a040 con 0x558714d28040 2024-09-12T17:28:03.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.472+0000 7f971c975800 20 remove_watcher() i=0 2024-09-12T17:28:03.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.472+0000 7f971c975800 2 removed watcher, disabling cache 2024-09-12T17:28:03.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.472+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94038658327552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558714d6b230 con 0x558714d23650 2024-09-12T17:28:03.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.473+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94038658327552] v29'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f970403b040 con 0x558714d23650 2024-09-12T17:28:03.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.473+0000 7f971c975800 20 remove_watcher() i=1 2024-09-12T17:28:03.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.473+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94038658320736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558714d6b230 con 0x558714d2cb50 2024-09-12T17:28:03.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.474+0000 7f971a45f640 1 -- 172.21.15.170:0/712948837 <== osd.3 v2:172.21.15.170:6816/2664906588 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94038658320736] v29'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f971407d070 con 0x558714d2cb50 2024-09-12T17:28:03.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.474+0000 7f971c975800 20 remove_watcher() i=2 2024-09-12T17:28:03.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.474+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94038658334176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558714d6b230 con 0x558714d28040 2024-09-12T17:28:03.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.475+0000 7f971ac60640 1 -- 172.21.15.170:0/712948837 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94038658334176] v29'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f970c05a040 con 0x558714d28040 2024-09-12T17:28:03.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.475+0000 7f971c975800 20 remove_watcher() i=3 2024-09-12T17:28:03.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.475+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94038658337952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558714d6b230 con 0x558714d23650 2024-09-12T17:28:03.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.476+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94038658337952] v29'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f970403b040 con 0x558714d23650 2024-09-12T17:28:03.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.476+0000 7f971c975800 20 remove_watcher() i=4 2024-09-12T17:28:03.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.476+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94038658336384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558714d6b230 con 0x7f970c038040 2024-09-12T17:28:03.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.477+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.0 v2:172.21.15.47:6800/3978157098 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94038658336384] v29'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f970403b040 con 0x7f970c038040 2024-09-12T17:28:03.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.477+0000 7f971c975800 20 remove_watcher() i=5 2024-09-12T17:28:03.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.477+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94038658340048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558714d6b230 con 0x7f970c038040 2024-09-12T17:28:03.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.478+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.0 v2:172.21.15.47:6800/3978157098 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94038658340048] v29'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f970403b040 con 0x7f970c038040 2024-09-12T17:28:03.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.478+0000 7f971c975800 20 remove_watcher() i=6 2024-09-12T17:28:03.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.478+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94038658343840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558714d6b230 con 0x7f970c038040 2024-09-12T17:28:03.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.479+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 <== osd.0 v2:172.21.15.47:6800/3978157098 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94038658343840] v29'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f970403b040 con 0x7f970c038040 2024-09-12T17:28:03.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.479+0000 7f971c975800 20 remove_watcher() i=7 2024-09-12T17:28:03.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.479+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f970c038040 msgr2=0x7f970c044730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.479+0000 7f971c975800 1 --2- 172.21.15.170:0/712948837 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f970c038040 0x7f970c044730 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.479+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x558714d23650 msgr2=0x558714d25b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.479+0000 7f971c975800 1 --2- 172.21.15.170:0/712948837 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x558714d23650 0x558714d25b10 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.479+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x558714d28040 msgr2=0x558714d2a430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.479+0000 7f971c975800 1 --2- 172.21.15.170:0/712948837 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x558714d28040 0x558714d2a430 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.479+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x558714d2cb50 msgr2=0x558714d2f010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.479+0000 7f971c975800 1 --2- 172.21.15.170:0/712948837 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x558714d2cb50 0x558714d2f010 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.479+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f95e403c780 msgr2=0x7f95e403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.479+0000 7f971c975800 1 --2- 172.21.15.170:0/712948837 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f95e403c780 0x7f95e403ec40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9714096bf0 tx=0x7f9714088000 comp rx=0 tx=0).stop 2024-09-12T17:28:03.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.479+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558714d10780 msgr2=0x558714d17d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.479+0000 7f9719c5e640 1 -- 172.21.15.170:0/712948837 reap_dead start 2024-09-12T17:28:03.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.479+0000 7f971c975800 1 --2- 172.21.15.170:0/712948837 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558714d10780 0x558714d17d60 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f970c0521a0 tx=0x7f970c053260 comp rx=0 tx=0).stop 2024-09-12T17:28:03.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.479+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 shutdown_connections 2024-09-12T17:28:03.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.479+0000 7f971c975800 1 --2- 172.21.15.170:0/712948837 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558714d10780 0x558714d17d60 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.479+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 >> 172.21.15.170:0/712948837 conn(0x558714d0cb80 msgr2=0x558714d0ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:03.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.479+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 shutdown_connections 2024-09-12T17:28:03.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.479+0000 7f971c975800 1 -- 172.21.15.170:0/712948837 wait complete. 2024-09-12T17:28:03.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.480+0000 7f971c975800 1 -- 172.21.15.170:0/1009726705 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f95f403c730 msgr2=0x7f95f403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.480+0000 7f971c975800 1 --2- 172.21.15.170:0/1009726705 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f95f403c730 0x7f95f403ebf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x558714cf5770 tx=0x7f97140753d0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.480+0000 7f971c975800 1 -- 172.21.15.170:0/1009726705 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558714d03c60 msgr2=0x558714d04080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.480+0000 7f971c975800 1 --2- 172.21.15.170:0/1009726705 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558714d03c60 0x558714d04080 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x558714ceace0 tx=0x7f970c00bf30 comp rx=0 tx=0).stop 2024-09-12T17:28:03.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.480+0000 7f971c975800 1 -- 172.21.15.170:0/1009726705 shutdown_connections 2024-09-12T17:28:03.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.480+0000 7f971c975800 1 --2- 172.21.15.170:0/1009726705 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f95f403c730 0x7f95f403ebf0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.480+0000 7f971c975800 1 --2- 172.21.15.170:0/1009726705 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558714d03c60 0x558714d04080 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.480+0000 7f971c975800 1 -- 172.21.15.170:0/1009726705 >> 172.21.15.170:0/1009726705 conn(0x558714cf8010 msgr2=0x558714cf83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:03.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.480+0000 7f971c975800 1 -- 172.21.15.170:0/1009726705 shutdown_connections 2024-09-12T17:28:03.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.480+0000 7f971c975800 1 -- 172.21.15.170:0/1009726705 wait complete. 2024-09-12T17:28:03.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.480+0000 7f971c975800 1 -- 172.21.15.170:0/3082972064 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x558714bf2070 msgr2=0x558714cf0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.480+0000 7f971c975800 1 --2- 172.21.15.170:0/3082972064 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x558714bf2070 0x558714cf0420 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.480+0000 7f971c975800 1 -- 172.21.15.170:0/3082972064 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x558714cf27c0 msgr2=0x558714cf4c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.480+0000 7f971c975800 1 --2- 172.21.15.170:0/3082972064 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x558714cf27c0 0x558714cf4c40 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.480+0000 7f971c975800 1 -- 172.21.15.170:0/3082972064 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f960003c780 msgr2=0x7f960003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.480+0000 7f971c975800 1 --2- 172.21.15.170:0/3082972064 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f960003c780 0x7f960003ec40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9704000c00 tx=0x7f97040013b0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.480+0000 7f971c975800 1 -- 172.21.15.170:0/3082972064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558714bf0e30 msgr2=0x558714ce8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.480+0000 7f971c975800 1 --2- 172.21.15.170:0/3082972064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558714bf0e30 0x558714ce8dd0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9714005fd0 tx=0x7f9714003330 comp rx=0 tx=0).stop 2024-09-12T17:28:03.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.480+0000 7f971c975800 1 -- 172.21.15.170:0/3082972064 shutdown_connections 2024-09-12T17:28:03.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.480+0000 7f971c975800 1 --2- 172.21.15.170:0/3082972064 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x558714cf27c0 0x558714cf4c40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.480+0000 7f971c975800 1 --2- 172.21.15.170:0/3082972064 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f960003c780 0x7f960003ec40 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.480+0000 7f971c975800 1 --2- 172.21.15.170:0/3082972064 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x558714bf2070 0x558714cf0420 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.480+0000 7f971c975800 1 --2- 172.21.15.170:0/3082972064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558714bf0e30 0x558714ce8dd0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.480+0000 7f971c975800 1 -- 172.21.15.170:0/3082972064 >> 172.21.15.170:0/3082972064 conn(0x558714bec200 msgr2=0x558714cda600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:03.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.480+0000 7f971c975800 1 -- 172.21.15.170:0/3082972064 shutdown_connections 2024-09-12T17:28:03.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.480+0000 7f971c975800 1 -- 172.21.15.170:0/3082972064 wait complete. 2024-09-12T17:28:03.496 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-12T17:28:03.467473Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:28:03.467463Z', 'tags': [], 'group_ids': []} 2024-09-12T17:28:03.502 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-12T17:28:03.506 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:28:03.506 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-09-12T17:28:03.506 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-09-12T17:28:03.506 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-09-12T17:28:03.550 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:03.550 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:03.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.548+0000 7f52c193a800 1 Processor -- start 2024-09-12T17:28:03.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.548+0000 7f52c193a800 1 -- start start 2024-09-12T17:28:03.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.548+0000 7f52c193a800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5609c51f5200 0x5609c51fada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.548+0000 7f52c193a800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5609c509ee40 con 0x5609c51f3df0 2024-09-12T17:28:03.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.548+0000 7f52c193a800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x5609c5069680 con 0x5609c51f5200 2024-09-12T17:28:03.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.549+0000 7f52b7fff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5609c51f5200 0x5609c51fada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.549+0000 7f52bd681640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x5609c51f3df0 0x5609c51f4af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:48478/0 (socket says 172.21.15.170:48478) 2024-09-12T17:28:03.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.549+0000 7f52bd681640 1 -- 172.21.15.170:0/814703705 learned_addr learned my addr 172.21.15.170:0/814703705 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:28:03.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.549+0000 7f52b7fff640 1 -- 172.21.15.170:0/814703705 >> v1:172.21.15.47:6789/0 conn(0x5609c51f3df0 legacy=0x5609c51f4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.549+0000 7f52b7fff640 1 -- 172.21.15.170:0/814703705 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609c50856b0 con 0x5609c51f5200 2024-09-12T17:28:03.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.551+0000 7f52b7fff640 1 --2- 172.21.15.170:0/814703705 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609c51f5200 0x5609c51fada0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f52a800a470 tx=0x7f52a8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a8e8e2a3ff54517 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.551+0000 7f52bce80640 1 -- 172.21.15.170:0/814703705 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52a8053570 con 0x5609c51f5200 2024-09-12T17:28:03.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.551+0000 7f52bce80640 1 -- 172.21.15.170:0/814703705 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52a8058070 con 0x5609c51f5200 2024-09-12T17:28:03.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.551+0000 7f52bce80640 1 -- 172.21.15.170:0/814703705 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52a8053880 con 0x5609c51f5200 2024-09-12T17:28:03.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.551+0000 7f52c193a800 1 -- 172.21.15.170:0/814703705 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609c51f5200 msgr2=0x5609c51fada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.551+0000 7f52c193a800 1 --2- 172.21.15.170:0/814703705 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609c51f5200 0x5609c51fada0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f52a800a470 tx=0x7f52a8045a20 comp rx=0 tx=0).stop 2024-09-12T17:28:03.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.551+0000 7f52c193a800 1 -- 172.21.15.170:0/814703705 shutdown_connections 2024-09-12T17:28:03.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.551+0000 7f52c193a800 1 --2- 172.21.15.170:0/814703705 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609c51f5200 0x5609c51fada0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.551+0000 7f52c193a800 1 -- 172.21.15.170:0/814703705 >> 172.21.15.170:0/814703705 conn(0x5609c51ef1c0 msgr2=0x5609c51f1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:03.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.552+0000 7f52c193a800 1 -- 172.21.15.170:0/814703705 shutdown_connections 2024-09-12T17:28:03.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.552+0000 7f52c193a800 1 -- 172.21.15.170:0/814703705 wait complete. 2024-09-12T17:28:03.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.565+0000 7f52c193a800 1 Processor -- start 2024-09-12T17:28:03.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.565+0000 7f52c193a800 1 -- start start 2024-09-12T17:28:03.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.565+0000 7f52c193a800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609c51f3df0 0x5609c52e3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.565+0000 7f52c193a800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5609c508ddd0 con 0x5609c51f3df0 2024-09-12T17:28:03.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.566+0000 7f52bd681640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609c51f3df0 0x5609c52e3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.566+0000 7f52bd681640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609c51f3df0 0x5609c52e3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:58072/0 (socket says 172.21.15.170:58072) 2024-09-12T17:28:03.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.566+0000 7f52bd681640 1 -- 172.21.15.170:0/3671261610 learned_addr learned my addr 172.21.15.170:0/3671261610 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:03.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.566+0000 7f52bd681640 1 -- 172.21.15.170:0/3671261610 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609c50a6e10 con 0x5609c51f3df0 2024-09-12T17:28:03.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.566+0000 7f52bd681640 1 --2- 172.21.15.170:0/3671261610 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609c51f3df0 0x5609c52e3580 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f52b0001e40 tx=0x7f52b0001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c8266945847075 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.566+0000 7f51ab606640 1 -- 172.21.15.170:0/3671261610 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52b000b200 con 0x5609c51f3df0 2024-09-12T17:28:03.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.566+0000 7f51ab606640 1 -- 172.21.15.170:0/3671261610 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52b0009460 con 0x5609c51f3df0 2024-09-12T17:28:03.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.566+0000 7f51ab606640 1 -- 172.21.15.170:0/3671261610 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52b0009760 con 0x5609c51f3df0 2024-09-12T17:28:03.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.567+0000 7f52c193a800 1 -- 172.21.15.170:0/3671261610 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609c51f3df0 msgr2=0x5609c52e3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.567+0000 7f52c193a800 1 --2- 172.21.15.170:0/3671261610 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609c51f3df0 0x5609c52e3580 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f52b0001e40 tx=0x7f52b0001e70 comp rx=0 tx=0).stop 2024-09-12T17:28:03.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.567+0000 7f52c193a800 1 -- 172.21.15.170:0/3671261610 shutdown_connections 2024-09-12T17:28:03.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.567+0000 7f52c193a800 1 --2- 172.21.15.170:0/3671261610 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609c51f3df0 0x5609c52e3580 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.567+0000 7f52c193a800 1 -- 172.21.15.170:0/3671261610 >> 172.21.15.170:0/3671261610 conn(0x5609c51ef1c0 msgr2=0x5609c52def00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:03.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.567+0000 7f52c193a800 1 -- 172.21.15.170:0/3671261610 shutdown_connections 2024-09-12T17:28:03.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.567+0000 7f52c193a800 1 -- 172.21.15.170:0/3671261610 wait complete. 2024-09-12T17:28:03.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.567+0000 7f52c193a800 1 Processor -- start 2024-09-12T17:28:03.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.568+0000 7f52c193a800 1 -- start start 2024-09-12T17:28:03.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.568+0000 7f52c193a800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609c51f3df0 0x5609c52ee240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.568+0000 7f52c193a800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5609c51f58f0 con 0x5609c51f3df0 2024-09-12T17:28:03.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.568+0000 7f52bd681640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609c51f3df0 0x5609c52ee240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.568+0000 7f52bd681640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609c51f3df0 0x5609c52ee240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:58074/0 (socket says 172.21.15.170:58074) 2024-09-12T17:28:03.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.568+0000 7f52bd681640 1 -- 172.21.15.170:0/2952033836 learned_addr learned my addr 172.21.15.170:0/2952033836 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:03.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.568+0000 7f52bd681640 1 -- 172.21.15.170:0/2952033836 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609c52ee7a0 con 0x5609c51f3df0 2024-09-12T17:28:03.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.568+0000 7f52bd681640 1 --2- 172.21.15.170:0/2952033836 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609c51f3df0 0x5609c52ee240 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f52b0000c00 tx=0x7f52b0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.569+0000 7f51a9e03640 1 -- 172.21.15.170:0/2952033836 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52b0025070 con 0x5609c51f3df0 2024-09-12T17:28:03.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.569+0000 7f51a9e03640 1 -- 172.21.15.170:0/2952033836 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52b0009b10 con 0x5609c51f3df0 2024-09-12T17:28:03.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.569+0000 7f51a9e03640 1 -- 172.21.15.170:0/2952033836 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52b001b040 con 0x5609c51f3df0 2024-09-12T17:28:03.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.569+0000 7f52c193a800 1 -- 172.21.15.170:0/2952033836 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5609c52eea30 con 0x5609c51f3df0 2024-09-12T17:28:03.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.569+0000 7f52c193a800 1 -- 172.21.15.170:0/2952033836 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609c52ef640 con 0x5609c51f3df0 2024-09-12T17:28:03.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.570+0000 7f51a9e03640 1 -- 172.21.15.170:0/2952033836 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f52b0016430 con 0x5609c51f3df0 2024-09-12T17:28:03.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.570+0000 7f51a9e03640 1 --2- 172.21.15.170:0/2952033836 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f51a403c730 0x7f51a403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.570+0000 7f51a9e03640 1 -- 172.21.15.170:0/2952033836 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f52b0011070 con 0x5609c51f3df0 2024-09-12T17:28:03.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.570+0000 7f52b7fff640 1 --2- 172.21.15.170:0/2952033836 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f51a403c730 0x7f51a403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.570+0000 7f52c193a800 1 --2- 172.21.15.170:0/2952033836 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5609c51f5200 0x5609c52f5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.570+0000 7f52c193a800 1 -- 172.21.15.170:0/2952033836 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5609c52f5dd0 con 0x5609c51f5200 2024-09-12T17:28:03.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.570+0000 7f52bde82640 1 --2- 172.21.15.170:0/2952033836 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5609c51f5200 0x5609c52f5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.570+0000 7f52b7fff640 1 --2- 172.21.15.170:0/2952033836 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f51a403c730 0x7f51a403ebf0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f52a8057000 tx=0x7f52a8052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.570+0000 7f52bde82640 1 --2- 172.21.15.170:0/2952033836 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5609c51f5200 0x5609c52f5890 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.571+0000 7f52bde82640 1 -- 172.21.15.170:0/2952033836 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f52b800a4d0 con 0x5609c51f5200 2024-09-12T17:28:03.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.571+0000 7f52c193a800 1 -- 172.21.15.170:0/2952033836 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5609c52f6170 con 0x5609c51f5200 2024-09-12T17:28:03.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.571+0000 7f52bde82640 1 -- 172.21.15.170:0/2952033836 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f52b800a4d0 con 0x5609c51f5200 2024-09-12T17:28:03.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.571+0000 7f52c193a800 1 --2- 172.21.15.170:0/2952033836 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5609c52f7cb0 0x5609c52fa120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.571+0000 7f52c193a800 1 -- 172.21.15.170:0/2952033836 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5609c52fa8b0 con 0x5609c52f7cb0 2024-09-12T17:28:03.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.571+0000 7f52bd681640 1 --2- 172.21.15.170:0/2952033836 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5609c52f7cb0 0x5609c52fa120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.571+0000 7f52bd681640 1 --2- 172.21.15.170:0/2952033836 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5609c52f7cb0 0x5609c52fa120 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.572+0000 7f52bd681640 1 -- 172.21.15.170:0/2952033836 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f52b0009040 con 0x5609c52f7cb0 2024-09-12T17:28:03.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.572+0000 7f52c193a800 1 -- 172.21.15.170:0/2952033836 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5609c52f69c0 con 0x5609c51f5200 2024-09-12T17:28:03.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.572+0000 7f52bde82640 1 -- 172.21.15.170:0/2952033836 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f52b800a4d0 con 0x5609c51f5200 2024-09-12T17:28:03.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.572+0000 7f52c193a800 1 -- 172.21.15.170:0/2952033836 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5609c52f6e20 con 0x5609c52f7cb0 2024-09-12T17:28:03.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.572+0000 7f52bd681640 1 -- 172.21.15.170:0/2952033836 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f52b0009040 con 0x5609c52f7cb0 2024-09-12T17:28:03.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.572+0000 7f52c193a800 1 Processor -- start 2024-09-12T17:28:03.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.573+0000 7f52c193a800 1 -- start start 2024-09-12T17:28:03.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.573+0000 7f52c193a800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609c5309140 0x5609c5309560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.573+0000 7f52c193a800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5609c50eba00 con 0x5609c5309140 2024-09-12T17:28:03.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.573+0000 7f52bde82640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609c5309140 0x5609c5309560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.573+0000 7f52bde82640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609c5309140 0x5609c5309560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:58084/0 (socket says 172.21.15.170:58084) 2024-09-12T17:28:03.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.573+0000 7f52bde82640 1 -- 172.21.15.170:0/3252587146 learned_addr learned my addr 172.21.15.170:0/3252587146 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:03.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.573+0000 7f52bde82640 1 -- 172.21.15.170:0/3252587146 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609c5309ba0 con 0x5609c5309140 2024-09-12T17:28:03.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.573+0000 7f52bde82640 1 --2- 172.21.15.170:0/3252587146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609c5309140 0x5609c5309560 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x5609c52ef0d0 tx=0x7f52b80167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.573+0000 7f51a2ffd640 1 -- 172.21.15.170:0/3252587146 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52b8013640 con 0x5609c5309140 2024-09-12T17:28:03.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.573+0000 7f51a2ffd640 1 -- 172.21.15.170:0/3252587146 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52b80137e0 con 0x5609c5309140 2024-09-12T17:28:03.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.573+0000 7f52c193a800 1 -- 172.21.15.170:0/3252587146 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5609c530a3d0 con 0x5609c5309140 2024-09-12T17:28:03.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.574+0000 7f51a2ffd640 1 -- 172.21.15.170:0/3252587146 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52b8013b00 con 0x5609c5309140 2024-09-12T17:28:03.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.574+0000 7f52c193a800 1 -- 172.21.15.170:0/3252587146 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609c530a970 con 0x5609c5309140 2024-09-12T17:28:03.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.574+0000 7f51a2ffd640 1 -- 172.21.15.170:0/3252587146 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f52b8011040 con 0x5609c5309140 2024-09-12T17:28:03.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.575+0000 7f51a2ffd640 1 --2- 172.21.15.170:0/3252587146 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f519803c730 0x7f519803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.575+0000 7f51a2ffd640 1 -- 172.21.15.170:0/3252587146 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f52b800e040 con 0x5609c5309140 2024-09-12T17:28:03.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.575+0000 7f52bd681640 1 --2- 172.21.15.170:0/3252587146 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f519803c730 0x7f519803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.575+0000 7f52c193a800 1 Processor -- start 2024-09-12T17:28:03.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.575+0000 7f52c193a800 1 -- start start 2024-09-12T17:28:03.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.575+0000 7f52bd681640 1 --2- 172.21.15.170:0/3252587146 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f519803c730 0x7f519803ebf0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x5609c52fac50 tx=0x7f52b0050ae0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.575+0000 7f52c193a800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609c5315c00 0x5609c5316000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.575+0000 7f52c193a800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5609c52e3dd0 con 0x5609c5315c00 2024-09-12T17:28:03.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.575+0000 7f52bde82640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609c5315c00 0x5609c5316000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.575+0000 7f52bde82640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609c5315c00 0x5609c5316000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:58094/0 (socket says 172.21.15.170:58094) 2024-09-12T17:28:03.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.575+0000 7f52bde82640 1 -- 172.21.15.170:0/2631190071 learned_addr learned my addr 172.21.15.170:0/2631190071 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:03.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.576+0000 7f52bde82640 1 -- 172.21.15.170:0/2631190071 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609c53165f0 con 0x5609c5315c00 2024-09-12T17:28:03.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.576+0000 7f52bde82640 1 --2- 172.21.15.170:0/2631190071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609c5315c00 0x5609c5316000 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f52b8020000 tx=0x7f52b8029450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d404fe5dd7a2a24 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.576+0000 7f51a0ff9640 1 -- 172.21.15.170:0/2631190071 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52b8051070 con 0x5609c5315c00 2024-09-12T17:28:03.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.576+0000 7f51a0ff9640 1 -- 172.21.15.170:0/2631190071 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52b8013dd0 con 0x5609c5315c00 2024-09-12T17:28:03.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.576+0000 7f51a0ff9640 1 -- 172.21.15.170:0/2631190071 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52b802a520 con 0x5609c5315c00 2024-09-12T17:28:03.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.576+0000 7f52c193a800 1 -- 172.21.15.170:0/2631190071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609c5315c00 msgr2=0x5609c5316000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.576+0000 7f52c193a800 1 --2- 172.21.15.170:0/2631190071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609c5315c00 0x5609c5316000 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f52b8020000 tx=0x7f52b8029450 comp rx=0 tx=0).stop 2024-09-12T17:28:03.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.576+0000 7f52c193a800 1 -- 172.21.15.170:0/2631190071 shutdown_connections 2024-09-12T17:28:03.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.576+0000 7f52c193a800 1 --2- 172.21.15.170:0/2631190071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609c5315c00 0x5609c5316000 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.576+0000 7f52c193a800 1 -- 172.21.15.170:0/2631190071 >> 172.21.15.170:0/2631190071 conn(0x5609c5312000 msgr2=0x5609c5310240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:03.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.576+0000 7f52c193a800 1 -- 172.21.15.170:0/2631190071 shutdown_connections 2024-09-12T17:28:03.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.576+0000 7f52c193a800 1 -- 172.21.15.170:0/2631190071 wait complete. 2024-09-12T17:28:03.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.577+0000 7f52c193a800 1 Processor -- start 2024-09-12T17:28:03.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.577+0000 7f52c193a800 1 -- start start 2024-09-12T17:28:03.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.577+0000 7f52c193a800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609c5315c00 0x5609c531d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.577+0000 7f52c193a800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5609c5316c10 con 0x5609c5315c00 2024-09-12T17:28:03.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.577+0000 7f52bde82640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609c5315c00 0x5609c531d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.577+0000 7f52bde82640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609c5315c00 0x5609c531d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:58098/0 (socket says 172.21.15.170:58098) 2024-09-12T17:28:03.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.577+0000 7f52bde82640 1 -- 172.21.15.170:0/3813614941 learned_addr learned my addr 172.21.15.170:0/3813614941 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:03.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.577+0000 7f52bde82640 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609c531d6b0 con 0x5609c5315c00 2024-09-12T17:28:03.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.577+0000 7f52bde82640 1 --2- 172.21.15.170:0/3813614941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609c5315c00 0x5609c531d150 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f52b8020000 tx=0x7f52b804e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.578+0000 7f518effd640 1 -- 172.21.15.170:0/3813614941 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52b8038070 con 0x5609c5315c00 2024-09-12T17:28:03.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.578+0000 7f518effd640 1 -- 172.21.15.170:0/3813614941 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52b801f550 con 0x5609c5315c00 2024-09-12T17:28:03.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.578+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5609c531d940 con 0x5609c5315c00 2024-09-12T17:28:03.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.578+0000 7f518effd640 1 -- 172.21.15.170:0/3813614941 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52b801f830 con 0x5609c5315c00 2024-09-12T17:28:03.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.578+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609c531e2c0 con 0x5609c5315c00 2024-09-12T17:28:03.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.579+0000 7f518effd640 1 -- 172.21.15.170:0/3813614941 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f52b803b070 con 0x5609c5315c00 2024-09-12T17:28:03.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.579+0000 7f518effd640 1 --2- 172.21.15.170:0/3813614941 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f518803c780 0x7f518803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.579+0000 7f518effd640 1 -- 172.21.15.170:0/3813614941 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f52b803eaf0 con 0x5609c5315c00 2024-09-12T17:28:03.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.579+0000 7f52bd681640 1 --2- 172.21.15.170:0/3813614941 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f518803c780 0x7f518803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.579+0000 7f52c193a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.579+0000 7f52c193a800 1 --2- 172.21.15.170:0/3813614941 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5609c5328ae0 0x5609c532af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.579+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5609c532b6a0 con 0x5609c5328ae0 2024-09-12T17:28:03.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.579+0000 7f52b7fff640 1 --2- 172.21.15.170:0/3813614941 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5609c5328ae0 0x5609c532af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.579+0000 7f52bd681640 1 --2- 172.21.15.170:0/3813614941 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f518803c780 0x7f518803ec40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f52b0013fd0 tx=0x7f52b0045000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.580+0000 7f52b7fff640 1 --2- 172.21.15.170:0/3813614941 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5609c5328ae0 0x5609c532af50 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.580+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f52a8051070 con 0x5609c5328ae0 2024-09-12T17:28:03.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.580+0000 7f52c193a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.580+0000 7f52c193a800 20 realm 2024-09-12T17:28:03.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.580+0000 7f52c193a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.580+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5609c532bad0 con 0x5609c5328ae0 2024-09-12T17:28:03.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.580+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f52a8051070 con 0x5609c5328ae0 2024-09-12T17:28:03.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.580+0000 7f52c193a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.580+0000 7f52c193a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:03.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.580+0000 7f52c193a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.580+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5609c532c3a0 con 0x5609c5328ae0 2024-09-12T17:28:03.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.580+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f52a8051070 con 0x5609c5328ae0 2024-09-12T17:28:03.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.580+0000 7f52c193a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.580+0000 7f52c193a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.580+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5609c532c740 con 0x5609c5328ae0 2024-09-12T17:28:03.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.580+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f52a8051070 con 0x5609c5328ae0 2024-09-12T17:28:03.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.580+0000 7f52c193a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:03.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.580+0000 7f52c193a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.580+0000 7f52c193a800 1 --2- 172.21.15.170:0/3813614941 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5609c532d4a0 0x5609c532f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.580+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5609c532fdd0 con 0x5609c532d4a0 2024-09-12T17:28:03.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.581+0000 7f52bde82640 1 --2- 172.21.15.170:0/3813614941 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5609c532d4a0 0x5609c532f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.581+0000 7f52bde82640 1 --2- 172.21.15.170:0/3813614941 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5609c532d4a0 0x5609c532f890 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.581+0000 7f52bde82640 1 -- 172.21.15.170:0/3813614941 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f52b803a030 con 0x5609c532d4a0 2024-09-12T17:28:03.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.581+0000 7f52c193a800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:03.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.581+0000 7f52c193a800 20 searching for the correct realm 2024-09-12T17:28:03.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.581+0000 7f52c193a800 1 --2- 172.21.15.170:0/3813614941 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5609c5331e10 0x5609c53342d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.581+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5609c53349a0 con 0x5609c5331e10 2024-09-12T17:28:03.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.581+0000 7f52bd681640 1 --2- 172.21.15.170:0/3813614941 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5609c5331e10 0x5609c53342d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.582+0000 7f52bd681640 1 --2- 172.21.15.170:0/3813614941 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5609c5331e10 0x5609c53342d0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.582+0000 7f52bd681640 1 -- 172.21.15.170:0/3813614941 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b0009040 con 0x5609c5331e10 2024-09-12T17:28:03.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.582+0000 7f52bd681640 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5609c53349a0 con 0x5609c532d4a0 2024-09-12T17:28:03.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.582+0000 7f52bde82640 1 -- 172.21.15.170:0/3813614941 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b803a030 con 0x5609c532d4a0 2024-09-12T17:28:03.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.582+0000 7f52bde82640 1 --2- 172.21.15.170:0/3813614941 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f52b803d060 0x7f52b801c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.582+0000 7f52bde82640 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5609c53349a0 con 0x7f52b803d060 2024-09-12T17:28:03.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.582+0000 7f52b7fff640 1 --2- 172.21.15.170:0/3813614941 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f52b803d060 0x7f52b801c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.583+0000 7f52b7fff640 1 --2- 172.21.15.170:0/3813614941 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f52b803d060 0x7f52b801c5f0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.583+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52a8051070 con 0x7f52b803d060 2024-09-12T17:28:03.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.583+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5609c53349a0 con 0x5609c5328ae0 2024-09-12T17:28:03.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.583+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52a8051070 con 0x5609c5328ae0 2024-09-12T17:28:03.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.583+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5609c53349a0 con 0x5609c5328ae0 2024-09-12T17:28:03.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.584+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52a8051070 con 0x5609c5328ae0 2024-09-12T17:28:03.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.584+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5609c53349a0 con 0x7f52b803d060 2024-09-12T17:28:03.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.584+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52a8051070 con 0x7f52b803d060 2024-09-12T17:28:03.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.584+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5609c53349a0 con 0x7f52b803d060 2024-09-12T17:28:03.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.584+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52a8051070 con 0x7f52b803d060 2024-09-12T17:28:03.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.584+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5609c53349a0 con 0x5609c532d4a0 2024-09-12T17:28:03.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.584+0000 7f52bde82640 1 -- 172.21.15.170:0/3813614941 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b803a030 con 0x5609c532d4a0 2024-09-12T17:28:03.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.584+0000 7f52bde82640 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5609c53349a0 con 0x5609c5331e10 2024-09-12T17:28:03.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.584+0000 7f52bd681640 1 -- 172.21.15.170:0/3813614941 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b0009040 con 0x5609c5331e10 2024-09-12T17:28:03.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.584+0000 7f52bd681640 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5609c53349a0 con 0x5609c5328ae0 2024-09-12T17:28:03.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.585+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52a8051070 con 0x5609c5328ae0 2024-09-12T17:28:03.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.585+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5609c53349a0 con 0x7f52b803d060 2024-09-12T17:28:03.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.585+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52a8051070 con 0x7f52b803d060 2024-09-12T17:28:03.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.585+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5609c53349a0 con 0x5609c5328ae0 2024-09-12T17:28:03.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.585+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52a8051070 con 0x5609c5328ae0 2024-09-12T17:28:03.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.585+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5609c53349a0 con 0x5609c532d4a0 2024-09-12T17:28:03.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.585+0000 7f52bde82640 1 -- 172.21.15.170:0/3813614941 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f52b803a030 con 0x5609c532d4a0 2024-09-12T17:28:03.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.585+0000 7f52bde82640 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5609c53349a0 con 0x5609c5331e10 2024-09-12T17:28:03.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.586+0000 7f52bd681640 1 -- 172.21.15.170:0/3813614941 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b0009040 con 0x5609c5331e10 2024-09-12T17:28:03.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.586+0000 7f52bd681640 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5609c53349a0 con 0x5609c5331e10 2024-09-12T17:28:03.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.586+0000 7f52bd681640 1 -- 172.21.15.170:0/3813614941 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b0009040 con 0x5609c5331e10 2024-09-12T17:28:03.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.586+0000 7f52bd681640 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5609c53349a0 con 0x7f52b803d060 2024-09-12T17:28:03.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.586+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52a8051070 con 0x7f52b803d060 2024-09-12T17:28:03.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.586+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5609c53349a0 con 0x5609c5331e10 2024-09-12T17:28:03.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.586+0000 7f52bd681640 1 -- 172.21.15.170:0/3813614941 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b0009040 con 0x5609c5331e10 2024-09-12T17:28:03.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.586+0000 7f52bd681640 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5609c53349a0 con 0x5609c5331e10 2024-09-12T17:28:03.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.587+0000 7f52bd681640 1 -- 172.21.15.170:0/3813614941 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b0009040 con 0x5609c5331e10 2024-09-12T17:28:03.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.587+0000 7f52bd681640 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5609c53349a0 con 0x5609c5328ae0 2024-09-12T17:28:03.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.587+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52a8051070 con 0x5609c5328ae0 2024-09-12T17:28:03.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.587+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5609c53349a0 con 0x5609c5328ae0 2024-09-12T17:28:03.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.587+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f52a8051070 con 0x5609c5328ae0 2024-09-12T17:28:03.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.587+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5609c53349a0 con 0x7f52b803d060 2024-09-12T17:28:03.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.587+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52a8051070 con 0x7f52b803d060 2024-09-12T17:28:03.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.587+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5609c53349a0 con 0x5609c5331e10 2024-09-12T17:28:03.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.588+0000 7f52bd681640 1 -- 172.21.15.170:0/3813614941 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b0009040 con 0x5609c5331e10 2024-09-12T17:28:03.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.588+0000 7f52bd681640 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5609c53349a0 con 0x5609c532d4a0 2024-09-12T17:28:03.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.588+0000 7f52bde82640 1 -- 172.21.15.170:0/3813614941 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b803a030 con 0x5609c532d4a0 2024-09-12T17:28:03.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.588+0000 7f52bde82640 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5609c53349a0 con 0x5609c5328ae0 2024-09-12T17:28:03.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.588+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52a8051070 con 0x5609c5328ae0 2024-09-12T17:28:03.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.588+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5609c53349a0 con 0x7f52b803d060 2024-09-12T17:28:03.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.588+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52a8051070 con 0x7f52b803d060 2024-09-12T17:28:03.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.588+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5609c53349a0 con 0x5609c5331e10 2024-09-12T17:28:03.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.589+0000 7f52bd681640 1 -- 172.21.15.170:0/3813614941 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b0009040 con 0x5609c5331e10 2024-09-12T17:28:03.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.589+0000 7f52bd681640 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5609c53349a0 con 0x7f52b803d060 2024-09-12T17:28:03.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.589+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52a8051070 con 0x7f52b803d060 2024-09-12T17:28:03.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.589+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5609c53349a0 con 0x5609c532d4a0 2024-09-12T17:28:03.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.589+0000 7f52bde82640 1 -- 172.21.15.170:0/3813614941 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b803a030 con 0x5609c532d4a0 2024-09-12T17:28:03.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.589+0000 7f52bde82640 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5609c53349a0 con 0x5609c5331e10 2024-09-12T17:28:03.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.589+0000 7f52bd681640 1 -- 172.21.15.170:0/3813614941 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52b0009040 con 0x5609c5331e10 2024-09-12T17:28:03.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.589+0000 7f52bd681640 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5609c53349a0 con 0x7f52b803d060 2024-09-12T17:28:03.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.590+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52a8051070 con 0x7f52b803d060 2024-09-12T17:28:03.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.590+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5609c53349a0 con 0x5609c5328ae0 2024-09-12T17:28:03.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.590+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f52a8051070 con 0x5609c5328ae0 2024-09-12T17:28:03.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.590+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5609c53349a0 con 0x5609c532d4a0 2024-09-12T17:28:03.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.591+0000 7f52bde82640 1 -- 172.21.15.170:0/3813614941 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f52b803a030 con 0x5609c532d4a0 2024-09-12T17:28:03.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.591+0000 7f52c193a800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:03.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.591+0000 7f52c193a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:03.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.591+0000 7f52c193a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:03.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.591+0000 7f52c193a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:03.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.591+0000 7f52c193a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:03.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.591+0000 7f52c193a800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:03.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.591+0000 7f52c193a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.591+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5609c5330840 con 0x5609c5328ae0 2024-09-12T17:28:03.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.591+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f52a8051070 con 0x5609c5328ae0 2024-09-12T17:28:03.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.591+0000 7f52c193a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.591+0000 7f52c193a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.591+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5609c5330420 con 0x5609c5328ae0 2024-09-12T17:28:03.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.591+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f52a8051070 con 0x5609c5328ae0 2024-09-12T17:28:03.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.591+0000 7f52c193a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:03.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.591+0000 7f52c193a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.591+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5609c5331160 con 0x5609c532d4a0 2024-09-12T17:28:03.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.591+0000 7f52bde82640 1 -- 172.21.15.170:0/3813614941 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f52b803a030 con 0x5609c532d4a0 2024-09-12T17:28:03.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.591+0000 7f52c193a800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:03.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.591+0000 7f52c193a800 20 zone default found 2024-09-12T17:28:03.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.591+0000 7f52c193a800 4 Realm: () 2024-09-12T17:28:03.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.591+0000 7f52c193a800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:03.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.591+0000 7f52c193a800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:03.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.591+0000 7f52c193a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:03.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.591+0000 7f52c193a800 20 zonegroup default 2024-09-12T17:28:03.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.591+0000 7f52c193a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.591+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5609c53352d0 con 0x7f52b803d060 2024-09-12T17:28:03.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.592+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f52a8051070 con 0x7f52b803d060 2024-09-12T17:28:03.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.592+0000 7f52c193a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.592+0000 7f52c193a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.592+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5609c5337160 con 0x5609c5331e10 2024-09-12T17:28:03.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.592+0000 7f52bd681640 1 -- 172.21.15.170:0/3813614941 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f52b0009040 con 0x5609c5331e10 2024-09-12T17:28:03.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.592+0000 7f52c193a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.592+0000 7f52c193a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.592+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5609c53375a0 con 0x5609c5331e10 2024-09-12T17:28:03.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.592+0000 7f52bd681640 1 -- 172.21.15.170:0/3813614941 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f52b0009040 con 0x5609c5331e10 2024-09-12T17:28:03.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.592+0000 7f52c193a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.592+0000 7f52c193a800 20 started sync module instance, tier type = 2024-09-12T17:28:03.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.592+0000 7f52c193a800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:03.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.592+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5609c5336500 con 0x5609c532d4a0 2024-09-12T17:28:03.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.593+0000 7f52bde82640 1 -- 172.21.15.170:0/3813614941 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52b803a030 con 0x5609c532d4a0 2024-09-12T17:28:03.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.593+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94599963175152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5609c5336160 con 0x5609c532d4a0 2024-09-12T17:28:03.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.594+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5609c53384d0 con 0x5609c5328ae0 2024-09-12T17:28:03.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.594+0000 7f52bde82640 1 -- 172.21.15.170:0/3813614941 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94599963175152] v29'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52b803a030 con 0x5609c532d4a0 2024-09-12T17:28:03.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.595+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52a8051070 con 0x5609c5328ae0 2024-09-12T17:28:03.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.595+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94599963179520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5609c53384d0 con 0x5609c5328ae0 2024-09-12T17:28:03.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.595+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5609c5338f10 con 0x5609c5331e10 2024-09-12T17:28:03.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.596+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94599963179520] v29'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52a8051070 con 0x5609c5328ae0 2024-09-12T17:28:03.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.596+0000 7f52bd681640 1 -- 172.21.15.170:0/3813614941 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52b0009040 con 0x5609c5331e10 2024-09-12T17:28:03.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.596+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94599963181088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5609c5338440 con 0x5609c5331e10 2024-09-12T17:28:03.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.596+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5609c5339dd0 con 0x5609c532d4a0 2024-09-12T17:28:03.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.597+0000 7f52bd681640 1 -- 172.21.15.170:0/3813614941 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94599963181088] v29'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52b0009040 con 0x5609c5331e10 2024-09-12T17:28:03.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.597+0000 7f52bde82640 1 -- 172.21.15.170:0/3813614941 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52b803a030 con 0x5609c532d4a0 2024-09-12T17:28:03.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.597+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94599963187488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5609c5339d40 con 0x5609c532d4a0 2024-09-12T17:28:03.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.597+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5609c533ac90 con 0x5609c5328ae0 2024-09-12T17:28:03.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.598+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52a8051070 con 0x5609c5328ae0 2024-09-12T17:28:03.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.598+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94599963191264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5609c533b0b0 con 0x5609c5328ae0 2024-09-12T17:28:03.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.598+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5609c533b740 con 0x7f52b803d060 2024-09-12T17:28:03.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.598+0000 7f52bde82640 1 -- 172.21.15.170:0/3813614941 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94599963187488] v29'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52b803a030 con 0x5609c532d4a0 2024-09-12T17:28:03.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.599+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94599963191264] v29'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52a8051070 con 0x5609c5328ae0 2024-09-12T17:28:03.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.599+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52a8051070 con 0x7f52b803d060 2024-09-12T17:28:03.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.599+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94599963192320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5609c533b250 con 0x7f52b803d060 2024-09-12T17:28:03.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.599+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5609c533c050 con 0x7f52b803d060 2024-09-12T17:28:03.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.600+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94599963192320] v29'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52a8051070 con 0x7f52b803d060 2024-09-12T17:28:03.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.600+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(56 notify.6 [create] v29'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52a8051070 con 0x7f52b803d060 2024-09-12T17:28:03.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.600+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94599963189696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5609c533c010 con 0x7f52b803d060 2024-09-12T17:28:03.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.600+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5609c533ca10 con 0x7f52b803d060 2024-09-12T17:28:03.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.601+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94599963189696] v29'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52a8051070 con 0x7f52b803d060 2024-09-12T17:28:03.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.601+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(58 notify.7 [create] v29'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52a8051070 con 0x7f52b803d060 2024-09-12T17:28:03.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.601+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94599963198752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5609c533cbf0 con 0x7f52b803d060 2024-09-12T17:28:03.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.601+0000 7f52c193a800 20 add_watcher() i=0 2024-09-12T17:28:03.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.601+0000 7f52c193a800 20 add_watcher() i=1 2024-09-12T17:28:03.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.601+0000 7f52c193a800 20 add_watcher() i=2 2024-09-12T17:28:03.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.601+0000 7f52c193a800 20 add_watcher() i=3 2024-09-12T17:28:03.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.601+0000 7f52c193a800 20 add_watcher() i=4 2024-09-12T17:28:03.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.601+0000 7f52c193a800 20 add_watcher() i=5 2024-09-12T17:28:03.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.601+0000 7f52c193a800 20 add_watcher() i=6 2024-09-12T17:28:03.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.602+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94599963198752] v29'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52a8051070 con 0x7f52b803d060 2024-09-12T17:28:03.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.602+0000 7f52c193a800 20 add_watcher() i=7 2024-09-12T17:28:03.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.602+0000 7f52c193a800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:03.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.602+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5609c533ffc0 con 0x5609c5328ae0 2024-09-12T17:28:03.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.603+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f52a8051070 con 0x5609c5328ae0 2024-09-12T17:28:03.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.603+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94599963200224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5609c533d3b0 con 0x5609c5328ae0 2024-09-12T17:28:03.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.603+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94599963200224] v29'108 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f52a8051070 con 0x5609c5328ae0 2024-09-12T17:28:03.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.604+0000 7f5173fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:03.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.604+0000 7f52c193a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:03.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.604+0000 7f52c193a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:03.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.604+0000 7f52c193a800 5 note: GC not initialized 2024-09-12T17:28:03.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.604+0000 7f5172fe5640 20 reqs_thread_entry: start 2024-09-12T17:28:03.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.604+0000 7f52c193a800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:03.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.604+0000 7f52c193a800 20 Filter name: none 2024-09-12T17:28:03.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.604+0000 7f5170fe1640 20 reqs_thread_entry: start 2024-09-12T17:28:03.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.604+0000 7f52c193a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.604+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5609c5372950 con 0x5609c532d4a0 2024-09-12T17:28:03.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.605+0000 7f52bde82640 1 -- 172.21.15.170:0/3813614941 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) ==== 275+0+304 (crc 0 0 0) 0x7f52b803a030 con 0x5609c532d4a0 2024-09-12T17:28:03.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.605+0000 7f52c193a800 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T17:28:03.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.605+0000 7f5173fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:03.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.605+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94599963200224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5609c533d7a0 con 0x5609c5328ae0 2024-09-12T17:28:03.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.606+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94599963200224] v29'109 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f52a8051070 con 0x5609c5328ae0 2024-09-12T17:28:03.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.606+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94599963175152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5609c53708c0 con 0x5609c532d4a0 2024-09-12T17:28:03.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.607+0000 7f52bde82640 1 -- 172.21.15.170:0/3813614941 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94599963175152] v29'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52b803a030 con 0x5609c532d4a0 2024-09-12T17:28:03.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.607+0000 7f52c193a800 20 remove_watcher() i=0 2024-09-12T17:28:03.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.607+0000 7f52c193a800 2 removed watcher, disabling cache 2024-09-12T17:28:03.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.607+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94599963179520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5609c53708c0 con 0x5609c5328ae0 2024-09-12T17:28:03.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.608+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94599963179520] v29'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52a8051070 con 0x5609c5328ae0 2024-09-12T17:28:03.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.608+0000 7f52c193a800 20 remove_watcher() i=1 2024-09-12T17:28:03.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.608+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94599963181088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5609c53708c0 con 0x5609c5331e10 2024-09-12T17:28:03.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.610+0000 7f52bd681640 1 -- 172.21.15.170:0/3813614941 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94599963181088] v29'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52b0009040 con 0x5609c5331e10 2024-09-12T17:28:03.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.610+0000 7f52c193a800 20 remove_watcher() i=2 2024-09-12T17:28:03.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.610+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94599963187488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5609c53708c0 con 0x5609c532d4a0 2024-09-12T17:28:03.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.611+0000 7f52bde82640 1 -- 172.21.15.170:0/3813614941 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94599963187488] v29'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52b803a030 con 0x5609c532d4a0 2024-09-12T17:28:03.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.611+0000 7f52c193a800 20 remove_watcher() i=3 2024-09-12T17:28:03.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.611+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94599963191264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5609c53708c0 con 0x5609c5328ae0 2024-09-12T17:28:03.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.612+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94599963191264] v29'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52a8051070 con 0x5609c5328ae0 2024-09-12T17:28:03.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.612+0000 7f52c193a800 20 remove_watcher() i=4 2024-09-12T17:28:03.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.612+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94599963192320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5609c53708c0 con 0x7f52b803d060 2024-09-12T17:28:03.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.613+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94599963192320] v29'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52a8051070 con 0x7f52b803d060 2024-09-12T17:28:03.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.613+0000 7f52c193a800 20 remove_watcher() i=5 2024-09-12T17:28:03.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.613+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94599963189696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5609c53708c0 con 0x7f52b803d060 2024-09-12T17:28:03.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.614+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94599963189696] v29'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52a8051070 con 0x7f52b803d060 2024-09-12T17:28:03.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.614+0000 7f52c193a800 20 remove_watcher() i=6 2024-09-12T17:28:03.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.614+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94599963198752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5609c53708c0 con 0x7f52b803d060 2024-09-12T17:28:03.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.615+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94599963198752] v29'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52a8051070 con 0x7f52b803d060 2024-09-12T17:28:03.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.615+0000 7f52c193a800 20 remove_watcher() i=7 2024-09-12T17:28:03.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.615+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f52b803d060 msgr2=0x7f52b801c5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.615+0000 7f52c193a800 1 --2- 172.21.15.170:0/3813614941 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f52b803d060 0x7f52b801c5f0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.615+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5609c5328ae0 msgr2=0x5609c532af50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.615+0000 7f52c193a800 1 --2- 172.21.15.170:0/3813614941 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5609c5328ae0 0x5609c532af50 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.615+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5609c532d4a0 msgr2=0x5609c532f890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.615+0000 7f52c193a800 1 --2- 172.21.15.170:0/3813614941 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5609c532d4a0 0x5609c532f890 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.615+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5609c5331e10 msgr2=0x5609c53342d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.615+0000 7f52c193a800 1 --2- 172.21.15.170:0/3813614941 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5609c5331e10 0x5609c53342d0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.615+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f518803c780 msgr2=0x7f518803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.615+0000 7f52c193a800 1 --2- 172.21.15.170:0/3813614941 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f518803c780 0x7f518803ec40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f52b0013fd0 tx=0x7f52b0045000 comp rx=0 tx=0).stop 2024-09-12T17:28:03.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.615+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609c5315c00 msgr2=0x5609c531d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.615+0000 7f52c193a800 1 --2- 172.21.15.170:0/3813614941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609c5315c00 0x5609c531d150 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f52b8020000 tx=0x7f52b804e000 comp rx=0 tx=0).stop 2024-09-12T17:28:03.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.615+0000 7f52b7fff640 1 -- 172.21.15.170:0/3813614941 reap_dead start 2024-09-12T17:28:03.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.615+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 shutdown_connections 2024-09-12T17:28:03.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.615+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 >> 172.21.15.170:0/3813614941 conn(0x5609c5312000 msgr2=0x5609c5310210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:03.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.615+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 shutdown_connections 2024-09-12T17:28:03.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.615+0000 7f52c193a800 1 -- 172.21.15.170:0/3813614941 wait complete. 2024-09-12T17:28:03.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.616+0000 7f52c193a800 1 -- 172.21.15.170:0/3252587146 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f519803c730 msgr2=0x7f519803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.616+0000 7f52c193a800 1 --2- 172.21.15.170:0/3252587146 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f519803c730 0x7f519803ebf0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x5609c52fac50 tx=0x7f52b0050ae0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.616+0000 7f52c193a800 1 -- 172.21.15.170:0/3252587146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609c5309140 msgr2=0x5609c5309560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.616+0000 7f52c193a800 1 --2- 172.21.15.170:0/3252587146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609c5309140 0x5609c5309560 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x5609c52ef0d0 tx=0x7f52b80167b0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.616+0000 7f52c193a800 1 -- 172.21.15.170:0/3252587146 shutdown_connections 2024-09-12T17:28:03.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.616+0000 7f52c193a800 1 --2- 172.21.15.170:0/3252587146 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f519803c730 0x7f519803ebf0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.616+0000 7f52c193a800 1 --2- 172.21.15.170:0/3252587146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609c5309140 0x5609c5309560 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.616+0000 7f52c193a800 1 -- 172.21.15.170:0/3252587146 >> 172.21.15.170:0/3252587146 conn(0x5609c52fd4f0 msgr2=0x5609c52fd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:03.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.616+0000 7f52c193a800 1 -- 172.21.15.170:0/3252587146 shutdown_connections 2024-09-12T17:28:03.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.616+0000 7f52c193a800 1 -- 172.21.15.170:0/3252587146 wait complete. 2024-09-12T17:28:03.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.616+0000 7f52c193a800 1 -- 172.21.15.170:0/2952033836 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5609c51f5200 msgr2=0x5609c52f5890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.616+0000 7f52c193a800 1 --2- 172.21.15.170:0/2952033836 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5609c51f5200 0x5609c52f5890 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.616+0000 7f52c193a800 1 -- 172.21.15.170:0/2952033836 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5609c52f7cb0 msgr2=0x5609c52fa120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.616+0000 7f52c193a800 1 --2- 172.21.15.170:0/2952033836 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5609c52f7cb0 0x5609c52fa120 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.616+0000 7f52c193a800 1 -- 172.21.15.170:0/2952033836 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f51a403c730 msgr2=0x7f51a403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.616+0000 7f52c193a800 1 --2- 172.21.15.170:0/2952033836 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f51a403c730 0x7f51a403ebf0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f52a8057000 tx=0x7f52a8052000 comp rx=0 tx=0).stop 2024-09-12T17:28:03.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.616+0000 7f52c193a800 1 -- 172.21.15.170:0/2952033836 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609c51f3df0 msgr2=0x5609c52ee240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.616+0000 7f52c193a800 1 --2- 172.21.15.170:0/2952033836 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609c51f3df0 0x5609c52ee240 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f52b0000c00 tx=0x7f52b0000ed0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.616+0000 7f52c193a800 1 -- 172.21.15.170:0/2952033836 shutdown_connections 2024-09-12T17:28:03.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.616+0000 7f52c193a800 1 --2- 172.21.15.170:0/2952033836 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5609c52f7cb0 0x5609c52fa120 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.616+0000 7f52c193a800 1 --2- 172.21.15.170:0/2952033836 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f51a403c730 0x7f51a403ebf0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.616+0000 7f52c193a800 1 --2- 172.21.15.170:0/2952033836 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5609c51f5200 0x5609c52f5890 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.616+0000 7f52c193a800 1 --2- 172.21.15.170:0/2952033836 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5609c51f3df0 0x5609c52ee240 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.616+0000 7f52c193a800 1 -- 172.21.15.170:0/2952033836 >> 172.21.15.170:0/2952033836 conn(0x5609c51ef1c0 msgr2=0x5609c52e4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:03.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.616+0000 7f52c193a800 1 -- 172.21.15.170:0/2952033836 shutdown_connections 2024-09-12T17:28:03.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.616+0000 7f52c193a800 1 -- 172.21.15.170:0/2952033836 wait complete. 2024-09-12T17:28:03.628 INFO:teuthology.orchestra.run.smithi170.stdout:{"key":"bucket:myfoo","ver":{"tag":"_kxjk_ls9KB0i57Yp1e8xyMh","ver":2},"mtime":"2024-09-12T17:28:03.328360Z","data":{"bucket":{"name":"myfoo","marker":"7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1","bucket_id":"7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-09-12T17:28:02.189371Z","linked":false,"has_bucket_info":false}} 2024-09-12T17:28:03.628 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_kxjk_ls9KB0i57Yp1e8xyMh', 'ver': 2}, 'mtime': '2024-09-12T17:28:03.328360Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1', 'bucket_id': '7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-09-12T17:28:02.189371Z', 'linked': False, 'has_bucket_info': False}} 2024-09-12T17:28:03.629 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1'] 2024-09-12T17:28:03.629 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1'] 2024-09-12T17:28:03.629 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 2024-09-12T17:28:03.718 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:03.718 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:03.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.717+0000 7f389dd33800 1 Processor -- start 2024-09-12T17:28:03.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.717+0000 7f389dd33800 1 -- start start 2024-09-12T17:28:03.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.717+0000 7f389dd33800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55efcff9b230 0x55efcff9d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.717+0000 7f389dd33800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55efcfe40e40 con 0x55efcff97720 2024-09-12T17:28:03.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.717+0000 7f389dd33800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x55efcfe0b680 con 0x55efcff9b230 2024-09-12T17:28:03.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.717+0000 7f3899275640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55efcff9b230 0x55efcff9d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.717+0000 7f3899275640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55efcff9b230 0x55efcff9d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:58114/0 (socket says 172.21.15.170:58114) 2024-09-12T17:28:03.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.717+0000 7f3899275640 1 -- 172.21.15.170:0/2233617659 learned_addr learned my addr 172.21.15.170:0/2233617659 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:03.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.717+0000 7f3899a76640 1 --1- 172.21.15.170:0/2233617659 >> v1:172.21.15.47:6789/0 conn(0x55efcff97720 0x55efcff99b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:48486/0 (socket says 172.21.15.170:48486) 2024-09-12T17:28:03.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.718+0000 7f3899275640 1 -- 172.21.15.170:0/2233617659 >> v1:172.21.15.47:6789/0 conn(0x55efcff97720 legacy=0x55efcff99b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.718+0000 7f3899275640 1 -- 172.21.15.170:0/2233617659 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efcfe276b0 con 0x55efcff9b230 2024-09-12T17:28:03.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.719+0000 7f3899275640 1 --2- 172.21.15.170:0/2233617659 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efcff9b230 0x55efcff9d6d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f389000a520 tx=0x7f3890045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b619d9225d983374 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.719+0000 7f3898a74640 1 -- 172.21.15.170:0/2233617659 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3890055070 con 0x55efcff9b230 2024-09-12T17:28:03.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.720+0000 7f3898a74640 1 -- 172.21.15.170:0/2233617659 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38900515b0 con 0x55efcff9b230 2024-09-12T17:28:03.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.720+0000 7f3898a74640 1 -- 172.21.15.170:0/2233617659 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38900518d0 con 0x55efcff9b230 2024-09-12T17:28:03.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.720+0000 7f389dd33800 1 -- 172.21.15.170:0/2233617659 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efcff9b230 msgr2=0x55efcff9d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.720+0000 7f389dd33800 1 --2- 172.21.15.170:0/2233617659 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efcff9b230 0x55efcff9d6d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f389000a520 tx=0x7f3890045ba0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.720+0000 7f389dd33800 1 -- 172.21.15.170:0/2233617659 shutdown_connections 2024-09-12T17:28:03.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.720+0000 7f389dd33800 1 --2- 172.21.15.170:0/2233617659 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efcff9b230 0x55efcff9d6d0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.720+0000 7f389dd33800 1 -- 172.21.15.170:0/2233617659 >> 172.21.15.170:0/2233617659 conn(0x55efcff911e0 msgr2=0x55efcff93640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:03.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.720+0000 7f389dd33800 1 -- 172.21.15.170:0/2233617659 shutdown_connections 2024-09-12T17:28:03.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.720+0000 7f389dd33800 1 -- 172.21.15.170:0/2233617659 wait complete. 2024-09-12T17:28:03.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.734+0000 7f389dd33800 1 Processor -- start 2024-09-12T17:28:03.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.734+0000 7f389dd33800 1 -- start start 2024-09-12T17:28:03.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.734+0000 7f389dd33800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efcff97720 0x55efcff96e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.734+0000 7f389dd33800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55efcfe2fdd0 con 0x55efcff97720 2024-09-12T17:28:03.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.734+0000 7f3899a76640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efcff97720 0x55efcff96e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.735+0000 7f3899a76640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efcff97720 0x55efcff96e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:58118/0 (socket says 172.21.15.170:58118) 2024-09-12T17:28:03.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.735+0000 7f3899a76640 1 -- 172.21.15.170:0/2776254539 learned_addr learned my addr 172.21.15.170:0/2776254539 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:03.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.735+0000 7f3899a76640 1 -- 172.21.15.170:0/2776254539 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efcfe48e10 con 0x55efcff97720 2024-09-12T17:28:03.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.735+0000 7f3899a76640 1 --2- 172.21.15.170:0/2776254539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efcff97720 0x55efcff96e70 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f388c00b260 tx=0x7f388c00b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a91dccb322706c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.735+0000 7f3787e07640 1 -- 172.21.15.170:0/2776254539 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f388c00be60 con 0x55efcff97720 2024-09-12T17:28:03.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.735+0000 7f3787e07640 1 -- 172.21.15.170:0/2776254539 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f388c006070 con 0x55efcff97720 2024-09-12T17:28:03.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.735+0000 7f3787e07640 1 -- 172.21.15.170:0/2776254539 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f388c00e710 con 0x55efcff97720 2024-09-12T17:28:03.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.736+0000 7f389dd33800 1 -- 172.21.15.170:0/2776254539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efcff97720 msgr2=0x55efcff96e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.736+0000 7f389dd33800 1 --2- 172.21.15.170:0/2776254539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efcff97720 0x55efcff96e70 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f388c00b260 tx=0x7f388c00b660 comp rx=0 tx=0).stop 2024-09-12T17:28:03.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.736+0000 7f389dd33800 1 -- 172.21.15.170:0/2776254539 shutdown_connections 2024-09-12T17:28:03.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.736+0000 7f389dd33800 1 --2- 172.21.15.170:0/2776254539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efcff97720 0x55efcff96e70 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.736+0000 7f389dd33800 1 -- 172.21.15.170:0/2776254539 >> 172.21.15.170:0/2776254539 conn(0x55efcff911e0 msgr2=0x55efd00820d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:03.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.736+0000 7f389dd33800 1 -- 172.21.15.170:0/2776254539 shutdown_connections 2024-09-12T17:28:03.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.736+0000 7f389dd33800 1 -- 172.21.15.170:0/2776254539 wait complete. 2024-09-12T17:28:03.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.736+0000 7f389dd33800 1 Processor -- start 2024-09-12T17:28:03.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.736+0000 7f389dd33800 1 -- start start 2024-09-12T17:28:03.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.736+0000 7f389dd33800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efcff97720 0x55efd00902d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.736+0000 7f389dd33800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55efcff9e050 con 0x55efcff97720 2024-09-12T17:28:03.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.737+0000 7f3899a76640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efcff97720 0x55efd00902d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.737+0000 7f3899a76640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efcff97720 0x55efd00902d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:58132/0 (socket says 172.21.15.170:58132) 2024-09-12T17:28:03.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.737+0000 7f3899a76640 1 -- 172.21.15.170:0/4038268321 learned_addr learned my addr 172.21.15.170:0/4038268321 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:03.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.737+0000 7f3899a76640 1 -- 172.21.15.170:0/4038268321 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efd0090830 con 0x55efcff97720 2024-09-12T17:28:03.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.737+0000 7f3899a76640 1 --2- 172.21.15.170:0/4038268321 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efcff97720 0x55efd00902d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x55efcff969a0 tx=0x7f388c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.737+0000 7f3786604640 1 -- 172.21.15.170:0/4038268321 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f388c00ee10 con 0x55efcff97720 2024-09-12T17:28:03.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.737+0000 7f3786604640 1 -- 172.21.15.170:0/4038268321 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f388c00fa30 con 0x55efcff97720 2024-09-12T17:28:03.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.737+0000 7f389dd33800 1 -- 172.21.15.170:0/4038268321 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55efd0090ac0 con 0x55efcff97720 2024-09-12T17:28:03.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.737+0000 7f3786604640 1 -- 172.21.15.170:0/4038268321 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f388c00fd30 con 0x55efcff97720 2024-09-12T17:28:03.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.737+0000 7f389dd33800 1 -- 172.21.15.170:0/4038268321 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efd00914c0 con 0x55efcff97720 2024-09-12T17:28:03.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.738+0000 7f3786604640 1 -- 172.21.15.170:0/4038268321 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f388c017070 con 0x55efcff97720 2024-09-12T17:28:03.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.738+0000 7f3786604640 1 --2- 172.21.15.170:0/4038268321 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f378003c780 0x7f378003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.738+0000 7f3786604640 1 -- 172.21.15.170:0/4038268321 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f388c015020 con 0x55efcff97720 2024-09-12T17:28:03.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.738+0000 7f3899275640 1 --2- 172.21.15.170:0/4038268321 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f378003c780 0x7f378003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.738+0000 7f389dd33800 1 --2- 172.21.15.170:0/4038268321 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55efcff9b230 0x55efd0097920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.738+0000 7f389dd33800 1 -- 172.21.15.170:0/4038268321 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efd0097e60 con 0x55efcff9b230 2024-09-12T17:28:03.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.739+0000 7f389a277640 1 --2- 172.21.15.170:0/4038268321 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55efcff9b230 0x55efd0097920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.739+0000 7f3899275640 1 --2- 172.21.15.170:0/4038268321 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f378003c780 0x7f378003ec40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3890057000 tx=0x7f3890052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.739+0000 7f389a277640 1 --2- 172.21.15.170:0/4038268321 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55efcff9b230 0x55efd0097920 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.739+0000 7f389a277640 1 -- 172.21.15.170:0/4038268321 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f389400a4d0 con 0x55efcff9b230 2024-09-12T17:28:03.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.739+0000 7f389dd33800 1 -- 172.21.15.170:0/4038268321 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efd0098200 con 0x55efcff9b230 2024-09-12T17:28:03.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.739+0000 7f389a277640 1 -- 172.21.15.170:0/4038268321 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f389400a4d0 con 0x55efcff9b230 2024-09-12T17:28:03.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.739+0000 7f389dd33800 1 --2- 172.21.15.170:0/4038268321 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55efd0099cc0 0x55efd009c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.739+0000 7f389dd33800 1 -- 172.21.15.170:0/4038268321 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efd009c8d0 con 0x55efd0099cc0 2024-09-12T17:28:03.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.740+0000 7f3899a76640 1 --2- 172.21.15.170:0/4038268321 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55efd0099cc0 0x55efd009c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.740+0000 7f3899a76640 1 --2- 172.21.15.170:0/4038268321 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55efd0099cc0 0x55efd009c140 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.740+0000 7f3899a76640 1 -- 172.21.15.170:0/4038268321 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f388c02e070 con 0x55efd0099cc0 2024-09-12T17:28:03.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.740+0000 7f389dd33800 1 -- 172.21.15.170:0/4038268321 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efd0098a50 con 0x55efcff9b230 2024-09-12T17:28:03.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.740+0000 7f389a277640 1 -- 172.21.15.170:0/4038268321 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f389400a4d0 con 0x55efcff9b230 2024-09-12T17:28:03.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.740+0000 7f389dd33800 1 -- 172.21.15.170:0/4038268321 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efd0098e30 con 0x55efd0099cc0 2024-09-12T17:28:03.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.741+0000 7f3899a76640 1 -- 172.21.15.170:0/4038268321 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f388c02e070 con 0x55efd0099cc0 2024-09-12T17:28:03.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.741+0000 7f389dd33800 1 Processor -- start 2024-09-12T17:28:03.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.741+0000 7f389dd33800 1 -- start start 2024-09-12T17:28:03.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.741+0000 7f389dd33800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efd00ab160 0x55efd00ab580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.741+0000 7f389dd33800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55efcfe8da00 con 0x55efd00ab160 2024-09-12T17:28:03.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.741+0000 7f389a277640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efd00ab160 0x55efd00ab580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.742+0000 7f389a277640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efd00ab160 0x55efd00ab580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:58148/0 (socket says 172.21.15.170:58148) 2024-09-12T17:28:03.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.742+0000 7f389a277640 1 -- 172.21.15.170:0/1523673390 learned_addr learned my addr 172.21.15.170:0/1523673390 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:03.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.742+0000 7f389a277640 1 -- 172.21.15.170:0/1523673390 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efd00abbc0 con 0x55efd00ab160 2024-09-12T17:28:03.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.742+0000 7f389a277640 1 --2- 172.21.15.170:0/1523673390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efd00ab160 0x55efd00ab580 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x55efd00912d0 tx=0x7f38940167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.742+0000 7f377f7fe640 1 -- 172.21.15.170:0/1523673390 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3894013640 con 0x55efd00ab160 2024-09-12T17:28:03.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.742+0000 7f377f7fe640 1 -- 172.21.15.170:0/1523673390 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38940137e0 con 0x55efd00ab160 2024-09-12T17:28:03.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.742+0000 7f377f7fe640 1 -- 172.21.15.170:0/1523673390 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3894013ae0 con 0x55efd00ab160 2024-09-12T17:28:03.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.742+0000 7f389dd33800 1 -- 172.21.15.170:0/1523673390 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55efd00ac3f0 con 0x55efd00ab160 2024-09-12T17:28:03.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.742+0000 7f389dd33800 1 -- 172.21.15.170:0/1523673390 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efd00ac990 con 0x55efd00ab160 2024-09-12T17:28:03.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.743+0000 7f377f7fe640 1 -- 172.21.15.170:0/1523673390 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3894011040 con 0x55efd00ab160 2024-09-12T17:28:03.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.743+0000 7f377f7fe640 1 --2- 172.21.15.170:0/1523673390 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f377403c730 0x7f377403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.743+0000 7f377f7fe640 1 -- 172.21.15.170:0/1523673390 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f389400e040 con 0x55efd00ab160 2024-09-12T17:28:03.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.743+0000 7f3899a76640 1 --2- 172.21.15.170:0/1523673390 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f377403c730 0x7f377403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.744+0000 7f389dd33800 1 Processor -- start 2024-09-12T17:28:03.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.744+0000 7f389dd33800 1 -- start start 2024-09-12T17:28:03.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.744+0000 7f3899a76640 1 --2- 172.21.15.170:0/1523673390 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f377403c730 0x7f377403ebf0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x55efd00923b0 tx=0x7f388c0525b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.744+0000 7f389dd33800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efd00b7c80 0x55efd00b8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.744+0000 7f389dd33800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55efcff95710 con 0x55efd00b7c80 2024-09-12T17:28:03.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.744+0000 7f389a277640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efd00b7c80 0x55efd00b8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.744+0000 7f389a277640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efd00b7c80 0x55efd00b8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:58156/0 (socket says 172.21.15.170:58156) 2024-09-12T17:28:03.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.744+0000 7f389a277640 1 -- 172.21.15.170:0/2657117147 learned_addr learned my addr 172.21.15.170:0/2657117147 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:03.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.744+0000 7f389a277640 1 -- 172.21.15.170:0/2657117147 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efd00b8670 con 0x55efd00b7c80 2024-09-12T17:28:03.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.745+0000 7f389a277640 1 --2- 172.21.15.170:0/2657117147 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efd00b7c80 0x55efd00b8080 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3894020000 tx=0x7f389401f400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ab9bc35c50066ad server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.745+0000 7f377d7fa640 1 -- 172.21.15.170:0/2657117147 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3894021960 con 0x55efd00b7c80 2024-09-12T17:28:03.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.745+0000 7f377d7fa640 1 -- 172.21.15.170:0/2657117147 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3894021440 con 0x55efd00b7c80 2024-09-12T17:28:03.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.745+0000 7f377d7fa640 1 -- 172.21.15.170:0/2657117147 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3894021b00 con 0x55efd00b7c80 2024-09-12T17:28:03.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.745+0000 7f389dd33800 1 -- 172.21.15.170:0/2657117147 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efd00b7c80 msgr2=0x55efd00b8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.745+0000 7f389dd33800 1 --2- 172.21.15.170:0/2657117147 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efd00b7c80 0x55efd00b8080 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3894020000 tx=0x7f389401f400 comp rx=0 tx=0).stop 2024-09-12T17:28:03.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.745+0000 7f389dd33800 1 -- 172.21.15.170:0/2657117147 shutdown_connections 2024-09-12T17:28:03.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.745+0000 7f389dd33800 1 --2- 172.21.15.170:0/2657117147 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efd00b7c80 0x55efd00b8080 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.745+0000 7f389dd33800 1 -- 172.21.15.170:0/2657117147 >> 172.21.15.170:0/2657117147 conn(0x55efd00b4080 msgr2=0x55efd00b22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:03.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.745+0000 7f389dd33800 1 -- 172.21.15.170:0/2657117147 shutdown_connections 2024-09-12T17:28:03.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.745+0000 7f389dd33800 1 -- 172.21.15.170:0/2657117147 wait complete. 2024-09-12T17:28:03.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.745+0000 7f389dd33800 1 Processor -- start 2024-09-12T17:28:03.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.746+0000 7f389dd33800 1 -- start start 2024-09-12T17:28:03.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.746+0000 7f389dd33800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efd00b7c80 0x55efd00bf270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.746+0000 7f389dd33800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55efd00b8c90 con 0x55efd00b7c80 2024-09-12T17:28:03.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.746+0000 7f389a277640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efd00b7c80 0x55efd00bf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.746+0000 7f389a277640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efd00b7c80 0x55efd00bf270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:58168/0 (socket says 172.21.15.170:58168) 2024-09-12T17:28:03.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.746+0000 7f389a277640 1 -- 172.21.15.170:0/921170458 learned_addr learned my addr 172.21.15.170:0/921170458 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:03.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.746+0000 7f389a277640 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efd00bf7d0 con 0x55efd00b7c80 2024-09-12T17:28:03.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.746+0000 7f389a277640 1 --2- 172.21.15.170:0/921170458 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efd00b7c80 0x55efd00bf270 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f38940208e0 tx=0x7f3894053cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.747+0000 7f376b7fe640 1 -- 172.21.15.170:0/921170458 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f389401f500 con 0x55efd00b7c80 2024-09-12T17:28:03.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.747+0000 7f376b7fe640 1 -- 172.21.15.170:0/921170458 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f389401f6a0 con 0x55efd00b7c80 2024-09-12T17:28:03.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.747+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55efd00bfa60 con 0x55efd00b7c80 2024-09-12T17:28:03.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.747+0000 7f376b7fe640 1 -- 172.21.15.170:0/921170458 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38940551a0 con 0x55efd00b7c80 2024-09-12T17:28:03.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.747+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efd00c03e0 con 0x55efd00b7c80 2024-09-12T17:28:03.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.747+0000 7f376b7fe640 1 -- 172.21.15.170:0/921170458 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3894055340 con 0x55efd00b7c80 2024-09-12T17:28:03.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.748+0000 7f376b7fe640 1 --2- 172.21.15.170:0/921170458 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f376403c780 0x7f376403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.748+0000 7f376b7fe640 1 -- 172.21.15.170:0/921170458 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f389403d0b0 con 0x55efd00b7c80 2024-09-12T17:28:03.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.748+0000 7f3899a76640 1 --2- 172.21.15.170:0/921170458 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f376403c780 0x7f376403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.748+0000 7f3899a76640 1 --2- 172.21.15.170:0/921170458 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f376403c780 0x7f376403ec40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f388c00efd0 tx=0x7f388c048000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.748+0000 7f389dd33800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.748+0000 7f389dd33800 1 --2- 172.21.15.170:0/921170458 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55efd00cab40 0x55efd00cd000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.748+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efd00cd750 con 0x55efd00cab40 2024-09-12T17:28:03.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.748+0000 7f3899275640 1 --2- 172.21.15.170:0/921170458 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55efd00cab40 0x55efd00cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.749+0000 7f3899275640 1 --2- 172.21.15.170:0/921170458 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55efd00cab40 0x55efd00cd000 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.749+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3890057030 con 0x55efd00cab40 2024-09-12T17:28:03.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.749+0000 7f389dd33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.749+0000 7f389dd33800 20 realm 2024-09-12T17:28:03.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.749+0000 7f389dd33800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.749+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efd00cdb80 con 0x55efd00cab40 2024-09-12T17:28:03.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.749+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3890057030 con 0x55efd00cab40 2024-09-12T17:28:03.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.749+0000 7f389dd33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.749+0000 7f389dd33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:03.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.749+0000 7f389dd33800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.749+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efd00ce450 con 0x55efd00cab40 2024-09-12T17:28:03.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.749+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3890057030 con 0x55efd00cab40 2024-09-12T17:28:03.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.749+0000 7f389dd33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.749+0000 7f389dd33800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.749+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efd00ce7f0 con 0x55efd00cab40 2024-09-12T17:28:03.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.750+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3890057030 con 0x55efd00cab40 2024-09-12T17:28:03.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.750+0000 7f389dd33800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:03.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.750+0000 7f389dd33800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.750+0000 7f389dd33800 1 --2- 172.21.15.170:0/921170458 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55efd00cf550 0x55efd00d1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.750+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d1f50 con 0x55efd00cf550 2024-09-12T17:28:03.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.750+0000 7f389a277640 1 --2- 172.21.15.170:0/921170458 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55efd00cf550 0x55efd00d1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.750+0000 7f389a277640 1 --2- 172.21.15.170:0/921170458 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55efd00cf550 0x55efd00d1940 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.750+0000 7f389a277640 1 -- 172.21.15.170:0/921170458 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3894038020 con 0x55efd00cf550 2024-09-12T17:28:03.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.750+0000 7f389dd33800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:03.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.750+0000 7f389dd33800 20 searching for the correct realm 2024-09-12T17:28:03.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.750+0000 7f389dd33800 1 --2- 172.21.15.170:0/921170458 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55efd00d3f20 0x55efd00d63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.750+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d6a60 con 0x55efd00d3f20 2024-09-12T17:28:03.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.750+0000 7f3899a76640 1 --2- 172.21.15.170:0/921170458 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55efd00d3f20 0x55efd00d63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.751+0000 7f3899a76640 1 --2- 172.21.15.170:0/921170458 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55efd00d3f20 0x55efd00d63e0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.751+0000 7f3899a76640 1 -- 172.21.15.170:0/921170458 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f388c057040 con 0x55efd00d3f20 2024-09-12T17:28:03.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.751+0000 7f3899a76640 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d6a60 con 0x55efd00cf550 2024-09-12T17:28:03.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.751+0000 7f389a277640 1 -- 172.21.15.170:0/921170458 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3894038020 con 0x55efd00cf550 2024-09-12T17:28:03.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.751+0000 7f389a277640 1 --2- 172.21.15.170:0/921170458 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f38940125f0 0x7f38940325c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.751+0000 7f389a277640 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d6a60 con 0x7f38940125f0 2024-09-12T17:28:03.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.751+0000 7f3899275640 1 --2- 172.21.15.170:0/921170458 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f38940125f0 0x7f38940325c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.752+0000 7f3899275640 1 --2- 172.21.15.170:0/921170458 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f38940125f0 0x7f38940325c0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.752+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3890057030 con 0x7f38940125f0 2024-09-12T17:28:03.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.752+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d6a60 con 0x55efd00cab40 2024-09-12T17:28:03.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.752+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3890057030 con 0x55efd00cab40 2024-09-12T17:28:03.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.752+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d6a60 con 0x55efd00cab40 2024-09-12T17:28:03.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.752+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3890057030 con 0x55efd00cab40 2024-09-12T17:28:03.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.752+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d6a60 con 0x7f38940125f0 2024-09-12T17:28:03.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.753+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3890057030 con 0x7f38940125f0 2024-09-12T17:28:03.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.753+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d6a60 con 0x7f38940125f0 2024-09-12T17:28:03.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.753+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3890057030 con 0x7f38940125f0 2024-09-12T17:28:03.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.753+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d6a60 con 0x55efd00cf550 2024-09-12T17:28:03.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.753+0000 7f389a277640 1 -- 172.21.15.170:0/921170458 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3894038020 con 0x55efd00cf550 2024-09-12T17:28:03.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.753+0000 7f389a277640 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d6a60 con 0x55efd00d3f20 2024-09-12T17:28:03.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.753+0000 7f3899a76640 1 -- 172.21.15.170:0/921170458 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f388c057040 con 0x55efd00d3f20 2024-09-12T17:28:03.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.753+0000 7f3899a76640 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d6a60 con 0x55efd00cab40 2024-09-12T17:28:03.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.754+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3890057030 con 0x55efd00cab40 2024-09-12T17:28:03.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.754+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d6a60 con 0x7f38940125f0 2024-09-12T17:28:03.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.754+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3890057030 con 0x7f38940125f0 2024-09-12T17:28:03.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.754+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d6a60 con 0x55efd00cab40 2024-09-12T17:28:03.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.754+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3890057030 con 0x55efd00cab40 2024-09-12T17:28:03.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.754+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d6a60 con 0x55efd00cf550 2024-09-12T17:28:03.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.754+0000 7f389a277640 1 -- 172.21.15.170:0/921170458 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f3894038020 con 0x55efd00cf550 2024-09-12T17:28:03.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.754+0000 7f389a277640 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d6a60 con 0x55efd00d3f20 2024-09-12T17:28:03.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.754+0000 7f3899a76640 1 -- 172.21.15.170:0/921170458 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f388c057040 con 0x55efd00d3f20 2024-09-12T17:28:03.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.754+0000 7f3899a76640 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d6a60 con 0x55efd00d3f20 2024-09-12T17:28:03.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.755+0000 7f3899a76640 1 -- 172.21.15.170:0/921170458 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f388c057040 con 0x55efd00d3f20 2024-09-12T17:28:03.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.755+0000 7f3899a76640 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d6a60 con 0x7f38940125f0 2024-09-12T17:28:03.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.755+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3890057030 con 0x7f38940125f0 2024-09-12T17:28:03.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.755+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d6a60 con 0x55efd00d3f20 2024-09-12T17:28:03.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.755+0000 7f3899a76640 1 -- 172.21.15.170:0/921170458 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f388c057040 con 0x55efd00d3f20 2024-09-12T17:28:03.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.755+0000 7f3899a76640 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d6a60 con 0x55efd00d3f20 2024-09-12T17:28:03.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.755+0000 7f3899a76640 1 -- 172.21.15.170:0/921170458 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f388c057040 con 0x55efd00d3f20 2024-09-12T17:28:03.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.755+0000 7f3899a76640 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d6a60 con 0x55efd00cab40 2024-09-12T17:28:03.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.756+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3890057030 con 0x55efd00cab40 2024-09-12T17:28:03.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.756+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d6a60 con 0x55efd00cab40 2024-09-12T17:28:03.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.756+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3890057030 con 0x55efd00cab40 2024-09-12T17:28:03.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.756+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d6a60 con 0x7f38940125f0 2024-09-12T17:28:03.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.756+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3890057030 con 0x7f38940125f0 2024-09-12T17:28:03.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.756+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d6a60 con 0x55efd00d3f20 2024-09-12T17:28:03.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.756+0000 7f3899a76640 1 -- 172.21.15.170:0/921170458 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f388c057040 con 0x55efd00d3f20 2024-09-12T17:28:03.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.756+0000 7f3899a76640 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d6a60 con 0x55efd00cf550 2024-09-12T17:28:03.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.757+0000 7f389a277640 1 -- 172.21.15.170:0/921170458 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3894038020 con 0x55efd00cf550 2024-09-12T17:28:03.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.757+0000 7f389a277640 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d6a60 con 0x55efd00cab40 2024-09-12T17:28:03.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.757+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3890057030 con 0x55efd00cab40 2024-09-12T17:28:03.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.757+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d6a60 con 0x7f38940125f0 2024-09-12T17:28:03.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.757+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3890057030 con 0x7f38940125f0 2024-09-12T17:28:03.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.757+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d6a60 con 0x55efd00d3f20 2024-09-12T17:28:03.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.758+0000 7f3899a76640 1 -- 172.21.15.170:0/921170458 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f388c057040 con 0x55efd00d3f20 2024-09-12T17:28:03.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.758+0000 7f3899a76640 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d6a60 con 0x7f38940125f0 2024-09-12T17:28:03.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.758+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3890057030 con 0x7f38940125f0 2024-09-12T17:28:03.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.758+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d6a60 con 0x55efd00cf550 2024-09-12T17:28:03.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.758+0000 7f389a277640 1 -- 172.21.15.170:0/921170458 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3894038020 con 0x55efd00cf550 2024-09-12T17:28:03.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.758+0000 7f389a277640 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d6a60 con 0x55efd00d3f20 2024-09-12T17:28:03.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.758+0000 7f3899a76640 1 -- 172.21.15.170:0/921170458 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f388c057040 con 0x55efd00d3f20 2024-09-12T17:28:03.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.758+0000 7f3899a76640 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d6a60 con 0x7f38940125f0 2024-09-12T17:28:03.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.759+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3890057030 con 0x7f38940125f0 2024-09-12T17:28:03.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.759+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d6a60 con 0x55efd00cab40 2024-09-12T17:28:03.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.759+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3890057030 con 0x55efd00cab40 2024-09-12T17:28:03.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.759+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d6a60 con 0x55efd00cf550 2024-09-12T17:28:03.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.759+0000 7f389a277640 1 -- 172.21.15.170:0/921170458 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3894038020 con 0x55efd00cf550 2024-09-12T17:28:03.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.759+0000 7f389dd33800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:03.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.759+0000 7f389dd33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:03.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.759+0000 7f389dd33800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:03.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.759+0000 7f389dd33800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:03.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.759+0000 7f389dd33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:03.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.759+0000 7f389dd33800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:03.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.759+0000 7f389dd33800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.759+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d2910 con 0x55efd00cab40 2024-09-12T17:28:03.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.759+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3890057030 con 0x55efd00cab40 2024-09-12T17:28:03.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.759+0000 7f389dd33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.759+0000 7f389dd33800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.759+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d31b0 con 0x55efd00cab40 2024-09-12T17:28:03.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.760+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3890057030 con 0x55efd00cab40 2024-09-12T17:28:03.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.760+0000 7f389dd33800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:03.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.760+0000 7f389dd33800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.760+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d2550 con 0x55efd00cf550 2024-09-12T17:28:03.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.760+0000 7f389a277640 1 -- 172.21.15.170:0/921170458 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3894038020 con 0x55efd00cf550 2024-09-12T17:28:03.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.760+0000 7f389dd33800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:03.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.760+0000 7f389dd33800 20 zone default found 2024-09-12T17:28:03.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.760+0000 7f389dd33800 4 Realm: () 2024-09-12T17:28:03.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.760+0000 7f389dd33800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:03.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.760+0000 7f389dd33800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:03.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.760+0000 7f389dd33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:03.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.760+0000 7f389dd33800 20 zonegroup default 2024-09-12T17:28:03.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.760+0000 7f389dd33800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.760+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d7390 con 0x7f38940125f0 2024-09-12T17:28:03.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.760+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3890057030 con 0x7f38940125f0 2024-09-12T17:28:03.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.760+0000 7f389dd33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.760+0000 7f389dd33800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.760+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d95d0 con 0x55efd00d3f20 2024-09-12T17:28:03.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.760+0000 7f3899a76640 1 -- 172.21.15.170:0/921170458 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f388c057040 con 0x55efd00d3f20 2024-09-12T17:28:03.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.760+0000 7f389dd33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.760+0000 7f389dd33800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.760+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d9970 con 0x55efd00d3f20 2024-09-12T17:28:03.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.761+0000 7f3899a76640 1 -- 172.21.15.170:0/921170458 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f388c057040 con 0x55efd00d3f20 2024-09-12T17:28:03.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.761+0000 7f389dd33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.761+0000 7f389dd33800 20 started sync module instance, tier type = 2024-09-12T17:28:03.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.761+0000 7f389dd33800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:03.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.761+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d8a60 con 0x55efd00cf550 2024-09-12T17:28:03.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.762+0000 7f389a277640 1 -- 172.21.15.170:0/921170458 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3894038020 con 0x55efd00cf550 2024-09-12T17:28:03.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.762+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94488476094304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d8a60 con 0x55efd00cf550 2024-09-12T17:28:03.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.762+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efd00da3d0 con 0x55efd00cab40 2024-09-12T17:28:03.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.763+0000 7f389a277640 1 -- 172.21.15.170:0/921170458 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94488476094304] v29'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3894038020 con 0x55efd00cf550 2024-09-12T17:28:03.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.763+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3890057030 con 0x55efd00cab40 2024-09-12T17:28:03.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.763+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94488476098224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d8a60 con 0x55efd00cab40 2024-09-12T17:28:03.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.763+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efd00dae40 con 0x55efd00d3f20 2024-09-12T17:28:03.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.764+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94488476098224] v29'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3890057030 con 0x55efd00cab40 2024-09-12T17:28:03.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.764+0000 7f3899a76640 1 -- 172.21.15.170:0/921170458 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f388c057040 con 0x55efd00d3f20 2024-09-12T17:28:03.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.764+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94488476091824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d89d0 con 0x55efd00d3f20 2024-09-12T17:28:03.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.764+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efd00dbd00 con 0x55efd00cf550 2024-09-12T17:28:03.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.765+0000 7f3899a76640 1 -- 172.21.15.170:0/921170458 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94488476091824] v29'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f388c057040 con 0x55efd00d3f20 2024-09-12T17:28:03.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.765+0000 7f389a277640 1 -- 172.21.15.170:0/921170458 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3894038020 con 0x55efd00cf550 2024-09-12T17:28:03.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.765+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94488476104784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efd00dbc70 con 0x55efd00cf550 2024-09-12T17:28:03.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.765+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efd00dcbc0 con 0x55efd00cab40 2024-09-12T17:28:03.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.766+0000 7f389a277640 1 -- 172.21.15.170:0/921170458 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94488476104784] v29'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3894038020 con 0x55efd00cf550 2024-09-12T17:28:03.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.766+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3890057030 con 0x55efd00cab40 2024-09-12T17:28:03.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.766+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94488476106992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efd00dcbc0 con 0x55efd00cab40 2024-09-12T17:28:03.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.766+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efd00dd580 con 0x7f38940125f0 2024-09-12T17:28:03.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.767+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94488476106992] v29'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3890057030 con 0x55efd00cab40 2024-09-12T17:28:03.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.768+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3890057030 con 0x7f38940125f0 2024-09-12T17:28:03.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.768+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94488476109040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efd00dd580 con 0x7f38940125f0 2024-09-12T17:28:03.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.768+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efd00ddf40 con 0x7f38940125f0 2024-09-12T17:28:03.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.769+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94488476109040] v29'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3890057030 con 0x7f38940125f0 2024-09-12T17:28:03.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.769+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(56 notify.6 [create] v29'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3890057030 con 0x7f38940125f0 2024-09-12T17:28:03.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.769+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94488476111056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efd00ddf40 con 0x7f38940125f0 2024-09-12T17:28:03.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.769+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efd00de900 con 0x7f38940125f0 2024-09-12T17:28:03.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.770+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94488476111056] v29'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3890057030 con 0x7f38940125f0 2024-09-12T17:28:03.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.770+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(58 notify.7 [create] v29'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3890057030 con 0x7f38940125f0 2024-09-12T17:28:03.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.770+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94488476113552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efd00de900 con 0x7f38940125f0 2024-09-12T17:28:03.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.770+0000 7f389dd33800 20 add_watcher() i=0 2024-09-12T17:28:03.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.770+0000 7f389dd33800 20 add_watcher() i=1 2024-09-12T17:28:03.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.770+0000 7f389dd33800 20 add_watcher() i=2 2024-09-12T17:28:03.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.770+0000 7f389dd33800 20 add_watcher() i=3 2024-09-12T17:28:03.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.770+0000 7f389dd33800 20 add_watcher() i=4 2024-09-12T17:28:03.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.770+0000 7f389dd33800 20 add_watcher() i=5 2024-09-12T17:28:03.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.770+0000 7f389dd33800 20 add_watcher() i=6 2024-09-12T17:28:03.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.771+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94488476113552] v29'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3890057030 con 0x7f38940125f0 2024-09-12T17:28:03.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.771+0000 7f389dd33800 20 add_watcher() i=7 2024-09-12T17:28:03.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.771+0000 7f389dd33800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:03.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.771+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efd00e1d60 con 0x55efd00cab40 2024-09-12T17:28:03.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.771+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3890057030 con 0x55efd00cab40 2024-09-12T17:28:03.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.771+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94488476116512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efd00df280 con 0x55efd00cab40 2024-09-12T17:28:03.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.772+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94488476116512] v29'110 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3890057030 con 0x55efd00cab40 2024-09-12T17:28:03.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.772+0000 7f374b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:03.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.772+0000 7f389dd33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:03.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.772+0000 7f389dd33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:03.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.772+0000 7f389dd33800 5 note: GC not initialized 2024-09-12T17:28:03.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.773+0000 7f374a7fc640 20 reqs_thread_entry: start 2024-09-12T17:28:03.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.773+0000 7f389dd33800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:03.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.773+0000 7f389dd33800 20 Filter name: none 2024-09-12T17:28:03.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.773+0000 7f36bbfff640 20 reqs_thread_entry: start 2024-09-12T17:28:03.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.773+0000 7f389dd33800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-12T17:28:03.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.773+0000 7f389dd33800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.773+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efd0114dc0 con 0x7f38940125f0 2024-09-12T17:28:03.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.774+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f3890057030 con 0x7f38940125f0 2024-09-12T17:28:03.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.774+0000 7f389dd33800 20 rados_obj.operate() r=0 bl.length=380 2024-09-12T17:28:03.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.774+0000 7f389dd33800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-12T17:28:03.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.774+0000 7f389dd33800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T17:28:03.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.774+0000 7f389dd33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:03.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.774+0000 7f389dd33800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T17:28:03.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.774+0000 7f389dd33800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.774+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efd0116d50 con 0x55efd00cf550 2024-09-12T17:28:03.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.774+0000 7f389a277640 1 -- 172.21.15.170:0/921170458 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f3894038020 con 0x55efd00cf550 2024-09-12T17:28:03.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.774+0000 7f389dd33800 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T17:28:03.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.774+0000 7f389dd33800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-12T17:28:03.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.774+0000 7f389dd33800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:28:03.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.774+0000 7f389dd33800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 : miss 2024-09-12T17:28:03.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.774+0000 7f389dd33800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.774+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:64 8.1d 8:baccd554:root::.bucket.meta.myfoo%3a7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efd01187e0 con 0x7f38940125f0 2024-09-12T17:28:03.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.774+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(64 .bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f3890057030 con 0x7f38940125f0 2024-09-12T17:28:03.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.774+0000 7f389dd33800 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T17:28:03.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.774+0000 7f389dd33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 info.flags=0x17 2024-09-12T17:28:03.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.774+0000 7f389dd33800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 to cache LRU end 2024-09-12T17:28:03.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.774+0000 7f389dd33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:03.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.774+0000 7f389dd33800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:28:03.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.774+0000 7f389dd33800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 2024-09-12T17:28:03.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.775+0000 7f389dd33800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-12T17:28:03.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.775+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efd011cdd0 con 0x55efd00cf550 2024-09-12T17:28:03.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.776+0000 7f389a277640 1 -- 172.21.15.170:0/921170458 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(65 foo.buckets [call] v29'19 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f3894038020 con 0x55efd00cf550 2024-09-12T17:28:03.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.776+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:66 8.1d 8:baccd554:root::.bucket.meta.myfoo%3a7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efd0122b60 con 0x7f38940125f0 2024-09-12T17:28:03.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.777+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(66 .bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v29'2 uv2 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f3890057030 con 0x7f38940125f0 2024-09-12T17:28:03.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.777+0000 7f389dd33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 info.flags=0x17 2024-09-12T17:28:03.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.777+0000 7f389dd33800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 to cache LRU end 2024-09-12T17:28:03.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.777+0000 7f389dd33800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:28:03.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.777+0000 7f389dd33800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1, ofs0, ns] 2024-09-12T17:28:03.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.777+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:67 7.9 7:93e5b521:::notify.7:head [notify cookie 94488476356224 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efd011d200 con 0x7f38940125f0 2024-09-12T17:28:03.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.777+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== watch-notify(notify (1) cookie 94488476113552 notify 124554051588 ret 0) ==== 802+0+0 (crc 0 0 0) 0x55efd0118bd0 con 0x7f38940125f0 2024-09-12T17:28:03.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.777+0000 7f377d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051588 cookie 94488476113552 notifier 4498 bl.length()=760 2024-09-12T17:28:03.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.777+0000 7f377d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 info.flags=0x17 2024-09-12T17:28:03.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.777+0000 7f377d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 to cache LRU end 2024-09-12T17:28:03.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.777+0000 7f377d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:28:03.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.777+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== osd_op_reply(67 notify.7 [notify cookie 94488476356224 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3890089040 con 0x7f38940125f0 2024-09-12T17:28:03.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.777+0000 7f377d7fa640 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:68 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f375c003ea0 con 0x7f38940125f0 2024-09-12T17:28:03.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.778+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.0 v2:172.21.15.47:6800/3978157098 22 ==== osd_op_reply(68 notify.7 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3890089040 con 0x7f38940125f0 2024-09-12T17:28:03.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.778+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.0 v2:172.21.15.47:6800/3978157098 23 ==== watch-notify(notify_complete (2) cookie 94488476356224 notify 124554051588 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55efd0117d50 con 0x7f38940125f0 2024-09-12T17:28:03.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.778+0000 7f389dd33800 20 handle_bi_update(): bucket=:myfoo[7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1]): orig_sources= new_sources= 2024-09-12T17:28:03.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.778+0000 7f389dd33800 20 handle_bi_update(): bucket=:myfoo[7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1]): potential sources added=[] removed=[] 2024-09-12T17:28:03.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.778+0000 7f389dd33800 20 handle_bi_update(): bucket=:myfoo[7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1]): orig_dests= new_dests= 2024-09-12T17:28:03.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.778+0000 7f389dd33800 20 handle_bi_update(): bucket=:myfoo[7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1]): potential dests added=[] removed=[] 2024-09-12T17:28:03.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.778+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efd01214f0 con 0x7f38940125f0 2024-09-12T17:28:03.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.779+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.0 v2:172.21.15.47:6800/3978157098 24 ==== osd_op_reply(69 fud.buckets [call] v29'1 uv1 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f3890089040 con 0x7f38940125f0 2024-09-12T17:28:03.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.779+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efd0118e60 con 0x55efd00cf550 2024-09-12T17:28:03.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.780+0000 7f389a277640 1 -- 172.21.15.170:0/921170458 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v29'20 uv20 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f3894038020 con 0x55efd00cf550 2024-09-12T17:28:03.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.780+0000 7f389dd33800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-12T17:28:03.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.780+0000 7f389dd33800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:28:03.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.780+0000 7f389dd33800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-12T17:28:03.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.780+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94488476356192 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efd01219a0 con 0x7f38940125f0 2024-09-12T17:28:03.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.780+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.0 v2:172.21.15.47:6800/3978157098 25 ==== watch-notify(notify (1) cookie 94488476111056 notify 124554051589 ret 0) ==== 356+0+0 (crc 0 0 0) 0x55efcfe276b0 con 0x7f38940125f0 2024-09-12T17:28:03.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.780+0000 7f377cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051589 cookie 94488476111056 notifier 4498 bl.length()=314 2024-09-12T17:28:03.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.780+0000 7f377cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-12T17:28:03.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.780+0000 7f377cff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:28:03.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.780+0000 7f377cff9640 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f36c4003400 con 0x7f38940125f0 2024-09-12T17:28:03.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.780+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.0 v2:172.21.15.47:6800/3978157098 26 ==== osd_op_reply(71 notify.6 [notify cookie 94488476356192 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3890089040 con 0x7f38940125f0 2024-09-12T17:28:03.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.780+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.0 v2:172.21.15.47:6800/3978157098 27 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3890089040 con 0x7f38940125f0 2024-09-12T17:28:03.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.780+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.0 v2:172.21.15.47:6800/3978157098 28 ==== watch-notify(notify_complete (2) cookie 94488476356192 notify 124554051589 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f389005bdd0 con 0x7f38940125f0 2024-09-12T17:28:03.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.781+0000 7f374b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:03.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.781+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94488476116512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efd0112c40 con 0x55efd00cab40 2024-09-12T17:28:03.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.782+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94488476116512] v29'111 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3890089040 con 0x55efd00cab40 2024-09-12T17:28:03.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.782+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94488476094304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efd0112c40 con 0x55efd00cf550 2024-09-12T17:28:03.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.783+0000 7f389a277640 1 -- 172.21.15.170:0/921170458 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94488476094304] v29'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3894038020 con 0x55efd00cf550 2024-09-12T17:28:03.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.783+0000 7f389dd33800 20 remove_watcher() i=0 2024-09-12T17:28:03.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.783+0000 7f389dd33800 2 removed watcher, disabling cache 2024-09-12T17:28:03.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.783+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94488476098224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efd0112c40 con 0x55efd00cab40 2024-09-12T17:28:03.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.784+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94488476098224] v29'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3890089040 con 0x55efd00cab40 2024-09-12T17:28:03.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.784+0000 7f389dd33800 20 remove_watcher() i=1 2024-09-12T17:28:03.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.784+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94488476091824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efd0112c40 con 0x55efd00d3f20 2024-09-12T17:28:03.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.786+0000 7f3899a76640 1 -- 172.21.15.170:0/921170458 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94488476091824] v29'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f388c057040 con 0x55efd00d3f20 2024-09-12T17:28:03.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.786+0000 7f389dd33800 20 remove_watcher() i=2 2024-09-12T17:28:03.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.786+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94488476104784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d85b0 con 0x55efd00cf550 2024-09-12T17:28:03.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.787+0000 7f389a277640 1 -- 172.21.15.170:0/921170458 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94488476104784] v29'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3894038020 con 0x55efd00cf550 2024-09-12T17:28:03.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.787+0000 7f389dd33800 20 remove_watcher() i=3 2024-09-12T17:28:03.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.787+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94488476106992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efd00db850 con 0x55efd00cab40 2024-09-12T17:28:03.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.788+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94488476106992] v29'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3890089040 con 0x55efd00cab40 2024-09-12T17:28:03.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.788+0000 7f389dd33800 20 remove_watcher() i=4 2024-09-12T17:28:03.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.788+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94488476109040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d85b0 con 0x7f38940125f0 2024-09-12T17:28:03.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.789+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.0 v2:172.21.15.47:6800/3978157098 29 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94488476109040] v29'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3890089040 con 0x7f38940125f0 2024-09-12T17:28:03.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.789+0000 7f389dd33800 20 remove_watcher() i=5 2024-09-12T17:28:03.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.789+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94488476111056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efd00db850 con 0x7f38940125f0 2024-09-12T17:28:03.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.790+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.0 v2:172.21.15.47:6800/3978157098 30 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94488476111056] v29'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3890089040 con 0x7f38940125f0 2024-09-12T17:28:03.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.790+0000 7f389dd33800 20 remove_watcher() i=6 2024-09-12T17:28:03.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.790+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94488476113552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efd00d85b0 con 0x7f38940125f0 2024-09-12T17:28:03.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.791+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 <== osd.0 v2:172.21.15.47:6800/3978157098 31 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94488476113552] v29'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3890089040 con 0x7f38940125f0 2024-09-12T17:28:03.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.791+0000 7f389dd33800 20 remove_watcher() i=7 2024-09-12T17:28:03.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.791+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f38940125f0 msgr2=0x7f38940325c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.791+0000 7f389dd33800 1 --2- 172.21.15.170:0/921170458 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f38940125f0 0x7f38940325c0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.791+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55efd00cab40 msgr2=0x55efd00cd000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.791+0000 7f389dd33800 1 --2- 172.21.15.170:0/921170458 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55efd00cab40 0x55efd00cd000 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.791+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55efd00cf550 msgr2=0x55efd00d1940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.791+0000 7f389dd33800 1 --2- 172.21.15.170:0/921170458 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55efd00cf550 0x55efd00d1940 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.791+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55efd00d3f20 msgr2=0x55efd00d63e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.791+0000 7f389dd33800 1 --2- 172.21.15.170:0/921170458 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55efd00d3f20 0x55efd00d63e0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.791+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f376403c780 msgr2=0x7f376403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.791+0000 7f389dd33800 1 --2- 172.21.15.170:0/921170458 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f376403c780 0x7f376403ec40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f388c00efd0 tx=0x7f388c048000 comp rx=0 tx=0).stop 2024-09-12T17:28:03.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.791+0000 7f3899275640 1 -- 172.21.15.170:0/921170458 reap_dead start 2024-09-12T17:28:03.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.791+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efd00b7c80 msgr2=0x55efd00bf270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.791+0000 7f389dd33800 1 --2- 172.21.15.170:0/921170458 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efd00b7c80 0x55efd00bf270 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f38940208e0 tx=0x7f3894053cf0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.791+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 shutdown_connections 2024-09-12T17:28:03.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.791+0000 7f389dd33800 1 --2- 172.21.15.170:0/921170458 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efd00b7c80 0x55efd00bf270 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.791+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 >> 172.21.15.170:0/921170458 conn(0x55efd00b4080 msgr2=0x55efd00b2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:03.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.791+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 shutdown_connections 2024-09-12T17:28:03.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.791+0000 7f389dd33800 1 -- 172.21.15.170:0/921170458 wait complete. 2024-09-12T17:28:03.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.791+0000 7f389dd33800 1 -- 172.21.15.170:0/1523673390 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f377403c730 msgr2=0x7f377403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.791+0000 7f389dd33800 1 --2- 172.21.15.170:0/1523673390 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f377403c730 0x7f377403ebf0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x55efd00923b0 tx=0x7f388c0525b0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.791+0000 7f389dd33800 1 -- 172.21.15.170:0/1523673390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efd00ab160 msgr2=0x55efd00ab580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.791+0000 7f389dd33800 1 --2- 172.21.15.170:0/1523673390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efd00ab160 0x55efd00ab580 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x55efd00912d0 tx=0x7f38940167b0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.791+0000 7f389dd33800 1 -- 172.21.15.170:0/1523673390 shutdown_connections 2024-09-12T17:28:03.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.791+0000 7f389dd33800 1 --2- 172.21.15.170:0/1523673390 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f377403c730 0x7f377403ebf0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.791+0000 7f389dd33800 1 --2- 172.21.15.170:0/1523673390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efd00ab160 0x55efd00ab580 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.791+0000 7f389dd33800 1 -- 172.21.15.170:0/1523673390 >> 172.21.15.170:0/1523673390 conn(0x55efd009f510 msgr2=0x55efd009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:03.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.792+0000 7f389dd33800 1 -- 172.21.15.170:0/1523673390 shutdown_connections 2024-09-12T17:28:03.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.792+0000 7f389dd33800 1 -- 172.21.15.170:0/1523673390 wait complete. 2024-09-12T17:28:03.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.792+0000 7f389dd33800 1 -- 172.21.15.170:0/4038268321 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55efcff9b230 msgr2=0x55efd0097920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.792+0000 7f389dd33800 1 --2- 172.21.15.170:0/4038268321 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55efcff9b230 0x55efd0097920 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.792+0000 7f389dd33800 1 -- 172.21.15.170:0/4038268321 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55efd0099cc0 msgr2=0x55efd009c140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.792+0000 7f389dd33800 1 --2- 172.21.15.170:0/4038268321 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55efd0099cc0 0x55efd009c140 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.792+0000 7f389dd33800 1 -- 172.21.15.170:0/4038268321 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f378003c780 msgr2=0x7f378003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.792+0000 7f389dd33800 1 --2- 172.21.15.170:0/4038268321 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f378003c780 0x7f378003ec40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3890057000 tx=0x7f3890052000 comp rx=0 tx=0).stop 2024-09-12T17:28:03.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.792+0000 7f389dd33800 1 -- 172.21.15.170:0/4038268321 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efcff97720 msgr2=0x55efd00902d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.792+0000 7f389dd33800 1 --2- 172.21.15.170:0/4038268321 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efcff97720 0x55efd00902d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x55efcff969a0 tx=0x7f388c000ed0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.792+0000 7f389dd33800 1 -- 172.21.15.170:0/4038268321 shutdown_connections 2024-09-12T17:28:03.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.792+0000 7f389dd33800 1 --2- 172.21.15.170:0/4038268321 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55efd0099cc0 0x55efd009c140 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.792+0000 7f389dd33800 1 --2- 172.21.15.170:0/4038268321 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f378003c780 0x7f378003ec40 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.792+0000 7f389dd33800 1 --2- 172.21.15.170:0/4038268321 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55efcff9b230 0x55efd0097920 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.792+0000 7f389dd33800 1 --2- 172.21.15.170:0/4038268321 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efcff97720 0x55efd00902d0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.792+0000 7f389dd33800 1 -- 172.21.15.170:0/4038268321 >> 172.21.15.170:0/4038268321 conn(0x55efcff911e0 msgr2=0x55efd0081c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:03.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.792+0000 7f389dd33800 1 -- 172.21.15.170:0/4038268321 shutdown_connections 2024-09-12T17:28:03.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.792+0000 7f389dd33800 1 -- 172.21.15.170:0/4038268321 wait complete. 2024-09-12T17:28:03.805 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-12T17:28:03.805 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-12T17:28:03.805 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-12T17:28:03.849 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:03.850 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:03.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.848+0000 7f630c546800 1 Processor -- start 2024-09-12T17:28:03.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.848+0000 7f630c546800 1 -- start start 2024-09-12T17:28:03.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.848+0000 7f630c546800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5638d4794b60 0x5638d4792f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.848+0000 7f630c546800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5638d46c8e40 con 0x5638d4793600 2024-09-12T17:28:03.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.848+0000 7f630c546800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x5638d4693680 con 0x5638d4794b60 2024-09-12T17:28:03.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.848+0000 7f630a037640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5638d4794b60 0x5638d4792f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.848+0000 7f6309836640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x5638d4793600 0x5638d4826b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:48498/0 (socket says 172.21.15.170:48498) 2024-09-12T17:28:03.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.848+0000 7f6309836640 1 -- 172.21.15.170:0/2639205836 learned_addr learned my addr 172.21.15.170:0/2639205836 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:28:03.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.849+0000 7f630a037640 1 -- 172.21.15.170:0/2639205836 >> v1:172.21.15.47:6789/0 conn(0x5638d4793600 legacy=0x5638d4826b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.849+0000 7f630a037640 1 -- 172.21.15.170:0/2639205836 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638d46af6b0 con 0x5638d4794b60 2024-09-12T17:28:03.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.850+0000 7f630a037640 1 --2- 172.21.15.170:0/2639205836 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638d4794b60 0x5638d4792f50 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f62fc00a470 tx=0x7f62fc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34cc0985abdaca8b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.851+0000 7f6309035640 1 -- 172.21.15.170:0/2639205836 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62fc053570 con 0x5638d4794b60 2024-09-12T17:28:03.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.851+0000 7f6309035640 1 -- 172.21.15.170:0/2639205836 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62fc058070 con 0x5638d4794b60 2024-09-12T17:28:03.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.851+0000 7f6309035640 1 -- 172.21.15.170:0/2639205836 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62fc053880 con 0x5638d4794b60 2024-09-12T17:28:03.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.851+0000 7f630c546800 1 -- 172.21.15.170:0/2639205836 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638d4794b60 msgr2=0x5638d4792f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.851+0000 7f630c546800 1 --2- 172.21.15.170:0/2639205836 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638d4794b60 0x5638d4792f50 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f62fc00a470 tx=0x7f62fc045a20 comp rx=0 tx=0).stop 2024-09-12T17:28:03.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.851+0000 7f630c546800 1 -- 172.21.15.170:0/2639205836 shutdown_connections 2024-09-12T17:28:03.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.851+0000 7f630c546800 1 --2- 172.21.15.170:0/2639205836 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638d4794b60 0x5638d4792f50 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.851+0000 7f630c546800 1 -- 172.21.15.170:0/2639205836 >> 172.21.15.170:0/2639205836 conn(0x5638d481a3c0 msgr2=0x5638d481c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:03.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.851+0000 7f630c546800 1 -- 172.21.15.170:0/2639205836 shutdown_connections 2024-09-12T17:28:03.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.851+0000 7f630c546800 1 -- 172.21.15.170:0/2639205836 wait complete. 2024-09-12T17:28:03.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.865+0000 7f630c546800 1 Processor -- start 2024-09-12T17:28:03.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.865+0000 7f630c546800 1 -- start start 2024-09-12T17:28:03.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.865+0000 7f630c546800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638d4793600 0x5638d49107f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.865+0000 7f630c546800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5638d46b7dd0 con 0x5638d4793600 2024-09-12T17:28:03.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.865+0000 7f630a037640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638d4793600 0x5638d49107f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.865+0000 7f630a037640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638d4793600 0x5638d49107f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:58174/0 (socket says 172.21.15.170:58174) 2024-09-12T17:28:03.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.865+0000 7f630a037640 1 -- 172.21.15.170:0/3255929003 learned_addr learned my addr 172.21.15.170:0/3255929003 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:03.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.866+0000 7f630a037640 1 -- 172.21.15.170:0/3255929003 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638d46d0e10 con 0x5638d4793600 2024-09-12T17:28:03.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.866+0000 7f630a037640 1 --2- 172.21.15.170:0/3255929003 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638d4793600 0x5638d49107f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f62fc025c20 tx=0x7f62fc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a3a6ff43c303fcc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.866+0000 7f61f8608640 1 -- 172.21.15.170:0/3255929003 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62fc053a20 con 0x5638d4793600 2024-09-12T17:28:03.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.866+0000 7f61f8608640 1 -- 172.21.15.170:0/3255929003 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62fc063070 con 0x5638d4793600 2024-09-12T17:28:03.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.866+0000 7f61f8608640 1 -- 172.21.15.170:0/3255929003 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62fc053cf0 con 0x5638d4793600 2024-09-12T17:28:03.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.867+0000 7f630c546800 1 -- 172.21.15.170:0/3255929003 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638d4793600 msgr2=0x5638d49107f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.867+0000 7f630c546800 1 --2- 172.21.15.170:0/3255929003 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638d4793600 0x5638d49107f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f62fc025c20 tx=0x7f62fc051000 comp rx=0 tx=0).stop 2024-09-12T17:28:03.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.867+0000 7f630c546800 1 -- 172.21.15.170:0/3255929003 shutdown_connections 2024-09-12T17:28:03.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.867+0000 7f630c546800 1 --2- 172.21.15.170:0/3255929003 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638d4793600 0x5638d49107f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.867+0000 7f630c546800 1 -- 172.21.15.170:0/3255929003 >> 172.21.15.170:0/3255929003 conn(0x5638d481a3c0 msgr2=0x5638d490c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:03.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.867+0000 7f630c546800 1 -- 172.21.15.170:0/3255929003 shutdown_connections 2024-09-12T17:28:03.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.867+0000 7f630c546800 1 -- 172.21.15.170:0/3255929003 wait complete. 2024-09-12T17:28:03.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.867+0000 7f630c546800 1 Processor -- start 2024-09-12T17:28:03.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.867+0000 7f630c546800 1 -- start start 2024-09-12T17:28:03.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.867+0000 7f630c546800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638d4793600 0x5638d4917ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.867+0000 7f630c546800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5638d4828450 con 0x5638d4793600 2024-09-12T17:28:03.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.868+0000 7f630a037640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638d4793600 0x5638d4917ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.868+0000 7f630a037640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638d4793600 0x5638d4917ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:58184/0 (socket says 172.21.15.170:58184) 2024-09-12T17:28:03.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.868+0000 7f630a037640 1 -- 172.21.15.170:0/1159999204 learned_addr learned my addr 172.21.15.170:0/1159999204 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:03.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.868+0000 7f630a037640 1 -- 172.21.15.170:0/1159999204 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638d4918550 con 0x5638d4793600 2024-09-12T17:28:03.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.868+0000 7f630a037640 1 --2- 172.21.15.170:0/1159999204 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638d4793600 0x5638d4917ff0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f62fc025c20 tx=0x7f62fc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.868+0000 7f61f6e05640 1 -- 172.21.15.170:0/1159999204 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62fc06c030 con 0x5638d4793600 2024-09-12T17:28:03.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.868+0000 7f61f6e05640 1 -- 172.21.15.170:0/1159999204 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62fc068660 con 0x5638d4793600 2024-09-12T17:28:03.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.868+0000 7f630c546800 1 -- 172.21.15.170:0/1159999204 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5638d49187e0 con 0x5638d4793600 2024-09-12T17:28:03.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.868+0000 7f61f6e05640 1 -- 172.21.15.170:0/1159999204 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62fc068940 con 0x5638d4793600 2024-09-12T17:28:03.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.868+0000 7f630c546800 1 -- 172.21.15.170:0/1159999204 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638d49191e0 con 0x5638d4793600 2024-09-12T17:28:03.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.869+0000 7f61f6e05640 1 -- 172.21.15.170:0/1159999204 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f62fc068ae0 con 0x5638d4793600 2024-09-12T17:28:03.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.869+0000 7f61f6e05640 1 --2- 172.21.15.170:0/1159999204 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f61f003c730 0x7f61f003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.869+0000 7f61f6e05640 1 -- 172.21.15.170:0/1159999204 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f62fc097e70 con 0x5638d4793600 2024-09-12T17:28:03.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.869+0000 7f6309836640 1 --2- 172.21.15.170:0/1159999204 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f61f003c730 0x7f61f003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.869+0000 7f630c546800 1 --2- 172.21.15.170:0/1159999204 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5638d4794b60 0x5638d491f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.869+0000 7f630c546800 1 -- 172.21.15.170:0/1159999204 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638d491fb80 con 0x5638d4794b60 2024-09-12T17:28:03.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.869+0000 7f630a838640 1 --2- 172.21.15.170:0/1159999204 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5638d4794b60 0x5638d491f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.870+0000 7f6309836640 1 --2- 172.21.15.170:0/1159999204 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f61f003c730 0x7f61f003ebf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f62f4001d70 tx=0x7f62f40012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.870+0000 7f630a838640 1 --2- 172.21.15.170:0/1159999204 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5638d4794b60 0x5638d491f640 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.870+0000 7f630a838640 1 -- 172.21.15.170:0/1159999204 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f630400a4d0 con 0x5638d4794b60 2024-09-12T17:28:03.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.870+0000 7f630c546800 1 -- 172.21.15.170:0/1159999204 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638d491ff20 con 0x5638d4794b60 2024-09-12T17:28:03.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.870+0000 7f630a838640 1 -- 172.21.15.170:0/1159999204 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f630400a4d0 con 0x5638d4794b60 2024-09-12T17:28:03.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.870+0000 7f630c546800 1 --2- 172.21.15.170:0/1159999204 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5638d4921a20 0x5638d4923ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.870+0000 7f630c546800 1 -- 172.21.15.170:0/1159999204 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638d4924630 con 0x5638d4921a20 2024-09-12T17:28:03.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.870+0000 7f630a037640 1 --2- 172.21.15.170:0/1159999204 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5638d4921a20 0x5638d4923ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.871+0000 7f630a037640 1 --2- 172.21.15.170:0/1159999204 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5638d4921a20 0x5638d4923ea0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.871+0000 7f630a037640 1 -- 172.21.15.170:0/1159999204 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f62fc051070 con 0x5638d4921a20 2024-09-12T17:28:03.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.871+0000 7f630c546800 1 -- 172.21.15.170:0/1159999204 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638d4920770 con 0x5638d4794b60 2024-09-12T17:28:03.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.871+0000 7f630a838640 1 -- 172.21.15.170:0/1159999204 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f630400a4d0 con 0x5638d4794b60 2024-09-12T17:28:03.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.871+0000 7f630c546800 1 -- 172.21.15.170:0/1159999204 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638d4920bc0 con 0x5638d4921a20 2024-09-12T17:28:03.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.872+0000 7f630a037640 1 -- 172.21.15.170:0/1159999204 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f62fc051070 con 0x5638d4921a20 2024-09-12T17:28:03.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.872+0000 7f630c546800 1 Processor -- start 2024-09-12T17:28:03.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.872+0000 7f630c546800 1 -- start start 2024-09-12T17:28:03.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.872+0000 7f630c546800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638d4932ee0 0x5638d4933300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.872+0000 7f630c546800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5638d4715a00 con 0x5638d4932ee0 2024-09-12T17:28:03.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.872+0000 7f630a838640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638d4932ee0 0x5638d4933300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.872+0000 7f630a838640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638d4932ee0 0x5638d4933300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:58196/0 (socket says 172.21.15.170:58196) 2024-09-12T17:28:03.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.872+0000 7f630a838640 1 -- 172.21.15.170:0/3711600912 learned_addr learned my addr 172.21.15.170:0/3711600912 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:03.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.873+0000 7f630a838640 1 -- 172.21.15.170:0/3711600912 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638d4933940 con 0x5638d4932ee0 2024-09-12T17:28:03.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.873+0000 7f630a838640 1 --2- 172.21.15.170:0/3711600912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638d4932ee0 0x5638d4933300 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x5638d4918ff0 tx=0x7f63040167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.873+0000 7f61effff640 1 -- 172.21.15.170:0/3711600912 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6304013640 con 0x5638d4932ee0 2024-09-12T17:28:03.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.873+0000 7f61effff640 1 -- 172.21.15.170:0/3711600912 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63040137e0 con 0x5638d4932ee0 2024-09-12T17:28:03.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.873+0000 7f630c546800 1 -- 172.21.15.170:0/3711600912 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5638d4934170 con 0x5638d4932ee0 2024-09-12T17:28:03.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.873+0000 7f61effff640 1 -- 172.21.15.170:0/3711600912 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6304013ae0 con 0x5638d4932ee0 2024-09-12T17:28:03.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.873+0000 7f630c546800 1 -- 172.21.15.170:0/3711600912 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638d4934710 con 0x5638d4932ee0 2024-09-12T17:28:03.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.874+0000 7f61effff640 1 -- 172.21.15.170:0/3711600912 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f6304011040 con 0x5638d4932ee0 2024-09-12T17:28:03.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.874+0000 7f61effff640 1 --2- 172.21.15.170:0/3711600912 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f61e403c730 0x7f61e403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.874+0000 7f61effff640 1 -- 172.21.15.170:0/3711600912 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f630400e040 con 0x5638d4932ee0 2024-09-12T17:28:03.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.874+0000 7f630a037640 1 --2- 172.21.15.170:0/3711600912 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f61e403c730 0x7f61e403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.874+0000 7f630c546800 1 Processor -- start 2024-09-12T17:28:03.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.875+0000 7f630c546800 1 -- start start 2024-09-12T17:28:03.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.875+0000 7f630a037640 1 --2- 172.21.15.170:0/3711600912 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f61e403c730 0x7f61e403ebf0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f62fc096410 tx=0x7f62fc05fd30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.875+0000 7f630c546800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638d493f9e0 0x5638d493fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.875+0000 7f630c546800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5638d4910fe0 con 0x5638d493f9e0 2024-09-12T17:28:03.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.875+0000 7f630a838640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638d493f9e0 0x5638d493fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.875+0000 7f630a838640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638d493f9e0 0x5638d493fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:58206/0 (socket says 172.21.15.170:58206) 2024-09-12T17:28:03.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.875+0000 7f630a838640 1 -- 172.21.15.170:0/3563707514 learned_addr learned my addr 172.21.15.170:0/3563707514 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:03.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.875+0000 7f630a838640 1 -- 172.21.15.170:0/3563707514 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638d49403d0 con 0x5638d493f9e0 2024-09-12T17:28:03.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.875+0000 7f630a838640 1 --2- 172.21.15.170:0/3563707514 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638d493f9e0 0x5638d493fde0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6304053d60 tx=0x7f630401fc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=625786f7375f1584 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.875+0000 7f61edffb640 1 -- 172.21.15.170:0/3563707514 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6304021a40 con 0x5638d493f9e0 2024-09-12T17:28:03.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.875+0000 7f61edffb640 1 -- 172.21.15.170:0/3563707514 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6304021440 con 0x5638d493f9e0 2024-09-12T17:28:03.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.876+0000 7f61edffb640 1 -- 172.21.15.170:0/3563707514 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f630401f340 con 0x5638d493f9e0 2024-09-12T17:28:03.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.876+0000 7f630c546800 1 -- 172.21.15.170:0/3563707514 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638d493f9e0 msgr2=0x5638d493fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.876+0000 7f630c546800 1 --2- 172.21.15.170:0/3563707514 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638d493f9e0 0x5638d493fde0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6304053d60 tx=0x7f630401fc40 comp rx=0 tx=0).stop 2024-09-12T17:28:03.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.876+0000 7f630c546800 1 -- 172.21.15.170:0/3563707514 shutdown_connections 2024-09-12T17:28:03.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.876+0000 7f630c546800 1 --2- 172.21.15.170:0/3563707514 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638d493f9e0 0x5638d493fde0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.876+0000 7f630c546800 1 -- 172.21.15.170:0/3563707514 >> 172.21.15.170:0/3563707514 conn(0x5638d493be00 msgr2=0x5638d493a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:03.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.876+0000 7f630c546800 1 -- 172.21.15.170:0/3563707514 shutdown_connections 2024-09-12T17:28:03.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.876+0000 7f630c546800 1 -- 172.21.15.170:0/3563707514 wait complete. 2024-09-12T17:28:03.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.876+0000 7f630c546800 1 Processor -- start 2024-09-12T17:28:03.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.876+0000 7f630c546800 1 -- start start 2024-09-12T17:28:03.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.876+0000 7f630c546800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638d493f9e0 0x5638d4946fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.876+0000 7f630c546800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5638d49409f0 con 0x5638d493f9e0 2024-09-12T17:28:03.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.877+0000 7f630a838640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638d493f9e0 0x5638d4946fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.877+0000 7f630a838640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638d493f9e0 0x5638d4946fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:58214/0 (socket says 172.21.15.170:58214) 2024-09-12T17:28:03.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.877+0000 7f630a838640 1 -- 172.21.15.170:0/3834466319 learned_addr learned my addr 172.21.15.170:0/3834466319 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:03.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.877+0000 7f630a838640 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638d4947540 con 0x5638d493f9e0 2024-09-12T17:28:03.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.877+0000 7f630a838640 1 --2- 172.21.15.170:0/3834466319 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638d493f9e0 0x5638d4946fe0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6304047040 tx=0x7f6304053cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.877+0000 7f61dbfff640 1 -- 172.21.15.170:0/3834466319 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6304020800 con 0x5638d493f9e0 2024-09-12T17:28:03.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.877+0000 7f61dbfff640 1 -- 172.21.15.170:0/3834466319 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63040209a0 con 0x5638d493f9e0 2024-09-12T17:28:03.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.877+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5638d49477d0 con 0x5638d493f9e0 2024-09-12T17:28:03.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.878+0000 7f61dbfff640 1 -- 172.21.15.170:0/3834466319 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6304020c80 con 0x5638d493f9e0 2024-09-12T17:28:03.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.878+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638d4948150 con 0x5638d493f9e0 2024-09-12T17:28:03.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.878+0000 7f61dbfff640 1 -- 172.21.15.170:0/3834466319 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f630403b060 con 0x5638d493f9e0 2024-09-12T17:28:03.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.878+0000 7f61dbfff640 1 --2- 172.21.15.170:0/3834466319 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f61d403c710 0x7f61d403ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.878+0000 7f61dbfff640 1 -- 172.21.15.170:0/3834466319 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f630403e320 con 0x5638d493f9e0 2024-09-12T17:28:03.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.878+0000 7f630a037640 1 --2- 172.21.15.170:0/3834466319 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f61d403c710 0x7f61d403ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.879+0000 7f630a037640 1 --2- 172.21.15.170:0/3834466319 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f61d403c710 0x7f61d403ebd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f62fc068fd0 tx=0x7f62fc092000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.879+0000 7f630c546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.879+0000 7f630c546800 1 --2- 172.21.15.170:0/3834466319 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5638d4952a40 0x5638d4954f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.879+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638d4955650 con 0x5638d4952a40 2024-09-12T17:28:03.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.879+0000 7f6309836640 1 --2- 172.21.15.170:0/3834466319 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5638d4952a40 0x5638d4954f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.880+0000 7f6309836640 1 --2- 172.21.15.170:0/3834466319 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5638d4952a40 0x5638d4954f00 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.880+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f62f4009050 con 0x5638d4952a40 2024-09-12T17:28:03.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.880+0000 7f630c546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.880+0000 7f630c546800 20 realm 2024-09-12T17:28:03.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.880+0000 7f630c546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.880+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638d4951d90 con 0x5638d4952a40 2024-09-12T17:28:03.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.880+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f62f4009050 con 0x5638d4952a40 2024-09-12T17:28:03.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.880+0000 7f630c546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.880+0000 7f630c546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:03.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.880+0000 7f630c546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.880+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638d4956140 con 0x5638d4952a40 2024-09-12T17:28:03.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.880+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f62f4009050 con 0x5638d4952a40 2024-09-12T17:28:03.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.880+0000 7f630c546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.880+0000 7f630c546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.880+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638d4956a10 con 0x5638d4952a40 2024-09-12T17:28:03.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.880+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f62f4009050 con 0x5638d4952a40 2024-09-12T17:28:03.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.880+0000 7f630c546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:03.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.880+0000 7f630c546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.881+0000 7f630c546800 1 --2- 172.21.15.170:0/3834466319 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5638d4957430 0x5638d4959820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.881+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638d4959f60 con 0x5638d4957430 2024-09-12T17:28:03.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.881+0000 7f630a838640 1 --2- 172.21.15.170:0/3834466319 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5638d4957430 0x5638d4959820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.881+0000 7f630a838640 1 --2- 172.21.15.170:0/3834466319 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5638d4957430 0x5638d4959820 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.881+0000 7f630a838640 1 -- 172.21.15.170:0/3834466319 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f630400a4d0 con 0x5638d4957430 2024-09-12T17:28:03.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.881+0000 7f630c546800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:03.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.881+0000 7f630c546800 20 searching for the correct realm 2024-09-12T17:28:03.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.881+0000 7f630c546800 1 --2- 172.21.15.170:0/3834466319 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5638d495bf10 0x5638d495e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.881+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638d495ea50 con 0x5638d495bf10 2024-09-12T17:28:03.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.881+0000 7f630a037640 1 --2- 172.21.15.170:0/3834466319 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5638d495bf10 0x5638d495e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.882+0000 7f630a037640 1 --2- 172.21.15.170:0/3834466319 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5638d495bf10 0x5638d495e3d0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.882+0000 7f630a037640 1 -- 172.21.15.170:0/3834466319 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62fc051070 con 0x5638d495bf10 2024-09-12T17:28:03.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.882+0000 7f630a037640 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638d495ea50 con 0x5638d4957430 2024-09-12T17:28:03.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.882+0000 7f630a838640 1 -- 172.21.15.170:0/3834466319 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f630400a4d0 con 0x5638d4957430 2024-09-12T17:28:03.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.882+0000 7f630a838640 1 --2- 172.21.15.170:0/3834466319 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f630403e660 0x7f63040489d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:03.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.882+0000 7f630a838640 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638d495ea50 con 0x7f630403e660 2024-09-12T17:28:03.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.882+0000 7f6309836640 1 --2- 172.21.15.170:0/3834466319 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f630403e660 0x7f63040489d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:03.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.883+0000 7f6309836640 1 --2- 172.21.15.170:0/3834466319 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f630403e660 0x7f63040489d0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:03.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.883+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62f4009050 con 0x7f630403e660 2024-09-12T17:28:03.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.883+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638d495ea50 con 0x5638d4952a40 2024-09-12T17:28:03.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.883+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62f4009050 con 0x5638d4952a40 2024-09-12T17:28:03.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.883+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638d495ea50 con 0x5638d4952a40 2024-09-12T17:28:03.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.883+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62f4029040 con 0x5638d4952a40 2024-09-12T17:28:03.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.883+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638d495ea50 con 0x7f630403e660 2024-09-12T17:28:03.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.884+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62f4029040 con 0x7f630403e660 2024-09-12T17:28:03.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.884+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638d495ea50 con 0x7f630403e660 2024-09-12T17:28:03.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.884+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62f4029040 con 0x7f630403e660 2024-09-12T17:28:03.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.884+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638d495ea50 con 0x5638d4957430 2024-09-12T17:28:03.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.884+0000 7f630a838640 1 -- 172.21.15.170:0/3834466319 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f630400a4d0 con 0x5638d4957430 2024-09-12T17:28:03.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.884+0000 7f630a838640 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638d495ea50 con 0x5638d495bf10 2024-09-12T17:28:03.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.884+0000 7f630a037640 1 -- 172.21.15.170:0/3834466319 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62fc051070 con 0x5638d495bf10 2024-09-12T17:28:03.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.884+0000 7f630a037640 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638d495ea50 con 0x5638d4952a40 2024-09-12T17:28:03.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.885+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62f4029040 con 0x5638d4952a40 2024-09-12T17:28:03.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.885+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638d495ea50 con 0x7f630403e660 2024-09-12T17:28:03.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.885+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62f4029040 con 0x7f630403e660 2024-09-12T17:28:03.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.885+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638d495ea50 con 0x5638d4952a40 2024-09-12T17:28:03.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.885+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62f4029040 con 0x5638d4952a40 2024-09-12T17:28:03.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.885+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638d495ea50 con 0x5638d4957430 2024-09-12T17:28:03.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.885+0000 7f630a838640 1 -- 172.21.15.170:0/3834466319 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f630400a4d0 con 0x5638d4957430 2024-09-12T17:28:03.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.885+0000 7f630a838640 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638d495ea50 con 0x5638d495bf10 2024-09-12T17:28:03.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.885+0000 7f630a037640 1 -- 172.21.15.170:0/3834466319 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62fc051070 con 0x5638d495bf10 2024-09-12T17:28:03.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.885+0000 7f630a037640 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638d495ea50 con 0x5638d495bf10 2024-09-12T17:28:03.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.886+0000 7f630a037640 1 -- 172.21.15.170:0/3834466319 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62fc051070 con 0x5638d495bf10 2024-09-12T17:28:03.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.886+0000 7f630a037640 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638d495ea50 con 0x7f630403e660 2024-09-12T17:28:03.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.886+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62f4029040 con 0x7f630403e660 2024-09-12T17:28:03.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.886+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638d495ea50 con 0x5638d495bf10 2024-09-12T17:28:03.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.886+0000 7f630a037640 1 -- 172.21.15.170:0/3834466319 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62fc051070 con 0x5638d495bf10 2024-09-12T17:28:03.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.886+0000 7f630a037640 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638d495ea50 con 0x5638d495bf10 2024-09-12T17:28:03.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.886+0000 7f630a037640 1 -- 172.21.15.170:0/3834466319 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62fc051070 con 0x5638d495bf10 2024-09-12T17:28:03.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.886+0000 7f630a037640 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638d495ea50 con 0x5638d4952a40 2024-09-12T17:28:03.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.887+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62f4029040 con 0x5638d4952a40 2024-09-12T17:28:03.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.887+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638d495ea50 con 0x5638d4952a40 2024-09-12T17:28:03.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.887+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f62f4029040 con 0x5638d4952a40 2024-09-12T17:28:03.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.887+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638d495ea50 con 0x7f630403e660 2024-09-12T17:28:03.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.887+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62f4029040 con 0x7f630403e660 2024-09-12T17:28:03.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.887+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638d495ea50 con 0x5638d495bf10 2024-09-12T17:28:03.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.887+0000 7f630a037640 1 -- 172.21.15.170:0/3834466319 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62fc051070 con 0x5638d495bf10 2024-09-12T17:28:03.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.887+0000 7f630a037640 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638d495ea50 con 0x5638d4957430 2024-09-12T17:28:03.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.888+0000 7f630a838640 1 -- 172.21.15.170:0/3834466319 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f630400a4d0 con 0x5638d4957430 2024-09-12T17:28:03.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.888+0000 7f630a838640 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638d495ea50 con 0x5638d4952a40 2024-09-12T17:28:03.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.888+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62f4029040 con 0x5638d4952a40 2024-09-12T17:28:03.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.888+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638d495ea50 con 0x7f630403e660 2024-09-12T17:28:03.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.888+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62f4029040 con 0x7f630403e660 2024-09-12T17:28:03.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.888+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638d495ea50 con 0x5638d495bf10 2024-09-12T17:28:03.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.889+0000 7f630a037640 1 -- 172.21.15.170:0/3834466319 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62fc051070 con 0x5638d495bf10 2024-09-12T17:28:03.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.889+0000 7f630a037640 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638d495ea50 con 0x7f630403e660 2024-09-12T17:28:03.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.889+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62f4029040 con 0x7f630403e660 2024-09-12T17:28:03.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.889+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638d495ea50 con 0x5638d4957430 2024-09-12T17:28:03.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.889+0000 7f630a838640 1 -- 172.21.15.170:0/3834466319 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f630400a4d0 con 0x5638d4957430 2024-09-12T17:28:03.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.889+0000 7f630a838640 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638d495ea50 con 0x5638d495bf10 2024-09-12T17:28:03.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.889+0000 7f630a037640 1 -- 172.21.15.170:0/3834466319 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62fc051070 con 0x5638d495bf10 2024-09-12T17:28:03.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.889+0000 7f630a037640 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638d495ea50 con 0x7f630403e660 2024-09-12T17:28:03.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.890+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62f4029040 con 0x7f630403e660 2024-09-12T17:28:03.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.890+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638d495ea50 con 0x5638d4952a40 2024-09-12T17:28:03.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.890+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f62f4029040 con 0x5638d4952a40 2024-09-12T17:28:03.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.890+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638d495ea50 con 0x5638d4957430 2024-09-12T17:28:03.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.890+0000 7f630a838640 1 -- 172.21.15.170:0/3834466319 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f630406a040 con 0x5638d4957430 2024-09-12T17:28:03.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.890+0000 7f630c546800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:03.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.890+0000 7f630c546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:03.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.890+0000 7f630c546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:03.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.890+0000 7f630c546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:03.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.890+0000 7f630c546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:03.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.890+0000 7f630c546800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:03.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.890+0000 7f630c546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.890+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638d495a920 con 0x5638d4952a40 2024-09-12T17:28:03.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.890+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f62f4029040 con 0x5638d4952a40 2024-09-12T17:28:03.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.890+0000 7f630c546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.890+0000 7f630c546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.890+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638d495a560 con 0x5638d4952a40 2024-09-12T17:28:03.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.890+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f62f4029040 con 0x5638d4952a40 2024-09-12T17:28:03.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.890+0000 7f630c546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:03.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.890+0000 7f630c546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.890+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638d495ad60 con 0x5638d4957430 2024-09-12T17:28:03.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.891+0000 7f630a838640 1 -- 172.21.15.170:0/3834466319 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f630406a040 con 0x5638d4957430 2024-09-12T17:28:03.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.891+0000 7f630c546800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:03.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.891+0000 7f630c546800 20 zone default found 2024-09-12T17:28:03.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.891+0000 7f630c546800 4 Realm: () 2024-09-12T17:28:03.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.891+0000 7f630c546800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:03.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.891+0000 7f630c546800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:03.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.891+0000 7f630c546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:03.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.891+0000 7f630c546800 20 zonegroup default 2024-09-12T17:28:03.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.891+0000 7f630c546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.891+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638d495f380 con 0x7f630403e660 2024-09-12T17:28:03.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.891+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f62f4029040 con 0x7f630403e660 2024-09-12T17:28:03.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.891+0000 7f630c546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.891+0000 7f630c546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.891+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638d49615c0 con 0x5638d495bf10 2024-09-12T17:28:03.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.891+0000 7f630a037640 1 -- 172.21.15.170:0/3834466319 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f62fc051070 con 0x5638d495bf10 2024-09-12T17:28:03.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.891+0000 7f630c546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.891+0000 7f630c546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.891+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638d4961960 con 0x5638d495bf10 2024-09-12T17:28:03.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.892+0000 7f630a037640 1 -- 172.21.15.170:0/3834466319 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f62fc051070 con 0x5638d495bf10 2024-09-12T17:28:03.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.892+0000 7f630c546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:03.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.892+0000 7f630c546800 20 started sync module instance, tier type = 2024-09-12T17:28:03.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.892+0000 7f630c546800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:03.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.892+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d4960a50 con 0x5638d4957430 2024-09-12T17:28:03.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.893+0000 7f630a838640 1 -- 172.21.15.170:0/3834466319 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f630406a040 con 0x5638d4957430 2024-09-12T17:28:03.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.893+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94802084761152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d49606b0 con 0x5638d4957430 2024-09-12T17:28:03.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.893+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d49627d0 con 0x5638d4952a40 2024-09-12T17:28:03.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.894+0000 7f630a838640 1 -- 172.21.15.170:0/3834466319 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94802084761152] v29'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f630406a040 con 0x5638d4957430 2024-09-12T17:28:03.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.894+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62f4029040 con 0x5638d4952a40 2024-09-12T17:28:03.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.894+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94802084764928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d49627d0 con 0x5638d4952a40 2024-09-12T17:28:03.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.894+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d49631d0 con 0x5638d495bf10 2024-09-12T17:28:03.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.895+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94802084764928] v29'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62f4029040 con 0x5638d4952a40 2024-09-12T17:28:03.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.895+0000 7f630a037640 1 -- 172.21.15.170:0/3834466319 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62fc051070 con 0x5638d495bf10 2024-09-12T17:28:03.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.895+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94802084766496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d4962740 con 0x5638d495bf10 2024-09-12T17:28:03.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.895+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d49640c0 con 0x5638d4957430 2024-09-12T17:28:03.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.896+0000 7f630a037640 1 -- 172.21.15.170:0/3834466319 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94802084766496] v29'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62fc051070 con 0x5638d495bf10 2024-09-12T17:28:03.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.896+0000 7f630a838640 1 -- 172.21.15.170:0/3834466319 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f630406a040 con 0x5638d4957430 2024-09-12T17:28:03.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.896+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94802084771312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d49640c0 con 0x5638d4957430 2024-09-12T17:28:03.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.896+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d4964b50 con 0x5638d4952a40 2024-09-12T17:28:03.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.897+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62f4029040 con 0x5638d4952a40 2024-09-12T17:28:03.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.897+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94802084775456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d4964b10 con 0x5638d4952a40 2024-09-12T17:28:03.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.897+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d4965b00 con 0x7f630403e660 2024-09-12T17:28:03.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.897+0000 7f630a838640 1 -- 172.21.15.170:0/3834466319 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94802084771312] v29'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f630406a040 con 0x5638d4957430 2024-09-12T17:28:03.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.898+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94802084775456] v29'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62f4029040 con 0x5638d4952a40 2024-09-12T17:28:03.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.898+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62f4029040 con 0x7f630403e660 2024-09-12T17:28:03.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.898+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94802084779536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d4964cf0 con 0x7f630403e660 2024-09-12T17:28:03.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.898+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d49663d0 con 0x7f630403e660 2024-09-12T17:28:03.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.899+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94802084779536] v29'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62f4029040 con 0x7f630403e660 2024-09-12T17:28:03.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.899+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(56 notify.6 [create] v29'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62f4029040 con 0x7f630403e660 2024-09-12T17:28:03.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.899+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94802084772880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d4964cf0 con 0x7f630403e660 2024-09-12T17:28:03.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.899+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d49669f0 con 0x7f630403e660 2024-09-12T17:28:03.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.900+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94802084772880] v29'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62f4029040 con 0x7f630403e660 2024-09-12T17:28:03.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.900+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(58 notify.7 [create] v29'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62f4029040 con 0x7f630403e660 2024-09-12T17:28:03.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.900+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94802084781712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d49669f0 con 0x7f630403e660 2024-09-12T17:28:03.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.900+0000 7f630c546800 20 add_watcher() i=0 2024-09-12T17:28:03.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.900+0000 7f630c546800 20 add_watcher() i=1 2024-09-12T17:28:03.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.900+0000 7f630c546800 20 add_watcher() i=2 2024-09-12T17:28:03.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.900+0000 7f630c546800 20 add_watcher() i=3 2024-09-12T17:28:03.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.900+0000 7f630c546800 20 add_watcher() i=4 2024-09-12T17:28:03.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.900+0000 7f630c546800 20 add_watcher() i=5 2024-09-12T17:28:03.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.900+0000 7f630c546800 20 add_watcher() i=6 2024-09-12T17:28:03.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.901+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94802084781712] v29'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62f4029040 con 0x7f630403e660 2024-09-12T17:28:03.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.901+0000 7f630c546800 20 add_watcher() i=7 2024-09-12T17:28:03.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.901+0000 7f630c546800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:03.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.901+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638d4969cd0 con 0x5638d4952a40 2024-09-12T17:28:03.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.902+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f62f4029040 con 0x5638d4952a40 2024-09-12T17:28:03.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.902+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94802084783792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d4966f80 con 0x5638d4952a40 2024-09-12T17:28:03.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.903+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94802084783792] v29'112 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f62f4029040 con 0x5638d4952a40 2024-09-12T17:28:03.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.903+0000 7f61c0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:03.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.903+0000 7f630c546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:03.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.903+0000 7f630c546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:03.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.903+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d4972500 con 0x5638d4952a40 2024-09-12T17:28:03.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.904+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f62f4029040 con 0x5638d4952a40 2024-09-12T17:28:03.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.904+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d4972bd0 con 0x7f630403e660 2024-09-12T17:28:03.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.905+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f62f4029040 con 0x7f630403e660 2024-09-12T17:28:03.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.905+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d4973030 con 0x5638d495bf10 2024-09-12T17:28:03.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.906+0000 7f630a037640 1 -- 172.21.15.170:0/3834466319 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f62fc051070 con 0x5638d495bf10 2024-09-12T17:28:03.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.906+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d49735a0 con 0x5638d4952a40 2024-09-12T17:28:03.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.907+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'113 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f62f4029040 con 0x5638d4952a40 2024-09-12T17:28:03.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.907+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d4973a50 con 0x5638d4957430 2024-09-12T17:28:03.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.908+0000 7f630a838640 1 -- 172.21.15.170:0/3834466319 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'32 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f630406a040 con 0x5638d4957430 2024-09-12T17:28:03.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.908+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d4973a50 con 0x5638d495bf10 2024-09-12T17:28:03.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.909+0000 7f630a037640 1 -- 172.21.15.170:0/3834466319 <== osd.3 v2:172.21.15.170:6816/2664906588 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'21 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f62fc051070 con 0x5638d495bf10 2024-09-12T17:28:03.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.909+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d49703e0 con 0x5638d4952a40 2024-09-12T17:28:03.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.910+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f62f4029040 con 0x5638d4952a40 2024-09-12T17:28:03.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.910+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d49703e0 con 0x7f630403e660 2024-09-12T17:28:03.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.911+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'21 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f62f4029040 con 0x7f630403e660 2024-09-12T17:28:03.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.911+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d4970210 con 0x5638d4957430 2024-09-12T17:28:03.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.912+0000 7f630a838640 1 -- 172.21.15.170:0/3834466319 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f630406a040 con 0x5638d4957430 2024-09-12T17:28:03.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.912+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d4970320 con 0x5638d495bf10 2024-09-12T17:28:03.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.913+0000 7f630a037640 1 -- 172.21.15.170:0/3834466319 <== osd.3 v2:172.21.15.170:6816/2664906588 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f62fc051070 con 0x5638d495bf10 2024-09-12T17:28:03.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.913+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d4970320 con 0x5638d4957430 2024-09-12T17:28:03.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.914+0000 7f630a838640 1 -- 172.21.15.170:0/3834466319 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'33 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f630406a040 con 0x5638d4957430 2024-09-12T17:28:03.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.914+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d4970320 con 0x7f630403e660 2024-09-12T17:28:03.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.915+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62f4029040 con 0x7f630403e660 2024-09-12T17:28:03.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.915+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d4970320 con 0x5638d4957430 2024-09-12T17:28:03.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.916+0000 7f630a838640 1 -- 172.21.15.170:0/3834466319 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f630406a040 con 0x5638d4957430 2024-09-12T17:28:03.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.916+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d4970320 con 0x7f630403e660 2024-09-12T17:28:03.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.917+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'27 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62f4029040 con 0x7f630403e660 2024-09-12T17:28:03.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.917+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d4970320 con 0x5638d4952a40 2024-09-12T17:28:03.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.918+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'114 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62f4029040 con 0x5638d4952a40 2024-09-12T17:28:03.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.918+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d4970320 con 0x5638d495bf10 2024-09-12T17:28:03.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.919+0000 7f630a037640 1 -- 172.21.15.170:0/3834466319 <== osd.3 v2:172.21.15.170:6816/2664906588 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62fc051070 con 0x5638d495bf10 2024-09-12T17:28:03.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.919+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d4970320 con 0x5638d4957430 2024-09-12T17:28:03.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.920+0000 7f630a838640 1 -- 172.21.15.170:0/3834466319 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'34 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f630406a040 con 0x5638d4957430 2024-09-12T17:28:03.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.920+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d4970320 con 0x5638d495bf10 2024-09-12T17:28:03.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.921+0000 7f630a037640 1 -- 172.21.15.170:0/3834466319 <== osd.3 v2:172.21.15.170:6816/2664906588 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62fc051070 con 0x5638d495bf10 2024-09-12T17:28:03.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.921+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d4970320 con 0x5638d4952a40 2024-09-12T17:28:03.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.922+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62f4029040 con 0x5638d4952a40 2024-09-12T17:28:03.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.922+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d4970320 con 0x5638d4952a40 2024-09-12T17:28:03.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.923+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'115 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62f4029040 con 0x5638d4952a40 2024-09-12T17:28:03.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.923+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d4970320 con 0x5638d495bf10 2024-09-12T17:28:03.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.924+0000 7f630a037640 1 -- 172.21.15.170:0/3834466319 <== osd.3 v2:172.21.15.170:6816/2664906588 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62fc051070 con 0x5638d495bf10 2024-09-12T17:28:03.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.924+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d4970320 con 0x5638d4957430 2024-09-12T17:28:03.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.925+0000 7f630a838640 1 -- 172.21.15.170:0/3834466319 <== osd.2 v2:172.21.15.170:6808/3855567754 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'25 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f630406a040 con 0x5638d4957430 2024-09-12T17:28:03.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.925+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d4970320 con 0x5638d495bf10 2024-09-12T17:28:03.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.926+0000 7f630a037640 1 -- 172.21.15.170:0/3834466319 <== osd.3 v2:172.21.15.170:6816/2664906588 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62fc051070 con 0x5638d495bf10 2024-09-12T17:28:03.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.926+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d4970320 con 0x5638d495bf10 2024-09-12T17:28:03.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.927+0000 7f630a037640 1 -- 172.21.15.170:0/3834466319 <== osd.3 v2:172.21.15.170:6816/2664906588 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62fc051070 con 0x5638d495bf10 2024-09-12T17:28:03.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.927+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d4970320 con 0x5638d495bf10 2024-09-12T17:28:03.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.928+0000 7f630a037640 1 -- 172.21.15.170:0/3834466319 <== osd.3 v2:172.21.15.170:6816/2664906588 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62fc051070 con 0x5638d495bf10 2024-09-12T17:28:03.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.928+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d4970320 con 0x5638d495bf10 2024-09-12T17:28:03.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.929+0000 7f630a037640 1 -- 172.21.15.170:0/3834466319 <== osd.3 v2:172.21.15.170:6816/2664906588 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62fc051070 con 0x5638d495bf10 2024-09-12T17:28:03.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.929+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d4970320 con 0x7f630403e660 2024-09-12T17:28:03.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.930+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62f4029040 con 0x7f630403e660 2024-09-12T17:28:03.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.930+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d4974610 con 0x5638d495bf10 2024-09-12T17:28:03.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.931+0000 7f630a037640 1 -- 172.21.15.170:0/3834466319 <== osd.3 v2:172.21.15.170:6816/2664906588 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62fc051070 con 0x5638d495bf10 2024-09-12T17:28:03.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.931+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d49745f0 con 0x7f630403e660 2024-09-12T17:28:03.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.933+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.0 v2:172.21.15.47:6800/3978157098 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62f4029040 con 0x7f630403e660 2024-09-12T17:28:03.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.933+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d49745f0 con 0x5638d495bf10 2024-09-12T17:28:03.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.933+0000 7f630a037640 1 -- 172.21.15.170:0/3834466319 <== osd.3 v2:172.21.15.170:6816/2664906588 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'28 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62fc051070 con 0x5638d495bf10 2024-09-12T17:28:03.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.934+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d49745d0 con 0x7f630403e660 2024-09-12T17:28:03.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.935+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.0 v2:172.21.15.47:6800/3978157098 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'28 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62f4029040 con 0x7f630403e660 2024-09-12T17:28:03.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.935+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d49745b0 con 0x5638d4957430 2024-09-12T17:28:03.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.936+0000 7f630a838640 1 -- 172.21.15.170:0/3834466319 <== osd.2 v2:172.21.15.170:6808/3855567754 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f630406a040 con 0x5638d4957430 2024-09-12T17:28:03.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.936+0000 7f613b7fe640 20 reqs_thread_entry: start 2024-09-12T17:28:03.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.936+0000 7f630c546800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:03.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.936+0000 7f630c546800 20 Filter name: none 2024-09-12T17:28:03.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.936+0000 7f61397fa640 20 reqs_thread_entry: start 2024-09-12T17:28:03.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.936+0000 7f630c546800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-12T17:28:03.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.936+0000 7f630c546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:03.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.936+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638d499ee80 con 0x7f630403e660 2024-09-12T17:28:03.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.937+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.0 v2:172.21.15.47:6800/3978157098 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f62f4029040 con 0x7f630403e660 2024-09-12T17:28:03.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.937+0000 7f630c546800 20 rados_obj.operate() r=0 bl.length=380 2024-09-12T17:28:03.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.937+0000 7f630c546800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-12T17:28:03.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.937+0000 7f630c546800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T17:28:03.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.937+0000 7f630c546800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:03.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.937+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638d49a1740 con 0x7f630403e660 2024-09-12T17:28:03.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.937+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.0 v2:172.21.15.47:6800/3978157098 25 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f62f4029040 con 0x7f630403e660 2024-09-12T17:28:03.941 INFO:teuthology.orchestra.run.smithi170.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-12T17:28:03.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.938+0000 7f61c0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:03.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.938+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94802084783792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d4968bb0 con 0x5638d4952a40 2024-09-12T17:28:03.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.939+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94802084783792] v29'116 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f62f4029040 con 0x5638d4952a40 2024-09-12T17:28:03.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.939+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94802084761152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d49666b0 con 0x5638d4957430 2024-09-12T17:28:03.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.940+0000 7f630a838640 1 -- 172.21.15.170:0/3834466319 <== osd.2 v2:172.21.15.170:6808/3855567754 20 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94802084761152] v29'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f630406a040 con 0x5638d4957430 2024-09-12T17:28:03.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.940+0000 7f630c546800 20 remove_watcher() i=0 2024-09-12T17:28:03.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.940+0000 7f630c546800 2 removed watcher, disabling cache 2024-09-12T17:28:03.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.940+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94802084764928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d49666b0 con 0x5638d4952a40 2024-09-12T17:28:03.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.941+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94802084764928] v29'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62f4029040 con 0x5638d4952a40 2024-09-12T17:28:03.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.941+0000 7f630c546800 20 remove_watcher() i=1 2024-09-12T17:28:03.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.941+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94802084766496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d4961d00 con 0x5638d495bf10 2024-09-12T17:28:03.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.942+0000 7f630a037640 1 -- 172.21.15.170:0/3834466319 <== osd.3 v2:172.21.15.170:6816/2664906588 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94802084766496] v29'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62fc051070 con 0x5638d495bf10 2024-09-12T17:28:03.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.942+0000 7f630c546800 20 remove_watcher() i=2 2024-09-12T17:28:03.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.942+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94802084771312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d49666b0 con 0x5638d4957430 2024-09-12T17:28:03.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.943+0000 7f630a838640 1 -- 172.21.15.170:0/3834466319 <== osd.2 v2:172.21.15.170:6808/3855567754 21 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94802084771312] v29'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f630406a040 con 0x5638d4957430 2024-09-12T17:28:03.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.943+0000 7f630c546800 20 remove_watcher() i=3 2024-09-12T17:28:03.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.943+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94802084775456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d4962320 con 0x5638d4952a40 2024-09-12T17:28:03.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.944+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94802084775456] v29'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62f4029040 con 0x5638d4952a40 2024-09-12T17:28:03.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.944+0000 7f630c546800 20 remove_watcher() i=4 2024-09-12T17:28:03.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.944+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94802084779536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d49635f0 con 0x7f630403e660 2024-09-12T17:28:03.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.945+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.0 v2:172.21.15.47:6800/3978157098 26 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94802084779536] v29'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62f4029040 con 0x7f630403e660 2024-09-12T17:28:03.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.945+0000 7f630c546800 20 remove_watcher() i=5 2024-09-12T17:28:03.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.945+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94802084772880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d49666b0 con 0x7f630403e660 2024-09-12T17:28:03.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.946+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.0 v2:172.21.15.47:6800/3978157098 27 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94802084772880] v29'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62f4029040 con 0x7f630403e660 2024-09-12T17:28:03.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.946+0000 7f630c546800 20 remove_watcher() i=6 2024-09-12T17:28:03.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.946+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94802084781712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638d4962320 con 0x7f630403e660 2024-09-12T17:28:03.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.947+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 <== osd.0 v2:172.21.15.47:6800/3978157098 28 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94802084781712] v29'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62f4029040 con 0x7f630403e660 2024-09-12T17:28:03.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.947+0000 7f630c546800 20 remove_watcher() i=7 2024-09-12T17:28:03.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.947+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f630403e660 msgr2=0x7f63040489d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.947+0000 7f630c546800 1 --2- 172.21.15.170:0/3834466319 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f630403e660 0x7f63040489d0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.947+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5638d4952a40 msgr2=0x5638d4954f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.947+0000 7f630c546800 1 --2- 172.21.15.170:0/3834466319 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5638d4952a40 0x5638d4954f00 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.947+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5638d4957430 msgr2=0x5638d4959820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.947+0000 7f630c546800 1 --2- 172.21.15.170:0/3834466319 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5638d4957430 0x5638d4959820 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.947+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5638d495bf10 msgr2=0x5638d495e3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.947+0000 7f630c546800 1 --2- 172.21.15.170:0/3834466319 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5638d495bf10 0x5638d495e3d0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.947+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f61d403c710 msgr2=0x7f61d403ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.947+0000 7f630c546800 1 --2- 172.21.15.170:0/3834466319 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f61d403c710 0x7f61d403ebd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f62fc068fd0 tx=0x7f62fc092000 comp rx=0 tx=0).stop 2024-09-12T17:28:03.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.947+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638d493f9e0 msgr2=0x5638d4946fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.947+0000 7f6309836640 1 -- 172.21.15.170:0/3834466319 reap_dead start 2024-09-12T17:28:03.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.947+0000 7f630c546800 1 --2- 172.21.15.170:0/3834466319 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638d493f9e0 0x5638d4946fe0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6304047040 tx=0x7f6304053cc0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.947+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 shutdown_connections 2024-09-12T17:28:03.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.947+0000 7f630c546800 1 --2- 172.21.15.170:0/3834466319 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638d493f9e0 0x5638d4946fe0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.947+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 >> 172.21.15.170:0/3834466319 conn(0x5638d493be00 msgr2=0x5638d493a010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:03.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.948+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 shutdown_connections 2024-09-12T17:28:03.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.948+0000 7f630c546800 1 -- 172.21.15.170:0/3834466319 wait complete. 2024-09-12T17:28:03.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.948+0000 7f630c546800 1 -- 172.21.15.170:0/3711600912 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f61e403c730 msgr2=0x7f61e403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.948+0000 7f630c546800 1 --2- 172.21.15.170:0/3711600912 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f61e403c730 0x7f61e403ebf0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f62fc096410 tx=0x7f62fc05fd30 comp rx=0 tx=0).stop 2024-09-12T17:28:03.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.948+0000 7f630c546800 1 -- 172.21.15.170:0/3711600912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638d4932ee0 msgr2=0x5638d4933300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.948+0000 7f630c546800 1 --2- 172.21.15.170:0/3711600912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638d4932ee0 0x5638d4933300 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x5638d4918ff0 tx=0x7f63040167b0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.948+0000 7f630c546800 1 -- 172.21.15.170:0/3711600912 shutdown_connections 2024-09-12T17:28:03.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.948+0000 7f630c546800 1 --2- 172.21.15.170:0/3711600912 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f61e403c730 0x7f61e403ebf0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.948+0000 7f630c546800 1 --2- 172.21.15.170:0/3711600912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638d4932ee0 0x5638d4933300 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.948+0000 7f630c546800 1 -- 172.21.15.170:0/3711600912 >> 172.21.15.170:0/3711600912 conn(0x5638d4927290 msgr2=0x5638d4927670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:03.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.948+0000 7f630c546800 1 -- 172.21.15.170:0/3711600912 shutdown_connections 2024-09-12T17:28:03.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.948+0000 7f630c546800 1 -- 172.21.15.170:0/3711600912 wait complete. 2024-09-12T17:28:03.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.948+0000 7f630c546800 1 -- 172.21.15.170:0/1159999204 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5638d4794b60 msgr2=0x5638d491f640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.948+0000 7f630c546800 1 --2- 172.21.15.170:0/1159999204 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5638d4794b60 0x5638d491f640 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.948+0000 7f630c546800 1 -- 172.21.15.170:0/1159999204 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5638d4921a20 msgr2=0x5638d4923ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.948+0000 7f630c546800 1 --2- 172.21.15.170:0/1159999204 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5638d4921a20 0x5638d4923ea0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.948+0000 7f630c546800 1 -- 172.21.15.170:0/1159999204 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f61f003c730 msgr2=0x7f61f003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.948+0000 7f630c546800 1 --2- 172.21.15.170:0/1159999204 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f61f003c730 0x7f61f003ebf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f62f4001d70 tx=0x7f62f40012d0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.948+0000 7f630c546800 1 -- 172.21.15.170:0/1159999204 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638d4793600 msgr2=0x5638d4917ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:03.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.948+0000 7f630c546800 1 --2- 172.21.15.170:0/1159999204 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638d4793600 0x5638d4917ff0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f62fc025c20 tx=0x7f62fc002fb0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.948+0000 7f630c546800 1 -- 172.21.15.170:0/1159999204 shutdown_connections 2024-09-12T17:28:03.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.948+0000 7f630c546800 1 --2- 172.21.15.170:0/1159999204 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5638d4921a20 0x5638d4923ea0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.948+0000 7f630c546800 1 --2- 172.21.15.170:0/1159999204 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f61f003c730 0x7f61f003ebf0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.948+0000 7f630c546800 1 --2- 172.21.15.170:0/1159999204 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5638d4794b60 0x5638d491f640 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.948+0000 7f630c546800 1 --2- 172.21.15.170:0/1159999204 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5638d4793600 0x5638d4917ff0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:03.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.948+0000 7f630c546800 1 -- 172.21.15.170:0/1159999204 >> 172.21.15.170:0/1159999204 conn(0x5638d481a3c0 msgr2=0x5638d490a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:03.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.949+0000 7f630c546800 1 -- 172.21.15.170:0/1159999204 shutdown_connections 2024-09-12T17:28:03.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:03.949+0000 7f630c546800 1 -- 172.21.15.170:0/1159999204 wait complete. 2024-09-12T17:28:03.959 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-12T17:28:03.959 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-12T17:28:03.960 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-12T17:28:03.960 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-09-12T17:28:04.006 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:04.007 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:04.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.005+0000 7f4254a40800 1 Processor -- start 2024-09-12T17:28:04.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.005+0000 7f4254a40800 1 -- start start 2024-09-12T17:28:04.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.005+0000 7f4254a40800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55c3592354b0 0x55c3592358b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.005+0000 7f4254a40800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c3590e0e40 con 0x55c359235df0 2024-09-12T17:28:04.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.005+0000 7f4254a40800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x55c3590ab680 con 0x55c3592354b0 2024-09-12T17:28:04.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.005+0000 7f425252a640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55c3592354b0 0x55c3592358b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.005+0000 7f425252a640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55c3592354b0 0x55c3592358b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:58220/0 (socket says 172.21.15.170:58220) 2024-09-12T17:28:04.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.005+0000 7f424bfff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x55c359235df0 0x55c3592362a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:48514/0 (socket says 172.21.15.170:48514) 2024-09-12T17:28:04.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.005+0000 7f425252a640 1 -- 172.21.15.170:0/2886910563 learned_addr learned my addr 172.21.15.170:0/2886910563 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:04.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.006+0000 7f425252a640 1 -- 172.21.15.170:0/2886910563 >> v1:172.21.15.47:6789/0 conn(0x55c359235df0 legacy=0x55c3592362a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.006+0000 7f425252a640 1 -- 172.21.15.170:0/2886910563 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3590c76b0 con 0x55c3592354b0 2024-09-12T17:28:04.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.008+0000 7f425252a640 1 --2- 172.21.15.170:0/2886910563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3592354b0 0x55c3592358b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f424400a520 tx=0x7f4244045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65069ec5172a63d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.008+0000 7f4251d29640 1 -- 172.21.15.170:0/2886910563 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4244055070 con 0x55c3592354b0 2024-09-12T17:28:04.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.008+0000 7f4251d29640 1 -- 172.21.15.170:0/2886910563 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42440515b0 con 0x55c3592354b0 2024-09-12T17:28:04.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.008+0000 7f4251d29640 1 -- 172.21.15.170:0/2886910563 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42440518d0 con 0x55c3592354b0 2024-09-12T17:28:04.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.008+0000 7f4254a40800 1 -- 172.21.15.170:0/2886910563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3592354b0 msgr2=0x55c3592358b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.008+0000 7f4254a40800 1 --2- 172.21.15.170:0/2886910563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3592354b0 0x55c3592358b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f424400a520 tx=0x7f4244045ba0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.008+0000 7f4254a40800 1 -- 172.21.15.170:0/2886910563 shutdown_connections 2024-09-12T17:28:04.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.008+0000 7f4254a40800 1 --2- 172.21.15.170:0/2886910563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3592354b0 0x55c3592358b0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.008+0000 7f4254a40800 1 -- 172.21.15.170:0/2886910563 >> 172.21.15.170:0/2886910563 conn(0x55c359231200 msgr2=0x55c359233640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:04.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.009+0000 7f4254a40800 1 -- 172.21.15.170:0/2886910563 shutdown_connections 2024-09-12T17:28:04.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.009+0000 7f4254a40800 1 -- 172.21.15.170:0/2886910563 wait complete. 2024-09-12T17:28:04.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.022+0000 7f4254a40800 1 Processor -- start 2024-09-12T17:28:04.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.022+0000 7f4254a40800 1 -- start start 2024-09-12T17:28:04.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.023+0000 7f4254a40800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3592354b0 0x55c359328820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.023+0000 7f4254a40800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c3590cfdd0 con 0x55c3592354b0 2024-09-12T17:28:04.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.023+0000 7f425252a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3592354b0 0x55c359328820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.023+0000 7f425252a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3592354b0 0x55c359328820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:58236/0 (socket says 172.21.15.170:58236) 2024-09-12T17:28:04.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.023+0000 7f425252a640 1 -- 172.21.15.170:0/3323889265 learned_addr learned my addr 172.21.15.170:0/3323889265 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:04.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.023+0000 7f425252a640 1 -- 172.21.15.170:0/3323889265 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3590e8e10 con 0x55c3592354b0 2024-09-12T17:28:04.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.023+0000 7f425252a640 1 --2- 172.21.15.170:0/3323889265 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3592354b0 0x55c359328820 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f42440460d0 tx=0x7f4244051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b12dca8f25e67d44 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.023+0000 7f4140608640 1 -- 172.21.15.170:0/3323889265 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42440519d0 con 0x55c3592354b0 2024-09-12T17:28:04.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.023+0000 7f4140608640 1 -- 172.21.15.170:0/3323889265 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4244051b70 con 0x55c3592354b0 2024-09-12T17:28:04.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.023+0000 7f4140608640 1 -- 172.21.15.170:0/3323889265 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4244051e50 con 0x55c3592354b0 2024-09-12T17:28:04.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.024+0000 7f4254a40800 1 -- 172.21.15.170:0/3323889265 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3592354b0 msgr2=0x55c359328820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.024+0000 7f4254a40800 1 --2- 172.21.15.170:0/3323889265 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3592354b0 0x55c359328820 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f42440460d0 tx=0x7f4244051000 comp rx=0 tx=0).stop 2024-09-12T17:28:04.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.024+0000 7f4254a40800 1 -- 172.21.15.170:0/3323889265 shutdown_connections 2024-09-12T17:28:04.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.024+0000 7f4254a40800 1 --2- 172.21.15.170:0/3323889265 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3592354b0 0x55c359328820 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.024+0000 7f4254a40800 1 -- 172.21.15.170:0/3323889265 >> 172.21.15.170:0/3323889265 conn(0x55c359231200 msgr2=0x55c3593241a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:04.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.024+0000 7f4254a40800 1 -- 172.21.15.170:0/3323889265 shutdown_connections 2024-09-12T17:28:04.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.024+0000 7f4254a40800 1 -- 172.21.15.170:0/3323889265 wait complete. 2024-09-12T17:28:04.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.024+0000 7f4254a40800 1 Processor -- start 2024-09-12T17:28:04.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.025+0000 7f4254a40800 1 -- start start 2024-09-12T17:28:04.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.025+0000 7f4254a40800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3592354b0 0x55c359330040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.025+0000 7f4254a40800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c359236d70 con 0x55c3592354b0 2024-09-12T17:28:04.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.025+0000 7f425252a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3592354b0 0x55c359330040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.025+0000 7f425252a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3592354b0 0x55c359330040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:58250/0 (socket says 172.21.15.170:58250) 2024-09-12T17:28:04.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.025+0000 7f425252a640 1 -- 172.21.15.170:0/1475014927 learned_addr learned my addr 172.21.15.170:0/1475014927 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:04.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.025+0000 7f425252a640 1 -- 172.21.15.170:0/1475014927 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3593305a0 con 0x55c3592354b0 2024-09-12T17:28:04.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.025+0000 7f425252a640 1 --2- 172.21.15.170:0/1475014927 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3592354b0 0x55c359330040 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f42440460d0 tx=0x7f4244002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.025+0000 7f413ee05640 1 -- 172.21.15.170:0/1475014927 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4244073020 con 0x55c3592354b0 2024-09-12T17:28:04.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.025+0000 7f413ee05640 1 -- 172.21.15.170:0/1475014927 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f424406f580 con 0x55c3592354b0 2024-09-12T17:28:04.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.025+0000 7f413ee05640 1 -- 172.21.15.170:0/1475014927 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f424406f8a0 con 0x55c3592354b0 2024-09-12T17:28:04.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.026+0000 7f4254a40800 1 -- 172.21.15.170:0/1475014927 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c359330830 con 0x55c3592354b0 2024-09-12T17:28:04.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.026+0000 7f4254a40800 1 -- 172.21.15.170:0/1475014927 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c359331440 con 0x55c3592354b0 2024-09-12T17:28:04.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.026+0000 7f413ee05640 1 -- 172.21.15.170:0/1475014927 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f4244076020 con 0x55c3592354b0 2024-09-12T17:28:04.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.027+0000 7f413ee05640 1 --2- 172.21.15.170:0/1475014927 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f413803c730 0x7f413803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.027+0000 7f413ee05640 1 -- 172.21.15.170:0/1475014927 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f424406b040 con 0x55c3592354b0 2024-09-12T17:28:04.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.027+0000 7f424bfff640 1 --2- 172.21.15.170:0/1475014927 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f413803c730 0x7f413803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.027+0000 7f4254a40800 1 --2- 172.21.15.170:0/1475014927 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55c359235df0 0x55c359337690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.027+0000 7f4254a40800 1 -- 172.21.15.170:0/1475014927 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c359337bd0 con 0x55c359235df0 2024-09-12T17:28:04.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.027+0000 7f4252d2b640 1 --2- 172.21.15.170:0/1475014927 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55c359235df0 0x55c359337690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.027+0000 7f424bfff640 1 --2- 172.21.15.170:0/1475014927 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f413803c730 0x7f413803ebf0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f423c001e30 tx=0x7f423c001390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.027+0000 7f4252d2b640 1 --2- 172.21.15.170:0/1475014927 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55c359235df0 0x55c359337690 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.027+0000 7f4252d2b640 1 -- 172.21.15.170:0/1475014927 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f424c00a4d0 con 0x55c359235df0 2024-09-12T17:28:04.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.028+0000 7f4254a40800 1 -- 172.21.15.170:0/1475014927 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c359337f70 con 0x55c359235df0 2024-09-12T17:28:04.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.028+0000 7f4252d2b640 1 -- 172.21.15.170:0/1475014927 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f424c00a4d0 con 0x55c359235df0 2024-09-12T17:28:04.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.028+0000 7f4254a40800 1 --2- 172.21.15.170:0/1475014927 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55c359339a70 0x55c35933bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.028+0000 7f4254a40800 1 -- 172.21.15.170:0/1475014927 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c35933c6a0 con 0x55c359339a70 2024-09-12T17:28:04.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.028+0000 7f425252a640 1 --2- 172.21.15.170:0/1475014927 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55c359339a70 0x55c35933bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.028+0000 7f425252a640 1 --2- 172.21.15.170:0/1475014927 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55c359339a70 0x55c35933bf10 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.029+0000 7f425252a640 1 -- 172.21.15.170:0/1475014927 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4244057030 con 0x55c359339a70 2024-09-12T17:28:04.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.029+0000 7f4254a40800 1 -- 172.21.15.170:0/1475014927 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c3593387c0 con 0x55c359235df0 2024-09-12T17:28:04.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.029+0000 7f4252d2b640 1 -- 172.21.15.170:0/1475014927 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f424c00a4d0 con 0x55c359235df0 2024-09-12T17:28:04.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.029+0000 7f4254a40800 1 -- 172.21.15.170:0/1475014927 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c359338be0 con 0x55c359339a70 2024-09-12T17:28:04.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.029+0000 7f425252a640 1 -- 172.21.15.170:0/1475014927 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4244057030 con 0x55c359339a70 2024-09-12T17:28:04.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.029+0000 7f4254a40800 1 Processor -- start 2024-09-12T17:28:04.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.029+0000 7f4254a40800 1 -- start start 2024-09-12T17:28:04.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.030+0000 7f4254a40800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c35934af30 0x55c35934b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.030+0000 7f4254a40800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c35912da00 con 0x55c35934af30 2024-09-12T17:28:04.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.030+0000 7f4252d2b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c35934af30 0x55c35934b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.030+0000 7f4252d2b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c35934af30 0x55c35934b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:58264/0 (socket says 172.21.15.170:58264) 2024-09-12T17:28:04.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.030+0000 7f4252d2b640 1 -- 172.21.15.170:0/3442199464 learned_addr learned my addr 172.21.15.170:0/3442199464 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:04.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.030+0000 7f4252d2b640 1 -- 172.21.15.170:0/3442199464 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c35934b990 con 0x55c35934af30 2024-09-12T17:28:04.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.030+0000 7f4252d2b640 1 --2- 172.21.15.170:0/3442199464 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c35934af30 0x55c35934b350 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x55c359331040 tx=0x7f424c0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.030+0000 7f4137fff640 1 -- 172.21.15.170:0/3442199464 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f424c013640 con 0x55c35934af30 2024-09-12T17:28:04.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.030+0000 7f4137fff640 1 -- 172.21.15.170:0/3442199464 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f424c0137e0 con 0x55c35934af30 2024-09-12T17:28:04.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.030+0000 7f4254a40800 1 -- 172.21.15.170:0/3442199464 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c35934c1c0 con 0x55c35934af30 2024-09-12T17:28:04.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.030+0000 7f4137fff640 1 -- 172.21.15.170:0/3442199464 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f424c013ae0 con 0x55c35934af30 2024-09-12T17:28:04.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.031+0000 7f4254a40800 1 -- 172.21.15.170:0/3442199464 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c35934c760 con 0x55c35934af30 2024-09-12T17:28:04.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.031+0000 7f4137fff640 1 -- 172.21.15.170:0/3442199464 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f424c011040 con 0x55c35934af30 2024-09-12T17:28:04.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.032+0000 7f4137fff640 1 --2- 172.21.15.170:0/3442199464 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f412c03c730 0x7f412c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.032+0000 7f4137fff640 1 -- 172.21.15.170:0/3442199464 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f424c00e040 con 0x55c35934af30 2024-09-12T17:28:04.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.032+0000 7f425252a640 1 --2- 172.21.15.170:0/3442199464 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f412c03c730 0x7f412c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.032+0000 7f4254a40800 1 Processor -- start 2024-09-12T17:28:04.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.032+0000 7f425252a640 1 --2- 172.21.15.170:0/3442199464 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f412c03c730 0x7f412c03ebf0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4244005570 tx=0x7f4244050600 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.032+0000 7f4254a40800 1 -- start start 2024-09-12T17:28:04.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.032+0000 7f4254a40800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3593579d0 0x55c359357dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.032+0000 7f4254a40800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c359328fb0 con 0x55c3593579d0 2024-09-12T17:28:04.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.032+0000 7f4252d2b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3593579d0 0x55c359357dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.032+0000 7f4252d2b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3593579d0 0x55c359357dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:58270/0 (socket says 172.21.15.170:58270) 2024-09-12T17:28:04.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.032+0000 7f4252d2b640 1 -- 172.21.15.170:0/3696272153 learned_addr learned my addr 172.21.15.170:0/3696272153 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:04.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.033+0000 7f4252d2b640 1 -- 172.21.15.170:0/3696272153 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3593583c0 con 0x55c3593579d0 2024-09-12T17:28:04.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.033+0000 7f4252d2b640 1 --2- 172.21.15.170:0/3696272153 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3593579d0 0x55c359357dd0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f424c02afd0 tx=0x7f424c014480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2dbd55c11bd7b6e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.033+0000 7f4135ffb640 1 -- 172.21.15.170:0/3696272153 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f424c052070 con 0x55c3593579d0 2024-09-12T17:28:04.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.033+0000 7f4135ffb640 1 -- 172.21.15.170:0/3696272153 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f424c04a020 con 0x55c3593579d0 2024-09-12T17:28:04.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.033+0000 7f4135ffb640 1 -- 172.21.15.170:0/3696272153 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f424c055040 con 0x55c3593579d0 2024-09-12T17:28:04.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.034+0000 7f4254a40800 1 -- 172.21.15.170:0/3696272153 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3593579d0 msgr2=0x55c359357dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.034+0000 7f4254a40800 1 --2- 172.21.15.170:0/3696272153 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3593579d0 0x55c359357dd0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f424c02afd0 tx=0x7f424c014480 comp rx=0 tx=0).stop 2024-09-12T17:28:04.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.034+0000 7f4254a40800 1 -- 172.21.15.170:0/3696272153 shutdown_connections 2024-09-12T17:28:04.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.034+0000 7f4254a40800 1 --2- 172.21.15.170:0/3696272153 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3593579d0 0x55c359357dd0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.034+0000 7f4254a40800 1 -- 172.21.15.170:0/3696272153 >> 172.21.15.170:0/3696272153 conn(0x55c359353df0 msgr2=0x55c359352030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:04.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.034+0000 7f4254a40800 1 -- 172.21.15.170:0/3696272153 shutdown_connections 2024-09-12T17:28:04.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.034+0000 7f4254a40800 1 -- 172.21.15.170:0/3696272153 wait complete. 2024-09-12T17:28:04.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.034+0000 7f4254a40800 1 Processor -- start 2024-09-12T17:28:04.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.034+0000 7f4254a40800 1 -- start start 2024-09-12T17:28:04.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.034+0000 7f4254a40800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3593579d0 0x55c35935f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.034+0000 7f4254a40800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c3593589e0 con 0x55c3593579d0 2024-09-12T17:28:04.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.034+0000 7f4252d2b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3593579d0 0x55c35935f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.034+0000 7f4252d2b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3593579d0 0x55c35935f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:58276/0 (socket says 172.21.15.170:58276) 2024-09-12T17:28:04.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.034+0000 7f4252d2b640 1 -- 172.21.15.170:0/2898391043 learned_addr learned my addr 172.21.15.170:0/2898391043 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:04.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.035+0000 7f4252d2b640 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c35935f5b0 con 0x55c3593579d0 2024-09-12T17:28:04.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.035+0000 7f4252d2b640 1 --2- 172.21.15.170:0/2898391043 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3593579d0 0x55c35935f050 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f424c014570 tx=0x7f424c053d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.035+0000 7f4123fff640 1 -- 172.21.15.170:0/2898391043 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f424c037070 con 0x55c3593579d0 2024-09-12T17:28:04.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.035+0000 7f4123fff640 1 -- 172.21.15.170:0/2898391043 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f424c013db0 con 0x55c3593579d0 2024-09-12T17:28:04.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.035+0000 7f4123fff640 1 -- 172.21.15.170:0/2898391043 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f424c021570 con 0x55c3593579d0 2024-09-12T17:28:04.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.035+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c35935f840 con 0x55c3593579d0 2024-09-12T17:28:04.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.035+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3593601c0 con 0x55c3593579d0 2024-09-12T17:28:04.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.036+0000 7f4123fff640 1 -- 172.21.15.170:0/2898391043 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f424c03a070 con 0x55c3593579d0 2024-09-12T17:28:04.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.036+0000 7f4123fff640 1 --2- 172.21.15.170:0/2898391043 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f411c03c780 0x7f411c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.036+0000 7f4123fff640 1 -- 172.21.15.170:0/2898391043 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f424c02f070 con 0x55c3593579d0 2024-09-12T17:28:04.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.036+0000 7f425252a640 1 --2- 172.21.15.170:0/2898391043 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f411c03c780 0x7f411c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.036+0000 7f425252a640 1 --2- 172.21.15.170:0/2898391043 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f411c03c780 0x7f411c03ec40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4244065fd0 tx=0x7f4244086000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.036+0000 7f4254a40800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.037+0000 7f4254a40800 1 --2- 172.21.15.170:0/2898391043 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55c35936a910 0x55c35936cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.037+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c35936d520 con 0x55c35936a910 2024-09-12T17:28:04.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.037+0000 7f424bfff640 1 --2- 172.21.15.170:0/2898391043 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55c35936a910 0x55c35936cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.037+0000 7f424bfff640 1 --2- 172.21.15.170:0/2898391043 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55c35936a910 0x55c35936cdd0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.037+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f423c00f610 con 0x55c35936a910 2024-09-12T17:28:04.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.037+0000 7f4254a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.037+0000 7f4254a40800 20 realm 2024-09-12T17:28:04.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.037+0000 7f4254a40800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.037+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c359369c60 con 0x55c35936a910 2024-09-12T17:28:04.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.037+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f423c00f610 con 0x55c35936a910 2024-09-12T17:28:04.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.037+0000 7f4254a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.037+0000 7f4254a40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:04.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.037+0000 7f4254a40800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.037+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c35936e010 con 0x55c35936a910 2024-09-12T17:28:04.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.038+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f423c00f610 con 0x55c35936a910 2024-09-12T17:28:04.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.038+0000 7f4254a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.038+0000 7f4254a40800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.038+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c35936e8e0 con 0x55c35936a910 2024-09-12T17:28:04.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.038+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f423c00f610 con 0x55c35936a910 2024-09-12T17:28:04.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.038+0000 7f4254a40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:04.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.038+0000 7f4254a40800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.038+0000 7f4254a40800 1 --2- 172.21.15.170:0/2898391043 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55c35936f300 0x55c3593716f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.038+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c359371e30 con 0x55c35936f300 2024-09-12T17:28:04.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.038+0000 7f4252d2b640 1 --2- 172.21.15.170:0/2898391043 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55c35936f300 0x55c3593716f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.038+0000 7f4252d2b640 1 --2- 172.21.15.170:0/2898391043 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55c35936f300 0x55c3593716f0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.038+0000 7f4252d2b640 1 -- 172.21.15.170:0/2898391043 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f424c039030 con 0x55c35936f300 2024-09-12T17:28:04.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.038+0000 7f4254a40800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:04.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.038+0000 7f4254a40800 20 searching for the correct realm 2024-09-12T17:28:04.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.039+0000 7f4254a40800 1 --2- 172.21.15.170:0/2898391043 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55c359373de0 0x55c3593762a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.039+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c359376920 con 0x55c359373de0 2024-09-12T17:28:04.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.039+0000 7f425252a640 1 --2- 172.21.15.170:0/2898391043 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55c359373de0 0x55c3593762a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.039+0000 7f425252a640 1 --2- 172.21.15.170:0/2898391043 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55c359373de0 0x55c3593762a0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.039+0000 7f425252a640 1 -- 172.21.15.170:0/2898391043 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4244057030 con 0x55c359373de0 2024-09-12T17:28:04.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.039+0000 7f425252a640 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c359376920 con 0x55c35936f300 2024-09-12T17:28:04.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.039+0000 7f4252d2b640 1 -- 172.21.15.170:0/2898391043 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f424c039030 con 0x55c35936f300 2024-09-12T17:28:04.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.039+0000 7f4252d2b640 1 --2- 172.21.15.170:0/2898391043 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f424c03c060 0x7f424c02c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.039+0000 7f4252d2b640 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c359376920 con 0x7f424c03c060 2024-09-12T17:28:04.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.040+0000 7f424bfff640 1 --2- 172.21.15.170:0/2898391043 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f424c03c060 0x7f424c02c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.040+0000 7f424bfff640 1 --2- 172.21.15.170:0/2898391043 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f424c03c060 0x7f424c02c9e0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.040+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f423c00f610 con 0x7f424c03c060 2024-09-12T17:28:04.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.040+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c359376920 con 0x55c35936a910 2024-09-12T17:28:04.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.041+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f423c00f610 con 0x55c35936a910 2024-09-12T17:28:04.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.041+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c359376920 con 0x55c35936a910 2024-09-12T17:28:04.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.041+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f423c02b040 con 0x55c35936a910 2024-09-12T17:28:04.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.041+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c359376920 con 0x7f424c03c060 2024-09-12T17:28:04.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.041+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f423c02b040 con 0x7f424c03c060 2024-09-12T17:28:04.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.041+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c359376920 con 0x7f424c03c060 2024-09-12T17:28:04.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.041+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f423c02b040 con 0x7f424c03c060 2024-09-12T17:28:04.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.041+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c359376920 con 0x55c35936f300 2024-09-12T17:28:04.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.042+0000 7f4252d2b640 1 -- 172.21.15.170:0/2898391043 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f424c039030 con 0x55c35936f300 2024-09-12T17:28:04.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.042+0000 7f4252d2b640 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c359376920 con 0x55c359373de0 2024-09-12T17:28:04.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.042+0000 7f425252a640 1 -- 172.21.15.170:0/2898391043 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4244057030 con 0x55c359373de0 2024-09-12T17:28:04.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.042+0000 7f425252a640 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c359376920 con 0x55c35936a910 2024-09-12T17:28:04.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.042+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f423c02b040 con 0x55c35936a910 2024-09-12T17:28:04.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.042+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c359376920 con 0x7f424c03c060 2024-09-12T17:28:04.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.042+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f423c02b040 con 0x7f424c03c060 2024-09-12T17:28:04.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.042+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c359376920 con 0x55c35936a910 2024-09-12T17:28:04.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.042+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f423c02b040 con 0x55c35936a910 2024-09-12T17:28:04.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.043+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c359376920 con 0x55c35936f300 2024-09-12T17:28:04.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.043+0000 7f4252d2b640 1 -- 172.21.15.170:0/2898391043 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f424c039030 con 0x55c35936f300 2024-09-12T17:28:04.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.043+0000 7f4252d2b640 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c359376920 con 0x55c359373de0 2024-09-12T17:28:04.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.043+0000 7f425252a640 1 -- 172.21.15.170:0/2898391043 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4244057030 con 0x55c359373de0 2024-09-12T17:28:04.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.043+0000 7f425252a640 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c359376920 con 0x55c359373de0 2024-09-12T17:28:04.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.043+0000 7f425252a640 1 -- 172.21.15.170:0/2898391043 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4244057030 con 0x55c359373de0 2024-09-12T17:28:04.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.043+0000 7f425252a640 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c359376920 con 0x7f424c03c060 2024-09-12T17:28:04.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.044+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f423c02b040 con 0x7f424c03c060 2024-09-12T17:28:04.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.044+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c359376920 con 0x55c359373de0 2024-09-12T17:28:04.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.044+0000 7f425252a640 1 -- 172.21.15.170:0/2898391043 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4244057030 con 0x55c359373de0 2024-09-12T17:28:04.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.044+0000 7f425252a640 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c359376920 con 0x55c359373de0 2024-09-12T17:28:04.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.044+0000 7f425252a640 1 -- 172.21.15.170:0/2898391043 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4244057030 con 0x55c359373de0 2024-09-12T17:28:04.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.044+0000 7f425252a640 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c359376920 con 0x55c35936a910 2024-09-12T17:28:04.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.044+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f423c02b040 con 0x55c35936a910 2024-09-12T17:28:04.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.044+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c359376920 con 0x55c35936a910 2024-09-12T17:28:04.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.044+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f423c02b040 con 0x55c35936a910 2024-09-12T17:28:04.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.044+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c359376920 con 0x7f424c03c060 2024-09-12T17:28:04.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.045+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f423c02b040 con 0x7f424c03c060 2024-09-12T17:28:04.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.045+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c359376920 con 0x55c359373de0 2024-09-12T17:28:04.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.045+0000 7f425252a640 1 -- 172.21.15.170:0/2898391043 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4244057030 con 0x55c359373de0 2024-09-12T17:28:04.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.045+0000 7f425252a640 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c359376920 con 0x55c35936f300 2024-09-12T17:28:04.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.045+0000 7f4252d2b640 1 -- 172.21.15.170:0/2898391043 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f424c039030 con 0x55c35936f300 2024-09-12T17:28:04.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.045+0000 7f4252d2b640 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c359376920 con 0x55c35936a910 2024-09-12T17:28:04.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.045+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f423c02b040 con 0x55c35936a910 2024-09-12T17:28:04.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.045+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c359376920 con 0x7f424c03c060 2024-09-12T17:28:04.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.046+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f423c03b040 con 0x7f424c03c060 2024-09-12T17:28:04.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.046+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c359376920 con 0x55c359373de0 2024-09-12T17:28:04.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.046+0000 7f425252a640 1 -- 172.21.15.170:0/2898391043 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4244057030 con 0x55c359373de0 2024-09-12T17:28:04.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.046+0000 7f425252a640 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c359376920 con 0x7f424c03c060 2024-09-12T17:28:04.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.046+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f423c03b040 con 0x7f424c03c060 2024-09-12T17:28:04.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.046+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c359376920 con 0x55c35936f300 2024-09-12T17:28:04.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.046+0000 7f4252d2b640 1 -- 172.21.15.170:0/2898391043 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f424c039030 con 0x55c35936f300 2024-09-12T17:28:04.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.046+0000 7f4252d2b640 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c359376920 con 0x55c359373de0 2024-09-12T17:28:04.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.047+0000 7f425252a640 1 -- 172.21.15.170:0/2898391043 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4244057030 con 0x55c359373de0 2024-09-12T17:28:04.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.047+0000 7f425252a640 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c359376920 con 0x7f424c03c060 2024-09-12T17:28:04.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.047+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f423c03b040 con 0x7f424c03c060 2024-09-12T17:28:04.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.047+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c359376920 con 0x55c35936a910 2024-09-12T17:28:04.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.047+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f423c03b040 con 0x55c35936a910 2024-09-12T17:28:04.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.047+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c359376920 con 0x55c35936f300 2024-09-12T17:28:04.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.047+0000 7f4252d2b640 1 -- 172.21.15.170:0/2898391043 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f424c067040 con 0x55c35936f300 2024-09-12T17:28:04.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.047+0000 7f4254a40800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:04.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.047+0000 7f4254a40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:04.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.047+0000 7f4254a40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:04.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.047+0000 7f4254a40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:04.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.047+0000 7f4254a40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:04.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.047+0000 7f4254a40800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:04.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.047+0000 7f4254a40800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.047+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c359372820 con 0x55c35936a910 2024-09-12T17:28:04.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.048+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f423c03b040 con 0x55c35936a910 2024-09-12T17:28:04.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.048+0000 7f4254a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.048+0000 7f4254a40800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.048+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c3593730c0 con 0x55c35936a910 2024-09-12T17:28:04.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.048+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f423c03b040 con 0x55c35936a910 2024-09-12T17:28:04.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.048+0000 7f4254a40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:04.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.048+0000 7f4254a40800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.048+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c359372460 con 0x55c35936f300 2024-09-12T17:28:04.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.048+0000 7f4252d2b640 1 -- 172.21.15.170:0/2898391043 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f424c067040 con 0x55c35936f300 2024-09-12T17:28:04.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.048+0000 7f4254a40800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:04.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.048+0000 7f4254a40800 20 zone default found 2024-09-12T17:28:04.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.048+0000 7f4254a40800 4 Realm: () 2024-09-12T17:28:04.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.048+0000 7f4254a40800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:04.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.048+0000 7f4254a40800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:04.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.048+0000 7f4254a40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:04.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.048+0000 7f4254a40800 20 zonegroup default 2024-09-12T17:28:04.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.048+0000 7f4254a40800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.048+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c359377250 con 0x7f424c03c060 2024-09-12T17:28:04.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.048+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f423c03b040 con 0x7f424c03c060 2024-09-12T17:28:04.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.048+0000 7f4254a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.049+0000 7f4254a40800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.049+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c359378fa0 con 0x55c359373de0 2024-09-12T17:28:04.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.049+0000 7f425252a640 1 -- 172.21.15.170:0/2898391043 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4244057030 con 0x55c359373de0 2024-09-12T17:28:04.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.049+0000 7f4254a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.049+0000 7f4254a40800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.049+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c359379430 con 0x55c359373de0 2024-09-12T17:28:04.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.049+0000 7f425252a640 1 -- 172.21.15.170:0/2898391043 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4244057030 con 0x55c359373de0 2024-09-12T17:28:04.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.049+0000 7f4254a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.049+0000 7f4254a40800 20 started sync module instance, tier type = 2024-09-12T17:28:04.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.049+0000 7f4254a40800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:04.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.049+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c359377d70 con 0x55c35936f300 2024-09-12T17:28:04.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.050+0000 7f4252d2b640 1 -- 172.21.15.170:0/2898391043 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f424c067040 con 0x55c35936f300 2024-09-12T17:28:04.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.050+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94297503793808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c359377d70 con 0x55c35936f300 2024-09-12T17:28:04.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.050+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c359379fb0 con 0x55c35936a910 2024-09-12T17:28:04.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.051+0000 7f4252d2b640 1 -- 172.21.15.170:0/2898391043 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94297503793808] v29'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f424c067040 con 0x55c35936f300 2024-09-12T17:28:04.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.051+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f423c03b040 con 0x55c35936a910 2024-09-12T17:28:04.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.051+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94297503799936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c359377d70 con 0x55c35936a910 2024-09-12T17:28:04.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.051+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c35937aa60 con 0x55c359373de0 2024-09-12T17:28:04.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.052+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94297503799936] v29'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f423c03b040 con 0x55c35936a910 2024-09-12T17:28:04.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.052+0000 7f425252a640 1 -- 172.21.15.170:0/2898391043 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4244057030 con 0x55c359373de0 2024-09-12T17:28:04.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.052+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94297503791296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c359377ce0 con 0x55c359373de0 2024-09-12T17:28:04.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.052+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c35937b920 con 0x55c35936f300 2024-09-12T17:28:04.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.053+0000 7f4252d2b640 1 -- 172.21.15.170:0/2898391043 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f424c067040 con 0x55c35936f300 2024-09-12T17:28:04.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.053+0000 7f425252a640 1 -- 172.21.15.170:0/2898391043 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94297503791296] v29'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4244057030 con 0x55c359373de0 2024-09-12T17:28:04.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.053+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94297503806576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c35937b890 con 0x55c35936f300 2024-09-12T17:28:04.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.054+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c35937c7e0 con 0x55c35936a910 2024-09-12T17:28:04.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.055+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f423c03b040 con 0x55c35936a910 2024-09-12T17:28:04.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.055+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94297503810352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c35937cc00 con 0x55c35936a910 2024-09-12T17:28:04.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.055+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c35937d6c0 con 0x7f424c03c060 2024-09-12T17:28:04.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.055+0000 7f4252d2b640 1 -- 172.21.15.170:0/2898391043 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94297503806576] v29'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f424c067040 con 0x55c35936f300 2024-09-12T17:28:04.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.056+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f423c03b040 con 0x7f424c03c060 2024-09-12T17:28:04.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.056+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94297503810352] v29'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f423c03b040 con 0x55c35936a910 2024-09-12T17:28:04.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.056+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94297503814032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c35937d680 con 0x7f424c03c060 2024-09-12T17:28:04.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.056+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c35937c750 con 0x7f424c03c060 2024-09-12T17:28:04.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.057+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94297503814032] v29'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f423c03b040 con 0x7f424c03c060 2024-09-12T17:28:04.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.057+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(56 notify.6 [create] v29'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f423c03b040 con 0x7f424c03c060 2024-09-12T17:28:04.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.057+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94297503811408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c35937dc50 con 0x7f424c03c060 2024-09-12T17:28:04.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.057+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c35937e610 con 0x7f424c03c060 2024-09-12T17:28:04.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.058+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94297503811408] v29'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f423c03b040 con 0x7f424c03c060 2024-09-12T17:28:04.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.058+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(58 notify.7 [create] v29'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f423c03b040 con 0x7f424c03c060 2024-09-12T17:28:04.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.058+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94297503808784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c35937e610 con 0x7f424c03c060 2024-09-12T17:28:04.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.058+0000 7f4254a40800 20 add_watcher() i=0 2024-09-12T17:28:04.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.058+0000 7f4254a40800 20 add_watcher() i=1 2024-09-12T17:28:04.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.058+0000 7f4254a40800 20 add_watcher() i=2 2024-09-12T17:28:04.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.058+0000 7f4254a40800 20 add_watcher() i=3 2024-09-12T17:28:04.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.058+0000 7f4254a40800 20 add_watcher() i=4 2024-09-12T17:28:04.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.058+0000 7f4254a40800 20 add_watcher() i=5 2024-09-12T17:28:04.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.058+0000 7f4254a40800 20 add_watcher() i=6 2024-09-12T17:28:04.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.059+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94297503808784] v29'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f423c03b040 con 0x7f424c03c060 2024-09-12T17:28:04.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.059+0000 7f4254a40800 20 add_watcher() i=7 2024-09-12T17:28:04.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.059+0000 7f4254a40800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:04.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.059+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c359381910 con 0x55c35936a910 2024-09-12T17:28:04.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.059+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f423c03b040 con 0x55c35936a910 2024-09-12T17:28:04.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.059+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94297503818448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c35937eba0 con 0x55c35936a910 2024-09-12T17:28:04.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.060+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94297503818448] v29'117 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f423c03b040 con 0x55c35936a910 2024-09-12T17:28:04.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.060+0000 7f4108fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:04.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.060+0000 7f4254a40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:04.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.060+0000 7f4254a40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:04.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.060+0000 7f4254a40800 5 note: GC not initialized 2024-09-12T17:28:04.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.060+0000 7f40837fe640 20 reqs_thread_entry: start 2024-09-12T17:28:04.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.061+0000 7f4254a40800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:04.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.061+0000 7f4254a40800 20 Filter name: none 2024-09-12T17:28:04.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.061+0000 7f40817fa640 20 reqs_thread_entry: start 2024-09-12T17:28:04.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.061+0000 7f4254a40800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-12T17:28:04.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.061+0000 7f4254a40800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.061+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c3593b49e0 con 0x7f424c03c060 2024-09-12T17:28:04.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.061+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f423c03b040 con 0x7f424c03c060 2024-09-12T17:28:04.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.061+0000 7f4254a40800 20 rados_obj.operate() r=0 bl.length=380 2024-09-12T17:28:04.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.061+0000 7f4254a40800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-12T17:28:04.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.061+0000 7f4254a40800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T17:28:04.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.061+0000 7f4254a40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:04.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.061+0000 7f4254a40800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T17:28:04.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.061+0000 7f4254a40800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.061+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c3593b6970 con 0x55c35936f300 2024-09-12T17:28:04.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.062+0000 7f4252d2b640 1 -- 172.21.15.170:0/2898391043 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f424c067040 con 0x55c35936f300 2024-09-12T17:28:04.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.062+0000 7f4254a40800 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T17:28:04.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.062+0000 7f4254a40800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-12T17:28:04.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.062+0000 7f4254a40800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:28:04.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.062+0000 7f4254a40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 : miss 2024-09-12T17:28:04.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.062+0000 7f4254a40800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.062+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:64 8.1d 8:baccd554:root::.bucket.meta.myfoo%3a7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c3593b8360 con 0x7f424c03c060 2024-09-12T17:28:04.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.062+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(64 .bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f423c03b040 con 0x7f424c03c060 2024-09-12T17:28:04.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.062+0000 7f4254a40800 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T17:28:04.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.062+0000 7f4254a40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 info.flags=0x17 2024-09-12T17:28:04.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.062+0000 7f4254a40800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 to cache LRU end 2024-09-12T17:28:04.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.062+0000 7f4254a40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:04.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.062+0000 7f4254a40800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:28:04.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.062+0000 7f4254a40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 2024-09-12T17:28:04.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.062+0000 7f4254a40800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-12T17:28:04.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.063+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c3593bbaa0 con 0x7f424c03c060 2024-09-12T17:28:04.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.064+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(65 fud.buckets [call] v29'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f423c03b040 con 0x7f424c03c060 2024-09-12T17:28:04.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.064+0000 7f4254a40800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-12T17:28:04.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.064+0000 7f4254a40800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.064+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c3593bab10 con 0x55c35936f300 2024-09-12T17:28:04.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.064+0000 7f4252d2b640 1 -- 172.21.15.170:0/2898391043 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f424c067040 con 0x55c35936f300 2024-09-12T17:28:04.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.064+0000 7f4254a40800 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T17:28:04.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.064+0000 7f4254a40800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-12T17:28:04.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.064+0000 7f4254a40800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:28:04.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.064+0000 7f4254a40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:04.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.064+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c3593bf630 con 0x55c35936f300 2024-09-12T17:28:04.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.065+0000 7f4252d2b640 1 -- 172.21.15.170:0/2898391043 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v29'21 uv21 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f424c067040 con 0x55c35936f300 2024-09-12T17:28:04.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.065+0000 7f4254a40800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-12T17:28:04.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.065+0000 7f4254a40800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:28:04.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.065+0000 7f4254a40800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-12T17:28:04.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.065+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94297504067664 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c3593bc930 con 0x7f424c03c060 2024-09-12T17:28:04.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.065+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== watch-notify(notify (1) cookie 94297503811408 notify 124554051590 ret 0) ==== 380+0+0 (crc 0 0 0) 0x55c3593b8750 con 0x7f424c03c060 2024-09-12T17:28:04.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.065+0000 7f4135ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051590 cookie 94297503811408 notifier 4512 bl.length()=338 2024-09-12T17:28:04.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.065+0000 7f4135ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-12T17:28:04.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.065+0000 7f4135ffb640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:28:04.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.065+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== osd_op_reply(68 notify.6 [notify cookie 94297504067664 out=8b] v0'0 uv120 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f423c03b040 con 0x7f424c03c060 2024-09-12T17:28:04.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.065+0000 7f4135ffb640 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f4118003ea0 con 0x7f424c03c060 2024-09-12T17:28:04.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.066+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.0 v2:172.21.15.47:6800/3978157098 22 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f423c03b040 con 0x7f424c03c060 2024-09-12T17:28:04.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.066+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.0 v2:172.21.15.47:6800/3978157098 23 ==== watch-notify(notify_complete (2) cookie 94297504067664 notify 124554051590 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c3593b78a0 con 0x7f424c03c060 2024-09-12T17:28:04.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.066+0000 7f4108fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:04.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.066+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94297503818448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c3593b2880 con 0x55c35936a910 2024-09-12T17:28:04.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.067+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94297503818448] v29'118 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f423c03b040 con 0x55c35936a910 2024-09-12T17:28:04.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.067+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94297503793808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c3593b2880 con 0x55c35936f300 2024-09-12T17:28:04.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.068+0000 7f4252d2b640 1 -- 172.21.15.170:0/2898391043 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94297503793808] v29'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f424c067040 con 0x55c35936f300 2024-09-12T17:28:04.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.068+0000 7f4254a40800 20 remove_watcher() i=0 2024-09-12T17:28:04.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.068+0000 7f4254a40800 2 removed watcher, disabling cache 2024-09-12T17:28:04.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.068+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94297503799936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c3593b2880 con 0x55c35936a910 2024-09-12T17:28:04.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.070+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94297503799936] v29'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f423c03b040 con 0x55c35936a910 2024-09-12T17:28:04.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.070+0000 7f4254a40800 20 remove_watcher() i=1 2024-09-12T17:28:04.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.070+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94297503791296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c3593b2880 con 0x55c359373de0 2024-09-12T17:28:04.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.071+0000 7f425252a640 1 -- 172.21.15.170:0/2898391043 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94297503791296] v29'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4244057030 con 0x55c359373de0 2024-09-12T17:28:04.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.071+0000 7f4254a40800 20 remove_watcher() i=2 2024-09-12T17:28:04.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.071+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94297503806576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c359379a80 con 0x55c35936f300 2024-09-12T17:28:04.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.072+0000 7f4252d2b640 1 -- 172.21.15.170:0/2898391043 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94297503806576] v29'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f424c067040 con 0x55c35936f300 2024-09-12T17:28:04.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.072+0000 7f4254a40800 20 remove_watcher() i=3 2024-09-12T17:28:04.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.072+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94297503810352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c3593778c0 con 0x55c35936a910 2024-09-12T17:28:04.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.073+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94297503810352] v29'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f423c03b040 con 0x55c35936a910 2024-09-12T17:28:04.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.073+0000 7f4254a40800 20 remove_watcher() i=4 2024-09-12T17:28:04.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.073+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94297503814032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c35937b470 con 0x7f424c03c060 2024-09-12T17:28:04.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.074+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.0 v2:172.21.15.47:6800/3978157098 24 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94297503814032] v29'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f423c03b040 con 0x7f424c03c060 2024-09-12T17:28:04.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.074+0000 7f4254a40800 20 remove_watcher() i=5 2024-09-12T17:28:04.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.074+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94297503811408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c359379a80 con 0x7f424c03c060 2024-09-12T17:28:04.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.075+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.0 v2:172.21.15.47:6800/3978157098 25 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94297503811408] v29'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f423c03b040 con 0x7f424c03c060 2024-09-12T17:28:04.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.075+0000 7f4254a40800 20 remove_watcher() i=6 2024-09-12T17:28:04.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.075+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94297503808784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c3593778c0 con 0x7f424c03c060 2024-09-12T17:28:04.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.076+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 <== osd.0 v2:172.21.15.47:6800/3978157098 26 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94297503808784] v29'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f423c03b040 con 0x7f424c03c060 2024-09-12T17:28:04.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.076+0000 7f4254a40800 20 remove_watcher() i=7 2024-09-12T17:28:04.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.076+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f424c03c060 msgr2=0x7f424c02c9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.076+0000 7f4254a40800 1 --2- 172.21.15.170:0/2898391043 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f424c03c060 0x7f424c02c9e0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.076+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55c35936a910 msgr2=0x55c35936cdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.076+0000 7f4254a40800 1 --2- 172.21.15.170:0/2898391043 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55c35936a910 0x55c35936cdd0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.076+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55c35936f300 msgr2=0x55c3593716f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.076+0000 7f4254a40800 1 --2- 172.21.15.170:0/2898391043 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55c35936f300 0x55c3593716f0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.076+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55c359373de0 msgr2=0x55c3593762a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.076+0000 7f4254a40800 1 --2- 172.21.15.170:0/2898391043 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55c359373de0 0x55c3593762a0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.076+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f411c03c780 msgr2=0x7f411c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.076+0000 7f4254a40800 1 --2- 172.21.15.170:0/2898391043 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f411c03c780 0x7f411c03ec40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4244065fd0 tx=0x7f4244086000 comp rx=0 tx=0).stop 2024-09-12T17:28:04.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.076+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3593579d0 msgr2=0x55c35935f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.076+0000 7f424bfff640 1 -- 172.21.15.170:0/2898391043 reap_dead start 2024-09-12T17:28:04.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.076+0000 7f4254a40800 1 --2- 172.21.15.170:0/2898391043 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3593579d0 0x55c35935f050 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f424c014570 tx=0x7f424c053d30 comp rx=0 tx=0).stop 2024-09-12T17:28:04.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.076+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 shutdown_connections 2024-09-12T17:28:04.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.076+0000 7f4254a40800 1 --2- 172.21.15.170:0/2898391043 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3593579d0 0x55c35935f050 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.076+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 >> 172.21.15.170:0/2898391043 conn(0x55c359353df0 msgr2=0x55c359352000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:04.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.076+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 shutdown_connections 2024-09-12T17:28:04.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.076+0000 7f4254a40800 1 -- 172.21.15.170:0/2898391043 wait complete. 2024-09-12T17:28:04.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.077+0000 7f4254a40800 1 -- 172.21.15.170:0/3442199464 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f412c03c730 msgr2=0x7f412c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.077+0000 7f4254a40800 1 --2- 172.21.15.170:0/3442199464 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f412c03c730 0x7f412c03ebf0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4244005570 tx=0x7f4244050600 comp rx=0 tx=0).stop 2024-09-12T17:28:04.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.077+0000 7f4254a40800 1 -- 172.21.15.170:0/3442199464 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c35934af30 msgr2=0x55c35934b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.077+0000 7f4254a40800 1 --2- 172.21.15.170:0/3442199464 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c35934af30 0x55c35934b350 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x55c359331040 tx=0x7f424c0167b0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.077+0000 7f4254a40800 1 -- 172.21.15.170:0/3442199464 shutdown_connections 2024-09-12T17:28:04.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.077+0000 7f4254a40800 1 --2- 172.21.15.170:0/3442199464 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f412c03c730 0x7f412c03ebf0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.077+0000 7f4254a40800 1 --2- 172.21.15.170:0/3442199464 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c35934af30 0x55c35934b350 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.077+0000 7f4254a40800 1 -- 172.21.15.170:0/3442199464 >> 172.21.15.170:0/3442199464 conn(0x55c35933f2e0 msgr2=0x55c35933f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:04.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.077+0000 7f4254a40800 1 -- 172.21.15.170:0/3442199464 shutdown_connections 2024-09-12T17:28:04.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.077+0000 7f4254a40800 1 -- 172.21.15.170:0/3442199464 wait complete. 2024-09-12T17:28:04.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.077+0000 7f4254a40800 1 -- 172.21.15.170:0/1475014927 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55c359235df0 msgr2=0x55c359337690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.077+0000 7f4254a40800 1 --2- 172.21.15.170:0/1475014927 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55c359235df0 0x55c359337690 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.077+0000 7f4254a40800 1 -- 172.21.15.170:0/1475014927 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55c359339a70 msgr2=0x55c35933bf10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.077+0000 7f4254a40800 1 --2- 172.21.15.170:0/1475014927 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55c359339a70 0x55c35933bf10 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.077+0000 7f4254a40800 1 -- 172.21.15.170:0/1475014927 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f413803c730 msgr2=0x7f413803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.077+0000 7f4254a40800 1 --2- 172.21.15.170:0/1475014927 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f413803c730 0x7f413803ebf0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f423c001e30 tx=0x7f423c001390 comp rx=0 tx=0).stop 2024-09-12T17:28:04.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.077+0000 7f4254a40800 1 -- 172.21.15.170:0/1475014927 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3592354b0 msgr2=0x55c359330040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.077+0000 7f4254a40800 1 --2- 172.21.15.170:0/1475014927 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3592354b0 0x55c359330040 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f42440460d0 tx=0x7f4244002fb0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.077+0000 7f4254a40800 1 -- 172.21.15.170:0/1475014927 shutdown_connections 2024-09-12T17:28:04.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.077+0000 7f4254a40800 1 --2- 172.21.15.170:0/1475014927 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55c359339a70 0x55c35933bf10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.077+0000 7f4254a40800 1 --2- 172.21.15.170:0/1475014927 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f413803c730 0x7f413803ebf0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.077+0000 7f4254a40800 1 --2- 172.21.15.170:0/1475014927 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55c359235df0 0x55c359337690 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.077+0000 7f4254a40800 1 --2- 172.21.15.170:0/1475014927 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c3592354b0 0x55c359330040 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.077+0000 7f4254a40800 1 -- 172.21.15.170:0/1475014927 >> 172.21.15.170:0/1475014927 conn(0x55c359231200 msgr2=0x55c359322990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:04.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.077+0000 7f4254a40800 1 -- 172.21.15.170:0/1475014927 shutdown_connections 2024-09-12T17:28:04.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.077+0000 7f4254a40800 1 -- 172.21.15.170:0/1475014927 wait complete. 2024-09-12T17:28:04.096 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1'] 2024-09-12T17:28:04.096 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1'] 2024-09-12T17:28:04.096 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 2024-09-12T17:28:04.145 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:04.145 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:04.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.143+0000 7f93e4935800 1 Processor -- start 2024-09-12T17:28:04.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.143+0000 7f93e4935800 1 -- start start 2024-09-12T17:28:04.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.144+0000 7f93e4935800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5636b964c520 0x5636b964c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.144+0000 7f93e4935800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5636b94f5e40 con 0x5636b9651340 2024-09-12T17:28:04.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.144+0000 7f93e4935800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x5636b94c0680 con 0x5636b964c520 2024-09-12T17:28:04.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.144+0000 7f93e06e4640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5636b964c520 0x5636b964c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.144+0000 7f93d7ee3640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x5636b9651340 0x5636b9653730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:48520/0 (socket says 172.21.15.170:48520) 2024-09-12T17:28:04.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.144+0000 7f93d7ee3640 1 -- 172.21.15.170:0/2591069478 learned_addr learned my addr 172.21.15.170:0/2591069478 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:28:04.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.144+0000 7f93e06e4640 1 -- 172.21.15.170:0/2591069478 >> v1:172.21.15.47:6789/0 conn(0x5636b9651340 legacy=0x5636b9653730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.144+0000 7f93dfee3640 1 -- 172.21.15.170:0/2591069478 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1194186400 0 0) 0x5636b94f5e40 con 0x5636b9651340 2024-09-12T17:28:04.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.144+0000 7f93e06e4640 1 -- 172.21.15.170:0/2591069478 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636b94dc6b0 con 0x5636b964c520 2024-09-12T17:28:04.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.146+0000 7f93e06e4640 1 --2- 172.21.15.170:0/2591069478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5636b964c520 0x5636b964c920 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f93d000a470 tx=0x7f93d0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9770aa9a6e130a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.146+0000 7f93dfee3640 1 -- 172.21.15.170:0/2591069478 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93d0053570 con 0x5636b964c520 2024-09-12T17:28:04.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.146+0000 7f93dfee3640 1 -- 172.21.15.170:0/2591069478 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93d0058070 con 0x5636b964c520 2024-09-12T17:28:04.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.146+0000 7f93dfee3640 1 -- 172.21.15.170:0/2591069478 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93d0053880 con 0x5636b964c520 2024-09-12T17:28:04.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.147+0000 7f93e4935800 1 -- 172.21.15.170:0/2591069478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5636b964c520 msgr2=0x5636b964c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.147+0000 7f93e4935800 1 --2- 172.21.15.170:0/2591069478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5636b964c520 0x5636b964c920 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f93d000a470 tx=0x7f93d0045a20 comp rx=0 tx=0).stop 2024-09-12T17:28:04.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.147+0000 7f93e4935800 1 -- 172.21.15.170:0/2591069478 shutdown_connections 2024-09-12T17:28:04.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.147+0000 7f93e4935800 1 --2- 172.21.15.170:0/2591069478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5636b964c520 0x5636b964c920 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.147+0000 7f93e4935800 1 -- 172.21.15.170:0/2591069478 >> 172.21.15.170:0/2591069478 conn(0x5636b9645940 msgr2=0x5636b9647dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:04.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.147+0000 7f93e4935800 1 -- 172.21.15.170:0/2591069478 shutdown_connections 2024-09-12T17:28:04.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.147+0000 7f93e4935800 1 -- 172.21.15.170:0/2591069478 wait complete. 2024-09-12T17:28:04.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.161+0000 7f93e4935800 1 Processor -- start 2024-09-12T17:28:04.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.161+0000 7f93e4935800 1 -- start start 2024-09-12T17:28:04.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.161+0000 7f93e4935800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5636b964c520 0x5636b973d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.161+0000 7f93e4935800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5636b94e4dd0 con 0x5636b964c520 2024-09-12T17:28:04.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.161+0000 7f93e06e4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5636b964c520 0x5636b973d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.161+0000 7f93e06e4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5636b964c520 0x5636b973d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:58294/0 (socket says 172.21.15.170:58294) 2024-09-12T17:28:04.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.161+0000 7f93e06e4640 1 -- 172.21.15.170:0/3145353391 learned_addr learned my addr 172.21.15.170:0/3145353391 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:04.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.161+0000 7f93e06e4640 1 -- 172.21.15.170:0/3145353391 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636b94fde10 con 0x5636b964c520 2024-09-12T17:28:04.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.162+0000 7f93e06e4640 1 --2- 172.21.15.170:0/3145353391 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5636b964c520 0x5636b973d7b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f93d0025c20 tx=0x7f93d0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8959b5801bd14f6e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.162+0000 7f92ce60c640 1 -- 172.21.15.170:0/3145353391 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93d0053a20 con 0x5636b964c520 2024-09-12T17:28:04.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.162+0000 7f92ce60c640 1 -- 172.21.15.170:0/3145353391 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93d0063070 con 0x5636b964c520 2024-09-12T17:28:04.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.162+0000 7f92ce60c640 1 -- 172.21.15.170:0/3145353391 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93d0053d30 con 0x5636b964c520 2024-09-12T17:28:04.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.162+0000 7f93e4935800 1 -- 172.21.15.170:0/3145353391 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5636b964c520 msgr2=0x5636b973d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.162+0000 7f93e4935800 1 --2- 172.21.15.170:0/3145353391 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5636b964c520 0x5636b973d7b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f93d0025c20 tx=0x7f93d0051000 comp rx=0 tx=0).stop 2024-09-12T17:28:04.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.162+0000 7f93e4935800 1 -- 172.21.15.170:0/3145353391 shutdown_connections 2024-09-12T17:28:04.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.162+0000 7f93e4935800 1 --2- 172.21.15.170:0/3145353391 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5636b964c520 0x5636b973d7b0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.162+0000 7f93e4935800 1 -- 172.21.15.170:0/3145353391 >> 172.21.15.170:0/3145353391 conn(0x5636b9645940 msgr2=0x5636b9739130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:04.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.163+0000 7f93e4935800 1 -- 172.21.15.170:0/3145353391 shutdown_connections 2024-09-12T17:28:04.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.163+0000 7f93e4935800 1 -- 172.21.15.170:0/3145353391 wait complete. 2024-09-12T17:28:04.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.163+0000 7f93e4935800 1 Processor -- start 2024-09-12T17:28:04.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.163+0000 7f93e4935800 1 -- start start 2024-09-12T17:28:04.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.163+0000 7f93e4935800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5636b9651340 0x5636b97452e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.163+0000 7f93e4935800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5636b9655270 con 0x5636b9651340 2024-09-12T17:28:04.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.163+0000 7f93e06e4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5636b9651340 0x5636b97452e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.163+0000 7f93e06e4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5636b9651340 0x5636b97452e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:58296/0 (socket says 172.21.15.170:58296) 2024-09-12T17:28:04.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.163+0000 7f93e06e4640 1 -- 172.21.15.170:0/192662560 learned_addr learned my addr 172.21.15.170:0/192662560 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:04.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.164+0000 7f93e06e4640 1 -- 172.21.15.170:0/192662560 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636b9745840 con 0x5636b9651340 2024-09-12T17:28:04.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.164+0000 7f93e06e4640 1 --2- 172.21.15.170:0/192662560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5636b9651340 0x5636b97452e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f93d0025c20 tx=0x7f93d0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.164+0000 7f92cce09640 1 -- 172.21.15.170:0/192662560 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93d0078070 con 0x5636b9651340 2024-09-12T17:28:04.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.164+0000 7f92cce09640 1 -- 172.21.15.170:0/192662560 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93d0053dd0 con 0x5636b9651340 2024-09-12T17:28:04.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.164+0000 7f93e4935800 1 -- 172.21.15.170:0/192662560 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5636b9745ad0 con 0x5636b9651340 2024-09-12T17:28:04.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.164+0000 7f92cce09640 1 -- 172.21.15.170:0/192662560 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93d00735a0 con 0x5636b9651340 2024-09-12T17:28:04.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.164+0000 7f93e4935800 1 -- 172.21.15.170:0/192662560 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636b97466e0 con 0x5636b9651340 2024-09-12T17:28:04.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.165+0000 7f92cce09640 1 -- 172.21.15.170:0/192662560 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f93d007b070 con 0x5636b9651340 2024-09-12T17:28:04.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.165+0000 7f92cce09640 1 --2- 172.21.15.170:0/192662560 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f92c803c780 0x7f92c803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.165+0000 7f92cce09640 1 -- 172.21.15.170:0/192662560 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f93d00978b0 con 0x5636b9651340 2024-09-12T17:28:04.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.165+0000 7f93d7ee3640 1 --2- 172.21.15.170:0/192662560 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f92c803c780 0x7f92c803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.165+0000 7f93e4935800 1 --2- 172.21.15.170:0/192662560 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5636b974a920 0x5636b974cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.165+0000 7f93e4935800 1 -- 172.21.15.170:0/192662560 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5636b97470a0 con 0x5636b974a920 2024-09-12T17:28:04.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.165+0000 7f93e0ee5640 1 --2- 172.21.15.170:0/192662560 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5636b974a920 0x5636b974cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.166+0000 7f93d7ee3640 1 --2- 172.21.15.170:0/192662560 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f92c803c780 0x7f92c803ec40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f93c8000c00 tx=0x7f93c80013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.166+0000 7f93e0ee5640 1 --2- 172.21.15.170:0/192662560 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5636b974a920 0x5636b974cd10 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.166+0000 7f93e0ee5640 1 -- 172.21.15.170:0/192662560 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f93d800a4d0 con 0x5636b974a920 2024-09-12T17:28:04.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.166+0000 7f93e4935800 1 -- 172.21.15.170:0/192662560 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5636b9746a50 con 0x5636b974a920 2024-09-12T17:28:04.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.166+0000 7f93e0ee5640 1 -- 172.21.15.170:0/192662560 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f93d800a4d0 con 0x5636b974a920 2024-09-12T17:28:04.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.166+0000 7f93e4935800 1 --2- 172.21.15.170:0/192662560 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5636b974f180 0x5636b9751570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.166+0000 7f93e4935800 1 -- 172.21.15.170:0/192662560 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5636b9751c40 con 0x5636b974f180 2024-09-12T17:28:04.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.167+0000 7f93e06e4640 1 --2- 172.21.15.170:0/192662560 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5636b974f180 0x5636b9751570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.167+0000 7f93e06e4640 1 --2- 172.21.15.170:0/192662560 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5636b974f180 0x5636b9751570 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.167+0000 7f93e06e4640 1 -- 172.21.15.170:0/192662560 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f93d007a030 con 0x5636b974f180 2024-09-12T17:28:04.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.167+0000 7f93e4935800 1 -- 172.21.15.170:0/192662560 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5636b974dff0 con 0x5636b974a920 2024-09-12T17:28:04.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.167+0000 7f93e0ee5640 1 -- 172.21.15.170:0/192662560 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f93d800a4d0 con 0x5636b974a920 2024-09-12T17:28:04.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.167+0000 7f93e4935800 1 -- 172.21.15.170:0/192662560 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5636b974e490 con 0x5636b974f180 2024-09-12T17:28:04.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.168+0000 7f93e06e4640 1 -- 172.21.15.170:0/192662560 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f93d007a030 con 0x5636b974f180 2024-09-12T17:28:04.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.168+0000 7f93e4935800 1 Processor -- start 2024-09-12T17:28:04.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.168+0000 7f93e4935800 1 -- start start 2024-09-12T17:28:04.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.168+0000 7f93e4935800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5636b9760510 0x5636b9760930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.168+0000 7f93e4935800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5636b9542a00 con 0x5636b9760510 2024-09-12T17:28:04.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.169+0000 7f93e0ee5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5636b9760510 0x5636b9760930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.169+0000 7f93e0ee5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5636b9760510 0x5636b9760930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43490/0 (socket says 172.21.15.170:43490) 2024-09-12T17:28:04.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.169+0000 7f93e0ee5640 1 -- 172.21.15.170:0/4130195217 learned_addr learned my addr 172.21.15.170:0/4130195217 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:04.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.169+0000 7f93e0ee5640 1 -- 172.21.15.170:0/4130195217 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636b9760f70 con 0x5636b9760510 2024-09-12T17:28:04.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.169+0000 7f93e0ee5640 1 --2- 172.21.15.170:0/4130195217 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5636b9760510 0x5636b9760930 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x5636b97462e0 tx=0x7f93d80167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.169+0000 7f92c5ffb640 1 -- 172.21.15.170:0/4130195217 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93d8013640 con 0x5636b9760510 2024-09-12T17:28:04.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.169+0000 7f92c5ffb640 1 -- 172.21.15.170:0/4130195217 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93d80137e0 con 0x5636b9760510 2024-09-12T17:28:04.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.169+0000 7f93e4935800 1 -- 172.21.15.170:0/4130195217 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5636b97617a0 con 0x5636b9760510 2024-09-12T17:28:04.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.169+0000 7f92c5ffb640 1 -- 172.21.15.170:0/4130195217 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93d8013ac0 con 0x5636b9760510 2024-09-12T17:28:04.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.169+0000 7f93e4935800 1 -- 172.21.15.170:0/4130195217 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636b9761d40 con 0x5636b9760510 2024-09-12T17:28:04.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.170+0000 7f92c5ffb640 1 -- 172.21.15.170:0/4130195217 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f93d8011040 con 0x5636b9760510 2024-09-12T17:28:04.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.170+0000 7f92c5ffb640 1 --2- 172.21.15.170:0/4130195217 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f92b803c730 0x7f92b803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.170+0000 7f92c5ffb640 1 -- 172.21.15.170:0/4130195217 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f93d800e040 con 0x5636b9760510 2024-09-12T17:28:04.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.170+0000 7f93e06e4640 1 --2- 172.21.15.170:0/4130195217 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f92b803c730 0x7f92b803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.171+0000 7f93e4935800 1 Processor -- start 2024-09-12T17:28:04.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.171+0000 7f93e06e4640 1 --2- 172.21.15.170:0/4130195217 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f92b803c730 0x7f92b803ebf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x5636b974d320 tx=0x7f93d005f4c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.171+0000 7f93e4935800 1 -- start start 2024-09-12T17:28:04.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.171+0000 7f93e4935800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5636b976cf50 0x5636b976d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.171+0000 7f93e4935800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5636b973dfa0 con 0x5636b976cf50 2024-09-12T17:28:04.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.171+0000 7f93e0ee5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5636b976cf50 0x5636b976d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.171+0000 7f93e0ee5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5636b976cf50 0x5636b976d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43492/0 (socket says 172.21.15.170:43492) 2024-09-12T17:28:04.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.171+0000 7f93e0ee5640 1 -- 172.21.15.170:0/865122841 learned_addr learned my addr 172.21.15.170:0/865122841 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:04.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.171+0000 7f93e0ee5640 1 -- 172.21.15.170:0/865122841 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636b976d940 con 0x5636b976cf50 2024-09-12T17:28:04.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.171+0000 7f93e0ee5640 1 --2- 172.21.15.170:0/865122841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5636b976cf50 0x5636b976d350 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f93d8040fd0 tx=0x7f93d801fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa8483b019b3dcf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.172+0000 7f92bf7fe640 1 -- 172.21.15.170:0/865122841 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93d804a070 con 0x5636b976cf50 2024-09-12T17:28:04.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.172+0000 7f92bf7fe640 1 -- 172.21.15.170:0/865122841 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93d8055040 con 0x5636b976cf50 2024-09-12T17:28:04.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.172+0000 7f92bf7fe640 1 -- 172.21.15.170:0/865122841 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93d8021a60 con 0x5636b976cf50 2024-09-12T17:28:04.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.172+0000 7f93e4935800 1 -- 172.21.15.170:0/865122841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5636b976cf50 msgr2=0x5636b976d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.172+0000 7f93e4935800 1 --2- 172.21.15.170:0/865122841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5636b976cf50 0x5636b976d350 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f93d8040fd0 tx=0x7f93d801fc90 comp rx=0 tx=0).stop 2024-09-12T17:28:04.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.172+0000 7f93e4935800 1 -- 172.21.15.170:0/865122841 shutdown_connections 2024-09-12T17:28:04.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.172+0000 7f93e4935800 1 --2- 172.21.15.170:0/865122841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5636b976cf50 0x5636b976d350 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.172+0000 7f93e4935800 1 -- 172.21.15.170:0/865122841 >> 172.21.15.170:0/865122841 conn(0x5636b9769350 msgr2=0x5636b9767590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:04.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.172+0000 7f93e4935800 1 -- 172.21.15.170:0/865122841 shutdown_connections 2024-09-12T17:28:04.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.172+0000 7f93e4935800 1 -- 172.21.15.170:0/865122841 wait complete. 2024-09-12T17:28:04.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.172+0000 7f93e4935800 1 Processor -- start 2024-09-12T17:28:04.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.172+0000 7f93e4935800 1 -- start start 2024-09-12T17:28:04.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.173+0000 7f93e4935800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5636b976cf50 0x5636b9774540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.173+0000 7f93e4935800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5636b976df60 con 0x5636b976cf50 2024-09-12T17:28:04.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.173+0000 7f93e0ee5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5636b976cf50 0x5636b9774540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.173+0000 7f93e0ee5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5636b976cf50 0x5636b9774540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43506/0 (socket says 172.21.15.170:43506) 2024-09-12T17:28:04.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.173+0000 7f93e0ee5640 1 -- 172.21.15.170:0/931176816 learned_addr learned my addr 172.21.15.170:0/931176816 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:04.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.173+0000 7f93e0ee5640 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636b9774aa0 con 0x5636b976cf50 2024-09-12T17:28:04.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.173+0000 7f93e0ee5640 1 --2- 172.21.15.170:0/931176816 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5636b976cf50 0x5636b9774540 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f93d8020560 tx=0x7f93d8053d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.174+0000 7f92bdffb640 1 -- 172.21.15.170:0/931176816 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93d804a070 con 0x5636b976cf50 2024-09-12T17:28:04.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.174+0000 7f92bdffb640 1 -- 172.21.15.170:0/931176816 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93d804b040 con 0x5636b976cf50 2024-09-12T17:28:04.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.174+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5636b9774d30 con 0x5636b976cf50 2024-09-12T17:28:04.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.174+0000 7f92bdffb640 1 -- 172.21.15.170:0/931176816 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93d8013c60 con 0x5636b976cf50 2024-09-12T17:28:04.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.174+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636b97756b0 con 0x5636b976cf50 2024-09-12T17:28:04.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.174+0000 7f92bdffb640 1 -- 172.21.15.170:0/931176816 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f93d8031070 con 0x5636b976cf50 2024-09-12T17:28:04.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.175+0000 7f92bdffb640 1 --2- 172.21.15.170:0/931176816 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f92b003c780 0x7f92b003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.175+0000 7f92bdffb640 1 -- 172.21.15.170:0/931176816 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f93d803dae0 con 0x5636b976cf50 2024-09-12T17:28:04.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.175+0000 7f93e06e4640 1 --2- 172.21.15.170:0/931176816 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f92b003c780 0x7f92b003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.175+0000 7f93e06e4640 1 --2- 172.21.15.170:0/931176816 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f92b003c780 0x7f92b003ec40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f93d005daa0 tx=0x7f93d0093000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.175+0000 7f93e4935800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.175+0000 7f93e4935800 1 --2- 172.21.15.170:0/931176816 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5636b977feb0 0x5636b9782370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.175+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5636b9782ac0 con 0x5636b977feb0 2024-09-12T17:28:04.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.175+0000 7f93d7ee3640 1 --2- 172.21.15.170:0/931176816 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5636b977feb0 0x5636b9782370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.176+0000 7f93d7ee3640 1 --2- 172.21.15.170:0/931176816 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5636b977feb0 0x5636b9782370 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.176+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f93c800f5f0 con 0x5636b977feb0 2024-09-12T17:28:04.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.176+0000 7f93e4935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.176+0000 7f93e4935800 20 realm 2024-09-12T17:28:04.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.176+0000 7f93e4935800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.176+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5636b977f200 con 0x5636b977feb0 2024-09-12T17:28:04.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.176+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f93c800f5f0 con 0x5636b977feb0 2024-09-12T17:28:04.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.176+0000 7f93e4935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.176+0000 7f93e4935800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:04.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.176+0000 7f93e4935800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.176+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5636b97835b0 con 0x5636b977feb0 2024-09-12T17:28:04.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.176+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f93c800f5f0 con 0x5636b977feb0 2024-09-12T17:28:04.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.176+0000 7f93e4935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.176+0000 7f93e4935800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.176+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5636b9783e80 con 0x5636b977feb0 2024-09-12T17:28:04.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.176+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f93c800f5f0 con 0x5636b977feb0 2024-09-12T17:28:04.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.177+0000 7f93e4935800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:04.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.177+0000 7f93e4935800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.177+0000 7f93e4935800 1 --2- 172.21.15.170:0/931176816 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5636b97848a0 0x5636b9786c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.177+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5636b9787400 con 0x5636b97848a0 2024-09-12T17:28:04.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.177+0000 7f93e0ee5640 1 --2- 172.21.15.170:0/931176816 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5636b97848a0 0x5636b9786c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.177+0000 7f93e0ee5640 1 --2- 172.21.15.170:0/931176816 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5636b97848a0 0x5636b9786c90 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.177+0000 7f93e0ee5640 1 -- 172.21.15.170:0/931176816 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f93d800a4d0 con 0x5636b97848a0 2024-09-12T17:28:04.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.177+0000 7f93e4935800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:04.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.177+0000 7f93e4935800 20 searching for the correct realm 2024-09-12T17:28:04.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.177+0000 7f93e4935800 1 --2- 172.21.15.170:0/931176816 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5636b97893b0 0x5636b978b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.177+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5636b978bf40 con 0x5636b97893b0 2024-09-12T17:28:04.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.177+0000 7f93e06e4640 1 --2- 172.21.15.170:0/931176816 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5636b97893b0 0x5636b978b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.178+0000 7f93e06e4640 1 --2- 172.21.15.170:0/931176816 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5636b97893b0 0x5636b978b870 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.178+0000 7f93e06e4640 1 -- 172.21.15.170:0/931176816 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93d007a030 con 0x5636b97893b0 2024-09-12T17:28:04.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.178+0000 7f93e06e4640 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5636b978bf40 con 0x5636b97848a0 2024-09-12T17:28:04.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.178+0000 7f93e0ee5640 1 -- 172.21.15.170:0/931176816 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93d800a4d0 con 0x5636b97848a0 2024-09-12T17:28:04.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.178+0000 7f93e0ee5640 1 --2- 172.21.15.170:0/931176816 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f93d8012ab0 0x7f93d805c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.178+0000 7f93e0ee5640 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5636b978bf40 con 0x7f93d8012ab0 2024-09-12T17:28:04.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.178+0000 7f93d7ee3640 1 --2- 172.21.15.170:0/931176816 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f93d8012ab0 0x7f93d805c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.179+0000 7f93d7ee3640 1 --2- 172.21.15.170:0/931176816 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f93d8012ab0 0x7f93d805c650 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.179+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93c800f5f0 con 0x7f93d8012ab0 2024-09-12T17:28:04.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.179+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5636b978bf40 con 0x5636b977feb0 2024-09-12T17:28:04.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.179+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93c800f5f0 con 0x5636b977feb0 2024-09-12T17:28:04.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.179+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5636b978bf40 con 0x5636b977feb0 2024-09-12T17:28:04.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.180+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93c802b040 con 0x5636b977feb0 2024-09-12T17:28:04.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.180+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5636b978bf40 con 0x7f93d8012ab0 2024-09-12T17:28:04.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.180+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93c802b040 con 0x7f93d8012ab0 2024-09-12T17:28:04.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.180+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5636b978bf40 con 0x7f93d8012ab0 2024-09-12T17:28:04.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.180+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93c802b040 con 0x7f93d8012ab0 2024-09-12T17:28:04.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.180+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5636b978bf40 con 0x5636b97848a0 2024-09-12T17:28:04.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.180+0000 7f93e0ee5640 1 -- 172.21.15.170:0/931176816 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93d800a4d0 con 0x5636b97848a0 2024-09-12T17:28:04.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.180+0000 7f93e0ee5640 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5636b978bf40 con 0x5636b97893b0 2024-09-12T17:28:04.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.180+0000 7f93e06e4640 1 -- 172.21.15.170:0/931176816 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93d007a030 con 0x5636b97893b0 2024-09-12T17:28:04.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.180+0000 7f93e06e4640 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5636b978bf40 con 0x5636b977feb0 2024-09-12T17:28:04.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.181+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93c802b040 con 0x5636b977feb0 2024-09-12T17:28:04.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.181+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5636b978bf40 con 0x7f93d8012ab0 2024-09-12T17:28:04.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.181+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93c802b040 con 0x7f93d8012ab0 2024-09-12T17:28:04.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.181+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5636b978bf40 con 0x5636b977feb0 2024-09-12T17:28:04.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.181+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93c802b040 con 0x5636b977feb0 2024-09-12T17:28:04.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.181+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5636b978bf40 con 0x5636b97848a0 2024-09-12T17:28:04.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.181+0000 7f93e0ee5640 1 -- 172.21.15.170:0/931176816 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f93d800a4d0 con 0x5636b97848a0 2024-09-12T17:28:04.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.181+0000 7f93e0ee5640 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5636b978bf40 con 0x5636b97893b0 2024-09-12T17:28:04.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.182+0000 7f93e06e4640 1 -- 172.21.15.170:0/931176816 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93d007a030 con 0x5636b97893b0 2024-09-12T17:28:04.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.182+0000 7f93e06e4640 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5636b978bf40 con 0x5636b97893b0 2024-09-12T17:28:04.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.182+0000 7f93e06e4640 1 -- 172.21.15.170:0/931176816 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93d007a030 con 0x5636b97893b0 2024-09-12T17:28:04.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.182+0000 7f93e06e4640 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5636b978bf40 con 0x7f93d8012ab0 2024-09-12T17:28:04.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.182+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93c802b040 con 0x7f93d8012ab0 2024-09-12T17:28:04.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.182+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5636b978bf40 con 0x5636b97893b0 2024-09-12T17:28:04.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.182+0000 7f93e06e4640 1 -- 172.21.15.170:0/931176816 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93d007a030 con 0x5636b97893b0 2024-09-12T17:28:04.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.182+0000 7f93e06e4640 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5636b978bf40 con 0x5636b97893b0 2024-09-12T17:28:04.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.183+0000 7f93e06e4640 1 -- 172.21.15.170:0/931176816 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93d007a030 con 0x5636b97893b0 2024-09-12T17:28:04.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.183+0000 7f93e06e4640 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5636b978bf40 con 0x5636b977feb0 2024-09-12T17:28:04.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.183+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93c802b040 con 0x5636b977feb0 2024-09-12T17:28:04.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.183+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5636b978bf40 con 0x5636b977feb0 2024-09-12T17:28:04.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.183+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f93c802b040 con 0x5636b977feb0 2024-09-12T17:28:04.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.183+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5636b978bf40 con 0x7f93d8012ab0 2024-09-12T17:28:04.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.183+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93c802b040 con 0x7f93d8012ab0 2024-09-12T17:28:04.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.183+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5636b978bf40 con 0x5636b97893b0 2024-09-12T17:28:04.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.183+0000 7f93e06e4640 1 -- 172.21.15.170:0/931176816 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93d007a030 con 0x5636b97893b0 2024-09-12T17:28:04.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.184+0000 7f93e06e4640 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5636b978bf40 con 0x5636b97848a0 2024-09-12T17:28:04.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.184+0000 7f93e0ee5640 1 -- 172.21.15.170:0/931176816 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93d800a4d0 con 0x5636b97848a0 2024-09-12T17:28:04.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.184+0000 7f93e0ee5640 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5636b978bf40 con 0x5636b977feb0 2024-09-12T17:28:04.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.184+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93c802b040 con 0x5636b977feb0 2024-09-12T17:28:04.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.184+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5636b978bf40 con 0x7f93d8012ab0 2024-09-12T17:28:04.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.184+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93c803b040 con 0x7f93d8012ab0 2024-09-12T17:28:04.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.184+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5636b978bf40 con 0x5636b97893b0 2024-09-12T17:28:04.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.184+0000 7f93e06e4640 1 -- 172.21.15.170:0/931176816 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93d007a030 con 0x5636b97893b0 2024-09-12T17:28:04.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.184+0000 7f93e06e4640 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5636b978bf40 con 0x7f93d8012ab0 2024-09-12T17:28:04.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.185+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93c803b040 con 0x7f93d8012ab0 2024-09-12T17:28:04.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.185+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5636b978bf40 con 0x5636b97848a0 2024-09-12T17:28:04.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.185+0000 7f93e0ee5640 1 -- 172.21.15.170:0/931176816 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93d800a4d0 con 0x5636b97848a0 2024-09-12T17:28:04.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.185+0000 7f93e0ee5640 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5636b978bf40 con 0x5636b97893b0 2024-09-12T17:28:04.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.185+0000 7f93e06e4640 1 -- 172.21.15.170:0/931176816 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93d007a030 con 0x5636b97893b0 2024-09-12T17:28:04.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.185+0000 7f93e06e4640 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5636b978bf40 con 0x7f93d8012ab0 2024-09-12T17:28:04.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.186+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93c803b040 con 0x7f93d8012ab0 2024-09-12T17:28:04.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.186+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5636b978bf40 con 0x5636b977feb0 2024-09-12T17:28:04.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.186+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f93c803b040 con 0x5636b977feb0 2024-09-12T17:28:04.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.186+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5636b978bf40 con 0x5636b97848a0 2024-09-12T17:28:04.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.186+0000 7f93e0ee5640 1 -- 172.21.15.170:0/931176816 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f93d8068040 con 0x5636b97848a0 2024-09-12T17:28:04.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.186+0000 7f93e4935800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:04.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.186+0000 7f93e4935800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:04.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.186+0000 7f93e4935800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:04.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.186+0000 7f93e4935800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:04.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.186+0000 7f93e4935800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:04.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.186+0000 7f93e4935800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:04.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.186+0000 7f93e4935800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.186+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5636b9787e20 con 0x5636b977feb0 2024-09-12T17:28:04.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.186+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f93c803b040 con 0x5636b977feb0 2024-09-12T17:28:04.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.186+0000 7f93e4935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.186+0000 7f93e4935800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.186+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5636b97886c0 con 0x5636b977feb0 2024-09-12T17:28:04.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.187+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f93c803b040 con 0x5636b977feb0 2024-09-12T17:28:04.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.187+0000 7f93e4935800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:04.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.187+0000 7f93e4935800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.187+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5636b9787a60 con 0x5636b97848a0 2024-09-12T17:28:04.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.187+0000 7f93e0ee5640 1 -- 172.21.15.170:0/931176816 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f93d8068040 con 0x5636b97848a0 2024-09-12T17:28:04.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.187+0000 7f93e4935800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:04.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.187+0000 7f93e4935800 20 zone default found 2024-09-12T17:28:04.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.187+0000 7f93e4935800 4 Realm: () 2024-09-12T17:28:04.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.187+0000 7f93e4935800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:04.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.187+0000 7f93e4935800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:04.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.187+0000 7f93e4935800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:04.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.187+0000 7f93e4935800 20 zonegroup default 2024-09-12T17:28:04.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.187+0000 7f93e4935800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.187+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5636b978c870 con 0x7f93d8012ab0 2024-09-12T17:28:04.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.187+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f93c803b040 con 0x7f93d8012ab0 2024-09-12T17:28:04.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.187+0000 7f93e4935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.187+0000 7f93e4935800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.187+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5636b978e540 con 0x5636b97893b0 2024-09-12T17:28:04.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.187+0000 7f93e06e4640 1 -- 172.21.15.170:0/931176816 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f93d007a030 con 0x5636b97893b0 2024-09-12T17:28:04.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.187+0000 7f93e4935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.187+0000 7f93e4935800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.187+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5636b978e9b0 con 0x5636b97893b0 2024-09-12T17:28:04.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.188+0000 7f93e06e4640 1 -- 172.21.15.170:0/931176816 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f93d007a030 con 0x5636b97893b0 2024-09-12T17:28:04.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.188+0000 7f93e4935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.188+0000 7f93e4935800 20 started sync module instance, tier type = 2024-09-12T17:28:04.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.188+0000 7f93e4935800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:04.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.188+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5636b978d310 con 0x5636b97848a0 2024-09-12T17:28:04.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.189+0000 7f93e0ee5640 1 -- 172.21.15.170:0/931176816 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93d8068040 con 0x5636b97848a0 2024-09-12T17:28:04.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.189+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94793039924832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5636b978ee10 con 0x5636b97848a0 2024-09-12T17:28:04.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.189+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5636b978f660 con 0x5636b977feb0 2024-09-12T17:28:04.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.190+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93c803b040 con 0x5636b977feb0 2024-09-12T17:28:04.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.190+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94793039933216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5636b978f990 con 0x5636b977feb0 2024-09-12T17:28:04.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.190+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5636b9790490 con 0x5636b97893b0 2024-09-12T17:28:04.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.190+0000 7f93e0ee5640 1 -- 172.21.15.170:0/931176816 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94793039924832] v29'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93d8068040 con 0x5636b97848a0 2024-09-12T17:28:04.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.191+0000 7f93e06e4640 1 -- 172.21.15.170:0/931176816 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93d007a030 con 0x5636b97893b0 2024-09-12T17:28:04.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.191+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94793039937408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5636b9790450 con 0x5636b97893b0 2024-09-12T17:28:04.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.191+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5636b9790f40 con 0x5636b97848a0 2024-09-12T17:28:04.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.191+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94793039933216] v29'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93c803b040 con 0x5636b977feb0 2024-09-12T17:28:04.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.192+0000 7f93e06e4640 1 -- 172.21.15.170:0/931176816 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94793039937408] v29'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93d007a030 con 0x5636b97893b0 2024-09-12T17:28:04.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.192+0000 7f93e0ee5640 1 -- 172.21.15.170:0/931176816 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93d8068040 con 0x5636b97848a0 2024-09-12T17:28:04.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.192+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94793039927040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5636b9790f00 con 0x5636b97848a0 2024-09-12T17:28:04.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.192+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5636b97917e0 con 0x5636b977feb0 2024-09-12T17:28:04.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.193+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93c803b040 con 0x5636b977feb0 2024-09-12T17:28:04.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.193+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94793039942448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5636b9791c00 con 0x5636b977feb0 2024-09-12T17:28:04.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.193+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5636b9792450 con 0x7f93d8012ab0 2024-09-12T17:28:04.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.193+0000 7f93e0ee5640 1 -- 172.21.15.170:0/931176816 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94793039927040] v29'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93d8068040 con 0x5636b97848a0 2024-09-12T17:28:04.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.194+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93c803b040 con 0x7f93d8012ab0 2024-09-12T17:28:04.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.194+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94793039944704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5636b9792840 con 0x7f93d8012ab0 2024-09-12T17:28:04.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.194+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5636b9793090 con 0x7f93d8012ab0 2024-09-12T17:28:04.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.194+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94793039942448] v29'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93c803b040 con 0x5636b977feb0 2024-09-12T17:28:04.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.195+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94793039944704] v29'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93c803b040 con 0x7f93d8012ab0 2024-09-12T17:28:04.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.195+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(56 notify.6 [create] v29'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93c803b040 con 0x7f93d8012ab0 2024-09-12T17:28:04.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.195+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94793039943504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5636b9792130 con 0x7f93d8012ab0 2024-09-12T17:28:04.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.195+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5636b97932b0 con 0x7f93d8012ab0 2024-09-12T17:28:04.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.196+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(58 notify.7 [create] v29'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93c803b040 con 0x7f93d8012ab0 2024-09-12T17:28:04.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.196+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94793039943504] v29'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93c803b040 con 0x7f93d8012ab0 2024-09-12T17:28:04.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.196+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94793039949152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5636b9793720 con 0x7f93d8012ab0 2024-09-12T17:28:04.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.196+0000 7f93e4935800 20 add_watcher() i=0 2024-09-12T17:28:04.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.196+0000 7f93e4935800 20 add_watcher() i=1 2024-09-12T17:28:04.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.196+0000 7f93e4935800 20 add_watcher() i=2 2024-09-12T17:28:04.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.196+0000 7f93e4935800 20 add_watcher() i=3 2024-09-12T17:28:04.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.196+0000 7f93e4935800 20 add_watcher() i=4 2024-09-12T17:28:04.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.196+0000 7f93e4935800 20 add_watcher() i=5 2024-09-12T17:28:04.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.196+0000 7f93e4935800 20 add_watcher() i=6 2024-09-12T17:28:04.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.197+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94793039949152] v29'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93c803b040 con 0x7f93d8012ab0 2024-09-12T17:28:04.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.197+0000 7f93e4935800 20 add_watcher() i=7 2024-09-12T17:28:04.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.197+0000 7f93e4935800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:04.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.197+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5636b9793720 con 0x5636b977feb0 2024-09-12T17:28:04.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.198+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f93c803b040 con 0x5636b977feb0 2024-09-12T17:28:04.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.198+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94793039950448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5636b97936c0 con 0x5636b977feb0 2024-09-12T17:28:04.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.199+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94793039950448] v29'119 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f93c803b040 con 0x5636b977feb0 2024-09-12T17:28:04.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.199+0000 7f92967e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:04.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.199+0000 7f93e4935800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:04.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.199+0000 7f93e4935800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:04.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.199+0000 7f93e4935800 5 note: GC not initialized 2024-09-12T17:28:04.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.199+0000 7f92957e2640 20 reqs_thread_entry: start 2024-09-12T17:28:04.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.199+0000 7f93e4935800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:04.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.200+0000 7f93e4935800 20 Filter name: none 2024-09-12T17:28:04.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.200+0000 7f9206ffd640 20 reqs_thread_entry: start 2024-09-12T17:28:04.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.200+0000 7f93e4935800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:28:04.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.200+0000 7f93e4935800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.200+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5636b97c97b0 con 0x5636b977feb0 2024-09-12T17:28:04.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.200+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f93c803b040 con 0x5636b977feb0 2024-09-12T17:28:04.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.200+0000 7f93e4935800 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:28:04.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.200+0000 7f93e4935800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T17:28:04.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.200+0000 7f93e4935800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:28:04.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.200+0000 7f93e4935800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:04.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.200+0000 7f93e4935800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T17:28:04.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.200+0000 7f93e4935800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.200+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5636b97cb740 con 0x5636b97848a0 2024-09-12T17:28:04.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.200+0000 7f93e0ee5640 1 -- 172.21.15.170:0/931176816 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f93d8068040 con 0x5636b97848a0 2024-09-12T17:28:04.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.200+0000 7f93e4935800 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T17:28:04.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.200+0000 7f93e4935800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-12T17:28:04.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.200+0000 7f93e4935800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:28:04.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.200+0000 7f93e4935800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 : miss 2024-09-12T17:28:04.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.200+0000 7f93e4935800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.200+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:64 8.1d 8:baccd554:root::.bucket.meta.myfoo%3a7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5636b97ccfc0 con 0x7f93d8012ab0 2024-09-12T17:28:04.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.201+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(64 .bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f93c803b040 con 0x7f93d8012ab0 2024-09-12T17:28:04.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.201+0000 7f93e4935800 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T17:28:04.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.201+0000 7f93e4935800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 info.flags=0x17 2024-09-12T17:28:04.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.201+0000 7f93e4935800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 to cache LRU end 2024-09-12T17:28:04.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.201+0000 7f93e4935800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:04.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.201+0000 7f93e4935800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:28:04.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.201+0000 7f93e4935800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 2024-09-12T17:28:04.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.201+0000 7f93e4935800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-12T17:28:04.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.201+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5636b97d15d0 con 0x7f93d8012ab0 2024-09-12T17:28:04.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.202+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(65 fud.buckets [call] v29'3 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f93c803b040 con 0x7f93d8012ab0 2024-09-12T17:28:04.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.202+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:66 8.1d 8:baccd554:root::.bucket.meta.myfoo%3a7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5636b97d7350 con 0x7f93d8012ab0 2024-09-12T17:28:04.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.203+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(66 .bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v29'3 uv3 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f93c803b040 con 0x7f93d8012ab0 2024-09-12T17:28:04.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.203+0000 7f93e4935800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 info.flags=0x17 2024-09-12T17:28:04.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.203+0000 7f93e4935800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 to cache LRU end 2024-09-12T17:28:04.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.203+0000 7f93e4935800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:28:04.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.203+0000 7f93e4935800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1, ofs0, ns] 2024-09-12T17:28:04.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.203+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:67 7.9 7:93e5b521:::notify.7:head [notify cookie 94793040189056 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5636b97d1a00 con 0x7f93d8012ab0 2024-09-12T17:28:04.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.203+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== watch-notify(notify (1) cookie 94793039949152 notify 124554051591 ret 0) ==== 802+0+0 (crc 0 0 0) 0x5636b97cd3b0 con 0x7f93d8012ab0 2024-09-12T17:28:04.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.203+0000 7f92bf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051591 cookie 94793039949152 notifier 4519 bl.length()=760 2024-09-12T17:28:04.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.203+0000 7f92bf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 info.flags=0x17 2024-09-12T17:28:04.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.203+0000 7f92bf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 to cache LRU end 2024-09-12T17:28:04.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.203+0000 7f92bf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:28:04.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.203+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== osd_op_reply(67 notify.7 [notify cookie 94793040189056 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f93c803b040 con 0x7f93d8012ab0 2024-09-12T17:28:04.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.204+0000 7f92bf7fe640 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:68 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f92a4003ea0 con 0x7f93d8012ab0 2024-09-12T17:28:04.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.204+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.0 v2:172.21.15.47:6800/3978157098 22 ==== watch-notify(notify_complete (2) cookie 94793040189056 notify 124554051591 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5636b97cc530 con 0x7f93d8012ab0 2024-09-12T17:28:04.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.204+0000 7f93e4935800 20 handle_bi_update(): bucket=:myfoo[7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1]): orig_sources= new_sources= 2024-09-12T17:28:04.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.204+0000 7f93e4935800 20 handle_bi_update(): bucket=:myfoo[7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1]): potential sources added=[] removed=[] 2024-09-12T17:28:04.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.204+0000 7f93e4935800 20 handle_bi_update(): bucket=:myfoo[7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1]): orig_dests= new_dests= 2024-09-12T17:28:04.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.204+0000 7f93e4935800 20 handle_bi_update(): bucket=:myfoo[7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1]): potential dests added=[] removed=[] 2024-09-12T17:28:04.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.204+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.0 v2:172.21.15.47:6800/3978157098 23 ==== osd_op_reply(68 notify.7 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93c803b040 con 0x7f93d8012ab0 2024-09-12T17:28:04.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.204+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5636b97cd660 con 0x5636b97848a0 2024-09-12T17:28:04.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.205+0000 7f93e0ee5640 1 -- 172.21.15.170:0/931176816 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(69 foo.buckets [call] v29'22 uv22 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f93d8068040 con 0x5636b97848a0 2024-09-12T17:28:04.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.205+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5636b97cd660 con 0x5636b97848a0 2024-09-12T17:28:04.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.206+0000 7f93e0ee5640 1 -- 172.21.15.170:0/931176816 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v29'23 uv23 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f93d8068040 con 0x5636b97848a0 2024-09-12T17:28:04.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.206+0000 7f93e4935800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-12T17:28:04.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.206+0000 7f93e4935800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:28:04.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.206+0000 7f93e4935800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-12T17:28:04.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.206+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94793040189024 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5636b97d61a0 con 0x7f93d8012ab0 2024-09-12T17:28:04.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.206+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.0 v2:172.21.15.47:6800/3978157098 24 ==== watch-notify(notify (1) cookie 94793039943504 notify 124554051592 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7f93c8018040 con 0x7f93d8012ab0 2024-09-12T17:28:04.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.206+0000 7f92bf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051592 cookie 94793039943504 notifier 4519 bl.length()=314 2024-09-12T17:28:04.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.206+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.0 v2:172.21.15.47:6800/3978157098 25 ==== osd_op_reply(71 notify.6 [notify cookie 94793040189024 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f93c803b040 con 0x7f93d8012ab0 2024-09-12T17:28:04.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.206+0000 7f92bf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-12T17:28:04.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.206+0000 7f92bf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:28:04.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.206+0000 7f92bf7fe640 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f92a4003ea0 con 0x7f93d8012ab0 2024-09-12T17:28:04.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.206+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.0 v2:172.21.15.47:6800/3978157098 26 ==== watch-notify(notify_complete (2) cookie 94793040189024 notify 124554051592 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f93c801d810 con 0x7f93d8012ab0 2024-09-12T17:28:04.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.207+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.0 v2:172.21.15.47:6800/3978157098 27 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93c803b040 con 0x7f93d8012ab0 2024-09-12T17:28:04.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.207+0000 7f92967e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:04.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.207+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94793039950448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5636b97c7650 con 0x5636b977feb0 2024-09-12T17:28:04.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.208+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94793039950448] v29'120 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f93c803b040 con 0x5636b977feb0 2024-09-12T17:28:04.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.208+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94793039924832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5636b97c7650 con 0x5636b97848a0 2024-09-12T17:28:04.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.209+0000 7f93e0ee5640 1 -- 172.21.15.170:0/931176816 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94793039924832] v29'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93d8068040 con 0x5636b97848a0 2024-09-12T17:28:04.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.209+0000 7f93e4935800 20 remove_watcher() i=0 2024-09-12T17:28:04.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.209+0000 7f93e4935800 2 removed watcher, disabling cache 2024-09-12T17:28:04.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.209+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94793039933216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5636b97c7650 con 0x5636b977feb0 2024-09-12T17:28:04.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.210+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94793039933216] v29'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93c803b040 con 0x5636b977feb0 2024-09-12T17:28:04.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.210+0000 7f93e4935800 20 remove_watcher() i=1 2024-09-12T17:28:04.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.210+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94793039937408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5636b97c7650 con 0x5636b97893b0 2024-09-12T17:28:04.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.211+0000 7f93e06e4640 1 -- 172.21.15.170:0/931176816 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94793039937408] v29'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93d007a030 con 0x5636b97893b0 2024-09-12T17:28:04.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.211+0000 7f93e4935800 20 remove_watcher() i=2 2024-09-12T17:28:04.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.211+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94793039927040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5636b97c7650 con 0x5636b97848a0 2024-09-12T17:28:04.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.212+0000 7f93e0ee5640 1 -- 172.21.15.170:0/931176816 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94793039927040] v29'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93d8068040 con 0x5636b97848a0 2024-09-12T17:28:04.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.212+0000 7f93e4935800 20 remove_watcher() i=3 2024-09-12T17:28:04.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.212+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94793039942448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5636b97c7650 con 0x5636b977feb0 2024-09-12T17:28:04.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.213+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94793039942448] v29'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93c803b040 con 0x5636b977feb0 2024-09-12T17:28:04.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.213+0000 7f93e4935800 20 remove_watcher() i=4 2024-09-12T17:28:04.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.213+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94793039944704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5636b97c7650 con 0x7f93d8012ab0 2024-09-12T17:28:04.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.214+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.0 v2:172.21.15.47:6800/3978157098 28 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94793039944704] v29'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93c803b040 con 0x7f93d8012ab0 2024-09-12T17:28:04.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.214+0000 7f93e4935800 20 remove_watcher() i=5 2024-09-12T17:28:04.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.214+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94793039943504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5636b97c7650 con 0x7f93d8012ab0 2024-09-12T17:28:04.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.215+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.0 v2:172.21.15.47:6800/3978157098 29 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94793039943504] v29'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93c803b040 con 0x7f93d8012ab0 2024-09-12T17:28:04.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.215+0000 7f93e4935800 20 remove_watcher() i=6 2024-09-12T17:28:04.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.215+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94793039949152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5636b97c7650 con 0x7f93d8012ab0 2024-09-12T17:28:04.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.216+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 <== osd.0 v2:172.21.15.47:6800/3978157098 30 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94793039949152] v29'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93c803b040 con 0x7f93d8012ab0 2024-09-12T17:28:04.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.216+0000 7f93e4935800 20 remove_watcher() i=7 2024-09-12T17:28:04.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.217+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f93d8012ab0 msgr2=0x7f93d805c650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.217+0000 7f93e4935800 1 --2- 172.21.15.170:0/931176816 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f93d8012ab0 0x7f93d805c650 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.217+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5636b977feb0 msgr2=0x5636b9782370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.217+0000 7f93e4935800 1 --2- 172.21.15.170:0/931176816 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5636b977feb0 0x5636b9782370 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.217+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5636b97848a0 msgr2=0x5636b9786c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.217+0000 7f93e4935800 1 --2- 172.21.15.170:0/931176816 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5636b97848a0 0x5636b9786c90 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.217+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5636b97893b0 msgr2=0x5636b978b870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.217+0000 7f93e4935800 1 --2- 172.21.15.170:0/931176816 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5636b97893b0 0x5636b978b870 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.217+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f92b003c780 msgr2=0x7f92b003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.217+0000 7f93e4935800 1 --2- 172.21.15.170:0/931176816 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f92b003c780 0x7f92b003ec40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f93d005daa0 tx=0x7f93d0093000 comp rx=0 tx=0).stop 2024-09-12T17:28:04.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.217+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5636b976cf50 msgr2=0x5636b9774540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.217+0000 7f93e4935800 1 --2- 172.21.15.170:0/931176816 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5636b976cf50 0x5636b9774540 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f93d8020560 tx=0x7f93d8053d00 comp rx=0 tx=0).stop 2024-09-12T17:28:04.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.217+0000 7f93d7ee3640 1 -- 172.21.15.170:0/931176816 reap_dead start 2024-09-12T17:28:04.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.217+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 shutdown_connections 2024-09-12T17:28:04.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.217+0000 7f93e4935800 1 --2- 172.21.15.170:0/931176816 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5636b976cf50 0x5636b9774540 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.217+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 >> 172.21.15.170:0/931176816 conn(0x5636b9769350 msgr2=0x5636b9767560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:04.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.217+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 shutdown_connections 2024-09-12T17:28:04.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.217+0000 7f93e4935800 1 -- 172.21.15.170:0/931176816 wait complete. 2024-09-12T17:28:04.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.217+0000 7f93e4935800 1 -- 172.21.15.170:0/4130195217 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f92b803c730 msgr2=0x7f92b803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.217+0000 7f93e4935800 1 --2- 172.21.15.170:0/4130195217 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f92b803c730 0x7f92b803ebf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x5636b974d320 tx=0x7f93d005f4c0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.217+0000 7f93e4935800 1 -- 172.21.15.170:0/4130195217 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5636b9760510 msgr2=0x5636b9760930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.217+0000 7f93e4935800 1 --2- 172.21.15.170:0/4130195217 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5636b9760510 0x5636b9760930 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x5636b97462e0 tx=0x7f93d80167b0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.217+0000 7f93e4935800 1 -- 172.21.15.170:0/4130195217 shutdown_connections 2024-09-12T17:28:04.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.217+0000 7f93e4935800 1 --2- 172.21.15.170:0/4130195217 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f92b803c730 0x7f92b803ebf0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.217+0000 7f93e4935800 1 --2- 172.21.15.170:0/4130195217 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5636b9760510 0x5636b9760930 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.217+0000 7f93e4935800 1 -- 172.21.15.170:0/4130195217 >> 172.21.15.170:0/4130195217 conn(0x5636b97548c0 msgr2=0x5636b9754ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:04.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.217+0000 7f93e4935800 1 -- 172.21.15.170:0/4130195217 shutdown_connections 2024-09-12T17:28:04.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.217+0000 7f93e4935800 1 -- 172.21.15.170:0/4130195217 wait complete. 2024-09-12T17:28:04.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.218+0000 7f93e4935800 1 -- 172.21.15.170:0/192662560 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5636b974a920 msgr2=0x5636b974cd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.218+0000 7f93e4935800 1 --2- 172.21.15.170:0/192662560 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5636b974a920 0x5636b974cd10 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.218+0000 7f93e4935800 1 -- 172.21.15.170:0/192662560 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5636b974f180 msgr2=0x5636b9751570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.218+0000 7f93e4935800 1 --2- 172.21.15.170:0/192662560 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5636b974f180 0x5636b9751570 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.218+0000 7f93e4935800 1 -- 172.21.15.170:0/192662560 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f92c803c780 msgr2=0x7f92c803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.218+0000 7f93e4935800 1 --2- 172.21.15.170:0/192662560 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f92c803c780 0x7f92c803ec40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f93c8000c00 tx=0x7f93c80013b0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.218+0000 7f93e4935800 1 -- 172.21.15.170:0/192662560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5636b9651340 msgr2=0x5636b97452e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.218+0000 7f93e4935800 1 --2- 172.21.15.170:0/192662560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5636b9651340 0x5636b97452e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f93d0025c20 tx=0x7f93d0002fb0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.218+0000 7f93e4935800 1 -- 172.21.15.170:0/192662560 shutdown_connections 2024-09-12T17:28:04.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.218+0000 7f93e4935800 1 --2- 172.21.15.170:0/192662560 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5636b974f180 0x5636b9751570 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.218+0000 7f93e4935800 1 --2- 172.21.15.170:0/192662560 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f92c803c780 0x7f92c803ec40 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.218+0000 7f93e4935800 1 --2- 172.21.15.170:0/192662560 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5636b974a920 0x5636b974cd10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.218+0000 7f93e4935800 1 --2- 172.21.15.170:0/192662560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5636b9651340 0x5636b97452e0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.218+0000 7f93e4935800 1 -- 172.21.15.170:0/192662560 >> 172.21.15.170:0/192662560 conn(0x5636b9645940 msgr2=0x5636b973ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:04.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.218+0000 7f93e4935800 1 -- 172.21.15.170:0/192662560 shutdown_connections 2024-09-12T17:28:04.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.218+0000 7f93e4935800 1 -- 172.21.15.170:0/192662560 wait complete. 2024-09-12T17:28:04.235 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-12T17:28:04.235 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-12T17:28:04.235 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-12T17:28:04.279 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:04.279 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:04.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.278+0000 7fac6af26800 1 Processor -- start 2024-09-12T17:28:04.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.278+0000 7fac6af26800 1 -- start start 2024-09-12T17:28:04.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.278+0000 7fac6af26800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5559a52d2aa0 0x5559a5366ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.278+0000 7fac6af26800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5559a5207e40 con 0x5559a52d1f90 2024-09-12T17:28:04.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.278+0000 7fac6af26800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x5559a51d2680 con 0x5559a52d2aa0 2024-09-12T17:28:04.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.278+0000 7fac663d8640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5559a52d2aa0 0x5559a5366ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.278+0000 7fac66bd9640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x5559a52d1f90 0x5559a52d2390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:36996/0 (socket says 172.21.15.170:36996) 2024-09-12T17:28:04.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.278+0000 7fac66bd9640 1 -- 172.21.15.170:0/4144145403 learned_addr learned my addr 172.21.15.170:0/4144145403 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:28:04.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.278+0000 7fac663d8640 1 -- 172.21.15.170:0/4144145403 >> v1:172.21.15.47:6789/0 conn(0x5559a52d1f90 legacy=0x5559a52d2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.279+0000 7fac663d8640 1 -- 172.21.15.170:0/4144145403 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559a51ee6b0 con 0x5559a52d2aa0 2024-09-12T17:28:04.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.280+0000 7fac663d8640 1 --2- 172.21.15.170:0/4144145403 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559a52d2aa0 0x5559a5366ad0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fac5c00a470 tx=0x7fac5c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67990cbc43c394da server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.280+0000 7fac65bd7640 1 -- 172.21.15.170:0/4144145403 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac5c053570 con 0x5559a52d2aa0 2024-09-12T17:28:04.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.280+0000 7fac65bd7640 1 -- 172.21.15.170:0/4144145403 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac5c058070 con 0x5559a52d2aa0 2024-09-12T17:28:04.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.280+0000 7fac65bd7640 1 -- 172.21.15.170:0/4144145403 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac5c053880 con 0x5559a52d2aa0 2024-09-12T17:28:04.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.281+0000 7fac6af26800 1 -- 172.21.15.170:0/4144145403 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559a52d2aa0 msgr2=0x5559a5366ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.281+0000 7fac6af26800 1 --2- 172.21.15.170:0/4144145403 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559a52d2aa0 0x5559a5366ad0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fac5c00a470 tx=0x7fac5c045a20 comp rx=0 tx=0).stop 2024-09-12T17:28:04.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.281+0000 7fac6af26800 1 -- 172.21.15.170:0/4144145403 shutdown_connections 2024-09-12T17:28:04.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.281+0000 7fac6af26800 1 --2- 172.21.15.170:0/4144145403 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559a52d2aa0 0x5559a5366ad0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.281+0000 7fac6af26800 1 -- 172.21.15.170:0/4144145403 >> 172.21.15.170:0/4144145403 conn(0x5559a53593c0 msgr2=0x5559a535b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:04.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.281+0000 7fac6af26800 1 -- 172.21.15.170:0/4144145403 shutdown_connections 2024-09-12T17:28:04.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.281+0000 7fac6af26800 1 -- 172.21.15.170:0/4144145403 wait complete. 2024-09-12T17:28:04.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.295+0000 7fac6af26800 1 Processor -- start 2024-09-12T17:28:04.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.295+0000 7fac6af26800 1 -- start start 2024-09-12T17:28:04.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.295+0000 7fac6af26800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559a52d1f90 0x5559a544f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.295+0000 7fac6af26800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5559a51f6dd0 con 0x5559a52d1f90 2024-09-12T17:28:04.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.295+0000 7fac66bd9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559a52d1f90 0x5559a544f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.295+0000 7fac66bd9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559a52d1f90 0x5559a544f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43522/0 (socket says 172.21.15.170:43522) 2024-09-12T17:28:04.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.295+0000 7fac66bd9640 1 -- 172.21.15.170:0/3080478385 learned_addr learned my addr 172.21.15.170:0/3080478385 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:04.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.296+0000 7fac66bd9640 1 -- 172.21.15.170:0/3080478385 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559a520fe10 con 0x5559a52d1f90 2024-09-12T17:28:04.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.296+0000 7fac66bd9640 1 --2- 172.21.15.170:0/3080478385 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559a52d1f90 0x5559a544f780 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fac58001e40 tx=0x7fac58001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bb3772157d8ff70 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.296+0000 7fab54e09640 1 -- 172.21.15.170:0/3080478385 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac58012020 con 0x5559a52d1f90 2024-09-12T17:28:04.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.296+0000 7fab54e09640 1 -- 172.21.15.170:0/3080478385 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac5800e5a0 con 0x5559a52d1f90 2024-09-12T17:28:04.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.296+0000 7fab54e09640 1 -- 172.21.15.170:0/3080478385 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac5800e8a0 con 0x5559a52d1f90 2024-09-12T17:28:04.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.297+0000 7fac6af26800 1 -- 172.21.15.170:0/3080478385 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559a52d1f90 msgr2=0x5559a544f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.297+0000 7fac6af26800 1 --2- 172.21.15.170:0/3080478385 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559a52d1f90 0x5559a544f780 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fac58001e40 tx=0x7fac58001e70 comp rx=0 tx=0).stop 2024-09-12T17:28:04.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.297+0000 7fac6af26800 1 -- 172.21.15.170:0/3080478385 shutdown_connections 2024-09-12T17:28:04.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.297+0000 7fac6af26800 1 --2- 172.21.15.170:0/3080478385 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559a52d1f90 0x5559a544f780 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.297+0000 7fac6af26800 1 -- 172.21.15.170:0/3080478385 >> 172.21.15.170:0/3080478385 conn(0x5559a53593c0 msgr2=0x5559a544b100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:04.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.297+0000 7fac6af26800 1 -- 172.21.15.170:0/3080478385 shutdown_connections 2024-09-12T17:28:04.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.297+0000 7fac6af26800 1 -- 172.21.15.170:0/3080478385 wait complete. 2024-09-12T17:28:04.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.297+0000 7fac6af26800 1 Processor -- start 2024-09-12T17:28:04.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.297+0000 7fac6af26800 1 -- start start 2024-09-12T17:28:04.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.297+0000 7fac6af26800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559a52d1f90 0x5559a54570d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.297+0000 7fac6af26800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5559a5367310 con 0x5559a52d1f90 2024-09-12T17:28:04.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.297+0000 7fac66bd9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559a52d1f90 0x5559a54570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.297+0000 7fac66bd9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559a52d1f90 0x5559a54570d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43538/0 (socket says 172.21.15.170:43538) 2024-09-12T17:28:04.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.297+0000 7fac66bd9640 1 -- 172.21.15.170:0/3415227693 learned_addr learned my addr 172.21.15.170:0/3415227693 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:04.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.298+0000 7fac66bd9640 1 -- 172.21.15.170:0/3415227693 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559a5457630 con 0x5559a52d1f90 2024-09-12T17:28:04.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.298+0000 7fac66bd9640 1 --2- 172.21.15.170:0/3415227693 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559a52d1f90 0x5559a54570d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fac5800c010 tx=0x7fac58000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.298+0000 7fab53606640 1 -- 172.21.15.170:0/3415227693 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac58012030 con 0x5559a52d1f90 2024-09-12T17:28:04.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.298+0000 7fab53606640 1 -- 172.21.15.170:0/3415227693 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac580014a0 con 0x5559a52d1f90 2024-09-12T17:28:04.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.298+0000 7fac6af26800 1 -- 172.21.15.170:0/3415227693 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5559a54578c0 con 0x5559a52d1f90 2024-09-12T17:28:04.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.298+0000 7fab53606640 1 -- 172.21.15.170:0/3415227693 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac5801a7a0 con 0x5559a52d1f90 2024-09-12T17:28:04.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.298+0000 7fac6af26800 1 -- 172.21.15.170:0/3415227693 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559a54582c0 con 0x5559a52d1f90 2024-09-12T17:28:04.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.299+0000 7fab53606640 1 -- 172.21.15.170:0/3415227693 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fac58015020 con 0x5559a52d1f90 2024-09-12T17:28:04.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.299+0000 7fab53606640 1 --2- 172.21.15.170:0/3415227693 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fab4c03c780 0x7fab4c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.299+0000 7fab53606640 1 -- 172.21.15.170:0/3415227693 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fac58020030 con 0x5559a52d1f90 2024-09-12T17:28:04.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.299+0000 7fac663d8640 1 --2- 172.21.15.170:0/3415227693 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fab4c03c780 0x7fab4c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.299+0000 7fac6af26800 1 --2- 172.21.15.170:0/3415227693 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5559a52d2aa0 0x5559a545e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.299+0000 7fac6af26800 1 -- 172.21.15.170:0/3415227693 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5559a5458e50 con 0x5559a52d2aa0 2024-09-12T17:28:04.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.299+0000 7fac673da640 1 --2- 172.21.15.170:0/3415227693 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5559a52d2aa0 0x5559a545e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.300+0000 7fac663d8640 1 --2- 172.21.15.170:0/3415227693 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fab4c03c780 0x7fab4c03ec40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fac5c057000 tx=0x7fac5c052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.300+0000 7fac673da640 1 --2- 172.21.15.170:0/3415227693 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5559a52d2aa0 0x5559a545e720 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.300+0000 7fac673da640 1 -- 172.21.15.170:0/3415227693 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fac6000a4d0 con 0x5559a52d2aa0 2024-09-12T17:28:04.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.300+0000 7fac6af26800 1 -- 172.21.15.170:0/3415227693 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5559a5458750 con 0x5559a52d2aa0 2024-09-12T17:28:04.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.300+0000 7fac673da640 1 -- 172.21.15.170:0/3415227693 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fac6000a4d0 con 0x5559a52d2aa0 2024-09-12T17:28:04.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.300+0000 7fac6af26800 1 --2- 172.21.15.170:0/3415227693 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5559a5460b90 0x5559a5462f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.300+0000 7fac6af26800 1 -- 172.21.15.170:0/3415227693 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5559a5463650 con 0x5559a5460b90 2024-09-12T17:28:04.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.300+0000 7fac66bd9640 1 --2- 172.21.15.170:0/3415227693 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5559a5460b90 0x5559a5462f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.301+0000 7fac66bd9640 1 --2- 172.21.15.170:0/3415227693 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5559a5460b90 0x5559a5462f80 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.301+0000 7fac66bd9640 1 -- 172.21.15.170:0/3415227693 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fac580187b0 con 0x5559a5460b90 2024-09-12T17:28:04.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.301+0000 7fac6af26800 1 -- 172.21.15.170:0/3415227693 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5559a545fa30 con 0x5559a52d2aa0 2024-09-12T17:28:04.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.301+0000 7fac673da640 1 -- 172.21.15.170:0/3415227693 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fac6000a4d0 con 0x5559a52d2aa0 2024-09-12T17:28:04.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.301+0000 7fac6af26800 1 -- 172.21.15.170:0/3415227693 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5559a545fed0 con 0x5559a5460b90 2024-09-12T17:28:04.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.302+0000 7fac66bd9640 1 -- 172.21.15.170:0/3415227693 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fac580187b0 con 0x5559a5460b90 2024-09-12T17:28:04.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.302+0000 7fac6af26800 1 Processor -- start 2024-09-12T17:28:04.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.302+0000 7fac6af26800 1 -- start start 2024-09-12T17:28:04.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.302+0000 7fac6af26800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559a5471f00 0x5559a5472320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.302+0000 7fac6af26800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5559a5254a00 con 0x5559a5471f00 2024-09-12T17:28:04.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.302+0000 7fac673da640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559a5471f00 0x5559a5472320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.302+0000 7fac673da640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559a5471f00 0x5559a5472320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43544/0 (socket says 172.21.15.170:43544) 2024-09-12T17:28:04.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.302+0000 7fac673da640 1 -- 172.21.15.170:0/1728795409 learned_addr learned my addr 172.21.15.170:0/1728795409 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:04.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.302+0000 7fac673da640 1 -- 172.21.15.170:0/1728795409 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559a5472960 con 0x5559a5471f00 2024-09-12T17:28:04.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.303+0000 7fac673da640 1 --2- 172.21.15.170:0/1728795409 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559a5471f00 0x5559a5472320 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x5559a5457f60 tx=0x7fac600167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.303+0000 7fab50e01640 1 -- 172.21.15.170:0/1728795409 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac60013640 con 0x5559a5471f00 2024-09-12T17:28:04.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.303+0000 7fab50e01640 1 -- 172.21.15.170:0/1728795409 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac600137e0 con 0x5559a5471f00 2024-09-12T17:28:04.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.303+0000 7fac6af26800 1 -- 172.21.15.170:0/1728795409 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5559a5473190 con 0x5559a5471f00 2024-09-12T17:28:04.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.303+0000 7fab50e01640 1 -- 172.21.15.170:0/1728795409 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac60013ac0 con 0x5559a5471f00 2024-09-12T17:28:04.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.303+0000 7fac6af26800 1 -- 172.21.15.170:0/1728795409 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559a5473730 con 0x5559a5471f00 2024-09-12T17:28:04.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.304+0000 7fab50e01640 1 -- 172.21.15.170:0/1728795409 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fac60011040 con 0x5559a5471f00 2024-09-12T17:28:04.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.304+0000 7fab50e01640 1 --2- 172.21.15.170:0/1728795409 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fab4003c730 0x7fab4003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.304+0000 7fab50e01640 1 -- 172.21.15.170:0/1728795409 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fac6000e040 con 0x5559a5471f00 2024-09-12T17:28:04.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.304+0000 7fac66bd9640 1 --2- 172.21.15.170:0/1728795409 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fab4003c730 0x7fab4003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.304+0000 7fac6af26800 1 Processor -- start 2024-09-12T17:28:04.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.304+0000 7fac6af26800 1 -- start start 2024-09-12T17:28:04.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.304+0000 7fac66bd9640 1 --2- 172.21.15.170:0/1728795409 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fab4003c730 0x7fab4003ebf0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x5559a545ed30 tx=0x7fac58040040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.304+0000 7fac6af26800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559a547e9c0 0x5559a547edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.304+0000 7fac6af26800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5559a544ffd0 con 0x5559a547e9c0 2024-09-12T17:28:04.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.305+0000 7fac673da640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559a547e9c0 0x5559a547edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.305+0000 7fac673da640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559a547e9c0 0x5559a547edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43558/0 (socket says 172.21.15.170:43558) 2024-09-12T17:28:04.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.305+0000 7fac673da640 1 -- 172.21.15.170:0/1010790545 learned_addr learned my addr 172.21.15.170:0/1010790545 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:04.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.305+0000 7fac673da640 1 -- 172.21.15.170:0/1010790545 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559a547f3b0 con 0x5559a547e9c0 2024-09-12T17:28:04.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.305+0000 7fac673da640 1 --2- 172.21.15.170:0/1010790545 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559a547e9c0 0x5559a547edc0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fac60020000 tx=0x7fac60013f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a2d41fe39dcb8c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.305+0000 7fab4a7fc640 1 -- 172.21.15.170:0/1010790545 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac60052070 con 0x5559a547e9c0 2024-09-12T17:28:04.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.305+0000 7fab4a7fc640 1 -- 172.21.15.170:0/1010790545 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac6004a020 con 0x5559a547e9c0 2024-09-12T17:28:04.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.305+0000 7fab4a7fc640 1 -- 172.21.15.170:0/1010790545 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac60021440 con 0x5559a547e9c0 2024-09-12T17:28:04.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.306+0000 7fac6af26800 1 -- 172.21.15.170:0/1010790545 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559a547e9c0 msgr2=0x5559a547edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.306+0000 7fac6af26800 1 --2- 172.21.15.170:0/1010790545 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559a547e9c0 0x5559a547edc0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fac60020000 tx=0x7fac60013f00 comp rx=0 tx=0).stop 2024-09-12T17:28:04.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.306+0000 7fac6af26800 1 -- 172.21.15.170:0/1010790545 shutdown_connections 2024-09-12T17:28:04.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.306+0000 7fac6af26800 1 --2- 172.21.15.170:0/1010790545 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559a547e9c0 0x5559a547edc0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.306+0000 7fac6af26800 1 -- 172.21.15.170:0/1010790545 >> 172.21.15.170:0/1010790545 conn(0x5559a547adc0 msgr2=0x5559a5479000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:04.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.306+0000 7fac6af26800 1 -- 172.21.15.170:0/1010790545 shutdown_connections 2024-09-12T17:28:04.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.306+0000 7fac6af26800 1 -- 172.21.15.170:0/1010790545 wait complete. 2024-09-12T17:28:04.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.306+0000 7fac6af26800 1 Processor -- start 2024-09-12T17:28:04.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.306+0000 7fac6af26800 1 -- start start 2024-09-12T17:28:04.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.306+0000 7fac6af26800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559a547e9c0 0x5559a5485f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.306+0000 7fac6af26800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5559a547f9a0 con 0x5559a547e9c0 2024-09-12T17:28:04.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.306+0000 7fac673da640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559a547e9c0 0x5559a5485f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.306+0000 7fac673da640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559a547e9c0 0x5559a5485f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43570/0 (socket says 172.21.15.170:43570) 2024-09-12T17:28:04.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.306+0000 7fac673da640 1 -- 172.21.15.170:0/4064727638 learned_addr learned my addr 172.21.15.170:0/4064727638 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:04.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.307+0000 7fac673da640 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559a54864b0 con 0x5559a547e9c0 2024-09-12T17:28:04.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.307+0000 7fac673da640 1 --2- 172.21.15.170:0/4064727638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559a547e9c0 0x5559a5485f50 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fac600147b0 tx=0x7fac60053d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.307+0000 7fab48ff9640 1 -- 172.21.15.170:0/4064727638 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac60039070 con 0x5559a547e9c0 2024-09-12T17:28:04.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.307+0000 7fab48ff9640 1 -- 172.21.15.170:0/4064727638 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac6001f710 con 0x5559a547e9c0 2024-09-12T17:28:04.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.307+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5559a5486740 con 0x5559a547e9c0 2024-09-12T17:28:04.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.307+0000 7fab48ff9640 1 -- 172.21.15.170:0/4064727638 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac6001fdc0 con 0x5559a547e9c0 2024-09-12T17:28:04.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.307+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559a5486740 con 0x5559a547e9c0 2024-09-12T17:28:04.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.308+0000 7fab48ff9640 1 -- 172.21.15.170:0/4064727638 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fac6003c070 con 0x5559a547e9c0 2024-09-12T17:28:04.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.308+0000 7fab48ff9640 1 --2- 172.21.15.170:0/4064727638 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fab3003c780 0x7fab3003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.308+0000 7fab48ff9640 1 -- 172.21.15.170:0/4064727638 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fac6004b070 con 0x5559a547e9c0 2024-09-12T17:28:04.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.308+0000 7fac66bd9640 1 --2- 172.21.15.170:0/4064727638 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fab3003c780 0x7fab3003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.309+0000 7fac66bd9640 1 --2- 172.21.15.170:0/4064727638 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fab3003c780 0x7fab3003ec40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fac58018ac0 tx=0x7fac5804f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.309+0000 7fac6af26800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.309+0000 7fac6af26800 1 --2- 172.21.15.170:0/4064727638 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5559a54916b0 0x5559a5493b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.309+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5559a54942c0 con 0x5559a54916b0 2024-09-12T17:28:04.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.309+0000 7fac663d8640 1 --2- 172.21.15.170:0/4064727638 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5559a54916b0 0x5559a5493b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.309+0000 7fac663d8640 1 --2- 172.21.15.170:0/4064727638 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5559a54916b0 0x5559a5493b70 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.309+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fac5c051070 con 0x5559a54916b0 2024-09-12T17:28:04.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.309+0000 7fac6af26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.309+0000 7fac6af26800 20 realm 2024-09-12T17:28:04.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.309+0000 7fac6af26800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.309+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5559a54946f0 con 0x5559a54916b0 2024-09-12T17:28:04.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.309+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fac5c051070 con 0x5559a54916b0 2024-09-12T17:28:04.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.310+0000 7fac6af26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.310+0000 7fac6af26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:04.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.310+0000 7fac6af26800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.310+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5559a5494fc0 con 0x5559a54916b0 2024-09-12T17:28:04.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.310+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fac5c051070 con 0x5559a54916b0 2024-09-12T17:28:04.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.310+0000 7fac6af26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.310+0000 7fac6af26800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.310+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5559a5495360 con 0x5559a54916b0 2024-09-12T17:28:04.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.310+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fac5c051070 con 0x5559a54916b0 2024-09-12T17:28:04.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.310+0000 7fac6af26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:04.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.310+0000 7fac6af26800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.310+0000 7fac6af26800 1 --2- 172.21.15.170:0/4064727638 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5559a54960c0 0x5559a54984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.310+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5559a5498ac0 con 0x5559a54960c0 2024-09-12T17:28:04.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.310+0000 7fac673da640 1 --2- 172.21.15.170:0/4064727638 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5559a54960c0 0x5559a54984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.310+0000 7fac673da640 1 --2- 172.21.15.170:0/4064727638 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5559a54960c0 0x5559a54984b0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.311+0000 7fac673da640 1 -- 172.21.15.170:0/4064727638 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fac6003b030 con 0x5559a54960c0 2024-09-12T17:28:04.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.311+0000 7fac6af26800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:04.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.311+0000 7fac6af26800 20 searching for the correct realm 2024-09-12T17:28:04.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.311+0000 7fac6af26800 1 --2- 172.21.15.170:0/4064727638 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5559a549aa70 0x5559a549cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.311+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559a549d5b0 con 0x5559a549aa70 2024-09-12T17:28:04.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.311+0000 7fac66bd9640 1 --2- 172.21.15.170:0/4064727638 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5559a549aa70 0x5559a549cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.311+0000 7fac66bd9640 1 --2- 172.21.15.170:0/4064727638 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5559a549aa70 0x5559a549cf30 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.311+0000 7fac66bd9640 1 -- 172.21.15.170:0/4064727638 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac58036040 con 0x5559a549aa70 2024-09-12T17:28:04.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.311+0000 7fac66bd9640 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559a549d5b0 con 0x5559a54960c0 2024-09-12T17:28:04.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.311+0000 7fac673da640 1 -- 172.21.15.170:0/4064727638 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac6003b030 con 0x5559a54960c0 2024-09-12T17:28:04.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.311+0000 7fac673da640 1 --2- 172.21.15.170:0/4064727638 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fac6003e060 0x7fac6002b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.311+0000 7fac673da640 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559a549d5b0 con 0x7fac6003e060 2024-09-12T17:28:04.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.312+0000 7fac663d8640 1 --2- 172.21.15.170:0/4064727638 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fac6003e060 0x7fac6002b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.312+0000 7fac663d8640 1 --2- 172.21.15.170:0/4064727638 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fac6003e060 0x7fac6002b830 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.312+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac5c051070 con 0x7fac6003e060 2024-09-12T17:28:04.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.312+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559a549d5b0 con 0x5559a54916b0 2024-09-12T17:28:04.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.313+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac5c051070 con 0x5559a54916b0 2024-09-12T17:28:04.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.313+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559a549d5b0 con 0x5559a54916b0 2024-09-12T17:28:04.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.313+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac5c051070 con 0x5559a54916b0 2024-09-12T17:28:04.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.313+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559a549d5b0 con 0x7fac6003e060 2024-09-12T17:28:04.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.313+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac5c051070 con 0x7fac6003e060 2024-09-12T17:28:04.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.313+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559a549d5b0 con 0x7fac6003e060 2024-09-12T17:28:04.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.313+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac5c051070 con 0x7fac6003e060 2024-09-12T17:28:04.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.313+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559a549d5b0 con 0x5559a54960c0 2024-09-12T17:28:04.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.313+0000 7fac673da640 1 -- 172.21.15.170:0/4064727638 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac6003b030 con 0x5559a54960c0 2024-09-12T17:28:04.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.313+0000 7fac673da640 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559a549d5b0 con 0x5559a549aa70 2024-09-12T17:28:04.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.314+0000 7fac66bd9640 1 -- 172.21.15.170:0/4064727638 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac58036040 con 0x5559a549aa70 2024-09-12T17:28:04.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.314+0000 7fac66bd9640 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559a549d5b0 con 0x5559a54916b0 2024-09-12T17:28:04.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.314+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac5c051070 con 0x5559a54916b0 2024-09-12T17:28:04.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.314+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559a549d5b0 con 0x7fac6003e060 2024-09-12T17:28:04.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.314+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac5c051070 con 0x7fac6003e060 2024-09-12T17:28:04.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.314+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559a549d5b0 con 0x5559a54916b0 2024-09-12T17:28:04.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.314+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac5c051070 con 0x5559a54916b0 2024-09-12T17:28:04.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.314+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559a549d5b0 con 0x5559a54960c0 2024-09-12T17:28:04.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.315+0000 7fac673da640 1 -- 172.21.15.170:0/4064727638 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fac6003b030 con 0x5559a54960c0 2024-09-12T17:28:04.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.315+0000 7fac673da640 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559a549d5b0 con 0x5559a549aa70 2024-09-12T17:28:04.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.315+0000 7fac66bd9640 1 -- 172.21.15.170:0/4064727638 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac58036040 con 0x5559a549aa70 2024-09-12T17:28:04.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.315+0000 7fac66bd9640 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559a549d5b0 con 0x5559a549aa70 2024-09-12T17:28:04.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.315+0000 7fac66bd9640 1 -- 172.21.15.170:0/4064727638 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac58036040 con 0x5559a549aa70 2024-09-12T17:28:04.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.315+0000 7fac66bd9640 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559a549d5b0 con 0x7fac6003e060 2024-09-12T17:28:04.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.315+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac5c051070 con 0x7fac6003e060 2024-09-12T17:28:04.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.315+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559a549d5b0 con 0x5559a549aa70 2024-09-12T17:28:04.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.316+0000 7fac66bd9640 1 -- 172.21.15.170:0/4064727638 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac58036040 con 0x5559a549aa70 2024-09-12T17:28:04.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.316+0000 7fac66bd9640 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559a549d5b0 con 0x5559a549aa70 2024-09-12T17:28:04.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.316+0000 7fac66bd9640 1 -- 172.21.15.170:0/4064727638 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac58036040 con 0x5559a549aa70 2024-09-12T17:28:04.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.316+0000 7fac66bd9640 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559a549d5b0 con 0x5559a54916b0 2024-09-12T17:28:04.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.316+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac5c051070 con 0x5559a54916b0 2024-09-12T17:28:04.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.316+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559a549d5b0 con 0x5559a54916b0 2024-09-12T17:28:04.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.316+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fac5c051070 con 0x5559a54916b0 2024-09-12T17:28:04.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.316+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559a549d5b0 con 0x7fac6003e060 2024-09-12T17:28:04.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.317+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac5c051070 con 0x7fac6003e060 2024-09-12T17:28:04.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.317+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559a549d5b0 con 0x5559a549aa70 2024-09-12T17:28:04.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.317+0000 7fac66bd9640 1 -- 172.21.15.170:0/4064727638 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac58036040 con 0x5559a549aa70 2024-09-12T17:28:04.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.317+0000 7fac66bd9640 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559a549d5b0 con 0x5559a54960c0 2024-09-12T17:28:04.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.317+0000 7fac673da640 1 -- 172.21.15.170:0/4064727638 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac60065040 con 0x5559a54960c0 2024-09-12T17:28:04.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.317+0000 7fac673da640 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559a549d5b0 con 0x5559a54916b0 2024-09-12T17:28:04.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.317+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac5c051070 con 0x5559a54916b0 2024-09-12T17:28:04.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.317+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559a549d5b0 con 0x7fac6003e060 2024-09-12T17:28:04.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.317+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac5c051070 con 0x7fac6003e060 2024-09-12T17:28:04.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.317+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559a549d5b0 con 0x5559a549aa70 2024-09-12T17:28:04.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.318+0000 7fac66bd9640 1 -- 172.21.15.170:0/4064727638 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac58036040 con 0x5559a549aa70 2024-09-12T17:28:04.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.318+0000 7fac66bd9640 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559a549d5b0 con 0x7fac6003e060 2024-09-12T17:28:04.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.318+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac5c051070 con 0x7fac6003e060 2024-09-12T17:28:04.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.318+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559a549d5b0 con 0x5559a54960c0 2024-09-12T17:28:04.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.318+0000 7fac673da640 1 -- 172.21.15.170:0/4064727638 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac60065040 con 0x5559a54960c0 2024-09-12T17:28:04.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.318+0000 7fac673da640 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559a549d5b0 con 0x5559a549aa70 2024-09-12T17:28:04.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.318+0000 7fac66bd9640 1 -- 172.21.15.170:0/4064727638 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac58036040 con 0x5559a549aa70 2024-09-12T17:28:04.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.318+0000 7fac66bd9640 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559a549d5b0 con 0x7fac6003e060 2024-09-12T17:28:04.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.319+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac5c051070 con 0x7fac6003e060 2024-09-12T17:28:04.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.319+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559a549d5b0 con 0x5559a54916b0 2024-09-12T17:28:04.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.319+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fac5c051070 con 0x5559a54916b0 2024-09-12T17:28:04.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.319+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5559a549d5b0 con 0x5559a54960c0 2024-09-12T17:28:04.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.319+0000 7fac673da640 1 -- 172.21.15.170:0/4064727638 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fac60065040 con 0x5559a54960c0 2024-09-12T17:28:04.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.319+0000 7fac6af26800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:04.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.319+0000 7fac6af26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:04.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.319+0000 7fac6af26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:04.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.319+0000 7fac6af26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:04.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.319+0000 7fac6af26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:04.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.319+0000 7fac6af26800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:04.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.319+0000 7fac6af26800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.319+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5559a5499480 con 0x5559a54916b0 2024-09-12T17:28:04.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.319+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fac5c051070 con 0x5559a54916b0 2024-09-12T17:28:04.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.319+0000 7fac6af26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.319+0000 7fac6af26800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.319+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5559a5499d20 con 0x5559a54916b0 2024-09-12T17:28:04.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.320+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fac5c051070 con 0x5559a54916b0 2024-09-12T17:28:04.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.320+0000 7fac6af26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:04.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.320+0000 7fac6af26800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.320+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5559a54990c0 con 0x5559a54960c0 2024-09-12T17:28:04.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.320+0000 7fac673da640 1 -- 172.21.15.170:0/4064727638 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fac60065040 con 0x5559a54960c0 2024-09-12T17:28:04.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.320+0000 7fac6af26800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:04.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.320+0000 7fac6af26800 20 zone default found 2024-09-12T17:28:04.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.320+0000 7fac6af26800 4 Realm: () 2024-09-12T17:28:04.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.320+0000 7fac6af26800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:04.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.320+0000 7fac6af26800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:04.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.320+0000 7fac6af26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:04.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.320+0000 7fac6af26800 20 zonegroup default 2024-09-12T17:28:04.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.320+0000 7fac6af26800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.320+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5559a549dee0 con 0x7fac6003e060 2024-09-12T17:28:04.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.320+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fac5c051070 con 0x7fac6003e060 2024-09-12T17:28:04.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.320+0000 7fac6af26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.320+0000 7fac6af26800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.320+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5559a54a0120 con 0x5559a549aa70 2024-09-12T17:28:04.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.321+0000 7fac66bd9640 1 -- 172.21.15.170:0/4064727638 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fac58036040 con 0x5559a549aa70 2024-09-12T17:28:04.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.321+0000 7fac6af26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.321+0000 7fac6af26800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.321+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5559a54a04c0 con 0x5559a549aa70 2024-09-12T17:28:04.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.321+0000 7fac66bd9640 1 -- 172.21.15.170:0/4064727638 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fac58036040 con 0x5559a549aa70 2024-09-12T17:28:04.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.321+0000 7fac6af26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.321+0000 7fac6af26800 20 started sync module instance, tier type = 2024-09-12T17:28:04.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.321+0000 7fac6af26800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:04.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.321+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a549f5b0 con 0x5559a54960c0 2024-09-12T17:28:04.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.322+0000 7fac673da640 1 -- 172.21.15.170:0/4064727638 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac60065040 con 0x5559a54960c0 2024-09-12T17:28:04.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.322+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93843513538976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54a0d60 con 0x5559a54960c0 2024-09-12T17:28:04.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.322+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54a15b0 con 0x5559a54916b0 2024-09-12T17:28:04.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.323+0000 7fac673da640 1 -- 172.21.15.170:0/4064727638 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93843513538976] v29'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac60065040 con 0x5559a54960c0 2024-09-12T17:28:04.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.323+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac5c051070 con 0x5559a54916b0 2024-09-12T17:28:04.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.323+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93843513542832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54a12a0 con 0x5559a54916b0 2024-09-12T17:28:04.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.323+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54a1dc0 con 0x5559a549aa70 2024-09-12T17:28:04.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.324+0000 7fac66bd9640 1 -- 172.21.15.170:0/4064727638 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac58036040 con 0x5559a549aa70 2024-09-12T17:28:04.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.324+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93843513546896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54a2660 con 0x5559a549aa70 2024-09-12T17:28:04.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.324+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54a3150 con 0x5559a54960c0 2024-09-12T17:28:04.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.324+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93843513542832] v29'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac5c051070 con 0x5559a54916b0 2024-09-12T17:28:04.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.325+0000 7fac66bd9640 1 -- 172.21.15.170:0/4064727638 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93843513546896] v29'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac58036040 con 0x5559a549aa70 2024-09-12T17:28:04.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.325+0000 7fac673da640 1 -- 172.21.15.170:0/4064727638 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac60065040 con 0x5559a54960c0 2024-09-12T17:28:04.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.325+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93843513549232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54a0d10 con 0x5559a54960c0 2024-09-12T17:28:04.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.325+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54a3b60 con 0x5559a54916b0 2024-09-12T17:28:04.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.326+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac5c051070 con 0x5559a54916b0 2024-09-12T17:28:04.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.326+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93843513554608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54a3f80 con 0x5559a54916b0 2024-09-12T17:28:04.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.326+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54a49c0 con 0x7fac6003e060 2024-09-12T17:28:04.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.326+0000 7fac673da640 1 -- 172.21.15.170:0/4064727638 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93843513549232] v29'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac60065040 con 0x5559a54960c0 2024-09-12T17:28:04.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.327+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93843513554608] v29'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac5c051070 con 0x5559a54916b0 2024-09-12T17:28:04.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.327+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac5c051070 con 0x7fac6003e060 2024-09-12T17:28:04.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.327+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93843513558160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54a3ad0 con 0x7fac6003e060 2024-09-12T17:28:04.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.327+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54a5260 con 0x7fac6003e060 2024-09-12T17:28:04.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.328+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93843513558160] v29'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac5c051070 con 0x7fac6003e060 2024-09-12T17:28:04.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.328+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(56 notify.6 [create] v29'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac5c051070 con 0x7fac6003e060 2024-09-12T17:28:04.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.328+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93843513551904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54a3ad0 con 0x7fac6003e060 2024-09-12T17:28:04.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.328+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54a5830 con 0x7fac6003e060 2024-09-12T17:28:04.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.329+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93843513551904] v29'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac5c051070 con 0x7fac6003e060 2024-09-12T17:28:04.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.329+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(58 notify.7 [create] v29'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac5c051070 con 0x7fac6003e060 2024-09-12T17:28:04.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.329+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93843513560416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54a5830 con 0x7fac6003e060 2024-09-12T17:28:04.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.329+0000 7fac6af26800 20 add_watcher() i=0 2024-09-12T17:28:04.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.329+0000 7fac6af26800 20 add_watcher() i=1 2024-09-12T17:28:04.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.329+0000 7fac6af26800 20 add_watcher() i=2 2024-09-12T17:28:04.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.329+0000 7fac6af26800 20 add_watcher() i=3 2024-09-12T17:28:04.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.329+0000 7fac6af26800 20 add_watcher() i=4 2024-09-12T17:28:04.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.329+0000 7fac6af26800 20 add_watcher() i=5 2024-09-12T17:28:04.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.329+0000 7fac6af26800 20 add_watcher() i=6 2024-09-12T17:28:04.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.330+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93843513560416] v29'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac5c051070 con 0x7fac6003e060 2024-09-12T17:28:04.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.330+0000 7fac6af26800 20 add_watcher() i=7 2024-09-12T17:28:04.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.330+0000 7fac6af26800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:04.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.330+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5559a54a8c30 con 0x5559a54916b0 2024-09-12T17:28:04.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.331+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fac5c051070 con 0x5559a54916b0 2024-09-12T17:28:04.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.331+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93843513562448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54a6180 con 0x5559a54916b0 2024-09-12T17:28:04.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.332+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93843513562448] v29'121 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fac5c051070 con 0x5559a54916b0 2024-09-12T17:28:04.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.332+0000 7fab1d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:04.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.332+0000 7fac6af26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:04.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.332+0000 7fac6af26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:04.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.332+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54b1580 con 0x5559a54916b0 2024-09-12T17:28:04.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.333+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fac5c051070 con 0x5559a54916b0 2024-09-12T17:28:04.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.333+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54aafe0 con 0x7fac6003e060 2024-09-12T17:28:04.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.334+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fac5c051070 con 0x7fac6003e060 2024-09-12T17:28:04.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.334+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54b1fa0 con 0x5559a549aa70 2024-09-12T17:28:04.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.335+0000 7fac66bd9640 1 -- 172.21.15.170:0/4064727638 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fac58036040 con 0x5559a549aa70 2024-09-12T17:28:04.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.335+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54b2030 con 0x5559a54916b0 2024-09-12T17:28:04.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.336+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'122 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fac5c051070 con 0x5559a54916b0 2024-09-12T17:28:04.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.336+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54b25e0 con 0x5559a54960c0 2024-09-12T17:28:04.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.337+0000 7fac673da640 1 -- 172.21.15.170:0/4064727638 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'35 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fac60065040 con 0x5559a54960c0 2024-09-12T17:28:04.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.337+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54b2570 con 0x5559a549aa70 2024-09-12T17:28:04.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.338+0000 7fac66bd9640 1 -- 172.21.15.170:0/4064727638 <== osd.3 v2:172.21.15.170:6816/2664906588 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'23 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fac58036040 con 0x5559a549aa70 2024-09-12T17:28:04.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.338+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54b2570 con 0x5559a54916b0 2024-09-12T17:28:04.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.339+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fac5c051070 con 0x5559a54916b0 2024-09-12T17:28:04.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.339+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54b2570 con 0x7fac6003e060 2024-09-12T17:28:04.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.340+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'23 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fac5c051070 con 0x7fac6003e060 2024-09-12T17:28:04.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.340+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54b2620 con 0x5559a54960c0 2024-09-12T17:28:04.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.341+0000 7fac673da640 1 -- 172.21.15.170:0/4064727638 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fac60065040 con 0x5559a54960c0 2024-09-12T17:28:04.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.341+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54b2a00 con 0x5559a549aa70 2024-09-12T17:28:04.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.342+0000 7fac66bd9640 1 -- 172.21.15.170:0/4064727638 <== osd.3 v2:172.21.15.170:6816/2664906588 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fac58036040 con 0x5559a549aa70 2024-09-12T17:28:04.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.342+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54b27e0 con 0x5559a54960c0 2024-09-12T17:28:04.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.343+0000 7fac673da640 1 -- 172.21.15.170:0/4064727638 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'36 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac60065040 con 0x5559a54960c0 2024-09-12T17:28:04.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.343+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54b2910 con 0x7fac6003e060 2024-09-12T17:28:04.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.344+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac5c051070 con 0x7fac6003e060 2024-09-12T17:28:04.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.344+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54b2e10 con 0x5559a54960c0 2024-09-12T17:28:04.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.345+0000 7fac673da640 1 -- 172.21.15.170:0/4064727638 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac60065040 con 0x5559a54960c0 2024-09-12T17:28:04.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.345+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54b2e10 con 0x7fac6003e060 2024-09-12T17:28:04.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.346+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'29 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac5c051070 con 0x7fac6003e060 2024-09-12T17:28:04.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.346+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54b2e10 con 0x5559a54916b0 2024-09-12T17:28:04.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.347+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'123 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac5c051070 con 0x5559a54916b0 2024-09-12T17:28:04.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.347+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54b2e10 con 0x5559a549aa70 2024-09-12T17:28:04.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.348+0000 7fac66bd9640 1 -- 172.21.15.170:0/4064727638 <== osd.3 v2:172.21.15.170:6816/2664906588 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'29 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac58036040 con 0x5559a549aa70 2024-09-12T17:28:04.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.348+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54b2e10 con 0x5559a54960c0 2024-09-12T17:28:04.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.349+0000 7fac673da640 1 -- 172.21.15.170:0/4064727638 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'37 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac60065040 con 0x5559a54960c0 2024-09-12T17:28:04.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.349+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54b2e10 con 0x5559a549aa70 2024-09-12T17:28:04.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.350+0000 7fac66bd9640 1 -- 172.21.15.170:0/4064727638 <== osd.3 v2:172.21.15.170:6816/2664906588 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac58036040 con 0x5559a549aa70 2024-09-12T17:28:04.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.350+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54b2e10 con 0x5559a54916b0 2024-09-12T17:28:04.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.351+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac5c051070 con 0x5559a54916b0 2024-09-12T17:28:04.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.351+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54b2e10 con 0x5559a54916b0 2024-09-12T17:28:04.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.352+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'124 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac5c051070 con 0x5559a54916b0 2024-09-12T17:28:04.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.352+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54b2e10 con 0x5559a549aa70 2024-09-12T17:28:04.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.353+0000 7fac66bd9640 1 -- 172.21.15.170:0/4064727638 <== osd.3 v2:172.21.15.170:6816/2664906588 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'30 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac58036040 con 0x5559a549aa70 2024-09-12T17:28:04.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.353+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54b2e10 con 0x5559a54960c0 2024-09-12T17:28:04.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.354+0000 7fac673da640 1 -- 172.21.15.170:0/4064727638 <== osd.2 v2:172.21.15.170:6808/3855567754 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac60065040 con 0x5559a54960c0 2024-09-12T17:28:04.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.354+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54b2e10 con 0x5559a549aa70 2024-09-12T17:28:04.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.355+0000 7fac66bd9640 1 -- 172.21.15.170:0/4064727638 <== osd.3 v2:172.21.15.170:6816/2664906588 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac58036040 con 0x5559a549aa70 2024-09-12T17:28:04.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.355+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54b2e10 con 0x5559a549aa70 2024-09-12T17:28:04.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.355+0000 7fac66bd9640 1 -- 172.21.15.170:0/4064727638 <== osd.3 v2:172.21.15.170:6816/2664906588 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac58036040 con 0x5559a549aa70 2024-09-12T17:28:04.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.356+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54b2e10 con 0x5559a549aa70 2024-09-12T17:28:04.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.356+0000 7fac66bd9640 1 -- 172.21.15.170:0/4064727638 <== osd.3 v2:172.21.15.170:6816/2664906588 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac58036040 con 0x5559a549aa70 2024-09-12T17:28:04.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.356+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54b2e10 con 0x5559a549aa70 2024-09-12T17:28:04.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.357+0000 7fac66bd9640 1 -- 172.21.15.170:0/4064727638 <== osd.3 v2:172.21.15.170:6816/2664906588 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac58036040 con 0x5559a549aa70 2024-09-12T17:28:04.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.357+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54b2e10 con 0x7fac6003e060 2024-09-12T17:28:04.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.359+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac5c051070 con 0x7fac6003e060 2024-09-12T17:28:04.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.359+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54b2e10 con 0x5559a549aa70 2024-09-12T17:28:04.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.360+0000 7fac66bd9640 1 -- 172.21.15.170:0/4064727638 <== osd.3 v2:172.21.15.170:6816/2664906588 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac58036040 con 0x5559a549aa70 2024-09-12T17:28:04.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.360+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54b2e10 con 0x7fac6003e060 2024-09-12T17:28:04.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.361+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.0 v2:172.21.15.47:6800/3978157098 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac5c051070 con 0x7fac6003e060 2024-09-12T17:28:04.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.361+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54b2e10 con 0x5559a549aa70 2024-09-12T17:28:04.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.362+0000 7fac66bd9640 1 -- 172.21.15.170:0/4064727638 <== osd.3 v2:172.21.15.170:6816/2664906588 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'31 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac58036040 con 0x5559a549aa70 2024-09-12T17:28:04.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.362+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54b2e10 con 0x7fac6003e060 2024-09-12T17:28:04.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.363+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.0 v2:172.21.15.47:6800/3978157098 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'30 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac5c051070 con 0x7fac6003e060 2024-09-12T17:28:04.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.363+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54b2e10 con 0x5559a54960c0 2024-09-12T17:28:04.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.364+0000 7fac673da640 1 -- 172.21.15.170:0/4064727638 <== osd.2 v2:172.21.15.170:6808/3855567754 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac60065040 con 0x5559a54960c0 2024-09-12T17:28:04.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.364+0000 7faa97fff640 20 reqs_thread_entry: start 2024-09-12T17:28:04.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.364+0000 7fac6af26800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:04.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.364+0000 7fac6af26800 20 Filter name: none 2024-09-12T17:28:04.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.364+0000 7faa95ffb640 20 reqs_thread_entry: start 2024-09-12T17:28:04.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.364+0000 7fac6af26800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-12T17:28:04.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.364+0000 7fac6af26800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.364+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5559a54dda40 con 0x7fac6003e060 2024-09-12T17:28:04.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.365+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.0 v2:172.21.15.47:6800/3978157098 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fac5c051070 con 0x7fac6003e060 2024-09-12T17:28:04.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.365+0000 7fac6af26800 20 rados_obj.operate() r=0 bl.length=380 2024-09-12T17:28:04.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.365+0000 7fac6af26800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-12T17:28:04.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.365+0000 7fac6af26800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T17:28:04.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.365+0000 7fac6af26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:04.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.365+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5559a54e0370 con 0x7fac6003e060 2024-09-12T17:28:04.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.365+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.0 v2:172.21.15.47:6800/3978157098 25 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 155+0+15 (crc 0 0 0) 0x7fac5c051070 con 0x7fac6003e060 2024-09-12T17:28:04.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.365+0000 7fac6af26800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-12T17:28:04.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.365+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54de350 con 0x7fac6003e060 2024-09-12T17:28:04.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.366+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.0 v2:172.21.15.47:6800/3978157098 26 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v29'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fac5c051070 con 0x7fac6003e060 2024-09-12T17:28:04.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.366+0000 7fac6af26800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-12T17:28:04.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.366+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 93843513798240 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5559a54e0a00 con 0x5559a549aa70 2024-09-12T17:28:04.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.366+0000 7fac66bd9640 1 -- 172.21.15.170:0/4064727638 <== osd.3 v2:172.21.15.170:6816/2664906588 26 ==== watch-notify(notify (1) cookie 93843513546896 notify 124554051593 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5559a54b1af0 con 0x5559a549aa70 2024-09-12T17:28:04.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.366+0000 7fab4a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051593 cookie 93843513546896 notifier 4526 bl.length()=170 2024-09-12T17:28:04.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.366+0000 7fac66bd9640 1 -- 172.21.15.170:0/4064727638 <== osd.3 v2:172.21.15.170:6816/2664906588 27 ==== osd_op_reply(97 notify.2 [notify cookie 93843513798240 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fac58036040 con 0x5559a549aa70 2024-09-12T17:28:04.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.366+0000 7fab4a7fc640 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fab2c003d60 con 0x5559a549aa70 2024-09-12T17:28:04.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.367+0000 7fac66bd9640 1 -- 172.21.15.170:0/4064727638 <== osd.3 v2:172.21.15.170:6816/2664906588 28 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac58036040 con 0x5559a549aa70 2024-09-12T17:28:04.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.367+0000 7fac66bd9640 1 -- 172.21.15.170:0/4064727638 <== osd.3 v2:172.21.15.170:6816/2664906588 29 ==== watch-notify(notify_complete (2) cookie 93843513798240 notify 124554051593 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fac5805a040 con 0x5559a549aa70 2024-09-12T17:28:04.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.367+0000 7fac6af26800 10 removing email index: 2024-09-12T17:28:04.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.367+0000 7fac6af26800 10 removing user buckets index 2024-09-12T17:28:04.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.367+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:99 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54e0980 con 0x7fac6003e060 2024-09-12T17:28:04.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.368+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.0 v2:172.21.15.47:6800/3978157098 27 ==== osd_op_reply(99 fud.buckets [delete] v29'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fac5c051070 con 0x7fac6003e060 2024-09-12T17:28:04.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.368+0000 7fac6af26800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-12T17:28:04.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.368+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93843513805184 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5559a54dfe70 con 0x7fac6003e060 2024-09-12T17:28:04.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.368+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.0 v2:172.21.15.47:6800/3978157098 28 ==== watch-notify(notify (1) cookie 93843513551904 notify 124554051593 ret 0) ==== 202+0+0 (crc 0 0 0) 0x5559a54aafe0 con 0x7fac6003e060 2024-09-12T17:28:04.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.368+0000 7fab49ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051593 cookie 93843513551904 notifier 4526 bl.length()=160 2024-09-12T17:28:04.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.368+0000 7fab49ffb640 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7faa9c0032c0 con 0x7fac6003e060 2024-09-12T17:28:04.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.368+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.0 v2:172.21.15.47:6800/3978157098 29 ==== osd_op_reply(100 notify.6 [notify cookie 93843513805184 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fac5c051070 con 0x7fac6003e060 2024-09-12T17:28:04.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.369+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.0 v2:172.21.15.47:6800/3978157098 30 ==== osd_op_reply(101 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac5c051070 con 0x7fac6003e060 2024-09-12T17:28:04.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.369+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.0 v2:172.21.15.47:6800/3978157098 31 ==== watch-notify(notify_complete (2) cookie 93843513805184 notify 124554051593 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5559a54b1650 con 0x7fac6003e060 2024-09-12T17:28:04.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.369+0000 7fac6af26800 10 removing user index: fud 2024-09-12T17:28:04.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.369+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54e0980 con 0x7fac6003e060 2024-09-12T17:28:04.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.370+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.0 v2:172.21.15.47:6800/3978157098 32 ==== osd_op_reply(102 fud [call,call,delete] v29'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fac5c051070 con 0x7fac6003e060 2024-09-12T17:28:04.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.370+0000 7fac6af26800 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-12T17:28:04.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.370+0000 7fac6af26800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-12T17:28:04.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.370+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify cookie 93843513805184 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5559a54dee60 con 0x7fac6003e060 2024-09-12T17:28:04.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.370+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.0 v2:172.21.15.47:6800/3978157098 33 ==== watch-notify(notify (1) cookie 93843513558160 notify 124554051594 ret 0) ==== 194+0+0 (crc 0 0 0) 0x5559a54b1650 con 0x7fac6003e060 2024-09-12T17:28:04.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.370+0000 7fab4a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051594 cookie 93843513558160 notifier 4526 bl.length()=152 2024-09-12T17:28:04.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.370+0000 7fab4a7fc640 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fab2c003d60 con 0x7fac6003e060 2024-09-12T17:28:04.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.370+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.0 v2:172.21.15.47:6800/3978157098 34 ==== osd_op_reply(103 notify.5 [notify cookie 93843513805184 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fac5c051070 con 0x7fac6003e060 2024-09-12T17:28:04.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.370+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.0 v2:172.21.15.47:6800/3978157098 35 ==== osd_op_reply(104 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac5c051070 con 0x7fac6003e060 2024-09-12T17:28:04.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.370+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.0 v2:172.21.15.47:6800/3978157098 36 ==== watch-notify(notify_complete (2) cookie 93843513805184 notify 124554051594 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5559a54aae10 con 0x7fac6003e060 2024-09-12T17:28:04.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.371+0000 7fab1d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:04.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.371+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93843513562448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54e0980 con 0x5559a54916b0 2024-09-12T17:28:04.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.372+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 93843513562448] v29'125 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fac5c051070 con 0x5559a54916b0 2024-09-12T17:28:04.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.372+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93843513538976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54e0980 con 0x5559a54960c0 2024-09-12T17:28:04.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.373+0000 7fac673da640 1 -- 172.21.15.170:0/4064727638 <== osd.2 v2:172.21.15.170:6808/3855567754 20 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 93843513538976] v29'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac60065040 con 0x5559a54960c0 2024-09-12T17:28:04.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.373+0000 7fac6af26800 20 remove_watcher() i=0 2024-09-12T17:28:04.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.373+0000 7fac6af26800 2 removed watcher, disabling cache 2024-09-12T17:28:04.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.373+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93843513542832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54e0980 con 0x5559a54916b0 2024-09-12T17:28:04.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.374+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 93843513542832] v29'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac5c051070 con 0x5559a54916b0 2024-09-12T17:28:04.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.374+0000 7fac6af26800 20 remove_watcher() i=1 2024-09-12T17:28:04.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.374+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93843513546896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54a08b0 con 0x5559a549aa70 2024-09-12T17:28:04.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.375+0000 7fac66bd9640 1 -- 172.21.15.170:0/4064727638 <== osd.3 v2:172.21.15.170:6816/2664906588 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 93843513546896] v29'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac58036040 con 0x5559a549aa70 2024-09-12T17:28:04.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.375+0000 7fac6af26800 20 remove_watcher() i=2 2024-09-12T17:28:04.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.375+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93843513549232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54e0980 con 0x5559a54960c0 2024-09-12T17:28:04.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.376+0000 7fac673da640 1 -- 172.21.15.170:0/4064727638 <== osd.2 v2:172.21.15.170:6808/3855567754 21 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 93843513549232] v29'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac60065040 con 0x5559a54960c0 2024-09-12T17:28:04.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.376+0000 7fac6af26800 20 remove_watcher() i=3 2024-09-12T17:28:04.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.376+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93843513554608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54a1890 con 0x5559a54916b0 2024-09-12T17:28:04.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.377+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 93843513554608] v29'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac5c051070 con 0x5559a54916b0 2024-09-12T17:28:04.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.377+0000 7fac6af26800 20 remove_watcher() i=4 2024-09-12T17:28:04.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.377+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93843513558160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54e0980 con 0x7fac6003e060 2024-09-12T17:28:04.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.378+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.0 v2:172.21.15.47:6800/3978157098 37 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 93843513558160] v29'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac5c051070 con 0x7fac6003e060 2024-09-12T17:28:04.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.378+0000 7fac6af26800 20 remove_watcher() i=5 2024-09-12T17:28:04.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.378+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93843513551904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54a36b0 con 0x7fac6003e060 2024-09-12T17:28:04.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.379+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.0 v2:172.21.15.47:6800/3978157098 38 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 93843513551904] v29'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac5c051070 con 0x7fac6003e060 2024-09-12T17:28:04.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.379+0000 7fac6af26800 20 remove_watcher() i=6 2024-09-12T17:28:04.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.379+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93843513560416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559a54a1890 con 0x7fac6003e060 2024-09-12T17:28:04.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.380+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 <== osd.0 v2:172.21.15.47:6800/3978157098 39 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 93843513560416] v29'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac5c051070 con 0x7fac6003e060 2024-09-12T17:28:04.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.380+0000 7fac6af26800 20 remove_watcher() i=7 2024-09-12T17:28:04.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.380+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fac6003e060 msgr2=0x7fac6002b830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.380+0000 7fac6af26800 1 --2- 172.21.15.170:0/4064727638 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fac6003e060 0x7fac6002b830 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.380+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5559a54916b0 msgr2=0x5559a5493b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.380+0000 7fac6af26800 1 --2- 172.21.15.170:0/4064727638 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5559a54916b0 0x5559a5493b70 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.380+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5559a54960c0 msgr2=0x5559a54984b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.380+0000 7fac6af26800 1 --2- 172.21.15.170:0/4064727638 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5559a54960c0 0x5559a54984b0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.380+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5559a549aa70 msgr2=0x5559a549cf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.380+0000 7fac6af26800 1 --2- 172.21.15.170:0/4064727638 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5559a549aa70 0x5559a549cf30 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.380+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fab3003c780 msgr2=0x7fab3003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.380+0000 7fac6af26800 1 --2- 172.21.15.170:0/4064727638 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fab3003c780 0x7fab3003ec40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fac58018ac0 tx=0x7fac5804f000 comp rx=0 tx=0).stop 2024-09-12T17:28:04.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.380+0000 7fac663d8640 1 -- 172.21.15.170:0/4064727638 reap_dead start 2024-09-12T17:28:04.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.380+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559a547e9c0 msgr2=0x5559a5485f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.380+0000 7fac6af26800 1 --2- 172.21.15.170:0/4064727638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559a547e9c0 0x5559a5485f50 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fac600147b0 tx=0x7fac60053d30 comp rx=0 tx=0).stop 2024-09-12T17:28:04.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.380+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 shutdown_connections 2024-09-12T17:28:04.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.380+0000 7fac6af26800 1 --2- 172.21.15.170:0/4064727638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559a547e9c0 0x5559a5485f50 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.380+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 >> 172.21.15.170:0/4064727638 conn(0x5559a547adc0 msgr2=0x5559a5478fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:04.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.380+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 shutdown_connections 2024-09-12T17:28:04.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.380+0000 7fac6af26800 1 -- 172.21.15.170:0/4064727638 wait complete. 2024-09-12T17:28:04.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.380+0000 7fac6af26800 1 -- 172.21.15.170:0/1728795409 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fab4003c730 msgr2=0x7fab4003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.380+0000 7fac6af26800 1 --2- 172.21.15.170:0/1728795409 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fab4003c730 0x7fab4003ebf0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x5559a545ed30 tx=0x7fac58040040 comp rx=0 tx=0).stop 2024-09-12T17:28:04.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.380+0000 7fac6af26800 1 -- 172.21.15.170:0/1728795409 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559a5471f00 msgr2=0x5559a5472320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.380+0000 7fac6af26800 1 --2- 172.21.15.170:0/1728795409 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559a5471f00 0x5559a5472320 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x5559a5457f60 tx=0x7fac600167b0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.380+0000 7fac6af26800 1 -- 172.21.15.170:0/1728795409 shutdown_connections 2024-09-12T17:28:04.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.380+0000 7fac6af26800 1 --2- 172.21.15.170:0/1728795409 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fab4003c730 0x7fab4003ebf0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.380+0000 7fac6af26800 1 --2- 172.21.15.170:0/1728795409 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559a5471f00 0x5559a5472320 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.380+0000 7fac6af26800 1 -- 172.21.15.170:0/1728795409 >> 172.21.15.170:0/1728795409 conn(0x5559a54662b0 msgr2=0x5559a5466690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:04.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.381+0000 7fac6af26800 1 -- 172.21.15.170:0/1728795409 shutdown_connections 2024-09-12T17:28:04.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.381+0000 7fac6af26800 1 -- 172.21.15.170:0/1728795409 wait complete. 2024-09-12T17:28:04.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.381+0000 7fac6af26800 1 -- 172.21.15.170:0/3415227693 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5559a52d2aa0 msgr2=0x5559a545e720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.381+0000 7fac6af26800 1 --2- 172.21.15.170:0/3415227693 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5559a52d2aa0 0x5559a545e720 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.381+0000 7fac6af26800 1 -- 172.21.15.170:0/3415227693 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5559a5460b90 msgr2=0x5559a5462f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.381+0000 7fac6af26800 1 --2- 172.21.15.170:0/3415227693 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5559a5460b90 0x5559a5462f80 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.381+0000 7fac6af26800 1 -- 172.21.15.170:0/3415227693 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fab4c03c780 msgr2=0x7fab4c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.381+0000 7fac6af26800 1 --2- 172.21.15.170:0/3415227693 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fab4c03c780 0x7fab4c03ec40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fac5c057000 tx=0x7fac5c052000 comp rx=0 tx=0).stop 2024-09-12T17:28:04.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.381+0000 7fac6af26800 1 -- 172.21.15.170:0/3415227693 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559a52d1f90 msgr2=0x5559a54570d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.381+0000 7fac6af26800 1 --2- 172.21.15.170:0/3415227693 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559a52d1f90 0x5559a54570d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fac5800c010 tx=0x7fac58000ed0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.381+0000 7fac6af26800 1 -- 172.21.15.170:0/3415227693 shutdown_connections 2024-09-12T17:28:04.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.381+0000 7fac6af26800 1 --2- 172.21.15.170:0/3415227693 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5559a5460b90 0x5559a5462f80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.381+0000 7fac6af26800 1 --2- 172.21.15.170:0/3415227693 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fab4c03c780 0x7fab4c03ec40 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.381+0000 7fac6af26800 1 --2- 172.21.15.170:0/3415227693 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5559a52d2aa0 0x5559a545e720 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.381+0000 7fac6af26800 1 --2- 172.21.15.170:0/3415227693 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559a52d1f90 0x5559a54570d0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.381+0000 7fac6af26800 1 -- 172.21.15.170:0/3415227693 >> 172.21.15.170:0/3415227693 conn(0x5559a53593c0 msgr2=0x5559a5450a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:04.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.381+0000 7fac6af26800 1 -- 172.21.15.170:0/3415227693 shutdown_connections 2024-09-12T17:28:04.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.381+0000 7fac6af26800 1 -- 172.21.15.170:0/3415227693 wait complete. 2024-09-12T17:28:04.392 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-12T17:28:04.392 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-12T17:28:04.392 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-12T17:28:04.487 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:04.488 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:04.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.486+0000 7f9d48abb800 1 Processor -- start 2024-09-12T17:28:04.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.486+0000 7f9d48abb800 1 -- start start 2024-09-12T17:28:04.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.486+0000 7f9d48abb800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x562d774ef040 0x562d774f7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.486+0000 7f9d48abb800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562d77398e40 con 0x562d774ed520 2024-09-12T17:28:04.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.486+0000 7f9d48abb800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x562d77363680 con 0x562d774ef040 2024-09-12T17:28:04.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.487+0000 7f9d45da4640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x562d774ef040 0x562d774f7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.487+0000 7f9d465a5640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x562d774ed520 0x562d774ed920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:37006/0 (socket says 172.21.15.170:37006) 2024-09-12T17:28:04.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.487+0000 7f9d465a5640 1 -- 172.21.15.170:0/2833787720 learned_addr learned my addr 172.21.15.170:0/2833787720 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:28:04.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.487+0000 7f9d45da4640 1 -- 172.21.15.170:0/2833787720 >> v1:172.21.15.47:6789/0 conn(0x562d774ed520 legacy=0x562d774ed920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.487+0000 7f9d45da4640 1 -- 172.21.15.170:0/2833787720 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d7737f6b0 con 0x562d774ef040 2024-09-12T17:28:04.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.489+0000 7f9d45da4640 1 --2- 172.21.15.170:0/2833787720 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d774ef040 0x562d774f7b60 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c00a470 tx=0x7f9d3c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=941550353636f368 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.489+0000 7f9d455a3640 1 -- 172.21.15.170:0/2833787720 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d3c053570 con 0x562d774ef040 2024-09-12T17:28:04.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.489+0000 7f9d455a3640 1 -- 172.21.15.170:0/2833787720 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d3c058070 con 0x562d774ef040 2024-09-12T17:28:04.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.489+0000 7f9d455a3640 1 -- 172.21.15.170:0/2833787720 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d3c053880 con 0x562d774ef040 2024-09-12T17:28:04.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.489+0000 7f9d48abb800 1 -- 172.21.15.170:0/2833787720 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d774ef040 msgr2=0x562d774f7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.489+0000 7f9d48abb800 1 --2- 172.21.15.170:0/2833787720 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d774ef040 0x562d774f7b60 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c00a470 tx=0x7f9d3c045a20 comp rx=0 tx=0).stop 2024-09-12T17:28:04.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.489+0000 7f9d48abb800 1 -- 172.21.15.170:0/2833787720 shutdown_connections 2024-09-12T17:28:04.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.489+0000 7f9d48abb800 1 --2- 172.21.15.170:0/2833787720 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d774ef040 0x562d774f7b60 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.489+0000 7f9d48abb800 1 -- 172.21.15.170:0/2833787720 >> 172.21.15.170:0/2833787720 conn(0x562d774e9250 msgr2=0x562d774eb690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:04.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.489+0000 7f9d48abb800 1 -- 172.21.15.170:0/2833787720 shutdown_connections 2024-09-12T17:28:04.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.489+0000 7f9d48abb800 1 -- 172.21.15.170:0/2833787720 wait complete. 2024-09-12T17:28:04.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.503+0000 7f9d48abb800 1 Processor -- start 2024-09-12T17:28:04.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.503+0000 7f9d48abb800 1 -- start start 2024-09-12T17:28:04.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.503+0000 7f9d48abb800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d774ed520 0x562d775e0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.503+0000 7f9d48abb800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562d77387dd0 con 0x562d774ed520 2024-09-12T17:28:04.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.504+0000 7f9d465a5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d774ed520 0x562d775e0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.504+0000 7f9d465a5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d774ed520 0x562d775e0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43580/0 (socket says 172.21.15.170:43580) 2024-09-12T17:28:04.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.504+0000 7f9d465a5640 1 -- 172.21.15.170:0/2535120170 learned_addr learned my addr 172.21.15.170:0/2535120170 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:04.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.504+0000 7f9d465a5640 1 -- 172.21.15.170:0/2535120170 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d773a0e10 con 0x562d774ed520 2024-09-12T17:28:04.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.504+0000 7f9d465a5640 1 --2- 172.21.15.170:0/2535120170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d774ed520 0x562d775e0950 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9d38001e40 tx=0x7f9d38001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84a3f1283bcd8129 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.504+0000 7f9c34608640 1 -- 172.21.15.170:0/2535120170 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d38012020 con 0x562d774ed520 2024-09-12T17:28:04.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.504+0000 7f9c34608640 1 -- 172.21.15.170:0/2535120170 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d3800e5a0 con 0x562d774ed520 2024-09-12T17:28:04.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.504+0000 7f9c34608640 1 -- 172.21.15.170:0/2535120170 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d3800e8a0 con 0x562d774ed520 2024-09-12T17:28:04.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.505+0000 7f9d48abb800 1 -- 172.21.15.170:0/2535120170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d774ed520 msgr2=0x562d775e0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.505+0000 7f9d48abb800 1 --2- 172.21.15.170:0/2535120170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d774ed520 0x562d775e0950 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9d38001e40 tx=0x7f9d38001e70 comp rx=0 tx=0).stop 2024-09-12T17:28:04.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.505+0000 7f9d48abb800 1 -- 172.21.15.170:0/2535120170 shutdown_connections 2024-09-12T17:28:04.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.505+0000 7f9d48abb800 1 --2- 172.21.15.170:0/2535120170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d774ed520 0x562d775e0950 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.505+0000 7f9d48abb800 1 -- 172.21.15.170:0/2535120170 >> 172.21.15.170:0/2535120170 conn(0x562d774e9250 msgr2=0x562d775dc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:04.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.505+0000 7f9d48abb800 1 -- 172.21.15.170:0/2535120170 shutdown_connections 2024-09-12T17:28:04.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.505+0000 7f9d48abb800 1 -- 172.21.15.170:0/2535120170 wait complete. 2024-09-12T17:28:04.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.505+0000 7f9d48abb800 1 Processor -- start 2024-09-12T17:28:04.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.505+0000 7f9d48abb800 1 -- start start 2024-09-12T17:28:04.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.505+0000 7f9d48abb800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d774ed520 0x562d775e8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.505+0000 7f9d48abb800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562d774f83a0 con 0x562d774ed520 2024-09-12T17:28:04.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.506+0000 7f9d465a5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d774ed520 0x562d775e8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.506+0000 7f9d465a5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d774ed520 0x562d775e8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43596/0 (socket says 172.21.15.170:43596) 2024-09-12T17:28:04.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.506+0000 7f9d465a5640 1 -- 172.21.15.170:0/3268250165 learned_addr learned my addr 172.21.15.170:0/3268250165 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:04.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.506+0000 7f9d465a5640 1 -- 172.21.15.170:0/3268250165 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d775e8860 con 0x562d774ed520 2024-09-12T17:28:04.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.506+0000 7f9d465a5640 1 --2- 172.21.15.170:0/3268250165 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d774ed520 0x562d775e8300 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9d3800c010 tx=0x7f9d38000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.506+0000 7f9c32e05640 1 -- 172.21.15.170:0/3268250165 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d38012030 con 0x562d774ed520 2024-09-12T17:28:04.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.506+0000 7f9c32e05640 1 -- 172.21.15.170:0/3268250165 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d380014a0 con 0x562d774ed520 2024-09-12T17:28:04.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.506+0000 7f9d48abb800 1 -- 172.21.15.170:0/3268250165 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d775e8af0 con 0x562d774ed520 2024-09-12T17:28:04.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.506+0000 7f9c32e05640 1 -- 172.21.15.170:0/3268250165 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d3801a7a0 con 0x562d774ed520 2024-09-12T17:28:04.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.506+0000 7f9d48abb800 1 -- 172.21.15.170:0/3268250165 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d775e94f0 con 0x562d774ed520 2024-09-12T17:28:04.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.507+0000 7f9c32e05640 1 -- 172.21.15.170:0/3268250165 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f9d38015020 con 0x562d774ed520 2024-09-12T17:28:04.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.508+0000 7f9c32e05640 1 --2- 172.21.15.170:0/3268250165 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f9c2c03c780 0x7f9c2c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.508+0000 7f9c32e05640 1 -- 172.21.15.170:0/3268250165 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f9d38020030 con 0x562d774ed520 2024-09-12T17:28:04.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.508+0000 7f9d45da4640 1 --2- 172.21.15.170:0/3268250165 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f9c2c03c780 0x7f9c2c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.508+0000 7f9d48abb800 1 --2- 172.21.15.170:0/3268250165 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x562d774ef040 0x562d775ef950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.508+0000 7f9d48abb800 1 -- 172.21.15.170:0/3268250165 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562d775ea080 con 0x562d774ef040 2024-09-12T17:28:04.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.508+0000 7f9d46da6640 1 --2- 172.21.15.170:0/3268250165 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x562d774ef040 0x562d775ef950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.508+0000 7f9d45da4640 1 --2- 172.21.15.170:0/3268250165 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f9c2c03c780 0x7f9c2c03ec40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c057000 tx=0x7f9d3c052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.508+0000 7f9d46da6640 1 --2- 172.21.15.170:0/3268250165 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x562d774ef040 0x562d775ef950 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.509+0000 7f9d46da6640 1 -- 172.21.15.170:0/3268250165 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d4000a4d0 con 0x562d774ef040 2024-09-12T17:28:04.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.509+0000 7f9d48abb800 1 -- 172.21.15.170:0/3268250165 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562d775e9980 con 0x562d774ef040 2024-09-12T17:28:04.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.509+0000 7f9d46da6640 1 -- 172.21.15.170:0/3268250165 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9d4000a4d0 con 0x562d774ef040 2024-09-12T17:28:04.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.509+0000 7f9d48abb800 1 --2- 172.21.15.170:0/3268250165 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x562d775f1dc0 0x562d775f41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.509+0000 7f9d48abb800 1 -- 172.21.15.170:0/3268250165 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562d775f4880 con 0x562d775f1dc0 2024-09-12T17:28:04.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.509+0000 7f9d465a5640 1 --2- 172.21.15.170:0/3268250165 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x562d775f1dc0 0x562d775f41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.509+0000 7f9d465a5640 1 --2- 172.21.15.170:0/3268250165 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x562d775f1dc0 0x562d775f41b0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.510+0000 7f9d465a5640 1 -- 172.21.15.170:0/3268250165 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9d380187b0 con 0x562d775f1dc0 2024-09-12T17:28:04.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.510+0000 7f9d48abb800 1 -- 172.21.15.170:0/3268250165 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562d775f0c60 con 0x562d774ef040 2024-09-12T17:28:04.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.510+0000 7f9d46da6640 1 -- 172.21.15.170:0/3268250165 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9d4000a4d0 con 0x562d774ef040 2024-09-12T17:28:04.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.510+0000 7f9d48abb800 1 -- 172.21.15.170:0/3268250165 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562d775f1100 con 0x562d775f1dc0 2024-09-12T17:28:04.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.510+0000 7f9d465a5640 1 -- 172.21.15.170:0/3268250165 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9d380187b0 con 0x562d775f1dc0 2024-09-12T17:28:04.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.510+0000 7f9d48abb800 1 Processor -- start 2024-09-12T17:28:04.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.510+0000 7f9d48abb800 1 -- start start 2024-09-12T17:28:04.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.511+0000 7f9d48abb800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d77603130 0x562d77603550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.511+0000 7f9d48abb800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562d773e5a00 con 0x562d77603130 2024-09-12T17:28:04.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.511+0000 7f9d46da6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d77603130 0x562d77603550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.511+0000 7f9d46da6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d77603130 0x562d77603550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43602/0 (socket says 172.21.15.170:43602) 2024-09-12T17:28:04.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.511+0000 7f9d46da6640 1 -- 172.21.15.170:0/539542083 learned_addr learned my addr 172.21.15.170:0/539542083 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:04.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.511+0000 7f9d46da6640 1 -- 172.21.15.170:0/539542083 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d77603b90 con 0x562d77603130 2024-09-12T17:28:04.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.511+0000 7f9d46da6640 1 --2- 172.21.15.170:0/539542083 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d77603130 0x562d77603550 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x562d775e9190 tx=0x7f9d400167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.512+0000 7f9c2bfff640 1 -- 172.21.15.170:0/539542083 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d40013640 con 0x562d77603130 2024-09-12T17:28:04.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.512+0000 7f9c2bfff640 1 -- 172.21.15.170:0/539542083 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d400137e0 con 0x562d77603130 2024-09-12T17:28:04.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.512+0000 7f9d48abb800 1 -- 172.21.15.170:0/539542083 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d776043c0 con 0x562d77603130 2024-09-12T17:28:04.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.512+0000 7f9c2bfff640 1 -- 172.21.15.170:0/539542083 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d40013ac0 con 0x562d77603130 2024-09-12T17:28:04.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.512+0000 7f9d48abb800 1 -- 172.21.15.170:0/539542083 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d77604960 con 0x562d77603130 2024-09-12T17:28:04.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.512+0000 7f9c2bfff640 1 -- 172.21.15.170:0/539542083 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f9d40011040 con 0x562d77603130 2024-09-12T17:28:04.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.513+0000 7f9c2bfff640 1 --2- 172.21.15.170:0/539542083 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f9c2003c730 0x7f9c2003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.513+0000 7f9c2bfff640 1 -- 172.21.15.170:0/539542083 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f9d4000e040 con 0x562d77603130 2024-09-12T17:28:04.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.513+0000 7f9d465a5640 1 --2- 172.21.15.170:0/539542083 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f9c2003c730 0x7f9c2003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.513+0000 7f9d48abb800 1 Processor -- start 2024-09-12T17:28:04.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.513+0000 7f9d465a5640 1 --2- 172.21.15.170:0/539542083 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f9c2003c730 0x7f9c2003ebf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x562d775eff60 tx=0x7f9d38040040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.513+0000 7f9d48abb800 1 -- start start 2024-09-12T17:28:04.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.513+0000 7f9d48abb800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d7760fbf0 0x562d7760fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.513+0000 7f9d48abb800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562d775e11a0 con 0x562d7760fbf0 2024-09-12T17:28:04.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.513+0000 7f9d46da6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d7760fbf0 0x562d7760fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.513+0000 7f9d46da6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d7760fbf0 0x562d7760fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43608/0 (socket says 172.21.15.170:43608) 2024-09-12T17:28:04.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.513+0000 7f9d46da6640 1 -- 172.21.15.170:0/276841840 learned_addr learned my addr 172.21.15.170:0/276841840 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:04.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.514+0000 7f9d46da6640 1 -- 172.21.15.170:0/276841840 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d776105e0 con 0x562d7760fbf0 2024-09-12T17:28:04.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.514+0000 7f9d46da6640 1 --2- 172.21.15.170:0/276841840 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d7760fbf0 0x562d7760fff0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9d40020000 tx=0x7f9d400204d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16a09340b5c52ca7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.514+0000 7f9c29ffb640 1 -- 172.21.15.170:0/276841840 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d40052070 con 0x562d7760fbf0 2024-09-12T17:28:04.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.514+0000 7f9c29ffb640 1 -- 172.21.15.170:0/276841840 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d4004a020 con 0x562d7760fbf0 2024-09-12T17:28:04.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.514+0000 7f9c29ffb640 1 -- 172.21.15.170:0/276841840 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d40021440 con 0x562d7760fbf0 2024-09-12T17:28:04.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.514+0000 7f9d48abb800 1 -- 172.21.15.170:0/276841840 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d7760fbf0 msgr2=0x562d7760fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.514+0000 7f9d48abb800 1 --2- 172.21.15.170:0/276841840 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d7760fbf0 0x562d7760fff0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9d40020000 tx=0x7f9d400204d0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.514+0000 7f9d48abb800 1 -- 172.21.15.170:0/276841840 shutdown_connections 2024-09-12T17:28:04.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.514+0000 7f9d48abb800 1 --2- 172.21.15.170:0/276841840 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d7760fbf0 0x562d7760fff0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.514+0000 7f9d48abb800 1 -- 172.21.15.170:0/276841840 >> 172.21.15.170:0/276841840 conn(0x562d7760bff0 msgr2=0x562d7760a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:04.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.514+0000 7f9d48abb800 1 -- 172.21.15.170:0/276841840 shutdown_connections 2024-09-12T17:28:04.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.514+0000 7f9d48abb800 1 -- 172.21.15.170:0/276841840 wait complete. 2024-09-12T17:28:04.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.515+0000 7f9d48abb800 1 Processor -- start 2024-09-12T17:28:04.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.515+0000 7f9d48abb800 1 -- start start 2024-09-12T17:28:04.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.515+0000 7f9d48abb800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d7760fbf0 0x562d776171f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.515+0000 7f9d48abb800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562d77610c00 con 0x562d7760fbf0 2024-09-12T17:28:04.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.515+0000 7f9d46da6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d7760fbf0 0x562d776171f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.515+0000 7f9d46da6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d7760fbf0 0x562d776171f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43614/0 (socket says 172.21.15.170:43614) 2024-09-12T17:28:04.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.515+0000 7f9d46da6640 1 -- 172.21.15.170:0/2644341136 learned_addr learned my addr 172.21.15.170:0/2644341136 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:04.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.515+0000 7f9d46da6640 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d77617750 con 0x562d7760fbf0 2024-09-12T17:28:04.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.516+0000 7f9d46da6640 1 --2- 172.21.15.170:0/2644341136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d7760fbf0 0x562d776171f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f9d40053cd0 tx=0x7f9d40053d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.516+0000 7f9c17fff640 1 -- 172.21.15.170:0/2644341136 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d40038070 con 0x562d7760fbf0 2024-09-12T17:28:04.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.516+0000 7f9c17fff640 1 -- 172.21.15.170:0/2644341136 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d4001f500 con 0x562d7760fbf0 2024-09-12T17:28:04.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.516+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d776179e0 con 0x562d7760fbf0 2024-09-12T17:28:04.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.516+0000 7f9c17fff640 1 -- 172.21.15.170:0/2644341136 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d4001f7e0 con 0x562d7760fbf0 2024-09-12T17:28:04.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.516+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d77618360 con 0x562d7760fbf0 2024-09-12T17:28:04.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.516+0000 7f9c17fff640 1 -- 172.21.15.170:0/2644341136 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f9d4003b070 con 0x562d7760fbf0 2024-09-12T17:28:04.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.517+0000 7f9c17fff640 1 --2- 172.21.15.170:0/2644341136 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f9c1003c730 0x7f9c1003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.517+0000 7f9c17fff640 1 -- 172.21.15.170:0/2644341136 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f9d4004b070 con 0x562d7760fbf0 2024-09-12T17:28:04.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.517+0000 7f9d465a5640 1 --2- 172.21.15.170:0/2644341136 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f9c1003c730 0x7f9c1003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.517+0000 7f9d465a5640 1 --2- 172.21.15.170:0/2644341136 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f9c1003c730 0x7f9c1003ebf0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9d38018ac0 tx=0x7f9d3804f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.517+0000 7f9d48abb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.517+0000 7f9d48abb800 1 --2- 172.21.15.170:0/2644341136 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x562d77622a90 0x562d77624f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.518+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562d776256a0 con 0x562d77622a90 2024-09-12T17:28:04.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.518+0000 7f9d45da4640 1 --2- 172.21.15.170:0/2644341136 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x562d77622a90 0x562d77624f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.518+0000 7f9d45da4640 1 --2- 172.21.15.170:0/2644341136 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x562d77622a90 0x562d77624f50 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.518+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d3c051070 con 0x562d77622a90 2024-09-12T17:28:04.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.518+0000 7f9d48abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.518+0000 7f9d48abb800 20 realm 2024-09-12T17:28:04.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.518+0000 7f9d48abb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.518+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562d77625ad0 con 0x562d77622a90 2024-09-12T17:28:04.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.518+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d3c051070 con 0x562d77622a90 2024-09-12T17:28:04.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.518+0000 7f9d48abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.518+0000 7f9d48abb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:04.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.518+0000 7f9d48abb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.518+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562d776263a0 con 0x562d77622a90 2024-09-12T17:28:04.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.519+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d3c051070 con 0x562d77622a90 2024-09-12T17:28:04.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.519+0000 7f9d48abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.519+0000 7f9d48abb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.519+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562d77626740 con 0x562d77622a90 2024-09-12T17:28:04.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.519+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9d3c051070 con 0x562d77622a90 2024-09-12T17:28:04.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.519+0000 7f9d48abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:04.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.519+0000 7f9d48abb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.519+0000 7f9d48abb800 1 --2- 172.21.15.170:0/2644341136 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x562d776274a0 0x562d77629890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.519+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562d77629ea0 con 0x562d776274a0 2024-09-12T17:28:04.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.519+0000 7f9d46da6640 1 --2- 172.21.15.170:0/2644341136 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x562d776274a0 0x562d77629890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.519+0000 7f9d46da6640 1 --2- 172.21.15.170:0/2644341136 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x562d776274a0 0x562d77629890 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.519+0000 7f9d46da6640 1 -- 172.21.15.170:0/2644341136 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9d4003a030 con 0x562d776274a0 2024-09-12T17:28:04.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.520+0000 7f9d48abb800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:04.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.520+0000 7f9d48abb800 20 searching for the correct realm 2024-09-12T17:28:04.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.520+0000 7f9d48abb800 1 --2- 172.21.15.170:0/2644341136 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x562d7762be50 0x562d7762e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.520+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d7762e990 con 0x562d7762be50 2024-09-12T17:28:04.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.520+0000 7f9d465a5640 1 --2- 172.21.15.170:0/2644341136 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x562d7762be50 0x562d7762e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.520+0000 7f9d465a5640 1 --2- 172.21.15.170:0/2644341136 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x562d7762be50 0x562d7762e310 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.520+0000 7f9d465a5640 1 -- 172.21.15.170:0/2644341136 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d38036040 con 0x562d7762be50 2024-09-12T17:28:04.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.520+0000 7f9d465a5640 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d7762e990 con 0x562d776274a0 2024-09-12T17:28:04.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.520+0000 7f9d46da6640 1 -- 172.21.15.170:0/2644341136 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d4003a030 con 0x562d776274a0 2024-09-12T17:28:04.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.520+0000 7f9d46da6640 1 --2- 172.21.15.170:0/2644341136 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f9d4003d060 0x7f9d4003c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.520+0000 7f9d46da6640 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d7762e990 con 0x7f9d4003d060 2024-09-12T17:28:04.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.521+0000 7f9d45da4640 1 --2- 172.21.15.170:0/2644341136 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f9d4003d060 0x7f9d4003c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.521+0000 7f9d45da4640 1 --2- 172.21.15.170:0/2644341136 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f9d4003d060 0x7f9d4003c7a0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.521+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3c051070 con 0x7f9d4003d060 2024-09-12T17:28:04.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.521+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d7762e990 con 0x562d77622a90 2024-09-12T17:28:04.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.522+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3c051070 con 0x562d77622a90 2024-09-12T17:28:04.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.522+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d7762e990 con 0x562d77622a90 2024-09-12T17:28:04.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.522+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3c051070 con 0x562d77622a90 2024-09-12T17:28:04.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.522+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d7762e990 con 0x7f9d4003d060 2024-09-12T17:28:04.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.522+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3c051070 con 0x7f9d4003d060 2024-09-12T17:28:04.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.522+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d7762e990 con 0x7f9d4003d060 2024-09-12T17:28:04.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.522+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3c051070 con 0x7f9d4003d060 2024-09-12T17:28:04.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.522+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d7762e990 con 0x562d776274a0 2024-09-12T17:28:04.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.523+0000 7f9d46da6640 1 -- 172.21.15.170:0/2644341136 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d4003a030 con 0x562d776274a0 2024-09-12T17:28:04.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.523+0000 7f9d46da6640 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d7762e990 con 0x562d7762be50 2024-09-12T17:28:04.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.523+0000 7f9d465a5640 1 -- 172.21.15.170:0/2644341136 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d38036040 con 0x562d7762be50 2024-09-12T17:28:04.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.523+0000 7f9d465a5640 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d7762e990 con 0x562d77622a90 2024-09-12T17:28:04.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.523+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3c051070 con 0x562d77622a90 2024-09-12T17:28:04.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.523+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d7762e990 con 0x7f9d4003d060 2024-09-12T17:28:04.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.523+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3c051070 con 0x7f9d4003d060 2024-09-12T17:28:04.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.523+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d7762e990 con 0x562d77622a90 2024-09-12T17:28:04.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.523+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3c051070 con 0x562d77622a90 2024-09-12T17:28:04.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.523+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d7762e990 con 0x562d776274a0 2024-09-12T17:28:04.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.524+0000 7f9d46da6640 1 -- 172.21.15.170:0/2644341136 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f9d4003a030 con 0x562d776274a0 2024-09-12T17:28:04.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.524+0000 7f9d46da6640 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d7762e990 con 0x562d7762be50 2024-09-12T17:28:04.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.524+0000 7f9d465a5640 1 -- 172.21.15.170:0/2644341136 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d38036040 con 0x562d7762be50 2024-09-12T17:28:04.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.524+0000 7f9d465a5640 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d7762e990 con 0x562d7762be50 2024-09-12T17:28:04.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.524+0000 7f9d465a5640 1 -- 172.21.15.170:0/2644341136 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d38036040 con 0x562d7762be50 2024-09-12T17:28:04.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.524+0000 7f9d465a5640 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d7762e990 con 0x7f9d4003d060 2024-09-12T17:28:04.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.525+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3c051070 con 0x7f9d4003d060 2024-09-12T17:28:04.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.525+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d7762e990 con 0x562d7762be50 2024-09-12T17:28:04.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.525+0000 7f9d465a5640 1 -- 172.21.15.170:0/2644341136 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d38036040 con 0x562d7762be50 2024-09-12T17:28:04.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.525+0000 7f9d465a5640 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d7762e990 con 0x562d7762be50 2024-09-12T17:28:04.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.525+0000 7f9d465a5640 1 -- 172.21.15.170:0/2644341136 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d38036040 con 0x562d7762be50 2024-09-12T17:28:04.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.525+0000 7f9d465a5640 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d7762e990 con 0x562d77622a90 2024-09-12T17:28:04.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.525+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3c051070 con 0x562d77622a90 2024-09-12T17:28:04.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.525+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d7762e990 con 0x562d77622a90 2024-09-12T17:28:04.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.525+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9d3c051070 con 0x562d77622a90 2024-09-12T17:28:04.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.525+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d7762e990 con 0x7f9d4003d060 2024-09-12T17:28:04.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.526+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3c051070 con 0x7f9d4003d060 2024-09-12T17:28:04.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.526+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d7762e990 con 0x562d7762be50 2024-09-12T17:28:04.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.526+0000 7f9d465a5640 1 -- 172.21.15.170:0/2644341136 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d38036040 con 0x562d7762be50 2024-09-12T17:28:04.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.526+0000 7f9d465a5640 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d7762e990 con 0x562d776274a0 2024-09-12T17:28:04.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.526+0000 7f9d46da6640 1 -- 172.21.15.170:0/2644341136 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d4003a030 con 0x562d776274a0 2024-09-12T17:28:04.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.526+0000 7f9d46da6640 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d7762e990 con 0x562d77622a90 2024-09-12T17:28:04.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.526+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3c051070 con 0x562d77622a90 2024-09-12T17:28:04.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.526+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d7762e990 con 0x7f9d4003d060 2024-09-12T17:28:04.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.527+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3c051070 con 0x7f9d4003d060 2024-09-12T17:28:04.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.527+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d7762e990 con 0x562d7762be50 2024-09-12T17:28:04.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.527+0000 7f9d465a5640 1 -- 172.21.15.170:0/2644341136 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d38036040 con 0x562d7762be50 2024-09-12T17:28:04.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.527+0000 7f9d465a5640 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d7762e990 con 0x7f9d4003d060 2024-09-12T17:28:04.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.527+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3c051070 con 0x7f9d4003d060 2024-09-12T17:28:04.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.527+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d7762e990 con 0x562d776274a0 2024-09-12T17:28:04.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.527+0000 7f9d46da6640 1 -- 172.21.15.170:0/2644341136 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d4003a030 con 0x562d776274a0 2024-09-12T17:28:04.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.527+0000 7f9d46da6640 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d7762e990 con 0x562d7762be50 2024-09-12T17:28:04.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.528+0000 7f9d465a5640 1 -- 172.21.15.170:0/2644341136 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d38036040 con 0x562d7762be50 2024-09-12T17:28:04.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.528+0000 7f9d465a5640 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d7762e990 con 0x7f9d4003d060 2024-09-12T17:28:04.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.528+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3c051070 con 0x7f9d4003d060 2024-09-12T17:28:04.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.528+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d7762e990 con 0x562d77622a90 2024-09-12T17:28:04.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.528+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9d3c051070 con 0x562d77622a90 2024-09-12T17:28:04.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.528+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562d7762e990 con 0x562d776274a0 2024-09-12T17:28:04.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.528+0000 7f9d46da6640 1 -- 172.21.15.170:0/2644341136 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9d40069040 con 0x562d776274a0 2024-09-12T17:28:04.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.528+0000 7f9d48abb800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:04.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.528+0000 7f9d48abb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:04.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.528+0000 7f9d48abb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:04.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.528+0000 7f9d48abb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:04.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.528+0000 7f9d48abb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:04.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.528+0000 7f9d48abb800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:04.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.528+0000 7f9d48abb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.528+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562d7762a860 con 0x562d77622a90 2024-09-12T17:28:04.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.529+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d3c051070 con 0x562d77622a90 2024-09-12T17:28:04.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.529+0000 7f9d48abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.529+0000 7f9d48abb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.529+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562d7762b100 con 0x562d77622a90 2024-09-12T17:28:04.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.529+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9d3c051070 con 0x562d77622a90 2024-09-12T17:28:04.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.529+0000 7f9d48abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:04.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.529+0000 7f9d48abb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.529+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562d7762a4a0 con 0x562d776274a0 2024-09-12T17:28:04.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.529+0000 7f9d46da6640 1 -- 172.21.15.170:0/2644341136 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9d40069040 con 0x562d776274a0 2024-09-12T17:28:04.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.529+0000 7f9d48abb800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:04.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.529+0000 7f9d48abb800 20 zone default found 2024-09-12T17:28:04.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.529+0000 7f9d48abb800 4 Realm: () 2024-09-12T17:28:04.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.529+0000 7f9d48abb800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:04.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.529+0000 7f9d48abb800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:04.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.529+0000 7f9d48abb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:04.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.529+0000 7f9d48abb800 20 zonegroup default 2024-09-12T17:28:04.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.529+0000 7f9d48abb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.529+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562d7762f2c0 con 0x7f9d4003d060 2024-09-12T17:28:04.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.530+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9d3c051070 con 0x7f9d4003d060 2024-09-12T17:28:04.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.530+0000 7f9d48abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.530+0000 7f9d48abb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.530+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562d77631500 con 0x562d7762be50 2024-09-12T17:28:04.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.530+0000 7f9d465a5640 1 -- 172.21.15.170:0/2644341136 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9d38036040 con 0x562d7762be50 2024-09-12T17:28:04.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.530+0000 7f9d48abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.530+0000 7f9d48abb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.530+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562d776318a0 con 0x562d7762be50 2024-09-12T17:28:04.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.530+0000 7f9d465a5640 1 -- 172.21.15.170:0/2644341136 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9d38036040 con 0x562d7762be50 2024-09-12T17:28:04.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.530+0000 7f9d48abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.530+0000 7f9d48abb800 20 started sync module instance, tier type = 2024-09-12T17:28:04.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.530+0000 7f9d48abb800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:04.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.530+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d77630990 con 0x562d776274a0 2024-09-12T17:28:04.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.531+0000 7f9d46da6640 1 -- 172.21.15.170:0/2644341136 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d40069040 con 0x562d776274a0 2024-09-12T17:28:04.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.531+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94753276497552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d77630990 con 0x562d776274a0 2024-09-12T17:28:04.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.531+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d77632360 con 0x562d77622a90 2024-09-12T17:28:04.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.532+0000 7f9d46da6640 1 -- 172.21.15.170:0/2644341136 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94753276497552] v29'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d40069040 con 0x562d776274a0 2024-09-12T17:28:04.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.532+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3c051070 con 0x562d77622a90 2024-09-12T17:28:04.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.532+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94753276501552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d77630990 con 0x562d77622a90 2024-09-12T17:28:04.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.532+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d77632e10 con 0x562d7762be50 2024-09-12T17:28:04.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.533+0000 7f9d465a5640 1 -- 172.21.15.170:0/2644341136 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d38036040 con 0x562d7762be50 2024-09-12T17:28:04.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.533+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94753276504304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d776336b0 con 0x562d7762be50 2024-09-12T17:28:04.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.533+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d77634170 con 0x562d776274a0 2024-09-12T17:28:04.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.534+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94753276501552] v29'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3c051070 con 0x562d77622a90 2024-09-12T17:28:04.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.534+0000 7f9d465a5640 1 -- 172.21.15.170:0/2644341136 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94753276504304] v29'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d38036040 con 0x562d7762be50 2024-09-12T17:28:04.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.535+0000 7f9d46da6640 1 -- 172.21.15.170:0/2644341136 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d40069040 con 0x562d776274a0 2024-09-12T17:28:04.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.535+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94753276506624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d776304e0 con 0x562d776274a0 2024-09-12T17:28:04.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.535+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d77634a10 con 0x562d77622a90 2024-09-12T17:28:04.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.536+0000 7f9d46da6640 1 -- 172.21.15.170:0/2644341136 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94753276506624] v29'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d40069040 con 0x562d776274a0 2024-09-12T17:28:04.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.536+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3c051070 con 0x562d77622a90 2024-09-12T17:28:04.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.536+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94753276509248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d77634a10 con 0x562d77622a90 2024-09-12T17:28:04.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.536+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d77635490 con 0x7f9d4003d060 2024-09-12T17:28:04.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.537+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3c051070 con 0x7f9d4003d060 2024-09-12T17:28:04.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.537+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94753276514208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d776353c0 con 0x7f9d4003d060 2024-09-12T17:28:04.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.537+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d776363c0 con 0x7f9d4003d060 2024-09-12T17:28:04.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.537+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94753276509248] v29'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3c051070 con 0x562d77622a90 2024-09-12T17:28:04.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.538+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94753276514208] v29'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3c051070 con 0x7f9d4003d060 2024-09-12T17:28:04.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.538+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(56 notify.6 [create] v29'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3c051070 con 0x7f9d4003d060 2024-09-12T17:28:04.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.538+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94753276511584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d77635ed0 con 0x7f9d4003d060 2024-09-12T17:28:04.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.538+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d77636890 con 0x7f9d4003d060 2024-09-12T17:28:04.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.539+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94753276511584] v29'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3c051070 con 0x7f9d4003d060 2024-09-12T17:28:04.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.539+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(58 notify.7 [create] v29'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3c051070 con 0x7f9d4003d060 2024-09-12T17:28:04.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.539+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94753276516400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d77636890 con 0x7f9d4003d060 2024-09-12T17:28:04.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.539+0000 7f9d48abb800 20 add_watcher() i=0 2024-09-12T17:28:04.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.539+0000 7f9d48abb800 20 add_watcher() i=1 2024-09-12T17:28:04.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.539+0000 7f9d48abb800 20 add_watcher() i=2 2024-09-12T17:28:04.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.539+0000 7f9d48abb800 20 add_watcher() i=3 2024-09-12T17:28:04.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.539+0000 7f9d48abb800 20 add_watcher() i=4 2024-09-12T17:28:04.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.539+0000 7f9d48abb800 20 add_watcher() i=5 2024-09-12T17:28:04.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.539+0000 7f9d48abb800 20 add_watcher() i=6 2024-09-12T17:28:04.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.540+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94753276516400] v29'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3c051070 con 0x7f9d4003d060 2024-09-12T17:28:04.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.540+0000 7f9d48abb800 20 add_watcher() i=7 2024-09-12T17:28:04.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.540+0000 7f9d48abb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:04.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.540+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562d77639cc0 con 0x562d77622a90 2024-09-12T17:28:04.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.540+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9d3c051070 con 0x562d77622a90 2024-09-12T17:28:04.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.540+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94753276519856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d77637210 con 0x562d77622a90 2024-09-12T17:28:04.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.541+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94753276519856] v29'126 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9d3c051070 con 0x562d77622a90 2024-09-12T17:28:04.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.541+0000 7f9bfcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:04.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.541+0000 7f9d48abb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:04.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.541+0000 7f9d48abb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:04.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.541+0000 7f9d48abb800 5 note: GC not initialized 2024-09-12T17:28:04.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.542+0000 7f9b777fe640 20 reqs_thread_entry: start 2024-09-12T17:28:04.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.542+0000 7f9d48abb800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:04.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.542+0000 7f9d48abb800 20 Filter name: none 2024-09-12T17:28:04.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.542+0000 7f9b757fa640 20 reqs_thread_entry: start 2024-09-12T17:28:04.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.542+0000 7f9d48abb800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-12T17:28:04.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.542+0000 7f9d48abb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.542+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562d7766cf40 con 0x7f9d4003d060 2024-09-12T17:28:04.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.542+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 246+0+0 (crc 0 0 0) 0x7f9d3c051070 con 0x7f9d4003d060 2024-09-12T17:28:04.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.543+0000 7f9d48abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.543+0000 7f9d48abb800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-09-12T17:28:04.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.543+0000 7f9d48abb800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-12T17:28:04.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.543+0000 7f9d48abb800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-12T17:28:04.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.543+0000 7f9d48abb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.543+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562d7766b530 con 0x7f9d4003d060 2024-09-12T17:28:04.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.543+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f9d3c051070 con 0x7f9d4003d060 2024-09-12T17:28:04.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.543+0000 7f9d48abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.543+0000 7f9d48abb800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-12T17:28:04.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.543+0000 7f9d48abb800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T17:28:04.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.543+0000 7f9d48abb800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-12T17:28:04.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.543+0000 7f9d48abb800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-12T17:28:04.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.543+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~419 in=419b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d7766bdb0 con 0x7f9d4003d060 2024-09-12T17:28:04.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.544+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~419] v29'5 uv5 ondisk = 0) ==== 288+0+0 (crc 0 0 0) 0x7f9d3c051070 con 0x7f9d4003d060 2024-09-12T17:28:04.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.544+0000 7f9d48abb800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-12T17:28:04.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.544+0000 7f9d48abb800 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-12T17:28:04.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.544+0000 7f9d48abb800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-12T17:28:04.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.544+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 94753276737792 in=622b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562d77670880 con 0x562d776274a0 2024-09-12T17:28:04.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.544+0000 7f9d46da6640 1 -- 172.21.15.170:0/2644341136 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== watch-notify(notify (1) cookie 94753276506624 notify 124554051596 ret 0) ==== 652+0+0 (crc 0 0 0) 0x562d776179e0 con 0x562d776274a0 2024-09-12T17:28:04.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.544+0000 7f9c29ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051596 cookie 94753276506624 notifier 4533 bl.length()=610 2024-09-12T17:28:04.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.544+0000 7f9c29ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-12T17:28:04.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.544+0000 7f9c29ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-12T17:28:04.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.544+0000 7f9d46da6640 1 -- 172.21.15.170:0/2644341136 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(65 notify.3 [notify cookie 94753276737792 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9d40069040 con 0x562d776274a0 2024-09-12T17:28:04.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.544+0000 7f9c29ffb640 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f9c0c003ea0 con 0x562d776274a0 2024-09-12T17:28:04.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.545+0000 7f9d46da6640 1 -- 172.21.15.170:0/2644341136 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d40069040 con 0x562d776274a0 2024-09-12T17:28:04.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.545+0000 7f9d46da6640 1 -- 172.21.15.170:0/2644341136 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== watch-notify(notify_complete (2) cookie 94753276737792 notify 124554051596 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562d77617750 con 0x562d776274a0 2024-09-12T17:28:04.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.545+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d7766e3b0 con 0x7f9d4003d060 2024-09-12T17:28:04.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.546+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v29'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f9d3c051070 con 0x7f9d4003d060 2024-09-12T17:28:04.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.546+0000 7f9d48abb800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-12T17:28:04.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.546+0000 7f9d48abb800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T17:28:04.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.546+0000 7f9d48abb800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-12T17:28:04.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.546+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94753276737744 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562d77670880 con 0x562d7762be50 2024-09-12T17:28:04.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.546+0000 7f9d465a5640 1 -- 172.21.15.170:0/2644341136 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== watch-notify(notify (1) cookie 94753276504304 notify 124554051594 ret 0) ==== 234+0+0 (crc 0 0 0) 0x7f9d3805a040 con 0x562d7762be50 2024-09-12T17:28:04.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.546+0000 7f9c297fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051594 cookie 94753276504304 notifier 4533 bl.length()=192 2024-09-12T17:28:04.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.546+0000 7f9c297fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-12T17:28:04.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.546+0000 7f9c297fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T17:28:04.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.546+0000 7f9d465a5640 1 -- 172.21.15.170:0/2644341136 <== osd.3 v2:172.21.15.170:6816/2664906588 15 ==== osd_op_reply(68 notify.2 [notify cookie 94753276737744 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9d38036040 con 0x562d7762be50 2024-09-12T17:28:04.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.546+0000 7f9c297fa640 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f9b7c003400 con 0x562d7762be50 2024-09-12T17:28:04.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.546+0000 7f9d465a5640 1 -- 172.21.15.170:0/2644341136 <== osd.3 v2:172.21.15.170:6816/2664906588 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d38036040 con 0x562d7762be50 2024-09-12T17:28:04.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.546+0000 7f9d465a5640 1 -- 172.21.15.170:0/2644341136 <== osd.3 v2:172.21.15.170:6816/2664906588 17 ==== watch-notify(notify_complete (2) cookie 94753276737744 notify 124554051594 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562d775e94f0 con 0x562d7762be50 2024-09-12T17:28:04.567 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-12T17:28:04.545176Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:28:04.545161Z","tags":[],"group_ids":[]} 2024-09-12T17:28:04.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.547+0000 7f9bfcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:04.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.547+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94753276519856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d7766abe0 con 0x562d77622a90 2024-09-12T17:28:04.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.548+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94753276519856] v29'127 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9d3c051070 con 0x562d77622a90 2024-09-12T17:28:04.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.548+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94753276497552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d7766abe0 con 0x562d776274a0 2024-09-12T17:28:04.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.549+0000 7f9d46da6640 1 -- 172.21.15.170:0/2644341136 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94753276497552] v29'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d40069040 con 0x562d776274a0 2024-09-12T17:28:04.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.549+0000 7f9d48abb800 20 remove_watcher() i=0 2024-09-12T17:28:04.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.549+0000 7f9d48abb800 2 removed watcher, disabling cache 2024-09-12T17:28:04.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.549+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94753276501552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d7766abe0 con 0x562d77622a90 2024-09-12T17:28:04.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.550+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94753276501552] v29'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3c051070 con 0x562d77622a90 2024-09-12T17:28:04.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.550+0000 7f9d48abb800 20 remove_watcher() i=1 2024-09-12T17:28:04.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.550+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94753276504304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d7766abe0 con 0x562d7762be50 2024-09-12T17:28:04.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.551+0000 7f9d465a5640 1 -- 172.21.15.170:0/2644341136 <== osd.3 v2:172.21.15.170:6816/2664906588 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94753276504304] v29'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d38036040 con 0x562d7762be50 2024-09-12T17:28:04.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.551+0000 7f9d48abb800 20 remove_watcher() i=2 2024-09-12T17:28:04.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.551+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94753276506624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d7766abe0 con 0x562d776274a0 2024-09-12T17:28:04.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.552+0000 7f9d46da6640 1 -- 172.21.15.170:0/2644341136 <== osd.2 v2:172.21.15.170:6808/3855567754 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94753276506624] v29'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d40069040 con 0x562d776274a0 2024-09-12T17:28:04.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.552+0000 7f9d48abb800 20 remove_watcher() i=3 2024-09-12T17:28:04.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.552+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94753276509248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d7766abe0 con 0x562d77622a90 2024-09-12T17:28:04.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.553+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94753276509248] v29'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3c051070 con 0x562d77622a90 2024-09-12T17:28:04.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.553+0000 7f9d48abb800 20 remove_watcher() i=4 2024-09-12T17:28:04.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.553+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94753276514208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d7766abe0 con 0x7f9d4003d060 2024-09-12T17:28:04.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.554+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94753276514208] v29'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3c051070 con 0x7f9d4003d060 2024-09-12T17:28:04.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.554+0000 7f9d48abb800 20 remove_watcher() i=5 2024-09-12T17:28:04.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.554+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94753276511584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d7766abe0 con 0x7f9d4003d060 2024-09-12T17:28:04.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.555+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.0 v2:172.21.15.47:6800/3978157098 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94753276511584] v29'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3c051070 con 0x7f9d4003d060 2024-09-12T17:28:04.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.555+0000 7f9d48abb800 20 remove_watcher() i=6 2024-09-12T17:28:04.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.555+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94753276516400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562d7766abe0 con 0x7f9d4003d060 2024-09-12T17:28:04.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.556+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 <== osd.0 v2:172.21.15.47:6800/3978157098 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94753276516400] v29'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3c051070 con 0x7f9d4003d060 2024-09-12T17:28:04.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.556+0000 7f9d48abb800 20 remove_watcher() i=7 2024-09-12T17:28:04.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.556+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f9d4003d060 msgr2=0x7f9d4003c7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.556+0000 7f9d48abb800 1 --2- 172.21.15.170:0/2644341136 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f9d4003d060 0x7f9d4003c7a0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.556+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x562d77622a90 msgr2=0x562d77624f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.556+0000 7f9d48abb800 1 --2- 172.21.15.170:0/2644341136 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x562d77622a90 0x562d77624f50 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.556+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x562d776274a0 msgr2=0x562d77629890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.556+0000 7f9d48abb800 1 --2- 172.21.15.170:0/2644341136 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x562d776274a0 0x562d77629890 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.556+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x562d7762be50 msgr2=0x562d7762e310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.556+0000 7f9d48abb800 1 --2- 172.21.15.170:0/2644341136 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x562d7762be50 0x562d7762e310 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.556+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f9c1003c730 msgr2=0x7f9c1003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.556+0000 7f9d48abb800 1 --2- 172.21.15.170:0/2644341136 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f9c1003c730 0x7f9c1003ebf0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9d38018ac0 tx=0x7f9d3804f000 comp rx=0 tx=0).stop 2024-09-12T17:28:04.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.556+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d7760fbf0 msgr2=0x562d776171f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.556+0000 7f9d48abb800 1 --2- 172.21.15.170:0/2644341136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d7760fbf0 0x562d776171f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f9d40053cd0 tx=0x7f9d40053d30 comp rx=0 tx=0).stop 2024-09-12T17:28:04.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.556+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 reap_dead start 2024-09-12T17:28:04.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.556+0000 7f9d45da4640 1 -- 172.21.15.170:0/2644341136 reap_dead start 2024-09-12T17:28:04.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.556+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 shutdown_connections 2024-09-12T17:28:04.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.556+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 >> 172.21.15.170:0/2644341136 conn(0x562d7760bff0 msgr2=0x562d7760a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:04.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.557+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 shutdown_connections 2024-09-12T17:28:04.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.557+0000 7f9d48abb800 1 -- 172.21.15.170:0/2644341136 wait complete. 2024-09-12T17:28:04.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.557+0000 7f9d48abb800 1 -- 172.21.15.170:0/539542083 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f9c2003c730 msgr2=0x7f9c2003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.557+0000 7f9d48abb800 1 --2- 172.21.15.170:0/539542083 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f9c2003c730 0x7f9c2003ebf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x562d775eff60 tx=0x7f9d38040040 comp rx=0 tx=0).stop 2024-09-12T17:28:04.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.557+0000 7f9d48abb800 1 -- 172.21.15.170:0/539542083 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d77603130 msgr2=0x562d77603550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.557+0000 7f9d48abb800 1 --2- 172.21.15.170:0/539542083 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d77603130 0x562d77603550 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x562d775e9190 tx=0x7f9d400167b0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.557+0000 7f9d48abb800 1 -- 172.21.15.170:0/539542083 shutdown_connections 2024-09-12T17:28:04.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.557+0000 7f9d48abb800 1 --2- 172.21.15.170:0/539542083 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f9c2003c730 0x7f9c2003ebf0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.557+0000 7f9d48abb800 1 --2- 172.21.15.170:0/539542083 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d77603130 0x562d77603550 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.557+0000 7f9d48abb800 1 -- 172.21.15.170:0/539542083 >> 172.21.15.170:0/539542083 conn(0x562d775f74e0 msgr2=0x562d775f78c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:04.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.557+0000 7f9d48abb800 1 -- 172.21.15.170:0/539542083 shutdown_connections 2024-09-12T17:28:04.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.557+0000 7f9d48abb800 1 -- 172.21.15.170:0/539542083 wait complete. 2024-09-12T17:28:04.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.557+0000 7f9d48abb800 1 -- 172.21.15.170:0/3268250165 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x562d774ef040 msgr2=0x562d775ef950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.557+0000 7f9d48abb800 1 --2- 172.21.15.170:0/3268250165 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x562d774ef040 0x562d775ef950 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.557+0000 7f9d48abb800 1 -- 172.21.15.170:0/3268250165 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x562d775f1dc0 msgr2=0x562d775f41b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.557+0000 7f9d48abb800 1 --2- 172.21.15.170:0/3268250165 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x562d775f1dc0 0x562d775f41b0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.557+0000 7f9d48abb800 1 -- 172.21.15.170:0/3268250165 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f9c2c03c780 msgr2=0x7f9c2c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.557+0000 7f9d48abb800 1 --2- 172.21.15.170:0/3268250165 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f9c2c03c780 0x7f9c2c03ec40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c057000 tx=0x7f9d3c052000 comp rx=0 tx=0).stop 2024-09-12T17:28:04.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.557+0000 7f9d48abb800 1 -- 172.21.15.170:0/3268250165 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d774ed520 msgr2=0x562d775e8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.557+0000 7f9d48abb800 1 --2- 172.21.15.170:0/3268250165 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d774ed520 0x562d775e8300 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9d3800c010 tx=0x7f9d38000ed0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.557+0000 7f9d48abb800 1 -- 172.21.15.170:0/3268250165 shutdown_connections 2024-09-12T17:28:04.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.557+0000 7f9d48abb800 1 --2- 172.21.15.170:0/3268250165 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x562d775f1dc0 0x562d775f41b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.557+0000 7f9d48abb800 1 --2- 172.21.15.170:0/3268250165 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f9c2c03c780 0x7f9c2c03ec40 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.557+0000 7f9d48abb800 1 --2- 172.21.15.170:0/3268250165 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x562d774ef040 0x562d775ef950 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.557+0000 7f9d48abb800 1 --2- 172.21.15.170:0/3268250165 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d774ed520 0x562d775e8300 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.557+0000 7f9d48abb800 1 -- 172.21.15.170:0/3268250165 >> 172.21.15.170:0/3268250165 conn(0x562d774e9250 msgr2=0x562d775e1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:04.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.558+0000 7f9d48abb800 1 -- 172.21.15.170:0/3268250165 shutdown_connections 2024-09-12T17:28:04.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.558+0000 7f9d48abb800 1 -- 172.21.15.170:0/3268250165 wait complete. 2024-09-12T17:28:04.579 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-12T17:28:04.545176Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:28:04.545161Z', 'tags': [], 'group_ids': []} 2024-09-12T17:28:04.580 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-12T17:28:04.580 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-12T17:28:04.580 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-09-12T17:28:04.628 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:04.629 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:04.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.627+0000 7f2f26b46800 1 Processor -- start 2024-09-12T17:28:04.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.627+0000 7f2f26b46800 1 -- start start 2024-09-12T17:28:04.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.627+0000 7f2f26b46800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x564ba21136c0 0x564ba2115ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.627+0000 7f2f26b46800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564ba1fbce40 con 0x564ba2116050 2024-09-12T17:28:04.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.627+0000 7f2f26b46800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x564ba1f87680 con 0x564ba21136c0 2024-09-12T17:28:04.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.628+0000 7f2f24637640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x564ba21136c0 0x564ba2115ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.628+0000 7f2f1bfff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x564ba2116050 0x564ba21184f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:37014/0 (socket says 172.21.15.170:37014) 2024-09-12T17:28:04.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.628+0000 7f2f1bfff640 1 -- 172.21.15.170:0/2683238901 learned_addr learned my addr 172.21.15.170:0/2683238901 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:28:04.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.628+0000 7f2f24637640 1 -- 172.21.15.170:0/2683238901 >> v1:172.21.15.47:6789/0 conn(0x564ba2116050 legacy=0x564ba21184f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.628+0000 7f2f24637640 1 -- 172.21.15.170:0/2683238901 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ba1fa36b0 con 0x564ba21136c0 2024-09-12T17:28:04.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.630+0000 7f2f24637640 1 --2- 172.21.15.170:0/2683238901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ba21136c0 0x564ba2115ab0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2f1400a470 tx=0x7f2f14045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7854438066e80851 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.630+0000 7f2f23e36640 1 -- 172.21.15.170:0/2683238901 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f14053570 con 0x564ba21136c0 2024-09-12T17:28:04.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.630+0000 7f2f23e36640 1 -- 172.21.15.170:0/2683238901 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f14058070 con 0x564ba21136c0 2024-09-12T17:28:04.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.630+0000 7f2f23e36640 1 -- 172.21.15.170:0/2683238901 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f14053880 con 0x564ba21136c0 2024-09-12T17:28:04.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.630+0000 7f2f26b46800 1 -- 172.21.15.170:0/2683238901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ba21136c0 msgr2=0x564ba2115ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.630+0000 7f2f26b46800 1 --2- 172.21.15.170:0/2683238901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ba21136c0 0x564ba2115ab0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2f1400a470 tx=0x7f2f14045a20 comp rx=0 tx=0).stop 2024-09-12T17:28:04.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.630+0000 7f2f26b46800 1 -- 172.21.15.170:0/2683238901 shutdown_connections 2024-09-12T17:28:04.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.630+0000 7f2f26b46800 1 --2- 172.21.15.170:0/2683238901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ba21136c0 0x564ba2115ab0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.630+0000 7f2f26b46800 1 -- 172.21.15.170:0/2683238901 >> 172.21.15.170:0/2683238901 conn(0x564ba210d1e0 msgr2=0x564ba210f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:04.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.630+0000 7f2f26b46800 1 -- 172.21.15.170:0/2683238901 shutdown_connections 2024-09-12T17:28:04.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.631+0000 7f2f26b46800 1 -- 172.21.15.170:0/2683238901 wait complete. 2024-09-12T17:28:04.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.644+0000 7f2f26b46800 1 Processor -- start 2024-09-12T17:28:04.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.644+0000 7f2f26b46800 1 -- start start 2024-09-12T17:28:04.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.645+0000 7f2f26b46800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ba21136c0 0x564ba2112e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.645+0000 7f2f26b46800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564ba1fabdd0 con 0x564ba21136c0 2024-09-12T17:28:04.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.645+0000 7f2f24637640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ba21136c0 0x564ba2112e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.645+0000 7f2f24637640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ba21136c0 0x564ba2112e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43640/0 (socket says 172.21.15.170:43640) 2024-09-12T17:28:04.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.645+0000 7f2f24637640 1 -- 172.21.15.170:0/1680878267 learned_addr learned my addr 172.21.15.170:0/1680878267 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:04.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.645+0000 7f2f24637640 1 -- 172.21.15.170:0/1680878267 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ba1fc4e10 con 0x564ba21136c0 2024-09-12T17:28:04.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.645+0000 7f2f24637640 1 --2- 172.21.15.170:0/1680878267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ba21136c0 0x564ba2112e50 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2f14025c20 tx=0x7f2f14051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46bd2cb94092e7a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.646+0000 7f2e1260c640 1 -- 172.21.15.170:0/1680878267 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f14053a20 con 0x564ba21136c0 2024-09-12T17:28:04.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.646+0000 7f2e1260c640 1 -- 172.21.15.170:0/1680878267 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f14063070 con 0x564ba21136c0 2024-09-12T17:28:04.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.646+0000 7f2e1260c640 1 -- 172.21.15.170:0/1680878267 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f14053cf0 con 0x564ba21136c0 2024-09-12T17:28:04.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.646+0000 7f2f26b46800 1 -- 172.21.15.170:0/1680878267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ba21136c0 msgr2=0x564ba2112e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.646+0000 7f2f26b46800 1 --2- 172.21.15.170:0/1680878267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ba21136c0 0x564ba2112e50 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2f14025c20 tx=0x7f2f14051000 comp rx=0 tx=0).stop 2024-09-12T17:28:04.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.646+0000 7f2f26b46800 1 -- 172.21.15.170:0/1680878267 shutdown_connections 2024-09-12T17:28:04.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.646+0000 7f2f26b46800 1 --2- 172.21.15.170:0/1680878267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ba21136c0 0x564ba2112e50 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.646+0000 7f2f26b46800 1 -- 172.21.15.170:0/1680878267 >> 172.21.15.170:0/1680878267 conn(0x564ba210d1e0 msgr2=0x564ba21fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:04.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.647+0000 7f2f26b46800 1 -- 172.21.15.170:0/1680878267 shutdown_connections 2024-09-12T17:28:04.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.647+0000 7f2f26b46800 1 -- 172.21.15.170:0/1680878267 wait complete. 2024-09-12T17:28:04.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.647+0000 7f2f26b46800 1 Processor -- start 2024-09-12T17:28:04.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.647+0000 7f2f26b46800 1 -- start start 2024-09-12T17:28:04.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.647+0000 7f2f26b46800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ba21136c0 0x564ba220c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.647+0000 7f2f26b46800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564ba211a050 con 0x564ba21136c0 2024-09-12T17:28:04.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.647+0000 7f2f24637640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ba21136c0 0x564ba220c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.647+0000 7f2f24637640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ba21136c0 0x564ba220c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43646/0 (socket says 172.21.15.170:43646) 2024-09-12T17:28:04.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.647+0000 7f2f24637640 1 -- 172.21.15.170:0/2519179268 learned_addr learned my addr 172.21.15.170:0/2519179268 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:04.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.647+0000 7f2f24637640 1 -- 172.21.15.170:0/2519179268 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ba220c640 con 0x564ba21136c0 2024-09-12T17:28:04.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.648+0000 7f2f24637640 1 --2- 172.21.15.170:0/2519179268 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ba21136c0 0x564ba220c0e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2f14025c20 tx=0x7f2f14002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.648+0000 7f2e10e09640 1 -- 172.21.15.170:0/2519179268 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f1406c030 con 0x564ba21136c0 2024-09-12T17:28:04.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.648+0000 7f2e10e09640 1 -- 172.21.15.170:0/2519179268 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f14068660 con 0x564ba21136c0 2024-09-12T17:28:04.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.648+0000 7f2f26b46800 1 -- 172.21.15.170:0/2519179268 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564ba220c8d0 con 0x564ba21136c0 2024-09-12T17:28:04.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.648+0000 7f2e10e09640 1 -- 172.21.15.170:0/2519179268 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f14068940 con 0x564ba21136c0 2024-09-12T17:28:04.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.648+0000 7f2f26b46800 1 -- 172.21.15.170:0/2519179268 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ba220d2d0 con 0x564ba21136c0 2024-09-12T17:28:04.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.649+0000 7f2e10e09640 1 -- 172.21.15.170:0/2519179268 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2f14068ae0 con 0x564ba21136c0 2024-09-12T17:28:04.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.649+0000 7f2e10e09640 1 --2- 172.21.15.170:0/2519179268 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2e0c03c780 0x7f2e0c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.649+0000 7f2e10e09640 1 -- 172.21.15.170:0/2519179268 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f2f14097e10 con 0x564ba21136c0 2024-09-12T17:28:04.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.649+0000 7f2f1bfff640 1 --2- 172.21.15.170:0/2519179268 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2e0c03c780 0x7f2e0c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.649+0000 7f2f26b46800 1 --2- 172.21.15.170:0/2519179268 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564ba2116050 0x564ba2213730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.649+0000 7f2f26b46800 1 -- 172.21.15.170:0/2519179268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564ba220deb0 con 0x564ba2116050 2024-09-12T17:28:04.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.649+0000 7f2f24e38640 1 --2- 172.21.15.170:0/2519179268 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564ba2116050 0x564ba2213730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.649+0000 7f2f1bfff640 1 --2- 172.21.15.170:0/2519179268 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2e0c03c780 0x7f2e0c03ec40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c001d70 tx=0x7f2f0c0012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.650+0000 7f2f24e38640 1 --2- 172.21.15.170:0/2519179268 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564ba2116050 0x564ba2213730 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.650+0000 7f2f24e38640 1 -- 172.21.15.170:0/2519179268 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f1c00a4d0 con 0x564ba2116050 2024-09-12T17:28:04.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.650+0000 7f2f26b46800 1 -- 172.21.15.170:0/2519179268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564ba22141b0 con 0x564ba2116050 2024-09-12T17:28:04.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.650+0000 7f2f24e38640 1 -- 172.21.15.170:0/2519179268 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2f1c00a4d0 con 0x564ba2116050 2024-09-12T17:28:04.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.650+0000 7f2f26b46800 1 --2- 172.21.15.170:0/2519179268 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564ba2215ac0 0x564ba2217f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.650+0000 7f2f26b46800 1 -- 172.21.15.170:0/2519179268 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564ba22186f0 con 0x564ba2215ac0 2024-09-12T17:28:04.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.650+0000 7f2f24637640 1 --2- 172.21.15.170:0/2519179268 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564ba2215ac0 0x564ba2217f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.651+0000 7f2f24637640 1 --2- 172.21.15.170:0/2519179268 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564ba2215ac0 0x564ba2217f60 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.651+0000 7f2f24637640 1 -- 172.21.15.170:0/2519179268 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2f14051070 con 0x564ba2215ac0 2024-09-12T17:28:04.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.651+0000 7f2f26b46800 1 -- 172.21.15.170:0/2519179268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564ba2214a00 con 0x564ba2116050 2024-09-12T17:28:04.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.651+0000 7f2f24e38640 1 -- 172.21.15.170:0/2519179268 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2f1c00a4d0 con 0x564ba2116050 2024-09-12T17:28:04.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.651+0000 7f2f26b46800 1 -- 172.21.15.170:0/2519179268 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564ba2214de0 con 0x564ba2215ac0 2024-09-12T17:28:04.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.651+0000 7f2f24637640 1 -- 172.21.15.170:0/2519179268 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2f14051070 con 0x564ba2215ac0 2024-09-12T17:28:04.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.652+0000 7f2f26b46800 1 Processor -- start 2024-09-12T17:28:04.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.652+0000 7f2f26b46800 1 -- start start 2024-09-12T17:28:04.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.652+0000 7f2f26b46800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ba2226fa0 0x564ba22273c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.652+0000 7f2f26b46800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564ba2009a00 con 0x564ba2226fa0 2024-09-12T17:28:04.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.652+0000 7f2f24e38640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ba2226fa0 0x564ba22273c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.652+0000 7f2f24e38640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ba2226fa0 0x564ba22273c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43656/0 (socket says 172.21.15.170:43656) 2024-09-12T17:28:04.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.652+0000 7f2f24e38640 1 -- 172.21.15.170:0/2951722297 learned_addr learned my addr 172.21.15.170:0/2951722297 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:04.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.653+0000 7f2f24e38640 1 -- 172.21.15.170:0/2951722297 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ba2227a00 con 0x564ba2226fa0 2024-09-12T17:28:04.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.653+0000 7f2f24e38640 1 --2- 172.21.15.170:0/2951722297 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ba2226fa0 0x564ba22273c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x564ba220d0e0 tx=0x7f2f1c018c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.653+0000 7f2e09ffb640 1 -- 172.21.15.170:0/2951722297 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f1c016b70 con 0x564ba2226fa0 2024-09-12T17:28:04.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.653+0000 7f2e09ffb640 1 -- 172.21.15.170:0/2951722297 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f1c016d10 con 0x564ba2226fa0 2024-09-12T17:28:04.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.653+0000 7f2f26b46800 1 -- 172.21.15.170:0/2951722297 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564ba2228230 con 0x564ba2226fa0 2024-09-12T17:28:04.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.653+0000 7f2e09ffb640 1 -- 172.21.15.170:0/2951722297 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f1c021440 con 0x564ba2226fa0 2024-09-12T17:28:04.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.653+0000 7f2f26b46800 1 -- 172.21.15.170:0/2951722297 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ba22287d0 con 0x564ba2226fa0 2024-09-12T17:28:04.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.654+0000 7f2e09ffb640 1 -- 172.21.15.170:0/2951722297 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2f1c011040 con 0x564ba2226fa0 2024-09-12T17:28:04.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.654+0000 7f2e09ffb640 1 --2- 172.21.15.170:0/2951722297 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2dfc03c780 0x7f2dfc03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.654+0000 7f2e09ffb640 1 -- 172.21.15.170:0/2951722297 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f2f1c00e040 con 0x564ba2226fa0 2024-09-12T17:28:04.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.654+0000 7f2f24637640 1 --2- 172.21.15.170:0/2951722297 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2dfc03c780 0x7f2dfc03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.654+0000 7f2f26b46800 1 Processor -- start 2024-09-12T17:28:04.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.654+0000 7f2f24637640 1 --2- 172.21.15.170:0/2951722297 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2dfc03c780 0x7f2dfc03ec40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x564ba220d920 tx=0x7f2f1407c4b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.654+0000 7f2f26b46800 1 -- start start 2024-09-12T17:28:04.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.655+0000 7f2f26b46800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ba2233a40 0x564ba2233e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.655+0000 7f2f26b46800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564ba21116f0 con 0x564ba2233a40 2024-09-12T17:28:04.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.655+0000 7f2f24e38640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ba2233a40 0x564ba2233e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.655+0000 7f2f24e38640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ba2233a40 0x564ba2233e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43672/0 (socket says 172.21.15.170:43672) 2024-09-12T17:28:04.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.655+0000 7f2f24e38640 1 -- 172.21.15.170:0/2646832169 learned_addr learned my addr 172.21.15.170:0/2646832169 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:04.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.655+0000 7f2f24e38640 1 -- 172.21.15.170:0/2646832169 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ba2234430 con 0x564ba2233a40 2024-09-12T17:28:04.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.655+0000 7f2f24e38640 1 --2- 172.21.15.170:0/2646832169 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ba2233a40 0x564ba2233e40 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c020450 tx=0x7f2f1c020e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e44e9e10399f9cf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.655+0000 7f2e037fe640 1 -- 172.21.15.170:0/2646832169 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f1c043070 con 0x564ba2233a40 2024-09-12T17:28:04.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.655+0000 7f2e037fe640 1 -- 172.21.15.170:0/2646832169 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f1c055070 con 0x564ba2233a40 2024-09-12T17:28:04.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.655+0000 7f2e037fe640 1 -- 172.21.15.170:0/2646832169 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f1c0522b0 con 0x564ba2233a40 2024-09-12T17:28:04.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.656+0000 7f2f26b46800 1 -- 172.21.15.170:0/2646832169 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ba2233a40 msgr2=0x564ba2233e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.656+0000 7f2f26b46800 1 --2- 172.21.15.170:0/2646832169 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ba2233a40 0x564ba2233e40 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c020450 tx=0x7f2f1c020e60 comp rx=0 tx=0).stop 2024-09-12T17:28:04.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.656+0000 7f2f26b46800 1 -- 172.21.15.170:0/2646832169 shutdown_connections 2024-09-12T17:28:04.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.656+0000 7f2f26b46800 1 --2- 172.21.15.170:0/2646832169 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ba2233a40 0x564ba2233e40 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.656+0000 7f2f26b46800 1 -- 172.21.15.170:0/2646832169 >> 172.21.15.170:0/2646832169 conn(0x564ba222fe80 msgr2=0x564ba222e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:04.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.656+0000 7f2f26b46800 1 -- 172.21.15.170:0/2646832169 shutdown_connections 2024-09-12T17:28:04.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.656+0000 7f2f26b46800 1 -- 172.21.15.170:0/2646832169 wait complete. 2024-09-12T17:28:04.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.656+0000 7f2f26b46800 1 Processor -- start 2024-09-12T17:28:04.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.656+0000 7f2f26b46800 1 -- start start 2024-09-12T17:28:04.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.656+0000 7f2f26b46800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ba2233a40 0x564ba223b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.656+0000 7f2f26b46800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564ba2234a50 con 0x564ba2233a40 2024-09-12T17:28:04.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.657+0000 7f2f24e38640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ba2233a40 0x564ba223b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.657+0000 7f2f24e38640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ba2233a40 0x564ba223b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43676/0 (socket says 172.21.15.170:43676) 2024-09-12T17:28:04.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.657+0000 7f2f24e38640 1 -- 172.21.15.170:0/3310915342 learned_addr learned my addr 172.21.15.170:0/3310915342 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:04.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.657+0000 7f2f24e38640 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ba223b5e0 con 0x564ba2233a40 2024-09-12T17:28:04.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.657+0000 7f2f24e38640 1 --2- 172.21.15.170:0/3310915342 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ba2233a40 0x564ba223b080 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c013740 tx=0x7f2f1c053740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.657+0000 7f2e01ffb640 1 -- 172.21.15.170:0/3310915342 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f1c0449f0 con 0x564ba2233a40 2024-09-12T17:28:04.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.657+0000 7f2e01ffb640 1 -- 172.21.15.170:0/3310915342 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f1c044bb0 con 0x564ba2233a40 2024-09-12T17:28:04.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.657+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564ba223b870 con 0x564ba2233a40 2024-09-12T17:28:04.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.657+0000 7f2e01ffb640 1 -- 172.21.15.170:0/3310915342 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f1c0143c0 con 0x564ba2233a40 2024-09-12T17:28:04.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.657+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ba223c1f0 con 0x564ba2233a40 2024-09-12T17:28:04.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.658+0000 7f2e01ffb640 1 -- 172.21.15.170:0/3310915342 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2f1c014560 con 0x564ba2233a40 2024-09-12T17:28:04.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.658+0000 7f2e01ffb640 1 --2- 172.21.15.170:0/3310915342 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2df403c780 0x7f2df403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.658+0000 7f2e01ffb640 1 -- 172.21.15.170:0/3310915342 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f2f1c03f760 con 0x564ba2233a40 2024-09-12T17:28:04.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.658+0000 7f2f24637640 1 --2- 172.21.15.170:0/3310915342 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2df403c780 0x7f2df403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.659+0000 7f2f24637640 1 --2- 172.21.15.170:0/3310915342 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2df403c780 0x7f2df403ec40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2f1407c560 tx=0x7f2f14087000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.659+0000 7f2f26b46800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.659+0000 7f2f26b46800 1 --2- 172.21.15.170:0/3310915342 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564ba2246b10 0x564ba2248fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.659+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564ba2249720 con 0x564ba2246b10 2024-09-12T17:28:04.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.659+0000 7f2f1bfff640 1 --2- 172.21.15.170:0/3310915342 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564ba2246b10 0x564ba2248fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.659+0000 7f2f1bfff640 1 --2- 172.21.15.170:0/3310915342 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564ba2246b10 0x564ba2248fd0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.659+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f0c009050 con 0x564ba2246b10 2024-09-12T17:28:04.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.659+0000 7f2f26b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.659+0000 7f2f26b46800 20 realm 2024-09-12T17:28:04.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.659+0000 7f2f26b46800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.659+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564ba2245e60 con 0x564ba2246b10 2024-09-12T17:28:04.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.660+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f0c009050 con 0x564ba2246b10 2024-09-12T17:28:04.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.660+0000 7f2f26b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.660+0000 7f2f26b46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:04.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.660+0000 7f2f26b46800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.660+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564ba224a210 con 0x564ba2246b10 2024-09-12T17:28:04.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.660+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f0c009050 con 0x564ba2246b10 2024-09-12T17:28:04.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.660+0000 7f2f26b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.660+0000 7f2f26b46800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.660+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564ba224aae0 con 0x564ba2246b10 2024-09-12T17:28:04.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.660+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2f0c009050 con 0x564ba2246b10 2024-09-12T17:28:04.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.660+0000 7f2f26b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:04.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.660+0000 7f2f26b46800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.660+0000 7f2f26b46800 1 --2- 172.21.15.170:0/3310915342 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564ba224b500 0x564ba224d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.660+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564ba224e030 con 0x564ba224b500 2024-09-12T17:28:04.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.660+0000 7f2f24e38640 1 --2- 172.21.15.170:0/3310915342 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564ba224b500 0x564ba224d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.660+0000 7f2f24e38640 1 --2- 172.21.15.170:0/3310915342 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564ba224b500 0x564ba224d8f0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.661+0000 7f2f24e38640 1 -- 172.21.15.170:0/3310915342 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2f1c00a4d0 con 0x564ba224b500 2024-09-12T17:28:04.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.661+0000 7f2f26b46800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:04.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.661+0000 7f2f26b46800 20 searching for the correct realm 2024-09-12T17:28:04.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.661+0000 7f2f26b46800 1 --2- 172.21.15.170:0/3310915342 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x564ba224ffe0 0x564ba22524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.661+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564ba2252b20 con 0x564ba224ffe0 2024-09-12T17:28:04.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.661+0000 7f2f24637640 1 --2- 172.21.15.170:0/3310915342 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x564ba224ffe0 0x564ba22524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.661+0000 7f2f24637640 1 --2- 172.21.15.170:0/3310915342 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x564ba224ffe0 0x564ba22524a0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.661+0000 7f2f24637640 1 -- 172.21.15.170:0/3310915342 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f14051070 con 0x564ba224ffe0 2024-09-12T17:28:04.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.661+0000 7f2f24637640 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564ba2252b20 con 0x564ba224b500 2024-09-12T17:28:04.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.662+0000 7f2f24e38640 1 -- 172.21.15.170:0/3310915342 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1c00a4d0 con 0x564ba224b500 2024-09-12T17:28:04.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.662+0000 7f2f24e38640 1 --2- 172.21.15.170:0/3310915342 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f2f1c044490 0x7f2f1c03fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.662+0000 7f2f24e38640 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564ba2252b20 con 0x7f2f1c044490 2024-09-12T17:28:04.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.662+0000 7f2f1bfff640 1 --2- 172.21.15.170:0/3310915342 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f2f1c044490 0x7f2f1c03fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.662+0000 7f2f1bfff640 1 --2- 172.21.15.170:0/3310915342 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f2f1c044490 0x7f2f1c03fa00 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.662+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0c009050 con 0x7f2f1c044490 2024-09-12T17:28:04.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.662+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564ba2252b20 con 0x564ba2246b10 2024-09-12T17:28:04.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.663+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0c009050 con 0x564ba2246b10 2024-09-12T17:28:04.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.663+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564ba2252b20 con 0x564ba2246b10 2024-09-12T17:28:04.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.663+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0c029040 con 0x564ba2246b10 2024-09-12T17:28:04.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.663+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564ba2252b20 con 0x7f2f1c044490 2024-09-12T17:28:04.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.663+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0c029040 con 0x7f2f1c044490 2024-09-12T17:28:04.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.663+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564ba2252b20 con 0x7f2f1c044490 2024-09-12T17:28:04.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.663+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0c029040 con 0x7f2f1c044490 2024-09-12T17:28:04.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.663+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564ba2252b20 con 0x564ba224b500 2024-09-12T17:28:04.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.664+0000 7f2f24e38640 1 -- 172.21.15.170:0/3310915342 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1c00a4d0 con 0x564ba224b500 2024-09-12T17:28:04.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.664+0000 7f2f24e38640 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564ba2252b20 con 0x564ba224ffe0 2024-09-12T17:28:04.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.664+0000 7f2f24637640 1 -- 172.21.15.170:0/3310915342 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f14051070 con 0x564ba224ffe0 2024-09-12T17:28:04.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.664+0000 7f2f24637640 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564ba2252b20 con 0x564ba2246b10 2024-09-12T17:28:04.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.664+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0c029040 con 0x564ba2246b10 2024-09-12T17:28:04.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.664+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564ba2252b20 con 0x7f2f1c044490 2024-09-12T17:28:04.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.664+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0c029040 con 0x7f2f1c044490 2024-09-12T17:28:04.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.664+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564ba2252b20 con 0x564ba2246b10 2024-09-12T17:28:04.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.664+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0c029040 con 0x564ba2246b10 2024-09-12T17:28:04.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.664+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564ba2252b20 con 0x564ba224b500 2024-09-12T17:28:04.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.665+0000 7f2f24e38640 1 -- 172.21.15.170:0/3310915342 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f2f1c00a4d0 con 0x564ba224b500 2024-09-12T17:28:04.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.665+0000 7f2f24e38640 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564ba2252b20 con 0x564ba224ffe0 2024-09-12T17:28:04.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.665+0000 7f2f24637640 1 -- 172.21.15.170:0/3310915342 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f14051070 con 0x564ba224ffe0 2024-09-12T17:28:04.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.665+0000 7f2f24637640 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564ba2252b20 con 0x564ba224ffe0 2024-09-12T17:28:04.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.665+0000 7f2f24637640 1 -- 172.21.15.170:0/3310915342 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f14051070 con 0x564ba224ffe0 2024-09-12T17:28:04.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.665+0000 7f2f24637640 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564ba2252b20 con 0x7f2f1c044490 2024-09-12T17:28:04.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.666+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0c029040 con 0x7f2f1c044490 2024-09-12T17:28:04.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.666+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564ba2252b20 con 0x564ba224ffe0 2024-09-12T17:28:04.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.666+0000 7f2f24637640 1 -- 172.21.15.170:0/3310915342 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f14051070 con 0x564ba224ffe0 2024-09-12T17:28:04.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.666+0000 7f2f24637640 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564ba2252b20 con 0x564ba224ffe0 2024-09-12T17:28:04.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.666+0000 7f2f24637640 1 -- 172.21.15.170:0/3310915342 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f14051070 con 0x564ba224ffe0 2024-09-12T17:28:04.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.666+0000 7f2f24637640 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564ba2252b20 con 0x564ba2246b10 2024-09-12T17:28:04.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.666+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0c029040 con 0x564ba2246b10 2024-09-12T17:28:04.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.666+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564ba2252b20 con 0x564ba2246b10 2024-09-12T17:28:04.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.666+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2f0c029040 con 0x564ba2246b10 2024-09-12T17:28:04.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.666+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564ba2252b20 con 0x7f2f1c044490 2024-09-12T17:28:04.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.667+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0c029040 con 0x7f2f1c044490 2024-09-12T17:28:04.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.667+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564ba2252b20 con 0x564ba224ffe0 2024-09-12T17:28:04.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.667+0000 7f2f24637640 1 -- 172.21.15.170:0/3310915342 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f14051070 con 0x564ba224ffe0 2024-09-12T17:28:04.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.667+0000 7f2f24637640 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564ba2252b20 con 0x564ba224b500 2024-09-12T17:28:04.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.667+0000 7f2f24e38640 1 -- 172.21.15.170:0/3310915342 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1c00a4d0 con 0x564ba224b500 2024-09-12T17:28:04.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.667+0000 7f2f24e38640 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564ba2252b20 con 0x564ba2246b10 2024-09-12T17:28:04.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.667+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0c029040 con 0x564ba2246b10 2024-09-12T17:28:04.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.667+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564ba2252b20 con 0x7f2f1c044490 2024-09-12T17:28:04.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.668+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0c029040 con 0x7f2f1c044490 2024-09-12T17:28:04.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.668+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564ba2252b20 con 0x564ba224ffe0 2024-09-12T17:28:04.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.668+0000 7f2f24637640 1 -- 172.21.15.170:0/3310915342 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f14051070 con 0x564ba224ffe0 2024-09-12T17:28:04.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.668+0000 7f2f24637640 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564ba2252b20 con 0x7f2f1c044490 2024-09-12T17:28:04.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.668+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0c029040 con 0x7f2f1c044490 2024-09-12T17:28:04.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.669+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564ba2252b20 con 0x564ba224b500 2024-09-12T17:28:04.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.669+0000 7f2f24e38640 1 -- 172.21.15.170:0/3310915342 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1c00a4d0 con 0x564ba224b500 2024-09-12T17:28:04.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.669+0000 7f2f24e38640 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564ba2252b20 con 0x564ba224ffe0 2024-09-12T17:28:04.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.669+0000 7f2f24637640 1 -- 172.21.15.170:0/3310915342 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f14051070 con 0x564ba224ffe0 2024-09-12T17:28:04.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.669+0000 7f2f24637640 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564ba2252b20 con 0x7f2f1c044490 2024-09-12T17:28:04.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.669+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0c029040 con 0x7f2f1c044490 2024-09-12T17:28:04.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.669+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564ba2252b20 con 0x564ba2246b10 2024-09-12T17:28:04.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.669+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2f0c029040 con 0x564ba2246b10 2024-09-12T17:28:04.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.669+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564ba2252b20 con 0x564ba224b500 2024-09-12T17:28:04.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.670+0000 7f2f24e38640 1 -- 172.21.15.170:0/3310915342 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2f1c067040 con 0x564ba224b500 2024-09-12T17:28:04.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.670+0000 7f2f26b46800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:04.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.670+0000 7f2f26b46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:04.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.670+0000 7f2f26b46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:04.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.670+0000 7f2f26b46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:04.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.670+0000 7f2f26b46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:04.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.670+0000 7f2f26b46800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:04.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.670+0000 7f2f26b46800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.670+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564ba224e9f0 con 0x564ba2246b10 2024-09-12T17:28:04.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.670+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f0c029040 con 0x564ba2246b10 2024-09-12T17:28:04.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.670+0000 7f2f26b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.670+0000 7f2f26b46800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.670+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564ba224e630 con 0x564ba2246b10 2024-09-12T17:28:04.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.670+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2f0c029040 con 0x564ba2246b10 2024-09-12T17:28:04.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.670+0000 7f2f26b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:04.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.670+0000 7f2f26b46800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.670+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564ba224ee30 con 0x564ba224b500 2024-09-12T17:28:04.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.671+0000 7f2f24e38640 1 -- 172.21.15.170:0/3310915342 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2f1c067040 con 0x564ba224b500 2024-09-12T17:28:04.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.671+0000 7f2f26b46800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:04.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.671+0000 7f2f26b46800 20 zone default found 2024-09-12T17:28:04.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.671+0000 7f2f26b46800 4 Realm: () 2024-09-12T17:28:04.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.671+0000 7f2f26b46800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:04.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.671+0000 7f2f26b46800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:04.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.671+0000 7f2f26b46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:04.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.671+0000 7f2f26b46800 20 zonegroup default 2024-09-12T17:28:04.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.671+0000 7f2f26b46800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.671+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564ba2253450 con 0x7f2f1c044490 2024-09-12T17:28:04.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.671+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2f0c029040 con 0x7f2f1c044490 2024-09-12T17:28:04.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.671+0000 7f2f26b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.671+0000 7f2f26b46800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.671+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564ba2255690 con 0x564ba224ffe0 2024-09-12T17:28:04.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.671+0000 7f2f24637640 1 -- 172.21.15.170:0/3310915342 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2f14051070 con 0x564ba224ffe0 2024-09-12T17:28:04.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.671+0000 7f2f26b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.671+0000 7f2f26b46800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.671+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564ba2255a30 con 0x564ba224ffe0 2024-09-12T17:28:04.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.671+0000 7f2f24637640 1 -- 172.21.15.170:0/3310915342 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2f14051070 con 0x564ba224ffe0 2024-09-12T17:28:04.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.671+0000 7f2f26b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.671+0000 7f2f26b46800 20 started sync module instance, tier type = 2024-09-12T17:28:04.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.671+0000 7f2f26b46800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:04.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.671+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564ba2254b20 con 0x564ba224b500 2024-09-12T17:28:04.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.672+0000 7f2f24e38640 1 -- 172.21.15.170:0/3310915342 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1c067040 con 0x564ba224b500 2024-09-12T17:28:04.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.672+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94882842890000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564ba2254780 con 0x564ba224b500 2024-09-12T17:28:04.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.672+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564ba22568a0 con 0x564ba2246b10 2024-09-12T17:28:04.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.673+0000 7f2f24e38640 1 -- 172.21.15.170:0/3310915342 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94882842890000] v29'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1c067040 con 0x564ba224b500 2024-09-12T17:28:04.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.674+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0c029040 con 0x564ba2246b10 2024-09-12T17:28:04.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.674+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94882842893776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564ba22568a0 con 0x564ba2246b10 2024-09-12T17:28:04.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.674+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564ba2257350 con 0x564ba224ffe0 2024-09-12T17:28:04.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.675+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94882842893776] v29'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0c029040 con 0x564ba2246b10 2024-09-12T17:28:04.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.675+0000 7f2f24637640 1 -- 172.21.15.170:0/3310915342 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f14051070 con 0x564ba224ffe0 2024-09-12T17:28:04.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.675+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94882842895344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564ba2256810 con 0x564ba224ffe0 2024-09-12T17:28:04.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.675+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564ba2258210 con 0x564ba224b500 2024-09-12T17:28:04.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.676+0000 7f2f24637640 1 -- 172.21.15.170:0/3310915342 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94882842895344] v29'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f14051070 con 0x564ba224ffe0 2024-09-12T17:28:04.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.676+0000 7f2f24e38640 1 -- 172.21.15.170:0/3310915342 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1c067040 con 0x564ba224b500 2024-09-12T17:28:04.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.676+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94882842900288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564ba2258210 con 0x564ba224b500 2024-09-12T17:28:04.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.676+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564ba2258c80 con 0x564ba2246b10 2024-09-12T17:28:04.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.677+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0c029040 con 0x564ba2246b10 2024-09-12T17:28:04.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.677+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94882842904432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564ba2258c40 con 0x564ba2246b10 2024-09-12T17:28:04.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.677+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564ba2259c30 con 0x7f2f1c044490 2024-09-12T17:28:04.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.677+0000 7f2f24e38640 1 -- 172.21.15.170:0/3310915342 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94882842900288] v29'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1c067040 con 0x564ba224b500 2024-09-12T17:28:04.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.678+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0c029040 con 0x7f2f1c044490 2024-09-12T17:28:04.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.678+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94882842904432] v29'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0c029040 con 0x564ba2246b10 2024-09-12T17:28:04.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.678+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94882842908480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564ba2259c30 con 0x7f2f1c044490 2024-09-12T17:28:04.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.678+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564ba2258fa0 con 0x7f2f1c044490 2024-09-12T17:28:04.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.679+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94882842908480] v29'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0c029040 con 0x7f2f1c044490 2024-09-12T17:28:04.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.679+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(56 notify.6 [create] v29'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0c029040 con 0x7f2f1c044490 2024-09-12T17:28:04.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.679+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94882842906528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564ba225a1c0 con 0x7f2f1c044490 2024-09-12T17:28:04.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.679+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564ba225aa50 con 0x7f2f1c044490 2024-09-12T17:28:04.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.680+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(58 notify.7 [create] v29'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0c029040 con 0x7f2f1c044490 2024-09-12T17:28:04.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.680+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94882842911168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564ba225b0e0 con 0x7f2f1c044490 2024-09-12T17:28:04.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.680+0000 7f2f26b46800 20 add_watcher() i=0 2024-09-12T17:28:04.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.680+0000 7f2f26b46800 20 add_watcher() i=1 2024-09-12T17:28:04.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.680+0000 7f2f26b46800 20 add_watcher() i=2 2024-09-12T17:28:04.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.680+0000 7f2f26b46800 20 add_watcher() i=3 2024-09-12T17:28:04.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.680+0000 7f2f26b46800 20 add_watcher() i=4 2024-09-12T17:28:04.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.680+0000 7f2f26b46800 20 add_watcher() i=5 2024-09-12T17:28:04.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.680+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94882842906528] v29'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0c029040 con 0x7f2f1c044490 2024-09-12T17:28:04.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.680+0000 7f2f26b46800 20 add_watcher() i=6 2024-09-12T17:28:04.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.681+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94882842911168] v29'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0c029040 con 0x7f2f1c044490 2024-09-12T17:28:04.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.681+0000 7f2f26b46800 20 add_watcher() i=7 2024-09-12T17:28:04.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.681+0000 7f2f26b46800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:04.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.681+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564ba225e000 con 0x564ba2246b10 2024-09-12T17:28:04.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.681+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2f0c029040 con 0x564ba2246b10 2024-09-12T17:28:04.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.681+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94882842913568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564ba225b3f0 con 0x564ba2246b10 2024-09-12T17:28:04.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.682+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94882842913568] v29'128 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2f0c029040 con 0x564ba2246b10 2024-09-12T17:28:04.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.682+0000 7f2dda7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:04.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.683+0000 7f2f26b46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:04.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.683+0000 7f2f26b46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:04.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.683+0000 7f2f26b46800 5 note: GC not initialized 2024-09-12T17:28:04.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.683+0000 7f2dd97e2640 20 reqs_thread_entry: start 2024-09-12T17:28:04.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.683+0000 7f2f26b46800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:04.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.683+0000 7f2f26b46800 20 Filter name: none 2024-09-12T17:28:04.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.683+0000 7f2d4affd640 20 reqs_thread_entry: start 2024-09-12T17:28:04.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.683+0000 7f2f26b46800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-12T17:28:04.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.683+0000 7f2f26b46800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.683+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564ba2291040 con 0x7f2f1c044490 2024-09-12T17:28:04.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.684+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f2f0c029040 con 0x7f2f1c044490 2024-09-12T17:28:04.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.684+0000 7f2f26b46800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:28:04.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.684+0000 7f2f26b46800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-12T17:28:04.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.684+0000 7f2f26b46800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-12T17:28:04.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.684+0000 7f2f26b46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:04.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.684+0000 7f2f26b46800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T17:28:04.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.684+0000 7f2f26b46800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.684+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564ba22909d0 con 0x564ba224b500 2024-09-12T17:28:04.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.684+0000 7f2f24e38640 1 -- 172.21.15.170:0/3310915342 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f2f1c067040 con 0x564ba224b500 2024-09-12T17:28:04.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.684+0000 7f2f26b46800 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T17:28:04.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.684+0000 7f2f26b46800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-12T17:28:04.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.684+0000 7f2f26b46800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:28:04.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.685+0000 7f2f26b46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 : miss 2024-09-12T17:28:04.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.685+0000 7f2f26b46800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.685+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:64 8.1d 8:baccd554:root::.bucket.meta.myfoo%3a7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564ba2294760 con 0x7f2f1c044490 2024-09-12T17:28:04.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.685+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(64 .bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f2f0c029040 con 0x7f2f1c044490 2024-09-12T17:28:04.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.685+0000 7f2f26b46800 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T17:28:04.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.685+0000 7f2f26b46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 info.flags=0x17 2024-09-12T17:28:04.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.685+0000 7f2f26b46800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 to cache LRU end 2024-09-12T17:28:04.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.685+0000 7f2f26b46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:04.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.685+0000 7f2f26b46800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:28:04.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.685+0000 7f2f26b46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 2024-09-12T17:28:04.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.685+0000 7f2f26b46800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-09-12T17:28:04.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.685+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564ba2298cc0 con 0x564ba224b500 2024-09-12T17:28:04.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.686+0000 7f2f24e38640 1 -- 172.21.15.170:0/3310915342 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(65 foo.buckets [call] v29'24 uv24 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f2f1c067040 con 0x564ba224b500 2024-09-12T17:28:04.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.686+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:66 8.0 8:0794129d:root::.bucket.meta.testx%3amyfoo%3a7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1:head [create,call version.inc in=38b,writefull 0~420 in=420b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564ba229c5d0 con 0x564ba224ffe0 2024-09-12T17:28:04.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.687+0000 7f2f24637640 1 -- 172.21.15.170:0/3310915342 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 [create,call,writefull 0~420,setxattr (203)] v29'3 uv3 ondisk = 0) ==== 338+0+0 (crc 0 0 0) 0x7f2f14051070 con 0x564ba224ffe0 2024-09-12T17:28:04.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.687+0000 7f2f26b46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 info.flags=0x7 2024-09-12T17:28:04.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.687+0000 7f2f26b46800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 to cache LRU end 2024-09-12T17:28:04.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.687+0000 7f2f26b46800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:28:04.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.687+0000 7f2f26b46800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1, ofs0, ns] 2024-09-12T17:28:04.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.687+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:67 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94882843173888 in=867b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564ba229c0a0 con 0x7f2f1c044490 2024-09-12T17:28:04.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.688+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== watch-notify(notify (1) cookie 94882842906528 notify 124554051595 ret 0) ==== 897+0+0 (crc 0 0 0) 0x564ba2294b50 con 0x7f2f1c044490 2024-09-12T17:28:04.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.688+0000 7f2e037fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051595 cookie 94882842906528 notifier 4540 bl.length()=855 2024-09-12T17:28:04.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.688+0000 7f2e037fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 info.flags=0x7 2024-09-12T17:28:04.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.688+0000 7f2e037fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 to cache LRU end 2024-09-12T17:28:04.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.688+0000 7f2e037fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:28:04.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.688+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(67 notify.6 [notify cookie 94882843173888 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2f0c029040 con 0x7f2f1c044490 2024-09-12T17:28:04.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.688+0000 7f2e037fe640 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f2de8003ea0 con 0x7f2f1c044490 2024-09-12T17:28:04.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.688+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== osd_op_reply(68 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0c029040 con 0x7f2f1c044490 2024-09-12T17:28:04.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.688+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.0 v2:172.21.15.47:6800/3978157098 22 ==== watch-notify(notify_complete (2) cookie 94882843173888 notify 124554051595 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564ba2292ca0 con 0x7f2f1c044490 2024-09-12T17:28:04.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.688+0000 7f2f26b46800 20 handle_bi_update(): bucket=testx:myfoo[7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1]): orig_sources= new_sources= 2024-09-12T17:28:04.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.688+0000 7f2f26b46800 20 handle_bi_update(): bucket=testx:myfoo[7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1]): potential sources added=[] removed=[] 2024-09-12T17:28:04.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.688+0000 7f2f26b46800 20 handle_bi_update(): bucket=testx:myfoo[7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1]): orig_dests= new_dests= 2024-09-12T17:28:04.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.688+0000 7f2f26b46800 20 handle_bi_update(): bucket=testx:myfoo[7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1]): potential dests added=[] removed=[] 2024-09-12T17:28:04.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.688+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564ba229c180 con 0x564ba2246b10 2024-09-12T17:28:04.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.689+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v29'1 uv1 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f2f0c029040 con 0x564ba2246b10 2024-09-12T17:28:04.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.689+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564ba229c180 con 0x564ba2246b10 2024-09-12T17:28:04.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.690+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v29'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f2f0c029040 con 0x564ba2246b10 2024-09-12T17:28:04.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.690+0000 7f2f26b46800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-12T17:28:04.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.690+0000 7f2f26b46800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-12T17:28:04.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.690+0000 7f2f26b46800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-12T17:28:04.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.690+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 94882843180240 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564ba229c0f0 con 0x564ba2246b10 2024-09-12T17:28:04.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.691+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== watch-notify(notify (1) cookie 94882842904432 notify 124554051595 ret 0) ==== 390+0+0 (crc 0 0 0) 0x564ba229c520 con 0x564ba2246b10 2024-09-12T17:28:04.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.691+0000 7f2e037fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051595 cookie 94882842904432 notifier 4540 bl.length()=348 2024-09-12T17:28:04.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.691+0000 7f2e037fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-12T17:28:04.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.691+0000 7f2e037fe640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-12T17:28:04.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.691+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(71 notify.4 [notify cookie 94882843180240 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2f0c029040 con 0x564ba2246b10 2024-09-12T17:28:04.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.691+0000 7f2e037fe640 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f2de8003ea0 con 0x564ba2246b10 2024-09-12T17:28:04.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.691+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== watch-notify(notify_complete (2) cookie 94882843180240 notify 124554051595 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564ba229b410 con 0x564ba2246b10 2024-09-12T17:28:04.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.691+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0c029040 con 0x564ba2246b10 2024-09-12T17:28:04.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.691+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:73 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564ba229c180 con 0x564ba224b500 2024-09-12T17:28:04.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.692+0000 7f2f24e38640 1 -- 172.21.15.170:0/3310915342 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(73 myfoo [call,delete] v29'25 uv25 ondisk = 0) ==== 191+0+0 (crc 0 0 0) 0x7f2f1c067040 con 0x564ba224b500 2024-09-12T17:28:04.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.692+0000 7f2f26b46800 10 removing default.rgw.meta+root+myfoo from cache 2024-09-12T17:28:04.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.692+0000 7f2f26b46800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-12T17:28:04.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.692+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94882843180240 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564ba229c0f0 con 0x7f2f1c044490 2024-09-12T17:28:04.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.692+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.0 v2:172.21.15.47:6800/3978157098 23 ==== watch-notify(notify (1) cookie 94882842906528 notify 124554051596 ret 0) ==== 191+0+0 (crc 0 0 0) 0x564ba229b410 con 0x7f2f1c044490 2024-09-12T17:28:04.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.692+0000 7f2e02ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051596 cookie 94882842906528 notifier 4540 bl.length()=149 2024-09-12T17:28:04.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.692+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.0 v2:172.21.15.47:6800/3978157098 24 ==== osd_op_reply(74 notify.6 [notify cookie 94882843180240 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2f0c029040 con 0x7f2f1c044490 2024-09-12T17:28:04.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.692+0000 7f2e02ffd640 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:75 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f2d580032c0 con 0x7f2f1c044490 2024-09-12T17:28:04.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.693+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.0 v2:172.21.15.47:6800/3978157098 25 ==== watch-notify(notify_complete (2) cookie 94882843180240 notify 124554051596 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564ba2292ca0 con 0x7f2f1c044490 2024-09-12T17:28:04.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.693+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.0 v2:172.21.15.47:6800/3978157098 26 ==== osd_op_reply(75 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0c029040 con 0x7f2f1c044490 2024-09-12T17:28:04.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.693+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:76 8.1d 8:baccd554:root::.bucket.meta.myfoo%3a7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564ba229c180 con 0x7f2f1c044490 2024-09-12T17:28:04.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.694+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.0 v2:172.21.15.47:6800/3978157098 27 ==== osd_op_reply(76 .bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 [call,delete] v29'4 uv4 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f2f0c029040 con 0x7f2f1c044490 2024-09-12T17:28:04.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.694+0000 7f2f26b46800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 from cache 2024-09-12T17:28:04.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.694+0000 7f2f26b46800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1, ofs0, ns] 2024-09-12T17:28:04.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.694+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [notify cookie 94882843151872 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564ba229c180 con 0x7f2f1c044490 2024-09-12T17:28:04.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.694+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.0 v2:172.21.15.47:6800/3978157098 28 ==== watch-notify(notify (1) cookie 94882842911168 notify 124554051597 ret 0) ==== 248+0+0 (crc 0 0 0) 0x564ba2292ca0 con 0x7f2f1c044490 2024-09-12T17:28:04.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.694+0000 7f2e037fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051597 cookie 94882842911168 notifier 4540 bl.length()=206 2024-09-12T17:28:04.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.694+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.0 v2:172.21.15.47:6800/3978157098 29 ==== osd_op_reply(77 notify.7 [notify cookie 94882843151872 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2f0c029040 con 0x7f2f1c044490 2024-09-12T17:28:04.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.694+0000 7f2e037fe640 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f2de8003ea0 con 0x7f2f1c044490 2024-09-12T17:28:04.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.694+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.0 v2:172.21.15.47:6800/3978157098 30 ==== osd_op_reply(78 notify.7 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0c029040 con 0x7f2f1c044490 2024-09-12T17:28:04.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.694+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.0 v2:172.21.15.47:6800/3978157098 31 ==== watch-notify(notify_complete (2) cookie 94882843151872 notify 124554051597 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564ba1fbce40 con 0x7f2f1c044490 2024-09-12T17:28:04.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.695+0000 7f2dda7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:04.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.695+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94882842913568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564ba228ed70 con 0x564ba2246b10 2024-09-12T17:28:04.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.696+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94882842913568] v29'129 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2f0c029040 con 0x564ba2246b10 2024-09-12T17:28:04.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.696+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94882842890000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564ba228ed70 con 0x564ba224b500 2024-09-12T17:28:04.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.697+0000 7f2f24e38640 1 -- 172.21.15.170:0/3310915342 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94882842890000] v29'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1c067040 con 0x564ba224b500 2024-09-12T17:28:04.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.697+0000 7f2f26b46800 20 remove_watcher() i=0 2024-09-12T17:28:04.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.697+0000 7f2f26b46800 2 removed watcher, disabling cache 2024-09-12T17:28:04.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.697+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94882842893776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564ba228ed70 con 0x564ba2246b10 2024-09-12T17:28:04.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.698+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94882842893776] v29'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0c029040 con 0x564ba2246b10 2024-09-12T17:28:04.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.698+0000 7f2f26b46800 20 remove_watcher() i=1 2024-09-12T17:28:04.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.698+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94882842895344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564ba228ed70 con 0x564ba224ffe0 2024-09-12T17:28:04.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.699+0000 7f2f24637640 1 -- 172.21.15.170:0/3310915342 <== osd.3 v2:172.21.15.170:6816/2664906588 15 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94882842895344] v29'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f14051070 con 0x564ba224ffe0 2024-09-12T17:28:04.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.699+0000 7f2f26b46800 20 remove_watcher() i=2 2024-09-12T17:28:04.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.699+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94882842900288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564ba228ed70 con 0x564ba224b500 2024-09-12T17:28:04.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.700+0000 7f2f24e38640 1 -- 172.21.15.170:0/3310915342 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94882842900288] v29'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1c067040 con 0x564ba224b500 2024-09-12T17:28:04.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.700+0000 7f2f26b46800 20 remove_watcher() i=3 2024-09-12T17:28:04.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.700+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94882842904432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564ba228ed70 con 0x564ba2246b10 2024-09-12T17:28:04.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.701+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94882842904432] v29'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0c029040 con 0x564ba2246b10 2024-09-12T17:28:04.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.701+0000 7f2f26b46800 20 remove_watcher() i=4 2024-09-12T17:28:04.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.701+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94882842908480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564ba228ed70 con 0x7f2f1c044490 2024-09-12T17:28:04.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.702+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.0 v2:172.21.15.47:6800/3978157098 32 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94882842908480] v29'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0c029040 con 0x7f2f1c044490 2024-09-12T17:28:04.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.702+0000 7f2f26b46800 20 remove_watcher() i=5 2024-09-12T17:28:04.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.702+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94882842906528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564ba228ed70 con 0x7f2f1c044490 2024-09-12T17:28:04.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.703+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.0 v2:172.21.15.47:6800/3978157098 33 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94882842906528] v29'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0c029040 con 0x7f2f1c044490 2024-09-12T17:28:04.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.703+0000 7f2f26b46800 20 remove_watcher() i=6 2024-09-12T17:28:04.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.703+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94882842911168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564ba228ed70 con 0x7f2f1c044490 2024-09-12T17:28:04.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.704+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 <== osd.0 v2:172.21.15.47:6800/3978157098 34 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94882842911168] v29'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0c029040 con 0x7f2f1c044490 2024-09-12T17:28:04.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.704+0000 7f2f26b46800 20 remove_watcher() i=7 2024-09-12T17:28:04.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.704+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f2f1c044490 msgr2=0x7f2f1c03fa00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.704+0000 7f2f26b46800 1 --2- 172.21.15.170:0/3310915342 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f2f1c044490 0x7f2f1c03fa00 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.704+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564ba2246b10 msgr2=0x564ba2248fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.704+0000 7f2f26b46800 1 --2- 172.21.15.170:0/3310915342 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564ba2246b10 0x564ba2248fd0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.704+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564ba224b500 msgr2=0x564ba224d8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.704+0000 7f2f26b46800 1 --2- 172.21.15.170:0/3310915342 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564ba224b500 0x564ba224d8f0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.704+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x564ba224ffe0 msgr2=0x564ba22524a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.704+0000 7f2f26b46800 1 --2- 172.21.15.170:0/3310915342 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x564ba224ffe0 0x564ba22524a0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.704+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2df403c780 msgr2=0x7f2df403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.704+0000 7f2f26b46800 1 --2- 172.21.15.170:0/3310915342 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2df403c780 0x7f2df403ec40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2f1407c560 tx=0x7f2f14087000 comp rx=0 tx=0).stop 2024-09-12T17:28:04.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.704+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ba2233a40 msgr2=0x564ba223b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.704+0000 7f2f1bfff640 1 -- 172.21.15.170:0/3310915342 reap_dead start 2024-09-12T17:28:04.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.704+0000 7f2f26b46800 1 --2- 172.21.15.170:0/3310915342 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ba2233a40 0x564ba223b080 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c013740 tx=0x7f2f1c053740 comp rx=0 tx=0).stop 2024-09-12T17:28:04.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.704+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 shutdown_connections 2024-09-12T17:28:04.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.704+0000 7f2f26b46800 1 --2- 172.21.15.170:0/3310915342 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ba2233a40 0x564ba223b080 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.704+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 >> 172.21.15.170:0/3310915342 conn(0x564ba222fe80 msgr2=0x564ba222e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:04.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.704+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 shutdown_connections 2024-09-12T17:28:04.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.704+0000 7f2f26b46800 1 -- 172.21.15.170:0/3310915342 wait complete. 2024-09-12T17:28:04.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.705+0000 7f2f26b46800 1 -- 172.21.15.170:0/2951722297 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2dfc03c780 msgr2=0x7f2dfc03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.705+0000 7f2f26b46800 1 --2- 172.21.15.170:0/2951722297 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2dfc03c780 0x7f2dfc03ec40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x564ba220d920 tx=0x7f2f1407c4b0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.705+0000 7f2f26b46800 1 -- 172.21.15.170:0/2951722297 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ba2226fa0 msgr2=0x564ba22273c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.705+0000 7f2f26b46800 1 --2- 172.21.15.170:0/2951722297 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ba2226fa0 0x564ba22273c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x564ba220d0e0 tx=0x7f2f1c018c80 comp rx=0 tx=0).stop 2024-09-12T17:28:04.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.705+0000 7f2f26b46800 1 -- 172.21.15.170:0/2951722297 shutdown_connections 2024-09-12T17:28:04.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.705+0000 7f2f26b46800 1 --2- 172.21.15.170:0/2951722297 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2dfc03c780 0x7f2dfc03ec40 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.705+0000 7f2f26b46800 1 --2- 172.21.15.170:0/2951722297 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ba2226fa0 0x564ba22273c0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.705+0000 7f2f26b46800 1 -- 172.21.15.170:0/2951722297 >> 172.21.15.170:0/2951722297 conn(0x564ba221b350 msgr2=0x564ba221b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:04.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.705+0000 7f2f26b46800 1 -- 172.21.15.170:0/2951722297 shutdown_connections 2024-09-12T17:28:04.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.705+0000 7f2f26b46800 1 -- 172.21.15.170:0/2951722297 wait complete. 2024-09-12T17:28:04.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.705+0000 7f2f26b46800 1 -- 172.21.15.170:0/2519179268 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564ba2116050 msgr2=0x564ba2213730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.705+0000 7f2f26b46800 1 --2- 172.21.15.170:0/2519179268 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564ba2116050 0x564ba2213730 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.705+0000 7f2f26b46800 1 -- 172.21.15.170:0/2519179268 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564ba2215ac0 msgr2=0x564ba2217f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.705+0000 7f2f26b46800 1 --2- 172.21.15.170:0/2519179268 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564ba2215ac0 0x564ba2217f60 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.705+0000 7f2f26b46800 1 -- 172.21.15.170:0/2519179268 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2e0c03c780 msgr2=0x7f2e0c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.705+0000 7f2f26b46800 1 --2- 172.21.15.170:0/2519179268 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2e0c03c780 0x7f2e0c03ec40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c001d70 tx=0x7f2f0c0012d0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.705+0000 7f2f26b46800 1 -- 172.21.15.170:0/2519179268 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ba21136c0 msgr2=0x564ba220c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.705+0000 7f2f26b46800 1 --2- 172.21.15.170:0/2519179268 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ba21136c0 0x564ba220c0e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2f14025c20 tx=0x7f2f14002fb0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.705+0000 7f2f26b46800 1 -- 172.21.15.170:0/2519179268 shutdown_connections 2024-09-12T17:28:04.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.705+0000 7f2f26b46800 1 --2- 172.21.15.170:0/2519179268 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564ba2215ac0 0x564ba2217f60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.705+0000 7f2f26b46800 1 --2- 172.21.15.170:0/2519179268 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2e0c03c780 0x7f2e0c03ec40 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.705+0000 7f2f26b46800 1 --2- 172.21.15.170:0/2519179268 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564ba2116050 0x564ba2213730 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.705+0000 7f2f26b46800 1 --2- 172.21.15.170:0/2519179268 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564ba21136c0 0x564ba220c0e0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.705+0000 7f2f26b46800 1 -- 172.21.15.170:0/2519179268 >> 172.21.15.170:0/2519179268 conn(0x564ba210d1e0 msgr2=0x564ba21fdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:04.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.705+0000 7f2f26b46800 1 -- 172.21.15.170:0/2519179268 shutdown_connections 2024-09-12T17:28:04.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.705+0000 7f2f26b46800 1 -- 172.21.15.170:0/2519179268 wait complete. 2024-09-12T17:28:04.733 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-09-12T17:28:04.733 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-09-12T17:28:04.733 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-09-12T17:28:04.777 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:04.777 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:04.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.775+0000 7f7a88f28800 1 Processor -- start 2024-09-12T17:28:04.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.775+0000 7f7a88f28800 1 -- start start 2024-09-12T17:28:04.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.775+0000 7f7a88f28800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x555644c10670 0x555644c12a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.775+0000 7f7a88f28800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555644ab9e40 con 0x555644c13000 2024-09-12T17:28:04.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.775+0000 7f7a88f28800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x555644a84680 con 0x555644c10670 2024-09-12T17:28:04.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.776+0000 7f7a84c4b640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x555644c10670 0x555644c12a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.776+0000 7f7a84c4b640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x555644c10670 0x555644c12a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43678/0 (socket says 172.21.15.170:43678) 2024-09-12T17:28:04.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.776+0000 7f7a84c4b640 1 -- 172.21.15.170:0/71358793 learned_addr learned my addr 172.21.15.170:0/71358793 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:04.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.776+0000 7f7a7ffff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x555644c13000 0x555644c154c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:37018/0 (socket says 172.21.15.170:37018) 2024-09-12T17:28:04.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.776+0000 7f7a84c4b640 1 -- 172.21.15.170:0/71358793 >> v1:172.21.15.47:6789/0 conn(0x555644c13000 legacy=0x555644c154c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.776+0000 7f7a84c4b640 1 -- 172.21.15.170:0/71358793 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555644aa06b0 con 0x555644c10670 2024-09-12T17:28:04.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.778+0000 7f7a84c4b640 1 --2- 172.21.15.170:0/71358793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555644c10670 0x555644c12a60 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7a7800a520 tx=0x7f7a78045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c1a4756f2303e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.778+0000 7f7a7f7fe640 1 -- 172.21.15.170:0/71358793 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a78055070 con 0x555644c10670 2024-09-12T17:28:04.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.778+0000 7f7a7f7fe640 1 -- 172.21.15.170:0/71358793 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a780515b0 con 0x555644c10670 2024-09-12T17:28:04.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.778+0000 7f7a7f7fe640 1 -- 172.21.15.170:0/71358793 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a780518d0 con 0x555644c10670 2024-09-12T17:28:04.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.778+0000 7f7a88f28800 1 -- 172.21.15.170:0/71358793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555644c10670 msgr2=0x555644c12a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.778+0000 7f7a88f28800 1 --2- 172.21.15.170:0/71358793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555644c10670 0x555644c12a60 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7a7800a520 tx=0x7f7a78045ba0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.778+0000 7f7a88f28800 1 -- 172.21.15.170:0/71358793 shutdown_connections 2024-09-12T17:28:04.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.778+0000 7f7a88f28800 1 --2- 172.21.15.170:0/71358793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555644c10670 0x555644c12a60 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.778+0000 7f7a88f28800 1 -- 172.21.15.170:0/71358793 >> 172.21.15.170:0/71358793 conn(0x555644c0a1b0 msgr2=0x555644c0c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:04.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.779+0000 7f7a88f28800 1 -- 172.21.15.170:0/71358793 shutdown_connections 2024-09-12T17:28:04.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.779+0000 7f7a88f28800 1 -- 172.21.15.170:0/71358793 wait complete. 2024-09-12T17:28:04.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.792+0000 7f7a88f28800 1 Processor -- start 2024-09-12T17:28:04.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.792+0000 7f7a88f28800 1 -- start start 2024-09-12T17:28:04.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.792+0000 7f7a88f28800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555644c10670 0x555644cff710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.792+0000 7f7a88f28800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555644aa8dd0 con 0x555644c10670 2024-09-12T17:28:04.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.793+0000 7f7a84c4b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555644c10670 0x555644cff710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.793+0000 7f7a84c4b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555644c10670 0x555644cff710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43692/0 (socket says 172.21.15.170:43692) 2024-09-12T17:28:04.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.793+0000 7f7a84c4b640 1 -- 172.21.15.170:0/746982122 learned_addr learned my addr 172.21.15.170:0/746982122 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:04.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.793+0000 7f7a84c4b640 1 -- 172.21.15.170:0/746982122 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555644ac1e10 con 0x555644c10670 2024-09-12T17:28:04.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.793+0000 7f7a84c4b640 1 --2- 172.21.15.170:0/746982122 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555644c10670 0x555644cff710 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7a780460d0 tx=0x7f7a78051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bd1ef6e383688b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.793+0000 7f7971e13640 1 -- 172.21.15.170:0/746982122 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a780519d0 con 0x555644c10670 2024-09-12T17:28:04.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.793+0000 7f7971e13640 1 -- 172.21.15.170:0/746982122 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a78051b70 con 0x555644c10670 2024-09-12T17:28:04.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.793+0000 7f7971e13640 1 -- 172.21.15.170:0/746982122 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a78051e50 con 0x555644c10670 2024-09-12T17:28:04.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.794+0000 7f7a88f28800 1 -- 172.21.15.170:0/746982122 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555644c10670 msgr2=0x555644cff710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.794+0000 7f7a88f28800 1 --2- 172.21.15.170:0/746982122 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555644c10670 0x555644cff710 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7a780460d0 tx=0x7f7a78051000 comp rx=0 tx=0).stop 2024-09-12T17:28:04.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.794+0000 7f7a88f28800 1 -- 172.21.15.170:0/746982122 shutdown_connections 2024-09-12T17:28:04.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.794+0000 7f7a88f28800 1 --2- 172.21.15.170:0/746982122 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555644c10670 0x555644cff710 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.794+0000 7f7a88f28800 1 -- 172.21.15.170:0/746982122 >> 172.21.15.170:0/746982122 conn(0x555644c0a1b0 msgr2=0x555644cfb090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:04.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.794+0000 7f7a88f28800 1 -- 172.21.15.170:0/746982122 shutdown_connections 2024-09-12T17:28:04.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.794+0000 7f7a88f28800 1 -- 172.21.15.170:0/746982122 wait complete. 2024-09-12T17:28:04.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.795+0000 7f7a88f28800 1 Processor -- start 2024-09-12T17:28:04.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.795+0000 7f7a88f28800 1 -- start start 2024-09-12T17:28:04.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.795+0000 7f7a88f28800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555644c13000 0x555644d07160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.795+0000 7f7a88f28800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555644c17020 con 0x555644c13000 2024-09-12T17:28:04.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.795+0000 7f7a84c4b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555644c13000 0x555644d07160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.795+0000 7f7a84c4b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555644c13000 0x555644d07160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43706/0 (socket says 172.21.15.170:43706) 2024-09-12T17:28:04.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.795+0000 7f7a84c4b640 1 -- 172.21.15.170:0/884089808 learned_addr learned my addr 172.21.15.170:0/884089808 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:04.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.795+0000 7f7a84c4b640 1 -- 172.21.15.170:0/884089808 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555644d076c0 con 0x555644c13000 2024-09-12T17:28:04.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.795+0000 7f7a84c4b640 1 --2- 172.21.15.170:0/884089808 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555644c13000 0x555644d07160 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7a780460d0 tx=0x7f7a78002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.796+0000 7f796bfff640 1 -- 172.21.15.170:0/884089808 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a78072020 con 0x555644c13000 2024-09-12T17:28:04.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.796+0000 7f796bfff640 1 -- 172.21.15.170:0/884089808 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a7805a450 con 0x555644c13000 2024-09-12T17:28:04.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.796+0000 7f7a88f28800 1 -- 172.21.15.170:0/884089808 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555644d07950 con 0x555644c13000 2024-09-12T17:28:04.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.796+0000 7f796bfff640 1 -- 172.21.15.170:0/884089808 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a7805a770 con 0x555644c13000 2024-09-12T17:28:04.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.796+0000 7f7a88f28800 1 -- 172.21.15.170:0/884089808 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555644d08560 con 0x555644c13000 2024-09-12T17:28:04.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.796+0000 7f796bfff640 1 -- 172.21.15.170:0/884089808 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f7a78075020 con 0x555644c13000 2024-09-12T17:28:04.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.797+0000 7f796bfff640 1 --2- 172.21.15.170:0/884089808 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f796c03c780 0x7f796c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.797+0000 7f796bfff640 1 -- 172.21.15.170:0/884089808 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f7a7806b040 con 0x555644c13000 2024-09-12T17:28:04.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.797+0000 7f7a7ffff640 1 --2- 172.21.15.170:0/884089808 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f796c03c780 0x7f796c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.797+0000 7f7a88f28800 1 --2- 172.21.15.170:0/884089808 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x555644d0c7a0 0x555644d0eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.797+0000 7f7a88f28800 1 -- 172.21.15.170:0/884089808 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555644d0f0d0 con 0x555644d0c7a0 2024-09-12T17:28:04.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.797+0000 7f7a8544c640 1 --2- 172.21.15.170:0/884089808 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x555644d0c7a0 0x555644d0eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.797+0000 7f7a7ffff640 1 --2- 172.21.15.170:0/884089808 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f796c03c780 0x7f796c03ec40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7a70001e30 tx=0x7f7a70001390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.797+0000 7f7a8544c640 1 --2- 172.21.15.170:0/884089808 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x555644d0c7a0 0x555644d0eb90 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.798+0000 7f7a8544c640 1 -- 172.21.15.170:0/884089808 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a8000a4d0 con 0x555644d0c7a0 2024-09-12T17:28:04.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.798+0000 7f7a88f28800 1 -- 172.21.15.170:0/884089808 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555644d0f470 con 0x555644d0c7a0 2024-09-12T17:28:04.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.798+0000 7f7a8544c640 1 -- 172.21.15.170:0/884089808 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7a8000a4d0 con 0x555644d0c7a0 2024-09-12T17:28:04.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.798+0000 7f7a88f28800 1 --2- 172.21.15.170:0/884089808 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x555644d10f70 0x555644d13410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.798+0000 7f7a88f28800 1 -- 172.21.15.170:0/884089808 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555644d13ba0 con 0x555644d10f70 2024-09-12T17:28:04.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.798+0000 7f7a84c4b640 1 --2- 172.21.15.170:0/884089808 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x555644d10f70 0x555644d13410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.798+0000 7f7a84c4b640 1 --2- 172.21.15.170:0/884089808 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x555644d10f70 0x555644d13410 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.799+0000 7f7a84c4b640 1 -- 172.21.15.170:0/884089808 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7a78057030 con 0x555644d10f70 2024-09-12T17:28:04.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.799+0000 7f7a88f28800 1 -- 172.21.15.170:0/884089808 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555644d0fcc0 con 0x555644d0c7a0 2024-09-12T17:28:04.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.799+0000 7f7a8544c640 1 -- 172.21.15.170:0/884089808 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7a8000a4d0 con 0x555644d0c7a0 2024-09-12T17:28:04.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.799+0000 7f7a88f28800 1 -- 172.21.15.170:0/884089808 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555644d10110 con 0x555644d10f70 2024-09-12T17:28:04.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.799+0000 7f7a84c4b640 1 -- 172.21.15.170:0/884089808 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7a78057030 con 0x555644d10f70 2024-09-12T17:28:04.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.799+0000 7f7a88f28800 1 Processor -- start 2024-09-12T17:28:04.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.800+0000 7f7a88f28800 1 -- start start 2024-09-12T17:28:04.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.800+0000 7f7a88f28800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555644c0fe30 0x555644c0e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.800+0000 7f7a88f28800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555644b06a00 con 0x555644c0fe30 2024-09-12T17:28:04.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.800+0000 7f7a8544c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555644c0fe30 0x555644c0e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.800+0000 7f7a8544c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555644c0fe30 0x555644c0e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43712/0 (socket says 172.21.15.170:43712) 2024-09-12T17:28:04.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.800+0000 7f7a8544c640 1 -- 172.21.15.170:0/4227491033 learned_addr learned my addr 172.21.15.170:0/4227491033 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:04.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.800+0000 7f7a8544c640 1 -- 172.21.15.170:0/4227491033 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555644c10350 con 0x555644c0fe30 2024-09-12T17:28:04.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.800+0000 7f7a8544c640 1 --2- 172.21.15.170:0/4227491033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555644c0fe30 0x555644c0e6a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x555644d08160 tx=0x7f7a800167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.801+0000 7f79697fa640 1 -- 172.21.15.170:0/4227491033 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a80013640 con 0x555644c0fe30 2024-09-12T17:28:04.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.801+0000 7f79697fa640 1 -- 172.21.15.170:0/4227491033 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a800137e0 con 0x555644c0fe30 2024-09-12T17:28:04.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.801+0000 7f7a88f28800 1 -- 172.21.15.170:0/4227491033 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555644c0ebe0 con 0x555644c0fe30 2024-09-12T17:28:04.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.801+0000 7f79697fa640 1 -- 172.21.15.170:0/4227491033 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a80013ae0 con 0x555644c0fe30 2024-09-12T17:28:04.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.801+0000 7f7a88f28800 1 -- 172.21.15.170:0/4227491033 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555644c0f180 con 0x555644c0fe30 2024-09-12T17:28:04.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.801+0000 7f79697fa640 1 -- 172.21.15.170:0/4227491033 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f7a80011040 con 0x555644c0fe30 2024-09-12T17:28:04.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.802+0000 7f79697fa640 1 --2- 172.21.15.170:0/4227491033 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f795c03c730 0x7f795c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.802+0000 7f79697fa640 1 -- 172.21.15.170:0/4227491033 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f7a8000e040 con 0x555644c0fe30 2024-09-12T17:28:04.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.802+0000 7f7a84c4b640 1 --2- 172.21.15.170:0/4227491033 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f795c03c730 0x7f795c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.802+0000 7f7a88f28800 1 Processor -- start 2024-09-12T17:28:04.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.802+0000 7f7a84c4b640 1 --2- 172.21.15.170:0/4227491033 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f795c03c730 0x7f795c03ebf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7a780655c0 tx=0x7f7a78065420 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.802+0000 7f7a88f28800 1 -- start start 2024-09-12T17:28:04.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.802+0000 7f7a88f28800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555644d31160 0x555644d31560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.802+0000 7f7a88f28800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555644cffea0 con 0x555644d31160 2024-09-12T17:28:04.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.802+0000 7f7a8544c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555644d31160 0x555644d31560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.802+0000 7f7a8544c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555644d31160 0x555644d31560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43716/0 (socket says 172.21.15.170:43716) 2024-09-12T17:28:04.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.802+0000 7f7a8544c640 1 -- 172.21.15.170:0/1717477709 learned_addr learned my addr 172.21.15.170:0/1717477709 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:04.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.803+0000 7f7a8544c640 1 -- 172.21.15.170:0/1717477709 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555644d31b50 con 0x555644d31160 2024-09-12T17:28:04.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.803+0000 7f7a8544c640 1 --2- 172.21.15.170:0/1717477709 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555644d31160 0x555644d31560 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7a80053cd0 tx=0x7f7a80014480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=557fccf31cd2f58a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.803+0000 7f7962ffd640 1 -- 172.21.15.170:0/1717477709 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a8004a070 con 0x555644d31160 2024-09-12T17:28:04.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.803+0000 7f7962ffd640 1 -- 172.21.15.170:0/1717477709 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a80055040 con 0x555644d31160 2024-09-12T17:28:04.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.803+0000 7f7962ffd640 1 -- 172.21.15.170:0/1717477709 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a8001f340 con 0x555644d31160 2024-09-12T17:28:04.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.803+0000 7f7a88f28800 1 -- 172.21.15.170:0/1717477709 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555644d31160 msgr2=0x555644d31560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.803+0000 7f7a88f28800 1 --2- 172.21.15.170:0/1717477709 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555644d31160 0x555644d31560 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7a80053cd0 tx=0x7f7a80014480 comp rx=0 tx=0).stop 2024-09-12T17:28:04.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.804+0000 7f7a88f28800 1 -- 172.21.15.170:0/1717477709 shutdown_connections 2024-09-12T17:28:04.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.804+0000 7f7a88f28800 1 --2- 172.21.15.170:0/1717477709 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555644d31160 0x555644d31560 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.804+0000 7f7a88f28800 1 -- 172.21.15.170:0/1717477709 >> 172.21.15.170:0/1717477709 conn(0x555644d2d580 msgr2=0x555644d2b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:04.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.804+0000 7f7a88f28800 1 -- 172.21.15.170:0/1717477709 shutdown_connections 2024-09-12T17:28:04.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.804+0000 7f7a88f28800 1 -- 172.21.15.170:0/1717477709 wait complete. 2024-09-12T17:28:04.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.804+0000 7f7a88f28800 1 Processor -- start 2024-09-12T17:28:04.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.804+0000 7f7a88f28800 1 -- start start 2024-09-12T17:28:04.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.804+0000 7f7a88f28800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555644d31160 0x555644d38790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.804+0000 7f7a88f28800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555644d32170 con 0x555644d31160 2024-09-12T17:28:04.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.804+0000 7f7a8544c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555644d31160 0x555644d38790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.804+0000 7f7a8544c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555644d31160 0x555644d38790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43728/0 (socket says 172.21.15.170:43728) 2024-09-12T17:28:04.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.804+0000 7f7a8544c640 1 -- 172.21.15.170:0/296568762 learned_addr learned my addr 172.21.15.170:0/296568762 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:04.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.804+0000 7f7a8544c640 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555644d38cf0 con 0x555644d31160 2024-09-12T17:28:04.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.805+0000 7f7a8544c640 1 --2- 172.21.15.170:0/296568762 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555644d31160 0x555644d38790 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7a800144c0 tx=0x7f7a80053d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.805+0000 7f79617fa640 1 -- 172.21.15.170:0/296568762 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a8004a040 con 0x555644d31160 2024-09-12T17:28:04.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.805+0000 7f79617fa640 1 -- 172.21.15.170:0/296568762 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a80013db0 con 0x555644d31160 2024-09-12T17:28:04.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.805+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555644d38f80 con 0x555644d31160 2024-09-12T17:28:04.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.805+0000 7f79617fa640 1 -- 172.21.15.170:0/296568762 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a800215b0 con 0x555644d31160 2024-09-12T17:28:04.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.805+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555644d39900 con 0x555644d31160 2024-09-12T17:28:04.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.805+0000 7f79617fa640 1 -- 172.21.15.170:0/296568762 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f7a8004d070 con 0x555644d31160 2024-09-12T17:28:04.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.806+0000 7f79617fa640 1 --2- 172.21.15.170:0/296568762 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f794c03c730 0x7f794c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.806+0000 7f79617fa640 1 -- 172.21.15.170:0/296568762 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f7a80034af0 con 0x555644d31160 2024-09-12T17:28:04.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.806+0000 7f7a84c4b640 1 --2- 172.21.15.170:0/296568762 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f794c03c730 0x7f794c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.806+0000 7f7a88f28800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.806+0000 7f7a88f28800 1 --2- 172.21.15.170:0/296568762 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x555644d44090 0x555644d46550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.806+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555644d46ca0 con 0x555644d44090 2024-09-12T17:28:04.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.806+0000 7f7a84c4b640 1 --2- 172.21.15.170:0/296568762 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f794c03c730 0x7f794c03ebf0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7a780933f0 tx=0x7f7a78085000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.806+0000 7f7a7ffff640 1 --2- 172.21.15.170:0/296568762 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x555644d44090 0x555644d46550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.807+0000 7f7a7ffff640 1 --2- 172.21.15.170:0/296568762 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x555644d44090 0x555644d46550 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.807+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a7000f610 con 0x555644d44090 2024-09-12T17:28:04.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.807+0000 7f7a88f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.807+0000 7f7a88f28800 20 realm 2024-09-12T17:28:04.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.807+0000 7f7a88f28800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.807+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555644d433e0 con 0x555644d44090 2024-09-12T17:28:04.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.807+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a7000f610 con 0x555644d44090 2024-09-12T17:28:04.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.807+0000 7f7a88f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.807+0000 7f7a88f28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:04.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.807+0000 7f7a88f28800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.807+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555644d47780 con 0x555644d44090 2024-09-12T17:28:04.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.807+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a7000f610 con 0x555644d44090 2024-09-12T17:28:04.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.807+0000 7f7a88f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.807+0000 7f7a88f28800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.807+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555644d48050 con 0x555644d44090 2024-09-12T17:28:04.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.807+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7a7000f610 con 0x555644d44090 2024-09-12T17:28:04.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.807+0000 7f7a88f28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:04.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.807+0000 7f7a88f28800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.808+0000 7f7a88f28800 1 --2- 172.21.15.170:0/296568762 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x555644d48990 0x555644d4ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.808+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555644d4b4c0 con 0x555644d48990 2024-09-12T17:28:04.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.808+0000 7f7a8544c640 1 --2- 172.21.15.170:0/296568762 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x555644d48990 0x555644d4ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.808+0000 7f7a8544c640 1 --2- 172.21.15.170:0/296568762 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x555644d48990 0x555644d4ad80 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.808+0000 7f7a8544c640 1 -- 172.21.15.170:0/296568762 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7a80039020 con 0x555644d48990 2024-09-12T17:28:04.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.808+0000 7f7a88f28800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:04.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.808+0000 7f7a88f28800 20 searching for the correct realm 2024-09-12T17:28:04.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.808+0000 7f7a88f28800 1 --2- 172.21.15.170:0/296568762 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x555644d4d540 0x555644d4fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.808+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555644d500d0 con 0x555644d4d540 2024-09-12T17:28:04.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.808+0000 7f7a84c4b640 1 --2- 172.21.15.170:0/296568762 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x555644d4d540 0x555644d4fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.809+0000 7f7a84c4b640 1 --2- 172.21.15.170:0/296568762 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x555644d4d540 0x555644d4fa00 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.809+0000 7f7a84c4b640 1 -- 172.21.15.170:0/296568762 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a78057030 con 0x555644d4d540 2024-09-12T17:28:04.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.809+0000 7f7a84c4b640 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555644d500d0 con 0x555644d48990 2024-09-12T17:28:04.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.809+0000 7f7a8544c640 1 -- 172.21.15.170:0/296568762 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a80039020 con 0x555644d48990 2024-09-12T17:28:04.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.809+0000 7f7a8544c640 1 --2- 172.21.15.170:0/296568762 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f7a800209e0 0x7f7a800569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.809+0000 7f7a8544c640 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555644d500d0 con 0x7f7a800209e0 2024-09-12T17:28:04.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.809+0000 7f7a7ffff640 1 --2- 172.21.15.170:0/296568762 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f7a800209e0 0x7f7a800569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.810+0000 7f7a7ffff640 1 --2- 172.21.15.170:0/296568762 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f7a800209e0 0x7f7a800569c0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.810+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a7000f610 con 0x7f7a800209e0 2024-09-12T17:28:04.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.810+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555644d500d0 con 0x555644d44090 2024-09-12T17:28:04.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.810+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a7000f610 con 0x555644d44090 2024-09-12T17:28:04.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.810+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555644d500d0 con 0x555644d44090 2024-09-12T17:28:04.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.811+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a7002b040 con 0x555644d44090 2024-09-12T17:28:04.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.811+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555644d500d0 con 0x7f7a800209e0 2024-09-12T17:28:04.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.811+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a7002b040 con 0x7f7a800209e0 2024-09-12T17:28:04.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.811+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555644d500d0 con 0x7f7a800209e0 2024-09-12T17:28:04.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.811+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a7002b040 con 0x7f7a800209e0 2024-09-12T17:28:04.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.811+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555644d500d0 con 0x555644d48990 2024-09-12T17:28:04.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.811+0000 7f7a8544c640 1 -- 172.21.15.170:0/296568762 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a80039020 con 0x555644d48990 2024-09-12T17:28:04.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.811+0000 7f7a8544c640 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555644d500d0 con 0x555644d4d540 2024-09-12T17:28:04.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.811+0000 7f7a84c4b640 1 -- 172.21.15.170:0/296568762 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a78057030 con 0x555644d4d540 2024-09-12T17:28:04.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.811+0000 7f7a84c4b640 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555644d500d0 con 0x555644d44090 2024-09-12T17:28:04.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.812+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a7002b040 con 0x555644d44090 2024-09-12T17:28:04.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.812+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555644d500d0 con 0x7f7a800209e0 2024-09-12T17:28:04.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.812+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a7002b040 con 0x7f7a800209e0 2024-09-12T17:28:04.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.812+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555644d500d0 con 0x555644d44090 2024-09-12T17:28:04.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.812+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a7002b040 con 0x555644d44090 2024-09-12T17:28:04.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.812+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555644d500d0 con 0x555644d48990 2024-09-12T17:28:04.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.812+0000 7f7a8544c640 1 -- 172.21.15.170:0/296568762 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f7a80039020 con 0x555644d48990 2024-09-12T17:28:04.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.812+0000 7f7a8544c640 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555644d500d0 con 0x555644d4d540 2024-09-12T17:28:04.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.813+0000 7f7a84c4b640 1 -- 172.21.15.170:0/296568762 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a78057030 con 0x555644d4d540 2024-09-12T17:28:04.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.813+0000 7f7a84c4b640 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555644d500d0 con 0x555644d4d540 2024-09-12T17:28:04.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.813+0000 7f7a84c4b640 1 -- 172.21.15.170:0/296568762 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a78057030 con 0x555644d4d540 2024-09-12T17:28:04.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.813+0000 7f7a84c4b640 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555644d500d0 con 0x7f7a800209e0 2024-09-12T17:28:04.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.813+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a7002b040 con 0x7f7a800209e0 2024-09-12T17:28:04.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.813+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555644d500d0 con 0x555644d4d540 2024-09-12T17:28:04.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.813+0000 7f7a84c4b640 1 -- 172.21.15.170:0/296568762 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a78057030 con 0x555644d4d540 2024-09-12T17:28:04.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.813+0000 7f7a84c4b640 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555644d500d0 con 0x555644d4d540 2024-09-12T17:28:04.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.813+0000 7f7a84c4b640 1 -- 172.21.15.170:0/296568762 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a78057030 con 0x555644d4d540 2024-09-12T17:28:04.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.813+0000 7f7a84c4b640 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555644d500d0 con 0x555644d44090 2024-09-12T17:28:04.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.814+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a7002b040 con 0x555644d44090 2024-09-12T17:28:04.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.814+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555644d500d0 con 0x555644d44090 2024-09-12T17:28:04.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.814+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7a7002b040 con 0x555644d44090 2024-09-12T17:28:04.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.814+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555644d500d0 con 0x7f7a800209e0 2024-09-12T17:28:04.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.814+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a7002b040 con 0x7f7a800209e0 2024-09-12T17:28:04.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.814+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555644d500d0 con 0x555644d4d540 2024-09-12T17:28:04.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.814+0000 7f7a84c4b640 1 -- 172.21.15.170:0/296568762 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a78057030 con 0x555644d4d540 2024-09-12T17:28:04.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.814+0000 7f7a84c4b640 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555644d500d0 con 0x555644d48990 2024-09-12T17:28:04.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.815+0000 7f7a8544c640 1 -- 172.21.15.170:0/296568762 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a80039020 con 0x555644d48990 2024-09-12T17:28:04.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.815+0000 7f7a8544c640 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555644d500d0 con 0x555644d44090 2024-09-12T17:28:04.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.815+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a7002b040 con 0x555644d44090 2024-09-12T17:28:04.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.815+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555644d500d0 con 0x7f7a800209e0 2024-09-12T17:28:04.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.815+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a7003b040 con 0x7f7a800209e0 2024-09-12T17:28:04.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.815+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555644d500d0 con 0x555644d4d540 2024-09-12T17:28:04.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.815+0000 7f7a84c4b640 1 -- 172.21.15.170:0/296568762 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a78057030 con 0x555644d4d540 2024-09-12T17:28:04.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.815+0000 7f7a84c4b640 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555644d500d0 con 0x7f7a800209e0 2024-09-12T17:28:04.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.816+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a7003b040 con 0x7f7a800209e0 2024-09-12T17:28:04.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.816+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555644d500d0 con 0x555644d48990 2024-09-12T17:28:04.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.816+0000 7f7a8544c640 1 -- 172.21.15.170:0/296568762 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a80039020 con 0x555644d48990 2024-09-12T17:28:04.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.816+0000 7f7a8544c640 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555644d500d0 con 0x555644d4d540 2024-09-12T17:28:04.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.816+0000 7f7a84c4b640 1 -- 172.21.15.170:0/296568762 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a78057030 con 0x555644d4d540 2024-09-12T17:28:04.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.816+0000 7f7a84c4b640 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555644d500d0 con 0x7f7a800209e0 2024-09-12T17:28:04.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.816+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a7003b040 con 0x7f7a800209e0 2024-09-12T17:28:04.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.816+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555644d500d0 con 0x555644d44090 2024-09-12T17:28:04.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.817+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7a7003b040 con 0x555644d44090 2024-09-12T17:28:04.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.817+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555644d500d0 con 0x555644d48990 2024-09-12T17:28:04.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.817+0000 7f7a8544c640 1 -- 172.21.15.170:0/296568762 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7a80039020 con 0x555644d48990 2024-09-12T17:28:04.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.817+0000 7f7a88f28800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:04.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.817+0000 7f7a88f28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:04.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.817+0000 7f7a88f28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:04.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.817+0000 7f7a88f28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:04.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.817+0000 7f7a88f28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:04.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.817+0000 7f7a88f28800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:04.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.817+0000 7f7a88f28800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.817+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555644d4bf40 con 0x555644d44090 2024-09-12T17:28:04.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.817+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a7003b040 con 0x555644d44090 2024-09-12T17:28:04.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.817+0000 7f7a88f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.817+0000 7f7a88f28800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.817+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555644d4bb50 con 0x555644d44090 2024-09-12T17:28:04.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.817+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7a7003b040 con 0x555644d44090 2024-09-12T17:28:04.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.817+0000 7f7a88f28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:04.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.817+0000 7f7a88f28800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.817+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555644d4c8b0 con 0x555644d48990 2024-09-12T17:28:04.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.818+0000 7f7a8544c640 1 -- 172.21.15.170:0/296568762 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7a80039020 con 0x555644d48990 2024-09-12T17:28:04.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.818+0000 7f7a88f28800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:04.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.818+0000 7f7a88f28800 20 zone default found 2024-09-12T17:28:04.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.818+0000 7f7a88f28800 4 Realm: () 2024-09-12T17:28:04.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.818+0000 7f7a88f28800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:04.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.818+0000 7f7a88f28800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:04.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.818+0000 7f7a88f28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:04.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.818+0000 7f7a88f28800 20 zonegroup default 2024-09-12T17:28:04.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.818+0000 7f7a88f28800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.818+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555644d4c440 con 0x7f7a800209e0 2024-09-12T17:28:04.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.818+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7a7003b040 con 0x7f7a800209e0 2024-09-12T17:28:04.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.818+0000 7f7a88f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.818+0000 7f7a88f28800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.818+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555644d52590 con 0x555644d4d540 2024-09-12T17:28:04.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.818+0000 7f7a84c4b640 1 -- 172.21.15.170:0/296568762 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7a78057030 con 0x555644d4d540 2024-09-12T17:28:04.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.818+0000 7f7a88f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.818+0000 7f7a88f28800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.818+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555644d529e0 con 0x555644d4d540 2024-09-12T17:28:04.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.818+0000 7f7a84c4b640 1 -- 172.21.15.170:0/296568762 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7a78057030 con 0x555644d4d540 2024-09-12T17:28:04.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.818+0000 7f7a88f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.818+0000 7f7a88f28800 20 started sync module instance, tier type = 2024-09-12T17:28:04.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.818+0000 7f7a88f28800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:04.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.818+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555644d51930 con 0x555644d48990 2024-09-12T17:28:04.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.820+0000 7f7a8544c640 1 -- 172.21.15.170:0/296568762 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a80039020 con 0x555644d48990 2024-09-12T17:28:04.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.820+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93829010365728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555644d532f0 con 0x555644d48990 2024-09-12T17:28:04.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.820+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555644d53b40 con 0x555644d44090 2024-09-12T17:28:04.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.820+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a7003b040 con 0x555644d44090 2024-09-12T17:28:04.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.821+0000 7f7a8544c640 1 -- 172.21.15.170:0/296568762 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93829010365728] v29'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a80039020 con 0x555644d48990 2024-09-12T17:28:04.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.821+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93829010371584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555644d53d90 con 0x555644d44090 2024-09-12T17:28:04.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.821+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555644d52e40 con 0x555644d4d540 2024-09-12T17:28:04.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.822+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93829010371584] v29'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a7003b040 con 0x555644d44090 2024-09-12T17:28:04.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.822+0000 7f7a84c4b640 1 -- 172.21.15.170:0/296568762 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a78057030 con 0x555644d4d540 2024-09-12T17:28:04.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.822+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93829010372640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555644d54800 con 0x555644d4d540 2024-09-12T17:28:04.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.822+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555644d551c0 con 0x555644d48990 2024-09-12T17:28:04.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.823+0000 7f7a84c4b640 1 -- 172.21.15.170:0/296568762 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93829010372640] v29'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a78057030 con 0x555644d4d540 2024-09-12T17:28:04.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.823+0000 7f7a8544c640 1 -- 172.21.15.170:0/296568762 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a80039020 con 0x555644d48990 2024-09-12T17:28:04.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.823+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93829010378000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555644d55130 con 0x555644d48990 2024-09-12T17:28:04.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.823+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555644d56080 con 0x555644d44090 2024-09-12T17:28:04.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.824+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a7003b040 con 0x555644d44090 2024-09-12T17:28:04.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.824+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93829010381776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555644d55ff0 con 0x555644d44090 2024-09-12T17:28:04.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.824+0000 7f7a8544c640 1 -- 172.21.15.170:0/296568762 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93829010378000] v29'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a80039020 con 0x555644d48990 2024-09-12T17:28:04.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.824+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555644d555b0 con 0x7f7a800209e0 2024-09-12T17:28:04.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.825+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93829010381776] v29'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a7003b040 con 0x555644d44090 2024-09-12T17:28:04.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.825+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a7003b040 con 0x7f7a800209e0 2024-09-12T17:28:04.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.825+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93829010383872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555644d555b0 con 0x7f7a800209e0 2024-09-12T17:28:04.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.825+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555644d57420 con 0x7f7a800209e0 2024-09-12T17:28:04.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.826+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93829010383872] v29'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a7003b040 con 0x7f7a800209e0 2024-09-12T17:28:04.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.826+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(56 notify.6 [create] v29'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a7003b040 con 0x7f7a800209e0 2024-09-12T17:28:04.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.826+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93829010385600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555644d57390 con 0x7f7a800209e0 2024-09-12T17:28:04.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.826+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555644d57df0 con 0x7f7a800209e0 2024-09-12T17:28:04.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.827+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(58 notify.7 [create] v29'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a7003b040 con 0x7f7a800209e0 2024-09-12T17:28:04.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.827+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93829010385600] v29'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a7003b040 con 0x7f7a800209e0 2024-09-12T17:28:04.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.827+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93829010389200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555644d57df0 con 0x7f7a800209e0 2024-09-12T17:28:04.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.827+0000 7f7a88f28800 20 add_watcher() i=0 2024-09-12T17:28:04.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.827+0000 7f7a88f28800 20 add_watcher() i=1 2024-09-12T17:28:04.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.827+0000 7f7a88f28800 20 add_watcher() i=2 2024-09-12T17:28:04.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.827+0000 7f7a88f28800 20 add_watcher() i=3 2024-09-12T17:28:04.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.827+0000 7f7a88f28800 20 add_watcher() i=4 2024-09-12T17:28:04.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.827+0000 7f7a88f28800 20 add_watcher() i=5 2024-09-12T17:28:04.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.827+0000 7f7a88f28800 20 add_watcher() i=6 2024-09-12T17:28:04.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.828+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93829010389200] v29'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a7003b040 con 0x7f7a800209e0 2024-09-12T17:28:04.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.828+0000 7f7a88f28800 20 add_watcher() i=7 2024-09-12T17:28:04.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.828+0000 7f7a88f28800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:04.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.828+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555644d56fa0 con 0x555644d44090 2024-09-12T17:28:04.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.828+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7a7003b040 con 0x555644d44090 2024-09-12T17:28:04.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.828+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93829010391312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555644d589e0 con 0x555644d44090 2024-09-12T17:28:04.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.829+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93829010391312] v29'130 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7a7003b040 con 0x555644d44090 2024-09-12T17:28:04.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.829+0000 7f7939fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:04.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.829+0000 7f7a88f28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:04.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.829+0000 7f7a88f28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:04.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.829+0000 7f7a88f28800 5 note: GC not initialized 2024-09-12T17:28:04.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.830+0000 7f7938fe1640 20 reqs_thread_entry: start 2024-09-12T17:28:04.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.830+0000 7f7a88f28800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:04.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.830+0000 7f7a88f28800 20 Filter name: none 2024-09-12T17:28:04.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.830+0000 7f78b27fc640 20 reqs_thread_entry: start 2024-09-12T17:28:04.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.830+0000 7f7a88f28800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.830+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555644d8dec0 con 0x555644d44090 2024-09-12T17:28:04.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.830+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 281+0+332 (crc 0 0 0) 0x7f7a7003b040 con 0x555644d44090 2024-09-12T17:28:04.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.830+0000 7f7a88f28800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:28:04.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.831+0000 7f7939fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:04.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.831+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93829010391312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555644d41160 con 0x555644d44090 2024-09-12T17:28:04.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.832+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93829010391312] v29'131 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7a7003b040 con 0x555644d44090 2024-09-12T17:28:04.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.832+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93829010365728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555644d8be30 con 0x555644d48990 2024-09-12T17:28:04.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.833+0000 7f7a8544c640 1 -- 172.21.15.170:0/296568762 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93829010365728] v29'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a80039020 con 0x555644d48990 2024-09-12T17:28:04.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.833+0000 7f7a88f28800 20 remove_watcher() i=0 2024-09-12T17:28:04.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.833+0000 7f7a88f28800 2 removed watcher, disabling cache 2024-09-12T17:28:04.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.833+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93829010371584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555644d8be30 con 0x555644d44090 2024-09-12T17:28:04.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.834+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93829010371584] v29'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a7003b040 con 0x555644d44090 2024-09-12T17:28:04.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.834+0000 7f7a88f28800 20 remove_watcher() i=1 2024-09-12T17:28:04.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.834+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93829010372640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555644d8be30 con 0x555644d4d540 2024-09-12T17:28:04.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.835+0000 7f7a84c4b640 1 -- 172.21.15.170:0/296568762 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93829010372640] v29'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a78057030 con 0x555644d4d540 2024-09-12T17:28:04.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.835+0000 7f7a88f28800 20 remove_watcher() i=2 2024-09-12T17:28:04.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.835+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93829010378000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555644d51d20 con 0x555644d48990 2024-09-12T17:28:04.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.836+0000 7f7a8544c640 1 -- 172.21.15.170:0/296568762 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93829010378000] v29'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a80039020 con 0x555644d48990 2024-09-12T17:28:04.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.836+0000 7f7a88f28800 20 remove_watcher() i=3 2024-09-12T17:28:04.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.836+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93829010381776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555644d538b0 con 0x555644d44090 2024-09-12T17:28:04.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.837+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93829010381776] v29'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a7003b040 con 0x555644d44090 2024-09-12T17:28:04.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.837+0000 7f7a88f28800 20 remove_watcher() i=4 2024-09-12T17:28:04.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.837+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93829010383872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555644d538b0 con 0x7f7a800209e0 2024-09-12T17:28:04.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.838+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93829010383872] v29'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a7003b040 con 0x7f7a800209e0 2024-09-12T17:28:04.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.838+0000 7f7a88f28800 20 remove_watcher() i=5 2024-09-12T17:28:04.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.838+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93829010385600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555644d538b0 con 0x7f7a800209e0 2024-09-12T17:28:04.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.839+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93829010385600] v29'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a7003b040 con 0x7f7a800209e0 2024-09-12T17:28:04.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.839+0000 7f7a88f28800 20 remove_watcher() i=6 2024-09-12T17:28:04.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.839+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93829010389200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555644d51d20 con 0x7f7a800209e0 2024-09-12T17:28:04.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.840+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93829010389200] v29'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a7003b040 con 0x7f7a800209e0 2024-09-12T17:28:04.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.840+0000 7f7a88f28800 20 remove_watcher() i=7 2024-09-12T17:28:04.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.840+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f7a800209e0 msgr2=0x7f7a800569c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.840+0000 7f7a88f28800 1 --2- 172.21.15.170:0/296568762 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f7a800209e0 0x7f7a800569c0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.840+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x555644d44090 msgr2=0x555644d46550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.840+0000 7f7a88f28800 1 --2- 172.21.15.170:0/296568762 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x555644d44090 0x555644d46550 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.840+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x555644d48990 msgr2=0x555644d4ad80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.840+0000 7f7a88f28800 1 --2- 172.21.15.170:0/296568762 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x555644d48990 0x555644d4ad80 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.840+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x555644d4d540 msgr2=0x555644d4fa00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.840+0000 7f7a88f28800 1 --2- 172.21.15.170:0/296568762 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x555644d4d540 0x555644d4fa00 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.840+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f794c03c730 msgr2=0x7f794c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.840+0000 7f7a88f28800 1 --2- 172.21.15.170:0/296568762 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f794c03c730 0x7f794c03ebf0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7a780933f0 tx=0x7f7a78085000 comp rx=0 tx=0).stop 2024-09-12T17:28:04.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.840+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555644d31160 msgr2=0x555644d38790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.840+0000 7f7a7ffff640 1 -- 172.21.15.170:0/296568762 reap_dead start 2024-09-12T17:28:04.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.840+0000 7f7a88f28800 1 --2- 172.21.15.170:0/296568762 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555644d31160 0x555644d38790 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7a800144c0 tx=0x7f7a80053d00 comp rx=0 tx=0).stop 2024-09-12T17:28:04.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.840+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 shutdown_connections 2024-09-12T17:28:04.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.840+0000 7f7a88f28800 1 --2- 172.21.15.170:0/296568762 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555644d31160 0x555644d38790 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.840+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 >> 172.21.15.170:0/296568762 conn(0x555644d2d580 msgr2=0x555644d2b790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:04.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.841+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 shutdown_connections 2024-09-12T17:28:04.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.841+0000 7f7a88f28800 1 -- 172.21.15.170:0/296568762 wait complete. 2024-09-12T17:28:04.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.841+0000 7f7a88f28800 1 -- 172.21.15.170:0/4227491033 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f795c03c730 msgr2=0x7f795c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.841+0000 7f7a88f28800 1 --2- 172.21.15.170:0/4227491033 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f795c03c730 0x7f795c03ebf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7a780655c0 tx=0x7f7a78065420 comp rx=0 tx=0).stop 2024-09-12T17:28:04.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.841+0000 7f7a88f28800 1 -- 172.21.15.170:0/4227491033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555644c0fe30 msgr2=0x555644c0e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.841+0000 7f7a88f28800 1 --2- 172.21.15.170:0/4227491033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555644c0fe30 0x555644c0e6a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x555644d08160 tx=0x7f7a800167b0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.841+0000 7f7a88f28800 1 -- 172.21.15.170:0/4227491033 shutdown_connections 2024-09-12T17:28:04.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.841+0000 7f7a88f28800 1 --2- 172.21.15.170:0/4227491033 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f795c03c730 0x7f795c03ebf0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.841+0000 7f7a88f28800 1 --2- 172.21.15.170:0/4227491033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555644c0fe30 0x555644c0e6a0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.841+0000 7f7a88f28800 1 -- 172.21.15.170:0/4227491033 >> 172.21.15.170:0/4227491033 conn(0x555644d16800 msgr2=0x555644d16be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:04.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.841+0000 7f7a88f28800 1 -- 172.21.15.170:0/4227491033 shutdown_connections 2024-09-12T17:28:04.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.841+0000 7f7a88f28800 1 -- 172.21.15.170:0/4227491033 wait complete. 2024-09-12T17:28:04.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.841+0000 7f7a88f28800 1 -- 172.21.15.170:0/884089808 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x555644d0c7a0 msgr2=0x555644d0eb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.841+0000 7f7a88f28800 1 --2- 172.21.15.170:0/884089808 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x555644d0c7a0 0x555644d0eb90 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.841+0000 7f7a88f28800 1 -- 172.21.15.170:0/884089808 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x555644d10f70 msgr2=0x555644d13410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.841+0000 7f7a88f28800 1 --2- 172.21.15.170:0/884089808 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x555644d10f70 0x555644d13410 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.841+0000 7f7a88f28800 1 -- 172.21.15.170:0/884089808 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f796c03c780 msgr2=0x7f796c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.841+0000 7f7a88f28800 1 --2- 172.21.15.170:0/884089808 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f796c03c780 0x7f796c03ec40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7a70001e30 tx=0x7f7a70001390 comp rx=0 tx=0).stop 2024-09-12T17:28:04.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.841+0000 7f7a88f28800 1 -- 172.21.15.170:0/884089808 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555644c13000 msgr2=0x555644d07160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.841+0000 7f7a88f28800 1 --2- 172.21.15.170:0/884089808 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555644c13000 0x555644d07160 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7a780460d0 tx=0x7f7a78002fb0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.841+0000 7f7a88f28800 1 -- 172.21.15.170:0/884089808 shutdown_connections 2024-09-12T17:28:04.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.841+0000 7f7a88f28800 1 --2- 172.21.15.170:0/884089808 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x555644d10f70 0x555644d13410 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.841+0000 7f7a88f28800 1 --2- 172.21.15.170:0/884089808 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f796c03c780 0x7f796c03ec40 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.841+0000 7f7a88f28800 1 --2- 172.21.15.170:0/884089808 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x555644d0c7a0 0x555644d0eb90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.841+0000 7f7a88f28800 1 --2- 172.21.15.170:0/884089808 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555644c13000 0x555644d07160 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.841+0000 7f7a88f28800 1 -- 172.21.15.170:0/884089808 >> 172.21.15.170:0/884089808 conn(0x555644c0a1b0 msgr2=0x555644d00910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:04.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.842+0000 7f7a88f28800 1 -- 172.21.15.170:0/884089808 shutdown_connections 2024-09-12T17:28:04.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.842+0000 7f7a88f28800 1 -- 172.21.15.170:0/884089808 wait complete. 2024-09-12T17:28:04.855 INFO:teuthology.orchestra.run.smithi170.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"MDcPidUpSoVFWzwbCudVqxsv","ver":2},"mtime":"2024-09-12T17:28:04.691572Z","data":{"bucket":{"name":"myfoo","marker":"7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1","bucket_id":"7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-09-12T17:28:02.189371Z","linked":true,"has_bucket_info":false}} 2024-09-12T17:28:04.856 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': 'MDcPidUpSoVFWzwbCudVqxsv', 'ver': 2}, 'mtime': '2024-09-12T17:28:04.691572Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1', 'bucket_id': '7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-09-12T17:28:02.189371Z', 'linked': True, 'has_bucket_info': False}} 2024-09-12T17:28:04.856 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-12T17:28:04.856 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-12T17:28:04.856 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-09-12T17:28:04.906 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:04.906 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:04.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.901+0000 7f683031f800 1 Processor -- start 2024-09-12T17:28:04.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.901+0000 7f683031f800 1 -- start start 2024-09-12T17:28:04.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.901+0000 7f683031f800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5646cad68fd0 0x5646cad71af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.901+0000 7f683031f800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5646cac12e40 con 0x5646cad674b0 2024-09-12T17:28:04.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.901+0000 7f683031f800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x5646cabdd680 con 0x5646cad68fd0 2024-09-12T17:28:04.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.902+0000 7f682b8a1640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5646cad68fd0 0x5646cad71af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.902+0000 7f682b8a1640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5646cad68fd0 0x5646cad71af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43744/0 (socket says 172.21.15.170:43744) 2024-09-12T17:28:04.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.902+0000 7f682c0a2640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x5646cad674b0 0x5646cad678b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:37020/0 (socket says 172.21.15.170:37020) 2024-09-12T17:28:04.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.902+0000 7f682b8a1640 1 -- 172.21.15.170:0/3024752888 learned_addr learned my addr 172.21.15.170:0/3024752888 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:04.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.902+0000 7f682b8a1640 1 -- 172.21.15.170:0/3024752888 >> v1:172.21.15.47:6789/0 conn(0x5646cad674b0 legacy=0x5646cad678b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.902+0000 7f682b8a1640 1 -- 172.21.15.170:0/3024752888 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646cabf96b0 con 0x5646cad68fd0 2024-09-12T17:28:04.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.904+0000 7f682b8a1640 1 --2- 172.21.15.170:0/3024752888 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5646cad68fd0 0x5646cad71af0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f681400a520 tx=0x7f6814045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c7319135f1c0209 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.904+0000 7f682b0a0640 1 -- 172.21.15.170:0/3024752888 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6814055070 con 0x5646cad68fd0 2024-09-12T17:28:04.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.904+0000 7f682b0a0640 1 -- 172.21.15.170:0/3024752888 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68140515b0 con 0x5646cad68fd0 2024-09-12T17:28:04.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.904+0000 7f682b0a0640 1 -- 172.21.15.170:0/3024752888 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68140518d0 con 0x5646cad68fd0 2024-09-12T17:28:04.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.904+0000 7f683031f800 1 -- 172.21.15.170:0/3024752888 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5646cad68fd0 msgr2=0x5646cad71af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.904+0000 7f683031f800 1 --2- 172.21.15.170:0/3024752888 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5646cad68fd0 0x5646cad71af0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f681400a520 tx=0x7f6814045ba0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.904+0000 7f683031f800 1 -- 172.21.15.170:0/3024752888 shutdown_connections 2024-09-12T17:28:04.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.904+0000 7f683031f800 1 --2- 172.21.15.170:0/3024752888 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5646cad68fd0 0x5646cad71af0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.904+0000 7f683031f800 1 -- 172.21.15.170:0/3024752888 >> 172.21.15.170:0/3024752888 conn(0x5646cad63200 msgr2=0x5646cad65640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:04.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.904+0000 7f683031f800 1 -- 172.21.15.170:0/3024752888 shutdown_connections 2024-09-12T17:28:04.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.904+0000 7f683031f800 1 -- 172.21.15.170:0/3024752888 wait complete. 2024-09-12T17:28:04.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.918+0000 7f683031f800 1 Processor -- start 2024-09-12T17:28:04.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.918+0000 7f683031f800 1 -- start start 2024-09-12T17:28:04.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.918+0000 7f683031f800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5646cad674b0 0x5646cae5a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.918+0000 7f683031f800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5646cac01dd0 con 0x5646cad674b0 2024-09-12T17:28:04.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.919+0000 7f682c0a2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5646cad674b0 0x5646cae5a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.919+0000 7f682c0a2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5646cad674b0 0x5646cae5a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43760/0 (socket says 172.21.15.170:43760) 2024-09-12T17:28:04.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.919+0000 7f682c0a2640 1 -- 172.21.15.170:0/972283272 learned_addr learned my addr 172.21.15.170:0/972283272 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:04.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.919+0000 7f682c0a2640 1 -- 172.21.15.170:0/972283272 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646cac1ae10 con 0x5646cad674b0 2024-09-12T17:28:04.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.919+0000 7f682c0a2640 1 --2- 172.21.15.170:0/972283272 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5646cad674b0 0x5646cae5a810 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f681c0016e0 tx=0x7f681c001ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cb11488c8b31e38 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.919+0000 7f671a60c640 1 -- 172.21.15.170:0/972283272 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f681c013420 con 0x5646cad674b0 2024-09-12T17:28:04.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.919+0000 7f671a60c640 1 -- 172.21.15.170:0/972283272 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f681c0135e0 con 0x5646cad674b0 2024-09-12T17:28:04.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.919+0000 7f671a60c640 1 -- 172.21.15.170:0/972283272 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f681c013900 con 0x5646cad674b0 2024-09-12T17:28:04.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.920+0000 7f683031f800 1 -- 172.21.15.170:0/972283272 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5646cad674b0 msgr2=0x5646cae5a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.920+0000 7f683031f800 1 --2- 172.21.15.170:0/972283272 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5646cad674b0 0x5646cae5a810 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f681c0016e0 tx=0x7f681c001ba0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.920+0000 7f683031f800 1 -- 172.21.15.170:0/972283272 shutdown_connections 2024-09-12T17:28:04.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.920+0000 7f683031f800 1 --2- 172.21.15.170:0/972283272 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5646cad674b0 0x5646cae5a810 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.920+0000 7f683031f800 1 -- 172.21.15.170:0/972283272 >> 172.21.15.170:0/972283272 conn(0x5646cad63200 msgr2=0x5646cae56190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:04.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.920+0000 7f683031f800 1 -- 172.21.15.170:0/972283272 shutdown_connections 2024-09-12T17:28:04.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.920+0000 7f683031f800 1 -- 172.21.15.170:0/972283272 wait complete. 2024-09-12T17:28:04.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.920+0000 7f683031f800 1 Processor -- start 2024-09-12T17:28:04.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.920+0000 7f683031f800 1 -- start start 2024-09-12T17:28:04.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.921+0000 7f683031f800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5646cad674b0 0x5646cae621a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.921+0000 7f683031f800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5646cad72300 con 0x5646cad674b0 2024-09-12T17:28:04.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.921+0000 7f682c0a2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5646cad674b0 0x5646cae621a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.921+0000 7f682c0a2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5646cad674b0 0x5646cae621a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43766/0 (socket says 172.21.15.170:43766) 2024-09-12T17:28:04.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.921+0000 7f682c0a2640 1 -- 172.21.15.170:0/1026137116 learned_addr learned my addr 172.21.15.170:0/1026137116 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:04.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.921+0000 7f682c0a2640 1 -- 172.21.15.170:0/1026137116 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646cae62700 con 0x5646cad674b0 2024-09-12T17:28:04.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.921+0000 7f682c0a2640 1 --2- 172.21.15.170:0/1026137116 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5646cad674b0 0x5646cae621a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f681c000f80 tx=0x7f681c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.921+0000 7f6718e09640 1 -- 172.21.15.170:0/1026137116 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f681c022020 con 0x5646cad674b0 2024-09-12T17:28:04.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.921+0000 7f6718e09640 1 -- 172.21.15.170:0/1026137116 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f681c006810 con 0x5646cad674b0 2024-09-12T17:28:04.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.921+0000 7f6718e09640 1 -- 172.21.15.170:0/1026137116 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f681c004ae0 con 0x5646cad674b0 2024-09-12T17:28:04.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.921+0000 7f683031f800 1 -- 172.21.15.170:0/1026137116 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5646cae62990 con 0x5646cad674b0 2024-09-12T17:28:04.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.921+0000 7f683031f800 1 -- 172.21.15.170:0/1026137116 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646cae63390 con 0x5646cad674b0 2024-09-12T17:28:04.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.922+0000 7f6718e09640 1 -- 172.21.15.170:0/1026137116 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f681c025020 con 0x5646cad674b0 2024-09-12T17:28:04.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.922+0000 7f6718e09640 1 --2- 172.21.15.170:0/1026137116 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f671403c730 0x7f671403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.922+0000 7f6718e09640 1 -- 172.21.15.170:0/1026137116 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f681c018030 con 0x5646cad674b0 2024-09-12T17:28:04.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.923+0000 7f682b8a1640 1 --2- 172.21.15.170:0/1026137116 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f671403c730 0x7f671403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.923+0000 7f683031f800 1 --2- 172.21.15.170:0/1026137116 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5646cad68fd0 0x5646cae697f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.923+0000 7f683031f800 1 -- 172.21.15.170:0/1026137116 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5646cae69d30 con 0x5646cad68fd0 2024-09-12T17:28:04.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.923+0000 7f682c8a3640 1 --2- 172.21.15.170:0/1026137116 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5646cad68fd0 0x5646cae697f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.923+0000 7f682b8a1640 1 --2- 172.21.15.170:0/1026137116 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f671403c730 0x7f671403ebf0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6814057000 tx=0x7f6814052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.923+0000 7f682c8a3640 1 --2- 172.21.15.170:0/1026137116 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5646cad68fd0 0x5646cae697f0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.923+0000 7f682c8a3640 1 -- 172.21.15.170:0/1026137116 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68240083e0 con 0x5646cad68fd0 2024-09-12T17:28:04.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.923+0000 7f683031f800 1 -- 172.21.15.170:0/1026137116 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5646cae6a0d0 con 0x5646cad68fd0 2024-09-12T17:28:04.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.924+0000 7f682c8a3640 1 -- 172.21.15.170:0/1026137116 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f68240083e0 con 0x5646cad68fd0 2024-09-12T17:28:04.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.924+0000 7f683031f800 1 --2- 172.21.15.170:0/1026137116 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5646cae6bbd0 0x5646cae6e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.924+0000 7f683031f800 1 -- 172.21.15.170:0/1026137116 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5646cae6e7e0 con 0x5646cae6bbd0 2024-09-12T17:28:04.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.924+0000 7f682c0a2640 1 --2- 172.21.15.170:0/1026137116 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5646cae6bbd0 0x5646cae6e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.924+0000 7f682c0a2640 1 --2- 172.21.15.170:0/1026137116 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5646cae6bbd0 0x5646cae6e050 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.924+0000 7f682c0a2640 1 -- 172.21.15.170:0/1026137116 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f681c01b070 con 0x5646cae6bbd0 2024-09-12T17:28:04.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.924+0000 7f683031f800 1 -- 172.21.15.170:0/1026137116 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5646cae6a920 con 0x5646cad68fd0 2024-09-12T17:28:04.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.925+0000 7f682c8a3640 1 -- 172.21.15.170:0/1026137116 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f68240083e0 con 0x5646cad68fd0 2024-09-12T17:28:04.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.925+0000 7f683031f800 1 -- 172.21.15.170:0/1026137116 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5646cae6ad70 con 0x5646cae6bbd0 2024-09-12T17:28:04.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.925+0000 7f682c0a2640 1 -- 172.21.15.170:0/1026137116 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f681c01b070 con 0x5646cae6bbd0 2024-09-12T17:28:04.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.925+0000 7f683031f800 1 Processor -- start 2024-09-12T17:28:04.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.925+0000 7f683031f800 1 -- start start 2024-09-12T17:28:04.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.925+0000 7f683031f800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5646cae7d0d0 0x5646cae7d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.925+0000 7f683031f800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5646cac5fa00 con 0x5646cae7d0d0 2024-09-12T17:28:04.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.926+0000 7f682c8a3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5646cae7d0d0 0x5646cae7d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.926+0000 7f682c8a3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5646cae7d0d0 0x5646cae7d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43778/0 (socket says 172.21.15.170:43778) 2024-09-12T17:28:04.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.926+0000 7f682c8a3640 1 -- 172.21.15.170:0/2949430443 learned_addr learned my addr 172.21.15.170:0/2949430443 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:04.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.926+0000 7f682c8a3640 1 -- 172.21.15.170:0/2949430443 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646cae7db30 con 0x5646cae7d0d0 2024-09-12T17:28:04.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.926+0000 7f682c8a3640 1 --2- 172.21.15.170:0/2949430443 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5646cae7d0d0 0x5646cae7d4f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x5646cae631a0 tx=0x7f682400bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.926+0000 7f6711ffb640 1 -- 172.21.15.170:0/2949430443 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f682401c020 con 0x5646cae7d0d0 2024-09-12T17:28:04.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.926+0000 7f6711ffb640 1 -- 172.21.15.170:0/2949430443 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6824007c90 con 0x5646cae7d0d0 2024-09-12T17:28:04.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.926+0000 7f683031f800 1 -- 172.21.15.170:0/2949430443 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5646cae7e360 con 0x5646cae7d0d0 2024-09-12T17:28:04.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.926+0000 7f6711ffb640 1 -- 172.21.15.170:0/2949430443 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6824018440 con 0x5646cae7d0d0 2024-09-12T17:28:04.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.926+0000 7f683031f800 1 -- 172.21.15.170:0/2949430443 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646cae7e900 con 0x5646cae7d0d0 2024-09-12T17:28:04.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.927+0000 7f6711ffb640 1 -- 172.21.15.170:0/2949430443 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f682401f020 con 0x5646cae7d0d0 2024-09-12T17:28:04.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.927+0000 7f6711ffb640 1 --2- 172.21.15.170:0/2949430443 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f670403c730 0x7f670403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.928+0000 7f6711ffb640 1 -- 172.21.15.170:0/2949430443 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f6824054d80 con 0x5646cae7d0d0 2024-09-12T17:28:04.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.928+0000 7f682c0a2640 1 --2- 172.21.15.170:0/2949430443 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f670403c730 0x7f670403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.928+0000 7f683031f800 1 Processor -- start 2024-09-12T17:28:04.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.928+0000 7f682c0a2640 1 --2- 172.21.15.170:0/2949430443 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f670403c730 0x7f670403ebf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x5646cae6acc0 tx=0x7f681c018f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.928+0000 7f683031f800 1 -- start start 2024-09-12T17:28:04.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.928+0000 7f683031f800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5646cae89b90 0x5646cae89f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.928+0000 7f683031f800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5646cae5b060 con 0x5646cae89b90 2024-09-12T17:28:04.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.928+0000 7f682c8a3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5646cae89b90 0x5646cae89f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.928+0000 7f682c8a3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5646cae89b90 0x5646cae89f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43790/0 (socket says 172.21.15.170:43790) 2024-09-12T17:28:04.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.928+0000 7f682c8a3640 1 -- 172.21.15.170:0/4049332389 learned_addr learned my addr 172.21.15.170:0/4049332389 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:04.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.929+0000 7f682c8a3640 1 -- 172.21.15.170:0/4049332389 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646cae8a580 con 0x5646cae89b90 2024-09-12T17:28:04.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.929+0000 7f682c8a3640 1 --2- 172.21.15.170:0/4049332389 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5646cae89b90 0x5646cae89f90 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f68240532d0 tx=0x7f68240158b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bce00e23400e99e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.929+0000 7f670b7fe640 1 -- 172.21.15.170:0/4049332389 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6824050020 con 0x5646cae89b90 2024-09-12T17:28:04.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.929+0000 7f670b7fe640 1 -- 172.21.15.170:0/4049332389 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6824015e70 con 0x5646cae89b90 2024-09-12T17:28:04.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.929+0000 7f670b7fe640 1 -- 172.21.15.170:0/4049332389 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68240174d0 con 0x5646cae89b90 2024-09-12T17:28:04.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.929+0000 7f683031f800 1 -- 172.21.15.170:0/4049332389 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5646cae89b90 msgr2=0x5646cae89f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.929+0000 7f683031f800 1 --2- 172.21.15.170:0/4049332389 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5646cae89b90 0x5646cae89f90 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f68240532d0 tx=0x7f68240158b0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.929+0000 7f683031f800 1 -- 172.21.15.170:0/4049332389 shutdown_connections 2024-09-12T17:28:04.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.929+0000 7f683031f800 1 --2- 172.21.15.170:0/4049332389 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5646cae89b90 0x5646cae89f90 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.929+0000 7f683031f800 1 -- 172.21.15.170:0/4049332389 >> 172.21.15.170:0/4049332389 conn(0x5646cae85f90 msgr2=0x5646cae841d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:04.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.929+0000 7f683031f800 1 -- 172.21.15.170:0/4049332389 shutdown_connections 2024-09-12T17:28:04.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.929+0000 7f683031f800 1 -- 172.21.15.170:0/4049332389 wait complete. 2024-09-12T17:28:04.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.930+0000 7f683031f800 1 Processor -- start 2024-09-12T17:28:04.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.930+0000 7f683031f800 1 -- start start 2024-09-12T17:28:04.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.930+0000 7f683031f800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5646cae89b90 0x5646cae91100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.930+0000 7f683031f800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5646cae8aba0 con 0x5646cae89b90 2024-09-12T17:28:04.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.930+0000 7f682c8a3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5646cae89b90 0x5646cae91100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.930+0000 7f682c8a3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5646cae89b90 0x5646cae91100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43804/0 (socket says 172.21.15.170:43804) 2024-09-12T17:28:04.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.930+0000 7f682c8a3640 1 -- 172.21.15.170:0/3001891706 learned_addr learned my addr 172.21.15.170:0/3001891706 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:04.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.930+0000 7f682c8a3640 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646cae91660 con 0x5646cae89b90 2024-09-12T17:28:04.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.931+0000 7f682c8a3640 1 --2- 172.21.15.170:0/3001891706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5646cae89b90 0x5646cae91100 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f68240154a0 tx=0x7f6824053230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.931+0000 7f6709ffb640 1 -- 172.21.15.170:0/3001891706 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f682404a040 con 0x5646cae89b90 2024-09-12T17:28:04.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.931+0000 7f6709ffb640 1 -- 172.21.15.170:0/3001891706 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6824016c50 con 0x5646cae89b90 2024-09-12T17:28:04.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.931+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5646cae918f0 con 0x5646cae89b90 2024-09-12T17:28:04.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.931+0000 7f6709ffb640 1 -- 172.21.15.170:0/3001891706 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f682400b030 con 0x5646cae89b90 2024-09-12T17:28:04.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.931+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646cae92270 con 0x5646cae89b90 2024-09-12T17:28:04.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.931+0000 7f6709ffb640 1 -- 172.21.15.170:0/3001891706 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f6824033020 con 0x5646cae89b90 2024-09-12T17:28:04.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.932+0000 7f6709ffb640 1 --2- 172.21.15.170:0/3001891706 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f66fc03c780 0x7f66fc03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.932+0000 7f6709ffb640 1 -- 172.21.15.170:0/3001891706 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f6824031020 con 0x5646cae89b90 2024-09-12T17:28:04.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.932+0000 7f682c0a2640 1 --2- 172.21.15.170:0/3001891706 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f66fc03c780 0x7f66fc03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.932+0000 7f682c0a2640 1 --2- 172.21.15.170:0/3001891706 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f66fc03c780 0x7f66fc03ec40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f681c01d850 tx=0x7f681c045000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.932+0000 7f683031f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.932+0000 7f683031f800 1 --2- 172.21.15.170:0/3001891706 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5646cae9ca40 0x5646cae9ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.932+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5646cae9f650 con 0x5646cae9ca40 2024-09-12T17:28:04.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.932+0000 7f682b8a1640 1 --2- 172.21.15.170:0/3001891706 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5646cae9ca40 0x5646cae9ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.933+0000 7f682b8a1640 1 --2- 172.21.15.170:0/3001891706 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5646cae9ca40 0x5646cae9ef00 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.933+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6814057030 con 0x5646cae9ca40 2024-09-12T17:28:04.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.933+0000 7f683031f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.933+0000 7f683031f800 20 realm 2024-09-12T17:28:04.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.933+0000 7f683031f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.933+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5646cae9fa80 con 0x5646cae9ca40 2024-09-12T17:28:04.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.933+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6814057030 con 0x5646cae9ca40 2024-09-12T17:28:04.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.933+0000 7f683031f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.933+0000 7f683031f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:04.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.933+0000 7f683031f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.933+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5646caea0350 con 0x5646cae9ca40 2024-09-12T17:28:04.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.933+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6814057030 con 0x5646cae9ca40 2024-09-12T17:28:04.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.934+0000 7f683031f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.934+0000 7f683031f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.934+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5646caea06f0 con 0x5646cae9ca40 2024-09-12T17:28:04.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.934+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6814057030 con 0x5646cae9ca40 2024-09-12T17:28:04.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.934+0000 7f683031f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:04.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.934+0000 7f683031f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.934+0000 7f683031f800 1 --2- 172.21.15.170:0/3001891706 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5646caea1450 0x5646caea3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.934+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5646caea3e50 con 0x5646caea1450 2024-09-12T17:28:04.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.934+0000 7f682c8a3640 1 --2- 172.21.15.170:0/3001891706 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5646caea1450 0x5646caea3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.934+0000 7f682c8a3640 1 --2- 172.21.15.170:0/3001891706 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5646caea1450 0x5646caea3840 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.934+0000 7f682c8a3640 1 -- 172.21.15.170:0/3001891706 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f68240083e0 con 0x5646caea1450 2024-09-12T17:28:04.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.934+0000 7f683031f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:04.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.934+0000 7f683031f800 20 searching for the correct realm 2024-09-12T17:28:04.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.934+0000 7f683031f800 1 --2- 172.21.15.170:0/3001891706 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5646caea5e20 0x5646caea82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.934+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5646caea8960 con 0x5646caea5e20 2024-09-12T17:28:04.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.935+0000 7f682c0a2640 1 --2- 172.21.15.170:0/3001891706 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5646caea5e20 0x5646caea82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.935+0000 7f682c0a2640 1 --2- 172.21.15.170:0/3001891706 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5646caea5e20 0x5646caea82e0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.935+0000 7f682c0a2640 1 -- 172.21.15.170:0/3001891706 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f681c01b070 con 0x5646caea5e20 2024-09-12T17:28:04.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.935+0000 7f682c0a2640 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5646caea8960 con 0x5646caea1450 2024-09-12T17:28:04.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.935+0000 7f682c8a3640 1 -- 172.21.15.170:0/3001891706 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68240083e0 con 0x5646caea1450 2024-09-12T17:28:04.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.935+0000 7f682c8a3640 1 --2- 172.21.15.170:0/3001891706 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f6824021020 0x7f682400a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:04.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.935+0000 7f682c8a3640 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5646caea8960 con 0x7f6824021020 2024-09-12T17:28:04.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.936+0000 7f682b8a1640 1 --2- 172.21.15.170:0/3001891706 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f6824021020 0x7f682400a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:04.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.936+0000 7f682b8a1640 1 --2- 172.21.15.170:0/3001891706 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f6824021020 0x7f682400a980 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:04.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.937+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6814057030 con 0x7f6824021020 2024-09-12T17:28:04.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.937+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5646caea8960 con 0x5646cae9ca40 2024-09-12T17:28:04.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.937+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6814057030 con 0x5646cae9ca40 2024-09-12T17:28:04.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.937+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5646caea8960 con 0x5646cae9ca40 2024-09-12T17:28:04.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.937+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6814057030 con 0x5646cae9ca40 2024-09-12T17:28:04.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.937+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5646caea8960 con 0x7f6824021020 2024-09-12T17:28:04.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.937+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6814057030 con 0x7f6824021020 2024-09-12T17:28:04.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.937+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5646caea8960 con 0x7f6824021020 2024-09-12T17:28:04.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.937+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6814057030 con 0x7f6824021020 2024-09-12T17:28:04.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.937+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5646caea8960 con 0x5646caea1450 2024-09-12T17:28:04.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.938+0000 7f682c8a3640 1 -- 172.21.15.170:0/3001891706 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68240083e0 con 0x5646caea1450 2024-09-12T17:28:04.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.938+0000 7f682c8a3640 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5646caea8960 con 0x5646caea5e20 2024-09-12T17:28:04.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.938+0000 7f682c0a2640 1 -- 172.21.15.170:0/3001891706 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f681c01b070 con 0x5646caea5e20 2024-09-12T17:28:04.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.938+0000 7f682c0a2640 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5646caea8960 con 0x5646cae9ca40 2024-09-12T17:28:04.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.938+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6814057030 con 0x5646cae9ca40 2024-09-12T17:28:04.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.938+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5646caea8960 con 0x7f6824021020 2024-09-12T17:28:04.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.938+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6814057030 con 0x7f6824021020 2024-09-12T17:28:04.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.938+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5646caea8960 con 0x5646cae9ca40 2024-09-12T17:28:04.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.939+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6814057030 con 0x5646cae9ca40 2024-09-12T17:28:04.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.939+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5646caea8960 con 0x5646caea1450 2024-09-12T17:28:04.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.939+0000 7f682c8a3640 1 -- 172.21.15.170:0/3001891706 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f68240083e0 con 0x5646caea1450 2024-09-12T17:28:04.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.939+0000 7f682c8a3640 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5646caea8960 con 0x5646caea5e20 2024-09-12T17:28:04.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.939+0000 7f682c0a2640 1 -- 172.21.15.170:0/3001891706 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f681c01b070 con 0x5646caea5e20 2024-09-12T17:28:04.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.939+0000 7f682c0a2640 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5646caea8960 con 0x5646caea5e20 2024-09-12T17:28:04.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.939+0000 7f682c0a2640 1 -- 172.21.15.170:0/3001891706 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f681c01b070 con 0x5646caea5e20 2024-09-12T17:28:04.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.939+0000 7f682c0a2640 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5646caea8960 con 0x7f6824021020 2024-09-12T17:28:04.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.940+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6814057030 con 0x7f6824021020 2024-09-12T17:28:04.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.940+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5646caea8960 con 0x5646caea5e20 2024-09-12T17:28:04.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.940+0000 7f682c0a2640 1 -- 172.21.15.170:0/3001891706 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f681c01b070 con 0x5646caea5e20 2024-09-12T17:28:04.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.940+0000 7f682c0a2640 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5646caea8960 con 0x5646caea5e20 2024-09-12T17:28:04.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.940+0000 7f682c0a2640 1 -- 172.21.15.170:0/3001891706 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f681c01b070 con 0x5646caea5e20 2024-09-12T17:28:04.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.940+0000 7f682c0a2640 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5646caea8960 con 0x5646cae9ca40 2024-09-12T17:28:04.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.940+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6814057030 con 0x5646cae9ca40 2024-09-12T17:28:04.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.940+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5646caea8960 con 0x5646cae9ca40 2024-09-12T17:28:04.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.941+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6814057030 con 0x5646cae9ca40 2024-09-12T17:28:04.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.941+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5646caea8960 con 0x7f6824021020 2024-09-12T17:28:04.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.941+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6814057030 con 0x7f6824021020 2024-09-12T17:28:04.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.941+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5646caea8960 con 0x5646caea5e20 2024-09-12T17:28:04.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.941+0000 7f682c0a2640 1 -- 172.21.15.170:0/3001891706 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f681c01b070 con 0x5646caea5e20 2024-09-12T17:28:04.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.941+0000 7f682c0a2640 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5646caea8960 con 0x5646caea1450 2024-09-12T17:28:04.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.941+0000 7f682c8a3640 1 -- 172.21.15.170:0/3001891706 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68240083e0 con 0x5646caea1450 2024-09-12T17:28:04.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.941+0000 7f682c8a3640 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5646caea8960 con 0x5646cae9ca40 2024-09-12T17:28:04.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.942+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6814057030 con 0x5646cae9ca40 2024-09-12T17:28:04.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.942+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5646caea8960 con 0x7f6824021020 2024-09-12T17:28:04.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.942+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6814057030 con 0x7f6824021020 2024-09-12T17:28:04.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.942+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5646caea8960 con 0x5646caea5e20 2024-09-12T17:28:04.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.942+0000 7f682c0a2640 1 -- 172.21.15.170:0/3001891706 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f681c01b070 con 0x5646caea5e20 2024-09-12T17:28:04.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.942+0000 7f682c0a2640 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5646caea8960 con 0x7f6824021020 2024-09-12T17:28:04.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.942+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6814057030 con 0x7f6824021020 2024-09-12T17:28:04.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.942+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5646caea8960 con 0x5646caea1450 2024-09-12T17:28:04.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.942+0000 7f682c8a3640 1 -- 172.21.15.170:0/3001891706 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6824066040 con 0x5646caea1450 2024-09-12T17:28:04.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.943+0000 7f682c8a3640 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5646caea8960 con 0x5646caea5e20 2024-09-12T17:28:04.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.943+0000 7f682c0a2640 1 -- 172.21.15.170:0/3001891706 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f681c01b070 con 0x5646caea5e20 2024-09-12T17:28:04.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.943+0000 7f682c0a2640 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5646caea8960 con 0x7f6824021020 2024-09-12T17:28:04.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.943+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6814057030 con 0x7f6824021020 2024-09-12T17:28:04.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.943+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5646caea8960 con 0x5646cae9ca40 2024-09-12T17:28:04.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.943+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6814057030 con 0x5646cae9ca40 2024-09-12T17:28:04.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.943+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5646caea8960 con 0x5646caea1450 2024-09-12T17:28:04.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.943+0000 7f682c8a3640 1 -- 172.21.15.170:0/3001891706 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6824066040 con 0x5646caea1450 2024-09-12T17:28:04.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.943+0000 7f683031f800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:04.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.943+0000 7f683031f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:04.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.943+0000 7f683031f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:04.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.943+0000 7f683031f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:04.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.943+0000 7f683031f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:04.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.944+0000 7f683031f800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:04.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.944+0000 7f683031f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.944+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5646caea4810 con 0x5646cae9ca40 2024-09-12T17:28:04.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.944+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6814057030 con 0x5646cae9ca40 2024-09-12T17:28:04.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.944+0000 7f683031f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.944+0000 7f683031f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.944+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5646caea50b0 con 0x5646cae9ca40 2024-09-12T17:28:04.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.944+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6814057030 con 0x5646cae9ca40 2024-09-12T17:28:04.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.944+0000 7f683031f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:04.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.944+0000 7f683031f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.944+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5646caea4450 con 0x5646caea1450 2024-09-12T17:28:04.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.944+0000 7f682c8a3640 1 -- 172.21.15.170:0/3001891706 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6824066040 con 0x5646caea1450 2024-09-12T17:28:04.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.944+0000 7f683031f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:04.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.944+0000 7f683031f800 20 zone default found 2024-09-12T17:28:04.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.944+0000 7f683031f800 4 Realm: () 2024-09-12T17:28:04.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.944+0000 7f683031f800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:04.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.944+0000 7f683031f800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:04.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.944+0000 7f683031f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:04.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.944+0000 7f683031f800 20 zonegroup default 2024-09-12T17:28:04.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.944+0000 7f683031f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.944+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5646caea8de0 con 0x7f6824021020 2024-09-12T17:28:04.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.945+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6814057030 con 0x7f6824021020 2024-09-12T17:28:04.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.945+0000 7f683031f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.945+0000 7f683031f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.945+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5646caeab0a0 con 0x5646caea5e20 2024-09-12T17:28:04.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.945+0000 7f682c0a2640 1 -- 172.21.15.170:0/3001891706 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f681c01b070 con 0x5646caea5e20 2024-09-12T17:28:04.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.945+0000 7f683031f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.945+0000 7f683031f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.945+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5646caeab440 con 0x5646caea5e20 2024-09-12T17:28:04.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.945+0000 7f682c0a2640 1 -- 172.21.15.170:0/3001891706 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f681c01b070 con 0x5646caea5e20 2024-09-12T17:28:04.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.945+0000 7f683031f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:04.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.945+0000 7f683031f800 20 started sync module instance, tier type = 2024-09-12T17:28:04.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.945+0000 7f683031f800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:04.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.945+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646caeaa530 con 0x5646caea1450 2024-09-12T17:28:04.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.946+0000 7f682c8a3640 1 -- 172.21.15.170:0/3001891706 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6824066040 con 0x5646caea1450 2024-09-12T17:28:04.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.946+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94862052076080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646caeaa530 con 0x5646caea1450 2024-09-12T17:28:04.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.946+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646caeabf20 con 0x5646cae9ca40 2024-09-12T17:28:04.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.947+0000 7f682c8a3640 1 -- 172.21.15.170:0/3001891706 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94862052076080] v29'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6824066040 con 0x5646caea1450 2024-09-12T17:28:04.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.947+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6814057030 con 0x5646cae9ca40 2024-09-12T17:28:04.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.947+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94862052080144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646caeaa530 con 0x5646cae9ca40 2024-09-12T17:28:04.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.947+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646caeac9e0 con 0x5646caea5e20 2024-09-12T17:28:04.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.948+0000 7f682c0a2640 1 -- 172.21.15.170:0/3001891706 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f681c01b070 con 0x5646caea5e20 2024-09-12T17:28:04.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.948+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94862052082864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646caead280 con 0x5646caea5e20 2024-09-12T17:28:04.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.948+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646caeadd60 con 0x5646caea1450 2024-09-12T17:28:04.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.948+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94862052080144] v29'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6814057030 con 0x5646cae9ca40 2024-09-12T17:28:04.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.949+0000 7f682c0a2640 1 -- 172.21.15.170:0/3001891706 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94862052082864] v29'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f681c01b070 con 0x5646caea5e20 2024-09-12T17:28:04.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.949+0000 7f682c8a3640 1 -- 172.21.15.170:0/3001891706 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6824066040 con 0x5646caea1450 2024-09-12T17:28:04.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.949+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94862052085200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646caeaa080 con 0x5646caea1450 2024-09-12T17:28:04.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.949+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646caeae640 con 0x5646cae9ca40 2024-09-12T17:28:04.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.950+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6814057030 con 0x5646cae9ca40 2024-09-12T17:28:04.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.950+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94862052090192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646caeae5d0 con 0x5646cae9ca40 2024-09-12T17:28:04.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.950+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646caeaf5f0 con 0x7f6824021020 2024-09-12T17:28:04.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.950+0000 7f682c8a3640 1 -- 172.21.15.170:0/3001891706 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94862052085200] v29'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6824066040 con 0x5646caea1450 2024-09-12T17:28:04.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.951+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94862052090192] v29'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6814057030 con 0x5646cae9ca40 2024-09-12T17:28:04.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.951+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6814057030 con 0x7f6824021020 2024-09-12T17:28:04.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.951+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94862052087920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646caeae7b0 con 0x7f6824021020 2024-09-12T17:28:04.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.951+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646caeafe90 con 0x7f6824021020 2024-09-12T17:28:04.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.952+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94862052087920] v29'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6814057030 con 0x7f6824021020 2024-09-12T17:28:04.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.953+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(56 notify.6 [create] v29'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6814057030 con 0x7f6824021020 2024-09-12T17:28:04.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.953+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94862052094160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646caeae7b0 con 0x7f6824021020 2024-09-12T17:28:04.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.953+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646caeb04b0 con 0x7f6824021020 2024-09-12T17:28:04.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.954+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(58 notify.7 [create] v29'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6814057030 con 0x7f6824021020 2024-09-12T17:28:04.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.954+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94862052094160] v29'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6814057030 con 0x7f6824021020 2024-09-12T17:28:04.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.954+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94862052098048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646caeb0420 con 0x7f6824021020 2024-09-12T17:28:04.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.954+0000 7f683031f800 20 add_watcher() i=0 2024-09-12T17:28:04.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.954+0000 7f683031f800 20 add_watcher() i=1 2024-09-12T17:28:04.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.954+0000 7f683031f800 20 add_watcher() i=2 2024-09-12T17:28:04.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.954+0000 7f683031f800 20 add_watcher() i=3 2024-09-12T17:28:04.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.954+0000 7f683031f800 20 add_watcher() i=4 2024-09-12T17:28:04.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.954+0000 7f683031f800 20 add_watcher() i=5 2024-09-12T17:28:04.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.954+0000 7f683031f800 20 add_watcher() i=6 2024-09-12T17:28:04.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.954+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94862052098048] v29'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6814057030 con 0x7f6824021020 2024-09-12T17:28:04.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.954+0000 7f683031f800 20 add_watcher() i=7 2024-09-12T17:28:04.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.955+0000 7f683031f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:04.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.955+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5646caeb38b0 con 0x5646cae9ca40 2024-09-12T17:28:04.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.955+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6814057030 con 0x5646cae9ca40 2024-09-12T17:28:04.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.955+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94862052096256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646caeb0d70 con 0x5646cae9ca40 2024-09-12T17:28:04.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.956+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94862052096256] v29'132 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6814057030 con 0x5646cae9ca40 2024-09-12T17:28:04.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.956+0000 7f66e27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:04.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.956+0000 7f683031f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:04.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.956+0000 7f683031f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:04.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.956+0000 7f683031f800 5 note: GC not initialized 2024-09-12T17:28:04.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.956+0000 7f66e17e2640 20 reqs_thread_entry: start 2024-09-12T17:28:04.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.956+0000 7f683031f800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:04.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.956+0000 7f683031f800 20 Filter name: none 2024-09-12T17:28:04.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.957+0000 7f6652ffd640 20 reqs_thread_entry: start 2024-09-12T17:28:04.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.957+0000 7f683031f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:28:04.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.957+0000 7f683031f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.957+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5646caee68b0 con 0x5646cae9ca40 2024-09-12T17:28:04.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.957+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f6814057030 con 0x5646cae9ca40 2024-09-12T17:28:04.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.957+0000 7f683031f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:28:04.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.957+0000 7f683031f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T17:28:04.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.957+0000 7f683031f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:28:04.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.957+0000 7f683031f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:04.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.957+0000 7f683031f800 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-09-12T17:28:04.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.957+0000 7f683031f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.957+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5646caee8840 con 0x5646cae9ca40 2024-09-12T17:28:04.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.957+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) ==== 197+0+241 (crc 0 0 0) 0x7f6814057030 con 0x5646cae9ca40 2024-09-12T17:28:04.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.957+0000 7f683031f800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:28:04.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.957+0000 7f683031f800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-09-12T17:28:04.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.957+0000 7f683031f800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-12T17:28:04.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.957+0000 7f683031f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 : miss 2024-09-12T17:28:04.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.957+0000 7f683031f800 20 rados->read ofs=0 len=0 2024-09-12T17:28:04.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.957+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:64 8.0 8:0794129d:root::.bucket.meta.testx%3amyfoo%3a7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5646caeea120 con 0x5646caea5e20 2024-09-12T17:28:04.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.958+0000 7f682c0a2640 1 -- 172.21.15.170:0/3001891706 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 [call out=48b,stat out=16b,read 0~420 out=420b,getxattrs out=298b] v0'0 uv3 ondisk = 0) ==== 338+0+782 (crc 0 0 0) 0x7f681c01b070 con 0x5646caea5e20 2024-09-12T17:28:04.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.958+0000 7f683031f800 20 rados_obj.operate() r=0 bl.length=420 2024-09-12T17:28:04.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.958+0000 7f683031f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 info.flags=0x17 2024-09-12T17:28:04.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.958+0000 7f683031f800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 to cache LRU end 2024-09-12T17:28:04.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.958+0000 7f683031f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:04.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.958+0000 7f683031f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:28:04.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.958+0000 7f683031f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 2024-09-12T17:28:04.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.958+0000 7f683031f800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-12T17:28:04.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.958+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646caeee8b0 con 0x5646cae9ca40 2024-09-12T17:28:04.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.959+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v29'2 uv2 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f6814089040 con 0x5646cae9ca40 2024-09-12T17:28:04.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.959+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:66 8.1d 8:baccd554:root::.bucket.meta.myfoo%3a7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1:head [create,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646caef21c0 con 0x7f6824021020 2024-09-12T17:28:04.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.960+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(66 .bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 [create,call,writefull 0~387,setxattr (123)] v29'5 uv5 ondisk = 0) ==== 332+0+0 (crc 0 0 0) 0x7f6814089040 con 0x7f6824021020 2024-09-12T17:28:04.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.960+0000 7f683031f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 info.flags=0x7 2024-09-12T17:28:04.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.960+0000 7f683031f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 to cache LRU end 2024-09-12T17:28:04.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.960+0000 7f683031f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:28:04.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.960+0000 7f683031f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1, ofs0, ns] 2024-09-12T17:28:04.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.960+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:67 7.9 7:93e5b521:::notify.7:head [notify cookie 94862052359936 in=748b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5646caef1b00 con 0x7f6824021020 2024-09-12T17:28:04.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.961+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== watch-notify(notify (1) cookie 94862052098048 notify 124554051598 ret 0) ==== 778+0+0 (crc 0 0 0) 0x5646caef2560 con 0x7f6824021020 2024-09-12T17:28:04.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.961+0000 7f670b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051598 cookie 94862052098048 notifier 4554 bl.length()=736 2024-09-12T17:28:04.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.961+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(67 notify.7 [notify cookie 94862052359936 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6814089040 con 0x7f6824021020 2024-09-12T17:28:04.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.961+0000 7f670b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 info.flags=0x7 2024-09-12T17:28:04.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.961+0000 7f670b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 to cache LRU end 2024-09-12T17:28:04.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.961+0000 7f670b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:28:04.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.961+0000 7f670b7fe640 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:68 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f66f0003ea0 con 0x7f6824021020 2024-09-12T17:28:04.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.961+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(68 notify.7 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6814089040 con 0x7f6824021020 2024-09-12T17:28:04.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.961+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== watch-notify(notify_complete (2) cookie 94862052359936 notify 124554051598 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5646caeee2e0 con 0x7f6824021020 2024-09-12T17:28:04.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.961+0000 7f683031f800 20 handle_bi_update(): bucket=:myfoo[7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1]): orig_sources= new_sources= 2024-09-12T17:28:04.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.961+0000 7f683031f800 20 handle_bi_update(): bucket=:myfoo[7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1]): potential sources added=[] removed=[] 2024-09-12T17:28:04.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.961+0000 7f683031f800 20 handle_bi_update(): bucket=:myfoo[7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1]): orig_dests= new_dests= 2024-09-12T17:28:04.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.961+0000 7f683031f800 20 handle_bi_update(): bucket=:myfoo[7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1]): potential dests added=[] removed=[] 2024-09-12T17:28:04.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.961+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646caeed9d0 con 0x5646caea1450 2024-09-12T17:28:04.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.962+0000 7f682c8a3640 1 -- 172.21.15.170:0/3001891706 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(69 foo.buckets [call] v29'26 uv26 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f6824066040 con 0x5646caea1450 2024-09-12T17:28:04.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.962+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646caeed9d0 con 0x5646caea1450 2024-09-12T17:28:04.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.963+0000 7f682c8a3640 1 -- 172.21.15.170:0/3001891706 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v29'27 uv27 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f6824066040 con 0x5646caea1450 2024-09-12T17:28:04.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.963+0000 7f683031f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-12T17:28:04.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.963+0000 7f683031f800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:28:04.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.963+0000 7f683031f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-12T17:28:04.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.963+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94862052349216 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5646caef2730 con 0x7f6824021020 2024-09-12T17:28:04.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.963+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.0 v2:172.21.15.47:6800/3978157098 22 ==== watch-notify(notify (1) cookie 94862052094160 notify 124554051599 ret 0) ==== 356+0+0 (crc 0 0 0) 0x5646cabf96b0 con 0x7f6824021020 2024-09-12T17:28:04.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.963+0000 7f670b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051599 cookie 94862052094160 notifier 4554 bl.length()=314 2024-09-12T17:28:04.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.963+0000 7f670b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-12T17:28:04.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.963+0000 7f670b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:28:04.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.963+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.0 v2:172.21.15.47:6800/3978157098 23 ==== osd_op_reply(71 notify.6 [notify cookie 94862052349216 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6814089040 con 0x7f6824021020 2024-09-12T17:28:04.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.963+0000 7f670b7fe640 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f66f0003ea0 con 0x7f6824021020 2024-09-12T17:28:04.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.964+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.0 v2:172.21.15.47:6800/3978157098 24 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6814089040 con 0x7f6824021020 2024-09-12T17:28:04.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.964+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.0 v2:172.21.15.47:6800/3978157098 25 ==== watch-notify(notify_complete (2) cookie 94862052349216 notify 124554051599 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f681405bdb0 con 0x7f6824021020 2024-09-12T17:28:04.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.964+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:73 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646caeed9d0 con 0x5646cae9ca40 2024-09-12T17:28:04.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.965+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(73 testx/myfoo [call,delete] v29'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f6814089040 con 0x5646cae9ca40 2024-09-12T17:28:04.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.965+0000 7f683031f800 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-09-12T17:28:04.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.965+0000 7f683031f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-12T17:28:04.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.965+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify cookie 94862052349216 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5646caeeeef0 con 0x5646cae9ca40 2024-09-12T17:28:04.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.965+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== watch-notify(notify (1) cookie 94862052090192 notify 124554051596 ret 0) ==== 197+0+0 (crc 0 0 0) 0x7f681405bdb0 con 0x5646cae9ca40 2024-09-12T17:28:04.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.965+0000 7f670affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051596 cookie 94862052090192 notifier 4554 bl.length()=155 2024-09-12T17:28:04.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.965+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(74 notify.4 [notify cookie 94862052349216 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6814089040 con 0x5646cae9ca40 2024-09-12T17:28:04.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.965+0000 7f670affd640 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f66600032c0 con 0x5646cae9ca40 2024-09-12T17:28:04.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.965+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== watch-notify(notify_complete (2) cookie 94862052349216 notify 124554051596 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f68140815d0 con 0x5646cae9ca40 2024-09-12T17:28:04.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.965+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(75 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6814089040 con 0x5646cae9ca40 2024-09-12T17:28:04.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.965+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:76 8.0 8:0794129d:root::.bucket.meta.testx%3amyfoo%3a7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646caeed990 con 0x5646caea5e20 2024-09-12T17:28:04.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.966+0000 7f682c0a2640 1 -- 172.21.15.170:0/3001891706 <== osd.3 v2:172.21.15.170:6816/2664906588 15 ==== osd_op_reply(76 .bucket.meta.testx:myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 [call,delete] v29'4 uv4 ondisk = 0) ==== 254+0+0 (crc 0 0 0) 0x7f681c01b070 con 0x5646caea5e20 2024-09-12T17:28:04.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.966+0000 7f683031f800 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 from cache 2024-09-12T17:28:04.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.966+0000 7f683031f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1, ofs0, ns] 2024-09-12T17:28:04.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.966+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94862052337600 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5646caeed990 con 0x7f6824021020 2024-09-12T17:28:04.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.967+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.0 v2:172.21.15.47:6800/3978157098 26 ==== watch-notify(notify (1) cookie 94862052094160 notify 124554051600 ret 0) ==== 254+0+0 (crc 0 0 0) 0x7f68140815d0 con 0x7f6824021020 2024-09-12T17:28:04.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.967+0000 7f670affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051600 cookie 94862052094160 notifier 4554 bl.length()=212 2024-09-12T17:28:04.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.967+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.0 v2:172.21.15.47:6800/3978157098 27 ==== osd_op_reply(77 notify.6 [notify cookie 94862052337600 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6814089040 con 0x7f6824021020 2024-09-12T17:28:04.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.967+0000 7f670affd640 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:78 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f6660003330 con 0x7f6824021020 2024-09-12T17:28:04.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.967+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.0 v2:172.21.15.47:6800/3978157098 28 ==== osd_op_reply(78 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6814089040 con 0x7f6824021020 2024-09-12T17:28:04.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.967+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.0 v2:172.21.15.47:6800/3978157098 29 ==== watch-notify(notify_complete (2) cookie 94862052337600 notify 124554051600 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f68140818b0 con 0x7f6824021020 2024-09-12T17:28:04.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.968+0000 7f66e27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:04.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.968+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94862052096256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646caee9b50 con 0x5646cae9ca40 2024-09-12T17:28:04.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.969+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94862052096256] v29'133 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6814089040 con 0x5646cae9ca40 2024-09-12T17:28:04.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.969+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94862052076080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646caee4710 con 0x5646caea1450 2024-09-12T17:28:04.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.970+0000 7f682c8a3640 1 -- 172.21.15.170:0/3001891706 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94862052076080] v29'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6824066040 con 0x5646caea1450 2024-09-12T17:28:04.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.970+0000 7f683031f800 20 remove_watcher() i=0 2024-09-12T17:28:04.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.970+0000 7f683031f800 2 removed watcher, disabling cache 2024-09-12T17:28:04.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.970+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94862052080144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646caee4710 con 0x5646cae9ca40 2024-09-12T17:28:04.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.971+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.1 v2:172.21.15.170:6800/1903654092 30 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94862052080144] v29'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6814089040 con 0x5646cae9ca40 2024-09-12T17:28:04.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.971+0000 7f683031f800 20 remove_watcher() i=1 2024-09-12T17:28:04.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.971+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94862052082864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646caee4710 con 0x5646caea5e20 2024-09-12T17:28:04.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.972+0000 7f682c0a2640 1 -- 172.21.15.170:0/3001891706 <== osd.3 v2:172.21.15.170:6816/2664906588 16 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94862052082864] v29'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f681c01b070 con 0x5646caea5e20 2024-09-12T17:28:04.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.972+0000 7f683031f800 20 remove_watcher() i=2 2024-09-12T17:28:04.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.972+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94862052085200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646caee4710 con 0x5646caea1450 2024-09-12T17:28:04.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.973+0000 7f682c8a3640 1 -- 172.21.15.170:0/3001891706 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94862052085200] v29'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6824066040 con 0x5646caea1450 2024-09-12T17:28:04.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.973+0000 7f683031f800 20 remove_watcher() i=3 2024-09-12T17:28:04.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.973+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94862052090192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646caee4710 con 0x5646cae9ca40 2024-09-12T17:28:04.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.974+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.1 v2:172.21.15.170:6800/1903654092 31 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94862052090192] v29'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6814089040 con 0x5646cae9ca40 2024-09-12T17:28:04.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.974+0000 7f683031f800 20 remove_watcher() i=4 2024-09-12T17:28:04.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.974+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94862052087920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646caee4710 con 0x7f6824021020 2024-09-12T17:28:04.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.975+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.0 v2:172.21.15.47:6800/3978157098 30 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94862052087920] v29'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6814089040 con 0x7f6824021020 2024-09-12T17:28:04.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.975+0000 7f683031f800 20 remove_watcher() i=5 2024-09-12T17:28:04.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.975+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94862052094160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646caee4710 con 0x7f6824021020 2024-09-12T17:28:04.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.976+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.0 v2:172.21.15.47:6800/3978157098 31 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94862052094160] v29'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6814089040 con 0x7f6824021020 2024-09-12T17:28:04.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.976+0000 7f683031f800 20 remove_watcher() i=6 2024-09-12T17:28:04.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.976+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94862052098048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5646caee4710 con 0x7f6824021020 2024-09-12T17:28:04.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.977+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 <== osd.0 v2:172.21.15.47:6800/3978157098 32 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94862052098048] v29'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6814089040 con 0x7f6824021020 2024-09-12T17:28:04.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.977+0000 7f683031f800 20 remove_watcher() i=7 2024-09-12T17:28:04.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.977+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f6824021020 msgr2=0x7f682400a980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.977+0000 7f683031f800 1 --2- 172.21.15.170:0/3001891706 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f6824021020 0x7f682400a980 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.977+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5646cae9ca40 msgr2=0x5646cae9ef00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.977+0000 7f683031f800 1 --2- 172.21.15.170:0/3001891706 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5646cae9ca40 0x5646cae9ef00 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.977+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5646caea1450 msgr2=0x5646caea3840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.977+0000 7f683031f800 1 --2- 172.21.15.170:0/3001891706 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5646caea1450 0x5646caea3840 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.977+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5646caea5e20 msgr2=0x5646caea82e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.977+0000 7f683031f800 1 --2- 172.21.15.170:0/3001891706 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5646caea5e20 0x5646caea82e0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.977+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f66fc03c780 msgr2=0x7f66fc03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.977+0000 7f683031f800 1 --2- 172.21.15.170:0/3001891706 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f66fc03c780 0x7f66fc03ec40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f681c01d850 tx=0x7f681c045000 comp rx=0 tx=0).stop 2024-09-12T17:28:04.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.977+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5646cae89b90 msgr2=0x5646cae91100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.977+0000 7f683031f800 1 --2- 172.21.15.170:0/3001891706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5646cae89b90 0x5646cae91100 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f68240154a0 tx=0x7f6824053230 comp rx=0 tx=0).stop 2024-09-12T17:28:04.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.977+0000 7f682b8a1640 1 -- 172.21.15.170:0/3001891706 reap_dead start 2024-09-12T17:28:04.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.977+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 shutdown_connections 2024-09-12T17:28:04.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.977+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 >> 172.21.15.170:0/3001891706 conn(0x5646cae85f90 msgr2=0x5646cae841a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:04.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.977+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 shutdown_connections 2024-09-12T17:28:04.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.977+0000 7f683031f800 1 -- 172.21.15.170:0/3001891706 wait complete. 2024-09-12T17:28:04.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.977+0000 7f683031f800 1 -- 172.21.15.170:0/2949430443 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f670403c730 msgr2=0x7f670403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.977+0000 7f683031f800 1 --2- 172.21.15.170:0/2949430443 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f670403c730 0x7f670403ebf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x5646cae6acc0 tx=0x7f681c018f90 comp rx=0 tx=0).stop 2024-09-12T17:28:04.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.977+0000 7f683031f800 1 -- 172.21.15.170:0/2949430443 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5646cae7d0d0 msgr2=0x5646cae7d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.977+0000 7f683031f800 1 --2- 172.21.15.170:0/2949430443 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5646cae7d0d0 0x5646cae7d4f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x5646cae631a0 tx=0x7f682400bf30 comp rx=0 tx=0).stop 2024-09-12T17:28:04.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.977+0000 7f683031f800 1 -- 172.21.15.170:0/2949430443 shutdown_connections 2024-09-12T17:28:04.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.977+0000 7f683031f800 1 --2- 172.21.15.170:0/2949430443 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f670403c730 0x7f670403ebf0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.977+0000 7f683031f800 1 --2- 172.21.15.170:0/2949430443 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5646cae7d0d0 0x5646cae7d4f0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.977+0000 7f683031f800 1 -- 172.21.15.170:0/2949430443 >> 172.21.15.170:0/2949430443 conn(0x5646cae71480 msgr2=0x5646cae71860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:04.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.978+0000 7f683031f800 1 -- 172.21.15.170:0/2949430443 shutdown_connections 2024-09-12T17:28:04.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.978+0000 7f683031f800 1 -- 172.21.15.170:0/2949430443 wait complete. 2024-09-12T17:28:04.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.978+0000 7f683031f800 1 -- 172.21.15.170:0/1026137116 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5646cad68fd0 msgr2=0x5646cae697f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.978+0000 7f683031f800 1 --2- 172.21.15.170:0/1026137116 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5646cad68fd0 0x5646cae697f0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.978+0000 7f683031f800 1 -- 172.21.15.170:0/1026137116 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5646cae6bbd0 msgr2=0x5646cae6e050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.978+0000 7f683031f800 1 --2- 172.21.15.170:0/1026137116 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5646cae6bbd0 0x5646cae6e050 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.978+0000 7f683031f800 1 -- 172.21.15.170:0/1026137116 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f671403c730 msgr2=0x7f671403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.978+0000 7f683031f800 1 --2- 172.21.15.170:0/1026137116 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f671403c730 0x7f671403ebf0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6814057000 tx=0x7f6814052000 comp rx=0 tx=0).stop 2024-09-12T17:28:04.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.978+0000 7f683031f800 1 -- 172.21.15.170:0/1026137116 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5646cad674b0 msgr2=0x5646cae621a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:04.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.978+0000 7f683031f800 1 --2- 172.21.15.170:0/1026137116 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5646cad674b0 0x5646cae621a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f681c000f80 tx=0x7f681c001250 comp rx=0 tx=0).stop 2024-09-12T17:28:04.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.978+0000 7f683031f800 1 -- 172.21.15.170:0/1026137116 shutdown_connections 2024-09-12T17:28:04.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.978+0000 7f683031f800 1 --2- 172.21.15.170:0/1026137116 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5646cae6bbd0 0x5646cae6e050 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.978+0000 7f683031f800 1 --2- 172.21.15.170:0/1026137116 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f671403c730 0x7f671403ebf0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.978+0000 7f683031f800 1 --2- 172.21.15.170:0/1026137116 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5646cad68fd0 0x5646cae697f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.978+0000 7f683031f800 1 --2- 172.21.15.170:0/1026137116 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5646cad674b0 0x5646cae621a0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:04.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.978+0000 7f683031f800 1 -- 172.21.15.170:0/1026137116 >> 172.21.15.170:0/1026137116 conn(0x5646cad63200 msgr2=0x5646cae5baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:04.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.978+0000 7f683031f800 1 -- 172.21.15.170:0/1026137116 shutdown_connections 2024-09-12T17:28:04.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:04.978+0000 7f683031f800 1 -- 172.21.15.170:0/1026137116 wait complete. 2024-09-12T17:28:05.000 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-12T17:28:05.000 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-12T17:28:05.001 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-09-12T17:28:05.047 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:05.047 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:05.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.046+0000 7f1338125800 1 Processor -- start 2024-09-12T17:28:05.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.046+0000 7f1338125800 1 -- start start 2024-09-12T17:28:05.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.046+0000 7f1338125800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x557ad8086fd0 0x557ad808faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.046+0000 7f1338125800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557ad7f30e40 con 0x557ad80854b0 2024-09-12T17:28:05.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.046+0000 7f1338125800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x557ad7efb680 con 0x557ad8086fd0 2024-09-12T17:28:05.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.046+0000 7f13335ad640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x557ad8086fd0 0x557ad808faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.046+0000 7f1333dae640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x557ad80854b0 0x557ad80858b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:37022/0 (socket says 172.21.15.170:37022) 2024-09-12T17:28:05.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.046+0000 7f1333dae640 1 -- 172.21.15.170:0/1551357944 learned_addr learned my addr 172.21.15.170:0/1551357944 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:28:05.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.046+0000 7f13335ad640 1 -- 172.21.15.170:0/1551357944 >> v1:172.21.15.47:6789/0 conn(0x557ad80854b0 legacy=0x557ad80858b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.046+0000 7f13335ad640 1 -- 172.21.15.170:0/1551357944 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ad7f176b0 con 0x557ad8086fd0 2024-09-12T17:28:05.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.046+0000 7f1332dac640 1 -- 172.21.15.170:0/1551357944 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3630029007 0 0) 0x557ad7f30e40 con 0x557ad80854b0 2024-09-12T17:28:05.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.048+0000 7f13335ad640 1 --2- 172.21.15.170:0/1551357944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ad8086fd0 0x557ad808faf0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f132800a470 tx=0x7f1328045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cc78dd98f49127 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.048+0000 7f1332dac640 1 -- 172.21.15.170:0/1551357944 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1328053570 con 0x557ad8086fd0 2024-09-12T17:28:05.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.048+0000 7f1332dac640 1 -- 172.21.15.170:0/1551357944 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1328058070 con 0x557ad8086fd0 2024-09-12T17:28:05.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.048+0000 7f1332dac640 1 -- 172.21.15.170:0/1551357944 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1328053880 con 0x557ad8086fd0 2024-09-12T17:28:05.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.049+0000 7f1338125800 1 -- 172.21.15.170:0/1551357944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ad8086fd0 msgr2=0x557ad808faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.049+0000 7f1338125800 1 --2- 172.21.15.170:0/1551357944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ad8086fd0 0x557ad808faf0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f132800a470 tx=0x7f1328045a20 comp rx=0 tx=0).stop 2024-09-12T17:28:05.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.049+0000 7f1338125800 1 -- 172.21.15.170:0/1551357944 shutdown_connections 2024-09-12T17:28:05.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.049+0000 7f1338125800 1 --2- 172.21.15.170:0/1551357944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ad8086fd0 0x557ad808faf0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.049+0000 7f1338125800 1 -- 172.21.15.170:0/1551357944 >> 172.21.15.170:0/1551357944 conn(0x557ad8081200 msgr2=0x557ad8083640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:05.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.049+0000 7f1338125800 1 -- 172.21.15.170:0/1551357944 shutdown_connections 2024-09-12T17:28:05.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.049+0000 7f1338125800 1 -- 172.21.15.170:0/1551357944 wait complete. 2024-09-12T17:28:05.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.063+0000 7f1338125800 1 Processor -- start 2024-09-12T17:28:05.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.063+0000 7f1338125800 1 -- start start 2024-09-12T17:28:05.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.063+0000 7f1338125800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ad80854b0 0x557ad8178670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.063+0000 7f1338125800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557ad7f1fdd0 con 0x557ad80854b0 2024-09-12T17:28:05.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.063+0000 7f1333dae640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ad80854b0 0x557ad8178670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.063+0000 7f1333dae640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ad80854b0 0x557ad8178670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43810/0 (socket says 172.21.15.170:43810) 2024-09-12T17:28:05.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.063+0000 7f1333dae640 1 -- 172.21.15.170:0/3874674201 learned_addr learned my addr 172.21.15.170:0/3874674201 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:05.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.063+0000 7f1333dae640 1 -- 172.21.15.170:0/3874674201 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ad7f38e10 con 0x557ad80854b0 2024-09-12T17:28:05.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.063+0000 7f1333dae640 1 --2- 172.21.15.170:0/3874674201 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ad80854b0 0x557ad8178670 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1324001ea0 tx=0x7f132400b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2418fe9db984da5a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.064+0000 7f1221e0b640 1 -- 172.21.15.170:0/3874674201 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1324008070 con 0x557ad80854b0 2024-09-12T17:28:05.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.064+0000 7f1221e0b640 1 -- 172.21.15.170:0/3874674201 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f132400d500 con 0x557ad80854b0 2024-09-12T17:28:05.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.064+0000 7f1221e0b640 1 -- 172.21.15.170:0/3874674201 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f132400d880 con 0x557ad80854b0 2024-09-12T17:28:05.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.064+0000 7f1338125800 1 -- 172.21.15.170:0/3874674201 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ad80854b0 msgr2=0x557ad8178670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.064+0000 7f1338125800 1 --2- 172.21.15.170:0/3874674201 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ad80854b0 0x557ad8178670 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1324001ea0 tx=0x7f132400b6a0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.064+0000 7f1338125800 1 -- 172.21.15.170:0/3874674201 shutdown_connections 2024-09-12T17:28:05.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.064+0000 7f1338125800 1 --2- 172.21.15.170:0/3874674201 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ad80854b0 0x557ad8178670 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.064+0000 7f1338125800 1 -- 172.21.15.170:0/3874674201 >> 172.21.15.170:0/3874674201 conn(0x557ad8081200 msgr2=0x557ad8173ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:05.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.064+0000 7f1338125800 1 -- 172.21.15.170:0/3874674201 shutdown_connections 2024-09-12T17:28:05.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.064+0000 7f1338125800 1 -- 172.21.15.170:0/3874674201 wait complete. 2024-09-12T17:28:05.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.065+0000 7f1338125800 1 Processor -- start 2024-09-12T17:28:05.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.065+0000 7f1338125800 1 -- start start 2024-09-12T17:28:05.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.065+0000 7f1338125800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ad80854b0 0x557ad817ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.065+0000 7f1338125800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557ad8090300 con 0x557ad80854b0 2024-09-12T17:28:05.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.065+0000 7f1333dae640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ad80854b0 0x557ad817ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.065+0000 7f1333dae640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ad80854b0 0x557ad817ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43822/0 (socket says 172.21.15.170:43822) 2024-09-12T17:28:05.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.065+0000 7f1333dae640 1 -- 172.21.15.170:0/1531817488 learned_addr learned my addr 172.21.15.170:0/1531817488 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:05.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.065+0000 7f1333dae640 1 -- 172.21.15.170:0/1531817488 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ad81804f0 con 0x557ad80854b0 2024-09-12T17:28:05.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.065+0000 7f1333dae640 1 --2- 172.21.15.170:0/1531817488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ad80854b0 0x557ad817ff90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f13240012f0 tx=0x7f1324000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.066+0000 7f121bfff640 1 -- 172.21.15.170:0/1531817488 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f132400f9d0 con 0x557ad80854b0 2024-09-12T17:28:05.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.066+0000 7f121bfff640 1 -- 172.21.15.170:0/1531817488 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f132400fb70 con 0x557ad80854b0 2024-09-12T17:28:05.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.066+0000 7f1338125800 1 -- 172.21.15.170:0/1531817488 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557ad8180780 con 0x557ad80854b0 2024-09-12T17:28:05.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.066+0000 7f121bfff640 1 -- 172.21.15.170:0/1531817488 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f132400fe50 con 0x557ad80854b0 2024-09-12T17:28:05.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.066+0000 7f1338125800 1 -- 172.21.15.170:0/1531817488 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ad8181180 con 0x557ad80854b0 2024-09-12T17:28:05.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.067+0000 7f121bfff640 1 -- 172.21.15.170:0/1531817488 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1324017040 con 0x557ad80854b0 2024-09-12T17:28:05.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.067+0000 7f121bfff640 1 --2- 172.21.15.170:0/1531817488 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f121c03c920 0x7f121c03ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.067+0000 7f121bfff640 1 -- 172.21.15.170:0/1531817488 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f1324015020 con 0x557ad80854b0 2024-09-12T17:28:05.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.067+0000 7f13335ad640 1 --2- 172.21.15.170:0/1531817488 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f121c03c920 0x7f121c03ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.067+0000 7f1338125800 1 --2- 172.21.15.170:0/1531817488 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x557ad8086fd0 0x557ad81875e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.067+0000 7f1338125800 1 -- 172.21.15.170:0/1531817488 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557ad8187b20 con 0x557ad8086fd0 2024-09-12T17:28:05.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.067+0000 7f13345af640 1 --2- 172.21.15.170:0/1531817488 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x557ad8086fd0 0x557ad81875e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.067+0000 7f13335ad640 1 --2- 172.21.15.170:0/1531817488 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f121c03c920 0x7f121c03ede0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1328057000 tx=0x7f1328052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.067+0000 7f13345af640 1 --2- 172.21.15.170:0/1531817488 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x557ad8086fd0 0x557ad81875e0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.068+0000 7f13345af640 1 -- 172.21.15.170:0/1531817488 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f132c00a4d0 con 0x557ad8086fd0 2024-09-12T17:28:05.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.068+0000 7f1338125800 1 -- 172.21.15.170:0/1531817488 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557ad8187ec0 con 0x557ad8086fd0 2024-09-12T17:28:05.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.068+0000 7f13345af640 1 -- 172.21.15.170:0/1531817488 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f132c00a4d0 con 0x557ad8086fd0 2024-09-12T17:28:05.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.068+0000 7f1338125800 1 --2- 172.21.15.170:0/1531817488 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x557ad81899c0 0x557ad818be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.068+0000 7f1338125800 1 -- 172.21.15.170:0/1531817488 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557ad818c5d0 con 0x557ad81899c0 2024-09-12T17:28:05.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.068+0000 7f1333dae640 1 --2- 172.21.15.170:0/1531817488 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x557ad81899c0 0x557ad818be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.068+0000 7f1333dae640 1 --2- 172.21.15.170:0/1531817488 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x557ad81899c0 0x557ad818be40 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.069+0000 7f1333dae640 1 -- 172.21.15.170:0/1531817488 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f132402d070 con 0x557ad81899c0 2024-09-12T17:28:05.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.069+0000 7f1338125800 1 -- 172.21.15.170:0/1531817488 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557ad8188710 con 0x557ad8086fd0 2024-09-12T17:28:05.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.069+0000 7f13345af640 1 -- 172.21.15.170:0/1531817488 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f132c00a4d0 con 0x557ad8086fd0 2024-09-12T17:28:05.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.069+0000 7f1338125800 1 -- 172.21.15.170:0/1531817488 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557ad8188b60 con 0x557ad81899c0 2024-09-12T17:28:05.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.069+0000 7f1333dae640 1 -- 172.21.15.170:0/1531817488 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f132402d070 con 0x557ad81899c0 2024-09-12T17:28:05.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.069+0000 7f1338125800 1 Processor -- start 2024-09-12T17:28:05.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.070+0000 7f1338125800 1 -- start start 2024-09-12T17:28:05.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.070+0000 7f1338125800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ad819ae60 0x557ad819b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.070+0000 7f1338125800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557ad7f7da00 con 0x557ad819ae60 2024-09-12T17:28:05.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.070+0000 7f13345af640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ad819ae60 0x557ad819b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.070+0000 7f13345af640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ad819ae60 0x557ad819b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43828/0 (socket says 172.21.15.170:43828) 2024-09-12T17:28:05.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.070+0000 7f13345af640 1 -- 172.21.15.170:0/113850572 learned_addr learned my addr 172.21.15.170:0/113850572 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:05.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.070+0000 7f13345af640 1 -- 172.21.15.170:0/113850572 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ad819b8c0 con 0x557ad819ae60 2024-09-12T17:28:05.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.071+0000 7f13345af640 1 --2- 172.21.15.170:0/113850572 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ad819ae60 0x557ad819b280 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x557ad8180f90 tx=0x7f132c0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.071+0000 7f12197fa640 1 -- 172.21.15.170:0/113850572 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f132c013640 con 0x557ad819ae60 2024-09-12T17:28:05.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.071+0000 7f12197fa640 1 -- 172.21.15.170:0/113850572 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f132c0137e0 con 0x557ad819ae60 2024-09-12T17:28:05.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.071+0000 7f1338125800 1 -- 172.21.15.170:0/113850572 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557ad819c0f0 con 0x557ad819ae60 2024-09-12T17:28:05.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.071+0000 7f12197fa640 1 -- 172.21.15.170:0/113850572 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f132c013ae0 con 0x557ad819ae60 2024-09-12T17:28:05.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.071+0000 7f1338125800 1 -- 172.21.15.170:0/113850572 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ad819c690 con 0x557ad819ae60 2024-09-12T17:28:05.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.072+0000 7f12197fa640 1 -- 172.21.15.170:0/113850572 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f132c011040 con 0x557ad819ae60 2024-09-12T17:28:05.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.072+0000 7f12197fa640 1 --2- 172.21.15.170:0/113850572 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f120c03c730 0x7f120c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.072+0000 7f12197fa640 1 -- 172.21.15.170:0/113850572 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f132c00e040 con 0x557ad819ae60 2024-09-12T17:28:05.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.072+0000 7f1333dae640 1 --2- 172.21.15.170:0/113850572 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f120c03c730 0x7f120c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.072+0000 7f1338125800 1 Processor -- start 2024-09-12T17:28:05.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.072+0000 7f1333dae640 1 --2- 172.21.15.170:0/113850572 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f120c03c730 0x7f120c03ebf0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1324052740 tx=0x7f132400ee10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.072+0000 7f1338125800 1 -- start start 2024-09-12T17:28:05.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.072+0000 7f1338125800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ad81a7980 0x557ad81a7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.072+0000 7f1338125800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557ad8178ec0 con 0x557ad81a7980 2024-09-12T17:28:05.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.073+0000 7f13345af640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ad81a7980 0x557ad81a7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.073+0000 7f13345af640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ad81a7980 0x557ad81a7d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43840/0 (socket says 172.21.15.170:43840) 2024-09-12T17:28:05.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.073+0000 7f13345af640 1 -- 172.21.15.170:0/725207231 learned_addr learned my addr 172.21.15.170:0/725207231 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:05.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.073+0000 7f13345af640 1 -- 172.21.15.170:0/725207231 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ad81a8370 con 0x557ad81a7980 2024-09-12T17:28:05.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.073+0000 7f13345af640 1 --2- 172.21.15.170:0/725207231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ad81a7980 0x557ad81a7d80 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f132c053d60 tx=0x7f132c01fe20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e827cb8f78c0f9b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.073+0000 7f1212ffd640 1 -- 172.21.15.170:0/725207231 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f132c0143c0 con 0x557ad81a7980 2024-09-12T17:28:05.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.073+0000 7f1212ffd640 1 -- 172.21.15.170:0/725207231 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f132c021910 con 0x557ad81a7980 2024-09-12T17:28:05.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.073+0000 7f1212ffd640 1 -- 172.21.15.170:0/725207231 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f132c021440 con 0x557ad81a7980 2024-09-12T17:28:05.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.074+0000 7f1338125800 1 -- 172.21.15.170:0/725207231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ad81a7980 msgr2=0x557ad81a7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.074+0000 7f1338125800 1 --2- 172.21.15.170:0/725207231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ad81a7980 0x557ad81a7d80 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f132c053d60 tx=0x7f132c01fe20 comp rx=0 tx=0).stop 2024-09-12T17:28:05.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.074+0000 7f1338125800 1 -- 172.21.15.170:0/725207231 shutdown_connections 2024-09-12T17:28:05.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.074+0000 7f1338125800 1 --2- 172.21.15.170:0/725207231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ad81a7980 0x557ad81a7d80 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.074+0000 7f1338125800 1 -- 172.21.15.170:0/725207231 >> 172.21.15.170:0/725207231 conn(0x557ad81a3d80 msgr2=0x557ad81a1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:05.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.074+0000 7f1338125800 1 -- 172.21.15.170:0/725207231 shutdown_connections 2024-09-12T17:28:05.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.074+0000 7f1338125800 1 -- 172.21.15.170:0/725207231 wait complete. 2024-09-12T17:28:05.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.074+0000 7f1338125800 1 Processor -- start 2024-09-12T17:28:05.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.074+0000 7f1338125800 1 -- start start 2024-09-12T17:28:05.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.074+0000 7f1338125800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ad81a7980 0x557ad81aef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.074+0000 7f1338125800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557ad81a8990 con 0x557ad81a7980 2024-09-12T17:28:05.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.074+0000 7f13345af640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ad81a7980 0x557ad81aef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.074+0000 7f13345af640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ad81a7980 0x557ad81aef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43848/0 (socket says 172.21.15.170:43848) 2024-09-12T17:28:05.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.074+0000 7f13345af640 1 -- 172.21.15.170:0/1368967120 learned_addr learned my addr 172.21.15.170:0/1368967120 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:05.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.075+0000 7f13345af640 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ad81af4d0 con 0x557ad81a7980 2024-09-12T17:28:05.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.075+0000 7f13345af640 1 --2- 172.21.15.170:0/1368967120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ad81a7980 0x557ad81aef70 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f132c01fe60 tx=0x7f132c053cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.075+0000 7f12117fa640 1 -- 172.21.15.170:0/1368967120 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f132c0143c0 con 0x557ad81a7980 2024-09-12T17:28:05.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.075+0000 7f12117fa640 1 -- 172.21.15.170:0/1368967120 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f132c020800 con 0x557ad81a7980 2024-09-12T17:28:05.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.075+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557ad81af760 con 0x557ad81a7980 2024-09-12T17:28:05.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.075+0000 7f12117fa640 1 -- 172.21.15.170:0/1368967120 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f132c020b40 con 0x557ad81a7980 2024-09-12T17:28:05.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.075+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ad81b00e0 con 0x557ad81a7980 2024-09-12T17:28:05.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.076+0000 7f12117fa640 1 -- 172.21.15.170:0/1368967120 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f132c020ce0 con 0x557ad81a7980 2024-09-12T17:28:05.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.076+0000 7f12117fa640 1 --2- 172.21.15.170:0/1368967120 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f11fc03c780 0x7f11fc03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.076+0000 7f12117fa640 1 -- 172.21.15.170:0/1368967120 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f132c053630 con 0x557ad81a7980 2024-09-12T17:28:05.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.076+0000 7f1333dae640 1 --2- 172.21.15.170:0/1368967120 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f11fc03c780 0x7f11fc03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.076+0000 7f1333dae640 1 --2- 172.21.15.170:0/1368967120 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f11fc03c780 0x7f11fc03ec40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f132400ed00 tx=0x7f132404d000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.077+0000 7f1338125800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.077+0000 7f1338125800 1 --2- 172.21.15.170:0/1368967120 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x557ad81ba800 0x557ad81bccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.077+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557ad81bd410 con 0x557ad81ba800 2024-09-12T17:28:05.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.077+0000 7f13335ad640 1 --2- 172.21.15.170:0/1368967120 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x557ad81ba800 0x557ad81bccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.077+0000 7f13335ad640 1 --2- 172.21.15.170:0/1368967120 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x557ad81ba800 0x557ad81bccc0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.077+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1328051070 con 0x557ad81ba800 2024-09-12T17:28:05.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.077+0000 7f1338125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:05.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.077+0000 7f1338125800 20 realm 2024-09-12T17:28:05.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.077+0000 7f1338125800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.077+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557ad81bd840 con 0x557ad81ba800 2024-09-12T17:28:05.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.078+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1328051070 con 0x557ad81ba800 2024-09-12T17:28:05.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.078+0000 7f1338125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:05.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.078+0000 7f1338125800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:05.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.078+0000 7f1338125800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.078+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557ad81be110 con 0x557ad81ba800 2024-09-12T17:28:05.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.078+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1328051070 con 0x557ad81ba800 2024-09-12T17:28:05.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.078+0000 7f1338125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:05.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.078+0000 7f1338125800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.078+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557ad81be4b0 con 0x557ad81ba800 2024-09-12T17:28:05.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.078+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1328051070 con 0x557ad81ba800 2024-09-12T17:28:05.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.078+0000 7f1338125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:05.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.078+0000 7f1338125800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.078+0000 7f1338125800 1 --2- 172.21.15.170:0/1368967120 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x557ad81bf210 0x557ad81c1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.078+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c1c10 con 0x557ad81bf210 2024-09-12T17:28:05.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.078+0000 7f13345af640 1 --2- 172.21.15.170:0/1368967120 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x557ad81bf210 0x557ad81c1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.078+0000 7f13345af640 1 --2- 172.21.15.170:0/1368967120 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x557ad81bf210 0x557ad81c1600 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.079+0000 7f13345af640 1 -- 172.21.15.170:0/1368967120 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f132c00a4d0 con 0x557ad81bf210 2024-09-12T17:28:05.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.079+0000 7f1338125800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:05.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.079+0000 7f1338125800 20 searching for the correct realm 2024-09-12T17:28:05.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.079+0000 7f1338125800 1 --2- 172.21.15.170:0/1368967120 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x557ad81c3bc0 0x557ad81c6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.079+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c6700 con 0x557ad81c3bc0 2024-09-12T17:28:05.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.079+0000 7f1333dae640 1 --2- 172.21.15.170:0/1368967120 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x557ad81c3bc0 0x557ad81c6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.079+0000 7f1333dae640 1 --2- 172.21.15.170:0/1368967120 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x557ad81c3bc0 0x557ad81c6080 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.079+0000 7f1333dae640 1 -- 172.21.15.170:0/1368967120 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f132402d070 con 0x557ad81c3bc0 2024-09-12T17:28:05.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.079+0000 7f1333dae640 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c6700 con 0x557ad81bf210 2024-09-12T17:28:05.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.080+0000 7f13345af640 1 -- 172.21.15.170:0/1368967120 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f132c00a4d0 con 0x557ad81bf210 2024-09-12T17:28:05.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.080+0000 7f13345af640 1 --2- 172.21.15.170:0/1368967120 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f132c0145e0 0x7f132c056940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.080+0000 7f13345af640 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c6700 con 0x7f132c0145e0 2024-09-12T17:28:05.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.080+0000 7f13335ad640 1 --2- 172.21.15.170:0/1368967120 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f132c0145e0 0x7f132c056940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.080+0000 7f13335ad640 1 --2- 172.21.15.170:0/1368967120 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f132c0145e0 0x7f132c056940 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.080+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1328051070 con 0x7f132c0145e0 2024-09-12T17:28:05.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.080+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c6700 con 0x557ad81ba800 2024-09-12T17:28:05.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.081+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1328051070 con 0x557ad81ba800 2024-09-12T17:28:05.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.081+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c6700 con 0x557ad81ba800 2024-09-12T17:28:05.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.081+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1328051070 con 0x557ad81ba800 2024-09-12T17:28:05.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.081+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c6700 con 0x7f132c0145e0 2024-09-12T17:28:05.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.081+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1328051070 con 0x7f132c0145e0 2024-09-12T17:28:05.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.081+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c6700 con 0x7f132c0145e0 2024-09-12T17:28:05.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.081+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1328051070 con 0x7f132c0145e0 2024-09-12T17:28:05.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.081+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c6700 con 0x557ad81bf210 2024-09-12T17:28:05.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.082+0000 7f13345af640 1 -- 172.21.15.170:0/1368967120 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f132c00a4d0 con 0x557ad81bf210 2024-09-12T17:28:05.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.082+0000 7f13345af640 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c6700 con 0x557ad81c3bc0 2024-09-12T17:28:05.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.082+0000 7f1333dae640 1 -- 172.21.15.170:0/1368967120 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f132402d070 con 0x557ad81c3bc0 2024-09-12T17:28:05.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.082+0000 7f1333dae640 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c6700 con 0x557ad81ba800 2024-09-12T17:28:05.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.082+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1328051070 con 0x557ad81ba800 2024-09-12T17:28:05.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.082+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c6700 con 0x7f132c0145e0 2024-09-12T17:28:05.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.082+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1328051070 con 0x7f132c0145e0 2024-09-12T17:28:05.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.082+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c6700 con 0x557ad81ba800 2024-09-12T17:28:05.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.082+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1328051070 con 0x557ad81ba800 2024-09-12T17:28:05.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.082+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c6700 con 0x557ad81bf210 2024-09-12T17:28:05.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.083+0000 7f13345af640 1 -- 172.21.15.170:0/1368967120 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f132c00a4d0 con 0x557ad81bf210 2024-09-12T17:28:05.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.083+0000 7f13345af640 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c6700 con 0x557ad81c3bc0 2024-09-12T17:28:05.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.083+0000 7f1333dae640 1 -- 172.21.15.170:0/1368967120 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f132402d070 con 0x557ad81c3bc0 2024-09-12T17:28:05.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.083+0000 7f1333dae640 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c6700 con 0x557ad81c3bc0 2024-09-12T17:28:05.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.083+0000 7f1333dae640 1 -- 172.21.15.170:0/1368967120 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f132402d070 con 0x557ad81c3bc0 2024-09-12T17:28:05.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.083+0000 7f1333dae640 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c6700 con 0x7f132c0145e0 2024-09-12T17:28:05.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.083+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1328051070 con 0x7f132c0145e0 2024-09-12T17:28:05.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.083+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c6700 con 0x557ad81c3bc0 2024-09-12T17:28:05.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.084+0000 7f1333dae640 1 -- 172.21.15.170:0/1368967120 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f132402d070 con 0x557ad81c3bc0 2024-09-12T17:28:05.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.084+0000 7f1333dae640 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c6700 con 0x557ad81c3bc0 2024-09-12T17:28:05.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.084+0000 7f1333dae640 1 -- 172.21.15.170:0/1368967120 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f132402d070 con 0x557ad81c3bc0 2024-09-12T17:28:05.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.084+0000 7f1333dae640 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c6700 con 0x557ad81ba800 2024-09-12T17:28:05.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.084+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1328051070 con 0x557ad81ba800 2024-09-12T17:28:05.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.084+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c6700 con 0x557ad81ba800 2024-09-12T17:28:05.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.084+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1328051070 con 0x557ad81ba800 2024-09-12T17:28:05.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.084+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c6700 con 0x7f132c0145e0 2024-09-12T17:28:05.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.085+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1328051070 con 0x7f132c0145e0 2024-09-12T17:28:05.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.085+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c6700 con 0x557ad81c3bc0 2024-09-12T17:28:05.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.085+0000 7f1333dae640 1 -- 172.21.15.170:0/1368967120 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f132402d070 con 0x557ad81c3bc0 2024-09-12T17:28:05.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.085+0000 7f1333dae640 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c6700 con 0x557ad81bf210 2024-09-12T17:28:05.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.085+0000 7f13345af640 1 -- 172.21.15.170:0/1368967120 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f132c065040 con 0x557ad81bf210 2024-09-12T17:28:05.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.085+0000 7f13345af640 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c6700 con 0x557ad81ba800 2024-09-12T17:28:05.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.085+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1328051070 con 0x557ad81ba800 2024-09-12T17:28:05.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.085+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c6700 con 0x7f132c0145e0 2024-09-12T17:28:05.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.086+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1328051070 con 0x7f132c0145e0 2024-09-12T17:28:05.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.086+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c6700 con 0x557ad81c3bc0 2024-09-12T17:28:05.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.086+0000 7f1333dae640 1 -- 172.21.15.170:0/1368967120 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f132402d070 con 0x557ad81c3bc0 2024-09-12T17:28:05.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.086+0000 7f1333dae640 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c6700 con 0x7f132c0145e0 2024-09-12T17:28:05.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.086+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1328051070 con 0x7f132c0145e0 2024-09-12T17:28:05.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.086+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c6700 con 0x557ad81bf210 2024-09-12T17:28:05.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.086+0000 7f13345af640 1 -- 172.21.15.170:0/1368967120 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f132c065040 con 0x557ad81bf210 2024-09-12T17:28:05.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.086+0000 7f13345af640 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c6700 con 0x557ad81c3bc0 2024-09-12T17:28:05.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.086+0000 7f1333dae640 1 -- 172.21.15.170:0/1368967120 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f132402d070 con 0x557ad81c3bc0 2024-09-12T17:28:05.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.086+0000 7f1333dae640 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c6700 con 0x7f132c0145e0 2024-09-12T17:28:05.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.087+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1328051070 con 0x7f132c0145e0 2024-09-12T17:28:05.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.087+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c6700 con 0x557ad81ba800 2024-09-12T17:28:05.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.087+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1328051070 con 0x557ad81ba800 2024-09-12T17:28:05.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.087+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c6700 con 0x557ad81bf210 2024-09-12T17:28:05.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.087+0000 7f13345af640 1 -- 172.21.15.170:0/1368967120 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f132c065040 con 0x557ad81bf210 2024-09-12T17:28:05.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.087+0000 7f1338125800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:05.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.087+0000 7f1338125800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:05.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.087+0000 7f1338125800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:05.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.087+0000 7f1338125800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:05.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.087+0000 7f1338125800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:05.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.087+0000 7f1338125800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:05.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.087+0000 7f1338125800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.087+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c2600 con 0x557ad81ba800 2024-09-12T17:28:05.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.087+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1328051070 con 0x557ad81ba800 2024-09-12T17:28:05.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.087+0000 7f1338125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:05.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.087+0000 7f1338125800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.087+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c2ea0 con 0x557ad81ba800 2024-09-12T17:28:05.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.088+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1328051070 con 0x557ad81ba800 2024-09-12T17:28:05.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.088+0000 7f1338125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:05.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.088+0000 7f1338125800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.088+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c2240 con 0x557ad81bf210 2024-09-12T17:28:05.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.088+0000 7f13345af640 1 -- 172.21.15.170:0/1368967120 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f132c065040 con 0x557ad81bf210 2024-09-12T17:28:05.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.088+0000 7f1338125800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:05.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.088+0000 7f1338125800 20 zone default found 2024-09-12T17:28:05.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.088+0000 7f1338125800 4 Realm: () 2024-09-12T17:28:05.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.088+0000 7f1338125800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:05.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.088+0000 7f1338125800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:05.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.088+0000 7f1338125800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:05.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.088+0000 7f1338125800 20 zonegroup default 2024-09-12T17:28:05.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.088+0000 7f1338125800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.088+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c7030 con 0x7f132c0145e0 2024-09-12T17:28:05.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.088+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1328051070 con 0x7f132c0145e0 2024-09-12T17:28:05.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.088+0000 7f1338125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:05.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.088+0000 7f1338125800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.088+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c9270 con 0x557ad81c3bc0 2024-09-12T17:28:05.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.088+0000 7f1333dae640 1 -- 172.21.15.170:0/1368967120 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f132402d070 con 0x557ad81c3bc0 2024-09-12T17:28:05.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.089+0000 7f1338125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:05.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.089+0000 7f1338125800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.089+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c9610 con 0x557ad81c3bc0 2024-09-12T17:28:05.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.089+0000 7f1333dae640 1 -- 172.21.15.170:0/1368967120 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f132402d070 con 0x557ad81c3bc0 2024-09-12T17:28:05.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.089+0000 7f1338125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:05.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.089+0000 7f1338125800 20 started sync module instance, tier type = 2024-09-12T17:28:05.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.089+0000 7f1338125800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:05.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.089+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c8700 con 0x557ad81bf210 2024-09-12T17:28:05.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.090+0000 7f13345af640 1 -- 172.21.15.170:0/1368967120 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f132c065040 con 0x557ad81bf210 2024-09-12T17:28:05.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.090+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93986100120304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c9ed0 con 0x557ad81bf210 2024-09-12T17:28:05.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.090+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81ca720 con 0x557ad81ba800 2024-09-12T17:28:05.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.091+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1328051070 con 0x557ad81ba800 2024-09-12T17:28:05.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.091+0000 7f13345af640 1 -- 172.21.15.170:0/1368967120 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93986100120304] v29'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f132c065040 con 0x557ad81bf210 2024-09-12T17:28:05.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.091+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93986100124192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81ca430 con 0x557ad81ba800 2024-09-12T17:28:05.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.091+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81caf50 con 0x557ad81c3bc0 2024-09-12T17:28:05.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.092+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93986100124192] v29'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1328051070 con 0x557ad81ba800 2024-09-12T17:28:05.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.092+0000 7f1333dae640 1 -- 172.21.15.170:0/1368967120 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f132402d070 con 0x557ad81c3bc0 2024-09-12T17:28:05.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.092+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93986100128288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81cb340 con 0x557ad81c3bc0 2024-09-12T17:28:05.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.092+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81cbd80 con 0x557ad81bf210 2024-09-12T17:28:05.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.093+0000 7f1333dae640 1 -- 172.21.15.170:0/1368967120 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93986100128288] v29'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f132402d070 con 0x557ad81c3bc0 2024-09-12T17:28:05.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.093+0000 7f13345af640 1 -- 172.21.15.170:0/1368967120 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f132c065040 con 0x557ad81bf210 2024-09-12T17:28:05.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.093+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93986100131920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81cc170 con 0x557ad81bf210 2024-09-12T17:28:05.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.093+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81ccbb0 con 0x557ad81ba800 2024-09-12T17:28:05.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.094+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1328051070 con 0x557ad81ba800 2024-09-12T17:28:05.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.094+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93986100135552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81ccb70 con 0x557ad81ba800 2024-09-12T17:28:05.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.094+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81cdb70 con 0x7f132c0145e0 2024-09-12T17:28:05.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.094+0000 7f13345af640 1 -- 172.21.15.170:0/1368967120 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93986100131920] v29'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f132c065040 con 0x557ad81bf210 2024-09-12T17:28:05.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.095+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93986100135552] v29'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1328051070 con 0x557ad81ba800 2024-09-12T17:28:05.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.095+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1328051070 con 0x7f132c0145e0 2024-09-12T17:28:05.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.095+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93986100139680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81cdb70 con 0x7f132c0145e0 2024-09-12T17:28:05.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.095+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81cdfa0 con 0x7f132c0145e0 2024-09-12T17:28:05.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.096+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93986100139680] v29'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1328051070 con 0x7f132c0145e0 2024-09-12T17:28:05.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.096+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(56 notify.6 [create] v29'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1328051070 con 0x7f132c0145e0 2024-09-12T17:28:05.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.096+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93986100137840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81ce230 con 0x7f132c0145e0 2024-09-12T17:28:05.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.096+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81cea80 con 0x7f132c0145e0 2024-09-12T17:28:05.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.097+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(58 notify.7 [create] v29'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1328051070 con 0x7f132c0145e0 2024-09-12T17:28:05.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.097+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93986100143120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81cedc0 con 0x7f132c0145e0 2024-09-12T17:28:05.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.097+0000 7f1338125800 20 add_watcher() i=0 2024-09-12T17:28:05.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.097+0000 7f1338125800 20 add_watcher() i=1 2024-09-12T17:28:05.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.097+0000 7f1338125800 20 add_watcher() i=2 2024-09-12T17:28:05.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.097+0000 7f1338125800 20 add_watcher() i=3 2024-09-12T17:28:05.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.097+0000 7f1338125800 20 add_watcher() i=4 2024-09-12T17:28:05.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.097+0000 7f1338125800 20 add_watcher() i=5 2024-09-12T17:28:05.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.097+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93986100137840] v29'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1328051070 con 0x7f132c0145e0 2024-09-12T17:28:05.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.097+0000 7f1338125800 20 add_watcher() i=6 2024-09-12T17:28:05.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.098+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93986100143120] v29'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1328051070 con 0x7f132c0145e0 2024-09-12T17:28:05.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.098+0000 7f1338125800 20 add_watcher() i=7 2024-09-12T17:28:05.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.098+0000 7f1338125800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:05.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.098+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557ad81cdd80 con 0x557ad81ba800 2024-09-12T17:28:05.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.099+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1328051070 con 0x557ad81ba800 2024-09-12T17:28:05.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.099+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93986100144240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81cdd80 con 0x557ad81ba800 2024-09-12T17:28:05.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.100+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93986100144240] v29'134 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1328051070 con 0x557ad81ba800 2024-09-12T17:28:05.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.100+0000 7f11ea7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:05.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.100+0000 7f1338125800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:05.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.100+0000 7f1338125800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:05.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.100+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81da7c0 con 0x557ad81ba800 2024-09-12T17:28:05.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.101+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1328051070 con 0x557ad81ba800 2024-09-12T17:28:05.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.101+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81da7c0 con 0x7f132c0145e0 2024-09-12T17:28:05.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.102+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1328051070 con 0x7f132c0145e0 2024-09-12T17:28:05.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.102+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81db230 con 0x557ad81c3bc0 2024-09-12T17:28:05.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.103+0000 7f1333dae640 1 -- 172.21.15.170:0/1368967120 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f132402d070 con 0x557ad81c3bc0 2024-09-12T17:28:05.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.103+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81dbad0 con 0x557ad81ba800 2024-09-12T17:28:05.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.104+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'135 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1328051070 con 0x557ad81ba800 2024-09-12T17:28:05.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.104+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81d8e20 con 0x557ad81bf210 2024-09-12T17:28:05.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.105+0000 7f13345af640 1 -- 172.21.15.170:0/1368967120 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'38 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f132c065040 con 0x557ad81bf210 2024-09-12T17:28:05.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.105+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81d8e20 con 0x557ad81c3bc0 2024-09-12T17:28:05.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.105+0000 7f1333dae640 1 -- 172.21.15.170:0/1368967120 <== osd.3 v2:172.21.15.170:6816/2664906588 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'25 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f132402d070 con 0x557ad81c3bc0 2024-09-12T17:28:05.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.106+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81d8e20 con 0x557ad81ba800 2024-09-12T17:28:05.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.106+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1328051070 con 0x557ad81ba800 2024-09-12T17:28:05.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.107+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81d8f20 con 0x7f132c0145e0 2024-09-12T17:28:05.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.108+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'25 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1328051070 con 0x7f132c0145e0 2024-09-12T17:28:05.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.108+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81dc630 con 0x557ad81bf210 2024-09-12T17:28:05.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.109+0000 7f13345af640 1 -- 172.21.15.170:0/1368967120 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f132c065040 con 0x557ad81bf210 2024-09-12T17:28:05.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.109+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81dc630 con 0x557ad81c3bc0 2024-09-12T17:28:05.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.109+0000 7f1333dae640 1 -- 172.21.15.170:0/1368967120 <== osd.3 v2:172.21.15.170:6816/2664906588 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'22 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f132402d070 con 0x557ad81c3bc0 2024-09-12T17:28:05.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.110+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81dc630 con 0x557ad81bf210 2024-09-12T17:28:05.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.110+0000 7f13345af640 1 -- 172.21.15.170:0/1368967120 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'39 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f132c065040 con 0x557ad81bf210 2024-09-12T17:28:05.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.110+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81dc630 con 0x7f132c0145e0 2024-09-12T17:28:05.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.112+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1328051070 con 0x7f132c0145e0 2024-09-12T17:28:05.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.112+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81dc630 con 0x557ad81bf210 2024-09-12T17:28:05.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.112+0000 7f13345af640 1 -- 172.21.15.170:0/1368967120 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f132c065040 con 0x557ad81bf210 2024-09-12T17:28:05.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.113+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81dc630 con 0x7f132c0145e0 2024-09-12T17:28:05.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.114+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'31 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1328051070 con 0x7f132c0145e0 2024-09-12T17:28:05.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.114+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81dc630 con 0x557ad81ba800 2024-09-12T17:28:05.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.115+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'136 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1328051070 con 0x557ad81ba800 2024-09-12T17:28:05.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.115+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81dc630 con 0x557ad81c3bc0 2024-09-12T17:28:05.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.116+0000 7f1333dae640 1 -- 172.21.15.170:0/1368967120 <== osd.3 v2:172.21.15.170:6816/2664906588 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'32 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f132402d070 con 0x557ad81c3bc0 2024-09-12T17:28:05.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.116+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81dc6c0 con 0x557ad81bf210 2024-09-12T17:28:05.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.117+0000 7f13345af640 1 -- 172.21.15.170:0/1368967120 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'40 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f132c065040 con 0x557ad81bf210 2024-09-12T17:28:05.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.117+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81dc6c0 con 0x557ad81c3bc0 2024-09-12T17:28:05.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.118+0000 7f1333dae640 1 -- 172.21.15.170:0/1368967120 <== osd.3 v2:172.21.15.170:6816/2664906588 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f132402d070 con 0x557ad81c3bc0 2024-09-12T17:28:05.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.118+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81dc6c0 con 0x557ad81ba800 2024-09-12T17:28:05.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.119+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1328051070 con 0x557ad81ba800 2024-09-12T17:28:05.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.119+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81dc6c0 con 0x557ad81ba800 2024-09-12T17:28:05.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.120+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'137 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1328051070 con 0x557ad81ba800 2024-09-12T17:28:05.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.120+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81dc6c0 con 0x557ad81c3bc0 2024-09-12T17:28:05.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.121+0000 7f1333dae640 1 -- 172.21.15.170:0/1368967120 <== osd.3 v2:172.21.15.170:6816/2664906588 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'33 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f132402d070 con 0x557ad81c3bc0 2024-09-12T17:28:05.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.121+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81dc700 con 0x557ad81bf210 2024-09-12T17:28:05.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.121+0000 7f13345af640 1 -- 172.21.15.170:0/1368967120 <== osd.2 v2:172.21.15.170:6808/3855567754 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'27 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f132c065040 con 0x557ad81bf210 2024-09-12T17:28:05.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.122+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81dcc80 con 0x557ad81c3bc0 2024-09-12T17:28:05.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.122+0000 7f1333dae640 1 -- 172.21.15.170:0/1368967120 <== osd.3 v2:172.21.15.170:6816/2664906588 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f132402d070 con 0x557ad81c3bc0 2024-09-12T17:28:05.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.122+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81dcc80 con 0x557ad81c3bc0 2024-09-12T17:28:05.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.123+0000 7f1333dae640 1 -- 172.21.15.170:0/1368967120 <== osd.3 v2:172.21.15.170:6816/2664906588 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f132402d070 con 0x557ad81c3bc0 2024-09-12T17:28:05.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.123+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81dcc80 con 0x557ad81c3bc0 2024-09-12T17:28:05.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.124+0000 7f1333dae640 1 -- 172.21.15.170:0/1368967120 <== osd.3 v2:172.21.15.170:6816/2664906588 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f132402d070 con 0x557ad81c3bc0 2024-09-12T17:28:05.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.124+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81dcc80 con 0x557ad81c3bc0 2024-09-12T17:28:05.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.125+0000 7f1333dae640 1 -- 172.21.15.170:0/1368967120 <== osd.3 v2:172.21.15.170:6816/2664906588 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f132402d070 con 0x557ad81c3bc0 2024-09-12T17:28:05.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.125+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81dcc80 con 0x7f132c0145e0 2024-09-12T17:28:05.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.127+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1328051070 con 0x7f132c0145e0 2024-09-12T17:28:05.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.127+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81d87a0 con 0x557ad81c3bc0 2024-09-12T17:28:05.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.128+0000 7f1333dae640 1 -- 172.21.15.170:0/1368967120 <== osd.3 v2:172.21.15.170:6816/2664906588 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f132402d070 con 0x557ad81c3bc0 2024-09-12T17:28:05.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.128+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81d87a0 con 0x7f132c0145e0 2024-09-12T17:28:05.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.129+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.0 v2:172.21.15.47:6800/3978157098 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1328051070 con 0x7f132c0145e0 2024-09-12T17:28:05.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.129+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81d87a0 con 0x557ad81c3bc0 2024-09-12T17:28:05.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.130+0000 7f1333dae640 1 -- 172.21.15.170:0/1368967120 <== osd.3 v2:172.21.15.170:6816/2664906588 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'34 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f132402d070 con 0x557ad81c3bc0 2024-09-12T17:28:05.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.130+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81d87a0 con 0x7f132c0145e0 2024-09-12T17:28:05.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.131+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.0 v2:172.21.15.47:6800/3978157098 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'32 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1328051070 con 0x7f132c0145e0 2024-09-12T17:28:05.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.131+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81d87a0 con 0x557ad81bf210 2024-09-12T17:28:05.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.132+0000 7f13345af640 1 -- 172.21.15.170:0/1368967120 <== osd.2 v2:172.21.15.170:6808/3855567754 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f132c065040 con 0x557ad81bf210 2024-09-12T17:28:05.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.132+0000 7f11e97e2640 20 reqs_thread_entry: start 2024-09-12T17:28:05.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.132+0000 7f1338125800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:05.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.132+0000 7f1338125800 20 Filter name: none 2024-09-12T17:28:05.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.132+0000 7f11e27fc640 20 reqs_thread_entry: start 2024-09-12T17:28:05.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.132+0000 7f1338125800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-12T17:28:05.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.132+0000 7f1338125800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.132+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557ad8207670 con 0x7f132c0145e0 2024-09-12T17:28:05.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.133+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.0 v2:172.21.15.47:6800/3978157098 24 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f1328051070 con 0x7f132c0145e0 2024-09-12T17:28:05.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.133+0000 7f1338125800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:28:05.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.133+0000 7f1338125800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-12T17:28:05.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.133+0000 7f1338125800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-12T17:28:05.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.133+0000 7f1338125800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:05.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.133+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557ad8209ab0 con 0x557ad81ba800 2024-09-12T17:28:05.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.133+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 170+0+15 (crc 0 0 0) 0x7f1328051070 con 0x557ad81ba800 2024-09-12T17:28:05.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.133+0000 7f1338125800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-12T17:28:05.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.133+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad82079f0 con 0x7f132c0145e0 2024-09-12T17:28:05.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.134+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.0 v2:172.21.15.47:6800/3978157098 25 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v29'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f1328051070 con 0x7f132c0145e0 2024-09-12T17:28:05.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.134+0000 7f1338125800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-12T17:28:05.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.134+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 93986100381008 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557ad820a380 con 0x557ad81c3bc0 2024-09-12T17:28:05.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.134+0000 7f1333dae640 1 -- 172.21.15.170:0/1368967120 <== osd.3 v2:172.21.15.170:6816/2664906588 26 ==== watch-notify(notify (1) cookie 93986100128288 notify 124554051595 ret 0) ==== 212+0+0 (crc 0 0 0) 0x557ad81dc700 con 0x557ad81c3bc0 2024-09-12T17:28:05.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.134+0000 7f1212ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051595 cookie 93986100128288 notifier 4561 bl.length()=170 2024-09-12T17:28:05.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.134+0000 7f1212ffd640 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f11f8003d60 con 0x557ad81c3bc0 2024-09-12T17:28:05.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.134+0000 7f1333dae640 1 -- 172.21.15.170:0/1368967120 <== osd.3 v2:172.21.15.170:6816/2664906588 27 ==== osd_op_reply(97 notify.2 [notify cookie 93986100381008 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f132402d070 con 0x557ad81c3bc0 2024-09-12T17:28:05.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.135+0000 7f1333dae640 1 -- 172.21.15.170:0/1368967120 <== osd.3 v2:172.21.15.170:6816/2664906588 28 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f132402d070 con 0x557ad81c3bc0 2024-09-12T17:28:05.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.135+0000 7f1333dae640 1 -- 172.21.15.170:0/1368967120 <== osd.3 v2:172.21.15.170:6816/2664906588 29 ==== watch-notify(notify_complete (2) cookie 93986100381008 notify 124554051595 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557ad81da990 con 0x557ad81c3bc0 2024-09-12T17:28:05.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.135+0000 7f1338125800 10 removing email index: 2024-09-12T17:28:05.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.135+0000 7f1338125800 10 removing user buckets index 2024-09-12T17:28:05.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.135+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:99 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad82079f0 con 0x557ad81ba800 2024-09-12T17:28:05.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.136+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(99 testx$tenanteduser.buckets [delete] v29'3 uv3 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f1328051070 con 0x557ad81ba800 2024-09-12T17:28:05.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.136+0000 7f1338125800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-09-12T17:28:05.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.136+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify cookie 93986100376896 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557ad8207960 con 0x557ad81ba800 2024-09-12T17:28:05.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.136+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== watch-notify(notify (1) cookie 93986100135552 notify 124554051597 ret 0) ==== 217+0+0 (crc 0 0 0) 0x557ad81dc8d0 con 0x557ad81ba800 2024-09-12T17:28:05.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.136+0000 7f12127fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051597 cookie 93986100135552 notifier 4561 bl.length()=175 2024-09-12T17:28:05.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.136+0000 7f12127fc640 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f115c0032c0 con 0x557ad81ba800 2024-09-12T17:28:05.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.136+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.1 v2:172.21.15.170:6800/1903654092 30 ==== osd_op_reply(100 notify.4 [notify cookie 93986100376896 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1328051070 con 0x557ad81ba800 2024-09-12T17:28:05.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.136+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.1 v2:172.21.15.170:6800/1903654092 31 ==== watch-notify(notify_complete (2) cookie 93986100376896 notify 124554051597 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557ad81d41e0 con 0x557ad81ba800 2024-09-12T17:28:05.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.136+0000 7f1338125800 10 removing user index: testx$tenanteduser 2024-09-12T17:28:05.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.136+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.1 v2:172.21.15.170:6800/1903654092 32 ==== osd_op_reply(101 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1328051070 con 0x557ad81ba800 2024-09-12T17:28:05.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.136+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad8208e00 con 0x7f132c0145e0 2024-09-12T17:28:05.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.138+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.0 v2:172.21.15.47:6800/3978157098 26 ==== osd_op_reply(102 testx$tenanteduser [call,call,delete] v29'8 uv8 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f1328051070 con 0x7f132c0145e0 2024-09-12T17:28:05.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.138+0000 7f1338125800 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-09-12T17:28:05.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.138+0000 7f1338125800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-12T17:28:05.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.138+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify cookie 93986100384704 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557ad8208e00 con 0x557ad81bf210 2024-09-12T17:28:05.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.138+0000 7f13345af640 1 -- 172.21.15.170:0/1368967120 <== osd.2 v2:172.21.15.170:6808/3855567754 20 ==== watch-notify(notify (1) cookie 93986100131920 notify 124554051597 ret 0) ==== 209+0+0 (crc 0 0 0) 0x557ad81af760 con 0x557ad81bf210 2024-09-12T17:28:05.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.138+0000 7f1212ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051597 cookie 93986100131920 notifier 4561 bl.length()=167 2024-09-12T17:28:05.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.138+0000 7f1212ffd640 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f11f8003d60 con 0x557ad81bf210 2024-09-12T17:28:05.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.138+0000 7f13345af640 1 -- 172.21.15.170:0/1368967120 <== osd.2 v2:172.21.15.170:6808/3855567754 21 ==== osd_op_reply(103 notify.3 [notify cookie 93986100384704 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f132c065040 con 0x557ad81bf210 2024-09-12T17:28:05.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.138+0000 7f13345af640 1 -- 172.21.15.170:0/1368967120 <== osd.2 v2:172.21.15.170:6808/3855567754 22 ==== osd_op_reply(104 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f132c065040 con 0x557ad81bf210 2024-09-12T17:28:05.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.138+0000 7f13345af640 1 -- 172.21.15.170:0/1368967120 <== osd.2 v2:172.21.15.170:6808/3855567754 23 ==== watch-notify(notify_complete (2) cookie 93986100384704 notify 124554051597 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557ad81af4d0 con 0x557ad81bf210 2024-09-12T17:28:05.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.139+0000 7f11ea7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:05.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.139+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93986100144240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81d8150 con 0x557ad81ba800 2024-09-12T17:28:05.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.140+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.1 v2:172.21.15.170:6800/1903654092 33 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 93986100144240] v29'138 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1328051070 con 0x557ad81ba800 2024-09-12T17:28:05.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.140+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93986100120304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81d8150 con 0x557ad81bf210 2024-09-12T17:28:05.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.141+0000 7f13345af640 1 -- 172.21.15.170:0/1368967120 <== osd.2 v2:172.21.15.170:6808/3855567754 24 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 93986100120304] v29'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f132c065040 con 0x557ad81bf210 2024-09-12T17:28:05.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.141+0000 7f1338125800 20 remove_watcher() i=0 2024-09-12T17:28:05.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.141+0000 7f1338125800 2 removed watcher, disabling cache 2024-09-12T17:28:05.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.141+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93986100124192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c8af0 con 0x557ad81ba800 2024-09-12T17:28:05.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.142+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.1 v2:172.21.15.170:6800/1903654092 34 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 93986100124192] v29'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1328051070 con 0x557ad81ba800 2024-09-12T17:28:05.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.142+0000 7f1338125800 20 remove_watcher() i=1 2024-09-12T17:28:05.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.142+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93986100128288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c8af0 con 0x557ad81c3bc0 2024-09-12T17:28:05.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.143+0000 7f1333dae640 1 -- 172.21.15.170:0/1368967120 <== osd.3 v2:172.21.15.170:6816/2664906588 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 93986100128288] v29'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f132402d070 con 0x557ad81c3bc0 2024-09-12T17:28:05.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.143+0000 7f1338125800 20 remove_watcher() i=2 2024-09-12T17:28:05.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.143+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93986100131920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c8af0 con 0x557ad81bf210 2024-09-12T17:28:05.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.144+0000 7f13345af640 1 -- 172.21.15.170:0/1368967120 <== osd.2 v2:172.21.15.170:6808/3855567754 25 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 93986100131920] v29'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f132c065040 con 0x557ad81bf210 2024-09-12T17:28:05.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.144+0000 7f1338125800 20 remove_watcher() i=3 2024-09-12T17:28:05.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.144+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93986100135552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81cb850 con 0x557ad81ba800 2024-09-12T17:28:05.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.145+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.1 v2:172.21.15.170:6800/1903654092 35 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 93986100135552] v29'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1328051070 con 0x557ad81ba800 2024-09-12T17:28:05.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.145+0000 7f1338125800 20 remove_watcher() i=4 2024-09-12T17:28:05.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.145+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93986100139680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c8af0 con 0x7f132c0145e0 2024-09-12T17:28:05.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.146+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.0 v2:172.21.15.47:6800/3978157098 27 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 93986100139680] v29'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1328051070 con 0x7f132c0145e0 2024-09-12T17:28:05.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.146+0000 7f1338125800 20 remove_watcher() i=5 2024-09-12T17:28:05.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.146+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93986100137840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81cd6a0 con 0x7f132c0145e0 2024-09-12T17:28:05.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.147+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.0 v2:172.21.15.47:6800/3978157098 28 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 93986100137840] v29'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1328051070 con 0x7f132c0145e0 2024-09-12T17:28:05.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.147+0000 7f1338125800 20 remove_watcher() i=6 2024-09-12T17:28:05.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.147+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93986100143120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557ad81c8af0 con 0x7f132c0145e0 2024-09-12T17:28:05.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.148+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 <== osd.0 v2:172.21.15.47:6800/3978157098 29 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 93986100143120] v29'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1328051070 con 0x7f132c0145e0 2024-09-12T17:28:05.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.148+0000 7f1338125800 20 remove_watcher() i=7 2024-09-12T17:28:05.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.148+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f132c0145e0 msgr2=0x7f132c056940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.148+0000 7f1338125800 1 --2- 172.21.15.170:0/1368967120 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f132c0145e0 0x7f132c056940 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.148+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x557ad81ba800 msgr2=0x557ad81bccc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.148+0000 7f1338125800 1 --2- 172.21.15.170:0/1368967120 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x557ad81ba800 0x557ad81bccc0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.148+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x557ad81bf210 msgr2=0x557ad81c1600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.148+0000 7f1338125800 1 --2- 172.21.15.170:0/1368967120 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x557ad81bf210 0x557ad81c1600 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.148+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x557ad81c3bc0 msgr2=0x557ad81c6080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.148+0000 7f1338125800 1 --2- 172.21.15.170:0/1368967120 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x557ad81c3bc0 0x557ad81c6080 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.148+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f11fc03c780 msgr2=0x7f11fc03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.148+0000 7f1338125800 1 --2- 172.21.15.170:0/1368967120 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f11fc03c780 0x7f11fc03ec40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f132400ed00 tx=0x7f132404d000 comp rx=0 tx=0).stop 2024-09-12T17:28:05.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.148+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ad81a7980 msgr2=0x557ad81aef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.148+0000 7f13335ad640 1 -- 172.21.15.170:0/1368967120 reap_dead start 2024-09-12T17:28:05.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.148+0000 7f1338125800 1 --2- 172.21.15.170:0/1368967120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ad81a7980 0x557ad81aef70 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f132c01fe60 tx=0x7f132c053cc0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.148+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 shutdown_connections 2024-09-12T17:28:05.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.148+0000 7f1338125800 1 --2- 172.21.15.170:0/1368967120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ad81a7980 0x557ad81aef70 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.148+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 >> 172.21.15.170:0/1368967120 conn(0x557ad81a3d80 msgr2=0x557ad81a1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:05.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.148+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 shutdown_connections 2024-09-12T17:28:05.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.148+0000 7f1338125800 1 -- 172.21.15.170:0/1368967120 wait complete. 2024-09-12T17:28:05.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.148+0000 7f1338125800 1 -- 172.21.15.170:0/113850572 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f120c03c730 msgr2=0x7f120c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.148+0000 7f1338125800 1 --2- 172.21.15.170:0/113850572 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f120c03c730 0x7f120c03ebf0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1324052740 tx=0x7f132400ee10 comp rx=0 tx=0).stop 2024-09-12T17:28:05.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.148+0000 7f1338125800 1 -- 172.21.15.170:0/113850572 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ad819ae60 msgr2=0x557ad819b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.148+0000 7f1338125800 1 --2- 172.21.15.170:0/113850572 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ad819ae60 0x557ad819b280 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x557ad8180f90 tx=0x7f132c0167b0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.148+0000 7f1338125800 1 -- 172.21.15.170:0/113850572 shutdown_connections 2024-09-12T17:28:05.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.148+0000 7f1338125800 1 --2- 172.21.15.170:0/113850572 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f120c03c730 0x7f120c03ebf0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.148+0000 7f1338125800 1 --2- 172.21.15.170:0/113850572 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ad819ae60 0x557ad819b280 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.148+0000 7f1338125800 1 -- 172.21.15.170:0/113850572 >> 172.21.15.170:0/113850572 conn(0x557ad818f210 msgr2=0x557ad818f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:05.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.148+0000 7f1338125800 1 -- 172.21.15.170:0/113850572 shutdown_connections 2024-09-12T17:28:05.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.148+0000 7f1338125800 1 -- 172.21.15.170:0/113850572 wait complete. 2024-09-12T17:28:05.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.149+0000 7f1338125800 1 -- 172.21.15.170:0/1531817488 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x557ad8086fd0 msgr2=0x557ad81875e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.149+0000 7f1338125800 1 --2- 172.21.15.170:0/1531817488 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x557ad8086fd0 0x557ad81875e0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.149+0000 7f1338125800 1 -- 172.21.15.170:0/1531817488 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x557ad81899c0 msgr2=0x557ad818be40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.149+0000 7f1338125800 1 --2- 172.21.15.170:0/1531817488 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x557ad81899c0 0x557ad818be40 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.149+0000 7f1338125800 1 -- 172.21.15.170:0/1531817488 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f121c03c920 msgr2=0x7f121c03ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.149+0000 7f1338125800 1 --2- 172.21.15.170:0/1531817488 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f121c03c920 0x7f121c03ede0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1328057000 tx=0x7f1328052000 comp rx=0 tx=0).stop 2024-09-12T17:28:05.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.149+0000 7f1338125800 1 -- 172.21.15.170:0/1531817488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ad80854b0 msgr2=0x557ad817ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.149+0000 7f1338125800 1 --2- 172.21.15.170:0/1531817488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ad80854b0 0x557ad817ff90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f13240012f0 tx=0x7f1324000ed0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.149+0000 7f1338125800 1 -- 172.21.15.170:0/1531817488 shutdown_connections 2024-09-12T17:28:05.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.149+0000 7f1338125800 1 --2- 172.21.15.170:0/1531817488 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x557ad81899c0 0x557ad818be40 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.149+0000 7f1338125800 1 --2- 172.21.15.170:0/1531817488 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f121c03c920 0x7f121c03ede0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.149+0000 7f1338125800 1 --2- 172.21.15.170:0/1531817488 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x557ad8086fd0 0x557ad81875e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.149+0000 7f1338125800 1 --2- 172.21.15.170:0/1531817488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557ad80854b0 0x557ad817ff90 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.149+0000 7f1338125800 1 -- 172.21.15.170:0/1531817488 >> 172.21.15.170:0/1531817488 conn(0x557ad8081200 msgr2=0x557ad8179950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:05.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.149+0000 7f1338125800 1 -- 172.21.15.170:0/1531817488 shutdown_connections 2024-09-12T17:28:05.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.149+0000 7f1338125800 1 -- 172.21.15.170:0/1531817488 wait complete. 2024-09-12T17:28:05.167 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-12T17:28:05.169 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-09-12T17:28:05.213 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:28:05.214 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-12T17:28:05.214 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-12T17:28:05.214 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-09-12T17:28:05.262 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:05.262 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:05.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.260+0000 7fefb9122800 1 Processor -- start 2024-09-12T17:28:05.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.261+0000 7fefb9122800 1 -- start start 2024-09-12T17:28:05.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.261+0000 7fefb9122800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55b19be26210 0x55b19be2bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.261+0000 7fefb9122800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b19bccfe40 con 0x55b19be24e00 2024-09-12T17:28:05.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.261+0000 7fefb9122800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x55b19bc9a680 con 0x55b19be26210 2024-09-12T17:28:05.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.261+0000 7fefac501640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55b19be26210 0x55b19be2bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.261+0000 7fefb4d02640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x55b19be24e00 0x55b19be25b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:37036/0 (socket says 172.21.15.170:37036) 2024-09-12T17:28:05.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.261+0000 7fefb4d02640 1 -- 172.21.15.170:0/3603576478 learned_addr learned my addr 172.21.15.170:0/3603576478 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:28:05.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.261+0000 7fefac501640 1 -- 172.21.15.170:0/3603576478 >> v1:172.21.15.47:6789/0 conn(0x55b19be24e00 legacy=0x55b19be25b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.261+0000 7fefac501640 1 -- 172.21.15.170:0/3603576478 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b19bcb66b0 con 0x55b19be26210 2024-09-12T17:28:05.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.263+0000 7fefac501640 1 --2- 172.21.15.170:0/3603576478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19be26210 0x55b19be2bdb0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fef9c00a470 tx=0x7fef9c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dbddf74623be765 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.263+0000 7fefaffff640 1 -- 172.21.15.170:0/3603576478 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef9c053570 con 0x55b19be26210 2024-09-12T17:28:05.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.263+0000 7fefaffff640 1 -- 172.21.15.170:0/3603576478 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef9c058070 con 0x55b19be26210 2024-09-12T17:28:05.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.263+0000 7fefaffff640 1 -- 172.21.15.170:0/3603576478 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef9c053880 con 0x55b19be26210 2024-09-12T17:28:05.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.264+0000 7fefb9122800 1 -- 172.21.15.170:0/3603576478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19be26210 msgr2=0x55b19be2bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.264+0000 7fefb9122800 1 --2- 172.21.15.170:0/3603576478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19be26210 0x55b19be2bdb0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fef9c00a470 tx=0x7fef9c045a20 comp rx=0 tx=0).stop 2024-09-12T17:28:05.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.264+0000 7fefb9122800 1 -- 172.21.15.170:0/3603576478 shutdown_connections 2024-09-12T17:28:05.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.264+0000 7fefb9122800 1 --2- 172.21.15.170:0/3603576478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19be26210 0x55b19be2bdb0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.264+0000 7fefb9122800 1 -- 172.21.15.170:0/3603576478 >> 172.21.15.170:0/3603576478 conn(0x55b19be201d0 msgr2=0x55b19be22630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:05.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.264+0000 7fefb9122800 1 -- 172.21.15.170:0/3603576478 shutdown_connections 2024-09-12T17:28:05.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.264+0000 7fefb9122800 1 -- 172.21.15.170:0/3603576478 wait complete. 2024-09-12T17:28:05.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.278+0000 7fefb9122800 1 Processor -- start 2024-09-12T17:28:05.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.278+0000 7fefb9122800 1 -- start start 2024-09-12T17:28:05.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.278+0000 7fefb9122800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19be24e00 0x55b19bd98e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.278+0000 7fefb9122800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b19bcbedd0 con 0x55b19be24e00 2024-09-12T17:28:05.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.278+0000 7fefb4d02640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19be24e00 0x55b19bd98e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.278+0000 7fefb4d02640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19be24e00 0x55b19bd98e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43862/0 (socket says 172.21.15.170:43862) 2024-09-12T17:28:05.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.278+0000 7fefb4d02640 1 -- 172.21.15.170:0/959532417 learned_addr learned my addr 172.21.15.170:0/959532417 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:05.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.278+0000 7fefb4d02640 1 -- 172.21.15.170:0/959532417 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b19bcd7e10 con 0x55b19be24e00 2024-09-12T17:28:05.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.279+0000 7fefb4d02640 1 --2- 172.21.15.170:0/959532417 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19be24e00 0x55b19bd98e00 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fefa4001e40 tx=0x7fefa4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5311a9940ce31c96 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.279+0000 7feea2e0d640 1 -- 172.21.15.170:0/959532417 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefa4012020 con 0x55b19be24e00 2024-09-12T17:28:05.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.279+0000 7feea2e0d640 1 -- 172.21.15.170:0/959532417 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefa400e5a0 con 0x55b19be24e00 2024-09-12T17:28:05.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.279+0000 7feea2e0d640 1 -- 172.21.15.170:0/959532417 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefa400e8a0 con 0x55b19be24e00 2024-09-12T17:28:05.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.279+0000 7fefb9122800 1 -- 172.21.15.170:0/959532417 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19be24e00 msgr2=0x55b19bd98e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.279+0000 7fefb9122800 1 --2- 172.21.15.170:0/959532417 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19be24e00 0x55b19bd98e00 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fefa4001e40 tx=0x7fefa4001e70 comp rx=0 tx=0).stop 2024-09-12T17:28:05.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.279+0000 7fefb9122800 1 -- 172.21.15.170:0/959532417 shutdown_connections 2024-09-12T17:28:05.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.279+0000 7fefb9122800 1 --2- 172.21.15.170:0/959532417 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19be24e00 0x55b19bd98e00 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.279+0000 7fefb9122800 1 -- 172.21.15.170:0/959532417 >> 172.21.15.170:0/959532417 conn(0x55b19be201d0 msgr2=0x55b19bf0fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:05.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.280+0000 7fefb9122800 1 -- 172.21.15.170:0/959532417 shutdown_connections 2024-09-12T17:28:05.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.280+0000 7fefb9122800 1 -- 172.21.15.170:0/959532417 wait complete. 2024-09-12T17:28:05.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.280+0000 7fefb9122800 1 Processor -- start 2024-09-12T17:28:05.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.280+0000 7fefb9122800 1 -- start start 2024-09-12T17:28:05.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.280+0000 7fefb9122800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19be24e00 0x55b19bf158d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.280+0000 7fefb9122800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b19be26900 con 0x55b19be24e00 2024-09-12T17:28:05.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.280+0000 7fefb4d02640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19be24e00 0x55b19bf158d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.280+0000 7fefb4d02640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19be24e00 0x55b19bf158d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43870/0 (socket says 172.21.15.170:43870) 2024-09-12T17:28:05.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.280+0000 7fefb4d02640 1 -- 172.21.15.170:0/3945030569 learned_addr learned my addr 172.21.15.170:0/3945030569 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:05.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.280+0000 7fefb4d02640 1 -- 172.21.15.170:0/3945030569 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b19bf15e30 con 0x55b19be24e00 2024-09-12T17:28:05.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.281+0000 7fefb4d02640 1 --2- 172.21.15.170:0/3945030569 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19be24e00 0x55b19bf158d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fefa40012b0 tx=0x7fefa4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.281+0000 7feea160a640 1 -- 172.21.15.170:0/3945030569 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefa4012030 con 0x55b19be24e00 2024-09-12T17:28:05.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.281+0000 7feea160a640 1 -- 172.21.15.170:0/3945030569 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefa401a750 con 0x55b19be24e00 2024-09-12T17:28:05.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.281+0000 7fefb9122800 1 -- 172.21.15.170:0/3945030569 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b19bf141e0 con 0x55b19be24e00 2024-09-12T17:28:05.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.281+0000 7feea160a640 1 -- 172.21.15.170:0/3945030569 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefa401aa70 con 0x55b19be24e00 2024-09-12T17:28:05.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.281+0000 7fefb9122800 1 -- 172.21.15.170:0/3945030569 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b19bf147a0 con 0x55b19be24e00 2024-09-12T17:28:05.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.282+0000 7feea160a640 1 -- 172.21.15.170:0/3945030569 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fefa4015020 con 0x55b19be24e00 2024-09-12T17:28:05.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.282+0000 7feea160a640 1 --2- 172.21.15.170:0/3945030569 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fee9c03c780 0x7fee9c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.282+0000 7feea160a640 1 -- 172.21.15.170:0/3945030569 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fefa4020030 con 0x55b19be24e00 2024-09-12T17:28:05.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.282+0000 7fefac501640 1 --2- 172.21.15.170:0/3945030569 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fee9c03c780 0x7fee9c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.282+0000 7fefb9122800 1 --2- 172.21.15.170:0/3945030569 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b19be26210 0x55b19bf263a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.282+0000 7fefb9122800 1 -- 172.21.15.170:0/3945030569 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf269c0 con 0x55b19be26210 2024-09-12T17:28:05.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.282+0000 7fefb5503640 1 --2- 172.21.15.170:0/3945030569 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b19be26210 0x55b19bf263a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.282+0000 7fefac501640 1 --2- 172.21.15.170:0/3945030569 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fee9c03c780 0x7fee9c03ec40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fef9c057000 tx=0x7fef9c052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.283+0000 7fefb5503640 1 --2- 172.21.15.170:0/3945030569 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b19be26210 0x55b19bf263a0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.283+0000 7fefb5503640 1 -- 172.21.15.170:0/3945030569 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fefb000a4d0 con 0x55b19be26210 2024-09-12T17:28:05.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.283+0000 7fefb9122800 1 -- 172.21.15.170:0/3945030569 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf14d60 con 0x55b19be26210 2024-09-12T17:28:05.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.283+0000 7fefb5503640 1 -- 172.21.15.170:0/3945030569 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fefb000a4d0 con 0x55b19be26210 2024-09-12T17:28:05.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.283+0000 7fefb9122800 1 --2- 172.21.15.170:0/3945030569 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b19bf28d10 0x55b19bf2b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.283+0000 7fefb9122800 1 -- 172.21.15.170:0/3945030569 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf2b7d0 con 0x55b19bf28d10 2024-09-12T17:28:05.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.283+0000 7fefb4d02640 1 --2- 172.21.15.170:0/3945030569 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b19bf28d10 0x55b19bf2b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.283+0000 7fefb4d02640 1 --2- 172.21.15.170:0/3945030569 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b19bf28d10 0x55b19bf2b100 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.284+0000 7fefb4d02640 1 -- 172.21.15.170:0/3945030569 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fefa4018ce0 con 0x55b19bf28d10 2024-09-12T17:28:05.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.284+0000 7fefb9122800 1 -- 172.21.15.170:0/3945030569 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf27bb0 con 0x55b19be26210 2024-09-12T17:28:05.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.284+0000 7fefb5503640 1 -- 172.21.15.170:0/3945030569 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fefb000a4d0 con 0x55b19be26210 2024-09-12T17:28:05.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.284+0000 7fefb9122800 1 -- 172.21.15.170:0/3945030569 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf28050 con 0x55b19bf28d10 2024-09-12T17:28:05.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.284+0000 7fefb4d02640 1 -- 172.21.15.170:0/3945030569 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fefa4018ce0 con 0x55b19bf28d10 2024-09-12T17:28:05.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.285+0000 7fefb9122800 1 Processor -- start 2024-09-12T17:28:05.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.285+0000 7fefb9122800 1 -- start start 2024-09-12T17:28:05.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.285+0000 7fefb9122800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19bf3a060 0x55b19bf3a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.285+0000 7fefb9122800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b19bd1ca00 con 0x55b19bf3a060 2024-09-12T17:28:05.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.285+0000 7fefb5503640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19bf3a060 0x55b19bf3a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.285+0000 7fefb5503640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19bf3a060 0x55b19bf3a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43880/0 (socket says 172.21.15.170:43880) 2024-09-12T17:28:05.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.285+0000 7fefb5503640 1 -- 172.21.15.170:0/3489378166 learned_addr learned my addr 172.21.15.170:0/3489378166 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:05.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.286+0000 7fefb5503640 1 -- 172.21.15.170:0/3489378166 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b19bf3aac0 con 0x55b19bf3a060 2024-09-12T17:28:05.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.286+0000 7fefb5503640 1 --2- 172.21.15.170:0/3489378166 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19bf3a060 0x55b19bf3a480 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x55b19bf15470 tx=0x7fefb00167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.286+0000 7fee9a7fc640 1 -- 172.21.15.170:0/3489378166 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefb0013640 con 0x55b19bf3a060 2024-09-12T17:28:05.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.286+0000 7fee9a7fc640 1 -- 172.21.15.170:0/3489378166 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefb00137e0 con 0x55b19bf3a060 2024-09-12T17:28:05.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.286+0000 7fefb9122800 1 -- 172.21.15.170:0/3489378166 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b19bf3b2f0 con 0x55b19bf3a060 2024-09-12T17:28:05.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.286+0000 7fee9a7fc640 1 -- 172.21.15.170:0/3489378166 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefb0013ac0 con 0x55b19bf3a060 2024-09-12T17:28:05.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.286+0000 7fefb9122800 1 -- 172.21.15.170:0/3489378166 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b19bf3b890 con 0x55b19bf3a060 2024-09-12T17:28:05.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.287+0000 7fee9a7fc640 1 -- 172.21.15.170:0/3489378166 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fefb0011040 con 0x55b19bf3a060 2024-09-12T17:28:05.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.287+0000 7fee9a7fc640 1 --2- 172.21.15.170:0/3489378166 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fee8c03c730 0x7fee8c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.287+0000 7fee9a7fc640 1 -- 172.21.15.170:0/3489378166 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fefb000e040 con 0x55b19bf3a060 2024-09-12T17:28:05.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.287+0000 7fefb4d02640 1 --2- 172.21.15.170:0/3489378166 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fee8c03c730 0x7fee8c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.287+0000 7fefb9122800 1 Processor -- start 2024-09-12T17:28:05.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.287+0000 7fefb9122800 1 -- start start 2024-09-12T17:28:05.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.287+0000 7fefb4d02640 1 --2- 172.21.15.170:0/3489378166 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fee8c03c730 0x7fee8c03ebf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fefa4016b40 tx=0x7fefa400e530 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.287+0000 7fefb9122800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19bf46b00 0x55b19bf46f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.287+0000 7fefb9122800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b19bf18380 con 0x55b19bf46b00 2024-09-12T17:28:05.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.288+0000 7fefb5503640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19bf46b00 0x55b19bf46f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.288+0000 7fefb5503640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19bf46b00 0x55b19bf46f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43890/0 (socket says 172.21.15.170:43890) 2024-09-12T17:28:05.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.288+0000 7fefb5503640 1 -- 172.21.15.170:0/244658884 learned_addr learned my addr 172.21.15.170:0/244658884 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:05.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.288+0000 7fefb5503640 1 -- 172.21.15.170:0/244658884 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b19bf474f0 con 0x55b19bf46b00 2024-09-12T17:28:05.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.288+0000 7fefb5503640 1 --2- 172.21.15.170:0/244658884 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19bf46b00 0x55b19bf46f00 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fefb0020000 tx=0x7fefb0013f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e39ad859077bd054 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.288+0000 7fee8bfff640 1 -- 172.21.15.170:0/244658884 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefb0052070 con 0x55b19bf46b00 2024-09-12T17:28:05.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.288+0000 7fee8bfff640 1 -- 172.21.15.170:0/244658884 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefb004a020 con 0x55b19bf46b00 2024-09-12T17:28:05.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.288+0000 7fee8bfff640 1 -- 172.21.15.170:0/244658884 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefb0021440 con 0x55b19bf46b00 2024-09-12T17:28:05.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.289+0000 7fefb9122800 1 -- 172.21.15.170:0/244658884 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19bf46b00 msgr2=0x55b19bf46f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.289+0000 7fefb9122800 1 --2- 172.21.15.170:0/244658884 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19bf46b00 0x55b19bf46f00 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fefb0020000 tx=0x7fefb0013f00 comp rx=0 tx=0).stop 2024-09-12T17:28:05.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.289+0000 7fefb9122800 1 -- 172.21.15.170:0/244658884 shutdown_connections 2024-09-12T17:28:05.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.289+0000 7fefb9122800 1 --2- 172.21.15.170:0/244658884 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19bf46b00 0x55b19bf46f00 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.289+0000 7fefb9122800 1 -- 172.21.15.170:0/244658884 >> 172.21.15.170:0/244658884 conn(0x55b19bf42f00 msgr2=0x55b19bf41140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:05.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.289+0000 7fefb9122800 1 -- 172.21.15.170:0/244658884 shutdown_connections 2024-09-12T17:28:05.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.289+0000 7fefb9122800 1 -- 172.21.15.170:0/244658884 wait complete. 2024-09-12T17:28:05.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.289+0000 7fefb9122800 1 Processor -- start 2024-09-12T17:28:05.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.289+0000 7fefb9122800 1 -- start start 2024-09-12T17:28:05.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.289+0000 7fefb9122800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19bf46b00 0x55b19bf4e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.289+0000 7fefb9122800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b19bf47ae0 con 0x55b19bf46b00 2024-09-12T17:28:05.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.289+0000 7fefb5503640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19bf46b00 0x55b19bf4e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.289+0000 7fefb5503640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19bf46b00 0x55b19bf4e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43900/0 (socket says 172.21.15.170:43900) 2024-09-12T17:28:05.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.289+0000 7fefb5503640 1 -- 172.21.15.170:0/776286597 learned_addr learned my addr 172.21.15.170:0/776286597 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:05.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.290+0000 7fefb5503640 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b19bf4e650 con 0x55b19bf46b00 2024-09-12T17:28:05.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.290+0000 7fefb5503640 1 --2- 172.21.15.170:0/776286597 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19bf46b00 0x55b19bf4e0f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fefb00208e0 tx=0x7fefb0053d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.290+0000 7fee8a7fc640 1 -- 172.21.15.170:0/776286597 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefb0039070 con 0x55b19bf46b00 2024-09-12T17:28:05.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.290+0000 7fee8a7fc640 1 -- 172.21.15.170:0/776286597 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefb001f710 con 0x55b19bf46b00 2024-09-12T17:28:05.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.290+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b19bf4e8e0 con 0x55b19bf46b00 2024-09-12T17:28:05.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.290+0000 7fee8a7fc640 1 -- 172.21.15.170:0/776286597 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefb001fdc0 con 0x55b19bf46b00 2024-09-12T17:28:05.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.290+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b19bf4e8e0 con 0x55b19bf46b00 2024-09-12T17:28:05.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.291+0000 7fee8a7fc640 1 -- 172.21.15.170:0/776286597 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fefb003c070 con 0x55b19bf46b00 2024-09-12T17:28:05.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.291+0000 7fee8a7fc640 1 --2- 172.21.15.170:0/776286597 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fee8003c780 0x7fee8003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.291+0000 7fee8a7fc640 1 -- 172.21.15.170:0/776286597 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fefb004b070 con 0x55b19bf46b00 2024-09-12T17:28:05.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.291+0000 7fefb4d02640 1 --2- 172.21.15.170:0/776286597 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fee8003c780 0x7fee8003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.292+0000 7fefb4d02640 1 --2- 172.21.15.170:0/776286597 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fee8003c780 0x7fee8003ec40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fefa401afd0 tx=0x7fefa4049000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.292+0000 7fefb9122800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.292+0000 7fefb9122800 1 --2- 172.21.15.170:0/776286597 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b19bf597e0 0x55b19bf5bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.292+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf5c3f0 con 0x55b19bf597e0 2024-09-12T17:28:05.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.292+0000 7fefac501640 1 --2- 172.21.15.170:0/776286597 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b19bf597e0 0x55b19bf5bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.292+0000 7fefac501640 1 --2- 172.21.15.170:0/776286597 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b19bf597e0 0x55b19bf5bca0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.292+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef9c051070 con 0x55b19bf597e0 2024-09-12T17:28:05.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.292+0000 7fefb9122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:05.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.292+0000 7fefb9122800 20 realm 2024-09-12T17:28:05.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.292+0000 7fefb9122800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.292+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf5c820 con 0x55b19bf597e0 2024-09-12T17:28:05.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.293+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef9c051070 con 0x55b19bf597e0 2024-09-12T17:28:05.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.293+0000 7fefb9122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:05.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.293+0000 7fefb9122800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:05.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.293+0000 7fefb9122800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.293+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf5d0f0 con 0x55b19bf597e0 2024-09-12T17:28:05.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.293+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef9c051070 con 0x55b19bf597e0 2024-09-12T17:28:05.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.293+0000 7fefb9122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:05.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.293+0000 7fefb9122800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.293+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf5d490 con 0x55b19bf597e0 2024-09-12T17:28:05.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.293+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fef9c051070 con 0x55b19bf597e0 2024-09-12T17:28:05.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.293+0000 7fefb9122800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:05.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.293+0000 7fefb9122800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.293+0000 7fefb9122800 1 --2- 172.21.15.170:0/776286597 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b19bf5e1f0 0x55b19bf605e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.293+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf60bf0 con 0x55b19bf5e1f0 2024-09-12T17:28:05.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.293+0000 7fefb5503640 1 --2- 172.21.15.170:0/776286597 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b19bf5e1f0 0x55b19bf605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.294+0000 7fefb5503640 1 --2- 172.21.15.170:0/776286597 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b19bf5e1f0 0x55b19bf605e0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.294+0000 7fefb5503640 1 -- 172.21.15.170:0/776286597 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fefb003b030 con 0x55b19bf5e1f0 2024-09-12T17:28:05.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.294+0000 7fefb9122800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:05.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.294+0000 7fefb9122800 20 searching for the correct realm 2024-09-12T17:28:05.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.294+0000 7fefb9122800 1 --2- 172.21.15.170:0/776286597 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55b19bf62ba0 0x55b19bf65060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.294+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf656e0 con 0x55b19bf62ba0 2024-09-12T17:28:05.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.294+0000 7fefb4d02640 1 --2- 172.21.15.170:0/776286597 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55b19bf62ba0 0x55b19bf65060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.294+0000 7fefb4d02640 1 --2- 172.21.15.170:0/776286597 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55b19bf62ba0 0x55b19bf65060 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.294+0000 7fefb4d02640 1 -- 172.21.15.170:0/776286597 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefa4034050 con 0x55b19bf62ba0 2024-09-12T17:28:05.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.295+0000 7fefb4d02640 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf656e0 con 0x55b19bf5e1f0 2024-09-12T17:28:05.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.295+0000 7fefb5503640 1 -- 172.21.15.170:0/776286597 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefb003b030 con 0x55b19bf5e1f0 2024-09-12T17:28:05.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.295+0000 7fefb5503640 1 --2- 172.21.15.170:0/776286597 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fefb003e060 0x7fefb00559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.295+0000 7fefb5503640 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf656e0 con 0x7fefb003e060 2024-09-12T17:28:05.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.295+0000 7fefac501640 1 --2- 172.21.15.170:0/776286597 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fefb003e060 0x7fefb00559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.295+0000 7fefac501640 1 --2- 172.21.15.170:0/776286597 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fefb003e060 0x7fefb00559a0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.296+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef9c051070 con 0x7fefb003e060 2024-09-12T17:28:05.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.296+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf656e0 con 0x55b19bf597e0 2024-09-12T17:28:05.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.296+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef9c051070 con 0x55b19bf597e0 2024-09-12T17:28:05.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.296+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf656e0 con 0x55b19bf597e0 2024-09-12T17:28:05.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.296+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef9c051070 con 0x55b19bf597e0 2024-09-12T17:28:05.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.296+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf656e0 con 0x7fefb003e060 2024-09-12T17:28:05.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.296+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef9c051070 con 0x7fefb003e060 2024-09-12T17:28:05.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.296+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf656e0 con 0x7fefb003e060 2024-09-12T17:28:05.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.297+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef9c051070 con 0x7fefb003e060 2024-09-12T17:28:05.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.297+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf656e0 con 0x55b19bf5e1f0 2024-09-12T17:28:05.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.297+0000 7fefb5503640 1 -- 172.21.15.170:0/776286597 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefb003b030 con 0x55b19bf5e1f0 2024-09-12T17:28:05.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.297+0000 7fefb5503640 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf656e0 con 0x55b19bf62ba0 2024-09-12T17:28:05.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.297+0000 7fefb4d02640 1 -- 172.21.15.170:0/776286597 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefa4034050 con 0x55b19bf62ba0 2024-09-12T17:28:05.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.297+0000 7fefb4d02640 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf656e0 con 0x55b19bf597e0 2024-09-12T17:28:05.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.297+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef9c051070 con 0x55b19bf597e0 2024-09-12T17:28:05.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.297+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf656e0 con 0x7fefb003e060 2024-09-12T17:28:05.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.298+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef9c051070 con 0x7fefb003e060 2024-09-12T17:28:05.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.298+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf656e0 con 0x55b19bf597e0 2024-09-12T17:28:05.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.298+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef9c051070 con 0x55b19bf597e0 2024-09-12T17:28:05.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.298+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf656e0 con 0x55b19bf5e1f0 2024-09-12T17:28:05.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.298+0000 7fefb5503640 1 -- 172.21.15.170:0/776286597 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fefb003b030 con 0x55b19bf5e1f0 2024-09-12T17:28:05.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.298+0000 7fefb5503640 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf656e0 con 0x55b19bf62ba0 2024-09-12T17:28:05.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.298+0000 7fefb4d02640 1 -- 172.21.15.170:0/776286597 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefa4034050 con 0x55b19bf62ba0 2024-09-12T17:28:05.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.298+0000 7fefb4d02640 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf656e0 con 0x55b19bf62ba0 2024-09-12T17:28:05.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.299+0000 7fefb4d02640 1 -- 172.21.15.170:0/776286597 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefa4034050 con 0x55b19bf62ba0 2024-09-12T17:28:05.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.299+0000 7fefb4d02640 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf656e0 con 0x7fefb003e060 2024-09-12T17:28:05.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.299+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef9c051070 con 0x7fefb003e060 2024-09-12T17:28:05.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.299+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf656e0 con 0x55b19bf62ba0 2024-09-12T17:28:05.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.299+0000 7fefb4d02640 1 -- 172.21.15.170:0/776286597 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefa4034050 con 0x55b19bf62ba0 2024-09-12T17:28:05.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.299+0000 7fefb4d02640 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf656e0 con 0x55b19bf62ba0 2024-09-12T17:28:05.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.299+0000 7fefb4d02640 1 -- 172.21.15.170:0/776286597 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefa4034050 con 0x55b19bf62ba0 2024-09-12T17:28:05.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.299+0000 7fefb4d02640 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf656e0 con 0x55b19bf597e0 2024-09-12T17:28:05.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.299+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef9c051070 con 0x55b19bf597e0 2024-09-12T17:28:05.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.299+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf656e0 con 0x55b19bf597e0 2024-09-12T17:28:05.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.300+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fef9c051070 con 0x55b19bf597e0 2024-09-12T17:28:05.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.300+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf656e0 con 0x7fefb003e060 2024-09-12T17:28:05.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.300+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef9c051070 con 0x7fefb003e060 2024-09-12T17:28:05.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.300+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf656e0 con 0x55b19bf62ba0 2024-09-12T17:28:05.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.300+0000 7fefb4d02640 1 -- 172.21.15.170:0/776286597 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefa4034050 con 0x55b19bf62ba0 2024-09-12T17:28:05.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.300+0000 7fefb4d02640 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf656e0 con 0x55b19bf5e1f0 2024-09-12T17:28:05.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.300+0000 7fefb5503640 1 -- 172.21.15.170:0/776286597 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefb003b030 con 0x55b19bf5e1f0 2024-09-12T17:28:05.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.300+0000 7fefb5503640 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf656e0 con 0x55b19bf597e0 2024-09-12T17:28:05.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.301+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef9c051070 con 0x55b19bf597e0 2024-09-12T17:28:05.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.301+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf656e0 con 0x7fefb003e060 2024-09-12T17:28:05.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.301+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef9c051070 con 0x7fefb003e060 2024-09-12T17:28:05.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.301+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf656e0 con 0x55b19bf62ba0 2024-09-12T17:28:05.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.301+0000 7fefb4d02640 1 -- 172.21.15.170:0/776286597 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefa4034050 con 0x55b19bf62ba0 2024-09-12T17:28:05.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.301+0000 7fefb4d02640 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf656e0 con 0x7fefb003e060 2024-09-12T17:28:05.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.301+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef9c051070 con 0x7fefb003e060 2024-09-12T17:28:05.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.301+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf656e0 con 0x55b19bf5e1f0 2024-09-12T17:28:05.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.302+0000 7fefb5503640 1 -- 172.21.15.170:0/776286597 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefb003b030 con 0x55b19bf5e1f0 2024-09-12T17:28:05.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.302+0000 7fefb5503640 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf656e0 con 0x55b19bf62ba0 2024-09-12T17:28:05.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.302+0000 7fefb4d02640 1 -- 172.21.15.170:0/776286597 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefa4034050 con 0x55b19bf62ba0 2024-09-12T17:28:05.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.302+0000 7fefb4d02640 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf656e0 con 0x7fefb003e060 2024-09-12T17:28:05.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.302+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef9c051070 con 0x7fefb003e060 2024-09-12T17:28:05.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.302+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf656e0 con 0x55b19bf597e0 2024-09-12T17:28:05.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.302+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fef9c051070 con 0x55b19bf597e0 2024-09-12T17:28:05.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.302+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf656e0 con 0x55b19bf5e1f0 2024-09-12T17:28:05.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.303+0000 7fefb5503640 1 -- 172.21.15.170:0/776286597 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fefb0069040 con 0x55b19bf5e1f0 2024-09-12T17:28:05.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.303+0000 7fefb9122800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:05.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.303+0000 7fefb9122800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:05.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.303+0000 7fefb9122800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:05.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.303+0000 7fefb9122800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:05.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.303+0000 7fefb9122800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:05.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.303+0000 7fefb9122800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:05.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.303+0000 7fefb9122800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.303+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf615b0 con 0x55b19bf597e0 2024-09-12T17:28:05.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.303+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef9c051070 con 0x55b19bf597e0 2024-09-12T17:28:05.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.303+0000 7fefb9122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:05.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.303+0000 7fefb9122800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.303+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf61e50 con 0x55b19bf597e0 2024-09-12T17:28:05.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.303+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fef9c051070 con 0x55b19bf597e0 2024-09-12T17:28:05.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.303+0000 7fefb9122800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:05.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.303+0000 7fefb9122800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.303+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf611f0 con 0x55b19bf5e1f0 2024-09-12T17:28:05.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.303+0000 7fefb5503640 1 -- 172.21.15.170:0/776286597 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fefb0069040 con 0x55b19bf5e1f0 2024-09-12T17:28:05.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.303+0000 7fefb9122800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:05.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.303+0000 7fefb9122800 20 zone default found 2024-09-12T17:28:05.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.303+0000 7fefb9122800 4 Realm: () 2024-09-12T17:28:05.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.303+0000 7fefb9122800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:05.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.303+0000 7fefb9122800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:05.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.303+0000 7fefb9122800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:05.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.303+0000 7fefb9122800 20 zonegroup default 2024-09-12T17:28:05.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.304+0000 7fefb9122800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.304+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf66010 con 0x7fefb003e060 2024-09-12T17:28:05.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.304+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fef9c051070 con 0x7fefb003e060 2024-09-12T17:28:05.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.304+0000 7fefb9122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:05.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.304+0000 7fefb9122800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.304+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf68250 con 0x55b19bf62ba0 2024-09-12T17:28:05.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.304+0000 7fefb4d02640 1 -- 172.21.15.170:0/776286597 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fefa4034050 con 0x55b19bf62ba0 2024-09-12T17:28:05.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.304+0000 7fefb9122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:05.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.304+0000 7fefb9122800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.304+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf685f0 con 0x55b19bf62ba0 2024-09-12T17:28:05.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.304+0000 7fefb4d02640 1 -- 172.21.15.170:0/776286597 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fefa4034050 con 0x55b19bf62ba0 2024-09-12T17:28:05.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.304+0000 7fefb9122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:05.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.304+0000 7fefb9122800 20 started sync module instance, tier type = 2024-09-12T17:28:05.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.304+0000 7fefb9122800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:05.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.304+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf67730 con 0x55b19bf5e1f0 2024-09-12T17:28:05.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.305+0000 7fefb5503640 1 -- 172.21.15.170:0/776286597 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefb0069040 con 0x55b19bf5e1f0 2024-09-12T17:28:05.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.305+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94221314194208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf68eb0 con 0x55b19bf5e1f0 2024-09-12T17:28:05.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.305+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf69700 con 0x55b19bf597e0 2024-09-12T17:28:05.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.306+0000 7fefb5503640 1 -- 172.21.15.170:0/776286597 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94221314194208] v29'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefb0069040 con 0x55b19bf5e1f0 2024-09-12T17:28:05.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.307+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef9c051070 con 0x55b19bf597e0 2024-09-12T17:28:05.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.307+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94221314198288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf69420 con 0x55b19bf597e0 2024-09-12T17:28:05.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.307+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf69f30 con 0x55b19bf62ba0 2024-09-12T17:28:05.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.308+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94221314198288] v29'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef9c051070 con 0x55b19bf597e0 2024-09-12T17:28:05.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.308+0000 7fefb4d02640 1 -- 172.21.15.170:0/776286597 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefa4034050 con 0x55b19bf62ba0 2024-09-12T17:28:05.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.308+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94221314202080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf6a320 con 0x55b19bf62ba0 2024-09-12T17:28:05.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.308+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf6ad20 con 0x55b19bf5e1f0 2024-09-12T17:28:05.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.309+0000 7fefb5503640 1 -- 172.21.15.170:0/776286597 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefb0069040 con 0x55b19bf5e1f0 2024-09-12T17:28:05.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.309+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94221314205744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf6b5c0 con 0x55b19bf5e1f0 2024-09-12T17:28:05.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.309+0000 7fefb4d02640 1 -- 172.21.15.170:0/776286597 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94221314202080] v29'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefa4034050 con 0x55b19bf62ba0 2024-09-12T17:28:05.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.309+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf6c0c0 con 0x55b19bf597e0 2024-09-12T17:28:05.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.310+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef9c051070 con 0x55b19bf597e0 2024-09-12T17:28:05.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.310+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94221314199472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf6c080 con 0x55b19bf597e0 2024-09-12T17:28:05.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.310+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf6cb00 con 0x7fefb003e060 2024-09-12T17:28:05.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.310+0000 7fefb5503640 1 -- 172.21.15.170:0/776286597 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94221314205744] v29'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefb0069040 con 0x55b19bf5e1f0 2024-09-12T17:28:05.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.311+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94221314199472] v29'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef9c051070 con 0x55b19bf597e0 2024-09-12T17:28:05.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.311+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef9c051070 con 0x7fefb003e060 2024-09-12T17:28:05.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.311+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94221314210736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf6cac0 con 0x7fefb003e060 2024-09-12T17:28:05.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.311+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf6d3a0 con 0x7fefb003e060 2024-09-12T17:28:05.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.312+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94221314210736] v29'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef9c051070 con 0x7fefb003e060 2024-09-12T17:28:05.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.312+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(56 notify.6 [create] v29'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef9c051070 con 0x7fefb003e060 2024-09-12T17:28:05.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.312+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94221314213360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf6cf70 con 0x7fefb003e060 2024-09-12T17:28:05.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.312+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf6d970 con 0x7fefb003e060 2024-09-12T17:28:05.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.313+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(58 notify.7 [create] v29'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef9c051070 con 0x7fefb003e060 2024-09-12T17:28:05.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.313+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94221314217088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf6dd90 con 0x7fefb003e060 2024-09-12T17:28:05.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.313+0000 7fefb9122800 20 add_watcher() i=0 2024-09-12T17:28:05.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.313+0000 7fefb9122800 20 add_watcher() i=1 2024-09-12T17:28:05.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.313+0000 7fefb9122800 20 add_watcher() i=2 2024-09-12T17:28:05.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.313+0000 7fefb9122800 20 add_watcher() i=3 2024-09-12T17:28:05.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.313+0000 7fefb9122800 20 add_watcher() i=4 2024-09-12T17:28:05.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.313+0000 7fefb9122800 20 add_watcher() i=5 2024-09-12T17:28:05.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.313+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94221314213360] v29'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef9c051070 con 0x7fefb003e060 2024-09-12T17:28:05.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.313+0000 7fefb9122800 20 add_watcher() i=6 2024-09-12T17:28:05.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.314+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94221314217088] v29'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef9c051070 con 0x7fefb003e060 2024-09-12T17:28:05.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.314+0000 7fefb9122800 20 add_watcher() i=7 2024-09-12T17:28:05.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.314+0000 7fefb9122800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:05.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.314+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf6cac0 con 0x55b19bf597e0 2024-09-12T17:28:05.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.314+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fef9c051070 con 0x55b19bf597e0 2024-09-12T17:28:05.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.314+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94221314218144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf6cac0 con 0x55b19bf597e0 2024-09-12T17:28:05.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.315+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94221314218144] v29'139 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fef9c051070 con 0x55b19bf597e0 2024-09-12T17:28:05.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.315+0000 7fee6afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:05.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.315+0000 7fefb9122800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:05.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.315+0000 7fefb9122800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:05.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.315+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf79720 con 0x55b19bf597e0 2024-09-12T17:28:05.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.317+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fef9c051070 con 0x55b19bf597e0 2024-09-12T17:28:05.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.317+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf79720 con 0x7fefb003e060 2024-09-12T17:28:05.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.318+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fef9c051070 con 0x7fefb003e060 2024-09-12T17:28:05.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.318+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf7a140 con 0x55b19bf62ba0 2024-09-12T17:28:05.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.319+0000 7fefb4d02640 1 -- 172.21.15.170:0/776286597 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fefa4034050 con 0x55b19bf62ba0 2024-09-12T17:28:05.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.319+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf7a570 con 0x55b19bf597e0 2024-09-12T17:28:05.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.320+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'140 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fef9c051070 con 0x55b19bf597e0 2024-09-12T17:28:05.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.320+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf7ac40 con 0x55b19bf5e1f0 2024-09-12T17:28:05.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.321+0000 7fefb5503640 1 -- 172.21.15.170:0/776286597 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'41 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fefb0069040 con 0x55b19bf5e1f0 2024-09-12T17:28:05.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.321+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf7ac40 con 0x55b19bf62ba0 2024-09-12T17:28:05.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.322+0000 7fefb4d02640 1 -- 172.21.15.170:0/776286597 <== osd.3 v2:172.21.15.170:6816/2664906588 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'27 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fefa4034050 con 0x55b19bf62ba0 2024-09-12T17:28:05.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.322+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf7a600 con 0x55b19bf597e0 2024-09-12T17:28:05.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.323+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fef9c051070 con 0x55b19bf597e0 2024-09-12T17:28:05.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.323+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf7a600 con 0x7fefb003e060 2024-09-12T17:28:05.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.324+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'27 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fef9c051070 con 0x7fefb003e060 2024-09-12T17:28:05.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.324+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf7b070 con 0x55b19bf5e1f0 2024-09-12T17:28:05.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.325+0000 7fefb5503640 1 -- 172.21.15.170:0/776286597 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fefb0069040 con 0x55b19bf5e1f0 2024-09-12T17:28:05.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.325+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf7b070 con 0x55b19bf62ba0 2024-09-12T17:28:05.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.326+0000 7fefb4d02640 1 -- 172.21.15.170:0/776286597 <== osd.3 v2:172.21.15.170:6816/2664906588 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fefa4034050 con 0x55b19bf62ba0 2024-09-12T17:28:05.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.326+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf7b070 con 0x55b19bf5e1f0 2024-09-12T17:28:05.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.326+0000 7fefb5503640 1 -- 172.21.15.170:0/776286597 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'42 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fefb0069040 con 0x55b19bf5e1f0 2024-09-12T17:28:05.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.326+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf7b070 con 0x7fefb003e060 2024-09-12T17:28:05.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.328+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef9c051070 con 0x7fefb003e060 2024-09-12T17:28:05.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.328+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf7b100 con 0x55b19bf5e1f0 2024-09-12T17:28:05.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.328+0000 7fefb5503640 1 -- 172.21.15.170:0/776286597 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fefb0069040 con 0x55b19bf5e1f0 2024-09-12T17:28:05.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.329+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf7b100 con 0x7fefb003e060 2024-09-12T17:28:05.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.329+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'33 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef9c051070 con 0x7fefb003e060 2024-09-12T17:28:05.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.330+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf7b100 con 0x55b19bf597e0 2024-09-12T17:28:05.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.330+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'141 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef9c051070 con 0x55b19bf597e0 2024-09-12T17:28:05.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.330+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf7b1c0 con 0x55b19bf62ba0 2024-09-12T17:28:05.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.331+0000 7fefb4d02640 1 -- 172.21.15.170:0/776286597 <== osd.3 v2:172.21.15.170:6816/2664906588 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'35 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fefa4034050 con 0x55b19bf62ba0 2024-09-12T17:28:05.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.331+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf7b250 con 0x55b19bf5e1f0 2024-09-12T17:28:05.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.332+0000 7fefb5503640 1 -- 172.21.15.170:0/776286597 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'43 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fefb0069040 con 0x55b19bf5e1f0 2024-09-12T17:28:05.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.332+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf7b250 con 0x55b19bf62ba0 2024-09-12T17:28:05.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.333+0000 7fefb4d02640 1 -- 172.21.15.170:0/776286597 <== osd.3 v2:172.21.15.170:6816/2664906588 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fefa4034050 con 0x55b19bf62ba0 2024-09-12T17:28:05.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.333+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf7b250 con 0x55b19bf597e0 2024-09-12T17:28:05.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.334+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef9c051070 con 0x55b19bf597e0 2024-09-12T17:28:05.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.334+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf7b250 con 0x55b19bf597e0 2024-09-12T17:28:05.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.335+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'142 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef9c051070 con 0x55b19bf597e0 2024-09-12T17:28:05.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.335+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf7b250 con 0x55b19bf62ba0 2024-09-12T17:28:05.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.336+0000 7fefb4d02640 1 -- 172.21.15.170:0/776286597 <== osd.3 v2:172.21.15.170:6816/2664906588 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'36 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fefa4034050 con 0x55b19bf62ba0 2024-09-12T17:28:05.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.336+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf7b1c0 con 0x55b19bf5e1f0 2024-09-12T17:28:05.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.337+0000 7fefb5503640 1 -- 172.21.15.170:0/776286597 <== osd.2 v2:172.21.15.170:6808/3855567754 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fefb0069040 con 0x55b19bf5e1f0 2024-09-12T17:28:05.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.337+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf7b1c0 con 0x55b19bf62ba0 2024-09-12T17:28:05.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.338+0000 7fefb4d02640 1 -- 172.21.15.170:0/776286597 <== osd.3 v2:172.21.15.170:6816/2664906588 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fefa4034050 con 0x55b19bf62ba0 2024-09-12T17:28:05.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.338+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf7b1e0 con 0x55b19bf62ba0 2024-09-12T17:28:05.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.339+0000 7fefb4d02640 1 -- 172.21.15.170:0/776286597 <== osd.3 v2:172.21.15.170:6816/2664906588 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fefa4034050 con 0x55b19bf62ba0 2024-09-12T17:28:05.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.339+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf7b1e0 con 0x55b19bf62ba0 2024-09-12T17:28:05.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.340+0000 7fefb4d02640 1 -- 172.21.15.170:0/776286597 <== osd.3 v2:172.21.15.170:6816/2664906588 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fefa4034050 con 0x55b19bf62ba0 2024-09-12T17:28:05.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.340+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf7b1e0 con 0x55b19bf62ba0 2024-09-12T17:28:05.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.341+0000 7fefb4d02640 1 -- 172.21.15.170:0/776286597 <== osd.3 v2:172.21.15.170:6816/2664906588 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fefa4034050 con 0x55b19bf62ba0 2024-09-12T17:28:05.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.341+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf7b1e0 con 0x7fefb003e060 2024-09-12T17:28:05.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.342+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef9c051070 con 0x7fefb003e060 2024-09-12T17:28:05.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.342+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf7b1e0 con 0x55b19bf62ba0 2024-09-12T17:28:05.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.343+0000 7fefb4d02640 1 -- 172.21.15.170:0/776286597 <== osd.3 v2:172.21.15.170:6816/2664906588 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fefa4034050 con 0x55b19bf62ba0 2024-09-12T17:28:05.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.343+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf7b1e0 con 0x7fefb003e060 2024-09-12T17:28:05.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.345+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.0 v2:172.21.15.47:6800/3978157098 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef9c051070 con 0x7fefb003e060 2024-09-12T17:28:05.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.345+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf7b1e0 con 0x55b19bf62ba0 2024-09-12T17:28:05.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.346+0000 7fefb4d02640 1 -- 172.21.15.170:0/776286597 <== osd.3 v2:172.21.15.170:6816/2664906588 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'37 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fefa4034050 con 0x55b19bf62ba0 2024-09-12T17:28:05.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.346+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf7b1e0 con 0x7fefb003e060 2024-09-12T17:28:05.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.347+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.0 v2:172.21.15.47:6800/3978157098 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'34 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef9c051070 con 0x7fefb003e060 2024-09-12T17:28:05.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.347+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bf7b1e0 con 0x55b19bf5e1f0 2024-09-12T17:28:05.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.348+0000 7fefb5503640 1 -- 172.21.15.170:0/776286597 <== osd.2 v2:172.21.15.170:6808/3855567754 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fefb0069040 con 0x55b19bf5e1f0 2024-09-12T17:28:05.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.348+0000 7fee69fe3640 20 reqs_thread_entry: start 2024-09-12T17:28:05.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.348+0000 7fefb9122800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:05.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.348+0000 7fefb9122800 20 Filter name: none 2024-09-12T17:28:05.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.348+0000 7feddb7fe640 20 reqs_thread_entry: start 2024-09-12T17:28:05.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.348+0000 7fefb9122800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T17:28:05.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.348+0000 7fefb9122800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.348+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b19bfa62d0 con 0x55b19bf5e1f0 2024-09-12T17:28:05.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.349+0000 7fefb5503640 1 -- 172.21.15.170:0/776286597 <== osd.2 v2:172.21.15.170:6808/3855567754 20 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fefb0069040 con 0x55b19bf5e1f0 2024-09-12T17:28:05.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.349+0000 7fefb9122800 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T17:28:05.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.349+0000 7fefb9122800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-12T17:28:05.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.349+0000 7fefb9122800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:28:05.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.349+0000 7fefb9122800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 : miss 2024-09-12T17:28:05.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.349+0000 7fefb9122800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.349+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:95 8.1d 8:baccd554:root::.bucket.meta.myfoo%3a7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b19bfa7cd0 con 0x7fefb003e060 2024-09-12T17:28:05.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.349+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.0 v2:172.21.15.47:6800/3978157098 24 ==== osd_op_reply(95 .bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fef9c051070 con 0x7fefb003e060 2024-09-12T17:28:05.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.349+0000 7fefb9122800 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T17:28:05.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.349+0000 7fefb9122800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 info.flags=0x17 2024-09-12T17:28:05.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.349+0000 7fefb9122800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 to cache LRU end 2024-09-12T17:28:05.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.349+0000 7fefb9122800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:05.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.349+0000 7fefb9122800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:28:05.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.349+0000 7fefb9122800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 2024-09-12T17:28:05.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.349+0000 7fefb9122800 20 get_obj_state: octx=0x7fefb00162f0 obj=myfoo:four state=0x55b19bfa8a88 s->prefetch_data=0 2024-09-12T17:28:05.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.349+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:96 3.38 3:1c6c31cb:::7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b19bfa9b90 con 0x7fefb003e060 2024-09-12T17:28:05.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.350+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.0 v2:172.21.15.47:6800/3978157098 25 ==== osd_op_reply(96 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1_four [getxattrs out=849b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 234+0+865 (crc 0 0 0) 0x7fef9c051070 con 0x7fefb003e060 2024-09-12T17:28:05.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.350+0000 7fefb9122800 10 manifest: total_size = 4 2024-09-12T17:28:05.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.350+0000 7fefb9122800 20 get_obj_state: setting s->obj_tag to 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.6196845561310230817 2024-09-12T17:28:05.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.350+0000 7fefb9122800 20 get_obj_state: octx=0x7fefb00162f0 obj=myfoo:four state=0x55b19bfa8a88 s->prefetch_data=0 2024-09-12T17:28:05.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.350+0000 7fefb9122800 20 prepare_atomic_modification: state is not atomic. state=0x55b19bfa8a88 2024-09-12T17:28:05.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.350+0000 7fefb9122800 20 bucket index object: :.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.6 2024-09-12T17:28:05.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.350+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:97 4.3e 4:7f412122:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bfae630 con 0x55b19bf5e1f0 2024-09-12T17:28:05.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.351+0000 7fefb5503640 1 -- 172.21.15.170:0/776286597 <== osd.2 v2:172.21.15.170:6808/3855567754 21 ==== osd_op_reply(97 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.6 [stat,call,call] v29'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fefb0069040 con 0x55b19bf5e1f0 2024-09-12T17:28:05.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.351+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:98 3.38 3:1c6c31cb:::7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bfae630 con 0x7fefb003e060 2024-09-12T17:28:05.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.352+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.0 v2:172.21.15.47:6800/3978157098 26 ==== osd_op_reply(98 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1_four [call] v29'2 uv2 ondisk = 0) ==== 192+0+0 (crc 0 0 0) 0x7fef9c051070 con 0x7fefb003e060 2024-09-12T17:28:05.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.352+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:99 4.3e 4:7f412122:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bfaef60 con 0x55b19bf5e1f0 2024-09-12T17:28:05.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.353+0000 7fee6afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:05.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.353+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94221314218144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bfaef60 con 0x55b19bf597e0 2024-09-12T17:28:05.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.353+0000 7fefb5503640 1 -- 172.21.15.170:0/776286597 <== osd.2 v2:172.21.15.170:6808/3855567754 22 ==== osd_op_reply(99 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.6 [stat,call,call] v29'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fefb0069040 con 0x55b19bf5e1f0 2024-09-12T17:28:05.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.353+0000 7fee8bfff640 20 handle_completion(): completion ok for obj=four 2024-09-12T17:28:05.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.354+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94221314218144] v29'143 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fef9c051070 con 0x55b19bf597e0 2024-09-12T17:28:05.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.354+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94221314194208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bfaef60 con 0x55b19bf5e1f0 2024-09-12T17:28:05.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.355+0000 7fefb5503640 1 -- 172.21.15.170:0/776286597 <== osd.2 v2:172.21.15.170:6808/3855567754 23 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94221314194208] v29'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefb0069040 con 0x55b19bf5e1f0 2024-09-12T17:28:05.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.355+0000 7fefb9122800 20 remove_watcher() i=0 2024-09-12T17:28:05.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.355+0000 7fefb9122800 2 removed watcher, disabling cache 2024-09-12T17:28:05.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.355+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94221314198288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bfaef60 con 0x55b19bf597e0 2024-09-12T17:28:05.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.356+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94221314198288] v29'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef9c051070 con 0x55b19bf597e0 2024-09-12T17:28:05.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.356+0000 7fefb9122800 20 remove_watcher() i=1 2024-09-12T17:28:05.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.356+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94221314202080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bfaef60 con 0x55b19bf62ba0 2024-09-12T17:28:05.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.357+0000 7fefb4d02640 1 -- 172.21.15.170:0/776286597 <== osd.3 v2:172.21.15.170:6816/2664906588 26 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94221314202080] v29'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefa4034050 con 0x55b19bf62ba0 2024-09-12T17:28:05.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.357+0000 7fefb9122800 20 remove_watcher() i=2 2024-09-12T17:28:05.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.357+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94221314205744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bfaef60 con 0x55b19bf5e1f0 2024-09-12T17:28:05.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.358+0000 7fefb5503640 1 -- 172.21.15.170:0/776286597 <== osd.2 v2:172.21.15.170:6808/3855567754 24 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94221314205744] v29'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefb0069040 con 0x55b19bf5e1f0 2024-09-12T17:28:05.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.358+0000 7fefb9122800 20 remove_watcher() i=3 2024-09-12T17:28:05.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.358+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94221314199472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bfa9a50 con 0x55b19bf597e0 2024-09-12T17:28:05.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.359+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94221314199472] v29'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef9c051070 con 0x55b19bf597e0 2024-09-12T17:28:05.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.359+0000 7fefb9122800 20 remove_watcher() i=4 2024-09-12T17:28:05.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.359+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94221314210736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bfa9a50 con 0x7fefb003e060 2024-09-12T17:28:05.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.360+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.0 v2:172.21.15.47:6800/3978157098 27 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94221314210736] v29'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef9c051070 con 0x7fefb003e060 2024-09-12T17:28:05.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.360+0000 7fefb9122800 20 remove_watcher() i=5 2024-09-12T17:28:05.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.360+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94221314213360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bfa9a50 con 0x7fefb003e060 2024-09-12T17:28:05.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.361+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.0 v2:172.21.15.47:6800/3978157098 28 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94221314213360] v29'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef9c051070 con 0x7fefb003e060 2024-09-12T17:28:05.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.361+0000 7fefb9122800 20 remove_watcher() i=6 2024-09-12T17:28:05.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.361+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94221314217088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b19bfa9a50 con 0x7fefb003e060 2024-09-12T17:28:05.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.362+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 <== osd.0 v2:172.21.15.47:6800/3978157098 29 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94221314217088] v29'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef9c051070 con 0x7fefb003e060 2024-09-12T17:28:05.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.362+0000 7fefb9122800 20 remove_watcher() i=7 2024-09-12T17:28:05.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.362+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fefb003e060 msgr2=0x7fefb00559a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.362+0000 7fefb9122800 1 --2- 172.21.15.170:0/776286597 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fefb003e060 0x7fefb00559a0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.362+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b19bf597e0 msgr2=0x55b19bf5bca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.362+0000 7fefb9122800 1 --2- 172.21.15.170:0/776286597 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b19bf597e0 0x55b19bf5bca0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.362+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b19bf5e1f0 msgr2=0x55b19bf605e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.362+0000 7fefb9122800 1 --2- 172.21.15.170:0/776286597 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b19bf5e1f0 0x55b19bf605e0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.362+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55b19bf62ba0 msgr2=0x55b19bf65060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.362+0000 7fefb9122800 1 --2- 172.21.15.170:0/776286597 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55b19bf62ba0 0x55b19bf65060 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.362+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fee8003c780 msgr2=0x7fee8003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.362+0000 7fefb9122800 1 --2- 172.21.15.170:0/776286597 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fee8003c780 0x7fee8003ec40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fefa401afd0 tx=0x7fefa4049000 comp rx=0 tx=0).stop 2024-09-12T17:28:05.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.362+0000 7fefac501640 1 -- 172.21.15.170:0/776286597 reap_dead start 2024-09-12T17:28:05.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.362+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19bf46b00 msgr2=0x55b19bf4e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.362+0000 7fefb9122800 1 --2- 172.21.15.170:0/776286597 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19bf46b00 0x55b19bf4e0f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fefb00208e0 tx=0x7fefb0053d30 comp rx=0 tx=0).stop 2024-09-12T17:28:05.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.362+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 shutdown_connections 2024-09-12T17:28:05.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.362+0000 7fefb9122800 1 --2- 172.21.15.170:0/776286597 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19bf46b00 0x55b19bf4e0f0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.362+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 >> 172.21.15.170:0/776286597 conn(0x55b19bf42f00 msgr2=0x55b19bf41110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:05.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.362+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 shutdown_connections 2024-09-12T17:28:05.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.362+0000 7fefb9122800 1 -- 172.21.15.170:0/776286597 wait complete. 2024-09-12T17:28:05.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.363+0000 7fefb9122800 1 -- 172.21.15.170:0/3489378166 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fee8c03c730 msgr2=0x7fee8c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.363+0000 7fefb9122800 1 --2- 172.21.15.170:0/3489378166 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fee8c03c730 0x7fee8c03ebf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fefa4016b40 tx=0x7fefa400e530 comp rx=0 tx=0).stop 2024-09-12T17:28:05.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.363+0000 7fefb9122800 1 -- 172.21.15.170:0/3489378166 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19bf3a060 msgr2=0x55b19bf3a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.363+0000 7fefb9122800 1 --2- 172.21.15.170:0/3489378166 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19bf3a060 0x55b19bf3a480 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x55b19bf15470 tx=0x7fefb00167b0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.363+0000 7fefb9122800 1 -- 172.21.15.170:0/3489378166 shutdown_connections 2024-09-12T17:28:05.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.363+0000 7fefb9122800 1 --2- 172.21.15.170:0/3489378166 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fee8c03c730 0x7fee8c03ebf0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.363+0000 7fefb9122800 1 --2- 172.21.15.170:0/3489378166 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19bf3a060 0x55b19bf3a480 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.363+0000 7fefb9122800 1 -- 172.21.15.170:0/3489378166 >> 172.21.15.170:0/3489378166 conn(0x55b19bf2e410 msgr2=0x55b19bf2e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:05.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.363+0000 7fefb9122800 1 -- 172.21.15.170:0/3489378166 shutdown_connections 2024-09-12T17:28:05.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.363+0000 7fefb9122800 1 -- 172.21.15.170:0/3489378166 wait complete. 2024-09-12T17:28:05.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.363+0000 7fefb9122800 1 -- 172.21.15.170:0/3945030569 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b19be26210 msgr2=0x55b19bf263a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.363+0000 7fefb9122800 1 --2- 172.21.15.170:0/3945030569 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b19be26210 0x55b19bf263a0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.363+0000 7fefb9122800 1 -- 172.21.15.170:0/3945030569 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b19bf28d10 msgr2=0x55b19bf2b100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.363+0000 7fefb9122800 1 --2- 172.21.15.170:0/3945030569 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b19bf28d10 0x55b19bf2b100 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.363+0000 7fefb9122800 1 -- 172.21.15.170:0/3945030569 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fee9c03c780 msgr2=0x7fee9c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.363+0000 7fefb9122800 1 --2- 172.21.15.170:0/3945030569 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fee9c03c780 0x7fee9c03ec40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fef9c057000 tx=0x7fef9c052000 comp rx=0 tx=0).stop 2024-09-12T17:28:05.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.363+0000 7fefb9122800 1 -- 172.21.15.170:0/3945030569 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19be24e00 msgr2=0x55b19bf158d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.363+0000 7fefb9122800 1 --2- 172.21.15.170:0/3945030569 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19be24e00 0x55b19bf158d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fefa40012b0 tx=0x7fefa4000ed0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.363+0000 7fefb9122800 1 -- 172.21.15.170:0/3945030569 shutdown_connections 2024-09-12T17:28:05.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.363+0000 7fefb9122800 1 --2- 172.21.15.170:0/3945030569 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b19bf28d10 0x55b19bf2b100 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.363+0000 7fefb9122800 1 --2- 172.21.15.170:0/3945030569 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fee9c03c780 0x7fee9c03ec40 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.363+0000 7fefb9122800 1 --2- 172.21.15.170:0/3945030569 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b19be26210 0x55b19bf263a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.363+0000 7fefb9122800 1 --2- 172.21.15.170:0/3945030569 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19be24e00 0x55b19bf158d0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.363+0000 7fefb9122800 1 -- 172.21.15.170:0/3945030569 >> 172.21.15.170:0/3945030569 conn(0x55b19be201d0 msgr2=0x55b19bf0e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:05.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.363+0000 7fefb9122800 1 -- 172.21.15.170:0/3945030569 shutdown_connections 2024-09-12T17:28:05.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.363+0000 7fefb9122800 1 -- 172.21.15.170:0/3945030569 wait complete. 2024-09-12T17:28:05.374 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-12T17:28:05.374 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-12T17:28:05.374 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-12T17:28:05.418 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:05.418 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:05.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.417+0000 7f3523546800 1 Processor -- start 2024-09-12T17:28:05.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.417+0000 7f3523546800 1 -- start start 2024-09-12T17:28:05.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.417+0000 7f3523546800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5562555d96e0 0x5562555dbad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.417+0000 7f3523546800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556255482e40 con 0x5562555dc010 2024-09-12T17:28:05.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.417+0000 7f3523546800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x55625544d680 con 0x5562555d96e0 2024-09-12T17:28:05.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.417+0000 7f3521037640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5562555d96e0 0x5562555dbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.417+0000 7f351bfff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x5562555dc010 0x5562555de4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:37046/0 (socket says 172.21.15.170:37046) 2024-09-12T17:28:05.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.417+0000 7f351bfff640 1 -- 172.21.15.170:0/3571614559 learned_addr learned my addr 172.21.15.170:0/3571614559 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:28:05.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.418+0000 7f3521037640 1 -- 172.21.15.170:0/3571614559 >> v1:172.21.15.47:6789/0 conn(0x5562555dc010 legacy=0x5562555de4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.418+0000 7f3521037640 1 -- 172.21.15.170:0/3571614559 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562554696b0 con 0x5562555d96e0 2024-09-12T17:28:05.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.418+0000 7f3520836640 1 -- 172.21.15.170:0/3571614559 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2423086097 0 0) 0x556255482e40 con 0x5562555dc010 2024-09-12T17:28:05.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.419+0000 7f3521037640 1 --2- 172.21.15.170:0/3571614559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5562555d96e0 0x5562555dbad0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f351400a470 tx=0x7f3514045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75af626944102ff5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.420+0000 7f3520836640 1 -- 172.21.15.170:0/3571614559 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3514053570 con 0x5562555d96e0 2024-09-12T17:28:05.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.420+0000 7f3520836640 1 -- 172.21.15.170:0/3571614559 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3514058070 con 0x5562555d96e0 2024-09-12T17:28:05.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.420+0000 7f3520836640 1 -- 172.21.15.170:0/3571614559 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3514053880 con 0x5562555d96e0 2024-09-12T17:28:05.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.420+0000 7f3523546800 1 -- 172.21.15.170:0/3571614559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5562555d96e0 msgr2=0x5562555dbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.420+0000 7f3523546800 1 --2- 172.21.15.170:0/3571614559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5562555d96e0 0x5562555dbad0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f351400a470 tx=0x7f3514045a20 comp rx=0 tx=0).stop 2024-09-12T17:28:05.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.420+0000 7f3523546800 1 -- 172.21.15.170:0/3571614559 shutdown_connections 2024-09-12T17:28:05.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.420+0000 7f3523546800 1 --2- 172.21.15.170:0/3571614559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5562555d96e0 0x5562555dbad0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.420+0000 7f3523546800 1 -- 172.21.15.170:0/3571614559 >> 172.21.15.170:0/3571614559 conn(0x5562555d31c0 msgr2=0x5562555d5620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:05.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.420+0000 7f3523546800 1 -- 172.21.15.170:0/3571614559 shutdown_connections 2024-09-12T17:28:05.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.420+0000 7f3523546800 1 -- 172.21.15.170:0/3571614559 wait complete. 2024-09-12T17:28:05.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.434+0000 7f3523546800 1 Processor -- start 2024-09-12T17:28:05.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.434+0000 7f3523546800 1 -- start start 2024-09-12T17:28:05.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.434+0000 7f3523546800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5562555d96e0 0x5562556c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.434+0000 7f3523546800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556255471dd0 con 0x5562555d96e0 2024-09-12T17:28:05.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.434+0000 7f3521037640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5562555d96e0 0x5562556c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.434+0000 7f3521037640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5562555d96e0 0x5562556c84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43926/0 (socket says 172.21.15.170:43926) 2024-09-12T17:28:05.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.434+0000 7f3521037640 1 -- 172.21.15.170:0/2883749593 learned_addr learned my addr 172.21.15.170:0/2883749593 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:05.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.435+0000 7f3521037640 1 -- 172.21.15.170:0/2883749593 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55625548ae10 con 0x5562555d96e0 2024-09-12T17:28:05.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.435+0000 7f3521037640 1 --2- 172.21.15.170:0/2883749593 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5562555d96e0 0x5562556c84d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f3514025c20 tx=0x7f3514051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c32187408fea72ca server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.435+0000 7f340f606640 1 -- 172.21.15.170:0/2883749593 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3514053a20 con 0x5562555d96e0 2024-09-12T17:28:05.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.435+0000 7f340f606640 1 -- 172.21.15.170:0/2883749593 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3514063070 con 0x5562555d96e0 2024-09-12T17:28:05.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.435+0000 7f340f606640 1 -- 172.21.15.170:0/2883749593 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3514053d30 con 0x5562555d96e0 2024-09-12T17:28:05.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.436+0000 7f3523546800 1 -- 172.21.15.170:0/2883749593 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5562555d96e0 msgr2=0x5562556c84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.436+0000 7f3523546800 1 --2- 172.21.15.170:0/2883749593 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5562555d96e0 0x5562556c84d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f3514025c20 tx=0x7f3514051000 comp rx=0 tx=0).stop 2024-09-12T17:28:05.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.436+0000 7f3523546800 1 -- 172.21.15.170:0/2883749593 shutdown_connections 2024-09-12T17:28:05.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.436+0000 7f3523546800 1 --2- 172.21.15.170:0/2883749593 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5562555d96e0 0x5562556c84d0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.436+0000 7f3523546800 1 -- 172.21.15.170:0/2883749593 >> 172.21.15.170:0/2883749593 conn(0x5562555d31c0 msgr2=0x5562556c3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:05.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.436+0000 7f3523546800 1 -- 172.21.15.170:0/2883749593 shutdown_connections 2024-09-12T17:28:05.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.436+0000 7f3523546800 1 -- 172.21.15.170:0/2883749593 wait complete. 2024-09-12T17:28:05.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.436+0000 7f3523546800 1 Processor -- start 2024-09-12T17:28:05.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.436+0000 7f3523546800 1 -- start start 2024-09-12T17:28:05.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.437+0000 7f3523546800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5562555d96e0 0x5562556cfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.437+0000 7f3523546800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5562555e0030 con 0x5562555d96e0 2024-09-12T17:28:05.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.437+0000 7f3521037640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5562555d96e0 0x5562556cfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.437+0000 7f3521037640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5562555d96e0 0x5562556cfdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43942/0 (socket says 172.21.15.170:43942) 2024-09-12T17:28:05.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.437+0000 7f3521037640 1 -- 172.21.15.170:0/127396639 learned_addr learned my addr 172.21.15.170:0/127396639 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:05.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.437+0000 7f3521037640 1 -- 172.21.15.170:0/127396639 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562556d0320 con 0x5562555d96e0 2024-09-12T17:28:05.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.437+0000 7f3521037640 1 --2- 172.21.15.170:0/127396639 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5562555d96e0 0x5562556cfdc0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f3514025c20 tx=0x7f3514002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.437+0000 7f340de03640 1 -- 172.21.15.170:0/127396639 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3514078070 con 0x5562555d96e0 2024-09-12T17:28:05.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.437+0000 7f340de03640 1 -- 172.21.15.170:0/127396639 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3514073470 con 0x5562555d96e0 2024-09-12T17:28:05.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.437+0000 7f3523546800 1 -- 172.21.15.170:0/127396639 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5562556d05b0 con 0x5562555d96e0 2024-09-12T17:28:05.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.437+0000 7f340de03640 1 -- 172.21.15.170:0/127396639 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3514073750 con 0x5562555d96e0 2024-09-12T17:28:05.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.438+0000 7f3523546800 1 -- 172.21.15.170:0/127396639 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562556d11c0 con 0x5562555d96e0 2024-09-12T17:28:05.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.438+0000 7f340de03640 1 -- 172.21.15.170:0/127396639 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f351407b070 con 0x5562555d96e0 2024-09-12T17:28:05.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.438+0000 7f340de03640 1 --2- 172.21.15.170:0/127396639 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f340803c780 0x7f340803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.439+0000 7f340de03640 1 -- 172.21.15.170:0/127396639 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f3514097930 con 0x5562555d96e0 2024-09-12T17:28:05.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.439+0000 7f351bfff640 1 --2- 172.21.15.170:0/127396639 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f340803c780 0x7f340803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.439+0000 7f3523546800 1 --2- 172.21.15.170:0/127396639 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5562555dc010 0x5562556d7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.439+0000 7f3523546800 1 -- 172.21.15.170:0/127396639 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5562556d1b80 con 0x5562555dc010 2024-09-12T17:28:05.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.439+0000 7f3521838640 1 --2- 172.21.15.170:0/127396639 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5562555dc010 0x5562556d7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.439+0000 7f351bfff640 1 --2- 172.21.15.170:0/127396639 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f340803c780 0x7f340803ec40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f350c000c00 tx=0x7f350c0013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.439+0000 7f3521838640 1 --2- 172.21.15.170:0/127396639 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5562555dc010 0x5562556d7410 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.439+0000 7f3521838640 1 -- 172.21.15.170:0/127396639 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f351c00a4d0 con 0x5562555dc010 2024-09-12T17:28:05.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.439+0000 7f3523546800 1 -- 172.21.15.170:0/127396639 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5562556d1530 con 0x5562555dc010 2024-09-12T17:28:05.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.440+0000 7f3521838640 1 -- 172.21.15.170:0/127396639 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f351c00a4d0 con 0x5562555dc010 2024-09-12T17:28:05.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.440+0000 7f3523546800 1 --2- 172.21.15.170:0/127396639 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5562556d9880 0x5562556dbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.440+0000 7f3523546800 1 -- 172.21.15.170:0/127396639 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5562556dc340 con 0x5562556d9880 2024-09-12T17:28:05.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.440+0000 7f3521037640 1 --2- 172.21.15.170:0/127396639 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5562556d9880 0x5562556dbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.440+0000 7f3521037640 1 --2- 172.21.15.170:0/127396639 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5562556d9880 0x5562556dbc70 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.440+0000 7f3521037640 1 -- 172.21.15.170:0/127396639 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f351407a030 con 0x5562556d9880 2024-09-12T17:28:05.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.440+0000 7f3523546800 1 -- 172.21.15.170:0/127396639 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5562556d8720 con 0x5562555dc010 2024-09-12T17:28:05.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.441+0000 7f3521838640 1 -- 172.21.15.170:0/127396639 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f351c00a4d0 con 0x5562555dc010 2024-09-12T17:28:05.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.441+0000 7f3523546800 1 -- 172.21.15.170:0/127396639 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5562556d8bc0 con 0x5562556d9880 2024-09-12T17:28:05.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.441+0000 7f3521037640 1 -- 172.21.15.170:0/127396639 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f351407a030 con 0x5562556d9880 2024-09-12T17:28:05.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.441+0000 7f3523546800 1 Processor -- start 2024-09-12T17:28:05.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.441+0000 7f3523546800 1 -- start start 2024-09-12T17:28:05.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.442+0000 7f3523546800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5562556eabd0 0x5562556eaff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.442+0000 7f3523546800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5562554cfa00 con 0x5562556eabd0 2024-09-12T17:28:05.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.442+0000 7f3521838640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5562556eabd0 0x5562556eaff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.442+0000 7f3521838640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5562556eabd0 0x5562556eaff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43958/0 (socket says 172.21.15.170:43958) 2024-09-12T17:28:05.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.442+0000 7f3521838640 1 -- 172.21.15.170:0/470346148 learned_addr learned my addr 172.21.15.170:0/470346148 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:05.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.442+0000 7f3521838640 1 -- 172.21.15.170:0/470346148 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562556eb630 con 0x5562556eabd0 2024-09-12T17:28:05.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.442+0000 7f3521838640 1 --2- 172.21.15.170:0/470346148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5562556eabd0 0x5562556eaff0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x5562556d0dc0 tx=0x7f351c0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.442+0000 7f3406ffd640 1 -- 172.21.15.170:0/470346148 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f351c013640 con 0x5562556eabd0 2024-09-12T17:28:05.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.442+0000 7f3406ffd640 1 -- 172.21.15.170:0/470346148 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f351c0137e0 con 0x5562556eabd0 2024-09-12T17:28:05.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.442+0000 7f3523546800 1 -- 172.21.15.170:0/470346148 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5562556ebe60 con 0x5562556eabd0 2024-09-12T17:28:05.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.442+0000 7f3406ffd640 1 -- 172.21.15.170:0/470346148 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f351c013ac0 con 0x5562556eabd0 2024-09-12T17:28:05.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.442+0000 7f3523546800 1 -- 172.21.15.170:0/470346148 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562556ec400 con 0x5562556eabd0 2024-09-12T17:28:05.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.443+0000 7f3406ffd640 1 -- 172.21.15.170:0/470346148 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f351c011040 con 0x5562556eabd0 2024-09-12T17:28:05.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.443+0000 7f3406ffd640 1 --2- 172.21.15.170:0/470346148 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f33f803c730 0x7f33f803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.443+0000 7f3406ffd640 1 -- 172.21.15.170:0/470346148 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f351c00e040 con 0x5562556eabd0 2024-09-12T17:28:05.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.444+0000 7f3521037640 1 --2- 172.21.15.170:0/470346148 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f33f803c730 0x7f33f803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.444+0000 7f3523546800 1 Processor -- start 2024-09-12T17:28:05.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.444+0000 7f3523546800 1 -- start start 2024-09-12T17:28:05.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.444+0000 7f3521037640 1 --2- 172.21.15.170:0/470346148 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f33f803c730 0x7f33f803ebf0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3514045a60 tx=0x7f3514068dc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.444+0000 7f3523546800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5562555d8790 0x5562555d8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.444+0000 7f3523546800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5562556c8cc0 con 0x5562555d8790 2024-09-12T17:28:05.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.444+0000 7f3521838640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5562555d8790 0x5562555d8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.444+0000 7f3521838640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5562555d8790 0x5562555d8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43962/0 (socket says 172.21.15.170:43962) 2024-09-12T17:28:05.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.444+0000 7f3521838640 1 -- 172.21.15.170:0/2558774311 learned_addr learned my addr 172.21.15.170:0/2558774311 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:05.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.444+0000 7f3521838640 1 -- 172.21.15.170:0/2558774311 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562555d90d0 con 0x5562555d8790 2024-09-12T17:28:05.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.445+0000 7f3521838640 1 --2- 172.21.15.170:0/2558774311 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5562555d8790 0x5562555d8b90 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f351c020000 tx=0x7f351c0204d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2b7413e6f5fa2ab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.445+0000 7f3404ff9640 1 -- 172.21.15.170:0/2558774311 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f351c052070 con 0x5562555d8790 2024-09-12T17:28:05.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.445+0000 7f3404ff9640 1 -- 172.21.15.170:0/2558774311 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f351c04a020 con 0x5562555d8790 2024-09-12T17:28:05.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.445+0000 7f3404ff9640 1 -- 172.21.15.170:0/2558774311 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f351c021440 con 0x5562555d8790 2024-09-12T17:28:05.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.445+0000 7f3523546800 1 -- 172.21.15.170:0/2558774311 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5562555d8790 msgr2=0x5562555d8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.445+0000 7f3523546800 1 --2- 172.21.15.170:0/2558774311 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5562555d8790 0x5562555d8b90 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f351c020000 tx=0x7f351c0204d0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.445+0000 7f3523546800 1 -- 172.21.15.170:0/2558774311 shutdown_connections 2024-09-12T17:28:05.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.445+0000 7f3523546800 1 --2- 172.21.15.170:0/2558774311 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5562555d8790 0x5562555d8b90 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.445+0000 7f3523546800 1 -- 172.21.15.170:0/2558774311 >> 172.21.15.170:0/2558774311 conn(0x5562556f3a90 msgr2=0x5562556f1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:05.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.445+0000 7f3523546800 1 -- 172.21.15.170:0/2558774311 shutdown_connections 2024-09-12T17:28:05.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.445+0000 7f3523546800 1 -- 172.21.15.170:0/2558774311 wait complete. 2024-09-12T17:28:05.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.445+0000 7f3523546800 1 Processor -- start 2024-09-12T17:28:05.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.446+0000 7f3523546800 1 -- start start 2024-09-12T17:28:05.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.446+0000 7f3523546800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5562555d8790 0x556255700f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.446+0000 7f3523546800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5562555d7650 con 0x5562555d8790 2024-09-12T17:28:05.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.446+0000 7f3521838640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5562555d8790 0x556255700f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.446+0000 7f3521838640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5562555d8790 0x556255700f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43968/0 (socket says 172.21.15.170:43968) 2024-09-12T17:28:05.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.446+0000 7f3521838640 1 -- 172.21.15.170:0/903474703 learned_addr learned my addr 172.21.15.170:0/903474703 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:05.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.446+0000 7f3521838640 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556255701460 con 0x5562555d8790 2024-09-12T17:28:05.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.446+0000 7f3521838640 1 --2- 172.21.15.170:0/903474703 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5562555d8790 0x556255700f00 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f351c013fd0 tx=0x7f351c053d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.447+0000 7f33f6ffd640 1 -- 172.21.15.170:0/903474703 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f351c01f500 con 0x5562555d8790 2024-09-12T17:28:05.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.447+0000 7f33f6ffd640 1 -- 172.21.15.170:0/903474703 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f351c01f6a0 con 0x5562555d8790 2024-09-12T17:28:05.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.447+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5562557016f0 con 0x5562555d8790 2024-09-12T17:28:05.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.447+0000 7f33f6ffd640 1 -- 172.21.15.170:0/903474703 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f351c055220 con 0x5562555d8790 2024-09-12T17:28:05.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.447+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556255702070 con 0x5562555d8790 2024-09-12T17:28:05.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.447+0000 7f33f6ffd640 1 -- 172.21.15.170:0/903474703 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f351c03a060 con 0x5562555d8790 2024-09-12T17:28:05.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.448+0000 7f33f6ffd640 1 --2- 172.21.15.170:0/903474703 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f33ec03c780 0x7f33ec03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.448+0000 7f33f6ffd640 1 -- 172.21.15.170:0/903474703 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f351c04b070 con 0x5562555d8790 2024-09-12T17:28:05.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.448+0000 7f3521037640 1 --2- 172.21.15.170:0/903474703 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f33ec03c780 0x7f33ec03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.448+0000 7f3523546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.448+0000 7f3523546800 1 --2- 172.21.15.170:0/903474703 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55625570c7a0 0x55625570ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.448+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55625570f3b0 con 0x55625570c7a0 2024-09-12T17:28:05.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.448+0000 7f3521037640 1 --2- 172.21.15.170:0/903474703 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f33ec03c780 0x7f33ec03ec40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x5562556d79f0 tx=0x7f3514093000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.448+0000 7f351bfff640 1 --2- 172.21.15.170:0/903474703 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55625570c7a0 0x55625570ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.448+0000 7f351bfff640 1 --2- 172.21.15.170:0/903474703 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55625570c7a0 0x55625570ec60 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.449+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f350c00f5f0 con 0x55625570c7a0 2024-09-12T17:28:05.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.449+0000 7f3523546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:05.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.449+0000 7f3523546800 20 realm 2024-09-12T17:28:05.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.449+0000 7f3523546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.449+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55625570baf0 con 0x55625570c7a0 2024-09-12T17:28:05.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.449+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f350c00f5f0 con 0x55625570c7a0 2024-09-12T17:28:05.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.449+0000 7f3523546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:05.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.449+0000 7f3523546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:05.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.449+0000 7f3523546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.449+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55625570fe90 con 0x55625570c7a0 2024-09-12T17:28:05.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.449+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f350c00f5f0 con 0x55625570c7a0 2024-09-12T17:28:05.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.449+0000 7f3523546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:05.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.449+0000 7f3523546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.449+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556255710760 con 0x55625570c7a0 2024-09-12T17:28:05.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.449+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f350c00f5f0 con 0x55625570c7a0 2024-09-12T17:28:05.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.449+0000 7f3523546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:05.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.449+0000 7f3523546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.449+0000 7f3523546800 1 --2- 172.21.15.170:0/903474703 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556255711060 0x556255713470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.449+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556255713bd0 con 0x556255711060 2024-09-12T17:28:05.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.449+0000 7f3521838640 1 --2- 172.21.15.170:0/903474703 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556255711060 0x556255713470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.450+0000 7f3521838640 1 --2- 172.21.15.170:0/903474703 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556255711060 0x556255713470 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.450+0000 7f3521838640 1 -- 172.21.15.170:0/903474703 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f351c00a4d0 con 0x556255711060 2024-09-12T17:28:05.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.450+0000 7f3523546800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:05.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.450+0000 7f3523546800 20 searching for the correct realm 2024-09-12T17:28:05.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.450+0000 7f3523546800 1 --2- 172.21.15.170:0/903474703 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x556255715c80 0x556255718140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.450+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556255718810 con 0x556255715c80 2024-09-12T17:28:05.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.450+0000 7f3521037640 1 --2- 172.21.15.170:0/903474703 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x556255715c80 0x556255718140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.450+0000 7f3521037640 1 --2- 172.21.15.170:0/903474703 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x556255715c80 0x556255718140 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.451+0000 7f3521037640 1 -- 172.21.15.170:0/903474703 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35140a1070 con 0x556255715c80 2024-09-12T17:28:05.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.451+0000 7f3521037640 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3514098c60 con 0x556255711060 2024-09-12T17:28:05.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.451+0000 7f3521838640 1 -- 172.21.15.170:0/903474703 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f351c00a4d0 con 0x556255711060 2024-09-12T17:28:05.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.451+0000 7f3521838640 1 --2- 172.21.15.170:0/903474703 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f351c03c070 0x7f351c0569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.451+0000 7f3521838640 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3514098c60 con 0x7f351c03c070 2024-09-12T17:28:05.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.451+0000 7f351bfff640 1 --2- 172.21.15.170:0/903474703 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f351c03c070 0x7f351c0569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.451+0000 7f351bfff640 1 --2- 172.21.15.170:0/903474703 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f351c03c070 0x7f351c0569f0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.452+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350c00f5f0 con 0x7f351c03c070 2024-09-12T17:28:05.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.452+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3514098c60 con 0x55625570c7a0 2024-09-12T17:28:05.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.452+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350c00f5f0 con 0x55625570c7a0 2024-09-12T17:28:05.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.452+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3514098c60 con 0x55625570c7a0 2024-09-12T17:28:05.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.452+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350c02b040 con 0x55625570c7a0 2024-09-12T17:28:05.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.452+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3514098c60 con 0x7f351c03c070 2024-09-12T17:28:05.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.452+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350c02b040 con 0x7f351c03c070 2024-09-12T17:28:05.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.452+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3514098c60 con 0x7f351c03c070 2024-09-12T17:28:05.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.453+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350c02b040 con 0x7f351c03c070 2024-09-12T17:28:05.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.453+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3514098c60 con 0x556255711060 2024-09-12T17:28:05.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.453+0000 7f3521838640 1 -- 172.21.15.170:0/903474703 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f351c00a4d0 con 0x556255711060 2024-09-12T17:28:05.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.453+0000 7f3521838640 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3514098c60 con 0x556255715c80 2024-09-12T17:28:05.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.453+0000 7f3521037640 1 -- 172.21.15.170:0/903474703 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35140a1070 con 0x556255715c80 2024-09-12T17:28:05.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.453+0000 7f3521037640 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3514098c60 con 0x55625570c7a0 2024-09-12T17:28:05.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.453+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350c02b040 con 0x55625570c7a0 2024-09-12T17:28:05.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.453+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3514098c60 con 0x7f351c03c070 2024-09-12T17:28:05.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.454+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350c02b040 con 0x7f351c03c070 2024-09-12T17:28:05.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.454+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3514098c60 con 0x55625570c7a0 2024-09-12T17:28:05.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.454+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350c02b040 con 0x55625570c7a0 2024-09-12T17:28:05.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.454+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3514098c60 con 0x556255711060 2024-09-12T17:28:05.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.454+0000 7f3521838640 1 -- 172.21.15.170:0/903474703 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f351c00a4d0 con 0x556255711060 2024-09-12T17:28:05.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.454+0000 7f3521838640 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3514098c60 con 0x556255715c80 2024-09-12T17:28:05.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.454+0000 7f3521037640 1 -- 172.21.15.170:0/903474703 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35140a1070 con 0x556255715c80 2024-09-12T17:28:05.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.454+0000 7f3521037640 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3514098c60 con 0x556255715c80 2024-09-12T17:28:05.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.455+0000 7f3521037640 1 -- 172.21.15.170:0/903474703 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35140a1070 con 0x556255715c80 2024-09-12T17:28:05.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.455+0000 7f3521037640 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3514098c60 con 0x7f351c03c070 2024-09-12T17:28:05.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.455+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350c02b040 con 0x7f351c03c070 2024-09-12T17:28:05.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.455+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3514098c60 con 0x556255715c80 2024-09-12T17:28:05.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.455+0000 7f3521037640 1 -- 172.21.15.170:0/903474703 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35140a1070 con 0x556255715c80 2024-09-12T17:28:05.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.455+0000 7f3521037640 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3514098c60 con 0x556255715c80 2024-09-12T17:28:05.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.456+0000 7f3521037640 1 -- 172.21.15.170:0/903474703 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35140a1070 con 0x556255715c80 2024-09-12T17:28:05.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.456+0000 7f3521037640 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3514098c60 con 0x55625570c7a0 2024-09-12T17:28:05.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.456+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350c02b040 con 0x55625570c7a0 2024-09-12T17:28:05.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.456+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3514098c60 con 0x55625570c7a0 2024-09-12T17:28:05.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.456+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f350c02b040 con 0x55625570c7a0 2024-09-12T17:28:05.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.456+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3514098c60 con 0x7f351c03c070 2024-09-12T17:28:05.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.456+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350c02b040 con 0x7f351c03c070 2024-09-12T17:28:05.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.456+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3514098c60 con 0x556255715c80 2024-09-12T17:28:05.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.457+0000 7f3521037640 1 -- 172.21.15.170:0/903474703 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35140a1070 con 0x556255715c80 2024-09-12T17:28:05.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.457+0000 7f3521037640 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3514098c60 con 0x556255711060 2024-09-12T17:28:05.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.457+0000 7f3521838640 1 -- 172.21.15.170:0/903474703 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f351c00a4d0 con 0x556255711060 2024-09-12T17:28:05.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.457+0000 7f3521838640 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3514098c60 con 0x55625570c7a0 2024-09-12T17:28:05.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.457+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350c02b040 con 0x55625570c7a0 2024-09-12T17:28:05.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.457+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3514098c60 con 0x7f351c03c070 2024-09-12T17:28:05.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.457+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350c03b040 con 0x7f351c03c070 2024-09-12T17:28:05.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.457+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3514098c60 con 0x556255715c80 2024-09-12T17:28:05.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.458+0000 7f3521037640 1 -- 172.21.15.170:0/903474703 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35140a1070 con 0x556255715c80 2024-09-12T17:28:05.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.458+0000 7f3521037640 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3514098c60 con 0x7f351c03c070 2024-09-12T17:28:05.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.458+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350c03b040 con 0x7f351c03c070 2024-09-12T17:28:05.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.458+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3514098c60 con 0x556255711060 2024-09-12T17:28:05.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.458+0000 7f3521838640 1 -- 172.21.15.170:0/903474703 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f351c00a4d0 con 0x556255711060 2024-09-12T17:28:05.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.458+0000 7f3521838640 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3514098c60 con 0x556255715c80 2024-09-12T17:28:05.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.458+0000 7f3521037640 1 -- 172.21.15.170:0/903474703 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35140a1070 con 0x556255715c80 2024-09-12T17:28:05.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.458+0000 7f3521037640 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3514098c60 con 0x7f351c03c070 2024-09-12T17:28:05.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.459+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f350c03b040 con 0x7f351c03c070 2024-09-12T17:28:05.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.459+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3514098c60 con 0x55625570c7a0 2024-09-12T17:28:05.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.459+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f350c03b040 con 0x55625570c7a0 2024-09-12T17:28:05.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.459+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f3514098c60 con 0x556255711060 2024-09-12T17:28:05.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.459+0000 7f3521838640 1 -- 172.21.15.170:0/903474703 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f351c00a4d0 con 0x556255711060 2024-09-12T17:28:05.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.459+0000 7f3523546800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:05.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.459+0000 7f3523546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:05.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.459+0000 7f3523546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:05.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.459+0000 7f3523546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:05.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.459+0000 7f3523546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:05.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.459+0000 7f3523546800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:05.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.459+0000 7f3523546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.459+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556255714580 con 0x55625570c7a0 2024-09-12T17:28:05.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.459+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f350c03b040 con 0x55625570c7a0 2024-09-12T17:28:05.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.459+0000 7f3523546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:05.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.459+0000 7f3523546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.459+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556255714970 con 0x55625570c7a0 2024-09-12T17:28:05.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.460+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f350c03b040 con 0x55625570c7a0 2024-09-12T17:28:05.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.460+0000 7f3523546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:05.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.460+0000 7f3523546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.460+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556255714d90 con 0x556255711060 2024-09-12T17:28:05.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.460+0000 7f3521838640 1 -- 172.21.15.170:0/903474703 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f351c00a4d0 con 0x556255711060 2024-09-12T17:28:05.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.460+0000 7f3523546800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:05.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.460+0000 7f3523546800 20 zone default found 2024-09-12T17:28:05.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.460+0000 7f3523546800 4 Realm: () 2024-09-12T17:28:05.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.460+0000 7f3523546800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:05.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.460+0000 7f3523546800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:05.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.460+0000 7f3523546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:05.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.460+0000 7f3523546800 20 zonegroup default 2024-09-12T17:28:05.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.460+0000 7f3523546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.460+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556255718c90 con 0x7f351c03c070 2024-09-12T17:28:05.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.460+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f350c03b040 con 0x7f351c03c070 2024-09-12T17:28:05.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.460+0000 7f3523546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:05.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.460+0000 7f3523546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.460+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55625571a7e0 con 0x556255715c80 2024-09-12T17:28:05.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.460+0000 7f3521037640 1 -- 172.21.15.170:0/903474703 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f35140a1070 con 0x556255715c80 2024-09-12T17:28:05.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.460+0000 7f3523546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:05.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.460+0000 7f3523546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.461+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55625571ac90 con 0x556255715c80 2024-09-12T17:28:05.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.461+0000 7f3521037640 1 -- 172.21.15.170:0/903474703 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f35140a1070 con 0x556255715c80 2024-09-12T17:28:05.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.461+0000 7f3523546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:05.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.461+0000 7f3523546800 20 started sync module instance, tier type = 2024-09-12T17:28:05.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.461+0000 7f3523546800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:05.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.461+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556255719b20 con 0x556255711060 2024-09-12T17:28:05.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.462+0000 7f3521838640 1 -- 172.21.15.170:0/903474703 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f351c00a4d0 con 0x556255711060 2024-09-12T17:28:05.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.462+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93880828663408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55625571b0f0 con 0x556255711060 2024-09-12T17:28:05.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.462+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55625571b940 con 0x55625570c7a0 2024-09-12T17:28:05.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.463+0000 7f3521838640 1 -- 172.21.15.170:0/903474703 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93880828663408] v29'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f351c00a4d0 con 0x556255711060 2024-09-12T17:28:05.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.463+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f350c03b040 con 0x55625570c7a0 2024-09-12T17:28:05.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.463+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93880828670192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55625571b9c0 con 0x55625570c7a0 2024-09-12T17:28:05.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.463+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55625571c210 con 0x556255715c80 2024-09-12T17:28:05.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.464+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93880828670192] v29'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f350c03b040 con 0x55625570c7a0 2024-09-12T17:28:05.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.464+0000 7f3521037640 1 -- 172.21.15.170:0/903474703 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35140a1070 con 0x556255715c80 2024-09-12T17:28:05.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.464+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93880828671728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55625571c140 con 0x556255715c80 2024-09-12T17:28:05.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.464+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55625571cc80 con 0x556255711060 2024-09-12T17:28:05.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.465+0000 7f3521037640 1 -- 172.21.15.170:0/903474703 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93880828671728] v29'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35140a1070 con 0x556255715c80 2024-09-12T17:28:05.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.465+0000 7f3521838640 1 -- 172.21.15.170:0/903474703 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f351c00a4d0 con 0x556255711060 2024-09-12T17:28:05.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.465+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93880828675952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55625571cc40 con 0x556255711060 2024-09-12T17:28:05.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.465+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55625571d6e0 con 0x55625570c7a0 2024-09-12T17:28:05.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.466+0000 7f3521838640 1 -- 172.21.15.170:0/903474703 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93880828675952] v29'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f351c00a4d0 con 0x556255711060 2024-09-12T17:28:05.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.466+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f350c03b040 con 0x55625570c7a0 2024-09-12T17:28:05.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.466+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93880828672912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55625571d6e0 con 0x55625570c7a0 2024-09-12T17:28:05.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.466+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55625571e130 con 0x7f351c03c070 2024-09-12T17:28:05.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.467+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93880828672912] v29'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f350c03b040 con 0x55625570c7a0 2024-09-12T17:28:05.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.467+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f350c03b040 con 0x7f351c03c070 2024-09-12T17:28:05.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.467+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93880828678624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55625571e0f0 con 0x7f351c03c070 2024-09-12T17:28:05.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.467+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55625571eb40 con 0x7f351c03c070 2024-09-12T17:28:05.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.468+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93880828678624] v29'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f350c03b040 con 0x7f351c03c070 2024-09-12T17:28:05.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.468+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(56 notify.6 [create] v29'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f350c03b040 con 0x7f351c03c070 2024-09-12T17:28:05.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.469+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93880828681760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55625571eb40 con 0x7f351c03c070 2024-09-12T17:28:05.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.469+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55625571f500 con 0x7f351c03c070 2024-09-12T17:28:05.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.469+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93880828681760] v29'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f350c03b040 con 0x7f351c03c070 2024-09-12T17:28:05.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.470+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(58 notify.7 [create] v29'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f350c03b040 con 0x7f351c03c070 2024-09-12T17:28:05.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.470+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93880828683920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55625571f6e0 con 0x7f351c03c070 2024-09-12T17:28:05.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.470+0000 7f3523546800 20 add_watcher() i=0 2024-09-12T17:28:05.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.470+0000 7f3523546800 20 add_watcher() i=1 2024-09-12T17:28:05.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.470+0000 7f3523546800 20 add_watcher() i=2 2024-09-12T17:28:05.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.470+0000 7f3523546800 20 add_watcher() i=3 2024-09-12T17:28:05.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.470+0000 7f3523546800 20 add_watcher() i=4 2024-09-12T17:28:05.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.470+0000 7f3523546800 20 add_watcher() i=5 2024-09-12T17:28:05.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.470+0000 7f3523546800 20 add_watcher() i=6 2024-09-12T17:28:05.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.470+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93880828683920] v29'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f350c03b040 con 0x7f351c03c070 2024-09-12T17:28:05.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.470+0000 7f3523546800 20 add_watcher() i=7 2024-09-12T17:28:05.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.470+0000 7f3523546800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:05.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.470+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556255722890 con 0x55625570c7a0 2024-09-12T17:28:05.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.471+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f350c03b040 con 0x55625570c7a0 2024-09-12T17:28:05.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.471+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93880828699168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55625571f630 con 0x55625570c7a0 2024-09-12T17:28:05.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.472+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93880828699168] v29'144 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f350c03b040 con 0x55625570c7a0 2024-09-12T17:28:05.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.472+0000 7f33d7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:05.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.472+0000 7f3523546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:05.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.472+0000 7f3523546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:05.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.472+0000 7f3523546800 5 note: GC not initialized 2024-09-12T17:28:05.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.472+0000 7f33d6fe5640 20 reqs_thread_entry: start 2024-09-12T17:28:05.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.472+0000 7f3523546800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:05.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.472+0000 7f3523546800 20 Filter name: none 2024-09-12T17:28:05.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.472+0000 7f33d4fe1640 20 reqs_thread_entry: start 2024-09-12T17:28:05.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.472+0000 7f3523546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.472+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556255755af0 con 0x556255711060 2024-09-12T17:28:05.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.473+0000 7f3521838640 1 -- 172.21.15.170:0/903474703 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f351c00a4d0 con 0x556255711060 2024-09-12T17:28:05.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.473+0000 7f3523546800 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T17:28:05.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.473+0000 7f3523546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.473+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:63 8.1d 8:baccd554:root::.bucket.meta.myfoo%3a7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556255756380 con 0x7f351c03c070 2024-09-12T17:28:05.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.473+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(63 .bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f350c03b040 con 0x7f351c03c070 2024-09-12T17:28:05.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.473+0000 7f3523546800 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T17:28:05.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.473+0000 7f3523546800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:28:05.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.473+0000 7f3523546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.473+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556255754de0 con 0x556255711060 2024-09-12T17:28:05.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.474+0000 7f3521838640 1 -- 172.21.15.170:0/903474703 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f351c00a4d0 con 0x556255711060 2024-09-12T17:28:05.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.474+0000 7f3523546800 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T17:28:05.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.474+0000 7f3523546800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.474+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:65 8.1d 8:baccd554:root::.bucket.meta.myfoo%3a7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5562557579c0 con 0x7f351c03c070 2024-09-12T17:28:05.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.474+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(65 .bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f350c03b040 con 0x7f351c03c070 2024-09-12T17:28:05.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.474+0000 7f3523546800 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T17:28:05.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.474+0000 7f3523546800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:28:05.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.474+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:66 4.33 4:cf7a7992:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556255757260 con 0x7f351c03c070 2024-09-12T17:28:05.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.474+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:67 4.a 4:523b0550:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55625575c010 con 0x556255711060 2024-09-12T17:28:05.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.474+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:68 4.2e 4:74d1473b:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55625575e970 con 0x556255715c80 2024-09-12T17:28:05.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.474+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:69 4.12 4:4b79d0ba:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5562557614b0 con 0x55625570c7a0 2024-09-12T17:28:05.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.474+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:70 4.20 4:058cb7b5:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556255763d80 con 0x55625570c7a0 2024-09-12T17:28:05.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.474+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:71 4.3 4:c2f55514:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5562557665f0 con 0x55625570c7a0 2024-09-12T17:28:05.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.475+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:72 4.3e 4:7f412122:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556255768e60 con 0x556255711060 2024-09-12T17:28:05.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.475+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(66 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f350c03b040 con 0x7f351c03c070 2024-09-12T17:28:05.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.475+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:73 4.9 4:916cfff6:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5562557692a0 con 0x55625570c7a0 2024-09-12T17:28:05.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.475+0000 7f3521838640 1 -- 172.21.15.170:0/903474703 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(67 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f351c00a4d0 con 0x556255711060 2024-09-12T17:28:05.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.475+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(69 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f350c03b040 con 0x55625570c7a0 2024-09-12T17:28:05.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.475+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:74 4.3f 4:fe994f63:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556255760e80 con 0x556255711060 2024-09-12T17:28:05.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.475+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(70 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f350c03b040 con 0x55625570c7a0 2024-09-12T17:28:05.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.475+0000 7f3521037640 1 -- 172.21.15.170:0/903474703 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(68 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f35140a1070 con 0x556255715c80 2024-09-12T17:28:05.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.475+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:75 4.3f 4:fcb62fad:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55625575ba90 con 0x556255711060 2024-09-12T17:28:05.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.475+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:76 4.16 4:6840e132:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55625575e520 con 0x556255715c80 2024-09-12T17:28:05.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.475+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(71 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.5 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f350c03b040 con 0x55625570c7a0 2024-09-12T17:28:05.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.475+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(73 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f350c03b040 con 0x55625570c7a0 2024-09-12T17:28:05.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.475+0000 7f3521037640 1 -- 172.21.15.170:0/903474703 <== osd.3 v2:172.21.15.170:6816/2664906588 15 ==== osd_op_reply(76 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f35140a1070 con 0x556255715c80 2024-09-12T17:28:05.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.475+0000 7f3521838640 1 -- 172.21.15.170:0/903474703 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(72 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.6 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f351c00a4d0 con 0x556255711060 2024-09-12T17:28:05.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.475+0000 7f3521838640 1 -- 172.21.15.170:0/903474703 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== osd_op_reply(74 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.8 [call out=128b] v0'0 uv6 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f351c00a4d0 con 0x556255711060 2024-09-12T17:28:05.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.475+0000 7f3521838640 1 -- 172.21.15.170:0/903474703 <== osd.2 v2:172.21.15.170:6808/3855567754 18 ==== osd_op_reply(75 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1.9 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f351c00a4d0 con 0x556255711060 2024-09-12T17:28:05.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.476+0000 7f33d7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:05.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.476+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93880828699168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5562557692a0 con 0x55625570c7a0 2024-09-12T17:28:05.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.477+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 93880828699168] v29'145 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f350c03b040 con 0x55625570c7a0 2024-09-12T17:28:05.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.477+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93880828663408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556255753490 con 0x556255711060 2024-09-12T17:28:05.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.478+0000 7f3521838640 1 -- 172.21.15.170:0/903474703 <== osd.2 v2:172.21.15.170:6808/3855567754 19 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 93880828663408] v29'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f351c00a4d0 con 0x556255711060 2024-09-12T17:28:05.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.478+0000 7f3523546800 20 remove_watcher() i=0 2024-09-12T17:28:05.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.478+0000 7f3523546800 2 removed watcher, disabling cache 2024-09-12T17:28:05.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.478+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93880828670192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556255753490 con 0x55625570c7a0 2024-09-12T17:28:05.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.479+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 93880828670192] v29'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f350c03b040 con 0x55625570c7a0 2024-09-12T17:28:05.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.479+0000 7f3523546800 20 remove_watcher() i=1 2024-09-12T17:28:05.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.479+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93880828671728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556255753490 con 0x556255715c80 2024-09-12T17:28:05.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.480+0000 7f3521037640 1 -- 172.21.15.170:0/903474703 <== osd.3 v2:172.21.15.170:6816/2664906588 16 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 93880828671728] v29'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35140a1070 con 0x556255715c80 2024-09-12T17:28:05.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.480+0000 7f3523546800 20 remove_watcher() i=2 2024-09-12T17:28:05.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.480+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93880828675952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556255753490 con 0x556255711060 2024-09-12T17:28:05.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.481+0000 7f3521838640 1 -- 172.21.15.170:0/903474703 <== osd.2 v2:172.21.15.170:6808/3855567754 20 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 93880828675952] v29'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f351c00a4d0 con 0x556255711060 2024-09-12T17:28:05.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.481+0000 7f3523546800 20 remove_watcher() i=3 2024-09-12T17:28:05.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.481+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93880828672912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556255753490 con 0x55625570c7a0 2024-09-12T17:28:05.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.482+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 93880828672912] v29'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f350c03b040 con 0x55625570c7a0 2024-09-12T17:28:05.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.482+0000 7f3523546800 20 remove_watcher() i=4 2024-09-12T17:28:05.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.482+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93880828678624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556255753490 con 0x7f351c03c070 2024-09-12T17:28:05.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.484+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 93880828678624] v29'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f350c03b040 con 0x7f351c03c070 2024-09-12T17:28:05.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.484+0000 7f3523546800 20 remove_watcher() i=5 2024-09-12T17:28:05.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.484+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93880828681760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556255753490 con 0x7f351c03c070 2024-09-12T17:28:05.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.485+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 93880828681760] v29'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f350c03b040 con 0x7f351c03c070 2024-09-12T17:28:05.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.485+0000 7f3523546800 20 remove_watcher() i=6 2024-09-12T17:28:05.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.485+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93880828683920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556255753490 con 0x7f351c03c070 2024-09-12T17:28:05.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.485+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 <== osd.0 v2:172.21.15.47:6800/3978157098 22 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 93880828683920] v29'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f350c03b040 con 0x7f351c03c070 2024-09-12T17:28:05.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.485+0000 7f3523546800 20 remove_watcher() i=7 2024-09-12T17:28:05.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.486+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f351c03c070 msgr2=0x7f351c0569f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.486+0000 7f3523546800 1 --2- 172.21.15.170:0/903474703 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f351c03c070 0x7f351c0569f0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.486+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55625570c7a0 msgr2=0x55625570ec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.486+0000 7f3523546800 1 --2- 172.21.15.170:0/903474703 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55625570c7a0 0x55625570ec60 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.486+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556255711060 msgr2=0x556255713470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.486+0000 7f3523546800 1 --2- 172.21.15.170:0/903474703 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556255711060 0x556255713470 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.486+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x556255715c80 msgr2=0x556255718140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.486+0000 7f3523546800 1 --2- 172.21.15.170:0/903474703 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x556255715c80 0x556255718140 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.486+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f33ec03c780 msgr2=0x7f33ec03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.486+0000 7f3523546800 1 --2- 172.21.15.170:0/903474703 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f33ec03c780 0x7f33ec03ec40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x5562556d79f0 tx=0x7f3514093000 comp rx=0 tx=0).stop 2024-09-12T17:28:05.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.486+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5562555d8790 msgr2=0x556255700f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.486+0000 7f351bfff640 1 -- 172.21.15.170:0/903474703 reap_dead start 2024-09-12T17:28:05.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.486+0000 7f3523546800 1 --2- 172.21.15.170:0/903474703 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5562555d8790 0x556255700f00 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f351c013fd0 tx=0x7f351c053d30 comp rx=0 tx=0).stop 2024-09-12T17:28:05.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.486+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 shutdown_connections 2024-09-12T17:28:05.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.486+0000 7f3523546800 1 --2- 172.21.15.170:0/903474703 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5562555d8790 0x556255700f00 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.486+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 >> 172.21.15.170:0/903474703 conn(0x5562556f3a90 msgr2=0x5562556f1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:05.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.486+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 shutdown_connections 2024-09-12T17:28:05.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.486+0000 7f3523546800 1 -- 172.21.15.170:0/903474703 wait complete. 2024-09-12T17:28:05.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.486+0000 7f3523546800 1 -- 172.21.15.170:0/470346148 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f33f803c730 msgr2=0x7f33f803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.486+0000 7f3523546800 1 --2- 172.21.15.170:0/470346148 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f33f803c730 0x7f33f803ebf0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3514045a60 tx=0x7f3514068dc0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.486+0000 7f3523546800 1 -- 172.21.15.170:0/470346148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5562556eabd0 msgr2=0x5562556eaff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.486+0000 7f3523546800 1 --2- 172.21.15.170:0/470346148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5562556eabd0 0x5562556eaff0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x5562556d0dc0 tx=0x7f351c0167b0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.486+0000 7f3523546800 1 -- 172.21.15.170:0/470346148 shutdown_connections 2024-09-12T17:28:05.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.486+0000 7f3523546800 1 --2- 172.21.15.170:0/470346148 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f33f803c730 0x7f33f803ebf0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.486+0000 7f3523546800 1 --2- 172.21.15.170:0/470346148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5562556eabd0 0x5562556eaff0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.486+0000 7f3523546800 1 -- 172.21.15.170:0/470346148 >> 172.21.15.170:0/470346148 conn(0x5562556def80 msgr2=0x5562556df360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:05.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.486+0000 7f3523546800 1 -- 172.21.15.170:0/470346148 shutdown_connections 2024-09-12T17:28:05.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.486+0000 7f3523546800 1 -- 172.21.15.170:0/470346148 wait complete. 2024-09-12T17:28:05.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.487+0000 7f3523546800 1 -- 172.21.15.170:0/127396639 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5562555dc010 msgr2=0x5562556d7410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.487+0000 7f3523546800 1 --2- 172.21.15.170:0/127396639 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5562555dc010 0x5562556d7410 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.487+0000 7f3523546800 1 -- 172.21.15.170:0/127396639 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5562556d9880 msgr2=0x5562556dbc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.487+0000 7f3523546800 1 --2- 172.21.15.170:0/127396639 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5562556d9880 0x5562556dbc70 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.487+0000 7f3523546800 1 -- 172.21.15.170:0/127396639 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f340803c780 msgr2=0x7f340803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.487+0000 7f3523546800 1 --2- 172.21.15.170:0/127396639 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f340803c780 0x7f340803ec40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f350c000c00 tx=0x7f350c0013b0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.487+0000 7f3523546800 1 -- 172.21.15.170:0/127396639 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5562555d96e0 msgr2=0x5562556cfdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.487+0000 7f3523546800 1 --2- 172.21.15.170:0/127396639 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5562555d96e0 0x5562556cfdc0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f3514025c20 tx=0x7f3514002fb0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.487+0000 7f3523546800 1 -- 172.21.15.170:0/127396639 shutdown_connections 2024-09-12T17:28:05.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.487+0000 7f3523546800 1 --2- 172.21.15.170:0/127396639 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5562556d9880 0x5562556dbc70 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.487+0000 7f3523546800 1 --2- 172.21.15.170:0/127396639 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f340803c780 0x7f340803ec40 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.487+0000 7f3523546800 1 --2- 172.21.15.170:0/127396639 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5562555dc010 0x5562556d7410 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.487+0000 7f3523546800 1 --2- 172.21.15.170:0/127396639 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5562555d96e0 0x5562556cfdc0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.487+0000 7f3523546800 1 -- 172.21.15.170:0/127396639 >> 172.21.15.170:0/127396639 conn(0x5562555d31c0 msgr2=0x5562556c9720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:05.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.487+0000 7f3523546800 1 -- 172.21.15.170:0/127396639 shutdown_connections 2024-09-12T17:28:05.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.487+0000 7f3523546800 1 -- 172.21.15.170:0/127396639 wait complete. 2024-09-12T17:28:05.509 INFO:teuthology.orchestra.run.smithi170.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"dc43fae2-274b-4ee4-ac82-d8ac27e45bf4","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1","marker":"7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-12T17:28:04.961288Z","creation_time":"2024-09-12T17:28:02.189371Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":2} 2024-09-12T17:28:05.509 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'dc43fae2-274b-4ee4-ac82-d8ac27e45bf4', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1', 'marker': '7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-12T17:28:04.961288Z', 'creation_time': '2024-09-12T17:28:02.189371Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 2} 2024-09-12T17:28:05.509 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-09-12T17:28:05.509 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-09-12T17:28:05.509 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-09-12T17:28:05.552 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:05.552 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:05.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.551+0000 7ff1f052c800 1 Processor -- start 2024-09-12T17:28:05.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.551+0000 7ff1f052c800 1 -- start start 2024-09-12T17:28:05.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.551+0000 7ff1f052c800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55a9b5ecf200 0x55a9b5ed4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.551+0000 7ff1f052c800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a9b5d78e40 con 0x55a9b5ecddf0 2024-09-12T17:28:05.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.551+0000 7ff1f052c800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x55a9b5d43680 con 0x55a9b5ecf200 2024-09-12T17:28:05.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.551+0000 7ff1e393d640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55a9b5ecf200 0x55a9b5ed4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.551+0000 7ff1ec13e640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x55a9b5ecddf0 0x55a9b5eceaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:37050/0 (socket says 172.21.15.170:37050) 2024-09-12T17:28:05.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.551+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2956897048 learned_addr learned my addr 172.21.15.170:0/2956897048 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:28:05.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.551+0000 7ff1e393d640 1 -- 172.21.15.170:0/2956897048 >> v1:172.21.15.47:6789/0 conn(0x55a9b5ecddf0 legacy=0x55a9b5eceaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.551+0000 7ff1e393d640 1 -- 172.21.15.170:0/2956897048 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9b5d5f6b0 con 0x55a9b5ecf200 2024-09-12T17:28:05.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.553+0000 7ff1e393d640 1 --2- 172.21.15.170:0/2956897048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9b5ecf200 0x55a9b5ed4da0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff1d400a470 tx=0x7ff1d4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b19ce631a128a22f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.553+0000 7ff1eb93d640 1 -- 172.21.15.170:0/2956897048 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1d4053570 con 0x55a9b5ecf200 2024-09-12T17:28:05.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.553+0000 7ff1eb93d640 1 -- 172.21.15.170:0/2956897048 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1d4058070 con 0x55a9b5ecf200 2024-09-12T17:28:05.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.553+0000 7ff1eb93d640 1 -- 172.21.15.170:0/2956897048 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1d4053880 con 0x55a9b5ecf200 2024-09-12T17:28:05.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.554+0000 7ff1f052c800 1 -- 172.21.15.170:0/2956897048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9b5ecf200 msgr2=0x55a9b5ed4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.554+0000 7ff1f052c800 1 --2- 172.21.15.170:0/2956897048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9b5ecf200 0x55a9b5ed4da0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff1d400a470 tx=0x7ff1d4045a20 comp rx=0 tx=0).stop 2024-09-12T17:28:05.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.554+0000 7ff1f052c800 1 -- 172.21.15.170:0/2956897048 shutdown_connections 2024-09-12T17:28:05.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.554+0000 7ff1f052c800 1 --2- 172.21.15.170:0/2956897048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9b5ecf200 0x55a9b5ed4da0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.554+0000 7ff1f052c800 1 -- 172.21.15.170:0/2956897048 >> 172.21.15.170:0/2956897048 conn(0x55a9b5ec91e0 msgr2=0x55a9b5ecb620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:05.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.554+0000 7ff1f052c800 1 -- 172.21.15.170:0/2956897048 shutdown_connections 2024-09-12T17:28:05.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.554+0000 7ff1f052c800 1 -- 172.21.15.170:0/2956897048 wait complete. 2024-09-12T17:28:05.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.567+0000 7ff1f052c800 1 Processor -- start 2024-09-12T17:28:05.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.567+0000 7ff1f052c800 1 -- start start 2024-09-12T17:28:05.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.568+0000 7ff1f052c800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9b5ecddf0 0x55a9b5e425a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.568+0000 7ff1f052c800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a9b5d67dd0 con 0x55a9b5ecddf0 2024-09-12T17:28:05.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.568+0000 7ff1ec13e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9b5ecddf0 0x55a9b5e425a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.568+0000 7ff1ec13e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9b5ecddf0 0x55a9b5e425a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43976/0 (socket says 172.21.15.170:43976) 2024-09-12T17:28:05.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.568+0000 7ff1ec13e640 1 -- 172.21.15.170:0/681832069 learned_addr learned my addr 172.21.15.170:0/681832069 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:05.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.568+0000 7ff1ec13e640 1 -- 172.21.15.170:0/681832069 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9b5d80e10 con 0x55a9b5ecddf0 2024-09-12T17:28:05.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.568+0000 7ff1ec13e640 1 --2- 172.21.15.170:0/681832069 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9b5ecddf0 0x55a9b5e425a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc001e40 tx=0x7ff1dc001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d9a1162856f200c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.568+0000 7ff0da60c640 1 -- 172.21.15.170:0/681832069 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1dc012020 con 0x55a9b5ecddf0 2024-09-12T17:28:05.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.568+0000 7ff0da60c640 1 -- 172.21.15.170:0/681832069 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1dc00e5a0 con 0x55a9b5ecddf0 2024-09-12T17:28:05.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.569+0000 7ff0da60c640 1 -- 172.21.15.170:0/681832069 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1dc00e8a0 con 0x55a9b5ecddf0 2024-09-12T17:28:05.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.569+0000 7ff1f052c800 1 -- 172.21.15.170:0/681832069 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9b5ecddf0 msgr2=0x55a9b5e425a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.569+0000 7ff1f052c800 1 --2- 172.21.15.170:0/681832069 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9b5ecddf0 0x55a9b5e425a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc001e40 tx=0x7ff1dc001e70 comp rx=0 tx=0).stop 2024-09-12T17:28:05.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.569+0000 7ff1f052c800 1 -- 172.21.15.170:0/681832069 shutdown_connections 2024-09-12T17:28:05.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.569+0000 7ff1f052c800 1 --2- 172.21.15.170:0/681832069 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9b5ecddf0 0x55a9b5e425a0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.569+0000 7ff1f052c800 1 -- 172.21.15.170:0/681832069 >> 172.21.15.170:0/681832069 conn(0x55a9b5ec91e0 msgr2=0x55a9b5fb8e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:05.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.569+0000 7ff1f052c800 1 -- 172.21.15.170:0/681832069 shutdown_connections 2024-09-12T17:28:05.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.569+0000 7ff1f052c800 1 -- 172.21.15.170:0/681832069 wait complete. 2024-09-12T17:28:05.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.570+0000 7ff1f052c800 1 Processor -- start 2024-09-12T17:28:05.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.570+0000 7ff1f052c800 1 -- start start 2024-09-12T17:28:05.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.570+0000 7ff1f052c800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9b5ecddf0 0x55a9b5fc5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.570+0000 7ff1f052c800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a9b5ecf8f0 con 0x55a9b5ecddf0 2024-09-12T17:28:05.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.570+0000 7ff1ec13e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9b5ecddf0 0x55a9b5fc5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.570+0000 7ff1ec13e640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9b5ecddf0 0x55a9b5fc5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:43992/0 (socket says 172.21.15.170:43992) 2024-09-12T17:28:05.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.570+0000 7ff1ec13e640 1 -- 172.21.15.170:0/862482090 learned_addr learned my addr 172.21.15.170:0/862482090 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:05.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.570+0000 7ff1ec13e640 1 -- 172.21.15.170:0/862482090 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9b5fc6500 con 0x55a9b5ecddf0 2024-09-12T17:28:05.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.571+0000 7ff1ec13e640 1 --2- 172.21.15.170:0/862482090 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9b5ecddf0 0x55a9b5fc5fa0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc00c010 tx=0x7ff1dc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.571+0000 7ff0d8e09640 1 -- 172.21.15.170:0/862482090 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1dc012030 con 0x55a9b5ecddf0 2024-09-12T17:28:05.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.571+0000 7ff0d8e09640 1 -- 172.21.15.170:0/862482090 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1dc0014a0 con 0x55a9b5ecddf0 2024-09-12T17:28:05.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.571+0000 7ff1f052c800 1 -- 172.21.15.170:0/862482090 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a9b5fc6790 con 0x55a9b5ecddf0 2024-09-12T17:28:05.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.571+0000 7ff0d8e09640 1 -- 172.21.15.170:0/862482090 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1dc01a7a0 con 0x55a9b5ecddf0 2024-09-12T17:28:05.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.571+0000 7ff1f052c800 1 -- 172.21.15.170:0/862482090 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9b5fc7190 con 0x55a9b5ecddf0 2024-09-12T17:28:05.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.572+0000 7ff0d8e09640 1 -- 172.21.15.170:0/862482090 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ff1dc015020 con 0x55a9b5ecddf0 2024-09-12T17:28:05.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.572+0000 7ff0d8e09640 1 --2- 172.21.15.170:0/862482090 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff0d403c780 0x7ff0d403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.572+0000 7ff0d8e09640 1 -- 172.21.15.170:0/862482090 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7ff1dc020030 con 0x55a9b5ecddf0 2024-09-12T17:28:05.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.572+0000 7ff1e393d640 1 --2- 172.21.15.170:0/862482090 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff0d403c780 0x7ff0d403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.572+0000 7ff1f052c800 1 --2- 172.21.15.170:0/862482090 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a9b5ecf200 0x55a9b5fcd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.572+0000 7ff1f052c800 1 -- 172.21.15.170:0/862482090 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a9b5fc7d20 con 0x55a9b5ecf200 2024-09-12T17:28:05.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.572+0000 7ff1ec93f640 1 --2- 172.21.15.170:0/862482090 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a9b5ecf200 0x55a9b5fcd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.572+0000 7ff1e393d640 1 --2- 172.21.15.170:0/862482090 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff0d403c780 0x7ff0d403ec40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4057000 tx=0x7ff1d4052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.573+0000 7ff1ec93f640 1 --2- 172.21.15.170:0/862482090 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a9b5ecf200 0x55a9b5fcd5f0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.573+0000 7ff1ec93f640 1 -- 172.21.15.170:0/862482090 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1e400a4d0 con 0x55a9b5ecf200 2024-09-12T17:28:05.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.573+0000 7ff1f052c800 1 -- 172.21.15.170:0/862482090 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a9b5fc7620 con 0x55a9b5ecf200 2024-09-12T17:28:05.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.573+0000 7ff1ec93f640 1 -- 172.21.15.170:0/862482090 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff1e400a4d0 con 0x55a9b5ecf200 2024-09-12T17:28:05.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.573+0000 7ff1f052c800 1 --2- 172.21.15.170:0/862482090 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a9b5fcfa60 0x55a9b5fd1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.573+0000 7ff1f052c800 1 -- 172.21.15.170:0/862482090 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a9b5fd2520 con 0x55a9b5fcfa60 2024-09-12T17:28:05.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.573+0000 7ff1ec13e640 1 --2- 172.21.15.170:0/862482090 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a9b5fcfa60 0x55a9b5fd1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.573+0000 7ff1ec13e640 1 --2- 172.21.15.170:0/862482090 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a9b5fcfa60 0x55a9b5fd1e50 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.574+0000 7ff1ec13e640 1 -- 172.21.15.170:0/862482090 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff1dc0187b0 con 0x55a9b5fcfa60 2024-09-12T17:28:05.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.574+0000 7ff1f052c800 1 -- 172.21.15.170:0/862482090 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a9b5fce900 con 0x55a9b5ecf200 2024-09-12T17:28:05.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.574+0000 7ff1ec93f640 1 -- 172.21.15.170:0/862482090 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff1e400a4d0 con 0x55a9b5ecf200 2024-09-12T17:28:05.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.574+0000 7ff1f052c800 1 -- 172.21.15.170:0/862482090 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a9b5fceda0 con 0x55a9b5fcfa60 2024-09-12T17:28:05.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.574+0000 7ff1ec13e640 1 -- 172.21.15.170:0/862482090 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff1dc0187b0 con 0x55a9b5fcfa60 2024-09-12T17:28:05.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.575+0000 7ff1f052c800 1 Processor -- start 2024-09-12T17:28:05.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.575+0000 7ff1f052c800 1 -- start start 2024-09-12T17:28:05.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.575+0000 7ff1f052c800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9b5fe0dd0 0x55a9b5fe11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.575+0000 7ff1f052c800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a9b5dc5a00 con 0x55a9b5fe0dd0 2024-09-12T17:28:05.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.575+0000 7ff1ec93f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9b5fe0dd0 0x55a9b5fe11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.575+0000 7ff1ec93f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9b5fe0dd0 0x55a9b5fe11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:44000/0 (socket says 172.21.15.170:44000) 2024-09-12T17:28:05.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.575+0000 7ff1ec93f640 1 -- 172.21.15.170:0/169869248 learned_addr learned my addr 172.21.15.170:0/169869248 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:05.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.575+0000 7ff1ec93f640 1 -- 172.21.15.170:0/169869248 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9b5fe1830 con 0x55a9b5fe0dd0 2024-09-12T17:28:05.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.576+0000 7ff1ec93f640 1 --2- 172.21.15.170:0/169869248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9b5fe0dd0 0x55a9b5fe11f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x55a9b5fc6e30 tx=0x7ff1e40167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.576+0000 7ff0d1ffb640 1 -- 172.21.15.170:0/169869248 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1e4013640 con 0x55a9b5fe0dd0 2024-09-12T17:28:05.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.576+0000 7ff0d1ffb640 1 -- 172.21.15.170:0/169869248 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1e40137e0 con 0x55a9b5fe0dd0 2024-09-12T17:28:05.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.576+0000 7ff0d1ffb640 1 -- 172.21.15.170:0/169869248 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1e4013ac0 con 0x55a9b5fe0dd0 2024-09-12T17:28:05.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.576+0000 7ff1f052c800 1 -- 172.21.15.170:0/169869248 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a9b5fe2060 con 0x55a9b5fe0dd0 2024-09-12T17:28:05.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.576+0000 7ff1f052c800 1 -- 172.21.15.170:0/169869248 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9b5fe2600 con 0x55a9b5fe0dd0 2024-09-12T17:28:05.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.577+0000 7ff0d1ffb640 1 -- 172.21.15.170:0/169869248 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ff1e4011040 con 0x55a9b5fe0dd0 2024-09-12T17:28:05.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.577+0000 7ff0d1ffb640 1 --2- 172.21.15.170:0/169869248 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff0c403c730 0x7ff0c403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.577+0000 7ff0d1ffb640 1 -- 172.21.15.170:0/169869248 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7ff1e400e040 con 0x55a9b5fe0dd0 2024-09-12T17:28:05.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.577+0000 7ff1ec13e640 1 --2- 172.21.15.170:0/169869248 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff0c403c730 0x7ff0c403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.577+0000 7ff1f052c800 1 Processor -- start 2024-09-12T17:28:05.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.577+0000 7ff1f052c800 1 -- start start 2024-09-12T17:28:05.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.577+0000 7ff1ec13e640 1 --2- 172.21.15.170:0/169869248 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff0c403c730 0x7ff0c403ebf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x55a9b5fcdc00 tx=0x7ff1dc040040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.577+0000 7ff1f052c800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9b5fed890 0x55a9b5fedc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.577+0000 7ff1f052c800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a9b5fc1300 con 0x55a9b5fed890 2024-09-12T17:28:05.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.578+0000 7ff1ec93f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9b5fed890 0x55a9b5fedc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.578+0000 7ff1ec93f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9b5fed890 0x55a9b5fedc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:44016/0 (socket says 172.21.15.170:44016) 2024-09-12T17:28:05.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.578+0000 7ff1ec93f640 1 -- 172.21.15.170:0/4224579995 learned_addr learned my addr 172.21.15.170:0/4224579995 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:05.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.578+0000 7ff1ec93f640 1 -- 172.21.15.170:0/4224579995 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9b5fee280 con 0x55a9b5fed890 2024-09-12T17:28:05.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.578+0000 7ff1ec93f640 1 --2- 172.21.15.170:0/4224579995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9b5fed890 0x55a9b5fedc90 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4020000 tx=0x7ff1e40204d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e1054e56c2b5183 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.578+0000 7ff0c37fe640 1 -- 172.21.15.170:0/4224579995 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1e4052070 con 0x55a9b5fed890 2024-09-12T17:28:05.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.578+0000 7ff0c37fe640 1 -- 172.21.15.170:0/4224579995 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1e404a020 con 0x55a9b5fed890 2024-09-12T17:28:05.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.578+0000 7ff0c37fe640 1 -- 172.21.15.170:0/4224579995 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1e4055040 con 0x55a9b5fed890 2024-09-12T17:28:05.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.579+0000 7ff1f052c800 1 -- 172.21.15.170:0/4224579995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9b5fed890 msgr2=0x55a9b5fedc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.579+0000 7ff1f052c800 1 --2- 172.21.15.170:0/4224579995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9b5fed890 0x55a9b5fedc90 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4020000 tx=0x7ff1e40204d0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.579+0000 7ff1f052c800 1 -- 172.21.15.170:0/4224579995 shutdown_connections 2024-09-12T17:28:05.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.579+0000 7ff1f052c800 1 --2- 172.21.15.170:0/4224579995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9b5fed890 0x55a9b5fedc90 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.579+0000 7ff1f052c800 1 -- 172.21.15.170:0/4224579995 >> 172.21.15.170:0/4224579995 conn(0x55a9b5fe9c90 msgr2=0x55a9b5fe7ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:05.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.579+0000 7ff1f052c800 1 -- 172.21.15.170:0/4224579995 shutdown_connections 2024-09-12T17:28:05.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.579+0000 7ff1f052c800 1 -- 172.21.15.170:0/4224579995 wait complete. 2024-09-12T17:28:05.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.579+0000 7ff1f052c800 1 Processor -- start 2024-09-12T17:28:05.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.579+0000 7ff1f052c800 1 -- start start 2024-09-12T17:28:05.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.579+0000 7ff1f052c800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9b5fed890 0x55a9b5ff4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.579+0000 7ff1f052c800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a9b5fee8a0 con 0x55a9b5fed890 2024-09-12T17:28:05.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.579+0000 7ff1ec93f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9b5fed890 0x55a9b5ff4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.579+0000 7ff1ec93f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9b5fed890 0x55a9b5ff4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:44030/0 (socket says 172.21.15.170:44030) 2024-09-12T17:28:05.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.579+0000 7ff1ec93f640 1 -- 172.21.15.170:0/2562813419 learned_addr learned my addr 172.21.15.170:0/2562813419 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:05.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.580+0000 7ff1ec93f640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9b5ff53f0 con 0x55a9b5fed890 2024-09-12T17:28:05.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.580+0000 7ff1ec93f640 1 --2- 172.21.15.170:0/2562813419 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9b5fed890 0x55a9b5ff4e90 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4013fd0 tx=0x7ff1e4053d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.580+0000 7ff0c1ffb640 1 -- 172.21.15.170:0/2562813419 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1e4037070 con 0x55a9b5fed890 2024-09-12T17:28:05.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.580+0000 7ff0c1ffb640 1 -- 172.21.15.170:0/2562813419 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1e401f500 con 0x55a9b5fed890 2024-09-12T17:28:05.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.580+0000 7ff0c1ffb640 1 -- 172.21.15.170:0/2562813419 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1e401f7e0 con 0x55a9b5fed890 2024-09-12T17:28:05.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.580+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a9b5ff5680 con 0x55a9b5fed890 2024-09-12T17:28:05.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.580+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9b5ff6000 con 0x55a9b5fed890 2024-09-12T17:28:05.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.581+0000 7ff0c1ffb640 1 -- 172.21.15.170:0/2562813419 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ff1e403a070 con 0x55a9b5fed890 2024-09-12T17:28:05.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.581+0000 7ff0c1ffb640 1 --2- 172.21.15.170:0/2562813419 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff0b403c780 0x7ff0b403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.581+0000 7ff0c1ffb640 1 -- 172.21.15.170:0/2562813419 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7ff1e404b070 con 0x55a9b5fed890 2024-09-12T17:28:05.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.581+0000 7ff1ec13e640 1 --2- 172.21.15.170:0/2562813419 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff0b403c780 0x7ff0b403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.581+0000 7ff1f052c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.581+0000 7ff1f052c800 1 --2- 172.21.15.170:0/2562813419 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a9b6000710 0x55a9b6002bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.581+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a9b6003320 con 0x55a9b6000710 2024-09-12T17:28:05.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.581+0000 7ff1e393d640 1 --2- 172.21.15.170:0/2562813419 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a9b6000710 0x55a9b6002bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.581+0000 7ff1ec13e640 1 --2- 172.21.15.170:0/2562813419 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff0b403c780 0x7ff0b403ec40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc018ac0 tx=0x7ff1dc04f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.582+0000 7ff1e393d640 1 --2- 172.21.15.170:0/2562813419 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a9b6000710 0x55a9b6002bd0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.582+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1d4051070 con 0x55a9b6000710 2024-09-12T17:28:05.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.582+0000 7ff1f052c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:05.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.582+0000 7ff1f052c800 20 realm 2024-09-12T17:28:05.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.582+0000 7ff1f052c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.582+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a9b6003750 con 0x55a9b6000710 2024-09-12T17:28:05.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.582+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1d4051070 con 0x55a9b6000710 2024-09-12T17:28:05.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.582+0000 7ff1f052c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:05.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.582+0000 7ff1f052c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:05.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.582+0000 7ff1f052c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.582+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a9b6004020 con 0x55a9b6000710 2024-09-12T17:28:05.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.582+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1d4051070 con 0x55a9b6000710 2024-09-12T17:28:05.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.582+0000 7ff1f052c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:05.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.582+0000 7ff1f052c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.582+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a9b60043c0 con 0x55a9b6000710 2024-09-12T17:28:05.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.583+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff1d4051070 con 0x55a9b6000710 2024-09-12T17:28:05.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.583+0000 7ff1f052c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:05.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.583+0000 7ff1f052c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.583+0000 7ff1f052c800 1 --2- 172.21.15.170:0/2562813419 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a9b6005120 0x55a9b6007510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.583+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a9b6007a50 con 0x55a9b6005120 2024-09-12T17:28:05.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.583+0000 7ff1ec93f640 1 --2- 172.21.15.170:0/2562813419 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a9b6005120 0x55a9b6007510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.583+0000 7ff1ec93f640 1 --2- 172.21.15.170:0/2562813419 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a9b6005120 0x55a9b6007510 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.583+0000 7ff1ec93f640 1 -- 172.21.15.170:0/2562813419 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff1e4039030 con 0x55a9b6005120 2024-09-12T17:28:05.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.583+0000 7ff1f052c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:05.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.583+0000 7ff1f052c800 20 searching for the correct realm 2024-09-12T17:28:05.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.583+0000 7ff1f052c800 1 --2- 172.21.15.170:0/2562813419 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55a9b6009a90 0x55a9b600bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.583+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a9b600c620 con 0x55a9b6009a90 2024-09-12T17:28:05.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.583+0000 7ff1ec13e640 1 --2- 172.21.15.170:0/2562813419 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55a9b6009a90 0x55a9b600bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.584+0000 7ff1ec13e640 1 --2- 172.21.15.170:0/2562813419 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55a9b6009a90 0x55a9b600bf50 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.584+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1dc036040 con 0x55a9b6009a90 2024-09-12T17:28:05.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.584+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a9b600c620 con 0x55a9b6005120 2024-09-12T17:28:05.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.584+0000 7ff1ec93f640 1 -- 172.21.15.170:0/2562813419 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e4039030 con 0x55a9b6005120 2024-09-12T17:28:05.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.584+0000 7ff1ec93f640 1 --2- 172.21.15.170:0/2562813419 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7ff1e403c060 0x7ff1e403b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.584+0000 7ff1ec93f640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a9b600c620 con 0x7ff1e403c060 2024-09-12T17:28:05.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.585+0000 7ff1e393d640 1 --2- 172.21.15.170:0/2562813419 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7ff1e403c060 0x7ff1e403b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.585+0000 7ff1e393d640 1 --2- 172.21.15.170:0/2562813419 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7ff1e403c060 0x7ff1e403b7e0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.585+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1d4051070 con 0x7ff1e403c060 2024-09-12T17:28:05.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.585+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a9b600c620 con 0x55a9b6000710 2024-09-12T17:28:05.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.586+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1d4051070 con 0x55a9b6000710 2024-09-12T17:28:05.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.586+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a9b600c620 con 0x55a9b6000710 2024-09-12T17:28:05.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.586+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1d4051070 con 0x55a9b6000710 2024-09-12T17:28:05.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.586+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a9b600c620 con 0x7ff1e403c060 2024-09-12T17:28:05.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.586+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1d4051070 con 0x7ff1e403c060 2024-09-12T17:28:05.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.586+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a9b600c620 con 0x7ff1e403c060 2024-09-12T17:28:05.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.586+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1d4051070 con 0x7ff1e403c060 2024-09-12T17:28:05.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.586+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a9b600c620 con 0x55a9b6005120 2024-09-12T17:28:05.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.586+0000 7ff1ec93f640 1 -- 172.21.15.170:0/2562813419 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e4039030 con 0x55a9b6005120 2024-09-12T17:28:05.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.586+0000 7ff1ec93f640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a9b600c620 con 0x55a9b6009a90 2024-09-12T17:28:05.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.587+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1dc036040 con 0x55a9b6009a90 2024-09-12T17:28:05.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.587+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a9b600c620 con 0x55a9b6000710 2024-09-12T17:28:05.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.587+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1d4051070 con 0x55a9b6000710 2024-09-12T17:28:05.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.587+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a9b600c620 con 0x7ff1e403c060 2024-09-12T17:28:05.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.587+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1d4051070 con 0x7ff1e403c060 2024-09-12T17:28:05.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.587+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a9b600c620 con 0x55a9b6000710 2024-09-12T17:28:05.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.587+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1d4051070 con 0x55a9b6000710 2024-09-12T17:28:05.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.587+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a9b600c620 con 0x55a9b6005120 2024-09-12T17:28:05.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.588+0000 7ff1ec93f640 1 -- 172.21.15.170:0/2562813419 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7ff1e4039030 con 0x55a9b6005120 2024-09-12T17:28:05.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.588+0000 7ff1ec93f640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a9b600c620 con 0x55a9b6009a90 2024-09-12T17:28:05.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.588+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1dc036040 con 0x55a9b6009a90 2024-09-12T17:28:05.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.588+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a9b600c620 con 0x55a9b6009a90 2024-09-12T17:28:05.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.588+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1dc036040 con 0x55a9b6009a90 2024-09-12T17:28:05.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.588+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a9b600c620 con 0x7ff1e403c060 2024-09-12T17:28:05.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.588+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1d4051070 con 0x7ff1e403c060 2024-09-12T17:28:05.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.588+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a9b600c620 con 0x55a9b6009a90 2024-09-12T17:28:05.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.588+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1dc036040 con 0x55a9b6009a90 2024-09-12T17:28:05.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.589+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a9b600c620 con 0x55a9b6009a90 2024-09-12T17:28:05.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.589+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1dc036040 con 0x55a9b6009a90 2024-09-12T17:28:05.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.589+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a9b600c620 con 0x55a9b6000710 2024-09-12T17:28:05.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.589+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1d4051070 con 0x55a9b6000710 2024-09-12T17:28:05.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.589+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a9b600c620 con 0x55a9b6000710 2024-09-12T17:28:05.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.589+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff1d4051070 con 0x55a9b6000710 2024-09-12T17:28:05.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.589+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a9b600c620 con 0x7ff1e403c060 2024-09-12T17:28:05.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.589+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1d4051070 con 0x7ff1e403c060 2024-09-12T17:28:05.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.589+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a9b600c620 con 0x55a9b6009a90 2024-09-12T17:28:05.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.590+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1dc036040 con 0x55a9b6009a90 2024-09-12T17:28:05.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.590+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a9b600c620 con 0x55a9b6005120 2024-09-12T17:28:05.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.590+0000 7ff1ec93f640 1 -- 172.21.15.170:0/2562813419 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e4039030 con 0x55a9b6005120 2024-09-12T17:28:05.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.590+0000 7ff1ec93f640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a9b600c620 con 0x55a9b6000710 2024-09-12T17:28:05.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.590+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1d4051070 con 0x55a9b6000710 2024-09-12T17:28:05.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.590+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a9b600c620 con 0x7ff1e403c060 2024-09-12T17:28:05.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.591+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1d4051070 con 0x7ff1e403c060 2024-09-12T17:28:05.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.591+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a9b600c620 con 0x55a9b6009a90 2024-09-12T17:28:05.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.591+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1dc036040 con 0x55a9b6009a90 2024-09-12T17:28:05.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.591+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a9b600c620 con 0x7ff1e403c060 2024-09-12T17:28:05.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.591+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1d4051070 con 0x7ff1e403c060 2024-09-12T17:28:05.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.591+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a9b600c620 con 0x55a9b6005120 2024-09-12T17:28:05.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.591+0000 7ff1ec93f640 1 -- 172.21.15.170:0/2562813419 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e4039030 con 0x55a9b6005120 2024-09-12T17:28:05.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.591+0000 7ff1ec93f640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a9b600c620 con 0x55a9b6009a90 2024-09-12T17:28:05.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.592+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1dc036040 con 0x55a9b6009a90 2024-09-12T17:28:05.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.592+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a9b600c620 con 0x7ff1e403c060 2024-09-12T17:28:05.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.592+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1d4051070 con 0x7ff1e403c060 2024-09-12T17:28:05.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.592+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a9b600c620 con 0x55a9b6000710 2024-09-12T17:28:05.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.592+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff1d4051070 con 0x55a9b6000710 2024-09-12T17:28:05.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.592+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a9b600c620 con 0x55a9b6005120 2024-09-12T17:28:05.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.592+0000 7ff1ec93f640 1 -- 172.21.15.170:0/2562813419 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff1e4068040 con 0x55a9b6005120 2024-09-12T17:28:05.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.592+0000 7ff1f052c800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:05.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.592+0000 7ff1f052c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:05.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.592+0000 7ff1f052c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:05.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.592+0000 7ff1f052c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:05.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.592+0000 7ff1f052c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:05.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.592+0000 7ff1f052c800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:05.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.592+0000 7ff1f052c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.592+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a9b6008490 con 0x55a9b6000710 2024-09-12T17:28:05.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.593+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1d4051070 con 0x55a9b6000710 2024-09-12T17:28:05.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.593+0000 7ff1f052c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:05.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.593+0000 7ff1f052c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.593+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a9b6008070 con 0x55a9b6000710 2024-09-12T17:28:05.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.593+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff1d4051070 con 0x55a9b6000710 2024-09-12T17:28:05.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.593+0000 7ff1f052c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:05.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.593+0000 7ff1f052c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.593+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a9b6008db0 con 0x55a9b6005120 2024-09-12T17:28:05.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.593+0000 7ff1ec93f640 1 -- 172.21.15.170:0/2562813419 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff1e4068040 con 0x55a9b6005120 2024-09-12T17:28:05.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.593+0000 7ff1f052c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:05.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.593+0000 7ff1f052c800 20 zone default found 2024-09-12T17:28:05.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.593+0000 7ff1f052c800 4 Realm: () 2024-09-12T17:28:05.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.593+0000 7ff1f052c800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:05.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.593+0000 7ff1f052c800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:05.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.593+0000 7ff1f052c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:05.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.593+0000 7ff1f052c800 20 zonegroup default 2024-09-12T17:28:05.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.593+0000 7ff1f052c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.593+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a9b6008910 con 0x7ff1e403c060 2024-09-12T17:28:05.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.593+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff1d4051070 con 0x7ff1e403c060 2024-09-12T17:28:05.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.593+0000 7ff1f052c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:05.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.593+0000 7ff1f052c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.594+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a9b600ee40 con 0x55a9b6009a90 2024-09-12T17:28:05.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.594+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff1dc036040 con 0x55a9b6009a90 2024-09-12T17:28:05.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.594+0000 7ff1f052c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:05.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.594+0000 7ff1f052c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.594+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a9b600f1e0 con 0x55a9b6009a90 2024-09-12T17:28:05.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.594+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff1dc036040 con 0x55a9b6009a90 2024-09-12T17:28:05.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.594+0000 7ff1f052c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:05.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.594+0000 7ff1f052c800 20 started sync module instance, tier type = 2024-09-12T17:28:05.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.594+0000 7ff1f052c800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:05.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.594+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a9b600e2d0 con 0x55a9b6005120 2024-09-12T17:28:05.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.595+0000 7ff1ec93f640 1 -- 172.21.15.170:0/2562813419 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e4068040 con 0x55a9b6005120 2024-09-12T17:28:05.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.595+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94187391346368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a9b600faa0 con 0x55a9b6005120 2024-09-12T17:28:05.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.595+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a9b60102f0 con 0x55a9b6000710 2024-09-12T17:28:05.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.596+0000 7ff1ec93f640 1 -- 172.21.15.170:0/2562813419 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94187391346368] v29'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e4068040 con 0x55a9b6005120 2024-09-12T17:28:05.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.596+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1d4051070 con 0x55a9b6000710 2024-09-12T17:28:05.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.596+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94187391350528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a9b60100b0 con 0x55a9b6000710 2024-09-12T17:28:05.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.596+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a9b6010bb0 con 0x55a9b6009a90 2024-09-12T17:28:05.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.597+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94187391350528] v29'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1d4051070 con 0x55a9b6000710 2024-09-12T17:28:05.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.598+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1dc036040 con 0x55a9b6009a90 2024-09-12T17:28:05.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.598+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94187391354528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a9b6010fd0 con 0x55a9b6009a90 2024-09-12T17:28:05.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.598+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a9b6011990 con 0x55a9b6005120 2024-09-12T17:28:05.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.599+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94187391354528] v29'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1dc036040 con 0x55a9b6009a90 2024-09-12T17:28:05.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.599+0000 7ff1ec93f640 1 -- 172.21.15.170:0/2562813419 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e4068040 con 0x55a9b6005120 2024-09-12T17:28:05.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.599+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94187391358176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a9b6011900 con 0x55a9b6005120 2024-09-12T17:28:05.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.599+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a9b6012880 con 0x55a9b6000710 2024-09-12T17:28:05.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.600+0000 7ff1ec93f640 1 -- 172.21.15.170:0/2562813419 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94187391358176] v29'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e4068040 con 0x55a9b6005120 2024-09-12T17:28:05.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.600+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1d4051070 con 0x55a9b6000710 2024-09-12T17:28:05.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.600+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94187391360432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a9b6012880 con 0x55a9b6000710 2024-09-12T17:28:05.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.600+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a9b6013240 con 0x7ff1e403c060 2024-09-12T17:28:05.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.601+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94187391360432] v29'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1d4051070 con 0x55a9b6000710 2024-09-12T17:28:05.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.601+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1d4051070 con 0x7ff1e403c060 2024-09-12T17:28:05.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.601+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94187391364976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a9b6012880 con 0x7ff1e403c060 2024-09-12T17:28:05.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.601+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a9b6013c50 con 0x7ff1e403c060 2024-09-12T17:28:05.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.602+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94187391364976] v29'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1d4051070 con 0x7ff1e403c060 2024-09-12T17:28:05.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.602+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(56 notify.6 [create] v29'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1d4051070 con 0x7ff1e403c060 2024-09-12T17:28:05.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.602+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94187391367552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a9b6012880 con 0x7ff1e403c060 2024-09-12T17:28:05.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.602+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a9b6014660 con 0x7ff1e403c060 2024-09-12T17:28:05.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.603+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94187391367552] v29'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1d4051070 con 0x7ff1e403c060 2024-09-12T17:28:05.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.603+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(58 notify.7 [create] v29'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1d4051070 con 0x7ff1e403c060 2024-09-12T17:28:05.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.603+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94187391362480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a9b6014660 con 0x7ff1e403c060 2024-09-12T17:28:05.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.603+0000 7ff1f052c800 20 add_watcher() i=0 2024-09-12T17:28:05.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.603+0000 7ff1f052c800 20 add_watcher() i=1 2024-09-12T17:28:05.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.603+0000 7ff1f052c800 20 add_watcher() i=2 2024-09-12T17:28:05.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.603+0000 7ff1f052c800 20 add_watcher() i=3 2024-09-12T17:28:05.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.603+0000 7ff1f052c800 20 add_watcher() i=4 2024-09-12T17:28:05.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.603+0000 7ff1f052c800 20 add_watcher() i=5 2024-09-12T17:28:05.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.603+0000 7ff1f052c800 20 add_watcher() i=6 2024-09-12T17:28:05.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.604+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94187391362480] v29'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1d4051070 con 0x7ff1e403c060 2024-09-12T17:28:05.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.604+0000 7ff1f052c800 20 add_watcher() i=7 2024-09-12T17:28:05.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.604+0000 7ff1f052c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:05.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.604+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a9b6017a60 con 0x55a9b6000710 2024-09-12T17:28:05.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.605+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff1d4051070 con 0x55a9b6000710 2024-09-12T17:28:05.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.605+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94187391370112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a9b6014f80 con 0x55a9b6000710 2024-09-12T17:28:05.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.605+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94187391370112] v29'146 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff1d4051070 con 0x55a9b6000710 2024-09-12T17:28:05.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.606+0000 7ff0a2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:05.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.606+0000 7ff1f052c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:05.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.606+0000 7ff1f052c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:05.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.606+0000 7ff1f052c800 5 note: GC not initialized 2024-09-12T17:28:05.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.606+0000 7ff0a1fdb640 20 reqs_thread_entry: start 2024-09-12T17:28:05.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.606+0000 7ff1f052c800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:05.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.606+0000 7ff1f052c800 20 Filter name: none 2024-09-12T17:28:05.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.606+0000 7ff0137fe640 20 reqs_thread_entry: start 2024-09-12T17:28:05.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.606+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a9b604a170 con 0x7ff1e403c060 2024-09-12T17:28:05.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.607+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(62 [pgnls start_epoch 29 out=254b] v29'34 uv18 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7ff1d4051070 con 0x7ff1e403c060 2024-09-12T17:28:05.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.607+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a9b6008910 con 0x7ff1e403c060 2024-09-12T17:28:05.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.607+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(63 [pgnls start_epoch 29 out=131b] v29'4 uv4 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7ff1d4051070 con 0x7ff1e403c060 2024-09-12T17:28:05.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.607+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a9b6008910 con 0x55a9b6009a90 2024-09-12T17:28:05.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.607+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(64 [pgnls start_epoch 29 out=295b] v29'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7ff1dc036040 con 0x55a9b6009a90 2024-09-12T17:28:05.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.607+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a9b6010fd0 con 0x7ff1e403c060 2024-09-12T17:28:05.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.608+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(65 [pgnls start_epoch 29 out=172b] v29'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7ff1d4051070 con 0x7ff1e403c060 2024-09-12T17:28:05.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.608+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a9b6010fd0 con 0x55a9b6000710 2024-09-12T17:28:05.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.608+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(66 [pgnls start_epoch 29 out=335b] v29'146 uv23 ondisk = 1) ==== 144+0+335 (crc 0 0 0) 0x7ff1d4051070 con 0x55a9b6000710 2024-09-12T17:28:05.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.608+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a9b6010fd0 con 0x55a9b6005120 2024-09-12T17:28:05.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.608+0000 7ff1ec93f640 1 -- 172.21.15.170:0/2562813419 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(67 [pgnls start_epoch 29 out=213b] v29'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7ff1e4068040 con 0x55a9b6005120 2024-09-12T17:28:05.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.608+0000 7ff1ec93f640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a9b600e2d0 con 0x55a9b6009a90 2024-09-12T17:28:05.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.609+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 <== osd.3 v2:172.21.15.170:6816/2664906588 15 ==== osd_op_reply(68 [pgnls start_epoch 29 out=254b] v29'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7ff1dc036040 con 0x55a9b6009a90 2024-09-12T17:28:05.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.609+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a9b600e2d0 con 0x55a9b6009a90 2024-09-12T17:28:05.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.609+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 <== osd.3 v2:172.21.15.170:6816/2664906588 16 ==== osd_op_reply(69 [pgnls start_epoch 29 out=295b] v29'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7ff1dc036040 con 0x55a9b6009a90 2024-09-12T17:28:05.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.609+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a9b600e2d0 con 0x55a9b6009a90 2024-09-12T17:28:05.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.609+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 <== osd.3 v2:172.21.15.170:6816/2664906588 17 ==== osd_op_reply(70 [pgnls start_epoch 29 out=213b] v29'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7ff1dc036040 con 0x55a9b6009a90 2024-09-12T17:28:05.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.609+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a9b600e2d0 con 0x55a9b6005120 2024-09-12T17:28:05.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.609+0000 7ff1ec93f640 1 -- 172.21.15.170:0/2562813419 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(71 [pgnls start_epoch 29 out=172b] v29'18 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7ff1e4068040 con 0x55a9b6005120 2024-09-12T17:28:05.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.609+0000 7ff1ec93f640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a9b600e2d0 con 0x55a9b6005120 2024-09-12T17:28:05.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.609+0000 7ff1ec93f640 1 -- 172.21.15.170:0/2562813419 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(72 [pgnls start_epoch 29 out=336b] v29'28 uv19 ondisk = 1) ==== 144+0+336 (crc 0 0 0) 0x7ff1e4068040 con 0x55a9b6005120 2024-09-12T17:28:05.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.609+0000 7ff1ec93f640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a9b600e2d0 con 0x55a9b6009a90 2024-09-12T17:28:05.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.610+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 <== osd.3 v2:172.21.15.170:6816/2664906588 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=131b] v29'17 uv9 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7ff1dc036040 con 0x55a9b6009a90 2024-09-12T17:28:05.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.610+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a9b600e2d0 con 0x55a9b6009a90 2024-09-12T17:28:05.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.610+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 <== osd.3 v2:172.21.15.170:6816/2664906588 19 ==== osd_op_reply(74 [pgnls start_epoch 29 out=254b] v29'12 uv12 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7ff1dc036040 con 0x55a9b6009a90 2024-09-12T17:28:05.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.610+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7ff1dc068040 con 0x55a9b6009a90 2024-09-12T17:28:05.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.610+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 <== osd.3 v2:172.21.15.170:6816/2664906588 20 ==== osd_op_reply(75 [pgnls start_epoch 29 out=90b] v29'17 uv9 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7ff1dc036040 con 0x55a9b6009a90 2024-09-12T17:28:05.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.610+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7ff1dc068040 con 0x55a9b6000710 2024-09-12T17:28:05.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.610+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(76 [pgnls start_epoch 29 out=213b] v29'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7ff1d4051070 con 0x55a9b6000710 2024-09-12T17:28:05.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.610+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7ff1dc068040 con 0x55a9b6009a90 2024-09-12T17:28:05.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.611+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 <== osd.3 v2:172.21.15.170:6816/2664906588 21 ==== osd_op_reply(77 [pgnls start_epoch 29 out=254b] v29'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7ff1dc036040 con 0x55a9b6009a90 2024-09-12T17:28:05.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.611+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7ff1dc068040 con 0x55a9b6000710 2024-09-12T17:28:05.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.611+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(78 [pgnls start_epoch 29 out=254b] v29'15 uv14 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7ff1d4051070 con 0x55a9b6000710 2024-09-12T17:28:05.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.611+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7ff1dc068040 con 0x55a9b6009a90 2024-09-12T17:28:05.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.611+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 <== osd.3 v2:172.21.15.170:6816/2664906588 22 ==== osd_op_reply(79 [pgnls start_epoch 29 out=213b] v29'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7ff1dc036040 con 0x55a9b6009a90 2024-09-12T17:28:05.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.611+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7ff1dc068040 con 0x55a9b6009a90 2024-09-12T17:28:05.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.611+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 <== osd.3 v2:172.21.15.170:6816/2664906588 23 ==== osd_op_reply(80 [pgnls start_epoch 29 out=172b] v29'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7ff1dc036040 con 0x55a9b6009a90 2024-09-12T17:28:05.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.611+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7ff1dc068040 con 0x55a9b6000710 2024-09-12T17:28:05.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.612+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(81 [pgnls start_epoch 29 out=295b] v29'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7ff1d4051070 con 0x55a9b6000710 2024-09-12T17:28:05.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.612+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7ff1dc068040 con 0x55a9b6005120 2024-09-12T17:28:05.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.612+0000 7ff1ec93f640 1 -- 172.21.15.170:0/2562813419 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(82 [pgnls start_epoch 29 out=276b] v29'15 uv15 ondisk = 1) ==== 144+0+276 (crc 0 0 0) 0x7ff1e4068040 con 0x55a9b6005120 2024-09-12T17:28:05.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.612+0000 7ff1ec93f640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7ff1dc068040 con 0x55a9b6005120 2024-09-12T17:28:05.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.612+0000 7ff1ec93f640 1 -- 172.21.15.170:0/2562813419 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== osd_op_reply(83 [pgnls start_epoch 29 out=172b] v29'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7ff1e4068040 con 0x55a9b6005120 2024-09-12T17:28:05.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.612+0000 7ff1ec93f640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7ff1dc068040 con 0x55a9b6000710 2024-09-12T17:28:05.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.613+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(84 [pgnls start_epoch 29 out=295b] v29'25 uv17 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7ff1d4051070 con 0x55a9b6000710 2024-09-12T17:28:05.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.613+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7ff1dc068040 con 0x7ff1e403c060 2024-09-12T17:28:05.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.613+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(85 [pgnls start_epoch 29 out=172b] v29'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7ff1d4051070 con 0x7ff1e403c060 2024-09-12T17:28:05.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.613+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7ff1dc068040 con 0x55a9b6005120 2024-09-12T17:28:05.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.614+0000 7ff1ec93f640 1 -- 172.21.15.170:0/2562813419 <== osd.2 v2:172.21.15.170:6808/3855567754 18 ==== osd_op_reply(86 [pgnls start_epoch 29 out=213b] v29'43 uv19 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7ff1e4068040 con 0x55a9b6005120 2024-09-12T17:28:05.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.614+0000 7ff1ec93f640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7ff1dc068040 con 0x7ff1e403c060 2024-09-12T17:28:05.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.614+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== osd_op_reply(87 [pgnls start_epoch 29 out=172b] v29'19 uv11 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7ff1d4051070 con 0x7ff1e403c060 2024-09-12T17:28:05.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.614+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7ff1dc068040 con 0x55a9b6009a90 2024-09-12T17:28:05.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.614+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 <== osd.3 v2:172.21.15.170:6816/2664906588 24 ==== osd_op_reply(88 [pgnls start_epoch 29 out=172b] v29'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7ff1dc036040 con 0x55a9b6009a90 2024-09-12T17:28:05.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.614+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7ff1dc068040 con 0x55a9b6009a90 2024-09-12T17:28:05.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.614+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 <== osd.3 v2:172.21.15.170:6816/2664906588 25 ==== osd_op_reply(89 [pgnls start_epoch 29 out=90b] v29'13 uv5 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7ff1dc036040 con 0x55a9b6009a90 2024-09-12T17:28:05.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.614+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7ff1dc068040 con 0x55a9b6009a90 2024-09-12T17:28:05.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.615+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 <== osd.3 v2:172.21.15.170:6816/2664906588 26 ==== osd_op_reply(90 [pgnls start_epoch 29 out=90b] v29'37 uv13 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7ff1dc036040 con 0x55a9b6009a90 2024-09-12T17:28:05.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.615+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7ff1dc068040 con 0x55a9b6000710 2024-09-12T17:28:05.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.615+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(91 [pgnls start_epoch 29 out=131b] v29'6 uv6 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7ff1d4051070 con 0x55a9b6000710 2024-09-12T17:28:05.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.615+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7ff1dc068040 con 0x55a9b6005120 2024-09-12T17:28:05.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.615+0000 7ff1ec93f640 1 -- 172.21.15.170:0/2562813419 <== osd.2 v2:172.21.15.170:6808/3855567754 19 ==== osd_op_reply(92 [pgnls start_epoch 29 out=295b] v29'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7ff1e4068040 con 0x55a9b6005120 2024-09-12T17:28:05.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.615+0000 7ff1ec93f640 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7ff1dc068040 con 0x7ff1e403c060 2024-09-12T17:28:05.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.616+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.0 v2:172.21.15.47:6800/3978157098 22 ==== osd_op_reply(93 [pgnls start_epoch 29 out=213b] v29'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7ff1d4051070 con 0x7ff1e403c060 2024-09-12T17:28:05.630 INFO:teuthology.orchestra.run.smithi170.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-09-12T17:28:05.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.617+0000 7ff0a2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:05.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.617+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94187391370112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a9b60484e0 con 0x55a9b6000710 2024-09-12T17:28:05.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.618+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94187391370112] v29'147 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff1d4051070 con 0x55a9b6000710 2024-09-12T17:28:05.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.618+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94187391346368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a9b60484e0 con 0x55a9b6005120 2024-09-12T17:28:05.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.619+0000 7ff1ec93f640 1 -- 172.21.15.170:0/2562813419 <== osd.2 v2:172.21.15.170:6808/3855567754 20 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94187391346368] v29'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e4068040 con 0x55a9b6005120 2024-09-12T17:28:05.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.619+0000 7ff1f052c800 20 remove_watcher() i=0 2024-09-12T17:28:05.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.619+0000 7ff1f052c800 2 removed watcher, disabling cache 2024-09-12T17:28:05.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.619+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94187391350528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a9b600e6c0 con 0x55a9b6000710 2024-09-12T17:28:05.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.620+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94187391350528] v29'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1d4051070 con 0x55a9b6000710 2024-09-12T17:28:05.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.621+0000 7ff1f052c800 20 remove_watcher() i=1 2024-09-12T17:28:05.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.621+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94187391354528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a9b600f700 con 0x55a9b6009a90 2024-09-12T17:28:05.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.622+0000 7ff1ec13e640 1 -- 172.21.15.170:0/2562813419 <== osd.3 v2:172.21.15.170:6816/2664906588 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94187391354528] v29'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1dc036040 con 0x55a9b6009a90 2024-09-12T17:28:05.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.622+0000 7ff1f052c800 20 remove_watcher() i=2 2024-09-12T17:28:05.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.622+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94187391358176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a9b60106a0 con 0x55a9b6005120 2024-09-12T17:28:05.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.623+0000 7ff1ec93f640 1 -- 172.21.15.170:0/2562813419 <== osd.2 v2:172.21.15.170:6808/3855567754 21 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94187391358176] v29'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e4068040 con 0x55a9b6005120 2024-09-12T17:28:05.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.623+0000 7ff1f052c800 20 remove_watcher() i=3 2024-09-12T17:28:05.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.623+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94187391360432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a9b60106a0 con 0x55a9b6000710 2024-09-12T17:28:05.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.624+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94187391360432] v29'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1d4051070 con 0x55a9b6000710 2024-09-12T17:28:05.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.624+0000 7ff1f052c800 20 remove_watcher() i=4 2024-09-12T17:28:05.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.624+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94187391364976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a9b6011db0 con 0x7ff1e403c060 2024-09-12T17:28:05.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.625+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.0 v2:172.21.15.47:6800/3978157098 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94187391364976] v29'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1d4051070 con 0x7ff1e403c060 2024-09-12T17:28:05.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.625+0000 7ff1f052c800 20 remove_watcher() i=5 2024-09-12T17:28:05.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.625+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94187391367552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a9b60106a0 con 0x7ff1e403c060 2024-09-12T17:28:05.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.626+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.0 v2:172.21.15.47:6800/3978157098 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94187391367552] v29'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1d4051070 con 0x7ff1e403c060 2024-09-12T17:28:05.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.626+0000 7ff1f052c800 20 remove_watcher() i=6 2024-09-12T17:28:05.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.626+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94187391362480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a9b60106a0 con 0x7ff1e403c060 2024-09-12T17:28:05.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.627+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 <== osd.0 v2:172.21.15.47:6800/3978157098 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94187391362480] v29'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1d4051070 con 0x7ff1e403c060 2024-09-12T17:28:05.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.627+0000 7ff1f052c800 20 remove_watcher() i=7 2024-09-12T17:28:05.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.627+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7ff1e403c060 msgr2=0x7ff1e403b7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.627+0000 7ff1f052c800 1 --2- 172.21.15.170:0/2562813419 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7ff1e403c060 0x7ff1e403b7e0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.627+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a9b6000710 msgr2=0x55a9b6002bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.627+0000 7ff1f052c800 1 --2- 172.21.15.170:0/2562813419 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a9b6000710 0x55a9b6002bd0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.627+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a9b6005120 msgr2=0x55a9b6007510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.627+0000 7ff1f052c800 1 --2- 172.21.15.170:0/2562813419 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a9b6005120 0x55a9b6007510 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.627+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55a9b6009a90 msgr2=0x55a9b600bf50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.627+0000 7ff1f052c800 1 --2- 172.21.15.170:0/2562813419 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55a9b6009a90 0x55a9b600bf50 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.627+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff0b403c780 msgr2=0x7ff0b403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.627+0000 7ff1f052c800 1 --2- 172.21.15.170:0/2562813419 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff0b403c780 0x7ff0b403ec40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc018ac0 tx=0x7ff1dc04f000 comp rx=0 tx=0).stop 2024-09-12T17:28:05.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.627+0000 7ff1e393d640 1 -- 172.21.15.170:0/2562813419 reap_dead start 2024-09-12T17:28:05.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.627+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9b5fed890 msgr2=0x55a9b5ff4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.627+0000 7ff1f052c800 1 --2- 172.21.15.170:0/2562813419 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9b5fed890 0x55a9b5ff4e90 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4013fd0 tx=0x7ff1e4053d30 comp rx=0 tx=0).stop 2024-09-12T17:28:05.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.627+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 shutdown_connections 2024-09-12T17:28:05.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.627+0000 7ff1f052c800 1 --2- 172.21.15.170:0/2562813419 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9b5fed890 0x55a9b5ff4e90 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.627+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 >> 172.21.15.170:0/2562813419 conn(0x55a9b5fe9c90 msgr2=0x55a9b5fe7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:05.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.627+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 shutdown_connections 2024-09-12T17:28:05.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.627+0000 7ff1f052c800 1 -- 172.21.15.170:0/2562813419 wait complete. 2024-09-12T17:28:05.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.627+0000 7ff1f052c800 1 -- 172.21.15.170:0/169869248 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff0c403c730 msgr2=0x7ff0c403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.627+0000 7ff1f052c800 1 --2- 172.21.15.170:0/169869248 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff0c403c730 0x7ff0c403ebf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x55a9b5fcdc00 tx=0x7ff1dc040040 comp rx=0 tx=0).stop 2024-09-12T17:28:05.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.627+0000 7ff1f052c800 1 -- 172.21.15.170:0/169869248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9b5fe0dd0 msgr2=0x55a9b5fe11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.627+0000 7ff1f052c800 1 --2- 172.21.15.170:0/169869248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9b5fe0dd0 0x55a9b5fe11f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x55a9b5fc6e30 tx=0x7ff1e40167b0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.627+0000 7ff1f052c800 1 -- 172.21.15.170:0/169869248 shutdown_connections 2024-09-12T17:28:05.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.627+0000 7ff1f052c800 1 --2- 172.21.15.170:0/169869248 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff0c403c730 0x7ff0c403ebf0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.627+0000 7ff1f052c800 1 --2- 172.21.15.170:0/169869248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9b5fe0dd0 0x55a9b5fe11f0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.627+0000 7ff1f052c800 1 -- 172.21.15.170:0/169869248 >> 172.21.15.170:0/169869248 conn(0x55a9b5fd5180 msgr2=0x55a9b5fd5560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:05.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.628+0000 7ff1f052c800 1 -- 172.21.15.170:0/169869248 shutdown_connections 2024-09-12T17:28:05.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.628+0000 7ff1f052c800 1 -- 172.21.15.170:0/169869248 wait complete. 2024-09-12T17:28:05.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.628+0000 7ff1f052c800 1 -- 172.21.15.170:0/862482090 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a9b5ecf200 msgr2=0x55a9b5fcd5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.628+0000 7ff1f052c800 1 --2- 172.21.15.170:0/862482090 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a9b5ecf200 0x55a9b5fcd5f0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.628+0000 7ff1f052c800 1 -- 172.21.15.170:0/862482090 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a9b5fcfa60 msgr2=0x55a9b5fd1e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.628+0000 7ff1f052c800 1 --2- 172.21.15.170:0/862482090 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a9b5fcfa60 0x55a9b5fd1e50 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.628+0000 7ff1f052c800 1 -- 172.21.15.170:0/862482090 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff0d403c780 msgr2=0x7ff0d403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.628+0000 7ff1f052c800 1 --2- 172.21.15.170:0/862482090 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff0d403c780 0x7ff0d403ec40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4057000 tx=0x7ff1d4052000 comp rx=0 tx=0).stop 2024-09-12T17:28:05.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.628+0000 7ff1f052c800 1 -- 172.21.15.170:0/862482090 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9b5ecddf0 msgr2=0x55a9b5fc5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.628+0000 7ff1f052c800 1 --2- 172.21.15.170:0/862482090 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9b5ecddf0 0x55a9b5fc5fa0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc00c010 tx=0x7ff1dc000ed0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.628+0000 7ff1f052c800 1 -- 172.21.15.170:0/862482090 shutdown_connections 2024-09-12T17:28:05.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.628+0000 7ff1f052c800 1 --2- 172.21.15.170:0/862482090 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a9b5fcfa60 0x55a9b5fd1e50 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.628+0000 7ff1f052c800 1 --2- 172.21.15.170:0/862482090 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff0d403c780 0x7ff0d403ec40 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.628+0000 7ff1f052c800 1 --2- 172.21.15.170:0/862482090 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a9b5ecf200 0x55a9b5fcd5f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.628+0000 7ff1f052c800 1 --2- 172.21.15.170:0/862482090 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9b5ecddf0 0x55a9b5fc5fa0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.628+0000 7ff1f052c800 1 -- 172.21.15.170:0/862482090 >> 172.21.15.170:0/862482090 conn(0x55a9b5ec91e0 msgr2=0x55a9b5fb7680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:05.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.628+0000 7ff1f052c800 1 -- 172.21.15.170:0/862482090 shutdown_connections 2024-09-12T17:28:05.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.628+0000 7ff1f052c800 1 -- 172.21.15.170:0/862482090 wait complete. 2024-09-12T17:28:05.642 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-09-12T17:28:05.642 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-12T17:28:05.642 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-12T17:28:05.642 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-12T17:28:05.727 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:05.727 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:05.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.725+0000 7f395a8bb800 1 Processor -- start 2024-09-12T17:28:05.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.725+0000 7f395a8bb800 1 -- start start 2024-09-12T17:28:05.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.725+0000 7f395a8bb800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x556f53e54200 0x556f53e59da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.725+0000 7f395a8bb800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556f53cfde40 con 0x556f53e52df0 2024-09-12T17:28:05.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.725+0000 7f395a8bb800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x556f53cc8680 con 0x556f53e54200 2024-09-12T17:28:05.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.726+0000 7f394fba4640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x556f53e54200 0x556f53e59da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.726+0000 7f39583a5640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x556f53e52df0 0x556f53e53af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:37064/0 (socket says 172.21.15.170:37064) 2024-09-12T17:28:05.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.726+0000 7f39583a5640 1 -- 172.21.15.170:0/1745260216 learned_addr learned my addr 172.21.15.170:0/1745260216 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:28:05.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.726+0000 7f394fba4640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x556f53e54200 0x556f53e59da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:44046/0 (socket says 172.21.15.170:44046) 2024-09-12T17:28:05.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.726+0000 7f394fba4640 1 -- 172.21.15.170:0/1745260216 >> v1:172.21.15.47:6789/0 conn(0x556f53e52df0 legacy=0x556f53e53af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.726+0000 7f394fba4640 1 -- 172.21.15.170:0/1745260216 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f53ce46b0 con 0x556f53e54200 2024-09-12T17:28:05.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.728+0000 7f394fba4640 1 --2- 172.21.15.170:0/1745260216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f53e54200 0x556f53e59da0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f394000a470 tx=0x7f3940045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=358da61676f0403c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.728+0000 7f3957ba4640 1 -- 172.21.15.170:0/1745260216 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3940053570 con 0x556f53e54200 2024-09-12T17:28:05.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.728+0000 7f3957ba4640 1 -- 172.21.15.170:0/1745260216 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3940058070 con 0x556f53e54200 2024-09-12T17:28:05.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.728+0000 7f3957ba4640 1 -- 172.21.15.170:0/1745260216 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3940053880 con 0x556f53e54200 2024-09-12T17:28:05.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.728+0000 7f395a8bb800 1 -- 172.21.15.170:0/1745260216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f53e54200 msgr2=0x556f53e59da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.728+0000 7f395a8bb800 1 --2- 172.21.15.170:0/1745260216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f53e54200 0x556f53e59da0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f394000a470 tx=0x7f3940045a20 comp rx=0 tx=0).stop 2024-09-12T17:28:05.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.728+0000 7f395a8bb800 1 -- 172.21.15.170:0/1745260216 shutdown_connections 2024-09-12T17:28:05.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.728+0000 7f395a8bb800 1 --2- 172.21.15.170:0/1745260216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f53e54200 0x556f53e59da0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.728+0000 7f395a8bb800 1 -- 172.21.15.170:0/1745260216 >> 172.21.15.170:0/1745260216 conn(0x556f53e4e1c0 msgr2=0x556f53e50620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:05.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.729+0000 7f395a8bb800 1 -- 172.21.15.170:0/1745260216 shutdown_connections 2024-09-12T17:28:05.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.729+0000 7f395a8bb800 1 -- 172.21.15.170:0/1745260216 wait complete. 2024-09-12T17:28:05.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.742+0000 7f395a8bb800 1 Processor -- start 2024-09-12T17:28:05.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.743+0000 7f395a8bb800 1 -- start start 2024-09-12T17:28:05.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.743+0000 7f395a8bb800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f53e52df0 0x556f53dc6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.743+0000 7f395a8bb800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556f53cecdd0 con 0x556f53e52df0 2024-09-12T17:28:05.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.743+0000 7f39583a5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f53e52df0 0x556f53dc6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.743+0000 7f39583a5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f53e52df0 0x556f53dc6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:44058/0 (socket says 172.21.15.170:44058) 2024-09-12T17:28:05.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.743+0000 7f39583a5640 1 -- 172.21.15.170:0/2772876738 learned_addr learned my addr 172.21.15.170:0/2772876738 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:05.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.743+0000 7f39583a5640 1 -- 172.21.15.170:0/2772876738 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f53d05e10 con 0x556f53e52df0 2024-09-12T17:28:05.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.744+0000 7f39583a5640 1 --2- 172.21.15.170:0/2772876738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f53e52df0 0x556f53dc6db0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f3948001df0 tx=0x7f394800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45c5d1f865a4fbb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.744+0000 7f384660c640 1 -- 172.21.15.170:0/2772876738 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3948012020 con 0x556f53e52df0 2024-09-12T17:28:05.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.744+0000 7f384660c640 1 -- 172.21.15.170:0/2772876738 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f394800e470 con 0x556f53e52df0 2024-09-12T17:28:05.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.744+0000 7f384660c640 1 -- 172.21.15.170:0/2772876738 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f394800e7f0 con 0x556f53e52df0 2024-09-12T17:28:05.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.744+0000 7f395a8bb800 1 -- 172.21.15.170:0/2772876738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f53e52df0 msgr2=0x556f53dc6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.744+0000 7f395a8bb800 1 --2- 172.21.15.170:0/2772876738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f53e52df0 0x556f53dc6db0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f3948001df0 tx=0x7f394800b6c0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.744+0000 7f395a8bb800 1 -- 172.21.15.170:0/2772876738 shutdown_connections 2024-09-12T17:28:05.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.744+0000 7f395a8bb800 1 --2- 172.21.15.170:0/2772876738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f53e52df0 0x556f53dc6db0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.744+0000 7f395a8bb800 1 -- 172.21.15.170:0/2772876738 >> 172.21.15.170:0/2772876738 conn(0x556f53e4e1c0 msgr2=0x556f53f3ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:05.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.745+0000 7f395a8bb800 1 -- 172.21.15.170:0/2772876738 shutdown_connections 2024-09-12T17:28:05.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.745+0000 7f395a8bb800 1 -- 172.21.15.170:0/2772876738 wait complete. 2024-09-12T17:28:05.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.745+0000 7f395a8bb800 1 Processor -- start 2024-09-12T17:28:05.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.745+0000 7f395a8bb800 1 -- start start 2024-09-12T17:28:05.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.745+0000 7f395a8bb800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f53e52df0 0x556f53f4aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.745+0000 7f395a8bb800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556f53e548f0 con 0x556f53e52df0 2024-09-12T17:28:05.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.745+0000 7f39583a5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f53e52df0 0x556f53f4aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.745+0000 7f39583a5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f53e52df0 0x556f53f4aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:44060/0 (socket says 172.21.15.170:44060) 2024-09-12T17:28:05.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.745+0000 7f39583a5640 1 -- 172.21.15.170:0/1100353640 learned_addr learned my addr 172.21.15.170:0/1100353640 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:05.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.745+0000 7f39583a5640 1 -- 172.21.15.170:0/1100353640 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f53f4b550 con 0x556f53e52df0 2024-09-12T17:28:05.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.746+0000 7f39583a5640 1 --2- 172.21.15.170:0/1100353640 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f53e52df0 0x556f53f4aff0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x556f53dc68e0 tx=0x7f3948000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.746+0000 7f3844e09640 1 -- 172.21.15.170:0/1100353640 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3948012030 con 0x556f53e52df0 2024-09-12T17:28:05.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.746+0000 7f3844e09640 1 -- 172.21.15.170:0/1100353640 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3948001450 con 0x556f53e52df0 2024-09-12T17:28:05.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.746+0000 7f395a8bb800 1 -- 172.21.15.170:0/1100353640 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556f53f4b7e0 con 0x556f53e52df0 2024-09-12T17:28:05.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.746+0000 7f3844e09640 1 -- 172.21.15.170:0/1100353640 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f394801a7a0 con 0x556f53e52df0 2024-09-12T17:28:05.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.746+0000 7f395a8bb800 1 -- 172.21.15.170:0/1100353640 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f53f4c1e0 con 0x556f53e52df0 2024-09-12T17:28:05.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.747+0000 7f3844e09640 1 -- 172.21.15.170:0/1100353640 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3948015020 con 0x556f53e52df0 2024-09-12T17:28:05.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.747+0000 7f3844e09640 1 --2- 172.21.15.170:0/1100353640 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f384003c730 0x7f384003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.747+0000 7f3844e09640 1 -- 172.21.15.170:0/1100353640 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f3948020030 con 0x556f53e52df0 2024-09-12T17:28:05.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.747+0000 7f394fba4640 1 --2- 172.21.15.170:0/1100353640 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f384003c730 0x7f384003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.747+0000 7f395a8bb800 1 --2- 172.21.15.170:0/1100353640 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x556f53e54200 0x556f53f52640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.747+0000 7f395a8bb800 1 -- 172.21.15.170:0/1100353640 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556f53f52b80 con 0x556f53e54200 2024-09-12T17:28:05.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.747+0000 7f3958ba6640 1 --2- 172.21.15.170:0/1100353640 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x556f53e54200 0x556f53f52640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.748+0000 7f394fba4640 1 --2- 172.21.15.170:0/1100353640 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f384003c730 0x7f384003ebf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3940057000 tx=0x7f3940052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.748+0000 7f3958ba6640 1 --2- 172.21.15.170:0/1100353640 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x556f53e54200 0x556f53f52640 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.748+0000 7f3958ba6640 1 -- 172.21.15.170:0/1100353640 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f395000a4d0 con 0x556f53e54200 2024-09-12T17:28:05.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.748+0000 7f395a8bb800 1 -- 172.21.15.170:0/1100353640 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556f53f52f20 con 0x556f53e54200 2024-09-12T17:28:05.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.748+0000 7f3958ba6640 1 -- 172.21.15.170:0/1100353640 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f395000a4d0 con 0x556f53e54200 2024-09-12T17:28:05.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.748+0000 7f395a8bb800 1 --2- 172.21.15.170:0/1100353640 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556f53f54a60 0x556f53f56ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.748+0000 7f395a8bb800 1 -- 172.21.15.170:0/1100353640 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556f53f57660 con 0x556f53f54a60 2024-09-12T17:28:05.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.748+0000 7f39583a5640 1 --2- 172.21.15.170:0/1100353640 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556f53f54a60 0x556f53f56ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.749+0000 7f39583a5640 1 --2- 172.21.15.170:0/1100353640 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556f53f54a60 0x556f53f56ed0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.749+0000 7f39583a5640 1 -- 172.21.15.170:0/1100353640 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f394801ab20 con 0x556f53f54a60 2024-09-12T17:28:05.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.749+0000 7f395a8bb800 1 -- 172.21.15.170:0/1100353640 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556f53f53770 con 0x556f53e54200 2024-09-12T17:28:05.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.749+0000 7f3958ba6640 1 -- 172.21.15.170:0/1100353640 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f395000a4d0 con 0x556f53e54200 2024-09-12T17:28:05.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.749+0000 7f395a8bb800 1 -- 172.21.15.170:0/1100353640 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556f53f53bd0 con 0x556f53f54a60 2024-09-12T17:28:05.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.749+0000 7f39583a5640 1 -- 172.21.15.170:0/1100353640 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f394801ab20 con 0x556f53f54a60 2024-09-12T17:28:05.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.750+0000 7f395a8bb800 1 Processor -- start 2024-09-12T17:28:05.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.750+0000 7f395a8bb800 1 -- start start 2024-09-12T17:28:05.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.750+0000 7f395a8bb800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f53f65ef0 0x556f53f66310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.750+0000 7f395a8bb800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556f53d4aa00 con 0x556f53f65ef0 2024-09-12T17:28:05.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.750+0000 7f3958ba6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f53f65ef0 0x556f53f66310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.750+0000 7f3958ba6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f53f65ef0 0x556f53f66310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:44076/0 (socket says 172.21.15.170:44076) 2024-09-12T17:28:05.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.750+0000 7f3958ba6640 1 -- 172.21.15.170:0/4085911899 learned_addr learned my addr 172.21.15.170:0/4085911899 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:05.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.751+0000 7f3958ba6640 1 -- 172.21.15.170:0/4085911899 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f53f66950 con 0x556f53f65ef0 2024-09-12T17:28:05.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.751+0000 7f3958ba6640 1 --2- 172.21.15.170:0/4085911899 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f53f65ef0 0x556f53f66310 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x556f53f4c3b0 tx=0x7f39500167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.751+0000 7f383dffb640 1 -- 172.21.15.170:0/4085911899 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3950013640 con 0x556f53f65ef0 2024-09-12T17:28:05.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.751+0000 7f383dffb640 1 -- 172.21.15.170:0/4085911899 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39500137e0 con 0x556f53f65ef0 2024-09-12T17:28:05.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.751+0000 7f395a8bb800 1 -- 172.21.15.170:0/4085911899 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556f53f67180 con 0x556f53f65ef0 2024-09-12T17:28:05.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.751+0000 7f383dffb640 1 -- 172.21.15.170:0/4085911899 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3950013ae0 con 0x556f53f65ef0 2024-09-12T17:28:05.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.751+0000 7f395a8bb800 1 -- 172.21.15.170:0/4085911899 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f53f67720 con 0x556f53f65ef0 2024-09-12T17:28:05.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.752+0000 7f383dffb640 1 -- 172.21.15.170:0/4085911899 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3950011040 con 0x556f53f65ef0 2024-09-12T17:28:05.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.752+0000 7f383dffb640 1 --2- 172.21.15.170:0/4085911899 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f383003c730 0x7f383003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.752+0000 7f383dffb640 1 -- 172.21.15.170:0/4085911899 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f395000e040 con 0x556f53f65ef0 2024-09-12T17:28:05.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.752+0000 7f39583a5640 1 --2- 172.21.15.170:0/4085911899 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f383003c730 0x7f383003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.752+0000 7f395a8bb800 1 Processor -- start 2024-09-12T17:28:05.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.752+0000 7f39583a5640 1 --2- 172.21.15.170:0/4085911899 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f383003c730 0x7f383003ebf0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3948051f80 tx=0x7f3948043050 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.752+0000 7f395a8bb800 1 -- start start 2024-09-12T17:28:05.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.753+0000 7f395a8bb800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f53f729f0 0x556f53f72df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.753+0000 7f395a8bb800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556f53f46320 con 0x556f53f729f0 2024-09-12T17:28:05.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.753+0000 7f3958ba6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f53f729f0 0x556f53f72df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.753+0000 7f3958ba6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f53f729f0 0x556f53f72df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:44078/0 (socket says 172.21.15.170:44078) 2024-09-12T17:28:05.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.753+0000 7f3958ba6640 1 -- 172.21.15.170:0/3420418586 learned_addr learned my addr 172.21.15.170:0/3420418586 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:05.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.753+0000 7f3958ba6640 1 -- 172.21.15.170:0/3420418586 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f53f733e0 con 0x556f53f729f0 2024-09-12T17:28:05.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.753+0000 7f3958ba6640 1 --2- 172.21.15.170:0/3420418586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f53f729f0 0x556f53f72df0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3950020000 tx=0x7f395001f400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd92e98b79fdbb10 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.753+0000 7f38377fe640 1 -- 172.21.15.170:0/3420418586 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3950055040 con 0x556f53f729f0 2024-09-12T17:28:05.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.753+0000 7f38377fe640 1 -- 172.21.15.170:0/3420418586 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3950021960 con 0x556f53f729f0 2024-09-12T17:28:05.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.753+0000 7f38377fe640 1 -- 172.21.15.170:0/3420418586 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3950021440 con 0x556f53f729f0 2024-09-12T17:28:05.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.754+0000 7f395a8bb800 1 -- 172.21.15.170:0/3420418586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f53f729f0 msgr2=0x556f53f72df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.754+0000 7f395a8bb800 1 --2- 172.21.15.170:0/3420418586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f53f729f0 0x556f53f72df0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3950020000 tx=0x7f395001f400 comp rx=0 tx=0).stop 2024-09-12T17:28:05.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.754+0000 7f395a8bb800 1 -- 172.21.15.170:0/3420418586 shutdown_connections 2024-09-12T17:28:05.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.754+0000 7f395a8bb800 1 --2- 172.21.15.170:0/3420418586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f53f729f0 0x556f53f72df0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.754+0000 7f395a8bb800 1 -- 172.21.15.170:0/3420418586 >> 172.21.15.170:0/3420418586 conn(0x556f53f6ee10 msgr2=0x556f53f6d050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:05.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.754+0000 7f395a8bb800 1 -- 172.21.15.170:0/3420418586 shutdown_connections 2024-09-12T17:28:05.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.754+0000 7f395a8bb800 1 -- 172.21.15.170:0/3420418586 wait complete. 2024-09-12T17:28:05.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.754+0000 7f395a8bb800 1 Processor -- start 2024-09-12T17:28:05.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.754+0000 7f395a8bb800 1 -- start start 2024-09-12T17:28:05.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.754+0000 7f395a8bb800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f53f729f0 0x556f53f79fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.754+0000 7f395a8bb800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556f53f73a00 con 0x556f53f729f0 2024-09-12T17:28:05.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.755+0000 7f3958ba6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f53f729f0 0x556f53f79fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.755+0000 7f3958ba6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f53f729f0 0x556f53f79fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:44092/0 (socket says 172.21.15.170:44092) 2024-09-12T17:28:05.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.755+0000 7f3958ba6640 1 -- 172.21.15.170:0/3016680716 learned_addr learned my addr 172.21.15.170:0/3016680716 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:05.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.755+0000 7f3958ba6640 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f53f7a530 con 0x556f53f729f0 2024-09-12T17:28:05.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.755+0000 7f3958ba6640 1 --2- 172.21.15.170:0/3016680716 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f53f729f0 0x556f53f79fd0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f39500208e0 tx=0x7f3950053cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.755+0000 7f3835ffb640 1 -- 172.21.15.170:0/3016680716 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3950055050 con 0x556f53f729f0 2024-09-12T17:28:05.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.755+0000 7f3835ffb640 1 -- 172.21.15.170:0/3016680716 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3950053f60 con 0x556f53f729f0 2024-09-12T17:28:05.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.755+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556f53f7a7c0 con 0x556f53f729f0 2024-09-12T17:28:05.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.755+0000 7f3835ffb640 1 -- 172.21.15.170:0/3016680716 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f395001f710 con 0x556f53f729f0 2024-09-12T17:28:05.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.755+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f53f7b140 con 0x556f53f729f0 2024-09-12T17:28:05.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.756+0000 7f3835ffb640 1 -- 172.21.15.170:0/3016680716 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f39500551f0 con 0x556f53f729f0 2024-09-12T17:28:05.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.756+0000 7f3835ffb640 1 --2- 172.21.15.170:0/3016680716 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f382803c780 0x7f382803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.756+0000 7f3835ffb640 1 -- 172.21.15.170:0/3016680716 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f395004d040 con 0x556f53f729f0 2024-09-12T17:28:05.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.756+0000 7f39583a5640 1 --2- 172.21.15.170:0/3016680716 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f382803c780 0x7f382803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.757+0000 7f39583a5640 1 --2- 172.21.15.170:0/3016680716 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f382803c780 0x7f382803ec40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3948023000 tx=0x7f3948049000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.757+0000 7f395a8bb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.757+0000 7f395a8bb800 1 --2- 172.21.15.170:0/3016680716 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x556f53f85920 0x556f53f87de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.757+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556f53f88530 con 0x556f53f85920 2024-09-12T17:28:05.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.757+0000 7f394fba4640 1 --2- 172.21.15.170:0/3016680716 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x556f53f85920 0x556f53f87de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.757+0000 7f394fba4640 1 --2- 172.21.15.170:0/3016680716 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x556f53f85920 0x556f53f87de0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.758+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3940051070 con 0x556f53f85920 2024-09-12T17:28:05.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.758+0000 7f395a8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:05.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.758+0000 7f395a8bb800 20 realm 2024-09-12T17:28:05.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.758+0000 7f395a8bb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.758+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556f53f88960 con 0x556f53f85920 2024-09-12T17:28:05.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.758+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3940051070 con 0x556f53f85920 2024-09-12T17:28:05.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.758+0000 7f395a8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:05.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.758+0000 7f395a8bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:05.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.758+0000 7f395a8bb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.758+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556f53f89230 con 0x556f53f85920 2024-09-12T17:28:05.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.758+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3940051070 con 0x556f53f85920 2024-09-12T17:28:05.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.758+0000 7f395a8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:05.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.758+0000 7f395a8bb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.758+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556f53f895d0 con 0x556f53f85920 2024-09-12T17:28:05.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.758+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3940051070 con 0x556f53f85920 2024-09-12T17:28:05.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.758+0000 7f395a8bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:05.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.758+0000 7f395a8bb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.758+0000 7f395a8bb800 1 --2- 172.21.15.170:0/3016680716 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556f53f8a330 0x556f53f8c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.758+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556f53f8cd30 con 0x556f53f8a330 2024-09-12T17:28:05.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.758+0000 7f3958ba6640 1 --2- 172.21.15.170:0/3016680716 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556f53f8a330 0x556f53f8c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.759+0000 7f3958ba6640 1 --2- 172.21.15.170:0/3016680716 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556f53f8a330 0x556f53f8c720 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.759+0000 7f3958ba6640 1 -- 172.21.15.170:0/3016680716 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f395000a4d0 con 0x556f53f8a330 2024-09-12T17:28:05.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.759+0000 7f395a8bb800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:05.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.759+0000 7f395a8bb800 20 searching for the correct realm 2024-09-12T17:28:05.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.759+0000 7f395a8bb800 1 --2- 172.21.15.170:0/3016680716 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x556f53f8ece0 0x556f53f911a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.759+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556f53f91820 con 0x556f53f8ece0 2024-09-12T17:28:05.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.759+0000 7f39583a5640 1 --2- 172.21.15.170:0/3016680716 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x556f53f8ece0 0x556f53f911a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.759+0000 7f39583a5640 1 --2- 172.21.15.170:0/3016680716 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x556f53f8ece0 0x556f53f911a0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.760+0000 7f39583a5640 1 -- 172.21.15.170:0/3016680716 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3948047070 con 0x556f53f8ece0 2024-09-12T17:28:05.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.760+0000 7f39583a5640 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556f53f91820 con 0x556f53f8a330 2024-09-12T17:28:05.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.760+0000 7f3958ba6640 1 -- 172.21.15.170:0/3016680716 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f395000a4d0 con 0x556f53f8a330 2024-09-12T17:28:05.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.760+0000 7f3958ba6640 1 --2- 172.21.15.170:0/3016680716 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f3950033070 0x7f39500327d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.760+0000 7f3958ba6640 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556f53f91820 con 0x7f3950033070 2024-09-12T17:28:05.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.760+0000 7f394fba4640 1 --2- 172.21.15.170:0/3016680716 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f3950033070 0x7f39500327d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.760+0000 7f394fba4640 1 --2- 172.21.15.170:0/3016680716 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f3950033070 0x7f39500327d0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.761+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3940051070 con 0x7f3950033070 2024-09-12T17:28:05.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.761+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556f53f91820 con 0x556f53f85920 2024-09-12T17:28:05.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.761+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3940051070 con 0x556f53f85920 2024-09-12T17:28:05.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.761+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556f53f91820 con 0x556f53f85920 2024-09-12T17:28:05.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.761+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3940051070 con 0x556f53f85920 2024-09-12T17:28:05.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.761+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556f53f91820 con 0x7f3950033070 2024-09-12T17:28:05.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.761+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3940051070 con 0x7f3950033070 2024-09-12T17:28:05.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.761+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556f53f91820 con 0x7f3950033070 2024-09-12T17:28:05.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.762+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3940051070 con 0x7f3950033070 2024-09-12T17:28:05.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.762+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556f53f91820 con 0x556f53f8a330 2024-09-12T17:28:05.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.762+0000 7f3958ba6640 1 -- 172.21.15.170:0/3016680716 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f395000a4d0 con 0x556f53f8a330 2024-09-12T17:28:05.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.762+0000 7f3958ba6640 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556f53f91820 con 0x556f53f8ece0 2024-09-12T17:28:05.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.762+0000 7f39583a5640 1 -- 172.21.15.170:0/3016680716 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3948047070 con 0x556f53f8ece0 2024-09-12T17:28:05.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.762+0000 7f39583a5640 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556f53f91820 con 0x556f53f85920 2024-09-12T17:28:05.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.762+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3940051070 con 0x556f53f85920 2024-09-12T17:28:05.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.762+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556f53f91820 con 0x7f3950033070 2024-09-12T17:28:05.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.763+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3940051070 con 0x7f3950033070 2024-09-12T17:28:05.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.763+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556f53f91820 con 0x556f53f85920 2024-09-12T17:28:05.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.763+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3940051070 con 0x556f53f85920 2024-09-12T17:28:05.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.763+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556f53f91820 con 0x556f53f8a330 2024-09-12T17:28:05.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.763+0000 7f3958ba6640 1 -- 172.21.15.170:0/3016680716 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f395000a4d0 con 0x556f53f8a330 2024-09-12T17:28:05.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.763+0000 7f3958ba6640 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556f53f91820 con 0x556f53f8ece0 2024-09-12T17:28:05.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.763+0000 7f39583a5640 1 -- 172.21.15.170:0/3016680716 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3948047070 con 0x556f53f8ece0 2024-09-12T17:28:05.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.763+0000 7f39583a5640 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556f53f91820 con 0x556f53f8ece0 2024-09-12T17:28:05.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.763+0000 7f39583a5640 1 -- 172.21.15.170:0/3016680716 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3948047070 con 0x556f53f8ece0 2024-09-12T17:28:05.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.763+0000 7f39583a5640 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556f53f91820 con 0x7f3950033070 2024-09-12T17:28:05.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.764+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3940051070 con 0x7f3950033070 2024-09-12T17:28:05.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.764+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556f53f91820 con 0x556f53f8ece0 2024-09-12T17:28:05.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.764+0000 7f39583a5640 1 -- 172.21.15.170:0/3016680716 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3948047070 con 0x556f53f8ece0 2024-09-12T17:28:05.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.764+0000 7f39583a5640 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556f53f91820 con 0x556f53f8ece0 2024-09-12T17:28:05.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.764+0000 7f39583a5640 1 -- 172.21.15.170:0/3016680716 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3948047070 con 0x556f53f8ece0 2024-09-12T17:28:05.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.764+0000 7f39583a5640 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556f53f91820 con 0x556f53f85920 2024-09-12T17:28:05.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.764+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3940051070 con 0x556f53f85920 2024-09-12T17:28:05.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.764+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556f53f91820 con 0x556f53f85920 2024-09-12T17:28:05.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.765+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3940051070 con 0x556f53f85920 2024-09-12T17:28:05.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.765+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556f53f91820 con 0x7f3950033070 2024-09-12T17:28:05.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.765+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3940051070 con 0x7f3950033070 2024-09-12T17:28:05.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.765+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556f53f91820 con 0x556f53f8ece0 2024-09-12T17:28:05.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.765+0000 7f39583a5640 1 -- 172.21.15.170:0/3016680716 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3948047070 con 0x556f53f8ece0 2024-09-12T17:28:05.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.765+0000 7f39583a5640 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556f53f91820 con 0x556f53f8a330 2024-09-12T17:28:05.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.765+0000 7f3958ba6640 1 -- 172.21.15.170:0/3016680716 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f395000a4d0 con 0x556f53f8a330 2024-09-12T17:28:05.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.765+0000 7f3958ba6640 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556f53f91820 con 0x556f53f85920 2024-09-12T17:28:05.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.765+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3940051070 con 0x556f53f85920 2024-09-12T17:28:05.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.766+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556f53f91820 con 0x7f3950033070 2024-09-12T17:28:05.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.766+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3940051070 con 0x7f3950033070 2024-09-12T17:28:05.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.766+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556f53f91820 con 0x556f53f8ece0 2024-09-12T17:28:05.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.766+0000 7f39583a5640 1 -- 172.21.15.170:0/3016680716 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3948047070 con 0x556f53f8ece0 2024-09-12T17:28:05.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.766+0000 7f39583a5640 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556f53f91820 con 0x7f3950033070 2024-09-12T17:28:05.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.766+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3940051070 con 0x7f3950033070 2024-09-12T17:28:05.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.766+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556f53f91820 con 0x556f53f8a330 2024-09-12T17:28:05.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.766+0000 7f3958ba6640 1 -- 172.21.15.170:0/3016680716 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f395000a4d0 con 0x556f53f8a330 2024-09-12T17:28:05.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.766+0000 7f3958ba6640 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556f53f91820 con 0x556f53f8ece0 2024-09-12T17:28:05.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.767+0000 7f39583a5640 1 -- 172.21.15.170:0/3016680716 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3948047070 con 0x556f53f8ece0 2024-09-12T17:28:05.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.767+0000 7f39583a5640 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556f53f91820 con 0x7f3950033070 2024-09-12T17:28:05.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.767+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3940051070 con 0x7f3950033070 2024-09-12T17:28:05.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.767+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556f53f91820 con 0x556f53f85920 2024-09-12T17:28:05.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.767+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3940051070 con 0x556f53f85920 2024-09-12T17:28:05.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.767+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556f53f91820 con 0x556f53f8a330 2024-09-12T17:28:05.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.767+0000 7f3958ba6640 1 -- 172.21.15.170:0/3016680716 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f395000a4d0 con 0x556f53f8a330 2024-09-12T17:28:05.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.768+0000 7f395a8bb800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:05.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.768+0000 7f395a8bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:05.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.768+0000 7f395a8bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:05.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.768+0000 7f395a8bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:05.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.768+0000 7f395a8bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:05.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.768+0000 7f395a8bb800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:05.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.768+0000 7f395a8bb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.768+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556f53f8d720 con 0x556f53f85920 2024-09-12T17:28:05.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.768+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3940051070 con 0x556f53f85920 2024-09-12T17:28:05.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.768+0000 7f395a8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:05.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.768+0000 7f395a8bb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.768+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556f53f8dfc0 con 0x556f53f85920 2024-09-12T17:28:05.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.768+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3940051070 con 0x556f53f85920 2024-09-12T17:28:05.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.768+0000 7f395a8bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:05.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.768+0000 7f395a8bb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.768+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556f53f8d360 con 0x556f53f8a330 2024-09-12T17:28:05.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.768+0000 7f3958ba6640 1 -- 172.21.15.170:0/3016680716 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f395000a4d0 con 0x556f53f8a330 2024-09-12T17:28:05.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.768+0000 7f395a8bb800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:05.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.768+0000 7f395a8bb800 20 zone default found 2024-09-12T17:28:05.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.768+0000 7f395a8bb800 4 Realm: () 2024-09-12T17:28:05.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.768+0000 7f395a8bb800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:05.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.768+0000 7f395a8bb800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:05.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.768+0000 7f395a8bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:05.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.768+0000 7f395a8bb800 20 zonegroup default 2024-09-12T17:28:05.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.768+0000 7f395a8bb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.768+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556f53f92150 con 0x7f3950033070 2024-09-12T17:28:05.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.769+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3940051070 con 0x7f3950033070 2024-09-12T17:28:05.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.769+0000 7f395a8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:05.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.769+0000 7f395a8bb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.769+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556f53f94390 con 0x556f53f8ece0 2024-09-12T17:28:05.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.769+0000 7f39583a5640 1 -- 172.21.15.170:0/3016680716 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3948047070 con 0x556f53f8ece0 2024-09-12T17:28:05.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.769+0000 7f395a8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:05.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.769+0000 7f395a8bb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.769+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556f53f94730 con 0x556f53f8ece0 2024-09-12T17:28:05.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.769+0000 7f39583a5640 1 -- 172.21.15.170:0/3016680716 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3948047070 con 0x556f53f8ece0 2024-09-12T17:28:05.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.769+0000 7f395a8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:05.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.769+0000 7f395a8bb800 20 started sync module instance, tier type = 2024-09-12T17:28:05.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.769+0000 7f395a8bb800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:05.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.769+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556f53f93870 con 0x556f53f8a330 2024-09-12T17:28:05.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.770+0000 7f3958ba6640 1 -- 172.21.15.170:0/3016680716 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f395000a4d0 con 0x556f53f8a330 2024-09-12T17:28:05.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.770+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93936638573968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556f53f93870 con 0x556f53f8a330 2024-09-12T17:28:05.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.770+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556f53f95230 con 0x556f53f85920 2024-09-12T17:28:05.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.771+0000 7f3958ba6640 1 -- 172.21.15.170:0/3016680716 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93936638573968] v29'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f395000a4d0 con 0x556f53f8a330 2024-09-12T17:28:05.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.771+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3940051070 con 0x556f53f85920 2024-09-12T17:28:05.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.771+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93936638577968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556f53f93870 con 0x556f53f85920 2024-09-12T17:28:05.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.771+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556f53f95ca0 con 0x556f53f8ece0 2024-09-12T17:28:05.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.772+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93936638577968] v29'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3940051070 con 0x556f53f85920 2024-09-12T17:28:05.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.772+0000 7f39583a5640 1 -- 172.21.15.170:0/3016680716 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3948047070 con 0x556f53f8ece0 2024-09-12T17:28:05.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.773+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93936638571456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556f53f937e0 con 0x556f53f8ece0 2024-09-12T17:28:05.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.773+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556f53f96b60 con 0x556f53f8a330 2024-09-12T17:28:05.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.774+0000 7f3958ba6640 1 -- 172.21.15.170:0/3016680716 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f395000a4d0 con 0x556f53f8a330 2024-09-12T17:28:05.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.774+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93936638585008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556f53f97400 con 0x556f53f8a330 2024-09-12T17:28:05.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.774+0000 7f39583a5640 1 -- 172.21.15.170:0/3016680716 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93936638571456] v29'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3948047070 con 0x556f53f8ece0 2024-09-12T17:28:05.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.774+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556f53f96090 con 0x556f53f85920 2024-09-12T17:28:05.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.775+0000 7f3958ba6640 1 -- 172.21.15.170:0/3016680716 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93936638585008] v29'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f395000a4d0 con 0x556f53f8a330 2024-09-12T17:28:05.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.775+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3940051070 con 0x556f53f85920 2024-09-12T17:28:05.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.775+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93936638582928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556f53f978b0 con 0x556f53f85920 2024-09-12T17:28:05.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.775+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556f53f983d0 con 0x7f3950033070 2024-09-12T17:28:05.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.776+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93936638582928] v29'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3940051070 con 0x556f53f85920 2024-09-12T17:28:05.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.776+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3940051070 con 0x7f3950033070 2024-09-12T17:28:05.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.776+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93936638590624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556f53f98390 con 0x7f3950033070 2024-09-12T17:28:05.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.776+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556f53f98de0 con 0x7f3950033070 2024-09-12T17:28:05.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.777+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93936638590624] v29'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3940051070 con 0x7f3950033070 2024-09-12T17:28:05.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.777+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(56 notify.6 [create] v29'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3940051070 con 0x7f3950033070 2024-09-12T17:28:05.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.777+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93936638586704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556f53f98de0 con 0x7f3950033070 2024-09-12T17:28:05.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.777+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556f53f997a0 con 0x7f3950033070 2024-09-12T17:28:05.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.778+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93936638586704] v29'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3940051070 con 0x7f3950033070 2024-09-12T17:28:05.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.778+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(58 notify.7 [create] v29'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3940051070 con 0x7f3950033070 2024-09-12T17:28:05.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.778+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93936638593328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556f53f99980 con 0x7f3950033070 2024-09-12T17:28:05.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.778+0000 7f395a8bb800 20 add_watcher() i=0 2024-09-12T17:28:05.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.778+0000 7f395a8bb800 20 add_watcher() i=1 2024-09-12T17:28:05.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.778+0000 7f395a8bb800 20 add_watcher() i=2 2024-09-12T17:28:05.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.778+0000 7f395a8bb800 20 add_watcher() i=3 2024-09-12T17:28:05.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.778+0000 7f395a8bb800 20 add_watcher() i=4 2024-09-12T17:28:05.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.778+0000 7f395a8bb800 20 add_watcher() i=5 2024-09-12T17:28:05.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.778+0000 7f395a8bb800 20 add_watcher() i=6 2024-09-12T17:28:05.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.779+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93936638593328] v29'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3940051070 con 0x7f3950033070 2024-09-12T17:28:05.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.779+0000 7f395a8bb800 20 add_watcher() i=7 2024-09-12T17:28:05.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.779+0000 7f395a8bb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:05.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.779+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556f53f9cb30 con 0x556f53f85920 2024-09-12T17:28:05.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.779+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3940051070 con 0x556f53f85920 2024-09-12T17:28:05.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.779+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93936638608576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556f53f998d0 con 0x556f53f85920 2024-09-12T17:28:05.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.780+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93936638608576] v29'148 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3940051070 con 0x556f53f85920 2024-09-12T17:28:05.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.780+0000 7f380e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:05.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.780+0000 7f395a8bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:05.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.780+0000 7f395a8bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:05.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.780+0000 7f395a8bb800 5 note: GC not initialized 2024-09-12T17:28:05.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.781+0000 7f380d7e2640 20 reqs_thread_entry: start 2024-09-12T17:28:05.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.781+0000 7f395a8bb800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:05.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.781+0000 7f395a8bb800 20 Filter name: none 2024-09-12T17:28:05.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.781+0000 7f377effd640 20 reqs_thread_entry: start 2024-09-12T17:28:05.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.781+0000 7f395a8bb800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:28:05.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.781+0000 7f395a8bb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.781+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556f53fcfc40 con 0x556f53f85920 2024-09-12T17:28:05.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.781+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3940051070 con 0x556f53f85920 2024-09-12T17:28:05.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.781+0000 7f395a8bb800 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:28:05.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.781+0000 7f395a8bb800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T17:28:05.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.781+0000 7f395a8bb800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:28:05.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.781+0000 7f395a8bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:05.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.781+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556f53fcf6a0 con 0x556f53f8a330 2024-09-12T17:28:05.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.782+0000 7f3958ba6640 1 -- 172.21.15.170:0/3016680716 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f395000a4d0 con 0x556f53f8a330 2024-09-12T17:28:05.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.782+0000 7f395a8bb800 20 disabling bucket name=myfoo 2024-09-12T17:28:05.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.782+0000 7f395a8bb800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T17:28:05.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.782+0000 7f395a8bb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.782+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556f53fcf6a0 con 0x556f53f8a330 2024-09-12T17:28:05.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.782+0000 7f3958ba6640 1 -- 172.21.15.170:0/3016680716 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f395000a4d0 con 0x556f53f8a330 2024-09-12T17:28:05.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.782+0000 7f395a8bb800 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T17:28:05.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.782+0000 7f395a8bb800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-12T17:28:05.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.782+0000 7f395a8bb800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:28:05.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.782+0000 7f395a8bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 : miss 2024-09-12T17:28:05.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.782+0000 7f395a8bb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.782+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:65 8.1d 8:baccd554:root::.bucket.meta.myfoo%3a7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556f53fd1ce0 con 0x7f3950033070 2024-09-12T17:28:05.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.783+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(65 .bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f3940051070 con 0x7f3950033070 2024-09-12T17:28:05.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.783+0000 7f395a8bb800 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T17:28:05.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.783+0000 7f395a8bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 info.flags=0x17 2024-09-12T17:28:05.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.783+0000 7f395a8bb800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 to cache LRU end 2024-09-12T17:28:05.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.783+0000 7f395a8bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:05.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.783+0000 7f395a8bb800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:28:05.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.783+0000 7f395a8bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 2024-09-12T17:28:05.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.783+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:66 8.1d 8:baccd554:root::.bucket.meta.myfoo%3a7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556f53fda5f0 con 0x7f3950033070 2024-09-12T17:28:05.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.784+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(66 .bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v29'6 uv6 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f3940051070 con 0x7f3950033070 2024-09-12T17:28:05.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.784+0000 7f395a8bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 info.flags=0x17 2024-09-12T17:28:05.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.784+0000 7f395a8bb800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 to cache LRU end 2024-09-12T17:28:05.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.784+0000 7f395a8bb800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:28:05.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.784+0000 7f395a8bb800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1, ofs0, ns] 2024-09-12T17:28:05.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.784+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:67 7.9 7:93e5b521:::notify.7:head [notify cookie 93936638860976 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556f53fd4bb0 con 0x7f3950033070 2024-09-12T17:28:05.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.784+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== watch-notify(notify (1) cookie 93936638593328 notify 124554051601 ret 0) ==== 802+0+0 (crc 0 0 0) 0x556f53fd20d0 con 0x7f3950033070 2024-09-12T17:28:05.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.784+0000 7f38377fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051601 cookie 93936638593328 notifier 4589 bl.length()=760 2024-09-12T17:28:05.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.784+0000 7f38377fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 info.flags=0x17 2024-09-12T17:28:05.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.784+0000 7f38377fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 to cache LRU end 2024-09-12T17:28:05.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.784+0000 7f38377fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:28:05.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.784+0000 7f38377fe640 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:68 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f381c003ea0 con 0x7f3950033070 2024-09-12T17:28:05.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.784+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(67 notify.7 [notify cookie 93936638860976 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3940051070 con 0x7f3950033070 2024-09-12T17:28:05.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.784+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== osd_op_reply(68 notify.7 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3940051070 con 0x7f3950033070 2024-09-12T17:28:05.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.785+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.0 v2:172.21.15.47:6800/3978157098 22 ==== watch-notify(notify_complete (2) cookie 93936638860976 notify 124554051601 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556f53fd0200 con 0x7f3950033070 2024-09-12T17:28:05.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.785+0000 7f395a8bb800 20 handle_bi_update(): bucket=:myfoo[7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1]): orig_sources= new_sources= 2024-09-12T17:28:05.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.785+0000 7f395a8bb800 20 handle_bi_update(): bucket=:myfoo[7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1]): potential sources added=[] removed=[] 2024-09-12T17:28:05.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.785+0000 7f395a8bb800 20 handle_bi_update(): bucket=:myfoo[7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1]): orig_dests= new_dests= 2024-09-12T17:28:05.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.785+0000 7f395a8bb800 20 handle_bi_update(): bucket=:myfoo[7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1]): potential dests added=[] removed=[] 2024-09-12T17:28:05.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.785+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556f53fd9eb0 con 0x556f53f85920 2024-09-12T17:28:05.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.786+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v29'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f3940051070 con 0x556f53f85920 2024-09-12T17:28:05.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.786+0000 7f395a8bb800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:28:05.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.786+0000 7f395a8bb800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:28:05.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.786+0000 7f395a8bb800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T17:28:05.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.786+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 93936638860976 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556f53fd3b10 con 0x556f53f85920 2024-09-12T17:28:05.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.786+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== watch-notify(notify (1) cookie 93936638582928 notify 124554051598 ret 0) ==== 609+0+0 (crc 0 0 0) 0x556f53fd0200 con 0x556f53f85920 2024-09-12T17:28:05.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.786+0000 7f3836ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051598 cookie 93936638582928 notifier 4589 bl.length()=567 2024-09-12T17:28:05.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.786+0000 7f3836ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:28:05.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.786+0000 7f3836ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:28:05.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.786+0000 7f3836ffd640 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f378c003460 con 0x556f53f85920 2024-09-12T17:28:05.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.786+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(70 notify.4 [notify cookie 93936638860976 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3940051070 con 0x556f53f85920 2024-09-12T17:28:05.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.786+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3940051070 con 0x556f53f85920 2024-09-12T17:28:05.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.786+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== watch-notify(notify_complete (2) cookie 93936638860976 notify 124554051598 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3940082040 con 0x556f53f85920 2024-09-12T17:28:05.826 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T17:27:59.362376Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:27:59.362351Z","tags":[],"group_ids":[]} 2024-09-12T17:28:05.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.787+0000 7f380e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:05.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.787+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93936638608576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556f53fcdae0 con 0x556f53f85920 2024-09-12T17:28:05.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.788+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 93936638608576] v29'149 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3940051070 con 0x556f53f85920 2024-09-12T17:28:05.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.788+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93936638573968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556f53fcdae0 con 0x556f53f8a330 2024-09-12T17:28:05.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.789+0000 7f3958ba6640 1 -- 172.21.15.170:0/3016680716 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 93936638573968] v29'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f395000a4d0 con 0x556f53f8a330 2024-09-12T17:28:05.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.789+0000 7f395a8bb800 20 remove_watcher() i=0 2024-09-12T17:28:05.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.789+0000 7f395a8bb800 2 removed watcher, disabling cache 2024-09-12T17:28:05.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.789+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93936638577968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556f53fcdae0 con 0x556f53f85920 2024-09-12T17:28:05.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.790+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 93936638577968] v29'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3940051070 con 0x556f53f85920 2024-09-12T17:28:05.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.790+0000 7f395a8bb800 20 remove_watcher() i=1 2024-09-12T17:28:05.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.790+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93936638571456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556f53fcdae0 con 0x556f53f8ece0 2024-09-12T17:28:05.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.791+0000 7f39583a5640 1 -- 172.21.15.170:0/3016680716 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 93936638571456] v29'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3948047070 con 0x556f53f8ece0 2024-09-12T17:28:05.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.791+0000 7f395a8bb800 20 remove_watcher() i=2 2024-09-12T17:28:05.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.791+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93936638585008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556f53f933c0 con 0x556f53f8a330 2024-09-12T17:28:05.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.792+0000 7f3958ba6640 1 -- 172.21.15.170:0/3016680716 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 93936638585008] v29'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f395000a4d0 con 0x556f53f8a330 2024-09-12T17:28:05.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.792+0000 7f395a8bb800 20 remove_watcher() i=3 2024-09-12T17:28:05.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.792+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93936638582928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556f53f933c0 con 0x556f53f85920 2024-09-12T17:28:05.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.793+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 93936638582928] v29'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3940051070 con 0x556f53f85920 2024-09-12T17:28:05.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.793+0000 7f395a8bb800 20 remove_watcher() i=4 2024-09-12T17:28:05.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.793+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93936638590624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556f53f96090 con 0x7f3950033070 2024-09-12T17:28:05.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.794+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.0 v2:172.21.15.47:6800/3978157098 23 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 93936638590624] v29'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3940051070 con 0x7f3950033070 2024-09-12T17:28:05.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.794+0000 7f395a8bb800 20 remove_watcher() i=5 2024-09-12T17:28:05.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.794+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93936638586704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556f53f933c0 con 0x7f3950033070 2024-09-12T17:28:05.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.795+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.0 v2:172.21.15.47:6800/3978157098 24 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 93936638586704] v29'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3940051070 con 0x7f3950033070 2024-09-12T17:28:05.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.795+0000 7f395a8bb800 20 remove_watcher() i=6 2024-09-12T17:28:05.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.795+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93936638593328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556f53f96f50 con 0x7f3950033070 2024-09-12T17:28:05.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.796+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 <== osd.0 v2:172.21.15.47:6800/3978157098 25 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 93936638593328] v29'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3940051070 con 0x7f3950033070 2024-09-12T17:28:05.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.796+0000 7f395a8bb800 20 remove_watcher() i=7 2024-09-12T17:28:05.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.796+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f3950033070 msgr2=0x7f39500327d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.796+0000 7f395a8bb800 1 --2- 172.21.15.170:0/3016680716 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f3950033070 0x7f39500327d0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.796+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x556f53f85920 msgr2=0x556f53f87de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.796+0000 7f395a8bb800 1 --2- 172.21.15.170:0/3016680716 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x556f53f85920 0x556f53f87de0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.796+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556f53f8a330 msgr2=0x556f53f8c720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.796+0000 7f395a8bb800 1 --2- 172.21.15.170:0/3016680716 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556f53f8a330 0x556f53f8c720 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.796+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x556f53f8ece0 msgr2=0x556f53f911a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.796+0000 7f395a8bb800 1 --2- 172.21.15.170:0/3016680716 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x556f53f8ece0 0x556f53f911a0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.796+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f382803c780 msgr2=0x7f382803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.796+0000 7f395a8bb800 1 --2- 172.21.15.170:0/3016680716 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f382803c780 0x7f382803ec40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3948023000 tx=0x7f3948049000 comp rx=0 tx=0).stop 2024-09-12T17:28:05.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.796+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f53f729f0 msgr2=0x556f53f79fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.796+0000 7f394fba4640 1 -- 172.21.15.170:0/3016680716 reap_dead start 2024-09-12T17:28:05.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.796+0000 7f395a8bb800 1 --2- 172.21.15.170:0/3016680716 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f53f729f0 0x556f53f79fd0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f39500208e0 tx=0x7f3950053cf0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.796+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 shutdown_connections 2024-09-12T17:28:05.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.796+0000 7f395a8bb800 1 --2- 172.21.15.170:0/3016680716 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f53f729f0 0x556f53f79fd0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.796+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 >> 172.21.15.170:0/3016680716 conn(0x556f53f6ee10 msgr2=0x556f53f6d020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:05.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.796+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 shutdown_connections 2024-09-12T17:28:05.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.796+0000 7f395a8bb800 1 -- 172.21.15.170:0/3016680716 wait complete. 2024-09-12T17:28:05.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.797+0000 7f395a8bb800 1 -- 172.21.15.170:0/4085911899 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f383003c730 msgr2=0x7f383003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.797+0000 7f395a8bb800 1 --2- 172.21.15.170:0/4085911899 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f383003c730 0x7f383003ebf0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3948051f80 tx=0x7f3948043050 comp rx=0 tx=0).stop 2024-09-12T17:28:05.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.797+0000 7f395a8bb800 1 -- 172.21.15.170:0/4085911899 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f53f65ef0 msgr2=0x556f53f66310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.797+0000 7f395a8bb800 1 --2- 172.21.15.170:0/4085911899 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f53f65ef0 0x556f53f66310 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x556f53f4c3b0 tx=0x7f39500167b0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.797+0000 7f395a8bb800 1 -- 172.21.15.170:0/4085911899 shutdown_connections 2024-09-12T17:28:05.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.797+0000 7f395a8bb800 1 --2- 172.21.15.170:0/4085911899 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f383003c730 0x7f383003ebf0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.797+0000 7f395a8bb800 1 --2- 172.21.15.170:0/4085911899 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f53f65ef0 0x556f53f66310 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.797+0000 7f395a8bb800 1 -- 172.21.15.170:0/4085911899 >> 172.21.15.170:0/4085911899 conn(0x556f53f5a2a0 msgr2=0x556f53f5a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:05.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.797+0000 7f395a8bb800 1 -- 172.21.15.170:0/4085911899 shutdown_connections 2024-09-12T17:28:05.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.797+0000 7f395a8bb800 1 -- 172.21.15.170:0/4085911899 wait complete. 2024-09-12T17:28:05.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.797+0000 7f395a8bb800 1 -- 172.21.15.170:0/1100353640 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x556f53e54200 msgr2=0x556f53f52640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.797+0000 7f395a8bb800 1 --2- 172.21.15.170:0/1100353640 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x556f53e54200 0x556f53f52640 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.797+0000 7f395a8bb800 1 -- 172.21.15.170:0/1100353640 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556f53f54a60 msgr2=0x556f53f56ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.797+0000 7f395a8bb800 1 --2- 172.21.15.170:0/1100353640 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556f53f54a60 0x556f53f56ed0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.797+0000 7f395a8bb800 1 -- 172.21.15.170:0/1100353640 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f384003c730 msgr2=0x7f384003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.797+0000 7f395a8bb800 1 --2- 172.21.15.170:0/1100353640 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f384003c730 0x7f384003ebf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3940057000 tx=0x7f3940052000 comp rx=0 tx=0).stop 2024-09-12T17:28:05.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.797+0000 7f395a8bb800 1 -- 172.21.15.170:0/1100353640 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f53e52df0 msgr2=0x556f53f4aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.797+0000 7f395a8bb800 1 --2- 172.21.15.170:0/1100353640 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f53e52df0 0x556f53f4aff0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x556f53dc68e0 tx=0x7f3948000bc0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.797+0000 7f395a8bb800 1 -- 172.21.15.170:0/1100353640 shutdown_connections 2024-09-12T17:28:05.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.797+0000 7f395a8bb800 1 --2- 172.21.15.170:0/1100353640 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556f53f54a60 0x556f53f56ed0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.797+0000 7f395a8bb800 1 --2- 172.21.15.170:0/1100353640 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f384003c730 0x7f384003ebf0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.797+0000 7f395a8bb800 1 --2- 172.21.15.170:0/1100353640 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x556f53e54200 0x556f53f52640 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.797+0000 7f395a8bb800 1 --2- 172.21.15.170:0/1100353640 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f53e52df0 0x556f53f4aff0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.797+0000 7f395a8bb800 1 -- 172.21.15.170:0/1100353640 >> 172.21.15.170:0/1100353640 conn(0x556f53e4e1c0 msgr2=0x556f53f3c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:05.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.797+0000 7f395a8bb800 1 -- 172.21.15.170:0/1100353640 shutdown_connections 2024-09-12T17:28:05.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.797+0000 7f395a8bb800 1 -- 172.21.15.170:0/1100353640 wait complete. 2024-09-12T17:28:05.840 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T17:27:59.362376Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:27:59.362351Z', 'tags': [], 'group_ids': []} 2024-09-12T17:28:05.842 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-12T17:28:05.842 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-12T17:28:05.842 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-12T17:28:05.887 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:05.887 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:05.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.886+0000 7f286ec87800 1 Processor -- start 2024-09-12T17:28:05.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.886+0000 7f286ec87800 1 -- start start 2024-09-12T17:28:05.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.886+0000 7f286ec87800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5575b28016a0 0x5575b2803a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.886+0000 7f286ec87800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5575b26aae40 con 0x5575b2804030 2024-09-12T17:28:05.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.886+0000 7f286ec87800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x5575b2675680 con 0x5575b28016a0 2024-09-12T17:28:05.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.886+0000 7f286c771640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5575b28016a0 0x5575b2803a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.886+0000 7f286bf70640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x5575b2804030 0x5575b28064d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:37076/0 (socket says 172.21.15.170:37076) 2024-09-12T17:28:05.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.886+0000 7f286bf70640 1 -- 172.21.15.170:0/2506625306 learned_addr learned my addr 172.21.15.170:0/2506625306 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:28:05.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.887+0000 7f286c771640 1 -- 172.21.15.170:0/2506625306 >> v1:172.21.15.47:6789/0 conn(0x5575b2804030 legacy=0x5575b28064d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.887+0000 7f286c771640 1 -- 172.21.15.170:0/2506625306 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575b26916b0 con 0x5575b28016a0 2024-09-12T17:28:05.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.889+0000 7f286c771640 1 --2- 172.21.15.170:0/2506625306 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575b28016a0 0x5575b2803a90 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f285c00a470 tx=0x7f285c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83300d150297d92e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.889+0000 7f286b76f640 1 -- 172.21.15.170:0/2506625306 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f285c053570 con 0x5575b28016a0 2024-09-12T17:28:05.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.889+0000 7f286b76f640 1 -- 172.21.15.170:0/2506625306 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f285c058070 con 0x5575b28016a0 2024-09-12T17:28:05.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.889+0000 7f286b76f640 1 -- 172.21.15.170:0/2506625306 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f285c053880 con 0x5575b28016a0 2024-09-12T17:28:05.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.889+0000 7f286ec87800 1 -- 172.21.15.170:0/2506625306 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575b28016a0 msgr2=0x5575b2803a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.889+0000 7f286ec87800 1 --2- 172.21.15.170:0/2506625306 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575b28016a0 0x5575b2803a90 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f285c00a470 tx=0x7f285c045a20 comp rx=0 tx=0).stop 2024-09-12T17:28:05.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.889+0000 7f286ec87800 1 -- 172.21.15.170:0/2506625306 shutdown_connections 2024-09-12T17:28:05.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.889+0000 7f286ec87800 1 --2- 172.21.15.170:0/2506625306 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575b28016a0 0x5575b2803a90 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.889+0000 7f286ec87800 1 -- 172.21.15.170:0/2506625306 >> 172.21.15.170:0/2506625306 conn(0x5575b27fb1c0 msgr2=0x5575b27fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:05.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.889+0000 7f286ec87800 1 -- 172.21.15.170:0/2506625306 shutdown_connections 2024-09-12T17:28:05.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.889+0000 7f286ec87800 1 -- 172.21.15.170:0/2506625306 wait complete. 2024-09-12T17:28:05.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.903+0000 7f286ec87800 1 Processor -- start 2024-09-12T17:28:05.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.903+0000 7f286ec87800 1 -- start start 2024-09-12T17:28:05.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.903+0000 7f286ec87800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575b28016a0 0x5575b2800e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.903+0000 7f286ec87800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5575b2699dd0 con 0x5575b28016a0 2024-09-12T17:28:05.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.904+0000 7f286c771640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575b28016a0 0x5575b2800e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.904+0000 7f286c771640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575b28016a0 0x5575b2800e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:44100/0 (socket says 172.21.15.170:44100) 2024-09-12T17:28:05.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.904+0000 7f286c771640 1 -- 172.21.15.170:0/2950608971 learned_addr learned my addr 172.21.15.170:0/2950608971 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:05.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.904+0000 7f286c771640 1 -- 172.21.15.170:0/2950608971 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575b26b2e10 con 0x5575b28016a0 2024-09-12T17:28:05.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.904+0000 7f286c771640 1 --2- 172.21.15.170:0/2950608971 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575b28016a0 0x5575b2800e30 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f285c025c20 tx=0x7f285c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fda17cdcf3a72e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.904+0000 7f275a60c640 1 -- 172.21.15.170:0/2950608971 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f285c053a20 con 0x5575b28016a0 2024-09-12T17:28:05.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.904+0000 7f275a60c640 1 -- 172.21.15.170:0/2950608971 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f285c063070 con 0x5575b28016a0 2024-09-12T17:28:05.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.904+0000 7f275a60c640 1 -- 172.21.15.170:0/2950608971 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f285c053cf0 con 0x5575b28016a0 2024-09-12T17:28:05.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.905+0000 7f286ec87800 1 -- 172.21.15.170:0/2950608971 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575b28016a0 msgr2=0x5575b2800e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.905+0000 7f286ec87800 1 --2- 172.21.15.170:0/2950608971 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575b28016a0 0x5575b2800e30 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f285c025c20 tx=0x7f285c051000 comp rx=0 tx=0).stop 2024-09-12T17:28:05.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.905+0000 7f286ec87800 1 -- 172.21.15.170:0/2950608971 shutdown_connections 2024-09-12T17:28:05.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.905+0000 7f286ec87800 1 --2- 172.21.15.170:0/2950608971 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575b28016a0 0x5575b2800e30 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.905+0000 7f286ec87800 1 -- 172.21.15.170:0/2950608971 >> 172.21.15.170:0/2950608971 conn(0x5575b27fb1c0 msgr2=0x5575b28ec000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:05.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.905+0000 7f286ec87800 1 -- 172.21.15.170:0/2950608971 shutdown_connections 2024-09-12T17:28:05.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.905+0000 7f286ec87800 1 -- 172.21.15.170:0/2950608971 wait complete. 2024-09-12T17:28:05.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.906+0000 7f286ec87800 1 Processor -- start 2024-09-12T17:28:05.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.906+0000 7f286ec87800 1 -- start start 2024-09-12T17:28:05.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.906+0000 7f286ec87800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575b2804030 0x5575b28fa3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.906+0000 7f286ec87800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5575b2808030 con 0x5575b2804030 2024-09-12T17:28:05.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.906+0000 7f286c771640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575b2804030 0x5575b28fa3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.906+0000 7f286c771640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575b2804030 0x5575b28fa3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:44106/0 (socket says 172.21.15.170:44106) 2024-09-12T17:28:05.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.906+0000 7f286c771640 1 -- 172.21.15.170:0/4160093494 learned_addr learned my addr 172.21.15.170:0/4160093494 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:05.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.906+0000 7f286c771640 1 -- 172.21.15.170:0/4160093494 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575b28fa920 con 0x5575b2804030 2024-09-12T17:28:05.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.906+0000 7f286c771640 1 --2- 172.21.15.170:0/4160093494 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575b2804030 0x5575b28fa3c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f285c025c20 tx=0x7f285c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.907+0000 7f2758e09640 1 -- 172.21.15.170:0/4160093494 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f285c0745b0 con 0x5575b2804030 2024-09-12T17:28:05.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.907+0000 7f2758e09640 1 -- 172.21.15.170:0/4160093494 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f285c074750 con 0x5575b2804030 2024-09-12T17:28:05.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.907+0000 7f286ec87800 1 -- 172.21.15.170:0/4160093494 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5575b28fabb0 con 0x5575b2804030 2024-09-12T17:28:05.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.907+0000 7f2758e09640 1 -- 172.21.15.170:0/4160093494 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f285c074a30 con 0x5575b2804030 2024-09-12T17:28:05.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.907+0000 7f286ec87800 1 -- 172.21.15.170:0/4160093494 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575b28fb770 con 0x5575b2804030 2024-09-12T17:28:05.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.907+0000 7f2758e09640 1 -- 172.21.15.170:0/4160093494 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f285c074bd0 con 0x5575b2804030 2024-09-12T17:28:05.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.908+0000 7f2758e09640 1 --2- 172.21.15.170:0/4160093494 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f275403c730 0x7f275403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.908+0000 7f2758e09640 1 -- 172.21.15.170:0/4160093494 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f285c097fe0 con 0x5575b2804030 2024-09-12T17:28:05.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.908+0000 7f286bf70640 1 --2- 172.21.15.170:0/4160093494 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f275403c730 0x7f275403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.908+0000 7f286ec87800 1 --2- 172.21.15.170:0/4160093494 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5575b28ff9b0 0x5575b2901da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.908+0000 7f286ec87800 1 -- 172.21.15.170:0/4160093494 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5575b29022e0 con 0x5575b28ff9b0 2024-09-12T17:28:05.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.908+0000 7f286cf72640 1 --2- 172.21.15.170:0/4160093494 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5575b28ff9b0 0x5575b2901da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.908+0000 7f286bf70640 1 --2- 172.21.15.170:0/4160093494 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f275403c730 0x7f275403ebf0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2860004170 tx=0x7f2860001330 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.908+0000 7f286cf72640 1 --2- 172.21.15.170:0/4160093494 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5575b28ff9b0 0x5575b2901da0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.908+0000 7f286cf72640 1 -- 172.21.15.170:0/4160093494 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f286400a4d0 con 0x5575b28ff9b0 2024-09-12T17:28:05.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.909+0000 7f286ec87800 1 -- 172.21.15.170:0/4160093494 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5575b2902680 con 0x5575b28ff9b0 2024-09-12T17:28:05.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.909+0000 7f286cf72640 1 -- 172.21.15.170:0/4160093494 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f286400a4d0 con 0x5575b28ff9b0 2024-09-12T17:28:05.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.909+0000 7f286ec87800 1 --2- 172.21.15.170:0/4160093494 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5575b2904140 0x5575b29065e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.909+0000 7f286ec87800 1 -- 172.21.15.170:0/4160093494 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5575b2906d70 con 0x5575b2904140 2024-09-12T17:28:05.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.909+0000 7f286c771640 1 --2- 172.21.15.170:0/4160093494 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5575b2904140 0x5575b29065e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.909+0000 7f286c771640 1 --2- 172.21.15.170:0/4160093494 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5575b2904140 0x5575b29065e0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.909+0000 7f286c771640 1 -- 172.21.15.170:0/4160093494 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f285c051070 con 0x5575b2904140 2024-09-12T17:28:05.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.910+0000 7f286ec87800 1 -- 172.21.15.170:0/4160093494 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5575b2902ed0 con 0x5575b28ff9b0 2024-09-12T17:28:05.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.910+0000 7f286cf72640 1 -- 172.21.15.170:0/4160093494 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f286400a4d0 con 0x5575b28ff9b0 2024-09-12T17:28:05.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.910+0000 7f286ec87800 1 -- 172.21.15.170:0/4160093494 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5575b29032b0 con 0x5575b2904140 2024-09-12T17:28:05.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.910+0000 7f286c771640 1 -- 172.21.15.170:0/4160093494 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f285c051070 con 0x5575b2904140 2024-09-12T17:28:05.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.910+0000 7f286ec87800 1 Processor -- start 2024-09-12T17:28:05.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.910+0000 7f286ec87800 1 -- start start 2024-09-12T17:28:05.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.911+0000 7f286ec87800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575b2915600 0x5575b2915a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.911+0000 7f286ec87800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5575b26f7a00 con 0x5575b2915600 2024-09-12T17:28:05.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.911+0000 7f286cf72640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575b2915600 0x5575b2915a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.911+0000 7f286cf72640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575b2915600 0x5575b2915a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:44116/0 (socket says 172.21.15.170:44116) 2024-09-12T17:28:05.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.911+0000 7f286cf72640 1 -- 172.21.15.170:0/1730112425 learned_addr learned my addr 172.21.15.170:0/1730112425 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:05.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.911+0000 7f286cf72640 1 -- 172.21.15.170:0/1730112425 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575b2916060 con 0x5575b2915600 2024-09-12T17:28:05.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.911+0000 7f286cf72640 1 --2- 172.21.15.170:0/1730112425 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575b2915600 0x5575b2915a20 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x5575b28fb370 tx=0x7f28640167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.911+0000 7f27527fc640 1 -- 172.21.15.170:0/1730112425 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2864013640 con 0x5575b2915600 2024-09-12T17:28:05.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.911+0000 7f27527fc640 1 -- 172.21.15.170:0/1730112425 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28640137e0 con 0x5575b2915600 2024-09-12T17:28:05.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.912+0000 7f27527fc640 1 -- 172.21.15.170:0/1730112425 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2864013ae0 con 0x5575b2915600 2024-09-12T17:28:05.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.912+0000 7f286ec87800 1 -- 172.21.15.170:0/1730112425 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5575b2916890 con 0x5575b2915600 2024-09-12T17:28:05.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.912+0000 7f286ec87800 1 -- 172.21.15.170:0/1730112425 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575b2916e30 con 0x5575b2915600 2024-09-12T17:28:05.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.912+0000 7f27527fc640 1 -- 172.21.15.170:0/1730112425 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2864011040 con 0x5575b2915600 2024-09-12T17:28:05.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.913+0000 7f27527fc640 1 --2- 172.21.15.170:0/1730112425 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f274403c730 0x7f274403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.913+0000 7f27527fc640 1 -- 172.21.15.170:0/1730112425 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f286400e040 con 0x5575b2915600 2024-09-12T17:28:05.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.913+0000 7f286c771640 1 --2- 172.21.15.170:0/1730112425 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f274403c730 0x7f274403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.913+0000 7f286ec87800 1 Processor -- start 2024-09-12T17:28:05.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.913+0000 7f286c771640 1 --2- 172.21.15.170:0/1730112425 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f274403c730 0x7f274403ebf0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x5575b28fc470 tx=0x7f285c05d7c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.913+0000 7f286ec87800 1 -- start start 2024-09-12T17:28:05.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.913+0000 7f286ec87800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575b2922120 0x5575b2922520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.913+0000 7f286ec87800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5575b27ff6d0 con 0x5575b2922120 2024-09-12T17:28:05.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.913+0000 7f286cf72640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575b2922120 0x5575b2922520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.913+0000 7f286cf72640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575b2922120 0x5575b2922520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:44126/0 (socket says 172.21.15.170:44126) 2024-09-12T17:28:05.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.913+0000 7f286cf72640 1 -- 172.21.15.170:0/4277090424 learned_addr learned my addr 172.21.15.170:0/4277090424 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:05.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.914+0000 7f286cf72640 1 -- 172.21.15.170:0/4277090424 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575b2922b10 con 0x5575b2922120 2024-09-12T17:28:05.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.914+0000 7f286cf72640 1 --2- 172.21.15.170:0/4277090424 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575b2922120 0x5575b2922520 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f2864020000 tx=0x7f286401f400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3554b107c14f001 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.914+0000 7f274b7fe640 1 -- 172.21.15.170:0/4277090424 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2864055040 con 0x5575b2922120 2024-09-12T17:28:05.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.914+0000 7f274b7fe640 1 -- 172.21.15.170:0/4277090424 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2864021960 con 0x5575b2922120 2024-09-12T17:28:05.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.914+0000 7f274b7fe640 1 -- 172.21.15.170:0/4277090424 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2864021440 con 0x5575b2922120 2024-09-12T17:28:05.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.914+0000 7f286ec87800 1 -- 172.21.15.170:0/4277090424 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575b2922120 msgr2=0x5575b2922520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:05.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.915+0000 7f286ec87800 1 --2- 172.21.15.170:0/4277090424 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575b2922120 0x5575b2922520 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f2864020000 tx=0x7f286401f400 comp rx=0 tx=0).stop 2024-09-12T17:28:05.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.915+0000 7f286ec87800 1 -- 172.21.15.170:0/4277090424 shutdown_connections 2024-09-12T17:28:05.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.915+0000 7f286ec87800 1 --2- 172.21.15.170:0/4277090424 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575b2922120 0x5575b2922520 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:05.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.915+0000 7f286ec87800 1 -- 172.21.15.170:0/4277090424 >> 172.21.15.170:0/4277090424 conn(0x5575b291e520 msgr2=0x5575b291c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:05.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.915+0000 7f286ec87800 1 -- 172.21.15.170:0/4277090424 shutdown_connections 2024-09-12T17:28:05.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.915+0000 7f286ec87800 1 -- 172.21.15.170:0/4277090424 wait complete. 2024-09-12T17:28:05.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.915+0000 7f286ec87800 1 Processor -- start 2024-09-12T17:28:05.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.915+0000 7f286ec87800 1 -- start start 2024-09-12T17:28:05.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.915+0000 7f286ec87800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575b2922120 0x5575b2929710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.915+0000 7f286ec87800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5575b2923130 con 0x5575b2922120 2024-09-12T17:28:05.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.915+0000 7f286cf72640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575b2922120 0x5575b2929710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.915+0000 7f286cf72640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575b2922120 0x5575b2929710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:44140/0 (socket says 172.21.15.170:44140) 2024-09-12T17:28:05.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.915+0000 7f286cf72640 1 -- 172.21.15.170:0/3328022942 learned_addr learned my addr 172.21.15.170:0/3328022942 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:05.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.916+0000 7f286cf72640 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575b2929c70 con 0x5575b2922120 2024-09-12T17:28:05.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.916+0000 7f286cf72640 1 --2- 172.21.15.170:0/3328022942 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575b2922120 0x5575b2929710 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f28640208e0 tx=0x7f2864053cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.916+0000 7f2749ffb640 1 -- 172.21.15.170:0/3328022942 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2864055050 con 0x5575b2922120 2024-09-12T17:28:05.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.916+0000 7f2749ffb640 1 -- 172.21.15.170:0/3328022942 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2864053f60 con 0x5575b2922120 2024-09-12T17:28:05.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.916+0000 7f2749ffb640 1 -- 172.21.15.170:0/3328022942 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f286401f840 con 0x5575b2922120 2024-09-12T17:28:05.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.916+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5575b2929f00 con 0x5575b2922120 2024-09-12T17:28:05.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.916+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575b292a880 con 0x5575b2922120 2024-09-12T17:28:05.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.917+0000 7f2749ffb640 1 -- 172.21.15.170:0/3328022942 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f28640551f0 con 0x5575b2922120 2024-09-12T17:28:05.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.917+0000 7f2749ffb640 1 --2- 172.21.15.170:0/3328022942 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f273403c780 0x7f273403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.917+0000 7f2749ffb640 1 -- 172.21.15.170:0/3328022942 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f286404d040 con 0x5575b2922120 2024-09-12T17:28:05.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.917+0000 7f286c771640 1 --2- 172.21.15.170:0/3328022942 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f273403c780 0x7f273403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.917+0000 7f286c771640 1 --2- 172.21.15.170:0/3328022942 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f273403c780 0x7f273403ec40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f285c05d8d0 tx=0x7f285c08b000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.918+0000 7f286ec87800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.918+0000 7f286ec87800 1 --2- 172.21.15.170:0/3328022942 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5575b2934ff0 0x5575b29374b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.918+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5575b2937c00 con 0x5575b2934ff0 2024-09-12T17:28:05.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.918+0000 7f286bf70640 1 --2- 172.21.15.170:0/3328022942 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5575b2934ff0 0x5575b29374b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.918+0000 7f286bf70640 1 --2- 172.21.15.170:0/3328022942 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5575b2934ff0 0x5575b29374b0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.918+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2860009050 con 0x5575b2934ff0 2024-09-12T17:28:05.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.918+0000 7f286ec87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:05.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.918+0000 7f286ec87800 20 realm 2024-09-12T17:28:05.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.918+0000 7f286ec87800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.918+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5575b2934380 con 0x5575b2934ff0 2024-09-12T17:28:05.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.919+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2860009050 con 0x5575b2934ff0 2024-09-12T17:28:05.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.919+0000 7f286ec87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:05.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.919+0000 7f286ec87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:05.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.919+0000 7f286ec87800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.919+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5575b29386f0 con 0x5575b2934ff0 2024-09-12T17:28:05.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.919+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2860009050 con 0x5575b2934ff0 2024-09-12T17:28:05.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.919+0000 7f286ec87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:05.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.919+0000 7f286ec87800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.919+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5575b2938fc0 con 0x5575b2934ff0 2024-09-12T17:28:05.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.919+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2860009050 con 0x5575b2934ff0 2024-09-12T17:28:05.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.919+0000 7f286ec87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:05.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.919+0000 7f286ec87800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.919+0000 7f286ec87800 1 --2- 172.21.15.170:0/3328022942 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5575b29399e0 0x5575b293bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.919+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5575b293c4a0 con 0x5575b29399e0 2024-09-12T17:28:05.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.919+0000 7f286cf72640 1 --2- 172.21.15.170:0/3328022942 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5575b29399e0 0x5575b293bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.919+0000 7f286cf72640 1 --2- 172.21.15.170:0/3328022942 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5575b29399e0 0x5575b293bdd0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.920+0000 7f286cf72640 1 -- 172.21.15.170:0/3328022942 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f286400a4d0 con 0x5575b29399e0 2024-09-12T17:28:05.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.920+0000 7f286ec87800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:05.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.920+0000 7f286ec87800 20 searching for the correct realm 2024-09-12T17:28:05.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.920+0000 7f286ec87800 1 --2- 172.21.15.170:0/3328022942 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5575b293e470 0x5575b2940930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.920+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575b2941000 con 0x5575b293e470 2024-09-12T17:28:05.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.920+0000 7f286c771640 1 --2- 172.21.15.170:0/3328022942 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5575b293e470 0x5575b2940930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.920+0000 7f286c771640 1 --2- 172.21.15.170:0/3328022942 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5575b293e470 0x5575b2940930 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.921+0000 7f286c771640 1 -- 172.21.15.170:0/3328022942 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f285c051070 con 0x5575b293e470 2024-09-12T17:28:05.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.921+0000 7f286c771640 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575b2941000 con 0x5575b29399e0 2024-09-12T17:28:05.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.921+0000 7f286cf72640 1 -- 172.21.15.170:0/3328022942 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f286400a4d0 con 0x5575b29399e0 2024-09-12T17:28:05.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.921+0000 7f286cf72640 1 --2- 172.21.15.170:0/3328022942 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f2864033070 0x7f28640569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:05.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.921+0000 7f286cf72640 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575b2941000 con 0x7f2864033070 2024-09-12T17:28:05.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.921+0000 7f286bf70640 1 --2- 172.21.15.170:0/3328022942 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f2864033070 0x7f28640569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:05.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.921+0000 7f286bf70640 1 --2- 172.21.15.170:0/3328022942 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f2864033070 0x7f28640569b0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:05.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.922+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2860009050 con 0x7f2864033070 2024-09-12T17:28:05.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.922+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575b2941000 con 0x5575b2934ff0 2024-09-12T17:28:05.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.922+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2860009050 con 0x5575b2934ff0 2024-09-12T17:28:05.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.922+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575b2941000 con 0x5575b2934ff0 2024-09-12T17:28:05.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.922+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2860029040 con 0x5575b2934ff0 2024-09-12T17:28:05.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.922+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575b2941000 con 0x7f2864033070 2024-09-12T17:28:05.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.922+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2860029040 con 0x7f2864033070 2024-09-12T17:28:05.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.922+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575b2941000 con 0x7f2864033070 2024-09-12T17:28:05.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.922+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2860029040 con 0x7f2864033070 2024-09-12T17:28:05.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.923+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575b2941000 con 0x5575b29399e0 2024-09-12T17:28:05.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.923+0000 7f286cf72640 1 -- 172.21.15.170:0/3328022942 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f286400a4d0 con 0x5575b29399e0 2024-09-12T17:28:05.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.923+0000 7f286cf72640 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575b2941000 con 0x5575b293e470 2024-09-12T17:28:05.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.923+0000 7f286c771640 1 -- 172.21.15.170:0/3328022942 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f285c051070 con 0x5575b293e470 2024-09-12T17:28:05.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.923+0000 7f286c771640 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575b2941000 con 0x5575b2934ff0 2024-09-12T17:28:05.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.923+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2860029040 con 0x5575b2934ff0 2024-09-12T17:28:05.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.923+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575b2941000 con 0x7f2864033070 2024-09-12T17:28:05.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.924+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2860029040 con 0x7f2864033070 2024-09-12T17:28:05.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.924+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575b2941000 con 0x5575b2934ff0 2024-09-12T17:28:05.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.924+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2860029040 con 0x5575b2934ff0 2024-09-12T17:28:05.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.924+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575b2941000 con 0x5575b29399e0 2024-09-12T17:28:05.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.924+0000 7f286cf72640 1 -- 172.21.15.170:0/3328022942 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 29 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f286400a4d0 con 0x5575b29399e0 2024-09-12T17:28:05.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.924+0000 7f286cf72640 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575b2941000 con 0x5575b293e470 2024-09-12T17:28:05.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.924+0000 7f286c771640 1 -- 172.21.15.170:0/3328022942 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f285c051070 con 0x5575b293e470 2024-09-12T17:28:05.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.924+0000 7f286c771640 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575b2941000 con 0x5575b293e470 2024-09-12T17:28:05.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.925+0000 7f286c771640 1 -- 172.21.15.170:0/3328022942 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f285c051070 con 0x5575b293e470 2024-09-12T17:28:05.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.925+0000 7f286c771640 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575b2941000 con 0x7f2864033070 2024-09-12T17:28:05.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.925+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2860029040 con 0x7f2864033070 2024-09-12T17:28:05.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.925+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575b2941000 con 0x5575b293e470 2024-09-12T17:28:05.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.925+0000 7f286c771640 1 -- 172.21.15.170:0/3328022942 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f285c051070 con 0x5575b293e470 2024-09-12T17:28:05.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.925+0000 7f286c771640 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575b2941000 con 0x5575b293e470 2024-09-12T17:28:05.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.925+0000 7f286c771640 1 -- 172.21.15.170:0/3328022942 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f285c051070 con 0x5575b293e470 2024-09-12T17:28:05.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.925+0000 7f286c771640 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575b2941000 con 0x5575b2934ff0 2024-09-12T17:28:05.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.926+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2860029040 con 0x5575b2934ff0 2024-09-12T17:28:05.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.926+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575b2941000 con 0x5575b2934ff0 2024-09-12T17:28:05.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.926+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2860029040 con 0x5575b2934ff0 2024-09-12T17:28:05.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.926+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575b2941000 con 0x7f2864033070 2024-09-12T17:28:05.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.926+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2860029040 con 0x7f2864033070 2024-09-12T17:28:05.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.926+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575b2941000 con 0x5575b293e470 2024-09-12T17:28:05.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.926+0000 7f286c771640 1 -- 172.21.15.170:0/3328022942 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f285c051070 con 0x5575b293e470 2024-09-12T17:28:05.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.926+0000 7f286c771640 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575b2941000 con 0x5575b29399e0 2024-09-12T17:28:05.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.927+0000 7f286cf72640 1 -- 172.21.15.170:0/3328022942 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f286400a4d0 con 0x5575b29399e0 2024-09-12T17:28:05.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.927+0000 7f286cf72640 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575b2941000 con 0x5575b2934ff0 2024-09-12T17:28:05.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.927+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2860029040 con 0x5575b2934ff0 2024-09-12T17:28:05.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.927+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575b2941000 con 0x7f2864033070 2024-09-12T17:28:05.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.927+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2860029040 con 0x7f2864033070 2024-09-12T17:28:05.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.927+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575b2941000 con 0x5575b293e470 2024-09-12T17:28:05.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.927+0000 7f286c771640 1 -- 172.21.15.170:0/3328022942 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f285c051070 con 0x5575b293e470 2024-09-12T17:28:05.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.927+0000 7f286c771640 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575b2941000 con 0x7f2864033070 2024-09-12T17:28:05.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.928+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2860029040 con 0x7f2864033070 2024-09-12T17:28:05.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.928+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575b2941000 con 0x5575b29399e0 2024-09-12T17:28:05.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.928+0000 7f286cf72640 1 -- 172.21.15.170:0/3328022942 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f286400a4d0 con 0x5575b29399e0 2024-09-12T17:28:05.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.928+0000 7f286cf72640 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575b2941000 con 0x5575b293e470 2024-09-12T17:28:05.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.928+0000 7f286c771640 1 -- 172.21.15.170:0/3328022942 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f285c051070 con 0x5575b293e470 2024-09-12T17:28:05.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.928+0000 7f286c771640 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575b2941000 con 0x7f2864033070 2024-09-12T17:28:05.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.928+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2860029040 con 0x7f2864033070 2024-09-12T17:28:05.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.928+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575b2941000 con 0x5575b2934ff0 2024-09-12T17:28:05.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.929+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2860029040 con 0x5575b2934ff0 2024-09-12T17:28:05.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.929+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575b2941000 con 0x5575b29399e0 2024-09-12T17:28:05.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.929+0000 7f286cf72640 1 -- 172.21.15.170:0/3328022942 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f286400a4d0 con 0x5575b29399e0 2024-09-12T17:28:05.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.929+0000 7f286ec87800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:05.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.929+0000 7f286ec87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:05.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.929+0000 7f286ec87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:05.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.929+0000 7f286ec87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:05.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.929+0000 7f286ec87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:05.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.929+0000 7f286ec87800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:05.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.929+0000 7f286ec87800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.929+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5575b293ce60 con 0x5575b2934ff0 2024-09-12T17:28:05.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.929+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2860029040 con 0x5575b2934ff0 2024-09-12T17:28:05.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.929+0000 7f286ec87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:05.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.929+0000 7f286ec87800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.929+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5575b293caa0 con 0x5575b2934ff0 2024-09-12T17:28:05.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.929+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2860029040 con 0x5575b2934ff0 2024-09-12T17:28:05.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.929+0000 7f286ec87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:05.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.929+0000 7f286ec87800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.929+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5575b293d840 con 0x5575b29399e0 2024-09-12T17:28:05.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.930+0000 7f286cf72640 1 -- 172.21.15.170:0/3328022942 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f286400a4d0 con 0x5575b29399e0 2024-09-12T17:28:05.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.930+0000 7f286ec87800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:05.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.930+0000 7f286ec87800 20 zone default found 2024-09-12T17:28:05.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.930+0000 7f286ec87800 4 Realm: () 2024-09-12T17:28:05.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.930+0000 7f286ec87800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:05.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.930+0000 7f286ec87800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:05.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.930+0000 7f286ec87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:05.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.930+0000 7f286ec87800 20 zonegroup default 2024-09-12T17:28:05.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.930+0000 7f286ec87800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.930+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5575b2941930 con 0x7f2864033070 2024-09-12T17:28:05.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.930+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2860029040 con 0x7f2864033070 2024-09-12T17:28:05.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.930+0000 7f286ec87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:05.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.930+0000 7f286ec87800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.930+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5575b2943b70 con 0x5575b293e470 2024-09-12T17:28:05.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.930+0000 7f286c771640 1 -- 172.21.15.170:0/3328022942 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f285c051070 con 0x5575b293e470 2024-09-12T17:28:05.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.930+0000 7f286ec87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:05.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.930+0000 7f286ec87800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.930+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5575b2943f10 con 0x5575b293e470 2024-09-12T17:28:05.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.930+0000 7f286c771640 1 -- 172.21.15.170:0/3328022942 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f285c051070 con 0x5575b293e470 2024-09-12T17:28:05.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.930+0000 7f286ec87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:05.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.931+0000 7f286ec87800 20 started sync module instance, tier type = 2024-09-12T17:28:05.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.931+0000 7f286ec87800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:05.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.931+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575b2943000 con 0x5575b29399e0 2024-09-12T17:28:05.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.932+0000 7f286cf72640 1 -- 172.21.15.170:0/3328022942 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(44 notify.0 [create] v29'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f286400a4d0 con 0x5575b29399e0 2024-09-12T17:28:05.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.932+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93963995591968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575b2943000 con 0x5575b29399e0 2024-09-12T17:28:05.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.932+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575b2944980 con 0x5575b2934ff0 2024-09-12T17:28:05.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.933+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v29'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2860029040 con 0x5575b2934ff0 2024-09-12T17:28:05.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.933+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93963995595888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575b2944980 con 0x5575b2934ff0 2024-09-12T17:28:05.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.933+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575b2945980 con 0x5575b293e470 2024-09-12T17:28:05.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.933+0000 7f286cf72640 1 -- 172.21.15.170:0/3328022942 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93963995591968] v29'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f286400a4d0 con 0x5575b29399e0 2024-09-12T17:28:05.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.934+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93963995595888] v29'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2860029040 con 0x5575b2934ff0 2024-09-12T17:28:05.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.934+0000 7f286c771640 1 -- 172.21.15.170:0/3328022942 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v29'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f285c051070 con 0x5575b293e470 2024-09-12T17:28:05.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.934+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93963995599984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575b2944d70 con 0x5575b293e470 2024-09-12T17:28:05.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.934+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575b2946390 con 0x5575b29399e0 2024-09-12T17:28:05.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.935+0000 7f286cf72640 1 -- 172.21.15.170:0/3328022942 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(50 notify.3 [create] v29'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f286400a4d0 con 0x5575b29399e0 2024-09-12T17:28:05.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.935+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93963995602656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575b29467b0 con 0x5575b29399e0 2024-09-12T17:28:05.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.935+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575b29472a0 con 0x5575b2934ff0 2024-09-12T17:28:05.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.936+0000 7f286c771640 1 -- 172.21.15.170:0/3328022942 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93963995599984] v29'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f285c051070 con 0x5575b293e470 2024-09-12T17:28:05.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.937+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v29'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2860029040 con 0x5575b2934ff0 2024-09-12T17:28:05.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.937+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93963995606384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575b2947260 con 0x5575b2934ff0 2024-09-12T17:28:05.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.937+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575b2947cf0 con 0x7f2864033070 2024-09-12T17:28:05.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.937+0000 7f286cf72640 1 -- 172.21.15.170:0/3328022942 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93963995602656] v29'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f286400a4d0 con 0x5575b29399e0 2024-09-12T17:28:05.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.937+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93963995606384] v29'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2860029040 con 0x5575b2934ff0 2024-09-12T17:28:05.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.938+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(54 notify.5 [create] v29'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2860029040 con 0x7f2864033070 2024-09-12T17:28:05.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.938+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93963995589456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575b2947800 con 0x7f2864033070 2024-09-12T17:28:05.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.938+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575b2948590 con 0x7f2864033070 2024-09-12T17:28:05.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.939+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93963995589456] v29'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2860029040 con 0x7f2864033070 2024-09-12T17:28:05.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.939+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(56 notify.6 [create] v29'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2860029040 con 0x7f2864033070 2024-09-12T17:28:05.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.939+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93963995603712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575b2947800 con 0x7f2864033070 2024-09-12T17:28:05.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.939+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575b2948ae0 con 0x7f2864033070 2024-09-12T17:28:05.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.940+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93963995603712] v29'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2860029040 con 0x7f2864033070 2024-09-12T17:28:05.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.940+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(58 notify.7 [create] v29'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2860029040 con 0x7f2864033070 2024-09-12T17:28:05.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.940+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93963995611280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575b2948aa0 con 0x7f2864033070 2024-09-12T17:28:05.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.940+0000 7f286ec87800 20 add_watcher() i=0 2024-09-12T17:28:05.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.940+0000 7f286ec87800 20 add_watcher() i=1 2024-09-12T17:28:05.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.940+0000 7f286ec87800 20 add_watcher() i=2 2024-09-12T17:28:05.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.940+0000 7f286ec87800 20 add_watcher() i=3 2024-09-12T17:28:05.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.940+0000 7f286ec87800 20 add_watcher() i=4 2024-09-12T17:28:05.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.940+0000 7f286ec87800 20 add_watcher() i=5 2024-09-12T17:28:05.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.940+0000 7f286ec87800 20 add_watcher() i=6 2024-09-12T17:28:05.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.941+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93963995611280] v29'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2860029040 con 0x7f2864033070 2024-09-12T17:28:05.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.941+0000 7f286ec87800 20 add_watcher() i=7 2024-09-12T17:28:05.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.941+0000 7f286ec87800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:05.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.941+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5575b294bf30 con 0x5575b2934ff0 2024-09-12T17:28:05.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.941+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2860029040 con 0x5575b2934ff0 2024-09-12T17:28:05.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.941+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93963995612336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575b2949450 con 0x5575b2934ff0 2024-09-12T17:28:05.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.942+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93963995612336] v29'150 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2860029040 con 0x5575b2934ff0 2024-09-12T17:28:05.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.942+0000 7f2722fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:05.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.943+0000 7f286ec87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:05.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.943+0000 7f286ec87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:05.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.943+0000 7f286ec87800 5 note: GC not initialized 2024-09-12T17:28:05.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.943+0000 7f2721fdb640 20 reqs_thread_entry: start 2024-09-12T17:28:05.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.943+0000 7f286ec87800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:05.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.943+0000 7f286ec87800 20 Filter name: none 2024-09-12T17:28:05.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.943+0000 7f26937fe640 20 reqs_thread_entry: start 2024-09-12T17:28:05.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.943+0000 7f286ec87800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:28:05.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.943+0000 7f286ec87800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.943+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5575b297f040 con 0x5575b2934ff0 2024-09-12T17:28:05.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.944+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2860029040 con 0x5575b2934ff0 2024-09-12T17:28:05.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.944+0000 7f286ec87800 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:28:05.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.944+0000 7f286ec87800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T17:28:05.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.944+0000 7f286ec87800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:28:05.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.944+0000 7f286ec87800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:05.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.944+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5575b2981970 con 0x5575b29399e0 2024-09-12T17:28:05.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.944+0000 7f286cf72640 1 -- 172.21.15.170:0/3328022942 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f286400a4d0 con 0x5575b29399e0 2024-09-12T17:28:05.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.944+0000 7f286ec87800 20 enabling bucket name=myfoo 2024-09-12T17:28:05.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.944+0000 7f286ec87800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T17:28:05.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.944+0000 7f286ec87800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.944+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5575b297f950 con 0x5575b29399e0 2024-09-12T17:28:05.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.944+0000 7f286cf72640 1 -- 172.21.15.170:0/3328022942 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f286400a4d0 con 0x5575b29399e0 2024-09-12T17:28:05.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.944+0000 7f286ec87800 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T17:28:05.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.944+0000 7f286ec87800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-12T17:28:05.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.944+0000 7f286ec87800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:28:05.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.944+0000 7f286ec87800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 : miss 2024-09-12T17:28:05.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.944+0000 7f286ec87800 20 rados->read ofs=0 len=0 2024-09-12T17:28:05.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.944+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:65 8.1d 8:baccd554:root::.bucket.meta.myfoo%3a7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5575b29822b0 con 0x7f2864033070 2024-09-12T17:28:05.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.945+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(65 .bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f2860029040 con 0x7f2864033070 2024-09-12T17:28:05.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.945+0000 7f286ec87800 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T17:28:05.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.945+0000 7f286ec87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 info.flags=0x17 2024-09-12T17:28:05.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.945+0000 7f286ec87800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 to cache LRU end 2024-09-12T17:28:05.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.945+0000 7f286ec87800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:05.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.945+0000 7f286ec87800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:28:05.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.945+0000 7f286ec87800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 2024-09-12T17:28:05.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.945+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:66 8.1d 8:baccd554:root::.bucket.meta.myfoo%3a7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575b2989a50 con 0x7f2864033070 2024-09-12T17:28:05.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.947+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(66 .bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v29'7 uv7 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f2860029040 con 0x7f2864033070 2024-09-12T17:28:05.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.947+0000 7f286ec87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 info.flags=0x17 2024-09-12T17:28:05.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.947+0000 7f286ec87800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 to cache LRU end 2024-09-12T17:28:05.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.947+0000 7f286ec87800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:28:05.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.947+0000 7f286ec87800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1, ofs0, ns] 2024-09-12T17:28:05.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.947+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:67 7.9 7:93e5b521:::notify.7:head [notify cookie 93963995851120 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5575b2983ec0 con 0x7f2864033070 2024-09-12T17:28:05.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.947+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== watch-notify(notify (1) cookie 93963995611280 notify 124554051602 ret 0) ==== 802+0+0 (crc 0 0 0) 0x5575b29826a0 con 0x7f2864033070 2024-09-12T17:28:05.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.947+0000 7f274b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051602 cookie 93963995611280 notifier 4596 bl.length()=760 2024-09-12T17:28:05.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.947+0000 7f274b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 info.flags=0x17 2024-09-12T17:28:05.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.947+0000 7f274b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1 to cache LRU end 2024-09-12T17:28:05.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.947+0000 7f274b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:28:05.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.947+0000 7f274b7fe640 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:68 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f2738003ea0 con 0x7f2864033070 2024-09-12T17:28:05.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.947+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(67 notify.7 [notify cookie 93963995851120 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2860029040 con 0x7f2864033070 2024-09-12T17:28:05.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.947+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== osd_op_reply(68 notify.7 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2860029040 con 0x7f2864033070 2024-09-12T17:28:05.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.947+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.0 v2:172.21.15.47:6800/3978157098 22 ==== watch-notify(notify_complete (2) cookie 93963995851120 notify 124554051602 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5575b29817a0 con 0x7f2864033070 2024-09-12T17:28:05.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.947+0000 7f286ec87800 20 handle_bi_update(): bucket=:myfoo[7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1]): orig_sources= new_sources= 2024-09-12T17:28:05.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.947+0000 7f286ec87800 20 handle_bi_update(): bucket=:myfoo[7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1]): potential sources added=[] removed=[] 2024-09-12T17:28:05.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.947+0000 7f286ec87800 20 handle_bi_update(): bucket=:myfoo[7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1]): orig_dests= new_dests= 2024-09-12T17:28:05.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.947+0000 7f286ec87800 20 handle_bi_update(): bucket=:myfoo[7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1]): potential dests added=[] removed=[] 2024-09-12T17:28:05.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.947+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575b2989290 con 0x5575b2934ff0 2024-09-12T17:28:05.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.949+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v29'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f2860029040 con 0x5575b2934ff0 2024-09-12T17:28:05.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.949+0000 7f286ec87800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:28:05.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.949+0000 7f286ec87800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:28:05.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.949+0000 7f286ec87800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T17:28:05.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.949+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 93963995873920 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5575b2982e00 con 0x5575b2934ff0 2024-09-12T17:28:05.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.949+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== watch-notify(notify (1) cookie 93963995606384 notify 124554051599 ret 0) ==== 609+0+0 (crc 0 0 0) 0x5575b29817a0 con 0x5575b2934ff0 2024-09-12T17:28:05.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.949+0000 7f274affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051599 cookie 93963995606384 notifier 4596 bl.length()=567 2024-09-12T17:28:05.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.949+0000 7f274affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:28:05.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.949+0000 7f274affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:28:05.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.949+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(70 notify.4 [notify cookie 93963995873920 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2860029040 con 0x5575b2934ff0 2024-09-12T17:28:05.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.949+0000 7f274affd640 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f26a0003430 con 0x5575b2934ff0 2024-09-12T17:28:05.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.949+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2860029040 con 0x5575b2934ff0 2024-09-12T17:28:05.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.949+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== watch-notify(notify_complete (2) cookie 93963995873920 notify 124554051599 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5575b26aae40 con 0x5575b2934ff0 2024-09-12T17:28:05.995 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T17:27:59.362376Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:27:59.362351Z","tags":[],"group_ids":[]} 2024-09-12T17:28:06.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.950+0000 7f2722fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:06.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.950+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93963995612336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575b297cf20 con 0x5575b2934ff0 2024-09-12T17:28:06.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.951+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 93963995612336] v29'151 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2860029040 con 0x5575b2934ff0 2024-09-12T17:28:06.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.951+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93963995591968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575b297cf20 con 0x5575b29399e0 2024-09-12T17:28:06.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.952+0000 7f286cf72640 1 -- 172.21.15.170:0/3328022942 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 93963995591968] v29'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f286400a4d0 con 0x5575b29399e0 2024-09-12T17:28:06.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.952+0000 7f286ec87800 20 remove_watcher() i=0 2024-09-12T17:28:06.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.952+0000 7f286ec87800 2 removed watcher, disabling cache 2024-09-12T17:28:06.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.952+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93963995595888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575b297cf20 con 0x5575b2934ff0 2024-09-12T17:28:06.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.953+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 93963995595888] v29'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2860029040 con 0x5575b2934ff0 2024-09-12T17:28:06.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.953+0000 7f286ec87800 20 remove_watcher() i=1 2024-09-12T17:28:06.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.953+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93963995599984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575b297cf20 con 0x5575b293e470 2024-09-12T17:28:06.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.955+0000 7f286c771640 1 -- 172.21.15.170:0/3328022942 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 93963995599984] v29'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f285c051070 con 0x5575b293e470 2024-09-12T17:28:06.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.955+0000 7f286ec87800 20 remove_watcher() i=2 2024-09-12T17:28:06.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.955+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93963995602656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575b297cf20 con 0x5575b29399e0 2024-09-12T17:28:06.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.955+0000 7f286cf72640 1 -- 172.21.15.170:0/3328022942 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 93963995602656] v29'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f286400a4d0 con 0x5575b29399e0 2024-09-12T17:28:06.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.956+0000 7f286ec87800 20 remove_watcher() i=3 2024-09-12T17:28:06.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.956+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93963995606384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575b297cf20 con 0x5575b2934ff0 2024-09-12T17:28:06.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.956+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 93963995606384] v29'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2860029040 con 0x5575b2934ff0 2024-09-12T17:28:06.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.956+0000 7f286ec87800 20 remove_watcher() i=4 2024-09-12T17:28:06.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.956+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93963995589456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575b297cf20 con 0x7f2864033070 2024-09-12T17:28:06.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.957+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.0 v2:172.21.15.47:6800/3978157098 23 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 93963995589456] v29'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2860029040 con 0x7f2864033070 2024-09-12T17:28:06.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.958+0000 7f286ec87800 20 remove_watcher() i=5 2024-09-12T17:28:06.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.958+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93963995603712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575b297cf20 con 0x7f2864033070 2024-09-12T17:28:06.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.958+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.0 v2:172.21.15.47:6800/3978157098 24 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 93963995603712] v29'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2860029040 con 0x7f2864033070 2024-09-12T17:28:06.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.958+0000 7f286ec87800 20 remove_watcher() i=6 2024-09-12T17:28:06.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.958+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93963995611280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575b297cf20 con 0x7f2864033070 2024-09-12T17:28:06.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.960+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 <== osd.0 v2:172.21.15.47:6800/3978157098 25 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 93963995611280] v29'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2860029040 con 0x7f2864033070 2024-09-12T17:28:06.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.960+0000 7f286ec87800 20 remove_watcher() i=7 2024-09-12T17:28:06.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.960+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f2864033070 msgr2=0x7f28640569b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:06.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.960+0000 7f286ec87800 1 --2- 172.21.15.170:0/3328022942 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f2864033070 0x7f28640569b0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:06.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.960+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5575b2934ff0 msgr2=0x5575b29374b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:06.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.960+0000 7f286ec87800 1 --2- 172.21.15.170:0/3328022942 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5575b2934ff0 0x5575b29374b0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:06.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.960+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5575b29399e0 msgr2=0x5575b293bdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:06.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.960+0000 7f286ec87800 1 --2- 172.21.15.170:0/3328022942 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5575b29399e0 0x5575b293bdd0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:06.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.960+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5575b293e470 msgr2=0x5575b2940930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:06.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.960+0000 7f286ec87800 1 --2- 172.21.15.170:0/3328022942 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5575b293e470 0x5575b2940930 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:06.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.960+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f273403c780 msgr2=0x7f273403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:06.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.960+0000 7f286ec87800 1 --2- 172.21.15.170:0/3328022942 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f273403c780 0x7f273403ec40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f285c05d8d0 tx=0x7f285c08b000 comp rx=0 tx=0).stop 2024-09-12T17:28:06.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.960+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575b2922120 msgr2=0x5575b2929710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:06.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.960+0000 7f286ec87800 1 --2- 172.21.15.170:0/3328022942 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575b2922120 0x5575b2929710 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f28640208e0 tx=0x7f2864053cf0 comp rx=0 tx=0).stop 2024-09-12T17:28:06.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.960+0000 7f286bf70640 1 -- 172.21.15.170:0/3328022942 reap_dead start 2024-09-12T17:28:06.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.960+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 shutdown_connections 2024-09-12T17:28:06.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.960+0000 7f286ec87800 1 --2- 172.21.15.170:0/3328022942 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575b2922120 0x5575b2929710 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:06.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.960+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 >> 172.21.15.170:0/3328022942 conn(0x5575b291e520 msgr2=0x5575b291c730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:06.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.960+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 shutdown_connections 2024-09-12T17:28:06.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.960+0000 7f286ec87800 1 -- 172.21.15.170:0/3328022942 wait complete. 2024-09-12T17:28:06.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.960+0000 7f286ec87800 1 -- 172.21.15.170:0/1730112425 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f274403c730 msgr2=0x7f274403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:06.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.960+0000 7f286ec87800 1 --2- 172.21.15.170:0/1730112425 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f274403c730 0x7f274403ebf0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x5575b28fc470 tx=0x7f285c05d7c0 comp rx=0 tx=0).stop 2024-09-12T17:28:06.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.960+0000 7f286ec87800 1 -- 172.21.15.170:0/1730112425 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575b2915600 msgr2=0x5575b2915a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:06.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.960+0000 7f286ec87800 1 --2- 172.21.15.170:0/1730112425 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575b2915600 0x5575b2915a20 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x5575b28fb370 tx=0x7f28640167b0 comp rx=0 tx=0).stop 2024-09-12T17:28:06.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.960+0000 7f286ec87800 1 -- 172.21.15.170:0/1730112425 shutdown_connections 2024-09-12T17:28:06.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.960+0000 7f286ec87800 1 --2- 172.21.15.170:0/1730112425 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f274403c730 0x7f274403ebf0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:06.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.960+0000 7f286ec87800 1 --2- 172.21.15.170:0/1730112425 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575b2915600 0x5575b2915a20 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:06.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.960+0000 7f286ec87800 1 -- 172.21.15.170:0/1730112425 >> 172.21.15.170:0/1730112425 conn(0x5575b29099b0 msgr2=0x5575b2909d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:06.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.960+0000 7f286ec87800 1 -- 172.21.15.170:0/1730112425 shutdown_connections 2024-09-12T17:28:06.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.961+0000 7f286ec87800 1 -- 172.21.15.170:0/1730112425 wait complete. 2024-09-12T17:28:06.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.961+0000 7f286ec87800 1 -- 172.21.15.170:0/4160093494 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5575b28ff9b0 msgr2=0x5575b2901da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:06.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.961+0000 7f286ec87800 1 --2- 172.21.15.170:0/4160093494 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5575b28ff9b0 0x5575b2901da0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:06.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.961+0000 7f286ec87800 1 -- 172.21.15.170:0/4160093494 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5575b2904140 msgr2=0x5575b29065e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:06.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.961+0000 7f286ec87800 1 --2- 172.21.15.170:0/4160093494 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5575b2904140 0x5575b29065e0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:06.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.961+0000 7f286ec87800 1 -- 172.21.15.170:0/4160093494 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f275403c730 msgr2=0x7f275403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:06.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.961+0000 7f286ec87800 1 --2- 172.21.15.170:0/4160093494 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f275403c730 0x7f275403ebf0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2860004170 tx=0x7f2860001330 comp rx=0 tx=0).stop 2024-09-12T17:28:06.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.961+0000 7f286ec87800 1 -- 172.21.15.170:0/4160093494 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575b2804030 msgr2=0x5575b28fa3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:06.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.961+0000 7f286ec87800 1 --2- 172.21.15.170:0/4160093494 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575b2804030 0x5575b28fa3c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f285c025c20 tx=0x7f285c002fb0 comp rx=0 tx=0).stop 2024-09-12T17:28:06.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.961+0000 7f286ec87800 1 -- 172.21.15.170:0/4160093494 shutdown_connections 2024-09-12T17:28:06.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.961+0000 7f286ec87800 1 --2- 172.21.15.170:0/4160093494 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5575b2904140 0x5575b29065e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:06.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.961+0000 7f286ec87800 1 --2- 172.21.15.170:0/4160093494 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f275403c730 0x7f275403ebf0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:06.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.961+0000 7f286ec87800 1 --2- 172.21.15.170:0/4160093494 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5575b28ff9b0 0x5575b2901da0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:06.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.961+0000 7f286ec87800 1 --2- 172.21.15.170:0/4160093494 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575b2804030 0x5575b28fa3c0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:06.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.961+0000 7f286ec87800 1 -- 172.21.15.170:0/4160093494 >> 172.21.15.170:0/4160093494 conn(0x5575b27fb1c0 msgr2=0x5575b28ebb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:06.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.961+0000 7f286ec87800 1 -- 172.21.15.170:0/4160093494 shutdown_connections 2024-09-12T17:28:06.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:05.961+0000 7f286ec87800 1 -- 172.21.15.170:0/4160093494 wait complete. 2024-09-12T17:28:06.008 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T17:27:59.362376Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:27:59.362351Z', 'tags': [], 'group_ids': []} 2024-09-12T17:28:06.015 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-12T17:28:06.288 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-09-12T17:28:06.295 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:28:21.296 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-12T17:28:21.296 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-12T17:28:21.297 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-12T17:28:21.352 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:21.352 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:21.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.351+0000 7fb833014800 1 Processor -- start 2024-09-12T17:28:21.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.351+0000 7fb833014800 1 -- start start 2024-09-12T17:28:21.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.352+0000 7fb833014800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55ea04ed21f0 0x55ea04ed46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:21.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.352+0000 7fb833014800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ea04d77e40 con 0x55ea04ece6e0 2024-09-12T17:28:21.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.352+0000 7fb833014800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x55ea04d42680 con 0x55ea04ed21f0 2024-09-12T17:28:21.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.352+0000 7fb82dfdf640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55ea04ed21f0 0x55ea04ed46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:21.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.352+0000 7fb82e7e0640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x55ea04ece6e0 0x55ea04ed0ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:47660/0 (socket says 172.21.15.170:47660) 2024-09-12T17:28:21.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.352+0000 7fb82e7e0640 1 -- 172.21.15.170:0/1368297962 learned_addr learned my addr 172.21.15.170:0/1368297962 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:28:21.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.352+0000 7fb82dfdf640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55ea04ed21f0 0x55ea04ed46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:55794/0 (socket says 172.21.15.170:55794) 2024-09-12T17:28:21.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.352+0000 7fb82dfdf640 1 -- 172.21.15.170:0/1368297962 >> v1:172.21.15.47:6789/0 conn(0x55ea04ece6e0 legacy=0x55ea04ed0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:21.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.352+0000 7fb82dfdf640 1 -- 172.21.15.170:0/1368297962 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea04d5e6b0 con 0x55ea04ed21f0 2024-09-12T17:28:21.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.354+0000 7fb82dfdf640 1 --2- 172.21.15.170:0/1368297962 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea04ed21f0 0x55ea04ed46b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fb82400a470 tx=0x7fb824045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42c862b9d872c138 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:21.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.354+0000 7fb82d7de640 1 -- 172.21.15.170:0/1368297962 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb824053570 con 0x55ea04ed21f0 2024-09-12T17:28:21.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.355+0000 7fb82d7de640 1 -- 172.21.15.170:0/1368297962 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb824058070 con 0x55ea04ed21f0 2024-09-12T17:28:21.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.355+0000 7fb82d7de640 1 -- 172.21.15.170:0/1368297962 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb824053880 con 0x55ea04ed21f0 2024-09-12T17:28:21.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.355+0000 7fb833014800 1 -- 172.21.15.170:0/1368297962 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea04ed21f0 msgr2=0x55ea04ed46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:21.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.355+0000 7fb833014800 1 --2- 172.21.15.170:0/1368297962 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea04ed21f0 0x55ea04ed46b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fb82400a470 tx=0x7fb824045a20 comp rx=0 tx=0).stop 2024-09-12T17:28:21.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.355+0000 7fb833014800 1 -- 172.21.15.170:0/1368297962 shutdown_connections 2024-09-12T17:28:21.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.355+0000 7fb833014800 1 --2- 172.21.15.170:0/1368297962 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea04ed21f0 0x55ea04ed46b0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:21.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.355+0000 7fb833014800 1 -- 172.21.15.170:0/1368297962 >> 172.21.15.170:0/1368297962 conn(0x55ea04ec81c0 msgr2=0x55ea04eca620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:21.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.355+0000 7fb833014800 1 -- 172.21.15.170:0/1368297962 shutdown_connections 2024-09-12T17:28:21.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.355+0000 7fb833014800 1 -- 172.21.15.170:0/1368297962 wait complete. 2024-09-12T17:28:21.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.371+0000 7fb833014800 1 Processor -- start 2024-09-12T17:28:21.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.371+0000 7fb833014800 1 -- start start 2024-09-12T17:28:21.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.371+0000 7fb833014800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea04ece6e0 0x55ea04fbd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:21.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.371+0000 7fb833014800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ea04d66dd0 con 0x55ea04ece6e0 2024-09-12T17:28:21.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.372+0000 7fb82e7e0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea04ece6e0 0x55ea04fbd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:21.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.372+0000 7fb82e7e0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea04ece6e0 0x55ea04fbd680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:55798/0 (socket says 172.21.15.170:55798) 2024-09-12T17:28:21.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.372+0000 7fb82e7e0640 1 -- 172.21.15.170:0/1316296118 learned_addr learned my addr 172.21.15.170:0/1316296118 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:21.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.372+0000 7fb82e7e0640 1 -- 172.21.15.170:0/1316296118 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea04d7fe10 con 0x55ea04ece6e0 2024-09-12T17:28:21.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.372+0000 7fb82e7e0640 1 --2- 172.21.15.170:0/1316296118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea04ece6e0 0x55ea04fbd680 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fb820001e40 tx=0x7fb820001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=685cbcea1f7c0cef server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:21.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.372+0000 7fb71c608640 1 -- 172.21.15.170:0/1316296118 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb820012020 con 0x55ea04ece6e0 2024-09-12T17:28:21.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.372+0000 7fb71c608640 1 -- 172.21.15.170:0/1316296118 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb82000e5a0 con 0x55ea04ece6e0 2024-09-12T17:28:21.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.372+0000 7fb71c608640 1 -- 172.21.15.170:0/1316296118 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb82000e8a0 con 0x55ea04ece6e0 2024-09-12T17:28:21.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.373+0000 7fb833014800 1 -- 172.21.15.170:0/1316296118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea04ece6e0 msgr2=0x55ea04fbd680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:21.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.373+0000 7fb833014800 1 --2- 172.21.15.170:0/1316296118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea04ece6e0 0x55ea04fbd680 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fb820001e40 tx=0x7fb820001e70 comp rx=0 tx=0).stop 2024-09-12T17:28:21.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.373+0000 7fb833014800 1 -- 172.21.15.170:0/1316296118 shutdown_connections 2024-09-12T17:28:21.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.373+0000 7fb833014800 1 --2- 172.21.15.170:0/1316296118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea04ece6e0 0x55ea04fbd680 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:21.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.373+0000 7fb833014800 1 -- 172.21.15.170:0/1316296118 >> 172.21.15.170:0/1316296118 conn(0x55ea04ec81c0 msgr2=0x55ea04fb9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:21.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.373+0000 7fb833014800 1 -- 172.21.15.170:0/1316296118 shutdown_connections 2024-09-12T17:28:21.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.373+0000 7fb833014800 1 -- 172.21.15.170:0/1316296118 wait complete. 2024-09-12T17:28:21.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.374+0000 7fb833014800 1 Processor -- start 2024-09-12T17:28:21.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.374+0000 7fb833014800 1 -- start start 2024-09-12T17:28:21.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.374+0000 7fb833014800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea04ece6e0 0x55ea04fc5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:21.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.374+0000 7fb833014800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ea04ed5030 con 0x55ea04ece6e0 2024-09-12T17:28:21.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.374+0000 7fb82e7e0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea04ece6e0 0x55ea04fc5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:21.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.374+0000 7fb82e7e0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea04ece6e0 0x55ea04fc5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:55802/0 (socket says 172.21.15.170:55802) 2024-09-12T17:28:21.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.374+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3366040755 learned_addr learned my addr 172.21.15.170:0/3366040755 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:21.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.375+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3366040755 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea04fc5560 con 0x55ea04ece6e0 2024-09-12T17:28:21.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.375+0000 7fb82e7e0640 1 --2- 172.21.15.170:0/3366040755 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea04ece6e0 0x55ea04fc5000 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fb82000c010 tx=0x7fb820000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:21.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.375+0000 7fb71ae05640 1 -- 172.21.15.170:0/3366040755 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb820012030 con 0x55ea04ece6e0 2024-09-12T17:28:21.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.375+0000 7fb71ae05640 1 -- 172.21.15.170:0/3366040755 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8200014a0 con 0x55ea04ece6e0 2024-09-12T17:28:21.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.375+0000 7fb833014800 1 -- 172.21.15.170:0/3366040755 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ea04fc57f0 con 0x55ea04ece6e0 2024-09-12T17:28:21.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.375+0000 7fb71ae05640 1 -- 172.21.15.170:0/3366040755 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb82001a7a0 con 0x55ea04ece6e0 2024-09-12T17:28:21.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.375+0000 7fb833014800 1 -- 172.21.15.170:0/3366040755 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea04fc61f0 con 0x55ea04ece6e0 2024-09-12T17:28:21.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.376+0000 7fb71ae05640 1 -- 172.21.15.170:0/3366040755 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb820015020 con 0x55ea04ece6e0 2024-09-12T17:28:21.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.376+0000 7fb71ae05640 1 --2- 172.21.15.170:0/3366040755 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb71403c730 0x7fb71403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:21.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.376+0000 7fb71ae05640 1 -- 172.21.15.170:0/3366040755 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5967+0+0 (secure 0 0 0) 0x7fb820020030 con 0x55ea04ece6e0 2024-09-12T17:28:21.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.377+0000 7fb82dfdf640 1 --2- 172.21.15.170:0/3366040755 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb71403c730 0x7fb71403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:21.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.377+0000 7fb833014800 1 --2- 172.21.15.170:0/3366040755 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55ea04ed21f0 0x55ea04fcc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:21.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.377+0000 7fb833014800 1 -- 172.21.15.170:0/3366040755 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ea04fccb90 con 0x55ea04ed21f0 2024-09-12T17:28:21.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.377+0000 7fb82efe1640 1 --2- 172.21.15.170:0/3366040755 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55ea04ed21f0 0x55ea04fcc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:21.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.377+0000 7fb82dfdf640 1 --2- 172.21.15.170:0/3366040755 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb71403c730 0x7fb71403ebf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb824057000 tx=0x7fb824052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:21.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.377+0000 7fb82efe1640 1 --2- 172.21.15.170:0/3366040755 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55ea04ed21f0 0x55ea04fcc650 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:21.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.377+0000 7fb82efe1640 1 -- 172.21.15.170:0/3366040755 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb82800a4d0 con 0x55ea04ed21f0 2024-09-12T17:28:21.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.377+0000 7fb833014800 1 -- 172.21.15.170:0/3366040755 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ea04fccf30 con 0x55ea04ed21f0 2024-09-12T17:28:21.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.378+0000 7fb82efe1640 1 -- 172.21.15.170:0/3366040755 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb82800a4d0 con 0x55ea04ed21f0 2024-09-12T17:28:21.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.378+0000 7fb833014800 1 --2- 172.21.15.170:0/3366040755 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55ea04fce9f0 0x55ea04fd0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:21.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.378+0000 7fb833014800 1 -- 172.21.15.170:0/3366040755 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ea04fd1620 con 0x55ea04fce9f0 2024-09-12T17:28:21.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.378+0000 7fb82e7e0640 1 --2- 172.21.15.170:0/3366040755 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55ea04fce9f0 0x55ea04fd0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:21.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.378+0000 7fb82e7e0640 1 --2- 172.21.15.170:0/3366040755 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55ea04fce9f0 0x55ea04fd0e90 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:21.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.379+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3366040755 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea04fce9f0 2024-09-12T17:28:21.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.379+0000 7fb833014800 1 -- 172.21.15.170:0/3366040755 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ea04fcd780 con 0x55ea04ed21f0 2024-09-12T17:28:21.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.379+0000 7fb82efe1640 1 -- 172.21.15.170:0/3366040755 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb82800a4d0 con 0x55ea04ed21f0 2024-09-12T17:28:21.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.379+0000 7fb833014800 1 -- 172.21.15.170:0/3366040755 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ea04fcdb60 con 0x55ea04fce9f0 2024-09-12T17:28:21.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.472+0000 7fb71ae05640 1 -- 172.21.15.170:0/3366040755 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_map(31..31 src has 1..31) ==== 312+0+0 (crc 0 0 0) 0x7fb8200520a0 con 0x55ea04fce9f0 2024-09-12T17:28:21.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.473+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3366040755 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea04fce9f0 2024-09-12T17:28:21.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.473+0000 7fb833014800 1 Processor -- start 2024-09-12T17:28:21.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.473+0000 7fb833014800 1 -- start start 2024-09-12T17:28:21.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.474+0000 7fb833014800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea04ecdea0 0x55ea04ecc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:21.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.474+0000 7fb833014800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ea04dc4a00 con 0x55ea04ecdea0 2024-09-12T17:28:21.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.474+0000 7fb82efe1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea04ecdea0 0x55ea04ecc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:21.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.474+0000 7fb82efe1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea04ecdea0 0x55ea04ecc710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:55804/0 (socket says 172.21.15.170:55804) 2024-09-12T17:28:21.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.474+0000 7fb82efe1640 1 -- 172.21.15.170:0/4014308523 learned_addr learned my addr 172.21.15.170:0/4014308523 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:21.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.475+0000 7fb82efe1640 1 -- 172.21.15.170:0/4014308523 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea04ece3c0 con 0x55ea04ecdea0 2024-09-12T17:28:21.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.475+0000 7fb82efe1640 1 --2- 172.21.15.170:0/4014308523 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea04ecdea0 0x55ea04ecc710 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x55ea04fc5e90 tx=0x7fb8280167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:21.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.475+0000 7fb713fff640 1 -- 172.21.15.170:0/4014308523 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb828013640 con 0x55ea04ecdea0 2024-09-12T17:28:21.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.475+0000 7fb713fff640 1 -- 172.21.15.170:0/4014308523 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8280137e0 con 0x55ea04ecdea0 2024-09-12T17:28:21.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.475+0000 7fb833014800 1 -- 172.21.15.170:0/4014308523 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ea04eccc50 con 0x55ea04ecdea0 2024-09-12T17:28:21.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.475+0000 7fb713fff640 1 -- 172.21.15.170:0/4014308523 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb828013b00 con 0x55ea04ecdea0 2024-09-12T17:28:21.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.475+0000 7fb833014800 1 -- 172.21.15.170:0/4014308523 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea04ecd1f0 con 0x55ea04ecdea0 2024-09-12T17:28:21.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.477+0000 7fb713fff640 1 -- 172.21.15.170:0/4014308523 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb828011040 con 0x55ea04ecdea0 2024-09-12T17:28:21.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.477+0000 7fb713fff640 1 --2- 172.21.15.170:0/4014308523 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb70803c780 0x7fb70803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:21.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.477+0000 7fb713fff640 1 -- 172.21.15.170:0/4014308523 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fb82800e040 con 0x55ea04ecdea0 2024-09-12T17:28:21.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.477+0000 7fb833014800 1 Processor -- start 2024-09-12T17:28:21.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.477+0000 7fb82e7e0640 1 --2- 172.21.15.170:0/4014308523 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb70803c780 0x7fb70803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:21.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.478+0000 7fb833014800 1 -- start start 2024-09-12T17:28:21.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.478+0000 7fb833014800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea04feebe0 0x55ea04feefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:21.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.478+0000 7fb833014800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ea04fbded0 con 0x55ea04feebe0 2024-09-12T17:28:21.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.478+0000 7fb82e7e0640 1 --2- 172.21.15.170:0/4014308523 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb70803c780 0x7fb70803ec40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb82000c720 tx=0x7fb820043050 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:21.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.478+0000 7fb82efe1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea04feebe0 0x55ea04feefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:21.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.478+0000 7fb82efe1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea04feebe0 0x55ea04feefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:55810/0 (socket says 172.21.15.170:55810) 2024-09-12T17:28:21.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.478+0000 7fb82efe1640 1 -- 172.21.15.170:0/3387876915 learned_addr learned my addr 172.21.15.170:0/3387876915 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:21.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.478+0000 7fb82efe1640 1 -- 172.21.15.170:0/3387876915 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea04fef5d0 con 0x55ea04feebe0 2024-09-12T17:28:21.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.479+0000 7fb82efe1640 1 --2- 172.21.15.170:0/3387876915 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea04feebe0 0x55ea04feefe0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb828053e00 tx=0x7fb8280294d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e4150a8cb5ccef server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:21.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.479+0000 7fb711ffb640 1 -- 172.21.15.170:0/3387876915 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8280143c0 con 0x55ea04feebe0 2024-09-12T17:28:21.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.479+0000 7fb711ffb640 1 -- 172.21.15.170:0/3387876915 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb828051030 con 0x55ea04feebe0 2024-09-12T17:28:21.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.479+0000 7fb711ffb640 1 -- 172.21.15.170:0/3387876915 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb82801fb70 con 0x55ea04feebe0 2024-09-12T17:28:21.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.480+0000 7fb833014800 1 -- 172.21.15.170:0/3387876915 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea04feebe0 msgr2=0x55ea04feefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:21.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.480+0000 7fb833014800 1 --2- 172.21.15.170:0/3387876915 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea04feebe0 0x55ea04feefe0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb828053e00 tx=0x7fb8280294d0 comp rx=0 tx=0).stop 2024-09-12T17:28:21.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.480+0000 7fb833014800 1 -- 172.21.15.170:0/3387876915 shutdown_connections 2024-09-12T17:28:21.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.480+0000 7fb833014800 1 --2- 172.21.15.170:0/3387876915 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea04feebe0 0x55ea04feefe0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:21.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.480+0000 7fb833014800 1 -- 172.21.15.170:0/3387876915 >> 172.21.15.170:0/3387876915 conn(0x55ea04feafe0 msgr2=0x55ea04fe9220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:21.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.480+0000 7fb833014800 1 -- 172.21.15.170:0/3387876915 shutdown_connections 2024-09-12T17:28:21.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.480+0000 7fb833014800 1 -- 172.21.15.170:0/3387876915 wait complete. 2024-09-12T17:28:21.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.480+0000 7fb833014800 1 Processor -- start 2024-09-12T17:28:21.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.480+0000 7fb833014800 1 -- start start 2024-09-12T17:28:21.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.480+0000 7fb833014800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea04feebe0 0x55ea04ff61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:21.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.480+0000 7fb833014800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ea04fefbf0 con 0x55ea04feebe0 2024-09-12T17:28:21.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.480+0000 7fb82efe1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea04feebe0 0x55ea04ff61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:21.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.481+0000 7fb82efe1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea04feebe0 0x55ea04ff61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:55814/0 (socket says 172.21.15.170:55814) 2024-09-12T17:28:21.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.481+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 learned_addr learned my addr 172.21.15.170:0/3396482397 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:21.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.481+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea04ff6740 con 0x55ea04feebe0 2024-09-12T17:28:21.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.481+0000 7fb82efe1640 1 --2- 172.21.15.170:0/3396482397 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea04feebe0 0x55ea04ff61e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb828029510 tx=0x7fb828053d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:21.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.481+0000 7fb6fffff640 1 -- 172.21.15.170:0/3396482397 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb828038070 con 0x55ea04feebe0 2024-09-12T17:28:21.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.481+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ea04ff69d0 con 0x55ea04feebe0 2024-09-12T17:28:21.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.481+0000 7fb6fffff640 1 -- 172.21.15.170:0/3396482397 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb828029560 con 0x55ea04feebe0 2024-09-12T17:28:21.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.481+0000 7fb6fffff640 1 -- 172.21.15.170:0/3396482397 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb828029840 con 0x55ea04feebe0 2024-09-12T17:28:21.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.481+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea04ff7350 con 0x55ea04feebe0 2024-09-12T17:28:21.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.482+0000 7fb6fffff640 1 -- 172.21.15.170:0/3396482397 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb82803b070 con 0x55ea04feebe0 2024-09-12T17:28:21.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.482+0000 7fb6fffff640 1 --2- 172.21.15.170:0/3396482397 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb6f803c730 0x7fb6f803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:21.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.482+0000 7fb6fffff640 1 -- 172.21.15.170:0/3396482397 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fb82803ebf0 con 0x55ea04feebe0 2024-09-12T17:28:21.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.483+0000 7fb82e7e0640 1 --2- 172.21.15.170:0/3396482397 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb6f803c730 0x7fb6f803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:21.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.483+0000 7fb833014800 20 rados->read ofs=0 len=0 2024-09-12T17:28:21.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.483+0000 7fb833014800 1 --2- 172.21.15.170:0/3396482397 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55ea05001ae0 0x55ea05003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:21.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.483+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea050046f0 con 0x55ea05001ae0 2024-09-12T17:28:21.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.483+0000 7fb82dfdf640 1 --2- 172.21.15.170:0/3396482397 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55ea05001ae0 0x55ea05003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:21.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.483+0000 7fb82e7e0640 1 --2- 172.21.15.170:0/3396482397 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb6f803c730 0x7fb6f803ebf0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb82001a6a0 tx=0x7fb820049000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:21.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.483+0000 7fb82dfdf640 1 --2- 172.21.15.170:0/3396482397 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55ea05001ae0 0x55ea05003fa0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:21.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.484+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.484+0000 7fb833014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:21.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.484+0000 7fb833014800 20 realm 2024-09-12T17:28:21.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.484+0000 7fb833014800 20 rados->read ofs=0 len=0 2024-09-12T17:28:21.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.484+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea05004b00 con 0x55ea05001ae0 2024-09-12T17:28:21.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.484+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.484+0000 7fb833014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:21.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.484+0000 7fb833014800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:21.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.484+0000 7fb833014800 20 rados->read ofs=0 len=0 2024-09-12T17:28:21.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.484+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea050053d0 con 0x55ea05001ae0 2024-09-12T17:28:21.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.484+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.484+0000 7fb833014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:21.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.484+0000 7fb833014800 20 rados->read ofs=0 len=0 2024-09-12T17:28:21.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.484+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea05005770 con 0x55ea05001ae0 2024-09-12T17:28:21.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.484+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.484+0000 7fb833014800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:21.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.484+0000 7fb833014800 20 rados->read ofs=0 len=0 2024-09-12T17:28:21.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.484+0000 7fb833014800 1 --2- 172.21.15.170:0/3396482397 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55ea05006220 0x55ea05008610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:21.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.484+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea05008d70 con 0x55ea05006220 2024-09-12T17:28:21.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.485+0000 7fb82efe1640 1 --2- 172.21.15.170:0/3396482397 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55ea05006220 0x55ea05008610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:21.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.485+0000 7fb82efe1640 1 --2- 172.21.15.170:0/3396482397 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55ea05006220 0x55ea05008610 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:21.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.485+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb82803a030 con 0x55ea05006220 2024-09-12T17:28:21.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.485+0000 7fb833014800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:21.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.485+0000 7fb833014800 20 searching for the correct realm 2024-09-12T17:28:21.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.485+0000 7fb833014800 1 --2- 172.21.15.170:0/3396482397 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55ea0500ada0 0x55ea0500d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:21.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.485+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea0500d930 con 0x55ea0500ada0 2024-09-12T17:28:21.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.485+0000 7fb82e7e0640 1 --2- 172.21.15.170:0/3396482397 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55ea0500ada0 0x55ea0500d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:21.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.486+0000 7fb82e7e0640 1 --2- 172.21.15.170:0/3396482397 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55ea0500ada0 0x55ea0500d260 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:21.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.486+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.486+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea0500d930 con 0x55ea05006220 2024-09-12T17:28:21.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.486+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb82803a030 con 0x55ea05006220 2024-09-12T17:28:21.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.486+0000 7fb82efe1640 1 --2- 172.21.15.170:0/3396482397 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fb82803d060 0x7fb828055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:21.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.486+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea0500d930 con 0x7fb82803d060 2024-09-12T17:28:21.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.486+0000 7fb82dfdf640 1 --2- 172.21.15.170:0/3396482397 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fb82803d060 0x7fb828055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:21.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.487+0000 7fb82dfdf640 1 --2- 172.21.15.170:0/3396482397 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fb82803d060 0x7fb828055a50 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:21.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.487+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.487+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea0500d930 con 0x55ea05001ae0 2024-09-12T17:28:21.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.487+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.487+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea0500d930 con 0x55ea05001ae0 2024-09-12T17:28:21.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.488+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.488+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea0500d930 con 0x7fb82803d060 2024-09-12T17:28:21.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.488+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.488+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea0500d930 con 0x7fb82803d060 2024-09-12T17:28:21.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.488+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.488+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea0500d930 con 0x55ea05006220 2024-09-12T17:28:21.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.488+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb82803a030 con 0x55ea05006220 2024-09-12T17:28:21.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.488+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea0500d930 con 0x55ea0500ada0 2024-09-12T17:28:21.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.489+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.489+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea0500d930 con 0x55ea05001ae0 2024-09-12T17:28:21.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.489+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.489+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea0500d930 con 0x7fb82803d060 2024-09-12T17:28:21.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.489+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.489+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea0500d930 con 0x55ea05001ae0 2024-09-12T17:28:21.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.489+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.489+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea0500d930 con 0x55ea05006220 2024-09-12T17:28:21.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.490+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fb82803a030 con 0x55ea05006220 2024-09-12T17:28:21.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.490+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea0500d930 con 0x55ea0500ada0 2024-09-12T17:28:21.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.490+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.490+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea0500d930 con 0x55ea0500ada0 2024-09-12T17:28:21.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.490+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.490+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea0500d930 con 0x55ea05006220 2024-09-12T17:28:21.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.490+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb82803a030 con 0x55ea05006220 2024-09-12T17:28:21.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.490+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea0500d930 con 0x55ea0500ada0 2024-09-12T17:28:21.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.490+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.491+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea0500d930 con 0x55ea0500ada0 2024-09-12T17:28:21.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.491+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.491+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea0500d930 con 0x55ea05001ae0 2024-09-12T17:28:21.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.491+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.491+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea0500d930 con 0x55ea05001ae0 2024-09-12T17:28:21.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.491+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.491+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea0500d930 con 0x7fb82803d060 2024-09-12T17:28:21.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.491+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.492+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea0500d930 con 0x55ea0500ada0 2024-09-12T17:28:21.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.492+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.492+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea0500d930 con 0x55ea05006220 2024-09-12T17:28:21.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.492+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb82803a030 con 0x55ea05006220 2024-09-12T17:28:21.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.492+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea0500d930 con 0x55ea05001ae0 2024-09-12T17:28:21.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.492+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.492+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea0500d930 con 0x7fb82803d060 2024-09-12T17:28:21.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.493+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.493+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea0500d930 con 0x55ea0500ada0 2024-09-12T17:28:21.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.493+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.493+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea0500d930 con 0x7fb82803d060 2024-09-12T17:28:21.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.493+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.493+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea0500d930 con 0x55ea05006220 2024-09-12T17:28:21.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.493+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb82803a030 con 0x55ea05006220 2024-09-12T17:28:21.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.493+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea0500d930 con 0x55ea0500ada0 2024-09-12T17:28:21.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.494+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.494+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea0500d930 con 0x7fb82803d060 2024-09-12T17:28:21.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.494+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.494+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea0500d930 con 0x55ea05001ae0 2024-09-12T17:28:21.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.494+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.494+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea0500d930 con 0x55ea05006220 2024-09-12T17:28:21.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.494+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(37 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb82803a030 con 0x55ea05006220 2024-09-12T17:28:21.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.495+0000 7fb833014800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:21.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.495+0000 7fb833014800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:21.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.495+0000 7fb833014800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:21.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.495+0000 7fb833014800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:21.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.495+0000 7fb833014800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:21.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.495+0000 7fb833014800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:21.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.495+0000 7fb833014800 20 rados->read ofs=0 len=0 2024-09-12T17:28:21.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.495+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea050097c0 con 0x55ea05001ae0 2024-09-12T17:28:21.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.495+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.495+0000 7fb833014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:21.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.495+0000 7fb833014800 20 rados->read ofs=0 len=0 2024-09-12T17:28:21.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.495+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea05009c10 con 0x55ea05001ae0 2024-09-12T17:28:21.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.495+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.495+0000 7fb833014800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:21.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.495+0000 7fb833014800 20 rados->read ofs=0 len=0 2024-09-12T17:28:21.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.495+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0500a0b0 con 0x55ea05006220 2024-09-12T17:28:21.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.495+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb82803a030 con 0x55ea05006220 2024-09-12T17:28:21.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.495+0000 7fb833014800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:21.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.495+0000 7fb833014800 20 zone default found 2024-09-12T17:28:21.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.495+0000 7fb833014800 4 Realm: () 2024-09-12T17:28:21.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.495+0000 7fb833014800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:21.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.495+0000 7fb833014800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:21.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.495+0000 7fb833014800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:21.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.495+0000 7fb833014800 20 zonegroup default 2024-09-12T17:28:21.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.495+0000 7fb833014800 20 rados->read ofs=0 len=0 2024-09-12T17:28:21.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.495+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea05009390 con 0x7fb82803d060 2024-09-12T17:28:21.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.496+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.496+0000 7fb833014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:21.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.496+0000 7fb833014800 20 rados->read ofs=0 len=0 2024-09-12T17:28:21.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.496+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea05010150 con 0x55ea0500ada0 2024-09-12T17:28:21.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.496+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.496+0000 7fb833014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:21.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.496+0000 7fb833014800 20 rados->read ofs=0 len=0 2024-09-12T17:28:21.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.496+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea05010520 con 0x55ea0500ada0 2024-09-12T17:28:21.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.496+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.496+0000 7fb833014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:21.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.496+0000 7fb833014800 20 started sync module instance, tier type = 2024-09-12T17:28:21.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.496+0000 7fb833014800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:21.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.496+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea0500f5e0 con 0x55ea05006220 2024-09-12T17:28:21.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.497+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(44 notify.0 [create] v31'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb82803a030 con 0x55ea05006220 2024-09-12T17:28:21.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.497+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94463594658256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea0500f240 con 0x55ea05006220 2024-09-12T17:28:21.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.497+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05011430 con 0x55ea05001ae0 2024-09-12T17:28:21.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.498+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94463594658256] v31'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb82803a030 con 0x55ea05006220 2024-09-12T17:28:21.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.499+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v31'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.499+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94463594662240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05011430 con 0x55ea05001ae0 2024-09-12T17:28:21.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.499+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05011ec0 con 0x55ea0500ada0 2024-09-12T17:28:21.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.500+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94463594662240] v31'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.500+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v31'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.500+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94463594663808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea050113a0 con 0x55ea0500ada0 2024-09-12T17:28:21.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.500+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05012db0 con 0x55ea05006220 2024-09-12T17:28:21.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.501+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(50 notify.3 [create] v31'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb82803a030 con 0x55ea05006220 2024-09-12T17:28:21.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.501+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94463594670848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05013650 con 0x55ea05006220 2024-09-12T17:28:21.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.501+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05014140 con 0x55ea05001ae0 2024-09-12T17:28:21.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.501+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94463594663808] v31'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.502+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94463594670848] v31'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb82803a030 con 0x55ea05006220 2024-09-12T17:28:21.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.502+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v31'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.502+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94463594675216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea050131a0 con 0x55ea05001ae0 2024-09-12T17:28:21.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.502+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea050149e0 con 0x7fb82803d060 2024-09-12T17:28:21.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.503+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94463594675216] v31'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.503+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(54 notify.5 [create] v31'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.504+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94463594668768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea050131a0 con 0x7fb82803d060 2024-09-12T17:28:21.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.504+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05015010 con 0x7fb82803d060 2024-09-12T17:28:21.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.505+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94463594668768] v31'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.505+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v31'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.505+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94463594679040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05014fd0 con 0x7fb82803d060 2024-09-12T17:28:21.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.505+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05015a20 con 0x7fb82803d060 2024-09-12T17:28:21.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.506+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(58 notify.7 [create] v31'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.506+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94463594679040] v31'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.506+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94463594681712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05015e40 con 0x7fb82803d060 2024-09-12T17:28:21.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.506+0000 7fb833014800 20 add_watcher() i=0 2024-09-12T17:28:21.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.506+0000 7fb833014800 20 add_watcher() i=1 2024-09-12T17:28:21.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.506+0000 7fb833014800 20 add_watcher() i=2 2024-09-12T17:28:21.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.506+0000 7fb833014800 20 add_watcher() i=3 2024-09-12T17:28:21.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.506+0000 7fb833014800 20 add_watcher() i=4 2024-09-12T17:28:21.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.506+0000 7fb833014800 20 add_watcher() i=5 2024-09-12T17:28:21.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.506+0000 7fb833014800 20 add_watcher() i=6 2024-09-12T17:28:21.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.507+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94463594681712] v31'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.507+0000 7fb833014800 20 add_watcher() i=7 2024-09-12T17:28:21.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.507+0000 7fb833014800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:21.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.507+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea05015e40 con 0x55ea05001ae0 2024-09-12T17:28:21.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.507+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.507+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94463594682768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05015df0 con 0x55ea05001ae0 2024-09-12T17:28:21.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.508+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94463594682768] v31'152 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.508+0000 7fb6e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:21.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.508+0000 7fb833014800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:21.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.508+0000 7fb833014800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:21.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.508+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea0501b2c0 con 0x55ea05001ae0 2024-09-12T17:28:21.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.509+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.509+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05021940 con 0x7fb82803d060 2024-09-12T17:28:21.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.510+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.510+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05021df0 con 0x55ea0500ada0 2024-09-12T17:28:21.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.512+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.512+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05020de0 con 0x55ea05001ae0 2024-09-12T17:28:21.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.512+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'153 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.512+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05020de0 con 0x55ea05006220 2024-09-12T17:28:21.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.513+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'44 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb82803a030 con 0x55ea05006220 2024-09-12T17:28:21.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.513+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05020f10 con 0x55ea0500ada0 2024-09-12T17:28:21.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.514+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'29 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.514+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05021040 con 0x55ea05001ae0 2024-09-12T17:28:21.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.516+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.516+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05022950 con 0x7fb82803d060 2024-09-12T17:28:21.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.517+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'29 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.517+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05022950 con 0x55ea05006220 2024-09-12T17:28:21.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.518+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb82803a030 con 0x55ea05006220 2024-09-12T17:28:21.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.518+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05022950 con 0x55ea0500ada0 2024-09-12T17:28:21.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.519+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.519+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05022950 con 0x55ea05006220 2024-09-12T17:28:21.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.520+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'45 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb82803a030 con 0x55ea05006220 2024-09-12T17:28:21.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.520+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05022950 con 0x7fb82803d060 2024-09-12T17:28:21.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.521+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.521+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea050229e0 con 0x55ea05006220 2024-09-12T17:28:21.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.522+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb82803a030 con 0x55ea05006220 2024-09-12T17:28:21.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.522+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea050229e0 con 0x7fb82803d060 2024-09-12T17:28:21.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.523+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'35 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.523+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea050229e0 con 0x55ea05001ae0 2024-09-12T17:28:21.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.524+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'154 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.524+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05022a30 con 0x55ea0500ada0 2024-09-12T17:28:21.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.525+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'38 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.525+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05022c00 con 0x55ea05006220 2024-09-12T17:28:21.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.526+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 <== osd.2 v2:172.21.15.170:6808/3855567754 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'46 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb82803a030 con 0x55ea05006220 2024-09-12T17:28:21.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.526+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05022c00 con 0x55ea0500ada0 2024-09-12T17:28:21.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.527+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.527+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05022c00 con 0x55ea05001ae0 2024-09-12T17:28:21.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.528+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'27 uv26 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.528+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05022c00 con 0x55ea05001ae0 2024-09-12T17:28:21.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.529+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'155 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.529+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05022c00 con 0x55ea0500ada0 2024-09-12T17:28:21.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.530+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'39 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.531+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05022c00 con 0x55ea05006220 2024-09-12T17:28:21.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.531+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 <== osd.2 v2:172.21.15.170:6808/3855567754 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'29 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb82803a030 con 0x55ea05006220 2024-09-12T17:28:21.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.531+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05022c00 con 0x55ea0500ada0 2024-09-12T17:28:21.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.532+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.532+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05022c40 con 0x55ea0500ada0 2024-09-12T17:28:21.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.533+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.533+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05022c60 con 0x55ea0500ada0 2024-09-12T17:28:21.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.534+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.534+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05022c60 con 0x55ea0500ada0 2024-09-12T17:28:21.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.535+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.535+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05022c60 con 0x7fb82803d060 2024-09-12T17:28:21.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.536+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.536+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05022ca0 con 0x55ea0500ada0 2024-09-12T17:28:21.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.537+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.537+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05022cd0 con 0x7fb82803d060 2024-09-12T17:28:21.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.538+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.538+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05022cd0 con 0x55ea0500ada0 2024-09-12T17:28:21.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.539+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'40 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.539+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05022ca0 con 0x7fb82803d060 2024-09-12T17:28:21.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.540+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'36 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.540+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05022ce0 con 0x55ea05006220 2024-09-12T17:28:21.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.542+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 <== osd.2 v2:172.21.15.170:6808/3855567754 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb82803a030 con 0x55ea05006220 2024-09-12T17:28:21.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.542+0000 7fb65f7fe640 20 reqs_thread_entry: start 2024-09-12T17:28:21.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.542+0000 7fb833014800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:21.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.542+0000 7fb833014800 20 Filter name: none 2024-09-12T17:28:21.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.542+0000 7fb65d7fa640 20 reqs_thread_entry: start 2024-09-12T17:28:21.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.542+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504e7a0 con 0x55ea05001ae0 2024-09-12T17:28:21.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.542+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.543+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504d790 con 0x55ea05001ae0 2024-09-12T17:28:21.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.543+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.543+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504e7a0 con 0x55ea05001ae0 2024-09-12T17:28:21.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.543+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.543+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504e7a0 con 0x7fb82803d060 2024-09-12T17:28:21.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.544+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 23 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.544+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504d790 con 0x7fb82803d060 2024-09-12T17:28:21.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.544+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 24 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv7 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.544+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504e7a0 con 0x7fb82803d060 2024-09-12T17:28:21.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.544+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 25 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.544+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504e7a0 con 0x55ea0500ada0 2024-09-12T17:28:21.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.545+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.545+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504d790 con 0x55ea0500ada0 2024-09-12T17:28:21.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.545+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.545+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504e7a0 con 0x55ea0500ada0 2024-09-12T17:28:21.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.545+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.545+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504e7a0 con 0x55ea05001ae0 2024-09-12T17:28:21.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.546+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 30 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv13 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.546+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504d790 con 0x55ea05001ae0 2024-09-12T17:28:21.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.546+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 31 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv13 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.546+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504e7a0 con 0x55ea05001ae0 2024-09-12T17:28:21.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.546+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 32 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv13 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.546+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504e7a0 con 0x55ea05006220 2024-09-12T17:28:21.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.547+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 <== osd.2 v2:172.21.15.170:6808/3855567754 21 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv11 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb82803a030 con 0x55ea05006220 2024-09-12T17:28:21.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.547+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504d790 con 0x55ea05006220 2024-09-12T17:28:21.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.547+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 <== osd.2 v2:172.21.15.170:6808/3855567754 22 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv11 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb82803a030 con 0x55ea05006220 2024-09-12T17:28:21.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.547+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504e7a0 con 0x55ea05006220 2024-09-12T17:28:21.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.547+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 <== osd.2 v2:172.21.15.170:6808/3855567754 23 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv11 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb82803a030 con 0x55ea05006220 2024-09-12T17:28:21.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.547+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504e7a0 con 0x55ea0500ada0 2024-09-12T17:28:21.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.547+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv10 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.547+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504d790 con 0x55ea0500ada0 2024-09-12T17:28:21.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.548+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv10 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.548+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504e7a0 con 0x55ea0500ada0 2024-09-12T17:28:21.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.548+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv10 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.548+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504e7a0 con 0x55ea05001ae0 2024-09-12T17:28:21.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.548+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 33 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.548+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504d790 con 0x55ea05001ae0 2024-09-12T17:28:21.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.548+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 34 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.548+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504e7a0 con 0x55ea05001ae0 2024-09-12T17:28:21.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.549+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 35 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.549+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504e7a0 con 0x7fb82803d060 2024-09-12T17:28:21.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.549+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 26 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv8 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.549+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504d790 con 0x7fb82803d060 2024-09-12T17:28:21.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.550+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 27 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv8 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.550+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504e7a0 con 0x7fb82803d060 2024-09-12T17:28:21.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.550+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 28 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv8 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.550+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504e7a0 con 0x55ea05006220 2024-09-12T17:28:21.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.550+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 <== osd.2 v2:172.21.15.170:6808/3855567754 24 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb82803a030 con 0x55ea05006220 2024-09-12T17:28:21.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.550+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504d790 con 0x55ea05006220 2024-09-12T17:28:21.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.550+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 <== osd.2 v2:172.21.15.170:6808/3855567754 25 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb82803a030 con 0x55ea05006220 2024-09-12T17:28:21.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.550+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504e7a0 con 0x55ea05006220 2024-09-12T17:28:21.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.551+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 <== osd.2 v2:172.21.15.170:6808/3855567754 26 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb82803a030 con 0x55ea05006220 2024-09-12T17:28:21.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.551+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504e7a0 con 0x55ea0500ada0 2024-09-12T17:28:21.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.551+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.551+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504d790 con 0x55ea0500ada0 2024-09-12T17:28:21.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.551+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.551+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504e7a0 con 0x55ea0500ada0 2024-09-12T17:28:21.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.552+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.552+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504e7a0 con 0x55ea05006220 2024-09-12T17:28:21.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.552+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 <== osd.2 v2:172.21.15.170:6808/3855567754 27 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb82803a030 con 0x55ea05006220 2024-09-12T17:28:21.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.552+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504d790 con 0x55ea05006220 2024-09-12T17:28:21.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.552+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 <== osd.2 v2:172.21.15.170:6808/3855567754 28 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb82803a030 con 0x55ea05006220 2024-09-12T17:28:21.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.552+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504e7a0 con 0x55ea05006220 2024-09-12T17:28:21.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.552+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 <== osd.2 v2:172.21.15.170:6808/3855567754 29 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb82803a030 con 0x55ea05006220 2024-09-12T17:28:21.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.552+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504e7a0 con 0x7fb82803d060 2024-09-12T17:28:21.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.553+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 29 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.553+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504d790 con 0x7fb82803d060 2024-09-12T17:28:21.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.553+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 30 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.553+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504e7a0 con 0x7fb82803d060 2024-09-12T17:28:21.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.553+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 31 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.553+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504e7a0 con 0x55ea05006220 2024-09-12T17:28:21.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.554+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 <== osd.2 v2:172.21.15.170:6808/3855567754 30 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb82803a030 con 0x55ea05006220 2024-09-12T17:28:21.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.554+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504d790 con 0x55ea05006220 2024-09-12T17:28:21.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.554+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 <== osd.2 v2:172.21.15.170:6808/3855567754 31 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb82803a030 con 0x55ea05006220 2024-09-12T17:28:21.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.554+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504e7a0 con 0x55ea05006220 2024-09-12T17:28:21.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.554+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 <== osd.2 v2:172.21.15.170:6808/3855567754 32 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb82803a030 con 0x55ea05006220 2024-09-12T17:28:21.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.554+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504e7a0 con 0x7fb82803d060 2024-09-12T17:28:21.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.555+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 32 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.555+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504d790 con 0x7fb82803d060 2024-09-12T17:28:21.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.555+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 33 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv12 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.555+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504e7a0 con 0x7fb82803d060 2024-09-12T17:28:21.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.555+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 34 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.555+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504e7a0 con 0x55ea05001ae0 2024-09-12T17:28:21.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.555+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 36 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.555+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504d790 con 0x55ea05001ae0 2024-09-12T17:28:21.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.556+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 37 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv15 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.556+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504e7a0 con 0x55ea05001ae0 2024-09-12T17:28:21.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.556+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 38 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.556+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504e7a0 con 0x55ea0500ada0 2024-09-12T17:28:21.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.556+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.556+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504d790 con 0x55ea0500ada0 2024-09-12T17:28:21.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.557+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.557+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504e7a0 con 0x55ea0500ada0 2024-09-12T17:28:21.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.557+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.557+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504e7a0 con 0x55ea05006220 2024-09-12T17:28:21.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.557+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 <== osd.2 v2:172.21.15.170:6808/3855567754 33 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb82803a030 con 0x55ea05006220 2024-09-12T17:28:21.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.557+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504d790 con 0x55ea05006220 2024-09-12T17:28:21.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.557+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 <== osd.2 v2:172.21.15.170:6808/3855567754 34 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb82803a030 con 0x55ea05006220 2024-09-12T17:28:21.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.557+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504e7a0 con 0x55ea05006220 2024-09-12T17:28:21.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.558+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 <== osd.2 v2:172.21.15.170:6808/3855567754 35 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb82803a030 con 0x55ea05006220 2024-09-12T17:28:21.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.558+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504e7a0 con 0x55ea0500ada0 2024-09-12T17:28:21.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.558+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.558+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504d790 con 0x55ea0500ada0 2024-09-12T17:28:21.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.558+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.558+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504e7a0 con 0x55ea0500ada0 2024-09-12T17:28:21.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.559+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.559+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504e7a0 con 0x55ea05001ae0 2024-09-12T17:28:21.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.559+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 39 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.559+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504d790 con 0x55ea05001ae0 2024-09-12T17:28:21.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.559+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 40 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.559+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504e7a0 con 0x55ea05001ae0 2024-09-12T17:28:21.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.559+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 41 ==== osd_op_reply(150 gc.18 [call out=1701b] v0'0 uv26 ondisk = 0) ==== 149+0+1701 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.560+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504edb0 con 0x55ea05001ae0 2024-09-12T17:28:21.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.560+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 42 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.560+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504dda0 con 0x55ea05001ae0 2024-09-12T17:28:21.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.560+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 43 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.560+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504edb0 con 0x55ea05001ae0 2024-09-12T17:28:21.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.560+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 44 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.560+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504edb0 con 0x55ea0500ada0 2024-09-12T17:28:21.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.561+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.561+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504dda0 con 0x55ea0500ada0 2024-09-12T17:28:21.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.561+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.561+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504edb0 con 0x55ea0500ada0 2024-09-12T17:28:21.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.561+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.561+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504edb0 con 0x55ea05006220 2024-09-12T17:28:21.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.561+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 <== osd.2 v2:172.21.15.170:6808/3855567754 36 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb82803a030 con 0x55ea05006220 2024-09-12T17:28:21.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.561+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504dda0 con 0x55ea05006220 2024-09-12T17:28:21.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.561+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 <== osd.2 v2:172.21.15.170:6808/3855567754 37 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb82803a030 con 0x55ea05006220 2024-09-12T17:28:21.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.561+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504edb0 con 0x55ea05006220 2024-09-12T17:28:21.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.562+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 <== osd.2 v2:172.21.15.170:6808/3855567754 38 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb82803a030 con 0x55ea05006220 2024-09-12T17:28:21.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.562+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504edb0 con 0x55ea0500ada0 2024-09-12T17:28:21.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.562+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.562+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504dda0 con 0x55ea0500ada0 2024-09-12T17:28:21.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.562+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.562+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504edb0 con 0x55ea0500ada0 2024-09-12T17:28:21.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.563+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.563+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504edb0 con 0x55ea0500ada0 2024-09-12T17:28:21.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.563+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.563+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504dda0 con 0x55ea0500ada0 2024-09-12T17:28:21.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.563+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.563+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504edb0 con 0x55ea0500ada0 2024-09-12T17:28:21.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.563+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.563+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504edb0 con 0x55ea0500ada0 2024-09-12T17:28:21.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.563+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.563+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504dda0 con 0x55ea0500ada0 2024-09-12T17:28:21.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.564+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.564+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504edb0 con 0x55ea0500ada0 2024-09-12T17:28:21.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.564+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.564+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504edb0 con 0x55ea0500ada0 2024-09-12T17:28:21.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.564+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.564+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504dda0 con 0x55ea0500ada0 2024-09-12T17:28:21.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.564+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.564+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504edb0 con 0x55ea0500ada0 2024-09-12T17:28:21.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.565+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.565+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504edb0 con 0x7fb82803d060 2024-09-12T17:28:21.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.565+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 35 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.565+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504dda0 con 0x7fb82803d060 2024-09-12T17:28:21.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.565+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 36 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.565+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504edb0 con 0x7fb82803d060 2024-09-12T17:28:21.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.566+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 37 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.566+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504edb0 con 0x55ea0500ada0 2024-09-12T17:28:21.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.566+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.566+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504dda0 con 0x55ea0500ada0 2024-09-12T17:28:21.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.566+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.566+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504edb0 con 0x55ea0500ada0 2024-09-12T17:28:21.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.566+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.566+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504edb0 con 0x7fb82803d060 2024-09-12T17:28:21.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.567+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 38 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.567+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504dda0 con 0x7fb82803d060 2024-09-12T17:28:21.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.567+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 39 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.567+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504edb0 con 0x7fb82803d060 2024-09-12T17:28:21.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.567+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 40 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.567+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504edb0 con 0x55ea0500ada0 2024-09-12T17:28:21.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.568+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.568+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504dda0 con 0x55ea0500ada0 2024-09-12T17:28:21.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.568+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.568+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504edb0 con 0x55ea0500ada0 2024-09-12T17:28:21.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.568+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.568+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504edb0 con 0x7fb82803d060 2024-09-12T17:28:21.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.569+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 41 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.569+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504dda0 con 0x7fb82803d060 2024-09-12T17:28:21.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.569+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 42 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv6 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.569+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504edb0 con 0x7fb82803d060 2024-09-12T17:28:21.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.569+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 43 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.569+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504edb0 con 0x55ea05006220 2024-09-12T17:28:21.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.570+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 <== osd.2 v2:172.21.15.170:6808/3855567754 39 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb82803a030 con 0x55ea05006220 2024-09-12T17:28:21.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.570+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504dda0 con 0x55ea05006220 2024-09-12T17:28:21.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.570+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 <== osd.2 v2:172.21.15.170:6808/3855567754 40 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb82803a030 con 0x55ea05006220 2024-09-12T17:28:21.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.570+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea0504edb0 con 0x55ea05006220 2024-09-12T17:28:21.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.570+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 <== osd.2 v2:172.21.15.170:6808/3855567754 41 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb82803a030 con 0x55ea05006220 2024-09-12T17:28:21.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.571+0000 7fb6e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:21.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.571+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94463594682768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea0501ff90 con 0x55ea05001ae0 2024-09-12T17:28:21.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.572+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 45 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94463594682768] v31'156 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.572+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94463594658256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05015990 con 0x55ea05006220 2024-09-12T17:28:21.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.573+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 <== osd.2 v2:172.21.15.170:6808/3855567754 42 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94463594658256] v31'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb82803a030 con 0x55ea05006220 2024-09-12T17:28:21.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.573+0000 7fb833014800 20 remove_watcher() i=0 2024-09-12T17:28:21.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.573+0000 7fb833014800 2 removed watcher, disabling cache 2024-09-12T17:28:21.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.573+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94463594662240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05015990 con 0x55ea05001ae0 2024-09-12T17:28:21.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.574+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 46 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94463594662240] v31'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.574+0000 7fb833014800 20 remove_watcher() i=1 2024-09-12T17:28:21.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.574+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94463594663808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05010960 con 0x55ea0500ada0 2024-09-12T17:28:21.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.575+0000 7fb82e7e0640 1 -- 172.21.15.170:0/3396482397 <== osd.3 v2:172.21.15.170:6816/2664906588 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94463594663808] v31'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb82001ab20 con 0x55ea0500ada0 2024-09-12T17:28:21.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.575+0000 7fb833014800 20 remove_watcher() i=2 2024-09-12T17:28:21.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.575+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94463594670848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05015990 con 0x55ea05006220 2024-09-12T17:28:21.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.576+0000 7fb82efe1640 1 -- 172.21.15.170:0/3396482397 <== osd.2 v2:172.21.15.170:6808/3855567754 43 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94463594670848] v31'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb82803a030 con 0x55ea05006220 2024-09-12T17:28:21.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.576+0000 7fb833014800 20 remove_watcher() i=3 2024-09-12T17:28:21.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.576+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94463594675216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05010f80 con 0x55ea05001ae0 2024-09-12T17:28:21.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.577+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.1 v2:172.21.15.170:6800/1903654092 47 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94463594675216] v31'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb824051070 con 0x55ea05001ae0 2024-09-12T17:28:21.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.577+0000 7fb833014800 20 remove_watcher() i=4 2024-09-12T17:28:21.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.577+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94463594668768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05010960 con 0x7fb82803d060 2024-09-12T17:28:21.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.578+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 44 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94463594668768] v31'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.578+0000 7fb833014800 20 remove_watcher() i=5 2024-09-12T17:28:21.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.578+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94463594679040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05015990 con 0x7fb82803d060 2024-09-12T17:28:21.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.579+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 45 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94463594679040] v31'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.579+0000 7fb833014800 20 remove_watcher() i=6 2024-09-12T17:28:21.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.579+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94463594681712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea05010f80 con 0x7fb82803d060 2024-09-12T17:28:21.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.580+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 <== osd.0 v2:172.21.15.47:6800/3978157098 46 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94463594681712] v31'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb824051070 con 0x7fb82803d060 2024-09-12T17:28:21.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.580+0000 7fb833014800 20 remove_watcher() i=7 2024-09-12T17:28:21.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.580+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fb82803d060 msgr2=0x7fb828055a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:21.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.580+0000 7fb833014800 1 --2- 172.21.15.170:0/3396482397 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fb82803d060 0x7fb828055a50 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:21.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.580+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55ea05001ae0 msgr2=0x55ea05003fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:21.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.580+0000 7fb833014800 1 --2- 172.21.15.170:0/3396482397 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55ea05001ae0 0x55ea05003fa0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:21.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.580+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55ea05006220 msgr2=0x55ea05008610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:21.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.580+0000 7fb833014800 1 --2- 172.21.15.170:0/3396482397 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55ea05006220 0x55ea05008610 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:21.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.580+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55ea0500ada0 msgr2=0x55ea0500d260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:21.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.580+0000 7fb833014800 1 --2- 172.21.15.170:0/3396482397 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55ea0500ada0 0x55ea0500d260 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:21.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.581+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb6f803c730 msgr2=0x7fb6f803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:21.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.581+0000 7fb833014800 1 --2- 172.21.15.170:0/3396482397 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb6f803c730 0x7fb6f803ebf0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb82001a6a0 tx=0x7fb820049000 comp rx=0 tx=0).stop 2024-09-12T17:28:21.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.581+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea04feebe0 msgr2=0x55ea04ff61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:21.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.581+0000 7fb833014800 1 --2- 172.21.15.170:0/3396482397 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea04feebe0 0x55ea04ff61e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb828029510 tx=0x7fb828053d60 comp rx=0 tx=0).stop 2024-09-12T17:28:21.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.581+0000 7fb82dfdf640 1 -- 172.21.15.170:0/3396482397 reap_dead start 2024-09-12T17:28:21.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.581+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 shutdown_connections 2024-09-12T17:28:21.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.581+0000 7fb833014800 1 --2- 172.21.15.170:0/3396482397 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea04feebe0 0x55ea04ff61e0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:21.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.581+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 >> 172.21.15.170:0/3396482397 conn(0x55ea04feafe0 msgr2=0x55ea04fe91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:21.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.581+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 shutdown_connections 2024-09-12T17:28:21.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.581+0000 7fb833014800 1 -- 172.21.15.170:0/3396482397 wait complete. 2024-09-12T17:28:21.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.581+0000 7fb833014800 1 -- 172.21.15.170:0/4014308523 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb70803c780 msgr2=0x7fb70803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:21.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.581+0000 7fb833014800 1 --2- 172.21.15.170:0/4014308523 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb70803c780 0x7fb70803ec40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb82000c720 tx=0x7fb820043050 comp rx=0 tx=0).stop 2024-09-12T17:28:21.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.581+0000 7fb833014800 1 -- 172.21.15.170:0/4014308523 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea04ecdea0 msgr2=0x55ea04ecc710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:21.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.581+0000 7fb833014800 1 --2- 172.21.15.170:0/4014308523 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea04ecdea0 0x55ea04ecc710 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x55ea04fc5e90 tx=0x7fb8280167b0 comp rx=0 tx=0).stop 2024-09-12T17:28:21.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.581+0000 7fb833014800 1 -- 172.21.15.170:0/4014308523 shutdown_connections 2024-09-12T17:28:21.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.581+0000 7fb833014800 1 --2- 172.21.15.170:0/4014308523 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb70803c780 0x7fb70803ec40 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:21.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.581+0000 7fb833014800 1 --2- 172.21.15.170:0/4014308523 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea04ecdea0 0x55ea04ecc710 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:21.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.581+0000 7fb833014800 1 -- 172.21.15.170:0/4014308523 >> 172.21.15.170:0/4014308523 conn(0x55ea04fd4300 msgr2=0x55ea04fd46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:21.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.581+0000 7fb833014800 1 -- 172.21.15.170:0/4014308523 shutdown_connections 2024-09-12T17:28:21.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.581+0000 7fb833014800 1 -- 172.21.15.170:0/4014308523 wait complete. 2024-09-12T17:28:21.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.581+0000 7fb833014800 1 -- 172.21.15.170:0/3366040755 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55ea04ed21f0 msgr2=0x55ea04fcc650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:21.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.581+0000 7fb833014800 1 --2- 172.21.15.170:0/3366040755 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55ea04ed21f0 0x55ea04fcc650 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:21.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.581+0000 7fb833014800 1 -- 172.21.15.170:0/3366040755 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55ea04fce9f0 msgr2=0x55ea04fd0e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:21.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.581+0000 7fb833014800 1 --2- 172.21.15.170:0/3366040755 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55ea04fce9f0 0x55ea04fd0e90 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:21.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.582+0000 7fb833014800 1 -- 172.21.15.170:0/3366040755 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb71403c730 msgr2=0x7fb71403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:21.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.582+0000 7fb833014800 1 --2- 172.21.15.170:0/3366040755 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb71403c730 0x7fb71403ebf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb824057000 tx=0x7fb824052000 comp rx=0 tx=0).stop 2024-09-12T17:28:21.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.582+0000 7fb833014800 1 -- 172.21.15.170:0/3366040755 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea04ece6e0 msgr2=0x55ea04fc5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:21.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.582+0000 7fb833014800 1 --2- 172.21.15.170:0/3366040755 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea04ece6e0 0x55ea04fc5000 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fb82000c010 tx=0x7fb820000ed0 comp rx=0 tx=0).stop 2024-09-12T17:28:21.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.582+0000 7fb833014800 1 -- 172.21.15.170:0/3366040755 shutdown_connections 2024-09-12T17:28:21.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.582+0000 7fb833014800 1 --2- 172.21.15.170:0/3366040755 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55ea04fce9f0 0x55ea04fd0e90 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:21.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.582+0000 7fb833014800 1 --2- 172.21.15.170:0/3366040755 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb71403c730 0x7fb71403ebf0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:21.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.582+0000 7fb833014800 1 --2- 172.21.15.170:0/3366040755 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55ea04ed21f0 0x55ea04fcc650 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:21.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.582+0000 7fb833014800 1 --2- 172.21.15.170:0/3366040755 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea04ece6e0 0x55ea04fc5000 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:21.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.582+0000 7fb833014800 1 -- 172.21.15.170:0/3366040755 >> 172.21.15.170:0/3366040755 conn(0x55ea04ec81c0 msgr2=0x55ea04fbe960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:21.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.582+0000 7fb833014800 1 -- 172.21.15.170:0/3366040755 shutdown_connections 2024-09-12T17:28:21.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.582+0000 7fb833014800 1 -- 172.21.15.170:0/3366040755 wait complete. 2024-09-12T17:28:21.601 INFO:teuthology.orchestra.run.smithi170.stdout:[{"tag":"7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.2072027110203852145\u0000","time":"2024-09-12T17:28:21.293958+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1__shadow_.uxvQv1sE2neHPJgUp_lKYYBlN67XOYG_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1__shadow_.uxvQv1sE2neHPJgUp_lKYYBlN67XOYG_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1__shadow_.uxvQv1sE2neHPJgUp_lKYYBlN67XOYG_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1__shadow_.uxvQv1sE2neHPJgUp_lKYYBlN67XOYG_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1__shadow_.uxvQv1sE2neHPJgUp_lKYYBlN67XOYG_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1__shadow_.uxvQv1sE2neHPJgUp_lKYYBlN67XOYG_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1__shadow_.uxvQv1sE2neHPJgUp_lKYYBlN67XOYG_7","key":"","instance":""}]}] 2024-09-12T17:28:21.602 DEBUG:tasks.util.rgw: json result: [{'tag': '7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.2072027110203852145\x00', 'time': '2024-09-12T17:28:21.293958+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': '7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1__shadow_.uxvQv1sE2neHPJgUp_lKYYBlN67XOYG_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1__shadow_.uxvQv1sE2neHPJgUp_lKYYBlN67XOYG_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1__shadow_.uxvQv1sE2neHPJgUp_lKYYBlN67XOYG_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1__shadow_.uxvQv1sE2neHPJgUp_lKYYBlN67XOYG_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1__shadow_.uxvQv1sE2neHPJgUp_lKYYBlN67XOYG_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1__shadow_.uxvQv1sE2neHPJgUp_lKYYBlN67XOYG_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1__shadow_.uxvQv1sE2neHPJgUp_lKYYBlN67XOYG_7', 'key': '', 'instance': ''}]}] 2024-09-12T17:28:21.602 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-09-12T17:28:21.602 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-09-12T17:28:21.602 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-09-12T17:28:21.645 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:21.645 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:21.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.644+0000 7fb91da0e800 1 Processor -- start 2024-09-12T17:28:21.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.644+0000 7fb91da0e800 1 -- start start 2024-09-12T17:28:21.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.645+0000 7fb91da0e800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55d4f1d282b0 0x55d4f1d2de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:21.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.645+0000 7fb91da0e800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d4f1bd0e40 con 0x55d4f1d26fe0 2024-09-12T17:28:21.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.645+0000 7fb91da0e800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x55d4f1b9b680 con 0x55d4f1d282b0 2024-09-12T17:28:21.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.645+0000 7fb910858640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55d4f1d282b0 0x55d4f1d2de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:21.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.645+0000 7fb910858640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55d4f1d282b0 0x55d4f1d2de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:55820/0 (socket says 172.21.15.170:55820) 2024-09-12T17:28:21.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.645+0000 7fb919059640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x55d4f1d26fe0 0x55d4f1d27ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:47668/0 (socket says 172.21.15.170:47668) 2024-09-12T17:28:21.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.645+0000 7fb910858640 1 -- 172.21.15.170:0/3776447401 learned_addr learned my addr 172.21.15.170:0/3776447401 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:21.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.645+0000 7fb910858640 1 -- 172.21.15.170:0/3776447401 >> v1:172.21.15.47:6789/0 conn(0x55d4f1d26fe0 legacy=0x55d4f1d27ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:21.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.645+0000 7fb910858640 1 -- 172.21.15.170:0/3776447401 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4f1bb76b0 con 0x55d4f1d282b0 2024-09-12T17:28:21.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.647+0000 7fb910858640 1 --2- 172.21.15.170:0/3776447401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4f1d282b0 0x55d4f1d2de50 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fb90400a520 tx=0x7fb904045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ef0eabe39c43b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:21.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.647+0000 7fb918858640 1 -- 172.21.15.170:0/3776447401 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb904055070 con 0x55d4f1d282b0 2024-09-12T17:28:21.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.647+0000 7fb918858640 1 -- 172.21.15.170:0/3776447401 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9040515b0 con 0x55d4f1d282b0 2024-09-12T17:28:21.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.647+0000 7fb918858640 1 -- 172.21.15.170:0/3776447401 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9040518d0 con 0x55d4f1d282b0 2024-09-12T17:28:21.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.648+0000 7fb91da0e800 1 -- 172.21.15.170:0/3776447401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4f1d282b0 msgr2=0x55d4f1d2de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:21.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.648+0000 7fb91da0e800 1 --2- 172.21.15.170:0/3776447401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4f1d282b0 0x55d4f1d2de50 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fb90400a520 tx=0x7fb904045ba0 comp rx=0 tx=0).stop 2024-09-12T17:28:21.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.648+0000 7fb91da0e800 1 -- 172.21.15.170:0/3776447401 shutdown_connections 2024-09-12T17:28:21.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.648+0000 7fb91da0e800 1 --2- 172.21.15.170:0/3776447401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4f1d282b0 0x55d4f1d2de50 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:21.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.648+0000 7fb91da0e800 1 -- 172.21.15.170:0/3776447401 >> 172.21.15.170:0/3776447401 conn(0x55d4f1d223b0 msgr2=0x55d4f1d24810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:21.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.648+0000 7fb91da0e800 1 -- 172.21.15.170:0/3776447401 shutdown_connections 2024-09-12T17:28:21.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.648+0000 7fb91da0e800 1 -- 172.21.15.170:0/3776447401 wait complete. 2024-09-12T17:28:21.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.662+0000 7fb91da0e800 1 Processor -- start 2024-09-12T17:28:21.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.662+0000 7fb91da0e800 1 -- start start 2024-09-12T17:28:21.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.662+0000 7fb91da0e800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4f1d26fe0 0x55d4f1e165d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:21.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.662+0000 7fb91da0e800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d4f1bbfdd0 con 0x55d4f1d26fe0 2024-09-12T17:28:21.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.662+0000 7fb919059640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4f1d26fe0 0x55d4f1e165d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:21.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.662+0000 7fb919059640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4f1d26fe0 0x55d4f1e165d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:55824/0 (socket says 172.21.15.170:55824) 2024-09-12T17:28:21.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.662+0000 7fb919059640 1 -- 172.21.15.170:0/4071550809 learned_addr learned my addr 172.21.15.170:0/4071550809 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:21.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.662+0000 7fb919059640 1 -- 172.21.15.170:0/4071550809 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4f1bd8e10 con 0x55d4f1d26fe0 2024-09-12T17:28:21.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.663+0000 7fb919059640 1 --2- 172.21.15.170:0/4071550809 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4f1d26fe0 0x55d4f1e165d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fb90c00b260 tx=0x7fb90c00b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=223943ae323040b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:21.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.663+0000 7fb807606640 1 -- 172.21.15.170:0/4071550809 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb90c00be60 con 0x55d4f1d26fe0 2024-09-12T17:28:21.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.663+0000 7fb807606640 1 -- 172.21.15.170:0/4071550809 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb90c006070 con 0x55d4f1d26fe0 2024-09-12T17:28:21.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.663+0000 7fb807606640 1 -- 172.21.15.170:0/4071550809 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb90c00e710 con 0x55d4f1d26fe0 2024-09-12T17:28:21.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.664+0000 7fb91da0e800 1 -- 172.21.15.170:0/4071550809 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4f1d26fe0 msgr2=0x55d4f1e165d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:21.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.664+0000 7fb91da0e800 1 --2- 172.21.15.170:0/4071550809 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4f1d26fe0 0x55d4f1e165d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fb90c00b260 tx=0x7fb90c00b660 comp rx=0 tx=0).stop 2024-09-12T17:28:21.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.664+0000 7fb91da0e800 1 -- 172.21.15.170:0/4071550809 shutdown_connections 2024-09-12T17:28:21.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.664+0000 7fb91da0e800 1 --2- 172.21.15.170:0/4071550809 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4f1d26fe0 0x55d4f1e165d0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:21.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.664+0000 7fb91da0e800 1 -- 172.21.15.170:0/4071550809 >> 172.21.15.170:0/4071550809 conn(0x55d4f1d223b0 msgr2=0x55d4f1e11f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:21.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.664+0000 7fb91da0e800 1 -- 172.21.15.170:0/4071550809 shutdown_connections 2024-09-12T17:28:21.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.664+0000 7fb91da0e800 1 -- 172.21.15.170:0/4071550809 wait complete. 2024-09-12T17:28:21.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.664+0000 7fb91da0e800 1 Processor -- start 2024-09-12T17:28:21.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.664+0000 7fb91da0e800 1 -- start start 2024-09-12T17:28:21.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.664+0000 7fb91da0e800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4f1d26fe0 0x55d4f1e1df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:21.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.664+0000 7fb91da0e800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d4f1d289a0 con 0x55d4f1d26fe0 2024-09-12T17:28:21.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.664+0000 7fb919059640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4f1d26fe0 0x55d4f1e1df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:21.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.664+0000 7fb919059640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4f1d26fe0 0x55d4f1e1df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:55826/0 (socket says 172.21.15.170:55826) 2024-09-12T17:28:21.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.664+0000 7fb919059640 1 -- 172.21.15.170:0/1290803519 learned_addr learned my addr 172.21.15.170:0/1290803519 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:21.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.665+0000 7fb919059640 1 -- 172.21.15.170:0/1290803519 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4f1e1e4c0 con 0x55d4f1d26fe0 2024-09-12T17:28:21.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.665+0000 7fb919059640 1 --2- 172.21.15.170:0/1290803519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4f1d26fe0 0x55d4f1e1df60 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x55d4f1e17560 tx=0x7fb90c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:21.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.665+0000 7fb805e03640 1 -- 172.21.15.170:0/1290803519 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb90c00ee10 con 0x55d4f1d26fe0 2024-09-12T17:28:21.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.665+0000 7fb805e03640 1 -- 172.21.15.170:0/1290803519 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb90c00fa30 con 0x55d4f1d26fe0 2024-09-12T17:28:21.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.665+0000 7fb91da0e800 1 -- 172.21.15.170:0/1290803519 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d4f1e1e750 con 0x55d4f1d26fe0 2024-09-12T17:28:21.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.665+0000 7fb805e03640 1 -- 172.21.15.170:0/1290803519 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb90c00fd30 con 0x55d4f1d26fe0 2024-09-12T17:28:21.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.666+0000 7fb91da0e800 1 -- 172.21.15.170:0/1290803519 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4f1e1f150 con 0x55d4f1d26fe0 2024-09-12T17:28:21.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.666+0000 7fb805e03640 1 -- 172.21.15.170:0/1290803519 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb90c017070 con 0x55d4f1d26fe0 2024-09-12T17:28:21.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.667+0000 7fb805e03640 1 --2- 172.21.15.170:0/1290803519 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb80003c780 0x7fb80003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:21.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.667+0000 7fb805e03640 1 -- 172.21.15.170:0/1290803519 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fb90c015020 con 0x55d4f1d26fe0 2024-09-12T17:28:21.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.667+0000 7fb910858640 1 --2- 172.21.15.170:0/1290803519 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb80003c780 0x7fb80003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:21.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.667+0000 7fb91da0e800 1 --2- 172.21.15.170:0/1290803519 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55d4f1d282b0 0x55d4f1e255b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:21.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.667+0000 7fb91da0e800 1 -- 172.21.15.170:0/1290803519 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e25af0 con 0x55d4f1d282b0 2024-09-12T17:28:21.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.667+0000 7fb91985a640 1 --2- 172.21.15.170:0/1290803519 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55d4f1d282b0 0x55d4f1e255b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:21.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.667+0000 7fb910858640 1 --2- 172.21.15.170:0/1290803519 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb80003c780 0x7fb80003ec40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb904057000 tx=0x7fb904052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:21.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.667+0000 7fb91985a640 1 --2- 172.21.15.170:0/1290803519 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55d4f1d282b0 0x55d4f1e255b0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:21.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.668+0000 7fb91985a640 1 -- 172.21.15.170:0/1290803519 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb91400a4d0 con 0x55d4f1d282b0 2024-09-12T17:28:21.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.668+0000 7fb91da0e800 1 -- 172.21.15.170:0/1290803519 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e25e90 con 0x55d4f1d282b0 2024-09-12T17:28:21.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.668+0000 7fb91985a640 1 -- 172.21.15.170:0/1290803519 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb91400a4d0 con 0x55d4f1d282b0 2024-09-12T17:28:21.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.668+0000 7fb91da0e800 1 --2- 172.21.15.170:0/1290803519 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55d4f1e27950 0x55d4f1e29dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:21.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.668+0000 7fb91da0e800 1 -- 172.21.15.170:0/1290803519 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e2a560 con 0x55d4f1e27950 2024-09-12T17:28:21.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.668+0000 7fb919059640 1 --2- 172.21.15.170:0/1290803519 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55d4f1e27950 0x55d4f1e29dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:21.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.668+0000 7fb919059640 1 --2- 172.21.15.170:0/1290803519 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55d4f1e27950 0x55d4f1e29dd0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:21.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.668+0000 7fb919059640 1 -- 172.21.15.170:0/1290803519 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e27950 2024-09-12T17:28:21.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.669+0000 7fb91da0e800 1 -- 172.21.15.170:0/1290803519 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e266e0 con 0x55d4f1d282b0 2024-09-12T17:28:21.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.669+0000 7fb91985a640 1 -- 172.21.15.170:0/1290803519 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb91400a4d0 con 0x55d4f1d282b0 2024-09-12T17:28:21.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.669+0000 7fb91da0e800 1 -- 172.21.15.170:0/1290803519 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e26ac0 con 0x55d4f1e27950 2024-09-12T17:28:21.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.669+0000 7fb919059640 1 -- 172.21.15.170:0/1290803519 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e27950 2024-09-12T17:28:21.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.669+0000 7fb91da0e800 1 Processor -- start 2024-09-12T17:28:21.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.669+0000 7fb91da0e800 1 -- start start 2024-09-12T17:28:21.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.670+0000 7fb91da0e800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4f1e38e10 0x55d4f1e39230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:21.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.670+0000 7fb91da0e800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d4f1c1da00 con 0x55d4f1e38e10 2024-09-12T17:28:21.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.670+0000 7fb91985a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4f1e38e10 0x55d4f1e39230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:21.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.670+0000 7fb91985a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4f1e38e10 0x55d4f1e39230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:55832/0 (socket says 172.21.15.170:55832) 2024-09-12T17:28:21.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.670+0000 7fb91985a640 1 -- 172.21.15.170:0/3382803092 learned_addr learned my addr 172.21.15.170:0/3382803092 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:21.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.670+0000 7fb91985a640 1 -- 172.21.15.170:0/3382803092 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4f1e39870 con 0x55d4f1e38e10 2024-09-12T17:28:21.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.670+0000 7fb91985a640 1 --2- 172.21.15.170:0/3382803092 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4f1e38e10 0x55d4f1e39230 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x55d4f1e1ef60 tx=0x7fb9140167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:21.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.671+0000 7fb7feffd640 1 -- 172.21.15.170:0/3382803092 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb914013640 con 0x55d4f1e38e10 2024-09-12T17:28:21.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.671+0000 7fb7feffd640 1 -- 172.21.15.170:0/3382803092 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9140137e0 con 0x55d4f1e38e10 2024-09-12T17:28:21.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.671+0000 7fb91da0e800 1 -- 172.21.15.170:0/3382803092 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d4f1e3a0a0 con 0x55d4f1e38e10 2024-09-12T17:28:21.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.671+0000 7fb7feffd640 1 -- 172.21.15.170:0/3382803092 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb914013ae0 con 0x55d4f1e38e10 2024-09-12T17:28:21.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.671+0000 7fb91da0e800 1 -- 172.21.15.170:0/3382803092 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4f1e3a640 con 0x55d4f1e38e10 2024-09-12T17:28:21.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.671+0000 7fb7feffd640 1 -- 172.21.15.170:0/3382803092 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb914011040 con 0x55d4f1e38e10 2024-09-12T17:28:21.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.672+0000 7fb7feffd640 1 --2- 172.21.15.170:0/3382803092 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb7f003c730 0x7fb7f003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:21.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.672+0000 7fb7feffd640 1 -- 172.21.15.170:0/3382803092 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fb91400e040 con 0x55d4f1e38e10 2024-09-12T17:28:21.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.672+0000 7fb919059640 1 --2- 172.21.15.170:0/3382803092 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb7f003c730 0x7fb7f003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:21.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.672+0000 7fb91da0e800 1 Processor -- start 2024-09-12T17:28:21.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.672+0000 7fb91da0e800 1 -- start start 2024-09-12T17:28:21.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.672+0000 7fb919059640 1 --2- 172.21.15.170:0/3382803092 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb7f003c730 0x7fb7f003ebf0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x55d4f1e20040 tx=0x7fb90c0525b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:21.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.672+0000 7fb91da0e800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4f1e458d0 0x55d4f1e45cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:21.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.672+0000 7fb91da0e800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d4f1e16e20 con 0x55d4f1e458d0 2024-09-12T17:28:21.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.672+0000 7fb91985a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4f1e458d0 0x55d4f1e45cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:21.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.672+0000 7fb91985a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4f1e458d0 0x55d4f1e45cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:55844/0 (socket says 172.21.15.170:55844) 2024-09-12T17:28:21.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.672+0000 7fb91985a640 1 -- 172.21.15.170:0/3644196879 learned_addr learned my addr 172.21.15.170:0/3644196879 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:21.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.673+0000 7fb91985a640 1 -- 172.21.15.170:0/3644196879 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4f1e462c0 con 0x55d4f1e458d0 2024-09-12T17:28:21.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.673+0000 7fb91985a640 1 --2- 172.21.15.170:0/3644196879 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4f1e458d0 0x55d4f1e45cd0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fb914053d70 tx=0x7fb9140203a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d3e2d224514204f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:21.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.673+0000 7fb7fcff9640 1 -- 172.21.15.170:0/3644196879 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9140143c0 con 0x55d4f1e458d0 2024-09-12T17:28:21.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.673+0000 7fb7fcff9640 1 -- 172.21.15.170:0/3644196879 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb914055050 con 0x55d4f1e458d0 2024-09-12T17:28:21.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.673+0000 7fb7fcff9640 1 -- 172.21.15.170:0/3644196879 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb914021a40 con 0x55d4f1e458d0 2024-09-12T17:28:21.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.673+0000 7fb91da0e800 1 -- 172.21.15.170:0/3644196879 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4f1e458d0 msgr2=0x55d4f1e45cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:21.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.673+0000 7fb91da0e800 1 --2- 172.21.15.170:0/3644196879 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4f1e458d0 0x55d4f1e45cd0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fb914053d70 tx=0x7fb9140203a0 comp rx=0 tx=0).stop 2024-09-12T17:28:21.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.673+0000 7fb91da0e800 1 -- 172.21.15.170:0/3644196879 shutdown_connections 2024-09-12T17:28:21.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.673+0000 7fb91da0e800 1 --2- 172.21.15.170:0/3644196879 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4f1e458d0 0x55d4f1e45cd0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:21.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.673+0000 7fb91da0e800 1 -- 172.21.15.170:0/3644196879 >> 172.21.15.170:0/3644196879 conn(0x55d4f1e41cd0 msgr2=0x55d4f1e3ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:21.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.673+0000 7fb91da0e800 1 -- 172.21.15.170:0/3644196879 shutdown_connections 2024-09-12T17:28:21.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.674+0000 7fb91da0e800 1 -- 172.21.15.170:0/3644196879 wait complete. 2024-09-12T17:28:21.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.674+0000 7fb91da0e800 1 Processor -- start 2024-09-12T17:28:21.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.674+0000 7fb91da0e800 1 -- start start 2024-09-12T17:28:21.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.674+0000 7fb91da0e800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4f1e458d0 0x55d4f1e4ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:21.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.674+0000 7fb91da0e800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d4f1e468e0 con 0x55d4f1e458d0 2024-09-12T17:28:21.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.674+0000 7fb91985a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4f1e458d0 0x55d4f1e4ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:21.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.674+0000 7fb91985a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4f1e458d0 0x55d4f1e4ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:55846/0 (socket says 172.21.15.170:55846) 2024-09-12T17:28:21.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.674+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 learned_addr learned my addr 172.21.15.170:0/736321245 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:21.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.674+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4f1e4d410 con 0x55d4f1e458d0 2024-09-12T17:28:21.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.675+0000 7fb91985a640 1 --2- 172.21.15.170:0/736321245 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4f1e458d0 0x55d4f1e4ceb0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fb9140203e0 tx=0x7fb914053d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:21.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.675+0000 7fb7eeffd640 1 -- 172.21.15.170:0/736321245 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb91401fbd0 con 0x55d4f1e458d0 2024-09-12T17:28:21.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.675+0000 7fb7eeffd640 1 -- 172.21.15.170:0/736321245 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9140143c0 con 0x55d4f1e458d0 2024-09-12T17:28:21.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.675+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d4f1e4d6a0 con 0x55d4f1e458d0 2024-09-12T17:28:21.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.675+0000 7fb7eeffd640 1 -- 172.21.15.170:0/736321245 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb914020800 con 0x55d4f1e458d0 2024-09-12T17:28:21.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.675+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4f1e4e020 con 0x55d4f1e458d0 2024-09-12T17:28:21.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.675+0000 7fb7eeffd640 1 -- 172.21.15.170:0/736321245 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb9140209a0 con 0x55d4f1e458d0 2024-09-12T17:28:21.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.676+0000 7fb7eeffd640 1 --2- 172.21.15.170:0/736321245 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb7e403c780 0x7fb7e403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:21.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.676+0000 7fb7eeffd640 1 -- 172.21.15.170:0/736321245 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fb91404a040 con 0x55d4f1e458d0 2024-09-12T17:28:21.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.676+0000 7fb919059640 1 --2- 172.21.15.170:0/736321245 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb7e403c780 0x7fb7e403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:21.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.676+0000 7fb919059640 1 --2- 172.21.15.170:0/736321245 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb7e403c780 0x7fb7e403ec40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb90c0541b0 tx=0x7fb90c048000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:21.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.676+0000 7fb91da0e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:21.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.676+0000 7fb91da0e800 1 --2- 172.21.15.170:0/736321245 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55d4f1e58790 0x55d4f1e5ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:21.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.676+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e5b3a0 con 0x55d4f1e58790 2024-09-12T17:28:21.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.676+0000 7fb910858640 1 --2- 172.21.15.170:0/736321245 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55d4f1e58790 0x55d4f1e5ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:21.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.677+0000 7fb910858640 1 --2- 172.21.15.170:0/736321245 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55d4f1e58790 0x55d4f1e5ac50 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:21.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.677+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb904057030 con 0x55d4f1e58790 2024-09-12T17:28:21.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.677+0000 7fb91da0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:21.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.677+0000 7fb91da0e800 20 realm 2024-09-12T17:28:21.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.677+0000 7fb91da0e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:21.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.677+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e5b7d0 con 0x55d4f1e58790 2024-09-12T17:28:21.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.677+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb904057030 con 0x55d4f1e58790 2024-09-12T17:28:21.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.677+0000 7fb91da0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:21.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.677+0000 7fb91da0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:21.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.677+0000 7fb91da0e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:21.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.677+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e5c0a0 con 0x55d4f1e58790 2024-09-12T17:28:21.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.677+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb904057030 con 0x55d4f1e58790 2024-09-12T17:28:21.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.677+0000 7fb91da0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:21.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.677+0000 7fb91da0e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:21.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.677+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e5c440 con 0x55d4f1e58790 2024-09-12T17:28:21.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.678+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb904057030 con 0x55d4f1e58790 2024-09-12T17:28:21.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.678+0000 7fb91da0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:21.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.678+0000 7fb91da0e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:21.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.678+0000 7fb91da0e800 1 --2- 172.21.15.170:0/736321245 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55d4f1e5d1a0 0x55d4f1e5f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:21.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.678+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e5fba0 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.678+0000 7fb91985a640 1 --2- 172.21.15.170:0/736321245 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55d4f1e5d1a0 0x55d4f1e5f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:21.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.678+0000 7fb91985a640 1 --2- 172.21.15.170:0/736321245 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55d4f1e5d1a0 0x55d4f1e5f590 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:21.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.678+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb91400a4d0 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.678+0000 7fb91da0e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:21.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.678+0000 7fb91da0e800 20 searching for the correct realm 2024-09-12T17:28:21.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.678+0000 7fb91da0e800 1 --2- 172.21.15.170:0/736321245 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55d4f1e61b70 0x55d4f1e64030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:21.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.678+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e646b0 con 0x55d4f1e61b70 2024-09-12T17:28:21.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.678+0000 7fb919059640 1 --2- 172.21.15.170:0/736321245 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55d4f1e61b70 0x55d4f1e64030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:21.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.679+0000 7fb919059640 1 --2- 172.21.15.170:0/736321245 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55d4f1e61b70 0x55d4f1e64030 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:21.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.679+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.679+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e646b0 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.679+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb91400a4d0 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.679+0000 7fb91985a640 1 --2- 172.21.15.170:0/736321245 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fb91404da90 0x7fb914012710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:21.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.679+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e646b0 con 0x7fb91404da90 2024-09-12T17:28:21.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.679+0000 7fb910858640 1 --2- 172.21.15.170:0/736321245 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fb91404da90 0x7fb914012710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:21.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.680+0000 7fb910858640 1 --2- 172.21.15.170:0/736321245 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fb91404da90 0x7fb914012710 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:21.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.680+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb904057030 con 0x7fb91404da90 2024-09-12T17:28:21.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.680+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e646b0 con 0x55d4f1e58790 2024-09-12T17:28:21.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.680+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb904057030 con 0x55d4f1e58790 2024-09-12T17:28:21.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.680+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e646b0 con 0x55d4f1e58790 2024-09-12T17:28:21.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.681+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb904057030 con 0x55d4f1e58790 2024-09-12T17:28:21.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.681+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e646b0 con 0x7fb91404da90 2024-09-12T17:28:21.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.681+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb904057030 con 0x7fb91404da90 2024-09-12T17:28:21.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.681+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e646b0 con 0x7fb91404da90 2024-09-12T17:28:21.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.681+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb904057030 con 0x7fb91404da90 2024-09-12T17:28:21.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.681+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e646b0 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.681+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb91400a4d0 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.681+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e646b0 con 0x55d4f1e61b70 2024-09-12T17:28:21.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.682+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.682+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e646b0 con 0x55d4f1e58790 2024-09-12T17:28:21.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.682+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb904057030 con 0x55d4f1e58790 2024-09-12T17:28:21.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.682+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e646b0 con 0x7fb91404da90 2024-09-12T17:28:21.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.682+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb904057030 con 0x7fb91404da90 2024-09-12T17:28:21.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.682+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e646b0 con 0x55d4f1e58790 2024-09-12T17:28:21.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.682+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb904057030 con 0x55d4f1e58790 2024-09-12T17:28:21.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.682+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e646b0 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.683+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fb91400a4d0 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.683+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e646b0 con 0x55d4f1e61b70 2024-09-12T17:28:21.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.683+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.683+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e646b0 con 0x55d4f1e61b70 2024-09-12T17:28:21.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.683+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.683+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e646b0 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.683+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb91400a4d0 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.683+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e646b0 con 0x55d4f1e61b70 2024-09-12T17:28:21.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.684+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.684+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e646b0 con 0x55d4f1e61b70 2024-09-12T17:28:21.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.684+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.684+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e646b0 con 0x55d4f1e58790 2024-09-12T17:28:21.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.684+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb904057030 con 0x55d4f1e58790 2024-09-12T17:28:21.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.684+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e646b0 con 0x55d4f1e58790 2024-09-12T17:28:21.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.684+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb904057030 con 0x55d4f1e58790 2024-09-12T17:28:21.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.684+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e646b0 con 0x7fb91404da90 2024-09-12T17:28:21.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.685+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb904057030 con 0x7fb91404da90 2024-09-12T17:28:21.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.685+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e646b0 con 0x55d4f1e61b70 2024-09-12T17:28:21.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.685+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.685+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e646b0 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.685+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb91400a4d0 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.685+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e646b0 con 0x55d4f1e58790 2024-09-12T17:28:21.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.685+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb904057030 con 0x55d4f1e58790 2024-09-12T17:28:21.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.685+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e646b0 con 0x7fb91404da90 2024-09-12T17:28:21.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.686+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb904057030 con 0x7fb91404da90 2024-09-12T17:28:21.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.686+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e646b0 con 0x55d4f1e61b70 2024-09-12T17:28:21.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.686+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.686+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e646b0 con 0x7fb91404da90 2024-09-12T17:28:21.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.686+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb904057030 con 0x7fb91404da90 2024-09-12T17:28:21.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.686+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e646b0 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.686+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.686+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e646b0 con 0x55d4f1e61b70 2024-09-12T17:28:21.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.687+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.687+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e646b0 con 0x7fb91404da90 2024-09-12T17:28:21.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.687+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb904057030 con 0x7fb91404da90 2024-09-12T17:28:21.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.687+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e646b0 con 0x55d4f1e58790 2024-09-12T17:28:21.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.687+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb904057030 con 0x55d4f1e58790 2024-09-12T17:28:21.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.687+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e646b0 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.687+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(37 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.687+0000 7fb91da0e800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:21.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.687+0000 7fb91da0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:21.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.687+0000 7fb91da0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:21.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.687+0000 7fb91da0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:21.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.687+0000 7fb91da0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:21.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.687+0000 7fb91da0e800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:21.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.687+0000 7fb91da0e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:21.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.687+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e60560 con 0x55d4f1e58790 2024-09-12T17:28:21.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.688+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb904057030 con 0x55d4f1e58790 2024-09-12T17:28:21.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.688+0000 7fb91da0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:21.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.688+0000 7fb91da0e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:21.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.688+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e60e00 con 0x55d4f1e58790 2024-09-12T17:28:21.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.688+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb904057030 con 0x55d4f1e58790 2024-09-12T17:28:21.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.688+0000 7fb91da0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:21.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.688+0000 7fb91da0e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:21.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.688+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e601a0 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.688+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.688+0000 7fb91da0e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:21.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.688+0000 7fb91da0e800 20 zone default found 2024-09-12T17:28:21.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.688+0000 7fb91da0e800 4 Realm: () 2024-09-12T17:28:21.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.688+0000 7fb91da0e800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:21.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.688+0000 7fb91da0e800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:21.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.688+0000 7fb91da0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:21.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.688+0000 7fb91da0e800 20 zonegroup default 2024-09-12T17:28:21.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.688+0000 7fb91da0e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:21.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.688+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e64fe0 con 0x7fb91404da90 2024-09-12T17:28:21.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.689+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb904057030 con 0x7fb91404da90 2024-09-12T17:28:21.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.689+0000 7fb91da0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:21.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.689+0000 7fb91da0e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:21.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.689+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e67220 con 0x55d4f1e61b70 2024-09-12T17:28:21.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.689+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.689+0000 7fb91da0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:21.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.689+0000 7fb91da0e800 20 rados->read ofs=0 len=0 2024-09-12T17:28:21.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.689+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e675c0 con 0x55d4f1e61b70 2024-09-12T17:28:21.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.689+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.689+0000 7fb91da0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:21.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.689+0000 7fb91da0e800 20 started sync module instance, tier type = 2024-09-12T17:28:21.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.689+0000 7fb91da0e800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:21.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.689+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e666b0 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.690+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(44 notify.0 [create] v31'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.690+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94373079837344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e66310 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.690+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e68430 con 0x55d4f1e58790 2024-09-12T17:28:21.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.691+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94373079837344] v31'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.691+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v31'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb904057030 con 0x55d4f1e58790 2024-09-12T17:28:21.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.691+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94373079841120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e68430 con 0x55d4f1e58790 2024-09-12T17:28:21.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.691+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e68e50 con 0x55d4f1e61b70 2024-09-12T17:28:21.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.692+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94373079841120] v31'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb904057030 con 0x55d4f1e58790 2024-09-12T17:28:21.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.693+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v31'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.693+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94373079842688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e683a0 con 0x55d4f1e61b70 2024-09-12T17:28:21.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.693+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e69d10 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.694+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(50 notify.3 [create] v31'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.694+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94373079849536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e6a5b0 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.694+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e6b0a0 con 0x55d4f1e58790 2024-09-12T17:28:21.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.694+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94373079842688] v31'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.695+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94373079849536] v31'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.695+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v31'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb904057030 con 0x55d4f1e58790 2024-09-12T17:28:21.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.695+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94373079853936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e6a100 con 0x55d4f1e58790 2024-09-12T17:28:21.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.695+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e6b940 con 0x7fb91404da90 2024-09-12T17:28:21.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.696+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94373079853936] v31'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb904057030 con 0x55d4f1e58790 2024-09-12T17:28:21.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.696+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(54 notify.5 [create] v31'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb904057030 con 0x7fb91404da90 2024-09-12T17:28:21.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.696+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94373079847488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e6a100 con 0x7fb91404da90 2024-09-12T17:28:21.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.696+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e6bf50 con 0x7fb91404da90 2024-09-12T17:28:21.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.697+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(56 notify.6 [create] v31'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb904057030 con 0x7fb91404da90 2024-09-12T17:28:21.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.697+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94373079857760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e6c3b0 con 0x7fb91404da90 2024-09-12T17:28:21.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.697+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e6ceb0 con 0x7fb91404da90 2024-09-12T17:28:21.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.697+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94373079847488] v31'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb904057030 con 0x7fb91404da90 2024-09-12T17:28:21.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.698+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94373079857760] v31'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb904057030 con 0x7fb91404da90 2024-09-12T17:28:21.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.698+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(58 notify.7 [create] v31'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb904057030 con 0x7fb91404da90 2024-09-12T17:28:21.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.698+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94373079858816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e6b440 con 0x7fb91404da90 2024-09-12T17:28:21.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.698+0000 7fb91da0e800 20 add_watcher() i=0 2024-09-12T17:28:21.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.698+0000 7fb91da0e800 20 add_watcher() i=1 2024-09-12T17:28:21.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.698+0000 7fb91da0e800 20 add_watcher() i=2 2024-09-12T17:28:21.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.698+0000 7fb91da0e800 20 add_watcher() i=3 2024-09-12T17:28:21.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.698+0000 7fb91da0e800 20 add_watcher() i=4 2024-09-12T17:28:21.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.698+0000 7fb91da0e800 20 add_watcher() i=5 2024-09-12T17:28:21.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.698+0000 7fb91da0e800 20 add_watcher() i=6 2024-09-12T17:28:21.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.699+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94373079858816] v31'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb904057030 con 0x7fb91404da90 2024-09-12T17:28:21.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.699+0000 7fb91da0e800 20 add_watcher() i=7 2024-09-12T17:28:21.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.699+0000 7fb91da0e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:21.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.699+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e6fea0 con 0x55d4f1e58790 2024-09-12T17:28:21.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.699+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb904057030 con 0x55d4f1e58790 2024-09-12T17:28:21.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.699+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94373079861664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e6d320 con 0x55d4f1e58790 2024-09-12T17:28:21.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.700+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94373079861664] v31'157 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb904057030 con 0x55d4f1e58790 2024-09-12T17:28:21.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.700+0000 7fb7cf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:21.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.700+0000 7fb91da0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:21.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.700+0000 7fb91da0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:21.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.700+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e786e0 con 0x55d4f1e58790 2024-09-12T17:28:21.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.701+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb904057030 con 0x55d4f1e58790 2024-09-12T17:28:21.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.702+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e786e0 con 0x7fb91404da90 2024-09-12T17:28:21.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.703+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb904057030 con 0x7fb91404da90 2024-09-12T17:28:21.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.703+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e79100 con 0x55d4f1e61b70 2024-09-12T17:28:21.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.704+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.704+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e79b20 con 0x55d4f1e58790 2024-09-12T17:28:21.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.705+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'158 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb904057030 con 0x55d4f1e58790 2024-09-12T17:28:21.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.705+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e76dd0 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.706+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'47 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.706+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e76dd0 con 0x55d4f1e61b70 2024-09-12T17:28:21.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.707+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'31 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.707+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e76fa0 con 0x55d4f1e58790 2024-09-12T17:28:21.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.708+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb904057030 con 0x55d4f1e58790 2024-09-12T17:28:21.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.708+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e7a4b0 con 0x7fb91404da90 2024-09-12T17:28:21.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.709+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'31 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb904057030 con 0x7fb91404da90 2024-09-12T17:28:21.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.709+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e7a4b0 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.710+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.710+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e7a4b0 con 0x55d4f1e61b70 2024-09-12T17:28:21.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.711+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'25 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.711+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e7a4b0 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.712+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'48 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.712+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e7a4b0 con 0x7fb91404da90 2024-09-12T17:28:21.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.713+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb904057030 con 0x7fb91404da90 2024-09-12T17:28:21.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.713+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e7a4b0 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.714+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.714+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e7a4b0 con 0x7fb91404da90 2024-09-12T17:28:21.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.715+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'37 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb904057030 con 0x7fb91404da90 2024-09-12T17:28:21.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.715+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e76920 con 0x55d4f1e58790 2024-09-12T17:28:21.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.716+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'159 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb904057030 con 0x55d4f1e58790 2024-09-12T17:28:21.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.716+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e76920 con 0x55d4f1e61b70 2024-09-12T17:28:21.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.717+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'41 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.717+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e7aad0 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.718+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'49 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.718+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e7aa90 con 0x55d4f1e61b70 2024-09-12T17:28:21.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.719+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.719+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e7aa90 con 0x55d4f1e58790 2024-09-12T17:28:21.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.720+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'28 uv26 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb904057030 con 0x55d4f1e58790 2024-09-12T17:28:21.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.720+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e7aa90 con 0x55d4f1e58790 2024-09-12T17:28:21.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.721+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'160 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb904057030 con 0x55d4f1e58790 2024-09-12T17:28:21.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.721+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e7aa90 con 0x55d4f1e61b70 2024-09-12T17:28:21.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.722+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'42 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.722+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e7aa90 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.723+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.723+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e7aa90 con 0x55d4f1e61b70 2024-09-12T17:28:21.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.724+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.724+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e7aa90 con 0x55d4f1e61b70 2024-09-12T17:28:21.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.725+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.725+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e7aa90 con 0x55d4f1e61b70 2024-09-12T17:28:21.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.725+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.725+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e7aa90 con 0x55d4f1e61b70 2024-09-12T17:28:21.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.726+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.726+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e7aa90 con 0x7fb91404da90 2024-09-12T17:28:21.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.728+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb904057030 con 0x7fb91404da90 2024-09-12T17:28:21.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.728+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e7aa90 con 0x55d4f1e61b70 2024-09-12T17:28:21.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.728+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.728+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e7aa90 con 0x7fb91404da90 2024-09-12T17:28:21.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.730+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb904057030 con 0x7fb91404da90 2024-09-12T17:28:21.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.730+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e7a4b0 con 0x55d4f1e61b70 2024-09-12T17:28:21.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.731+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'43 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.731+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e7a4b0 con 0x7fb91404da90 2024-09-12T17:28:21.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.732+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'38 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb904057030 con 0x7fb91404da90 2024-09-12T17:28:21.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.732+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e7a4d0 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.733+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.734+0000 7fb7ce7e4640 20 reqs_thread_entry: start 2024-09-12T17:28:21.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.734+0000 7fb91da0e800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:21.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.734+0000 7fb91da0e800 20 Filter name: none 2024-09-12T17:28:21.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.734+0000 7fb73ffff640 20 reqs_thread_entry: start 2024-09-12T17:28:21.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.734+0000 7fb91da0e800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-09-12T17:28:21.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.734+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:94 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.735+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 26 ==== osd_op_reply(94 gc.23 [call] v31'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.735+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:95 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.735+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 27 ==== osd_op_reply(95 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.735+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.735+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:96 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea58f0 con 0x55d4f1e61b70 2024-09-12T17:28:21.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.736+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 28 ==== osd_op_reply(96 gc.23 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.736+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:97 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.736+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 29 ==== osd_op_reply(97 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.736+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:28:21.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.736+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:98 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.736+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 30 ==== osd_op_reply(98 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.736+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.736+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:99 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.737+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 31 ==== osd_op_reply(99 gc.23 [call] v31'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.737+0000 7fb91da0e800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-09-12T17:28:21.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.737+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:100 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.738+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 32 ==== osd_op_reply(100 gc.24 [call] v31'16 uv16 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.738+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:101 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.738+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 33 ==== osd_op_reply(101 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.738+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.738+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:102 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea58f0 con 0x55d4f1e61b70 2024-09-12T17:28:21.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.739+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 34 ==== osd_op_reply(102 gc.24 [call out=24b] v0'0 uv16 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.739+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:103 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.739+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 35 ==== osd_op_reply(103 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.739+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:28:21.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.739+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:104 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.739+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 36 ==== osd_op_reply(104 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.739+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.739+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:105 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.740+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 37 ==== osd_op_reply(105 gc.24 [call] v31'17 uv17 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.740+0000 7fb91da0e800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-09-12T17:28:21.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.740+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:106 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.741+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 38 ==== osd_op_reply(106 gc.25 [call] v31'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.741+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:107 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.741+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 39 ==== osd_op_reply(107 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.741+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.741+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:108 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea58f0 con 0x55d4f1e61b70 2024-09-12T17:28:21.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.741+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 40 ==== osd_op_reply(108 gc.25 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.741+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:109 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.742+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 41 ==== osd_op_reply(109 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.742+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:28:21.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.742+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:110 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.742+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 42 ==== osd_op_reply(110 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.742+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.742+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:111 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.743+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 43 ==== osd_op_reply(111 gc.25 [call] v31'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.743+0000 7fb91da0e800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-09-12T17:28:21.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.743+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:112 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x7fb91404da90 2024-09-12T17:28:21.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.744+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 23 ==== osd_op_reply(112 gc.26 [call] v31'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb904057030 con 0x7fb91404da90 2024-09-12T17:28:21.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.744+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:113 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x7fb91404da90 2024-09-12T17:28:21.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.744+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 24 ==== osd_op_reply(113 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb904057030 con 0x7fb91404da90 2024-09-12T17:28:21.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.744+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.744+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:114 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea58f0 con 0x7fb91404da90 2024-09-12T17:28:21.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.745+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 25 ==== osd_op_reply(114 gc.26 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb904057030 con 0x7fb91404da90 2024-09-12T17:28:21.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.745+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:115 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x7fb91404da90 2024-09-12T17:28:21.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.745+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 26 ==== osd_op_reply(115 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb904057030 con 0x7fb91404da90 2024-09-12T17:28:21.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.745+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:28:21.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.745+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:116 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x7fb91404da90 2024-09-12T17:28:21.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.745+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 27 ==== osd_op_reply(116 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb904057030 con 0x7fb91404da90 2024-09-12T17:28:21.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.745+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.745+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:117 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x7fb91404da90 2024-09-12T17:28:21.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.746+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 28 ==== osd_op_reply(117 gc.26 [call] v31'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb904057030 con 0x7fb91404da90 2024-09-12T17:28:21.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.746+0000 7fb91da0e800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-09-12T17:28:21.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.746+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:118 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.747+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 44 ==== osd_op_reply(118 gc.27 [call] v31'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.747+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:119 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.748+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 45 ==== osd_op_reply(119 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.748+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.748+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:120 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea58f0 con 0x55d4f1e61b70 2024-09-12T17:28:21.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.748+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 46 ==== osd_op_reply(120 gc.27 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.748+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:121 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.748+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 47 ==== osd_op_reply(121 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.748+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:28:21.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.748+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:122 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.748+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 48 ==== osd_op_reply(122 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.748+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.748+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:123 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.749+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 49 ==== osd_op_reply(123 gc.27 [call] v31'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.749+0000 7fb91da0e800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-09-12T17:28:21.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.749+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:124 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x7fb91404da90 2024-09-12T17:28:21.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.751+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 29 ==== osd_op_reply(124 gc.28 [call] v31'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb904057030 con 0x7fb91404da90 2024-09-12T17:28:21.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.751+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:125 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x7fb91404da90 2024-09-12T17:28:21.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.751+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 30 ==== osd_op_reply(125 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb904057030 con 0x7fb91404da90 2024-09-12T17:28:21.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.751+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.751+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:126 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea58f0 con 0x7fb91404da90 2024-09-12T17:28:21.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.751+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 31 ==== osd_op_reply(126 gc.28 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb904057030 con 0x7fb91404da90 2024-09-12T17:28:21.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.751+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:127 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x7fb91404da90 2024-09-12T17:28:21.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.752+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 32 ==== osd_op_reply(127 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb904057030 con 0x7fb91404da90 2024-09-12T17:28:21.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.752+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:28:21.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.752+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:128 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x7fb91404da90 2024-09-12T17:28:21.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.752+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 33 ==== osd_op_reply(128 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb904057030 con 0x7fb91404da90 2024-09-12T17:28:21.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.752+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.752+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:129 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x7fb91404da90 2024-09-12T17:28:21.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.753+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 34 ==== osd_op_reply(129 gc.28 [call] v31'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb904057030 con 0x7fb91404da90 2024-09-12T17:28:21.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.753+0000 7fb91da0e800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-09-12T17:28:21.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.753+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:130 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.754+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 50 ==== osd_op_reply(130 gc.29 [call] v31'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.754+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:131 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.755+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 51 ==== osd_op_reply(131 gc.29 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.755+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.755+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:132 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea58f0 con 0x55d4f1e61b70 2024-09-12T17:28:21.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.755+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 52 ==== osd_op_reply(132 gc.29 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.755+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:133 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.755+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 53 ==== osd_op_reply(133 gc.29 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.755+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:28:21.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.755+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:134 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.755+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 54 ==== osd_op_reply(134 gc.29 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.755+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.755+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:135 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.756+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 55 ==== osd_op_reply(135 gc.29 [call] v31'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.756+0000 7fb91da0e800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-09-12T17:28:21.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.756+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:136 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x7fb91404da90 2024-09-12T17:28:21.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.757+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 35 ==== osd_op_reply(136 gc.30 [call] v31'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb904057030 con 0x7fb91404da90 2024-09-12T17:28:21.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.757+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:137 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x7fb91404da90 2024-09-12T17:28:21.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.758+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 36 ==== osd_op_reply(137 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb904057030 con 0x7fb91404da90 2024-09-12T17:28:21.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.758+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.758+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:138 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea58f0 con 0x7fb91404da90 2024-09-12T17:28:21.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.758+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 37 ==== osd_op_reply(138 gc.30 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb904057030 con 0x7fb91404da90 2024-09-12T17:28:21.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.758+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:139 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x7fb91404da90 2024-09-12T17:28:21.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.758+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 38 ==== osd_op_reply(139 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb904057030 con 0x7fb91404da90 2024-09-12T17:28:21.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.758+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:28:21.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.758+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:140 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x7fb91404da90 2024-09-12T17:28:21.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.759+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 39 ==== osd_op_reply(140 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb904057030 con 0x7fb91404da90 2024-09-12T17:28:21.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.759+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.759+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:141 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x7fb91404da90 2024-09-12T17:28:21.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.760+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 40 ==== osd_op_reply(141 gc.30 [call] v31'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb904089040 con 0x7fb91404da90 2024-09-12T17:28:21.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.760+0000 7fb91da0e800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-09-12T17:28:21.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.760+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:142 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.761+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 21 ==== osd_op_reply(142 gc.31 [call] v31'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.761+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:143 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.761+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 22 ==== osd_op_reply(143 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.761+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.761+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:144 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea58f0 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.761+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 23 ==== osd_op_reply(144 gc.31 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.761+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:145 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.762+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 24 ==== osd_op_reply(145 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.762+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:28:21.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.762+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:146 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.762+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 25 ==== osd_op_reply(146 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.762+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.762+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:147 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.763+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 26 ==== osd_op_reply(147 gc.31 [call] v31'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.763+0000 7fb91da0e800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-09-12T17:28:21.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.763+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:148 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e58790 2024-09-12T17:28:21.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.764+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(148 gc.0 [call] v31'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb904089040 con 0x55d4f1e58790 2024-09-12T17:28:21.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.764+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:149 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e58790 2024-09-12T17:28:21.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.764+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(149 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb904089040 con 0x55d4f1e58790 2024-09-12T17:28:21.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.764+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.764+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:150 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea58f0 con 0x55d4f1e58790 2024-09-12T17:28:21.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.764+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(150 gc.0 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb904089040 con 0x55d4f1e58790 2024-09-12T17:28:21.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.764+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:151 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e58790 2024-09-12T17:28:21.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.765+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 30 ==== osd_op_reply(151 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb904089040 con 0x55d4f1e58790 2024-09-12T17:28:21.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.765+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:28:21.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.765+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:152 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e58790 2024-09-12T17:28:21.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.765+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 31 ==== osd_op_reply(152 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb904089040 con 0x55d4f1e58790 2024-09-12T17:28:21.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.765+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.765+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:153 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e58790 2024-09-12T17:28:21.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.766+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 32 ==== osd_op_reply(153 gc.0 [call] v31'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb904089040 con 0x55d4f1e58790 2024-09-12T17:28:21.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.766+0000 7fb91da0e800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-09-12T17:28:21.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.766+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:154 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x7fb91404da90 2024-09-12T17:28:21.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.767+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 41 ==== osd_op_reply(154 gc.1 [call] v31'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb904089040 con 0x7fb91404da90 2024-09-12T17:28:21.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.767+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:155 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x7fb91404da90 2024-09-12T17:28:21.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.767+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 42 ==== osd_op_reply(155 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb904089040 con 0x7fb91404da90 2024-09-12T17:28:21.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.767+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.767+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:156 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea58f0 con 0x7fb91404da90 2024-09-12T17:28:21.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.767+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 43 ==== osd_op_reply(156 gc.1 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb904089040 con 0x7fb91404da90 2024-09-12T17:28:21.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.767+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:157 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x7fb91404da90 2024-09-12T17:28:21.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.768+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 44 ==== osd_op_reply(157 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb904089040 con 0x7fb91404da90 2024-09-12T17:28:21.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.768+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:28:21.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.768+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:158 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x7fb91404da90 2024-09-12T17:28:21.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.768+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 45 ==== osd_op_reply(158 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb904089040 con 0x7fb91404da90 2024-09-12T17:28:21.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.768+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.768+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:159 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x7fb91404da90 2024-09-12T17:28:21.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.769+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 46 ==== osd_op_reply(159 gc.1 [call] v31'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb904089040 con 0x7fb91404da90 2024-09-12T17:28:21.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.769+0000 7fb91da0e800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-09-12T17:28:21.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.769+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:160 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.770+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 56 ==== osd_op_reply(160 gc.2 [call] v31'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.770+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:161 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.770+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 57 ==== osd_op_reply(161 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.770+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.770+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:162 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea58f0 con 0x55d4f1e61b70 2024-09-12T17:28:21.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.770+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 58 ==== osd_op_reply(162 gc.2 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.771+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:163 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.771+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 59 ==== osd_op_reply(163 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.771+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:28:21.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.771+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:164 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.771+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 60 ==== osd_op_reply(164 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.771+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.771+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:165 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.772+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 61 ==== osd_op_reply(165 gc.2 [call] v31'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.772+0000 7fb91da0e800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-09-12T17:28:21.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.772+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:166 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e58790 2024-09-12T17:28:21.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.773+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 33 ==== osd_op_reply(166 gc.3 [call] v31'161 uv161 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb904089040 con 0x55d4f1e58790 2024-09-12T17:28:21.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.773+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:167 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e58790 2024-09-12T17:28:21.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.773+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 34 ==== osd_op_reply(167 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb904089040 con 0x55d4f1e58790 2024-09-12T17:28:21.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.773+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.773+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:168 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea58f0 con 0x55d4f1e58790 2024-09-12T17:28:21.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.774+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 35 ==== osd_op_reply(168 gc.3 [call out=24b] v0'0 uv161 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb904089040 con 0x55d4f1e58790 2024-09-12T17:28:21.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.774+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:169 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e58790 2024-09-12T17:28:21.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.774+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 36 ==== osd_op_reply(169 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb904089040 con 0x55d4f1e58790 2024-09-12T17:28:21.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.774+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:28:21.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.774+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:170 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e58790 2024-09-12T17:28:21.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.774+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 37 ==== osd_op_reply(170 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb904089040 con 0x55d4f1e58790 2024-09-12T17:28:21.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.774+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.774+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:171 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e58790 2024-09-12T17:28:21.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.775+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 38 ==== osd_op_reply(171 gc.3 [call] v31'162 uv162 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb904089040 con 0x55d4f1e58790 2024-09-12T17:28:21.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.775+0000 7fb91da0e800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-09-12T17:28:21.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.775+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:172 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.776+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 27 ==== osd_op_reply(172 gc.4 [call] v31'50 uv50 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.776+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:173 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.776+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 28 ==== osd_op_reply(173 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.776+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.776+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:174 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea58f0 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.776+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 29 ==== osd_op_reply(174 gc.4 [call out=24b] v0'0 uv50 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.776+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:175 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.777+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 30 ==== osd_op_reply(175 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.777+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:28:21.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.777+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:176 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.777+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 31 ==== osd_op_reply(176 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.777+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.777+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:177 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.778+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 32 ==== osd_op_reply(177 gc.4 [call] v31'51 uv51 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.778+0000 7fb91da0e800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-09-12T17:28:21.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.778+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:178 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.779+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 62 ==== osd_op_reply(178 gc.5 [call] v31'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.779+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:179 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.779+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 63 ==== osd_op_reply(179 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.779+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.779+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:180 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea58f0 con 0x55d4f1e61b70 2024-09-12T17:28:21.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.779+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 64 ==== osd_op_reply(180 gc.5 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.779+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:181 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.779+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 65 ==== osd_op_reply(181 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.779+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:28:21.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.779+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:182 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.780+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 66 ==== osd_op_reply(182 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.780+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.780+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:183 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.780+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 67 ==== osd_op_reply(183 gc.5 [call] v31'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.780+0000 7fb91da0e800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-09-12T17:28:21.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.781+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:184 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e58790 2024-09-12T17:28:21.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.782+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 39 ==== osd_op_reply(184 gc.6 [call] v31'22 uv22 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb904089040 con 0x55d4f1e58790 2024-09-12T17:28:21.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.782+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:185 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e58790 2024-09-12T17:28:21.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.782+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 40 ==== osd_op_reply(185 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb904089040 con 0x55d4f1e58790 2024-09-12T17:28:21.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.782+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.782+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:186 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea58f0 con 0x55d4f1e58790 2024-09-12T17:28:21.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.782+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 41 ==== osd_op_reply(186 gc.6 [call out=24b] v0'0 uv22 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb904089040 con 0x55d4f1e58790 2024-09-12T17:28:21.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.782+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:187 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e58790 2024-09-12T17:28:21.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.782+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 42 ==== osd_op_reply(187 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb904089040 con 0x55d4f1e58790 2024-09-12T17:28:21.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.782+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:28:21.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.782+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:188 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e58790 2024-09-12T17:28:21.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.783+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 43 ==== osd_op_reply(188 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb904089040 con 0x55d4f1e58790 2024-09-12T17:28:21.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.783+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.783+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:189 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e58790 2024-09-12T17:28:21.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.784+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 44 ==== osd_op_reply(189 gc.6 [call] v31'23 uv23 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb904089040 con 0x55d4f1e58790 2024-09-12T17:28:21.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.784+0000 7fb91da0e800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-09-12T17:28:21.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.784+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:190 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x7fb91404da90 2024-09-12T17:28:21.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.785+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 47 ==== osd_op_reply(190 gc.7 [call] v31'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb904089040 con 0x7fb91404da90 2024-09-12T17:28:21.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.785+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:191 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x7fb91404da90 2024-09-12T17:28:21.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.785+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 48 ==== osd_op_reply(191 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb904089040 con 0x7fb91404da90 2024-09-12T17:28:21.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.785+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.785+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:192 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea58f0 con 0x7fb91404da90 2024-09-12T17:28:21.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.785+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 49 ==== osd_op_reply(192 gc.7 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb904089040 con 0x7fb91404da90 2024-09-12T17:28:21.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.785+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:193 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x7fb91404da90 2024-09-12T17:28:21.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.786+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 50 ==== osd_op_reply(193 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb904089040 con 0x7fb91404da90 2024-09-12T17:28:21.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.786+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:28:21.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.786+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:194 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x7fb91404da90 2024-09-12T17:28:21.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.786+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 51 ==== osd_op_reply(194 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb904089040 con 0x7fb91404da90 2024-09-12T17:28:21.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.786+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.786+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:195 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x7fb91404da90 2024-09-12T17:28:21.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.787+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 52 ==== osd_op_reply(195 gc.7 [call] v31'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb904089040 con 0x7fb91404da90 2024-09-12T17:28:21.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.787+0000 7fb91da0e800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-09-12T17:28:21.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.787+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:196 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.788+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 33 ==== osd_op_reply(196 gc.8 [call] v31'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.788+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:197 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.788+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 34 ==== osd_op_reply(197 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.788+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.788+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:198 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea58f0 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.788+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 35 ==== osd_op_reply(198 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.788+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:199 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.788+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 36 ==== osd_op_reply(199 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.788+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:28:21.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.788+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:200 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.789+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 37 ==== osd_op_reply(200 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.789+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.789+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:201 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.790+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 38 ==== osd_op_reply(201 gc.8 [call] v31'22 uv22 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.790+0000 7fb91da0e800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-09-12T17:28:21.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.790+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:202 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.791+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 68 ==== osd_op_reply(202 gc.9 [call] v31'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.791+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:203 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.791+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 69 ==== osd_op_reply(203 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.791+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.791+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:204 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea58f0 con 0x55d4f1e61b70 2024-09-12T17:28:21.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.791+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 70 ==== osd_op_reply(204 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.791+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:205 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.791+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 71 ==== osd_op_reply(205 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.791+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:28:21.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.791+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:206 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.792+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 72 ==== osd_op_reply(206 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.792+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.792+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:207 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.793+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 73 ==== osd_op_reply(207 gc.9 [call] v31'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.793+0000 7fb91da0e800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-09-12T17:28:21.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.793+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:208 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.793+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 39 ==== osd_op_reply(208 gc.10 [call] v31'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.793+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:209 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.794+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 40 ==== osd_op_reply(209 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.794+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.794+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:210 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea58f0 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.794+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 41 ==== osd_op_reply(210 gc.10 [call out=24b] v0'0 uv52 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.794+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:211 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.794+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 42 ==== osd_op_reply(211 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.794+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:28:21.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.794+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:212 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.794+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 43 ==== osd_op_reply(212 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.794+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.794+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:213 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.795+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 44 ==== osd_op_reply(213 gc.10 [call] v31'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.795+0000 7fb91da0e800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-09-12T17:28:21.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.795+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:214 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x7fb91404da90 2024-09-12T17:28:21.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.796+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 53 ==== osd_op_reply(214 gc.11 [call] v31'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb904089040 con 0x7fb91404da90 2024-09-12T17:28:21.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.796+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:215 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x7fb91404da90 2024-09-12T17:28:21.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.797+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 54 ==== osd_op_reply(215 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb904089040 con 0x7fb91404da90 2024-09-12T17:28:21.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.797+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.797+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:216 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea58f0 con 0x7fb91404da90 2024-09-12T17:28:21.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.797+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 55 ==== osd_op_reply(216 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb904089040 con 0x7fb91404da90 2024-09-12T17:28:21.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.797+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:217 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x7fb91404da90 2024-09-12T17:28:21.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.798+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 56 ==== osd_op_reply(217 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb904089040 con 0x7fb91404da90 2024-09-12T17:28:21.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.798+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:28:21.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.798+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:218 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x7fb91404da90 2024-09-12T17:28:21.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.798+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 57 ==== osd_op_reply(218 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb904089040 con 0x7fb91404da90 2024-09-12T17:28:21.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.798+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.798+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:219 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x7fb91404da90 2024-09-12T17:28:21.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.799+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 58 ==== osd_op_reply(219 gc.11 [call] v31'24 uv24 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb904089040 con 0x7fb91404da90 2024-09-12T17:28:21.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.799+0000 7fb91da0e800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-09-12T17:28:21.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.799+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:220 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.800+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 45 ==== osd_op_reply(220 gc.12 [call] v31'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.800+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:221 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.800+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 46 ==== osd_op_reply(221 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.800+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.800+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:222 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea58f0 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.800+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 47 ==== osd_op_reply(222 gc.12 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.800+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:223 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.800+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 48 ==== osd_op_reply(223 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.800+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:28:21.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.800+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:224 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.801+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 49 ==== osd_op_reply(224 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.801+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.801+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:225 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.802+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 50 ==== osd_op_reply(225 gc.12 [call] v31'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.802+0000 7fb91da0e800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-09-12T17:28:21.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.802+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:226 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x7fb91404da90 2024-09-12T17:28:21.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.803+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 59 ==== osd_op_reply(226 gc.13 [call] v31'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb904089040 con 0x7fb91404da90 2024-09-12T17:28:21.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.803+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:227 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x7fb91404da90 2024-09-12T17:28:21.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.803+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 60 ==== osd_op_reply(227 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb904089040 con 0x7fb91404da90 2024-09-12T17:28:21.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.803+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.803+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:228 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea58f0 con 0x7fb91404da90 2024-09-12T17:28:21.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.803+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 61 ==== osd_op_reply(228 gc.13 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb904089040 con 0x7fb91404da90 2024-09-12T17:28:21.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.803+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:229 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x7fb91404da90 2024-09-12T17:28:21.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.803+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 62 ==== osd_op_reply(229 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb904089040 con 0x7fb91404da90 2024-09-12T17:28:21.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.803+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:28:21.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.803+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:230 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x7fb91404da90 2024-09-12T17:28:21.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.804+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 63 ==== osd_op_reply(230 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb904089040 con 0x7fb91404da90 2024-09-12T17:28:21.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.804+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.804+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:231 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x7fb91404da90 2024-09-12T17:28:21.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.805+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 64 ==== osd_op_reply(231 gc.13 [call] v31'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb904089040 con 0x7fb91404da90 2024-09-12T17:28:21.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.805+0000 7fb91da0e800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-09-12T17:28:21.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.805+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:232 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e58790 2024-09-12T17:28:21.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.806+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 45 ==== osd_op_reply(232 gc.14 [call] v31'163 uv163 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb904089040 con 0x55d4f1e58790 2024-09-12T17:28:21.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.806+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:233 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e58790 2024-09-12T17:28:21.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.806+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 46 ==== osd_op_reply(233 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb904089040 con 0x55d4f1e58790 2024-09-12T17:28:21.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.806+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.806+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:234 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea58f0 con 0x55d4f1e58790 2024-09-12T17:28:21.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.806+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 47 ==== osd_op_reply(234 gc.14 [call out=24b] v0'0 uv163 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb904089040 con 0x55d4f1e58790 2024-09-12T17:28:21.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.806+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:235 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e58790 2024-09-12T17:28:21.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.806+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 48 ==== osd_op_reply(235 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb904089040 con 0x55d4f1e58790 2024-09-12T17:28:21.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.807+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:28:21.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.807+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:236 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e58790 2024-09-12T17:28:21.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.807+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 49 ==== osd_op_reply(236 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb904089040 con 0x55d4f1e58790 2024-09-12T17:28:21.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.807+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.807+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:237 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e58790 2024-09-12T17:28:21.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.808+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 50 ==== osd_op_reply(237 gc.14 [call] v31'164 uv164 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb904089040 con 0x55d4f1e58790 2024-09-12T17:28:21.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.808+0000 7fb91da0e800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-09-12T17:28:21.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.808+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:238 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.809+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 74 ==== osd_op_reply(238 gc.15 [call] v31'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.809+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:239 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.809+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 75 ==== osd_op_reply(239 gc.15 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.809+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.809+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:240 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea58f0 con 0x55d4f1e61b70 2024-09-12T17:28:21.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.810+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 76 ==== osd_op_reply(240 gc.15 [call out=24b] v0'0 uv46 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.810+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:241 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.810+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 77 ==== osd_op_reply(241 gc.15 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.810+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:28:21.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.810+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:242 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.810+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 78 ==== osd_op_reply(242 gc.15 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.810+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.810+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:243 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.811+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 79 ==== osd_op_reply(243 gc.15 [call] v31'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.811+0000 7fb91da0e800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-09-12T17:28:21.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.811+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:244 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.812+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 51 ==== osd_op_reply(244 gc.16 [call] v31'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.812+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:245 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.812+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 52 ==== osd_op_reply(245 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.812+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.812+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:246 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea58f0 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.812+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 53 ==== osd_op_reply(246 gc.16 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.812+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:247 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.813+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 54 ==== osd_op_reply(247 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.813+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:28:21.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.813+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:248 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.813+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 55 ==== osd_op_reply(248 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.813+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.813+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:249 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.814+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 56 ==== osd_op_reply(249 gc.16 [call] v31'55 uv55 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.814+0000 7fb91da0e800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-09-12T17:28:21.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.814+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:250 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.815+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 80 ==== osd_op_reply(250 gc.17 [call] v31'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.815+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:251 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.815+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 81 ==== osd_op_reply(251 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.815+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.815+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:252 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea58f0 con 0x55d4f1e61b70 2024-09-12T17:28:21.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.815+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 82 ==== osd_op_reply(252 gc.17 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.815+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:253 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.815+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 83 ==== osd_op_reply(253 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.815+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:28:21.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.815+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:254 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.816+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 84 ==== osd_op_reply(254 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.816+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.816+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:255 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e61b70 2024-09-12T17:28:21.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.816+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 85 ==== osd_op_reply(255 gc.17 [call] v31'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.816+0000 7fb91da0e800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-09-12T17:28:21.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.816+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:256 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e58790 2024-09-12T17:28:21.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.817+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 51 ==== osd_op_reply(256 gc.18 [call] v31'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb904089040 con 0x55d4f1e58790 2024-09-12T17:28:21.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.817+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:257 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e58790 2024-09-12T17:28:21.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.818+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 52 ==== osd_op_reply(257 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb904089040 con 0x55d4f1e58790 2024-09-12T17:28:21.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.818+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.818+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:258 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea58f0 con 0x55d4f1e58790 2024-09-12T17:28:21.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.818+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 53 ==== osd_op_reply(258 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb904089040 con 0x55d4f1e58790 2024-09-12T17:28:21.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.818+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:259 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e58790 2024-09-12T17:28:21.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.818+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 54 ==== osd_op_reply(259 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb904089040 con 0x55d4f1e58790 2024-09-12T17:28:21.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.818+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:28:21.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.818+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:260 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6900 con 0x55d4f1e58790 2024-09-12T17:28:21.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.818+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 55 ==== osd_op_reply(260 gc.18 [call out=1701b] v0'0 uv29 ondisk = 0) ==== 149+0+1701 (crc 0 0 0) 0x7fb904089040 con 0x55d4f1e58790 2024-09-12T17:28:21.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.818+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:28:21.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.818+0000 7fb91da0e800 20 garbage collection: RGWGC::process iterating over entry tag='7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.2072027110203852145', time=2024-09-12T17:28:21.293958+0000, chain.objs.size()=7 2024-09-12T17:28:21.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.818+0000 7fb91da0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1__shadow_.uxvQv1sE2neHPJgUp_lKYYBlN67XOYG_1 2024-09-12T17:28:21.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.818+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:261 3.27 3:e69c02e2:::7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1__shadow_.uxvQv1sE2neHPJgUp_lKYYBlN67XOYG_1:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea6db0 con 0x7fb91404da90 2024-09-12T17:28:21.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.818+0000 7fb91da0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1__shadow_.uxvQv1sE2neHPJgUp_lKYYBlN67XOYG_2 2024-09-12T17:28:21.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.819+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:262 3.23 3:c5613ebc:::7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1__shadow_.uxvQv1sE2neHPJgUp_lKYYBlN67XOYG_2:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea99a0 con 0x7fb91404da90 2024-09-12T17:28:21.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.819+0000 7fb91da0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1__shadow_.uxvQv1sE2neHPJgUp_lKYYBlN67XOYG_3 2024-09-12T17:28:21.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.819+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:263 3.1b 3:d9ca538e:::7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1__shadow_.uxvQv1sE2neHPJgUp_lKYYBlN67XOYG_3:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1ea99a0 con 0x55d4f1e61b70 2024-09-12T17:28:21.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.819+0000 7fb91da0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1__shadow_.uxvQv1sE2neHPJgUp_lKYYBlN67XOYG_4 2024-09-12T17:28:21.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.819+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:264 3.1b 3:d9283951:::7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1__shadow_.uxvQv1sE2neHPJgUp_lKYYBlN67XOYG_4:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1eae8c0 con 0x55d4f1e61b70 2024-09-12T17:28:21.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.819+0000 7fb91da0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1__shadow_.uxvQv1sE2neHPJgUp_lKYYBlN67XOYG_5 2024-09-12T17:28:21.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.819+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:265 3.29 3:94cb351b:::7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1__shadow_.uxvQv1sE2neHPJgUp_lKYYBlN67XOYG_5:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1eb1470 con 0x7fb91404da90 2024-09-12T17:28:21.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.819+0000 7fb91da0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1__shadow_.uxvQv1sE2neHPJgUp_lKYYBlN67XOYG_6 2024-09-12T17:28:21.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.819+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:266 3.38 3:1e14b2c1:::7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1__shadow_.uxvQv1sE2neHPJgUp_lKYYBlN67XOYG_6:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1eae8c0 con 0x7fb91404da90 2024-09-12T17:28:21.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.819+0000 7fb91da0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1__shadow_.uxvQv1sE2neHPJgUp_lKYYBlN67XOYG_7 2024-09-12T17:28:21.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.819+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:267 3.32 3:4e43b80a:::7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1__shadow_.uxvQv1sE2neHPJgUp_lKYYBlN67XOYG_7:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1eb61b0 con 0x55d4f1e61b70 2024-09-12T17:28:21.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.820+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 86 ==== osd_op_reply(267 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1__shadow_.uxvQv1sE2neHPJgUp_lKYYBlN67XOYG_7 [call] v31'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.821+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 65 ==== osd_op_reply(262 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1__shadow_.uxvQv1sE2neHPJgUp_lKYYBlN67XOYG_2 [call] v31'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fb904089040 con 0x7fb91404da90 2024-09-12T17:28:21.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.821+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 66 ==== osd_op_reply(261 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1__shadow_.uxvQv1sE2neHPJgUp_lKYYBlN67XOYG_1 [call] v31'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fb904089040 con 0x7fb91404da90 2024-09-12T17:28:21.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.821+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 67 ==== osd_op_reply(266 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1__shadow_.uxvQv1sE2neHPJgUp_lKYYBlN67XOYG_6 [call] v31'4 uv4 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fb904089040 con 0x7fb91404da90 2024-09-12T17:28:21.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.821+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 68 ==== osd_op_reply(265 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1__shadow_.uxvQv1sE2neHPJgUp_lKYYBlN67XOYG_5 [call] v31'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fb904089040 con 0x7fb91404da90 2024-09-12T17:28:21.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.822+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 87 ==== osd_op_reply(263 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1__shadow_.uxvQv1sE2neHPJgUp_lKYYBlN67XOYG_3 [call] v31'3 uv3 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.822+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 88 ==== osd_op_reply(264 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.1__shadow_.uxvQv1sE2neHPJgUp_lKYYBlN67XOYG_4 [call] v31'4 uv4 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.822+0000 7fb91da0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:28:21.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.822+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:268 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1eae8c0 con 0x55d4f1e58790 2024-09-12T17:28:21.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.823+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 56 ==== osd_op_reply(268 gc.18 [call] v31'30 uv30 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb904089040 con 0x55d4f1e58790 2024-09-12T17:28:21.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.823+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:269 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1eae8c0 con 0x55d4f1e58790 2024-09-12T17:28:21.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.824+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 57 ==== osd_op_reply(269 gc.18 [call] v31'31 uv31 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb904089040 con 0x55d4f1e58790 2024-09-12T17:28:21.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.824+0000 7fb91da0e800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-09-12T17:28:21.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.824+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:270 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1eae8c0 con 0x55d4f1e58790 2024-09-12T17:28:21.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.825+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 58 ==== osd_op_reply(270 gc.19 [call] v31'165 uv165 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb904089040 con 0x55d4f1e58790 2024-09-12T17:28:21.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.825+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:271 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1eae8c0 con 0x55d4f1e58790 2024-09-12T17:28:21.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.825+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 59 ==== osd_op_reply(271 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb904089040 con 0x55d4f1e58790 2024-09-12T17:28:21.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.825+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.825+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:272 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1eae8c0 con 0x55d4f1e58790 2024-09-12T17:28:21.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.825+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 60 ==== osd_op_reply(272 gc.19 [call out=24b] v0'0 uv165 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb904089040 con 0x55d4f1e58790 2024-09-12T17:28:21.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.825+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:273 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1eae8c0 con 0x55d4f1e58790 2024-09-12T17:28:21.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.826+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 61 ==== osd_op_reply(273 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb904089040 con 0x55d4f1e58790 2024-09-12T17:28:21.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.826+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:28:21.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.826+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:274 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1eae8c0 con 0x55d4f1e58790 2024-09-12T17:28:21.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.826+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 62 ==== osd_op_reply(274 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb904089040 con 0x55d4f1e58790 2024-09-12T17:28:21.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.826+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.826+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:275 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1eae8c0 con 0x55d4f1e58790 2024-09-12T17:28:21.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.827+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 63 ==== osd_op_reply(275 gc.19 [call] v31'166 uv166 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb904089040 con 0x55d4f1e58790 2024-09-12T17:28:21.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.827+0000 7fb91da0e800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-09-12T17:28:21.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.827+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:276 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1eae8c0 con 0x55d4f1e61b70 2024-09-12T17:28:21.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.828+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 89 ==== osd_op_reply(276 gc.20 [call] v31'48 uv48 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.828+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:277 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1eae8c0 con 0x55d4f1e61b70 2024-09-12T17:28:21.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.828+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 90 ==== osd_op_reply(277 gc.20 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.828+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.828+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:278 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1eae8c0 con 0x55d4f1e61b70 2024-09-12T17:28:21.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.829+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 91 ==== osd_op_reply(278 gc.20 [call out=24b] v0'0 uv48 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.829+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:279 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1eae8c0 con 0x55d4f1e61b70 2024-09-12T17:28:21.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.829+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 92 ==== osd_op_reply(279 gc.20 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.829+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:28:21.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.829+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:280 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1eae8c0 con 0x55d4f1e61b70 2024-09-12T17:28:21.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.829+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 93 ==== osd_op_reply(280 gc.20 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.829+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.829+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:281 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1eb0e40 con 0x55d4f1e61b70 2024-09-12T17:28:21.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.830+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 94 ==== osd_op_reply(281 gc.20 [call] v31'49 uv49 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.830+0000 7fb91da0e800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-09-12T17:28:21.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.830+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:282 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1eb0e40 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.831+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 57 ==== osd_op_reply(282 gc.21 [call] v31'31 uv31 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.831+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:283 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1eb0e40 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.831+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 58 ==== osd_op_reply(283 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.832+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.832+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:284 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1eb0e40 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.832+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 59 ==== osd_op_reply(284 gc.21 [call out=24b] v0'0 uv31 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.832+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:285 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1eb0e40 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.832+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 60 ==== osd_op_reply(285 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.832+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:28:21.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.832+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:286 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1eb0e40 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.832+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 61 ==== osd_op_reply(286 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.832+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.832+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:287 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1eb0e40 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.833+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 62 ==== osd_op_reply(287 gc.21 [call] v31'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.833+0000 7fb91da0e800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-09-12T17:28:21.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.833+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:288 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1eb0e40 con 0x55d4f1e61b70 2024-09-12T17:28:21.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.834+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 95 ==== osd_op_reply(288 gc.22 [call] v31'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.834+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:289 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1eb0e40 con 0x55d4f1e61b70 2024-09-12T17:28:21.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.834+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 96 ==== osd_op_reply(289 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.834+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.834+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:290 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1eb0e40 con 0x55d4f1e61b70 2024-09-12T17:28:21.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.835+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 97 ==== osd_op_reply(290 gc.22 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.835+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:291 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1eb0e40 con 0x55d4f1e61b70 2024-09-12T17:28:21.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.835+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 98 ==== osd_op_reply(291 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.835+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:28:21.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.835+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:292 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1eb0e40 con 0x55d4f1e61b70 2024-09-12T17:28:21.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.835+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 99 ==== osd_op_reply(292 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.835+0000 7fb91da0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:28:21.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.835+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:293 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1eb0e40 con 0x55d4f1e61b70 2024-09-12T17:28:21.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.836+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 100 ==== osd_op_reply(293 gc.22 [call] v31'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.837+0000 7fb7cf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:21.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.837+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94373079861664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e778a0 con 0x55d4f1e58790 2024-09-12T17:28:21.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.838+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 64 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94373079861664] v31'167 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb904089040 con 0x55d4f1e58790 2024-09-12T17:28:21.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.838+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94373079837344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e6c9a0 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.839+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 63 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94373079837344] v31'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.839+0000 7fb91da0e800 20 remove_watcher() i=0 2024-09-12T17:28:21.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.839+0000 7fb91da0e800 2 removed watcher, disabling cache 2024-09-12T17:28:21.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.839+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94373079841120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e66aa0 con 0x55d4f1e58790 2024-09-12T17:28:21.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.840+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 65 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94373079841120] v31'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb904089040 con 0x55d4f1e58790 2024-09-12T17:28:21.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.840+0000 7fb91da0e800 20 remove_watcher() i=1 2024-09-12T17:28:21.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.840+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94373079842688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e66aa0 con 0x55d4f1e61b70 2024-09-12T17:28:21.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.841+0000 7fb919059640 1 -- 172.21.15.170:0/736321245 <== osd.3 v2:172.21.15.170:6816/2664906588 101 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94373079842688] v31'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb90c02e070 con 0x55d4f1e61b70 2024-09-12T17:28:21.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.841+0000 7fb91da0e800 20 remove_watcher() i=2 2024-09-12T17:28:21.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.841+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94373079849536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e66aa0 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.842+0000 7fb91985a640 1 -- 172.21.15.170:0/736321245 <== osd.2 v2:172.21.15.170:6808/3855567754 64 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94373079849536] v31'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb914068040 con 0x55d4f1e5d1a0 2024-09-12T17:28:21.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.842+0000 7fb91da0e800 20 remove_watcher() i=3 2024-09-12T17:28:21.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.842+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94373079853936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e69a40 con 0x55d4f1e58790 2024-09-12T17:28:21.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.843+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.1 v2:172.21.15.170:6800/1903654092 66 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94373079853936] v31'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb904089040 con 0x55d4f1e58790 2024-09-12T17:28:21.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.843+0000 7fb91da0e800 20 remove_watcher() i=4 2024-09-12T17:28:21.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.843+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94373079847488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e66aa0 con 0x7fb91404da90 2024-09-12T17:28:21.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.844+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 69 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94373079847488] v31'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb904089040 con 0x7fb91404da90 2024-09-12T17:28:21.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.844+0000 7fb91da0e800 20 remove_watcher() i=5 2024-09-12T17:28:21.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.844+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94373079857760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e6ab70 con 0x7fb91404da90 2024-09-12T17:28:21.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.845+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 70 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94373079857760] v31'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb904089040 con 0x7fb91404da90 2024-09-12T17:28:21.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.845+0000 7fb91da0e800 20 remove_watcher() i=6 2024-09-12T17:28:21.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.845+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94373079858816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d4f1e69a40 con 0x7fb91404da90 2024-09-12T17:28:21.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.846+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 <== osd.0 v2:172.21.15.47:6800/3978157098 71 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94373079858816] v31'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb904089040 con 0x7fb91404da90 2024-09-12T17:28:21.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.846+0000 7fb91da0e800 20 remove_watcher() i=7 2024-09-12T17:28:21.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.846+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fb91404da90 msgr2=0x7fb914012710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:21.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.846+0000 7fb91da0e800 1 --2- 172.21.15.170:0/736321245 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fb91404da90 0x7fb914012710 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:21.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.846+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55d4f1e58790 msgr2=0x55d4f1e5ac50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:21.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.846+0000 7fb91da0e800 1 --2- 172.21.15.170:0/736321245 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55d4f1e58790 0x55d4f1e5ac50 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:21.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.846+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55d4f1e5d1a0 msgr2=0x55d4f1e5f590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:21.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.846+0000 7fb91da0e800 1 --2- 172.21.15.170:0/736321245 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55d4f1e5d1a0 0x55d4f1e5f590 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:21.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.846+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55d4f1e61b70 msgr2=0x55d4f1e64030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:21.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.846+0000 7fb91da0e800 1 --2- 172.21.15.170:0/736321245 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55d4f1e61b70 0x55d4f1e64030 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:21.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.846+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb7e403c780 msgr2=0x7fb7e403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:21.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.846+0000 7fb91da0e800 1 --2- 172.21.15.170:0/736321245 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb7e403c780 0x7fb7e403ec40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb90c0541b0 tx=0x7fb90c048000 comp rx=0 tx=0).stop 2024-09-12T17:28:21.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.846+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4f1e458d0 msgr2=0x55d4f1e4ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:21.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.846+0000 7fb91da0e800 1 --2- 172.21.15.170:0/736321245 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4f1e458d0 0x55d4f1e4ceb0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fb9140203e0 tx=0x7fb914053d00 comp rx=0 tx=0).stop 2024-09-12T17:28:21.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.846+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 reap_dead start 2024-09-12T17:28:21.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.846+0000 7fb910858640 1 -- 172.21.15.170:0/736321245 reap_dead start 2024-09-12T17:28:21.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.846+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 shutdown_connections 2024-09-12T17:28:21.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.846+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 >> 172.21.15.170:0/736321245 conn(0x55d4f1e41cd0 msgr2=0x55d4f1e3fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:21.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.846+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 shutdown_connections 2024-09-12T17:28:21.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.846+0000 7fb91da0e800 1 -- 172.21.15.170:0/736321245 wait complete. 2024-09-12T17:28:21.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.846+0000 7fb91da0e800 1 -- 172.21.15.170:0/3382803092 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb7f003c730 msgr2=0x7fb7f003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:21.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.846+0000 7fb91da0e800 1 --2- 172.21.15.170:0/3382803092 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb7f003c730 0x7fb7f003ebf0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x55d4f1e20040 tx=0x7fb90c0525b0 comp rx=0 tx=0).stop 2024-09-12T17:28:21.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.846+0000 7fb91da0e800 1 -- 172.21.15.170:0/3382803092 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4f1e38e10 msgr2=0x55d4f1e39230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:21.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.846+0000 7fb91da0e800 1 --2- 172.21.15.170:0/3382803092 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4f1e38e10 0x55d4f1e39230 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x55d4f1e1ef60 tx=0x7fb9140167b0 comp rx=0 tx=0).stop 2024-09-12T17:28:21.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.846+0000 7fb91da0e800 1 -- 172.21.15.170:0/3382803092 shutdown_connections 2024-09-12T17:28:21.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.846+0000 7fb91da0e800 1 --2- 172.21.15.170:0/3382803092 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb7f003c730 0x7fb7f003ebf0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:21.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.846+0000 7fb91da0e800 1 --2- 172.21.15.170:0/3382803092 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4f1e38e10 0x55d4f1e39230 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:21.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.846+0000 7fb91da0e800 1 -- 172.21.15.170:0/3382803092 >> 172.21.15.170:0/3382803092 conn(0x55d4f1e2d1c0 msgr2=0x55d4f1e2d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:21.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.846+0000 7fb91da0e800 1 -- 172.21.15.170:0/3382803092 shutdown_connections 2024-09-12T17:28:21.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.846+0000 7fb91da0e800 1 -- 172.21.15.170:0/3382803092 wait complete. 2024-09-12T17:28:21.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.847+0000 7fb91da0e800 1 -- 172.21.15.170:0/1290803519 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55d4f1d282b0 msgr2=0x55d4f1e255b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:21.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.847+0000 7fb91da0e800 1 --2- 172.21.15.170:0/1290803519 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55d4f1d282b0 0x55d4f1e255b0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:21.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.847+0000 7fb91da0e800 1 -- 172.21.15.170:0/1290803519 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55d4f1e27950 msgr2=0x55d4f1e29dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:21.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.847+0000 7fb91da0e800 1 --2- 172.21.15.170:0/1290803519 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55d4f1e27950 0x55d4f1e29dd0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:21.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.847+0000 7fb91da0e800 1 -- 172.21.15.170:0/1290803519 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb80003c780 msgr2=0x7fb80003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:21.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.847+0000 7fb91da0e800 1 --2- 172.21.15.170:0/1290803519 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb80003c780 0x7fb80003ec40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb904057000 tx=0x7fb904052000 comp rx=0 tx=0).stop 2024-09-12T17:28:21.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.847+0000 7fb91da0e800 1 -- 172.21.15.170:0/1290803519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4f1d26fe0 msgr2=0x55d4f1e1df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:21.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.847+0000 7fb91da0e800 1 --2- 172.21.15.170:0/1290803519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4f1d26fe0 0x55d4f1e1df60 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x55d4f1e17560 tx=0x7fb90c000ed0 comp rx=0 tx=0).stop 2024-09-12T17:28:21.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.847+0000 7fb91da0e800 1 -- 172.21.15.170:0/1290803519 shutdown_connections 2024-09-12T17:28:21.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.847+0000 7fb91da0e800 1 --2- 172.21.15.170:0/1290803519 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55d4f1e27950 0x55d4f1e29dd0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:21.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.847+0000 7fb91da0e800 1 --2- 172.21.15.170:0/1290803519 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fb80003c780 0x7fb80003ec40 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:21.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.847+0000 7fb91da0e800 1 --2- 172.21.15.170:0/1290803519 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55d4f1d282b0 0x55d4f1e255b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:21.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.847+0000 7fb91da0e800 1 --2- 172.21.15.170:0/1290803519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4f1d26fe0 0x55d4f1e1df60 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:21.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.847+0000 7fb91da0e800 1 -- 172.21.15.170:0/1290803519 >> 172.21.15.170:0/1290803519 conn(0x55d4f1d223b0 msgr2=0x55d4f1e178b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:21.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.847+0000 7fb91da0e800 1 -- 172.21.15.170:0/1290803519 shutdown_connections 2024-09-12T17:28:21.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.847+0000 7fb91da0e800 1 -- 172.21.15.170:0/1290803519 wait complete. 2024-09-12T17:28:21.865 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-12T17:28:21.865 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-12T17:28:21.865 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-12T17:28:21.948 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:21.948 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:21.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.948+0000 7f37d9ebb800 1 Processor -- start 2024-09-12T17:28:21.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.948+0000 7f37d9ebb800 1 -- start start 2024-09-12T17:28:21.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.948+0000 7f37d9ebb800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5557ad76b690 0x5557ad76da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:21.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.948+0000 7f37d9ebb800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5557ad614e40 con 0x5557ad76e020 2024-09-12T17:28:21.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.948+0000 7f37d9ebb800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x5557ad5df680 con 0x5557ad76b690 2024-09-12T17:28:21.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.948+0000 7f37d79a5640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5557ad76b690 0x5557ad76da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:21.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.948+0000 7f37d79a5640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5557ad76b690 0x5557ad76da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:55856/0 (socket says 172.21.15.170:55856) 2024-09-12T17:28:21.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.948+0000 7f37d79a5640 1 -- 172.21.15.170:0/4282648862 learned_addr learned my addr 172.21.15.170:0/4282648862 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:21.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.949+0000 7f37d71a4640 1 -- 172.21.15.170:0/4282648862 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3997105308 0 0) 0x5557ad614e40 con 0x5557ad76e020 2024-09-12T17:28:21.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.949+0000 7f37d71a4640 1 -- 172.21.15.170:0/4282648862 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37c4001e10 con 0x5557ad76e020 2024-09-12T17:28:21.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.949+0000 7f37d79a5640 1 -- 172.21.15.170:0/4282648862 >> v1:172.21.15.47:6789/0 conn(0x5557ad76e020 legacy=0x5557ad7704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:21.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.949+0000 7f37d79a5640 1 -- 172.21.15.170:0/4282648862 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557ad5fb6b0 con 0x5557ad76b690 2024-09-12T17:28:21.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.951+0000 7f37d79a5640 1 --2- 172.21.15.170:0/4282648862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557ad76b690 0x5557ad76da80 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f37c800a520 tx=0x7f37c8045aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f05018cd73dc1c8a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:21.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.951+0000 7f37d71a4640 1 -- 172.21.15.170:0/4282648862 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37c8056020 con 0x5557ad76b690 2024-09-12T17:28:21.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.951+0000 7f37d71a4640 1 -- 172.21.15.170:0/4282648862 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37c8052550 con 0x5557ad76b690 2024-09-12T17:28:21.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.951+0000 7f37d71a4640 1 -- 172.21.15.170:0/4282648862 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37c8052850 con 0x5557ad76b690 2024-09-12T17:28:21.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.951+0000 7f37d9ebb800 1 -- 172.21.15.170:0/4282648862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557ad76b690 msgr2=0x5557ad76da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:21.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.951+0000 7f37d9ebb800 1 --2- 172.21.15.170:0/4282648862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557ad76b690 0x5557ad76da80 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f37c800a520 tx=0x7f37c8045aa0 comp rx=0 tx=0).stop 2024-09-12T17:28:21.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.951+0000 7f37d9ebb800 1 -- 172.21.15.170:0/4282648862 shutdown_connections 2024-09-12T17:28:21.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.951+0000 7f37d9ebb800 1 --2- 172.21.15.170:0/4282648862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557ad76b690 0x5557ad76da80 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:21.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.951+0000 7f37d9ebb800 1 -- 172.21.15.170:0/4282648862 >> 172.21.15.170:0/4282648862 conn(0x5557ad7651f0 msgr2=0x5557ad767630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:21.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.951+0000 7f37d9ebb800 1 -- 172.21.15.170:0/4282648862 shutdown_connections 2024-09-12T17:28:21.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.951+0000 7f37d9ebb800 1 -- 172.21.15.170:0/4282648862 wait complete. 2024-09-12T17:28:21.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.965+0000 7f37d9ebb800 1 Processor -- start 2024-09-12T17:28:21.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.965+0000 7f37d9ebb800 1 -- start start 2024-09-12T17:28:21.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.965+0000 7f37d9ebb800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557ad76b690 0x5557ad85a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:21.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.965+0000 7f37d9ebb800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5557ad603dd0 con 0x5557ad76b690 2024-09-12T17:28:21.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.966+0000 7f37d79a5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557ad76b690 0x5557ad85a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:21.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.966+0000 7f37d79a5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557ad76b690 0x5557ad85a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:55870/0 (socket says 172.21.15.170:55870) 2024-09-12T17:28:21.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.966+0000 7f37d79a5640 1 -- 172.21.15.170:0/4193791670 learned_addr learned my addr 172.21.15.170:0/4193791670 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:21.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.966+0000 7f37d79a5640 1 -- 172.21.15.170:0/4193791670 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557ad61ce10 con 0x5557ad76b690 2024-09-12T17:28:21.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.966+0000 7f37d79a5640 1 --2- 172.21.15.170:0/4193791670 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557ad76b690 0x5557ad85a480 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f37c8045ae0 tx=0x7f37c8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=514776c510707dea server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:21.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.966+0000 7f36c5e0b640 1 -- 172.21.15.170:0/4193791670 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37c8052a40 con 0x5557ad76b690 2024-09-12T17:28:21.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.966+0000 7f36c5e0b640 1 -- 172.21.15.170:0/4193791670 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37c8052be0 con 0x5557ad76b690 2024-09-12T17:28:21.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.966+0000 7f36c5e0b640 1 -- 172.21.15.170:0/4193791670 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37c805d440 con 0x5557ad76b690 2024-09-12T17:28:21.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.967+0000 7f37d9ebb800 1 -- 172.21.15.170:0/4193791670 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557ad76b690 msgr2=0x5557ad85a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:21.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.967+0000 7f37d9ebb800 1 --2- 172.21.15.170:0/4193791670 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557ad76b690 0x5557ad85a480 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f37c8045ae0 tx=0x7f37c8051000 comp rx=0 tx=0).stop 2024-09-12T17:28:21.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.967+0000 7f37d9ebb800 1 -- 172.21.15.170:0/4193791670 shutdown_connections 2024-09-12T17:28:21.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.967+0000 7f37d9ebb800 1 --2- 172.21.15.170:0/4193791670 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557ad76b690 0x5557ad85a480 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:21.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.967+0000 7f37d9ebb800 1 -- 172.21.15.170:0/4193791670 >> 172.21.15.170:0/4193791670 conn(0x5557ad7651f0 msgr2=0x5557ad855e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:21.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.967+0000 7f37d9ebb800 1 -- 172.21.15.170:0/4193791670 shutdown_connections 2024-09-12T17:28:21.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.967+0000 7f37d9ebb800 1 -- 172.21.15.170:0/4193791670 wait complete. 2024-09-12T17:28:21.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.967+0000 7f37d9ebb800 1 Processor -- start 2024-09-12T17:28:21.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.967+0000 7f37d9ebb800 1 -- start start 2024-09-12T17:28:21.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.968+0000 7f37d9ebb800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557ad76b690 0x5557ad76adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:21.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.968+0000 7f37d9ebb800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5557ad772040 con 0x5557ad76b690 2024-09-12T17:28:21.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.968+0000 7f37d79a5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557ad76b690 0x5557ad76adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:21.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.968+0000 7f37d79a5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557ad76b690 0x5557ad76adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:55878/0 (socket says 172.21.15.170:55878) 2024-09-12T17:28:21.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.968+0000 7f37d79a5640 1 -- 172.21.15.170:0/3211700375 learned_addr learned my addr 172.21.15.170:0/3211700375 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:21.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.968+0000 7f37d79a5640 1 -- 172.21.15.170:0/3211700375 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557ad76b310 con 0x5557ad76b690 2024-09-12T17:28:21.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.968+0000 7f37d79a5640 1 --2- 172.21.15.170:0/3211700375 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557ad76b690 0x5557ad76adb0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f37c805f040 tx=0x7f37c8003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:21.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.968+0000 7f36bffff640 1 -- 172.21.15.170:0/3211700375 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37c8077070 con 0x5557ad76b690 2024-09-12T17:28:21.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.968+0000 7f36bffff640 1 -- 172.21.15.170:0/3211700375 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37c805d670 con 0x5557ad76b690 2024-09-12T17:28:21.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.968+0000 7f37d9ebb800 1 -- 172.21.15.170:0/3211700375 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5557ad7696c0 con 0x5557ad76b690 2024-09-12T17:28:21.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.968+0000 7f36bffff640 1 -- 172.21.15.170:0/3211700375 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37c805d990 con 0x5557ad76b690 2024-09-12T17:28:21.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.968+0000 7f37d9ebb800 1 -- 172.21.15.170:0/3211700375 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557ad769c80 con 0x5557ad76b690 2024-09-12T17:28:21.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.969+0000 7f36bffff640 1 -- 172.21.15.170:0/3211700375 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f37c807a070 con 0x5557ad76b690 2024-09-12T17:28:21.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.969+0000 7f36bffff640 1 --2- 172.21.15.170:0/3211700375 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f36c003c780 0x7f36c003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:21.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.970+0000 7f36bffff640 1 -- 172.21.15.170:0/3211700375 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f37c80978f0 con 0x5557ad76b690 2024-09-12T17:28:21.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.970+0000 7f37cffff640 1 --2- 172.21.15.170:0/3211700375 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f36c003c780 0x7f36c003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:21.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.970+0000 7f37d9ebb800 1 --2- 172.21.15.170:0/3211700375 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5557ad76e020 0x5557ad86b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:21.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.970+0000 7f37d9ebb800 1 -- 172.21.15.170:0/3211700375 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad86b700 con 0x5557ad76e020 2024-09-12T17:28:21.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.970+0000 7f37d81a6640 1 --2- 172.21.15.170:0/3211700375 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5557ad76e020 0x5557ad86b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:21.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.970+0000 7f37cffff640 1 --2- 172.21.15.170:0/3211700375 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f36c003c780 0x7f36c003ec40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f37c0001e90 tx=0x7f37c0001410 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:21.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.970+0000 7f37d81a6640 1 --2- 172.21.15.170:0/3211700375 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5557ad76e020 0x5557ad86b1c0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:21.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.970+0000 7f37d81a6640 1 -- 172.21.15.170:0/3211700375 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37d000a4d0 con 0x5557ad76e020 2024-09-12T17:28:21.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.970+0000 7f37d9ebb800 1 -- 172.21.15.170:0/3211700375 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad76a180 con 0x5557ad76e020 2024-09-12T17:28:21.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.971+0000 7f37d81a6640 1 -- 172.21.15.170:0/3211700375 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f37d000a4d0 con 0x5557ad76e020 2024-09-12T17:28:21.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.971+0000 7f37d9ebb800 1 --2- 172.21.15.170:0/3211700375 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5557ad86da30 0x5557ad86fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:21.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.971+0000 7f37d9ebb800 1 -- 172.21.15.170:0/3211700375 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8704f0 con 0x5557ad86da30 2024-09-12T17:28:21.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.971+0000 7f37d79a5640 1 --2- 172.21.15.170:0/3211700375 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5557ad86da30 0x5557ad86fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:21.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.971+0000 7f37d79a5640 1 --2- 172.21.15.170:0/3211700375 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5557ad86da30 0x5557ad86fe20 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:21.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.971+0000 7f37d79a5640 1 -- 172.21.15.170:0/3211700375 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad86da30 2024-09-12T17:28:21.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.972+0000 7f37d9ebb800 1 -- 172.21.15.170:0/3211700375 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad86c8d0 con 0x5557ad76e020 2024-09-12T17:28:21.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.972+0000 7f37d81a6640 1 -- 172.21.15.170:0/3211700375 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f37d000a4d0 con 0x5557ad76e020 2024-09-12T17:28:21.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.972+0000 7f37d9ebb800 1 -- 172.21.15.170:0/3211700375 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad86cd70 con 0x5557ad86da30 2024-09-12T17:28:21.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.972+0000 7f37d79a5640 1 -- 172.21.15.170:0/3211700375 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad86da30 2024-09-12T17:28:21.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.972+0000 7f37d9ebb800 1 Processor -- start 2024-09-12T17:28:21.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.972+0000 7f37d9ebb800 1 -- start start 2024-09-12T17:28:21.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.973+0000 7f37d9ebb800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557ad87ed60 0x5557ad87f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:21.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.973+0000 7f37d9ebb800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5557ad661a00 con 0x5557ad87ed60 2024-09-12T17:28:21.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.973+0000 7f37d81a6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557ad87ed60 0x5557ad87f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:21.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.973+0000 7f37d81a6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557ad87ed60 0x5557ad87f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:55882/0 (socket says 172.21.15.170:55882) 2024-09-12T17:28:21.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.973+0000 7f37d81a6640 1 -- 172.21.15.170:0/2961311395 learned_addr learned my addr 172.21.15.170:0/2961311395 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:21.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.973+0000 7f37d81a6640 1 -- 172.21.15.170:0/2961311395 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557ad87f7c0 con 0x5557ad87ed60 2024-09-12T17:28:21.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.973+0000 7f37d81a6640 1 --2- 172.21.15.170:0/2961311395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557ad87ed60 0x5557ad87f180 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x5557ad76a950 tx=0x7f37d00167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:21.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.973+0000 7f36bd7fa640 1 -- 172.21.15.170:0/2961311395 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d0013640 con 0x5557ad87ed60 2024-09-12T17:28:21.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.973+0000 7f36bd7fa640 1 -- 172.21.15.170:0/2961311395 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d00137e0 con 0x5557ad87ed60 2024-09-12T17:28:21.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.973+0000 7f37d9ebb800 1 -- 172.21.15.170:0/2961311395 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5557ad87fff0 con 0x5557ad87ed60 2024-09-12T17:28:21.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.973+0000 7f36bd7fa640 1 -- 172.21.15.170:0/2961311395 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d0013ae0 con 0x5557ad87ed60 2024-09-12T17:28:21.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.973+0000 7f37d9ebb800 1 -- 172.21.15.170:0/2961311395 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557ad880590 con 0x5557ad87ed60 2024-09-12T17:28:21.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.974+0000 7f36bd7fa640 1 -- 172.21.15.170:0/2961311395 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f37d0011040 con 0x5557ad87ed60 2024-09-12T17:28:21.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.974+0000 7f36bd7fa640 1 --2- 172.21.15.170:0/2961311395 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f36b003c780 0x7f36b003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:21.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.974+0000 7f36bd7fa640 1 -- 172.21.15.170:0/2961311395 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f37d000e040 con 0x5557ad87ed60 2024-09-12T17:28:21.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.975+0000 7f37d79a5640 1 --2- 172.21.15.170:0/2961311395 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f36b003c780 0x7f36b003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:21.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.975+0000 7f37d9ebb800 1 Processor -- start 2024-09-12T17:28:21.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.975+0000 7f37d9ebb800 1 -- start start 2024-09-12T17:28:21.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.975+0000 7f37d79a5640 1 --2- 172.21.15.170:0/2961311395 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f36b003c780 0x7f36b003ec40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f37c8071000 tx=0x7f37c8074f60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:21.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.975+0000 7f37d9ebb800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557ad88b7e0 0x5557ad88bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:21.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.975+0000 7f37d9ebb800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5557ad85ac10 con 0x5557ad88b7e0 2024-09-12T17:28:21.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.975+0000 7f37d81a6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557ad88b7e0 0x5557ad88bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:21.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.975+0000 7f37d81a6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557ad88b7e0 0x5557ad88bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:55888/0 (socket says 172.21.15.170:55888) 2024-09-12T17:28:21.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.975+0000 7f37d81a6640 1 -- 172.21.15.170:0/392442086 learned_addr learned my addr 172.21.15.170:0/392442086 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:21.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.976+0000 7f37d81a6640 1 -- 172.21.15.170:0/392442086 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557ad88c1d0 con 0x5557ad88b7e0 2024-09-12T17:28:21.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.976+0000 7f37d81a6640 1 --2- 172.21.15.170:0/392442086 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557ad88b7e0 0x5557ad88bbe0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f37d0053d00 tx=0x7f37d001fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29e44bf86edecd9a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:21.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.976+0000 7f36b6ffd640 1 -- 172.21.15.170:0/392442086 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d0021910 con 0x5557ad88b7e0 2024-09-12T17:28:21.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.976+0000 7f36b6ffd640 1 -- 172.21.15.170:0/392442086 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d0021440 con 0x5557ad88b7e0 2024-09-12T17:28:21.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.976+0000 7f36b6ffd640 1 -- 172.21.15.170:0/392442086 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d0021ab0 con 0x5557ad88b7e0 2024-09-12T17:28:21.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.976+0000 7f37d9ebb800 1 -- 172.21.15.170:0/392442086 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557ad88b7e0 msgr2=0x5557ad88bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.976+0000 7f37d9ebb800 1 --2- 172.21.15.170:0/392442086 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557ad88b7e0 0x5557ad88bbe0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f37d0053d00 tx=0x7f37d001fc80 comp rx=0 tx=0).stop 2024-09-12T17:28:22.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.976+0000 7f37d9ebb800 1 -- 172.21.15.170:0/392442086 shutdown_connections 2024-09-12T17:28:22.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.976+0000 7f37d9ebb800 1 --2- 172.21.15.170:0/392442086 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557ad88b7e0 0x5557ad88bbe0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.976+0000 7f37d9ebb800 1 -- 172.21.15.170:0/392442086 >> 172.21.15.170:0/392442086 conn(0x5557ad887be0 msgr2=0x5557ad885e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:22.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.976+0000 7f37d9ebb800 1 -- 172.21.15.170:0/392442086 shutdown_connections 2024-09-12T17:28:22.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.976+0000 7f37d9ebb800 1 -- 172.21.15.170:0/392442086 wait complete. 2024-09-12T17:28:22.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.977+0000 7f37d9ebb800 1 Processor -- start 2024-09-12T17:28:22.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.977+0000 7f37d9ebb800 1 -- start start 2024-09-12T17:28:22.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.977+0000 7f37d9ebb800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557ad88b7e0 0x5557ad892d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.977+0000 7f37d9ebb800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5557ad88c7c0 con 0x5557ad88b7e0 2024-09-12T17:28:22.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.977+0000 7f37d81a6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557ad88b7e0 0x5557ad892d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.977+0000 7f37d81a6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557ad88b7e0 0x5557ad892d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:55896/0 (socket says 172.21.15.170:55896) 2024-09-12T17:28:22.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.977+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 learned_addr learned my addr 172.21.15.170:0/695162576 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:22.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.977+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557ad893280 con 0x5557ad88b7e0 2024-09-12T17:28:22.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.978+0000 7f37d81a6640 1 --2- 172.21.15.170:0/695162576 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557ad88b7e0 0x5557ad892d20 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f37d0022ff0 tx=0x7f37d0053c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.978+0000 7f36b57fa640 1 -- 172.21.15.170:0/695162576 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d0039070 con 0x5557ad88b7e0 2024-09-12T17:28:22.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.978+0000 7f36b57fa640 1 -- 172.21.15.170:0/695162576 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d002adb0 con 0x5557ad88b7e0 2024-09-12T17:28:22.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.978+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5557ad893510 con 0x5557ad88b7e0 2024-09-12T17:28:22.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.978+0000 7f36b57fa640 1 -- 172.21.15.170:0/695162576 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d00556a0 con 0x5557ad88b7e0 2024-09-12T17:28:22.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.978+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557ad8940a0 con 0x5557ad88b7e0 2024-09-12T17:28:22.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.979+0000 7f36b57fa640 1 -- 172.21.15.170:0/695162576 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f37d003c070 con 0x5557ad88b7e0 2024-09-12T17:28:22.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.979+0000 7f36b57fa640 1 --2- 172.21.15.170:0/695162576 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f36a003c730 0x7f36a003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.979+0000 7f36b57fa640 1 -- 172.21.15.170:0/695162576 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f37d0031070 con 0x5557ad88b7e0 2024-09-12T17:28:22.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.979+0000 7f37d79a5640 1 --2- 172.21.15.170:0/695162576 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f36a003c730 0x7f36a003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.979+0000 7f37d9ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.979+0000 7f37d79a5640 1 --2- 172.21.15.170:0/695162576 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f36a003c730 0x7f36a003ebf0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f37c8051520 tx=0x7f37c808b000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.979+0000 7f37d9ebb800 1 --2- 172.21.15.170:0/695162576 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5557ad89e670 0x5557ad8a0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.979+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8a1280 con 0x5557ad89e670 2024-09-12T17:28:22.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.979+0000 7f37cffff640 1 --2- 172.21.15.170:0/695162576 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5557ad89e670 0x5557ad8a0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.980+0000 7f37cffff640 1 --2- 172.21.15.170:0/695162576 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5557ad89e670 0x5557ad8a0b30 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.980+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37c0010530 con 0x5557ad89e670 2024-09-12T17:28:22.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.980+0000 7f37d9ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:22.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.980+0000 7f37d9ebb800 20 realm 2024-09-12T17:28:22.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.980+0000 7f37d9ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.980+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad89d9c0 con 0x5557ad89e670 2024-09-12T17:28:22.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.980+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37c0010530 con 0x5557ad89e670 2024-09-12T17:28:22.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.980+0000 7f37d9ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:22.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.980+0000 7f37d9ebb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:22.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.980+0000 7f37d9ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.980+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8a1d60 con 0x5557ad89e670 2024-09-12T17:28:22.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.980+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37c0010530 con 0x5557ad89e670 2024-09-12T17:28:22.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.980+0000 7f37d9ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:22.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.980+0000 7f37d9ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.980+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8a2630 con 0x5557ad89e670 2024-09-12T17:28:22.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.981+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f37c0010530 con 0x5557ad89e670 2024-09-12T17:28:22.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.981+0000 7f37d9ebb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:22.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.981+0000 7f37d9ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.981+0000 7f37d9ebb800 1 --2- 172.21.15.170:0/695162576 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5557ad8a2f30 0x5557ad8a5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.981+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8a5a60 con 0x5557ad8a2f30 2024-09-12T17:28:22.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.981+0000 7f37d81a6640 1 --2- 172.21.15.170:0/695162576 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5557ad8a2f30 0x5557ad8a5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.981+0000 7f37d81a6640 1 --2- 172.21.15.170:0/695162576 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5557ad8a2f30 0x5557ad8a5320 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.981+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f37d003b030 con 0x5557ad8a2f30 2024-09-12T17:28:22.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.981+0000 7f37d9ebb800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:22.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.981+0000 7f37d9ebb800 20 searching for the correct realm 2024-09-12T17:28:22.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.981+0000 7f37d9ebb800 1 --2- 172.21.15.170:0/695162576 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5557ad8a7b10 0x5557ad8a9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.981+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8aa6a0 con 0x5557ad8a7b10 2024-09-12T17:28:22.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.981+0000 7f37d79a5640 1 --2- 172.21.15.170:0/695162576 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5557ad8a7b10 0x5557ad8a9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.982+0000 7f37d79a5640 1 --2- 172.21.15.170:0/695162576 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5557ad8a7b10 0x5557ad8a9fd0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.982+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.982+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8aa6a0 con 0x5557ad8a2f30 2024-09-12T17:28:22.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.982+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d003b030 con 0x5557ad8a2f30 2024-09-12T17:28:22.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.982+0000 7f37d81a6640 1 --2- 172.21.15.170:0/695162576 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f37d003e060 0x7f37d00123d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.982+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8aa6a0 con 0x7f37d003e060 2024-09-12T17:28:22.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.982+0000 7f37cffff640 1 --2- 172.21.15.170:0/695162576 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f37d003e060 0x7f37d00123d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.983+0000 7f37cffff640 1 --2- 172.21.15.170:0/695162576 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f37d003e060 0x7f37d00123d0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.983+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c0010530 con 0x7f37d003e060 2024-09-12T17:28:22.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.983+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8aa6a0 con 0x5557ad89e670 2024-09-12T17:28:22.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.983+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c0010530 con 0x5557ad89e670 2024-09-12T17:28:22.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.983+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8aa6a0 con 0x5557ad89e670 2024-09-12T17:28:22.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.983+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c002a040 con 0x5557ad89e670 2024-09-12T17:28:22.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.983+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8aa6a0 con 0x7f37d003e060 2024-09-12T17:28:22.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.984+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c002a040 con 0x7f37d003e060 2024-09-12T17:28:22.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.984+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8aa6a0 con 0x7f37d003e060 2024-09-12T17:28:22.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.984+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c002a040 con 0x7f37d003e060 2024-09-12T17:28:22.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.984+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8aa6a0 con 0x5557ad8a2f30 2024-09-12T17:28:22.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.984+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d003b030 con 0x5557ad8a2f30 2024-09-12T17:28:22.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.984+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8aa6a0 con 0x5557ad8a7b10 2024-09-12T17:28:22.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.984+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.984+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8aa6a0 con 0x5557ad89e670 2024-09-12T17:28:22.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.985+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c002a040 con 0x5557ad89e670 2024-09-12T17:28:22.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.985+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8aa6a0 con 0x7f37d003e060 2024-09-12T17:28:22.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.985+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c002a040 con 0x7f37d003e060 2024-09-12T17:28:22.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.985+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8aa6a0 con 0x5557ad89e670 2024-09-12T17:28:22.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.985+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c002a040 con 0x5557ad89e670 2024-09-12T17:28:22.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.985+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8aa6a0 con 0x5557ad8a2f30 2024-09-12T17:28:22.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.986+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f37d003b030 con 0x5557ad8a2f30 2024-09-12T17:28:22.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.986+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8aa6a0 con 0x5557ad8a7b10 2024-09-12T17:28:22.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.986+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.986+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8aa6a0 con 0x5557ad8a7b10 2024-09-12T17:28:22.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.986+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.986+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8aa6a0 con 0x5557ad8a2f30 2024-09-12T17:28:22.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.986+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d003b030 con 0x5557ad8a2f30 2024-09-12T17:28:22.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.986+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8aa6a0 con 0x5557ad8a7b10 2024-09-12T17:28:22.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.987+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.987+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8aa6a0 con 0x5557ad8a7b10 2024-09-12T17:28:22.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.987+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.987+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8aa6a0 con 0x5557ad89e670 2024-09-12T17:28:22.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.987+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c002a040 con 0x5557ad89e670 2024-09-12T17:28:22.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.987+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8aa6a0 con 0x5557ad89e670 2024-09-12T17:28:22.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.987+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f37c002a040 con 0x5557ad89e670 2024-09-12T17:28:22.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.987+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8aa6a0 con 0x7f37d003e060 2024-09-12T17:28:22.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.988+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c002a040 con 0x7f37d003e060 2024-09-12T17:28:22.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.988+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8aa6a0 con 0x5557ad8a7b10 2024-09-12T17:28:22.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.988+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.988+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8aa6a0 con 0x5557ad8a2f30 2024-09-12T17:28:22.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.988+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d0066040 con 0x5557ad8a2f30 2024-09-12T17:28:22.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.988+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8aa6a0 con 0x5557ad89e670 2024-09-12T17:28:22.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.988+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c002a040 con 0x5557ad89e670 2024-09-12T17:28:22.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.988+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8aa6a0 con 0x7f37d003e060 2024-09-12T17:28:22.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.988+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c002a040 con 0x7f37d003e060 2024-09-12T17:28:22.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.989+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8aa6a0 con 0x5557ad8a7b10 2024-09-12T17:28:22.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.989+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.989+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8aa6a0 con 0x7f37d003e060 2024-09-12T17:28:22.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.989+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c002a040 con 0x7f37d003e060 2024-09-12T17:28:22.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.989+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8aa6a0 con 0x5557ad8a2f30 2024-09-12T17:28:22.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.989+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d0066040 con 0x5557ad8a2f30 2024-09-12T17:28:22.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.989+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8aa6a0 con 0x5557ad8a7b10 2024-09-12T17:28:22.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.989+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.990+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8aa6a0 con 0x7f37d003e060 2024-09-12T17:28:22.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.990+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37c002a040 con 0x7f37d003e060 2024-09-12T17:28:22.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.990+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8aa6a0 con 0x5557ad89e670 2024-09-12T17:28:22.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.990+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f37c002a040 con 0x5557ad89e670 2024-09-12T17:28:22.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.990+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8aa6a0 con 0x5557ad8a2f30 2024-09-12T17:28:22.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.990+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(37 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f37d0066040 con 0x5557ad8a2f30 2024-09-12T17:28:22.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.990+0000 7f37d9ebb800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:22.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.990+0000 7f37d9ebb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:22.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.990+0000 7f37d9ebb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:22.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.990+0000 7f37d9ebb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:22.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.990+0000 7f37d9ebb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:22.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.990+0000 7f37d9ebb800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:22.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.990+0000 7f37d9ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.990+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8a6510 con 0x5557ad89e670 2024-09-12T17:28:22.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.990+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37c002a040 con 0x5557ad89e670 2024-09-12T17:28:22.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.990+0000 7f37d9ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:22.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.990+0000 7f37d9ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.990+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8a60f0 con 0x5557ad89e670 2024-09-12T17:28:22.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.991+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f37c003a040 con 0x5557ad89e670 2024-09-12T17:28:22.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.991+0000 7f37d9ebb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:22.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.991+0000 7f37d9ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.991+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8a6e30 con 0x5557ad8a2f30 2024-09-12T17:28:22.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.991+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f37d0066040 con 0x5557ad8a2f30 2024-09-12T17:28:22.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.991+0000 7f37d9ebb800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:22.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.991+0000 7f37d9ebb800 20 zone default found 2024-09-12T17:28:22.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.991+0000 7f37d9ebb800 4 Realm: () 2024-09-12T17:28:22.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.991+0000 7f37d9ebb800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:22.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.991+0000 7f37d9ebb800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:22.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.991+0000 7f37d9ebb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:22.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.991+0000 7f37d9ebb800 20 zonegroup default 2024-09-12T17:28:22.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.991+0000 7f37d9ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.991+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8aab20 con 0x7f37d003e060 2024-09-12T17:28:22.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.991+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f37c003a040 con 0x7f37d003e060 2024-09-12T17:28:22.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.991+0000 7f37d9ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:22.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.991+0000 7f37d9ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.991+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8aca40 con 0x5557ad8a7b10 2024-09-12T17:28:22.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.991+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.992+0000 7f37d9ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:22.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.992+0000 7f37d9ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.992+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8aced0 con 0x5557ad8a7b10 2024-09-12T17:28:22.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.992+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.992+0000 7f37d9ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:22.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.992+0000 7f37d9ebb800 20 started sync module instance, tier type = 2024-09-12T17:28:22.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.992+0000 7f37d9ebb800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:22.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.992+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8abd50 con 0x5557ad8a2f30 2024-09-12T17:28:22.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.993+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(44 notify.0 [create] v31'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d0066040 con 0x5557ad8a2f30 2024-09-12T17:28:22.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.993+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93835062067824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8abd50 con 0x5557ad8a2f30 2024-09-12T17:28:22.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.993+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8ada00 con 0x5557ad89e670 2024-09-12T17:28:22.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.994+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93835062067824] v31'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d0066040 con 0x5557ad8a2f30 2024-09-12T17:28:22.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.994+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v31'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c003a040 con 0x5557ad89e670 2024-09-12T17:28:22.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.994+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93835062072528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8abd50 con 0x5557ad89e670 2024-09-12T17:28:22.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.994+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8ae490 con 0x5557ad8a7b10 2024-09-12T17:28:22.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.995+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93835062072528] v31'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c003a040 con 0x5557ad89e670 2024-09-12T17:28:22.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.995+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v31'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.995+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93835062065312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8abcc0 con 0x5557ad8a7b10 2024-09-12T17:28:22.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.995+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8af380 con 0x5557ad8a2f30 2024-09-12T17:28:22.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.996+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(50 notify.3 [create] v31'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d0066040 con 0x5557ad8a2f30 2024-09-12T17:28:22.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.996+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93835062079664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8afb00 con 0x5557ad8a2f30 2024-09-12T17:28:22.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.996+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93835062065312] v31'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.996+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8ae8d0 con 0x5557ad89e670 2024-09-12T17:28:22.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.997+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93835062079664] v31'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d0066040 con 0x5557ad8a2f30 2024-09-12T17:28:22.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.998+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v31'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c003a040 con 0x5557ad89e670 2024-09-12T17:28:22.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.998+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93835062080848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8ae8d0 con 0x5557ad89e670 2024-09-12T17:28:22.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.998+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8b0bc0 con 0x7f37d003e060 2024-09-12T17:28:22.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.999+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(54 notify.5 [create] v31'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c003a040 con 0x7f37d003e060 2024-09-12T17:28:22.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.999+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93835062085392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8b0fe0 con 0x7f37d003e060 2024-09-12T17:28:22.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.999+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93835062080848] v31'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c003a040 con 0x5557ad89e670 2024-09-12T17:28:22.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:21.999+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8b1a80 con 0x7f37d003e060 2024-09-12T17:28:22.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.000+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93835062085392] v31'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c003a040 con 0x7f37d003e060 2024-09-12T17:28:22.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.000+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v31'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c003a040 con 0x7f37d003e060 2024-09-12T17:28:22.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.000+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93835062089040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8b0b30 con 0x7f37d003e060 2024-09-12T17:28:22.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.000+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8b2350 con 0x7f37d003e060 2024-09-12T17:28:22.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.001+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93835062089040] v31'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c003a040 con 0x7f37d003e060 2024-09-12T17:28:22.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.001+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(58 notify.7 [create] v31'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c003a040 con 0x7f37d003e060 2024-09-12T17:28:22.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.001+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93835062083824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8b0b30 con 0x7f37d003e060 2024-09-12T17:28:22.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.001+0000 7f37d9ebb800 20 add_watcher() i=0 2024-09-12T17:28:22.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.001+0000 7f37d9ebb800 20 add_watcher() i=1 2024-09-12T17:28:22.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.001+0000 7f37d9ebb800 20 add_watcher() i=2 2024-09-12T17:28:22.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.001+0000 7f37d9ebb800 20 add_watcher() i=3 2024-09-12T17:28:22.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.001+0000 7f37d9ebb800 20 add_watcher() i=4 2024-09-12T17:28:22.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.001+0000 7f37d9ebb800 20 add_watcher() i=5 2024-09-12T17:28:22.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.001+0000 7f37d9ebb800 20 add_watcher() i=6 2024-09-12T17:28:22.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.002+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93835062083824] v31'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c003a040 con 0x7f37d003e060 2024-09-12T17:28:22.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.002+0000 7f37d9ebb800 20 add_watcher() i=7 2024-09-12T17:28:22.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.002+0000 7f37d9ebb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:22.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.002+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8b5380 con 0x5557ad89e670 2024-09-12T17:28:22.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.002+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f37c003a040 con 0x5557ad89e670 2024-09-12T17:28:22.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.002+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93835062091424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8b2880 con 0x5557ad89e670 2024-09-12T17:28:22.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.003+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93835062091424] v31'168 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f37c003a040 con 0x5557ad89e670 2024-09-12T17:28:22.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.003+0000 7f368dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:22.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.003+0000 7f37d9ebb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:22.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.003+0000 7f37d9ebb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:22.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.003+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8b7830 con 0x5557ad89e670 2024-09-12T17:28:22.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.005+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f37c003a040 con 0x5557ad89e670 2024-09-12T17:28:22.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.005+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8bdeb0 con 0x7f37d003e060 2024-09-12T17:28:22.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.006+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f37c003a040 con 0x7f37d003e060 2024-09-12T17:28:22.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.006+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8be290 con 0x5557ad8a7b10 2024-09-12T17:28:22.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.006+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.006+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8beae0 con 0x5557ad89e670 2024-09-12T17:28:22.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.007+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'169 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f37c003a040 con 0x5557ad89e670 2024-09-12T17:28:22.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.007+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8bd350 con 0x5557ad8a2f30 2024-09-12T17:28:22.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.008+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'56 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f37d0066040 con 0x5557ad8a2f30 2024-09-12T17:28:22.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.008+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8bd350 con 0x5557ad8a7b10 2024-09-12T17:28:22.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.009+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'37 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.009+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8bd480 con 0x5557ad89e670 2024-09-12T17:28:22.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.010+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f37c003a040 con 0x5557ad89e670 2024-09-12T17:28:22.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.010+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8bd480 con 0x7f37d003e060 2024-09-12T17:28:22.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.011+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'37 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f37c003a040 con 0x7f37d003e060 2024-09-12T17:28:22.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.011+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8bd480 con 0x5557ad8a2f30 2024-09-12T17:28:22.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.012+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'23 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f37d0066040 con 0x5557ad8a2f30 2024-09-12T17:28:22.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.012+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8bd650 con 0x5557ad8a7b10 2024-09-12T17:28:22.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.013+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.013+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8bd650 con 0x5557ad8a2f30 2024-09-12T17:28:22.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.014+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'57 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f37d0066040 con 0x5557ad8a2f30 2024-09-12T17:28:22.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.014+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8bd650 con 0x7f37d003e060 2024-09-12T17:28:22.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.016+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f37c003a040 con 0x7f37d003e060 2024-09-12T17:28:22.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.016+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8bd650 con 0x5557ad8a2f30 2024-09-12T17:28:22.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.017+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f37d0066040 con 0x5557ad8a2f30 2024-09-12T17:28:22.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.017+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8bf640 con 0x7f37d003e060 2024-09-12T17:28:22.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.018+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'43 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f37c003a040 con 0x7f37d003e060 2024-09-12T17:28:22.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.018+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8bf640 con 0x5557ad89e670 2024-09-12T17:28:22.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.019+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'170 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f37c003a040 con 0x5557ad89e670 2024-09-12T17:28:22.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.019+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8bf640 con 0x5557ad8a7b10 2024-09-12T17:28:22.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.020+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'50 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.020+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8bf640 con 0x5557ad8a2f30 2024-09-12T17:28:22.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.021+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 <== osd.2 v2:172.21.15.170:6808/3855567754 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'58 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f37d0066040 con 0x5557ad8a2f30 2024-09-12T17:28:22.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.021+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8bf640 con 0x5557ad8a7b10 2024-09-12T17:28:22.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.022+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.022+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8bf640 con 0x5557ad89e670 2024-09-12T17:28:22.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.023+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'32 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f37c003a040 con 0x5557ad89e670 2024-09-12T17:28:22.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.023+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8bf640 con 0x5557ad89e670 2024-09-12T17:28:22.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.023+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'171 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f37c003a040 con 0x5557ad89e670 2024-09-12T17:28:22.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.023+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8bf640 con 0x5557ad8a7b10 2024-09-12T17:28:22.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.024+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'51 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.024+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8bf640 con 0x5557ad8a2f30 2024-09-12T17:28:22.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.025+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 <== osd.2 v2:172.21.15.170:6808/3855567754 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'33 uv32 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f37d0066040 con 0x5557ad8a2f30 2024-09-12T17:28:22.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.025+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8bf640 con 0x5557ad8a7b10 2024-09-12T17:28:22.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.026+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.026+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8bf640 con 0x5557ad8a7b10 2024-09-12T17:28:22.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.027+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.027+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8bf640 con 0x5557ad8a7b10 2024-09-12T17:28:22.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.028+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'18 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.028+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8bf640 con 0x5557ad8a7b10 2024-09-12T17:28:22.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.029+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'38 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.029+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8bf640 con 0x7f37d003e060 2024-09-12T17:28:22.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.031+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f37c003a040 con 0x7f37d003e060 2024-09-12T17:28:22.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.031+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8bf640 con 0x5557ad8a7b10 2024-09-12T17:28:22.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.031+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.032+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8bf640 con 0x7f37d003e060 2024-09-12T17:28:22.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.032+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'38 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f37c003a040 con 0x7f37d003e060 2024-09-12T17:28:22.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.032+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8bf640 con 0x5557ad8a7b10 2024-09-12T17:28:22.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.034+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'52 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.034+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8bf640 con 0x7f37d003e060 2024-09-12T17:28:22.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.035+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'44 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f37c003a040 con 0x7f37d003e060 2024-09-12T17:28:22.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.035+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8bf640 con 0x5557ad8a2f30 2024-09-12T17:28:22.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.036+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 <== osd.2 v2:172.21.15.170:6808/3855567754 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f37d0066040 con 0x5557ad8a2f30 2024-09-12T17:28:22.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.036+0000 7f368cfe1640 20 reqs_thread_entry: start 2024-09-12T17:28:22.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.036+0000 7f37d9ebb800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:22.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.036+0000 7f37d9ebb800 20 Filter name: none 2024-09-12T17:28:22.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.036+0000 7f36067fc640 20 reqs_thread_entry: start 2024-09-12T17:28:22.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.036+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad89e670 2024-09-12T17:28:22.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.037+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37c003a040 con 0x5557ad89e670 2024-09-12T17:28:22.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.037+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8e9ec0 con 0x5557ad89e670 2024-09-12T17:28:22.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.037+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f37c003a040 con 0x5557ad89e670 2024-09-12T17:28:22.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.037+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad89e670 2024-09-12T17:28:22.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.037+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37c003a040 con 0x5557ad89e670 2024-09-12T17:28:22.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.037+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x7f37d003e060 2024-09-12T17:28:22.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.037+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 23 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37c003a040 con 0x7f37d003e060 2024-09-12T17:28:22.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.037+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8e9ec0 con 0x7f37d003e060 2024-09-12T17:28:22.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.038+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 24 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f37c003a040 con 0x7f37d003e060 2024-09-12T17:28:22.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.038+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x7f37d003e060 2024-09-12T17:28:22.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.038+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 25 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37c003a040 con 0x7f37d003e060 2024-09-12T17:28:22.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.038+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad8a7b10 2024-09-12T17:28:22.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.039+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.039+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8e9ec0 con 0x5557ad8a7b10 2024-09-12T17:28:22.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.039+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.039+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad8a7b10 2024-09-12T17:28:22.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.039+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.039+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad89e670 2024-09-12T17:28:22.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.039+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 30 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37c003a040 con 0x5557ad89e670 2024-09-12T17:28:22.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.039+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8e9ec0 con 0x5557ad89e670 2024-09-12T17:28:22.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.040+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 31 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv162 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f37c003a040 con 0x5557ad89e670 2024-09-12T17:28:22.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.040+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad89e670 2024-09-12T17:28:22.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.040+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 32 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37c003a040 con 0x5557ad89e670 2024-09-12T17:28:22.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.040+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad8a2f30 2024-09-12T17:28:22.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.040+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 <== osd.2 v2:172.21.15.170:6808/3855567754 21 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37d0066040 con 0x5557ad8a2f30 2024-09-12T17:28:22.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.040+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8e9ec0 con 0x5557ad8a2f30 2024-09-12T17:28:22.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.040+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 <== osd.2 v2:172.21.15.170:6808/3855567754 22 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv51 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f37d0066040 con 0x5557ad8a2f30 2024-09-12T17:28:22.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.040+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad8a2f30 2024-09-12T17:28:22.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.041+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 <== osd.2 v2:172.21.15.170:6808/3855567754 23 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37d0066040 con 0x5557ad8a2f30 2024-09-12T17:28:22.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.041+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad8a7b10 2024-09-12T17:28:22.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.041+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.041+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8e9ec0 con 0x5557ad8a7b10 2024-09-12T17:28:22.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.041+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv36 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.041+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad8a7b10 2024-09-12T17:28:22.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.041+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.041+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad89e670 2024-09-12T17:28:22.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.042+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 33 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37c003a040 con 0x5557ad89e670 2024-09-12T17:28:22.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.042+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8e9ec0 con 0x5557ad89e670 2024-09-12T17:28:22.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.042+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 34 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv23 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f37c003a040 con 0x5557ad89e670 2024-09-12T17:28:22.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.042+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad89e670 2024-09-12T17:28:22.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.042+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 35 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37c003a040 con 0x5557ad89e670 2024-09-12T17:28:22.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.042+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x7f37d003e060 2024-09-12T17:28:22.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.043+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 26 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37c003a040 con 0x7f37d003e060 2024-09-12T17:28:22.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.043+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8e9ec0 con 0x7f37d003e060 2024-09-12T17:28:22.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.043+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 27 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv36 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f37c003a040 con 0x7f37d003e060 2024-09-12T17:28:22.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.043+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x7f37d003e060 2024-09-12T17:28:22.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.043+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 28 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37c003a040 con 0x7f37d003e060 2024-09-12T17:28:22.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.043+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad8a2f30 2024-09-12T17:28:22.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.044+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 <== osd.2 v2:172.21.15.170:6808/3855567754 24 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37d0066040 con 0x5557ad8a2f30 2024-09-12T17:28:22.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.044+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8e9ec0 con 0x5557ad8a2f30 2024-09-12T17:28:22.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.044+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 <== osd.2 v2:172.21.15.170:6808/3855567754 25 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv22 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f37d0066040 con 0x5557ad8a2f30 2024-09-12T17:28:22.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.044+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad8a2f30 2024-09-12T17:28:22.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.045+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 <== osd.2 v2:172.21.15.170:6808/3855567754 26 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37d0066040 con 0x5557ad8a2f30 2024-09-12T17:28:22.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.045+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad8a7b10 2024-09-12T17:28:22.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.045+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.045+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8e9ec0 con 0x5557ad8a7b10 2024-09-12T17:28:22.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.045+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.045+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad8a7b10 2024-09-12T17:28:22.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.045+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.045+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad8a2f30 2024-09-12T17:28:22.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.046+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 <== osd.2 v2:172.21.15.170:6808/3855567754 27 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d0066040 con 0x5557ad8a2f30 2024-09-12T17:28:22.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.046+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8e9ec0 con 0x5557ad8a2f30 2024-09-12T17:28:22.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.046+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 <== osd.2 v2:172.21.15.170:6808/3855567754 28 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f37d0066040 con 0x5557ad8a2f30 2024-09-12T17:28:22.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.046+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad8a2f30 2024-09-12T17:28:22.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.046+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 <== osd.2 v2:172.21.15.170:6808/3855567754 29 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d0066040 con 0x5557ad8a2f30 2024-09-12T17:28:22.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.046+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x7f37d003e060 2024-09-12T17:28:22.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.047+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 29 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37c003a040 con 0x7f37d003e060 2024-09-12T17:28:22.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.047+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8e9ec0 con 0x7f37d003e060 2024-09-12T17:28:22.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.047+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 30 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f37c003a040 con 0x7f37d003e060 2024-09-12T17:28:22.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.047+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x7f37d003e060 2024-09-12T17:28:22.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.047+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 31 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37c003a040 con 0x7f37d003e060 2024-09-12T17:28:22.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.047+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad8a2f30 2024-09-12T17:28:22.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.048+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 <== osd.2 v2:172.21.15.170:6808/3855567754 30 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d0066040 con 0x5557ad8a2f30 2024-09-12T17:28:22.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.048+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8e9ec0 con 0x5557ad8a2f30 2024-09-12T17:28:22.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.048+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 <== osd.2 v2:172.21.15.170:6808/3855567754 31 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f37d0066040 con 0x5557ad8a2f30 2024-09-12T17:28:22.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.048+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad8a2f30 2024-09-12T17:28:22.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.048+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 <== osd.2 v2:172.21.15.170:6808/3855567754 32 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d0066040 con 0x5557ad8a2f30 2024-09-12T17:28:22.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.048+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x7f37d003e060 2024-09-12T17:28:22.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.049+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 32 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37c003a040 con 0x7f37d003e060 2024-09-12T17:28:22.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.049+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8e9ec0 con 0x7f37d003e060 2024-09-12T17:28:22.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.049+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 33 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f37c003a040 con 0x7f37d003e060 2024-09-12T17:28:22.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.049+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x7f37d003e060 2024-09-12T17:28:22.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.049+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 34 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37c003a040 con 0x7f37d003e060 2024-09-12T17:28:22.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.050+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad89e670 2024-09-12T17:28:22.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.050+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 36 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37c003a040 con 0x5557ad89e670 2024-09-12T17:28:22.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.050+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8e9ec0 con 0x5557ad89e670 2024-09-12T17:28:22.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.050+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 37 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv164 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f37c003a040 con 0x5557ad89e670 2024-09-12T17:28:22.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.050+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad89e670 2024-09-12T17:28:22.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.050+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 38 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37c003a040 con 0x5557ad89e670 2024-09-12T17:28:22.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.050+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad8a7b10 2024-09-12T17:28:22.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.051+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.051+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8e9ec0 con 0x5557ad8a7b10 2024-09-12T17:28:22.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.051+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv47 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.051+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad8a7b10 2024-09-12T17:28:22.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.051+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.051+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad8a2f30 2024-09-12T17:28:22.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.052+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 <== osd.2 v2:172.21.15.170:6808/3855567754 33 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d0066040 con 0x5557ad8a2f30 2024-09-12T17:28:22.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.052+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8e9ec0 con 0x5557ad8a2f30 2024-09-12T17:28:22.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.052+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 <== osd.2 v2:172.21.15.170:6808/3855567754 34 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv55 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f37d0066040 con 0x5557ad8a2f30 2024-09-12T17:28:22.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.052+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad8a2f30 2024-09-12T17:28:22.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.052+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 <== osd.2 v2:172.21.15.170:6808/3855567754 35 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d0066040 con 0x5557ad8a2f30 2024-09-12T17:28:22.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.052+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad8a7b10 2024-09-12T17:28:22.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.052+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.052+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8e9ec0 con 0x5557ad8a7b10 2024-09-12T17:28:22.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.053+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.053+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad8a7b10 2024-09-12T17:28:22.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.053+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.053+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad89e670 2024-09-12T17:28:22.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.053+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 39 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37c003a040 con 0x5557ad89e670 2024-09-12T17:28:22.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.053+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8e9ec0 con 0x5557ad89e670 2024-09-12T17:28:22.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.053+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 40 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv31 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f37c003a040 con 0x5557ad89e670 2024-09-12T17:28:22.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.053+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad89e670 2024-09-12T17:28:22.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.054+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 41 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37c003a040 con 0x5557ad89e670 2024-09-12T17:28:22.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.054+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad89e670 2024-09-12T17:28:22.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.054+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 42 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37c003a040 con 0x5557ad89e670 2024-09-12T17:28:22.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.054+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8e9ec0 con 0x5557ad89e670 2024-09-12T17:28:22.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.054+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 43 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv166 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f37c003a040 con 0x5557ad89e670 2024-09-12T17:28:22.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.054+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad89e670 2024-09-12T17:28:22.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.054+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 44 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37c003a040 con 0x5557ad89e670 2024-09-12T17:28:22.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.054+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad8a7b10 2024-09-12T17:28:22.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.055+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.055+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8e9ec0 con 0x5557ad8a7b10 2024-09-12T17:28:22.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.055+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv49 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.055+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad8a7b10 2024-09-12T17:28:22.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.055+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.055+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad8a2f30 2024-09-12T17:28:22.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.056+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 <== osd.2 v2:172.21.15.170:6808/3855567754 36 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d0066040 con 0x5557ad8a2f30 2024-09-12T17:28:22.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.056+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8e9ec0 con 0x5557ad8a2f30 2024-09-12T17:28:22.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.056+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 <== osd.2 v2:172.21.15.170:6808/3855567754 37 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f37d0066040 con 0x5557ad8a2f30 2024-09-12T17:28:22.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.056+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad8a2f30 2024-09-12T17:28:22.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.056+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 <== osd.2 v2:172.21.15.170:6808/3855567754 38 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d0066040 con 0x5557ad8a2f30 2024-09-12T17:28:22.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.056+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad8a7b10 2024-09-12T17:28:22.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.056+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.056+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8e9ec0 con 0x5557ad8a7b10 2024-09-12T17:28:22.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.057+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.057+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad8a7b10 2024-09-12T17:28:22.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.057+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.057+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad8a7b10 2024-09-12T17:28:22.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.057+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.057+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8e9ec0 con 0x5557ad8a7b10 2024-09-12T17:28:22.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.057+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.057+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad8a7b10 2024-09-12T17:28:22.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.058+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.058+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad8a7b10 2024-09-12T17:28:22.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.058+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.058+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8e9ec0 con 0x5557ad8a7b10 2024-09-12T17:28:22.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.058+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv17 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.058+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad8a7b10 2024-09-12T17:28:22.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.058+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.058+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad8a7b10 2024-09-12T17:28:22.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.059+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.059+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8e9ec0 con 0x5557ad8a7b10 2024-09-12T17:28:22.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.059+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.059+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad8a7b10 2024-09-12T17:28:22.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.059+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.059+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x7f37d003e060 2024-09-12T17:28:22.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.060+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 35 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37c003a040 con 0x7f37d003e060 2024-09-12T17:28:22.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.060+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8e9ec0 con 0x7f37d003e060 2024-09-12T17:28:22.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.060+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 36 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f37c003a040 con 0x7f37d003e060 2024-09-12T17:28:22.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.060+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x7f37d003e060 2024-09-12T17:28:22.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.060+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 37 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37c003a040 con 0x7f37d003e060 2024-09-12T17:28:22.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.060+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad8a7b10 2024-09-12T17:28:22.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.061+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.061+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8e9ec0 con 0x5557ad8a7b10 2024-09-12T17:28:22.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.061+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.061+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad8a7b10 2024-09-12T17:28:22.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.061+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.061+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x7f37d003e060 2024-09-12T17:28:22.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.062+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 38 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37c003a040 con 0x7f37d003e060 2024-09-12T17:28:22.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.062+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8e9ec0 con 0x7f37d003e060 2024-09-12T17:28:22.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.062+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 39 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f37c003a040 con 0x7f37d003e060 2024-09-12T17:28:22.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.062+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x7f37d003e060 2024-09-12T17:28:22.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.062+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 40 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37c003a040 con 0x7f37d003e060 2024-09-12T17:28:22.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.062+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad8a7b10 2024-09-12T17:28:22.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.063+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.063+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8e9ec0 con 0x5557ad8a7b10 2024-09-12T17:28:22.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.063+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv45 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.063+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad8a7b10 2024-09-12T17:28:22.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.063+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.063+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x7f37d003e060 2024-09-12T17:28:22.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.064+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 41 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37c003a040 con 0x7f37d003e060 2024-09-12T17:28:22.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.064+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8e9ec0 con 0x7f37d003e060 2024-09-12T17:28:22.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.064+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 42 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f37c003a040 con 0x7f37d003e060 2024-09-12T17:28:22.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.064+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x7f37d003e060 2024-09-12T17:28:22.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.064+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 43 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37c003a040 con 0x7f37d003e060 2024-09-12T17:28:22.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.064+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad8a2f30 2024-09-12T17:28:22.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.065+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 <== osd.2 v2:172.21.15.170:6808/3855567754 39 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d0066040 con 0x5557ad8a2f30 2024-09-12T17:28:22.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.065+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8e9ec0 con 0x5557ad8a2f30 2024-09-12T17:28:22.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.065+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 <== osd.2 v2:172.21.15.170:6808/3855567754 40 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f37d0066040 con 0x5557ad8a2f30 2024-09-12T17:28:22.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.065+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8eaed0 con 0x5557ad8a2f30 2024-09-12T17:28:22.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.065+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 <== osd.2 v2:172.21.15.170:6808/3855567754 41 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f37d0066040 con 0x5557ad8a2f30 2024-09-12T17:28:22.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.066+0000 7f368dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:22.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.066+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93835062091424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad89b7d0 con 0x5557ad89e670 2024-09-12T17:28:22.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.067+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 45 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 93835062091424] v31'172 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f37c003a040 con 0x5557ad89e670 2024-09-12T17:28:22.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.067+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93835062067824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8b1ea0 con 0x5557ad8a2f30 2024-09-12T17:28:22.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.068+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 <== osd.2 v2:172.21.15.170:6808/3855567754 42 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 93835062067824] v31'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d0066040 con 0x5557ad8a2f30 2024-09-12T17:28:22.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.068+0000 7f37d9ebb800 20 remove_watcher() i=0 2024-09-12T17:28:22.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.068+0000 7f37d9ebb800 2 removed watcher, disabling cache 2024-09-12T17:28:22.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.068+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93835062072528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8b1ea0 con 0x5557ad89e670 2024-09-12T17:28:22.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.069+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 46 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 93835062072528] v31'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c003a040 con 0x5557ad89e670 2024-09-12T17:28:22.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.069+0000 7f37d9ebb800 20 remove_watcher() i=1 2024-09-12T17:28:22.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.069+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93835062065312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8ad4d0 con 0x5557ad8a7b10 2024-09-12T17:28:22.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.070+0000 7f37d79a5640 1 -- 172.21.15.170:0/695162576 <== osd.3 v2:172.21.15.170:6816/2664906588 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 93835062065312] v31'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c8079030 con 0x5557ad8a7b10 2024-09-12T17:28:22.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.070+0000 7f37d9ebb800 20 remove_watcher() i=2 2024-09-12T17:28:22.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.070+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93835062079664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8b1ea0 con 0x5557ad8a2f30 2024-09-12T17:28:22.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.071+0000 7f37d81a6640 1 -- 172.21.15.170:0/695162576 <== osd.2 v2:172.21.15.170:6808/3855567754 43 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 93835062079664] v31'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d0066040 con 0x5557ad8a2f30 2024-09-12T17:28:22.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.071+0000 7f37d9ebb800 20 remove_watcher() i=3 2024-09-12T17:28:22.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.071+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93835062080848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8ab8a0 con 0x5557ad89e670 2024-09-12T17:28:22.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.073+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.1 v2:172.21.15.170:6800/1903654092 47 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 93835062080848] v31'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c003a040 con 0x5557ad89e670 2024-09-12T17:28:22.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.073+0000 7f37d9ebb800 20 remove_watcher() i=4 2024-09-12T17:28:22.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.073+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93835062085392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8ad4d0 con 0x7f37d003e060 2024-09-12T17:28:22.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.074+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 44 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 93835062085392] v31'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c003a040 con 0x7f37d003e060 2024-09-12T17:28:22.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.074+0000 7f37d9ebb800 20 remove_watcher() i=5 2024-09-12T17:28:22.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.074+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93835062089040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8b1ea0 con 0x7f37d003e060 2024-09-12T17:28:22.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.075+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 45 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 93835062089040] v31'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c003a040 con 0x7f37d003e060 2024-09-12T17:28:22.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.075+0000 7f37d9ebb800 20 remove_watcher() i=6 2024-09-12T17:28:22.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.075+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93835062083824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5557ad8ab8a0 con 0x7f37d003e060 2024-09-12T17:28:22.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.075+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 <== osd.0 v2:172.21.15.47:6800/3978157098 46 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 93835062083824] v31'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37c003a040 con 0x7f37d003e060 2024-09-12T17:28:22.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.075+0000 7f37d9ebb800 20 remove_watcher() i=7 2024-09-12T17:28:22.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.076+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f37d003e060 msgr2=0x7f37d00123d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.076+0000 7f37d9ebb800 1 --2- 172.21.15.170:0/695162576 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f37d003e060 0x7f37d00123d0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.076+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5557ad89e670 msgr2=0x5557ad8a0b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.076+0000 7f37d9ebb800 1 --2- 172.21.15.170:0/695162576 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5557ad89e670 0x5557ad8a0b30 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.076+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5557ad8a2f30 msgr2=0x5557ad8a5320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.076+0000 7f37d9ebb800 1 --2- 172.21.15.170:0/695162576 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5557ad8a2f30 0x5557ad8a5320 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.076+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5557ad8a7b10 msgr2=0x5557ad8a9fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.076+0000 7f37d9ebb800 1 --2- 172.21.15.170:0/695162576 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5557ad8a7b10 0x5557ad8a9fd0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.076+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f36a003c730 msgr2=0x7f36a003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.076+0000 7f37d9ebb800 1 --2- 172.21.15.170:0/695162576 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f36a003c730 0x7f36a003ebf0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f37c8051520 tx=0x7f37c808b000 comp rx=0 tx=0).stop 2024-09-12T17:28:22.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.076+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557ad88b7e0 msgr2=0x5557ad892d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.076+0000 7f37d9ebb800 1 --2- 172.21.15.170:0/695162576 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557ad88b7e0 0x5557ad892d20 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f37d0022ff0 tx=0x7f37d0053c60 comp rx=0 tx=0).stop 2024-09-12T17:28:22.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.076+0000 7f37cffff640 1 -- 172.21.15.170:0/695162576 reap_dead start 2024-09-12T17:28:22.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.076+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 shutdown_connections 2024-09-12T17:28:22.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.076+0000 7f37d9ebb800 1 --2- 172.21.15.170:0/695162576 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557ad88b7e0 0x5557ad892d20 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.076+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 >> 172.21.15.170:0/695162576 conn(0x5557ad887be0 msgr2=0x5557ad885df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:22.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.076+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 shutdown_connections 2024-09-12T17:28:22.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.076+0000 7f37d9ebb800 1 -- 172.21.15.170:0/695162576 wait complete. 2024-09-12T17:28:22.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.076+0000 7f37d9ebb800 1 -- 172.21.15.170:0/2961311395 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f36b003c780 msgr2=0x7f36b003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.076+0000 7f37d9ebb800 1 --2- 172.21.15.170:0/2961311395 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f36b003c780 0x7f36b003ec40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f37c8071000 tx=0x7f37c8074f60 comp rx=0 tx=0).stop 2024-09-12T17:28:22.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.076+0000 7f37d9ebb800 1 -- 172.21.15.170:0/2961311395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557ad87ed60 msgr2=0x5557ad87f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.076+0000 7f37d9ebb800 1 --2- 172.21.15.170:0/2961311395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557ad87ed60 0x5557ad87f180 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x5557ad76a950 tx=0x7f37d00167b0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.076+0000 7f37d9ebb800 1 -- 172.21.15.170:0/2961311395 shutdown_connections 2024-09-12T17:28:22.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.076+0000 7f37d9ebb800 1 --2- 172.21.15.170:0/2961311395 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f36b003c780 0x7f36b003ec40 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.076+0000 7f37d9ebb800 1 --2- 172.21.15.170:0/2961311395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557ad87ed60 0x5557ad87f180 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.076+0000 7f37d9ebb800 1 -- 172.21.15.170:0/2961311395 >> 172.21.15.170:0/2961311395 conn(0x5557ad873110 msgr2=0x5557ad8734f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:22.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.076+0000 7f37d9ebb800 1 -- 172.21.15.170:0/2961311395 shutdown_connections 2024-09-12T17:28:22.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.076+0000 7f37d9ebb800 1 -- 172.21.15.170:0/2961311395 wait complete. 2024-09-12T17:28:22.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.077+0000 7f37d9ebb800 1 -- 172.21.15.170:0/3211700375 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5557ad76e020 msgr2=0x5557ad86b1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.077+0000 7f37d9ebb800 1 --2- 172.21.15.170:0/3211700375 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5557ad76e020 0x5557ad86b1c0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.077+0000 7f37d9ebb800 1 -- 172.21.15.170:0/3211700375 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5557ad86da30 msgr2=0x5557ad86fe20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.077+0000 7f37d9ebb800 1 --2- 172.21.15.170:0/3211700375 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5557ad86da30 0x5557ad86fe20 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.077+0000 7f37d9ebb800 1 -- 172.21.15.170:0/3211700375 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f36c003c780 msgr2=0x7f36c003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.077+0000 7f37d9ebb800 1 --2- 172.21.15.170:0/3211700375 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f36c003c780 0x7f36c003ec40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f37c0001e90 tx=0x7f37c0001410 comp rx=0 tx=0).stop 2024-09-12T17:28:22.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.077+0000 7f37d9ebb800 1 -- 172.21.15.170:0/3211700375 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557ad76b690 msgr2=0x5557ad76adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.077+0000 7f37d9ebb800 1 --2- 172.21.15.170:0/3211700375 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557ad76b690 0x5557ad76adb0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f37c805f040 tx=0x7f37c8003020 comp rx=0 tx=0).stop 2024-09-12T17:28:22.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.077+0000 7f37d9ebb800 1 -- 172.21.15.170:0/3211700375 shutdown_connections 2024-09-12T17:28:22.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.077+0000 7f37d9ebb800 1 --2- 172.21.15.170:0/3211700375 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5557ad86da30 0x5557ad86fe20 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.077+0000 7f37d9ebb800 1 --2- 172.21.15.170:0/3211700375 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f36c003c780 0x7f36c003ec40 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.077+0000 7f37d9ebb800 1 --2- 172.21.15.170:0/3211700375 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5557ad76e020 0x5557ad86b1c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.077+0000 7f37d9ebb800 1 --2- 172.21.15.170:0/3211700375 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5557ad76b690 0x5557ad76adb0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.077+0000 7f37d9ebb800 1 -- 172.21.15.170:0/3211700375 >> 172.21.15.170:0/3211700375 conn(0x5557ad7651f0 msgr2=0x5557ad85b640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:22.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.077+0000 7f37d9ebb800 1 -- 172.21.15.170:0/3211700375 shutdown_connections 2024-09-12T17:28:22.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.077+0000 7f37d9ebb800 1 -- 172.21.15.170:0/3211700375 wait complete. 2024-09-12T17:28:22.090 INFO:teuthology.orchestra.run.smithi170.stdout:[] 2024-09-12T17:28:22.090 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T17:28:22.090 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-12T17:28:22.090 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-12T17:28:22.090 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-12T17:28:22.175 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:22.175 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:22.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.174+0000 7f76a8640800 1 Processor -- start 2024-09-12T17:28:22.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.174+0000 7f76a8640800 1 -- start start 2024-09-12T17:28:22.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.175+0000 7f76a8640800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55b966a13000 0x55b966a1bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.175+0000 7f76a8640800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b9668bce40 con 0x55b966a114e0 2024-09-12T17:28:22.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.175+0000 7f76a8640800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x55b966887680 con 0x55b966a13000 2024-09-12T17:28:22.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.175+0000 7f769ffff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55b966a13000 0x55b966a1bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.175+0000 7f769ffff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55b966a13000 0x55b966a1bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:55904/0 (socket says 172.21.15.170:55904) 2024-09-12T17:28:22.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.175+0000 7f76a612a640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x55b966a114e0 0x55b966a118e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:47690/0 (socket says 172.21.15.170:47690) 2024-09-12T17:28:22.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.175+0000 7f769ffff640 1 -- 172.21.15.170:0/572305087 learned_addr learned my addr 172.21.15.170:0/572305087 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:22.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.175+0000 7f769ffff640 1 -- 172.21.15.170:0/572305087 >> v1:172.21.15.47:6789/0 conn(0x55b966a114e0 legacy=0x55b966a118e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.175+0000 7f769ffff640 1 -- 172.21.15.170:0/572305087 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9668a36b0 con 0x55b966a13000 2024-09-12T17:28:22.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.177+0000 7f769ffff640 1 --2- 172.21.15.170:0/572305087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b966a13000 0x55b966a1bb20 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f769000a520 tx=0x7f7690045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2b35ea5514b855e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.177+0000 7f76a5929640 1 -- 172.21.15.170:0/572305087 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7690055070 con 0x55b966a13000 2024-09-12T17:28:22.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.177+0000 7f76a5929640 1 -- 172.21.15.170:0/572305087 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76900515b0 con 0x55b966a13000 2024-09-12T17:28:22.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.177+0000 7f76a5929640 1 -- 172.21.15.170:0/572305087 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76900518d0 con 0x55b966a13000 2024-09-12T17:28:22.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.178+0000 7f76a8640800 1 -- 172.21.15.170:0/572305087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b966a13000 msgr2=0x55b966a1bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.178+0000 7f76a8640800 1 --2- 172.21.15.170:0/572305087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b966a13000 0x55b966a1bb20 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f769000a520 tx=0x7f7690045ba0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.178+0000 7f76a8640800 1 -- 172.21.15.170:0/572305087 shutdown_connections 2024-09-12T17:28:22.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.178+0000 7f76a8640800 1 --2- 172.21.15.170:0/572305087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b966a13000 0x55b966a1bb20 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.178+0000 7f76a8640800 1 -- 172.21.15.170:0/572305087 >> 172.21.15.170:0/572305087 conn(0x55b966a0d1f0 msgr2=0x55b966a0f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:22.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.178+0000 7f76a8640800 1 -- 172.21.15.170:0/572305087 shutdown_connections 2024-09-12T17:28:22.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.178+0000 7f76a8640800 1 -- 172.21.15.170:0/572305087 wait complete. 2024-09-12T17:28:22.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.192+0000 7f76a8640800 1 Processor -- start 2024-09-12T17:28:22.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.192+0000 7f76a8640800 1 -- start start 2024-09-12T17:28:22.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.192+0000 7f76a8640800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b966a114e0 0x55b966b047a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.192+0000 7f76a8640800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b9668abdd0 con 0x55b966a114e0 2024-09-12T17:28:22.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.192+0000 7f76a612a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b966a114e0 0x55b966b047a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.192+0000 7f76a612a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b966a114e0 0x55b966b047a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:55908/0 (socket says 172.21.15.170:55908) 2024-09-12T17:28:22.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.192+0000 7f76a612a640 1 -- 172.21.15.170:0/4166741074 learned_addr learned my addr 172.21.15.170:0/4166741074 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:22.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.192+0000 7f76a612a640 1 -- 172.21.15.170:0/4166741074 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9668c4e10 con 0x55b966a114e0 2024-09-12T17:28:22.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.193+0000 7f76a612a640 1 --2- 172.21.15.170:0/4166741074 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b966a114e0 0x55b966b047a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f769800b260 tx=0x7f769800b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfd39b53bba9b43d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.193+0000 7f7594608640 1 -- 172.21.15.170:0/4166741074 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f769800be60 con 0x55b966a114e0 2024-09-12T17:28:22.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.193+0000 7f7594608640 1 -- 172.21.15.170:0/4166741074 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7698006070 con 0x55b966a114e0 2024-09-12T17:28:22.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.193+0000 7f7594608640 1 -- 172.21.15.170:0/4166741074 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f769800e710 con 0x55b966a114e0 2024-09-12T17:28:22.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.194+0000 7f76a8640800 1 -- 172.21.15.170:0/4166741074 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b966a114e0 msgr2=0x55b966b047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.194+0000 7f76a8640800 1 --2- 172.21.15.170:0/4166741074 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b966a114e0 0x55b966b047a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f769800b260 tx=0x7f769800b660 comp rx=0 tx=0).stop 2024-09-12T17:28:22.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.194+0000 7f76a8640800 1 -- 172.21.15.170:0/4166741074 shutdown_connections 2024-09-12T17:28:22.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.194+0000 7f76a8640800 1 --2- 172.21.15.170:0/4166741074 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b966a114e0 0x55b966b047a0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.194+0000 7f76a8640800 1 -- 172.21.15.170:0/4166741074 >> 172.21.15.170:0/4166741074 conn(0x55b966a0d1f0 msgr2=0x55b966b00120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:22.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.194+0000 7f76a8640800 1 -- 172.21.15.170:0/4166741074 shutdown_connections 2024-09-12T17:28:22.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.194+0000 7f76a8640800 1 -- 172.21.15.170:0/4166741074 wait complete. 2024-09-12T17:28:22.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.194+0000 7f76a8640800 1 Processor -- start 2024-09-12T17:28:22.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.194+0000 7f76a8640800 1 -- start start 2024-09-12T17:28:22.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.194+0000 7f76a8640800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b966a114e0 0x55b966b0c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.194+0000 7f76a8640800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b966a1c360 con 0x55b966a114e0 2024-09-12T17:28:22.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.194+0000 7f76a612a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b966a114e0 0x55b966b0c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.194+0000 7f76a612a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b966a114e0 0x55b966b0c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:55922/0 (socket says 172.21.15.170:55922) 2024-09-12T17:28:22.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.194+0000 7f76a612a640 1 -- 172.21.15.170:0/3127236170 learned_addr learned my addr 172.21.15.170:0/3127236170 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:22.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.195+0000 7f76a612a640 1 -- 172.21.15.170:0/3127236170 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b966b0c680 con 0x55b966a114e0 2024-09-12T17:28:22.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.195+0000 7f76a612a640 1 --2- 172.21.15.170:0/3127236170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b966a114e0 0x55b966b0c120 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x55b966b05730 tx=0x7f7698000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.195+0000 7f7592e05640 1 -- 172.21.15.170:0/3127236170 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f769800ee10 con 0x55b966a114e0 2024-09-12T17:28:22.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.195+0000 7f7592e05640 1 -- 172.21.15.170:0/3127236170 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f769800fa30 con 0x55b966a114e0 2024-09-12T17:28:22.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.195+0000 7f76a8640800 1 -- 172.21.15.170:0/3127236170 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b966b0c910 con 0x55b966a114e0 2024-09-12T17:28:22.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.195+0000 7f7592e05640 1 -- 172.21.15.170:0/3127236170 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f769800fd30 con 0x55b966a114e0 2024-09-12T17:28:22.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.195+0000 7f76a8640800 1 -- 172.21.15.170:0/3127236170 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b966b0d310 con 0x55b966a114e0 2024-09-12T17:28:22.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.196+0000 7f7592e05640 1 -- 172.21.15.170:0/3127236170 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f7698017070 con 0x55b966a114e0 2024-09-12T17:28:22.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.196+0000 7f7592e05640 1 --2- 172.21.15.170:0/3127236170 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f758c03c780 0x7f758c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.196+0000 7f7592e05640 1 -- 172.21.15.170:0/3127236170 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f7698015020 con 0x55b966a114e0 2024-09-12T17:28:22.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.196+0000 7f769ffff640 1 --2- 172.21.15.170:0/3127236170 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f758c03c780 0x7f758c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.196+0000 7f76a8640800 1 --2- 172.21.15.170:0/3127236170 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b966a13000 0x55b966b13770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.196+0000 7f76a8640800 1 -- 172.21.15.170:0/3127236170 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b966b13cb0 con 0x55b966a13000 2024-09-12T17:28:22.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.196+0000 7f76a692b640 1 --2- 172.21.15.170:0/3127236170 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b966a13000 0x55b966b13770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.197+0000 7f769ffff640 1 --2- 172.21.15.170:0/3127236170 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f758c03c780 0x7f758c03ec40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7690057000 tx=0x7f7690052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.197+0000 7f76a692b640 1 --2- 172.21.15.170:0/3127236170 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b966a13000 0x55b966b13770 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.197+0000 7f76a692b640 1 -- 172.21.15.170:0/3127236170 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f76a000a4d0 con 0x55b966a13000 2024-09-12T17:28:22.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.197+0000 7f76a8640800 1 -- 172.21.15.170:0/3127236170 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b966b14050 con 0x55b966a13000 2024-09-12T17:28:22.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.197+0000 7f76a692b640 1 -- 172.21.15.170:0/3127236170 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f76a000a4d0 con 0x55b966a13000 2024-09-12T17:28:22.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.197+0000 7f76a8640800 1 --2- 172.21.15.170:0/3127236170 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b966b15b10 0x55b966b17f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.197+0000 7f76a8640800 1 -- 172.21.15.170:0/3127236170 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b966b18710 con 0x55b966b15b10 2024-09-12T17:28:22.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.197+0000 7f76a612a640 1 --2- 172.21.15.170:0/3127236170 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b966b15b10 0x55b966b17f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.198+0000 7f76a612a640 1 --2- 172.21.15.170:0/3127236170 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b966b15b10 0x55b966b17f80 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.198+0000 7f76a612a640 1 -- 172.21.15.170:0/3127236170 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f769802e070 con 0x55b966b15b10 2024-09-12T17:28:22.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.198+0000 7f76a8640800 1 -- 172.21.15.170:0/3127236170 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b966b148a0 con 0x55b966a13000 2024-09-12T17:28:22.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.198+0000 7f76a692b640 1 -- 172.21.15.170:0/3127236170 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f76a000a4d0 con 0x55b966a13000 2024-09-12T17:28:22.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.198+0000 7f76a8640800 1 -- 172.21.15.170:0/3127236170 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b966b14c80 con 0x55b966b15b10 2024-09-12T17:28:22.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.198+0000 7f76a612a640 1 -- 172.21.15.170:0/3127236170 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f769802e070 con 0x55b966b15b10 2024-09-12T17:28:22.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.199+0000 7f76a8640800 1 Processor -- start 2024-09-12T17:28:22.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.199+0000 7f76a8640800 1 -- start start 2024-09-12T17:28:22.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.199+0000 7f76a8640800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b966b26fc0 0x55b966b273e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.199+0000 7f76a8640800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b966909a00 con 0x55b966b26fc0 2024-09-12T17:28:22.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.199+0000 7f76a692b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b966b26fc0 0x55b966b273e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.199+0000 7f76a692b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b966b26fc0 0x55b966b273e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:55936/0 (socket says 172.21.15.170:55936) 2024-09-12T17:28:22.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.199+0000 7f76a692b640 1 -- 172.21.15.170:0/3320000577 learned_addr learned my addr 172.21.15.170:0/3320000577 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:22.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.199+0000 7f76a692b640 1 -- 172.21.15.170:0/3320000577 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b966b27a20 con 0x55b966b26fc0 2024-09-12T17:28:22.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.200+0000 7f76a692b640 1 --2- 172.21.15.170:0/3320000577 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b966b26fc0 0x55b966b273e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x55b966b0d120 tx=0x7f76a00167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.200+0000 7f758bfff640 1 -- 172.21.15.170:0/3320000577 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76a0013640 con 0x55b966b26fc0 2024-09-12T17:28:22.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.200+0000 7f76a8640800 1 -- 172.21.15.170:0/3320000577 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b966b28250 con 0x55b966b26fc0 2024-09-12T17:28:22.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.200+0000 7f758bfff640 1 -- 172.21.15.170:0/3320000577 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76a00137e0 con 0x55b966b26fc0 2024-09-12T17:28:22.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.200+0000 7f76a8640800 1 -- 172.21.15.170:0/3320000577 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b966b287f0 con 0x55b966b26fc0 2024-09-12T17:28:22.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.200+0000 7f758bfff640 1 -- 172.21.15.170:0/3320000577 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76a0013ac0 con 0x55b966b26fc0 2024-09-12T17:28:22.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.201+0000 7f758bfff640 1 -- 172.21.15.170:0/3320000577 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f76a0011040 con 0x55b966b26fc0 2024-09-12T17:28:22.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.201+0000 7f758bfff640 1 --2- 172.21.15.170:0/3320000577 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f758003c730 0x7f758003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.201+0000 7f758bfff640 1 -- 172.21.15.170:0/3320000577 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f76a000e040 con 0x55b966b26fc0 2024-09-12T17:28:22.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.201+0000 7f76a612a640 1 --2- 172.21.15.170:0/3320000577 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f758003c730 0x7f758003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.201+0000 7f76a8640800 1 Processor -- start 2024-09-12T17:28:22.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.201+0000 7f76a8640800 1 -- start start 2024-09-12T17:28:22.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.201+0000 7f76a612a640 1 --2- 172.21.15.170:0/3320000577 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f758003c730 0x7f758003ebf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x55b966b0e1f0 tx=0x7f76980525b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.202+0000 7f76a8640800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b966b34b30 0x55b966b34f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.202+0000 7f76a8640800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b966b04ff0 con 0x55b966b34b30 2024-09-12T17:28:22.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.202+0000 7f76a692b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b966b34b30 0x55b966b34f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.202+0000 7f76a692b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b966b34b30 0x55b966b34f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:55942/0 (socket says 172.21.15.170:55942) 2024-09-12T17:28:22.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.202+0000 7f76a692b640 1 -- 172.21.15.170:0/3397525445 learned_addr learned my addr 172.21.15.170:0/3397525445 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:22.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.202+0000 7f76a692b640 1 -- 172.21.15.170:0/3397525445 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b966b35520 con 0x55b966b34b30 2024-09-12T17:28:22.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.202+0000 7f76a692b640 1 --2- 172.21.15.170:0/3397525445 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b966b34b30 0x55b966b34f30 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f76a0016cd0 tx=0x7f76a001f400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbe40f0b83a31056 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.202+0000 7f7589ffb640 1 -- 172.21.15.170:0/3397525445 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76a0055040 con 0x55b966b34b30 2024-09-12T17:28:22.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.202+0000 7f7589ffb640 1 -- 172.21.15.170:0/3397525445 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76a00143c0 con 0x55b966b34b30 2024-09-12T17:28:22.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.202+0000 7f7589ffb640 1 -- 172.21.15.170:0/3397525445 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76a0021a60 con 0x55b966b34b30 2024-09-12T17:28:22.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.203+0000 7f76a8640800 1 -- 172.21.15.170:0/3397525445 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b966b34b30 msgr2=0x55b966b34f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.203+0000 7f76a8640800 1 --2- 172.21.15.170:0/3397525445 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b966b34b30 0x55b966b34f30 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f76a0016cd0 tx=0x7f76a001f400 comp rx=0 tx=0).stop 2024-09-12T17:28:22.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.203+0000 7f76a8640800 1 -- 172.21.15.170:0/3397525445 shutdown_connections 2024-09-12T17:28:22.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.203+0000 7f76a8640800 1 --2- 172.21.15.170:0/3397525445 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b966b34b30 0x55b966b34f30 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.203+0000 7f76a8640800 1 -- 172.21.15.170:0/3397525445 >> 172.21.15.170:0/3397525445 conn(0x55b966b2fe80 msgr2=0x55b966b2e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:22.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.203+0000 7f76a8640800 1 -- 172.21.15.170:0/3397525445 shutdown_connections 2024-09-12T17:28:22.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.203+0000 7f76a8640800 1 -- 172.21.15.170:0/3397525445 wait complete. 2024-09-12T17:28:22.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.203+0000 7f76a8640800 1 Processor -- start 2024-09-12T17:28:22.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.203+0000 7f76a8640800 1 -- start start 2024-09-12T17:28:22.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.203+0000 7f76a8640800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b966b34b30 0x55b966b3b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.203+0000 7f76a8640800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b966b33ac0 con 0x55b966b34b30 2024-09-12T17:28:22.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.204+0000 7f76a692b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b966b34b30 0x55b966b3b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.204+0000 7f76a692b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b966b34b30 0x55b966b3b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:55956/0 (socket says 172.21.15.170:55956) 2024-09-12T17:28:22.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.204+0000 7f76a692b640 1 -- 172.21.15.170:0/3103894459 learned_addr learned my addr 172.21.15.170:0/3103894459 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:22.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.204+0000 7f76a692b640 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b966b3b620 con 0x55b966b34b30 2024-09-12T17:28:22.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.204+0000 7f76a692b640 1 --2- 172.21.15.170:0/3103894459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b966b34b30 0x55b966b3b0c0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f76a001f500 tx=0x7f76a0053cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.204+0000 7f7577fff640 1 -- 172.21.15.170:0/3103894459 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76a0037070 con 0x55b966b34b30 2024-09-12T17:28:22.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.204+0000 7f7577fff640 1 -- 172.21.15.170:0/3103894459 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76a004a070 con 0x55b966b34b30 2024-09-12T17:28:22.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.204+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b966b3b8b0 con 0x55b966b34b30 2024-09-12T17:28:22.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.204+0000 7f7577fff640 1 -- 172.21.15.170:0/3103894459 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76a0021910 con 0x55b966b34b30 2024-09-12T17:28:22.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.204+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b966b3c230 con 0x55b966b34b30 2024-09-12T17:28:22.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.205+0000 7f7577fff640 1 -- 172.21.15.170:0/3103894459 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f76a003a070 con 0x55b966b34b30 2024-09-12T17:28:22.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.205+0000 7f7577fff640 1 --2- 172.21.15.170:0/3103894459 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f757003c780 0x7f757003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.205+0000 7f7577fff640 1 -- 172.21.15.170:0/3103894459 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f76a003dbf0 con 0x55b966b34b30 2024-09-12T17:28:22.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.205+0000 7f76a612a640 1 --2- 172.21.15.170:0/3103894459 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f757003c780 0x7f757003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.206+0000 7f76a612a640 1 --2- 172.21.15.170:0/3103894459 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f757003c780 0x7f757003ec40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f769800efd0 tx=0x7f7698048000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.206+0000 7f76a8640800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.206+0000 7f76a8640800 1 --2- 172.21.15.170:0/3103894459 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b966b469a0 0x55b966b48e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.206+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b966b495b0 con 0x55b966b469a0 2024-09-12T17:28:22.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.206+0000 7f769ffff640 1 --2- 172.21.15.170:0/3103894459 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b966b469a0 0x55b966b48e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.206+0000 7f769ffff640 1 --2- 172.21.15.170:0/3103894459 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b966b469a0 0x55b966b48e60 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.207+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7690057030 con 0x55b966b469a0 2024-09-12T17:28:22.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.207+0000 7f76a8640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:22.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.207+0000 7f76a8640800 20 realm 2024-09-12T17:28:22.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.207+0000 7f76a8640800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.207+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b966b499e0 con 0x55b966b469a0 2024-09-12T17:28:22.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.207+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7690057030 con 0x55b966b469a0 2024-09-12T17:28:22.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.207+0000 7f76a8640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:22.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.207+0000 7f76a8640800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:22.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.207+0000 7f76a8640800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.207+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b966b4a2b0 con 0x55b966b469a0 2024-09-12T17:28:22.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.207+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7690057030 con 0x55b966b469a0 2024-09-12T17:28:22.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.207+0000 7f76a8640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:22.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.207+0000 7f76a8640800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.207+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b966b4a650 con 0x55b966b469a0 2024-09-12T17:28:22.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.207+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7690057030 con 0x55b966b469a0 2024-09-12T17:28:22.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.207+0000 7f76a8640800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:22.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.207+0000 7f76a8640800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.207+0000 7f76a8640800 1 --2- 172.21.15.170:0/3103894459 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b966b4b3b0 0x55b966b4d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.207+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b966b4ddb0 con 0x55b966b4b3b0 2024-09-12T17:28:22.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.207+0000 7f76a692b640 1 --2- 172.21.15.170:0/3103894459 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b966b4b3b0 0x55b966b4d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.208+0000 7f76a692b640 1 --2- 172.21.15.170:0/3103894459 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b966b4b3b0 0x55b966b4d7a0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.208+0000 7f76a692b640 1 -- 172.21.15.170:0/3103894459 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f76a0039030 con 0x55b966b4b3b0 2024-09-12T17:28:22.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.208+0000 7f76a8640800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:22.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.208+0000 7f76a8640800 20 searching for the correct realm 2024-09-12T17:28:22.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.208+0000 7f76a8640800 1 --2- 172.21.15.170:0/3103894459 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55b966b4fd80 0x55b966b52240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.208+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b966b528c0 con 0x55b966b4fd80 2024-09-12T17:28:22.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.208+0000 7f76a612a640 1 --2- 172.21.15.170:0/3103894459 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55b966b4fd80 0x55b966b52240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.208+0000 7f76a612a640 1 --2- 172.21.15.170:0/3103894459 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55b966b4fd80 0x55b966b52240 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.209+0000 7f76a612a640 1 -- 172.21.15.170:0/3103894459 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f769802e070 con 0x55b966b4fd80 2024-09-12T17:28:22.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.209+0000 7f76a612a640 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b966b528c0 con 0x55b966b4b3b0 2024-09-12T17:28:22.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.209+0000 7f76a692b640 1 -- 172.21.15.170:0/3103894459 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76a0039030 con 0x55b966b4b3b0 2024-09-12T17:28:22.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.209+0000 7f76a692b640 1 --2- 172.21.15.170:0/3103894459 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f76a003c060 0x7f76a0023070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.209+0000 7f76a692b640 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b966b528c0 con 0x7f76a003c060 2024-09-12T17:28:22.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.209+0000 7f769ffff640 1 --2- 172.21.15.170:0/3103894459 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f76a003c060 0x7f76a0023070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.210+0000 7f769ffff640 1 --2- 172.21.15.170:0/3103894459 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f76a003c060 0x7f76a0023070 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.210+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7690057030 con 0x7f76a003c060 2024-09-12T17:28:22.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.210+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b966b528c0 con 0x55b966b469a0 2024-09-12T17:28:22.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.210+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7690057030 con 0x55b966b469a0 2024-09-12T17:28:22.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.210+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b966b528c0 con 0x55b966b469a0 2024-09-12T17:28:22.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.210+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7690057030 con 0x55b966b469a0 2024-09-12T17:28:22.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.210+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b966b528c0 con 0x7f76a003c060 2024-09-12T17:28:22.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.211+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7690057030 con 0x7f76a003c060 2024-09-12T17:28:22.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.211+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b966b528c0 con 0x7f76a003c060 2024-09-12T17:28:22.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.211+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7690057030 con 0x7f76a003c060 2024-09-12T17:28:22.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.211+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b966b528c0 con 0x55b966b4b3b0 2024-09-12T17:28:22.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.211+0000 7f76a692b640 1 -- 172.21.15.170:0/3103894459 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76a0039030 con 0x55b966b4b3b0 2024-09-12T17:28:22.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.211+0000 7f76a692b640 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b966b528c0 con 0x55b966b4fd80 2024-09-12T17:28:22.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.211+0000 7f76a612a640 1 -- 172.21.15.170:0/3103894459 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f769802e070 con 0x55b966b4fd80 2024-09-12T17:28:22.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.211+0000 7f76a612a640 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b966b528c0 con 0x55b966b469a0 2024-09-12T17:28:22.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.211+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7690057030 con 0x55b966b469a0 2024-09-12T17:28:22.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.211+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b966b528c0 con 0x7f76a003c060 2024-09-12T17:28:22.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.212+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7690057030 con 0x7f76a003c060 2024-09-12T17:28:22.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.212+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b966b528c0 con 0x55b966b469a0 2024-09-12T17:28:22.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.212+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7690057030 con 0x55b966b469a0 2024-09-12T17:28:22.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.212+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b966b528c0 con 0x55b966b4b3b0 2024-09-12T17:28:22.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.212+0000 7f76a692b640 1 -- 172.21.15.170:0/3103894459 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f76a0039030 con 0x55b966b4b3b0 2024-09-12T17:28:22.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.212+0000 7f76a692b640 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b966b528c0 con 0x55b966b4fd80 2024-09-12T17:28:22.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.212+0000 7f76a612a640 1 -- 172.21.15.170:0/3103894459 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f769802e070 con 0x55b966b4fd80 2024-09-12T17:28:22.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.212+0000 7f76a612a640 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b966b528c0 con 0x55b966b4fd80 2024-09-12T17:28:22.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.213+0000 7f76a612a640 1 -- 172.21.15.170:0/3103894459 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f769802e070 con 0x55b966b4fd80 2024-09-12T17:28:22.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.213+0000 7f76a612a640 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b966b528c0 con 0x55b966b4b3b0 2024-09-12T17:28:22.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.213+0000 7f76a692b640 1 -- 172.21.15.170:0/3103894459 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76a0039030 con 0x55b966b4b3b0 2024-09-12T17:28:22.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.213+0000 7f76a692b640 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b966b528c0 con 0x55b966b4fd80 2024-09-12T17:28:22.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.213+0000 7f76a612a640 1 -- 172.21.15.170:0/3103894459 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f769802e070 con 0x55b966b4fd80 2024-09-12T17:28:22.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.213+0000 7f76a612a640 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b966b528c0 con 0x55b966b4fd80 2024-09-12T17:28:22.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.213+0000 7f76a612a640 1 -- 172.21.15.170:0/3103894459 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f769802e070 con 0x55b966b4fd80 2024-09-12T17:28:22.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.213+0000 7f76a612a640 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b966b528c0 con 0x55b966b469a0 2024-09-12T17:28:22.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.213+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7690057030 con 0x55b966b469a0 2024-09-12T17:28:22.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.213+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b966b528c0 con 0x55b966b469a0 2024-09-12T17:28:22.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.214+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7690057030 con 0x55b966b469a0 2024-09-12T17:28:22.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.214+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b966b528c0 con 0x7f76a003c060 2024-09-12T17:28:22.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.214+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7690057030 con 0x7f76a003c060 2024-09-12T17:28:22.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.214+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b966b528c0 con 0x55b966b4fd80 2024-09-12T17:28:22.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.214+0000 7f76a612a640 1 -- 172.21.15.170:0/3103894459 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f769802e070 con 0x55b966b4fd80 2024-09-12T17:28:22.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.214+0000 7f76a612a640 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b966b528c0 con 0x55b966b4b3b0 2024-09-12T17:28:22.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.214+0000 7f76a692b640 1 -- 172.21.15.170:0/3103894459 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76a0039030 con 0x55b966b4b3b0 2024-09-12T17:28:22.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.214+0000 7f76a692b640 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b966b528c0 con 0x55b966b469a0 2024-09-12T17:28:22.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.214+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7690057030 con 0x55b966b469a0 2024-09-12T17:28:22.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.214+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b966b528c0 con 0x7f76a003c060 2024-09-12T17:28:22.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.215+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7690057030 con 0x7f76a003c060 2024-09-12T17:28:22.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.215+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b966b528c0 con 0x55b966b4fd80 2024-09-12T17:28:22.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.215+0000 7f76a612a640 1 -- 172.21.15.170:0/3103894459 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f769802e070 con 0x55b966b4fd80 2024-09-12T17:28:22.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.215+0000 7f76a612a640 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b966b528c0 con 0x7f76a003c060 2024-09-12T17:28:22.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.215+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7690057030 con 0x7f76a003c060 2024-09-12T17:28:22.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.215+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b966b528c0 con 0x55b966b4b3b0 2024-09-12T17:28:22.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.215+0000 7f76a692b640 1 -- 172.21.15.170:0/3103894459 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76a0039030 con 0x55b966b4b3b0 2024-09-12T17:28:22.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.215+0000 7f76a692b640 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b966b528c0 con 0x55b966b4fd80 2024-09-12T17:28:22.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.216+0000 7f76a612a640 1 -- 172.21.15.170:0/3103894459 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f769802e070 con 0x55b966b4fd80 2024-09-12T17:28:22.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.216+0000 7f76a612a640 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b966b528c0 con 0x7f76a003c060 2024-09-12T17:28:22.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.216+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7690057030 con 0x7f76a003c060 2024-09-12T17:28:22.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.216+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b966b528c0 con 0x55b966b469a0 2024-09-12T17:28:22.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.216+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7690057030 con 0x55b966b469a0 2024-09-12T17:28:22.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.216+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b966b528c0 con 0x55b966b4b3b0 2024-09-12T17:28:22.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.216+0000 7f76a692b640 1 -- 172.21.15.170:0/3103894459 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(37 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f76a0039030 con 0x55b966b4b3b0 2024-09-12T17:28:22.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.216+0000 7f76a8640800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:22.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.216+0000 7f76a8640800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:22.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.216+0000 7f76a8640800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:22.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.216+0000 7f76a8640800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:22.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.216+0000 7f76a8640800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:22.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.216+0000 7f76a8640800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:22.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.216+0000 7f76a8640800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.216+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b966b4e770 con 0x55b966b469a0 2024-09-12T17:28:22.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.217+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7690057030 con 0x55b966b469a0 2024-09-12T17:28:22.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.217+0000 7f76a8640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:22.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.217+0000 7f76a8640800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.217+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b966b4f010 con 0x55b966b469a0 2024-09-12T17:28:22.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.217+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7690057030 con 0x55b966b469a0 2024-09-12T17:28:22.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.217+0000 7f76a8640800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:22.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.217+0000 7f76a8640800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.217+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b966b4e3b0 con 0x55b966b4b3b0 2024-09-12T17:28:22.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.217+0000 7f76a692b640 1 -- 172.21.15.170:0/3103894459 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f76a0039030 con 0x55b966b4b3b0 2024-09-12T17:28:22.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.217+0000 7f76a8640800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:22.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.217+0000 7f76a8640800 20 zone default found 2024-09-12T17:28:22.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.217+0000 7f76a8640800 4 Realm: () 2024-09-12T17:28:22.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.217+0000 7f76a8640800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:22.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.217+0000 7f76a8640800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:22.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.217+0000 7f76a8640800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:22.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.217+0000 7f76a8640800 20 zonegroup default 2024-09-12T17:28:22.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.217+0000 7f76a8640800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.217+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b966b531f0 con 0x7f76a003c060 2024-09-12T17:28:22.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.217+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7690057030 con 0x7f76a003c060 2024-09-12T17:28:22.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.217+0000 7f76a8640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:22.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.217+0000 7f76a8640800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.217+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b966b55430 con 0x55b966b4fd80 2024-09-12T17:28:22.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.218+0000 7f76a612a640 1 -- 172.21.15.170:0/3103894459 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f769802e070 con 0x55b966b4fd80 2024-09-12T17:28:22.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.218+0000 7f76a8640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:22.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.218+0000 7f76a8640800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.218+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b966b557d0 con 0x55b966b4fd80 2024-09-12T17:28:22.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.218+0000 7f76a612a640 1 -- 172.21.15.170:0/3103894459 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f769802e070 con 0x55b966b4fd80 2024-09-12T17:28:22.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.218+0000 7f76a8640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:22.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.218+0000 7f76a8640800 20 started sync module instance, tier type = 2024-09-12T17:28:22.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.218+0000 7f76a8640800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:22.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.218+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b548c0 con 0x55b966b4b3b0 2024-09-12T17:28:22.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.219+0000 7f76a692b640 1 -- 172.21.15.170:0/3103894459 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(44 notify.0 [create] v31'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76a0039030 con 0x55b966b4b3b0 2024-09-12T17:28:22.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.219+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94254780468400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b54520 con 0x55b966b4b3b0 2024-09-12T17:28:22.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.219+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b56690 con 0x55b966b469a0 2024-09-12T17:28:22.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.220+0000 7f76a692b640 1 -- 172.21.15.170:0/3103894459 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94254780468400] v31'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76a0039030 con 0x55b966b4b3b0 2024-09-12T17:28:22.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.220+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v31'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7690057030 con 0x55b966b469a0 2024-09-12T17:28:22.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.220+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94254780472256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b56690 con 0x55b966b469a0 2024-09-12T17:28:22.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.220+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b570b0 con 0x55b966b4fd80 2024-09-12T17:28:22.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.221+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94254780472256] v31'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7690057030 con 0x55b966b469a0 2024-09-12T17:28:22.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.221+0000 7f76a612a640 1 -- 172.21.15.170:0/3103894459 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v31'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f769802e070 con 0x55b966b4fd80 2024-09-12T17:28:22.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.221+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94254780473824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b56600 con 0x55b966b4fd80 2024-09-12T17:28:22.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.221+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b57f70 con 0x55b966b4b3b0 2024-09-12T17:28:22.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.222+0000 7f76a612a640 1 -- 172.21.15.170:0/3103894459 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94254780473824] v31'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f769802e070 con 0x55b966b4fd80 2024-09-12T17:28:22.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.223+0000 7f76a692b640 1 -- 172.21.15.170:0/3103894459 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(50 notify.3 [create] v31'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76a0039030 con 0x55b966b4b3b0 2024-09-12T17:28:22.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.223+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94254780480192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b57ee0 con 0x55b966b4b3b0 2024-09-12T17:28:22.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.223+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b58e30 con 0x55b966b469a0 2024-09-12T17:28:22.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.224+0000 7f76a692b640 1 -- 172.21.15.170:0/3103894459 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94254780480192] v31'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76a0039030 con 0x55b966b4b3b0 2024-09-12T17:28:22.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.224+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v31'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7690057030 con 0x55b966b469a0 2024-09-12T17:28:22.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.224+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94254780482400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b58e30 con 0x55b966b469a0 2024-09-12T17:28:22.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.224+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b597f0 con 0x7f76a003c060 2024-09-12T17:28:22.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.225+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(54 notify.5 [create] v31'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7690057030 con 0x7f76a003c060 2024-09-12T17:28:22.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.225+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94254780482400] v31'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7690057030 con 0x55b966b469a0 2024-09-12T17:28:22.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.225+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94254780486464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b59760 con 0x7f76a003c060 2024-09-12T17:28:22.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.225+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b5a270 con 0x7f76a003c060 2024-09-12T17:28:22.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.226+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94254780486464] v31'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7690057030 con 0x7f76a003c060 2024-09-12T17:28:22.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.226+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v31'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7690057030 con 0x7f76a003c060 2024-09-12T17:28:22.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.226+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94254780483968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b5a230 con 0x7f76a003c060 2024-09-12T17:28:22.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.226+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b5abf0 con 0x7f76a003c060 2024-09-12T17:28:22.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.227+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94254780483968] v31'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7690057030 con 0x7f76a003c060 2024-09-12T17:28:22.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.227+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(58 notify.7 [create] v31'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7690057030 con 0x7f76a003c060 2024-09-12T17:28:22.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.227+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94254780488592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b5abf0 con 0x7f76a003c060 2024-09-12T17:28:22.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.227+0000 7f76a8640800 20 add_watcher() i=0 2024-09-12T17:28:22.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.227+0000 7f76a8640800 20 add_watcher() i=1 2024-09-12T17:28:22.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.227+0000 7f76a8640800 20 add_watcher() i=2 2024-09-12T17:28:22.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.227+0000 7f76a8640800 20 add_watcher() i=3 2024-09-12T17:28:22.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.227+0000 7f76a8640800 20 add_watcher() i=4 2024-09-12T17:28:22.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.227+0000 7f76a8640800 20 add_watcher() i=5 2024-09-12T17:28:22.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.227+0000 7f76a8640800 20 add_watcher() i=6 2024-09-12T17:28:22.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.228+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94254780488592] v31'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7690057030 con 0x7f76a003c060 2024-09-12T17:28:22.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.228+0000 7f76a8640800 20 add_watcher() i=7 2024-09-12T17:28:22.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.228+0000 7f76a8640800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:22.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.228+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b966b5e010 con 0x55b966b469a0 2024-09-12T17:28:22.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.228+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7690057030 con 0x55b966b469a0 2024-09-12T17:28:22.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.228+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94254780492048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b5b510 con 0x55b966b469a0 2024-09-12T17:28:22.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.229+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94254780492048] v31'173 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7690057030 con 0x55b966b469a0 2024-09-12T17:28:22.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.229+0000 7f755cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:22.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.230+0000 7f76a8640800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:22.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.230+0000 7f76a8640800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:22.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.230+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b66910 con 0x55b966b469a0 2024-09-12T17:28:22.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.231+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7690057030 con 0x55b966b469a0 2024-09-12T17:28:22.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.231+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b60390 con 0x7f76a003c060 2024-09-12T17:28:22.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.232+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7690057030 con 0x7f76a003c060 2024-09-12T17:28:22.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.232+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b67330 con 0x55b966b4fd80 2024-09-12T17:28:22.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.233+0000 7f76a612a640 1 -- 172.21.15.170:0/3103894459 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f769802e070 con 0x55b966b4fd80 2024-09-12T17:28:22.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.233+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b67b80 con 0x55b966b469a0 2024-09-12T17:28:22.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.234+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'174 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7690057030 con 0x55b966b469a0 2024-09-12T17:28:22.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.234+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b65fa0 con 0x55b966b4b3b0 2024-09-12T17:28:22.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.235+0000 7f76a692b640 1 -- 172.21.15.170:0/3103894459 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'59 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f76a0039030 con 0x55b966b4b3b0 2024-09-12T17:28:22.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.235+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b65fa0 con 0x55b966b4fd80 2024-09-12T17:28:22.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.236+0000 7f76a612a640 1 -- 172.21.15.170:0/3103894459 <== osd.3 v2:172.21.15.170:6816/2664906588 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'39 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f769802e070 con 0x55b966b4fd80 2024-09-12T17:28:22.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.236+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b65fa0 con 0x55b966b469a0 2024-09-12T17:28:22.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.237+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7690057030 con 0x55b966b469a0 2024-09-12T17:28:22.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.237+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b66050 con 0x7f76a003c060 2024-09-12T17:28:22.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.238+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'39 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7690057030 con 0x7f76a003c060 2024-09-12T17:28:22.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.238+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b661a0 con 0x55b966b4b3b0 2024-09-12T17:28:22.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.239+0000 7f76a692b640 1 -- 172.21.15.170:0/3103894459 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'24 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f76a0039030 con 0x55b966b4b3b0 2024-09-12T17:28:22.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.239+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b686e0 con 0x55b966b4fd80 2024-09-12T17:28:22.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.240+0000 7f76a612a640 1 -- 172.21.15.170:0/3103894459 <== osd.3 v2:172.21.15.170:6816/2664906588 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f769802e070 con 0x55b966b4fd80 2024-09-12T17:28:22.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.240+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b686e0 con 0x55b966b4b3b0 2024-09-12T17:28:22.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.241+0000 7f76a692b640 1 -- 172.21.15.170:0/3103894459 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'60 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f76a0039030 con 0x55b966b4b3b0 2024-09-12T17:28:22.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.241+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b686e0 con 0x7f76a003c060 2024-09-12T17:28:22.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.242+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7690057030 con 0x7f76a003c060 2024-09-12T17:28:22.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.242+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b686e0 con 0x55b966b4b3b0 2024-09-12T17:28:22.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.243+0000 7f76a692b640 1 -- 172.21.15.170:0/3103894459 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f76a0039030 con 0x55b966b4b3b0 2024-09-12T17:28:22.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.243+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b686e0 con 0x7f76a003c060 2024-09-12T17:28:22.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.244+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'45 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7690057030 con 0x7f76a003c060 2024-09-12T17:28:22.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.244+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b686e0 con 0x55b966b469a0 2024-09-12T17:28:22.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.245+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'175 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7690057030 con 0x55b966b469a0 2024-09-12T17:28:22.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.245+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b686e0 con 0x55b966b4fd80 2024-09-12T17:28:22.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.246+0000 7f76a612a640 1 -- 172.21.15.170:0/3103894459 <== osd.3 v2:172.21.15.170:6816/2664906588 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'53 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f769802e070 con 0x55b966b4fd80 2024-09-12T17:28:22.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.246+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b68770 con 0x55b966b4b3b0 2024-09-12T17:28:22.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.247+0000 7f76a692b640 1 -- 172.21.15.170:0/3103894459 <== osd.2 v2:172.21.15.170:6808/3855567754 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'61 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f76a0039030 con 0x55b966b4b3b0 2024-09-12T17:28:22.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.247+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b68770 con 0x55b966b4fd80 2024-09-12T17:28:22.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.248+0000 7f76a612a640 1 -- 172.21.15.170:0/3103894459 <== osd.3 v2:172.21.15.170:6816/2664906588 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f769802e070 con 0x55b966b4fd80 2024-09-12T17:28:22.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.248+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b68770 con 0x55b966b469a0 2024-09-12T17:28:22.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.249+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'33 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7690057030 con 0x55b966b469a0 2024-09-12T17:28:22.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.249+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b68770 con 0x55b966b469a0 2024-09-12T17:28:22.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.250+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'176 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7690057030 con 0x55b966b469a0 2024-09-12T17:28:22.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.250+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b68770 con 0x55b966b4fd80 2024-09-12T17:28:22.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.251+0000 7f76a612a640 1 -- 172.21.15.170:0/3103894459 <== osd.3 v2:172.21.15.170:6816/2664906588 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'54 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f769802e070 con 0x55b966b4fd80 2024-09-12T17:28:22.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.251+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b68770 con 0x55b966b4b3b0 2024-09-12T17:28:22.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.252+0000 7f76a692b640 1 -- 172.21.15.170:0/3103894459 <== osd.2 v2:172.21.15.170:6808/3855567754 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'34 uv32 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f76a0039030 con 0x55b966b4b3b0 2024-09-12T17:28:22.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.252+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b68770 con 0x55b966b4fd80 2024-09-12T17:28:22.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.253+0000 7f76a612a640 1 -- 172.21.15.170:0/3103894459 <== osd.3 v2:172.21.15.170:6816/2664906588 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f769802e070 con 0x55b966b4fd80 2024-09-12T17:28:22.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.253+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b68770 con 0x55b966b4fd80 2024-09-12T17:28:22.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.254+0000 7f76a612a640 1 -- 172.21.15.170:0/3103894459 <== osd.3 v2:172.21.15.170:6816/2664906588 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f769802e070 con 0x55b966b4fd80 2024-09-12T17:28:22.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.254+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b687b0 con 0x55b966b4fd80 2024-09-12T17:28:22.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.255+0000 7f76a612a640 1 -- 172.21.15.170:0/3103894459 <== osd.3 v2:172.21.15.170:6816/2664906588 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'19 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f769802e070 con 0x55b966b4fd80 2024-09-12T17:28:22.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.255+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b687b0 con 0x55b966b4fd80 2024-09-12T17:28:22.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.255+0000 7f76a612a640 1 -- 172.21.15.170:0/3103894459 <== osd.3 v2:172.21.15.170:6816/2664906588 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'40 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f769802e070 con 0x55b966b4fd80 2024-09-12T17:28:22.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.255+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b687b0 con 0x7f76a003c060 2024-09-12T17:28:22.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.256+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7690057030 con 0x7f76a003c060 2024-09-12T17:28:22.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.256+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b687b0 con 0x55b966b4fd80 2024-09-12T17:28:22.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.257+0000 7f76a612a640 1 -- 172.21.15.170:0/3103894459 <== osd.3 v2:172.21.15.170:6816/2664906588 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f769802e070 con 0x55b966b4fd80 2024-09-12T17:28:22.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.257+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b687b0 con 0x7f76a003c060 2024-09-12T17:28:22.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.259+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'40 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7690057030 con 0x7f76a003c060 2024-09-12T17:28:22.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.259+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b687b0 con 0x55b966b4fd80 2024-09-12T17:28:22.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.259+0000 7f76a612a640 1 -- 172.21.15.170:0/3103894459 <== osd.3 v2:172.21.15.170:6816/2664906588 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'55 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f769802e070 con 0x55b966b4fd80 2024-09-12T17:28:22.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.260+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b687b0 con 0x7f76a003c060 2024-09-12T17:28:22.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.261+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.0 v2:172.21.15.47:6800/3978157098 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'46 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7690057030 con 0x7f76a003c060 2024-09-12T17:28:22.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.261+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b687f0 con 0x55b966b4b3b0 2024-09-12T17:28:22.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.262+0000 7f76a692b640 1 -- 172.21.15.170:0/3103894459 <== osd.2 v2:172.21.15.170:6808/3855567754 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f76a0039030 con 0x55b966b4b3b0 2024-09-12T17:28:22.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.262+0000 7f74d77fe640 20 reqs_thread_entry: start 2024-09-12T17:28:22.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.262+0000 7f76a8640800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:22.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.263+0000 7f76a8640800 20 Filter name: none 2024-09-12T17:28:22.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.263+0000 7f74d57fa640 20 reqs_thread_entry: start 2024-09-12T17:28:22.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.263+0000 7f76a8640800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:28:22.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.263+0000 7f76a8640800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.263+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b966b936b0 con 0x55b966b469a0 2024-09-12T17:28:22.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.263+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f7690057030 con 0x55b966b469a0 2024-09-12T17:28:22.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.263+0000 7f76a8640800 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:28:22.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.263+0000 7f76a8640800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T17:28:22.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.263+0000 7f76a8640800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:28:22.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.263+0000 7f76a8640800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:22.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.263+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b966b95b00 con 0x55b966b4b3b0 2024-09-12T17:28:22.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.263+0000 7f76a692b640 1 -- 172.21.15.170:0/3103894459 <== osd.2 v2:172.21.15.170:6808/3855567754 21 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f76a0039030 con 0x55b966b4b3b0 2024-09-12T17:28:22.266 INFO:teuthology.orchestra.run.smithi170.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-12T17:28:22.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.264+0000 7f755cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:22.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.264+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94254780492048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b67b80 con 0x55b966b469a0 2024-09-12T17:28:22.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.265+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94254780492048] v31'177 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7690057030 con 0x55b966b469a0 2024-09-12T17:28:22.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.265+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94254780468400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b5a8e0 con 0x55b966b4b3b0 2024-09-12T17:28:22.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.266+0000 7f76a692b640 1 -- 172.21.15.170:0/3103894459 <== osd.2 v2:172.21.15.170:6808/3855567754 22 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94254780468400] v31'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76a0039030 con 0x55b966b4b3b0 2024-09-12T17:28:22.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.266+0000 7f76a8640800 20 remove_watcher() i=0 2024-09-12T17:28:22.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.266+0000 7f76a8640800 2 removed watcher, disabling cache 2024-09-12T17:28:22.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.266+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94254780472256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b54cb0 con 0x55b966b469a0 2024-09-12T17:28:22.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.267+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94254780472256] v31'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7690057030 con 0x55b966b469a0 2024-09-12T17:28:22.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.267+0000 7f76a8640800 20 remove_watcher() i=1 2024-09-12T17:28:22.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.267+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94254780473824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b54cb0 con 0x55b966b4fd80 2024-09-12T17:28:22.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.268+0000 7f76a612a640 1 -- 172.21.15.170:0/3103894459 <== osd.3 v2:172.21.15.170:6816/2664906588 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94254780473824] v31'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f769802e070 con 0x55b966b4fd80 2024-09-12T17:28:22.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.268+0000 7f76a8640800 20 remove_watcher() i=2 2024-09-12T17:28:22.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.268+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94254780480192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b54cb0 con 0x55b966b4b3b0 2024-09-12T17:28:22.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.269+0000 7f76a692b640 1 -- 172.21.15.170:0/3103894459 <== osd.2 v2:172.21.15.170:6808/3855567754 23 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94254780480192] v31'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76a0039030 con 0x55b966b4b3b0 2024-09-12T17:28:22.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.269+0000 7f76a8640800 20 remove_watcher() i=3 2024-09-12T17:28:22.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.269+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94254780482400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b57ac0 con 0x55b966b469a0 2024-09-12T17:28:22.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.270+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.1 v2:172.21.15.170:6800/1903654092 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94254780482400] v31'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7690057030 con 0x55b966b469a0 2024-09-12T17:28:22.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.270+0000 7f76a8640800 20 remove_watcher() i=4 2024-09-12T17:28:22.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.270+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94254780486464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b54cb0 con 0x7f76a003c060 2024-09-12T17:28:22.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.271+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.0 v2:172.21.15.47:6800/3978157098 23 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94254780486464] v31'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7690057030 con 0x7f76a003c060 2024-09-12T17:28:22.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.271+0000 7f76a8640800 20 remove_watcher() i=5 2024-09-12T17:28:22.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.271+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94254780483968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b57ac0 con 0x7f76a003c060 2024-09-12T17:28:22.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.272+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.0 v2:172.21.15.47:6800/3978157098 24 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94254780483968] v31'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7690057030 con 0x7f76a003c060 2024-09-12T17:28:22.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.272+0000 7f76a8640800 20 remove_watcher() i=6 2024-09-12T17:28:22.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.272+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94254780488592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b966b59340 con 0x7f76a003c060 2024-09-12T17:28:22.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.273+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 <== osd.0 v2:172.21.15.47:6800/3978157098 25 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94254780488592] v31'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7690057030 con 0x7f76a003c060 2024-09-12T17:28:22.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.273+0000 7f76a8640800 20 remove_watcher() i=7 2024-09-12T17:28:22.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.273+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f76a003c060 msgr2=0x7f76a0023070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.273+0000 7f76a8640800 1 --2- 172.21.15.170:0/3103894459 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f76a003c060 0x7f76a0023070 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.273+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b966b469a0 msgr2=0x55b966b48e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.273+0000 7f76a8640800 1 --2- 172.21.15.170:0/3103894459 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b966b469a0 0x55b966b48e60 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.273+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b966b4b3b0 msgr2=0x55b966b4d7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.273+0000 7f76a8640800 1 --2- 172.21.15.170:0/3103894459 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b966b4b3b0 0x55b966b4d7a0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.273+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55b966b4fd80 msgr2=0x55b966b52240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.273+0000 7f76a8640800 1 --2- 172.21.15.170:0/3103894459 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55b966b4fd80 0x55b966b52240 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.273+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f757003c780 msgr2=0x7f757003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.273+0000 7f76a8640800 1 --2- 172.21.15.170:0/3103894459 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f757003c780 0x7f757003ec40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f769800efd0 tx=0x7f7698048000 comp rx=0 tx=0).stop 2024-09-12T17:28:22.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.273+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b966b34b30 msgr2=0x55b966b3b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.273+0000 7f76a8640800 1 --2- 172.21.15.170:0/3103894459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b966b34b30 0x55b966b3b0c0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f76a001f500 tx=0x7f76a0053cf0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.273+0000 7f769ffff640 1 -- 172.21.15.170:0/3103894459 reap_dead start 2024-09-12T17:28:22.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.274+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 shutdown_connections 2024-09-12T17:28:22.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.274+0000 7f76a8640800 1 --2- 172.21.15.170:0/3103894459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b966b34b30 0x55b966b3b0c0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.274+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 >> 172.21.15.170:0/3103894459 conn(0x55b966b2fe80 msgr2=0x55b966b2e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:22.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.274+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 shutdown_connections 2024-09-12T17:28:22.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.274+0000 7f76a8640800 1 -- 172.21.15.170:0/3103894459 wait complete. 2024-09-12T17:28:22.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.274+0000 7f76a8640800 1 -- 172.21.15.170:0/3320000577 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f758003c730 msgr2=0x7f758003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.274+0000 7f76a8640800 1 --2- 172.21.15.170:0/3320000577 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f758003c730 0x7f758003ebf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x55b966b0e1f0 tx=0x7f76980525b0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.274+0000 7f76a8640800 1 -- 172.21.15.170:0/3320000577 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b966b26fc0 msgr2=0x55b966b273e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.274+0000 7f76a8640800 1 --2- 172.21.15.170:0/3320000577 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b966b26fc0 0x55b966b273e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x55b966b0d120 tx=0x7f76a00167b0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.274+0000 7f76a8640800 1 -- 172.21.15.170:0/3320000577 shutdown_connections 2024-09-12T17:28:22.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.274+0000 7f76a8640800 1 --2- 172.21.15.170:0/3320000577 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f758003c730 0x7f758003ebf0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.274+0000 7f76a8640800 1 --2- 172.21.15.170:0/3320000577 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b966b26fc0 0x55b966b273e0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.274+0000 7f76a8640800 1 -- 172.21.15.170:0/3320000577 >> 172.21.15.170:0/3320000577 conn(0x55b966b1b370 msgr2=0x55b966b1b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:22.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.274+0000 7f76a8640800 1 -- 172.21.15.170:0/3320000577 shutdown_connections 2024-09-12T17:28:22.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.274+0000 7f76a8640800 1 -- 172.21.15.170:0/3320000577 wait complete. 2024-09-12T17:28:22.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.274+0000 7f76a8640800 1 -- 172.21.15.170:0/3127236170 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b966a13000 msgr2=0x55b966b13770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.274+0000 7f76a8640800 1 --2- 172.21.15.170:0/3127236170 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b966a13000 0x55b966b13770 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.274+0000 7f76a8640800 1 -- 172.21.15.170:0/3127236170 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b966b15b10 msgr2=0x55b966b17f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.274+0000 7f76a8640800 1 --2- 172.21.15.170:0/3127236170 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b966b15b10 0x55b966b17f80 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.274+0000 7f76a8640800 1 -- 172.21.15.170:0/3127236170 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f758c03c780 msgr2=0x7f758c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.274+0000 7f76a8640800 1 --2- 172.21.15.170:0/3127236170 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f758c03c780 0x7f758c03ec40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7690057000 tx=0x7f7690052000 comp rx=0 tx=0).stop 2024-09-12T17:28:22.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.274+0000 7f76a8640800 1 -- 172.21.15.170:0/3127236170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b966a114e0 msgr2=0x55b966b0c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.274+0000 7f76a8640800 1 --2- 172.21.15.170:0/3127236170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b966a114e0 0x55b966b0c120 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x55b966b05730 tx=0x7f7698000ed0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.275+0000 7f76a8640800 1 -- 172.21.15.170:0/3127236170 shutdown_connections 2024-09-12T17:28:22.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.275+0000 7f76a8640800 1 --2- 172.21.15.170:0/3127236170 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b966b15b10 0x55b966b17f80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.275+0000 7f76a8640800 1 --2- 172.21.15.170:0/3127236170 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f758c03c780 0x7f758c03ec40 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.275+0000 7f76a8640800 1 --2- 172.21.15.170:0/3127236170 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b966a13000 0x55b966b13770 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.275+0000 7f76a8640800 1 --2- 172.21.15.170:0/3127236170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b966a114e0 0x55b966b0c120 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.275+0000 7f76a8640800 1 -- 172.21.15.170:0/3127236170 >> 172.21.15.170:0/3127236170 conn(0x55b966a0d1f0 msgr2=0x55b966b05a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:22.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.275+0000 7f76a8640800 1 -- 172.21.15.170:0/3127236170 shutdown_connections 2024-09-12T17:28:22.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.275+0000 7f76a8640800 1 -- 172.21.15.170:0/3127236170 wait complete. 2024-09-12T17:28:22.284 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-12T17:28:22.292 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-09-12T17:28:22.296 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:28:22.322 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:28:22.332 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:28:22.377 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-12T17:28:22.381 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:28:22.382 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-12T17:28:22.382 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-12T17:28:22.382 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-12T17:28:22.430 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:22.430 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:22.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.430+0000 7f87ba830800 1 Processor -- start 2024-09-12T17:28:22.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.430+0000 7f87ba830800 1 -- start start 2024-09-12T17:28:22.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.430+0000 7f87ba830800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x56552a298000 0x56552a298bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.430+0000 7f87ba830800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56552a141e40 con 0x56552a299100 2024-09-12T17:28:22.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.430+0000 7f87ba830800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x56552a10c680 con 0x56552a298000 2024-09-12T17:28:22.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.430+0000 7f87b5bcc640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x56552a298000 0x56552a298bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.430+0000 7f87b5bcc640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x56552a298000 0x56552a298bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:55972/0 (socket says 172.21.15.170:55972) 2024-09-12T17:28:22.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.430+0000 7f87b5bcc640 1 -- 172.21.15.170:0/3508728242 learned_addr learned my addr 172.21.15.170:0/3508728242 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:22.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.430+0000 7f87b5bcc640 1 -- 172.21.15.170:0/3508728242 >> v1:172.21.15.47:6789/0 conn(0x56552a299100 legacy=0x56552a29de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.430+0000 7f87b5bcc640 1 -- 172.21.15.170:0/3508728242 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56552a1286b0 con 0x56552a298000 2024-09-12T17:28:22.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.432+0000 7f87b5bcc640 1 --2- 172.21.15.170:0/3508728242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56552a298000 0x56552a298bc0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f87a800a520 tx=0x7f87a8045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e0a42dc6f3096e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.433+0000 7f87b4bca640 1 -- 172.21.15.170:0/3508728242 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87a8055070 con 0x56552a298000 2024-09-12T17:28:22.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.433+0000 7f87b4bca640 1 -- 172.21.15.170:0/3508728242 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87a80515b0 con 0x56552a298000 2024-09-12T17:28:22.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.433+0000 7f87b4bca640 1 -- 172.21.15.170:0/3508728242 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87a80518d0 con 0x56552a298000 2024-09-12T17:28:22.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.433+0000 7f87ba830800 1 -- 172.21.15.170:0/3508728242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56552a298000 msgr2=0x56552a298bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.433+0000 7f87ba830800 1 --2- 172.21.15.170:0/3508728242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56552a298000 0x56552a298bc0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f87a800a520 tx=0x7f87a8045ba0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.433+0000 7f87ba830800 1 -- 172.21.15.170:0/3508728242 shutdown_connections 2024-09-12T17:28:22.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.433+0000 7f87ba830800 1 --2- 172.21.15.170:0/3508728242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56552a298000 0x56552a298bc0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.433+0000 7f87ba830800 1 -- 172.21.15.170:0/3508728242 >> 172.21.15.170:0/3508728242 conn(0x56552a2933d0 msgr2=0x56552a295830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:22.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.433+0000 7f87ba830800 1 -- 172.21.15.170:0/3508728242 shutdown_connections 2024-09-12T17:28:22.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.433+0000 7f87ba830800 1 -- 172.21.15.170:0/3508728242 wait complete. 2024-09-12T17:28:22.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.448+0000 7f87ba830800 1 Processor -- start 2024-09-12T17:28:22.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.448+0000 7f87ba830800 1 -- start start 2024-09-12T17:28:22.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.448+0000 7f87ba830800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56552a298000 0x56552a387660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.448+0000 7f87ba830800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56552a130dd0 con 0x56552a298000 2024-09-12T17:28:22.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.448+0000 7f87b5bcc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56552a298000 0x56552a387660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.448+0000 7f87b5bcc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56552a298000 0x56552a387660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:55984/0 (socket says 172.21.15.170:55984) 2024-09-12T17:28:22.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.448+0000 7f87b5bcc640 1 -- 172.21.15.170:0/1029855801 learned_addr learned my addr 172.21.15.170:0/1029855801 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:22.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.449+0000 7f87b5bcc640 1 -- 172.21.15.170:0/1029855801 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56552a149e10 con 0x56552a298000 2024-09-12T17:28:22.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.449+0000 7f87b5bcc640 1 --2- 172.21.15.170:0/1029855801 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56552a298000 0x56552a387660 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f87a80460d0 tx=0x7f87a8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a831e9dc291be74f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.449+0000 7f86a3e07640 1 -- 172.21.15.170:0/1029855801 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87a80519d0 con 0x56552a298000 2024-09-12T17:28:22.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.449+0000 7f86a3e07640 1 -- 172.21.15.170:0/1029855801 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87a8051b70 con 0x56552a298000 2024-09-12T17:28:22.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.449+0000 7f86a3e07640 1 -- 172.21.15.170:0/1029855801 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87a8051e50 con 0x56552a298000 2024-09-12T17:28:22.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.450+0000 7f87ba830800 1 -- 172.21.15.170:0/1029855801 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56552a298000 msgr2=0x56552a387660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.450+0000 7f87ba830800 1 --2- 172.21.15.170:0/1029855801 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56552a298000 0x56552a387660 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f87a80460d0 tx=0x7f87a8051000 comp rx=0 tx=0).stop 2024-09-12T17:28:22.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.450+0000 7f87ba830800 1 -- 172.21.15.170:0/1029855801 shutdown_connections 2024-09-12T17:28:22.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.450+0000 7f87ba830800 1 --2- 172.21.15.170:0/1029855801 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56552a298000 0x56552a387660 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.450+0000 7f87ba830800 1 -- 172.21.15.170:0/1029855801 >> 172.21.15.170:0/1029855801 conn(0x56552a2933d0 msgr2=0x56552a382fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:22.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.450+0000 7f87ba830800 1 -- 172.21.15.170:0/1029855801 shutdown_connections 2024-09-12T17:28:22.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.450+0000 7f87ba830800 1 -- 172.21.15.170:0/1029855801 wait complete. 2024-09-12T17:28:22.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.450+0000 7f87ba830800 1 Processor -- start 2024-09-12T17:28:22.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.450+0000 7f87ba830800 1 -- start start 2024-09-12T17:28:22.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.450+0000 7f87ba830800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56552a298000 0x56552a38ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.450+0000 7f87ba830800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56552a2997f0 con 0x56552a298000 2024-09-12T17:28:22.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.451+0000 7f87b5bcc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56552a298000 0x56552a38ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.451+0000 7f87b5bcc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56552a298000 0x56552a38ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:55990/0 (socket says 172.21.15.170:55990) 2024-09-12T17:28:22.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.451+0000 7f87b5bcc640 1 -- 172.21.15.170:0/1086969968 learned_addr learned my addr 172.21.15.170:0/1086969968 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:22.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.451+0000 7f87b5bcc640 1 -- 172.21.15.170:0/1086969968 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56552a38f3e0 con 0x56552a298000 2024-09-12T17:28:22.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.451+0000 7f87b5bcc640 1 --2- 172.21.15.170:0/1086969968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56552a298000 0x56552a38ee80 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f87a80460d0 tx=0x7f87a8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.451+0000 7f86a2604640 1 -- 172.21.15.170:0/1086969968 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87a8073020 con 0x56552a298000 2024-09-12T17:28:22.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.451+0000 7f86a2604640 1 -- 172.21.15.170:0/1086969968 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87a806f580 con 0x56552a298000 2024-09-12T17:28:22.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.451+0000 7f87ba830800 1 -- 172.21.15.170:0/1086969968 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56552a38f670 con 0x56552a298000 2024-09-12T17:28:22.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.451+0000 7f86a2604640 1 -- 172.21.15.170:0/1086969968 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87a806f8a0 con 0x56552a298000 2024-09-12T17:28:22.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.452+0000 7f87ba830800 1 -- 172.21.15.170:0/1086969968 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56552a390280 con 0x56552a298000 2024-09-12T17:28:22.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.452+0000 7f86a2604640 1 -- 172.21.15.170:0/1086969968 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f87a8076020 con 0x56552a298000 2024-09-12T17:28:22.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.453+0000 7f86a2604640 1 --2- 172.21.15.170:0/1086969968 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f869c03c780 0x7f869c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.453+0000 7f86a2604640 1 -- 172.21.15.170:0/1086969968 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f87a806b040 con 0x56552a298000 2024-09-12T17:28:22.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.453+0000 7f87b53cb640 1 --2- 172.21.15.170:0/1086969968 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f869c03c780 0x7f869c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.453+0000 7f87ba830800 1 --2- 172.21.15.170:0/1086969968 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56552a299100 0x56552a3964d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.453+0000 7f87ba830800 1 -- 172.21.15.170:0/1086969968 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56552a396a10 con 0x56552a299100 2024-09-12T17:28:22.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.453+0000 7f87b63cd640 1 --2- 172.21.15.170:0/1086969968 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56552a299100 0x56552a3964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.453+0000 7f87b53cb640 1 --2- 172.21.15.170:0/1086969968 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f869c03c780 0x7f869c03ec40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f87ac001e50 tx=0x7f87ac0013d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.453+0000 7f87b63cd640 1 --2- 172.21.15.170:0/1086969968 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56552a299100 0x56552a3964d0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.453+0000 7f87b63cd640 1 -- 172.21.15.170:0/1086969968 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f87b000a4d0 con 0x56552a299100 2024-09-12T17:28:22.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.454+0000 7f87ba830800 1 -- 172.21.15.170:0/1086969968 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56552a396db0 con 0x56552a299100 2024-09-12T17:28:22.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.454+0000 7f87b63cd640 1 -- 172.21.15.170:0/1086969968 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f87b000a4d0 con 0x56552a299100 2024-09-12T17:28:22.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.454+0000 7f87ba830800 1 --2- 172.21.15.170:0/1086969968 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56552a3988f0 0x56552a39ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.454+0000 7f87ba830800 1 -- 172.21.15.170:0/1086969968 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56552a39b4f0 con 0x56552a3988f0 2024-09-12T17:28:22.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.454+0000 7f87b5bcc640 1 --2- 172.21.15.170:0/1086969968 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56552a3988f0 0x56552a39ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.454+0000 7f87b5bcc640 1 --2- 172.21.15.170:0/1086969968 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56552a3988f0 0x56552a39ad60 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.455+0000 7f87b5bcc640 1 -- 172.21.15.170:0/1086969968 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f87a8057030 con 0x56552a3988f0 2024-09-12T17:28:22.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.455+0000 7f87ba830800 1 -- 172.21.15.170:0/1086969968 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56552a397600 con 0x56552a299100 2024-09-12T17:28:22.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.455+0000 7f87b63cd640 1 -- 172.21.15.170:0/1086969968 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f87b000a4d0 con 0x56552a299100 2024-09-12T17:28:22.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.455+0000 7f87ba830800 1 -- 172.21.15.170:0/1086969968 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56552a397a60 con 0x56552a3988f0 2024-09-12T17:28:22.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.455+0000 7f87b5bcc640 1 -- 172.21.15.170:0/1086969968 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f87a8057030 con 0x56552a3988f0 2024-09-12T17:28:22.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.456+0000 7f87ba830800 1 Processor -- start 2024-09-12T17:28:22.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.456+0000 7f87ba830800 1 -- start start 2024-09-12T17:28:22.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.456+0000 7f87ba830800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56552a20d6f0 0x56552a20bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.456+0000 7f87ba830800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56552a18ea00 con 0x56552a20d6f0 2024-09-12T17:28:22.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.456+0000 7f87b63cd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56552a20d6f0 0x56552a20bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.456+0000 7f87b63cd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56552a20d6f0 0x56552a20bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56004/0 (socket says 172.21.15.170:56004) 2024-09-12T17:28:22.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.456+0000 7f87b63cd640 1 -- 172.21.15.170:0/4157140736 learned_addr learned my addr 172.21.15.170:0/4157140736 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:22.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.457+0000 7f87b63cd640 1 -- 172.21.15.170:0/4157140736 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56552a20dc10 con 0x56552a20d6f0 2024-09-12T17:28:22.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.457+0000 7f87b63cd640 1 --2- 172.21.15.170:0/4157140736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56552a20d6f0 0x56552a20bf60 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x56552a38fe80 tx=0x7f87b00167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.457+0000 7f869b7fe640 1 -- 172.21.15.170:0/4157140736 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87b0013640 con 0x56552a20d6f0 2024-09-12T17:28:22.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.457+0000 7f869b7fe640 1 -- 172.21.15.170:0/4157140736 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87b00137e0 con 0x56552a20d6f0 2024-09-12T17:28:22.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.457+0000 7f87ba830800 1 -- 172.21.15.170:0/4157140736 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56552a20c4a0 con 0x56552a20d6f0 2024-09-12T17:28:22.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.457+0000 7f869b7fe640 1 -- 172.21.15.170:0/4157140736 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87b0013b00 con 0x56552a20d6f0 2024-09-12T17:28:22.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.457+0000 7f87ba830800 1 -- 172.21.15.170:0/4157140736 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56552a20c9f0 con 0x56552a20d6f0 2024-09-12T17:28:22.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.458+0000 7f869b7fe640 1 -- 172.21.15.170:0/4157140736 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f87b0011040 con 0x56552a20d6f0 2024-09-12T17:28:22.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.458+0000 7f869b7fe640 1 --2- 172.21.15.170:0/4157140736 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f869003c780 0x7f869003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.458+0000 7f869b7fe640 1 -- 172.21.15.170:0/4157140736 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f87b000e040 con 0x56552a20d6f0 2024-09-12T17:28:22.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.458+0000 7f87b5bcc640 1 --2- 172.21.15.170:0/4157140736 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f869003c780 0x7f869003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.459+0000 7f87ba830800 1 Processor -- start 2024-09-12T17:28:22.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.459+0000 7f87b5bcc640 1 --2- 172.21.15.170:0/4157140736 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f869003c780 0x7f869003ec40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x56552a39b890 tx=0x7f87a805adc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.459+0000 7f87ba830800 1 -- start start 2024-09-12T17:28:22.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.459+0000 7f87ba830800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56552a3a9b60 0x56552a3a9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.459+0000 7f87ba830800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56552a387df0 con 0x56552a3a9b60 2024-09-12T17:28:22.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.459+0000 7f87b63cd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56552a3a9b60 0x56552a3a9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.459+0000 7f87b63cd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56552a3a9b60 0x56552a3a9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56014/0 (socket says 172.21.15.170:56014) 2024-09-12T17:28:22.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.459+0000 7f87b63cd640 1 -- 172.21.15.170:0/2604803783 learned_addr learned my addr 172.21.15.170:0/2604803783 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:22.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.459+0000 7f87b63cd640 1 -- 172.21.15.170:0/2604803783 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56552a3aa4a0 con 0x56552a3a9b60 2024-09-12T17:28:22.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.460+0000 7f87b63cd640 1 --2- 172.21.15.170:0/2604803783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56552a3a9b60 0x56552a3a9f60 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f87b0053d40 tx=0x7f87b0021db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ac5399da980ebf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.460+0000 7f86997fa640 1 -- 172.21.15.170:0/2604803783 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87b0013dd0 con 0x56552a3a9b60 2024-09-12T17:28:22.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.460+0000 7f86997fa640 1 -- 172.21.15.170:0/2604803783 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87b0053e50 con 0x56552a3a9b60 2024-09-12T17:28:22.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.460+0000 7f86997fa640 1 -- 172.21.15.170:0/2604803783 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87b0021570 con 0x56552a3a9b60 2024-09-12T17:28:22.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.460+0000 7f87ba830800 1 -- 172.21.15.170:0/2604803783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56552a3a9b60 msgr2=0x56552a3a9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.460+0000 7f87ba830800 1 --2- 172.21.15.170:0/2604803783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56552a3a9b60 0x56552a3a9f60 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f87b0053d40 tx=0x7f87b0021db0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.460+0000 7f87ba830800 1 -- 172.21.15.170:0/2604803783 shutdown_connections 2024-09-12T17:28:22.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.460+0000 7f87ba830800 1 --2- 172.21.15.170:0/2604803783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56552a3a9b60 0x56552a3a9f60 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.460+0000 7f87ba830800 1 -- 172.21.15.170:0/2604803783 >> 172.21.15.170:0/2604803783 conn(0x56552a3b4de0 msgr2=0x56552a3b3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:22.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.460+0000 7f87ba830800 1 -- 172.21.15.170:0/2604803783 shutdown_connections 2024-09-12T17:28:22.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.460+0000 7f87ba830800 1 -- 172.21.15.170:0/2604803783 wait complete. 2024-09-12T17:28:22.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.461+0000 7f87ba830800 1 Processor -- start 2024-09-12T17:28:22.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.461+0000 7f87ba830800 1 -- start start 2024-09-12T17:28:22.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.461+0000 7f87ba830800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56552a3a9b60 0x56552a3c43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.461+0000 7f87ba830800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56552a3aab40 con 0x56552a3a9b60 2024-09-12T17:28:22.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.461+0000 7f87b63cd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56552a3a9b60 0x56552a3c43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.461+0000 7f87b63cd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56552a3a9b60 0x56552a3c43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56026/0 (socket says 172.21.15.170:56026) 2024-09-12T17:28:22.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.461+0000 7f87b63cd640 1 -- 172.21.15.170:0/2426832410 learned_addr learned my addr 172.21.15.170:0/2426832410 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:22.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.461+0000 7f87b63cd640 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56552a3c4950 con 0x56552a3a9b60 2024-09-12T17:28:22.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.461+0000 7f87b63cd640 1 --2- 172.21.15.170:0/2426832410 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56552a3a9b60 0x56552a3c43f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f87b0022ff0 tx=0x7f87b0053ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.462+0000 7f86877fe640 1 -- 172.21.15.170:0/2426832410 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87b001f500 con 0x56552a3a9b60 2024-09-12T17:28:22.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.462+0000 7f86877fe640 1 -- 172.21.15.170:0/2426832410 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87b001f6a0 con 0x56552a3a9b60 2024-09-12T17:28:22.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.462+0000 7f86877fe640 1 -- 172.21.15.170:0/2426832410 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87b0055070 con 0x56552a3a9b60 2024-09-12T17:28:22.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.462+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56552a3c4be0 con 0x56552a3a9b60 2024-09-12T17:28:22.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.462+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56552a3c5560 con 0x56552a3a9b60 2024-09-12T17:28:22.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.463+0000 7f86877fe640 1 -- 172.21.15.170:0/2426832410 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f87b003b060 con 0x56552a3a9b60 2024-09-12T17:28:22.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.463+0000 7f86877fe640 1 --2- 172.21.15.170:0/2426832410 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f868003c780 0x7f868003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.463+0000 7f86877fe640 1 -- 172.21.15.170:0/2426832410 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f87b004a040 con 0x56552a3a9b60 2024-09-12T17:28:22.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.463+0000 7f87b5bcc640 1 --2- 172.21.15.170:0/2426832410 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f868003c780 0x7f868003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.463+0000 7f87b5bcc640 1 --2- 172.21.15.170:0/2426832410 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f868003c780 0x7f868003ec40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f87a80514a0 tx=0x7f87a8084000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.464+0000 7f87ba830800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.464+0000 7f87ba830800 1 --2- 172.21.15.170:0/2426832410 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56552a3cfdd0 0x56552a3d2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.464+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56552a3d29e0 con 0x56552a3cfdd0 2024-09-12T17:28:22.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.464+0000 7f87b53cb640 1 --2- 172.21.15.170:0/2426832410 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56552a3cfdd0 0x56552a3d2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.464+0000 7f87b53cb640 1 --2- 172.21.15.170:0/2426832410 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56552a3cfdd0 0x56552a3d2290 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.464+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f87ac010580 con 0x56552a3cfdd0 2024-09-12T17:28:22.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.464+0000 7f87ba830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:22.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.464+0000 7f87ba830800 20 realm 2024-09-12T17:28:22.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.464+0000 7f87ba830800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.464+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56552a3cf120 con 0x56552a3cfdd0 2024-09-12T17:28:22.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.465+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f87ac010580 con 0x56552a3cfdd0 2024-09-12T17:28:22.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.465+0000 7f87ba830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:22.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.465+0000 7f87ba830800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:22.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.465+0000 7f87ba830800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.465+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56552a3d34d0 con 0x56552a3cfdd0 2024-09-12T17:28:22.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.465+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f87ac010580 con 0x56552a3cfdd0 2024-09-12T17:28:22.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.465+0000 7f87ba830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:22.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.465+0000 7f87ba830800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.465+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56552a3d3da0 con 0x56552a3cfdd0 2024-09-12T17:28:22.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.465+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f87ac010580 con 0x56552a3cfdd0 2024-09-12T17:28:22.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.465+0000 7f87ba830800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:22.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.465+0000 7f87ba830800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.465+0000 7f87ba830800 1 --2- 172.21.15.170:0/2426832410 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56552a3d47c0 0x56552a3d6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.465+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56552a3d72f0 con 0x56552a3d47c0 2024-09-12T17:28:22.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.465+0000 7f87b63cd640 1 --2- 172.21.15.170:0/2426832410 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56552a3d47c0 0x56552a3d6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.466+0000 7f87b63cd640 1 --2- 172.21.15.170:0/2426832410 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56552a3d47c0 0x56552a3d6bb0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.466+0000 7f87b63cd640 1 -- 172.21.15.170:0/2426832410 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f87b000a4d0 con 0x56552a3d47c0 2024-09-12T17:28:22.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.466+0000 7f87ba830800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:22.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.466+0000 7f87ba830800 20 searching for the correct realm 2024-09-12T17:28:22.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.466+0000 7f87ba830800 1 --2- 172.21.15.170:0/2426832410 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x56552a3d92c0 0x56552a3db780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.466+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56552a3dbe50 con 0x56552a3d92c0 2024-09-12T17:28:22.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.466+0000 7f87b5bcc640 1 --2- 172.21.15.170:0/2426832410 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x56552a3d92c0 0x56552a3db780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.466+0000 7f87b5bcc640 1 --2- 172.21.15.170:0/2426832410 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x56552a3d92c0 0x56552a3db780 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.467+0000 7f87b5bcc640 1 -- 172.21.15.170:0/2426832410 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87a8057030 con 0x56552a3d92c0 2024-09-12T17:28:22.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.467+0000 7f87b5bcc640 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56552a3dbe50 con 0x56552a3d47c0 2024-09-12T17:28:22.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.467+0000 7f87b63cd640 1 -- 172.21.15.170:0/2426832410 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87b000a4d0 con 0x56552a3d47c0 2024-09-12T17:28:22.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.467+0000 7f87b63cd640 1 --2- 172.21.15.170:0/2426832410 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f87b003d070 0x7f87b00337d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.467+0000 7f87b63cd640 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56552a3dbe50 con 0x7f87b003d070 2024-09-12T17:28:22.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.467+0000 7f87b53cb640 1 --2- 172.21.15.170:0/2426832410 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f87b003d070 0x7f87b00337d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.468+0000 7f87b53cb640 1 --2- 172.21.15.170:0/2426832410 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f87b003d070 0x7f87b00337d0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.468+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87ac010580 con 0x7f87b003d070 2024-09-12T17:28:22.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.468+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56552a3dbe50 con 0x56552a3cfdd0 2024-09-12T17:28:22.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.468+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87ac010580 con 0x56552a3cfdd0 2024-09-12T17:28:22.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.468+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56552a3dbe50 con 0x56552a3cfdd0 2024-09-12T17:28:22.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.468+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87ac02a040 con 0x56552a3cfdd0 2024-09-12T17:28:22.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.468+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56552a3dbe50 con 0x7f87b003d070 2024-09-12T17:28:22.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.469+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87ac02a040 con 0x7f87b003d070 2024-09-12T17:28:22.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.469+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56552a3dbe50 con 0x7f87b003d070 2024-09-12T17:28:22.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.469+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87ac02a040 con 0x7f87b003d070 2024-09-12T17:28:22.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.469+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56552a3dbe50 con 0x56552a3d47c0 2024-09-12T17:28:22.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.469+0000 7f87b63cd640 1 -- 172.21.15.170:0/2426832410 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87b000a4d0 con 0x56552a3d47c0 2024-09-12T17:28:22.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.469+0000 7f87b63cd640 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56552a3dbe50 con 0x56552a3d92c0 2024-09-12T17:28:22.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.469+0000 7f87b5bcc640 1 -- 172.21.15.170:0/2426832410 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87a8057030 con 0x56552a3d92c0 2024-09-12T17:28:22.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.469+0000 7f87b5bcc640 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56552a3dbe50 con 0x56552a3cfdd0 2024-09-12T17:28:22.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.470+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87ac02a040 con 0x56552a3cfdd0 2024-09-12T17:28:22.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.470+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56552a3dbe50 con 0x7f87b003d070 2024-09-12T17:28:22.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.470+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87ac02a040 con 0x7f87b003d070 2024-09-12T17:28:22.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.470+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56552a3dbe50 con 0x56552a3cfdd0 2024-09-12T17:28:22.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.470+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87ac02a040 con 0x56552a3cfdd0 2024-09-12T17:28:22.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.470+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56552a3dbe50 con 0x56552a3d47c0 2024-09-12T17:28:22.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.470+0000 7f87b63cd640 1 -- 172.21.15.170:0/2426832410 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f87b000a4d0 con 0x56552a3d47c0 2024-09-12T17:28:22.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.470+0000 7f87b63cd640 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56552a3dbe50 con 0x56552a3d92c0 2024-09-12T17:28:22.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.470+0000 7f87b5bcc640 1 -- 172.21.15.170:0/2426832410 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87a8057030 con 0x56552a3d92c0 2024-09-12T17:28:22.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.470+0000 7f87b5bcc640 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56552a3dbe50 con 0x56552a3d92c0 2024-09-12T17:28:22.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.471+0000 7f87b5bcc640 1 -- 172.21.15.170:0/2426832410 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87a8057030 con 0x56552a3d92c0 2024-09-12T17:28:22.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.471+0000 7f87b5bcc640 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56552a3dbe50 con 0x56552a3d47c0 2024-09-12T17:28:22.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.471+0000 7f87b63cd640 1 -- 172.21.15.170:0/2426832410 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87b000a4d0 con 0x56552a3d47c0 2024-09-12T17:28:22.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.471+0000 7f87b63cd640 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56552a3dbe50 con 0x56552a3d92c0 2024-09-12T17:28:22.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.471+0000 7f87b5bcc640 1 -- 172.21.15.170:0/2426832410 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87a8057030 con 0x56552a3d92c0 2024-09-12T17:28:22.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.471+0000 7f87b5bcc640 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56552a3dbe50 con 0x56552a3d92c0 2024-09-12T17:28:22.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.471+0000 7f87b5bcc640 1 -- 172.21.15.170:0/2426832410 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87a8057030 con 0x56552a3d92c0 2024-09-12T17:28:22.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.471+0000 7f87b5bcc640 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56552a3dbe50 con 0x56552a3cfdd0 2024-09-12T17:28:22.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.472+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87ac02a040 con 0x56552a3cfdd0 2024-09-12T17:28:22.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.472+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56552a3dbe50 con 0x56552a3cfdd0 2024-09-12T17:28:22.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.472+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f87ac02a040 con 0x56552a3cfdd0 2024-09-12T17:28:22.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.472+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56552a3dbe50 con 0x7f87b003d070 2024-09-12T17:28:22.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.472+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87ac02a040 con 0x7f87b003d070 2024-09-12T17:28:22.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.472+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56552a3dbe50 con 0x56552a3d92c0 2024-09-12T17:28:22.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.472+0000 7f87b5bcc640 1 -- 172.21.15.170:0/2426832410 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87a8057030 con 0x56552a3d92c0 2024-09-12T17:28:22.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.472+0000 7f87b5bcc640 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56552a3dbe50 con 0x56552a3d47c0 2024-09-12T17:28:22.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.473+0000 7f87b63cd640 1 -- 172.21.15.170:0/2426832410 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87b000a4d0 con 0x56552a3d47c0 2024-09-12T17:28:22.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.473+0000 7f87b63cd640 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56552a3dbe50 con 0x56552a3cfdd0 2024-09-12T17:28:22.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.473+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87ac02a040 con 0x56552a3cfdd0 2024-09-12T17:28:22.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.473+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56552a3dbe50 con 0x7f87b003d070 2024-09-12T17:28:22.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.473+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87ac02a040 con 0x7f87b003d070 2024-09-12T17:28:22.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.473+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56552a3dbe50 con 0x56552a3d92c0 2024-09-12T17:28:22.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.473+0000 7f87b5bcc640 1 -- 172.21.15.170:0/2426832410 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87a8057030 con 0x56552a3d92c0 2024-09-12T17:28:22.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.473+0000 7f87b5bcc640 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56552a3dbe50 con 0x7f87b003d070 2024-09-12T17:28:22.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.474+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87ac02a040 con 0x7f87b003d070 2024-09-12T17:28:22.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.474+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56552a3dbe50 con 0x56552a3d47c0 2024-09-12T17:28:22.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.474+0000 7f87b63cd640 1 -- 172.21.15.170:0/2426832410 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87b000a4d0 con 0x56552a3d47c0 2024-09-12T17:28:22.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.474+0000 7f87b63cd640 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56552a3dbe50 con 0x56552a3d92c0 2024-09-12T17:28:22.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.474+0000 7f87b5bcc640 1 -- 172.21.15.170:0/2426832410 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87a8057030 con 0x56552a3d92c0 2024-09-12T17:28:22.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.474+0000 7f87b5bcc640 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56552a3dbe50 con 0x7f87b003d070 2024-09-12T17:28:22.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.474+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87ac03a040 con 0x7f87b003d070 2024-09-12T17:28:22.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.474+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56552a3dbe50 con 0x56552a3cfdd0 2024-09-12T17:28:22.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.475+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f87ac03a040 con 0x56552a3cfdd0 2024-09-12T17:28:22.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.475+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56552a3dbe50 con 0x56552a3d47c0 2024-09-12T17:28:22.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.475+0000 7f87b63cd640 1 -- 172.21.15.170:0/2426832410 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(37 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f87b000a4d0 con 0x56552a3d47c0 2024-09-12T17:28:22.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.475+0000 7f87ba830800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:22.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.475+0000 7f87ba830800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:22.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.475+0000 7f87ba830800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:22.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.475+0000 7f87ba830800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:22.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.475+0000 7f87ba830800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:22.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.475+0000 7f87ba830800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:22.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.475+0000 7f87ba830800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.475+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56552a3d7cb0 con 0x56552a3cfdd0 2024-09-12T17:28:22.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.475+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f87ac03a040 con 0x56552a3cfdd0 2024-09-12T17:28:22.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.475+0000 7f87ba830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:22.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.475+0000 7f87ba830800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.475+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56552a3d8550 con 0x56552a3cfdd0 2024-09-12T17:28:22.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.475+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f87ac03a040 con 0x56552a3cfdd0 2024-09-12T17:28:22.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.475+0000 7f87ba830800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:22.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.475+0000 7f87ba830800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.475+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56552a3d78f0 con 0x56552a3d47c0 2024-09-12T17:28:22.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.476+0000 7f87b63cd640 1 -- 172.21.15.170:0/2426832410 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f87b000a4d0 con 0x56552a3d47c0 2024-09-12T17:28:22.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.476+0000 7f87ba830800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:22.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.476+0000 7f87ba830800 20 zone default found 2024-09-12T17:28:22.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.476+0000 7f87ba830800 4 Realm: () 2024-09-12T17:28:22.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.476+0000 7f87ba830800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:22.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.476+0000 7f87ba830800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:22.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.476+0000 7f87ba830800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:22.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.476+0000 7f87ba830800 20 zonegroup default 2024-09-12T17:28:22.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.476+0000 7f87ba830800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.476+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56552a3dc780 con 0x7f87b003d070 2024-09-12T17:28:22.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.476+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f87ac03a040 con 0x7f87b003d070 2024-09-12T17:28:22.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.476+0000 7f87ba830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:22.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.476+0000 7f87ba830800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.476+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56552a3de450 con 0x56552a3d92c0 2024-09-12T17:28:22.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.476+0000 7f87b5bcc640 1 -- 172.21.15.170:0/2426832410 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f87a8057030 con 0x56552a3d92c0 2024-09-12T17:28:22.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.476+0000 7f87ba830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:22.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.476+0000 7f87ba830800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.476+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56552a3de940 con 0x56552a3d92c0 2024-09-12T17:28:22.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.477+0000 7f87b5bcc640 1 -- 172.21.15.170:0/2426832410 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f87a8057030 con 0x56552a3d92c0 2024-09-12T17:28:22.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.477+0000 7f87ba830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:22.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.477+0000 7f87ba830800 20 started sync module instance, tier type = 2024-09-12T17:28:22.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.477+0000 7f87ba830800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:22.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.477+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56552a3dd220 con 0x56552a3d47c0 2024-09-12T17:28:22.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.478+0000 7f87b63cd640 1 -- 172.21.15.170:0/2426832410 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(44 notify.0 [create] v31'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87b000a4d0 con 0x56552a3d47c0 2024-09-12T17:28:22.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.478+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94923780904464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56552a3df250 con 0x56552a3d47c0 2024-09-12T17:28:22.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.478+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56552a3dfaa0 con 0x56552a3cfdd0 2024-09-12T17:28:22.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.478+0000 7f87b63cd640 1 -- 172.21.15.170:0/2426832410 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94923780904464] v31'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87b000a4d0 con 0x56552a3d47c0 2024-09-12T17:28:22.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.479+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v31'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87ac03a040 con 0x56552a3cfdd0 2024-09-12T17:28:22.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.479+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94923780910496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56552a3df750 con 0x56552a3cfdd0 2024-09-12T17:28:22.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.479+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56552a3e0270 con 0x56552a3d92c0 2024-09-12T17:28:22.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.480+0000 7f87b5bcc640 1 -- 172.21.15.170:0/2426832410 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v31'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87a8057030 con 0x56552a3d92c0 2024-09-12T17:28:22.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.480+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94923780914496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56552a3e0b10 con 0x56552a3d92c0 2024-09-12T17:28:22.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.480+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56552a3e15e0 con 0x56552a3d47c0 2024-09-12T17:28:22.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.480+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94923780910496] v31'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87ac03a040 con 0x56552a3cfdd0 2024-09-12T17:28:22.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.481+0000 7f87b5bcc640 1 -- 172.21.15.170:0/2426832410 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94923780914496] v31'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87a8057030 con 0x56552a3d92c0 2024-09-12T17:28:22.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.481+0000 7f87b63cd640 1 -- 172.21.15.170:0/2426832410 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(50 notify.3 [create] v31'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87b000a4d0 con 0x56552a3d47c0 2024-09-12T17:28:22.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.481+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94923780916832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56552a3df1c0 con 0x56552a3d47c0 2024-09-12T17:28:22.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.481+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56552a3e2020 con 0x56552a3cfdd0 2024-09-12T17:28:22.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.482+0000 7f87b63cd640 1 -- 172.21.15.170:0/2426832410 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94923780916832] v31'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87b000a4d0 con 0x56552a3d47c0 2024-09-12T17:28:22.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.482+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v31'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87ac03a040 con 0x56552a3cfdd0 2024-09-12T17:28:22.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.482+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94923780919504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56552a3e2020 con 0x56552a3cfdd0 2024-09-12T17:28:22.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.482+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56552a3e28b0 con 0x7f87b003d070 2024-09-12T17:28:22.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.483+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94923780919504] v31'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87ac03a040 con 0x56552a3cfdd0 2024-09-12T17:28:22.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.483+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(54 notify.5 [create] v31'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87ac03a040 con 0x7f87b003d070 2024-09-12T17:28:22.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.483+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94923780922224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56552a3e2440 con 0x7f87b003d070 2024-09-12T17:28:22.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.483+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56552a3e32c0 con 0x7f87b003d070 2024-09-12T17:28:22.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.484+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94923780922224] v31'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87ac03a040 con 0x7f87b003d070 2024-09-12T17:28:22.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.484+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v31'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87ac03a040 con 0x7f87b003d070 2024-09-12T17:28:22.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.484+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94923780923280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56552a3e34a0 con 0x7f87b003d070 2024-09-12T17:28:22.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.484+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56552a3e3cf0 con 0x7f87b003d070 2024-09-12T17:28:22.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.485+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94923780923280] v31'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87ac03a040 con 0x7f87b003d070 2024-09-12T17:28:22.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.485+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(58 notify.7 [create] v31'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87ac03a040 con 0x7f87b003d070 2024-09-12T17:28:22.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.485+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94923780927952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56552a3e3b60 con 0x7f87b003d070 2024-09-12T17:28:22.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.485+0000 7f87ba830800 20 add_watcher() i=0 2024-09-12T17:28:22.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.485+0000 7f87ba830800 20 add_watcher() i=1 2024-09-12T17:28:22.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.485+0000 7f87ba830800 20 add_watcher() i=2 2024-09-12T17:28:22.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.485+0000 7f87ba830800 20 add_watcher() i=3 2024-09-12T17:28:22.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.485+0000 7f87ba830800 20 add_watcher() i=4 2024-09-12T17:28:22.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.485+0000 7f87ba830800 20 add_watcher() i=5 2024-09-12T17:28:22.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.485+0000 7f87ba830800 20 add_watcher() i=6 2024-09-12T17:28:22.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.486+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94923780927952] v31'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87ac03a040 con 0x7f87b003d070 2024-09-12T17:28:22.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.486+0000 7f87ba830800 20 add_watcher() i=7 2024-09-12T17:28:22.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.486+0000 7f87ba830800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:22.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.486+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56552a3e70a0 con 0x56552a3cfdd0 2024-09-12T17:28:22.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.487+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f87ac03a040 con 0x56552a3cfdd0 2024-09-12T17:28:22.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.487+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94923780929072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56552a3e4550 con 0x56552a3cfdd0 2024-09-12T17:28:22.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.488+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94923780929072] v31'178 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f87ac03a040 con 0x56552a3cfdd0 2024-09-12T17:28:22.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.488+0000 7f86677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:22.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.488+0000 7f87ba830800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:22.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.488+0000 7f87ba830800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:22.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.488+0000 7f87ba830800 5 note: GC not initialized 2024-09-12T17:28:22.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.488+0000 7f86667fc640 20 reqs_thread_entry: start 2024-09-12T17:28:22.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.488+0000 7f87ba830800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:22.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.488+0000 7f87ba830800 20 Filter name: none 2024-09-12T17:28:22.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.488+0000 7f85dbfff640 20 reqs_thread_entry: start 2024-09-12T17:28:22.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.488+0000 7f87ba830800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T17:28:22.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.488+0000 7f87ba830800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.488+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56552a41a760 con 0x56552a3d47c0 2024-09-12T17:28:22.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.489+0000 7f87b63cd640 1 -- 172.21.15.170:0/2426832410 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f87b000a4d0 con 0x56552a3d47c0 2024-09-12T17:28:22.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.489+0000 7f87ba830800 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T17:28:22.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.489+0000 7f87ba830800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-12T17:28:22.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.489+0000 7f87ba830800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:28:22.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.489+0000 7f87ba830800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5 : miss 2024-09-12T17:28:22.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.489+0000 7f87ba830800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.489+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:63 8.5 8:a5fd9635:root::.bucket.meta.myfoo%3a7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56552a41c1e0 con 0x56552a3cfdd0 2024-09-12T17:28:22.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.489+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(63 .bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f87ac03a040 con 0x56552a3cfdd0 2024-09-12T17:28:22.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.489+0000 7f87ba830800 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T17:28:22.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.489+0000 7f87ba830800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5 info.flags=0x17 2024-09-12T17:28:22.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.489+0000 7f87ba830800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5 to cache LRU end 2024-09-12T17:28:22.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.489+0000 7f87ba830800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:22.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.489+0000 7f87ba830800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:28:22.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.489+0000 7f87ba830800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5 2024-09-12T17:28:22.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.489+0000 7f87ba830800 20 get_obj_state: octx=0x7f87b0033420 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x56552a41e8d8 s->prefetch_data=0 2024-09-12T17:28:22.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.489+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:64 3.3c 3:3e309e99:::7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56552a41f860 con 0x56552a3d47c0 2024-09-12T17:28:22.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.490+0000 7f87b63cd640 1 -- 172.21.15.170:0/2426832410 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(64 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=849b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 262+0+865 (crc 0 0 0) 0x7f87b000a4d0 con 0x56552a3d47c0 2024-09-12T17:28:22.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.490+0000 7f87ba830800 10 manifest: total_size = 5 2024-09-12T17:28:22.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.490+0000 7f87ba830800 20 get_obj_state: setting s->obj_tag to _T_M96qpJzLSHBPaqryGQF6Ex5T772IH 2024-09-12T17:28:22.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.490+0000 7f86677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:22.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.490+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94923780929072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56552a41f860 con 0x56552a3cfdd0 2024-09-12T17:28:22.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.491+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94923780929072] v31'179 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f87ac03a040 con 0x56552a3cfdd0 2024-09-12T17:28:22.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.491+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94923780904464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56552a41f860 con 0x56552a3d47c0 2024-09-12T17:28:22.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.492+0000 7f87b63cd640 1 -- 172.21.15.170:0/2426832410 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94923780904464] v31'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87b000a4d0 con 0x56552a3d47c0 2024-09-12T17:28:22.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.492+0000 7f87ba830800 20 remove_watcher() i=0 2024-09-12T17:28:22.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.492+0000 7f87ba830800 2 removed watcher, disabling cache 2024-09-12T17:28:22.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.492+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94923780910496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56552a41f860 con 0x56552a3cfdd0 2024-09-12T17:28:22.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.494+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94923780910496] v31'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87ac03a040 con 0x56552a3cfdd0 2024-09-12T17:28:22.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.494+0000 7f87ba830800 20 remove_watcher() i=1 2024-09-12T17:28:22.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.494+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94923780914496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56552a41f860 con 0x56552a3d92c0 2024-09-12T17:28:22.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.495+0000 7f87b5bcc640 1 -- 172.21.15.170:0/2426832410 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94923780914496] v31'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87a8057030 con 0x56552a3d92c0 2024-09-12T17:28:22.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.495+0000 7f87ba830800 20 remove_watcher() i=2 2024-09-12T17:28:22.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.495+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94923780916832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56552a3deda0 con 0x56552a3d47c0 2024-09-12T17:28:22.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.496+0000 7f87b63cd640 1 -- 172.21.15.170:0/2426832410 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94923780916832] v31'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87b000a4d0 con 0x56552a3d47c0 2024-09-12T17:28:22.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.496+0000 7f87ba830800 20 remove_watcher() i=3 2024-09-12T17:28:22.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.496+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94923780919504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56552a3dfd40 con 0x56552a3cfdd0 2024-09-12T17:28:22.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.497+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94923780919504] v31'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87ac03a040 con 0x56552a3cfdd0 2024-09-12T17:28:22.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.497+0000 7f87ba830800 20 remove_watcher() i=4 2024-09-12T17:28:22.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.497+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94923780922224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56552a3deda0 con 0x7f87b003d070 2024-09-12T17:28:22.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.498+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94923780922224] v31'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87ac03a040 con 0x7f87b003d070 2024-09-12T17:28:22.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.498+0000 7f87ba830800 20 remove_watcher() i=5 2024-09-12T17:28:22.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.498+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94923780923280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56552a3e10d0 con 0x7f87b003d070 2024-09-12T17:28:22.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.499+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94923780923280] v31'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87ac03a040 con 0x7f87b003d070 2024-09-12T17:28:22.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.499+0000 7f87ba830800 20 remove_watcher() i=6 2024-09-12T17:28:22.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.499+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94923780927952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56552a3dfd40 con 0x7f87b003d070 2024-09-12T17:28:22.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.500+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94923780927952] v31'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87ac03a040 con 0x7f87b003d070 2024-09-12T17:28:22.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.500+0000 7f87ba830800 20 remove_watcher() i=7 2024-09-12T17:28:22.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.500+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f87b003d070 msgr2=0x7f87b00337d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.500+0000 7f87ba830800 1 --2- 172.21.15.170:0/2426832410 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f87b003d070 0x7f87b00337d0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.500+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56552a3cfdd0 msgr2=0x56552a3d2290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.500+0000 7f87ba830800 1 --2- 172.21.15.170:0/2426832410 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56552a3cfdd0 0x56552a3d2290 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.500+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56552a3d47c0 msgr2=0x56552a3d6bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.500+0000 7f87ba830800 1 --2- 172.21.15.170:0/2426832410 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56552a3d47c0 0x56552a3d6bb0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.500+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x56552a3d92c0 msgr2=0x56552a3db780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.500+0000 7f87ba830800 1 --2- 172.21.15.170:0/2426832410 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x56552a3d92c0 0x56552a3db780 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.500+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f868003c780 msgr2=0x7f868003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.500+0000 7f87ba830800 1 --2- 172.21.15.170:0/2426832410 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f868003c780 0x7f868003ec40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f87a80514a0 tx=0x7f87a8084000 comp rx=0 tx=0).stop 2024-09-12T17:28:22.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.500+0000 7f87b53cb640 1 -- 172.21.15.170:0/2426832410 reap_dead start 2024-09-12T17:28:22.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.500+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56552a3a9b60 msgr2=0x56552a3c43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.500+0000 7f87ba830800 1 --2- 172.21.15.170:0/2426832410 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56552a3a9b60 0x56552a3c43f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f87b0022ff0 tx=0x7f87b0053ca0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.500+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 shutdown_connections 2024-09-12T17:28:22.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.500+0000 7f87ba830800 1 --2- 172.21.15.170:0/2426832410 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56552a3a9b60 0x56552a3c43f0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.500+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 >> 172.21.15.170:0/2426832410 conn(0x56552a3b4de0 msgr2=0x56552a3ab2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:22.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.500+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 shutdown_connections 2024-09-12T17:28:22.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.500+0000 7f87ba830800 1 -- 172.21.15.170:0/2426832410 wait complete. 2024-09-12T17:28:22.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.501+0000 7f87ba830800 1 -- 172.21.15.170:0/4157140736 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f869003c780 msgr2=0x7f869003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.501+0000 7f87ba830800 1 --2- 172.21.15.170:0/4157140736 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f869003c780 0x7f869003ec40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x56552a39b890 tx=0x7f87a805adc0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.501+0000 7f87ba830800 1 -- 172.21.15.170:0/4157140736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56552a20d6f0 msgr2=0x56552a20bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.501+0000 7f87ba830800 1 --2- 172.21.15.170:0/4157140736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56552a20d6f0 0x56552a20bf60 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x56552a38fe80 tx=0x7f87b00167b0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.501+0000 7f87ba830800 1 -- 172.21.15.170:0/4157140736 shutdown_connections 2024-09-12T17:28:22.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.501+0000 7f87ba830800 1 --2- 172.21.15.170:0/4157140736 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f869003c780 0x7f869003ec40 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.501+0000 7f87ba830800 1 --2- 172.21.15.170:0/4157140736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56552a20d6f0 0x56552a20bf60 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.501+0000 7f87ba830800 1 -- 172.21.15.170:0/4157140736 >> 172.21.15.170:0/4157140736 conn(0x56552a39e130 msgr2=0x56552a39e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:22.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.501+0000 7f87ba830800 1 -- 172.21.15.170:0/4157140736 shutdown_connections 2024-09-12T17:28:22.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.501+0000 7f87ba830800 1 -- 172.21.15.170:0/4157140736 wait complete. 2024-09-12T17:28:22.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.501+0000 7f87ba830800 1 -- 172.21.15.170:0/1086969968 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56552a299100 msgr2=0x56552a3964d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.501+0000 7f87ba830800 1 --2- 172.21.15.170:0/1086969968 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56552a299100 0x56552a3964d0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.501+0000 7f87ba830800 1 -- 172.21.15.170:0/1086969968 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56552a3988f0 msgr2=0x56552a39ad60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.501+0000 7f87ba830800 1 --2- 172.21.15.170:0/1086969968 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56552a3988f0 0x56552a39ad60 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.501+0000 7f87ba830800 1 -- 172.21.15.170:0/1086969968 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f869c03c780 msgr2=0x7f869c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.501+0000 7f87ba830800 1 --2- 172.21.15.170:0/1086969968 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f869c03c780 0x7f869c03ec40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f87ac001e50 tx=0x7f87ac0013d0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.501+0000 7f87ba830800 1 -- 172.21.15.170:0/1086969968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56552a298000 msgr2=0x56552a38ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.501+0000 7f87ba830800 1 --2- 172.21.15.170:0/1086969968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56552a298000 0x56552a38ee80 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f87a80460d0 tx=0x7f87a8002fb0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.501+0000 7f87ba830800 1 -- 172.21.15.170:0/1086969968 shutdown_connections 2024-09-12T17:28:22.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.501+0000 7f87ba830800 1 --2- 172.21.15.170:0/1086969968 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56552a3988f0 0x56552a39ad60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.501+0000 7f87ba830800 1 --2- 172.21.15.170:0/1086969968 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f869c03c780 0x7f869c03ec40 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.501+0000 7f87ba830800 1 --2- 172.21.15.170:0/1086969968 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56552a299100 0x56552a3964d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.501+0000 7f87ba830800 1 --2- 172.21.15.170:0/1086969968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56552a298000 0x56552a38ee80 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.501+0000 7f87ba830800 1 -- 172.21.15.170:0/1086969968 >> 172.21.15.170:0/1086969968 conn(0x56552a2933d0 msgr2=0x56552a3817d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:22.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.501+0000 7f87ba830800 1 -- 172.21.15.170:0/1086969968 shutdown_connections 2024-09-12T17:28:22.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.501+0000 7f87ba830800 1 -- 172.21.15.170:0/1086969968 wait complete. 2024-09-12T17:28:22.515 INFO:teuthology.orchestra.run.smithi170.stdout:fooFoofooFooFULL_CONTROL 2024-09-12T17:28:22.516 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-09-12T17:28:22.518 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-09-12T17:28:22.522 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:28:22.522 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-12T17:28:22.522 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-12T17:28:22.523 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-12T17:28:22.568 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:22.568 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:22.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.567+0000 7f8eaa175800 1 Processor -- start 2024-09-12T17:28:22.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.568+0000 7f8eaa175800 1 -- start start 2024-09-12T17:28:22.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.568+0000 7f8eaa175800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x555eee08ae00 0x555eee08bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.568+0000 7f8eaa175800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555eedf35e40 con 0x555eee08c040 2024-09-12T17:28:22.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.568+0000 7f8eaa175800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x555eedf00680 con 0x555eee08ae00 2024-09-12T17:28:22.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.568+0000 7f8ea7c5f640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x555eee08ae00 0x555eee08bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.568+0000 7f8ea745e640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x555eee08c040 0x555eee090da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:47702/0 (socket says 172.21.15.170:47702) 2024-09-12T17:28:22.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.568+0000 7f8ea7c5f640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x555eee08ae00 0x555eee08bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56034/0 (socket says 172.21.15.170:56034) 2024-09-12T17:28:22.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.568+0000 7f8ea745e640 1 -- 172.21.15.170:0/4078346646 learned_addr learned my addr 172.21.15.170:0/4078346646 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:28:22.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.568+0000 7f8ea7c5f640 1 -- 172.21.15.170:0/4078346646 >> v1:172.21.15.47:6789/0 conn(0x555eee08c040 legacy=0x555eee090da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.568+0000 7f8ea7c5f640 1 -- 172.21.15.170:0/4078346646 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555eedf1c6b0 con 0x555eee08ae00 2024-09-12T17:28:22.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.570+0000 7f8ea7c5f640 1 --2- 172.21.15.170:0/4078346646 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555eee08ae00 0x555eee08bb00 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f8e98005fd0 tx=0x7f8e98045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=303fb0ef09f426e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.570+0000 7f8ea6c5d640 1 -- 172.21.15.170:0/4078346646 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e98058530 con 0x555eee08ae00 2024-09-12T17:28:22.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.570+0000 7f8ea6c5d640 1 -- 172.21.15.170:0/4078346646 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e980586d0 con 0x555eee08ae00 2024-09-12T17:28:22.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.570+0000 7f8ea6c5d640 1 -- 172.21.15.170:0/4078346646 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e980589d0 con 0x555eee08ae00 2024-09-12T17:28:22.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.571+0000 7f8eaa175800 1 -- 172.21.15.170:0/4078346646 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555eee08ae00 msgr2=0x555eee08bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.571+0000 7f8eaa175800 1 --2- 172.21.15.170:0/4078346646 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555eee08ae00 0x555eee08bb00 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f8e98005fd0 tx=0x7f8e98045c30 comp rx=0 tx=0).stop 2024-09-12T17:28:22.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.571+0000 7f8eaa175800 1 -- 172.21.15.170:0/4078346646 shutdown_connections 2024-09-12T17:28:22.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.571+0000 7f8eaa175800 1 --2- 172.21.15.170:0/4078346646 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555eee08ae00 0x555eee08bb00 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.571+0000 7f8eaa175800 1 -- 172.21.15.170:0/4078346646 >> 172.21.15.170:0/4078346646 conn(0x555eee0861d0 msgr2=0x555eee088630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:22.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.571+0000 7f8eaa175800 1 -- 172.21.15.170:0/4078346646 shutdown_connections 2024-09-12T17:28:22.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.571+0000 7f8eaa175800 1 -- 172.21.15.170:0/4078346646 wait complete. 2024-09-12T17:28:22.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.585+0000 7f8eaa175800 1 Processor -- start 2024-09-12T17:28:22.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.585+0000 7f8eaa175800 1 -- start start 2024-09-12T17:28:22.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.585+0000 7f8eaa175800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555eee08ae00 0x555eedffed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.585+0000 7f8eaa175800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555eedf24dd0 con 0x555eee08ae00 2024-09-12T17:28:22.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.585+0000 7f8ea7c5f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555eee08ae00 0x555eedffed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.585+0000 7f8ea7c5f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555eee08ae00 0x555eedffed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56048/0 (socket says 172.21.15.170:56048) 2024-09-12T17:28:22.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.585+0000 7f8ea7c5f640 1 -- 172.21.15.170:0/396481026 learned_addr learned my addr 172.21.15.170:0/396481026 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:22.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.585+0000 7f8ea7c5f640 1 -- 172.21.15.170:0/396481026 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555eedf3de10 con 0x555eee08ae00 2024-09-12T17:28:22.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.586+0000 7f8ea7c5f640 1 --2- 172.21.15.170:0/396481026 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555eee08ae00 0x555eedffed20 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f8e98025a60 tx=0x7f8e98051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3db1eb2fe0f2e02 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.586+0000 7f8d95e0b640 1 -- 172.21.15.170:0/396481026 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e980589b0 con 0x555eee08ae00 2024-09-12T17:28:22.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.586+0000 7f8d95e0b640 1 -- 172.21.15.170:0/396481026 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e98068070 con 0x555eee08ae00 2024-09-12T17:28:22.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.586+0000 7f8d95e0b640 1 -- 172.21.15.170:0/396481026 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e98058c80 con 0x555eee08ae00 2024-09-12T17:28:22.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.586+0000 7f8eaa175800 1 -- 172.21.15.170:0/396481026 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555eee08ae00 msgr2=0x555eedffed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.586+0000 7f8eaa175800 1 --2- 172.21.15.170:0/396481026 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555eee08ae00 0x555eedffed20 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f8e98025a60 tx=0x7f8e98051000 comp rx=0 tx=0).stop 2024-09-12T17:28:22.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.586+0000 7f8eaa175800 1 -- 172.21.15.170:0/396481026 shutdown_connections 2024-09-12T17:28:22.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.586+0000 7f8eaa175800 1 --2- 172.21.15.170:0/396481026 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555eee08ae00 0x555eedffed20 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.586+0000 7f8eaa175800 1 -- 172.21.15.170:0/396481026 >> 172.21.15.170:0/396481026 conn(0x555eee0861d0 msgr2=0x555eee175f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:22.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.587+0000 7f8eaa175800 1 -- 172.21.15.170:0/396481026 shutdown_connections 2024-09-12T17:28:22.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.587+0000 7f8eaa175800 1 -- 172.21.15.170:0/396481026 wait complete. 2024-09-12T17:28:22.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.587+0000 7f8eaa175800 1 Processor -- start 2024-09-12T17:28:22.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.587+0000 7f8eaa175800 1 -- start start 2024-09-12T17:28:22.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.587+0000 7f8eaa175800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555eee08ae00 0x555eee185150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.587+0000 7f8eaa175800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555eee08c730 con 0x555eee08ae00 2024-09-12T17:28:22.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.587+0000 7f8ea7c5f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555eee08ae00 0x555eee185150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.587+0000 7f8ea7c5f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555eee08ae00 0x555eee185150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56058/0 (socket says 172.21.15.170:56058) 2024-09-12T17:28:22.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.587+0000 7f8ea7c5f640 1 -- 172.21.15.170:0/3520460196 learned_addr learned my addr 172.21.15.170:0/3520460196 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:22.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.587+0000 7f8ea7c5f640 1 -- 172.21.15.170:0/3520460196 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555eee1856b0 con 0x555eee08ae00 2024-09-12T17:28:22.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.588+0000 7f8ea7c5f640 1 --2- 172.21.15.170:0/3520460196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555eee08ae00 0x555eee185150 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8e98025a60 tx=0x7f8e98003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.588+0000 7f8d8ffff640 1 -- 172.21.15.170:0/3520460196 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e98063650 con 0x555eee08ae00 2024-09-12T17:28:22.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.588+0000 7f8d8ffff640 1 -- 172.21.15.170:0/3520460196 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e980637f0 con 0x555eee08ae00 2024-09-12T17:28:22.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.588+0000 7f8d8ffff640 1 -- 172.21.15.170:0/3520460196 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e98063af0 con 0x555eee08ae00 2024-09-12T17:28:22.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.588+0000 7f8eaa175800 1 -- 172.21.15.170:0/3520460196 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555eee185940 con 0x555eee08ae00 2024-09-12T17:28:22.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.588+0000 7f8eaa175800 1 -- 172.21.15.170:0/3520460196 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555eee186550 con 0x555eee08ae00 2024-09-12T17:28:22.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.589+0000 7f8d8ffff640 1 -- 172.21.15.170:0/3520460196 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8e98063c90 con 0x555eee08ae00 2024-09-12T17:28:22.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.589+0000 7f8d8ffff640 1 --2- 172.21.15.170:0/3520460196 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8d9003c780 0x7f8d9003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.589+0000 7f8d8ffff640 1 -- 172.21.15.170:0/3520460196 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f8e98097cb0 con 0x555eee08ae00 2024-09-12T17:28:22.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.589+0000 7f8ea745e640 1 --2- 172.21.15.170:0/3520460196 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8d9003c780 0x7f8d9003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.589+0000 7f8eaa175800 1 --2- 172.21.15.170:0/3520460196 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x555eee08c040 0x555eee18c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.589+0000 7f8eaa175800 1 -- 172.21.15.170:0/3520460196 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555eee18cce0 con 0x555eee08c040 2024-09-12T17:28:22.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.589+0000 7f8ea8460640 1 --2- 172.21.15.170:0/3520460196 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x555eee08c040 0x555eee18c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.589+0000 7f8ea745e640 1 --2- 172.21.15.170:0/3520460196 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8d9003c780 0x7f8d9003ec40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c001d70 tx=0x7f8e9c0012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.590+0000 7f8ea8460640 1 --2- 172.21.15.170:0/3520460196 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x555eee08c040 0x555eee18c7a0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.590+0000 7f8ea8460640 1 -- 172.21.15.170:0/3520460196 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ea00083e0 con 0x555eee08c040 2024-09-12T17:28:22.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.590+0000 7f8eaa175800 1 -- 172.21.15.170:0/3520460196 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555eee18d080 con 0x555eee08c040 2024-09-12T17:28:22.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.590+0000 7f8ea8460640 1 -- 172.21.15.170:0/3520460196 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8ea00083e0 con 0x555eee08c040 2024-09-12T17:28:22.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.590+0000 7f8eaa175800 1 --2- 172.21.15.170:0/3520460196 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x555eee18eb40 0x555eee190fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.590+0000 7f8eaa175800 1 -- 172.21.15.170:0/3520460196 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555eee191770 con 0x555eee18eb40 2024-09-12T17:28:22.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.590+0000 7f8ea7c5f640 1 --2- 172.21.15.170:0/3520460196 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x555eee18eb40 0x555eee190fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.591+0000 7f8ea7c5f640 1 --2- 172.21.15.170:0/3520460196 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x555eee18eb40 0x555eee190fe0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.591+0000 7f8ea7c5f640 1 -- 172.21.15.170:0/3520460196 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8e980743e0 con 0x555eee18eb40 2024-09-12T17:28:22.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.591+0000 7f8eaa175800 1 -- 172.21.15.170:0/3520460196 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555eee18d8d0 con 0x555eee08c040 2024-09-12T17:28:22.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.591+0000 7f8ea8460640 1 -- 172.21.15.170:0/3520460196 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8ea00083e0 con 0x555eee08c040 2024-09-12T17:28:22.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.591+0000 7f8eaa175800 1 -- 172.21.15.170:0/3520460196 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555eee18dcb0 con 0x555eee18eb40 2024-09-12T17:28:22.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.591+0000 7f8ea7c5f640 1 -- 172.21.15.170:0/3520460196 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8e980743e0 con 0x555eee18eb40 2024-09-12T17:28:22.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.592+0000 7f8eaa175800 1 Processor -- start 2024-09-12T17:28:22.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.592+0000 7f8eaa175800 1 -- start start 2024-09-12T17:28:22.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.592+0000 7f8eaa175800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555eee1a0020 0x555eee1a0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.592+0000 7f8eaa175800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555eedf82a00 con 0x555eee1a0020 2024-09-12T17:28:22.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.592+0000 7f8ea8460640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555eee1a0020 0x555eee1a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.592+0000 7f8ea8460640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555eee1a0020 0x555eee1a0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56076/0 (socket says 172.21.15.170:56076) 2024-09-12T17:28:22.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.592+0000 7f8ea8460640 1 -- 172.21.15.170:0/3497235644 learned_addr learned my addr 172.21.15.170:0/3497235644 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:22.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.592+0000 7f8ea8460640 1 -- 172.21.15.170:0/3497235644 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555eee1a0a80 con 0x555eee1a0020 2024-09-12T17:28:22.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.593+0000 7f8ea8460640 1 --2- 172.21.15.170:0/3497235644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555eee1a0020 0x555eee1a0440 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x555eee187040 tx=0x7f8ea000bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.593+0000 7f8d8d7fa640 1 -- 172.21.15.170:0/3497235644 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ea001c020 con 0x555eee1a0020 2024-09-12T17:28:22.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.593+0000 7f8d8d7fa640 1 -- 172.21.15.170:0/3497235644 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ea0007c90 con 0x555eee1a0020 2024-09-12T17:28:22.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.593+0000 7f8eaa175800 1 -- 172.21.15.170:0/3497235644 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555eee1a12b0 con 0x555eee1a0020 2024-09-12T17:28:22.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.593+0000 7f8d8d7fa640 1 -- 172.21.15.170:0/3497235644 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ea0018440 con 0x555eee1a0020 2024-09-12T17:28:22.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.593+0000 7f8eaa175800 1 -- 172.21.15.170:0/3497235644 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555eee1a1850 con 0x555eee1a0020 2024-09-12T17:28:22.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.594+0000 7f8d8d7fa640 1 -- 172.21.15.170:0/3497235644 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8ea001f020 con 0x555eee1a0020 2024-09-12T17:28:22.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.594+0000 7f8d8d7fa640 1 --2- 172.21.15.170:0/3497235644 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8d8003c730 0x7f8d8003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.594+0000 7f8d8d7fa640 1 -- 172.21.15.170:0/3497235644 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f8ea0054eb0 con 0x555eee1a0020 2024-09-12T17:28:22.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.594+0000 7f8ea7c5f640 1 --2- 172.21.15.170:0/3497235644 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8d8003c730 0x7f8d8003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.594+0000 7f8eaa175800 1 Processor -- start 2024-09-12T17:28:22.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.594+0000 7f8ea7c5f640 1 --2- 172.21.15.170:0/3497235644 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8d8003c730 0x7f8d8003ebf0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8e98096150 tx=0x7f8e9804e790 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.594+0000 7f8eaa175800 1 -- start start 2024-09-12T17:28:22.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.594+0000 7f8eaa175800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555eee1aca60 0x555eee1ace60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.594+0000 7f8eaa175800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555eedfff3a0 con 0x555eee1aca60 2024-09-12T17:28:22.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.595+0000 7f8ea8460640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555eee1aca60 0x555eee1ace60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.595+0000 7f8ea8460640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555eee1aca60 0x555eee1ace60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56088/0 (socket says 172.21.15.170:56088) 2024-09-12T17:28:22.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.595+0000 7f8ea8460640 1 -- 172.21.15.170:0/2716386391 learned_addr learned my addr 172.21.15.170:0/2716386391 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:22.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.595+0000 7f8ea8460640 1 -- 172.21.15.170:0/2716386391 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555eee1ad450 con 0x555eee1aca60 2024-09-12T17:28:22.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.595+0000 7f8ea8460640 1 --2- 172.21.15.170:0/2716386391 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555eee1aca60 0x555eee1ace60 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0053300 tx=0x7f8ea0015f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6319a5e2454e4739 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.595+0000 7f8d86ffd640 1 -- 172.21.15.170:0/2716386391 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ea0050030 con 0x555eee1aca60 2024-09-12T17:28:22.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.595+0000 7f8d86ffd640 1 -- 172.21.15.170:0/2716386391 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ea0017520 con 0x555eee1aca60 2024-09-12T17:28:22.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.595+0000 7f8d86ffd640 1 -- 172.21.15.170:0/2716386391 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ea0015820 con 0x555eee1aca60 2024-09-12T17:28:22.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.596+0000 7f8eaa175800 1 -- 172.21.15.170:0/2716386391 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555eee1aca60 msgr2=0x555eee1ace60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.596+0000 7f8eaa175800 1 --2- 172.21.15.170:0/2716386391 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555eee1aca60 0x555eee1ace60 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0053300 tx=0x7f8ea0015f20 comp rx=0 tx=0).stop 2024-09-12T17:28:22.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.596+0000 7f8eaa175800 1 -- 172.21.15.170:0/2716386391 shutdown_connections 2024-09-12T17:28:22.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.596+0000 7f8eaa175800 1 --2- 172.21.15.170:0/2716386391 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555eee1aca60 0x555eee1ace60 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.596+0000 7f8eaa175800 1 -- 172.21.15.170:0/2716386391 >> 172.21.15.170:0/2716386391 conn(0x555eee1a8e80 msgr2=0x555eee1a70c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:22.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.596+0000 7f8eaa175800 1 -- 172.21.15.170:0/2716386391 shutdown_connections 2024-09-12T17:28:22.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.596+0000 7f8eaa175800 1 -- 172.21.15.170:0/2716386391 wait complete. 2024-09-12T17:28:22.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.596+0000 7f8eaa175800 1 Processor -- start 2024-09-12T17:28:22.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.596+0000 7f8eaa175800 1 -- start start 2024-09-12T17:28:22.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.596+0000 7f8eaa175800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555eee1aca60 0x555eee1b4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.596+0000 7f8eaa175800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555eee1ada70 con 0x555eee1aca60 2024-09-12T17:28:22.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.596+0000 7f8ea8460640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555eee1aca60 0x555eee1b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.596+0000 7f8ea8460640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555eee1aca60 0x555eee1b4080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56100/0 (socket says 172.21.15.170:56100) 2024-09-12T17:28:22.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.596+0000 7f8ea8460640 1 -- 172.21.15.170:0/3434436234 learned_addr learned my addr 172.21.15.170:0/3434436234 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:22.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.597+0000 7f8ea8460640 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555eee1b45e0 con 0x555eee1aca60 2024-09-12T17:28:22.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.597+0000 7f8ea8460640 1 --2- 172.21.15.170:0/3434436234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555eee1aca60 0x555eee1b4080 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f8ea00206f0 tx=0x7f8ea0005670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.597+0000 7f8d857fa640 1 -- 172.21.15.170:0/3434436234 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ea0030070 con 0x555eee1aca60 2024-09-12T17:28:22.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.597+0000 7f8d857fa640 1 -- 172.21.15.170:0/3434436234 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ea000b020 con 0x555eee1aca60 2024-09-12T17:28:22.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.597+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555eee1b4870 con 0x555eee1aca60 2024-09-12T17:28:22.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.597+0000 7f8d857fa640 1 -- 172.21.15.170:0/3434436234 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ea0050070 con 0x555eee1aca60 2024-09-12T17:28:22.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.597+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555eee1b51f0 con 0x555eee1aca60 2024-09-12T17:28:22.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.598+0000 7f8d857fa640 1 -- 172.21.15.170:0/3434436234 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8ea0016040 con 0x555eee1aca60 2024-09-12T17:28:22.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.598+0000 7f8d857fa640 1 --2- 172.21.15.170:0/3434436234 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8d7003c780 0x7f8d7003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.598+0000 7f8d857fa640 1 -- 172.21.15.170:0/3434436234 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f8ea0051070 con 0x555eee1aca60 2024-09-12T17:28:22.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.598+0000 7f8ea7c5f640 1 --2- 172.21.15.170:0/3434436234 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8d7003c780 0x7f8d7003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.598+0000 7f8ea7c5f640 1 --2- 172.21.15.170:0/3434436234 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8d7003c780 0x7f8d7003ec40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8e9807ffd0 tx=0x7f8e98090000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.599+0000 7f8eaa175800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.599+0000 7f8eaa175800 1 --2- 172.21.15.170:0/3434436234 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x555eee1bf9b0 0x555eee1c1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.599+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555eee1c25c0 con 0x555eee1bf9b0 2024-09-12T17:28:22.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.599+0000 7f8ea745e640 1 --2- 172.21.15.170:0/3434436234 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x555eee1bf9b0 0x555eee1c1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.599+0000 7f8ea745e640 1 --2- 172.21.15.170:0/3434436234 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x555eee1bf9b0 0x555eee1c1e70 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.599+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8e9c009050 con 0x555eee1bf9b0 2024-09-12T17:28:22.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.599+0000 7f8eaa175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:22.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.599+0000 7f8eaa175800 20 realm 2024-09-12T17:28:22.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.599+0000 7f8eaa175800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.599+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555eee1bed00 con 0x555eee1bf9b0 2024-09-12T17:28:22.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.600+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8e9c009050 con 0x555eee1bf9b0 2024-09-12T17:28:22.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.600+0000 7f8eaa175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:22.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.600+0000 7f8eaa175800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:22.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.600+0000 7f8eaa175800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.600+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555eee1c30b0 con 0x555eee1bf9b0 2024-09-12T17:28:22.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.600+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8e9c009050 con 0x555eee1bf9b0 2024-09-12T17:28:22.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.600+0000 7f8eaa175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:22.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.600+0000 7f8eaa175800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.600+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555eee1c3980 con 0x555eee1bf9b0 2024-09-12T17:28:22.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.600+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8e9c009050 con 0x555eee1bf9b0 2024-09-12T17:28:22.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.600+0000 7f8eaa175800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:22.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.600+0000 7f8eaa175800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.600+0000 7f8eaa175800 1 --2- 172.21.15.170:0/3434436234 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x555eee1c43a0 0x555eee1c6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.600+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555eee1c6ed0 con 0x555eee1c43a0 2024-09-12T17:28:22.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.600+0000 7f8ea8460640 1 --2- 172.21.15.170:0/3434436234 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x555eee1c43a0 0x555eee1c6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.600+0000 7f8ea8460640 1 --2- 172.21.15.170:0/3434436234 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x555eee1c43a0 0x555eee1c6790 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.601+0000 7f8ea8460640 1 -- 172.21.15.170:0/3434436234 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8ea00083e0 con 0x555eee1c43a0 2024-09-12T17:28:22.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.601+0000 7f8eaa175800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:22.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.601+0000 7f8eaa175800 20 searching for the correct realm 2024-09-12T17:28:22.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.601+0000 7f8eaa175800 1 --2- 172.21.15.170:0/3434436234 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x555eee1c8e80 0x555eee1cb340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.601+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555eee1cb9c0 con 0x555eee1c8e80 2024-09-12T17:28:22.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.601+0000 7f8ea7c5f640 1 --2- 172.21.15.170:0/3434436234 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x555eee1c8e80 0x555eee1cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.601+0000 7f8ea7c5f640 1 --2- 172.21.15.170:0/3434436234 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x555eee1c8e80 0x555eee1cb340 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.601+0000 7f8ea7c5f640 1 -- 172.21.15.170:0/3434436234 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e98089040 con 0x555eee1c8e80 2024-09-12T17:28:22.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.601+0000 7f8ea7c5f640 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555eee1cb9c0 con 0x555eee1c43a0 2024-09-12T17:28:22.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.602+0000 7f8ea8460640 1 -- 172.21.15.170:0/3434436234 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ea00083e0 con 0x555eee1c43a0 2024-09-12T17:28:22.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.602+0000 7f8ea8460640 1 --2- 172.21.15.170:0/3434436234 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f8ea0021020 0x7f8ea0013320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.602+0000 7f8ea8460640 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555eee1cb9c0 con 0x7f8ea0021020 2024-09-12T17:28:22.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.602+0000 7f8ea745e640 1 --2- 172.21.15.170:0/3434436234 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f8ea0021020 0x7f8ea0013320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.602+0000 7f8ea745e640 1 --2- 172.21.15.170:0/3434436234 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f8ea0021020 0x7f8ea0013320 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.602+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e9c009050 con 0x7f8ea0021020 2024-09-12T17:28:22.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.602+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555eee1cb9c0 con 0x555eee1bf9b0 2024-09-12T17:28:22.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.602+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e9c009050 con 0x555eee1bf9b0 2024-09-12T17:28:22.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.603+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555eee1cb9c0 con 0x555eee1bf9b0 2024-09-12T17:28:22.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.603+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e9c029040 con 0x555eee1bf9b0 2024-09-12T17:28:22.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.603+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555eee1cb9c0 con 0x7f8ea0021020 2024-09-12T17:28:22.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.603+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e9c029040 con 0x7f8ea0021020 2024-09-12T17:28:22.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.603+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555eee1cb9c0 con 0x7f8ea0021020 2024-09-12T17:28:22.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.603+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e9c029040 con 0x7f8ea0021020 2024-09-12T17:28:22.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.603+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555eee1cb9c0 con 0x555eee1c43a0 2024-09-12T17:28:22.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.603+0000 7f8ea8460640 1 -- 172.21.15.170:0/3434436234 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ea00083e0 con 0x555eee1c43a0 2024-09-12T17:28:22.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.603+0000 7f8ea8460640 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555eee1cb9c0 con 0x555eee1c8e80 2024-09-12T17:28:22.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.604+0000 7f8ea7c5f640 1 -- 172.21.15.170:0/3434436234 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e98089040 con 0x555eee1c8e80 2024-09-12T17:28:22.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.604+0000 7f8ea7c5f640 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555eee1cb9c0 con 0x555eee1bf9b0 2024-09-12T17:28:22.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.604+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e9c029040 con 0x555eee1bf9b0 2024-09-12T17:28:22.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.604+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555eee1cb9c0 con 0x7f8ea0021020 2024-09-12T17:28:22.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.604+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e9c029040 con 0x7f8ea0021020 2024-09-12T17:28:22.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.604+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555eee1cb9c0 con 0x555eee1bf9b0 2024-09-12T17:28:22.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.604+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e9c029040 con 0x555eee1bf9b0 2024-09-12T17:28:22.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.604+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555eee1cb9c0 con 0x555eee1c43a0 2024-09-12T17:28:22.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.605+0000 7f8ea8460640 1 -- 172.21.15.170:0/3434436234 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f8ea00083e0 con 0x555eee1c43a0 2024-09-12T17:28:22.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.605+0000 7f8ea8460640 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555eee1cb9c0 con 0x555eee1c8e80 2024-09-12T17:28:22.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.605+0000 7f8ea7c5f640 1 -- 172.21.15.170:0/3434436234 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e98089040 con 0x555eee1c8e80 2024-09-12T17:28:22.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.605+0000 7f8ea7c5f640 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555eee1cb9c0 con 0x555eee1c8e80 2024-09-12T17:28:22.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.605+0000 7f8ea7c5f640 1 -- 172.21.15.170:0/3434436234 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e98089040 con 0x555eee1c8e80 2024-09-12T17:28:22.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.605+0000 7f8ea7c5f640 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555eee1cb9c0 con 0x555eee1c43a0 2024-09-12T17:28:22.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.605+0000 7f8ea8460640 1 -- 172.21.15.170:0/3434436234 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ea00083e0 con 0x555eee1c43a0 2024-09-12T17:28:22.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.605+0000 7f8ea8460640 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555eee1cb9c0 con 0x555eee1c8e80 2024-09-12T17:28:22.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.606+0000 7f8ea7c5f640 1 -- 172.21.15.170:0/3434436234 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e98089040 con 0x555eee1c8e80 2024-09-12T17:28:22.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.606+0000 7f8ea7c5f640 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555eee1cb9c0 con 0x555eee1c8e80 2024-09-12T17:28:22.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.606+0000 7f8ea7c5f640 1 -- 172.21.15.170:0/3434436234 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e98089040 con 0x555eee1c8e80 2024-09-12T17:28:22.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.606+0000 7f8ea7c5f640 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555eee1cb9c0 con 0x555eee1bf9b0 2024-09-12T17:28:22.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.606+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e9c029040 con 0x555eee1bf9b0 2024-09-12T17:28:22.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.606+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555eee1cb9c0 con 0x555eee1bf9b0 2024-09-12T17:28:22.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.606+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8e9c029040 con 0x555eee1bf9b0 2024-09-12T17:28:22.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.606+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555eee1cb9c0 con 0x7f8ea0021020 2024-09-12T17:28:22.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.607+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e9c029040 con 0x7f8ea0021020 2024-09-12T17:28:22.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.607+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555eee1cb9c0 con 0x555eee1c8e80 2024-09-12T17:28:22.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.607+0000 7f8ea7c5f640 1 -- 172.21.15.170:0/3434436234 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e98089040 con 0x555eee1c8e80 2024-09-12T17:28:22.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.607+0000 7f8ea7c5f640 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555eee1cb9c0 con 0x555eee1c43a0 2024-09-12T17:28:22.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.607+0000 7f8ea8460640 1 -- 172.21.15.170:0/3434436234 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ea00083e0 con 0x555eee1c43a0 2024-09-12T17:28:22.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.607+0000 7f8ea8460640 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555eee1cb9c0 con 0x555eee1bf9b0 2024-09-12T17:28:22.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.607+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e9c029040 con 0x555eee1bf9b0 2024-09-12T17:28:22.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.607+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555eee1cb9c0 con 0x7f8ea0021020 2024-09-12T17:28:22.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.607+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e9c029040 con 0x7f8ea0021020 2024-09-12T17:28:22.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.607+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555eee1cb9c0 con 0x555eee1c8e80 2024-09-12T17:28:22.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.608+0000 7f8ea7c5f640 1 -- 172.21.15.170:0/3434436234 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e98089040 con 0x555eee1c8e80 2024-09-12T17:28:22.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.608+0000 7f8ea7c5f640 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555eee1cb9c0 con 0x7f8ea0021020 2024-09-12T17:28:22.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.608+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e9c029040 con 0x7f8ea0021020 2024-09-12T17:28:22.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.608+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555eee1cb9c0 con 0x555eee1c43a0 2024-09-12T17:28:22.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.608+0000 7f8ea8460640 1 -- 172.21.15.170:0/3434436234 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ea00083e0 con 0x555eee1c43a0 2024-09-12T17:28:22.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.608+0000 7f8ea8460640 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555eee1cb9c0 con 0x555eee1c8e80 2024-09-12T17:28:22.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.608+0000 7f8ea7c5f640 1 -- 172.21.15.170:0/3434436234 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e98089040 con 0x555eee1c8e80 2024-09-12T17:28:22.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.608+0000 7f8ea7c5f640 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555eee1cb9c0 con 0x7f8ea0021020 2024-09-12T17:28:22.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.609+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e9c029040 con 0x7f8ea0021020 2024-09-12T17:28:22.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.609+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555eee1cb9c0 con 0x555eee1bf9b0 2024-09-12T17:28:22.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.609+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8e9c029040 con 0x555eee1bf9b0 2024-09-12T17:28:22.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.609+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555eee1cb9c0 con 0x555eee1c43a0 2024-09-12T17:28:22.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.609+0000 7f8ea8460640 1 -- 172.21.15.170:0/3434436234 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(37 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8ea00083e0 con 0x555eee1c43a0 2024-09-12T17:28:22.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.609+0000 7f8eaa175800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:22.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.609+0000 7f8eaa175800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:22.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.609+0000 7f8eaa175800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:22.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.609+0000 7f8eaa175800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:22.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.609+0000 7f8eaa175800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:22.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.609+0000 7f8eaa175800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:22.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.609+0000 7f8eaa175800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.609+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555eee1c7890 con 0x555eee1bf9b0 2024-09-12T17:28:22.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.609+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8e9c029040 con 0x555eee1bf9b0 2024-09-12T17:28:22.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.609+0000 7f8eaa175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:22.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.609+0000 7f8eaa175800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.610+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555eee1c74d0 con 0x555eee1bf9b0 2024-09-12T17:28:22.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.610+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8e9c029040 con 0x555eee1bf9b0 2024-09-12T17:28:22.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.610+0000 7f8eaa175800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:22.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.610+0000 7f8eaa175800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.610+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555eee1c7cd0 con 0x555eee1c43a0 2024-09-12T17:28:22.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.610+0000 7f8ea8460640 1 -- 172.21.15.170:0/3434436234 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8ea00083e0 con 0x555eee1c43a0 2024-09-12T17:28:22.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.610+0000 7f8eaa175800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:22.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.610+0000 7f8eaa175800 20 zone default found 2024-09-12T17:28:22.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.610+0000 7f8eaa175800 4 Realm: () 2024-09-12T17:28:22.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.610+0000 7f8eaa175800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:22.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.610+0000 7f8eaa175800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:22.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.610+0000 7f8eaa175800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:22.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.610+0000 7f8eaa175800 20 zonegroup default 2024-09-12T17:28:22.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.610+0000 7f8eaa175800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.610+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555eee1cbe40 con 0x7f8ea0021020 2024-09-12T17:28:22.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.610+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8e9c029040 con 0x7f8ea0021020 2024-09-12T17:28:22.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.610+0000 7f8eaa175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:22.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.610+0000 7f8eaa175800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.610+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555eee1ce0d0 con 0x555eee1c8e80 2024-09-12T17:28:22.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.611+0000 7f8ea7c5f640 1 -- 172.21.15.170:0/3434436234 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8e98089040 con 0x555eee1c8e80 2024-09-12T17:28:22.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.611+0000 7f8eaa175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:22.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.611+0000 7f8eaa175800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.611+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555eee1ce470 con 0x555eee1c8e80 2024-09-12T17:28:22.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.611+0000 7f8ea7c5f640 1 -- 172.21.15.170:0/3434436234 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8e98089040 con 0x555eee1c8e80 2024-09-12T17:28:22.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.611+0000 7f8eaa175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:22.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.611+0000 7f8eaa175800 20 started sync module instance, tier type = 2024-09-12T17:28:22.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.611+0000 7f8eaa175800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:22.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.611+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555eee1cd560 con 0x555eee1c43a0 2024-09-12T17:28:22.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.612+0000 7f8ea8460640 1 -- 172.21.15.170:0/3434436234 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(44 notify.0 [create] v31'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ea00083e0 con 0x555eee1c43a0 2024-09-12T17:28:22.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.612+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93866210155136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555eee1cd560 con 0x555eee1c43a0 2024-09-12T17:28:22.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.612+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555eee1cef30 con 0x555eee1bf9b0 2024-09-12T17:28:22.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.613+0000 7f8ea8460640 1 -- 172.21.15.170:0/3434436234 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93866210155136] v31'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ea00083e0 con 0x555eee1c43a0 2024-09-12T17:28:22.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.613+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v31'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e9c029040 con 0x555eee1bf9b0 2024-09-12T17:28:22.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.613+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93866210159136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555eee1cd560 con 0x555eee1bf9b0 2024-09-12T17:28:22.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.613+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555eee1cf9a0 con 0x555eee1c8e80 2024-09-12T17:28:22.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.614+0000 7f8ea7c5f640 1 -- 172.21.15.170:0/3434436234 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v31'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e98089040 con 0x555eee1c8e80 2024-09-12T17:28:22.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.614+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93866210161808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555eee1d0240 con 0x555eee1c8e80 2024-09-12T17:28:22.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.614+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555eee1d0d40 con 0x555eee1c43a0 2024-09-12T17:28:22.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.614+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93866210159136] v31'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e9c029040 con 0x555eee1bf9b0 2024-09-12T17:28:22.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.615+0000 7f8ea7c5f640 1 -- 172.21.15.170:0/3434436234 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93866210161808] v31'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e98089040 con 0x555eee1c8e80 2024-09-12T17:28:22.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.615+0000 7f8ea8460640 1 -- 172.21.15.170:0/3434436234 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(50 notify.3 [create] v31'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ea00083e0 con 0x555eee1c43a0 2024-09-12T17:28:22.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.615+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93866210164112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555eee1cd0b0 con 0x555eee1c43a0 2024-09-12T17:28:22.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.615+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555eee1d1750 con 0x555eee1bf9b0 2024-09-12T17:28:22.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.616+0000 7f8ea8460640 1 -- 172.21.15.170:0/3434436234 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93866210164112] v31'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ea00083e0 con 0x555eee1c43a0 2024-09-12T17:28:22.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.616+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v31'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e9c029040 con 0x555eee1bf9b0 2024-09-12T17:28:22.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.616+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93866210166832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555eee1d1750 con 0x555eee1bf9b0 2024-09-12T17:28:22.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.616+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555eee1d2020 con 0x7f8ea0021020 2024-09-12T17:28:22.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.617+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93866210166832] v31'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e9c029040 con 0x555eee1bf9b0 2024-09-12T17:28:22.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.617+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(54 notify.5 [create] v31'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e9c029040 con 0x7f8ea0021020 2024-09-12T17:28:22.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.617+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93866210169504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555eee1d1b70 con 0x7f8ea0021020 2024-09-12T17:28:22.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.617+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555eee1d2a30 con 0x7f8ea0021020 2024-09-12T17:28:22.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.618+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93866210169504] v31'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e9c029040 con 0x7f8ea0021020 2024-09-12T17:28:22.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.618+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v31'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e9c029040 con 0x7f8ea0021020 2024-09-12T17:28:22.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.618+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93866210170560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555eee1d2c10 con 0x7f8ea0021020 2024-09-12T17:28:22.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.618+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555eee1d3460 con 0x7f8ea0021020 2024-09-12T17:28:22.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.619+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93866210170560] v31'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e9c029040 con 0x7f8ea0021020 2024-09-12T17:28:22.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.619+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(58 notify.7 [create] v31'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e9c029040 con 0x7f8ea0021020 2024-09-12T17:28:22.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.619+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93866210175296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555eee1d32b0 con 0x7f8ea0021020 2024-09-12T17:28:22.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.619+0000 7f8eaa175800 20 add_watcher() i=0 2024-09-12T17:28:22.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.619+0000 7f8eaa175800 20 add_watcher() i=1 2024-09-12T17:28:22.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.619+0000 7f8eaa175800 20 add_watcher() i=2 2024-09-12T17:28:22.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.619+0000 7f8eaa175800 20 add_watcher() i=3 2024-09-12T17:28:22.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.619+0000 7f8eaa175800 20 add_watcher() i=4 2024-09-12T17:28:22.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.619+0000 7f8eaa175800 20 add_watcher() i=5 2024-09-12T17:28:22.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.619+0000 7f8eaa175800 20 add_watcher() i=6 2024-09-12T17:28:22.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.620+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93866210175296] v31'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e9c029040 con 0x7f8ea0021020 2024-09-12T17:28:22.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.620+0000 7f8eaa175800 20 add_watcher() i=7 2024-09-12T17:28:22.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.620+0000 7f8eaa175800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:22.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.620+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555eee1d67f0 con 0x555eee1bf9b0 2024-09-12T17:28:22.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.621+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8e9c029040 con 0x555eee1bf9b0 2024-09-12T17:28:22.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.621+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93866210176352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555eee1d3d10 con 0x555eee1bf9b0 2024-09-12T17:28:22.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.621+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93866210176352] v31'180 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8e9c029040 con 0x555eee1bf9b0 2024-09-12T17:28:22.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.622+0000 7f8d5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:22.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.622+0000 7f8eaa175800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:22.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.622+0000 7f8eaa175800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:22.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.622+0000 7f8eaa175800 5 note: GC not initialized 2024-09-12T17:28:22.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.622+0000 7f8d5cfe1640 20 reqs_thread_entry: start 2024-09-12T17:28:22.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.622+0000 7f8eaa175800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:22.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.622+0000 7f8eaa175800 20 Filter name: none 2024-09-12T17:28:22.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.622+0000 7f8cd67fc640 20 reqs_thread_entry: start 2024-09-12T17:28:22.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.622+0000 7f8eaa175800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T17:28:22.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.622+0000 7f8eaa175800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.622+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555eee209ec0 con 0x555eee1c43a0 2024-09-12T17:28:22.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.623+0000 7f8ea8460640 1 -- 172.21.15.170:0/3434436234 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f8ea00083e0 con 0x555eee1c43a0 2024-09-12T17:28:22.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.623+0000 7f8eaa175800 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T17:28:22.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.623+0000 7f8eaa175800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-12T17:28:22.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.623+0000 7f8eaa175800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:28:22.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.623+0000 7f8eaa175800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5 : miss 2024-09-12T17:28:22.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.623+0000 7f8eaa175800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.623+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:63 8.5 8:a5fd9635:root::.bucket.meta.myfoo%3a7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555eee20b960 con 0x555eee1bf9b0 2024-09-12T17:28:22.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.623+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(63 .bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f8e9c029040 con 0x555eee1bf9b0 2024-09-12T17:28:22.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.623+0000 7f8eaa175800 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T17:28:22.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.623+0000 7f8eaa175800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5 info.flags=0x17 2024-09-12T17:28:22.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.623+0000 7f8eaa175800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5 to cache LRU end 2024-09-12T17:28:22.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.623+0000 7f8eaa175800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:22.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.623+0000 7f8eaa175800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:28:22.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.623+0000 7f8eaa175800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5 2024-09-12T17:28:22.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.623+0000 7f8eaa175800 20 get_obj_state: octx=0x7f8ea001e3c0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x555eee20e058 s->prefetch_data=0 2024-09-12T17:28:22.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.623+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:64 3.3c 3:3e309e99:::7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555eee20efc0 con 0x555eee1c43a0 2024-09-12T17:28:22.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.623+0000 7f8ea8460640 1 -- 172.21.15.170:0/3434436234 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(64 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+927 (crc 0 0 0) 0x7f8ea00083e0 con 0x555eee1c43a0 2024-09-12T17:28:22.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.623+0000 7f8eaa175800 10 manifest: total_size = 5 2024-09-12T17:28:22.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.623+0000 7f8eaa175800 20 get_obj_state: setting s->obj_tag to _ZlGT4fTbhSq8snhpdp-0d11YHSP5J9l 2024-09-12T17:28:22.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.624+0000 7f8d5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:22.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.624+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93866210176352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555eee20efc0 con 0x555eee1bf9b0 2024-09-12T17:28:22.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.625+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93866210176352] v31'181 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8e9c029040 con 0x555eee1bf9b0 2024-09-12T17:28:22.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.625+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93866210155136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555eee20efc0 con 0x555eee1c43a0 2024-09-12T17:28:22.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.626+0000 7f8ea8460640 1 -- 172.21.15.170:0/3434436234 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93866210155136] v31'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ea00083e0 con 0x555eee1c43a0 2024-09-12T17:28:22.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.626+0000 7f8eaa175800 20 remove_watcher() i=0 2024-09-12T17:28:22.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.626+0000 7f8eaa175800 2 removed watcher, disabling cache 2024-09-12T17:28:22.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.626+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93866210159136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555eee20efc0 con 0x555eee1bf9b0 2024-09-12T17:28:22.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.627+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93866210159136] v31'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e9c029040 con 0x555eee1bf9b0 2024-09-12T17:28:22.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.627+0000 7f8eaa175800 20 remove_watcher() i=1 2024-09-12T17:28:22.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.627+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93866210161808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555eee20efc0 con 0x555eee1c8e80 2024-09-12T17:28:22.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.628+0000 7f8ea7c5f640 1 -- 172.21.15.170:0/3434436234 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93866210161808] v31'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e98089040 con 0x555eee1c8e80 2024-09-12T17:28:22.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.628+0000 7f8eaa175800 20 remove_watcher() i=2 2024-09-12T17:28:22.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.628+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93866210164112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555eee207730 con 0x555eee1c43a0 2024-09-12T17:28:22.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.629+0000 7f8ea8460640 1 -- 172.21.15.170:0/3434436234 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93866210164112] v31'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ea00083e0 con 0x555eee1c43a0 2024-09-12T17:28:22.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.629+0000 7f8eaa175800 20 remove_watcher() i=3 2024-09-12T17:28:22.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.629+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93866210166832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555eee207730 con 0x555eee1bf9b0 2024-09-12T17:28:22.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.630+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93866210166832] v31'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e9c029040 con 0x555eee1bf9b0 2024-09-12T17:28:22.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.630+0000 7f8eaa175800 20 remove_watcher() i=4 2024-09-12T17:28:22.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.630+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93866210169504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555eee207730 con 0x7f8ea0021020 2024-09-12T17:28:22.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.631+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93866210169504] v31'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e9c029040 con 0x7f8ea0021020 2024-09-12T17:28:22.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.631+0000 7f8eaa175800 20 remove_watcher() i=5 2024-09-12T17:28:22.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.631+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93866210170560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555eee207730 con 0x7f8ea0021020 2024-09-12T17:28:22.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.632+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93866210170560] v31'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e9c029040 con 0x7f8ea0021020 2024-09-12T17:28:22.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.632+0000 7f8eaa175800 20 remove_watcher() i=6 2024-09-12T17:28:22.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.632+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93866210175296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555eee207730 con 0x7f8ea0021020 2024-09-12T17:28:22.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.633+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93866210175296] v31'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e9c029040 con 0x7f8ea0021020 2024-09-12T17:28:22.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.633+0000 7f8eaa175800 20 remove_watcher() i=7 2024-09-12T17:28:22.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.633+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f8ea0021020 msgr2=0x7f8ea0013320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.633+0000 7f8eaa175800 1 --2- 172.21.15.170:0/3434436234 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f8ea0021020 0x7f8ea0013320 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.633+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x555eee1bf9b0 msgr2=0x555eee1c1e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.633+0000 7f8eaa175800 1 --2- 172.21.15.170:0/3434436234 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x555eee1bf9b0 0x555eee1c1e70 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.633+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x555eee1c43a0 msgr2=0x555eee1c6790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.633+0000 7f8eaa175800 1 --2- 172.21.15.170:0/3434436234 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x555eee1c43a0 0x555eee1c6790 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.633+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x555eee1c8e80 msgr2=0x555eee1cb340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.633+0000 7f8eaa175800 1 --2- 172.21.15.170:0/3434436234 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x555eee1c8e80 0x555eee1cb340 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.633+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8d7003c780 msgr2=0x7f8d7003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.633+0000 7f8eaa175800 1 --2- 172.21.15.170:0/3434436234 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8d7003c780 0x7f8d7003ec40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8e9807ffd0 tx=0x7f8e98090000 comp rx=0 tx=0).stop 2024-09-12T17:28:22.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.633+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555eee1aca60 msgr2=0x555eee1b4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.633+0000 7f8eaa175800 1 --2- 172.21.15.170:0/3434436234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555eee1aca60 0x555eee1b4080 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f8ea00206f0 tx=0x7f8ea0005670 comp rx=0 tx=0).stop 2024-09-12T17:28:22.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.633+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 reap_dead start 2024-09-12T17:28:22.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.633+0000 7f8ea745e640 1 -- 172.21.15.170:0/3434436234 reap_dead start 2024-09-12T17:28:22.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.633+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 shutdown_connections 2024-09-12T17:28:22.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.633+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 >> 172.21.15.170:0/3434436234 conn(0x555eee1a8e80 msgr2=0x555eee1a7090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:22.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.634+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 shutdown_connections 2024-09-12T17:28:22.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.634+0000 7f8eaa175800 1 -- 172.21.15.170:0/3434436234 wait complete. 2024-09-12T17:28:22.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.634+0000 7f8eaa175800 1 -- 172.21.15.170:0/3497235644 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8d8003c730 msgr2=0x7f8d8003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.634+0000 7f8eaa175800 1 --2- 172.21.15.170:0/3497235644 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8d8003c730 0x7f8d8003ebf0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8e98096150 tx=0x7f8e9804e790 comp rx=0 tx=0).stop 2024-09-12T17:28:22.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.634+0000 7f8eaa175800 1 -- 172.21.15.170:0/3497235644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555eee1a0020 msgr2=0x555eee1a0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.634+0000 7f8eaa175800 1 --2- 172.21.15.170:0/3497235644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555eee1a0020 0x555eee1a0440 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x555eee187040 tx=0x7f8ea000bf30 comp rx=0 tx=0).stop 2024-09-12T17:28:22.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.634+0000 7f8eaa175800 1 -- 172.21.15.170:0/3497235644 shutdown_connections 2024-09-12T17:28:22.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.634+0000 7f8eaa175800 1 --2- 172.21.15.170:0/3497235644 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8d8003c730 0x7f8d8003ebf0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.634+0000 7f8eaa175800 1 --2- 172.21.15.170:0/3497235644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555eee1a0020 0x555eee1a0440 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.634+0000 7f8eaa175800 1 -- 172.21.15.170:0/3497235644 >> 172.21.15.170:0/3497235644 conn(0x555eee1943d0 msgr2=0x555eee1947b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:22.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.634+0000 7f8eaa175800 1 -- 172.21.15.170:0/3497235644 shutdown_connections 2024-09-12T17:28:22.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.634+0000 7f8eaa175800 1 -- 172.21.15.170:0/3497235644 wait complete. 2024-09-12T17:28:22.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.634+0000 7f8eaa175800 1 -- 172.21.15.170:0/3520460196 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x555eee08c040 msgr2=0x555eee18c7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.634+0000 7f8eaa175800 1 --2- 172.21.15.170:0/3520460196 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x555eee08c040 0x555eee18c7a0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.634+0000 7f8eaa175800 1 -- 172.21.15.170:0/3520460196 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x555eee18eb40 msgr2=0x555eee190fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.634+0000 7f8eaa175800 1 --2- 172.21.15.170:0/3520460196 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x555eee18eb40 0x555eee190fe0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.634+0000 7f8eaa175800 1 -- 172.21.15.170:0/3520460196 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8d9003c780 msgr2=0x7f8d9003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.634+0000 7f8eaa175800 1 --2- 172.21.15.170:0/3520460196 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8d9003c780 0x7f8d9003ec40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c001d70 tx=0x7f8e9c0012d0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.634+0000 7f8eaa175800 1 -- 172.21.15.170:0/3520460196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555eee08ae00 msgr2=0x555eee185150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.634+0000 7f8eaa175800 1 --2- 172.21.15.170:0/3520460196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555eee08ae00 0x555eee185150 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8e98025a60 tx=0x7f8e98003330 comp rx=0 tx=0).stop 2024-09-12T17:28:22.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.634+0000 7f8eaa175800 1 -- 172.21.15.170:0/3520460196 shutdown_connections 2024-09-12T17:28:22.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.634+0000 7f8eaa175800 1 --2- 172.21.15.170:0/3520460196 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x555eee18eb40 0x555eee190fe0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.634+0000 7f8eaa175800 1 --2- 172.21.15.170:0/3520460196 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8d9003c780 0x7f8d9003ec40 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.634+0000 7f8eaa175800 1 --2- 172.21.15.170:0/3520460196 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x555eee08c040 0x555eee18c7a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.634+0000 7f8eaa175800 1 --2- 172.21.15.170:0/3520460196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555eee08ae00 0x555eee185150 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.634+0000 7f8eaa175800 1 -- 172.21.15.170:0/3520460196 >> 172.21.15.170:0/3520460196 conn(0x555eee0861d0 msgr2=0x555eee174770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:22.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.634+0000 7f8eaa175800 1 -- 172.21.15.170:0/3520460196 shutdown_connections 2024-09-12T17:28:22.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.634+0000 7f8eaa175800 1 -- 172.21.15.170:0/3520460196 wait complete. 2024-09-12T17:28:22.655 INFO:teuthology.orchestra.run.smithi170.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-12T17:28:22.655 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-12T17:28:22.657 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-09-12T17:28:22.669 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:28:22.725 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-12T17:28:22.725 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-12T17:28:22.725 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-12T17:28:22.726 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-12T17:28:22.726 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-12T17:28:22.726 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-12T17:28:22.726 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-09-12T17:28:22.772 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:22.772 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:22.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.771+0000 7ff78f220800 1 Processor -- start 2024-09-12T17:28:22.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.771+0000 7ff78f220800 1 -- start start 2024-09-12T17:28:22.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.771+0000 7ff78f220800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55f7488e4210 0x55f7488e9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.771+0000 7ff78f220800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f74878de40 con 0x55f7488e2e00 2024-09-12T17:28:22.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.771+0000 7ff78f220800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x55f748758680 con 0x55f7488e4210 2024-09-12T17:28:22.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.772+0000 7ff784509640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55f7488e4210 0x55f7488e9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.772+0000 7ff78cd0a640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x55f7488e2e00 0x55f7488e3b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:47706/0 (socket says 172.21.15.170:47706) 2024-09-12T17:28:22.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.772+0000 7ff78cd0a640 1 -- 172.21.15.170:0/3641263161 learned_addr learned my addr 172.21.15.170:0/3641263161 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:28:22.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.772+0000 7ff784509640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55f7488e4210 0x55f7488e9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56116/0 (socket says 172.21.15.170:56116) 2024-09-12T17:28:22.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.772+0000 7ff784509640 1 -- 172.21.15.170:0/3641263161 >> v1:172.21.15.47:6789/0 conn(0x55f7488e2e00 legacy=0x55f7488e3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.772+0000 7ff784509640 1 -- 172.21.15.170:0/3641263161 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7487746b0 con 0x55f7488e4210 2024-09-12T17:28:22.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.774+0000 7ff784509640 1 --2- 172.21.15.170:0/3641263161 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f7488e4210 0x55f7488e9db0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7ff77400a470 tx=0x7ff774045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b39a1d9dc7bb498 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.774+0000 7ff787fff640 1 -- 172.21.15.170:0/3641263161 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff774053570 con 0x55f7488e4210 2024-09-12T17:28:22.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.774+0000 7ff787fff640 1 -- 172.21.15.170:0/3641263161 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff774058070 con 0x55f7488e4210 2024-09-12T17:28:22.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.774+0000 7ff787fff640 1 -- 172.21.15.170:0/3641263161 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff774053880 con 0x55f7488e4210 2024-09-12T17:28:22.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.774+0000 7ff78f220800 1 -- 172.21.15.170:0/3641263161 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f7488e4210 msgr2=0x55f7488e9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.774+0000 7ff78f220800 1 --2- 172.21.15.170:0/3641263161 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f7488e4210 0x55f7488e9db0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7ff77400a470 tx=0x7ff774045a20 comp rx=0 tx=0).stop 2024-09-12T17:28:22.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.774+0000 7ff78f220800 1 -- 172.21.15.170:0/3641263161 shutdown_connections 2024-09-12T17:28:22.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.774+0000 7ff78f220800 1 --2- 172.21.15.170:0/3641263161 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f7488e4210 0x55f7488e9db0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.774+0000 7ff78f220800 1 -- 172.21.15.170:0/3641263161 >> 172.21.15.170:0/3641263161 conn(0x55f7488de1d0 msgr2=0x55f7488e0630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:22.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.775+0000 7ff78f220800 1 -- 172.21.15.170:0/3641263161 shutdown_connections 2024-09-12T17:28:22.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.775+0000 7ff78f220800 1 -- 172.21.15.170:0/3641263161 wait complete. 2024-09-12T17:28:22.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.788+0000 7ff78f220800 1 Processor -- start 2024-09-12T17:28:22.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.788+0000 7ff78f220800 1 -- start start 2024-09-12T17:28:22.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.789+0000 7ff78f220800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f7488e2e00 0x55f7489d2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.789+0000 7ff78f220800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f74877cdd0 con 0x55f7488e2e00 2024-09-12T17:28:22.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.789+0000 7ff78cd0a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f7488e2e00 0x55f7489d2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.789+0000 7ff78cd0a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f7488e2e00 0x55f7489d2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56130/0 (socket says 172.21.15.170:56130) 2024-09-12T17:28:22.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.789+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1449708010 learned_addr learned my addr 172.21.15.170:0/1449708010 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:22.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.789+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1449708010 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f748795e10 con 0x55f7488e2e00 2024-09-12T17:28:22.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.789+0000 7ff78cd0a640 1 --2- 172.21.15.170:0/1449708010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f7488e2e00 0x55f7489d2560 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ff77c001e40 tx=0x7ff77c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3820f68097abbf84 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.789+0000 7ff67ae0d640 1 -- 172.21.15.170:0/1449708010 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff77c012020 con 0x55f7488e2e00 2024-09-12T17:28:22.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.790+0000 7ff67ae0d640 1 -- 172.21.15.170:0/1449708010 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff77c00e5a0 con 0x55f7488e2e00 2024-09-12T17:28:22.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.790+0000 7ff67ae0d640 1 -- 172.21.15.170:0/1449708010 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff77c00e8a0 con 0x55f7488e2e00 2024-09-12T17:28:22.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.790+0000 7ff78f220800 1 -- 172.21.15.170:0/1449708010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f7488e2e00 msgr2=0x55f7489d2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.790+0000 7ff78f220800 1 --2- 172.21.15.170:0/1449708010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f7488e2e00 0x55f7489d2560 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ff77c001e40 tx=0x7ff77c001e70 comp rx=0 tx=0).stop 2024-09-12T17:28:22.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.790+0000 7ff78f220800 1 -- 172.21.15.170:0/1449708010 shutdown_connections 2024-09-12T17:28:22.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.790+0000 7ff78f220800 1 --2- 172.21.15.170:0/1449708010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f7488e2e00 0x55f7489d2560 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.790+0000 7ff78f220800 1 -- 172.21.15.170:0/1449708010 >> 172.21.15.170:0/1449708010 conn(0x55f7488de1d0 msgr2=0x55f7489cdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:22.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.790+0000 7ff78f220800 1 -- 172.21.15.170:0/1449708010 shutdown_connections 2024-09-12T17:28:22.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.790+0000 7ff78f220800 1 -- 172.21.15.170:0/1449708010 wait complete. 2024-09-12T17:28:22.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.791+0000 7ff78f220800 1 Processor -- start 2024-09-12T17:28:22.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.791+0000 7ff78f220800 1 -- start start 2024-09-12T17:28:22.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.791+0000 7ff78f220800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f7488e2e00 0x55f7489d9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.791+0000 7ff78f220800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f7488e4900 con 0x55f7488e2e00 2024-09-12T17:28:22.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.791+0000 7ff78cd0a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f7488e2e00 0x55f7489d9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.791+0000 7ff78cd0a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f7488e2e00 0x55f7489d9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56140/0 (socket says 172.21.15.170:56140) 2024-09-12T17:28:22.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.791+0000 7ff78cd0a640 1 -- 172.21.15.170:0/3019997546 learned_addr learned my addr 172.21.15.170:0/3019997546 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:22.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.791+0000 7ff78cd0a640 1 -- 172.21.15.170:0/3019997546 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7489da470 con 0x55f7488e2e00 2024-09-12T17:28:22.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.791+0000 7ff78cd0a640 1 --2- 172.21.15.170:0/3019997546 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f7488e2e00 0x55f7489d9f10 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7ff77c00c010 tx=0x7ff77c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.792+0000 7ff67960a640 1 -- 172.21.15.170:0/3019997546 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff77c012030 con 0x55f7488e2e00 2024-09-12T17:28:22.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.792+0000 7ff67960a640 1 -- 172.21.15.170:0/3019997546 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff77c0014a0 con 0x55f7488e2e00 2024-09-12T17:28:22.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.792+0000 7ff78f220800 1 -- 172.21.15.170:0/3019997546 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f7489da700 con 0x55f7488e2e00 2024-09-12T17:28:22.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.792+0000 7ff67960a640 1 -- 172.21.15.170:0/3019997546 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff77c01a7a0 con 0x55f7488e2e00 2024-09-12T17:28:22.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.792+0000 7ff78f220800 1 -- 172.21.15.170:0/3019997546 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7489db100 con 0x55f7488e2e00 2024-09-12T17:28:22.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.793+0000 7ff67960a640 1 -- 172.21.15.170:0/3019997546 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ff77c015020 con 0x55f7488e2e00 2024-09-12T17:28:22.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.793+0000 7ff67960a640 1 --2- 172.21.15.170:0/3019997546 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff67403c780 0x7ff67403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.793+0000 7ff67960a640 1 -- 172.21.15.170:0/3019997546 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7ff77c020030 con 0x55f7488e2e00 2024-09-12T17:28:22.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.793+0000 7ff784509640 1 --2- 172.21.15.170:0/3019997546 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff67403c780 0x7ff67403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.793+0000 7ff78f220800 1 --2- 172.21.15.170:0/3019997546 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55f7488e4210 0x55f7489e1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.793+0000 7ff78f220800 1 -- 172.21.15.170:0/3019997546 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f7489dbc90 con 0x55f7488e4210 2024-09-12T17:28:22.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.793+0000 7ff78d50b640 1 --2- 172.21.15.170:0/3019997546 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55f7488e4210 0x55f7489e1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.794+0000 7ff784509640 1 --2- 172.21.15.170:0/3019997546 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff67403c780 0x7ff67403ec40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff774057000 tx=0x7ff774052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.794+0000 7ff78d50b640 1 --2- 172.21.15.170:0/3019997546 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55f7488e4210 0x55f7489e1560 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.794+0000 7ff78d50b640 1 -- 172.21.15.170:0/3019997546 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff78800a4d0 con 0x55f7488e4210 2024-09-12T17:28:22.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.794+0000 7ff78f220800 1 -- 172.21.15.170:0/3019997546 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f7489db590 con 0x55f7488e4210 2024-09-12T17:28:22.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.794+0000 7ff78d50b640 1 -- 172.21.15.170:0/3019997546 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff78800a4d0 con 0x55f7488e4210 2024-09-12T17:28:22.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.794+0000 7ff78f220800 1 --2- 172.21.15.170:0/3019997546 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55f7489e39d0 0x55f7489e5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.794+0000 7ff78f220800 1 -- 172.21.15.170:0/3019997546 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f7489e6490 con 0x55f7489e39d0 2024-09-12T17:28:22.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.794+0000 7ff78cd0a640 1 --2- 172.21.15.170:0/3019997546 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55f7489e39d0 0x55f7489e5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.795+0000 7ff78cd0a640 1 --2- 172.21.15.170:0/3019997546 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55f7489e39d0 0x55f7489e5dc0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.795+0000 7ff78cd0a640 1 -- 172.21.15.170:0/3019997546 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff77c0187b0 con 0x55f7489e39d0 2024-09-12T17:28:22.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.795+0000 7ff78f220800 1 -- 172.21.15.170:0/3019997546 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f7489e2870 con 0x55f7488e4210 2024-09-12T17:28:22.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.795+0000 7ff78d50b640 1 -- 172.21.15.170:0/3019997546 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff78800a4d0 con 0x55f7488e4210 2024-09-12T17:28:22.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.795+0000 7ff78f220800 1 -- 172.21.15.170:0/3019997546 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f7489e2d10 con 0x55f7489e39d0 2024-09-12T17:28:22.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.796+0000 7ff78cd0a640 1 -- 172.21.15.170:0/3019997546 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff77c0187b0 con 0x55f7489e39d0 2024-09-12T17:28:22.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.796+0000 7ff78f220800 1 Processor -- start 2024-09-12T17:28:22.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.796+0000 7ff78f220800 1 -- start start 2024-09-12T17:28:22.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.796+0000 7ff78f220800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f748856d30 0x55f7489faed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.796+0000 7ff78f220800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f7487daa00 con 0x55f748856d30 2024-09-12T17:28:22.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.796+0000 7ff78d50b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f748856d30 0x55f7489faed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.796+0000 7ff78d50b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f748856d30 0x55f7489faed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56142/0 (socket says 172.21.15.170:56142) 2024-09-12T17:28:22.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.796+0000 7ff78d50b640 1 -- 172.21.15.170:0/467048613 learned_addr learned my addr 172.21.15.170:0/467048613 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:22.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.797+0000 7ff78d50b640 1 -- 172.21.15.170:0/467048613 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f748857150 con 0x55f748856d30 2024-09-12T17:28:22.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.797+0000 7ff78d50b640 1 --2- 172.21.15.170:0/467048613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f748856d30 0x55f7489faed0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x55f7489dada0 tx=0x7ff7880167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.797+0000 7ff6727fc640 1 -- 172.21.15.170:0/467048613 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff788013640 con 0x55f748856d30 2024-09-12T17:28:22.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.797+0000 7ff6727fc640 1 -- 172.21.15.170:0/467048613 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7880137e0 con 0x55f748856d30 2024-09-12T17:28:22.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.797+0000 7ff78f220800 1 -- 172.21.15.170:0/467048613 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f7489fb410 con 0x55f748856d30 2024-09-12T17:28:22.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.797+0000 7ff6727fc640 1 -- 172.21.15.170:0/467048613 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff788013ac0 con 0x55f748856d30 2024-09-12T17:28:22.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.797+0000 7ff78f220800 1 -- 172.21.15.170:0/467048613 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7489fb8a0 con 0x55f748856d30 2024-09-12T17:28:22.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.798+0000 7ff6727fc640 1 -- 172.21.15.170:0/467048613 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ff788011040 con 0x55f748856d30 2024-09-12T17:28:22.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.798+0000 7ff6727fc640 1 --2- 172.21.15.170:0/467048613 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff66403c730 0x7ff66403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.798+0000 7ff6727fc640 1 -- 172.21.15.170:0/467048613 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7ff78800e040 con 0x55f748856d30 2024-09-12T17:28:22.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.798+0000 7ff78cd0a640 1 --2- 172.21.15.170:0/467048613 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff66403c730 0x7ff66403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.799+0000 7ff78f220800 1 Processor -- start 2024-09-12T17:28:22.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.799+0000 7ff78cd0a640 1 --2- 172.21.15.170:0/467048613 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff66403c730 0x7ff66403ebf0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55f7489e1b70 tx=0x7ff77c040040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.799+0000 7ff78f220800 1 -- start start 2024-09-12T17:28:22.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.799+0000 7ff78f220800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f748a04b00 0x55f748a04f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.799+0000 7ff78f220800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f7489d2db0 con 0x55f748a04b00 2024-09-12T17:28:22.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.799+0000 7ff78d50b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f748a04b00 0x55f748a04f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.799+0000 7ff78d50b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f748a04b00 0x55f748a04f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56146/0 (socket says 172.21.15.170:56146) 2024-09-12T17:28:22.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.799+0000 7ff78d50b640 1 -- 172.21.15.170:0/2567097109 learned_addr learned my addr 172.21.15.170:0/2567097109 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:22.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.799+0000 7ff78d50b640 1 -- 172.21.15.170:0/2567097109 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f748a054f0 con 0x55f748a04b00 2024-09-12T17:28:22.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.799+0000 7ff78d50b640 1 --2- 172.21.15.170:0/2567097109 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f748a04b00 0x55f748a04f00 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7ff788020000 tx=0x7ff7880204d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93a78accea776942 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.800+0000 7ff663fff640 1 -- 172.21.15.170:0/2567097109 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff788052070 con 0x55f748a04b00 2024-09-12T17:28:22.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.800+0000 7ff663fff640 1 -- 172.21.15.170:0/2567097109 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff78804a020 con 0x55f748a04b00 2024-09-12T17:28:22.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.800+0000 7ff663fff640 1 -- 172.21.15.170:0/2567097109 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff788021440 con 0x55f748a04b00 2024-09-12T17:28:22.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.800+0000 7ff78f220800 1 -- 172.21.15.170:0/2567097109 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f748a04b00 msgr2=0x55f748a04f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.800+0000 7ff78f220800 1 --2- 172.21.15.170:0/2567097109 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f748a04b00 0x55f748a04f00 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7ff788020000 tx=0x7ff7880204d0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.800+0000 7ff78f220800 1 -- 172.21.15.170:0/2567097109 shutdown_connections 2024-09-12T17:28:22.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.800+0000 7ff78f220800 1 --2- 172.21.15.170:0/2567097109 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f748a04b00 0x55f748a04f00 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.800+0000 7ff78f220800 1 -- 172.21.15.170:0/2567097109 >> 172.21.15.170:0/2567097109 conn(0x55f748a00f00 msgr2=0x55f7489ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:22.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.800+0000 7ff78f220800 1 -- 172.21.15.170:0/2567097109 shutdown_connections 2024-09-12T17:28:22.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.800+0000 7ff78f220800 1 -- 172.21.15.170:0/2567097109 wait complete. 2024-09-12T17:28:22.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.800+0000 7ff78f220800 1 Processor -- start 2024-09-12T17:28:22.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.800+0000 7ff78f220800 1 -- start start 2024-09-12T17:28:22.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.801+0000 7ff78f220800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f748a04b00 0x55f748a0c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.801+0000 7ff78f220800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f748a05b10 con 0x55f748a04b00 2024-09-12T17:28:22.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.801+0000 7ff78d50b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f748a04b00 0x55f748a0c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.801+0000 7ff78d50b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f748a04b00 0x55f748a0c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56152/0 (socket says 172.21.15.170:56152) 2024-09-12T17:28:22.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.801+0000 7ff78d50b640 1 -- 172.21.15.170:0/1804368993 learned_addr learned my addr 172.21.15.170:0/1804368993 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:22.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.801+0000 7ff78d50b640 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f748a0c660 con 0x55f748a04b00 2024-09-12T17:28:22.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.801+0000 7ff78d50b640 1 --2- 172.21.15.170:0/1804368993 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f748a04b00 0x55f748a0c100 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ff788053cd0 tx=0x7ff788053d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.801+0000 7ff6627fc640 1 -- 172.21.15.170:0/1804368993 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff788038070 con 0x55f748a04b00 2024-09-12T17:28:22.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.801+0000 7ff6627fc640 1 -- 172.21.15.170:0/1804368993 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff78801f500 con 0x55f748a04b00 2024-09-12T17:28:22.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.801+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f748a0c8f0 con 0x55f748a04b00 2024-09-12T17:28:22.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.801+0000 7ff6627fc640 1 -- 172.21.15.170:0/1804368993 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff78801f7e0 con 0x55f748a04b00 2024-09-12T17:28:22.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.801+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f748a0d270 con 0x55f748a04b00 2024-09-12T17:28:22.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.802+0000 7ff6627fc640 1 -- 172.21.15.170:0/1804368993 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ff78803b070 con 0x55f748a04b00 2024-09-12T17:28:22.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.803+0000 7ff6627fc640 1 --2- 172.21.15.170:0/1804368993 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff65803c730 0x7ff65803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.803+0000 7ff6627fc640 1 -- 172.21.15.170:0/1804368993 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7ff78804b070 con 0x55f748a04b00 2024-09-12T17:28:22.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.803+0000 7ff78cd0a640 1 --2- 172.21.15.170:0/1804368993 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff65803c730 0x7ff65803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.803+0000 7ff78cd0a640 1 --2- 172.21.15.170:0/1804368993 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff65803c730 0x7ff65803ebf0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff77c018ac0 tx=0x7ff77c04f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.803+0000 7ff78f220800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.803+0000 7ff78f220800 1 --2- 172.21.15.170:0/1804368993 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55f748a17a00 0x55f748a19ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.803+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748a1a610 con 0x55f748a17a00 2024-09-12T17:28:22.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.803+0000 7ff784509640 1 --2- 172.21.15.170:0/1804368993 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55f748a17a00 0x55f748a19ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.804+0000 7ff784509640 1 --2- 172.21.15.170:0/1804368993 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55f748a17a00 0x55f748a19ec0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.804+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.804+0000 7ff78f220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:22.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.804+0000 7ff78f220800 20 realm 2024-09-12T17:28:22.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.804+0000 7ff78f220800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.804+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748a1aa40 con 0x55f748a17a00 2024-09-12T17:28:22.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.804+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.804+0000 7ff78f220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:22.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.804+0000 7ff78f220800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:22.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.804+0000 7ff78f220800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.804+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748a1b310 con 0x55f748a17a00 2024-09-12T17:28:22.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.804+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.804+0000 7ff78f220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:22.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.804+0000 7ff78f220800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.804+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748a1b6b0 con 0x55f748a17a00 2024-09-12T17:28:22.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.805+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.805+0000 7ff78f220800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:22.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.805+0000 7ff78f220800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.805+0000 7ff78f220800 1 --2- 172.21.15.170:0/1804368993 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55f748a1c410 0x55f748a1e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.805+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748a1ee10 con 0x55f748a1c410 2024-09-12T17:28:22.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.805+0000 7ff78d50b640 1 --2- 172.21.15.170:0/1804368993 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55f748a1c410 0x55f748a1e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.805+0000 7ff78d50b640 1 --2- 172.21.15.170:0/1804368993 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55f748a1c410 0x55f748a1e800 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.805+0000 7ff78d50b640 1 -- 172.21.15.170:0/1804368993 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff78803a030 con 0x55f748a1c410 2024-09-12T17:28:22.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.805+0000 7ff78f220800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:22.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.805+0000 7ff78f220800 20 searching for the correct realm 2024-09-12T17:28:22.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.805+0000 7ff78f220800 1 --2- 172.21.15.170:0/1804368993 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55f748a20de0 0x55f748a23270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.805+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f748a238f0 con 0x55f748a20de0 2024-09-12T17:28:22.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.805+0000 7ff78cd0a640 1 --2- 172.21.15.170:0/1804368993 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55f748a20de0 0x55f748a23270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.806+0000 7ff78cd0a640 1 --2- 172.21.15.170:0/1804368993 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55f748a20de0 0x55f748a23270 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.806+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff77c036040 con 0x55f748a20de0 2024-09-12T17:28:22.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.806+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f748a238f0 con 0x55f748a1c410 2024-09-12T17:28:22.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.806+0000 7ff78d50b640 1 -- 172.21.15.170:0/1804368993 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff78803a030 con 0x55f748a1c410 2024-09-12T17:28:22.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.806+0000 7ff78d50b640 1 --2- 172.21.15.170:0/1804368993 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7ff78803d060 0x7ff7880123d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.806+0000 7ff78d50b640 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f748a238f0 con 0x7ff78803d060 2024-09-12T17:28:22.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.806+0000 7ff784509640 1 --2- 172.21.15.170:0/1804368993 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7ff78803d060 0x7ff7880123d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.807+0000 7ff784509640 1 --2- 172.21.15.170:0/1804368993 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7ff78803d060 0x7ff7880123d0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.807+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff774051070 con 0x7ff78803d060 2024-09-12T17:28:22.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.807+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f748a238f0 con 0x55f748a17a00 2024-09-12T17:28:22.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.807+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.807+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f748a238f0 con 0x55f748a17a00 2024-09-12T17:28:22.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.807+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.807+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f748a238f0 con 0x7ff78803d060 2024-09-12T17:28:22.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.808+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff774051070 con 0x7ff78803d060 2024-09-12T17:28:22.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.808+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f748a238f0 con 0x7ff78803d060 2024-09-12T17:28:22.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.808+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff774051070 con 0x7ff78803d060 2024-09-12T17:28:22.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.808+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f748a238f0 con 0x55f748a1c410 2024-09-12T17:28:22.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.808+0000 7ff78d50b640 1 -- 172.21.15.170:0/1804368993 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff78803a030 con 0x55f748a1c410 2024-09-12T17:28:22.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.808+0000 7ff78d50b640 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f748a238f0 con 0x55f748a20de0 2024-09-12T17:28:22.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.808+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff77c036040 con 0x55f748a20de0 2024-09-12T17:28:22.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.808+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f748a238f0 con 0x55f748a17a00 2024-09-12T17:28:22.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.809+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.809+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f748a238f0 con 0x7ff78803d060 2024-09-12T17:28:22.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.809+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff774051070 con 0x7ff78803d060 2024-09-12T17:28:22.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.809+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f748a238f0 con 0x55f748a17a00 2024-09-12T17:28:22.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.809+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.809+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f748a238f0 con 0x55f748a1c410 2024-09-12T17:28:22.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.809+0000 7ff78d50b640 1 -- 172.21.15.170:0/1804368993 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7ff78803a030 con 0x55f748a1c410 2024-09-12T17:28:22.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.809+0000 7ff78d50b640 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f748a238f0 con 0x55f748a20de0 2024-09-12T17:28:22.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.810+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff77c036040 con 0x55f748a20de0 2024-09-12T17:28:22.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.810+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f748a238f0 con 0x55f748a20de0 2024-09-12T17:28:22.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.810+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff77c036040 con 0x55f748a20de0 2024-09-12T17:28:22.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.810+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f748a238f0 con 0x55f748a1c410 2024-09-12T17:28:22.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.810+0000 7ff78d50b640 1 -- 172.21.15.170:0/1804368993 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff78803a030 con 0x55f748a1c410 2024-09-12T17:28:22.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.810+0000 7ff78d50b640 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f748a238f0 con 0x55f748a20de0 2024-09-12T17:28:22.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.810+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff77c036040 con 0x55f748a20de0 2024-09-12T17:28:22.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.810+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f748a238f0 con 0x55f748a20de0 2024-09-12T17:28:22.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.810+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff77c036040 con 0x55f748a20de0 2024-09-12T17:28:22.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.810+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f748a238f0 con 0x55f748a17a00 2024-09-12T17:28:22.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.811+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.811+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f748a238f0 con 0x55f748a17a00 2024-09-12T17:28:22.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.811+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.811+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f748a238f0 con 0x7ff78803d060 2024-09-12T17:28:22.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.811+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff774051070 con 0x7ff78803d060 2024-09-12T17:28:22.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.811+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f748a238f0 con 0x55f748a20de0 2024-09-12T17:28:22.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.812+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff77c036040 con 0x55f748a20de0 2024-09-12T17:28:22.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.812+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f748a238f0 con 0x55f748a1c410 2024-09-12T17:28:22.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.812+0000 7ff78d50b640 1 -- 172.21.15.170:0/1804368993 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff78803a030 con 0x55f748a1c410 2024-09-12T17:28:22.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.812+0000 7ff78d50b640 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f748a238f0 con 0x55f748a17a00 2024-09-12T17:28:22.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.812+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.812+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f748a238f0 con 0x7ff78803d060 2024-09-12T17:28:22.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.813+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff774051070 con 0x7ff78803d060 2024-09-12T17:28:22.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.813+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f748a238f0 con 0x55f748a20de0 2024-09-12T17:28:22.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.813+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff77c036040 con 0x55f748a20de0 2024-09-12T17:28:22.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.813+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f748a238f0 con 0x7ff78803d060 2024-09-12T17:28:22.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.813+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff774051070 con 0x7ff78803d060 2024-09-12T17:28:22.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.813+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f748a238f0 con 0x55f748a1c410 2024-09-12T17:28:22.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.813+0000 7ff78d50b640 1 -- 172.21.15.170:0/1804368993 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff788069040 con 0x55f748a1c410 2024-09-12T17:28:22.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.813+0000 7ff78d50b640 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f748a238f0 con 0x55f748a20de0 2024-09-12T17:28:22.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.814+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff77c036040 con 0x55f748a20de0 2024-09-12T17:28:22.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.814+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f748a238f0 con 0x7ff78803d060 2024-09-12T17:28:22.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.814+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff774051070 con 0x7ff78803d060 2024-09-12T17:28:22.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.814+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f748a238f0 con 0x55f748a17a00 2024-09-12T17:28:22.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.814+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.814+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f748a238f0 con 0x55f748a1c410 2024-09-12T17:28:22.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.814+0000 7ff78d50b640 1 -- 172.21.15.170:0/1804368993 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(37 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff788069040 con 0x55f748a1c410 2024-09-12T17:28:22.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.814+0000 7ff78f220800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:22.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.814+0000 7ff78f220800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:22.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.814+0000 7ff78f220800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:22.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.814+0000 7ff78f220800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:22.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.814+0000 7ff78f220800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:22.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.814+0000 7ff78f220800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:22.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.814+0000 7ff78f220800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.814+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748a1f7d0 con 0x55f748a17a00 2024-09-12T17:28:22.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.815+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.815+0000 7ff78f220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:22.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.815+0000 7ff78f220800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.815+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748a1f3e0 con 0x55f748a17a00 2024-09-12T17:28:22.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.815+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.815+0000 7ff78f220800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:22.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.815+0000 7ff78f220800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.815+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748a201c0 con 0x55f748a1c410 2024-09-12T17:28:22.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.815+0000 7ff78d50b640 1 -- 172.21.15.170:0/1804368993 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff788069040 con 0x55f748a1c410 2024-09-12T17:28:22.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.815+0000 7ff78f220800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:22.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.815+0000 7ff78f220800 20 zone default found 2024-09-12T17:28:22.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.815+0000 7ff78f220800 4 Realm: () 2024-09-12T17:28:22.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.815+0000 7ff78f220800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:22.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.815+0000 7ff78f220800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:22.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.815+0000 7ff78f220800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:22.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.815+0000 7ff78f220800 20 zonegroup default 2024-09-12T17:28:22.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.815+0000 7ff78f220800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.815+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748a24220 con 0x7ff78803d060 2024-09-12T17:28:22.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.816+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff774051070 con 0x7ff78803d060 2024-09-12T17:28:22.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.816+0000 7ff78f220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:22.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.816+0000 7ff78f220800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.816+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748a26460 con 0x55f748a20de0 2024-09-12T17:28:22.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.816+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff77c036040 con 0x55f748a20de0 2024-09-12T17:28:22.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.816+0000 7ff78f220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:22.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.816+0000 7ff78f220800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.816+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748a26800 con 0x55f748a20de0 2024-09-12T17:28:22.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.816+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff77c036040 con 0x55f748a20de0 2024-09-12T17:28:22.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.816+0000 7ff78f220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:22.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.816+0000 7ff78f220800 20 started sync module instance, tier type = 2024-09-12T17:28:22.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.816+0000 7ff78f220800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:22.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.816+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a258a0 con 0x55f748a1c410 2024-09-12T17:28:22.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.817+0000 7ff78d50b640 1 -- 172.21.15.170:0/1804368993 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(44 notify.0 [create] v31'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff788069040 con 0x55f748a1c410 2024-09-12T17:28:22.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.817+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94520563883424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a258a0 con 0x55f748a1c410 2024-09-12T17:28:22.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.817+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a27220 con 0x55f748a17a00 2024-09-12T17:28:22.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.818+0000 7ff78d50b640 1 -- 172.21.15.170:0/1804368993 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94520563883424] v31'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff788069040 con 0x55f748a1c410 2024-09-12T17:28:22.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.819+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v31'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.819+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94520563887376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a258a0 con 0x55f748a17a00 2024-09-12T17:28:22.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.819+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a27cb0 con 0x55f748a20de0 2024-09-12T17:28:22.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.819+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94520563887376] v31'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.820+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v31'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff77c036040 con 0x55f748a20de0 2024-09-12T17:28:22.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.820+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94520563880944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a25810 con 0x55f748a20de0 2024-09-12T17:28:22.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.820+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a28b70 con 0x55f748a1c410 2024-09-12T17:28:22.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.821+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94520563880944] v31'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff77c036040 con 0x55f748a20de0 2024-09-12T17:28:22.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.821+0000 7ff78d50b640 1 -- 172.21.15.170:0/1804368993 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(50 notify.3 [create] v31'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff788069040 con 0x55f748a1c410 2024-09-12T17:28:22.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.821+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94520563893952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a28ae0 con 0x55f748a1c410 2024-09-12T17:28:22.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.821+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a29a30 con 0x55f748a17a00 2024-09-12T17:28:22.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.822+0000 7ff78d50b640 1 -- 172.21.15.170:0/1804368993 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94520563893952] v31'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff788069040 con 0x55f748a1c410 2024-09-12T17:28:22.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.822+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v31'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.822+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94520563896160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a29a30 con 0x55f748a17a00 2024-09-12T17:28:22.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.822+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a2a3f0 con 0x7ff78803d060 2024-09-12T17:28:22.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.823+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(54 notify.5 [create] v31'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff774051070 con 0x7ff78803d060 2024-09-12T17:28:22.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.823+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94520563900224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a2a360 con 0x7ff78803d060 2024-09-12T17:28:22.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.823+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a2b3a0 con 0x7ff78803d060 2024-09-12T17:28:22.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.823+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94520563896160] v31'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.824+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94520563900224] v31'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff774051070 con 0x7ff78803d060 2024-09-12T17:28:22.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.824+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v31'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff774051070 con 0x7ff78803d060 2024-09-12T17:28:22.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.824+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94520563902432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a2ae80 con 0x7ff78803d060 2024-09-12T17:28:22.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.824+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a2b850 con 0x7ff78803d060 2024-09-12T17:28:22.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.825+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(58 notify.7 [create] v31'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff774051070 con 0x7ff78803d060 2024-09-12T17:28:22.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.825+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94520563905440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a2bc70 con 0x7ff78803d060 2024-09-12T17:28:22.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.825+0000 7ff78f220800 20 add_watcher() i=0 2024-09-12T17:28:22.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.825+0000 7ff78f220800 20 add_watcher() i=1 2024-09-12T17:28:22.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.825+0000 7ff78f220800 20 add_watcher() i=2 2024-09-12T17:28:22.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.825+0000 7ff78f220800 20 add_watcher() i=3 2024-09-12T17:28:22.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.825+0000 7ff78f220800 20 add_watcher() i=4 2024-09-12T17:28:22.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.825+0000 7ff78f220800 20 add_watcher() i=5 2024-09-12T17:28:22.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.825+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94520563902432] v31'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff774051070 con 0x7ff78803d060 2024-09-12T17:28:22.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.825+0000 7ff78f220800 20 add_watcher() i=6 2024-09-12T17:28:22.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.826+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94520563905440] v31'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff774051070 con 0x7ff78803d060 2024-09-12T17:28:22.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.826+0000 7ff78f220800 20 add_watcher() i=7 2024-09-12T17:28:22.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.826+0000 7ff78f220800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:22.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.826+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748a29580 con 0x55f748a17a00 2024-09-12T17:28:22.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.826+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.826+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94520563906496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a29580 con 0x55f748a17a00 2024-09-12T17:28:22.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.827+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94520563906496] v31'182 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.827+0000 7ff6437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:22.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.827+0000 7ff78f220800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:22.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.827+0000 7ff78f220800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:22.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.827+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a375b0 con 0x55f748a17a00 2024-09-12T17:28:22.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.828+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.828+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a375b0 con 0x7ff78803d060 2024-09-12T17:28:22.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.829+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff774051070 con 0x7ff78803d060 2024-09-12T17:28:22.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.829+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a37fd0 con 0x55f748a20de0 2024-09-12T17:28:22.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.830+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff77c036040 con 0x55f748a20de0 2024-09-12T17:28:22.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.830+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a37fd0 con 0x55f748a17a00 2024-09-12T17:28:22.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.831+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'183 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.831+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a38600 con 0x55f748a1c410 2024-09-12T17:28:22.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.832+0000 7ff78d50b640 1 -- 172.21.15.170:0/1804368993 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'62 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff788069040 con 0x55f748a1c410 2024-09-12T17:28:22.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.832+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a38580 con 0x55f748a20de0 2024-09-12T17:28:22.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.833+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 <== osd.3 v2:172.21.15.170:6816/2664906588 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'41 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff77c036040 con 0x55f748a20de0 2024-09-12T17:28:22.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.833+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a388b0 con 0x55f748a17a00 2024-09-12T17:28:22.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.834+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.834+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a388b0 con 0x7ff78803d060 2024-09-12T17:28:22.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.835+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'41 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff774051070 con 0x7ff78803d060 2024-09-12T17:28:22.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.835+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a388b0 con 0x55f748a1c410 2024-09-12T17:28:22.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.836+0000 7ff78d50b640 1 -- 172.21.15.170:0/1804368993 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'25 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff788069040 con 0x55f748a1c410 2024-09-12T17:28:22.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.836+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a388b0 con 0x55f748a20de0 2024-09-12T17:28:22.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.837+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 <== osd.3 v2:172.21.15.170:6816/2664906588 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff77c036040 con 0x55f748a20de0 2024-09-12T17:28:22.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.837+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a38940 con 0x55f748a1c410 2024-09-12T17:28:22.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.838+0000 7ff78d50b640 1 -- 172.21.15.170:0/1804368993 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'63 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff788069040 con 0x55f748a1c410 2024-09-12T17:28:22.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.838+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a389d0 con 0x7ff78803d060 2024-09-12T17:28:22.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.839+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'27 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff774051070 con 0x7ff78803d060 2024-09-12T17:28:22.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.839+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a389d0 con 0x55f748a1c410 2024-09-12T17:28:22.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.840+0000 7ff78d50b640 1 -- 172.21.15.170:0/1804368993 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff788069040 con 0x55f748a1c410 2024-09-12T17:28:22.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.840+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a389d0 con 0x7ff78803d060 2024-09-12T17:28:22.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.841+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'47 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff774051070 con 0x7ff78803d060 2024-09-12T17:28:22.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.841+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a389d0 con 0x55f748a17a00 2024-09-12T17:28:22.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.842+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'184 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.842+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a389d0 con 0x55f748a20de0 2024-09-12T17:28:22.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.843+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 <== osd.3 v2:172.21.15.170:6816/2664906588 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'56 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff77c036040 con 0x55f748a20de0 2024-09-12T17:28:22.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.843+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a38a60 con 0x55f748a1c410 2024-09-12T17:28:22.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.844+0000 7ff78d50b640 1 -- 172.21.15.170:0/1804368993 <== osd.2 v2:172.21.15.170:6808/3855567754 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'64 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff788069040 con 0x55f748a1c410 2024-09-12T17:28:22.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.844+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a38a60 con 0x55f748a20de0 2024-09-12T17:28:22.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.844+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 <== osd.3 v2:172.21.15.170:6816/2664906588 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff77c036040 con 0x55f748a20de0 2024-09-12T17:28:22.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.844+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a38a80 con 0x55f748a17a00 2024-09-12T17:28:22.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.846+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'34 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.846+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a38a80 con 0x55f748a17a00 2024-09-12T17:28:22.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.847+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'185 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.847+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a38a80 con 0x55f748a20de0 2024-09-12T17:28:22.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.848+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 <== osd.3 v2:172.21.15.170:6816/2664906588 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'57 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff77c036040 con 0x55f748a20de0 2024-09-12T17:28:22.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.848+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a38ab0 con 0x55f748a1c410 2024-09-12T17:28:22.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.849+0000 7ff78d50b640 1 -- 172.21.15.170:0/1804368993 <== osd.2 v2:172.21.15.170:6808/3855567754 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'35 uv32 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff788069040 con 0x55f748a1c410 2024-09-12T17:28:22.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.849+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a38af0 con 0x55f748a20de0 2024-09-12T17:28:22.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.850+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 <== osd.3 v2:172.21.15.170:6816/2664906588 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff77c036040 con 0x55f748a20de0 2024-09-12T17:28:22.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.850+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a38b20 con 0x55f748a20de0 2024-09-12T17:28:22.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.851+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 <== osd.3 v2:172.21.15.170:6816/2664906588 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff77c036040 con 0x55f748a20de0 2024-09-12T17:28:22.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.851+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a38b60 con 0x55f748a20de0 2024-09-12T17:28:22.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.852+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 <== osd.3 v2:172.21.15.170:6816/2664906588 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'20 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff77c036040 con 0x55f748a20de0 2024-09-12T17:28:22.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.852+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a38b60 con 0x55f748a20de0 2024-09-12T17:28:22.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.853+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 <== osd.3 v2:172.21.15.170:6816/2664906588 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'42 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff77c036040 con 0x55f748a20de0 2024-09-12T17:28:22.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.853+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a38bb0 con 0x7ff78803d060 2024-09-12T17:28:22.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.854+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff774051070 con 0x7ff78803d060 2024-09-12T17:28:22.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.854+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a38bf0 con 0x55f748a20de0 2024-09-12T17:28:22.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.855+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 <== osd.3 v2:172.21.15.170:6816/2664906588 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff77c036040 con 0x55f748a20de0 2024-09-12T17:28:22.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.855+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a38bf0 con 0x7ff78803d060 2024-09-12T17:28:22.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.856+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'42 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff774051070 con 0x7ff78803d060 2024-09-12T17:28:22.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.856+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a38bf0 con 0x55f748a20de0 2024-09-12T17:28:22.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.857+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 <== osd.3 v2:172.21.15.170:6816/2664906588 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'58 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff77c036040 con 0x55f748a20de0 2024-09-12T17:28:22.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.857+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a38bf0 con 0x7ff78803d060 2024-09-12T17:28:22.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.858+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.0 v2:172.21.15.47:6800/3978157098 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'48 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff774051070 con 0x7ff78803d060 2024-09-12T17:28:22.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.858+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a38c30 con 0x55f748a1c410 2024-09-12T17:28:22.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.859+0000 7ff78d50b640 1 -- 172.21.15.170:0/1804368993 <== osd.2 v2:172.21.15.170:6808/3855567754 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff788069040 con 0x55f748a1c410 2024-09-12T17:28:22.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.859+0000 7ff6427e4640 20 reqs_thread_entry: start 2024-09-12T17:28:22.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.860+0000 7ff78f220800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:22.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.860+0000 7ff78f220800 20 Filter name: none 2024-09-12T17:28:22.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.860+0000 7ff63bfff640 20 reqs_thread_entry: start 2024-09-12T17:28:22.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.860+0000 7ff78f220800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T17:28:22.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.860+0000 7ff78f220800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.860+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748a63b50 con 0x55f748a1c410 2024-09-12T17:28:22.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.860+0000 7ff78d50b640 1 -- 172.21.15.170:0/1804368993 <== osd.2 v2:172.21.15.170:6808/3855567754 21 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7ff788069040 con 0x55f748a1c410 2024-09-12T17:28:22.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.860+0000 7ff78f220800 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T17:28:22.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.860+0000 7ff78f220800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-12T17:28:22.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.860+0000 7ff78f220800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:28:22.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.860+0000 7ff78f220800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5 : miss 2024-09-12T17:28:22.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.860+0000 7ff78f220800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.860+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:95 8.5 8:a5fd9635:root::.bucket.meta.myfoo%3a7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748a655c0 con 0x55f748a17a00 2024-09-12T17:28:22.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.861+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(95 .bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.861+0000 7ff78f220800 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T17:28:22.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.861+0000 7ff78f220800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5 info.flags=0x17 2024-09-12T17:28:22.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.861+0000 7ff78f220800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5 to cache LRU end 2024-09-12T17:28:22.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.861+0000 7ff78f220800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:22.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.861+0000 7ff78f220800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:28:22.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.861+0000 7ff78f220800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5 2024-09-12T17:28:22.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.861+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:96 4.2b 4:d7e58a83:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748ae2af0 con 0x55f748a17a00 2024-09-12T17:28:22.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.861+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(96 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.861+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:97 4.0 4:0304f000:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748ae2b30 con 0x55f748a20de0 2024-09-12T17:28:22.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.861+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 <== osd.3 v2:172.21.15.170:6816/2664906588 26 ==== osd_op_reply(97 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff77c036040 con 0x55f748a20de0 2024-09-12T17:28:22.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.861+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:98 4.1a 4:5af1c9ff:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748ae2b30 con 0x55f748a1c410 2024-09-12T17:28:22.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.862+0000 7ff78d50b640 1 -- 172.21.15.170:0/1804368993 <== osd.2 v2:172.21.15.170:6808/3855567754 22 ==== osd_op_reply(98 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.2 [call out=430b] v0'0 uv3 ondisk = 0) ==== 194+0+430 (crc 0 0 0) 0x7ff788069040 con 0x55f748a1c410 2024-09-12T17:28:22.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.862+0000 7ff78f220800 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-09-12T17:28:22.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.862+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:99 4.37 4:ee79de5c:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748ae2b70 con 0x7ff78803d060 2024-09-12T17:28:22.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.862+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.0 v2:172.21.15.47:6800/3978157098 23 ==== osd_op_reply(99 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff774051070 con 0x7ff78803d060 2024-09-12T17:28:22.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.862+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:100 4.12 4:4926d1a5:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748ae2b70 con 0x55f748a17a00 2024-09-12T17:28:22.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.863+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(100 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.4 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.863+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:101 4.3 4:c2a31d04:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748ae2b70 con 0x55f748a17a00 2024-09-12T17:28:22.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.863+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 30 ==== osd_op_reply(101 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.5 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.863+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:102 4.17 4:e9d4b924:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748ae2b70 con 0x7ff78803d060 2024-09-12T17:28:22.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.863+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.0 v2:172.21.15.47:6800/3978157098 24 ==== osd_op_reply(102 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.6 [call out=429b] v0'0 uv3 ondisk = 0) ==== 194+0+429 (crc 0 0 0) 0x7ff774051070 con 0x7ff78803d060 2024-09-12T17:28:22.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.863+0000 7ff78f220800 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-09-12T17:28:22.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.863+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:103 4.3c 4:3c3c4bfb:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748ae2af0 con 0x55f748a17a00 2024-09-12T17:28:22.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.864+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 31 ==== osd_op_reply(103 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.864+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:104 4.10 4:0ab7f675:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748ae2b50 con 0x55f748a20de0 2024-09-12T17:28:22.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.864+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 <== osd.3 v2:172.21.15.170:6816/2664906588 27 ==== osd_op_reply(104 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.8 [call out=430b] v0'0 uv5 ondisk = 0) ==== 194+0+430 (crc 0 0 0) 0x7ff77c036040 con 0x55f748a20de0 2024-09-12T17:28:22.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.864+0000 7ff78f220800 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-09-12T17:28:22.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.864+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:105 4.1f 4:fadcb124:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748ae2b50 con 0x55f748a20de0 2024-09-12T17:28:22.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.864+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 <== osd.3 v2:172.21.15.170:6816/2664906588 28 ==== osd_op_reply(105 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff77c036040 con 0x55f748a20de0 2024-09-12T17:28:22.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.864+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:106 4.3 4:c3d31936:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748ae2b90 con 0x55f748a17a00 2024-09-12T17:28:22.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.865+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 32 ==== osd_op_reply(106 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.10 [call out=700b] v0'0 uv16 ondisk = 0) ==== 195+0+700 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.865+0000 7ff78f220800 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-09-12T17:28:22.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.865+0000 7ff78f220800 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-09-12T17:28:22.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.865+0000 7ff78f220800 20 get_obj_state: octx=0x7ff78801fdd0 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55f748ae1f88 s->prefetch_data=0 2024-09-12T17:28:22.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.865+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:107 3.4 3:2261ef03:::7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748ae0480 con 0x7ff78803d060 2024-09-12T17:28:22.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.865+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.0 v2:172.21.15.47:6800/3978157098 25 ==== osd_op_reply(107 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7ff774051070 con 0x7ff78803d060 2024-09-12T17:28:22.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.865+0000 7ff78f220800 10 manifest: total_size = 6 2024-09-12T17:28:22.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.865+0000 7ff78f220800 20 get_obj_state: setting s->obj_tag to 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.13901474974331627580 2024-09-12T17:28:22.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.865+0000 7ff78f220800 20 get_obj_state: octx=0x7ff78801fdd0 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55f748ae1f88 s->prefetch_data=0 2024-09-12T17:28:22.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.865+0000 7ff78f220800 20 prepare_atomic_modification: state is not atomic. state=0x55f748ae1f88 2024-09-12T17:28:22.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.865+0000 7ff78f220800 20 bucket index object: :.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.2 2024-09-12T17:28:22.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.865+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:108 4.1a 4:5af1c9ff:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a6a6f0 con 0x55f748a1c410 2024-09-12T17:28:22.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.866+0000 7ff78d50b640 1 -- 172.21.15.170:0/1804368993 <== osd.2 v2:172.21.15.170:6808/3855567754 23 ==== osd_op_reply(108 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.2 [stat,call,call] v31'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7ff788069040 con 0x55f748a1c410 2024-09-12T17:28:22.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.866+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:109 3.4 3:2261ef03:::7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a6a6f0 con 0x7ff78803d060 2024-09-12T17:28:22.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.867+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.0 v2:172.21.15.47:6800/3978157098 26 ==== osd_op_reply(109 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5_9c8454ddf7aa50116496bac348d7550d [call] v31'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7ff774051070 con 0x7ff78803d060 2024-09-12T17:28:22.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.867+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:110 4.1a 4:5af1c9ff:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a6b020 con 0x55f748a1c410 2024-09-12T17:28:22.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.867+0000 7ff78f220800 20 get_obj_state: octx=0x7ff78801fdd0 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55f748ae1f88 s->prefetch_data=0 2024-09-12T17:28:22.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.867+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:111 3.18 3:195360e0:::7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748a6b020 con 0x55f748a20de0 2024-09-12T17:28:22.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.868+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 <== osd.3 v2:172.21.15.170:6816/2664906588 29 ==== osd_op_reply(111 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7ff77c036040 con 0x55f748a20de0 2024-09-12T17:28:22.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.868+0000 7ff78f220800 10 manifest: total_size = 3 2024-09-12T17:28:22.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.868+0000 7ff78f220800 20 get_obj_state: setting s->obj_tag to 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.4169071647196465698 2024-09-12T17:28:22.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.868+0000 7ff78f220800 20 get_obj_state: octx=0x7ff78801fdd0 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55f748ae1f88 s->prefetch_data=0 2024-09-12T17:28:22.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.868+0000 7ff78f220800 20 prepare_atomic_modification: state is not atomic. state=0x55f748ae1f88 2024-09-12T17:28:22.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.868+0000 7ff78f220800 20 bucket index object: :.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.6 2024-09-12T17:28:22.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.868+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:112 4.17 4:e9d4b924:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a6fcd0 con 0x7ff78803d060 2024-09-12T17:28:22.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.868+0000 7ff78d50b640 1 -- 172.21.15.170:0/1804368993 <== osd.2 v2:172.21.15.170:6808/3855567754 24 ==== osd_op_reply(110 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.2 [stat,call,call] v31'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7ff788069040 con 0x55f748a1c410 2024-09-12T17:28:22.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.868+0000 7ff663fff640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-09-12T17:28:22.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.869+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.0 v2:172.21.15.47:6800/3978157098 27 ==== osd_op_reply(112 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.6 [stat,call,call] v31'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7ff774051070 con 0x7ff78803d060 2024-09-12T17:28:22.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.869+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:113 3.18 3:195360e0:::7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a67030 con 0x55f748a20de0 2024-09-12T17:28:22.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.870+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 <== osd.3 v2:172.21.15.170:6816/2664906588 30 ==== osd_op_reply(113 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5_b1b9a972ccd8c962a473909b97007eb4 [call] v31'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7ff77c036040 con 0x55f748a20de0 2024-09-12T17:28:22.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.870+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:114 4.17 4:e9d4b924:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a6bc90 con 0x7ff78803d060 2024-09-12T17:28:22.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.870+0000 7ff78f220800 20 get_obj_state: octx=0x7ff78801fdd0 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55f748ae1f88 s->prefetch_data=0 2024-09-12T17:28:22.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.870+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:115 3.39 3:9cdd4f88:::7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748a6bc90 con 0x55f748a20de0 2024-09-12T17:28:22.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.870+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 <== osd.3 v2:172.21.15.170:6816/2664906588 31 ==== osd_op_reply(115 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7ff77c036040 con 0x55f748a20de0 2024-09-12T17:28:22.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.870+0000 7ff78f220800 10 manifest: total_size = 4 2024-09-12T17:28:22.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.870+0000 7ff78f220800 20 get_obj_state: setting s->obj_tag to 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.16070993899934136526 2024-09-12T17:28:22.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.870+0000 7ff78f220800 20 get_obj_state: octx=0x7ff78801fdd0 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55f748ae1f88 s->prefetch_data=0 2024-09-12T17:28:22.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.870+0000 7ff78f220800 20 prepare_atomic_modification: state is not atomic. state=0x55f748ae1f88 2024-09-12T17:28:22.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.870+0000 7ff78f220800 20 bucket index object: :.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.8 2024-09-12T17:28:22.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.870+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:116 4.10 4:0ab7f675:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a6bc90 con 0x55f748a20de0 2024-09-12T17:28:22.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.871+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.0 v2:172.21.15.47:6800/3978157098 28 ==== osd_op_reply(114 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.6 [stat,call,call] v31'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7ff774051070 con 0x7ff78803d060 2024-09-12T17:28:22.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.871+0000 7ff6637fe640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-09-12T17:28:22.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.871+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 <== osd.3 v2:172.21.15.170:6816/2664906588 32 ==== osd_op_reply(116 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.8 [stat,call,call] v31'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7ff77c036040 con 0x55f748a20de0 2024-09-12T17:28:22.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.871+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:117 3.39 3:9cdd4f88:::7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a6bc90 con 0x55f748a20de0 2024-09-12T17:28:22.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.872+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 <== osd.3 v2:172.21.15.170:6816/2664906588 33 ==== osd_op_reply(117 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v31'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7ff77c036040 con 0x55f748a20de0 2024-09-12T17:28:22.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.872+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:118 4.10 4:0ab7f675:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a6fc00 con 0x55f748a20de0 2024-09-12T17:28:22.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.872+0000 7ff78f220800 20 get_obj_state: octx=0x7ff78801fdd0 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55f748ae1f88 s->prefetch_data=0 2024-09-12T17:28:22.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.872+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:119 3.16 3:68dac440:::7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748a674e0 con 0x55f748a1c410 2024-09-12T17:28:22.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.873+0000 7ff78d50b640 1 -- 172.21.15.170:0/1804368993 <== osd.2 v2:172.21.15.170:6808/3855567754 25 ==== osd_op_reply(119 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=875b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+891 (crc 0 0 0) 0x7ff788069040 con 0x55f748a1c410 2024-09-12T17:28:22.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.873+0000 7ff78f220800 10 manifest: total_size = 5 2024-09-12T17:28:22.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.873+0000 7ff78f220800 20 get_obj_state: setting s->obj_tag to 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.509711446623742591 2024-09-12T17:28:22.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.873+0000 7ff78f220800 20 get_obj_state: octx=0x7ff78801fdd0 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55f748ae1f88 s->prefetch_data=0 2024-09-12T17:28:22.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.873+0000 7ff78f220800 20 prepare_atomic_modification: state is not atomic. state=0x55f748ae1f88 2024-09-12T17:28:22.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.873+0000 7ff78f220800 20 bucket index object: :.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.10 2024-09-12T17:28:22.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.873+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:120 4.3 4:c3d31936:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a67030 con 0x55f748a17a00 2024-09-12T17:28:22.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.874+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 <== osd.3 v2:172.21.15.170:6816/2664906588 34 ==== osd_op_reply(118 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.8 [stat,call,call] v31'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7ff77c036040 con 0x55f748a20de0 2024-09-12T17:28:22.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.874+0000 7ff663fff640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-09-12T17:28:22.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.874+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 33 ==== osd_op_reply(120 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.10 [stat,call,call] v31'17 uv17 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.874+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:121 3.16 3:68dac440:::7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a688f0 con 0x55f748a1c410 2024-09-12T17:28:22.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.875+0000 7ff78d50b640 1 -- 172.21.15.170:0/1804368993 <== osd.2 v2:172.21.15.170:6808/3855567754 26 ==== osd_op_reply(121 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5_24d27c169c2c881eb09a065116f2aa5c [call] v31'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7ff788069040 con 0x55f748a1c410 2024-09-12T17:28:22.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.875+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:122 4.3 4:c3d31936:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a6d730 con 0x55f748a17a00 2024-09-12T17:28:22.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.875+0000 7ff78f220800 20 get_obj_state: octx=0x7ff78801fdd0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55f748ae1f88 s->prefetch_data=0 2024-09-12T17:28:22.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.875+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:123 3.3c 3:3e309e99:::7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748a6de30 con 0x55f748a1c410 2024-09-12T17:28:22.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.875+0000 7ff78d50b640 1 -- 172.21.15.170:0/1804368993 <== osd.2 v2:172.21.15.170:6808/3855567754 27 ==== osd_op_reply(123 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+927 (crc 0 0 0) 0x7ff788069040 con 0x55f748a1c410 2024-09-12T17:28:22.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.875+0000 7ff78f220800 10 manifest: total_size = 5 2024-09-12T17:28:22.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.875+0000 7ff78f220800 20 get_obj_state: setting s->obj_tag to _ZlGT4fTbhSq8snhpdp-0d11YHSP5J9l 2024-09-12T17:28:22.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.875+0000 7ff78f220800 20 get_obj_state: octx=0x7ff78801fdd0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55f748ae1f88 s->prefetch_data=0 2024-09-12T17:28:22.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.875+0000 7ff78f220800 20 prepare_atomic_modification: state is not atomic. state=0x55f748ae1f88 2024-09-12T17:28:22.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.875+0000 7ff78f220800 20 bucket index object: :.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.10 2024-09-12T17:28:22.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.875+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:124 4.3 4:c3d31936:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a6ee40 con 0x55f748a17a00 2024-09-12T17:28:22.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.876+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 34 ==== osd_op_reply(122 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.10 [stat,call,call] v31'18 uv18 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.876+0000 7ff6637fe640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-09-12T17:28:22.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.876+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 35 ==== osd_op_reply(124 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.10 [stat,call,call] v31'19 uv19 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.877+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:125 3.3c 3:3e309e99:::7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a6ee40 con 0x55f748a1c410 2024-09-12T17:28:22.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.878+0000 7ff78d50b640 1 -- 172.21.15.170:0/1804368993 <== osd.2 v2:172.21.15.170:6808/3855567754 28 ==== osd_op_reply(125 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5_bb3aec0fdcdbc2974890f805c585d432 [call] v31'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7ff788069040 con 0x55f748a1c410 2024-09-12T17:28:22.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.878+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:126 4.3 4:c3d31936:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a6ee40 con 0x55f748a17a00 2024-09-12T17:28:22.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.878+0000 7ff78f220800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:28:22.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.878+0000 7ff78f220800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:28:22.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.878+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:127 4.2b 4:d7e58a83:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748a6ee40 con 0x55f748a17a00 2024-09-12T17:28:22.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.878+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:128 4.0 4:0304f000:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748ae2250 con 0x55f748a20de0 2024-09-12T17:28:22.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.878+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:129 4.1a 4:5af1c9ff:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748a6ee40 con 0x55f748a1c410 2024-09-12T17:28:22.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.878+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:130 4.37 4:ee79de5c:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748ae2250 con 0x7ff78803d060 2024-09-12T17:28:22.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.878+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:131 4.12 4:4926d1a5:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748a6ee40 con 0x55f748a17a00 2024-09-12T17:28:22.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.878+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:132 4.3 4:c2a31d04:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748ae2250 con 0x55f748a17a00 2024-09-12T17:28:22.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.878+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:133 4.17 4:e9d4b924:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748a7eb10 con 0x7ff78803d060 2024-09-12T17:28:22.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.878+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:134 4.3c 4:3c3c4bfb:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748a7eb10 con 0x55f748a17a00 2024-09-12T17:28:22.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.878+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:135 4.10 4:0ab7f675:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748a838d0 con 0x55f748a20de0 2024-09-12T17:28:22.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.878+0000 7ff78d50b640 1 -- 172.21.15.170:0/1804368993 <== osd.2 v2:172.21.15.170:6808/3855567754 29 ==== osd_op_reply(129 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.2 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7ff788069040 con 0x55f748a1c410 2024-09-12T17:28:22.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.878+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 <== osd.3 v2:172.21.15.170:6816/2664906588 35 ==== osd_op_reply(128 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff77c036040 con 0x55f748a20de0 2024-09-12T17:28:22.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.878+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 36 ==== osd_op_reply(127 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.878+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.0 v2:172.21.15.47:6800/3978157098 29 ==== osd_op_reply(130 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff774051070 con 0x7ff78803d060 2024-09-12T17:28:22.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.878+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.0 v2:172.21.15.47:6800/3978157098 30 ==== osd_op_reply(133 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.6 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7ff774051070 con 0x7ff78803d060 2024-09-12T17:28:22.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.878+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:136 4.1f 4:fadcb124:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748a838d0 con 0x55f748a20de0 2024-09-12T17:28:22.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.878+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 37 ==== osd_op_reply(131 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.4 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.878+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 38 ==== osd_op_reply(134 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.878+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:137 4.3 4:c3d31936:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748a6f420 con 0x55f748a17a00 2024-09-12T17:28:22.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.879+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 39 ==== osd_op_reply(132 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.5 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.879+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 <== osd.3 v2:172.21.15.170:6816/2664906588 36 ==== osd_op_reply(135 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.8 [call out=128b] v0'0 uv7 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7ff77c036040 con 0x55f748a20de0 2024-09-12T17:28:22.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.879+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 <== osd.3 v2:172.21.15.170:6816/2664906588 37 ==== osd_op_reply(136 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff77c036040 con 0x55f748a20de0 2024-09-12T17:28:22.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.879+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 40 ==== osd_op_reply(126 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.10 [stat,call,call] v31'20 uv20 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.879+0000 7ff6637fe640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-09-12T17:28:22.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.879+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 41 ==== osd_op_reply(137 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.10 [call out=128b] v0'0 uv20 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.879+0000 7ff78f220800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:28:22.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.879+0000 7ff78f220800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:28:22.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.879+0000 7ff78f220800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:28:22.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.879+0000 7ff78f220800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:28:22.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.879+0000 7ff78f220800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5])"; uploads.size()=0; is_truncated=0 2024-09-12T17:28:22.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.879+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:138 4.2b 4:d7e58a83:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748ae1da0 con 0x55f748a17a00 2024-09-12T17:28:22.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.879+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:139 4.0 4:0304f000:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748a6f420 con 0x55f748a20de0 2024-09-12T17:28:22.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.879+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:140 4.1a 4:5af1c9ff:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748ae1da0 con 0x55f748a1c410 2024-09-12T17:28:22.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.880+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:141 4.37 4:ee79de5c:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748a7fc00 con 0x7ff78803d060 2024-09-12T17:28:22.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.880+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:142 4.12 4:4926d1a5:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748a6f420 con 0x55f748a17a00 2024-09-12T17:28:22.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.880+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:143 4.3 4:c2a31d04:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748a71220 con 0x55f748a17a00 2024-09-12T17:28:22.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.880+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:144 4.17 4:e9d4b924:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748a7fc00 con 0x7ff78803d060 2024-09-12T17:28:22.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.880+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:145 4.3c 4:3c3c4bfb:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748a6f420 con 0x55f748a17a00 2024-09-12T17:28:22.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.880+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:146 4.10 4:0ab7f675:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748a78520 con 0x55f748a20de0 2024-09-12T17:28:22.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.880+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:147 4.1f 4:fadcb124:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748ae1da0 con 0x55f748a20de0 2024-09-12T17:28:22.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.880+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.0 v2:172.21.15.47:6800/3978157098 31 ==== osd_op_reply(144 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.6 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7ff774051070 con 0x7ff78803d060 2024-09-12T17:28:22.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.880+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:148 4.3 4:c3d31936:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748a7fc00 con 0x55f748a17a00 2024-09-12T17:28:22.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.880+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 <== osd.3 v2:172.21.15.170:6816/2664906588 38 ==== osd_op_reply(139 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff77c036040 con 0x55f748a20de0 2024-09-12T17:28:22.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.880+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.0 v2:172.21.15.47:6800/3978157098 32 ==== osd_op_reply(141 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff774051070 con 0x7ff78803d060 2024-09-12T17:28:22.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.880+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 42 ==== osd_op_reply(138 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.880+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 <== osd.3 v2:172.21.15.170:6816/2664906588 39 ==== osd_op_reply(146 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.8 [call out=128b] v0'0 uv7 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7ff77c036040 con 0x55f748a20de0 2024-09-12T17:28:22.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.880+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 43 ==== osd_op_reply(142 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.4 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.880+0000 7ff78d50b640 1 -- 172.21.15.170:0/1804368993 <== osd.2 v2:172.21.15.170:6808/3855567754 30 ==== osd_op_reply(140 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.2 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7ff788069040 con 0x55f748a1c410 2024-09-12T17:28:22.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.880+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 44 ==== osd_op_reply(143 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.5 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.880+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 <== osd.3 v2:172.21.15.170:6816/2664906588 40 ==== osd_op_reply(147 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff77c036040 con 0x55f748a20de0 2024-09-12T17:28:22.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.880+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 45 ==== osd_op_reply(145 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.880+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 46 ==== osd_op_reply(148 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.10 [call out=128b] v0'0 uv20 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.880+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748ae07f0 con 0x55f748a1c410 2024-09-12T17:28:22.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.882+0000 7ff78d50b640 1 -- 172.21.15.170:0/1804368993 <== osd.2 v2:172.21.15.170:6808/3855567754 31 ==== osd_op_reply(149 foo.buckets [call] v31'37 uv37 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ff788069040 con 0x55f748a1c410 2024-09-12T17:28:22.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.882+0000 7ff78f220800 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-09-12T17:28:22.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.882+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:150 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a71220 con 0x55f748a1c410 2024-09-12T17:28:22.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.882+0000 7ff78d50b640 1 -- 172.21.15.170:0/1804368993 <== osd.2 v2:172.21.15.170:6808/3855567754 32 ==== osd_op_reply(150 myfoo [call,call,delete] v31'38 uv38 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7ff788069040 con 0x55f748a1c410 2024-09-12T17:28:22.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.883+0000 7ff78f220800 10 removing default.rgw.meta+root+myfoo from cache 2024-09-12T17:28:22.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.883+0000 7ff78f220800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-12T17:28:22.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.883+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94520564185088 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748a7e450 con 0x7ff78803d060 2024-09-12T17:28:22.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.883+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.0 v2:172.21.15.47:6800/3978157098 33 ==== watch-notify(notify (1) cookie 94520563902432 notify 133143986201 ret 0) ==== 191+0+0 (crc 0 0 0) 0x55f748a63af0 con 0x7ff78803d060 2024-09-12T17:28:22.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.883+0000 7ff663fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986201 cookie 94520563902432 notifier 4645 bl.length()=149 2024-09-12T17:28:22.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.883+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.0 v2:172.21.15.47:6800/3978157098 34 ==== osd_op_reply(151 notify.6 [notify cookie 94520564185088 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff774051070 con 0x7ff78803d060 2024-09-12T17:28:22.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.883+0000 7ff663fff640 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:152 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7ff650003d60 con 0x7ff78803d060 2024-09-12T17:28:22.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.883+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.0 v2:172.21.15.47:6800/3978157098 35 ==== osd_op_reply(152 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff774051070 con 0x7ff78803d060 2024-09-12T17:28:22.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.883+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.0 v2:172.21.15.47:6800/3978157098 36 ==== watch-notify(notify_complete (2) cookie 94520564185088 notify 133143986201 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f748a30ec0 con 0x7ff78803d060 2024-09-12T17:28:22.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.883+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:153 8.5 8:a5fd9635:root::.bucket.meta.myfoo%3a7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a71220 con 0x55f748a17a00 2024-09-12T17:28:22.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.884+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 47 ==== osd_op_reply(153 .bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5 [call,call,delete] v31'4 uv4 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.884+0000 7ff78f220800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5 from cache 2024-09-12T17:28:22.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.884+0000 7ff78f220800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5, ofs0, ns] 2024-09-12T17:28:22.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.884+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:154 7.9 7:93e5b521:::notify.7:head [notify cookie 94520564185088 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748ae07f0 con 0x7ff78803d060 2024-09-12T17:28:22.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.885+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.0 v2:172.21.15.47:6800/3978157098 37 ==== watch-notify(notify (1) cookie 94520563905440 notify 133143986202 ret 0) ==== 248+0+0 (crc 0 0 0) 0x55f748a30ec0 con 0x7ff78803d060 2024-09-12T17:28:22.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.885+0000 7ff663fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986202 cookie 94520563905440 notifier 4645 bl.length()=206 2024-09-12T17:28:22.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.885+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.0 v2:172.21.15.47:6800/3978157098 38 ==== osd_op_reply(154 notify.7 [notify cookie 94520564185088 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff774051070 con 0x7ff78803d060 2024-09-12T17:28:22.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.885+0000 7ff663fff640 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:155 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7ff650003d60 con 0x7ff78803d060 2024-09-12T17:28:22.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.885+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.0 v2:172.21.15.47:6800/3978157098 39 ==== osd_op_reply(155 notify.7 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff774051070 con 0x7ff78803d060 2024-09-12T17:28:22.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.885+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.0 v2:172.21.15.47:6800/3978157098 40 ==== watch-notify(notify_complete (2) cookie 94520564185088 notify 133143986202 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f748a30cf0 con 0x7ff78803d060 2024-09-12T17:28:22.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.885+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:156 4.2b 4:d7e58a83:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748ae07f0 con 0x55f748a17a00 2024-09-12T17:28:22.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.885+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:157 4.0 4:0304f000:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a7e450 con 0x55f748a20de0 2024-09-12T17:28:22.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.885+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:158 4.1a 4:5af1c9ff:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a6cbd0 con 0x55f748a1c410 2024-09-12T17:28:22.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.885+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:159 4.37 4:ee79de5c:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a63f70 con 0x7ff78803d060 2024-09-12T17:28:22.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.885+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:160 4.12 4:4926d1a5:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a64350 con 0x55f748a17a00 2024-09-12T17:28:22.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.885+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:161 4.3 4:c2a31d04:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a63f70 con 0x55f748a17a00 2024-09-12T17:28:22.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.885+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:162 4.17 4:e9d4b924:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a64350 con 0x7ff78803d060 2024-09-12T17:28:22.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.885+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:163 4.3c 4:3c3c4bfb:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a64be0 con 0x55f748a17a00 2024-09-12T17:28:22.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.885+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:164 4.10 4:0ab7f675:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a6cbd0 con 0x55f748a20de0 2024-09-12T17:28:22.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.885+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:165 4.1f 4:fadcb124:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a6de30 con 0x55f748a20de0 2024-09-12T17:28:22.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.885+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:166 4.3 4:c3d31936:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a6e870 con 0x55f748a17a00 2024-09-12T17:28:22.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.887+0000 7ff78d50b640 1 -- 172.21.15.170:0/1804368993 <== osd.2 v2:172.21.15.170:6808/3855567754 33 ==== osd_op_reply(158 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.2 [delete] v31'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff788069040 con 0x55f748a1c410 2024-09-12T17:28:22.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.887+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.0 v2:172.21.15.47:6800/3978157098 41 ==== osd_op_reply(159 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.3 [delete] v31'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff774051070 con 0x7ff78803d060 2024-09-12T17:28:22.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.887+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 <== osd.3 v2:172.21.15.170:6816/2664906588 41 ==== osd_op_reply(165 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.9 [delete] v31'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff77c036040 con 0x55f748a20de0 2024-09-12T17:28:22.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.887+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 <== osd.3 v2:172.21.15.170:6816/2664906588 42 ==== osd_op_reply(157 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.1 [delete] v31'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff77c036040 con 0x55f748a20de0 2024-09-12T17:28:22.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.888+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 <== osd.3 v2:172.21.15.170:6816/2664906588 43 ==== osd_op_reply(164 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.8 [delete] v31'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff77c036040 con 0x55f748a20de0 2024-09-12T17:28:22.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.888+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.0 v2:172.21.15.47:6800/3978157098 42 ==== osd_op_reply(162 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.6 [delete] v31'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff774051070 con 0x7ff78803d060 2024-09-12T17:28:22.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.888+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 48 ==== osd_op_reply(156 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.0 [delete] v31'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.888+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 49 ==== osd_op_reply(163 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.7 [delete] v31'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.888+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 50 ==== osd_op_reply(160 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.4 [delete] v31'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.888+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 51 ==== osd_op_reply(161 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.5 [delete] v31'21 uv21 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.888+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 52 ==== osd_op_reply(166 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5.10 [delete] v31'22 uv22 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.888+0000 7ff78f220800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5 : miss 2024-09-12T17:28:22.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.888+0000 7ff78f220800 20 rados->read ofs=0 len=0 2024-09-12T17:28:22.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.888+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:167 6.4 6:23607148:::pubsub..bucket.myfoo%2f7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f748a6de30 con 0x55f748a17a00 2024-09-12T17:28:22.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.888+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 53 ==== osd_op_reply(167 pubsub..bucket.myfoo/7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.888+0000 7ff78f220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:22.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.888+0000 7ff78f220800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5 info.flags=0x0 2024-09-12T17:28:22.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.888+0000 7ff78f220800 10 adding default.rgw.log++pubsub..bucket.myfoo/7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5 to cache LRU end 2024-09-12T17:28:22.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.888+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:168 6.4 6:23607148:::pubsub..bucket.myfoo%2f7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a6de30 con 0x55f748a17a00 2024-09-12T17:28:22.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.889+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 54 ==== osd_op_reply(168 pubsub..bucket.myfoo/7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.5 [delete] v31'186 uv166 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.889+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:169 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a6de30 con 0x55f748a1c410 2024-09-12T17:28:22.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.891+0000 7ff78d50b640 1 -- 172.21.15.170:0/1804368993 <== osd.2 v2:172.21.15.170:6808/3855567754 34 ==== osd_op_reply(169 foo.buckets [call] v31'39 uv39 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ff788069040 con 0x55f748a1c410 2024-09-12T17:28:22.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.891+0000 7ff6437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:22.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.891+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94520563906496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a6de30 con 0x55f748a17a00 2024-09-12T17:28:22.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.892+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 55 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 94520563906496] v31'187 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.892+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94520563883424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a6de30 con 0x55f748a1c410 2024-09-12T17:28:22.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.893+0000 7ff78d50b640 1 -- 172.21.15.170:0/1804368993 <== osd.2 v2:172.21.15.170:6808/3855567754 35 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 94520563883424] v31'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff788069040 con 0x55f748a1c410 2024-09-12T17:28:22.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.893+0000 7ff78f220800 20 remove_watcher() i=0 2024-09-12T17:28:22.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.893+0000 7ff78f220800 2 removed watcher, disabling cache 2024-09-12T17:28:22.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.893+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94520563887376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a6de30 con 0x55f748a17a00 2024-09-12T17:28:22.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.894+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 56 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 94520563887376] v31'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.894+0000 7ff78f220800 20 remove_watcher() i=1 2024-09-12T17:28:22.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.894+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94520563880944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a6de30 con 0x55f748a20de0 2024-09-12T17:28:22.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.895+0000 7ff78cd0a640 1 -- 172.21.15.170:0/1804368993 <== osd.3 v2:172.21.15.170:6816/2664906588 44 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 94520563880944] v31'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff77c036040 con 0x55f748a20de0 2024-09-12T17:28:22.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.895+0000 7ff78f220800 20 remove_watcher() i=2 2024-09-12T17:28:22.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.895+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94520563893952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a6de30 con 0x55f748a1c410 2024-09-12T17:28:22.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.896+0000 7ff78d50b640 1 -- 172.21.15.170:0/1804368993 <== osd.2 v2:172.21.15.170:6808/3855567754 36 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 94520563893952] v31'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff788069040 con 0x55f748a1c410 2024-09-12T17:28:22.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.896+0000 7ff78f220800 20 remove_watcher() i=3 2024-09-12T17:28:22.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.896+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94520563896160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a6de30 con 0x55f748a17a00 2024-09-12T17:28:22.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.897+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.1 v2:172.21.15.170:6800/1903654092 57 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 94520563896160] v31'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff774051070 con 0x55f748a17a00 2024-09-12T17:28:22.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.897+0000 7ff78f220800 20 remove_watcher() i=4 2024-09-12T17:28:22.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.897+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94520563900224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a6de30 con 0x7ff78803d060 2024-09-12T17:28:22.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.898+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.0 v2:172.21.15.47:6800/3978157098 43 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 94520563900224] v31'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff774051070 con 0x7ff78803d060 2024-09-12T17:28:22.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.898+0000 7ff78f220800 20 remove_watcher() i=5 2024-09-12T17:28:22.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.898+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94520563902432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a6de30 con 0x7ff78803d060 2024-09-12T17:28:22.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.899+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.0 v2:172.21.15.47:6800/3978157098 44 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 94520563902432] v31'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff774051070 con 0x7ff78803d060 2024-09-12T17:28:22.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.899+0000 7ff78f220800 20 remove_watcher() i=6 2024-09-12T17:28:22.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.899+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94520563905440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f748a6de30 con 0x7ff78803d060 2024-09-12T17:28:22.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.900+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 <== osd.0 v2:172.21.15.47:6800/3978157098 45 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 94520563905440] v31'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff774051070 con 0x7ff78803d060 2024-09-12T17:28:22.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.900+0000 7ff78f220800 20 remove_watcher() i=7 2024-09-12T17:28:22.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.901+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7ff78803d060 msgr2=0x7ff7880123d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.901+0000 7ff78f220800 1 --2- 172.21.15.170:0/1804368993 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7ff78803d060 0x7ff7880123d0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.901+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55f748a17a00 msgr2=0x55f748a19ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.901+0000 7ff78f220800 1 --2- 172.21.15.170:0/1804368993 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55f748a17a00 0x55f748a19ec0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.901+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55f748a1c410 msgr2=0x55f748a1e800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.901+0000 7ff78f220800 1 --2- 172.21.15.170:0/1804368993 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55f748a1c410 0x55f748a1e800 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.901+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55f748a20de0 msgr2=0x55f748a23270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.901+0000 7ff78f220800 1 --2- 172.21.15.170:0/1804368993 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55f748a20de0 0x55f748a23270 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.901+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff65803c730 msgr2=0x7ff65803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.901+0000 7ff78f220800 1 --2- 172.21.15.170:0/1804368993 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff65803c730 0x7ff65803ebf0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff77c018ac0 tx=0x7ff77c04f000 comp rx=0 tx=0).stop 2024-09-12T17:28:22.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.901+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f748a04b00 msgr2=0x55f748a0c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.901+0000 7ff784509640 1 -- 172.21.15.170:0/1804368993 reap_dead start 2024-09-12T17:28:22.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.901+0000 7ff78f220800 1 --2- 172.21.15.170:0/1804368993 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f748a04b00 0x55f748a0c100 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ff788053cd0 tx=0x7ff788053d30 comp rx=0 tx=0).stop 2024-09-12T17:28:22.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.901+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 shutdown_connections 2024-09-12T17:28:22.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.901+0000 7ff78f220800 1 --2- 172.21.15.170:0/1804368993 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f748a04b00 0x55f748a0c100 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.901+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 >> 172.21.15.170:0/1804368993 conn(0x55f748a00f00 msgr2=0x55f7489ff110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:22.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.901+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 shutdown_connections 2024-09-12T17:28:22.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.901+0000 7ff78f220800 1 -- 172.21.15.170:0/1804368993 wait complete. 2024-09-12T17:28:22.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.901+0000 7ff78f220800 1 -- 172.21.15.170:0/467048613 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff66403c730 msgr2=0x7ff66403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.901+0000 7ff78f220800 1 --2- 172.21.15.170:0/467048613 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff66403c730 0x7ff66403ebf0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55f7489e1b70 tx=0x7ff77c040040 comp rx=0 tx=0).stop 2024-09-12T17:28:22.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.901+0000 7ff78f220800 1 -- 172.21.15.170:0/467048613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f748856d30 msgr2=0x55f7489faed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.901+0000 7ff78f220800 1 --2- 172.21.15.170:0/467048613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f748856d30 0x55f7489faed0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x55f7489dada0 tx=0x7ff7880167b0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.901+0000 7ff78f220800 1 -- 172.21.15.170:0/467048613 shutdown_connections 2024-09-12T17:28:22.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.901+0000 7ff78f220800 1 --2- 172.21.15.170:0/467048613 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff66403c730 0x7ff66403ebf0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.901+0000 7ff78f220800 1 --2- 172.21.15.170:0/467048613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f748856d30 0x55f7489faed0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.901+0000 7ff78f220800 1 -- 172.21.15.170:0/467048613 >> 172.21.15.170:0/467048613 conn(0x55f7489e90f0 msgr2=0x55f7489e94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:22.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.901+0000 7ff78f220800 1 -- 172.21.15.170:0/467048613 shutdown_connections 2024-09-12T17:28:22.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.901+0000 7ff78f220800 1 -- 172.21.15.170:0/467048613 wait complete. 2024-09-12T17:28:22.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.902+0000 7ff78f220800 1 -- 172.21.15.170:0/3019997546 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55f7488e4210 msgr2=0x55f7489e1560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.902+0000 7ff78f220800 1 --2- 172.21.15.170:0/3019997546 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55f7488e4210 0x55f7489e1560 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.902+0000 7ff78f220800 1 -- 172.21.15.170:0/3019997546 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55f7489e39d0 msgr2=0x55f7489e5dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.902+0000 7ff78f220800 1 --2- 172.21.15.170:0/3019997546 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55f7489e39d0 0x55f7489e5dc0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.902+0000 7ff78f220800 1 -- 172.21.15.170:0/3019997546 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff67403c780 msgr2=0x7ff67403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.902+0000 7ff78f220800 1 --2- 172.21.15.170:0/3019997546 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff67403c780 0x7ff67403ec40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff774057000 tx=0x7ff774052000 comp rx=0 tx=0).stop 2024-09-12T17:28:22.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.902+0000 7ff78f220800 1 -- 172.21.15.170:0/3019997546 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f7488e2e00 msgr2=0x55f7489d9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.902+0000 7ff78f220800 1 --2- 172.21.15.170:0/3019997546 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f7488e2e00 0x55f7489d9f10 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7ff77c00c010 tx=0x7ff77c000ed0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.902+0000 7ff78f220800 1 -- 172.21.15.170:0/3019997546 shutdown_connections 2024-09-12T17:28:22.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.902+0000 7ff78f220800 1 --2- 172.21.15.170:0/3019997546 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55f7489e39d0 0x55f7489e5dc0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.902+0000 7ff78f220800 1 --2- 172.21.15.170:0/3019997546 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff67403c780 0x7ff67403ec40 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.902+0000 7ff78f220800 1 --2- 172.21.15.170:0/3019997546 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55f7488e4210 0x55f7489e1560 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.902+0000 7ff78f220800 1 --2- 172.21.15.170:0/3019997546 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f7488e2e00 0x55f7489d9f10 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.902+0000 7ff78f220800 1 -- 172.21.15.170:0/3019997546 >> 172.21.15.170:0/3019997546 conn(0x55f7488de1d0 msgr2=0x55f7489d3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:22.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.902+0000 7ff78f220800 1 -- 172.21.15.170:0/3019997546 shutdown_connections 2024-09-12T17:28:22.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.902+0000 7ff78f220800 1 -- 172.21.15.170:0/3019997546 wait complete. 2024-09-12T17:28:22.911 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-12T17:28:22.911 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-12T17:28:22.912 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-09-12T17:28:22.958 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:22.958 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:22.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.957+0000 7f8a4bb40800 1 Processor -- start 2024-09-12T17:28:22.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.957+0000 7f8a4bb40800 1 -- start start 2024-09-12T17:28:22.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.958+0000 7f8a4bb40800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55b224cab220 0x55b224cad6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.958+0000 7f8a4bb40800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b224b50e40 con 0x55b224ca7620 2024-09-12T17:28:22.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.958+0000 7f8a4bb40800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x55b224b1b680 con 0x55b224cab220 2024-09-12T17:28:22.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.958+0000 7f8a470bf640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55b224cab220 0x55b224cad6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.958+0000 7f8a478c0640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x55b224ca7620 0x55b224ca9a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:47712/0 (socket says 172.21.15.170:47712) 2024-09-12T17:28:22.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.958+0000 7f8a478c0640 1 -- 172.21.15.170:0/577205237 learned_addr learned my addr 172.21.15.170:0/577205237 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:28:22.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.958+0000 7f8a470bf640 1 -- 172.21.15.170:0/577205237 >> v1:172.21.15.47:6789/0 conn(0x55b224ca7620 legacy=0x55b224ca9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.958+0000 7f8a470bf640 1 -- 172.21.15.170:0/577205237 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b224b376b0 con 0x55b224cab220 2024-09-12T17:28:22.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.958+0000 7f8a468be640 1 -- 172.21.15.170:0/577205237 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2878418025 0 0) 0x55b224b50e40 con 0x55b224ca7620 2024-09-12T17:28:22.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.960+0000 7f8a470bf640 1 --2- 172.21.15.170:0/577205237 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b224cab220 0x55b224cad6e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f8a3000a470 tx=0x7f8a30045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f4303cb1450ff84 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.960+0000 7f8a468be640 1 -- 172.21.15.170:0/577205237 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a30053570 con 0x55b224cab220 2024-09-12T17:28:22.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.960+0000 7f8a468be640 1 -- 172.21.15.170:0/577205237 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a30058070 con 0x55b224cab220 2024-09-12T17:28:22.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.960+0000 7f8a468be640 1 -- 172.21.15.170:0/577205237 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a30053880 con 0x55b224cab220 2024-09-12T17:28:22.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.961+0000 7f8a4bb40800 1 -- 172.21.15.170:0/577205237 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b224cab220 msgr2=0x55b224cad6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.961+0000 7f8a4bb40800 1 --2- 172.21.15.170:0/577205237 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b224cab220 0x55b224cad6e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f8a3000a470 tx=0x7f8a30045a20 comp rx=0 tx=0).stop 2024-09-12T17:28:22.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.961+0000 7f8a4bb40800 1 -- 172.21.15.170:0/577205237 shutdown_connections 2024-09-12T17:28:22.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.961+0000 7f8a4bb40800 1 --2- 172.21.15.170:0/577205237 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b224cab220 0x55b224cad6e0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.961+0000 7f8a4bb40800 1 -- 172.21.15.170:0/577205237 >> 172.21.15.170:0/577205237 conn(0x55b224ca1200 msgr2=0x55b224ca3640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:22.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.961+0000 7f8a4bb40800 1 -- 172.21.15.170:0/577205237 shutdown_connections 2024-09-12T17:28:22.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.961+0000 7f8a4bb40800 1 -- 172.21.15.170:0/577205237 wait complete. 2024-09-12T17:28:22.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.975+0000 7f8a4bb40800 1 Processor -- start 2024-09-12T17:28:22.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.975+0000 7f8a4bb40800 1 -- start start 2024-09-12T17:28:22.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.975+0000 7f8a4bb40800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b224ca7620 0x55b224d96480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.975+0000 7f8a4bb40800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b224b3fdd0 con 0x55b224ca7620 2024-09-12T17:28:22.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.975+0000 7f8a478c0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b224ca7620 0x55b224d96480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.975+0000 7f8a478c0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b224ca7620 0x55b224d96480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56166/0 (socket says 172.21.15.170:56166) 2024-09-12T17:28:22.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.975+0000 7f8a478c0640 1 -- 172.21.15.170:0/1011017971 learned_addr learned my addr 172.21.15.170:0/1011017971 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:22.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.975+0000 7f8a478c0640 1 -- 172.21.15.170:0/1011017971 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b224b58e10 con 0x55b224ca7620 2024-09-12T17:28:22.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.976+0000 7f8a478c0640 1 --2- 172.21.15.170:0/1011017971 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b224ca7620 0x55b224d96480 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f8a40006fa0 tx=0x7f8a40001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1242076190dd5b10 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.976+0000 7f8935e0b640 1 -- 172.21.15.170:0/1011017971 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a40003450 con 0x55b224ca7620 2024-09-12T17:28:22.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.976+0000 7f8935e0b640 1 -- 172.21.15.170:0/1011017971 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a40003610 con 0x55b224ca7620 2024-09-12T17:28:22.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.976+0000 7f8935e0b640 1 -- 172.21.15.170:0/1011017971 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a40003970 con 0x55b224ca7620 2024-09-12T17:28:22.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.977+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1011017971 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b224ca7620 msgr2=0x55b224d96480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:22.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.977+0000 7f8a4bb40800 1 --2- 172.21.15.170:0/1011017971 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b224ca7620 0x55b224d96480 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f8a40006fa0 tx=0x7f8a40001b00 comp rx=0 tx=0).stop 2024-09-12T17:28:22.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.977+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1011017971 shutdown_connections 2024-09-12T17:28:22.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.977+0000 7f8a4bb40800 1 --2- 172.21.15.170:0/1011017971 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b224ca7620 0x55b224d96480 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:22.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.977+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1011017971 >> 172.21.15.170:0/1011017971 conn(0x55b224ca1200 msgr2=0x55b224d91e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:22.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.977+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1011017971 shutdown_connections 2024-09-12T17:28:22.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.977+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1011017971 wait complete. 2024-09-12T17:28:22.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.977+0000 7f8a4bb40800 1 Processor -- start 2024-09-12T17:28:22.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.977+0000 7f8a4bb40800 1 -- start start 2024-09-12T17:28:22.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.977+0000 7f8a4bb40800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b224ca7620 0x55b224d9dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.977+0000 7f8a4bb40800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b224cae060 con 0x55b224ca7620 2024-09-12T17:28:22.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.977+0000 7f8a478c0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b224ca7620 0x55b224d9dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.977+0000 7f8a478c0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b224ca7620 0x55b224d9dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56182/0 (socket says 172.21.15.170:56182) 2024-09-12T17:28:22.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.977+0000 7f8a478c0640 1 -- 172.21.15.170:0/3077744588 learned_addr learned my addr 172.21.15.170:0/3077744588 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:22.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.978+0000 7f8a478c0640 1 -- 172.21.15.170:0/3077744588 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b224d9e300 con 0x55b224ca7620 2024-09-12T17:28:22.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.978+0000 7f8a478c0640 1 --2- 172.21.15.170:0/3077744588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b224ca7620 0x55b224d9dda0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f8a40001330 tx=0x7f8a40001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.978+0000 7f892ffff640 1 -- 172.21.15.170:0/3077744588 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a40014a10 con 0x55b224ca7620 2024-09-12T17:28:22.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.978+0000 7f892ffff640 1 -- 172.21.15.170:0/3077744588 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a40014bb0 con 0x55b224ca7620 2024-09-12T17:28:22.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.978+0000 7f8a4bb40800 1 -- 172.21.15.170:0/3077744588 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b224d9e590 con 0x55b224ca7620 2024-09-12T17:28:22.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.978+0000 7f892ffff640 1 -- 172.21.15.170:0/3077744588 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a4001e3f0 con 0x55b224ca7620 2024-09-12T17:28:22.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.978+0000 7f8a4bb40800 1 -- 172.21.15.170:0/3077744588 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b224d9ef90 con 0x55b224ca7620 2024-09-12T17:28:22.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.979+0000 7f892ffff640 1 -- 172.21.15.170:0/3077744588 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8a40010070 con 0x55b224ca7620 2024-09-12T17:28:22.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.979+0000 7f892ffff640 1 --2- 172.21.15.170:0/3077744588 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f893003c780 0x7f893003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.979+0000 7f892ffff640 1 -- 172.21.15.170:0/3077744588 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f8a40018070 con 0x55b224ca7620 2024-09-12T17:28:22.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.979+0000 7f8a470bf640 1 --2- 172.21.15.170:0/3077744588 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f893003c780 0x7f893003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.979+0000 7f8a4bb40800 1 --2- 172.21.15.170:0/3077744588 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b224cab220 0x55b224da53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.979+0000 7f8a4bb40800 1 -- 172.21.15.170:0/3077744588 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b224da5930 con 0x55b224cab220 2024-09-12T17:28:22.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.979+0000 7f8a480c1640 1 --2- 172.21.15.170:0/3077744588 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b224cab220 0x55b224da53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.980+0000 7f8a470bf640 1 --2- 172.21.15.170:0/3077744588 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f893003c780 0x7f893003ec40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8a30057000 tx=0x7f8a30052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.980+0000 7f8a480c1640 1 --2- 172.21.15.170:0/3077744588 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b224cab220 0x55b224da53f0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.980+0000 7f8a480c1640 1 -- 172.21.15.170:0/3077744588 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a380083e0 con 0x55b224cab220 2024-09-12T17:28:22.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.980+0000 7f8a4bb40800 1 -- 172.21.15.170:0/3077744588 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b224da5cd0 con 0x55b224cab220 2024-09-12T17:28:22.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.980+0000 7f8a480c1640 1 -- 172.21.15.170:0/3077744588 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8a380083e0 con 0x55b224cab220 2024-09-12T17:28:22.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.980+0000 7f8a4bb40800 1 --2- 172.21.15.170:0/3077744588 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b224da7790 0x55b224da9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.980+0000 7f8a4bb40800 1 -- 172.21.15.170:0/3077744588 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b224daa390 con 0x55b224da7790 2024-09-12T17:28:22.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.980+0000 7f8a478c0640 1 --2- 172.21.15.170:0/3077744588 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b224da7790 0x55b224da9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.981+0000 7f8a478c0640 1 --2- 172.21.15.170:0/3077744588 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b224da7790 0x55b224da9c00 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.981+0000 7f8a478c0640 1 -- 172.21.15.170:0/3077744588 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8a4001b070 con 0x55b224da7790 2024-09-12T17:28:22.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.981+0000 7f8a4bb40800 1 -- 172.21.15.170:0/3077744588 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b224da6520 con 0x55b224cab220 2024-09-12T17:28:22.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.981+0000 7f8a480c1640 1 -- 172.21.15.170:0/3077744588 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8a380083e0 con 0x55b224cab220 2024-09-12T17:28:22.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.981+0000 7f8a4bb40800 1 -- 172.21.15.170:0/3077744588 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b224da6910 con 0x55b224da7790 2024-09-12T17:28:22.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.982+0000 7f8a478c0640 1 -- 172.21.15.170:0/3077744588 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8a4001b070 con 0x55b224da7790 2024-09-12T17:28:22.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.982+0000 7f8a4bb40800 1 Processor -- start 2024-09-12T17:28:22.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.982+0000 7f8a4bb40800 1 -- start start 2024-09-12T17:28:22.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.982+0000 7f8a4bb40800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b224db8c60 0x55b224db9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:22.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.982+0000 7f8a4bb40800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b224b9da00 con 0x55b224db8c60 2024-09-12T17:28:22.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.982+0000 7f8a480c1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b224db8c60 0x55b224db9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:22.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.982+0000 7f8a480c1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b224db8c60 0x55b224db9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56198/0 (socket says 172.21.15.170:56198) 2024-09-12T17:28:22.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.982+0000 7f8a480c1640 1 -- 172.21.15.170:0/1633209724 learned_addr learned my addr 172.21.15.170:0/1633209724 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:22.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.983+0000 7f8a480c1640 1 -- 172.21.15.170:0/1633209724 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b224db96c0 con 0x55b224db8c60 2024-09-12T17:28:22.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.983+0000 7f8a480c1640 1 --2- 172.21.15.170:0/1633209724 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b224db8c60 0x55b224db9080 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x55b224d9fc80 tx=0x7f8a3800bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:22.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.983+0000 7f892d7fa640 1 -- 172.21.15.170:0/1633209724 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a3801c020 con 0x55b224db8c60 2024-09-12T17:28:22.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.983+0000 7f892d7fa640 1 -- 172.21.15.170:0/1633209724 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a38007c90 con 0x55b224db8c60 2024-09-12T17:28:22.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.983+0000 7f892d7fa640 1 -- 172.21.15.170:0/1633209724 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a38018440 con 0x55b224db8c60 2024-09-12T17:28:22.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.983+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1633209724 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b224db9ef0 con 0x55b224db8c60 2024-09-12T17:28:22.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.983+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1633209724 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b224dba490 con 0x55b224db8c60 2024-09-12T17:28:22.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.984+0000 7f892d7fa640 1 -- 172.21.15.170:0/1633209724 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8a3801f020 con 0x55b224db8c60 2024-09-12T17:28:23.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.984+0000 7f892d7fa640 1 --2- 172.21.15.170:0/1633209724 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f892003c730 0x7f892003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:23.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.984+0000 7f892d7fa640 1 -- 172.21.15.170:0/1633209724 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f8a38054ef0 con 0x55b224db8c60 2024-09-12T17:28:23.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.984+0000 7f8a478c0640 1 --2- 172.21.15.170:0/1633209724 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f892003c730 0x7f892003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:23.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.984+0000 7f8a4bb40800 1 Processor -- start 2024-09-12T17:28:23.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.984+0000 7f8a4bb40800 1 -- start start 2024-09-12T17:28:23.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.985+0000 7f8a478c0640 1 --2- 172.21.15.170:0/1633209724 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f892003c730 0x7f892003ebf0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55b224d9fec0 tx=0x7f8a40045330 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:23.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.985+0000 7f8a4bb40800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b224ca66d0 0x55b224ca6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:23.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.985+0000 7f8a4bb40800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b224d96cd0 con 0x55b224ca66d0 2024-09-12T17:28:23.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.985+0000 7f8a480c1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b224ca66d0 0x55b224ca6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:23.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.985+0000 7f8a480c1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b224ca66d0 0x55b224ca6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56206/0 (socket says 172.21.15.170:56206) 2024-09-12T17:28:23.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.985+0000 7f8a480c1640 1 -- 172.21.15.170:0/3379211431 learned_addr learned my addr 172.21.15.170:0/3379211431 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:23.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.985+0000 7f8a480c1640 1 -- 172.21.15.170:0/3379211431 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b224ca7010 con 0x55b224ca66d0 2024-09-12T17:28:23.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.985+0000 7f8a480c1640 1 --2- 172.21.15.170:0/3379211431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b224ca66d0 0x55b224ca6ad0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f8a380532d0 tx=0x7f8a38015970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fec52fb00c6af1fd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:23.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.985+0000 7f8926ffd640 1 -- 172.21.15.170:0/3379211431 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a38050030 con 0x55b224ca66d0 2024-09-12T17:28:23.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.985+0000 7f8926ffd640 1 -- 172.21.15.170:0/3379211431 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a38015e70 con 0x55b224ca66d0 2024-09-12T17:28:23.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.985+0000 7f8926ffd640 1 -- 172.21.15.170:0/3379211431 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a380188f0 con 0x55b224ca66d0 2024-09-12T17:28:23.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.986+0000 7f8a4bb40800 1 -- 172.21.15.170:0/3379211431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b224ca66d0 msgr2=0x55b224ca6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:23.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.986+0000 7f8a4bb40800 1 --2- 172.21.15.170:0/3379211431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b224ca66d0 0x55b224ca6ad0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f8a380532d0 tx=0x7f8a38015970 comp rx=0 tx=0).stop 2024-09-12T17:28:23.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.986+0000 7f8a4bb40800 1 -- 172.21.15.170:0/3379211431 shutdown_connections 2024-09-12T17:28:23.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.986+0000 7f8a4bb40800 1 --2- 172.21.15.170:0/3379211431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b224ca66d0 0x55b224ca6ad0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.986+0000 7f8a4bb40800 1 -- 172.21.15.170:0/3379211431 >> 172.21.15.170:0/3379211431 conn(0x55b224dc1ac0 msgr2=0x55b224dbfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:23.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.986+0000 7f8a4bb40800 1 -- 172.21.15.170:0/3379211431 shutdown_connections 2024-09-12T17:28:23.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.986+0000 7f8a4bb40800 1 -- 172.21.15.170:0/3379211431 wait complete. 2024-09-12T17:28:23.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.986+0000 7f8a4bb40800 1 Processor -- start 2024-09-12T17:28:23.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.986+0000 7f8a4bb40800 1 -- start start 2024-09-12T17:28:23.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.986+0000 7f8a4bb40800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b224ca66d0 0x55b224dcef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:23.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.986+0000 7f8a4bb40800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b224ca5590 con 0x55b224ca66d0 2024-09-12T17:28:23.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.987+0000 7f8a480c1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b224ca66d0 0x55b224dcef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:23.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.987+0000 7f8a480c1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b224ca66d0 0x55b224dcef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56212/0 (socket says 172.21.15.170:56212) 2024-09-12T17:28:23.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.987+0000 7f8a480c1640 1 -- 172.21.15.170:0/1710807962 learned_addr learned my addr 172.21.15.170:0/1710807962 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:23.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.987+0000 7f8a480c1640 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b224dcf480 con 0x55b224ca66d0 2024-09-12T17:28:23.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.987+0000 7f8a480c1640 1 --2- 172.21.15.170:0/1710807962 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b224ca66d0 0x55b224dcef20 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f8a380521a0 tx=0x7f8a38008940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:23.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.987+0000 7f89257fa640 1 -- 172.21.15.170:0/1710807962 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a38050070 con 0x55b224ca66d0 2024-09-12T17:28:23.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.987+0000 7f89257fa640 1 -- 172.21.15.170:0/1710807962 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a3802f070 con 0x55b224ca66d0 2024-09-12T17:28:23.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.987+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b224dcf710 con 0x55b224ca66d0 2024-09-12T17:28:23.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.987+0000 7f89257fa640 1 -- 172.21.15.170:0/1710807962 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a38028430 con 0x55b224ca66d0 2024-09-12T17:28:23.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.987+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b224dd0090 con 0x55b224ca66d0 2024-09-12T17:28:23.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.988+0000 7f89257fa640 1 -- 172.21.15.170:0/1710807962 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8a38016040 con 0x55b224ca66d0 2024-09-12T17:28:23.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.988+0000 7f89257fa640 1 --2- 172.21.15.170:0/1710807962 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f891003c780 0x7f891003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:23.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.988+0000 7f89257fa640 1 -- 172.21.15.170:0/1710807962 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f8a38051070 con 0x55b224ca66d0 2024-09-12T17:28:23.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.988+0000 7f8a478c0640 1 --2- 172.21.15.170:0/1710807962 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f891003c780 0x7f891003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:23.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.989+0000 7f8a478c0640 1 --2- 172.21.15.170:0/1710807962 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f891003c780 0x7f891003ec40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8a40028ea0 tx=0x7f8a40047000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:23.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.989+0000 7f8a4bb40800 20 rados->read ofs=0 len=0 2024-09-12T17:28:23.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.989+0000 7f8a4bb40800 1 --2- 172.21.15.170:0/1710807962 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b224dda770 0x55b224ddcc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:23.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.989+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b224ddd380 con 0x55b224dda770 2024-09-12T17:28:23.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.989+0000 7f8a470bf640 1 --2- 172.21.15.170:0/1710807962 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b224dda770 0x55b224ddcc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:23.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.990+0000 7f8a470bf640 1 --2- 172.21.15.170:0/1710807962 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b224dda770 0x55b224ddcc30 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:23.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.990+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a30051070 con 0x55b224dda770 2024-09-12T17:28:23.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.990+0000 7f8a4bb40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:23.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.990+0000 7f8a4bb40800 20 realm 2024-09-12T17:28:23.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.990+0000 7f8a4bb40800 20 rados->read ofs=0 len=0 2024-09-12T17:28:23.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.990+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b224ddd7b0 con 0x55b224dda770 2024-09-12T17:28:23.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.990+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a30051070 con 0x55b224dda770 2024-09-12T17:28:23.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.990+0000 7f8a4bb40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:23.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.990+0000 7f8a4bb40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:23.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.990+0000 7f8a4bb40800 20 rados->read ofs=0 len=0 2024-09-12T17:28:23.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.990+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b224dde080 con 0x55b224dda770 2024-09-12T17:28:23.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.990+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a30051070 con 0x55b224dda770 2024-09-12T17:28:23.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.990+0000 7f8a4bb40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:23.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.990+0000 7f8a4bb40800 20 rados->read ofs=0 len=0 2024-09-12T17:28:23.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.990+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b224dde420 con 0x55b224dda770 2024-09-12T17:28:23.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.990+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8a30051070 con 0x55b224dda770 2024-09-12T17:28:23.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.990+0000 7f8a4bb40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:23.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.990+0000 7f8a4bb40800 20 rados->read ofs=0 len=0 2024-09-12T17:28:23.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.990+0000 7f8a4bb40800 1 --2- 172.21.15.170:0/1710807962 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b224ddf180 0x55b224de1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:23.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.990+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b224de1b80 con 0x55b224ddf180 2024-09-12T17:28:23.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.991+0000 7f8a480c1640 1 --2- 172.21.15.170:0/1710807962 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b224ddf180 0x55b224de1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:23.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.991+0000 7f8a480c1640 1 --2- 172.21.15.170:0/1710807962 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b224ddf180 0x55b224de1570 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:23.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.991+0000 7f8a480c1640 1 -- 172.21.15.170:0/1710807962 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8a380083e0 con 0x55b224ddf180 2024-09-12T17:28:23.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.991+0000 7f8a4bb40800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:23.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.991+0000 7f8a4bb40800 20 searching for the correct realm 2024-09-12T17:28:23.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.991+0000 7f8a4bb40800 1 --2- 172.21.15.170:0/1710807962 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55b224de3b30 0x55b224de5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:23.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.991+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b224de6670 con 0x55b224de3b30 2024-09-12T17:28:23.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.991+0000 7f8a478c0640 1 --2- 172.21.15.170:0/1710807962 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55b224de3b30 0x55b224de5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:23.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.992+0000 7f8a478c0640 1 --2- 172.21.15.170:0/1710807962 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55b224de3b30 0x55b224de5ff0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:23.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.992+0000 7f8a478c0640 1 -- 172.21.15.170:0/1710807962 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a4001b070 con 0x55b224de3b30 2024-09-12T17:28:23.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.992+0000 7f8a478c0640 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b224de6670 con 0x55b224ddf180 2024-09-12T17:28:23.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.992+0000 7f8a480c1640 1 -- 172.21.15.170:0/1710807962 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a380083e0 con 0x55b224ddf180 2024-09-12T17:28:23.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.992+0000 7f8a480c1640 1 --2- 172.21.15.170:0/1710807962 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f8a38021020 0x7f8a38053890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:23.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.992+0000 7f8a480c1640 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8a3805b040 con 0x7f8a38021020 2024-09-12T17:28:23.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.992+0000 7f8a470bf640 1 --2- 172.21.15.170:0/1710807962 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f8a38021020 0x7f8a38053890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:23.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.993+0000 7f8a470bf640 1 --2- 172.21.15.170:0/1710807962 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f8a38021020 0x7f8a38053890 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:23.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.993+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a30051070 con 0x7f8a38021020 2024-09-12T17:28:23.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.993+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8a3805b040 con 0x55b224dda770 2024-09-12T17:28:23.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.993+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a30051070 con 0x55b224dda770 2024-09-12T17:28:23.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.993+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8a3805b040 con 0x55b224dda770 2024-09-12T17:28:23.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.994+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a30051070 con 0x55b224dda770 2024-09-12T17:28:23.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.994+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8a3805b040 con 0x7f8a38021020 2024-09-12T17:28:23.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.994+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a30051070 con 0x7f8a38021020 2024-09-12T17:28:23.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.994+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8a3805b040 con 0x7f8a38021020 2024-09-12T17:28:23.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.994+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a30051070 con 0x7f8a38021020 2024-09-12T17:28:23.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.994+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8a3805b040 con 0x55b224ddf180 2024-09-12T17:28:23.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.994+0000 7f8a480c1640 1 -- 172.21.15.170:0/1710807962 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a380083e0 con 0x55b224ddf180 2024-09-12T17:28:23.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.994+0000 7f8a480c1640 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8a3805b040 con 0x55b224de3b30 2024-09-12T17:28:23.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.994+0000 7f8a478c0640 1 -- 172.21.15.170:0/1710807962 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a4001b070 con 0x55b224de3b30 2024-09-12T17:28:23.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.994+0000 7f8a478c0640 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8a3805b040 con 0x55b224dda770 2024-09-12T17:28:23.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.995+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a30051070 con 0x55b224dda770 2024-09-12T17:28:23.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.995+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8a3805b040 con 0x7f8a38021020 2024-09-12T17:28:23.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.995+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a30051070 con 0x7f8a38021020 2024-09-12T17:28:23.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.995+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8a3805b040 con 0x55b224dda770 2024-09-12T17:28:23.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.995+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a30051070 con 0x55b224dda770 2024-09-12T17:28:23.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.995+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8a3805b040 con 0x55b224ddf180 2024-09-12T17:28:23.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.995+0000 7f8a480c1640 1 -- 172.21.15.170:0/1710807962 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f8a380083e0 con 0x55b224ddf180 2024-09-12T17:28:23.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.995+0000 7f8a480c1640 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8a3805b040 con 0x55b224de3b30 2024-09-12T17:28:23.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.996+0000 7f8a478c0640 1 -- 172.21.15.170:0/1710807962 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a4001b070 con 0x55b224de3b30 2024-09-12T17:28:23.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.996+0000 7f8a478c0640 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8a3805b040 con 0x55b224de3b30 2024-09-12T17:28:23.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.996+0000 7f8a478c0640 1 -- 172.21.15.170:0/1710807962 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a4001b070 con 0x55b224de3b30 2024-09-12T17:28:23.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.996+0000 7f8a478c0640 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8a3805b040 con 0x55b224ddf180 2024-09-12T17:28:23.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.996+0000 7f8a480c1640 1 -- 172.21.15.170:0/1710807962 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a380083e0 con 0x55b224ddf180 2024-09-12T17:28:23.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.996+0000 7f8a480c1640 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8a3805b040 con 0x55b224de3b30 2024-09-12T17:28:23.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.996+0000 7f8a478c0640 1 -- 172.21.15.170:0/1710807962 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a4001b070 con 0x55b224de3b30 2024-09-12T17:28:23.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.996+0000 7f8a478c0640 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8a3805b040 con 0x55b224de3b30 2024-09-12T17:28:23.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.996+0000 7f8a478c0640 1 -- 172.21.15.170:0/1710807962 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a4001b070 con 0x55b224de3b30 2024-09-12T17:28:23.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.997+0000 7f8a478c0640 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8a3805b040 con 0x55b224dda770 2024-09-12T17:28:23.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.997+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a30051070 con 0x55b224dda770 2024-09-12T17:28:23.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.997+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8a3805b040 con 0x55b224dda770 2024-09-12T17:28:23.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.997+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8a30051070 con 0x55b224dda770 2024-09-12T17:28:23.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.997+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8a3805b040 con 0x7f8a38021020 2024-09-12T17:28:23.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.997+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a30051070 con 0x7f8a38021020 2024-09-12T17:28:23.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.997+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8a3805b040 con 0x55b224de3b30 2024-09-12T17:28:23.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.997+0000 7f8a478c0640 1 -- 172.21.15.170:0/1710807962 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a4001b070 con 0x55b224de3b30 2024-09-12T17:28:23.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.997+0000 7f8a478c0640 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8a3805b040 con 0x55b224ddf180 2024-09-12T17:28:23.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.998+0000 7f8a480c1640 1 -- 172.21.15.170:0/1710807962 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a380083e0 con 0x55b224ddf180 2024-09-12T17:28:23.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.998+0000 7f8a480c1640 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8a3805b040 con 0x55b224dda770 2024-09-12T17:28:23.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.998+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a30051070 con 0x55b224dda770 2024-09-12T17:28:23.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.998+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8a3805b040 con 0x7f8a38021020 2024-09-12T17:28:23.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.998+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a30051070 con 0x7f8a38021020 2024-09-12T17:28:23.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.998+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8a3805b040 con 0x55b224de3b30 2024-09-12T17:28:23.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.998+0000 7f8a478c0640 1 -- 172.21.15.170:0/1710807962 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a4001b070 con 0x55b224de3b30 2024-09-12T17:28:23.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.998+0000 7f8a478c0640 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8a3805b040 con 0x7f8a38021020 2024-09-12T17:28:23.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.999+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a30051070 con 0x7f8a38021020 2024-09-12T17:28:23.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.999+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8a3805b040 con 0x55b224ddf180 2024-09-12T17:28:23.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.999+0000 7f8a480c1640 1 -- 172.21.15.170:0/1710807962 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a380083e0 con 0x55b224ddf180 2024-09-12T17:28:23.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.999+0000 7f8a480c1640 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8a3805b040 con 0x55b224de3b30 2024-09-12T17:28:23.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.999+0000 7f8a478c0640 1 -- 172.21.15.170:0/1710807962 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a4001b070 con 0x55b224de3b30 2024-09-12T17:28:23.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.999+0000 7f8a478c0640 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8a3805b040 con 0x7f8a38021020 2024-09-12T17:28:23.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.999+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a30051070 con 0x7f8a38021020 2024-09-12T17:28:23.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:22.999+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8a3805b040 con 0x55b224dda770 2024-09-12T17:28:23.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.000+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8a30051070 con 0x55b224dda770 2024-09-12T17:28:23.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.000+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8a3805b040 con 0x55b224ddf180 2024-09-12T17:28:23.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.000+0000 7f8a480c1640 1 -- 172.21.15.170:0/1710807962 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(37 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8a380083e0 con 0x55b224ddf180 2024-09-12T17:28:23.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.000+0000 7f8a4bb40800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:23.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.000+0000 7f8a4bb40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:23.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.000+0000 7f8a4bb40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:23.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.000+0000 7f8a4bb40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:23.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.000+0000 7f8a4bb40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:23.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.000+0000 7f8a4bb40800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:23.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.000+0000 7f8a4bb40800 20 rados->read ofs=0 len=0 2024-09-12T17:28:23.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.000+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b224de2440 con 0x55b224dda770 2024-09-12T17:28:23.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.000+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a30051070 con 0x55b224dda770 2024-09-12T17:28:23.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.000+0000 7f8a4bb40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:23.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.000+0000 7f8a4bb40800 20 rados->read ofs=0 len=0 2024-09-12T17:28:23.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.000+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b224de2830 con 0x55b224dda770 2024-09-12T17:28:23.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.000+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8a30051070 con 0x55b224dda770 2024-09-12T17:28:23.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.000+0000 7f8a4bb40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:23.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.000+0000 7f8a4bb40800 20 rados->read ofs=0 len=0 2024-09-12T17:28:23.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.000+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b224de2c50 con 0x55b224ddf180 2024-09-12T17:28:23.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.001+0000 7f8a480c1640 1 -- 172.21.15.170:0/1710807962 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8a380083e0 con 0x55b224ddf180 2024-09-12T17:28:23.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.001+0000 7f8a4bb40800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:23.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.001+0000 7f8a4bb40800 20 zone default found 2024-09-12T17:28:23.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.001+0000 7f8a4bb40800 4 Realm: () 2024-09-12T17:28:23.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.001+0000 7f8a4bb40800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:23.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.001+0000 7f8a4bb40800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:23.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.001+0000 7f8a4bb40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:23.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.001+0000 7f8a4bb40800 20 zonegroup default 2024-09-12T17:28:23.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.001+0000 7f8a4bb40800 20 rados->read ofs=0 len=0 2024-09-12T17:28:23.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.001+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b224de6af0 con 0x7f8a38021020 2024-09-12T17:28:23.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.001+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8a30051070 con 0x7f8a38021020 2024-09-12T17:28:23.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.001+0000 7f8a4bb40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:23.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.001+0000 7f8a4bb40800 20 rados->read ofs=0 len=0 2024-09-12T17:28:23.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.001+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b224de8980 con 0x55b224de3b30 2024-09-12T17:28:23.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.001+0000 7f8a478c0640 1 -- 172.21.15.170:0/1710807962 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8a4001b070 con 0x55b224de3b30 2024-09-12T17:28:23.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.001+0000 7f8a4bb40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:23.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.001+0000 7f8a4bb40800 20 rados->read ofs=0 len=0 2024-09-12T17:28:23.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.001+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b224de8da0 con 0x55b224de3b30 2024-09-12T17:28:23.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.002+0000 7f8a478c0640 1 -- 172.21.15.170:0/1710807962 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8a4001b070 con 0x55b224de3b30 2024-09-12T17:28:23.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.002+0000 7f8a4bb40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:23.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.002+0000 7f8a4bb40800 20 started sync module instance, tier type = 2024-09-12T17:28:23.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.002+0000 7f8a4bb40800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:23.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.002+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b224de7d20 con 0x55b224ddf180 2024-09-12T17:28:23.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.003+0000 7f8a480c1640 1 -- 172.21.15.170:0/1710807962 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(44 notify.0 [create] v31'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a380083e0 con 0x55b224ddf180 2024-09-12T17:28:23.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.003+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94223611101728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b224de7d20 con 0x55b224ddf180 2024-09-12T17:28:23.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.003+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b224de9900 con 0x55b224dda770 2024-09-12T17:28:23.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.004+0000 7f8a480c1640 1 -- 172.21.15.170:0/1710807962 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94223611101728] v31'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a380083e0 con 0x55b224ddf180 2024-09-12T17:28:23.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.004+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v31'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a30051070 con 0x55b224dda770 2024-09-12T17:28:23.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.004+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94223611106256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b224de7d20 con 0x55b224dda770 2024-09-12T17:28:23.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.004+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b224dea3b0 con 0x55b224de3b30 2024-09-12T17:28:23.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.005+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94223611106256] v31'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a30051070 con 0x55b224dda770 2024-09-12T17:28:23.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.005+0000 7f8a478c0640 1 -- 172.21.15.170:0/1710807962 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v31'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a4001b070 con 0x55b224de3b30 2024-09-12T17:28:23.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.005+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94223611099248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b224de7c90 con 0x55b224de3b30 2024-09-12T17:28:23.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.005+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b224deb270 con 0x55b224ddf180 2024-09-12T17:28:23.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.006+0000 7f8a478c0640 1 -- 172.21.15.170:0/1710807962 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94223611099248] v31'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a4001b070 con 0x55b224de3b30 2024-09-12T17:28:23.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.006+0000 7f8a480c1640 1 -- 172.21.15.170:0/1710807962 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(50 notify.3 [create] v31'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a380083e0 con 0x55b224ddf180 2024-09-12T17:28:23.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.006+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94223611111328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b224deb270 con 0x55b224ddf180 2024-09-12T17:28:23.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.006+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b224debce0 con 0x55b224dda770 2024-09-12T17:28:23.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.007+0000 7f8a480c1640 1 -- 172.21.15.170:0/1710807962 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94223611111328] v31'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a380083e0 con 0x55b224ddf180 2024-09-12T17:28:23.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.007+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v31'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a30051070 con 0x55b224dda770 2024-09-12T17:28:23.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.008+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94223611115472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b224deb270 con 0x55b224dda770 2024-09-12T17:28:23.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.008+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b224dec730 con 0x7f8a38021020 2024-09-12T17:28:23.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.008+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94223611115472] v31'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a30051070 con 0x55b224dda770 2024-09-12T17:28:23.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.009+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(54 notify.5 [create] v31'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a30051070 con 0x7f8a38021020 2024-09-12T17:28:23.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.009+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94223611118144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b224deb270 con 0x7f8a38021020 2024-09-12T17:28:23.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.009+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b224ded140 con 0x7f8a38021020 2024-09-12T17:28:23.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.010+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94223611118144] v31'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a30051070 con 0x7f8a38021020 2024-09-12T17:28:23.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.010+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v31'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a30051070 con 0x7f8a38021020 2024-09-12T17:28:23.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.010+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94223611113376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b224ded140 con 0x7f8a38021020 2024-09-12T17:28:23.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.010+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b224dedb40 con 0x7f8a38021020 2024-09-12T17:28:23.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.011+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(58 notify.7 [create] v31'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a30051070 con 0x7f8a38021020 2024-09-12T17:28:23.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.011+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94223611123280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b224dedf60 con 0x7f8a38021020 2024-09-12T17:28:23.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.011+0000 7f8a4bb40800 20 add_watcher() i=0 2024-09-12T17:28:23.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.011+0000 7f8a4bb40800 20 add_watcher() i=1 2024-09-12T17:28:23.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.011+0000 7f8a4bb40800 20 add_watcher() i=2 2024-09-12T17:28:23.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.011+0000 7f8a4bb40800 20 add_watcher() i=3 2024-09-12T17:28:23.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.011+0000 7f8a4bb40800 20 add_watcher() i=4 2024-09-12T17:28:23.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.011+0000 7f8a4bb40800 20 add_watcher() i=5 2024-09-12T17:28:23.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.011+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94223611113376] v31'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a30051070 con 0x7f8a38021020 2024-09-12T17:28:23.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.011+0000 7f8a4bb40800 20 add_watcher() i=6 2024-09-12T17:28:23.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.012+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94223611123280] v31'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a30051070 con 0x7f8a38021020 2024-09-12T17:28:23.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.012+0000 7f8a4bb40800 20 add_watcher() i=7 2024-09-12T17:28:23.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.012+0000 7f8a4bb40800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:23.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.012+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b224decc90 con 0x55b224dda770 2024-09-12T17:28:23.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.012+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8a30051070 con 0x55b224dda770 2024-09-12T17:28:23.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.012+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94223611124336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b224decc90 con 0x55b224dda770 2024-09-12T17:28:23.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.013+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94223611124336] v31'188 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8a30051070 con 0x55b224dda770 2024-09-12T17:28:23.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.013+0000 7f88fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:23.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.013+0000 7f8a4bb40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:23.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.013+0000 7f8a4bb40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:23.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.013+0000 7f8a4bb40800 5 note: GC not initialized 2024-09-12T17:28:23.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.013+0000 7f88fcfe1640 20 reqs_thread_entry: start 2024-09-12T17:28:23.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.014+0000 7f8a4bb40800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:23.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.014+0000 7f8a4bb40800 20 Filter name: none 2024-09-12T17:28:23.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.014+0000 7f88767fc640 20 reqs_thread_entry: start 2024-09-12T17:28:23.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.014+0000 7f8a4bb40800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:28:23.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.014+0000 7f8a4bb40800 20 rados->read ofs=0 len=0 2024-09-12T17:28:23.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.014+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b224e23fb0 con 0x55b224dda770 2024-09-12T17:28:23.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.014+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f8a30051070 con 0x55b224dda770 2024-09-12T17:28:23.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.014+0000 7f8a4bb40800 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:28:23.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.014+0000 7f8a4bb40800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T17:28:23.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.014+0000 7f8a4bb40800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:28:23.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.014+0000 7f8a4bb40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:23.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.014+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~403 in=403b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b224e29fe0 con 0x55b224dda770 2024-09-12T17:28:23.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.015+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~403] v31'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f8a30051070 con 0x55b224dda770 2024-09-12T17:28:23.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.015+0000 7f8a4bb40800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:28:23.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.015+0000 7f8a4bb40800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:28:23.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.015+0000 7f8a4bb40800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T17:28:23.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.015+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94223611369904 in=591b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b224e258d0 con 0x55b224dda770 2024-09-12T17:28:23.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.015+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== watch-notify(notify (1) cookie 94223611115472 notify 133143986192 ret 0) ==== 621+0+0 (crc 0 0 0) 0x7f8a30082040 con 0x55b224dda770 2024-09-12T17:28:23.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.015+0000 7f8926ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986192 cookie 94223611115472 notifier 4652 bl.length()=579 2024-09-12T17:28:23.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.015+0000 7f8926ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:28:23.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.015+0000 7f8926ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:28:23.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.015+0000 7f8926ffd640 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f890c003ea0 con 0x55b224dda770 2024-09-12T17:28:23.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.015+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(64 notify.4 [notify cookie 94223611369904 out=8b] v0'0 uv180 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8a30051070 con 0x55b224dda770 2024-09-12T17:28:23.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.016+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a30051070 con 0x55b224dda770 2024-09-12T17:28:23.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.016+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== watch-notify(notify_complete (2) cookie 94223611369904 notify 133143986192 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b224b376b0 con 0x55b224dda770 2024-09-12T17:28:23.032 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T17:27:59.362376Z"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:27:59.362351Z","tags":[],"group_ids":[]} 2024-09-12T17:28:23.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.017+0000 7f88fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:23.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.017+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94223611124336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b224e21e10 con 0x55b224dda770 2024-09-12T17:28:23.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.018+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94223611124336] v31'189 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8a30051070 con 0x55b224dda770 2024-09-12T17:28:23.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.018+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94223611101728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b224e21e10 con 0x55b224ddf180 2024-09-12T17:28:23.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.019+0000 7f8a480c1640 1 -- 172.21.15.170:0/1710807962 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94223611101728] v31'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a380083e0 con 0x55b224ddf180 2024-09-12T17:28:23.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.019+0000 7f8a4bb40800 20 remove_watcher() i=0 2024-09-12T17:28:23.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.019+0000 7f8a4bb40800 2 removed watcher, disabling cache 2024-09-12T17:28:23.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.019+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94223611106256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b224e21e10 con 0x55b224dda770 2024-09-12T17:28:23.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.020+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94223611106256] v31'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a30051070 con 0x55b224dda770 2024-09-12T17:28:23.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.020+0000 7f8a4bb40800 20 remove_watcher() i=1 2024-09-12T17:28:23.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.020+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94223611099248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b224e21e10 con 0x55b224de3b30 2024-09-12T17:28:23.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.021+0000 7f8a478c0640 1 -- 172.21.15.170:0/1710807962 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94223611099248] v31'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a4001b070 con 0x55b224de3b30 2024-09-12T17:28:23.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.021+0000 7f8a4bb40800 20 remove_watcher() i=2 2024-09-12T17:28:23.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.021+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94223611111328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b224e21e10 con 0x55b224ddf180 2024-09-12T17:28:23.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.022+0000 7f8a480c1640 1 -- 172.21.15.170:0/1710807962 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94223611111328] v31'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a380083e0 con 0x55b224ddf180 2024-09-12T17:28:23.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.022+0000 7f8a4bb40800 20 remove_watcher() i=3 2024-09-12T17:28:23.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.022+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94223611115472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b224e21e10 con 0x55b224dda770 2024-09-12T17:28:23.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.023+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94223611115472] v31'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a30051070 con 0x55b224dda770 2024-09-12T17:28:23.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.023+0000 7f8a4bb40800 20 remove_watcher() i=4 2024-09-12T17:28:23.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.023+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94223611118144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b224e21e10 con 0x7f8a38021020 2024-09-12T17:28:23.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.024+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94223611118144] v31'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a30051070 con 0x7f8a38021020 2024-09-12T17:28:23.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.024+0000 7f8a4bb40800 20 remove_watcher() i=5 2024-09-12T17:28:23.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.024+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94223611113376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b224e21e10 con 0x7f8a38021020 2024-09-12T17:28:23.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.025+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94223611113376] v31'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a30051070 con 0x7f8a38021020 2024-09-12T17:28:23.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.025+0000 7f8a4bb40800 20 remove_watcher() i=6 2024-09-12T17:28:23.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.025+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94223611123280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b224e21e10 con 0x7f8a38021020 2024-09-12T17:28:23.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.026+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94223611123280] v31'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a30051070 con 0x7f8a38021020 2024-09-12T17:28:23.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.026+0000 7f8a4bb40800 20 remove_watcher() i=7 2024-09-12T17:28:23.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.026+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f8a38021020 msgr2=0x7f8a38053890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:23.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.026+0000 7f8a4bb40800 1 --2- 172.21.15.170:0/1710807962 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f8a38021020 0x7f8a38053890 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.026+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b224dda770 msgr2=0x55b224ddcc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:23.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.026+0000 7f8a4bb40800 1 --2- 172.21.15.170:0/1710807962 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b224dda770 0x55b224ddcc30 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.026+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b224ddf180 msgr2=0x55b224de1570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:23.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.026+0000 7f8a4bb40800 1 --2- 172.21.15.170:0/1710807962 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b224ddf180 0x55b224de1570 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.026+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55b224de3b30 msgr2=0x55b224de5ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:23.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.026+0000 7f8a4bb40800 1 --2- 172.21.15.170:0/1710807962 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55b224de3b30 0x55b224de5ff0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.026+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f891003c780 msgr2=0x7f891003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:23.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.026+0000 7f8a4bb40800 1 --2- 172.21.15.170:0/1710807962 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f891003c780 0x7f891003ec40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8a40028ea0 tx=0x7f8a40047000 comp rx=0 tx=0).stop 2024-09-12T17:28:23.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.026+0000 7f8a470bf640 1 -- 172.21.15.170:0/1710807962 reap_dead start 2024-09-12T17:28:23.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.026+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b224ca66d0 msgr2=0x55b224dcef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:23.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.026+0000 7f8a4bb40800 1 --2- 172.21.15.170:0/1710807962 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b224ca66d0 0x55b224dcef20 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f8a380521a0 tx=0x7f8a38008940 comp rx=0 tx=0).stop 2024-09-12T17:28:23.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.026+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 shutdown_connections 2024-09-12T17:28:23.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.026+0000 7f8a4bb40800 1 --2- 172.21.15.170:0/1710807962 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b224ca66d0 0x55b224dcef20 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.026+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 >> 172.21.15.170:0/1710807962 conn(0x55b224dc1ac0 msgr2=0x55b224dbfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:23.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.026+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 shutdown_connections 2024-09-12T17:28:23.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.026+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1710807962 wait complete. 2024-09-12T17:28:23.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.027+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1633209724 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f892003c730 msgr2=0x7f892003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:23.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.027+0000 7f8a4bb40800 1 --2- 172.21.15.170:0/1633209724 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f892003c730 0x7f892003ebf0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55b224d9fec0 tx=0x7f8a40045330 comp rx=0 tx=0).stop 2024-09-12T17:28:23.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.027+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1633209724 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b224db8c60 msgr2=0x55b224db9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:23.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.027+0000 7f8a4bb40800 1 --2- 172.21.15.170:0/1633209724 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b224db8c60 0x55b224db9080 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x55b224d9fc80 tx=0x7f8a3800bf30 comp rx=0 tx=0).stop 2024-09-12T17:28:23.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.027+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1633209724 shutdown_connections 2024-09-12T17:28:23.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.027+0000 7f8a4bb40800 1 --2- 172.21.15.170:0/1633209724 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f892003c730 0x7f892003ebf0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.027+0000 7f8a4bb40800 1 --2- 172.21.15.170:0/1633209724 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b224db8c60 0x55b224db9080 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.027+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1633209724 >> 172.21.15.170:0/1633209724 conn(0x55b224dad010 msgr2=0x55b224dad3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:23.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.027+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1633209724 shutdown_connections 2024-09-12T17:28:23.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.027+0000 7f8a4bb40800 1 -- 172.21.15.170:0/1633209724 wait complete. 2024-09-12T17:28:23.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.027+0000 7f8a4bb40800 1 -- 172.21.15.170:0/3077744588 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b224cab220 msgr2=0x55b224da53f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:23.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.027+0000 7f8a4bb40800 1 --2- 172.21.15.170:0/3077744588 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b224cab220 0x55b224da53f0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.027+0000 7f8a4bb40800 1 -- 172.21.15.170:0/3077744588 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b224da7790 msgr2=0x55b224da9c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:23.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.027+0000 7f8a4bb40800 1 --2- 172.21.15.170:0/3077744588 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b224da7790 0x55b224da9c00 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.027+0000 7f8a4bb40800 1 -- 172.21.15.170:0/3077744588 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f893003c780 msgr2=0x7f893003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:23.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.027+0000 7f8a4bb40800 1 --2- 172.21.15.170:0/3077744588 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f893003c780 0x7f893003ec40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8a30057000 tx=0x7f8a30052000 comp rx=0 tx=0).stop 2024-09-12T17:28:23.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.027+0000 7f8a4bb40800 1 -- 172.21.15.170:0/3077744588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b224ca7620 msgr2=0x55b224d9dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:23.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.027+0000 7f8a4bb40800 1 --2- 172.21.15.170:0/3077744588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b224ca7620 0x55b224d9dda0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f8a40001330 tx=0x7f8a40001250 comp rx=0 tx=0).stop 2024-09-12T17:28:23.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.027+0000 7f8a4bb40800 1 -- 172.21.15.170:0/3077744588 shutdown_connections 2024-09-12T17:28:23.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.027+0000 7f8a4bb40800 1 --2- 172.21.15.170:0/3077744588 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b224da7790 0x55b224da9c00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.027+0000 7f8a4bb40800 1 --2- 172.21.15.170:0/3077744588 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f893003c780 0x7f893003ec40 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.027+0000 7f8a4bb40800 1 --2- 172.21.15.170:0/3077744588 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b224cab220 0x55b224da53f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.027+0000 7f8a4bb40800 1 --2- 172.21.15.170:0/3077744588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b224ca7620 0x55b224d9dda0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.027+0000 7f8a4bb40800 1 -- 172.21.15.170:0/3077744588 >> 172.21.15.170:0/3077744588 conn(0x55b224ca1200 msgr2=0x55b224d97760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:23.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.027+0000 7f8a4bb40800 1 -- 172.21.15.170:0/3077744588 shutdown_connections 2024-09-12T17:28:23.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.027+0000 7f8a4bb40800 1 -- 172.21.15.170:0/3077744588 wait complete. 2024-09-12T17:28:23.043 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T17:27:59.362376Z'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:27:59.362351Z', 'tags': [], 'group_ids': []} 2024-09-12T17:28:23.044 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-12T17:28:23.044 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-12T17:28:23.044 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-09-12T17:28:23.090 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:23.090 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:23.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.090+0000 7f63f0814800 1 Processor -- start 2024-09-12T17:28:23.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.090+0000 7f63f0814800 1 -- start start 2024-09-12T17:28:23.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.090+0000 7f63f0814800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55d8cb48c240 0x55d8cb48e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:23.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.090+0000 7f63f0814800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d8cb331e40 con 0x55d8cb488730 2024-09-12T17:28:23.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.090+0000 7f63f0814800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x55d8cb2fc680 con 0x55d8cb48c240 2024-09-12T17:28:23.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.090+0000 7f63e37df640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55d8cb48c240 0x55d8cb48e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:23.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.090+0000 7f63e37df640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55d8cb48c240 0x55d8cb48e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56222/0 (socket says 172.21.15.170:56222) 2024-09-12T17:28:23.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.090+0000 7f63e37df640 1 -- 172.21.15.170:0/2852973604 learned_addr learned my addr 172.21.15.170:0/2852973604 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:23.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.090+0000 7f63e37df640 1 -- 172.21.15.170:0/2852973604 >> v1:172.21.15.47:6789/0 conn(0x55d8cb488730 legacy=0x55d8cb48ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:23.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.090+0000 7f63e37df640 1 -- 172.21.15.170:0/2852973604 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8cb3186b0 con 0x55d8cb48c240 2024-09-12T17:28:23.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.092+0000 7f63e37df640 1 --2- 172.21.15.170:0/2852973604 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8cb48c240 0x55d8cb48e6d0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f63d400a520 tx=0x7f63d4045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a278e53d54432e7a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:23.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.092+0000 7f63eb7df640 1 -- 172.21.15.170:0/2852973604 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63d4055070 con 0x55d8cb48c240 2024-09-12T17:28:23.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.092+0000 7f63eb7df640 1 -- 172.21.15.170:0/2852973604 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63d40515b0 con 0x55d8cb48c240 2024-09-12T17:28:23.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.092+0000 7f63eb7df640 1 -- 172.21.15.170:0/2852973604 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63d40518d0 con 0x55d8cb48c240 2024-09-12T17:28:23.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.093+0000 7f63f0814800 1 -- 172.21.15.170:0/2852973604 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8cb48c240 msgr2=0x55d8cb48e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:23.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.093+0000 7f63f0814800 1 --2- 172.21.15.170:0/2852973604 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8cb48c240 0x55d8cb48e6d0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f63d400a520 tx=0x7f63d4045ba0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.093+0000 7f63f0814800 1 -- 172.21.15.170:0/2852973604 shutdown_connections 2024-09-12T17:28:23.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.093+0000 7f63f0814800 1 --2- 172.21.15.170:0/2852973604 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8cb48c240 0x55d8cb48e6d0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.093+0000 7f63f0814800 1 -- 172.21.15.170:0/2852973604 >> 172.21.15.170:0/2852973604 conn(0x55d8cb4821d0 msgr2=0x55d8cb484630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:23.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.093+0000 7f63f0814800 1 -- 172.21.15.170:0/2852973604 shutdown_connections 2024-09-12T17:28:23.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.093+0000 7f63f0814800 1 -- 172.21.15.170:0/2852973604 wait complete. 2024-09-12T17:28:23.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.107+0000 7f63f0814800 1 Processor -- start 2024-09-12T17:28:23.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.107+0000 7f63f0814800 1 -- start start 2024-09-12T17:28:23.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.107+0000 7f63f0814800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8cb488730 0x55d8cb487ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:23.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.107+0000 7f63f0814800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d8cb320dd0 con 0x55d8cb488730 2024-09-12T17:28:23.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.107+0000 7f63ebfe0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8cb488730 0x55d8cb487ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:23.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.107+0000 7f63ebfe0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8cb488730 0x55d8cb487ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56236/0 (socket says 172.21.15.170:56236) 2024-09-12T17:28:23.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.107+0000 7f63ebfe0640 1 -- 172.21.15.170:0/3615394794 learned_addr learned my addr 172.21.15.170:0/3615394794 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:23.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.108+0000 7f63ebfe0640 1 -- 172.21.15.170:0/3615394794 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8cb339e10 con 0x55d8cb488730 2024-09-12T17:28:23.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.108+0000 7f63ebfe0640 1 --2- 172.21.15.170:0/3615394794 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8cb488730 0x55d8cb487ec0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f63dc001da0 tx=0x7f63dc00b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=169280ab7e314ce1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:23.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.108+0000 7f62d9e0b640 1 -- 172.21.15.170:0/3615394794 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63dc00f400 con 0x55d8cb488730 2024-09-12T17:28:23.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.108+0000 7f62d9e0b640 1 -- 172.21.15.170:0/3615394794 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63dc00f5a0 con 0x55d8cb488730 2024-09-12T17:28:23.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.108+0000 7f62d9e0b640 1 -- 172.21.15.170:0/3615394794 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63dc00f8c0 con 0x55d8cb488730 2024-09-12T17:28:23.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.109+0000 7f63f0814800 1 -- 172.21.15.170:0/3615394794 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8cb488730 msgr2=0x55d8cb487ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:23.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.109+0000 7f63f0814800 1 --2- 172.21.15.170:0/3615394794 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8cb488730 0x55d8cb487ec0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f63dc001da0 tx=0x7f63dc00b5b0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.109+0000 7f63f0814800 1 -- 172.21.15.170:0/3615394794 shutdown_connections 2024-09-12T17:28:23.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.109+0000 7f63f0814800 1 --2- 172.21.15.170:0/3615394794 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8cb488730 0x55d8cb487ec0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.109+0000 7f63f0814800 1 -- 172.21.15.170:0/3615394794 >> 172.21.15.170:0/3615394794 conn(0x55d8cb4821d0 msgr2=0x55d8cb573010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:23.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.109+0000 7f63f0814800 1 -- 172.21.15.170:0/3615394794 shutdown_connections 2024-09-12T17:28:23.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.109+0000 7f63f0814800 1 -- 172.21.15.170:0/3615394794 wait complete. 2024-09-12T17:28:23.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.109+0000 7f63f0814800 1 Processor -- start 2024-09-12T17:28:23.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.109+0000 7f63f0814800 1 -- start start 2024-09-12T17:28:23.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.109+0000 7f63f0814800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8cb488730 0x55d8cb581220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:23.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.109+0000 7f63f0814800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d8cb48f050 con 0x55d8cb488730 2024-09-12T17:28:23.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.109+0000 7f63ebfe0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8cb488730 0x55d8cb581220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:23.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.109+0000 7f63ebfe0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8cb488730 0x55d8cb581220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56246/0 (socket says 172.21.15.170:56246) 2024-09-12T17:28:23.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.109+0000 7f63ebfe0640 1 -- 172.21.15.170:0/344015065 learned_addr learned my addr 172.21.15.170:0/344015065 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:23.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.110+0000 7f63ebfe0640 1 -- 172.21.15.170:0/344015065 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8cb581780 con 0x55d8cb488730 2024-09-12T17:28:23.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.110+0000 7f63ebfe0640 1 --2- 172.21.15.170:0/344015065 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8cb488730 0x55d8cb581220 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x55d8cb4879f0 tx=0x7f63dc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:23.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.110+0000 7f62d3fff640 1 -- 172.21.15.170:0/344015065 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63dc01a690 con 0x55d8cb488730 2024-09-12T17:28:23.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.110+0000 7f62d3fff640 1 -- 172.21.15.170:0/344015065 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63dc01a830 con 0x55d8cb488730 2024-09-12T17:28:23.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.110+0000 7f63f0814800 1 -- 172.21.15.170:0/344015065 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d8cb581a10 con 0x55d8cb488730 2024-09-12T17:28:23.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.110+0000 7f62d3fff640 1 -- 172.21.15.170:0/344015065 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63dc01ab50 con 0x55d8cb488730 2024-09-12T17:28:23.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.110+0000 7f63f0814800 1 -- 172.21.15.170:0/344015065 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8cb582390 con 0x55d8cb488730 2024-09-12T17:28:23.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.111+0000 7f62d3fff640 1 -- 172.21.15.170:0/344015065 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f63dc017070 con 0x55d8cb488730 2024-09-12T17:28:23.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.111+0000 7f62d3fff640 1 --2- 172.21.15.170:0/344015065 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f62d403c730 0x7f62d403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:23.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.111+0000 7f62d3fff640 1 -- 172.21.15.170:0/344015065 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f63dc015020 con 0x55d8cb488730 2024-09-12T17:28:23.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.111+0000 7f63e37df640 1 --2- 172.21.15.170:0/344015065 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f62d403c730 0x7f62d403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:23.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.111+0000 7f63f0814800 1 --2- 172.21.15.170:0/344015065 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55d8cb48c240 0x55d8cb588870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:23.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.111+0000 7f63f0814800 1 -- 172.21.15.170:0/344015065 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb583000 con 0x55d8cb48c240 2024-09-12T17:28:23.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.111+0000 7f63ec7e1640 1 --2- 172.21.15.170:0/344015065 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55d8cb48c240 0x55d8cb588870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:23.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.112+0000 7f63e37df640 1 --2- 172.21.15.170:0/344015065 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f62d403c730 0x7f62d403ebf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f63d4057000 tx=0x7f63d4052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:23.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.112+0000 7f63ec7e1640 1 --2- 172.21.15.170:0/344015065 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55d8cb48c240 0x55d8cb588870 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:23.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.112+0000 7f63ec7e1640 1 -- 172.21.15.170:0/344015065 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f63e400a4d0 con 0x55d8cb48c240 2024-09-12T17:28:23.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.112+0000 7f63f0814800 1 -- 172.21.15.170:0/344015065 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb582890 con 0x55d8cb48c240 2024-09-12T17:28:23.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.112+0000 7f63ec7e1640 1 -- 172.21.15.170:0/344015065 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f63e400a4d0 con 0x55d8cb48c240 2024-09-12T17:28:23.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.112+0000 7f63f0814800 1 --2- 172.21.15.170:0/344015065 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55d8cb58ad60 0x55d8cb58d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:23.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.112+0000 7f63f0814800 1 -- 172.21.15.170:0/344015065 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb58d820 con 0x55d8cb58ad60 2024-09-12T17:28:23.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.112+0000 7f63ebfe0640 1 --2- 172.21.15.170:0/344015065 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55d8cb58ad60 0x55d8cb58d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:23.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.113+0000 7f63ebfe0640 1 --2- 172.21.15.170:0/344015065 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55d8cb58ad60 0x55d8cb58d150 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:23.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.113+0000 7f63ebfe0640 1 -- 172.21.15.170:0/344015065 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f63dc02e070 con 0x55d8cb58ad60 2024-09-12T17:28:23.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.113+0000 7f63f0814800 1 -- 172.21.15.170:0/344015065 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb589c00 con 0x55d8cb48c240 2024-09-12T17:28:23.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.113+0000 7f63ec7e1640 1 -- 172.21.15.170:0/344015065 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f63e400a4d0 con 0x55d8cb48c240 2024-09-12T17:28:23.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.113+0000 7f63f0814800 1 -- 172.21.15.170:0/344015065 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb58a0a0 con 0x55d8cb58ad60 2024-09-12T17:28:23.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.114+0000 7f63ebfe0640 1 -- 172.21.15.170:0/344015065 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f63dc02e070 con 0x55d8cb58ad60 2024-09-12T17:28:23.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.114+0000 7f63f0814800 1 Processor -- start 2024-09-12T17:28:23.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.114+0000 7f63f0814800 1 -- start start 2024-09-12T17:28:23.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.114+0000 7f63f0814800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8cb59c0b0 0x55d8cb59c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:23.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.114+0000 7f63f0814800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d8cb37ea00 con 0x55d8cb59c0b0 2024-09-12T17:28:23.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.114+0000 7f63ec7e1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8cb59c0b0 0x55d8cb59c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:23.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.114+0000 7f63ec7e1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8cb59c0b0 0x55d8cb59c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56250/0 (socket says 172.21.15.170:56250) 2024-09-12T17:28:23.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.114+0000 7f63ec7e1640 1 -- 172.21.15.170:0/1016225938 learned_addr learned my addr 172.21.15.170:0/1016225938 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:23.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.115+0000 7f63ec7e1640 1 -- 172.21.15.170:0/1016225938 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8cb59cb10 con 0x55d8cb59c0b0 2024-09-12T17:28:23.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.115+0000 7f63ec7e1640 1 --2- 172.21.15.170:0/1016225938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8cb59c0b0 0x55d8cb59c4d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x55d8cb582220 tx=0x7f63e40167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:23.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.115+0000 7f62d17fa640 1 -- 172.21.15.170:0/1016225938 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63e4013640 con 0x55d8cb59c0b0 2024-09-12T17:28:23.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.115+0000 7f62d17fa640 1 -- 172.21.15.170:0/1016225938 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63e40137e0 con 0x55d8cb59c0b0 2024-09-12T17:28:23.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.115+0000 7f63f0814800 1 -- 172.21.15.170:0/1016225938 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d8cb59d340 con 0x55d8cb59c0b0 2024-09-12T17:28:23.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.115+0000 7f62d17fa640 1 -- 172.21.15.170:0/1016225938 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63e4013ac0 con 0x55d8cb59c0b0 2024-09-12T17:28:23.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.115+0000 7f63f0814800 1 -- 172.21.15.170:0/1016225938 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8cb59d8e0 con 0x55d8cb59c0b0 2024-09-12T17:28:23.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.116+0000 7f62d17fa640 1 -- 172.21.15.170:0/1016225938 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f63e4011040 con 0x55d8cb59c0b0 2024-09-12T17:28:23.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.116+0000 7f62d17fa640 1 --2- 172.21.15.170:0/1016225938 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f62c403c730 0x7f62c403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:23.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.116+0000 7f62d17fa640 1 -- 172.21.15.170:0/1016225938 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f63e400e040 con 0x55d8cb59c0b0 2024-09-12T17:28:23.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.116+0000 7f63ebfe0640 1 --2- 172.21.15.170:0/1016225938 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f62c403c730 0x7f62c403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:23.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.116+0000 7f63f0814800 1 Processor -- start 2024-09-12T17:28:23.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.116+0000 7f63ebfe0640 1 --2- 172.21.15.170:0/1016225938 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f62c403c730 0x7f62c403ebf0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x55d8cb588ee0 tx=0x7f63dc01af30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:23.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.116+0000 7f63f0814800 1 -- start start 2024-09-12T17:28:23.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.117+0000 7f63f0814800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8cb5a8b70 0x55d8cb5a8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:23.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.117+0000 7f63f0814800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d8cb486760 con 0x55d8cb5a8b70 2024-09-12T17:28:23.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.117+0000 7f63ec7e1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8cb5a8b70 0x55d8cb5a8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:23.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.117+0000 7f63ec7e1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8cb5a8b70 0x55d8cb5a8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56266/0 (socket says 172.21.15.170:56266) 2024-09-12T17:28:23.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.117+0000 7f63ec7e1640 1 -- 172.21.15.170:0/3280094986 learned_addr learned my addr 172.21.15.170:0/3280094986 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:23.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.117+0000 7f63ec7e1640 1 -- 172.21.15.170:0/3280094986 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8cb5a9560 con 0x55d8cb5a8b70 2024-09-12T17:28:23.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.117+0000 7f63ec7e1640 1 --2- 172.21.15.170:0/3280094986 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8cb5a8b70 0x55d8cb5a8f70 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f63e4020000 tx=0x7f63e4013f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d84d9c5c3d75f69a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:23.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.117+0000 7f62caffd640 1 -- 172.21.15.170:0/3280094986 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63e4052070 con 0x55d8cb5a8b70 2024-09-12T17:28:23.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.117+0000 7f62caffd640 1 -- 172.21.15.170:0/3280094986 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63e404a020 con 0x55d8cb5a8b70 2024-09-12T17:28:23.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.117+0000 7f62caffd640 1 -- 172.21.15.170:0/3280094986 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63e4021440 con 0x55d8cb5a8b70 2024-09-12T17:28:23.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.118+0000 7f63f0814800 1 -- 172.21.15.170:0/3280094986 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8cb5a8b70 msgr2=0x55d8cb5a8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:23.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.118+0000 7f63f0814800 1 --2- 172.21.15.170:0/3280094986 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8cb5a8b70 0x55d8cb5a8f70 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f63e4020000 tx=0x7f63e4013f00 comp rx=0 tx=0).stop 2024-09-12T17:28:23.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.118+0000 7f63f0814800 1 -- 172.21.15.170:0/3280094986 shutdown_connections 2024-09-12T17:28:23.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.118+0000 7f63f0814800 1 --2- 172.21.15.170:0/3280094986 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8cb5a8b70 0x55d8cb5a8f70 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.118+0000 7f63f0814800 1 -- 172.21.15.170:0/3280094986 >> 172.21.15.170:0/3280094986 conn(0x55d8cb5a4f70 msgr2=0x55d8cb5a31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:23.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.118+0000 7f63f0814800 1 -- 172.21.15.170:0/3280094986 shutdown_connections 2024-09-12T17:28:23.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.118+0000 7f63f0814800 1 -- 172.21.15.170:0/3280094986 wait complete. 2024-09-12T17:28:23.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.118+0000 7f63f0814800 1 Processor -- start 2024-09-12T17:28:23.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.118+0000 7f63f0814800 1 -- start start 2024-09-12T17:28:23.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.118+0000 7f63f0814800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8cb5a8b70 0x55d8cb5b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:23.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.118+0000 7f63f0814800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d8cb5a9b50 con 0x55d8cb5a8b70 2024-09-12T17:28:23.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.119+0000 7f63ec7e1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8cb5a8b70 0x55d8cb5b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:23.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.119+0000 7f63ec7e1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8cb5a8b70 0x55d8cb5b00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56276/0 (socket says 172.21.15.170:56276) 2024-09-12T17:28:23.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.119+0000 7f63ec7e1640 1 -- 172.21.15.170:0/2675634638 learned_addr learned my addr 172.21.15.170:0/2675634638 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:23.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.119+0000 7f63ec7e1640 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8cb5b0650 con 0x55d8cb5a8b70 2024-09-12T17:28:23.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.119+0000 7f63ec7e1640 1 --2- 172.21.15.170:0/2675634638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8cb5a8b70 0x55d8cb5b00f0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f63e40147b0 tx=0x7f63e4053d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:23.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.119+0000 7f62c97fa640 1 -- 172.21.15.170:0/2675634638 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63e4039070 con 0x55d8cb5a8b70 2024-09-12T17:28:23.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.119+0000 7f62c97fa640 1 -- 172.21.15.170:0/2675634638 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63e401f710 con 0x55d8cb5a8b70 2024-09-12T17:28:23.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.119+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d8cb5b08e0 con 0x55d8cb5a8b70 2024-09-12T17:28:23.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.119+0000 7f62c97fa640 1 -- 172.21.15.170:0/2675634638 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63e401fdc0 con 0x55d8cb5a8b70 2024-09-12T17:28:23.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.120+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8cb5b08e0 con 0x55d8cb5a8b70 2024-09-12T17:28:23.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.120+0000 7f62c97fa640 1 -- 172.21.15.170:0/2675634638 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f63e403c070 con 0x55d8cb5a8b70 2024-09-12T17:28:23.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.120+0000 7f62c97fa640 1 --2- 172.21.15.170:0/2675634638 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f62b403c730 0x7f62b403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:23.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.121+0000 7f62c97fa640 1 -- 172.21.15.170:0/2675634638 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f63e404b070 con 0x55d8cb5a8b70 2024-09-12T17:28:23.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.121+0000 7f63ebfe0640 1 --2- 172.21.15.170:0/2675634638 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f62b403c730 0x7f62b403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:23.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.121+0000 7f63ebfe0640 1 --2- 172.21.15.170:0/2675634638 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f62b403c730 0x7f62b403ebf0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f63dc01afa0 tx=0x7f63dc047000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:23.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.121+0000 7f63f0814800 20 rados->read ofs=0 len=0 2024-09-12T17:28:23.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.121+0000 7f63f0814800 1 --2- 172.21.15.170:0/2675634638 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55d8cb5bb870 0x55d8cb5bdd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:23.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.121+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5be480 con 0x55d8cb5bb870 2024-09-12T17:28:23.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.121+0000 7f63e37df640 1 --2- 172.21.15.170:0/2675634638 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55d8cb5bb870 0x55d8cb5bdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:23.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.122+0000 7f63e37df640 1 --2- 172.21.15.170:0/2675634638 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55d8cb5bb870 0x55d8cb5bdd30 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:23.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.122+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f63d4057030 con 0x55d8cb5bb870 2024-09-12T17:28:23.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.122+0000 7f63f0814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:23.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.122+0000 7f63f0814800 20 realm 2024-09-12T17:28:23.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.122+0000 7f63f0814800 20 rados->read ofs=0 len=0 2024-09-12T17:28:23.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.122+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5be8b0 con 0x55d8cb5bb870 2024-09-12T17:28:23.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.122+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f63d4057030 con 0x55d8cb5bb870 2024-09-12T17:28:23.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.122+0000 7f63f0814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:23.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.122+0000 7f63f0814800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:23.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.122+0000 7f63f0814800 20 rados->read ofs=0 len=0 2024-09-12T17:28:23.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.122+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5bf180 con 0x55d8cb5bb870 2024-09-12T17:28:23.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.122+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f63d4057030 con 0x55d8cb5bb870 2024-09-12T17:28:23.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.122+0000 7f63f0814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:23.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.122+0000 7f63f0814800 20 rados->read ofs=0 len=0 2024-09-12T17:28:23.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.122+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5bf520 con 0x55d8cb5bb870 2024-09-12T17:28:23.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.123+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f63d4057030 con 0x55d8cb5bb870 2024-09-12T17:28:23.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.123+0000 7f63f0814800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:23.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.123+0000 7f63f0814800 20 rados->read ofs=0 len=0 2024-09-12T17:28:23.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.123+0000 7f63f0814800 1 --2- 172.21.15.170:0/2675634638 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55d8cb5c0280 0x55d8cb5c2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:23.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.123+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5c2c80 con 0x55d8cb5c0280 2024-09-12T17:28:23.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.123+0000 7f63ec7e1640 1 --2- 172.21.15.170:0/2675634638 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55d8cb5c0280 0x55d8cb5c2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:23.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.123+0000 7f63ec7e1640 1 --2- 172.21.15.170:0/2675634638 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55d8cb5c0280 0x55d8cb5c2670 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:23.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.123+0000 7f63ec7e1640 1 -- 172.21.15.170:0/2675634638 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f63e403b030 con 0x55d8cb5c0280 2024-09-12T17:28:23.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.123+0000 7f63f0814800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:23.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.123+0000 7f63f0814800 20 searching for the correct realm 2024-09-12T17:28:23.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.123+0000 7f63f0814800 1 --2- 172.21.15.170:0/2675634638 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55d8cb5c4c50 0x55d8cb5c7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:23.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.123+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5c7790 con 0x55d8cb5c4c50 2024-09-12T17:28:23.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.123+0000 7f63ebfe0640 1 --2- 172.21.15.170:0/2675634638 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55d8cb5c4c50 0x55d8cb5c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:23.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.124+0000 7f63ebfe0640 1 --2- 172.21.15.170:0/2675634638 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55d8cb5c4c50 0x55d8cb5c7110 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:23.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.124+0000 7f63ebfe0640 1 -- 172.21.15.170:0/2675634638 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63dc02e070 con 0x55d8cb5c4c50 2024-09-12T17:28:23.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.124+0000 7f63ebfe0640 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5c7790 con 0x55d8cb5c0280 2024-09-12T17:28:23.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.124+0000 7f63ec7e1640 1 -- 172.21.15.170:0/2675634638 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63e403b030 con 0x55d8cb5c0280 2024-09-12T17:28:23.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.124+0000 7f63ec7e1640 1 --2- 172.21.15.170:0/2675634638 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f63e403e060 0x7f63e40125f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:23.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.124+0000 7f63ec7e1640 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5c7790 con 0x7f63e403e060 2024-09-12T17:28:23.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.124+0000 7f63e37df640 1 --2- 172.21.15.170:0/2675634638 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f63e403e060 0x7f63e40125f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:23.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.125+0000 7f63e37df640 1 --2- 172.21.15.170:0/2675634638 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f63e403e060 0x7f63e40125f0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:23.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.125+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63d4057030 con 0x7f63e403e060 2024-09-12T17:28:23.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.125+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5c7790 con 0x55d8cb5bb870 2024-09-12T17:28:23.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.125+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63d4057030 con 0x55d8cb5bb870 2024-09-12T17:28:23.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.125+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5c7790 con 0x55d8cb5bb870 2024-09-12T17:28:23.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.125+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63d4057030 con 0x55d8cb5bb870 2024-09-12T17:28:23.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.125+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5c7790 con 0x7f63e403e060 2024-09-12T17:28:23.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.126+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63d4057030 con 0x7f63e403e060 2024-09-12T17:28:23.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.126+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5c7790 con 0x7f63e403e060 2024-09-12T17:28:23.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.126+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63d4057030 con 0x7f63e403e060 2024-09-12T17:28:23.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.126+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5c7790 con 0x55d8cb5c0280 2024-09-12T17:28:23.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.126+0000 7f63ec7e1640 1 -- 172.21.15.170:0/2675634638 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63e403b030 con 0x55d8cb5c0280 2024-09-12T17:28:23.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.126+0000 7f63ec7e1640 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5c7790 con 0x55d8cb5c4c50 2024-09-12T17:28:23.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.126+0000 7f63ebfe0640 1 -- 172.21.15.170:0/2675634638 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63dc02e070 con 0x55d8cb5c4c50 2024-09-12T17:28:23.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.126+0000 7f63ebfe0640 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5c7790 con 0x55d8cb5bb870 2024-09-12T17:28:23.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.127+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63d4057030 con 0x55d8cb5bb870 2024-09-12T17:28:23.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.127+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5c7790 con 0x7f63e403e060 2024-09-12T17:28:23.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.127+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63d4057030 con 0x7f63e403e060 2024-09-12T17:28:23.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.127+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5c7790 con 0x55d8cb5bb870 2024-09-12T17:28:23.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.127+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63d4057030 con 0x55d8cb5bb870 2024-09-12T17:28:23.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.127+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5c7790 con 0x55d8cb5c0280 2024-09-12T17:28:23.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.127+0000 7f63ec7e1640 1 -- 172.21.15.170:0/2675634638 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f63e403b030 con 0x55d8cb5c0280 2024-09-12T17:28:23.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.127+0000 7f63ec7e1640 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5c7790 con 0x55d8cb5c4c50 2024-09-12T17:28:23.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.127+0000 7f63ebfe0640 1 -- 172.21.15.170:0/2675634638 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63dc02e070 con 0x55d8cb5c4c50 2024-09-12T17:28:23.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.128+0000 7f63ebfe0640 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5c7790 con 0x55d8cb5c4c50 2024-09-12T17:28:23.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.128+0000 7f63ebfe0640 1 -- 172.21.15.170:0/2675634638 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63dc02e070 con 0x55d8cb5c4c50 2024-09-12T17:28:23.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.128+0000 7f63ebfe0640 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5c7790 con 0x55d8cb5c0280 2024-09-12T17:28:23.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.128+0000 7f63ec7e1640 1 -- 172.21.15.170:0/2675634638 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63e403b030 con 0x55d8cb5c0280 2024-09-12T17:28:23.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.128+0000 7f63ec7e1640 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5c7790 con 0x55d8cb5c4c50 2024-09-12T17:28:23.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.128+0000 7f63ebfe0640 1 -- 172.21.15.170:0/2675634638 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63dc02e070 con 0x55d8cb5c4c50 2024-09-12T17:28:23.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.128+0000 7f63ebfe0640 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5c7790 con 0x55d8cb5c4c50 2024-09-12T17:28:23.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.128+0000 7f63ebfe0640 1 -- 172.21.15.170:0/2675634638 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63dc02e070 con 0x55d8cb5c4c50 2024-09-12T17:28:23.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.128+0000 7f63ebfe0640 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5c7790 con 0x55d8cb5bb870 2024-09-12T17:28:23.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.128+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63d4057030 con 0x55d8cb5bb870 2024-09-12T17:28:23.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.128+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5c7790 con 0x55d8cb5bb870 2024-09-12T17:28:23.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.129+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f63d4057030 con 0x55d8cb5bb870 2024-09-12T17:28:23.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.129+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5c7790 con 0x7f63e403e060 2024-09-12T17:28:23.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.129+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63d4057030 con 0x7f63e403e060 2024-09-12T17:28:23.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.129+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5c7790 con 0x55d8cb5c4c50 2024-09-12T17:28:23.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.129+0000 7f63ebfe0640 1 -- 172.21.15.170:0/2675634638 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63dc02e070 con 0x55d8cb5c4c50 2024-09-12T17:28:23.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.129+0000 7f63ebfe0640 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5c7790 con 0x55d8cb5c0280 2024-09-12T17:28:23.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.130+0000 7f63ec7e1640 1 -- 172.21.15.170:0/2675634638 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63e403b030 con 0x55d8cb5c0280 2024-09-12T17:28:23.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.130+0000 7f63ec7e1640 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5c7790 con 0x55d8cb5bb870 2024-09-12T17:28:23.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.130+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63d4057030 con 0x55d8cb5bb870 2024-09-12T17:28:23.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.130+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5c7790 con 0x7f63e403e060 2024-09-12T17:28:23.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.130+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63d4057030 con 0x7f63e403e060 2024-09-12T17:28:23.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.130+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5c7790 con 0x55d8cb5c4c50 2024-09-12T17:28:23.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.130+0000 7f63ebfe0640 1 -- 172.21.15.170:0/2675634638 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63dc02e070 con 0x55d8cb5c4c50 2024-09-12T17:28:23.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.130+0000 7f63ebfe0640 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5c7790 con 0x7f63e403e060 2024-09-12T17:28:23.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.131+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63d4057030 con 0x7f63e403e060 2024-09-12T17:28:23.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.131+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5c7790 con 0x55d8cb5c0280 2024-09-12T17:28:23.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.131+0000 7f63ec7e1640 1 -- 172.21.15.170:0/2675634638 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63e4069040 con 0x55d8cb5c0280 2024-09-12T17:28:23.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.131+0000 7f63ec7e1640 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5c7790 con 0x55d8cb5c4c50 2024-09-12T17:28:23.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.131+0000 7f63ebfe0640 1 -- 172.21.15.170:0/2675634638 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63dc02e070 con 0x55d8cb5c4c50 2024-09-12T17:28:23.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.131+0000 7f63ebfe0640 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5c7790 con 0x7f63e403e060 2024-09-12T17:28:23.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.132+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63d4057030 con 0x7f63e403e060 2024-09-12T17:28:23.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.132+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5c7790 con 0x55d8cb5bb870 2024-09-12T17:28:23.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.132+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f63d4057030 con 0x55d8cb5bb870 2024-09-12T17:28:23.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.132+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5c7790 con 0x55d8cb5c0280 2024-09-12T17:28:23.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.132+0000 7f63ec7e1640 1 -- 172.21.15.170:0/2675634638 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(37 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f63e4069040 con 0x55d8cb5c0280 2024-09-12T17:28:23.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.132+0000 7f63f0814800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:23.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.132+0000 7f63f0814800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:23.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.132+0000 7f63f0814800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:23.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.132+0000 7f63f0814800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:23.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.132+0000 7f63f0814800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:23.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.132+0000 7f63f0814800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:23.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.132+0000 7f63f0814800 20 rados->read ofs=0 len=0 2024-09-12T17:28:23.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.132+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5c3640 con 0x55d8cb5bb870 2024-09-12T17:28:23.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.132+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f63d4057030 con 0x55d8cb5bb870 2024-09-12T17:28:23.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.132+0000 7f63f0814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:23.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.132+0000 7f63f0814800 20 rados->read ofs=0 len=0 2024-09-12T17:28:23.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.132+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5c3280 con 0x55d8cb5bb870 2024-09-12T17:28:23.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.133+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f63d4057030 con 0x55d8cb5bb870 2024-09-12T17:28:23.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.133+0000 7f63f0814800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:23.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.133+0000 7f63f0814800 20 rados->read ofs=0 len=0 2024-09-12T17:28:23.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.133+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5c3a80 con 0x55d8cb5c0280 2024-09-12T17:28:23.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.133+0000 7f63ec7e1640 1 -- 172.21.15.170:0/2675634638 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f63e4069040 con 0x55d8cb5c0280 2024-09-12T17:28:23.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.133+0000 7f63f0814800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:23.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.133+0000 7f63f0814800 20 zone default found 2024-09-12T17:28:23.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.133+0000 7f63f0814800 4 Realm: () 2024-09-12T17:28:23.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.133+0000 7f63f0814800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:23.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.133+0000 7f63f0814800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:23.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.133+0000 7f63f0814800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:23.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.133+0000 7f63f0814800 20 zonegroup default 2024-09-12T17:28:23.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.133+0000 7f63f0814800 20 rados->read ofs=0 len=0 2024-09-12T17:28:23.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.133+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5c80c0 con 0x7f63e403e060 2024-09-12T17:28:23.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.133+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f63d4057030 con 0x7f63e403e060 2024-09-12T17:28:23.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.133+0000 7f63f0814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:23.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.133+0000 7f63f0814800 20 rados->read ofs=0 len=0 2024-09-12T17:28:23.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.133+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5ca300 con 0x55d8cb5c4c50 2024-09-12T17:28:23.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.133+0000 7f63ebfe0640 1 -- 172.21.15.170:0/2675634638 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f63dc02e070 con 0x55d8cb5c4c50 2024-09-12T17:28:23.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.134+0000 7f63f0814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:23.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.134+0000 7f63f0814800 20 rados->read ofs=0 len=0 2024-09-12T17:28:23.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.134+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5ca6a0 con 0x55d8cb5c4c50 2024-09-12T17:28:23.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.134+0000 7f63ebfe0640 1 -- 172.21.15.170:0/2675634638 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f63dc02e070 con 0x55d8cb5c4c50 2024-09-12T17:28:23.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.134+0000 7f63f0814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:23.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.134+0000 7f63f0814800 20 started sync module instance, tier type = 2024-09-12T17:28:23.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.134+0000 7f63f0814800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:23.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.134+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5c9790 con 0x55d8cb5c0280 2024-09-12T17:28:23.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.135+0000 7f63ec7e1640 1 -- 172.21.15.170:0/2675634638 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(44 notify.0 [create] v31'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63e4069040 con 0x55d8cb5c0280 2024-09-12T17:28:23.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.135+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94389613140864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5caf60 con 0x55d8cb5c0280 2024-09-12T17:28:23.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.135+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5cb7b0 con 0x55d8cb5bb870 2024-09-12T17:28:23.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.136+0000 7f63ec7e1640 1 -- 172.21.15.170:0/2675634638 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94389613140864] v31'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63e4069040 con 0x55d8cb5c0280 2024-09-12T17:28:23.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.136+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v31'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63d4057030 con 0x55d8cb5bb870 2024-09-12T17:28:23.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.136+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94389613144752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5cb3e0 con 0x55d8cb5bb870 2024-09-12T17:28:23.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.136+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5cbef0 con 0x55d8cb5c4c50 2024-09-12T17:28:23.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.137+0000 7f63ebfe0640 1 -- 172.21.15.170:0/2675634638 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v31'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63dc02e070 con 0x55d8cb5c4c50 2024-09-12T17:28:23.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.137+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94389613148576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5cc790 con 0x55d8cb5c4c50 2024-09-12T17:28:23.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.137+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5cd290 con 0x55d8cb5c0280 2024-09-12T17:28:23.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.137+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94389613144752] v31'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63d4057030 con 0x55d8cb5bb870 2024-09-12T17:28:23.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.138+0000 7f63ebfe0640 1 -- 172.21.15.170:0/2675634638 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94389613148576] v31'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63dc02e070 con 0x55d8cb5c4c50 2024-09-12T17:28:23.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.138+0000 7f63ec7e1640 1 -- 172.21.15.170:0/2675634638 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(50 notify.3 [create] v31'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63e4069040 con 0x55d8cb5c0280 2024-09-12T17:28:23.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.138+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94389613150944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5caed0 con 0x55d8cb5c0280 2024-09-12T17:28:23.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.138+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5cdca0 con 0x55d8cb5bb870 2024-09-12T17:28:23.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.139+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v31'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63d4057030 con 0x55d8cb5bb870 2024-09-12T17:28:23.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.139+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94389613156336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5ce0c0 con 0x55d8cb5bb870 2024-09-12T17:28:23.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.139+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5ceb10 con 0x7f63e403e060 2024-09-12T17:28:23.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.139+0000 7f63ec7e1640 1 -- 172.21.15.170:0/2675634638 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94389613150944] v31'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63e4069040 con 0x55d8cb5c0280 2024-09-12T17:28:23.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.140+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94389613156336] v31'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63d4057030 con 0x55d8cb5bb870 2024-09-12T17:28:23.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.140+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(54 notify.5 [create] v31'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63d4057030 con 0x7f63e403e060 2024-09-12T17:28:23.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.140+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94389613159936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5cdc10 con 0x7f63e403e060 2024-09-12T17:28:23.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.140+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5cf3b0 con 0x7f63e403e060 2024-09-12T17:28:23.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.141+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(56 notify.6 [create] v31'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63d4057030 con 0x7f63e403e060 2024-09-12T17:28:23.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.141+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94389613162240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5cdc10 con 0x7f63e403e060 2024-09-12T17:28:23.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.141+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5cfeb0 con 0x7f63e403e060 2024-09-12T17:28:23.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.141+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94389613159936] v31'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63d4057030 con 0x7f63e403e060 2024-09-12T17:28:23.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.142+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(58 notify.7 [create] v31'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63d4057030 con 0x7f63e403e060 2024-09-12T17:28:23.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.142+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94389613164960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5cfe70 con 0x7f63e403e060 2024-09-12T17:28:23.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.142+0000 7f63f0814800 20 add_watcher() i=0 2024-09-12T17:28:23.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.142+0000 7f63f0814800 20 add_watcher() i=1 2024-09-12T17:28:23.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.142+0000 7f63f0814800 20 add_watcher() i=2 2024-09-12T17:28:23.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.142+0000 7f63f0814800 20 add_watcher() i=3 2024-09-12T17:28:23.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.142+0000 7f63f0814800 20 add_watcher() i=4 2024-09-12T17:28:23.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.142+0000 7f63f0814800 20 add_watcher() i=5 2024-09-12T17:28:23.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.143+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94389613162240] v31'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63d4057030 con 0x7f63e403e060 2024-09-12T17:28:23.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.143+0000 7f63f0814800 20 add_watcher() i=6 2024-09-12T17:28:23.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.143+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94389613164960] v31'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63d4057030 con 0x7f63e403e060 2024-09-12T17:28:23.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.143+0000 7f63f0814800 20 add_watcher() i=7 2024-09-12T17:28:23.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.143+0000 7f63f0814800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:23.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.143+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5cf320 con 0x55d8cb5bb870 2024-09-12T17:28:23.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.144+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f63d4057030 con 0x55d8cb5bb870 2024-09-12T17:28:23.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.144+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94389613153664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5cf320 con 0x55d8cb5bb870 2024-09-12T17:28:23.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.145+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94389613153664] v31'190 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f63d4057030 con 0x55d8cb5bb870 2024-09-12T17:28:23.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.145+0000 7f62a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:23.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.145+0000 7f63f0814800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:23.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.145+0000 7f63f0814800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:23.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.145+0000 7f63f0814800 5 note: GC not initialized 2024-09-12T17:28:23.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.145+0000 7f62a0fe1640 20 reqs_thread_entry: start 2024-09-12T17:28:23.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.145+0000 7f63f0814800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:23.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.145+0000 7f63f0814800 20 Filter name: none 2024-09-12T17:28:23.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.145+0000 7f621a7fc640 20 reqs_thread_entry: start 2024-09-12T17:28:23.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.145+0000 7f63f0814800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:28:23.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.145+0000 7f63f0814800 20 rados->read ofs=0 len=0 2024-09-12T17:28:23.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.145+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb605e00 con 0x55d8cb5bb870 2024-09-12T17:28:23.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.146+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 foo [call out=48b,read 0~403 out=403b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+526 (crc 0 0 0) 0x7f63d4057030 con 0x55d8cb5bb870 2024-09-12T17:28:23.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.146+0000 7f63f0814800 20 rados_obj.operate() r=0 bl.length=403 2024-09-12T17:28:23.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.146+0000 7f63f0814800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T17:28:23.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.146+0000 7f63f0814800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:28:23.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.146+0000 7f63f0814800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:23.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.146+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb60be00 con 0x55d8cb5bb870 2024-09-12T17:28:23.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.147+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v31'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f63d4057030 con 0x55d8cb5bb870 2024-09-12T17:28:23.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.147+0000 7f63f0814800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:28:23.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.147+0000 7f63f0814800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:28:23.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.147+0000 7f63f0814800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T17:28:23.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.147+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94389613410304 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb607720 con 0x55d8cb5bb870 2024-09-12T17:28:23.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.147+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== watch-notify(notify (1) cookie 94389613156336 notify 133143986193 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55d8cb3186b0 con 0x55d8cb5bb870 2024-09-12T17:28:23.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.147+0000 7f62caffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986193 cookie 94389613156336 notifier 4659 bl.length()=567 2024-09-12T17:28:23.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.147+0000 7f62caffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:28:23.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.147+0000 7f62caffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:28:23.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.147+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(64 notify.4 [notify cookie 94389613410304 out=8b] v0'0 uv183 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f63d4057030 con 0x55d8cb5bb870 2024-09-12T17:28:23.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.147+0000 7f62caffd640 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f62b0003ea0 con 0x55d8cb5bb870 2024-09-12T17:28:23.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.147+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63d4057030 con 0x55d8cb5bb870 2024-09-12T17:28:23.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.147+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== watch-notify(notify_complete (2) cookie 94389613410304 notify 133143986193 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f63d405bd60 con 0x55d8cb5bb870 2024-09-12T17:28:23.165 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T17:27:59.362376Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:27:59.362351Z","tags":[],"group_ids":[]} 2024-09-12T17:28:23.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.148+0000 7f62a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:23.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.148+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94389613153664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb603c60 con 0x55d8cb5bb870 2024-09-12T17:28:23.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.149+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94389613153664] v31'191 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f63d4089040 con 0x55d8cb5bb870 2024-09-12T17:28:23.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.149+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94389613140864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb603c60 con 0x55d8cb5c0280 2024-09-12T17:28:23.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.150+0000 7f63ec7e1640 1 -- 172.21.15.170:0/2675634638 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94389613140864] v31'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63e4069040 con 0x55d8cb5c0280 2024-09-12T17:28:23.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.150+0000 7f63f0814800 20 remove_watcher() i=0 2024-09-12T17:28:23.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.150+0000 7f63f0814800 2 removed watcher, disabling cache 2024-09-12T17:28:23.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.150+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94389613144752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb603c60 con 0x55d8cb5bb870 2024-09-12T17:28:23.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.151+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94389613144752] v31'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63d4089040 con 0x55d8cb5bb870 2024-09-12T17:28:23.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.151+0000 7f63f0814800 20 remove_watcher() i=1 2024-09-12T17:28:23.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.151+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94389613148576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb603c60 con 0x55d8cb5c4c50 2024-09-12T17:28:23.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.152+0000 7f63ebfe0640 1 -- 172.21.15.170:0/2675634638 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94389613148576] v31'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63dc02e070 con 0x55d8cb5c4c50 2024-09-12T17:28:23.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.152+0000 7f63f0814800 20 remove_watcher() i=2 2024-09-12T17:28:23.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.152+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94389613150944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5c9b80 con 0x55d8cb5c0280 2024-09-12T17:28:23.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.153+0000 7f63ec7e1640 1 -- 172.21.15.170:0/2675634638 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94389613150944] v31'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63e4069040 con 0x55d8cb5c0280 2024-09-12T17:28:23.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.153+0000 7f63f0814800 20 remove_watcher() i=3 2024-09-12T17:28:23.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.153+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94389613156336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5caab0 con 0x55d8cb5bb870 2024-09-12T17:28:23.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.154+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94389613156336] v31'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63d4089040 con 0x55d8cb5bb870 2024-09-12T17:28:23.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.154+0000 7f63f0814800 20 remove_watcher() i=4 2024-09-12T17:28:23.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.154+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94389613159936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5cc2e0 con 0x7f63e403e060 2024-09-12T17:28:23.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.155+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94389613159936] v31'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63d4089040 con 0x7f63e403e060 2024-09-12T17:28:23.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.155+0000 7f63f0814800 20 remove_watcher() i=5 2024-09-12T17:28:23.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.155+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94389613162240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5c9b80 con 0x7f63e403e060 2024-09-12T17:28:23.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.156+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94389613162240] v31'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63d4089040 con 0x7f63e403e060 2024-09-12T17:28:23.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.156+0000 7f63f0814800 20 remove_watcher() i=6 2024-09-12T17:28:23.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.156+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94389613164960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d8cb5caab0 con 0x7f63e403e060 2024-09-12T17:28:23.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.157+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94389613164960] v31'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63d4089040 con 0x7f63e403e060 2024-09-12T17:28:23.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.157+0000 7f63f0814800 20 remove_watcher() i=7 2024-09-12T17:28:23.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.157+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f63e403e060 msgr2=0x7f63e40125f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:23.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.157+0000 7f63f0814800 1 --2- 172.21.15.170:0/2675634638 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f63e403e060 0x7f63e40125f0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.157+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55d8cb5bb870 msgr2=0x55d8cb5bdd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:23.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.157+0000 7f63f0814800 1 --2- 172.21.15.170:0/2675634638 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55d8cb5bb870 0x55d8cb5bdd30 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.157+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55d8cb5c0280 msgr2=0x55d8cb5c2670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:23.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.157+0000 7f63f0814800 1 --2- 172.21.15.170:0/2675634638 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55d8cb5c0280 0x55d8cb5c2670 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.157+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55d8cb5c4c50 msgr2=0x55d8cb5c7110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:23.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.157+0000 7f63f0814800 1 --2- 172.21.15.170:0/2675634638 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55d8cb5c4c50 0x55d8cb5c7110 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.157+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f62b403c730 msgr2=0x7f62b403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:23.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.157+0000 7f63f0814800 1 --2- 172.21.15.170:0/2675634638 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f62b403c730 0x7f62b403ebf0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f63dc01afa0 tx=0x7f63dc047000 comp rx=0 tx=0).stop 2024-09-12T17:28:23.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.158+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8cb5a8b70 msgr2=0x55d8cb5b00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:23.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.158+0000 7f63f0814800 1 --2- 172.21.15.170:0/2675634638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8cb5a8b70 0x55d8cb5b00f0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f63e40147b0 tx=0x7f63e4053d30 comp rx=0 tx=0).stop 2024-09-12T17:28:23.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.158+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 reap_dead start 2024-09-12T17:28:23.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.158+0000 7f63e37df640 1 -- 172.21.15.170:0/2675634638 reap_dead start 2024-09-12T17:28:23.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.158+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 shutdown_connections 2024-09-12T17:28:23.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.158+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 >> 172.21.15.170:0/2675634638 conn(0x55d8cb5a4f70 msgr2=0x55d8cb5a3180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:23.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.158+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 shutdown_connections 2024-09-12T17:28:23.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.158+0000 7f63f0814800 1 -- 172.21.15.170:0/2675634638 wait complete. 2024-09-12T17:28:23.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.158+0000 7f63f0814800 1 -- 172.21.15.170:0/1016225938 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f62c403c730 msgr2=0x7f62c403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:23.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.158+0000 7f63f0814800 1 --2- 172.21.15.170:0/1016225938 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f62c403c730 0x7f62c403ebf0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x55d8cb588ee0 tx=0x7f63dc01af30 comp rx=0 tx=0).stop 2024-09-12T17:28:23.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.158+0000 7f63f0814800 1 -- 172.21.15.170:0/1016225938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8cb59c0b0 msgr2=0x55d8cb59c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:23.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.158+0000 7f63f0814800 1 --2- 172.21.15.170:0/1016225938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8cb59c0b0 0x55d8cb59c4d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x55d8cb582220 tx=0x7f63e40167b0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.158+0000 7f63f0814800 1 -- 172.21.15.170:0/1016225938 shutdown_connections 2024-09-12T17:28:23.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.158+0000 7f63f0814800 1 --2- 172.21.15.170:0/1016225938 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f62c403c730 0x7f62c403ebf0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.158+0000 7f63f0814800 1 --2- 172.21.15.170:0/1016225938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8cb59c0b0 0x55d8cb59c4d0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.158+0000 7f63f0814800 1 -- 172.21.15.170:0/1016225938 >> 172.21.15.170:0/1016225938 conn(0x55d8cb590460 msgr2=0x55d8cb590840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:23.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.158+0000 7f63f0814800 1 -- 172.21.15.170:0/1016225938 shutdown_connections 2024-09-12T17:28:23.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.158+0000 7f63f0814800 1 -- 172.21.15.170:0/1016225938 wait complete. 2024-09-12T17:28:23.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.158+0000 7f63f0814800 1 -- 172.21.15.170:0/344015065 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55d8cb48c240 msgr2=0x55d8cb588870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:23.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.158+0000 7f63f0814800 1 --2- 172.21.15.170:0/344015065 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55d8cb48c240 0x55d8cb588870 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.158+0000 7f63f0814800 1 -- 172.21.15.170:0/344015065 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55d8cb58ad60 msgr2=0x55d8cb58d150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:23.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.158+0000 7f63f0814800 1 --2- 172.21.15.170:0/344015065 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55d8cb58ad60 0x55d8cb58d150 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.158+0000 7f63f0814800 1 -- 172.21.15.170:0/344015065 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f62d403c730 msgr2=0x7f62d403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:23.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.158+0000 7f63f0814800 1 --2- 172.21.15.170:0/344015065 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f62d403c730 0x7f62d403ebf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f63d4057000 tx=0x7f63d4052000 comp rx=0 tx=0).stop 2024-09-12T17:28:23.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.158+0000 7f63f0814800 1 -- 172.21.15.170:0/344015065 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8cb488730 msgr2=0x55d8cb581220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:23.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.158+0000 7f63f0814800 1 --2- 172.21.15.170:0/344015065 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8cb488730 0x55d8cb581220 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x55d8cb4879f0 tx=0x7f63dc000ed0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.159+0000 7f63f0814800 1 -- 172.21.15.170:0/344015065 shutdown_connections 2024-09-12T17:28:23.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.159+0000 7f63f0814800 1 --2- 172.21.15.170:0/344015065 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55d8cb58ad60 0x55d8cb58d150 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.159+0000 7f63f0814800 1 --2- 172.21.15.170:0/344015065 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f62d403c730 0x7f62d403ebf0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.159+0000 7f63f0814800 1 --2- 172.21.15.170:0/344015065 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55d8cb48c240 0x55d8cb588870 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.159+0000 7f63f0814800 1 --2- 172.21.15.170:0/344015065 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d8cb488730 0x55d8cb581220 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.159+0000 7f63f0814800 1 -- 172.21.15.170:0/344015065 >> 172.21.15.170:0/344015065 conn(0x55d8cb4821d0 msgr2=0x55d8cb572b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:23.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.159+0000 7f63f0814800 1 -- 172.21.15.170:0/344015065 shutdown_connections 2024-09-12T17:28:23.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.159+0000 7f63f0814800 1 -- 172.21.15.170:0/344015065 wait complete. 2024-09-12T17:28:23.176 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T17:27:59.362376Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:27:59.362351Z', 'tags': [], 'group_ids': []} 2024-09-12T17:28:23.186 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:28:23.186 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-12T17:28:23.186 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-12T17:28:23.187 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-12T17:28:23.231 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:23.231 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:23.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.231+0000 7f7ef9e32800 1 Processor -- start 2024-09-12T17:28:23.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.231+0000 7f7ef9e32800 1 -- start start 2024-09-12T17:28:23.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.231+0000 7f7ef9e32800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5560f7058200 0x5560f705dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:23.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.231+0000 7f7ef9e32800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5560f6f01e40 con 0x5560f7056df0 2024-09-12T17:28:23.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.231+0000 7f7ef9e32800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x5560f6ecc680 con 0x5560f7058200 2024-09-12T17:28:23.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.231+0000 7f7ef4952640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5560f7058200 0x5560f705dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:23.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.231+0000 7f7ef5153640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x5560f7056df0 0x5560f7057af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:47728/0 (socket says 172.21.15.170:47728) 2024-09-12T17:28:23.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.231+0000 7f7ef5153640 1 -- 172.21.15.170:0/2184471318 learned_addr learned my addr 172.21.15.170:0/2184471318 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:28:23.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.231+0000 7f7ef4952640 1 -- 172.21.15.170:0/2184471318 >> v1:172.21.15.47:6789/0 conn(0x5560f7056df0 legacy=0x5560f7057af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:23.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.231+0000 7f7ef4952640 1 -- 172.21.15.170:0/2184471318 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560f6ee86b0 con 0x5560f7058200 2024-09-12T17:28:23.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.233+0000 7f7ef4952640 1 --2- 172.21.15.170:0/2184471318 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5560f7058200 0x5560f705dda0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f7ee000a470 tx=0x7f7ee0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98a27629416fcc9b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:23.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.233+0000 7f7eeffff640 1 -- 172.21.15.170:0/2184471318 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ee0053570 con 0x5560f7058200 2024-09-12T17:28:23.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.234+0000 7f7eeffff640 1 -- 172.21.15.170:0/2184471318 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ee0058070 con 0x5560f7058200 2024-09-12T17:28:23.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.234+0000 7f7eeffff640 1 -- 172.21.15.170:0/2184471318 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ee0053880 con 0x5560f7058200 2024-09-12T17:28:23.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.234+0000 7f7ef9e32800 1 -- 172.21.15.170:0/2184471318 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5560f7058200 msgr2=0x5560f705dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:23.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.234+0000 7f7ef9e32800 1 --2- 172.21.15.170:0/2184471318 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5560f7058200 0x5560f705dda0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f7ee000a470 tx=0x7f7ee0045a20 comp rx=0 tx=0).stop 2024-09-12T17:28:23.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.234+0000 7f7ef9e32800 1 -- 172.21.15.170:0/2184471318 shutdown_connections 2024-09-12T17:28:23.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.234+0000 7f7ef9e32800 1 --2- 172.21.15.170:0/2184471318 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5560f7058200 0x5560f705dda0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.234+0000 7f7ef9e32800 1 -- 172.21.15.170:0/2184471318 >> 172.21.15.170:0/2184471318 conn(0x5560f70521c0 msgr2=0x5560f7054620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:23.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.234+0000 7f7ef9e32800 1 -- 172.21.15.170:0/2184471318 shutdown_connections 2024-09-12T17:28:23.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.234+0000 7f7ef9e32800 1 -- 172.21.15.170:0/2184471318 wait complete. 2024-09-12T17:28:23.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.248+0000 7f7ef9e32800 1 Processor -- start 2024-09-12T17:28:23.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.248+0000 7f7ef9e32800 1 -- start start 2024-09-12T17:28:23.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.248+0000 7f7ef9e32800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5560f7056df0 0x5560f7145450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:23.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.248+0000 7f7ef9e32800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5560f6ef0dd0 con 0x5560f7056df0 2024-09-12T17:28:23.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.248+0000 7f7ef5153640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5560f7056df0 0x5560f7145450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:23.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.248+0000 7f7ef5153640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5560f7056df0 0x5560f7145450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56296/0 (socket says 172.21.15.170:56296) 2024-09-12T17:28:23.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.248+0000 7f7ef5153640 1 -- 172.21.15.170:0/3284720027 learned_addr learned my addr 172.21.15.170:0/3284720027 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:23.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.249+0000 7f7ef5153640 1 -- 172.21.15.170:0/3284720027 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560f6f09e10 con 0x5560f7056df0 2024-09-12T17:28:23.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.249+0000 7f7ef5153640 1 --2- 172.21.15.170:0/3284720027 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5560f7056df0 0x5560f7145450 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8001800 tx=0x7f7ee8001cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1031323fdaef98c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:23.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.249+0000 7f7de3606640 1 -- 172.21.15.170:0/3284720027 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ee8004520 con 0x5560f7056df0 2024-09-12T17:28:23.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.249+0000 7f7de3606640 1 -- 172.21.15.170:0/3284720027 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ee80046c0 con 0x5560f7056df0 2024-09-12T17:28:23.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.249+0000 7f7de3606640 1 -- 172.21.15.170:0/3284720027 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ee80049e0 con 0x5560f7056df0 2024-09-12T17:28:23.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.250+0000 7f7ef9e32800 1 -- 172.21.15.170:0/3284720027 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5560f7056df0 msgr2=0x5560f7145450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:23.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.250+0000 7f7ef9e32800 1 --2- 172.21.15.170:0/3284720027 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5560f7056df0 0x5560f7145450 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8001800 tx=0x7f7ee8001cc0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.250+0000 7f7ef9e32800 1 -- 172.21.15.170:0/3284720027 shutdown_connections 2024-09-12T17:28:23.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.250+0000 7f7ef9e32800 1 --2- 172.21.15.170:0/3284720027 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5560f7056df0 0x5560f7145450 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.250+0000 7f7ef9e32800 1 -- 172.21.15.170:0/3284720027 >> 172.21.15.170:0/3284720027 conn(0x5560f70521c0 msgr2=0x5560f7140dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:23.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.250+0000 7f7ef9e32800 1 -- 172.21.15.170:0/3284720027 shutdown_connections 2024-09-12T17:28:23.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.250+0000 7f7ef9e32800 1 -- 172.21.15.170:0/3284720027 wait complete. 2024-09-12T17:28:23.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.250+0000 7f7ef9e32800 1 Processor -- start 2024-09-12T17:28:23.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.250+0000 7f7ef9e32800 1 -- start start 2024-09-12T17:28:23.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.250+0000 7f7ef9e32800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5560f7056df0 0x5560f7151210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:23.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.250+0000 7f7ef9e32800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5560f70588c0 con 0x5560f7056df0 2024-09-12T17:28:23.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.250+0000 7f7ef5153640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5560f7056df0 0x5560f7151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:23.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.250+0000 7f7ef5153640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5560f7056df0 0x5560f7151210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56298/0 (socket says 172.21.15.170:56298) 2024-09-12T17:28:23.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.250+0000 7f7ef5153640 1 -- 172.21.15.170:0/2217440046 learned_addr learned my addr 172.21.15.170:0/2217440046 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:23.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.251+0000 7f7ef5153640 1 -- 172.21.15.170:0/2217440046 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560f7151770 con 0x5560f7056df0 2024-09-12T17:28:23.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.251+0000 7f7ef5153640 1 --2- 172.21.15.170:0/2217440046 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5560f7056df0 0x5560f7151210 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8000f80 tx=0x7f7ee8001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:23.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.251+0000 7f7de1e03640 1 -- 172.21.15.170:0/2217440046 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ee8022020 con 0x5560f7056df0 2024-09-12T17:28:23.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.251+0000 7f7de1e03640 1 -- 172.21.15.170:0/2217440046 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ee8014890 con 0x5560f7056df0 2024-09-12T17:28:23.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.251+0000 7f7ef9e32800 1 -- 172.21.15.170:0/2217440046 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5560f7151a00 con 0x5560f7056df0 2024-09-12T17:28:23.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.251+0000 7f7de1e03640 1 -- 172.21.15.170:0/2217440046 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ee8014bb0 con 0x5560f7056df0 2024-09-12T17:28:23.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.251+0000 7f7ef9e32800 1 -- 172.21.15.170:0/2217440046 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560f7152400 con 0x5560f7056df0 2024-09-12T17:28:23.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.252+0000 7f7de1e03640 1 -- 172.21.15.170:0/2217440046 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f7ee8025020 con 0x5560f7056df0 2024-09-12T17:28:23.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.252+0000 7f7de1e03640 1 --2- 172.21.15.170:0/2217440046 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f7ddc03c780 0x7f7ddc03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:23.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.252+0000 7f7de1e03640 1 -- 172.21.15.170:0/2217440046 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f7ee8018030 con 0x5560f7056df0 2024-09-12T17:28:23.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.252+0000 7f7ef4952640 1 --2- 172.21.15.170:0/2217440046 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f7ddc03c780 0x7f7ddc03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:23.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.252+0000 7f7ef9e32800 1 --2- 172.21.15.170:0/2217440046 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5560f7058200 0x5560f7158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:23.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.252+0000 7f7ef9e32800 1 -- 172.21.15.170:0/2217440046 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5560f7158da0 con 0x5560f7058200 2024-09-12T17:28:23.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.253+0000 7f7ef5954640 1 --2- 172.21.15.170:0/2217440046 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5560f7058200 0x5560f7158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:23.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.253+0000 7f7ef4952640 1 --2- 172.21.15.170:0/2217440046 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f7ddc03c780 0x7f7ddc03ec40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0057000 tx=0x7f7ee0052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:23.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.253+0000 7f7ef5954640 1 --2- 172.21.15.170:0/2217440046 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5560f7058200 0x5560f7158860 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:23.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.253+0000 7f7ef5954640 1 -- 172.21.15.170:0/2217440046 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7ef00083e0 con 0x5560f7058200 2024-09-12T17:28:23.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.253+0000 7f7ef9e32800 1 -- 172.21.15.170:0/2217440046 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5560f7159140 con 0x5560f7058200 2024-09-12T17:28:23.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.253+0000 7f7ef5954640 1 -- 172.21.15.170:0/2217440046 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7ef00083e0 con 0x5560f7058200 2024-09-12T17:28:23.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.253+0000 7f7ef9e32800 1 --2- 172.21.15.170:0/2217440046 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5560f715ac40 0x5560f715d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:23.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.253+0000 7f7ef9e32800 1 -- 172.21.15.170:0/2217440046 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5560f715d850 con 0x5560f715ac40 2024-09-12T17:28:23.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.254+0000 7f7ef5153640 1 --2- 172.21.15.170:0/2217440046 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5560f715ac40 0x5560f715d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:23.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.254+0000 7f7ef5153640 1 --2- 172.21.15.170:0/2217440046 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5560f715ac40 0x5560f715d0c0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:23.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.254+0000 7f7ef5153640 1 -- 172.21.15.170:0/2217440046 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7ee801b070 con 0x5560f715ac40 2024-09-12T17:28:23.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.254+0000 7f7ef9e32800 1 -- 172.21.15.170:0/2217440046 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5560f7159990 con 0x5560f7058200 2024-09-12T17:28:23.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.254+0000 7f7ef5954640 1 -- 172.21.15.170:0/2217440046 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7ef00083e0 con 0x5560f7058200 2024-09-12T17:28:23.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.254+0000 7f7ef9e32800 1 -- 172.21.15.170:0/2217440046 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5560f7159de0 con 0x5560f715ac40 2024-09-12T17:28:23.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.255+0000 7f7ef5153640 1 -- 172.21.15.170:0/2217440046 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7ee801b070 con 0x5560f715ac40 2024-09-12T17:28:23.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.255+0000 7f7ef9e32800 1 Processor -- start 2024-09-12T17:28:23.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.255+0000 7f7ef9e32800 1 -- start start 2024-09-12T17:28:23.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.255+0000 7f7ef9e32800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5560f716c160 0x5560f716c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:23.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.255+0000 7f7ef9e32800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5560f6f4ea00 con 0x5560f716c160 2024-09-12T17:28:23.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.256+0000 7f7ef5954640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5560f716c160 0x5560f716c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:23.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.256+0000 7f7ef5954640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5560f716c160 0x5560f716c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56306/0 (socket says 172.21.15.170:56306) 2024-09-12T17:28:23.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.256+0000 7f7ef5954640 1 -- 172.21.15.170:0/4069027660 learned_addr learned my addr 172.21.15.170:0/4069027660 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:23.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.256+0000 7f7ef5954640 1 -- 172.21.15.170:0/4069027660 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560f716cbc0 con 0x5560f716c160 2024-09-12T17:28:23.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.256+0000 7f7ef5954640 1 --2- 172.21.15.170:0/4069027660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5560f716c160 0x5560f716c580 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x5560f7152210 tx=0x7f7ef000bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:23.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.256+0000 7f7ddaffd640 1 -- 172.21.15.170:0/4069027660 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ef001c020 con 0x5560f716c160 2024-09-12T17:28:23.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.256+0000 7f7ddaffd640 1 -- 172.21.15.170:0/4069027660 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ef0007c90 con 0x5560f716c160 2024-09-12T17:28:23.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.256+0000 7f7ef9e32800 1 -- 172.21.15.170:0/4069027660 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5560f716d3f0 con 0x5560f716c160 2024-09-12T17:28:23.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.256+0000 7f7ef9e32800 1 -- 172.21.15.170:0/4069027660 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560f716d990 con 0x5560f716c160 2024-09-12T17:28:23.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.257+0000 7f7ddaffd640 1 -- 172.21.15.170:0/4069027660 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ef0018440 con 0x5560f716c160 2024-09-12T17:28:23.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.257+0000 7f7ddaffd640 1 -- 172.21.15.170:0/4069027660 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f7ef001f020 con 0x5560f716c160 2024-09-12T17:28:23.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.257+0000 7f7ddaffd640 1 --2- 172.21.15.170:0/4069027660 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f7dcc03c730 0x7f7dcc03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:23.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.257+0000 7f7ddaffd640 1 -- 172.21.15.170:0/4069027660 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f7ef0054ec0 con 0x5560f716c160 2024-09-12T17:28:23.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.257+0000 7f7ef5153640 1 --2- 172.21.15.170:0/4069027660 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f7dcc03c730 0x7f7dcc03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:23.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.258+0000 7f7ef9e32800 1 Processor -- start 2024-09-12T17:28:23.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.258+0000 7f7ef9e32800 1 -- start start 2024-09-12T17:28:23.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.258+0000 7f7ef5153640 1 --2- 172.21.15.170:0/4069027660 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f7dcc03c730 0x7f7dcc03ebf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x5560f7159d30 tx=0x7f7ee8019f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:23.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.258+0000 7f7ef9e32800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5560f7178c40 0x5560f7179020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:23.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.258+0000 7f7ef9e32800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5560f7145ca0 con 0x5560f7178c40 2024-09-12T17:28:23.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.258+0000 7f7ef5954640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5560f7178c40 0x5560f7179020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:23.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.258+0000 7f7ef5954640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5560f7178c40 0x5560f7179020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56322/0 (socket says 172.21.15.170:56322) 2024-09-12T17:28:23.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.258+0000 7f7ef5954640 1 -- 172.21.15.170:0/3791521677 learned_addr learned my addr 172.21.15.170:0/3791521677 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:23.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.258+0000 7f7ef5954640 1 -- 172.21.15.170:0/3791521677 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560f7179610 con 0x5560f7178c40 2024-09-12T17:28:23.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.258+0000 7f7ef5954640 1 --2- 172.21.15.170:0/3791521677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5560f7178c40 0x5560f7179020 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f7ef00532d0 tx=0x7f7ef00158b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b09f8b7bb281468f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:23.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.259+0000 7f7dd8ff9640 1 -- 172.21.15.170:0/3791521677 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ef0050020 con 0x5560f7178c40 2024-09-12T17:28:23.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.259+0000 7f7dd8ff9640 1 -- 172.21.15.170:0/3791521677 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ef0015e70 con 0x5560f7178c40 2024-09-12T17:28:23.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.259+0000 7f7dd8ff9640 1 -- 172.21.15.170:0/3791521677 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ef00174d0 con 0x5560f7178c40 2024-09-12T17:28:23.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.259+0000 7f7ef9e32800 1 -- 172.21.15.170:0/3791521677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5560f7178c40 msgr2=0x5560f7179020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:23.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.259+0000 7f7ef9e32800 1 --2- 172.21.15.170:0/3791521677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5560f7178c40 0x5560f7179020 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f7ef00532d0 tx=0x7f7ef00158b0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.259+0000 7f7ef9e32800 1 -- 172.21.15.170:0/3791521677 shutdown_connections 2024-09-12T17:28:23.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.259+0000 7f7ef9e32800 1 --2- 172.21.15.170:0/3791521677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5560f7178c40 0x5560f7179020 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.259+0000 7f7ef9e32800 1 -- 172.21.15.170:0/3791521677 >> 172.21.15.170:0/3791521677 conn(0x5560f7175040 msgr2=0x5560f7173280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:23.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.259+0000 7f7ef9e32800 1 -- 172.21.15.170:0/3791521677 shutdown_connections 2024-09-12T17:28:23.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.259+0000 7f7ef9e32800 1 -- 172.21.15.170:0/3791521677 wait complete. 2024-09-12T17:28:23.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.259+0000 7f7ef9e32800 1 Processor -- start 2024-09-12T17:28:23.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.259+0000 7f7ef9e32800 1 -- start start 2024-09-12T17:28:23.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.260+0000 7f7ef9e32800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5560f7178c40 0x5560f7180190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:23.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.260+0000 7f7ef9e32800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5560f7179c50 con 0x5560f7178c40 2024-09-12T17:28:23.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.260+0000 7f7ef5954640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5560f7178c40 0x5560f7180190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:23.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.260+0000 7f7ef5954640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5560f7178c40 0x5560f7180190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:56324/0 (socket says 172.21.15.170:56324) 2024-09-12T17:28:23.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.260+0000 7f7ef5954640 1 -- 172.21.15.170:0/101745981 learned_addr learned my addr 172.21.15.170:0/101745981 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:23.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.260+0000 7f7ef5954640 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560f71806f0 con 0x5560f7178c40 2024-09-12T17:28:23.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.260+0000 7f7ef5954640 1 --2- 172.21.15.170:0/101745981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5560f7178c40 0x5560f7180190 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f7ef00154a0 tx=0x7f7ef0053230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:23.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.260+0000 7f7dcaffd640 1 -- 172.21.15.170:0/101745981 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ef004a040 con 0x5560f7178c40 2024-09-12T17:28:23.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.260+0000 7f7dcaffd640 1 -- 172.21.15.170:0/101745981 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ef0016c50 con 0x5560f7178c40 2024-09-12T17:28:23.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.260+0000 7f7dcaffd640 1 -- 172.21.15.170:0/101745981 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ef000b030 con 0x5560f7178c40 2024-09-12T17:28:23.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.260+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5560f7180980 con 0x5560f7178c40 2024-09-12T17:28:23.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.261+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560f7181300 con 0x5560f7178c40 2024-09-12T17:28:23.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.261+0000 7f7dcaffd640 1 -- 172.21.15.170:0/101745981 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f7ef0033020 con 0x5560f7178c40 2024-09-12T17:28:23.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.261+0000 7f7dcaffd640 1 --2- 172.21.15.170:0/101745981 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f7dc003c780 0x7f7dc003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:23.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.261+0000 7f7dcaffd640 1 -- 172.21.15.170:0/101745981 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f7ef0031020 con 0x5560f7178c40 2024-09-12T17:28:23.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.262+0000 7f7ef5153640 1 --2- 172.21.15.170:0/101745981 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f7dc003c780 0x7f7dc003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:23.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.262+0000 7f7ef5153640 1 --2- 172.21.15.170:0/101745981 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f7dc003c780 0x7f7dc003ec40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8051fa0 tx=0x7f7ee8030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:23.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.262+0000 7f7ef9e32800 20 rados->read ofs=0 len=0 2024-09-12T17:28:23.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.262+0000 7f7ef9e32800 1 --2- 172.21.15.170:0/101745981 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5560f718bac0 0x5560f718df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:23.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.262+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5560f718e6d0 con 0x5560f718bac0 2024-09-12T17:28:23.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.262+0000 7f7ef4952640 1 --2- 172.21.15.170:0/101745981 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5560f718bac0 0x5560f718df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:23.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.263+0000 7f7ef4952640 1 --2- 172.21.15.170:0/101745981 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5560f718bac0 0x5560f718df80 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:23.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.263+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7ee0051070 con 0x5560f718bac0 2024-09-12T17:28:23.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.263+0000 7f7ef9e32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:23.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.263+0000 7f7ef9e32800 20 realm 2024-09-12T17:28:23.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.263+0000 7f7ef9e32800 20 rados->read ofs=0 len=0 2024-09-12T17:28:23.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.263+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5560f718eb00 con 0x5560f718bac0 2024-09-12T17:28:23.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.263+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7ee0051070 con 0x5560f718bac0 2024-09-12T17:28:23.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.263+0000 7f7ef9e32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:23.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.263+0000 7f7ef9e32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:23.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.263+0000 7f7ef9e32800 20 rados->read ofs=0 len=0 2024-09-12T17:28:23.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.263+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5560f718f3d0 con 0x5560f718bac0 2024-09-12T17:28:23.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.263+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7ee0051070 con 0x5560f718bac0 2024-09-12T17:28:23.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.263+0000 7f7ef9e32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:23.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.263+0000 7f7ef9e32800 20 rados->read ofs=0 len=0 2024-09-12T17:28:23.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.263+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5560f718f770 con 0x5560f718bac0 2024-09-12T17:28:23.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.264+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7ee0051070 con 0x5560f718bac0 2024-09-12T17:28:23.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.264+0000 7f7ef9e32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:23.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.264+0000 7f7ef9e32800 20 rados->read ofs=0 len=0 2024-09-12T17:28:23.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.264+0000 7f7ef9e32800 1 --2- 172.21.15.170:0/101745981 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5560f71904d0 0x5560f71928c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:23.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.264+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5560f7192ed0 con 0x5560f71904d0 2024-09-12T17:28:23.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.264+0000 7f7ef5954640 1 --2- 172.21.15.170:0/101745981 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5560f71904d0 0x5560f71928c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:23.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.264+0000 7f7ef5954640 1 --2- 172.21.15.170:0/101745981 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5560f71904d0 0x5560f71928c0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:23.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.264+0000 7f7ef5954640 1 -- 172.21.15.170:0/101745981 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7ef0059040 con 0x5560f71904d0 2024-09-12T17:28:23.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.264+0000 7f7ef9e32800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:23.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.264+0000 7f7ef9e32800 20 searching for the correct realm 2024-09-12T17:28:23.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.264+0000 7f7ef9e32800 1 --2- 172.21.15.170:0/101745981 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5560f7194e80 0x5560f7197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:23.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.264+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5560f71979c0 con 0x5560f7194e80 2024-09-12T17:28:23.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.264+0000 7f7ef5153640 1 --2- 172.21.15.170:0/101745981 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5560f7194e80 0x5560f7197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:23.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.265+0000 7f7ef5153640 1 --2- 172.21.15.170:0/101745981 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5560f7194e80 0x5560f7197340 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:23.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.265+0000 7f7ef5153640 1 -- 172.21.15.170:0/101745981 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ee801b070 con 0x5560f7194e80 2024-09-12T17:28:23.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.265+0000 7f7ef5153640 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5560f71979c0 con 0x5560f71904d0 2024-09-12T17:28:23.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.265+0000 7f7ef5954640 1 -- 172.21.15.170:0/101745981 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ef0059040 con 0x5560f71904d0 2024-09-12T17:28:23.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.265+0000 7f7ef5954640 1 --2- 172.21.15.170:0/101745981 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f7ef005c040 0x7f7ef0053640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:23.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.265+0000 7f7ef5954640 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5560f71979c0 con 0x7f7ef005c040 2024-09-12T17:28:23.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.266+0000 7f7ef4952640 1 --2- 172.21.15.170:0/101745981 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f7ef005c040 0x7f7ef0053640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:23.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.266+0000 7f7ef4952640 1 --2- 172.21.15.170:0/101745981 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f7ef005c040 0x7f7ef0053640 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:23.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.266+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ee0051070 con 0x7f7ef005c040 2024-09-12T17:28:23.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.266+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5560f71979c0 con 0x5560f718bac0 2024-09-12T17:28:23.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.266+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ee0051070 con 0x5560f718bac0 2024-09-12T17:28:23.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.266+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5560f71979c0 con 0x5560f718bac0 2024-09-12T17:28:23.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.267+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ee0051070 con 0x5560f718bac0 2024-09-12T17:28:23.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.267+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5560f71979c0 con 0x7f7ef005c040 2024-09-12T17:28:23.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.267+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ee0051070 con 0x7f7ef005c040 2024-09-12T17:28:23.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.267+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5560f71979c0 con 0x7f7ef005c040 2024-09-12T17:28:23.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.267+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ee0051070 con 0x7f7ef005c040 2024-09-12T17:28:23.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.267+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5560f71979c0 con 0x5560f71904d0 2024-09-12T17:28:23.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.267+0000 7f7ef5954640 1 -- 172.21.15.170:0/101745981 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ef0059040 con 0x5560f71904d0 2024-09-12T17:28:23.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.267+0000 7f7ef5954640 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5560f71979c0 con 0x5560f7194e80 2024-09-12T17:28:23.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.267+0000 7f7ef5153640 1 -- 172.21.15.170:0/101745981 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ee801b070 con 0x5560f7194e80 2024-09-12T17:28:23.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.267+0000 7f7ef5153640 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5560f71979c0 con 0x5560f718bac0 2024-09-12T17:28:23.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.268+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ee0051070 con 0x5560f718bac0 2024-09-12T17:28:23.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.268+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5560f71979c0 con 0x7f7ef005c040 2024-09-12T17:28:23.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.268+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ee0051070 con 0x7f7ef005c040 2024-09-12T17:28:23.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.268+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5560f71979c0 con 0x5560f718bac0 2024-09-12T17:28:23.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.268+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ee0051070 con 0x5560f718bac0 2024-09-12T17:28:23.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.268+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5560f71979c0 con 0x5560f71904d0 2024-09-12T17:28:23.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.269+0000 7f7ef5954640 1 -- 172.21.15.170:0/101745981 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f7ef0059040 con 0x5560f71904d0 2024-09-12T17:28:23.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.269+0000 7f7ef5954640 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5560f71979c0 con 0x5560f7194e80 2024-09-12T17:28:23.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.269+0000 7f7ef5153640 1 -- 172.21.15.170:0/101745981 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ee801b070 con 0x5560f7194e80 2024-09-12T17:28:23.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.269+0000 7f7ef5153640 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5560f71979c0 con 0x5560f7194e80 2024-09-12T17:28:23.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.269+0000 7f7ef5153640 1 -- 172.21.15.170:0/101745981 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ee801b070 con 0x5560f7194e80 2024-09-12T17:28:23.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.269+0000 7f7ef5153640 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5560f71979c0 con 0x5560f71904d0 2024-09-12T17:28:23.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.269+0000 7f7ef5954640 1 -- 172.21.15.170:0/101745981 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ef0059040 con 0x5560f71904d0 2024-09-12T17:28:23.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.269+0000 7f7ef5954640 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5560f71979c0 con 0x5560f7194e80 2024-09-12T17:28:23.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.270+0000 7f7ef5153640 1 -- 172.21.15.170:0/101745981 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ee801b070 con 0x5560f7194e80 2024-09-12T17:28:23.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.270+0000 7f7ef5153640 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5560f71979c0 con 0x5560f7194e80 2024-09-12T17:28:23.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.270+0000 7f7ef5153640 1 -- 172.21.15.170:0/101745981 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ee801b070 con 0x5560f7194e80 2024-09-12T17:28:23.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.270+0000 7f7ef5153640 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5560f71979c0 con 0x5560f718bac0 2024-09-12T17:28:23.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.270+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ee0051070 con 0x5560f718bac0 2024-09-12T17:28:23.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.270+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5560f71979c0 con 0x5560f718bac0 2024-09-12T17:28:23.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.270+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7ee0051070 con 0x5560f718bac0 2024-09-12T17:28:23.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.270+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5560f71979c0 con 0x7f7ef005c040 2024-09-12T17:28:23.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.271+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ee0051070 con 0x7f7ef005c040 2024-09-12T17:28:23.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.271+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5560f71979c0 con 0x5560f7194e80 2024-09-12T17:28:23.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.271+0000 7f7ef5153640 1 -- 172.21.15.170:0/101745981 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ee801b070 con 0x5560f7194e80 2024-09-12T17:28:23.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.271+0000 7f7ef5153640 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5560f71979c0 con 0x5560f71904d0 2024-09-12T17:28:23.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.271+0000 7f7ef5954640 1 -- 172.21.15.170:0/101745981 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ef0059040 con 0x5560f71904d0 2024-09-12T17:28:23.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.271+0000 7f7ef5954640 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5560f71979c0 con 0x5560f718bac0 2024-09-12T17:28:23.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.272+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ee0051070 con 0x5560f718bac0 2024-09-12T17:28:23.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.272+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5560f71979c0 con 0x7f7ef005c040 2024-09-12T17:28:23.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.272+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ee0051070 con 0x7f7ef005c040 2024-09-12T17:28:23.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.272+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5560f71979c0 con 0x5560f7194e80 2024-09-12T17:28:23.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.272+0000 7f7ef5153640 1 -- 172.21.15.170:0/101745981 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ee801b070 con 0x5560f7194e80 2024-09-12T17:28:23.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.272+0000 7f7ef5153640 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5560f71979c0 con 0x7f7ef005c040 2024-09-12T17:28:23.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.272+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ee0051070 con 0x7f7ef005c040 2024-09-12T17:28:23.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.272+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5560f71979c0 con 0x5560f71904d0 2024-09-12T17:28:23.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.273+0000 7f7ef5954640 1 -- 172.21.15.170:0/101745981 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ef0059040 con 0x5560f71904d0 2024-09-12T17:28:23.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.273+0000 7f7ef5954640 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5560f71979c0 con 0x5560f7194e80 2024-09-12T17:28:23.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.273+0000 7f7ef5153640 1 -- 172.21.15.170:0/101745981 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ee801b070 con 0x5560f7194e80 2024-09-12T17:28:23.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.273+0000 7f7ef5153640 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5560f71979c0 con 0x7f7ef005c040 2024-09-12T17:28:23.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.273+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ee0051070 con 0x7f7ef005c040 2024-09-12T17:28:23.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.273+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5560f71979c0 con 0x5560f718bac0 2024-09-12T17:28:23.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.273+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7ee0051070 con 0x5560f718bac0 2024-09-12T17:28:23.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.273+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5560f71979c0 con 0x5560f71904d0 2024-09-12T17:28:23.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.274+0000 7f7ef5954640 1 -- 172.21.15.170:0/101745981 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(37 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7ef0059040 con 0x5560f71904d0 2024-09-12T17:28:23.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.274+0000 7f7ef9e32800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:23.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.274+0000 7f7ef9e32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:23.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.274+0000 7f7ef9e32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:23.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.274+0000 7f7ef9e32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:23.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.274+0000 7f7ef9e32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:23.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.274+0000 7f7ef9e32800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:23.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.274+0000 7f7ef9e32800 20 rados->read ofs=0 len=0 2024-09-12T17:28:23.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.274+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5560f7193890 con 0x5560f718bac0 2024-09-12T17:28:23.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.274+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7ee0051070 con 0x5560f718bac0 2024-09-12T17:28:23.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.274+0000 7f7ef9e32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:23.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.274+0000 7f7ef9e32800 20 rados->read ofs=0 len=0 2024-09-12T17:28:23.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.274+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5560f71934d0 con 0x5560f718bac0 2024-09-12T17:28:23.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.274+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7ee0051070 con 0x5560f718bac0 2024-09-12T17:28:23.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.274+0000 7f7ef9e32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:23.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.274+0000 7f7ef9e32800 20 rados->read ofs=0 len=0 2024-09-12T17:28:23.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.274+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5560f7193cd0 con 0x5560f71904d0 2024-09-12T17:28:23.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.274+0000 7f7ef5954640 1 -- 172.21.15.170:0/101745981 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7ef0059040 con 0x5560f71904d0 2024-09-12T17:28:23.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.274+0000 7f7ef9e32800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:23.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.274+0000 7f7ef9e32800 20 zone default found 2024-09-12T17:28:23.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.274+0000 7f7ef9e32800 4 Realm: () 2024-09-12T17:28:23.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.274+0000 7f7ef9e32800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:23.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.274+0000 7f7ef9e32800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:23.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.274+0000 7f7ef9e32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:23.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.274+0000 7f7ef9e32800 20 zonegroup default 2024-09-12T17:28:23.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.274+0000 7f7ef9e32800 20 rados->read ofs=0 len=0 2024-09-12T17:28:23.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.274+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5560f7197e40 con 0x7f7ef005c040 2024-09-12T17:28:23.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.275+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7ee0051070 con 0x7f7ef005c040 2024-09-12T17:28:23.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.275+0000 7f7ef9e32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:23.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.275+0000 7f7ef9e32800 20 rados->read ofs=0 len=0 2024-09-12T17:28:23.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.275+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5560f719a100 con 0x5560f7194e80 2024-09-12T17:28:23.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.275+0000 7f7ef5153640 1 -- 172.21.15.170:0/101745981 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7ee801b070 con 0x5560f7194e80 2024-09-12T17:28:23.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.275+0000 7f7ef9e32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:23.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.275+0000 7f7ef9e32800 20 rados->read ofs=0 len=0 2024-09-12T17:28:23.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.275+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5560f719a4a0 con 0x5560f7194e80 2024-09-12T17:28:23.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.275+0000 7f7ef5153640 1 -- 172.21.15.170:0/101745981 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7ee801b070 con 0x5560f7194e80 2024-09-12T17:28:23.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.275+0000 7f7ef9e32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:23.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.275+0000 7f7ef9e32800 20 started sync module instance, tier type = 2024-09-12T17:28:23.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.275+0000 7f7ef9e32800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:23.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.275+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f7199590 con 0x5560f71904d0 2024-09-12T17:28:23.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.276+0000 7f7ef5954640 1 -- 172.21.15.170:0/101745981 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(44 notify.0 [create] v31'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ef0059040 con 0x5560f71904d0 2024-09-12T17:28:23.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.276+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93874950871728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f7199590 con 0x5560f71904d0 2024-09-12T17:28:23.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.276+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f719af80 con 0x5560f718bac0 2024-09-12T17:28:23.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.277+0000 7f7ef5954640 1 -- 172.21.15.170:0/101745981 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93874950871728] v31'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ef0059040 con 0x5560f71904d0 2024-09-12T17:28:23.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.277+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v31'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ee0051070 con 0x5560f718bac0 2024-09-12T17:28:23.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.277+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93874950875760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f7199590 con 0x5560f718bac0 2024-09-12T17:28:23.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.277+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f719ba30 con 0x5560f7194e80 2024-09-12T17:28:23.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.278+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93874950875760] v31'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ee0051070 con 0x5560f718bac0 2024-09-12T17:28:23.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.279+0000 7f7ef5153640 1 -- 172.21.15.170:0/101745981 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v31'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ee801b070 con 0x5560f7194e80 2024-09-12T17:28:23.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.279+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93874950869216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f7199500 con 0x5560f7194e80 2024-09-12T17:28:23.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.279+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f719c8f0 con 0x5560f71904d0 2024-09-12T17:28:23.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.280+0000 7f7ef5954640 1 -- 172.21.15.170:0/101745981 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(50 notify.3 [create] v31'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ef0059040 con 0x5560f71904d0 2024-09-12T17:28:23.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.280+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93874950882848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f719d190 con 0x5560f71904d0 2024-09-12T17:28:23.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.280+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f719dc80 con 0x5560f718bac0 2024-09-12T17:28:23.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.280+0000 7f7ef5153640 1 -- 172.21.15.170:0/101745981 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93874950869216] v31'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ee801b070 con 0x5560f7194e80 2024-09-12T17:28:23.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.281+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v31'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ee0051070 con 0x5560f718bac0 2024-09-12T17:28:23.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.281+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93874950887248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f719dc40 con 0x5560f718bac0 2024-09-12T17:28:23.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.281+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f719e6d0 con 0x7f7ef005c040 2024-09-12T17:28:23.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.281+0000 7f7ef5954640 1 -- 172.21.15.170:0/101745981 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93874950882848] v31'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ef0059040 con 0x5560f71904d0 2024-09-12T17:28:23.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.282+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93874950887248] v31'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ee0051070 con 0x5560f718bac0 2024-09-12T17:28:23.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.282+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(54 notify.5 [create] v31'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ee0051070 con 0x7f7ef005c040 2024-09-12T17:28:23.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.282+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93874950880800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f719e1e0 con 0x7f7ef005c040 2024-09-12T17:28:23.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.282+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f719ef70 con 0x7f7ef005c040 2024-09-12T17:28:23.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.283+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(56 notify.6 [create] v31'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ee0051070 con 0x7f7ef005c040 2024-09-12T17:28:23.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.283+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93874950892224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f719e1e0 con 0x7f7ef005c040 2024-09-12T17:28:23.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.283+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f719fae0 con 0x7f7ef005c040 2024-09-12T17:28:23.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.283+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93874950880800] v31'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ee0051070 con 0x7f7ef005c040 2024-09-12T17:28:23.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.284+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93874950892224] v31'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ee0051070 con 0x7f7ef005c040 2024-09-12T17:28:23.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.284+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(58 notify.7 [create] v31'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ee0051070 con 0x7f7ef005c040 2024-09-12T17:28:23.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.284+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93874950893280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f719cce0 con 0x7f7ef005c040 2024-09-12T17:28:23.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.284+0000 7f7ef9e32800 20 add_watcher() i=0 2024-09-12T17:28:23.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.284+0000 7f7ef9e32800 20 add_watcher() i=1 2024-09-12T17:28:23.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.284+0000 7f7ef9e32800 20 add_watcher() i=2 2024-09-12T17:28:23.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.284+0000 7f7ef9e32800 20 add_watcher() i=3 2024-09-12T17:28:23.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.284+0000 7f7ef9e32800 20 add_watcher() i=4 2024-09-12T17:28:23.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.284+0000 7f7ef9e32800 20 add_watcher() i=5 2024-09-12T17:28:23.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.284+0000 7f7ef9e32800 20 add_watcher() i=6 2024-09-12T17:28:23.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.285+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93874950893280] v31'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ee0051070 con 0x7f7ef005c040 2024-09-12T17:28:23.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.285+0000 7f7ef9e32800 20 add_watcher() i=7 2024-09-12T17:28:23.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.285+0000 7f7ef9e32800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:23.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.285+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5560f71a2ad0 con 0x5560f718bac0 2024-09-12T17:28:23.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.285+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7ee0051070 con 0x5560f718bac0 2024-09-12T17:28:23.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.285+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93874950895024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f719ff50 con 0x5560f718bac0 2024-09-12T17:28:23.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.286+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93874950895024] v31'192 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7ee0051070 con 0x5560f718bac0 2024-09-12T17:28:23.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.286+0000 7f7dab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:23.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.286+0000 7f7ef9e32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:23.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.286+0000 7f7ef9e32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:23.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.286+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f71ab2b0 con 0x5560f718bac0 2024-09-12T17:28:23.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.288+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7ee0051070 con 0x5560f718bac0 2024-09-12T17:28:23.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.288+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f71ab2b0 con 0x7f7ef005c040 2024-09-12T17:28:23.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.289+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7ee0051070 con 0x7f7ef005c040 2024-09-12T17:28:23.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.289+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f71abcd0 con 0x5560f7194e80 2024-09-12T17:28:23.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.290+0000 7f7ef5153640 1 -- 172.21.15.170:0/101745981 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7ee801b070 con 0x5560f7194e80 2024-09-12T17:28:23.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.290+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f71abd80 con 0x5560f718bac0 2024-09-12T17:28:23.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.291+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'193 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7ee0051070 con 0x5560f718bac0 2024-09-12T17:28:23.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.291+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f71ac450 con 0x5560f71904d0 2024-09-12T17:28:23.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.291+0000 7f7ef5954640 1 -- 172.21.15.170:0/101745981 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'65 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7ef0059040 con 0x5560f71904d0 2024-09-12T17:28:23.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.291+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f71ac450 con 0x5560f7194e80 2024-09-12T17:28:23.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.292+0000 7f7ef5153640 1 -- 172.21.15.170:0/101745981 <== osd.3 v2:172.21.15.170:6816/2664906588 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'43 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7ee801b070 con 0x5560f7194e80 2024-09-12T17:28:23.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.292+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f71ac450 con 0x5560f718bac0 2024-09-12T17:28:23.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.294+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7ee0051070 con 0x5560f718bac0 2024-09-12T17:28:23.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.294+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f71ac4e0 con 0x7f7ef005c040 2024-09-12T17:28:23.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.295+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'43 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7ee0051070 con 0x7f7ef005c040 2024-09-12T17:28:23.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.295+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f71ac570 con 0x5560f71904d0 2024-09-12T17:28:23.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.296+0000 7f7ef5954640 1 -- 172.21.15.170:0/101745981 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'26 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7ef0059040 con 0x5560f71904d0 2024-09-12T17:28:23.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.296+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f71ac600 con 0x5560f7194e80 2024-09-12T17:28:23.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.297+0000 7f7ef5153640 1 -- 172.21.15.170:0/101745981 <== osd.3 v2:172.21.15.170:6816/2664906588 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7ee801b070 con 0x5560f7194e80 2024-09-12T17:28:23.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.297+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f71acbf0 con 0x5560f71904d0 2024-09-12T17:28:23.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.298+0000 7f7ef5954640 1 -- 172.21.15.170:0/101745981 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'66 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ef0059040 con 0x5560f71904d0 2024-09-12T17:28:23.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.298+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f71acba0 con 0x7f7ef005c040 2024-09-12T17:28:23.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.299+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'28 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ee0051070 con 0x7f7ef005c040 2024-09-12T17:28:23.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.299+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f71acb40 con 0x5560f71904d0 2024-09-12T17:28:23.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.300+0000 7f7ef5954640 1 -- 172.21.15.170:0/101745981 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ef0059040 con 0x5560f71904d0 2024-09-12T17:28:23.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.300+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f71acb40 con 0x7f7ef005c040 2024-09-12T17:28:23.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.301+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'49 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ee0051070 con 0x7f7ef005c040 2024-09-12T17:28:23.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.301+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f71acab0 con 0x5560f718bac0 2024-09-12T17:28:23.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.302+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'194 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ee0051070 con 0x5560f718bac0 2024-09-12T17:28:23.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.302+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f71acab0 con 0x5560f7194e80 2024-09-12T17:28:23.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.303+0000 7f7ef5153640 1 -- 172.21.15.170:0/101745981 <== osd.3 v2:172.21.15.170:6816/2664906588 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'59 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ee801b070 con 0x5560f7194e80 2024-09-12T17:28:23.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.303+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f71acb40 con 0x5560f71904d0 2024-09-12T17:28:23.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.304+0000 7f7ef5954640 1 -- 172.21.15.170:0/101745981 <== osd.2 v2:172.21.15.170:6808/3855567754 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'67 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ef0059040 con 0x5560f71904d0 2024-09-12T17:28:23.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.304+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f71acbd0 con 0x5560f7194e80 2024-09-12T17:28:23.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.305+0000 7f7ef5153640 1 -- 172.21.15.170:0/101745981 <== osd.3 v2:172.21.15.170:6816/2664906588 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ee801b070 con 0x5560f7194e80 2024-09-12T17:28:23.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.305+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f71acbd0 con 0x5560f718bac0 2024-09-12T17:28:23.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.306+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'35 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ee0051070 con 0x5560f718bac0 2024-09-12T17:28:23.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.306+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f71acbd0 con 0x5560f718bac0 2024-09-12T17:28:23.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.307+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'195 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ee0051070 con 0x5560f718bac0 2024-09-12T17:28:23.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.307+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f71acc00 con 0x5560f7194e80 2024-09-12T17:28:23.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.308+0000 7f7ef5153640 1 -- 172.21.15.170:0/101745981 <== osd.3 v2:172.21.15.170:6816/2664906588 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'60 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ee801b070 con 0x5560f7194e80 2024-09-12T17:28:23.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.308+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f71acc00 con 0x5560f71904d0 2024-09-12T17:28:23.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.309+0000 7f7ef5954640 1 -- 172.21.15.170:0/101745981 <== osd.2 v2:172.21.15.170:6808/3855567754 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'36 uv32 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ef0059040 con 0x5560f71904d0 2024-09-12T17:28:23.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.309+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f71acbd0 con 0x5560f7194e80 2024-09-12T17:28:23.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.310+0000 7f7ef5153640 1 -- 172.21.15.170:0/101745981 <== osd.3 v2:172.21.15.170:6816/2664906588 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ee801b070 con 0x5560f7194e80 2024-09-12T17:28:23.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.310+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f71acbd0 con 0x5560f7194e80 2024-09-12T17:28:23.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.311+0000 7f7ef5153640 1 -- 172.21.15.170:0/101745981 <== osd.3 v2:172.21.15.170:6816/2664906588 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ee801b070 con 0x5560f7194e80 2024-09-12T17:28:23.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.311+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f71acbd0 con 0x5560f7194e80 2024-09-12T17:28:23.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.312+0000 7f7ef5153640 1 -- 172.21.15.170:0/101745981 <== osd.3 v2:172.21.15.170:6816/2664906588 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'21 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ee801b070 con 0x5560f7194e80 2024-09-12T17:28:23.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.312+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f71acbd0 con 0x5560f7194e80 2024-09-12T17:28:23.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.313+0000 7f7ef5153640 1 -- 172.21.15.170:0/101745981 <== osd.3 v2:172.21.15.170:6816/2664906588 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'44 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ee801b070 con 0x5560f7194e80 2024-09-12T17:28:23.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.313+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f71acbd0 con 0x7f7ef005c040 2024-09-12T17:28:23.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.314+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ee0051070 con 0x7f7ef005c040 2024-09-12T17:28:23.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.314+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f71acbd0 con 0x5560f7194e80 2024-09-12T17:28:23.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.315+0000 7f7ef5153640 1 -- 172.21.15.170:0/101745981 <== osd.3 v2:172.21.15.170:6816/2664906588 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ee801b070 con 0x5560f7194e80 2024-09-12T17:28:23.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.315+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f71acbd0 con 0x7f7ef005c040 2024-09-12T17:28:23.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.316+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'44 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ee0051070 con 0x7f7ef005c040 2024-09-12T17:28:23.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.316+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f71acbd0 con 0x5560f7194e80 2024-09-12T17:28:23.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.317+0000 7f7ef5153640 1 -- 172.21.15.170:0/101745981 <== osd.3 v2:172.21.15.170:6816/2664906588 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'61 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ee801b070 con 0x5560f7194e80 2024-09-12T17:28:23.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.317+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f71acbd0 con 0x7f7ef005c040 2024-09-12T17:28:23.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.319+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.0 v2:172.21.15.47:6800/3978157098 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'50 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ee0051070 con 0x7f7ef005c040 2024-09-12T17:28:23.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.319+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f71acbd0 con 0x5560f71904d0 2024-09-12T17:28:23.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.320+0000 7f7ef5954640 1 -- 172.21.15.170:0/101745981 <== osd.2 v2:172.21.15.170:6808/3855567754 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ef0059040 con 0x5560f71904d0 2024-09-12T17:28:23.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.320+0000 7f7daa7e4640 20 reqs_thread_entry: start 2024-09-12T17:28:23.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.320+0000 7f7ef9e32800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:23.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.320+0000 7f7ef9e32800 20 Filter name: none 2024-09-12T17:28:23.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.320+0000 7f7d1bfff640 20 reqs_thread_entry: start 2024-09-12T17:28:23.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.320+0000 7f7ef9e32800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:28:23.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.320+0000 7f7ef9e32800 20 rados->read ofs=0 len=0 2024-09-12T17:28:23.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.320+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5560f71d7de0 con 0x5560f718bac0 2024-09-12T17:28:23.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.321+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f7ee0051070 con 0x5560f718bac0 2024-09-12T17:28:23.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.321+0000 7f7ef9e32800 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:28:23.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.321+0000 7f7ef9e32800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T17:28:23.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.321+0000 7f7ef9e32800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:28:23.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.321+0000 7f7ef9e32800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:23.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.321+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5560f71da080 con 0x5560f71904d0 2024-09-12T17:28:23.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.321+0000 7f7ef5954640 1 -- 172.21.15.170:0/101745981 <== osd.2 v2:172.21.15.170:6808/3855567754 21 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv41 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f7ef0059040 con 0x5560f71904d0 2024-09-12T17:28:23.324 INFO:teuthology.orchestra.run.smithi170.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-12T17:28:23.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.322+0000 7f7dab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:23.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.322+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93874950895024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f7188180 con 0x5560f718bac0 2024-09-12T17:28:23.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.323+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 93874950895024] v31'196 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7ee0051070 con 0x5560f718bac0 2024-09-12T17:28:23.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.323+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93874950871728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f719f5b0 con 0x5560f71904d0 2024-09-12T17:28:23.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.324+0000 7f7ef5954640 1 -- 172.21.15.170:0/101745981 <== osd.2 v2:172.21.15.170:6808/3855567754 22 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 93874950871728] v31'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ef0059040 con 0x5560f71904d0 2024-09-12T17:28:23.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.324+0000 7f7ef9e32800 20 remove_watcher() i=0 2024-09-12T17:28:23.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.324+0000 7f7ef9e32800 2 removed watcher, disabling cache 2024-09-12T17:28:23.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.324+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93874950875760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f719f5b0 con 0x5560f718bac0 2024-09-12T17:28:23.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.325+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 93874950875760] v31'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ee0051070 con 0x5560f718bac0 2024-09-12T17:28:23.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.325+0000 7f7ef9e32800 20 remove_watcher() i=1 2024-09-12T17:28:23.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.325+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93874950869216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f719aa70 con 0x5560f7194e80 2024-09-12T17:28:23.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.326+0000 7f7ef5153640 1 -- 172.21.15.170:0/101745981 <== osd.3 v2:172.21.15.170:6816/2664906588 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 93874950869216] v31'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ee801b070 con 0x5560f7194e80 2024-09-12T17:28:23.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.326+0000 7f7ef9e32800 20 remove_watcher() i=2 2024-09-12T17:28:23.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.326+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93874950882848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f719f5b0 con 0x5560f71904d0 2024-09-12T17:28:23.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.327+0000 7f7ef5954640 1 -- 172.21.15.170:0/101745981 <== osd.2 v2:172.21.15.170:6808/3855567754 23 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 93874950882848] v31'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ef0059040 con 0x5560f71904d0 2024-09-12T17:28:23.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.327+0000 7f7ef9e32800 20 remove_watcher() i=3 2024-09-12T17:28:23.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.327+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93874950887248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f71990e0 con 0x5560f718bac0 2024-09-12T17:28:23.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.328+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.1 v2:172.21.15.170:6800/1903654092 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 93874950887248] v31'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ee0051070 con 0x5560f718bac0 2024-09-12T17:28:23.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.328+0000 7f7ef9e32800 20 remove_watcher() i=4 2024-09-12T17:28:23.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.328+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93874950880800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f719aa70 con 0x7f7ef005c040 2024-09-12T17:28:23.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.329+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.0 v2:172.21.15.47:6800/3978157098 23 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 93874950880800] v31'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ee0051070 con 0x7f7ef005c040 2024-09-12T17:28:23.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.329+0000 7f7ef9e32800 20 remove_watcher() i=5 2024-09-12T17:28:23.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.329+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93874950892224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f719c620 con 0x7f7ef005c040 2024-09-12T17:28:23.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.330+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.0 v2:172.21.15.47:6800/3978157098 24 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 93874950892224] v31'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ee0051070 con 0x7f7ef005c040 2024-09-12T17:28:23.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.330+0000 7f7ef9e32800 20 remove_watcher() i=6 2024-09-12T17:28:23.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.330+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93874950893280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5560f719f5b0 con 0x7f7ef005c040 2024-09-12T17:28:23.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.331+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 <== osd.0 v2:172.21.15.47:6800/3978157098 25 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 93874950893280] v31'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ee0051070 con 0x7f7ef005c040 2024-09-12T17:28:23.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.331+0000 7f7ef9e32800 20 remove_watcher() i=7 2024-09-12T17:28:23.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.331+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f7ef005c040 msgr2=0x7f7ef0053640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:23.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.331+0000 7f7ef9e32800 1 --2- 172.21.15.170:0/101745981 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f7ef005c040 0x7f7ef0053640 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.331+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5560f718bac0 msgr2=0x5560f718df80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:23.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.331+0000 7f7ef9e32800 1 --2- 172.21.15.170:0/101745981 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5560f718bac0 0x5560f718df80 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.331+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5560f71904d0 msgr2=0x5560f71928c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:23.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.331+0000 7f7ef9e32800 1 --2- 172.21.15.170:0/101745981 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5560f71904d0 0x5560f71928c0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.331+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5560f7194e80 msgr2=0x5560f7197340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:23.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.331+0000 7f7ef9e32800 1 --2- 172.21.15.170:0/101745981 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5560f7194e80 0x5560f7197340 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.331+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f7dc003c780 msgr2=0x7f7dc003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:23.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.331+0000 7f7ef9e32800 1 --2- 172.21.15.170:0/101745981 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f7dc003c780 0x7f7dc003ec40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8051fa0 tx=0x7f7ee8030000 comp rx=0 tx=0).stop 2024-09-12T17:28:23.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.331+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5560f7178c40 msgr2=0x5560f7180190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:23.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.331+0000 7f7ef9e32800 1 --2- 172.21.15.170:0/101745981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5560f7178c40 0x5560f7180190 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f7ef00154a0 tx=0x7f7ef0053230 comp rx=0 tx=0).stop 2024-09-12T17:28:23.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.331+0000 7f7ef4952640 1 -- 172.21.15.170:0/101745981 reap_dead start 2024-09-12T17:28:23.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.331+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 shutdown_connections 2024-09-12T17:28:23.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.331+0000 7f7ef9e32800 1 --2- 172.21.15.170:0/101745981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5560f7178c40 0x5560f7180190 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.331+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 >> 172.21.15.170:0/101745981 conn(0x5560f7175040 msgr2=0x5560f7173250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:23.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.332+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 shutdown_connections 2024-09-12T17:28:23.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.332+0000 7f7ef9e32800 1 -- 172.21.15.170:0/101745981 wait complete. 2024-09-12T17:28:23.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.332+0000 7f7ef9e32800 1 -- 172.21.15.170:0/4069027660 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f7dcc03c730 msgr2=0x7f7dcc03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:23.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.332+0000 7f7ef9e32800 1 --2- 172.21.15.170:0/4069027660 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f7dcc03c730 0x7f7dcc03ebf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x5560f7159d30 tx=0x7f7ee8019f90 comp rx=0 tx=0).stop 2024-09-12T17:28:23.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.332+0000 7f7ef9e32800 1 -- 172.21.15.170:0/4069027660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5560f716c160 msgr2=0x5560f716c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:23.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.332+0000 7f7ef9e32800 1 --2- 172.21.15.170:0/4069027660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5560f716c160 0x5560f716c580 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x5560f7152210 tx=0x7f7ef000bf30 comp rx=0 tx=0).stop 2024-09-12T17:28:23.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.332+0000 7f7ef9e32800 1 -- 172.21.15.170:0/4069027660 shutdown_connections 2024-09-12T17:28:23.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.332+0000 7f7ef9e32800 1 --2- 172.21.15.170:0/4069027660 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f7dcc03c730 0x7f7dcc03ebf0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.332+0000 7f7ef9e32800 1 --2- 172.21.15.170:0/4069027660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5560f716c160 0x5560f716c580 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.332+0000 7f7ef9e32800 1 -- 172.21.15.170:0/4069027660 >> 172.21.15.170:0/4069027660 conn(0x5560f7160510 msgr2=0x5560f71608f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:23.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.332+0000 7f7ef9e32800 1 -- 172.21.15.170:0/4069027660 shutdown_connections 2024-09-12T17:28:23.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.332+0000 7f7ef9e32800 1 -- 172.21.15.170:0/4069027660 wait complete. 2024-09-12T17:28:23.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.332+0000 7f7ef9e32800 1 -- 172.21.15.170:0/2217440046 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5560f7058200 msgr2=0x5560f7158860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:23.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.332+0000 7f7ef9e32800 1 --2- 172.21.15.170:0/2217440046 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5560f7058200 0x5560f7158860 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.332+0000 7f7ef9e32800 1 -- 172.21.15.170:0/2217440046 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5560f715ac40 msgr2=0x5560f715d0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:23.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.332+0000 7f7ef9e32800 1 --2- 172.21.15.170:0/2217440046 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5560f715ac40 0x5560f715d0c0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.332+0000 7f7ef9e32800 1 -- 172.21.15.170:0/2217440046 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f7ddc03c780 msgr2=0x7f7ddc03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:23.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.332+0000 7f7ef9e32800 1 --2- 172.21.15.170:0/2217440046 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f7ddc03c780 0x7f7ddc03ec40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0057000 tx=0x7f7ee0052000 comp rx=0 tx=0).stop 2024-09-12T17:28:23.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.332+0000 7f7ef9e32800 1 -- 172.21.15.170:0/2217440046 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5560f7056df0 msgr2=0x5560f7151210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:23.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.332+0000 7f7ef9e32800 1 --2- 172.21.15.170:0/2217440046 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5560f7056df0 0x5560f7151210 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8000f80 tx=0x7f7ee8001250 comp rx=0 tx=0).stop 2024-09-12T17:28:23.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.332+0000 7f7ef9e32800 1 -- 172.21.15.170:0/2217440046 shutdown_connections 2024-09-12T17:28:23.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.332+0000 7f7ef9e32800 1 --2- 172.21.15.170:0/2217440046 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5560f715ac40 0x5560f715d0c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.332+0000 7f7ef9e32800 1 --2- 172.21.15.170:0/2217440046 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f7ddc03c780 0x7f7ddc03ec40 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.332+0000 7f7ef9e32800 1 --2- 172.21.15.170:0/2217440046 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5560f7058200 0x5560f7158860 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.332+0000 7f7ef9e32800 1 --2- 172.21.15.170:0/2217440046 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5560f7056df0 0x5560f7151210 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:23.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.332+0000 7f7ef9e32800 1 -- 172.21.15.170:0/2217440046 >> 172.21.15.170:0/2217440046 conn(0x5560f70521c0 msgr2=0x5560f7146730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:23.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.332+0000 7f7ef9e32800 1 -- 172.21.15.170:0/2217440046 shutdown_connections 2024-09-12T17:28:23.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:23.333+0000 7f7ef9e32800 1 -- 172.21.15.170:0/2217440046 wait complete. 2024-09-12T17:28:23.342 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-12T17:28:23.355 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:28:23.405 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-12T17:28:58.407 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-09-12T17:28:58.407 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-09-12T17:28:58.408 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-09-12T17:28:58.462 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:58.462 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:58.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.461+0000 7f150f72c800 1 Processor -- start 2024-09-12T17:28:58.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.461+0000 7f150f72c800 1 -- start start 2024-09-12T17:28:58.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.462+0000 7f150f72c800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x56390d83dff0 0x56390d846b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.462+0000 7f150f72c800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56390d6e7e40 con 0x56390d83c4d0 2024-09-12T17:28:58.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.462+0000 7f150f72c800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x56390d6b2680 con 0x56390d83dff0 2024-09-12T17:28:58.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.462+0000 7f150acd9640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x56390d83dff0 0x56390d846b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.462+0000 7f150b4da640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x56390d83c4d0 0x56390d83c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:57340/0 (socket says 172.21.15.170:57340) 2024-09-12T17:28:58.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.462+0000 7f150b4da640 1 -- 172.21.15.170:0/4257793874 learned_addr learned my addr 172.21.15.170:0/4257793874 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:28:58.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.462+0000 7f150a4d8640 1 -- 172.21.15.170:0/4257793874 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3245930997 0 0) 0x56390d6e7e40 con 0x56390d83c4d0 2024-09-12T17:28:58.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.462+0000 7f150a4d8640 1 -- 172.21.15.170:0/4257793874 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14f4001e10 con 0x56390d83c4d0 2024-09-12T17:28:58.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.462+0000 7f150acd9640 1 -- 172.21.15.170:0/4257793874 >> v1:172.21.15.47:6789/0 conn(0x56390d83c4d0 legacy=0x56390d83c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.462+0000 7f150acd9640 1 -- 172.21.15.170:0/4257793874 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56390d6ce6b0 con 0x56390d83dff0 2024-09-12T17:28:58.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.464+0000 7f150acd9640 1 --2- 172.21.15.170:0/4257793874 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56390d83dff0 0x56390d846b10 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f150000a470 tx=0x7f1500045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28640df6e0121b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.464+0000 7f150a4d8640 1 -- 172.21.15.170:0/4257793874 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1500059070 con 0x56390d83dff0 2024-09-12T17:28:58.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.465+0000 7f150a4d8640 1 -- 172.21.15.170:0/4257793874 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1500054570 con 0x56390d83dff0 2024-09-12T17:28:58.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.465+0000 7f150a4d8640 1 -- 172.21.15.170:0/4257793874 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1500054850 con 0x56390d83dff0 2024-09-12T17:28:58.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.465+0000 7f150f72c800 1 -- 172.21.15.170:0/4257793874 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56390d83dff0 msgr2=0x56390d846b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.465+0000 7f150f72c800 1 --2- 172.21.15.170:0/4257793874 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56390d83dff0 0x56390d846b10 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f150000a470 tx=0x7f1500045920 comp rx=0 tx=0).stop 2024-09-12T17:28:58.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.465+0000 7f150f72c800 1 -- 172.21.15.170:0/4257793874 shutdown_connections 2024-09-12T17:28:58.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.465+0000 7f150f72c800 1 --2- 172.21.15.170:0/4257793874 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56390d83dff0 0x56390d846b10 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.465+0000 7f150f72c800 1 -- 172.21.15.170:0/4257793874 >> 172.21.15.170:0/4257793874 conn(0x56390d8381c0 msgr2=0x56390d83a620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:58.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.465+0000 7f150f72c800 1 -- 172.21.15.170:0/4257793874 shutdown_connections 2024-09-12T17:28:58.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.465+0000 7f150f72c800 1 -- 172.21.15.170:0/4257793874 wait complete. 2024-09-12T17:28:58.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.481+0000 7f150f72c800 1 Processor -- start 2024-09-12T17:28:58.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.481+0000 7f150f72c800 1 -- start start 2024-09-12T17:28:58.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.481+0000 7f150f72c800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56390d83c4d0 0x56390d92f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.481+0000 7f150f72c800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56390d6d6dd0 con 0x56390d83c4d0 2024-09-12T17:28:58.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.482+0000 7f150b4da640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56390d83c4d0 0x56390d92f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.482+0000 7f150b4da640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56390d83c4d0 0x56390d92f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59462/0 (socket says 172.21.15.170:59462) 2024-09-12T17:28:58.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.482+0000 7f150b4da640 1 -- 172.21.15.170:0/2011214746 learned_addr learned my addr 172.21.15.170:0/2011214746 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:58.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.482+0000 7f150b4da640 1 -- 172.21.15.170:0/2011214746 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56390d6efe10 con 0x56390d83c4d0 2024-09-12T17:28:58.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.482+0000 7f150b4da640 1 --2- 172.21.15.170:0/2011214746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56390d83c4d0 0x56390d92f690 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f14fc001e30 tx=0x7f14fc00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a419e673306c2bc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.482+0000 7f13f960a640 1 -- 172.21.15.170:0/2011214746 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14fc012020 con 0x56390d83c4d0 2024-09-12T17:28:58.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.482+0000 7f13f960a640 1 -- 172.21.15.170:0/2011214746 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14fc00e470 con 0x56390d83c4d0 2024-09-12T17:28:58.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.482+0000 7f13f960a640 1 -- 172.21.15.170:0/2011214746 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14fc00e790 con 0x56390d83c4d0 2024-09-12T17:28:58.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.483+0000 7f150f72c800 1 -- 172.21.15.170:0/2011214746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56390d83c4d0 msgr2=0x56390d92f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.483+0000 7f150f72c800 1 --2- 172.21.15.170:0/2011214746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56390d83c4d0 0x56390d92f690 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f14fc001e30 tx=0x7f14fc00b780 comp rx=0 tx=0).stop 2024-09-12T17:28:58.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.483+0000 7f150f72c800 1 -- 172.21.15.170:0/2011214746 shutdown_connections 2024-09-12T17:28:58.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.483+0000 7f150f72c800 1 --2- 172.21.15.170:0/2011214746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56390d83c4d0 0x56390d92f690 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.483+0000 7f150f72c800 1 -- 172.21.15.170:0/2011214746 >> 172.21.15.170:0/2011214746 conn(0x56390d8381c0 msgr2=0x56390d92b010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:58.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.483+0000 7f150f72c800 1 -- 172.21.15.170:0/2011214746 shutdown_connections 2024-09-12T17:28:58.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.483+0000 7f150f72c800 1 -- 172.21.15.170:0/2011214746 wait complete. 2024-09-12T17:28:58.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.484+0000 7f150f72c800 1 Processor -- start 2024-09-12T17:28:58.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.484+0000 7f150f72c800 1 -- start start 2024-09-12T17:28:58.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.484+0000 7f150f72c800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56390d83c4d0 0x56390d936fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.484+0000 7f150f72c800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56390d847350 con 0x56390d83c4d0 2024-09-12T17:28:58.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.484+0000 7f150b4da640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56390d83c4d0 0x56390d936fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.484+0000 7f150b4da640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56390d83c4d0 0x56390d936fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59464/0 (socket says 172.21.15.170:59464) 2024-09-12T17:28:58.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.484+0000 7f150b4da640 1 -- 172.21.15.170:0/1237503361 learned_addr learned my addr 172.21.15.170:0/1237503361 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:58.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.484+0000 7f150b4da640 1 -- 172.21.15.170:0/1237503361 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56390d937540 con 0x56390d83c4d0 2024-09-12T17:28:58.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.485+0000 7f150b4da640 1 --2- 172.21.15.170:0/1237503361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56390d83c4d0 0x56390d936fe0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x56390d930620 tx=0x7f14fc0040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.486+0000 7f13f7e07640 1 -- 172.21.15.170:0/1237503361 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14fc012030 con 0x56390d83c4d0 2024-09-12T17:28:58.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.486+0000 7f13f7e07640 1 -- 172.21.15.170:0/1237503361 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14fc01a7a0 con 0x56390d83c4d0 2024-09-12T17:28:58.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.486+0000 7f150f72c800 1 -- 172.21.15.170:0/1237503361 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56390d9377d0 con 0x56390d83c4d0 2024-09-12T17:28:58.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.486+0000 7f13f7e07640 1 -- 172.21.15.170:0/1237503361 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14fc01aaa0 con 0x56390d83c4d0 2024-09-12T17:28:58.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.486+0000 7f150f72c800 1 -- 172.21.15.170:0/1237503361 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56390d9381d0 con 0x56390d83c4d0 2024-09-12T17:28:58.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.487+0000 7f13f7e07640 1 -- 172.21.15.170:0/1237503361 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f14fc015020 con 0x56390d83c4d0 2024-09-12T17:28:58.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.487+0000 7f13f7e07640 1 --2- 172.21.15.170:0/1237503361 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f13f003c7d0 0x7f13f003ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.487+0000 7f13f7e07640 1 -- 172.21.15.170:0/1237503361 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f14fc020070 con 0x56390d83c4d0 2024-09-12T17:28:58.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.487+0000 7f150acd9640 1 --2- 172.21.15.170:0/1237503361 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f13f003c7d0 0x7f13f003ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.487+0000 7f150f72c800 1 --2- 172.21.15.170:0/1237503361 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56390d83dff0 0x56390d93e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.487+0000 7f150f72c800 1 -- 172.21.15.170:0/1237503361 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d938db0 con 0x56390d83dff0 2024-09-12T17:28:58.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.487+0000 7f150bcdb640 1 --2- 172.21.15.170:0/1237503361 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56390d83dff0 0x56390d93e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.488+0000 7f150acd9640 1 --2- 172.21.15.170:0/1237503361 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f13f003c7d0 0x7f13f003ec90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x56390d7b0460 tx=0x7f1500050000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.488+0000 7f150bcdb640 1 --2- 172.21.15.170:0/1237503361 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56390d83dff0 0x56390d93e630 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.488+0000 7f150bcdb640 1 -- 172.21.15.170:0/1237503361 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f150400a4d0 con 0x56390d83dff0 2024-09-12T17:28:58.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.488+0000 7f150f72c800 1 -- 172.21.15.170:0/1237503361 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d9386b0 con 0x56390d83dff0 2024-09-12T17:28:58.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.488+0000 7f150bcdb640 1 -- 172.21.15.170:0/1237503361 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f150400a4d0 con 0x56390d83dff0 2024-09-12T17:28:58.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.488+0000 7f150f72c800 1 --2- 172.21.15.170:0/1237503361 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56390d940b20 0x56390d942f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.488+0000 7f150f72c800 1 -- 172.21.15.170:0/1237503361 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d9435e0 con 0x56390d940b20 2024-09-12T17:28:58.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.489+0000 7f150b4da640 1 --2- 172.21.15.170:0/1237503361 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56390d940b20 0x56390d942f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.489+0000 7f150b4da640 1 --2- 172.21.15.170:0/1237503361 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56390d940b20 0x56390d942f10 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.489+0000 7f150b4da640 1 -- 172.21.15.170:0/1237503361 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f14fc018950 con 0x56390d940b20 2024-09-12T17:28:58.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.489+0000 7f150f72c800 1 -- 172.21.15.170:0/1237503361 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d93f9c0 con 0x56390d83dff0 2024-09-12T17:28:58.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.490+0000 7f150bcdb640 1 -- 172.21.15.170:0/1237503361 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f150400a4d0 con 0x56390d83dff0 2024-09-12T17:28:58.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.490+0000 7f150f72c800 1 -- 172.21.15.170:0/1237503361 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d93fe40 con 0x56390d940b20 2024-09-12T17:28:58.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.490+0000 7f150b4da640 1 -- 172.21.15.170:0/1237503361 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f14fc018950 con 0x56390d940b20 2024-09-12T17:28:58.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.490+0000 7f150f72c800 1 Processor -- start 2024-09-12T17:28:58.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.490+0000 7f150f72c800 1 -- start start 2024-09-12T17:28:58.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.490+0000 7f150f72c800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56390d951e50 0x56390d952270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.490+0000 7f150f72c800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56390d734a00 con 0x56390d951e50 2024-09-12T17:28:58.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.491+0000 7f150bcdb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56390d951e50 0x56390d952270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.491+0000 7f150bcdb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56390d951e50 0x56390d952270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59476/0 (socket says 172.21.15.170:59476) 2024-09-12T17:28:58.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.491+0000 7f150bcdb640 1 -- 172.21.15.170:0/2683899935 learned_addr learned my addr 172.21.15.170:0/2683899935 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:58.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.491+0000 7f150bcdb640 1 -- 172.21.15.170:0/2683899935 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56390d9528b0 con 0x56390d951e50 2024-09-12T17:28:58.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.491+0000 7f150bcdb640 1 --2- 172.21.15.170:0/2683899935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56390d951e50 0x56390d952270 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x56390d9383a0 tx=0x7f1504018c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.491+0000 7f13f5602640 1 -- 172.21.15.170:0/2683899935 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1504016b70 con 0x56390d951e50 2024-09-12T17:28:58.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.492+0000 7f13f5602640 1 -- 172.21.15.170:0/2683899935 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1504016d10 con 0x56390d951e50 2024-09-12T17:28:58.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.492+0000 7f13f5602640 1 -- 172.21.15.170:0/2683899935 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1504021440 con 0x56390d951e50 2024-09-12T17:28:58.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.492+0000 7f150f72c800 1 -- 172.21.15.170:0/2683899935 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56390d9530e0 con 0x56390d951e50 2024-09-12T17:28:58.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.492+0000 7f150f72c800 1 -- 172.21.15.170:0/2683899935 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56390d953680 con 0x56390d951e50 2024-09-12T17:28:58.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.493+0000 7f13f5602640 1 -- 172.21.15.170:0/2683899935 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1504011040 con 0x56390d951e50 2024-09-12T17:28:58.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.493+0000 7f13f5602640 1 --2- 172.21.15.170:0/2683899935 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f13e403c780 0x7f13e403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.493+0000 7f13f5602640 1 -- 172.21.15.170:0/2683899935 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f150400e040 con 0x56390d951e50 2024-09-12T17:28:58.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.493+0000 7f150b4da640 1 --2- 172.21.15.170:0/2683899935 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f13e403c780 0x7f13e403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.493+0000 7f150f72c800 1 Processor -- start 2024-09-12T17:28:58.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.493+0000 7f150f72c800 1 -- start start 2024-09-12T17:28:58.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.493+0000 7f150b4da640 1 --2- 172.21.15.170:0/2683899935 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f13e403c780 0x7f13e403ec40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f14fc052150 tx=0x7f14fc017f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.493+0000 7f150f72c800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56390d95e930 0x56390d95ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.493+0000 7f150f72c800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56390d92fee0 con 0x56390d95e930 2024-09-12T17:28:58.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.494+0000 7f150bcdb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56390d95e930 0x56390d95ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.494+0000 7f150bcdb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56390d95e930 0x56390d95ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59480/0 (socket says 172.21.15.170:59480) 2024-09-12T17:28:58.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.494+0000 7f150bcdb640 1 -- 172.21.15.170:0/3893914412 learned_addr learned my addr 172.21.15.170:0/3893914412 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:58.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.494+0000 7f150bcdb640 1 -- 172.21.15.170:0/3893914412 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56390d95f320 con 0x56390d95e930 2024-09-12T17:28:58.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.494+0000 7f150bcdb640 1 --2- 172.21.15.170:0/3893914412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56390d95e930 0x56390d95ed30 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f1504053780 tx=0x7f1504020e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43a773cc3eaa28f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.495+0000 7f13eeffd640 1 -- 172.21.15.170:0/3893914412 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15040522b0 con 0x56390d95e930 2024-09-12T17:28:58.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.495+0000 7f13eeffd640 1 -- 172.21.15.170:0/3893914412 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1504014ad0 con 0x56390d95e930 2024-09-12T17:28:58.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.495+0000 7f13eeffd640 1 -- 172.21.15.170:0/3893914412 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1504014df0 con 0x56390d95e930 2024-09-12T17:28:58.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.495+0000 7f150f72c800 1 -- 172.21.15.170:0/3893914412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56390d95e930 msgr2=0x56390d95ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.495+0000 7f150f72c800 1 --2- 172.21.15.170:0/3893914412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56390d95e930 0x56390d95ed30 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f1504053780 tx=0x7f1504020e60 comp rx=0 tx=0).stop 2024-09-12T17:28:58.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.495+0000 7f150f72c800 1 -- 172.21.15.170:0/3893914412 shutdown_connections 2024-09-12T17:28:58.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.495+0000 7f150f72c800 1 --2- 172.21.15.170:0/3893914412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56390d95e930 0x56390d95ed30 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.495+0000 7f150f72c800 1 -- 172.21.15.170:0/3893914412 >> 172.21.15.170:0/3893914412 conn(0x56390d95ad30 msgr2=0x56390d958f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:58.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.495+0000 7f150f72c800 1 -- 172.21.15.170:0/3893914412 shutdown_connections 2024-09-12T17:28:58.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.495+0000 7f150f72c800 1 -- 172.21.15.170:0/3893914412 wait complete. 2024-09-12T17:28:58.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.495+0000 7f150f72c800 1 Processor -- start 2024-09-12T17:28:58.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.496+0000 7f150f72c800 1 -- start start 2024-09-12T17:28:58.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.496+0000 7f150f72c800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56390d95e930 0x56390d965f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.496+0000 7f150f72c800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56390d95f940 con 0x56390d95e930 2024-09-12T17:28:58.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.496+0000 7f150bcdb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56390d95e930 0x56390d965f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.496+0000 7f150bcdb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56390d95e930 0x56390d965f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59490/0 (socket says 172.21.15.170:59490) 2024-09-12T17:28:58.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.496+0000 7f150bcdb640 1 -- 172.21.15.170:0/3317998666 learned_addr learned my addr 172.21.15.170:0/3317998666 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:58.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.497+0000 7f150bcdb640 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56390d966480 con 0x56390d95e930 2024-09-12T17:28:58.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.497+0000 7f150bcdb640 1 --2- 172.21.15.170:0/3317998666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56390d95e930 0x56390d965f20 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f1504052600 tx=0x7f1504053710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.497+0000 7f13ed7fa640 1 -- 172.21.15.170:0/3317998666 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15040137e0 con 0x56390d95e930 2024-09-12T17:28:58.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.497+0000 7f13ed7fa640 1 -- 172.21.15.170:0/3317998666 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f150402ab30 con 0x56390d95e930 2024-09-12T17:28:58.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.497+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56390d966710 con 0x56390d95e930 2024-09-12T17:28:58.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.497+0000 7f13ed7fa640 1 -- 172.21.15.170:0/3317998666 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f150402ae10 con 0x56390d95e930 2024-09-12T17:28:58.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.497+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56390d967090 con 0x56390d95e930 2024-09-12T17:28:58.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.498+0000 7f13ed7fa640 1 -- 172.21.15.170:0/3317998666 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f15040143c0 con 0x56390d95e930 2024-09-12T17:28:58.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.498+0000 7f13ed7fa640 1 --2- 172.21.15.170:0/3317998666 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f13d403c6e0 0x7f13d403eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.498+0000 7f13ed7fa640 1 -- 172.21.15.170:0/3317998666 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f1504033ba0 con 0x56390d95e930 2024-09-12T17:28:58.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.498+0000 7f150b4da640 1 --2- 172.21.15.170:0/3317998666 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f13d403c6e0 0x7f13d403eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.499+0000 7f150f72c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.499+0000 7f150f72c800 1 --2- 172.21.15.170:0/3317998666 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56390d971990 0x56390d973e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.499+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d9745a0 con 0x56390d971990 2024-09-12T17:28:58.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.499+0000 7f150acd9640 1 --2- 172.21.15.170:0/3317998666 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56390d971990 0x56390d973e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.499+0000 7f150b4da640 1 --2- 172.21.15.170:0/3317998666 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f13d403c6e0 0x7f13d403eba0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f14fc04b650 tx=0x7f14fc02f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.499+0000 7f150acd9640 1 --2- 172.21.15.170:0/3317998666 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56390d971990 0x56390d973e50 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.499+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1500061430 con 0x56390d971990 2024-09-12T17:28:58.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.499+0000 7f150f72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:58.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.499+0000 7f150f72c800 20 realm 2024-09-12T17:28:58.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.499+0000 7f150f72c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.499+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d9749d0 con 0x56390d971990 2024-09-12T17:28:58.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.500+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1500061430 con 0x56390d971990 2024-09-12T17:28:58.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.500+0000 7f150f72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:58.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.500+0000 7f150f72c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:58.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.500+0000 7f150f72c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.500+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d9752a0 con 0x56390d971990 2024-09-12T17:28:58.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.500+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1500061430 con 0x56390d971990 2024-09-12T17:28:58.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.500+0000 7f150f72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:58.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.500+0000 7f150f72c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.500+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d975640 con 0x56390d971990 2024-09-12T17:28:58.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.500+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1500061430 con 0x56390d971990 2024-09-12T17:28:58.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.500+0000 7f150f72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:58.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.500+0000 7f150f72c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.500+0000 7f150f72c800 1 --2- 172.21.15.170:0/3317998666 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56390d9763a0 0x56390d978790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.500+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d978cd0 con 0x56390d9763a0 2024-09-12T17:28:58.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.500+0000 7f150bcdb640 1 --2- 172.21.15.170:0/3317998666 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56390d9763a0 0x56390d978790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.501+0000 7f150bcdb640 1 --2- 172.21.15.170:0/3317998666 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56390d9763a0 0x56390d978790 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.501+0000 7f150bcdb640 1 -- 172.21.15.170:0/3317998666 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1504052020 con 0x56390d9763a0 2024-09-12T17:28:58.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.501+0000 7f150f72c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:58.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.501+0000 7f150f72c800 20 searching for the correct realm 2024-09-12T17:28:58.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.501+0000 7f150f72c800 1 --2- 172.21.15.170:0/3317998666 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x56390d97ad10 0x56390d97d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.501+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56390d97d8a0 con 0x56390d97ad10 2024-09-12T17:28:58.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.501+0000 7f150b4da640 1 --2- 172.21.15.170:0/3317998666 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x56390d97ad10 0x56390d97d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.501+0000 7f150b4da640 1 --2- 172.21.15.170:0/3317998666 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x56390d97ad10 0x56390d97d1d0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.502+0000 7f150b4da640 1 -- 172.21.15.170:0/3317998666 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14fc018950 con 0x56390d97ad10 2024-09-12T17:28:58.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.502+0000 7f150b4da640 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56390d97d8a0 con 0x56390d9763a0 2024-09-12T17:28:58.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.502+0000 7f150bcdb640 1 -- 172.21.15.170:0/3317998666 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1504052020 con 0x56390d9763a0 2024-09-12T17:28:58.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.502+0000 7f150bcdb640 1 --2- 172.21.15.170:0/3317998666 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f15040442d0 0x7f150403b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.502+0000 7f150bcdb640 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56390d97d8a0 con 0x7f15040442d0 2024-09-12T17:28:58.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.502+0000 7f150acd9640 1 --2- 172.21.15.170:0/3317998666 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f15040442d0 0x7f150403b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.503+0000 7f150acd9640 1 --2- 172.21.15.170:0/3317998666 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f15040442d0 0x7f150403b3f0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.503+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1500061430 con 0x7f15040442d0 2024-09-12T17:28:58.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.503+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56390d97d8a0 con 0x56390d971990 2024-09-12T17:28:58.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.504+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1500061430 con 0x56390d971990 2024-09-12T17:28:58.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.504+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56390d97d8a0 con 0x56390d971990 2024-09-12T17:28:58.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.504+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1500061430 con 0x56390d971990 2024-09-12T17:28:58.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.504+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56390d97d8a0 con 0x7f15040442d0 2024-09-12T17:28:58.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.504+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1500061430 con 0x7f15040442d0 2024-09-12T17:28:58.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.504+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56390d97d8a0 con 0x7f15040442d0 2024-09-12T17:28:58.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.505+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1500061430 con 0x7f15040442d0 2024-09-12T17:28:58.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.505+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56390d97d8a0 con 0x56390d9763a0 2024-09-12T17:28:58.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.505+0000 7f150bcdb640 1 -- 172.21.15.170:0/3317998666 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1504052020 con 0x56390d9763a0 2024-09-12T17:28:58.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.505+0000 7f150bcdb640 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56390d97d8a0 con 0x56390d97ad10 2024-09-12T17:28:58.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.505+0000 7f150b4da640 1 -- 172.21.15.170:0/3317998666 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14fc018950 con 0x56390d97ad10 2024-09-12T17:28:58.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.505+0000 7f150b4da640 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56390d97d8a0 con 0x56390d971990 2024-09-12T17:28:58.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.505+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1500061430 con 0x56390d971990 2024-09-12T17:28:58.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.505+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56390d97d8a0 con 0x7f15040442d0 2024-09-12T17:28:58.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.506+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1500061430 con 0x7f15040442d0 2024-09-12T17:28:58.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.506+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56390d97d8a0 con 0x56390d971990 2024-09-12T17:28:58.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.506+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1500061430 con 0x56390d971990 2024-09-12T17:28:58.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.506+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56390d97d8a0 con 0x56390d9763a0 2024-09-12T17:28:58.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.506+0000 7f150bcdb640 1 -- 172.21.15.170:0/3317998666 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f1504052020 con 0x56390d9763a0 2024-09-12T17:28:58.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.506+0000 7f150bcdb640 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56390d97d8a0 con 0x56390d97ad10 2024-09-12T17:28:58.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.507+0000 7f150b4da640 1 -- 172.21.15.170:0/3317998666 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14fc018950 con 0x56390d97ad10 2024-09-12T17:28:58.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.507+0000 7f150b4da640 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56390d97d8a0 con 0x56390d97ad10 2024-09-12T17:28:58.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.507+0000 7f150b4da640 1 -- 172.21.15.170:0/3317998666 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14fc018950 con 0x56390d97ad10 2024-09-12T17:28:58.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.507+0000 7f150b4da640 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56390d97d8a0 con 0x56390d9763a0 2024-09-12T17:28:58.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.507+0000 7f150bcdb640 1 -- 172.21.15.170:0/3317998666 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1504052020 con 0x56390d9763a0 2024-09-12T17:28:58.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.507+0000 7f150bcdb640 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56390d97d8a0 con 0x56390d97ad10 2024-09-12T17:28:58.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.507+0000 7f150b4da640 1 -- 172.21.15.170:0/3317998666 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14fc018950 con 0x56390d97ad10 2024-09-12T17:28:58.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.507+0000 7f150b4da640 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56390d97d8a0 con 0x56390d97ad10 2024-09-12T17:28:58.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.508+0000 7f150b4da640 1 -- 172.21.15.170:0/3317998666 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14fc018950 con 0x56390d97ad10 2024-09-12T17:28:58.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.508+0000 7f150b4da640 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56390d97d8a0 con 0x56390d971990 2024-09-12T17:28:58.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.508+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1500061430 con 0x56390d971990 2024-09-12T17:28:58.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.508+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56390d97d8a0 con 0x56390d971990 2024-09-12T17:28:58.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.508+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1500061430 con 0x56390d971990 2024-09-12T17:28:58.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.508+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56390d97d8a0 con 0x7f15040442d0 2024-09-12T17:28:58.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.508+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1500061430 con 0x7f15040442d0 2024-09-12T17:28:58.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.508+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56390d97d8a0 con 0x56390d97ad10 2024-09-12T17:28:58.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.509+0000 7f150b4da640 1 -- 172.21.15.170:0/3317998666 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14fc018950 con 0x56390d97ad10 2024-09-12T17:28:58.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.509+0000 7f150b4da640 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56390d97d8a0 con 0x56390d9763a0 2024-09-12T17:28:58.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.509+0000 7f150bcdb640 1 -- 172.21.15.170:0/3317998666 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1504052020 con 0x56390d9763a0 2024-09-12T17:28:58.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.509+0000 7f150bcdb640 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56390d97d8a0 con 0x56390d971990 2024-09-12T17:28:58.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.509+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1500061430 con 0x56390d971990 2024-09-12T17:28:58.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.509+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56390d97d8a0 con 0x7f15040442d0 2024-09-12T17:28:58.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.510+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1500061430 con 0x7f15040442d0 2024-09-12T17:28:58.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.510+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56390d97d8a0 con 0x56390d97ad10 2024-09-12T17:28:58.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.510+0000 7f150b4da640 1 -- 172.21.15.170:0/3317998666 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14fc018950 con 0x56390d97ad10 2024-09-12T17:28:58.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.510+0000 7f150b4da640 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56390d97d8a0 con 0x7f15040442d0 2024-09-12T17:28:58.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.510+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1500061430 con 0x7f15040442d0 2024-09-12T17:28:58.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.510+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56390d97d8a0 con 0x56390d9763a0 2024-09-12T17:28:58.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.510+0000 7f150bcdb640 1 -- 172.21.15.170:0/3317998666 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1504052020 con 0x56390d9763a0 2024-09-12T17:28:58.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.510+0000 7f150bcdb640 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56390d97d8a0 con 0x56390d97ad10 2024-09-12T17:28:58.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.511+0000 7f150b4da640 1 -- 172.21.15.170:0/3317998666 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14fc018950 con 0x56390d97ad10 2024-09-12T17:28:58.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.511+0000 7f150b4da640 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56390d97d8a0 con 0x7f15040442d0 2024-09-12T17:28:58.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.511+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1500061430 con 0x7f15040442d0 2024-09-12T17:28:58.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.511+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56390d97d8a0 con 0x56390d971990 2024-09-12T17:28:58.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.511+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1500061430 con 0x56390d971990 2024-09-12T17:28:58.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.511+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f1500083080 con 0x56390d9763a0 2024-09-12T17:28:58.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.512+0000 7f150bcdb640 1 -- 172.21.15.170:0/3317998666 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(37 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1504052020 con 0x56390d9763a0 2024-09-12T17:28:58.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.512+0000 7f150f72c800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:58.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.512+0000 7f150f72c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:58.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.512+0000 7f150f72c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:58.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.512+0000 7f150f72c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:58.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.512+0000 7f150f72c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:58.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.512+0000 7f150f72c800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:58.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.512+0000 7f150f72c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.512+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d979710 con 0x56390d971990 2024-09-12T17:28:58.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.512+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1500061430 con 0x56390d971990 2024-09-12T17:28:58.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.512+0000 7f150f72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:58.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.512+0000 7f150f72c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.512+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d979b30 con 0x56390d971990 2024-09-12T17:28:58.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.512+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1500061430 con 0x56390d971990 2024-09-12T17:28:58.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.512+0000 7f150f72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:58.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.512+0000 7f150f72c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.512+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d979f50 con 0x56390d9763a0 2024-09-12T17:28:58.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.513+0000 7f150bcdb640 1 -- 172.21.15.170:0/3317998666 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1504052020 con 0x56390d9763a0 2024-09-12T17:28:58.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.513+0000 7f150f72c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:58.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.513+0000 7f150f72c800 20 zone default found 2024-09-12T17:28:58.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.513+0000 7f150f72c800 4 Realm: () 2024-09-12T17:28:58.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.513+0000 7f150f72c800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:58.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.513+0000 7f150f72c800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:58.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.513+0000 7f150f72c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:58.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.513+0000 7f150f72c800 20 zonegroup default 2024-09-12T17:28:58.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.513+0000 7f150f72c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.513+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d97dd20 con 0x7f15040442d0 2024-09-12T17:28:58.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.513+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1500061430 con 0x7f15040442d0 2024-09-12T17:28:58.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.513+0000 7f150f72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:58.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.513+0000 7f150f72c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.513+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d97f810 con 0x56390d97ad10 2024-09-12T17:28:58.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.513+0000 7f150b4da640 1 -- 172.21.15.170:0/3317998666 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f14fc018950 con 0x56390d97ad10 2024-09-12T17:28:58.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.513+0000 7f150f72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:58.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.513+0000 7f150f72c800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.513+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d97fcf0 con 0x56390d97ad10 2024-09-12T17:28:58.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.514+0000 7f150b4da640 1 -- 172.21.15.170:0/3317998666 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f14fc018950 con 0x56390d97ad10 2024-09-12T17:28:58.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.514+0000 7f150f72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:58.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.514+0000 7f150f72c800 20 started sync module instance, tier type = 2024-09-12T17:28:58.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.514+0000 7f150f72c800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:58.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.514+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56390d97ebb0 con 0x56390d9763a0 2024-09-12T17:28:58.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.515+0000 7f150bcdb640 1 -- 172.21.15.170:0/3317998666 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(44 notify.0 [create] v31'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1504052020 con 0x56390d9763a0 2024-09-12T17:28:58.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.515+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94803041185696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56390d980600 con 0x56390d9763a0 2024-09-12T17:28:58.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.515+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56390d980e50 con 0x56390d971990 2024-09-12T17:28:58.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.516+0000 7f150bcdb640 1 -- 172.21.15.170:0/3317998666 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94803041185696] v31'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1504052020 con 0x56390d9763a0 2024-09-12T17:28:58.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.516+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v31'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1500061430 con 0x56390d971990 2024-09-12T17:28:58.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.516+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94803041190224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56390d980f10 con 0x56390d971990 2024-09-12T17:28:58.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.516+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56390d981a30 con 0x56390d97ad10 2024-09-12T17:28:58.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.518+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94803041190224] v31'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1500061430 con 0x56390d971990 2024-09-12T17:28:58.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.518+0000 7f150b4da640 1 -- 172.21.15.170:0/3317998666 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v31'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14fc018950 con 0x56390d97ad10 2024-09-12T17:28:58.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.518+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94803041195264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56390d981e20 con 0x56390d97ad10 2024-09-12T17:28:58.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.518+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56390d982870 con 0x56390d9763a0 2024-09-12T17:28:58.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.519+0000 7f150bcdb640 1 -- 172.21.15.170:0/3317998666 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(50 notify.3 [create] v31'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1504052020 con 0x56390d9763a0 2024-09-12T17:28:58.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.519+0000 7f150b4da640 1 -- 172.21.15.170:0/3317998666 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94803041195264] v31'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14fc018950 con 0x56390d97ad10 2024-09-12T17:28:58.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.519+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94803041192352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56390d982c60 con 0x56390d9763a0 2024-09-12T17:28:58.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.519+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56390d983680 con 0x56390d971990 2024-09-12T17:28:58.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.520+0000 7f150bcdb640 1 -- 172.21.15.170:0/3317998666 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94803041192352] v31'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1504052020 con 0x56390d9763a0 2024-09-12T17:28:58.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.520+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v31'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1500061430 con 0x56390d971990 2024-09-12T17:28:58.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.520+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94803041202544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56390d983640 con 0x56390d971990 2024-09-12T17:28:58.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.520+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56390d984100 con 0x7f15040442d0 2024-09-12T17:28:58.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.521+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(54 notify.5 [create] v31'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1500061430 con 0x7f15040442d0 2024-09-12T17:28:58.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.521+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94803041205264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56390d984030 con 0x7f15040442d0 2024-09-12T17:28:58.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.521+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56390d985050 con 0x7f15040442d0 2024-09-12T17:28:58.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.521+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94803041202544] v31'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1500061430 con 0x56390d971990 2024-09-12T17:28:58.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.523+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94803041205264] v31'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1500061430 con 0x7f15040442d0 2024-09-12T17:28:58.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.523+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v31'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1500061430 con 0x7f15040442d0 2024-09-12T17:28:58.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.523+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94803041209152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56390d9844a0 con 0x7f15040442d0 2024-09-12T17:28:58.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.523+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56390d9854c0 con 0x7f15040442d0 2024-09-12T17:28:58.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.524+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(58 notify.7 [create] v31'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1500061430 con 0x7f15040442d0 2024-09-12T17:28:58.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.524+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94803041209152] v31'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1500061430 con 0x7f15040442d0 2024-09-12T17:28:58.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.524+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94803041210384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56390d9858e0 con 0x7f15040442d0 2024-09-12T17:28:58.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.524+0000 7f150f72c800 20 add_watcher() i=0 2024-09-12T17:28:58.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.524+0000 7f150f72c800 20 add_watcher() i=1 2024-09-12T17:28:58.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.524+0000 7f150f72c800 20 add_watcher() i=2 2024-09-12T17:28:58.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.524+0000 7f150f72c800 20 add_watcher() i=3 2024-09-12T17:28:58.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.524+0000 7f150f72c800 20 add_watcher() i=4 2024-09-12T17:28:58.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.524+0000 7f150f72c800 20 add_watcher() i=5 2024-09-12T17:28:58.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.524+0000 7f150f72c800 20 add_watcher() i=6 2024-09-12T17:28:58.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.525+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94803041210384] v31'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1500061430 con 0x7f15040442d0 2024-09-12T17:28:58.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.525+0000 7f150f72c800 20 add_watcher() i=7 2024-09-12T17:28:58.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.525+0000 7f150f72c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:58.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.525+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d9858e0 con 0x56390d971990 2024-09-12T17:28:58.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.526+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1500061430 con 0x56390d971990 2024-09-12T17:28:58.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.526+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94803041211440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56390d985850 con 0x56390d971990 2024-09-12T17:28:58.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.527+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94803041211440] v31'197 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1500061430 con 0x56390d971990 2024-09-12T17:28:58.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.527+0000 7f13c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:58.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.527+0000 7f150f72c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:58.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.527+0000 7f150f72c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:58.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.527+0000 7f150f72c800 5 note: GC not initialized 2024-09-12T17:28:58.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.527+0000 7f13c0fe1640 20 reqs_thread_entry: start 2024-09-12T17:28:58.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.527+0000 7f150f72c800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:58.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.527+0000 7f150f72c800 20 Filter name: none 2024-09-12T17:28:58.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.527+0000 7f133a7fc640 20 reqs_thread_entry: start 2024-09-12T17:28:58.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.527+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d9bbf60 con 0x56390d971990 2024-09-12T17:28:58.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.528+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f1500061430 con 0x56390d971990 2024-09-12T17:28:58.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.528+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d9bbf60 con 0x56390d9763a0 2024-09-12T17:28:58.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.528+0000 7f150bcdb640 1 -- 172.21.15.170:0/3317998666 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f1504052020 con 0x56390d9763a0 2024-09-12T17:28:58.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.528+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d9bbf20 con 0x56390d971990 2024-09-12T17:28:58.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.528+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f1500061430 con 0x56390d971990 2024-09-12T17:28:58.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.528+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d9bbf20 con 0x56390d97ad10 2024-09-12T17:28:58.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.528+0000 7f150b4da640 1 -- 172.21.15.170:0/3317998666 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f14fc018950 con 0x56390d97ad10 2024-09-12T17:28:58.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.528+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d9bc430 con 0x56390d97ad10 2024-09-12T17:28:58.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.529+0000 7f150b4da640 1 -- 172.21.15.170:0/3317998666 <== osd.3 v2:172.21.15.170:6816/2664906588 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f14fc018950 con 0x56390d97ad10 2024-09-12T17:28:58.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.529+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d9bc430 con 0x56390d97ad10 2024-09-12T17:28:58.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.529+0000 7f150b4da640 1 -- 172.21.15.170:0/3317998666 <== osd.3 v2:172.21.15.170:6816/2664906588 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f14fc018950 con 0x56390d97ad10 2024-09-12T17:28:58.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.529+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d9bc430 con 0x56390d971990 2024-09-12T17:28:58.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.529+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f1500061430 con 0x56390d971990 2024-09-12T17:28:58.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.529+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d9bc430 con 0x56390d971990 2024-09-12T17:28:58.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.529+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f1500061430 con 0x56390d971990 2024-09-12T17:28:58.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.529+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d9bc3e0 con 0x56390d97ad10 2024-09-12T17:28:58.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.529+0000 7f150b4da640 1 -- 172.21.15.170:0/3317998666 <== osd.3 v2:172.21.15.170:6816/2664906588 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f14fc018950 con 0x56390d97ad10 2024-09-12T17:28:58.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.529+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d9bc3e0 con 0x56390d97ad10 2024-09-12T17:28:58.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.530+0000 7f150b4da640 1 -- 172.21.15.170:0/3317998666 <== osd.3 v2:172.21.15.170:6816/2664906588 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f14fc018950 con 0x56390d97ad10 2024-09-12T17:28:58.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.530+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d9bc3e0 con 0x7f15040442d0 2024-09-12T17:28:58.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.530+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(72 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f1500061430 con 0x7f15040442d0 2024-09-12T17:28:58.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.530+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d9bb970 con 0x56390d971990 2024-09-12T17:28:58.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.530+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1500061430 con 0x56390d971990 2024-09-12T17:28:58.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.530+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d9bb970 con 0x56390d9763a0 2024-09-12T17:28:58.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.531+0000 7f150bcdb640 1 -- 172.21.15.170:0/3317998666 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1504052020 con 0x56390d9763a0 2024-09-12T17:28:58.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.531+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d9bb970 con 0x56390d97ad10 2024-09-12T17:28:58.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.531+0000 7f150b4da640 1 -- 172.21.15.170:0/3317998666 <== osd.3 v2:172.21.15.170:6816/2664906588 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f14fc018950 con 0x56390d97ad10 2024-09-12T17:28:58.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.531+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d9bb970 con 0x7f15040442d0 2024-09-12T17:28:58.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.531+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1500061430 con 0x7f15040442d0 2024-09-12T17:28:58.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.531+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d9bb970 con 0x7f15040442d0 2024-09-12T17:28:58.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.532+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1500061430 con 0x7f15040442d0 2024-09-12T17:28:58.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.532+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d9bb970 con 0x56390d97ad10 2024-09-12T17:28:58.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.532+0000 7f150b4da640 1 -- 172.21.15.170:0/3317998666 <== osd.3 v2:172.21.15.170:6816/2664906588 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f14fc018950 con 0x56390d97ad10 2024-09-12T17:28:58.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.532+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d9bb970 con 0x7f15040442d0 2024-09-12T17:28:58.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.532+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(79 usage.17 [call out=185b] v0'0 uv5 ondisk = 0) ==== 152+0+185 (crc 0 0 0) 0x7f1500061430 con 0x7f15040442d0 2024-09-12T17:28:58.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.532+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d9bb970 con 0x56390d971990 2024-09-12T17:28:58.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.533+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1500061430 con 0x56390d971990 2024-09-12T17:28:58.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.533+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d9bb970 con 0x56390d97ad10 2024-09-12T17:28:58.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.533+0000 7f150b4da640 1 -- 172.21.15.170:0/3317998666 <== osd.3 v2:172.21.15.170:6816/2664906588 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f14fc018950 con 0x56390d97ad10 2024-09-12T17:28:58.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.533+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d9bb970 con 0x7f15040442d0 2024-09-12T17:28:58.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.533+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1500061430 con 0x7f15040442d0 2024-09-12T17:28:58.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.533+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d9bb970 con 0x56390d9763a0 2024-09-12T17:28:58.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.533+0000 7f150bcdb640 1 -- 172.21.15.170:0/3317998666 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1504052020 con 0x56390d9763a0 2024-09-12T17:28:58.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.533+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d9bb970 con 0x7f15040442d0 2024-09-12T17:28:58.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.534+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1500061430 con 0x7f15040442d0 2024-09-12T17:28:58.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.534+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d9bb970 con 0x56390d971990 2024-09-12T17:28:58.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.534+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1500061430 con 0x56390d971990 2024-09-12T17:28:58.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.534+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d9bb970 con 0x56390d971990 2024-09-12T17:28:58.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.534+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1500061430 con 0x56390d971990 2024-09-12T17:28:58.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.534+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d9bb970 con 0x56390d97ad10 2024-09-12T17:28:58.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.534+0000 7f150b4da640 1 -- 172.21.15.170:0/3317998666 <== osd.3 v2:172.21.15.170:6816/2664906588 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f14fc018950 con 0x56390d97ad10 2024-09-12T17:28:58.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.534+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d9bb970 con 0x56390d971990 2024-09-12T17:28:58.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.535+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1500061430 con 0x56390d971990 2024-09-12T17:28:58.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.535+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d9bb970 con 0x56390d971990 2024-09-12T17:28:58.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.535+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.1 v2:172.21.15.170:6800/1903654092 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1500061430 con 0x56390d971990 2024-09-12T17:28:58.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.535+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d9bb970 con 0x56390d97ad10 2024-09-12T17:28:58.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.535+0000 7f150b4da640 1 -- 172.21.15.170:0/3317998666 <== osd.3 v2:172.21.15.170:6816/2664906588 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f14fc018950 con 0x56390d97ad10 2024-09-12T17:28:58.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.535+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d9bb970 con 0x56390d97ad10 2024-09-12T17:28:58.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.535+0000 7f150b4da640 1 -- 172.21.15.170:0/3317998666 <== osd.3 v2:172.21.15.170:6816/2664906588 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f14fc018950 con 0x56390d97ad10 2024-09-12T17:28:58.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.535+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d9bb970 con 0x56390d97ad10 2024-09-12T17:28:58.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.536+0000 7f150b4da640 1 -- 172.21.15.170:0/3317998666 <== osd.3 v2:172.21.15.170:6816/2664906588 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f14fc018950 con 0x56390d97ad10 2024-09-12T17:28:58.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.536+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56390d9bb970 con 0x7f15040442d0 2024-09-12T17:28:58.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.536+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.0 v2:172.21.15.47:6800/3978157098 22 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1500061430 con 0x7f15040442d0 2024-09-12T17:28:58.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.537+0000 7f13c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:58.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.537+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94803041211440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56390d9bcf30 con 0x56390d971990 2024-09-12T17:28:58.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.538+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.1 v2:172.21.15.170:6800/1903654092 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94803041211440] v31'198 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1500061430 con 0x56390d971990 2024-09-12T17:28:58.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.538+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94803041185696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56390d9b9370 con 0x56390d9763a0 2024-09-12T17:28:58.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.539+0000 7f150bcdb640 1 -- 172.21.15.170:0/3317998666 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94803041185696] v31'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1504052020 con 0x56390d9763a0 2024-09-12T17:28:58.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.539+0000 7f150f72c800 20 remove_watcher() i=0 2024-09-12T17:28:58.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.539+0000 7f150f72c800 2 removed watcher, disabling cache 2024-09-12T17:28:58.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.539+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94803041190224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56390d9b9370 con 0x56390d971990 2024-09-12T17:28:58.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.540+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.1 v2:172.21.15.170:6800/1903654092 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94803041190224] v31'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1500061430 con 0x56390d971990 2024-09-12T17:28:58.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.540+0000 7f150f72c800 20 remove_watcher() i=1 2024-09-12T17:28:58.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.540+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94803041195264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56390d9b9370 con 0x56390d97ad10 2024-09-12T17:28:58.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.541+0000 7f150b4da640 1 -- 172.21.15.170:0/3317998666 <== osd.3 v2:172.21.15.170:6816/2664906588 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94803041195264] v31'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14fc018950 con 0x56390d97ad10 2024-09-12T17:28:58.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.541+0000 7f150f72c800 20 remove_watcher() i=2 2024-09-12T17:28:58.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.542+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94803041192352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56390d9b9370 con 0x56390d9763a0 2024-09-12T17:28:58.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.542+0000 7f150bcdb640 1 -- 172.21.15.170:0/3317998666 <== osd.2 v2:172.21.15.170:6808/3855567754 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94803041192352] v31'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1504052020 con 0x56390d9763a0 2024-09-12T17:28:58.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.542+0000 7f150f72c800 20 remove_watcher() i=3 2024-09-12T17:28:58.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.542+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94803041202544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56390d9b9370 con 0x56390d971990 2024-09-12T17:28:58.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.544+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.1 v2:172.21.15.170:6800/1903654092 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94803041202544] v31'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1500061430 con 0x56390d971990 2024-09-12T17:28:58.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.544+0000 7f150f72c800 20 remove_watcher() i=4 2024-09-12T17:28:58.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.544+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94803041205264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56390d9b9370 con 0x7f15040442d0 2024-09-12T17:28:58.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.545+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.0 v2:172.21.15.47:6800/3978157098 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94803041205264] v31'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1500061430 con 0x7f15040442d0 2024-09-12T17:28:58.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.545+0000 7f150f72c800 20 remove_watcher() i=5 2024-09-12T17:28:58.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.545+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94803041209152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56390d9b9370 con 0x7f15040442d0 2024-09-12T17:28:58.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.546+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.0 v2:172.21.15.47:6800/3978157098 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94803041209152] v31'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1500061430 con 0x7f15040442d0 2024-09-12T17:28:58.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.546+0000 7f150f72c800 20 remove_watcher() i=6 2024-09-12T17:28:58.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.546+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94803041210384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56390d9b9370 con 0x7f15040442d0 2024-09-12T17:28:58.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.547+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 <== osd.0 v2:172.21.15.47:6800/3978157098 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94803041210384] v31'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1500061430 con 0x7f15040442d0 2024-09-12T17:28:58.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.547+0000 7f150f72c800 20 remove_watcher() i=7 2024-09-12T17:28:58.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.547+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f15040442d0 msgr2=0x7f150403b3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.547+0000 7f150f72c800 1 --2- 172.21.15.170:0/3317998666 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f15040442d0 0x7f150403b3f0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.547+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56390d971990 msgr2=0x56390d973e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.547+0000 7f150f72c800 1 --2- 172.21.15.170:0/3317998666 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56390d971990 0x56390d973e50 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.547+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56390d9763a0 msgr2=0x56390d978790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.547+0000 7f150f72c800 1 --2- 172.21.15.170:0/3317998666 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56390d9763a0 0x56390d978790 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.547+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x56390d97ad10 msgr2=0x56390d97d1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.547+0000 7f150f72c800 1 --2- 172.21.15.170:0/3317998666 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x56390d97ad10 0x56390d97d1d0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.547+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f13d403c6e0 msgr2=0x7f13d403eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.547+0000 7f150f72c800 1 --2- 172.21.15.170:0/3317998666 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f13d403c6e0 0x7f13d403eba0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f14fc04b650 tx=0x7f14fc02f000 comp rx=0 tx=0).stop 2024-09-12T17:28:58.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.547+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56390d95e930 msgr2=0x56390d965f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.547+0000 7f150f72c800 1 --2- 172.21.15.170:0/3317998666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56390d95e930 0x56390d965f20 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f1504052600 tx=0x7f1504053710 comp rx=0 tx=0).stop 2024-09-12T17:28:58.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.547+0000 7f150acd9640 1 -- 172.21.15.170:0/3317998666 reap_dead start 2024-09-12T17:28:58.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.547+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 shutdown_connections 2024-09-12T17:28:58.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.547+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 >> 172.21.15.170:0/3317998666 conn(0x56390d95ad30 msgr2=0x56390d958f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:58.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.547+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 shutdown_connections 2024-09-12T17:28:58.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.547+0000 7f150f72c800 1 -- 172.21.15.170:0/3317998666 wait complete. 2024-09-12T17:28:58.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.548+0000 7f150f72c800 1 -- 172.21.15.170:0/2683899935 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f13e403c780 msgr2=0x7f13e403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.548+0000 7f150f72c800 1 --2- 172.21.15.170:0/2683899935 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f13e403c780 0x7f13e403ec40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f14fc052150 tx=0x7f14fc017f90 comp rx=0 tx=0).stop 2024-09-12T17:28:58.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.548+0000 7f150f72c800 1 -- 172.21.15.170:0/2683899935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56390d951e50 msgr2=0x56390d952270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.548+0000 7f150f72c800 1 --2- 172.21.15.170:0/2683899935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56390d951e50 0x56390d952270 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x56390d9383a0 tx=0x7f1504018c80 comp rx=0 tx=0).stop 2024-09-12T17:28:58.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.548+0000 7f150f72c800 1 -- 172.21.15.170:0/2683899935 shutdown_connections 2024-09-12T17:28:58.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.548+0000 7f150f72c800 1 --2- 172.21.15.170:0/2683899935 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f13e403c780 0x7f13e403ec40 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.548+0000 7f150f72c800 1 --2- 172.21.15.170:0/2683899935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56390d951e50 0x56390d952270 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.548+0000 7f150f72c800 1 -- 172.21.15.170:0/2683899935 >> 172.21.15.170:0/2683899935 conn(0x56390d946200 msgr2=0x56390d9465e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:58.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.548+0000 7f150f72c800 1 -- 172.21.15.170:0/2683899935 shutdown_connections 2024-09-12T17:28:58.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.548+0000 7f150f72c800 1 -- 172.21.15.170:0/2683899935 wait complete. 2024-09-12T17:28:58.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.548+0000 7f150f72c800 1 -- 172.21.15.170:0/1237503361 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56390d83dff0 msgr2=0x56390d93e630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.548+0000 7f150f72c800 1 --2- 172.21.15.170:0/1237503361 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56390d83dff0 0x56390d93e630 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.548+0000 7f150f72c800 1 -- 172.21.15.170:0/1237503361 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56390d940b20 msgr2=0x56390d942f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.548+0000 7f150f72c800 1 --2- 172.21.15.170:0/1237503361 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56390d940b20 0x56390d942f10 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.548+0000 7f150f72c800 1 -- 172.21.15.170:0/1237503361 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f13f003c7d0 msgr2=0x7f13f003ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.548+0000 7f150f72c800 1 --2- 172.21.15.170:0/1237503361 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f13f003c7d0 0x7f13f003ec90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x56390d7b0460 tx=0x7f1500050000 comp rx=0 tx=0).stop 2024-09-12T17:28:58.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.548+0000 7f150f72c800 1 -- 172.21.15.170:0/1237503361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56390d83c4d0 msgr2=0x56390d936fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.548+0000 7f150f72c800 1 --2- 172.21.15.170:0/1237503361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56390d83c4d0 0x56390d936fe0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x56390d930620 tx=0x7f14fc0040e0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.548+0000 7f150f72c800 1 -- 172.21.15.170:0/1237503361 shutdown_connections 2024-09-12T17:28:58.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.548+0000 7f150f72c800 1 --2- 172.21.15.170:0/1237503361 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56390d940b20 0x56390d942f10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.548+0000 7f150f72c800 1 --2- 172.21.15.170:0/1237503361 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f13f003c7d0 0x7f13f003ec90 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.548+0000 7f150f72c800 1 --2- 172.21.15.170:0/1237503361 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56390d83dff0 0x56390d93e630 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.548+0000 7f150f72c800 1 --2- 172.21.15.170:0/1237503361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56390d83c4d0 0x56390d936fe0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.548+0000 7f150f72c800 1 -- 172.21.15.170:0/1237503361 >> 172.21.15.170:0/1237503361 conn(0x56390d8381c0 msgr2=0x56390d930970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:58.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.548+0000 7f150f72c800 1 -- 172.21.15.170:0/1237503361 shutdown_connections 2024-09-12T17:28:58.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.548+0000 7f150f72c800 1 -- 172.21.15.170:0/1237503361 wait complete. 2024-09-12T17:28:58.558 INFO:teuthology.orchestra.run.smithi170.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"anonymous","categories":[],"s3select":{}}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0,"bytes_processed":0,"bytes_returned":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-12T17:28:58.559 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'anonymous', 'categories': [], 's3select': {}}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T17:28:58.559 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-12T17:28:58.559 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-12T17:28:58.559 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-12T17:28:58.602 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:58.602 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:58.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.602+0000 7f5a7f175800 1 Processor -- start 2024-09-12T17:28:58.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.602+0000 7f5a7f175800 1 -- start start 2024-09-12T17:28:58.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.602+0000 7f5a7f175800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55c35cca5200 0x55c35cca76c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.602+0000 7f5a7f175800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c35cb4ae40 con 0x55c35cca1600 2024-09-12T17:28:58.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.602+0000 7f5a7f175800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x55c35cb15680 con 0x55c35cca5200 2024-09-12T17:28:58.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.602+0000 7f5a77fff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55c35cca5200 0x55c35cca76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.602+0000 7f5a77fff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55c35cca5200 0x55c35cca76c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59496/0 (socket says 172.21.15.170:59496) 2024-09-12T17:28:58.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.602+0000 7f5a77fff640 1 -- 172.21.15.170:0/3761883130 learned_addr learned my addr 172.21.15.170:0/3761883130 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:58.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.602+0000 7f5a7cc5f640 1 --1- 172.21.15.170:0/3761883130 >> v1:172.21.15.47:6789/0 conn(0x55c35cca1600 0x55c35cca39f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:57356/0 (socket says 172.21.15.170:57356) 2024-09-12T17:28:58.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.603+0000 7f5a77fff640 1 -- 172.21.15.170:0/3761883130 >> v1:172.21.15.47:6789/0 conn(0x55c35cca1600 legacy=0x55c35cca39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.603+0000 7f5a77fff640 1 -- 172.21.15.170:0/3761883130 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c35cb316b0 con 0x55c35cca5200 2024-09-12T17:28:58.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.604+0000 7f5a77fff640 1 --2- 172.21.15.170:0/3761883130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c35cca5200 0x55c35cca76c0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5a6800a520 tx=0x7f5a68045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1befbfe1c2b9b87 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.605+0000 7f5a777fe640 1 -- 172.21.15.170:0/3761883130 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a68055070 con 0x55c35cca5200 2024-09-12T17:28:58.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.605+0000 7f5a777fe640 1 -- 172.21.15.170:0/3761883130 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a680515b0 con 0x55c35cca5200 2024-09-12T17:28:58.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.605+0000 7f5a777fe640 1 -- 172.21.15.170:0/3761883130 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a680518d0 con 0x55c35cca5200 2024-09-12T17:28:58.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.605+0000 7f5a7f175800 1 -- 172.21.15.170:0/3761883130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c35cca5200 msgr2=0x55c35cca76c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.605+0000 7f5a7f175800 1 --2- 172.21.15.170:0/3761883130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c35cca5200 0x55c35cca76c0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5a6800a520 tx=0x7f5a68045ba0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.605+0000 7f5a7f175800 1 -- 172.21.15.170:0/3761883130 shutdown_connections 2024-09-12T17:28:58.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.605+0000 7f5a7f175800 1 --2- 172.21.15.170:0/3761883130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c35cca5200 0x55c35cca76c0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.605+0000 7f5a7f175800 1 -- 172.21.15.170:0/3761883130 >> 172.21.15.170:0/3761883130 conn(0x55c35cc9b1e0 msgr2=0x55c35cc9d620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:58.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.605+0000 7f5a7f175800 1 -- 172.21.15.170:0/3761883130 shutdown_connections 2024-09-12T17:28:58.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.605+0000 7f5a7f175800 1 -- 172.21.15.170:0/3761883130 wait complete. 2024-09-12T17:28:58.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.619+0000 7f5a7f175800 1 Processor -- start 2024-09-12T17:28:58.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.619+0000 7f5a7f175800 1 -- start start 2024-09-12T17:28:58.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.619+0000 7f5a7f175800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c35cca1600 0x55c35cd90620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.619+0000 7f5a7f175800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c35cb39dd0 con 0x55c35cca1600 2024-09-12T17:28:58.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.619+0000 7f5a7cc5f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c35cca1600 0x55c35cd90620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.619+0000 7f5a7cc5f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c35cca1600 0x55c35cd90620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59498/0 (socket says 172.21.15.170:59498) 2024-09-12T17:28:58.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.619+0000 7f5a7cc5f640 1 -- 172.21.15.170:0/3084744730 learned_addr learned my addr 172.21.15.170:0/3084744730 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:58.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.620+0000 7f5a7cc5f640 1 -- 172.21.15.170:0/3084744730 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c35cb52e10 con 0x55c35cca1600 2024-09-12T17:28:58.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.620+0000 7f5a7cc5f640 1 --2- 172.21.15.170:0/3084744730 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c35cca1600 0x55c35cd90620 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f5a7000b260 tx=0x7f5a7000b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7b66d52f4b0e338 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.620+0000 7f596ae05640 1 -- 172.21.15.170:0/3084744730 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a7000be60 con 0x55c35cca1600 2024-09-12T17:28:58.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.620+0000 7f596ae05640 1 -- 172.21.15.170:0/3084744730 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a70006070 con 0x55c35cca1600 2024-09-12T17:28:58.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.620+0000 7f596ae05640 1 -- 172.21.15.170:0/3084744730 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a7000e710 con 0x55c35cca1600 2024-09-12T17:28:58.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.621+0000 7f5a7f175800 1 -- 172.21.15.170:0/3084744730 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c35cca1600 msgr2=0x55c35cd90620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.621+0000 7f5a7f175800 1 --2- 172.21.15.170:0/3084744730 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c35cca1600 0x55c35cd90620 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f5a7000b260 tx=0x7f5a7000b660 comp rx=0 tx=0).stop 2024-09-12T17:28:58.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.621+0000 7f5a7f175800 1 -- 172.21.15.170:0/3084744730 shutdown_connections 2024-09-12T17:28:58.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.621+0000 7f5a7f175800 1 --2- 172.21.15.170:0/3084744730 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c35cca1600 0x55c35cd90620 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.621+0000 7f5a7f175800 1 -- 172.21.15.170:0/3084744730 >> 172.21.15.170:0/3084744730 conn(0x55c35cc9b1e0 msgr2=0x55c35cd8bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:58.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.621+0000 7f5a7f175800 1 -- 172.21.15.170:0/3084744730 shutdown_connections 2024-09-12T17:28:58.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.621+0000 7f5a7f175800 1 -- 172.21.15.170:0/3084744730 wait complete. 2024-09-12T17:28:58.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.621+0000 7f5a7f175800 1 Processor -- start 2024-09-12T17:28:58.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.622+0000 7f5a7f175800 1 -- start start 2024-09-12T17:28:58.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.622+0000 7f5a7f175800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c35cca5200 0x55c35cd98240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.622+0000 7f5a7f175800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c35cca8040 con 0x55c35cca5200 2024-09-12T17:28:58.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.622+0000 7f5a7cc5f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c35cca5200 0x55c35cd98240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.622+0000 7f5a7cc5f640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c35cca5200 0x55c35cd98240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59510/0 (socket says 172.21.15.170:59510) 2024-09-12T17:28:58.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.622+0000 7f5a7cc5f640 1 -- 172.21.15.170:0/1242661803 learned_addr learned my addr 172.21.15.170:0/1242661803 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:58.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.622+0000 7f5a7cc5f640 1 -- 172.21.15.170:0/1242661803 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c35cd987a0 con 0x55c35cca5200 2024-09-12T17:28:58.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.622+0000 7f5a7cc5f640 1 --2- 172.21.15.170:0/1242661803 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c35cca5200 0x55c35cd98240 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x55c35cd915b0 tx=0x7f5a70000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.623+0000 7f5969602640 1 -- 172.21.15.170:0/1242661803 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a70001560 con 0x55c35cca5200 2024-09-12T17:28:58.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.623+0000 7f5969602640 1 -- 172.21.15.170:0/1242661803 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a7000ee10 con 0x55c35cca5200 2024-09-12T17:28:58.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.623+0000 7f5a7f175800 1 -- 172.21.15.170:0/1242661803 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c35cd98a30 con 0x55c35cca5200 2024-09-12T17:28:58.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.623+0000 7f5969602640 1 -- 172.21.15.170:0/1242661803 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a7000fb00 con 0x55c35cca5200 2024-09-12T17:28:58.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.623+0000 7f5a7f175800 1 -- 172.21.15.170:0/1242661803 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c35cd99430 con 0x55c35cca5200 2024-09-12T17:28:58.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.624+0000 7f5969602640 1 -- 172.21.15.170:0/1242661803 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f5a70017070 con 0x55c35cca5200 2024-09-12T17:28:58.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.624+0000 7f5969602640 1 --2- 172.21.15.170:0/1242661803 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f596403c780 0x7f596403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.624+0000 7f5969602640 1 -- 172.21.15.170:0/1242661803 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f5a70015020 con 0x55c35cca5200 2024-09-12T17:28:58.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.624+0000 7f5a77fff640 1 --2- 172.21.15.170:0/1242661803 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f596403c780 0x7f596403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.624+0000 7f5a7f175800 1 --2- 172.21.15.170:0/1242661803 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55c35cd99f30 0x55c35cd9f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.624+0000 7f5a7f175800 1 -- 172.21.15.170:0/1242661803 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35cd9fe20 con 0x55c35cd99f30 2024-09-12T17:28:58.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.624+0000 7f5a7d460640 1 --2- 172.21.15.170:0/1242661803 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55c35cd99f30 0x55c35cd9f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.624+0000 7f5a77fff640 1 --2- 172.21.15.170:0/1242661803 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f596403c780 0x7f596403ec40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5a68057000 tx=0x7f5a68052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.624+0000 7f5a7d460640 1 --2- 172.21.15.170:0/1242661803 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55c35cd99f30 0x55c35cd9f890 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.625+0000 7f5a7d460640 1 -- 172.21.15.170:0/1242661803 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5a7800a4d0 con 0x55c35cd99f30 2024-09-12T17:28:58.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.625+0000 7f5a7f175800 1 -- 172.21.15.170:0/1242661803 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35cd998e0 con 0x55c35cd99f30 2024-09-12T17:28:58.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.625+0000 7f5a7d460640 1 -- 172.21.15.170:0/1242661803 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5a7800a4d0 con 0x55c35cd99f30 2024-09-12T17:28:58.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.625+0000 7f5a7f175800 1 --2- 172.21.15.170:0/1242661803 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55c35cda2170 0x55c35cda4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.625+0000 7f5a7f175800 1 -- 172.21.15.170:0/1242661803 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35cda4c30 con 0x55c35cda2170 2024-09-12T17:28:58.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.625+0000 7f5a7cc5f640 1 --2- 172.21.15.170:0/1242661803 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55c35cda2170 0x55c35cda4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.625+0000 7f5a7cc5f640 1 --2- 172.21.15.170:0/1242661803 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55c35cda2170 0x55c35cda4560 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.626+0000 7f5a7cc5f640 1 -- 172.21.15.170:0/1242661803 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5a7002e070 con 0x55c35cda2170 2024-09-12T17:28:58.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.626+0000 7f5a7f175800 1 -- 172.21.15.170:0/1242661803 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35cda0fe0 con 0x55c35cd99f30 2024-09-12T17:28:58.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.626+0000 7f5a7d460640 1 -- 172.21.15.170:0/1242661803 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5a7800a4d0 con 0x55c35cd99f30 2024-09-12T17:28:58.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.626+0000 7f5a7f175800 1 -- 172.21.15.170:0/1242661803 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35cda1480 con 0x55c35cda2170 2024-09-12T17:28:58.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.626+0000 7f5a7cc5f640 1 -- 172.21.15.170:0/1242661803 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5a7002e070 con 0x55c35cda2170 2024-09-12T17:28:58.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.627+0000 7f5a7f175800 1 Processor -- start 2024-09-12T17:28:58.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.627+0000 7f5a7f175800 1 -- start start 2024-09-12T17:28:58.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.627+0000 7f5a7f175800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c35cdb3420 0x55c35cdb3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.627+0000 7f5a7f175800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c35cb97a00 con 0x55c35cdb3420 2024-09-12T17:28:58.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.627+0000 7f5a7d460640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c35cdb3420 0x55c35cdb3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.627+0000 7f5a7d460640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c35cdb3420 0x55c35cdb3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59518/0 (socket says 172.21.15.170:59518) 2024-09-12T17:28:58.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.627+0000 7f5a7d460640 1 -- 172.21.15.170:0/2651772960 learned_addr learned my addr 172.21.15.170:0/2651772960 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:58.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.627+0000 7f5a7d460640 1 -- 172.21.15.170:0/2651772960 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c35cdb3e80 con 0x55c35cdb3420 2024-09-12T17:28:58.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.628+0000 7f5a7d460640 1 --2- 172.21.15.170:0/2651772960 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c35cdb3420 0x55c35cdb3840 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x55c35cd99240 tx=0x7f5a780167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.628+0000 7f59627fc640 1 -- 172.21.15.170:0/2651772960 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a78013640 con 0x55c35cdb3420 2024-09-12T17:28:58.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.628+0000 7f59627fc640 1 -- 172.21.15.170:0/2651772960 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a780137e0 con 0x55c35cdb3420 2024-09-12T17:28:58.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.628+0000 7f5a7f175800 1 -- 172.21.15.170:0/2651772960 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c35cdb46b0 con 0x55c35cdb3420 2024-09-12T17:28:58.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.628+0000 7f59627fc640 1 -- 172.21.15.170:0/2651772960 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a78013ac0 con 0x55c35cdb3420 2024-09-12T17:28:58.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.628+0000 7f5a7f175800 1 -- 172.21.15.170:0/2651772960 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c35cdb4c50 con 0x55c35cdb3420 2024-09-12T17:28:58.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.629+0000 7f59627fc640 1 -- 172.21.15.170:0/2651772960 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f5a78011040 con 0x55c35cdb3420 2024-09-12T17:28:58.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.629+0000 7f59627fc640 1 --2- 172.21.15.170:0/2651772960 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f595403c730 0x7f595403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.629+0000 7f59627fc640 1 -- 172.21.15.170:0/2651772960 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f5a7800e040 con 0x55c35cdb3420 2024-09-12T17:28:58.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.629+0000 7f5a7cc5f640 1 --2- 172.21.15.170:0/2651772960 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f595403c730 0x7f595403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.629+0000 7f5a7f175800 1 Processor -- start 2024-09-12T17:28:58.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.629+0000 7f5a7cc5f640 1 --2- 172.21.15.170:0/2651772960 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f595403c730 0x7f595403ebf0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5a70017b00 tx=0x7f5a700179c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.629+0000 7f5a7f175800 1 -- start start 2024-09-12T17:28:58.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.630+0000 7f5a7f175800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c35cdbfe60 0x55c35cdc0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.630+0000 7f5a7f175800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c35cd90e70 con 0x55c35cdbfe60 2024-09-12T17:28:58.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.630+0000 7f5a7d460640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c35cdbfe60 0x55c35cdc0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.630+0000 7f5a7d460640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c35cdbfe60 0x55c35cdc0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59520/0 (socket says 172.21.15.170:59520) 2024-09-12T17:28:58.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.630+0000 7f5a7d460640 1 -- 172.21.15.170:0/634033864 learned_addr learned my addr 172.21.15.170:0/634033864 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:58.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.630+0000 7f5a7d460640 1 -- 172.21.15.170:0/634033864 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c35cdc0850 con 0x55c35cdbfe60 2024-09-12T17:28:58.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.630+0000 7f5a7d460640 1 --2- 172.21.15.170:0/634033864 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c35cdbfe60 0x55c35cdc0260 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f5a78040fd0 tx=0x7f5a7801fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8776f216064592db server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.631+0000 7f5953fff640 1 -- 172.21.15.170:0/634033864 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a7804a070 con 0x55c35cdbfe60 2024-09-12T17:28:58.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.631+0000 7f5953fff640 1 -- 172.21.15.170:0/634033864 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a78055040 con 0x55c35cdbfe60 2024-09-12T17:28:58.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.631+0000 7f5953fff640 1 -- 172.21.15.170:0/634033864 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a78021a40 con 0x55c35cdbfe60 2024-09-12T17:28:58.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.631+0000 7f5a7f175800 1 -- 172.21.15.170:0/634033864 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c35cdbfe60 msgr2=0x55c35cdc0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.631+0000 7f5a7f175800 1 --2- 172.21.15.170:0/634033864 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c35cdbfe60 0x55c35cdc0260 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f5a78040fd0 tx=0x7f5a7801fc90 comp rx=0 tx=0).stop 2024-09-12T17:28:58.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.631+0000 7f5a7f175800 1 -- 172.21.15.170:0/634033864 shutdown_connections 2024-09-12T17:28:58.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.631+0000 7f5a7f175800 1 --2- 172.21.15.170:0/634033864 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c35cdbfe60 0x55c35cdc0260 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.631+0000 7f5a7f175800 1 -- 172.21.15.170:0/634033864 >> 172.21.15.170:0/634033864 conn(0x55c35cdbc280 msgr2=0x55c35cdba4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:58.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.631+0000 7f5a7f175800 1 -- 172.21.15.170:0/634033864 shutdown_connections 2024-09-12T17:28:58.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.631+0000 7f5a7f175800 1 -- 172.21.15.170:0/634033864 wait complete. 2024-09-12T17:28:58.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.631+0000 7f5a7f175800 1 Processor -- start 2024-09-12T17:28:58.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.631+0000 7f5a7f175800 1 -- start start 2024-09-12T17:28:58.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.632+0000 7f5a7f175800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c35cdbfe60 0x55c35cdc7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.632+0000 7f5a7f175800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c35cdc0e70 con 0x55c35cdbfe60 2024-09-12T17:28:58.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.632+0000 7f5a7d460640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c35cdbfe60 0x55c35cdc7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.632+0000 7f5a7d460640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c35cdbfe60 0x55c35cdc7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59534/0 (socket says 172.21.15.170:59534) 2024-09-12T17:28:58.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.632+0000 7f5a7d460640 1 -- 172.21.15.170:0/718712443 learned_addr learned my addr 172.21.15.170:0/718712443 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:58.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.632+0000 7f5a7d460640 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c35cdc79a0 con 0x55c35cdbfe60 2024-09-12T17:28:58.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.632+0000 7f5a7d460640 1 --2- 172.21.15.170:0/718712443 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c35cdbfe60 0x55c35cdc7440 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f5a78048040 tx=0x7f5a78053d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.632+0000 7f59527fc640 1 -- 172.21.15.170:0/718712443 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a78039070 con 0x55c35cdbfe60 2024-09-12T17:28:58.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.632+0000 7f59527fc640 1 -- 172.21.15.170:0/718712443 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a78013c60 con 0x55c35cdbfe60 2024-09-12T17:28:58.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.632+0000 7f59527fc640 1 -- 172.21.15.170:0/718712443 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a7804a040 con 0x55c35cdbfe60 2024-09-12T17:28:58.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.633+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c35cdc7c30 con 0x55c35cdbfe60 2024-09-12T17:28:58.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.633+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c35cdc87c0 con 0x55c35cdbfe60 2024-09-12T17:28:58.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.633+0000 7f59527fc640 1 -- 172.21.15.170:0/718712443 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f5a7803c070 con 0x55c35cdbfe60 2024-09-12T17:28:58.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.634+0000 7f59527fc640 1 --2- 172.21.15.170:0/718712443 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f594803c780 0x7f594803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.634+0000 7f59527fc640 1 -- 172.21.15.170:0/718712443 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f5a78031070 con 0x55c35cdbfe60 2024-09-12T17:28:58.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.634+0000 7f5a7cc5f640 1 --2- 172.21.15.170:0/718712443 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f594803c780 0x7f594803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.634+0000 7f5a7f175800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.634+0000 7f5a7f175800 1 --2- 172.21.15.170:0/718712443 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55c35cdd2da0 0x55c35cdd5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.634+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35cdd5980 con 0x55c35cdd2da0 2024-09-12T17:28:58.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.634+0000 7f5a77fff640 1 --2- 172.21.15.170:0/718712443 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55c35cdd2da0 0x55c35cdd5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.634+0000 7f5a7cc5f640 1 --2- 172.21.15.170:0/718712443 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f594803c780 0x7f594803ec40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5a7001afd0 tx=0x7f5a70028000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.635+0000 7f5a77fff640 1 --2- 172.21.15.170:0/718712443 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55c35cdd2da0 0x55c35cdd5230 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.635+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5a68057030 con 0x55c35cdd2da0 2024-09-12T17:28:58.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.635+0000 7f5a7f175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:58.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.635+0000 7f5a7f175800 20 realm 2024-09-12T17:28:58.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.635+0000 7f5a7f175800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.635+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35cdd5db0 con 0x55c35cdd2da0 2024-09-12T17:28:58.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.635+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5a68057030 con 0x55c35cdd2da0 2024-09-12T17:28:58.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.635+0000 7f5a7f175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:58.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.635+0000 7f5a7f175800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:58.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.635+0000 7f5a7f175800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.635+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35cdd6650 con 0x55c35cdd2da0 2024-09-12T17:28:58.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.635+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5a68057030 con 0x55c35cdd2da0 2024-09-12T17:28:58.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.635+0000 7f5a7f175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:58.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.635+0000 7f5a7f175800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.635+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35cdd69f0 con 0x55c35cdd2da0 2024-09-12T17:28:58.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.636+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5a68057030 con 0x55c35cdd2da0 2024-09-12T17:28:58.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.636+0000 7f5a7f175800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:58.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.636+0000 7f5a7f175800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.636+0000 7f5a7f175800 1 --2- 172.21.15.170:0/718712443 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55c35cdd7750 0x55c35cdd9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.636+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35cdda080 con 0x55c35cdd7750 2024-09-12T17:28:58.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.636+0000 7f5a7d460640 1 --2- 172.21.15.170:0/718712443 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55c35cdd7750 0x55c35cdd9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.636+0000 7f5a7d460640 1 --2- 172.21.15.170:0/718712443 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55c35cdd7750 0x55c35cdd9b40 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.636+0000 7f5a7d460640 1 -- 172.21.15.170:0/718712443 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5a7803b030 con 0x55c35cdd7750 2024-09-12T17:28:58.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.636+0000 7f5a7f175800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:58.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.636+0000 7f5a7f175800 20 searching for the correct realm 2024-09-12T17:28:58.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.636+0000 7f5a7f175800 1 --2- 172.21.15.170:0/718712443 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55c35cddc0e0 0x55c35cdde5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.636+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c35cddec70 con 0x55c35cddc0e0 2024-09-12T17:28:58.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.636+0000 7f5a7cc5f640 1 --2- 172.21.15.170:0/718712443 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55c35cddc0e0 0x55c35cdde5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.637+0000 7f5a7cc5f640 1 --2- 172.21.15.170:0/718712443 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55c35cddc0e0 0x55c35cdde5a0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.637+0000 7f5a7cc5f640 1 -- 172.21.15.170:0/718712443 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a7002e070 con 0x55c35cddc0e0 2024-09-12T17:28:58.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.637+0000 7f5a7cc5f640 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c35cddec70 con 0x55c35cdd7750 2024-09-12T17:28:58.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.637+0000 7f5a7d460640 1 -- 172.21.15.170:0/718712443 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a7803b030 con 0x55c35cdd7750 2024-09-12T17:28:58.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.637+0000 7f5a7d460640 1 --2- 172.21.15.170:0/718712443 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f5a7803e060 0x7f5a7803f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.637+0000 7f5a7d460640 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c35cddec70 con 0x7f5a7803e060 2024-09-12T17:28:58.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.637+0000 7f5a77fff640 1 --2- 172.21.15.170:0/718712443 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f5a7803e060 0x7f5a7803f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.638+0000 7f5a77fff640 1 --2- 172.21.15.170:0/718712443 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f5a7803e060 0x7f5a7803f450 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.638+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a68057030 con 0x7f5a7803e060 2024-09-12T17:28:58.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.638+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c35cddec70 con 0x55c35cdd2da0 2024-09-12T17:28:58.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.638+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a68057030 con 0x55c35cdd2da0 2024-09-12T17:28:58.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.638+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c35cddec70 con 0x55c35cdd2da0 2024-09-12T17:28:58.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.639+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a68057030 con 0x55c35cdd2da0 2024-09-12T17:28:58.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.639+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c35cddec70 con 0x7f5a7803e060 2024-09-12T17:28:58.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.639+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a68057030 con 0x7f5a7803e060 2024-09-12T17:28:58.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.639+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c35cddec70 con 0x7f5a7803e060 2024-09-12T17:28:58.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.639+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a68057030 con 0x7f5a7803e060 2024-09-12T17:28:58.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.639+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c35cddec70 con 0x55c35cdd7750 2024-09-12T17:28:58.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.640+0000 7f5a7d460640 1 -- 172.21.15.170:0/718712443 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a7803b030 con 0x55c35cdd7750 2024-09-12T17:28:58.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.640+0000 7f5a7d460640 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c35cddec70 con 0x55c35cddc0e0 2024-09-12T17:28:58.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.640+0000 7f5a7cc5f640 1 -- 172.21.15.170:0/718712443 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a7002e070 con 0x55c35cddc0e0 2024-09-12T17:28:58.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.640+0000 7f5a7cc5f640 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c35cddec70 con 0x55c35cdd2da0 2024-09-12T17:28:58.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.640+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a68057030 con 0x55c35cdd2da0 2024-09-12T17:28:58.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.640+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c35cddec70 con 0x7f5a7803e060 2024-09-12T17:28:58.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.641+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a68057030 con 0x7f5a7803e060 2024-09-12T17:28:58.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.641+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c35cddec70 con 0x55c35cdd2da0 2024-09-12T17:28:58.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.641+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a68057030 con 0x55c35cdd2da0 2024-09-12T17:28:58.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.641+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c35cddec70 con 0x55c35cdd7750 2024-09-12T17:28:58.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.641+0000 7f5a7d460640 1 -- 172.21.15.170:0/718712443 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f5a7803b030 con 0x55c35cdd7750 2024-09-12T17:28:58.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.641+0000 7f5a7d460640 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c35cddec70 con 0x55c35cddc0e0 2024-09-12T17:28:58.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.641+0000 7f5a7cc5f640 1 -- 172.21.15.170:0/718712443 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a7002e070 con 0x55c35cddc0e0 2024-09-12T17:28:58.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.641+0000 7f5a7cc5f640 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c35cddec70 con 0x55c35cddc0e0 2024-09-12T17:28:58.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.641+0000 7f5a7cc5f640 1 -- 172.21.15.170:0/718712443 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a7002e070 con 0x55c35cddc0e0 2024-09-12T17:28:58.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.641+0000 7f5a7cc5f640 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c35cddec70 con 0x55c35cdd7750 2024-09-12T17:28:58.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.642+0000 7f5a7d460640 1 -- 172.21.15.170:0/718712443 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a7803b030 con 0x55c35cdd7750 2024-09-12T17:28:58.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.642+0000 7f5a7d460640 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c35cddec70 con 0x55c35cddc0e0 2024-09-12T17:28:58.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.642+0000 7f5a7cc5f640 1 -- 172.21.15.170:0/718712443 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a7002e070 con 0x55c35cddc0e0 2024-09-12T17:28:58.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.642+0000 7f5a7cc5f640 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c35cddec70 con 0x55c35cddc0e0 2024-09-12T17:28:58.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.642+0000 7f5a7cc5f640 1 -- 172.21.15.170:0/718712443 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a7002e070 con 0x55c35cddc0e0 2024-09-12T17:28:58.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.642+0000 7f5a7cc5f640 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c35cddec70 con 0x55c35cdd2da0 2024-09-12T17:28:58.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.642+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a68057030 con 0x55c35cdd2da0 2024-09-12T17:28:58.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.642+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c35cddec70 con 0x55c35cdd2da0 2024-09-12T17:28:58.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.642+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5a68057030 con 0x55c35cdd2da0 2024-09-12T17:28:58.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.642+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c35cddec70 con 0x7f5a7803e060 2024-09-12T17:28:58.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.643+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a68057030 con 0x7f5a7803e060 2024-09-12T17:28:58.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.643+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c35cddec70 con 0x55c35cddc0e0 2024-09-12T17:28:58.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.643+0000 7f5a7cc5f640 1 -- 172.21.15.170:0/718712443 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a7002e070 con 0x55c35cddc0e0 2024-09-12T17:28:58.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.643+0000 7f5a7cc5f640 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c35cddec70 con 0x55c35cdd7750 2024-09-12T17:28:58.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.643+0000 7f5a7d460640 1 -- 172.21.15.170:0/718712443 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a78067040 con 0x55c35cdd7750 2024-09-12T17:28:58.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.643+0000 7f5a7d460640 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c35cddec70 con 0x55c35cdd2da0 2024-09-12T17:28:58.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.644+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a68057030 con 0x55c35cdd2da0 2024-09-12T17:28:58.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.644+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c35cddec70 con 0x7f5a7803e060 2024-09-12T17:28:58.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.644+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a68057030 con 0x7f5a7803e060 2024-09-12T17:28:58.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.644+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c35cddec70 con 0x55c35cddc0e0 2024-09-12T17:28:58.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.644+0000 7f5a7cc5f640 1 -- 172.21.15.170:0/718712443 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a7002e070 con 0x55c35cddc0e0 2024-09-12T17:28:58.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.644+0000 7f5a7cc5f640 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c35cddec70 con 0x7f5a7803e060 2024-09-12T17:28:58.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.644+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a68057030 con 0x7f5a7803e060 2024-09-12T17:28:58.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.644+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c35cddec70 con 0x55c35cdd7750 2024-09-12T17:28:58.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.645+0000 7f5a7d460640 1 -- 172.21.15.170:0/718712443 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a78067040 con 0x55c35cdd7750 2024-09-12T17:28:58.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.645+0000 7f5a7d460640 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c35cddec70 con 0x55c35cddc0e0 2024-09-12T17:28:58.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.645+0000 7f5a7cc5f640 1 -- 172.21.15.170:0/718712443 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a7002e070 con 0x55c35cddc0e0 2024-09-12T17:28:58.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.645+0000 7f5a7cc5f640 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c35cddec70 con 0x7f5a7803e060 2024-09-12T17:28:58.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.645+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a68057030 con 0x7f5a7803e060 2024-09-12T17:28:58.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.645+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c35cddec70 con 0x55c35cdd2da0 2024-09-12T17:28:58.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.645+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5a68057030 con 0x55c35cdd2da0 2024-09-12T17:28:58.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.646+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c35cddec70 con 0x55c35cdd7750 2024-09-12T17:28:58.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.646+0000 7f5a7d460640 1 -- 172.21.15.170:0/718712443 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(37 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5a78067040 con 0x55c35cdd7750 2024-09-12T17:28:58.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.646+0000 7f5a7f175800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:58.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.646+0000 7f5a7f175800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:58.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.646+0000 7f5a7f175800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:58.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.646+0000 7f5a7f175800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:58.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.646+0000 7f5a7f175800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:58.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.646+0000 7f5a7f175800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:58.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.646+0000 7f5a7f175800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.646+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35cddab60 con 0x55c35cdd2da0 2024-09-12T17:28:58.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.646+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5a68057030 con 0x55c35cdd2da0 2024-09-12T17:28:58.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.646+0000 7f5a7f175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:58.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.646+0000 7f5a7f175800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.646+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35cdda7a0 con 0x55c35cdd2da0 2024-09-12T17:28:58.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.646+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5a68057030 con 0x55c35cdd2da0 2024-09-12T17:28:58.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.646+0000 7f5a7f175800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:58.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.646+0000 7f5a7f175800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.646+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35cddb540 con 0x55c35cdd7750 2024-09-12T17:28:58.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.647+0000 7f5a7d460640 1 -- 172.21.15.170:0/718712443 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5a78067040 con 0x55c35cdd7750 2024-09-12T17:28:58.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.647+0000 7f5a7f175800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:58.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.647+0000 7f5a7f175800 20 zone default found 2024-09-12T17:28:58.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.647+0000 7f5a7f175800 4 Realm: () 2024-09-12T17:28:58.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.647+0000 7f5a7f175800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:58.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.647+0000 7f5a7f175800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:58.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.647+0000 7f5a7f175800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:58.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.647+0000 7f5a7f175800 20 zonegroup default 2024-09-12T17:28:58.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.647+0000 7f5a7f175800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.647+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35cddf5a0 con 0x7f5a7803e060 2024-09-12T17:28:58.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.647+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5a68057030 con 0x7f5a7803e060 2024-09-12T17:28:58.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.647+0000 7f5a7f175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:58.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.647+0000 7f5a7f175800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.647+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35cde1430 con 0x55c35cddc0e0 2024-09-12T17:28:58.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.647+0000 7f5a7cc5f640 1 -- 172.21.15.170:0/718712443 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5a7002e070 con 0x55c35cddc0e0 2024-09-12T17:28:58.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.647+0000 7f5a7f175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:58.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.647+0000 7f5a7f175800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.647+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35cde18c0 con 0x55c35cddc0e0 2024-09-12T17:28:58.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.647+0000 7f5a7cc5f640 1 -- 172.21.15.170:0/718712443 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5a7002e070 con 0x55c35cddc0e0 2024-09-12T17:28:58.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.647+0000 7f5a7f175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:58.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.647+0000 7f5a7f175800 20 started sync module instance, tier type = 2024-09-12T17:28:58.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.647+0000 7f5a7f175800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:58.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.647+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c35cde07d0 con 0x55c35cdd7750 2024-09-12T17:28:58.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.648+0000 7f5a7d460640 1 -- 172.21.15.170:0/718712443 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(44 notify.0 [create] v31'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a78067040 con 0x55c35cdd7750 2024-09-12T17:28:58.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.648+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94297565039824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c35cde07d0 con 0x55c35cdd7750 2024-09-12T17:28:58.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.648+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c35cde2440 con 0x55c35cdd2da0 2024-09-12T17:28:58.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.649+0000 7f5a7d460640 1 -- 172.21.15.170:0/718712443 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94297565039824] v31'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a78067040 con 0x55c35cdd7750 2024-09-12T17:28:58.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.650+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v31'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a68057030 con 0x55c35cdd2da0 2024-09-12T17:28:58.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.650+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94297565044496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c35cde07d0 con 0x55c35cdd2da0 2024-09-12T17:28:58.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.650+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c35cde2ef0 con 0x55c35cddc0e0 2024-09-12T17:28:58.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.651+0000 7f5a7cc5f640 1 -- 172.21.15.170:0/718712443 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v31'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a7002e070 con 0x55c35cddc0e0 2024-09-12T17:28:58.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.651+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94297565047248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c35cde3790 con 0x55c35cddc0e0 2024-09-12T17:28:58.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.651+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c35cde4250 con 0x55c35cdd7750 2024-09-12T17:28:58.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.651+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94297565044496] v31'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a68057030 con 0x55c35cdd2da0 2024-09-12T17:28:58.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.652+0000 7f5a7d460640 1 -- 172.21.15.170:0/718712443 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(50 notify.3 [create] v31'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a78067040 con 0x55c35cdd7750 2024-09-12T17:28:58.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.652+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94297565052192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c35cde4640 con 0x55c35cdd7750 2024-09-12T17:28:58.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.652+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c35cde50a0 con 0x55c35cdd2da0 2024-09-12T17:28:58.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.652+0000 7f5a7cc5f640 1 -- 172.21.15.170:0/718712443 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94297565047248] v31'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a7002e070 con 0x55c35cddc0e0 2024-09-12T17:28:58.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.653+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v31'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a68057030 con 0x55c35cdd2da0 2024-09-12T17:28:58.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.653+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94297565049568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c35cde50a0 con 0x55c35cdd2da0 2024-09-12T17:28:58.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.653+0000 7f5a7d460640 1 -- 172.21.15.170:0/718712443 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94297565052192] v31'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a78067040 con 0x55c35cdd7750 2024-09-12T17:28:58.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.653+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c35cde5af0 con 0x7f5a7803e060 2024-09-12T17:28:58.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.654+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(54 notify.5 [create] v31'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a68057030 con 0x7f5a7803e060 2024-09-12T17:28:58.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.654+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94297565037424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c35cde5ab0 con 0x7f5a7803e060 2024-09-12T17:28:58.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.654+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c35cde64b0 con 0x7f5a7803e060 2024-09-12T17:28:58.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.654+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94297565049568] v31'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a68057030 con 0x55c35cdd2da0 2024-09-12T17:28:58.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.655+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94297565037424] v31'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a68057030 con 0x7f5a7803e060 2024-09-12T17:28:58.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.655+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v31'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a68057030 con 0x7f5a7803e060 2024-09-12T17:28:58.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.655+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94297565055872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c35cde5600 con 0x7f5a7803e060 2024-09-12T17:28:58.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.655+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c35cde6d50 con 0x7f5a7803e060 2024-09-12T17:28:58.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.656+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(58 notify.7 [create] v31'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a68057030 con 0x7f5a7803e060 2024-09-12T17:28:58.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.656+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94297565063328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c35cde5600 con 0x7f5a7803e060 2024-09-12T17:28:58.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.656+0000 7f5a7f175800 20 add_watcher() i=0 2024-09-12T17:28:58.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.656+0000 7f5a7f175800 20 add_watcher() i=1 2024-09-12T17:28:58.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.656+0000 7f5a7f175800 20 add_watcher() i=2 2024-09-12T17:28:58.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.656+0000 7f5a7f175800 20 add_watcher() i=3 2024-09-12T17:28:58.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.656+0000 7f5a7f175800 20 add_watcher() i=4 2024-09-12T17:28:58.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.656+0000 7f5a7f175800 20 add_watcher() i=5 2024-09-12T17:28:58.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.656+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94297565055872] v31'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a68057030 con 0x7f5a7803e060 2024-09-12T17:28:58.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.656+0000 7f5a7f175800 20 add_watcher() i=6 2024-09-12T17:28:58.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.657+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94297565063328] v31'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a68057030 con 0x7f5a7803e060 2024-09-12T17:28:58.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.657+0000 7f5a7f175800 20 add_watcher() i=7 2024-09-12T17:28:58.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.657+0000 7f5a7f175800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:58.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.657+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35cde5fc0 con 0x55c35cdd2da0 2024-09-12T17:28:58.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.658+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5a68057030 con 0x55c35cdd2da0 2024-09-12T17:28:58.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.658+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94297565064384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c35cde5fc0 con 0x55c35cdd2da0 2024-09-12T17:28:58.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.659+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94297565064384] v31'199 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5a68057030 con 0x55c35cdd2da0 2024-09-12T17:28:58.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.659+0000 7f5932fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:58.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.659+0000 7f5a7f175800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:58.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.659+0000 7f5a7f175800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:58.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.659+0000 7f5a7f175800 5 note: GC not initialized 2024-09-12T17:28:58.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.659+0000 7f5931fe3640 20 reqs_thread_entry: start 2024-09-12T17:28:58.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.659+0000 7f5a7f175800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:58.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.659+0000 7f5a7f175800 20 Filter name: none 2024-09-12T17:28:58.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.659+0000 7f58a37fe640 20 reqs_thread_entry: start 2024-09-12T17:28:58.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.659+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35ce1d410 con 0x55c35cdd2da0 2024-09-12T17:28:58.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.660+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f5a68057030 con 0x55c35cdd2da0 2024-09-12T17:28:58.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.660+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35ce1d3d0 con 0x55c35cdd7750 2024-09-12T17:28:58.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.660+0000 7f5a7d460640 1 -- 172.21.15.170:0/718712443 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f5a78067040 con 0x55c35cdd7750 2024-09-12T17:28:58.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.660+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35ce1d3d0 con 0x55c35cdd2da0 2024-09-12T17:28:58.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.660+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f5a68057030 con 0x55c35cdd2da0 2024-09-12T17:28:58.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.660+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35ce1d3d0 con 0x55c35cddc0e0 2024-09-12T17:28:58.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.660+0000 7f5a7cc5f640 1 -- 172.21.15.170:0/718712443 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f5a7002e070 con 0x55c35cddc0e0 2024-09-12T17:28:58.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.660+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35ce1d930 con 0x55c35cddc0e0 2024-09-12T17:28:58.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.660+0000 7f5a7cc5f640 1 -- 172.21.15.170:0/718712443 <== osd.3 v2:172.21.15.170:6816/2664906588 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f5a7002e070 con 0x55c35cddc0e0 2024-09-12T17:28:58.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.661+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35ce1dd60 con 0x55c35cddc0e0 2024-09-12T17:28:58.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.661+0000 7f5a7cc5f640 1 -- 172.21.15.170:0/718712443 <== osd.3 v2:172.21.15.170:6816/2664906588 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f5a7002e070 con 0x55c35cddc0e0 2024-09-12T17:28:58.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.661+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35ce1dd60 con 0x55c35cdd2da0 2024-09-12T17:28:58.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.661+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f5a68057030 con 0x55c35cdd2da0 2024-09-12T17:28:58.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.661+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35ce1dd60 con 0x55c35cdd2da0 2024-09-12T17:28:58.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.661+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f5a68057030 con 0x55c35cdd2da0 2024-09-12T17:28:58.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.661+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35ce1dd60 con 0x55c35cddc0e0 2024-09-12T17:28:58.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.661+0000 7f5a7cc5f640 1 -- 172.21.15.170:0/718712443 <== osd.3 v2:172.21.15.170:6816/2664906588 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f5a7002e070 con 0x55c35cddc0e0 2024-09-12T17:28:58.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.661+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35ce1dd10 con 0x55c35cddc0e0 2024-09-12T17:28:58.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.662+0000 7f5a7cc5f640 1 -- 172.21.15.170:0/718712443 <== osd.3 v2:172.21.15.170:6816/2664906588 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f5a7002e070 con 0x55c35cddc0e0 2024-09-12T17:28:58.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.662+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35ce1db40 con 0x7f5a7803e060 2024-09-12T17:28:58.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.662+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(72 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f5a68057030 con 0x7f5a7803e060 2024-09-12T17:28:58.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.662+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35ce1ce00 con 0x55c35cdd2da0 2024-09-12T17:28:58.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.662+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5a68057030 con 0x55c35cdd2da0 2024-09-12T17:28:58.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.662+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35ce1ce00 con 0x55c35cdd7750 2024-09-12T17:28:58.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.663+0000 7f5a7d460640 1 -- 172.21.15.170:0/718712443 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5a78067040 con 0x55c35cdd7750 2024-09-12T17:28:58.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.663+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35ce1ce00 con 0x55c35cddc0e0 2024-09-12T17:28:58.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.663+0000 7f5a7cc5f640 1 -- 172.21.15.170:0/718712443 <== osd.3 v2:172.21.15.170:6816/2664906588 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5a7002e070 con 0x55c35cddc0e0 2024-09-12T17:28:58.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.663+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35ce1ce00 con 0x7f5a7803e060 2024-09-12T17:28:58.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.663+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5a68057030 con 0x7f5a7803e060 2024-09-12T17:28:58.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.663+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35ce1ce00 con 0x7f5a7803e060 2024-09-12T17:28:58.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.663+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5a68057030 con 0x7f5a7803e060 2024-09-12T17:28:58.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.663+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35ce1ce00 con 0x55c35cddc0e0 2024-09-12T17:28:58.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.664+0000 7f5a7cc5f640 1 -- 172.21.15.170:0/718712443 <== osd.3 v2:172.21.15.170:6816/2664906588 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5a7002e070 con 0x55c35cddc0e0 2024-09-12T17:28:58.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.664+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35ce1ce00 con 0x7f5a7803e060 2024-09-12T17:28:58.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.664+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(79 usage.17 [call out=185b] v0'0 uv5 ondisk = 0) ==== 152+0+185 (crc 0 0 0) 0x7f5a68057030 con 0x7f5a7803e060 2024-09-12T17:28:58.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.664+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35ce1ce00 con 0x55c35cdd2da0 2024-09-12T17:28:58.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.664+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5a68057030 con 0x55c35cdd2da0 2024-09-12T17:28:58.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.664+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35ce1ce00 con 0x55c35cddc0e0 2024-09-12T17:28:58.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.665+0000 7f5a7cc5f640 1 -- 172.21.15.170:0/718712443 <== osd.3 v2:172.21.15.170:6816/2664906588 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5a7002e070 con 0x55c35cddc0e0 2024-09-12T17:28:58.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.665+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35ce1ce00 con 0x7f5a7803e060 2024-09-12T17:28:58.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.665+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5a68057030 con 0x7f5a7803e060 2024-09-12T17:28:58.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.665+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35ce1ce00 con 0x55c35cdd7750 2024-09-12T17:28:58.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.665+0000 7f5a7d460640 1 -- 172.21.15.170:0/718712443 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5a78067040 con 0x55c35cdd7750 2024-09-12T17:28:58.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.665+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35ce1ce00 con 0x7f5a7803e060 2024-09-12T17:28:58.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.665+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5a68057030 con 0x7f5a7803e060 2024-09-12T17:28:58.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.665+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35ce1ce00 con 0x55c35cdd2da0 2024-09-12T17:28:58.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.666+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5a68057030 con 0x55c35cdd2da0 2024-09-12T17:28:58.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.666+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35ce1ce00 con 0x55c35cdd2da0 2024-09-12T17:28:58.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.666+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5a68057030 con 0x55c35cdd2da0 2024-09-12T17:28:58.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.666+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35ce1ce00 con 0x55c35cddc0e0 2024-09-12T17:28:58.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.666+0000 7f5a7cc5f640 1 -- 172.21.15.170:0/718712443 <== osd.3 v2:172.21.15.170:6816/2664906588 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5a7002e070 con 0x55c35cddc0e0 2024-09-12T17:28:58.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.666+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35ce1ce00 con 0x55c35cdd2da0 2024-09-12T17:28:58.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.666+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5a68057030 con 0x55c35cdd2da0 2024-09-12T17:28:58.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.666+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35ce1ce00 con 0x55c35cdd2da0 2024-09-12T17:28:58.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.666+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.1 v2:172.21.15.170:6800/1903654092 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5a68057030 con 0x55c35cdd2da0 2024-09-12T17:28:58.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.666+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35ce1ce00 con 0x55c35cddc0e0 2024-09-12T17:28:58.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.667+0000 7f5a7cc5f640 1 -- 172.21.15.170:0/718712443 <== osd.3 v2:172.21.15.170:6816/2664906588 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5a7002e070 con 0x55c35cddc0e0 2024-09-12T17:28:58.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.667+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35ce1ce00 con 0x55c35cddc0e0 2024-09-12T17:28:58.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.667+0000 7f5a7cc5f640 1 -- 172.21.15.170:0/718712443 <== osd.3 v2:172.21.15.170:6816/2664906588 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5a7002e070 con 0x55c35cddc0e0 2024-09-12T17:28:58.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.667+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35ce1ce00 con 0x55c35cddc0e0 2024-09-12T17:28:58.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.667+0000 7f5a7cc5f640 1 -- 172.21.15.170:0/718712443 <== osd.3 v2:172.21.15.170:6816/2664906588 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5a7002e070 con 0x55c35cddc0e0 2024-09-12T17:28:58.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.667+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c35ce1ce00 con 0x7f5a7803e060 2024-09-12T17:28:58.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.667+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.0 v2:172.21.15.47:6800/3978157098 22 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5a68057030 con 0x7f5a7803e060 2024-09-12T17:28:58.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.668+0000 7f5932fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:58.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.668+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94297565064384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c35cde7230 con 0x55c35cdd2da0 2024-09-12T17:28:58.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.669+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.1 v2:172.21.15.170:6800/1903654092 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94297565064384] v31'200 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5a68057030 con 0x55c35cdd2da0 2024-09-12T17:28:58.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.669+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94297565039824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c35ce1a800 con 0x55c35cdd7750 2024-09-12T17:28:58.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.670+0000 7f5a7d460640 1 -- 172.21.15.170:0/718712443 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94297565039824] v31'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a78067040 con 0x55c35cdd7750 2024-09-12T17:28:58.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.670+0000 7f5a7f175800 20 remove_watcher() i=0 2024-09-12T17:28:58.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.670+0000 7f5a7f175800 2 removed watcher, disabling cache 2024-09-12T17:28:58.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.670+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94297565044496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c35ce1a800 con 0x55c35cdd2da0 2024-09-12T17:28:58.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.671+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.1 v2:172.21.15.170:6800/1903654092 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94297565044496] v31'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a68057030 con 0x55c35cdd2da0 2024-09-12T17:28:58.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.671+0000 7f5a7f175800 20 remove_watcher() i=1 2024-09-12T17:28:58.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.671+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94297565047248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c35ce1a800 con 0x55c35cddc0e0 2024-09-12T17:28:58.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.672+0000 7f5a7cc5f640 1 -- 172.21.15.170:0/718712443 <== osd.3 v2:172.21.15.170:6816/2664906588 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94297565047248] v31'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a7002e070 con 0x55c35cddc0e0 2024-09-12T17:28:58.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.672+0000 7f5a7f175800 20 remove_watcher() i=2 2024-09-12T17:28:58.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.672+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94297565052192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c35ce1a800 con 0x55c35cdd7750 2024-09-12T17:28:58.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.673+0000 7f5a7d460640 1 -- 172.21.15.170:0/718712443 <== osd.2 v2:172.21.15.170:6808/3855567754 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94297565052192] v31'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a78067040 con 0x55c35cdd7750 2024-09-12T17:28:58.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.673+0000 7f5a7f175800 20 remove_watcher() i=3 2024-09-12T17:28:58.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.673+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94297565049568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c35ce1a800 con 0x55c35cdd2da0 2024-09-12T17:28:58.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.675+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.1 v2:172.21.15.170:6800/1903654092 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94297565049568] v31'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a68057030 con 0x55c35cdd2da0 2024-09-12T17:28:58.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.675+0000 7f5a7f175800 20 remove_watcher() i=4 2024-09-12T17:28:58.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.675+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94297565037424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c35ce1a800 con 0x7f5a7803e060 2024-09-12T17:28:58.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.676+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.0 v2:172.21.15.47:6800/3978157098 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94297565037424] v31'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a68057030 con 0x7f5a7803e060 2024-09-12T17:28:58.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.676+0000 7f5a7f175800 20 remove_watcher() i=5 2024-09-12T17:28:58.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.676+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94297565055872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c35ce1a800 con 0x7f5a7803e060 2024-09-12T17:28:58.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.677+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.0 v2:172.21.15.47:6800/3978157098 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94297565055872] v31'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a68057030 con 0x7f5a7803e060 2024-09-12T17:28:58.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.677+0000 7f5a7f175800 20 remove_watcher() i=6 2024-09-12T17:28:58.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.677+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94297565063328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c35ce1a800 con 0x7f5a7803e060 2024-09-12T17:28:58.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.678+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 <== osd.0 v2:172.21.15.47:6800/3978157098 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94297565063328] v31'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a68057030 con 0x7f5a7803e060 2024-09-12T17:28:58.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.678+0000 7f5a7f175800 20 remove_watcher() i=7 2024-09-12T17:28:58.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.678+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f5a7803e060 msgr2=0x7f5a7803f450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.678+0000 7f5a7f175800 1 --2- 172.21.15.170:0/718712443 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f5a7803e060 0x7f5a7803f450 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.678+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55c35cdd2da0 msgr2=0x55c35cdd5230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.678+0000 7f5a7f175800 1 --2- 172.21.15.170:0/718712443 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55c35cdd2da0 0x55c35cdd5230 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.678+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55c35cdd7750 msgr2=0x55c35cdd9b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.678+0000 7f5a7f175800 1 --2- 172.21.15.170:0/718712443 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55c35cdd7750 0x55c35cdd9b40 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.678+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55c35cddc0e0 msgr2=0x55c35cdde5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.678+0000 7f5a7f175800 1 --2- 172.21.15.170:0/718712443 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55c35cddc0e0 0x55c35cdde5a0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.678+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f594803c780 msgr2=0x7f594803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.678+0000 7f5a7f175800 1 --2- 172.21.15.170:0/718712443 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f594803c780 0x7f594803ec40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5a7001afd0 tx=0x7f5a70028000 comp rx=0 tx=0).stop 2024-09-12T17:28:58.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.678+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c35cdbfe60 msgr2=0x55c35cdc7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.678+0000 7f5a7f175800 1 --2- 172.21.15.170:0/718712443 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c35cdbfe60 0x55c35cdc7440 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f5a78048040 tx=0x7f5a78053d00 comp rx=0 tx=0).stop 2024-09-12T17:28:58.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.678+0000 7f5a77fff640 1 -- 172.21.15.170:0/718712443 reap_dead start 2024-09-12T17:28:58.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.678+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 shutdown_connections 2024-09-12T17:28:58.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.678+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 >> 172.21.15.170:0/718712443 conn(0x55c35cdbc280 msgr2=0x55c35cdba490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:58.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.678+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 shutdown_connections 2024-09-12T17:28:58.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.678+0000 7f5a7f175800 1 -- 172.21.15.170:0/718712443 wait complete. 2024-09-12T17:28:58.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.679+0000 7f5a7f175800 1 -- 172.21.15.170:0/2651772960 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f595403c730 msgr2=0x7f595403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.679+0000 7f5a7f175800 1 --2- 172.21.15.170:0/2651772960 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f595403c730 0x7f595403ebf0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5a70017b00 tx=0x7f5a700179c0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.679+0000 7f5a7f175800 1 -- 172.21.15.170:0/2651772960 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c35cdb3420 msgr2=0x55c35cdb3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.679+0000 7f5a7f175800 1 --2- 172.21.15.170:0/2651772960 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c35cdb3420 0x55c35cdb3840 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x55c35cd99240 tx=0x7f5a780167b0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.679+0000 7f5a7f175800 1 -- 172.21.15.170:0/2651772960 shutdown_connections 2024-09-12T17:28:58.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.679+0000 7f5a7f175800 1 --2- 172.21.15.170:0/2651772960 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f595403c730 0x7f595403ebf0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.679+0000 7f5a7f175800 1 --2- 172.21.15.170:0/2651772960 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c35cdb3420 0x55c35cdb3840 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.679+0000 7f5a7f175800 1 -- 172.21.15.170:0/2651772960 >> 172.21.15.170:0/2651772960 conn(0x55c35cda77d0 msgr2=0x55c35cda7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:58.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.679+0000 7f5a7f175800 1 -- 172.21.15.170:0/2651772960 shutdown_connections 2024-09-12T17:28:58.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.679+0000 7f5a7f175800 1 -- 172.21.15.170:0/2651772960 wait complete. 2024-09-12T17:28:58.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.679+0000 7f5a7f175800 1 -- 172.21.15.170:0/1242661803 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55c35cd99f30 msgr2=0x55c35cd9f890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.679+0000 7f5a7f175800 1 --2- 172.21.15.170:0/1242661803 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55c35cd99f30 0x55c35cd9f890 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.679+0000 7f5a7f175800 1 -- 172.21.15.170:0/1242661803 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55c35cda2170 msgr2=0x55c35cda4560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.679+0000 7f5a7f175800 1 --2- 172.21.15.170:0/1242661803 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55c35cda2170 0x55c35cda4560 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.679+0000 7f5a7f175800 1 -- 172.21.15.170:0/1242661803 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f596403c780 msgr2=0x7f596403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.679+0000 7f5a7f175800 1 --2- 172.21.15.170:0/1242661803 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f596403c780 0x7f596403ec40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5a68057000 tx=0x7f5a68052000 comp rx=0 tx=0).stop 2024-09-12T17:28:58.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.679+0000 7f5a7f175800 1 -- 172.21.15.170:0/1242661803 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c35cca5200 msgr2=0x55c35cd98240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.679+0000 7f5a7f175800 1 --2- 172.21.15.170:0/1242661803 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c35cca5200 0x55c35cd98240 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x55c35cd915b0 tx=0x7f5a70000ed0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.679+0000 7f5a7f175800 1 -- 172.21.15.170:0/1242661803 shutdown_connections 2024-09-12T17:28:58.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.679+0000 7f5a7f175800 1 --2- 172.21.15.170:0/1242661803 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55c35cda2170 0x55c35cda4560 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.679+0000 7f5a7f175800 1 --2- 172.21.15.170:0/1242661803 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f596403c780 0x7f596403ec40 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.679+0000 7f5a7f175800 1 --2- 172.21.15.170:0/1242661803 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55c35cd99f30 0x55c35cd9f890 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.679+0000 7f5a7f175800 1 --2- 172.21.15.170:0/1242661803 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c35cca5200 0x55c35cd98240 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.679+0000 7f5a7f175800 1 -- 172.21.15.170:0/1242661803 >> 172.21.15.170:0/1242661803 conn(0x55c35cc9b1e0 msgr2=0x55c35cd91980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:58.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.679+0000 7f5a7f175800 1 -- 172.21.15.170:0/1242661803 shutdown_connections 2024-09-12T17:28:58.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.679+0000 7f5a7f175800 1 -- 172.21.15.170:0/1242661803 wait complete. 2024-09-12T17:28:58.695 INFO:teuthology.orchestra.run.smithi170.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo2","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo3","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo4","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1,"bytes_processed":0,"bytes_returned":0}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-12T17:28:58.695 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo2', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo3', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo4', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T17:28:58.696 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-12T17:28:58.696 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-12T17:28:58.696 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-12T17:28:58.782 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:58.782 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:58.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.781+0000 7fbf79125800 1 Processor -- start 2024-09-12T17:28:58.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.781+0000 7fbf79125800 1 -- start start 2024-09-12T17:28:58.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.781+0000 7fbf79125800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55d9b05f5600 0x55d9b05f79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.781+0000 7fbf79125800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d9b049ee40 con 0x55d9b05f8020 2024-09-12T17:28:58.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.781+0000 7fbf79125800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x55d9b0469680 con 0x55d9b05f5600 2024-09-12T17:28:58.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.782+0000 7fbf74d33640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55d9b05f5600 0x55d9b05f79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.782+0000 7fbf74d33640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55d9b05f5600 0x55d9b05f79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59548/0 (socket says 172.21.15.170:59548) 2024-09-12T17:28:58.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.782+0000 7fbf74d33640 1 -- 172.21.15.170:0/2346672693 learned_addr learned my addr 172.21.15.170:0/2346672693 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:58.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.782+0000 7fbf74d33640 1 -- 172.21.15.170:0/2346672693 >> v1:172.21.15.47:6789/0 conn(0x55d9b05f8020 legacy=0x55d9b05fa4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.782+0000 7fbf74d33640 1 -- 172.21.15.170:0/2346672693 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9b04856b0 con 0x55d9b05f5600 2024-09-12T17:28:58.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.782+0000 7fbf6f7fe640 1 -- 172.21.15.170:0/2346672693 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1081576767 0 0) 0x55d9b049ee40 con 0x55d9b05f8020 2024-09-12T17:28:58.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.784+0000 7fbf74d33640 1 --2- 172.21.15.170:0/2346672693 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9b05f5600 0x55d9b05f79f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fbf6800a520 tx=0x7fbf68045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1282f4345d0fd84 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.784+0000 7fbf6f7fe640 1 -- 172.21.15.170:0/2346672693 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf68055070 con 0x55d9b05f5600 2024-09-12T17:28:58.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.784+0000 7fbf6f7fe640 1 -- 172.21.15.170:0/2346672693 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf680515b0 con 0x55d9b05f5600 2024-09-12T17:28:58.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.784+0000 7fbf6f7fe640 1 -- 172.21.15.170:0/2346672693 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf680518d0 con 0x55d9b05f5600 2024-09-12T17:28:58.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.785+0000 7fbf79125800 1 -- 172.21.15.170:0/2346672693 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9b05f5600 msgr2=0x55d9b05f79f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.785+0000 7fbf79125800 1 --2- 172.21.15.170:0/2346672693 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9b05f5600 0x55d9b05f79f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fbf6800a520 tx=0x7fbf68045ba0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.785+0000 7fbf79125800 1 -- 172.21.15.170:0/2346672693 shutdown_connections 2024-09-12T17:28:58.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.785+0000 7fbf79125800 1 --2- 172.21.15.170:0/2346672693 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9b05f5600 0x55d9b05f79f0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.785+0000 7fbf79125800 1 -- 172.21.15.170:0/2346672693 >> 172.21.15.170:0/2346672693 conn(0x55d9b05ef1c0 msgr2=0x55d9b05f1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:58.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.785+0000 7fbf79125800 1 -- 172.21.15.170:0/2346672693 shutdown_connections 2024-09-12T17:28:58.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.785+0000 7fbf79125800 1 -- 172.21.15.170:0/2346672693 wait complete. 2024-09-12T17:28:58.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.798+0000 7fbf79125800 1 Processor -- start 2024-09-12T17:28:58.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.799+0000 7fbf79125800 1 -- start start 2024-09-12T17:28:58.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.799+0000 7fbf79125800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9b05f5600 0x55d9b06e4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.799+0000 7fbf79125800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d9b048ddd0 con 0x55d9b05f5600 2024-09-12T17:28:58.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.799+0000 7fbf74d33640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9b05f5600 0x55d9b06e4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.799+0000 7fbf74d33640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9b05f5600 0x55d9b06e4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59550/0 (socket says 172.21.15.170:59550) 2024-09-12T17:28:58.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.799+0000 7fbf74d33640 1 -- 172.21.15.170:0/2128830699 learned_addr learned my addr 172.21.15.170:0/2128830699 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:58.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.799+0000 7fbf74d33640 1 -- 172.21.15.170:0/2128830699 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9b04a6e10 con 0x55d9b05f5600 2024-09-12T17:28:58.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.800+0000 7fbf74d33640 1 --2- 172.21.15.170:0/2128830699 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9b05f5600 0x55d9b06e4470 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fbf68045be0 tx=0x7fbf68051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac2ccf6eb31c3f3d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.800+0000 7fbe62e05640 1 -- 172.21.15.170:0/2128830699 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf68051ac0 con 0x55d9b05f5600 2024-09-12T17:28:58.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.800+0000 7fbe62e05640 1 -- 172.21.15.170:0/2128830699 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf68051c60 con 0x55d9b05f5600 2024-09-12T17:28:58.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.800+0000 7fbe62e05640 1 -- 172.21.15.170:0/2128830699 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf68066460 con 0x55d9b05f5600 2024-09-12T17:28:58.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.800+0000 7fbf79125800 1 -- 172.21.15.170:0/2128830699 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9b05f5600 msgr2=0x55d9b06e4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.800+0000 7fbf79125800 1 --2- 172.21.15.170:0/2128830699 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9b05f5600 0x55d9b06e4470 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fbf68045be0 tx=0x7fbf68051000 comp rx=0 tx=0).stop 2024-09-12T17:28:58.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.801+0000 7fbf79125800 1 -- 172.21.15.170:0/2128830699 shutdown_connections 2024-09-12T17:28:58.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.801+0000 7fbf79125800 1 --2- 172.21.15.170:0/2128830699 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9b05f5600 0x55d9b06e4470 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.801+0000 7fbf79125800 1 -- 172.21.15.170:0/2128830699 >> 172.21.15.170:0/2128830699 conn(0x55d9b05ef1c0 msgr2=0x55d9b06dfdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:58.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.801+0000 7fbf79125800 1 -- 172.21.15.170:0/2128830699 shutdown_connections 2024-09-12T17:28:58.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.801+0000 7fbf79125800 1 -- 172.21.15.170:0/2128830699 wait complete. 2024-09-12T17:28:58.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.801+0000 7fbf79125800 1 Processor -- start 2024-09-12T17:28:58.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.801+0000 7fbf79125800 1 -- start start 2024-09-12T17:28:58.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.801+0000 7fbf79125800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9b05f5600 0x55d9b06ebd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.801+0000 7fbf79125800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d9b05fc040 con 0x55d9b05f5600 2024-09-12T17:28:58.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.801+0000 7fbf74d33640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9b05f5600 0x55d9b06ebd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.801+0000 7fbf74d33640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9b05f5600 0x55d9b06ebd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59558/0 (socket says 172.21.15.170:59558) 2024-09-12T17:28:58.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.801+0000 7fbf74d33640 1 -- 172.21.15.170:0/1943288567 learned_addr learned my addr 172.21.15.170:0/1943288567 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:58.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.802+0000 7fbf74d33640 1 -- 172.21.15.170:0/1943288567 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9b06ec270 con 0x55d9b05f5600 2024-09-12T17:28:58.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.802+0000 7fbf74d33640 1 --2- 172.21.15.170:0/1943288567 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9b05f5600 0x55d9b06ebd10 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fbf68045be0 tx=0x7fbf68003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.802+0000 7fbe61602640 1 -- 172.21.15.170:0/1943288567 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf6805a600 con 0x55d9b05f5600 2024-09-12T17:28:58.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.802+0000 7fbe61602640 1 -- 172.21.15.170:0/1943288567 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf6805a7a0 con 0x55d9b05f5600 2024-09-12T17:28:58.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.802+0000 7fbf79125800 1 -- 172.21.15.170:0/1943288567 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d9b06ec500 con 0x55d9b05f5600 2024-09-12T17:28:58.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.802+0000 7fbe61602640 1 -- 172.21.15.170:0/1943288567 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf6805aa80 con 0x55d9b05f5600 2024-09-12T17:28:58.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.802+0000 7fbf79125800 1 -- 172.21.15.170:0/1943288567 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9b06ecf00 con 0x55d9b05f5600 2024-09-12T17:28:58.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.803+0000 7fbe61602640 1 -- 172.21.15.170:0/1943288567 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fbf68058070 con 0x55d9b05f5600 2024-09-12T17:28:58.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.803+0000 7fbe61602640 1 --2- 172.21.15.170:0/1943288567 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbe5c03c730 0x7fbe5c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.803+0000 7fbe61602640 1 -- 172.21.15.170:0/1943288567 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fbf68062070 con 0x55d9b05f5600 2024-09-12T17:28:58.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.803+0000 7fbf6ffff640 1 --2- 172.21.15.170:0/1943288567 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbe5c03c730 0x7fbe5c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.803+0000 7fbf79125800 1 --2- 172.21.15.170:0/1943288567 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55d9b05f8020 0x55d9b06f3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.803+0000 7fbf79125800 1 -- 172.21.15.170:0/1943288567 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d9b06f38a0 con 0x55d9b05f8020 2024-09-12T17:28:58.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.804+0000 7fbf75534640 1 --2- 172.21.15.170:0/1943288567 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55d9b05f8020 0x55d9b06f3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.804+0000 7fbf6ffff640 1 --2- 172.21.15.170:0/1943288567 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbe5c03c730 0x7fbe5c03ebf0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbf60000f60 tx=0x7fbf600013f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.804+0000 7fbf75534640 1 --2- 172.21.15.170:0/1943288567 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55d9b05f8020 0x55d9b06f3360 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.804+0000 7fbf75534640 1 -- 172.21.15.170:0/1943288567 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf7000a4d0 con 0x55d9b05f8020 2024-09-12T17:28:58.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.804+0000 7fbf79125800 1 -- 172.21.15.170:0/1943288567 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d9b06f3c40 con 0x55d9b05f8020 2024-09-12T17:28:58.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.804+0000 7fbf75534640 1 -- 172.21.15.170:0/1943288567 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbf7000a4d0 con 0x55d9b05f8020 2024-09-12T17:28:58.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.804+0000 7fbf79125800 1 --2- 172.21.15.170:0/1943288567 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55d9b06f5740 0x55d9b06f7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.804+0000 7fbf79125800 1 -- 172.21.15.170:0/1943288567 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d9b06f8350 con 0x55d9b06f5740 2024-09-12T17:28:58.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.805+0000 7fbf74d33640 1 --2- 172.21.15.170:0/1943288567 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55d9b06f5740 0x55d9b06f7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.805+0000 7fbf74d33640 1 --2- 172.21.15.170:0/1943288567 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55d9b06f5740 0x55d9b06f7bc0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.805+0000 7fbf74d33640 1 -- 172.21.15.170:0/1943288567 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbf68057030 con 0x55d9b06f5740 2024-09-12T17:28:58.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.805+0000 7fbf79125800 1 -- 172.21.15.170:0/1943288567 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d9b06f4490 con 0x55d9b05f8020 2024-09-12T17:28:58.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.805+0000 7fbf75534640 1 -- 172.21.15.170:0/1943288567 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbf7000a4d0 con 0x55d9b05f8020 2024-09-12T17:28:58.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.805+0000 7fbf79125800 1 -- 172.21.15.170:0/1943288567 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d9b06f48e0 con 0x55d9b06f5740 2024-09-12T17:28:58.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.806+0000 7fbf74d33640 1 -- 172.21.15.170:0/1943288567 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbf68057030 con 0x55d9b06f5740 2024-09-12T17:28:58.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.806+0000 7fbf79125800 1 Processor -- start 2024-09-12T17:28:58.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.806+0000 7fbf79125800 1 -- start start 2024-09-12T17:28:58.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.806+0000 7fbf79125800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9b0706be0 0x55d9b0707000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.806+0000 7fbf79125800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d9b04eba00 con 0x55d9b0706be0 2024-09-12T17:28:58.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.807+0000 7fbf75534640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9b0706be0 0x55d9b0707000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.807+0000 7fbf75534640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9b0706be0 0x55d9b0707000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59560/0 (socket says 172.21.15.170:59560) 2024-09-12T17:28:58.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.807+0000 7fbf75534640 1 -- 172.21.15.170:0/2737502152 learned_addr learned my addr 172.21.15.170:0/2737502152 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:58.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.807+0000 7fbf75534640 1 -- 172.21.15.170:0/2737502152 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9b0707640 con 0x55d9b0706be0 2024-09-12T17:28:58.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.807+0000 7fbf75534640 1 --2- 172.21.15.170:0/2737502152 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9b0706be0 0x55d9b0707000 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x55d9b06ecd10 tx=0x7fbf700167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.807+0000 7fbe5a7fc640 1 -- 172.21.15.170:0/2737502152 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf70013640 con 0x55d9b0706be0 2024-09-12T17:28:58.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.807+0000 7fbe5a7fc640 1 -- 172.21.15.170:0/2737502152 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf700137e0 con 0x55d9b0706be0 2024-09-12T17:28:58.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.807+0000 7fbf79125800 1 -- 172.21.15.170:0/2737502152 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d9b0707e70 con 0x55d9b0706be0 2024-09-12T17:28:58.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.807+0000 7fbe5a7fc640 1 -- 172.21.15.170:0/2737502152 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf70013ac0 con 0x55d9b0706be0 2024-09-12T17:28:58.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.808+0000 7fbf79125800 1 -- 172.21.15.170:0/2737502152 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9b0708410 con 0x55d9b0706be0 2024-09-12T17:28:58.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.808+0000 7fbe5a7fc640 1 -- 172.21.15.170:0/2737502152 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fbf70011040 con 0x55d9b0706be0 2024-09-12T17:28:58.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.809+0000 7fbe5a7fc640 1 --2- 172.21.15.170:0/2737502152 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbe4c03c780 0x7fbe4c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.809+0000 7fbe5a7fc640 1 -- 172.21.15.170:0/2737502152 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fbf7000e040 con 0x55d9b0706be0 2024-09-12T17:28:58.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.809+0000 7fbf74d33640 1 --2- 172.21.15.170:0/2737502152 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbe4c03c780 0x7fbe4c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.809+0000 7fbf79125800 1 Processor -- start 2024-09-12T17:28:58.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.809+0000 7fbf74d33640 1 --2- 172.21.15.170:0/2737502152 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbe4c03c780 0x7fbe4c03ec40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbf68066ec0 tx=0x7fbf68066e30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.809+0000 7fbf79125800 1 -- start start 2024-09-12T17:28:58.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.809+0000 7fbf79125800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9b0713660 0x55d9b0713a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.809+0000 7fbf79125800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d9b06e4c00 con 0x55d9b0713660 2024-09-12T17:28:58.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.810+0000 7fbf75534640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9b0713660 0x55d9b0713a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.810+0000 7fbf75534640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9b0713660 0x55d9b0713a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59566/0 (socket says 172.21.15.170:59566) 2024-09-12T17:28:58.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.810+0000 7fbf75534640 1 -- 172.21.15.170:0/4280111684 learned_addr learned my addr 172.21.15.170:0/4280111684 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:58.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.810+0000 7fbf75534640 1 -- 172.21.15.170:0/4280111684 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9b0714050 con 0x55d9b0713660 2024-09-12T17:28:58.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.810+0000 7fbf75534640 1 --2- 172.21.15.170:0/4280111684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9b0713660 0x55d9b0713a60 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fbf70013dd0 tx=0x7fbf70013f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22b75960dbbcde4d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.810+0000 7fbe4bfff640 1 -- 172.21.15.170:0/4280111684 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf70021a90 con 0x55d9b0713660 2024-09-12T17:28:58.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.810+0000 7fbe4bfff640 1 -- 172.21.15.170:0/4280111684 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf70021440 con 0x55d9b0713660 2024-09-12T17:28:58.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.810+0000 7fbe4bfff640 1 -- 172.21.15.170:0/4280111684 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf70020bd0 con 0x55d9b0713660 2024-09-12T17:28:58.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.811+0000 7fbf79125800 1 -- 172.21.15.170:0/4280111684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9b0713660 msgr2=0x55d9b0713a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.811+0000 7fbf79125800 1 --2- 172.21.15.170:0/4280111684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9b0713660 0x55d9b0713a60 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fbf70013dd0 tx=0x7fbf70013f00 comp rx=0 tx=0).stop 2024-09-12T17:28:58.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.811+0000 7fbf79125800 1 -- 172.21.15.170:0/4280111684 shutdown_connections 2024-09-12T17:28:58.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.811+0000 7fbf79125800 1 --2- 172.21.15.170:0/4280111684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9b0713660 0x55d9b0713a60 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.811+0000 7fbf79125800 1 -- 172.21.15.170:0/4280111684 >> 172.21.15.170:0/4280111684 conn(0x55d9b070fa60 msgr2=0x55d9b070dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:58.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.811+0000 7fbf79125800 1 -- 172.21.15.170:0/4280111684 shutdown_connections 2024-09-12T17:28:58.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.811+0000 7fbf79125800 1 -- 172.21.15.170:0/4280111684 wait complete. 2024-09-12T17:28:58.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.811+0000 7fbf79125800 1 Processor -- start 2024-09-12T17:28:58.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.811+0000 7fbf79125800 1 -- start start 2024-09-12T17:28:58.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.811+0000 7fbf79125800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9b0713660 0x55d9b071abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.811+0000 7fbf79125800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d9b0714640 con 0x55d9b0713660 2024-09-12T17:28:58.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.811+0000 7fbf75534640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9b0713660 0x55d9b071abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.811+0000 7fbf75534640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9b0713660 0x55d9b071abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59580/0 (socket says 172.21.15.170:59580) 2024-09-12T17:28:58.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.812+0000 7fbf75534640 1 -- 172.21.15.170:0/1520177266 learned_addr learned my addr 172.21.15.170:0/1520177266 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:58.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.812+0000 7fbf75534640 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9b071b120 con 0x55d9b0713660 2024-09-12T17:28:58.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.812+0000 7fbf75534640 1 --2- 172.21.15.170:0/1520177266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9b0713660 0x55d9b071abc0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fbf70013dd0 tx=0x7fbf70053ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.812+0000 7fbe4a7fc640 1 -- 172.21.15.170:0/1520177266 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf70037070 con 0x55d9b0713660 2024-09-12T17:28:58.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.812+0000 7fbe4a7fc640 1 -- 172.21.15.170:0/1520177266 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf700215f0 con 0x55d9b0713660 2024-09-12T17:28:58.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.812+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d9b071b3b0 con 0x55d9b0713660 2024-09-12T17:28:58.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.812+0000 7fbe4a7fc640 1 -- 172.21.15.170:0/1520177266 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf7004a040 con 0x55d9b0713660 2024-09-12T17:28:58.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.812+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9b071bf40 con 0x55d9b0713660 2024-09-12T17:28:58.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.813+0000 7fbe4a7fc640 1 -- 172.21.15.170:0/1520177266 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fbf7003a070 con 0x55d9b0713660 2024-09-12T17:28:58.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.813+0000 7fbe4a7fc640 1 --2- 172.21.15.170:0/1520177266 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbe4003c780 0x7fbe4003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.813+0000 7fbf79125800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.813+0000 7fbe4a7fc640 1 -- 172.21.15.170:0/1520177266 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fbf7003dc10 con 0x55d9b0713660 2024-09-12T17:28:58.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.813+0000 7fbf74d33640 1 --2- 172.21.15.170:0/1520177266 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbe4003c780 0x7fbe4003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.814+0000 7fbf79125800 1 --2- 172.21.15.170:0/1520177266 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55d9b0726570 0x55d9b07289c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.814+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0729110 con 0x55d9b0726570 2024-09-12T17:28:58.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.814+0000 7fbf6ffff640 1 --2- 172.21.15.170:0/1520177266 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55d9b0726570 0x55d9b07289c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.814+0000 7fbf74d33640 1 --2- 172.21.15.170:0/1520177266 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbe4003c780 0x7fbe4003ec40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbf680853f0 tx=0x7fbf68090000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.814+0000 7fbf6ffff640 1 --2- 172.21.15.170:0/1520177266 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55d9b0726570 0x55d9b07289c0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.814+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf600104c0 con 0x55d9b0726570 2024-09-12T17:28:58.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.814+0000 7fbf79125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:58.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.814+0000 7fbf79125800 20 realm 2024-09-12T17:28:58.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.814+0000 7fbf79125800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.814+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0725980 con 0x55d9b0726570 2024-09-12T17:28:58.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.814+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf600104c0 con 0x55d9b0726570 2024-09-12T17:28:58.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.814+0000 7fbf79125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:58.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.814+0000 7fbf79125800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:58.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.815+0000 7fbf79125800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.815+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0729bf0 con 0x55d9b0726570 2024-09-12T17:28:58.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.815+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf600104c0 con 0x55d9b0726570 2024-09-12T17:28:58.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.815+0000 7fbf79125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:58.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.815+0000 7fbf79125800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.815+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d9b072a4c0 con 0x55d9b0726570 2024-09-12T17:28:58.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.815+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbf600104c0 con 0x55d9b0726570 2024-09-12T17:28:58.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.815+0000 7fbf79125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:58.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.815+0000 7fbf79125800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.815+0000 7fbf79125800 1 --2- 172.21.15.170:0/1520177266 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55d9b072ae00 0x55d9b072d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.815+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d9b072d930 con 0x55d9b072ae00 2024-09-12T17:28:58.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.815+0000 7fbf75534640 1 --2- 172.21.15.170:0/1520177266 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55d9b072ae00 0x55d9b072d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.815+0000 7fbf75534640 1 --2- 172.21.15.170:0/1520177266 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55d9b072ae00 0x55d9b072d1f0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.816+0000 7fbf75534640 1 -- 172.21.15.170:0/1520177266 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbf70039030 con 0x55d9b072ae00 2024-09-12T17:28:58.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.816+0000 7fbf79125800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:58.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.816+0000 7fbf79125800 20 searching for the correct realm 2024-09-12T17:28:58.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.816+0000 7fbf79125800 1 --2- 172.21.15.170:0/1520177266 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55d9b072f9b0 0x55d9b0731e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.816+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0732540 con 0x55d9b072f9b0 2024-09-12T17:28:58.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.816+0000 7fbf74d33640 1 --2- 172.21.15.170:0/1520177266 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55d9b072f9b0 0x55d9b0731e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.816+0000 7fbf74d33640 1 --2- 172.21.15.170:0/1520177266 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55d9b072f9b0 0x55d9b0731e70 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.816+0000 7fbf74d33640 1 -- 172.21.15.170:0/1520177266 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf68088050 con 0x55d9b072f9b0 2024-09-12T17:28:58.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.816+0000 7fbf74d33640 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0732540 con 0x55d9b072ae00 2024-09-12T17:28:58.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.816+0000 7fbf75534640 1 -- 172.21.15.170:0/1520177266 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf70039030 con 0x55d9b072ae00 2024-09-12T17:28:58.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.816+0000 7fbf75534640 1 --2- 172.21.15.170:0/1520177266 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fbf7003c060 0x7fbf70036a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.816+0000 7fbf75534640 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0732540 con 0x7fbf7003c060 2024-09-12T17:28:58.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.817+0000 7fbf6ffff640 1 --2- 172.21.15.170:0/1520177266 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fbf7003c060 0x7fbf70036a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.817+0000 7fbf6ffff640 1 --2- 172.21.15.170:0/1520177266 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fbf7003c060 0x7fbf70036a20 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.817+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf600104c0 con 0x7fbf7003c060 2024-09-12T17:28:58.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.817+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0732540 con 0x55d9b0726570 2024-09-12T17:28:58.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.818+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf600104c0 con 0x55d9b0726570 2024-09-12T17:28:58.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.818+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0732540 con 0x55d9b0726570 2024-09-12T17:28:58.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.818+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf6002a040 con 0x55d9b0726570 2024-09-12T17:28:58.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.818+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0732540 con 0x7fbf7003c060 2024-09-12T17:28:58.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.818+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf6002a040 con 0x7fbf7003c060 2024-09-12T17:28:58.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.818+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0732540 con 0x7fbf7003c060 2024-09-12T17:28:58.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.818+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf6002a040 con 0x7fbf7003c060 2024-09-12T17:28:58.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.818+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0732540 con 0x55d9b072ae00 2024-09-12T17:28:58.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.819+0000 7fbf75534640 1 -- 172.21.15.170:0/1520177266 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf70039030 con 0x55d9b072ae00 2024-09-12T17:28:58.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.819+0000 7fbf75534640 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0732540 con 0x55d9b072f9b0 2024-09-12T17:28:58.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.819+0000 7fbf74d33640 1 -- 172.21.15.170:0/1520177266 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf68088050 con 0x55d9b072f9b0 2024-09-12T17:28:58.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.819+0000 7fbf74d33640 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0732540 con 0x55d9b0726570 2024-09-12T17:28:58.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.819+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf6002a040 con 0x55d9b0726570 2024-09-12T17:28:58.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.819+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0732540 con 0x7fbf7003c060 2024-09-12T17:28:58.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.819+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf6002a040 con 0x7fbf7003c060 2024-09-12T17:28:58.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.819+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0732540 con 0x55d9b0726570 2024-09-12T17:28:58.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.820+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf6002a040 con 0x55d9b0726570 2024-09-12T17:28:58.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.820+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0732540 con 0x55d9b072ae00 2024-09-12T17:28:58.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.820+0000 7fbf75534640 1 -- 172.21.15.170:0/1520177266 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fbf70039030 con 0x55d9b072ae00 2024-09-12T17:28:58.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.820+0000 7fbf75534640 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0732540 con 0x55d9b072f9b0 2024-09-12T17:28:58.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.820+0000 7fbf74d33640 1 -- 172.21.15.170:0/1520177266 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf68088050 con 0x55d9b072f9b0 2024-09-12T17:28:58.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.820+0000 7fbf74d33640 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0732540 con 0x55d9b072f9b0 2024-09-12T17:28:58.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.820+0000 7fbf74d33640 1 -- 172.21.15.170:0/1520177266 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf68088050 con 0x55d9b072f9b0 2024-09-12T17:28:58.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.820+0000 7fbf74d33640 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0732540 con 0x55d9b072ae00 2024-09-12T17:28:58.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.821+0000 7fbf75534640 1 -- 172.21.15.170:0/1520177266 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf70039030 con 0x55d9b072ae00 2024-09-12T17:28:58.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.821+0000 7fbf75534640 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0732540 con 0x55d9b072f9b0 2024-09-12T17:28:58.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.821+0000 7fbf74d33640 1 -- 172.21.15.170:0/1520177266 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf68088050 con 0x55d9b072f9b0 2024-09-12T17:28:58.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.821+0000 7fbf74d33640 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0732540 con 0x55d9b072f9b0 2024-09-12T17:28:58.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.821+0000 7fbf74d33640 1 -- 172.21.15.170:0/1520177266 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf68088050 con 0x55d9b072f9b0 2024-09-12T17:28:58.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.821+0000 7fbf74d33640 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0732540 con 0x55d9b0726570 2024-09-12T17:28:58.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.821+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf6002a040 con 0x55d9b0726570 2024-09-12T17:28:58.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.821+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0732540 con 0x55d9b0726570 2024-09-12T17:28:58.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.822+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbf6002a040 con 0x55d9b0726570 2024-09-12T17:28:58.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.822+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0732540 con 0x7fbf7003c060 2024-09-12T17:28:58.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.822+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf6002a040 con 0x7fbf7003c060 2024-09-12T17:28:58.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.822+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0732540 con 0x55d9b072f9b0 2024-09-12T17:28:58.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.822+0000 7fbf74d33640 1 -- 172.21.15.170:0/1520177266 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf68088050 con 0x55d9b072f9b0 2024-09-12T17:28:58.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.822+0000 7fbf74d33640 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0732540 con 0x55d9b072ae00 2024-09-12T17:28:58.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.822+0000 7fbf75534640 1 -- 172.21.15.170:0/1520177266 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf70039030 con 0x55d9b072ae00 2024-09-12T17:28:58.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.822+0000 7fbf75534640 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0732540 con 0x55d9b0726570 2024-09-12T17:28:58.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.823+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf6002a040 con 0x55d9b0726570 2024-09-12T17:28:58.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.823+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0732540 con 0x7fbf7003c060 2024-09-12T17:28:58.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.823+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf6002a040 con 0x7fbf7003c060 2024-09-12T17:28:58.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.823+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0732540 con 0x55d9b072f9b0 2024-09-12T17:28:58.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.823+0000 7fbf74d33640 1 -- 172.21.15.170:0/1520177266 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf68088050 con 0x55d9b072f9b0 2024-09-12T17:28:58.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.823+0000 7fbf74d33640 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0732540 con 0x7fbf7003c060 2024-09-12T17:28:58.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.824+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf6002a040 con 0x7fbf7003c060 2024-09-12T17:28:58.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.824+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0732540 con 0x55d9b072ae00 2024-09-12T17:28:58.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.824+0000 7fbf75534640 1 -- 172.21.15.170:0/1520177266 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf70039030 con 0x55d9b072ae00 2024-09-12T17:28:58.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.824+0000 7fbf75534640 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0732540 con 0x55d9b072f9b0 2024-09-12T17:28:58.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.824+0000 7fbf74d33640 1 -- 172.21.15.170:0/1520177266 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf68088050 con 0x55d9b072f9b0 2024-09-12T17:28:58.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.824+0000 7fbf74d33640 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0732540 con 0x7fbf7003c060 2024-09-12T17:28:58.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.824+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf6002a040 con 0x7fbf7003c060 2024-09-12T17:28:58.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.824+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0732540 con 0x55d9b0726570 2024-09-12T17:28:58.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.825+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbf6002a040 con 0x55d9b0726570 2024-09-12T17:28:58.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.825+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0732540 con 0x55d9b072ae00 2024-09-12T17:28:58.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.825+0000 7fbf75534640 1 -- 172.21.15.170:0/1520177266 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(37 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbf70039030 con 0x55d9b072ae00 2024-09-12T17:28:58.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.825+0000 7fbf79125800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:58.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.825+0000 7fbf79125800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:58.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.825+0000 7fbf79125800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:58.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.825+0000 7fbf79125800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:58.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.825+0000 7fbf79125800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:58.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.825+0000 7fbf79125800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:58.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.825+0000 7fbf79125800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.825+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d9b072e3b0 con 0x55d9b0726570 2024-09-12T17:28:58.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.825+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf6002a040 con 0x55d9b0726570 2024-09-12T17:28:58.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.825+0000 7fbf79125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:58.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.825+0000 7fbf79125800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.825+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d9b072df90 con 0x55d9b0726570 2024-09-12T17:28:58.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.825+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbf6003a040 con 0x55d9b0726570 2024-09-12T17:28:58.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.825+0000 7fbf79125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:58.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.825+0000 7fbf79125800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.825+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d9b072ed10 con 0x55d9b072ae00 2024-09-12T17:28:58.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.826+0000 7fbf75534640 1 -- 172.21.15.170:0/1520177266 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbf70039030 con 0x55d9b072ae00 2024-09-12T17:28:58.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.826+0000 7fbf79125800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:58.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.826+0000 7fbf79125800 20 zone default found 2024-09-12T17:28:58.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.826+0000 7fbf79125800 4 Realm: () 2024-09-12T17:28:58.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.826+0000 7fbf79125800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:58.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.826+0000 7fbf79125800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:58.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.826+0000 7fbf79125800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:58.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.826+0000 7fbf79125800 20 zonegroup default 2024-09-12T17:28:58.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.826+0000 7fbf79125800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.826+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d9b072e8b0 con 0x7fbf7003c060 2024-09-12T17:28:58.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.826+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbf6003a040 con 0x7fbf7003c060 2024-09-12T17:28:58.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.826+0000 7fbf79125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:58.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.826+0000 7fbf79125800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.826+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0734d90 con 0x55d9b072f9b0 2024-09-12T17:28:58.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.826+0000 7fbf74d33640 1 -- 172.21.15.170:0/1520177266 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbf68088050 con 0x55d9b072f9b0 2024-09-12T17:28:58.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.826+0000 7fbf79125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:58.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.826+0000 7fbf79125800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.826+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d9b07351e0 con 0x55d9b072f9b0 2024-09-12T17:28:58.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.827+0000 7fbf74d33640 1 -- 172.21.15.170:0/1520177266 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbf68088050 con 0x55d9b072f9b0 2024-09-12T17:28:58.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.827+0000 7fbf79125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:58.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.827+0000 7fbf79125800 20 started sync module instance, tier type = 2024-09-12T17:28:58.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.827+0000 7fbf79125800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:58.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.827+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0734220 con 0x55d9b072ae00 2024-09-12T17:28:58.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.828+0000 7fbf75534640 1 -- 172.21.15.170:0/1520177266 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(44 notify.0 [create] v31'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf70039030 con 0x55d9b072ae00 2024-09-12T17:28:58.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.828+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94393456608784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0733e80 con 0x55d9b072ae00 2024-09-12T17:28:58.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.828+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0736110 con 0x55d9b0726570 2024-09-12T17:28:58.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.829+0000 7fbf75534640 1 -- 172.21.15.170:0/1520177266 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94393456608784] v31'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf70039030 con 0x55d9b072ae00 2024-09-12T17:28:58.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.829+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v31'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf6003a040 con 0x55d9b0726570 2024-09-12T17:28:58.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.829+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94393456612928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0736110 con 0x55d9b0726570 2024-09-12T17:28:58.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.829+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0736b30 con 0x55d9b072f9b0 2024-09-12T17:28:58.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.830+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94393456612928] v31'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf6003a040 con 0x55d9b0726570 2024-09-12T17:28:58.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.830+0000 7fbf74d33640 1 -- 172.21.15.170:0/1520177266 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v31'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf68088050 con 0x55d9b072f9b0 2024-09-12T17:28:58.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.830+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94393456614496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0736080 con 0x55d9b072f9b0 2024-09-12T17:28:58.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.830+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0737a20 con 0x55d9b072ae00 2024-09-12T17:28:58.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.831+0000 7fbf75534640 1 -- 172.21.15.170:0/1520177266 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(50 notify.3 [create] v31'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf70039030 con 0x55d9b072ae00 2024-09-12T17:28:58.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.831+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94393456621392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9b07382c0 con 0x55d9b072ae00 2024-09-12T17:28:58.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.831+0000 7fbf74d33640 1 -- 172.21.15.170:0/1520177266 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94393456614496] v31'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf68088050 con 0x55d9b072f9b0 2024-09-12T17:28:58.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.831+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0738db0 con 0x55d9b0726570 2024-09-12T17:28:58.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.832+0000 7fbf75534640 1 -- 172.21.15.170:0/1520177266 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94393456621392] v31'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf70039030 con 0x55d9b072ae00 2024-09-12T17:28:58.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.832+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v31'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf6003a040 con 0x55d9b0726570 2024-09-12T17:28:58.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.833+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94393456625792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9b07382c0 con 0x55d9b0726570 2024-09-12T17:28:58.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.833+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9b07392c0 con 0x7fbf7003c060 2024-09-12T17:28:58.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.834+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(54 notify.5 [create] v31'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf6003a040 con 0x7fbf7003c060 2024-09-12T17:28:58.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.834+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94393456627056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0739280 con 0x7fbf7003c060 2024-09-12T17:28:58.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.834+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94393456625792] v31'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf6003a040 con 0x55d9b0726570 2024-09-12T17:28:58.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.834+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9b073a070 con 0x7fbf7003c060 2024-09-12T17:28:58.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.835+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94393456627056] v31'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf6003a040 con 0x7fbf7003c060 2024-09-12T17:28:58.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.835+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v31'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf6003a040 con 0x7fbf7003c060 2024-09-12T17:28:58.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.835+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94393456629424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0739280 con 0x7fbf7003c060 2024-09-12T17:28:58.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.835+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9b073a6b0 con 0x7fbf7003c060 2024-09-12T17:28:58.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.836+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94393456629424] v31'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf6003a040 con 0x7fbf7003c060 2024-09-12T17:28:58.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.836+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(58 notify.7 [create] v31'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf6003a040 con 0x7fbf7003c060 2024-09-12T17:28:58.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.836+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94393456632288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9b073a6b0 con 0x7fbf7003c060 2024-09-12T17:28:58.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.836+0000 7fbf79125800 20 add_watcher() i=0 2024-09-12T17:28:58.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.836+0000 7fbf79125800 20 add_watcher() i=1 2024-09-12T17:28:58.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.836+0000 7fbf79125800 20 add_watcher() i=2 2024-09-12T17:28:58.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.836+0000 7fbf79125800 20 add_watcher() i=3 2024-09-12T17:28:58.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.836+0000 7fbf79125800 20 add_watcher() i=4 2024-09-12T17:28:58.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.836+0000 7fbf79125800 20 add_watcher() i=5 2024-09-12T17:28:58.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.836+0000 7fbf79125800 20 add_watcher() i=6 2024-09-12T17:28:58.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.837+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94393456632288] v31'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf6003a040 con 0x7fbf7003c060 2024-09-12T17:28:58.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.837+0000 7fbf79125800 20 add_watcher() i=7 2024-09-12T17:28:58.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.837+0000 7fbf79125800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:58.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.837+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d9b073dab0 con 0x55d9b0726570 2024-09-12T17:28:58.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.837+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbf6003a040 con 0x55d9b0726570 2024-09-12T17:28:58.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.837+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94393456630720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9b073afa0 con 0x55d9b0726570 2024-09-12T17:28:58.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.838+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94393456630720] v31'201 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbf6003a040 con 0x55d9b0726570 2024-09-12T17:28:58.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.838+0000 7fbe2b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:58.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.838+0000 7fbf79125800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:58.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.838+0000 7fbf79125800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:58.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.838+0000 7fbf79125800 5 note: GC not initialized 2024-09-12T17:28:58.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.839+0000 7fbe2a7e4640 20 reqs_thread_entry: start 2024-09-12T17:28:58.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.839+0000 7fbf79125800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:58.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.839+0000 7fbf79125800 20 Filter name: none 2024-09-12T17:28:58.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.839+0000 7fbe237fe640 20 reqs_thread_entry: start 2024-09-12T17:28:58.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.839+0000 7fbf79125800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.839+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d9b07706e0 con 0x55d9b0726570 2024-09-12T17:28:58.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.839+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fbf6003a040 con 0x55d9b0726570 2024-09-12T17:28:58.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.839+0000 7fbf79125800 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:28:58.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.839+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0771b00 con 0x7fbf7003c060 2024-09-12T17:28:58.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.840+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fbf6003a040 con 0x7fbf7003c060 2024-09-12T17:28:58.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.841+0000 7fbe2b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:58.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.841+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94393456630720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0770000 con 0x55d9b0726570 2024-09-12T17:28:58.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.842+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94393456630720] v31'202 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbf6003a040 con 0x55d9b0726570 2024-09-12T17:28:58.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.842+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94393456608784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0739bc0 con 0x55d9b072ae00 2024-09-12T17:28:58.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.843+0000 7fbf75534640 1 -- 172.21.15.170:0/1520177266 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94393456608784] v31'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf70039030 con 0x55d9b072ae00 2024-09-12T17:28:58.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.843+0000 7fbf79125800 20 remove_watcher() i=0 2024-09-12T17:28:58.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.843+0000 7fbf79125800 2 removed watcher, disabling cache 2024-09-12T17:28:58.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.843+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94393456612928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0739bc0 con 0x55d9b0726570 2024-09-12T17:28:58.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.844+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94393456612928] v31'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf6003a040 con 0x55d9b0726570 2024-09-12T17:28:58.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.844+0000 7fbf79125800 20 remove_watcher() i=1 2024-09-12T17:28:58.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.844+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94393456614496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0735640 con 0x55d9b072f9b0 2024-09-12T17:28:58.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.845+0000 7fbf74d33640 1 -- 172.21.15.170:0/1520177266 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94393456614496] v31'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf68088050 con 0x55d9b072f9b0 2024-09-12T17:28:58.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.845+0000 7fbf79125800 20 remove_watcher() i=2 2024-09-12T17:28:58.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.845+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94393456621392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0739bc0 con 0x55d9b072ae00 2024-09-12T17:28:58.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.846+0000 7fbf75534640 1 -- 172.21.15.170:0/1520177266 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94393456621392] v31'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf70039030 con 0x55d9b072ae00 2024-09-12T17:28:58.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.846+0000 7fbf79125800 20 remove_watcher() i=3 2024-09-12T17:28:58.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.846+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94393456625792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0735c60 con 0x55d9b0726570 2024-09-12T17:28:58.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.847+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94393456625792] v31'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf6003a040 con 0x55d9b0726570 2024-09-12T17:28:58.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.847+0000 7fbf79125800 20 remove_watcher() i=4 2024-09-12T17:28:58.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.847+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94393456627056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0737750 con 0x7fbf7003c060 2024-09-12T17:28:58.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.848+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94393456627056] v31'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf6003a040 con 0x7fbf7003c060 2024-09-12T17:28:58.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.848+0000 7fbf79125800 20 remove_watcher() i=5 2024-09-12T17:28:58.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.848+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94393456629424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0739bc0 con 0x7fbf7003c060 2024-09-12T17:28:58.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.850+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94393456629424] v31'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf6003a040 con 0x7fbf7003c060 2024-09-12T17:28:58.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.850+0000 7fbf79125800 20 remove_watcher() i=6 2024-09-12T17:28:58.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.850+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94393456632288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9b0735c60 con 0x7fbf7003c060 2024-09-12T17:28:58.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.851+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94393456632288] v31'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf6003a040 con 0x7fbf7003c060 2024-09-12T17:28:58.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.851+0000 7fbf79125800 20 remove_watcher() i=7 2024-09-12T17:28:58.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.851+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fbf7003c060 msgr2=0x7fbf70036a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.851+0000 7fbf79125800 1 --2- 172.21.15.170:0/1520177266 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fbf7003c060 0x7fbf70036a20 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.851+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55d9b0726570 msgr2=0x55d9b07289c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.851+0000 7fbf79125800 1 --2- 172.21.15.170:0/1520177266 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55d9b0726570 0x55d9b07289c0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.851+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55d9b072ae00 msgr2=0x55d9b072d1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.851+0000 7fbf79125800 1 --2- 172.21.15.170:0/1520177266 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55d9b072ae00 0x55d9b072d1f0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.851+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55d9b072f9b0 msgr2=0x55d9b0731e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.851+0000 7fbf79125800 1 --2- 172.21.15.170:0/1520177266 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55d9b072f9b0 0x55d9b0731e70 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.851+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbe4003c780 msgr2=0x7fbe4003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.851+0000 7fbf79125800 1 --2- 172.21.15.170:0/1520177266 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbe4003c780 0x7fbe4003ec40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbf680853f0 tx=0x7fbf68090000 comp rx=0 tx=0).stop 2024-09-12T17:28:58.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.851+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9b0713660 msgr2=0x55d9b071abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.851+0000 7fbf79125800 1 --2- 172.21.15.170:0/1520177266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9b0713660 0x55d9b071abc0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fbf70013dd0 tx=0x7fbf70053ca0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.851+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 reap_dead start 2024-09-12T17:28:58.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.851+0000 7fbf6ffff640 1 -- 172.21.15.170:0/1520177266 reap_dead start 2024-09-12T17:28:58.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.851+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 shutdown_connections 2024-09-12T17:28:58.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.851+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 >> 172.21.15.170:0/1520177266 conn(0x55d9b070fa60 msgr2=0x55d9b070dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:58.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.851+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 shutdown_connections 2024-09-12T17:28:58.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.851+0000 7fbf79125800 1 -- 172.21.15.170:0/1520177266 wait complete. 2024-09-12T17:28:58.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.851+0000 7fbf79125800 1 -- 172.21.15.170:0/2737502152 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbe4c03c780 msgr2=0x7fbe4c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.851+0000 7fbf79125800 1 --2- 172.21.15.170:0/2737502152 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbe4c03c780 0x7fbe4c03ec40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbf68066ec0 tx=0x7fbf68066e30 comp rx=0 tx=0).stop 2024-09-12T17:28:58.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.851+0000 7fbf79125800 1 -- 172.21.15.170:0/2737502152 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9b0706be0 msgr2=0x55d9b0707000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.851+0000 7fbf79125800 1 --2- 172.21.15.170:0/2737502152 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9b0706be0 0x55d9b0707000 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x55d9b06ecd10 tx=0x7fbf700167b0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.851+0000 7fbf79125800 1 -- 172.21.15.170:0/2737502152 shutdown_connections 2024-09-12T17:28:58.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.851+0000 7fbf79125800 1 --2- 172.21.15.170:0/2737502152 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbe4c03c780 0x7fbe4c03ec40 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.851+0000 7fbf79125800 1 --2- 172.21.15.170:0/2737502152 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9b0706be0 0x55d9b0707000 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.851+0000 7fbf79125800 1 -- 172.21.15.170:0/2737502152 >> 172.21.15.170:0/2737502152 conn(0x55d9b06faf90 msgr2=0x55d9b06fb370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:58.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.852+0000 7fbf79125800 1 -- 172.21.15.170:0/2737502152 shutdown_connections 2024-09-12T17:28:58.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.852+0000 7fbf79125800 1 -- 172.21.15.170:0/2737502152 wait complete. 2024-09-12T17:28:58.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.852+0000 7fbf79125800 1 -- 172.21.15.170:0/1943288567 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55d9b05f8020 msgr2=0x55d9b06f3360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.852+0000 7fbf79125800 1 --2- 172.21.15.170:0/1943288567 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55d9b05f8020 0x55d9b06f3360 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.852+0000 7fbf79125800 1 -- 172.21.15.170:0/1943288567 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55d9b06f5740 msgr2=0x55d9b06f7bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.852+0000 7fbf79125800 1 --2- 172.21.15.170:0/1943288567 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55d9b06f5740 0x55d9b06f7bc0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.852+0000 7fbf79125800 1 -- 172.21.15.170:0/1943288567 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbe5c03c730 msgr2=0x7fbe5c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.852+0000 7fbf79125800 1 --2- 172.21.15.170:0/1943288567 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbe5c03c730 0x7fbe5c03ebf0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbf60000f60 tx=0x7fbf600013f0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.852+0000 7fbf79125800 1 -- 172.21.15.170:0/1943288567 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9b05f5600 msgr2=0x55d9b06ebd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.852+0000 7fbf79125800 1 --2- 172.21.15.170:0/1943288567 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9b05f5600 0x55d9b06ebd10 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fbf68045be0 tx=0x7fbf68003020 comp rx=0 tx=0).stop 2024-09-12T17:28:58.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.852+0000 7fbf79125800 1 -- 172.21.15.170:0/1943288567 shutdown_connections 2024-09-12T17:28:58.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.852+0000 7fbf79125800 1 --2- 172.21.15.170:0/1943288567 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55d9b06f5740 0x55d9b06f7bc0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.852+0000 7fbf79125800 1 --2- 172.21.15.170:0/1943288567 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbe5c03c730 0x7fbe5c03ebf0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.852+0000 7fbf79125800 1 --2- 172.21.15.170:0/1943288567 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55d9b05f8020 0x55d9b06f3360 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.852+0000 7fbf79125800 1 --2- 172.21.15.170:0/1943288567 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d9b05f5600 0x55d9b06ebd10 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.852+0000 7fbf79125800 1 -- 172.21.15.170:0/1943288567 >> 172.21.15.170:0/1943288567 conn(0x55d9b05ef1c0 msgr2=0x55d9b06e5630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:58.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.852+0000 7fbf79125800 1 -- 172.21.15.170:0/1943288567 shutdown_connections 2024-09-12T17:28:58.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.852+0000 7fbf79125800 1 -- 172.21.15.170:0/1943288567 wait complete. 2024-09-12T17:28:58.863 INFO:teuthology.orchestra.run.smithi170.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo2","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo3","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo4","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-12T17:28:58.863 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo2', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo3', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo4', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T17:28:58.864 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-12T17:28:58.864 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-12T17:28:58.864 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-09-12T17:28:58.911 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:58.911 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:58.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.910+0000 7f90c9614800 1 Processor -- start 2024-09-12T17:28:58.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.910+0000 7f90c9614800 1 -- start start 2024-09-12T17:28:58.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.911+0000 7f90c9614800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55e7cd0544b0 0x55e7cd0548b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.911+0000 7f90c9614800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e7cceffe40 con 0x55e7cd054df0 2024-09-12T17:28:58.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.911+0000 7f90c9614800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x55e7cceca680 con 0x55e7cd0544b0 2024-09-12T17:28:58.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.911+0000 7f90c4ccb640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55e7cd0544b0 0x55e7cd0548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.911+0000 7f90c4ccb640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55e7cd0544b0 0x55e7cd0548b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59588/0 (socket says 172.21.15.170:59588) 2024-09-12T17:28:58.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.911+0000 7f90c4ccb640 1 -- 172.21.15.170:0/220655123 learned_addr learned my addr 172.21.15.170:0/220655123 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:58.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.911+0000 7f90bc4ca640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x55e7cd054df0 0x55e7cd0552a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:57382/0 (socket says 172.21.15.170:57382) 2024-09-12T17:28:58.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.911+0000 7f90c4ccb640 1 -- 172.21.15.170:0/220655123 >> v1:172.21.15.47:6789/0 conn(0x55e7cd054df0 legacy=0x55e7cd0552a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.911+0000 7f90c4ccb640 1 -- 172.21.15.170:0/220655123 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7ccee66b0 con 0x55e7cd0544b0 2024-09-12T17:28:58.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.913+0000 7f90c4ccb640 1 --2- 172.21.15.170:0/220655123 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7cd0544b0 0x55e7cd0548b0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f90b400a520 tx=0x7f90b4045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3f73f638aeb44c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.913+0000 7f90bffff640 1 -- 172.21.15.170:0/220655123 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90b4055070 con 0x55e7cd0544b0 2024-09-12T17:28:58.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.913+0000 7f90bffff640 1 -- 172.21.15.170:0/220655123 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90b40515b0 con 0x55e7cd0544b0 2024-09-12T17:28:58.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.913+0000 7f90bffff640 1 -- 172.21.15.170:0/220655123 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90b40518d0 con 0x55e7cd0544b0 2024-09-12T17:28:58.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.914+0000 7f90c9614800 1 -- 172.21.15.170:0/220655123 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7cd0544b0 msgr2=0x55e7cd0548b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.914+0000 7f90c9614800 1 --2- 172.21.15.170:0/220655123 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7cd0544b0 0x55e7cd0548b0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f90b400a520 tx=0x7f90b4045ba0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.914+0000 7f90c9614800 1 -- 172.21.15.170:0/220655123 shutdown_connections 2024-09-12T17:28:58.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.914+0000 7f90c9614800 1 --2- 172.21.15.170:0/220655123 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7cd0544b0 0x55e7cd0548b0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.914+0000 7f90c9614800 1 -- 172.21.15.170:0/220655123 >> 172.21.15.170:0/220655123 conn(0x55e7cd050200 msgr2=0x55e7cd052640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:58.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.914+0000 7f90c9614800 1 -- 172.21.15.170:0/220655123 shutdown_connections 2024-09-12T17:28:58.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.914+0000 7f90c9614800 1 -- 172.21.15.170:0/220655123 wait complete. 2024-09-12T17:28:58.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.928+0000 7f90c9614800 1 Processor -- start 2024-09-12T17:28:58.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.928+0000 7f90c9614800 1 -- start start 2024-09-12T17:28:58.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.928+0000 7f90c9614800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7cd0544b0 0x55e7cd147870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.928+0000 7f90c9614800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e7cceeedd0 con 0x55e7cd0544b0 2024-09-12T17:28:58.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.928+0000 7f90c4ccb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7cd0544b0 0x55e7cd147870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.928+0000 7f90c4ccb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7cd0544b0 0x55e7cd147870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59604/0 (socket says 172.21.15.170:59604) 2024-09-12T17:28:58.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.928+0000 7f90c4ccb640 1 -- 172.21.15.170:0/3286451165 learned_addr learned my addr 172.21.15.170:0/3286451165 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:58.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.929+0000 7f90c4ccb640 1 -- 172.21.15.170:0/3286451165 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7ccf07e10 con 0x55e7cd0544b0 2024-09-12T17:28:58.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.929+0000 7f90c4ccb640 1 --2- 172.21.15.170:0/3286451165 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7cd0544b0 0x55e7cd147870 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f90b40460d0 tx=0x7f90b4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28ffd24ec291e54 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.929+0000 7f8fb2e0d640 1 -- 172.21.15.170:0/3286451165 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90b40519d0 con 0x55e7cd0544b0 2024-09-12T17:28:58.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.929+0000 7f8fb2e0d640 1 -- 172.21.15.170:0/3286451165 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90b4051b70 con 0x55e7cd0544b0 2024-09-12T17:28:58.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.929+0000 7f8fb2e0d640 1 -- 172.21.15.170:0/3286451165 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90b4051e50 con 0x55e7cd0544b0 2024-09-12T17:28:58.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.930+0000 7f90c9614800 1 -- 172.21.15.170:0/3286451165 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7cd0544b0 msgr2=0x55e7cd147870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.930+0000 7f90c9614800 1 --2- 172.21.15.170:0/3286451165 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7cd0544b0 0x55e7cd147870 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f90b40460d0 tx=0x7f90b4051000 comp rx=0 tx=0).stop 2024-09-12T17:28:58.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.930+0000 7f90c9614800 1 -- 172.21.15.170:0/3286451165 shutdown_connections 2024-09-12T17:28:58.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.930+0000 7f90c9614800 1 --2- 172.21.15.170:0/3286451165 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7cd0544b0 0x55e7cd147870 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.930+0000 7f90c9614800 1 -- 172.21.15.170:0/3286451165 >> 172.21.15.170:0/3286451165 conn(0x55e7cd050200 msgr2=0x55e7cd1431f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:58.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.930+0000 7f90c9614800 1 -- 172.21.15.170:0/3286451165 shutdown_connections 2024-09-12T17:28:58.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.930+0000 7f90c9614800 1 -- 172.21.15.170:0/3286451165 wait complete. 2024-09-12T17:28:58.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.930+0000 7f90c9614800 1 Processor -- start 2024-09-12T17:28:58.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.930+0000 7f90c9614800 1 -- start start 2024-09-12T17:28:58.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.930+0000 7f90c9614800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7cd0544b0 0x55e7cd14f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.930+0000 7f90c9614800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e7cd055d70 con 0x55e7cd0544b0 2024-09-12T17:28:58.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.931+0000 7f90c4ccb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7cd0544b0 0x55e7cd14f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.931+0000 7f90c4ccb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7cd0544b0 0x55e7cd14f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59614/0 (socket says 172.21.15.170:59614) 2024-09-12T17:28:58.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.931+0000 7f90c4ccb640 1 -- 172.21.15.170:0/2354519891 learned_addr learned my addr 172.21.15.170:0/2354519891 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:58.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.931+0000 7f90c4ccb640 1 -- 172.21.15.170:0/2354519891 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7cd14f5f0 con 0x55e7cd0544b0 2024-09-12T17:28:58.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.931+0000 7f90c4ccb640 1 --2- 172.21.15.170:0/2354519891 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7cd0544b0 0x55e7cd14f090 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f90b40460d0 tx=0x7f90b4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.931+0000 7f8fb160a640 1 -- 172.21.15.170:0/2354519891 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90b4073020 con 0x55e7cd0544b0 2024-09-12T17:28:58.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.931+0000 7f8fb160a640 1 -- 172.21.15.170:0/2354519891 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90b406f580 con 0x55e7cd0544b0 2024-09-12T17:28:58.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.931+0000 7f90c9614800 1 -- 172.21.15.170:0/2354519891 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e7cd14f880 con 0x55e7cd0544b0 2024-09-12T17:28:58.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.931+0000 7f8fb160a640 1 -- 172.21.15.170:0/2354519891 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90b406f8a0 con 0x55e7cd0544b0 2024-09-12T17:28:58.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.931+0000 7f90c9614800 1 -- 172.21.15.170:0/2354519891 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7cd150490 con 0x55e7cd0544b0 2024-09-12T17:28:58.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.932+0000 7f8fb160a640 1 -- 172.21.15.170:0/2354519891 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f90b4076020 con 0x55e7cd0544b0 2024-09-12T17:28:58.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.933+0000 7f8fb160a640 1 --2- 172.21.15.170:0/2354519891 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8fac03c730 0x7f8fac03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.933+0000 7f8fb160a640 1 -- 172.21.15.170:0/2354519891 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f90b406b040 con 0x55e7cd0544b0 2024-09-12T17:28:58.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.933+0000 7f90bc4ca640 1 --2- 172.21.15.170:0/2354519891 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8fac03c730 0x7f8fac03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.933+0000 7f90c9614800 1 --2- 172.21.15.170:0/2354519891 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55e7cd054df0 0x55e7cd1566e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.933+0000 7f90c9614800 1 -- 172.21.15.170:0/2354519891 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd156c20 con 0x55e7cd054df0 2024-09-12T17:28:58.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.933+0000 7f90c54cc640 1 --2- 172.21.15.170:0/2354519891 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55e7cd054df0 0x55e7cd1566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.933+0000 7f90bc4ca640 1 --2- 172.21.15.170:0/2354519891 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8fac03c730 0x7f8fac03ebf0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f90ac001e30 tx=0x7f90ac001390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.933+0000 7f90c54cc640 1 --2- 172.21.15.170:0/2354519891 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55e7cd054df0 0x55e7cd1566e0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.933+0000 7f90c54cc640 1 -- 172.21.15.170:0/2354519891 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90c000a4d0 con 0x55e7cd054df0 2024-09-12T17:28:58.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.933+0000 7f90c9614800 1 -- 172.21.15.170:0/2354519891 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd156fc0 con 0x55e7cd054df0 2024-09-12T17:28:58.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.934+0000 7f90c54cc640 1 -- 172.21.15.170:0/2354519891 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f90c000a4d0 con 0x55e7cd054df0 2024-09-12T17:28:58.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.934+0000 7f90c9614800 1 --2- 172.21.15.170:0/2354519891 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55e7cd158ac0 0x55e7cd15af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.934+0000 7f90c9614800 1 -- 172.21.15.170:0/2354519891 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd15b6f0 con 0x55e7cd158ac0 2024-09-12T17:28:58.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.934+0000 7f90c4ccb640 1 --2- 172.21.15.170:0/2354519891 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55e7cd158ac0 0x55e7cd15af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.934+0000 7f90c4ccb640 1 --2- 172.21.15.170:0/2354519891 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55e7cd158ac0 0x55e7cd15af60 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.934+0000 7f90c4ccb640 1 -- 172.21.15.170:0/2354519891 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f90b4057030 con 0x55e7cd158ac0 2024-09-12T17:28:58.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.934+0000 7f90c9614800 1 -- 172.21.15.170:0/2354519891 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd157810 con 0x55e7cd054df0 2024-09-12T17:28:58.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.935+0000 7f90c54cc640 1 -- 172.21.15.170:0/2354519891 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f90c000a4d0 con 0x55e7cd054df0 2024-09-12T17:28:58.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.935+0000 7f90c9614800 1 -- 172.21.15.170:0/2354519891 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd157c30 con 0x55e7cd158ac0 2024-09-12T17:28:58.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.935+0000 7f90c4ccb640 1 -- 172.21.15.170:0/2354519891 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f90b4057030 con 0x55e7cd158ac0 2024-09-12T17:28:58.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.935+0000 7f90c9614800 1 Processor -- start 2024-09-12T17:28:58.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.935+0000 7f90c9614800 1 -- start start 2024-09-12T17:28:58.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.935+0000 7f90c9614800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7cd169f80 0x55e7cd16a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.935+0000 7f90c9614800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e7ccf4ca00 con 0x55e7cd169f80 2024-09-12T17:28:58.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.936+0000 7f90c54cc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7cd169f80 0x55e7cd16a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.936+0000 7f90c54cc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7cd169f80 0x55e7cd16a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59618/0 (socket says 172.21.15.170:59618) 2024-09-12T17:28:58.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.936+0000 7f90c54cc640 1 -- 172.21.15.170:0/1260258400 learned_addr learned my addr 172.21.15.170:0/1260258400 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:58.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.936+0000 7f90c54cc640 1 -- 172.21.15.170:0/1260258400 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7cd16a9e0 con 0x55e7cd169f80 2024-09-12T17:28:58.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.936+0000 7f90c54cc640 1 --2- 172.21.15.170:0/1260258400 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7cd169f80 0x55e7cd16a3a0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x55e7cd150090 tx=0x7f90c00167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.937+0000 7f8faa7fc640 1 -- 172.21.15.170:0/1260258400 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90c0013640 con 0x55e7cd169f80 2024-09-12T17:28:58.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.937+0000 7f8faa7fc640 1 -- 172.21.15.170:0/1260258400 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90c00137e0 con 0x55e7cd169f80 2024-09-12T17:28:58.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.937+0000 7f90c9614800 1 -- 172.21.15.170:0/1260258400 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e7cd16b210 con 0x55e7cd169f80 2024-09-12T17:28:58.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.937+0000 7f8faa7fc640 1 -- 172.21.15.170:0/1260258400 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90c0013ae0 con 0x55e7cd169f80 2024-09-12T17:28:58.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.937+0000 7f90c9614800 1 -- 172.21.15.170:0/1260258400 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7cd16b7b0 con 0x55e7cd169f80 2024-09-12T17:28:58.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.938+0000 7f8faa7fc640 1 -- 172.21.15.170:0/1260258400 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f90c0011040 con 0x55e7cd169f80 2024-09-12T17:28:58.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.938+0000 7f8faa7fc640 1 --2- 172.21.15.170:0/1260258400 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8f9c03c730 0x7f8f9c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.938+0000 7f8faa7fc640 1 -- 172.21.15.170:0/1260258400 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f90c000e040 con 0x55e7cd169f80 2024-09-12T17:28:58.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.938+0000 7f90c4ccb640 1 --2- 172.21.15.170:0/1260258400 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8f9c03c730 0x7f8f9c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.938+0000 7f90c9614800 1 Processor -- start 2024-09-12T17:28:58.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.938+0000 7f90c4ccb640 1 --2- 172.21.15.170:0/1260258400 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8f9c03c730 0x7f8f9c03ebf0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f90b4005570 tx=0x7f90b4050600 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.938+0000 7f90c9614800 1 -- start start 2024-09-12T17:28:58.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.938+0000 7f90c9614800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7cd176a50 0x55e7cd176e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.938+0000 7f90c9614800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e7cd148000 con 0x55e7cd176a50 2024-09-12T17:28:58.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.939+0000 7f90c54cc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7cd176a50 0x55e7cd176e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.939+0000 7f90c54cc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7cd176a50 0x55e7cd176e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59634/0 (socket says 172.21.15.170:59634) 2024-09-12T17:28:58.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.939+0000 7f90c54cc640 1 -- 172.21.15.170:0/4015335765 learned_addr learned my addr 172.21.15.170:0/4015335765 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:58.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.939+0000 7f90c54cc640 1 -- 172.21.15.170:0/4015335765 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7cd177440 con 0x55e7cd176a50 2024-09-12T17:28:58.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.939+0000 7f90c54cc640 1 --2- 172.21.15.170:0/4015335765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7cd176a50 0x55e7cd176e50 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f90c0053da0 tx=0x7f90c001fdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4df6e110de8a187c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.939+0000 7f8f9bfff640 1 -- 172.21.15.170:0/4015335765 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90c00143c0 con 0x55e7cd176a50 2024-09-12T17:28:58.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.939+0000 7f8f9bfff640 1 -- 172.21.15.170:0/4015335765 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90c0021cf0 con 0x55e7cd176a50 2024-09-12T17:28:58.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.939+0000 7f8f9bfff640 1 -- 172.21.15.170:0/4015335765 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90c001f470 con 0x55e7cd176a50 2024-09-12T17:28:58.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.940+0000 7f90c9614800 1 -- 172.21.15.170:0/4015335765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7cd176a50 msgr2=0x55e7cd176e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.940+0000 7f90c9614800 1 --2- 172.21.15.170:0/4015335765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7cd176a50 0x55e7cd176e50 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f90c0053da0 tx=0x7f90c001fdb0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.940+0000 7f90c9614800 1 -- 172.21.15.170:0/4015335765 shutdown_connections 2024-09-12T17:28:58.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.940+0000 7f90c9614800 1 --2- 172.21.15.170:0/4015335765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7cd176a50 0x55e7cd176e50 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.940+0000 7f90c9614800 1 -- 172.21.15.170:0/4015335765 >> 172.21.15.170:0/4015335765 conn(0x55e7cd172e50 msgr2=0x55e7cd171090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:58.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.940+0000 7f90c9614800 1 -- 172.21.15.170:0/4015335765 shutdown_connections 2024-09-12T17:28:58.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.940+0000 7f90c9614800 1 -- 172.21.15.170:0/4015335765 wait complete. 2024-09-12T17:28:58.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.940+0000 7f90c9614800 1 Processor -- start 2024-09-12T17:28:58.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.940+0000 7f90c9614800 1 -- start start 2024-09-12T17:28:58.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.940+0000 7f90c9614800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7cd176a50 0x55e7cd17e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.940+0000 7f90c9614800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e7cd177a60 con 0x55e7cd176a50 2024-09-12T17:28:58.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.941+0000 7f90c54cc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7cd176a50 0x55e7cd17e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.941+0000 7f90c54cc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7cd176a50 0x55e7cd17e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59648/0 (socket says 172.21.15.170:59648) 2024-09-12T17:28:58.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.941+0000 7f90c54cc640 1 -- 172.21.15.170:0/2983332922 learned_addr learned my addr 172.21.15.170:0/2983332922 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:58.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.941+0000 7f90c54cc640 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7cd17e570 con 0x55e7cd176a50 2024-09-12T17:28:58.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.941+0000 7f90c54cc640 1 --2- 172.21.15.170:0/2983332922 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7cd176a50 0x55e7cd17e010 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f90c0053ca0 tx=0x7f90c0053d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.941+0000 7f8f9a7fc640 1 -- 172.21.15.170:0/2983332922 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90c00143c0 con 0x55e7cd176a50 2024-09-12T17:28:58.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.941+0000 7f8f9a7fc640 1 -- 172.21.15.170:0/2983332922 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90c0020800 con 0x55e7cd176a50 2024-09-12T17:28:58.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.941+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e7cd17e800 con 0x55e7cd176a50 2024-09-12T17:28:58.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.941+0000 7f8f9a7fc640 1 -- 172.21.15.170:0/2983332922 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90c0020b00 con 0x55e7cd176a50 2024-09-12T17:28:58.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.941+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7cd17f390 con 0x55e7cd176a50 2024-09-12T17:28:58.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.942+0000 7f8f9a7fc640 1 -- 172.21.15.170:0/2983332922 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f90c0020ca0 con 0x55e7cd176a50 2024-09-12T17:28:58.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.942+0000 7f8f9a7fc640 1 --2- 172.21.15.170:0/2983332922 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8f9003c780 0x7f8f9003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.942+0000 7f8f9a7fc640 1 -- 172.21.15.170:0/2983332922 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f90c004a040 con 0x55e7cd176a50 2024-09-12T17:28:58.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.942+0000 7f90c9614800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.942+0000 7f90c4ccb640 1 --2- 172.21.15.170:0/2983332922 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8f9003c780 0x7f8f9003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.943+0000 7f90c9614800 1 --2- 172.21.15.170:0/2983332922 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55e7cd1899a0 0x55e7cd18bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.943+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd18c540 con 0x55e7cd1899a0 2024-09-12T17:28:58.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.943+0000 7f90bc4ca640 1 --2- 172.21.15.170:0/2983332922 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55e7cd1899a0 0x55e7cd18bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.943+0000 7f90c4ccb640 1 --2- 172.21.15.170:0/2983332922 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8f9003c780 0x7f8f9003ec40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f90b4065fd0 tx=0x7f90b4086000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.943+0000 7f90bc4ca640 1 --2- 172.21.15.170:0/2983332922 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55e7cd1899a0 0x55e7cd18bdf0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.943+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90ac00f610 con 0x55e7cd1899a0 2024-09-12T17:28:58.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.943+0000 7f90c9614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:58.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.943+0000 7f90c9614800 20 realm 2024-09-12T17:28:58.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.943+0000 7f90c9614800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.943+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd188db0 con 0x55e7cd1899a0 2024-09-12T17:28:58.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.943+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90ac00f610 con 0x55e7cd1899a0 2024-09-12T17:28:58.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.943+0000 7f90c9614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:58.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.943+0000 7f90c9614800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:58.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.943+0000 7f90c9614800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.943+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd18d020 con 0x55e7cd1899a0 2024-09-12T17:28:58.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.944+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90ac00f610 con 0x55e7cd1899a0 2024-09-12T17:28:58.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.944+0000 7f90c9614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:58.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.944+0000 7f90c9614800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.944+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd18d8f0 con 0x55e7cd1899a0 2024-09-12T17:28:58.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.944+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f90ac00f610 con 0x55e7cd1899a0 2024-09-12T17:28:58.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.944+0000 7f90c9614800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:58.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.944+0000 7f90c9614800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.944+0000 7f90c9614800 1 --2- 172.21.15.170:0/2983332922 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55e7cd18e230 0x55e7cd190620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.944+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd190d60 con 0x55e7cd18e230 2024-09-12T17:28:58.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.944+0000 7f90c54cc640 1 --2- 172.21.15.170:0/2983332922 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55e7cd18e230 0x55e7cd190620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.944+0000 7f90c54cc640 1 --2- 172.21.15.170:0/2983332922 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55e7cd18e230 0x55e7cd190620 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.945+0000 7f90c54cc640 1 -- 172.21.15.170:0/2983332922 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f90c000a4d0 con 0x55e7cd18e230 2024-09-12T17:28:58.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.945+0000 7f90c9614800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:58.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.945+0000 7f90c9614800 20 searching for the correct realm 2024-09-12T17:28:58.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.945+0000 7f90c9614800 1 --2- 172.21.15.170:0/2983332922 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55e7cd192dd0 0x55e7cd195290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.945+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd195960 con 0x55e7cd192dd0 2024-09-12T17:28:58.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.945+0000 7f90c4ccb640 1 --2- 172.21.15.170:0/2983332922 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55e7cd192dd0 0x55e7cd195290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.945+0000 7f90c4ccb640 1 --2- 172.21.15.170:0/2983332922 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55e7cd192dd0 0x55e7cd195290 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.945+0000 7f90c4ccb640 1 -- 172.21.15.170:0/2983332922 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b4057030 con 0x55e7cd192dd0 2024-09-12T17:28:58.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.945+0000 7f90c4ccb640 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd195960 con 0x55e7cd18e230 2024-09-12T17:28:58.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.945+0000 7f90c54cc640 1 -- 172.21.15.170:0/2983332922 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90c000a4d0 con 0x55e7cd18e230 2024-09-12T17:28:58.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.945+0000 7f90c54cc640 1 --2- 172.21.15.170:0/2983332922 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f90c0050980 0x7f90c00145e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:58.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.945+0000 7f90c54cc640 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd195960 con 0x7f90c0050980 2024-09-12T17:28:58.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.946+0000 7f90bc4ca640 1 --2- 172.21.15.170:0/2983332922 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f90c0050980 0x7f90c00145e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:58.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.946+0000 7f90bc4ca640 1 --2- 172.21.15.170:0/2983332922 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f90c0050980 0x7f90c00145e0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:58.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.946+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90ac00f610 con 0x7f90c0050980 2024-09-12T17:28:58.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.946+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd195960 con 0x55e7cd1899a0 2024-09-12T17:28:58.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.947+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90ac00f610 con 0x55e7cd1899a0 2024-09-12T17:28:58.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.947+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd195960 con 0x55e7cd1899a0 2024-09-12T17:28:58.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.947+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90ac02b040 con 0x55e7cd1899a0 2024-09-12T17:28:58.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.947+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd195960 con 0x7f90c0050980 2024-09-12T17:28:58.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.947+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90ac02b040 con 0x7f90c0050980 2024-09-12T17:28:58.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.947+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd195960 con 0x7f90c0050980 2024-09-12T17:28:58.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.947+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90ac02b040 con 0x7f90c0050980 2024-09-12T17:28:58.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.947+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd195960 con 0x55e7cd18e230 2024-09-12T17:28:58.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.948+0000 7f90c54cc640 1 -- 172.21.15.170:0/2983332922 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90c000a4d0 con 0x55e7cd18e230 2024-09-12T17:28:58.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.948+0000 7f90c54cc640 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd195960 con 0x55e7cd192dd0 2024-09-12T17:28:58.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.948+0000 7f90c4ccb640 1 -- 172.21.15.170:0/2983332922 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b4057030 con 0x55e7cd192dd0 2024-09-12T17:28:58.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.948+0000 7f90c4ccb640 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd195960 con 0x55e7cd1899a0 2024-09-12T17:28:58.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.948+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90ac02b040 con 0x55e7cd1899a0 2024-09-12T17:28:58.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.948+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd195960 con 0x7f90c0050980 2024-09-12T17:28:58.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.948+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90ac02b040 con 0x7f90c0050980 2024-09-12T17:28:58.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.948+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd195960 con 0x55e7cd1899a0 2024-09-12T17:28:58.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.949+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90ac02b040 con 0x55e7cd1899a0 2024-09-12T17:28:58.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.949+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd195960 con 0x55e7cd18e230 2024-09-12T17:28:58.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.949+0000 7f90c54cc640 1 -- 172.21.15.170:0/2983332922 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f90c000a4d0 con 0x55e7cd18e230 2024-09-12T17:28:58.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.949+0000 7f90c54cc640 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd195960 con 0x55e7cd192dd0 2024-09-12T17:28:58.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.949+0000 7f90c4ccb640 1 -- 172.21.15.170:0/2983332922 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b4057030 con 0x55e7cd192dd0 2024-09-12T17:28:58.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.949+0000 7f90c4ccb640 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd195960 con 0x55e7cd192dd0 2024-09-12T17:28:58.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.949+0000 7f90c4ccb640 1 -- 172.21.15.170:0/2983332922 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b4057030 con 0x55e7cd192dd0 2024-09-12T17:28:58.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.949+0000 7f90c4ccb640 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd195960 con 0x55e7cd18e230 2024-09-12T17:28:58.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.949+0000 7f90c54cc640 1 -- 172.21.15.170:0/2983332922 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90c000a4d0 con 0x55e7cd18e230 2024-09-12T17:28:58.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.949+0000 7f90c54cc640 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd195960 con 0x55e7cd192dd0 2024-09-12T17:28:58.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.950+0000 7f90c4ccb640 1 -- 172.21.15.170:0/2983332922 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b4057030 con 0x55e7cd192dd0 2024-09-12T17:28:58.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.950+0000 7f90c4ccb640 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd195960 con 0x55e7cd192dd0 2024-09-12T17:28:58.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.950+0000 7f90c4ccb640 1 -- 172.21.15.170:0/2983332922 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b4057030 con 0x55e7cd192dd0 2024-09-12T17:28:58.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.950+0000 7f90c4ccb640 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd195960 con 0x55e7cd1899a0 2024-09-12T17:28:58.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.950+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90ac02b040 con 0x55e7cd1899a0 2024-09-12T17:28:58.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.950+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd195960 con 0x55e7cd1899a0 2024-09-12T17:28:58.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.950+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f90ac02b040 con 0x55e7cd1899a0 2024-09-12T17:28:58.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.950+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd195960 con 0x7f90c0050980 2024-09-12T17:28:58.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.951+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90ac02b040 con 0x7f90c0050980 2024-09-12T17:28:58.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.951+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd195960 con 0x55e7cd192dd0 2024-09-12T17:28:58.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.951+0000 7f90c4ccb640 1 -- 172.21.15.170:0/2983332922 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b4057030 con 0x55e7cd192dd0 2024-09-12T17:28:58.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.951+0000 7f90c4ccb640 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd195960 con 0x55e7cd18e230 2024-09-12T17:28:58.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.951+0000 7f90c54cc640 1 -- 172.21.15.170:0/2983332922 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90c000a4d0 con 0x55e7cd18e230 2024-09-12T17:28:58.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.951+0000 7f90c54cc640 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd195960 con 0x55e7cd1899a0 2024-09-12T17:28:58.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.951+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90ac02b040 con 0x55e7cd1899a0 2024-09-12T17:28:58.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.951+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd195960 con 0x7f90c0050980 2024-09-12T17:28:58.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.952+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90ac02b040 con 0x7f90c0050980 2024-09-12T17:28:58.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.952+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd195960 con 0x55e7cd192dd0 2024-09-12T17:28:58.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.952+0000 7f90c4ccb640 1 -- 172.21.15.170:0/2983332922 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b4057030 con 0x55e7cd192dd0 2024-09-12T17:28:58.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.952+0000 7f90c4ccb640 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd195960 con 0x7f90c0050980 2024-09-12T17:28:58.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.952+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90ac02b040 con 0x7f90c0050980 2024-09-12T17:28:58.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.952+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd195960 con 0x55e7cd18e230 2024-09-12T17:28:58.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.953+0000 7f90c54cc640 1 -- 172.21.15.170:0/2983332922 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90c0068040 con 0x55e7cd18e230 2024-09-12T17:28:58.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.953+0000 7f90c54cc640 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd195960 con 0x55e7cd192dd0 2024-09-12T17:28:58.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.953+0000 7f90c4ccb640 1 -- 172.21.15.170:0/2983332922 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90b4057030 con 0x55e7cd192dd0 2024-09-12T17:28:58.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.953+0000 7f90c4ccb640 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd195960 con 0x7f90c0050980 2024-09-12T17:28:58.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.953+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90ac02b040 con 0x7f90c0050980 2024-09-12T17:28:58.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.953+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd195960 con 0x55e7cd1899a0 2024-09-12T17:28:58.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.953+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f90ac02b040 con 0x55e7cd1899a0 2024-09-12T17:28:58.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.953+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd195960 con 0x55e7cd18e230 2024-09-12T17:28:58.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.954+0000 7f90c54cc640 1 -- 172.21.15.170:0/2983332922 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(37 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f90c0068040 con 0x55e7cd18e230 2024-09-12T17:28:58.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.954+0000 7f90c9614800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:58.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.954+0000 7f90c9614800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:58.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.954+0000 7f90c9614800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:58.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.954+0000 7f90c9614800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:58.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.954+0000 7f90c9614800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:58.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.954+0000 7f90c9614800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:58.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.954+0000 7f90c9614800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.954+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd1917d0 con 0x55e7cd1899a0 2024-09-12T17:28:58.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.954+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90ac02b040 con 0x55e7cd1899a0 2024-09-12T17:28:58.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.954+0000 7f90c9614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:58.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.954+0000 7f90c9614800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.954+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd1913e0 con 0x55e7cd1899a0 2024-09-12T17:28:58.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.954+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f90ac03b040 con 0x55e7cd1899a0 2024-09-12T17:28:58.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.954+0000 7f90c9614800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:58.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.954+0000 7f90c9614800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.954+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd192100 con 0x55e7cd18e230 2024-09-12T17:28:58.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.954+0000 7f90c54cc640 1 -- 172.21.15.170:0/2983332922 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f90c0068040 con 0x55e7cd18e230 2024-09-12T17:28:58.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.954+0000 7f90c9614800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:58.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.954+0000 7f90c9614800 20 zone default found 2024-09-12T17:28:58.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.954+0000 7f90c9614800 4 Realm: () 2024-09-12T17:28:58.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.954+0000 7f90c9614800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:58.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.954+0000 7f90c9614800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:58.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.954+0000 7f90c9614800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:58.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.954+0000 7f90c9614800 20 zonegroup default 2024-09-12T17:28:58.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.954+0000 7f90c9614800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.954+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd191c80 con 0x7f90c0050980 2024-09-12T17:28:58.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.955+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f90ac03b040 con 0x7f90c0050980 2024-09-12T17:28:58.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.955+0000 7f90c9614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:58.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.955+0000 7f90c9614800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.955+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd198180 con 0x55e7cd192dd0 2024-09-12T17:28:58.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.955+0000 7f90c4ccb640 1 -- 172.21.15.170:0/2983332922 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f90b4057030 con 0x55e7cd192dd0 2024-09-12T17:28:58.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.955+0000 7f90c9614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:58.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.955+0000 7f90c9614800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.955+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd198570 con 0x55e7cd192dd0 2024-09-12T17:28:58.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.955+0000 7f90c4ccb640 1 -- 172.21.15.170:0/2983332922 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f90b4057030 con 0x55e7cd192dd0 2024-09-12T17:28:58.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.955+0000 7f90c9614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:58.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.955+0000 7f90c9614800 20 started sync module instance, tier type = 2024-09-12T17:28:58.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.955+0000 7f90c9614800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:58.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.955+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd197610 con 0x55e7cd18e230 2024-09-12T17:28:58.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.956+0000 7f90c54cc640 1 -- 172.21.15.170:0/2983332922 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(44 notify.0 [create] v31'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90c0068040 con 0x55e7cd18e230 2024-09-12T17:28:58.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.956+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94454066805248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd198e80 con 0x55e7cd18e230 2024-09-12T17:28:58.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.956+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd1996d0 con 0x55e7cd1899a0 2024-09-12T17:28:58.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.957+0000 7f90c54cc640 1 -- 172.21.15.170:0/2983332922 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94454066805248] v31'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90c0068040 con 0x55e7cd18e230 2024-09-12T17:28:58.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.957+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v31'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90ac03b040 con 0x55e7cd1899a0 2024-09-12T17:28:58.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.957+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94454066809296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd1993a0 con 0x55e7cd1899a0 2024-09-12T17:28:58.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.958+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd199ec0 con 0x55e7cd192dd0 2024-09-12T17:28:58.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.959+0000 7f90c4ccb640 1 -- 172.21.15.170:0/2983332922 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v31'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b4057030 con 0x55e7cd192dd0 2024-09-12T17:28:58.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.959+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94454066813328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd19a760 con 0x55e7cd192dd0 2024-09-12T17:28:58.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.959+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd19b250 con 0x55e7cd18e230 2024-09-12T17:28:58.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.959+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94454066809296] v31'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90ac03b040 con 0x55e7cd1899a0 2024-09-12T17:28:58.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.960+0000 7f90c4ccb640 1 -- 172.21.15.170:0/2983332922 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94454066813328] v31'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b4057030 con 0x55e7cd192dd0 2024-09-12T17:28:58.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.960+0000 7f90c54cc640 1 -- 172.21.15.170:0/2983332922 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(50 notify.3 [create] v31'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90c0068040 con 0x55e7cd18e230 2024-09-12T17:28:58.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.960+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94454066815664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd198df0 con 0x55e7cd18e230 2024-09-12T17:28:58.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.960+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd19bc60 con 0x55e7cd1899a0 2024-09-12T17:28:58.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.961+0000 7f90c54cc640 1 -- 172.21.15.170:0/2983332922 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94454066815664] v31'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90c0068040 con 0x55e7cd18e230 2024-09-12T17:28:58.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.961+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v31'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90ac03b040 con 0x55e7cd1899a0 2024-09-12T17:28:58.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.961+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94454066818336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd19bc60 con 0x55e7cd1899a0 2024-09-12T17:28:58.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.961+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd19c550 con 0x7f90c0050980 2024-09-12T17:28:58.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.962+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94454066818336] v31'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90ac03b040 con 0x55e7cd1899a0 2024-09-12T17:28:58.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.962+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(54 notify.5 [create] v31'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90ac03b040 con 0x7f90c0050980 2024-09-12T17:28:58.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.962+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94454066821520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd19c510 con 0x7f90c0050980 2024-09-12T17:28:58.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.962+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd19cf10 con 0x7f90c0050980 2024-09-12T17:28:58.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.963+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94454066821520] v31'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90ac03b040 con 0x7f90c0050980 2024-09-12T17:28:58.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.963+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v31'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90ac03b040 con 0x7f90c0050980 2024-09-12T17:28:58.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.963+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94454066822704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd19ced0 con 0x7f90c0050980 2024-09-12T17:28:58.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.963+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd19d920 con 0x7f90c0050980 2024-09-12T17:28:58.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.964+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(58 notify.7 [create] v31'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90ac03b040 con 0x7f90c0050980 2024-09-12T17:28:58.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.964+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94454066822704] v31'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90ac03b040 con 0x7f90c0050980 2024-09-12T17:28:58.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.964+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94454066828400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd19d890 con 0x7f90c0050980 2024-09-12T17:28:58.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.964+0000 7f90c9614800 20 add_watcher() i=0 2024-09-12T17:28:58.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.964+0000 7f90c9614800 20 add_watcher() i=1 2024-09-12T17:28:58.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.964+0000 7f90c9614800 20 add_watcher() i=2 2024-09-12T17:28:58.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.964+0000 7f90c9614800 20 add_watcher() i=3 2024-09-12T17:28:58.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.964+0000 7f90c9614800 20 add_watcher() i=4 2024-09-12T17:28:58.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.964+0000 7f90c9614800 20 add_watcher() i=5 2024-09-12T17:28:58.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.964+0000 7f90c9614800 20 add_watcher() i=6 2024-09-12T17:28:58.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.965+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94454066828400] v31'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90ac03b040 con 0x7f90c0050980 2024-09-12T17:28:58.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.965+0000 7f90c9614800 20 add_watcher() i=7 2024-09-12T17:28:58.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.965+0000 7f90c9614800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:58.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.965+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd1a0db0 con 0x55e7cd1899a0 2024-09-12T17:28:58.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.966+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f90ac03b040 con 0x55e7cd1899a0 2024-09-12T17:28:58.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.966+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94454066825760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd19e260 con 0x55e7cd1899a0 2024-09-12T17:28:58.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.967+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94454066825760] v31'203 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f90ac03b040 con 0x55e7cd1899a0 2024-09-12T17:28:58.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.967+0000 7f8f7afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:58.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.967+0000 7f90c9614800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:58.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.967+0000 7f90c9614800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:58.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.967+0000 7f90c9614800 5 note: GC not initialized 2024-09-12T17:28:58.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.967+0000 7f8f79fe3640 20 reqs_thread_entry: start 2024-09-12T17:28:58.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.967+0000 7f90c9614800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:58.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.967+0000 7f90c9614800 20 Filter name: none 2024-09-12T17:28:58.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.967+0000 7f8eeb7fe640 20 reqs_thread_entry: start 2024-09-12T17:28:58.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.967+0000 7f90c9614800 20 rados->read ofs=0 len=0 2024-09-12T17:28:58.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.967+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd1d3950 con 0x55e7cd1899a0 2024-09-12T17:28:58.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.968+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f90ac03b040 con 0x55e7cd1899a0 2024-09-12T17:28:58.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.968+0000 7f90c9614800 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:28:58.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.968+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd1d4d70 con 0x7f90c0050980 2024-09-12T17:28:58.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.968+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f90ac03b040 con 0x7f90c0050980 2024-09-12T17:28:58.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.969+0000 7f8f7afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:58.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.969+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94454066825760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd1d3270 con 0x55e7cd1899a0 2024-09-12T17:28:58.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.970+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94454066825760] v31'204 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f90ac03b040 con 0x55e7cd1899a0 2024-09-12T17:28:58.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.970+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94454066805248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd19ca20 con 0x55e7cd18e230 2024-09-12T17:28:58.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.971+0000 7f90c54cc640 1 -- 172.21.15.170:0/2983332922 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94454066805248] v31'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90c0068040 con 0x55e7cd18e230 2024-09-12T17:28:58.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.971+0000 7f90c9614800 20 remove_watcher() i=0 2024-09-12T17:28:58.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.971+0000 7f90c9614800 2 removed watcher, disabling cache 2024-09-12T17:28:58.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.971+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94454066809296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd19ca20 con 0x55e7cd1899a0 2024-09-12T17:28:58.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.972+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94454066809296] v31'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90ac03b040 con 0x55e7cd1899a0 2024-09-12T17:28:58.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.972+0000 7f90c9614800 20 remove_watcher() i=1 2024-09-12T17:28:58.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.972+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94454066813328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd1989d0 con 0x55e7cd192dd0 2024-09-12T17:28:58.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.973+0000 7f90c4ccb640 1 -- 172.21.15.170:0/2983332922 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94454066813328] v31'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90b4057030 con 0x55e7cd192dd0 2024-09-12T17:28:58.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.973+0000 7f90c9614800 20 remove_watcher() i=2 2024-09-12T17:28:58.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.973+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94454066815664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd19ca20 con 0x55e7cd18e230 2024-09-12T17:28:58.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.974+0000 7f90c54cc640 1 -- 172.21.15.170:0/2983332922 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94454066815664] v31'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90c0068040 con 0x55e7cd18e230 2024-09-12T17:28:58.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.974+0000 7f90c9614800 20 remove_watcher() i=3 2024-09-12T17:28:58.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.974+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94454066818336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd19a2b0 con 0x55e7cd1899a0 2024-09-12T17:28:58.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.975+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94454066818336] v31'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90ac03b040 con 0x55e7cd1899a0 2024-09-12T17:28:58.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.975+0000 7f90c9614800 20 remove_watcher() i=4 2024-09-12T17:28:58.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.975+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94454066821520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd19ca20 con 0x7f90c0050980 2024-09-12T17:28:58.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.976+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94454066821520] v31'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90ac03b040 con 0x7f90c0050980 2024-09-12T17:28:58.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.977+0000 7f90c9614800 20 remove_watcher() i=5 2024-09-12T17:28:58.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.977+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94454066822704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd19a2b0 con 0x7f90c0050980 2024-09-12T17:28:58.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.978+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94454066822704] v31'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90ac03b040 con 0x7f90c0050980 2024-09-12T17:28:58.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.978+0000 7f90c9614800 20 remove_watcher() i=6 2024-09-12T17:28:58.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.978+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94454066828400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7cd19ca20 con 0x7f90c0050980 2024-09-12T17:28:58.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.979+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94454066828400] v31'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90ac03b040 con 0x7f90c0050980 2024-09-12T17:28:58.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.979+0000 7f90c9614800 20 remove_watcher() i=7 2024-09-12T17:28:58.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.979+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f90c0050980 msgr2=0x7f90c00145e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.979+0000 7f90c9614800 1 --2- 172.21.15.170:0/2983332922 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f90c0050980 0x7f90c00145e0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.979+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55e7cd1899a0 msgr2=0x55e7cd18bdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.979+0000 7f90c9614800 1 --2- 172.21.15.170:0/2983332922 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55e7cd1899a0 0x55e7cd18bdf0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.979+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55e7cd18e230 msgr2=0x55e7cd190620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.979+0000 7f90c9614800 1 --2- 172.21.15.170:0/2983332922 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55e7cd18e230 0x55e7cd190620 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.979+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55e7cd192dd0 msgr2=0x55e7cd195290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.979+0000 7f90c9614800 1 --2- 172.21.15.170:0/2983332922 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55e7cd192dd0 0x55e7cd195290 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.979+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8f9003c780 msgr2=0x7f8f9003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.979+0000 7f90c9614800 1 --2- 172.21.15.170:0/2983332922 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8f9003c780 0x7f8f9003ec40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f90b4065fd0 tx=0x7f90b4086000 comp rx=0 tx=0).stop 2024-09-12T17:28:58.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.979+0000 7f90bc4ca640 1 -- 172.21.15.170:0/2983332922 reap_dead start 2024-09-12T17:28:58.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.979+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7cd176a50 msgr2=0x55e7cd17e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.979+0000 7f90c9614800 1 --2- 172.21.15.170:0/2983332922 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7cd176a50 0x55e7cd17e010 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f90c0053ca0 tx=0x7f90c0053d00 comp rx=0 tx=0).stop 2024-09-12T17:28:58.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.979+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 shutdown_connections 2024-09-12T17:28:58.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.979+0000 7f90c9614800 1 --2- 172.21.15.170:0/2983332922 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7cd176a50 0x55e7cd17e010 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.979+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 >> 172.21.15.170:0/2983332922 conn(0x55e7cd172e50 msgr2=0x55e7cd171060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:58.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.979+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 shutdown_connections 2024-09-12T17:28:58.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.979+0000 7f90c9614800 1 -- 172.21.15.170:0/2983332922 wait complete. 2024-09-12T17:28:58.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.979+0000 7f90c9614800 1 -- 172.21.15.170:0/1260258400 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8f9c03c730 msgr2=0x7f8f9c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.979+0000 7f90c9614800 1 --2- 172.21.15.170:0/1260258400 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8f9c03c730 0x7f8f9c03ebf0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f90b4005570 tx=0x7f90b4050600 comp rx=0 tx=0).stop 2024-09-12T17:28:58.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.979+0000 7f90c9614800 1 -- 172.21.15.170:0/1260258400 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7cd169f80 msgr2=0x55e7cd16a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.979+0000 7f90c9614800 1 --2- 172.21.15.170:0/1260258400 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7cd169f80 0x55e7cd16a3a0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x55e7cd150090 tx=0x7f90c00167b0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.979+0000 7f90c9614800 1 -- 172.21.15.170:0/1260258400 shutdown_connections 2024-09-12T17:28:58.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.979+0000 7f90c9614800 1 --2- 172.21.15.170:0/1260258400 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8f9c03c730 0x7f8f9c03ebf0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.979+0000 7f90c9614800 1 --2- 172.21.15.170:0/1260258400 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7cd169f80 0x55e7cd16a3a0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.979+0000 7f90c9614800 1 -- 172.21.15.170:0/1260258400 >> 172.21.15.170:0/1260258400 conn(0x55e7cd15e330 msgr2=0x55e7cd15e710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:58.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.980+0000 7f90c9614800 1 -- 172.21.15.170:0/1260258400 shutdown_connections 2024-09-12T17:28:58.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.980+0000 7f90c9614800 1 -- 172.21.15.170:0/1260258400 wait complete. 2024-09-12T17:28:58.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.980+0000 7f90c9614800 1 -- 172.21.15.170:0/2354519891 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55e7cd054df0 msgr2=0x55e7cd1566e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.980+0000 7f90c9614800 1 --2- 172.21.15.170:0/2354519891 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55e7cd054df0 0x55e7cd1566e0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.980+0000 7f90c9614800 1 -- 172.21.15.170:0/2354519891 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55e7cd158ac0 msgr2=0x55e7cd15af60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.980+0000 7f90c9614800 1 --2- 172.21.15.170:0/2354519891 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55e7cd158ac0 0x55e7cd15af60 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.980+0000 7f90c9614800 1 -- 172.21.15.170:0/2354519891 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8fac03c730 msgr2=0x7f8fac03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.980+0000 7f90c9614800 1 --2- 172.21.15.170:0/2354519891 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8fac03c730 0x7f8fac03ebf0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f90ac001e30 tx=0x7f90ac001390 comp rx=0 tx=0).stop 2024-09-12T17:28:58.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.980+0000 7f90c9614800 1 -- 172.21.15.170:0/2354519891 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7cd0544b0 msgr2=0x55e7cd14f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:58.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.980+0000 7f90c9614800 1 --2- 172.21.15.170:0/2354519891 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7cd0544b0 0x55e7cd14f090 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f90b40460d0 tx=0x7f90b4002fb0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.980+0000 7f90c9614800 1 -- 172.21.15.170:0/2354519891 shutdown_connections 2024-09-12T17:28:58.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.980+0000 7f90c9614800 1 --2- 172.21.15.170:0/2354519891 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55e7cd158ac0 0x55e7cd15af60 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.980+0000 7f90c9614800 1 --2- 172.21.15.170:0/2354519891 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8fac03c730 0x7f8fac03ebf0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.980+0000 7f90c9614800 1 --2- 172.21.15.170:0/2354519891 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55e7cd054df0 0x55e7cd1566e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.980+0000 7f90c9614800 1 --2- 172.21.15.170:0/2354519891 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7cd0544b0 0x55e7cd14f090 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:58.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.980+0000 7f90c9614800 1 -- 172.21.15.170:0/2354519891 >> 172.21.15.170:0/2354519891 conn(0x55e7cd050200 msgr2=0x55e7cd1419e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:58.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.980+0000 7f90c9614800 1 -- 172.21.15.170:0/2354519891 shutdown_connections 2024-09-12T17:28:58.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:58.980+0000 7f90c9614800 1 -- 172.21.15.170:0/2354519891 wait complete. 2024-09-12T17:28:58.995 INFO:teuthology.orchestra.run.smithi170.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-12T17:28:58.996 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T17:28:58.996 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-12T17:28:58.996 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-12T17:28:58.996 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-09-12T17:28:59.043 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:59.043 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:59.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.042+0000 7f2d7aa15800 1 Processor -- start 2024-09-12T17:28:59.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.042+0000 7f2d7aa15800 1 -- start start 2024-09-12T17:28:59.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.043+0000 7f2d7aa15800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x56177f6ad240 0x56177f6af6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.043+0000 7f2d7aa15800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56177f552e40 con 0x56177f6a9730 2024-09-12T17:28:59.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.043+0000 7f2d7aa15800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x56177f51d680 con 0x56177f6ad240 2024-09-12T17:28:59.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.043+0000 7f2d6ffff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x56177f6ad240 0x56177f6af6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.043+0000 7f2d6ffff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x56177f6ad240 0x56177f6af6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59662/0 (socket says 172.21.15.170:59662) 2024-09-12T17:28:59.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.043+0000 7f2d76192640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x56177f6a9730 0x56177f6abb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:57394/0 (socket says 172.21.15.170:57394) 2024-09-12T17:28:59.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.043+0000 7f2d6ffff640 1 -- 172.21.15.170:0/2704280725 learned_addr learned my addr 172.21.15.170:0/2704280725 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:59.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.043+0000 7f2d6ffff640 1 -- 172.21.15.170:0/2704280725 >> v1:172.21.15.47:6789/0 conn(0x56177f6a9730 legacy=0x56177f6abb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.043+0000 7f2d6ffff640 1 -- 172.21.15.170:0/2704280725 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56177f5396b0 con 0x56177f6ad240 2024-09-12T17:28:59.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.045+0000 7f2d6ffff640 1 --2- 172.21.15.170:0/2704280725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56177f6ad240 0x56177f6af6d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f2d6000a520 tx=0x7f2d60045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb009b47dda587d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.045+0000 7f2d75991640 1 -- 172.21.15.170:0/2704280725 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d60055070 con 0x56177f6ad240 2024-09-12T17:28:59.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.045+0000 7f2d75991640 1 -- 172.21.15.170:0/2704280725 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d600515b0 con 0x56177f6ad240 2024-09-12T17:28:59.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.045+0000 7f2d75991640 1 -- 172.21.15.170:0/2704280725 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d600518d0 con 0x56177f6ad240 2024-09-12T17:28:59.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.046+0000 7f2d7aa15800 1 -- 172.21.15.170:0/2704280725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56177f6ad240 msgr2=0x56177f6af6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.046+0000 7f2d7aa15800 1 --2- 172.21.15.170:0/2704280725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56177f6ad240 0x56177f6af6d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f2d6000a520 tx=0x7f2d60045ba0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.046+0000 7f2d7aa15800 1 -- 172.21.15.170:0/2704280725 shutdown_connections 2024-09-12T17:28:59.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.046+0000 7f2d7aa15800 1 --2- 172.21.15.170:0/2704280725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56177f6ad240 0x56177f6af6d0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.046+0000 7f2d7aa15800 1 -- 172.21.15.170:0/2704280725 >> 172.21.15.170:0/2704280725 conn(0x56177f6a31d0 msgr2=0x56177f6a5630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:59.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.046+0000 7f2d7aa15800 1 -- 172.21.15.170:0/2704280725 shutdown_connections 2024-09-12T17:28:59.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.046+0000 7f2d7aa15800 1 -- 172.21.15.170:0/2704280725 wait complete. 2024-09-12T17:28:59.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.060+0000 7f2d7aa15800 1 Processor -- start 2024-09-12T17:28:59.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.060+0000 7f2d7aa15800 1 -- start start 2024-09-12T17:28:59.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.060+0000 7f2d7aa15800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56177f6a9730 0x56177f6a8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.060+0000 7f2d7aa15800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56177f541dd0 con 0x56177f6a9730 2024-09-12T17:28:59.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.060+0000 7f2d76192640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56177f6a9730 0x56177f6a8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.060+0000 7f2d76192640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56177f6a9730 0x56177f6a8ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59670/0 (socket says 172.21.15.170:59670) 2024-09-12T17:28:59.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.061+0000 7f2d76192640 1 -- 172.21.15.170:0/1681673411 learned_addr learned my addr 172.21.15.170:0/1681673411 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:59.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.061+0000 7f2d76192640 1 -- 172.21.15.170:0/1681673411 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56177f55ae10 con 0x56177f6a9730 2024-09-12T17:28:59.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.061+0000 7f2d76192640 1 --2- 172.21.15.170:0/1681673411 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56177f6a9730 0x56177f6a8ea0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800b260 tx=0x7f2d6800b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59f75e9616e97c3d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.061+0000 7f2c64608640 1 -- 172.21.15.170:0/1681673411 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d6800be60 con 0x56177f6a9730 2024-09-12T17:28:59.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.061+0000 7f2c64608640 1 -- 172.21.15.170:0/1681673411 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d68006070 con 0x56177f6a9730 2024-09-12T17:28:59.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.061+0000 7f2c64608640 1 -- 172.21.15.170:0/1681673411 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d6800e710 con 0x56177f6a9730 2024-09-12T17:28:59.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.062+0000 7f2d7aa15800 1 -- 172.21.15.170:0/1681673411 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56177f6a9730 msgr2=0x56177f6a8ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.062+0000 7f2d7aa15800 1 --2- 172.21.15.170:0/1681673411 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56177f6a9730 0x56177f6a8ea0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800b260 tx=0x7f2d6800b660 comp rx=0 tx=0).stop 2024-09-12T17:28:59.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.062+0000 7f2d7aa15800 1 -- 172.21.15.170:0/1681673411 shutdown_connections 2024-09-12T17:28:59.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.062+0000 7f2d7aa15800 1 --2- 172.21.15.170:0/1681673411 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56177f6a9730 0x56177f6a8ea0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.062+0000 7f2d7aa15800 1 -- 172.21.15.170:0/1681673411 >> 172.21.15.170:0/1681673411 conn(0x56177f6a31d0 msgr2=0x56177f794060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:59.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.062+0000 7f2d7aa15800 1 -- 172.21.15.170:0/1681673411 shutdown_connections 2024-09-12T17:28:59.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.062+0000 7f2d7aa15800 1 -- 172.21.15.170:0/1681673411 wait complete. 2024-09-12T17:28:59.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.062+0000 7f2d7aa15800 1 Processor -- start 2024-09-12T17:28:59.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.062+0000 7f2d7aa15800 1 -- start start 2024-09-12T17:28:59.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.062+0000 7f2d7aa15800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56177f6a9730 0x56177f7a2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.062+0000 7f2d7aa15800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56177f6b0050 con 0x56177f6a9730 2024-09-12T17:28:59.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.063+0000 7f2d76192640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56177f6a9730 0x56177f7a2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.063+0000 7f2d76192640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56177f6a9730 0x56177f7a2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59678/0 (socket says 172.21.15.170:59678) 2024-09-12T17:28:59.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.063+0000 7f2d76192640 1 -- 172.21.15.170:0/2745900523 learned_addr learned my addr 172.21.15.170:0/2745900523 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:59.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.063+0000 7f2d76192640 1 -- 172.21.15.170:0/2745900523 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56177f7a27a0 con 0x56177f6a9730 2024-09-12T17:28:59.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.063+0000 7f2d76192640 1 --2- 172.21.15.170:0/2745900523 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56177f6a9730 0x56177f7a2240 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x56177f6a89d0 tx=0x7f2d68000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.063+0000 7f2c62e05640 1 -- 172.21.15.170:0/2745900523 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d6800f810 con 0x56177f6a9730 2024-09-12T17:28:59.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.063+0000 7f2c62e05640 1 -- 172.21.15.170:0/2745900523 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d6800f9b0 con 0x56177f6a9730 2024-09-12T17:28:59.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.063+0000 7f2d7aa15800 1 -- 172.21.15.170:0/2745900523 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56177f7a2a30 con 0x56177f6a9730 2024-09-12T17:28:59.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.063+0000 7f2c62e05640 1 -- 172.21.15.170:0/2745900523 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d6800fcd0 con 0x56177f6a9730 2024-09-12T17:28:59.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.064+0000 7f2d7aa15800 1 -- 172.21.15.170:0/2745900523 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56177f7a3430 con 0x56177f6a9730 2024-09-12T17:28:59.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.064+0000 7f2c62e05640 1 -- 172.21.15.170:0/2745900523 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2d68017070 con 0x56177f6a9730 2024-09-12T17:28:59.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.065+0000 7f2c62e05640 1 --2- 172.21.15.170:0/2745900523 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2c5c03c780 0x7f2c5c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.065+0000 7f2c62e05640 1 -- 172.21.15.170:0/2745900523 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f2d68015020 con 0x56177f6a9730 2024-09-12T17:28:59.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.065+0000 7f2d6ffff640 1 --2- 172.21.15.170:0/2745900523 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2c5c03c780 0x7f2c5c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.065+0000 7f2d7aa15800 1 --2- 172.21.15.170:0/2745900523 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56177f6ad240 0x56177f7a9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.065+0000 7f2d7aa15800 1 -- 172.21.15.170:0/2745900523 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56177f7a9dd0 con 0x56177f6ad240 2024-09-12T17:28:59.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.065+0000 7f2d76993640 1 --2- 172.21.15.170:0/2745900523 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56177f6ad240 0x56177f7a9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.065+0000 7f2d6ffff640 1 --2- 172.21.15.170:0/2745900523 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2c5c03c780 0x7f2c5c03ec40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2d60057000 tx=0x7f2d60052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.065+0000 7f2d76993640 1 --2- 172.21.15.170:0/2745900523 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56177f6ad240 0x56177f7a9890 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.066+0000 7f2d76993640 1 -- 172.21.15.170:0/2745900523 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d7000a4d0 con 0x56177f6ad240 2024-09-12T17:28:59.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.066+0000 7f2d7aa15800 1 -- 172.21.15.170:0/2745900523 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56177f7aa170 con 0x56177f6ad240 2024-09-12T17:28:59.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.066+0000 7f2d76993640 1 -- 172.21.15.170:0/2745900523 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2d7000a4d0 con 0x56177f6ad240 2024-09-12T17:28:59.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.066+0000 7f2d7aa15800 1 --2- 172.21.15.170:0/2745900523 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56177f7abc70 0x56177f7ae0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.066+0000 7f2d7aa15800 1 -- 172.21.15.170:0/2745900523 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56177f7ae880 con 0x56177f7abc70 2024-09-12T17:28:59.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.066+0000 7f2d76192640 1 --2- 172.21.15.170:0/2745900523 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56177f7abc70 0x56177f7ae0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.066+0000 7f2d76192640 1 --2- 172.21.15.170:0/2745900523 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56177f7abc70 0x56177f7ae0f0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.067+0000 7f2d76192640 1 -- 172.21.15.170:0/2745900523 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2d6802e070 con 0x56177f7abc70 2024-09-12T17:28:59.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.067+0000 7f2d7aa15800 1 -- 172.21.15.170:0/2745900523 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56177f7aa9c0 con 0x56177f6ad240 2024-09-12T17:28:59.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.067+0000 7f2d76993640 1 -- 172.21.15.170:0/2745900523 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2d7000a4d0 con 0x56177f6ad240 2024-09-12T17:28:59.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.067+0000 7f2d7aa15800 1 -- 172.21.15.170:0/2745900523 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56177f7aae10 con 0x56177f7abc70 2024-09-12T17:28:59.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.067+0000 7f2d76192640 1 -- 172.21.15.170:0/2745900523 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2d6802e070 con 0x56177f7abc70 2024-09-12T17:28:59.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.068+0000 7f2d7aa15800 1 Processor -- start 2024-09-12T17:28:59.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.068+0000 7f2d7aa15800 1 -- start start 2024-09-12T17:28:59.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.068+0000 7f2d7aa15800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56177f7bd130 0x56177f7bd550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.068+0000 7f2d7aa15800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56177f59fa00 con 0x56177f7bd130 2024-09-12T17:28:59.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.068+0000 7f2d76993640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56177f7bd130 0x56177f7bd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.068+0000 7f2d76993640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56177f7bd130 0x56177f7bd550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59690/0 (socket says 172.21.15.170:59690) 2024-09-12T17:28:59.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.068+0000 7f2d76993640 1 -- 172.21.15.170:0/2330592498 learned_addr learned my addr 172.21.15.170:0/2330592498 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:59.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.068+0000 7f2d76993640 1 -- 172.21.15.170:0/2330592498 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56177f7bdb90 con 0x56177f7bd130 2024-09-12T17:28:59.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.069+0000 7f2d76993640 1 --2- 172.21.15.170:0/2330592498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56177f7bd130 0x56177f7bd550 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x56177f7a3240 tx=0x7f2d700167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.069+0000 7f2c5bfff640 1 -- 172.21.15.170:0/2330592498 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d70013640 con 0x56177f7bd130 2024-09-12T17:28:59.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.069+0000 7f2c5bfff640 1 -- 172.21.15.170:0/2330592498 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d700137e0 con 0x56177f7bd130 2024-09-12T17:28:59.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.069+0000 7f2d7aa15800 1 -- 172.21.15.170:0/2330592498 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56177f7be3c0 con 0x56177f7bd130 2024-09-12T17:28:59.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.069+0000 7f2c5bfff640 1 -- 172.21.15.170:0/2330592498 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d70013ae0 con 0x56177f7bd130 2024-09-12T17:28:59.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.069+0000 7f2d7aa15800 1 -- 172.21.15.170:0/2330592498 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56177f7be960 con 0x56177f7bd130 2024-09-12T17:28:59.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.070+0000 7f2c5bfff640 1 -- 172.21.15.170:0/2330592498 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2d70011040 con 0x56177f7bd130 2024-09-12T17:28:59.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.070+0000 7f2c5bfff640 1 --2- 172.21.15.170:0/2330592498 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2c5003c730 0x7f2c5003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.070+0000 7f2c5bfff640 1 -- 172.21.15.170:0/2330592498 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f2d7000e040 con 0x56177f7bd130 2024-09-12T17:28:59.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.070+0000 7f2d76192640 1 --2- 172.21.15.170:0/2330592498 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2c5003c730 0x7f2c5003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.070+0000 7f2d7aa15800 1 Processor -- start 2024-09-12T17:28:59.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.070+0000 7f2d7aa15800 1 -- start start 2024-09-12T17:28:59.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.070+0000 7f2d76192640 1 --2- 172.21.15.170:0/2330592498 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2c5003c730 0x7f2c5003ebf0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2d68000c00 tx=0x7f2d680526d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.070+0000 7f2d7aa15800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56177f7c9c30 0x56177f7ca030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.070+0000 7f2d7aa15800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56177f6a7740 con 0x56177f7c9c30 2024-09-12T17:28:59.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.071+0000 7f2d76993640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56177f7c9c30 0x56177f7ca030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.071+0000 7f2d76993640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56177f7c9c30 0x56177f7ca030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59692/0 (socket says 172.21.15.170:59692) 2024-09-12T17:28:59.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.071+0000 7f2d76993640 1 -- 172.21.15.170:0/1347443011 learned_addr learned my addr 172.21.15.170:0/1347443011 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:59.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.071+0000 7f2d76993640 1 -- 172.21.15.170:0/1347443011 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56177f7ca620 con 0x56177f7c9c30 2024-09-12T17:28:59.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.071+0000 7f2d76993640 1 --2- 172.21.15.170:0/1347443011 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56177f7c9c30 0x56177f7ca030 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f2d70053d60 tx=0x7f2d7001fc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=459a42948eaa8a6b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.071+0000 7f2c59ffb640 1 -- 172.21.15.170:0/1347443011 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d70021910 con 0x56177f7c9c30 2024-09-12T17:28:59.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.071+0000 7f2c59ffb640 1 -- 172.21.15.170:0/1347443011 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d70021440 con 0x56177f7c9c30 2024-09-12T17:28:59.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.071+0000 7f2c59ffb640 1 -- 172.21.15.170:0/1347443011 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d70021ab0 con 0x56177f7c9c30 2024-09-12T17:28:59.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.072+0000 7f2d7aa15800 1 -- 172.21.15.170:0/1347443011 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56177f7c9c30 msgr2=0x56177f7ca030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.072+0000 7f2d7aa15800 1 --2- 172.21.15.170:0/1347443011 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56177f7c9c30 0x56177f7ca030 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f2d70053d60 tx=0x7f2d7001fc40 comp rx=0 tx=0).stop 2024-09-12T17:28:59.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.072+0000 7f2d7aa15800 1 -- 172.21.15.170:0/1347443011 shutdown_connections 2024-09-12T17:28:59.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.072+0000 7f2d7aa15800 1 --2- 172.21.15.170:0/1347443011 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56177f7c9c30 0x56177f7ca030 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.072+0000 7f2d7aa15800 1 -- 172.21.15.170:0/1347443011 >> 172.21.15.170:0/1347443011 conn(0x56177f7c6050 msgr2=0x56177f7c4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:59.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.072+0000 7f2d7aa15800 1 -- 172.21.15.170:0/1347443011 shutdown_connections 2024-09-12T17:28:59.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.072+0000 7f2d7aa15800 1 -- 172.21.15.170:0/1347443011 wait complete. 2024-09-12T17:28:59.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.072+0000 7f2d7aa15800 1 Processor -- start 2024-09-12T17:28:59.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.072+0000 7f2d7aa15800 1 -- start start 2024-09-12T17:28:59.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.072+0000 7f2d7aa15800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56177f7c9c30 0x56177f7d1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.072+0000 7f2d7aa15800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56177f7cac40 con 0x56177f7c9c30 2024-09-12T17:28:59.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.073+0000 7f2d76993640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56177f7c9c30 0x56177f7d1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.073+0000 7f2d76993640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56177f7c9c30 0x56177f7d1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59704/0 (socket says 172.21.15.170:59704) 2024-09-12T17:28:59.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.073+0000 7f2d76993640 1 -- 172.21.15.170:0/739167571 learned_addr learned my addr 172.21.15.170:0/739167571 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:59.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.073+0000 7f2d76993640 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56177f7d1770 con 0x56177f7c9c30 2024-09-12T17:28:59.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.073+0000 7f2d76993640 1 --2- 172.21.15.170:0/739167571 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56177f7c9c30 0x56177f7d1210 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f2d70047040 tx=0x7f2d70053cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.073+0000 7f2c47fff640 1 -- 172.21.15.170:0/739167571 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d70013db0 con 0x56177f7c9c30 2024-09-12T17:28:59.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.073+0000 7f2c47fff640 1 -- 172.21.15.170:0/739167571 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d70020800 con 0x56177f7c9c30 2024-09-12T17:28:59.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.073+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56177f7d1a00 con 0x56177f7c9c30 2024-09-12T17:28:59.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.073+0000 7f2c47fff640 1 -- 172.21.15.170:0/739167571 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d70020ae0 con 0x56177f7c9c30 2024-09-12T17:28:59.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.073+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56177f7d2380 con 0x56177f7c9c30 2024-09-12T17:28:59.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.074+0000 7f2c47fff640 1 -- 172.21.15.170:0/739167571 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2d70020c80 con 0x56177f7c9c30 2024-09-12T17:28:59.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.074+0000 7f2c47fff640 1 --2- 172.21.15.170:0/739167571 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2c4003c780 0x7f2c4003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.074+0000 7f2c47fff640 1 -- 172.21.15.170:0/739167571 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f2d7004b040 con 0x56177f7c9c30 2024-09-12T17:28:59.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.074+0000 7f2d7aa15800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.074+0000 7f2d76192640 1 --2- 172.21.15.170:0/739167571 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2c4003c780 0x7f2c4003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.075+0000 7f2d7aa15800 1 --2- 172.21.15.170:0/739167571 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56177f7dcb60 0x56177f7defd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.075+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56177f7df720 con 0x56177f7dcb60 2024-09-12T17:28:59.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.075+0000 7f2d6ffff640 1 --2- 172.21.15.170:0/739167571 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56177f7dcb60 0x56177f7defd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.075+0000 7f2d76192640 1 --2- 172.21.15.170:0/739167571 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2c4003c780 0x7f2c4003ec40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2d68051520 tx=0x7f2d68048000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.075+0000 7f2d6ffff640 1 --2- 172.21.15.170:0/739167571 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56177f7dcb60 0x56177f7defd0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.075+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d60057030 con 0x56177f7dcb60 2024-09-12T17:28:59.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.075+0000 7f2d7aa15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:59.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.075+0000 7f2d7aa15800 20 realm 2024-09-12T17:28:59.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.075+0000 7f2d7aa15800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.075+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56177f7dfb50 con 0x56177f7dcb60 2024-09-12T17:28:59.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.075+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d60057030 con 0x56177f7dcb60 2024-09-12T17:28:59.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.076+0000 7f2d7aa15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:59.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.076+0000 7f2d7aa15800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:59.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.076+0000 7f2d7aa15800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.076+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56177f7e0420 con 0x56177f7dcb60 2024-09-12T17:28:59.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.076+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d60057030 con 0x56177f7dcb60 2024-09-12T17:28:59.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.076+0000 7f2d7aa15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:59.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.076+0000 7f2d7aa15800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.076+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56177f7e07c0 con 0x56177f7dcb60 2024-09-12T17:28:59.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.076+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2d60057030 con 0x56177f7dcb60 2024-09-12T17:28:59.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.076+0000 7f2d7aa15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:59.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.076+0000 7f2d7aa15800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.076+0000 7f2d7aa15800 1 --2- 172.21.15.170:0/739167571 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56177f7e1520 0x56177f7e3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.076+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56177f7e3e50 con 0x56177f7e1520 2024-09-12T17:28:59.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.076+0000 7f2d76993640 1 --2- 172.21.15.170:0/739167571 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56177f7e1520 0x56177f7e3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.076+0000 7f2d76993640 1 --2- 172.21.15.170:0/739167571 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56177f7e1520 0x56177f7e3910 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.077+0000 7f2d76993640 1 -- 172.21.15.170:0/739167571 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2d70032070 con 0x56177f7e1520 2024-09-12T17:28:59.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.077+0000 7f2d7aa15800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:59.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.077+0000 7f2d7aa15800 20 searching for the correct realm 2024-09-12T17:28:59.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.077+0000 7f2d7aa15800 1 --2- 172.21.15.170:0/739167571 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x56177f7e5e90 0x56177f7e8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.077+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56177f7e8a20 con 0x56177f7e5e90 2024-09-12T17:28:59.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.077+0000 7f2d76192640 1 --2- 172.21.15.170:0/739167571 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x56177f7e5e90 0x56177f7e8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.077+0000 7f2d76192640 1 --2- 172.21.15.170:0/739167571 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x56177f7e5e90 0x56177f7e8350 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.077+0000 7f2d76192640 1 -- 172.21.15.170:0/739167571 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d6802e070 con 0x56177f7e5e90 2024-09-12T17:28:59.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.077+0000 7f2d76192640 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56177f7e8a20 con 0x56177f7e1520 2024-09-12T17:28:59.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.078+0000 7f2d76993640 1 -- 172.21.15.170:0/739167571 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d70032070 con 0x56177f7e1520 2024-09-12T17:28:59.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.078+0000 7f2d76993640 1 --2- 172.21.15.170:0/739167571 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f2d70035070 0x7f2d70055a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.078+0000 7f2d76993640 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56177f7e8a20 con 0x7f2d70035070 2024-09-12T17:28:59.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.078+0000 7f2d6ffff640 1 --2- 172.21.15.170:0/739167571 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f2d70035070 0x7f2d70055a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.078+0000 7f2d6ffff640 1 --2- 172.21.15.170:0/739167571 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f2d70035070 0x7f2d70055a30 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.079+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d60057030 con 0x7f2d70035070 2024-09-12T17:28:59.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.079+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56177f7e8a20 con 0x56177f7dcb60 2024-09-12T17:28:59.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.079+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d60057030 con 0x56177f7dcb60 2024-09-12T17:28:59.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.079+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56177f7e8a20 con 0x56177f7dcb60 2024-09-12T17:28:59.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.079+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d60057030 con 0x56177f7dcb60 2024-09-12T17:28:59.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.079+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56177f7e8a20 con 0x7f2d70035070 2024-09-12T17:28:59.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.079+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d60057030 con 0x7f2d70035070 2024-09-12T17:28:59.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.079+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56177f7e8a20 con 0x7f2d70035070 2024-09-12T17:28:59.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.080+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d60057030 con 0x7f2d70035070 2024-09-12T17:28:59.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.080+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56177f7e8a20 con 0x56177f7e1520 2024-09-12T17:28:59.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.080+0000 7f2d76993640 1 -- 172.21.15.170:0/739167571 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d70032070 con 0x56177f7e1520 2024-09-12T17:28:59.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.080+0000 7f2d76993640 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56177f7e8a20 con 0x56177f7e5e90 2024-09-12T17:28:59.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.080+0000 7f2d76192640 1 -- 172.21.15.170:0/739167571 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d6802e070 con 0x56177f7e5e90 2024-09-12T17:28:59.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.080+0000 7f2d76192640 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56177f7e8a20 con 0x56177f7dcb60 2024-09-12T17:28:59.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.080+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d60057030 con 0x56177f7dcb60 2024-09-12T17:28:59.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.080+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56177f7e8a20 con 0x7f2d70035070 2024-09-12T17:28:59.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.081+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d60057030 con 0x7f2d70035070 2024-09-12T17:28:59.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.081+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56177f7e8a20 con 0x56177f7dcb60 2024-09-12T17:28:59.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.081+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d60057030 con 0x56177f7dcb60 2024-09-12T17:28:59.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.081+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56177f7e8a20 con 0x56177f7e1520 2024-09-12T17:28:59.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.081+0000 7f2d76993640 1 -- 172.21.15.170:0/739167571 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f2d70032070 con 0x56177f7e1520 2024-09-12T17:28:59.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.081+0000 7f2d76993640 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56177f7e8a20 con 0x56177f7e5e90 2024-09-12T17:28:59.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.081+0000 7f2d76192640 1 -- 172.21.15.170:0/739167571 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d6802e070 con 0x56177f7e5e90 2024-09-12T17:28:59.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.081+0000 7f2d76192640 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56177f7e8a20 con 0x56177f7e5e90 2024-09-12T17:28:59.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.082+0000 7f2d76192640 1 -- 172.21.15.170:0/739167571 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d6802e070 con 0x56177f7e5e90 2024-09-12T17:28:59.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.082+0000 7f2d76192640 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56177f7e8a20 con 0x56177f7e1520 2024-09-12T17:28:59.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.082+0000 7f2d76993640 1 -- 172.21.15.170:0/739167571 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d70032070 con 0x56177f7e1520 2024-09-12T17:28:59.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.082+0000 7f2d76993640 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56177f7e8a20 con 0x56177f7e5e90 2024-09-12T17:28:59.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.082+0000 7f2d76192640 1 -- 172.21.15.170:0/739167571 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d6802e070 con 0x56177f7e5e90 2024-09-12T17:28:59.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.082+0000 7f2d76192640 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56177f7e8a20 con 0x56177f7e5e90 2024-09-12T17:28:59.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.082+0000 7f2d76192640 1 -- 172.21.15.170:0/739167571 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d6802e070 con 0x56177f7e5e90 2024-09-12T17:28:59.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.082+0000 7f2d76192640 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56177f7e8a20 con 0x56177f7dcb60 2024-09-12T17:28:59.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.082+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d60057030 con 0x56177f7dcb60 2024-09-12T17:28:59.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.082+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56177f7e8a20 con 0x56177f7dcb60 2024-09-12T17:28:59.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.083+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2d60057030 con 0x56177f7dcb60 2024-09-12T17:28:59.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.083+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56177f7e8a20 con 0x7f2d70035070 2024-09-12T17:28:59.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.083+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d60057030 con 0x7f2d70035070 2024-09-12T17:28:59.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.083+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56177f7e8a20 con 0x56177f7e5e90 2024-09-12T17:28:59.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.083+0000 7f2d76192640 1 -- 172.21.15.170:0/739167571 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d6802e070 con 0x56177f7e5e90 2024-09-12T17:28:59.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.083+0000 7f2d76192640 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56177f7e8a20 con 0x56177f7e1520 2024-09-12T17:28:59.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.083+0000 7f2d76993640 1 -- 172.21.15.170:0/739167571 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d70032070 con 0x56177f7e1520 2024-09-12T17:28:59.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.083+0000 7f2d76993640 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56177f7e8a20 con 0x56177f7dcb60 2024-09-12T17:28:59.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.084+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d60057030 con 0x56177f7dcb60 2024-09-12T17:28:59.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.084+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56177f7e8a20 con 0x7f2d70035070 2024-09-12T17:28:59.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.084+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d60057030 con 0x7f2d70035070 2024-09-12T17:28:59.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.084+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56177f7e8a20 con 0x56177f7e5e90 2024-09-12T17:28:59.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.084+0000 7f2d76192640 1 -- 172.21.15.170:0/739167571 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d6802e070 con 0x56177f7e5e90 2024-09-12T17:28:59.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.084+0000 7f2d76192640 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56177f7e8a20 con 0x7f2d70035070 2024-09-12T17:28:59.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.085+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d60057030 con 0x7f2d70035070 2024-09-12T17:28:59.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.085+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56177f7e8a20 con 0x56177f7e1520 2024-09-12T17:28:59.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.085+0000 7f2d76993640 1 -- 172.21.15.170:0/739167571 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d70032070 con 0x56177f7e1520 2024-09-12T17:28:59.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.085+0000 7f2d76993640 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56177f7e8a20 con 0x56177f7e5e90 2024-09-12T17:28:59.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.085+0000 7f2d76192640 1 -- 172.21.15.170:0/739167571 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d6802e070 con 0x56177f7e5e90 2024-09-12T17:28:59.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.085+0000 7f2d76192640 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56177f7e8a20 con 0x7f2d70035070 2024-09-12T17:28:59.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.085+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d60057030 con 0x7f2d70035070 2024-09-12T17:28:59.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.085+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56177f7e8a20 con 0x56177f7dcb60 2024-09-12T17:28:59.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.086+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2d60057030 con 0x56177f7dcb60 2024-09-12T17:28:59.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.086+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56177f7e8a20 con 0x56177f7e1520 2024-09-12T17:28:59.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.086+0000 7f2d76993640 1 -- 172.21.15.170:0/739167571 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(37 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2d70032070 con 0x56177f7e1520 2024-09-12T17:28:59.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.086+0000 7f2d7aa15800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:59.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.086+0000 7f2d7aa15800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:59.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.086+0000 7f2d7aa15800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:59.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.086+0000 7f2d7aa15800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:59.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.086+0000 7f2d7aa15800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:59.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.086+0000 7f2d7aa15800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:59.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.086+0000 7f2d7aa15800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.086+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56177f7e48c0 con 0x56177f7dcb60 2024-09-12T17:28:59.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.086+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d60057030 con 0x56177f7dcb60 2024-09-12T17:28:59.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.086+0000 7f2d7aa15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:59.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.086+0000 7f2d7aa15800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.086+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56177f7e44a0 con 0x56177f7dcb60 2024-09-12T17:28:59.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.086+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2d60057030 con 0x56177f7dcb60 2024-09-12T17:28:59.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.086+0000 7f2d7aa15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:59.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.086+0000 7f2d7aa15800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.086+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56177f7e51e0 con 0x56177f7e1520 2024-09-12T17:28:59.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.087+0000 7f2d76993640 1 -- 172.21.15.170:0/739167571 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2d70032070 con 0x56177f7e1520 2024-09-12T17:28:59.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.087+0000 7f2d7aa15800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:59.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.087+0000 7f2d7aa15800 20 zone default found 2024-09-12T17:28:59.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.087+0000 7f2d7aa15800 4 Realm: () 2024-09-12T17:28:59.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.087+0000 7f2d7aa15800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:59.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.087+0000 7f2d7aa15800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:59.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.087+0000 7f2d7aa15800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:59.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.087+0000 7f2d7aa15800 20 zonegroup default 2024-09-12T17:28:59.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.087+0000 7f2d7aa15800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.087+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56177f7e9350 con 0x7f2d70035070 2024-09-12T17:28:59.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.087+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2d60057030 con 0x7f2d70035070 2024-09-12T17:28:59.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.087+0000 7f2d7aa15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:59.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.087+0000 7f2d7aa15800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.087+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56177f7eb1e0 con 0x56177f7e5e90 2024-09-12T17:28:59.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.087+0000 7f2d76192640 1 -- 172.21.15.170:0/739167571 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2d6802e070 con 0x56177f7e5e90 2024-09-12T17:28:59.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.087+0000 7f2d7aa15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:59.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.087+0000 7f2d7aa15800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.087+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56177f7eb640 con 0x56177f7e5e90 2024-09-12T17:28:59.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.088+0000 7f2d76192640 1 -- 172.21.15.170:0/739167571 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2d6802e070 con 0x56177f7e5e90 2024-09-12T17:28:59.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.088+0000 7f2d7aa15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:59.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.088+0000 7f2d7aa15800 20 started sync module instance, tier type = 2024-09-12T17:28:59.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.088+0000 7f2d7aa15800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:59.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.088+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56177f7ea580 con 0x56177f7e1520 2024-09-12T17:28:59.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.089+0000 7f2d76993640 1 -- 172.21.15.170:0/739167571 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(44 notify.0 [create] v31'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d70032070 con 0x56177f7e1520 2024-09-12T17:28:59.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.089+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94658923243888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56177f7ebf50 con 0x56177f7e1520 2024-09-12T17:28:59.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.089+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56177f7ec7a0 con 0x56177f7dcb60 2024-09-12T17:28:59.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.089+0000 7f2d76993640 1 -- 172.21.15.170:0/739167571 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94658923243888] v31'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d70032070 con 0x56177f7e1520 2024-09-12T17:28:59.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.090+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v31'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d60057030 con 0x56177f7dcb60 2024-09-12T17:28:59.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.090+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94658923248560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56177f7ec500 con 0x56177f7dcb60 2024-09-12T17:28:59.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.090+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56177f7ecff0 con 0x56177f7e5e90 2024-09-12T17:28:59.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.091+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94658923248560] v31'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d60057030 con 0x56177f7dcb60 2024-09-12T17:28:59.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.091+0000 7f2d76192640 1 -- 172.21.15.170:0/739167571 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v31'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d6802e070 con 0x56177f7e5e90 2024-09-12T17:28:59.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.091+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94658923252416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56177f7ed410 con 0x56177f7e5e90 2024-09-12T17:28:59.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.091+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56177f7ede10 con 0x56177f7e1520 2024-09-12T17:28:59.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.092+0000 7f2d76993640 1 -- 172.21.15.170:0/739167571 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(50 notify.3 [create] v31'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d70032070 con 0x56177f7e1520 2024-09-12T17:28:59.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.092+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94658923256096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56177f7ee6b0 con 0x56177f7e1520 2024-09-12T17:28:59.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.092+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56177f7ef1b0 con 0x56177f7dcb60 2024-09-12T17:28:59.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.092+0000 7f2d76192640 1 -- 172.21.15.170:0/739167571 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94658923252416] v31'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d6802e070 con 0x56177f7e5e90 2024-09-12T17:28:59.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.093+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v31'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d60057030 con 0x56177f7dcb60 2024-09-12T17:28:59.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.093+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94658923261088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56177f7ef170 con 0x56177f7dcb60 2024-09-12T17:28:59.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.093+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56177f7efbc0 con 0x7f2d70035070 2024-09-12T17:28:59.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.093+0000 7f2d76993640 1 -- 172.21.15.170:0/739167571 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94658923256096] v31'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d70032070 con 0x56177f7e1520 2024-09-12T17:28:59.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.094+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94658923261088] v31'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d60057030 con 0x56177f7dcb60 2024-09-12T17:28:59.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.094+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(54 notify.5 [create] v31'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d60057030 con 0x7f2d70035070 2024-09-12T17:28:59.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.094+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94658923249616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56177f7ef710 con 0x7f2d70035070 2024-09-12T17:28:59.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.094+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56177f7f0490 con 0x7f2d70035070 2024-09-12T17:28:59.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.095+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94658923249616] v31'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d60057030 con 0x7f2d70035070 2024-09-12T17:28:59.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.095+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v31'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d60057030 con 0x7f2d70035070 2024-09-12T17:28:59.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.095+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94658923258368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56177f7ef710 con 0x7f2d70035070 2024-09-12T17:28:59.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.095+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56177f7f0ab0 con 0x7f2d70035070 2024-09-12T17:28:59.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.097+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94658923258368] v31'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d60057030 con 0x7f2d70035070 2024-09-12T17:28:59.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.097+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(58 notify.7 [create] v31'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d60057030 con 0x7f2d70035070 2024-09-12T17:28:59.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.097+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94658923265712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56177f7f0ab0 con 0x7f2d70035070 2024-09-12T17:28:59.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.097+0000 7f2d7aa15800 20 add_watcher() i=0 2024-09-12T17:28:59.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.097+0000 7f2d7aa15800 20 add_watcher() i=1 2024-09-12T17:28:59.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.097+0000 7f2d7aa15800 20 add_watcher() i=2 2024-09-12T17:28:59.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.097+0000 7f2d7aa15800 20 add_watcher() i=3 2024-09-12T17:28:59.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.097+0000 7f2d7aa15800 20 add_watcher() i=4 2024-09-12T17:28:59.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.097+0000 7f2d7aa15800 20 add_watcher() i=5 2024-09-12T17:28:59.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.097+0000 7f2d7aa15800 20 add_watcher() i=6 2024-09-12T17:28:59.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.098+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94658923265712] v31'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d60057030 con 0x7f2d70035070 2024-09-12T17:28:59.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.098+0000 7f2d7aa15800 20 add_watcher() i=7 2024-09-12T17:28:59.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.098+0000 7f2d7aa15800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:59.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.098+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56177f7f3dd0 con 0x56177f7dcb60 2024-09-12T17:28:59.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.098+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2d60057030 con 0x56177f7dcb60 2024-09-12T17:28:59.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.098+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94658923267952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56177f7f1040 con 0x56177f7dcb60 2024-09-12T17:28:59.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.099+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94658923267952] v31'205 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2d60057030 con 0x56177f7dcb60 2024-09-12T17:28:59.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.099+0000 7f2c2cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:59.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.099+0000 7f2d7aa15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:59.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.099+0000 7f2d7aa15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:59.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.099+0000 7f2d7aa15800 5 note: GC not initialized 2024-09-12T17:28:59.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.099+0000 7f2ba77fe640 20 reqs_thread_entry: start 2024-09-12T17:28:59.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.100+0000 7f2d7aa15800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:59.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.100+0000 7f2d7aa15800 20 Filter name: none 2024-09-12T17:28:59.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.100+0000 7f2ba57fa640 20 reqs_thread_entry: start 2024-09-12T17:28:59.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.100+0000 7f2d7aa15800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.100+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56177f826a00 con 0x56177f7dcb60 2024-09-12T17:28:59.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.100+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2d60057030 con 0x56177f7dcb60 2024-09-12T17:28:59.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.100+0000 7f2d7aa15800 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:28:59.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.100+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56177f827e20 con 0x7f2d70035070 2024-09-12T17:28:59.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.101+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f2d60089040 con 0x7f2d70035070 2024-09-12T17:28:59.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.101+0000 7f2c2cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:59.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.101+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94658923267952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56177f826320 con 0x56177f7dcb60 2024-09-12T17:28:59.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.102+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94658923267952] v31'206 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2d60089040 con 0x56177f7dcb60 2024-09-12T17:28:59.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.102+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94658923243888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56177f7f0770 con 0x56177f7e1520 2024-09-12T17:28:59.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.103+0000 7f2d76993640 1 -- 172.21.15.170:0/739167571 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94658923243888] v31'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d70032070 con 0x56177f7e1520 2024-09-12T17:28:59.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.103+0000 7f2d7aa15800 20 remove_watcher() i=0 2024-09-12T17:28:59.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.103+0000 7f2d7aa15800 2 removed watcher, disabling cache 2024-09-12T17:28:59.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.103+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94658923248560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56177f7ea970 con 0x56177f7dcb60 2024-09-12T17:28:59.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.104+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94658923248560] v31'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d60089040 con 0x56177f7dcb60 2024-09-12T17:28:59.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.104+0000 7f2d7aa15800 20 remove_watcher() i=1 2024-09-12T17:28:59.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.104+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94658923252416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56177f7ea970 con 0x56177f7e5e90 2024-09-12T17:28:59.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.106+0000 7f2d76192640 1 -- 172.21.15.170:0/739167571 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94658923252416] v31'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d6802e070 con 0x56177f7e5e90 2024-09-12T17:28:59.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.106+0000 7f2d7aa15800 20 remove_watcher() i=2 2024-09-12T17:28:59.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.106+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94658923256096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56177f7ebbb0 con 0x56177f7e1520 2024-09-12T17:28:59.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.107+0000 7f2d76993640 1 -- 172.21.15.170:0/739167571 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94658923256096] v31'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d70032070 con 0x56177f7e1520 2024-09-12T17:28:59.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.107+0000 7f2d7aa15800 20 remove_watcher() i=3 2024-09-12T17:28:59.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.107+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94658923261088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56177f7ebbb0 con 0x56177f7dcb60 2024-09-12T17:28:59.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.108+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94658923261088] v31'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d60089040 con 0x56177f7dcb60 2024-09-12T17:28:59.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.108+0000 7f2d7aa15800 20 remove_watcher() i=4 2024-09-12T17:28:59.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.108+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94658923249616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56177f7ebbb0 con 0x7f2d70035070 2024-09-12T17:28:59.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.109+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94658923249616] v31'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d60089040 con 0x7f2d70035070 2024-09-12T17:28:59.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.109+0000 7f2d7aa15800 20 remove_watcher() i=5 2024-09-12T17:28:59.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.109+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94658923258368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56177f7ec060 con 0x7f2d70035070 2024-09-12T17:28:59.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.110+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94658923258368] v31'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d60089040 con 0x7f2d70035070 2024-09-12T17:28:59.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.110+0000 7f2d7aa15800 20 remove_watcher() i=6 2024-09-12T17:28:59.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.110+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94658923265712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56177f7ee200 con 0x7f2d70035070 2024-09-12T17:28:59.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.111+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94658923265712] v31'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d60089040 con 0x7f2d70035070 2024-09-12T17:28:59.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.111+0000 7f2d7aa15800 20 remove_watcher() i=7 2024-09-12T17:28:59.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.111+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f2d70035070 msgr2=0x7f2d70055a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.111+0000 7f2d7aa15800 1 --2- 172.21.15.170:0/739167571 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f2d70035070 0x7f2d70055a30 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.111+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56177f7dcb60 msgr2=0x56177f7defd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.111+0000 7f2d7aa15800 1 --2- 172.21.15.170:0/739167571 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56177f7dcb60 0x56177f7defd0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.111+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56177f7e1520 msgr2=0x56177f7e3910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.111+0000 7f2d7aa15800 1 --2- 172.21.15.170:0/739167571 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56177f7e1520 0x56177f7e3910 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.111+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x56177f7e5e90 msgr2=0x56177f7e8350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.111+0000 7f2d7aa15800 1 --2- 172.21.15.170:0/739167571 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x56177f7e5e90 0x56177f7e8350 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.111+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2c4003c780 msgr2=0x7f2c4003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.111+0000 7f2d7aa15800 1 --2- 172.21.15.170:0/739167571 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2c4003c780 0x7f2c4003ec40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2d68051520 tx=0x7f2d68048000 comp rx=0 tx=0).stop 2024-09-12T17:28:59.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.111+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56177f7c9c30 msgr2=0x56177f7d1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.111+0000 7f2d7aa15800 1 --2- 172.21.15.170:0/739167571 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56177f7c9c30 0x56177f7d1210 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f2d70047040 tx=0x7f2d70053cc0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.111+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 reap_dead start 2024-09-12T17:28:59.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.111+0000 7f2d6ffff640 1 -- 172.21.15.170:0/739167571 reap_dead start 2024-09-12T17:28:59.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.111+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 shutdown_connections 2024-09-12T17:28:59.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.111+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 >> 172.21.15.170:0/739167571 conn(0x56177f7c6050 msgr2=0x56177f7c4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:59.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.111+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 shutdown_connections 2024-09-12T17:28:59.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.111+0000 7f2d7aa15800 1 -- 172.21.15.170:0/739167571 wait complete. 2024-09-12T17:28:59.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.112+0000 7f2d7aa15800 1 -- 172.21.15.170:0/2330592498 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2c5003c730 msgr2=0x7f2c5003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.112+0000 7f2d7aa15800 1 --2- 172.21.15.170:0/2330592498 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2c5003c730 0x7f2c5003ebf0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2d68000c00 tx=0x7f2d680526d0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.112+0000 7f2d7aa15800 1 -- 172.21.15.170:0/2330592498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56177f7bd130 msgr2=0x56177f7bd550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.112+0000 7f2d7aa15800 1 --2- 172.21.15.170:0/2330592498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56177f7bd130 0x56177f7bd550 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x56177f7a3240 tx=0x7f2d700167b0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.112+0000 7f2d7aa15800 1 -- 172.21.15.170:0/2330592498 shutdown_connections 2024-09-12T17:28:59.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.112+0000 7f2d7aa15800 1 --2- 172.21.15.170:0/2330592498 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2c5003c730 0x7f2c5003ebf0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.112+0000 7f2d7aa15800 1 --2- 172.21.15.170:0/2330592498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56177f7bd130 0x56177f7bd550 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.112+0000 7f2d7aa15800 1 -- 172.21.15.170:0/2330592498 >> 172.21.15.170:0/2330592498 conn(0x56177f7b14e0 msgr2=0x56177f7b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:59.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.112+0000 7f2d7aa15800 1 -- 172.21.15.170:0/2330592498 shutdown_connections 2024-09-12T17:28:59.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.112+0000 7f2d7aa15800 1 -- 172.21.15.170:0/2330592498 wait complete. 2024-09-12T17:28:59.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.112+0000 7f2d7aa15800 1 -- 172.21.15.170:0/2745900523 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56177f6ad240 msgr2=0x56177f7a9890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.112+0000 7f2d7aa15800 1 --2- 172.21.15.170:0/2745900523 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56177f6ad240 0x56177f7a9890 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.112+0000 7f2d7aa15800 1 -- 172.21.15.170:0/2745900523 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56177f7abc70 msgr2=0x56177f7ae0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.112+0000 7f2d7aa15800 1 --2- 172.21.15.170:0/2745900523 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56177f7abc70 0x56177f7ae0f0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.112+0000 7f2d7aa15800 1 -- 172.21.15.170:0/2745900523 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2c5c03c780 msgr2=0x7f2c5c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.112+0000 7f2d7aa15800 1 --2- 172.21.15.170:0/2745900523 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2c5c03c780 0x7f2c5c03ec40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2d60057000 tx=0x7f2d60052000 comp rx=0 tx=0).stop 2024-09-12T17:28:59.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.112+0000 7f2d7aa15800 1 -- 172.21.15.170:0/2745900523 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56177f6a9730 msgr2=0x56177f7a2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.112+0000 7f2d7aa15800 1 --2- 172.21.15.170:0/2745900523 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56177f6a9730 0x56177f7a2240 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x56177f6a89d0 tx=0x7f2d68000ed0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.112+0000 7f2d7aa15800 1 -- 172.21.15.170:0/2745900523 shutdown_connections 2024-09-12T17:28:59.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.112+0000 7f2d7aa15800 1 --2- 172.21.15.170:0/2745900523 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56177f7abc70 0x56177f7ae0f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.112+0000 7f2d7aa15800 1 --2- 172.21.15.170:0/2745900523 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2c5c03c780 0x7f2c5c03ec40 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.112+0000 7f2d7aa15800 1 --2- 172.21.15.170:0/2745900523 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56177f6ad240 0x56177f7a9890 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.112+0000 7f2d7aa15800 1 --2- 172.21.15.170:0/2745900523 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56177f6a9730 0x56177f7a2240 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.112+0000 7f2d7aa15800 1 -- 172.21.15.170:0/2745900523 >> 172.21.15.170:0/2745900523 conn(0x56177f6a31d0 msgr2=0x56177f793bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:59.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.112+0000 7f2d7aa15800 1 -- 172.21.15.170:0/2745900523 shutdown_connections 2024-09-12T17:28:59.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.112+0000 7f2d7aa15800 1 -- 172.21.15.170:0/2745900523 wait complete. 2024-09-12T17:28:59.126 INFO:teuthology.orchestra.run.smithi170.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-12T17:28:59.127 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T17:28:59.127 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-12T17:28:59.127 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-12T17:28:59.127 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-09-12T17:28:59.173 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:59.173 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:59.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.173+0000 7fbe534b7800 1 Processor -- start 2024-09-12T17:28:59.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.173+0000 7fbe534b7800 1 -- start start 2024-09-12T17:28:59.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.173+0000 7fbe534b7800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55ca28cdd210 0x55ca28ce2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.173+0000 7fbe534b7800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ca28b86e40 con 0x55ca28cdbe00 2024-09-12T17:28:59.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.173+0000 7fbe534b7800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x55ca28b51680 con 0x55ca28cdd210 2024-09-12T17:28:59.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.173+0000 7fbe507a0640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55ca28cdd210 0x55ca28ce2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.173+0000 7fbe50fa1640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x55ca28cdbe00 0x55ca28cdcb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:57400/0 (socket says 172.21.15.170:57400) 2024-09-12T17:28:59.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.173+0000 7fbe507a0640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55ca28cdd210 0x55ca28ce2db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59710/0 (socket says 172.21.15.170:59710) 2024-09-12T17:28:59.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.173+0000 7fbe50fa1640 1 -- 172.21.15.170:0/2910991314 learned_addr learned my addr 172.21.15.170:0/2910991314 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:28:59.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.174+0000 7fbe507a0640 1 -- 172.21.15.170:0/2910991314 >> v1:172.21.15.47:6789/0 conn(0x55ca28cdbe00 legacy=0x55ca28cdcb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.174+0000 7fbe507a0640 1 -- 172.21.15.170:0/2910991314 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca28b6d6b0 con 0x55ca28cdd210 2024-09-12T17:28:59.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.175+0000 7fbe507a0640 1 --2- 172.21.15.170:0/2910991314 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca28cdd210 0x55ca28ce2db0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fbe3800a470 tx=0x7fbe38045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dd7d54772899a35 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.176+0000 7fbe4ff9f640 1 -- 172.21.15.170:0/2910991314 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe38053570 con 0x55ca28cdd210 2024-09-12T17:28:59.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.176+0000 7fbe4ff9f640 1 -- 172.21.15.170:0/2910991314 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe38058070 con 0x55ca28cdd210 2024-09-12T17:28:59.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.176+0000 7fbe4ff9f640 1 -- 172.21.15.170:0/2910991314 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe38053880 con 0x55ca28cdd210 2024-09-12T17:28:59.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.176+0000 7fbe534b7800 1 -- 172.21.15.170:0/2910991314 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca28cdd210 msgr2=0x55ca28ce2db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.176+0000 7fbe534b7800 1 --2- 172.21.15.170:0/2910991314 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca28cdd210 0x55ca28ce2db0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fbe3800a470 tx=0x7fbe38045a20 comp rx=0 tx=0).stop 2024-09-12T17:28:59.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.176+0000 7fbe534b7800 1 -- 172.21.15.170:0/2910991314 shutdown_connections 2024-09-12T17:28:59.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.176+0000 7fbe534b7800 1 --2- 172.21.15.170:0/2910991314 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca28cdd210 0x55ca28ce2db0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.176+0000 7fbe534b7800 1 -- 172.21.15.170:0/2910991314 >> 172.21.15.170:0/2910991314 conn(0x55ca28cd71d0 msgr2=0x55ca28cd9630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:59.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.176+0000 7fbe534b7800 1 -- 172.21.15.170:0/2910991314 shutdown_connections 2024-09-12T17:28:59.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.176+0000 7fbe534b7800 1 -- 172.21.15.170:0/2910991314 wait complete. 2024-09-12T17:28:59.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.190+0000 7fbe534b7800 1 Processor -- start 2024-09-12T17:28:59.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.190+0000 7fbe534b7800 1 -- start start 2024-09-12T17:28:59.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.191+0000 7fbe534b7800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca28cdbe00 0x55ca28dcb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.191+0000 7fbe534b7800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ca28b75dd0 con 0x55ca28cdbe00 2024-09-12T17:28:59.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.191+0000 7fbe50fa1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca28cdbe00 0x55ca28dcb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.191+0000 7fbe50fa1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca28cdbe00 0x55ca28dcb5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59716/0 (socket says 172.21.15.170:59716) 2024-09-12T17:28:59.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.191+0000 7fbe50fa1640 1 -- 172.21.15.170:0/2980349340 learned_addr learned my addr 172.21.15.170:0/2980349340 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:59.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.191+0000 7fbe50fa1640 1 -- 172.21.15.170:0/2980349340 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca28b8ee10 con 0x55ca28cdbe00 2024-09-12T17:28:59.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.191+0000 7fbe50fa1640 1 --2- 172.21.15.170:0/2980349340 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca28cdbe00 0x55ca28dcb5b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fbe480017a0 tx=0x7fbe48001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27b006ac0c4c9dba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.191+0000 7fbd3ee0d640 1 -- 172.21.15.170:0/2980349340 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe480044e0 con 0x55ca28cdbe00 2024-09-12T17:28:59.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.191+0000 7fbd3ee0d640 1 -- 172.21.15.170:0/2980349340 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe480046a0 con 0x55ca28cdbe00 2024-09-12T17:28:59.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.191+0000 7fbd3ee0d640 1 -- 172.21.15.170:0/2980349340 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe48004a00 con 0x55ca28cdbe00 2024-09-12T17:28:59.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.192+0000 7fbe534b7800 1 -- 172.21.15.170:0/2980349340 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca28cdbe00 msgr2=0x55ca28dcb5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.192+0000 7fbe534b7800 1 --2- 172.21.15.170:0/2980349340 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca28cdbe00 0x55ca28dcb5b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fbe480017a0 tx=0x7fbe48001c60 comp rx=0 tx=0).stop 2024-09-12T17:28:59.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.192+0000 7fbe534b7800 1 -- 172.21.15.170:0/2980349340 shutdown_connections 2024-09-12T17:28:59.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.192+0000 7fbe534b7800 1 --2- 172.21.15.170:0/2980349340 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca28cdbe00 0x55ca28dcb5b0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.192+0000 7fbe534b7800 1 -- 172.21.15.170:0/2980349340 >> 172.21.15.170:0/2980349340 conn(0x55ca28cd71d0 msgr2=0x55ca28dc6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:59.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.192+0000 7fbe534b7800 1 -- 172.21.15.170:0/2980349340 shutdown_connections 2024-09-12T17:28:59.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.192+0000 7fbe534b7800 1 -- 172.21.15.170:0/2980349340 wait complete. 2024-09-12T17:28:59.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.193+0000 7fbe534b7800 1 Processor -- start 2024-09-12T17:28:59.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.193+0000 7fbe534b7800 1 -- start start 2024-09-12T17:28:59.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.193+0000 7fbe534b7800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca28cdbe00 0x55ca28c4fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.193+0000 7fbe534b7800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ca28cdd900 con 0x55ca28cdbe00 2024-09-12T17:28:59.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.193+0000 7fbe50fa1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca28cdbe00 0x55ca28c4fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.193+0000 7fbe50fa1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca28cdbe00 0x55ca28c4fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59732/0 (socket says 172.21.15.170:59732) 2024-09-12T17:28:59.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.193+0000 7fbe50fa1640 1 -- 172.21.15.170:0/2656846948 learned_addr learned my addr 172.21.15.170:0/2656846948 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:59.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.193+0000 7fbe50fa1640 1 -- 172.21.15.170:0/2656846948 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca28c50210 con 0x55ca28cdbe00 2024-09-12T17:28:59.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.194+0000 7fbe50fa1640 1 --2- 172.21.15.170:0/2656846948 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca28cdbe00 0x55ca28c4fcd0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x55ca28dcc540 tx=0x7fbe48000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.194+0000 7fbd3d60a640 1 -- 172.21.15.170:0/2656846948 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe48022020 con 0x55ca28cdbe00 2024-09-12T17:28:59.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.194+0000 7fbd3d60a640 1 -- 172.21.15.170:0/2656846948 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe48019040 con 0x55ca28cdbe00 2024-09-12T17:28:59.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.194+0000 7fbd3d60a640 1 -- 172.21.15.170:0/2656846948 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe48014960 con 0x55ca28cdbe00 2024-09-12T17:28:59.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.194+0000 7fbe534b7800 1 -- 172.21.15.170:0/2656846948 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ca28dd9070 con 0x55ca28cdbe00 2024-09-12T17:28:59.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.194+0000 7fbe534b7800 1 -- 172.21.15.170:0/2656846948 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca28dd94d0 con 0x55ca28cdbe00 2024-09-12T17:28:59.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.195+0000 7fbd3d60a640 1 -- 172.21.15.170:0/2656846948 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fbe48025020 con 0x55ca28cdbe00 2024-09-12T17:28:59.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.195+0000 7fbd3d60a640 1 --2- 172.21.15.170:0/2656846948 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbd3803c780 0x7fbd3803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.195+0000 7fbd3d60a640 1 -- 172.21.15.170:0/2656846948 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fbe48053830 con 0x55ca28cdbe00 2024-09-12T17:28:59.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.195+0000 7fbe507a0640 1 --2- 172.21.15.170:0/2656846948 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbd3803c780 0x7fbd3803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.195+0000 7fbe534b7800 1 --2- 172.21.15.170:0/2656846948 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55ca28cdd210 0x55ca28ddd480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.195+0000 7fbe534b7800 1 -- 172.21.15.170:0/2656846948 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ca28dddaf0 con 0x55ca28cdd210 2024-09-12T17:28:59.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.196+0000 7fbe517a2640 1 --2- 172.21.15.170:0/2656846948 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55ca28cdd210 0x55ca28ddd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.196+0000 7fbe507a0640 1 --2- 172.21.15.170:0/2656846948 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbd3803c780 0x7fbd3803ec40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbe38057000 tx=0x7fbe38052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.196+0000 7fbe517a2640 1 --2- 172.21.15.170:0/2656846948 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55ca28cdd210 0x55ca28ddd480 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.196+0000 7fbe517a2640 1 -- 172.21.15.170:0/2656846948 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe400083e0 con 0x55ca28cdd210 2024-09-12T17:28:59.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.196+0000 7fbe534b7800 1 -- 172.21.15.170:0/2656846948 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ca28dda910 con 0x55ca28cdd210 2024-09-12T17:28:59.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.196+0000 7fbe517a2640 1 -- 172.21.15.170:0/2656846948 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbe400083e0 con 0x55ca28cdd210 2024-09-12T17:28:59.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.196+0000 7fbe534b7800 1 --2- 172.21.15.170:0/2656846948 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55ca28ddfe40 0x55ca28de2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.196+0000 7fbe534b7800 1 -- 172.21.15.170:0/2656846948 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ca28de2900 con 0x55ca28ddfe40 2024-09-12T17:28:59.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.197+0000 7fbe50fa1640 1 --2- 172.21.15.170:0/2656846948 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55ca28ddfe40 0x55ca28de2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.197+0000 7fbe50fa1640 1 --2- 172.21.15.170:0/2656846948 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55ca28ddfe40 0x55ca28de2230 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.197+0000 7fbe50fa1640 1 -- 172.21.15.170:0/2656846948 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbe4800f030 con 0x55ca28ddfe40 2024-09-12T17:28:59.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.197+0000 7fbe534b7800 1 -- 172.21.15.170:0/2656846948 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ca28ddece0 con 0x55ca28cdd210 2024-09-12T17:28:59.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.197+0000 7fbe517a2640 1 -- 172.21.15.170:0/2656846948 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbe400083e0 con 0x55ca28cdd210 2024-09-12T17:28:59.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.197+0000 7fbe534b7800 1 -- 172.21.15.170:0/2656846948 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ca28ddf180 con 0x55ca28ddfe40 2024-09-12T17:28:59.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.198+0000 7fbe50fa1640 1 -- 172.21.15.170:0/2656846948 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbe4800f030 con 0x55ca28ddfe40 2024-09-12T17:28:59.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.198+0000 7fbe534b7800 1 Processor -- start 2024-09-12T17:28:59.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.198+0000 7fbe534b7800 1 -- start start 2024-09-12T17:28:59.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.198+0000 7fbe534b7800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca28df1170 0x55ca28df1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.198+0000 7fbe534b7800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ca28bd3a00 con 0x55ca28df1170 2024-09-12T17:28:59.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.198+0000 7fbe517a2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca28df1170 0x55ca28df1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.199+0000 7fbe517a2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca28df1170 0x55ca28df1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59738/0 (socket says 172.21.15.170:59738) 2024-09-12T17:28:59.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.199+0000 7fbe517a2640 1 -- 172.21.15.170:0/1549204705 learned_addr learned my addr 172.21.15.170:0/1549204705 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:59.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.199+0000 7fbe517a2640 1 -- 172.21.15.170:0/1549204705 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca28df1bd0 con 0x55ca28df1170 2024-09-12T17:28:59.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.199+0000 7fbe517a2640 1 --2- 172.21.15.170:0/1549204705 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca28df1170 0x55ca28df1590 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x55ca28c504f0 tx=0x7fbe4000bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.199+0000 7fbd367fc640 1 -- 172.21.15.170:0/1549204705 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe4001c020 con 0x55ca28df1170 2024-09-12T17:28:59.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.199+0000 7fbd367fc640 1 -- 172.21.15.170:0/1549204705 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe40007c90 con 0x55ca28df1170 2024-09-12T17:28:59.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.199+0000 7fbd367fc640 1 -- 172.21.15.170:0/1549204705 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe40018440 con 0x55ca28df1170 2024-09-12T17:28:59.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.199+0000 7fbe534b7800 1 -- 172.21.15.170:0/1549204705 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ca28df2400 con 0x55ca28df1170 2024-09-12T17:28:59.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.199+0000 7fbe534b7800 1 -- 172.21.15.170:0/1549204705 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca28df29a0 con 0x55ca28df1170 2024-09-12T17:28:59.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.200+0000 7fbd367fc640 1 -- 172.21.15.170:0/1549204705 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fbe4001f020 con 0x55ca28df1170 2024-09-12T17:28:59.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.200+0000 7fbd367fc640 1 --2- 172.21.15.170:0/1549204705 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbd2803c780 0x7fbd2803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.200+0000 7fbd367fc640 1 -- 172.21.15.170:0/1549204705 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fbe40054e50 con 0x55ca28df1170 2024-09-12T17:28:59.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.200+0000 7fbe50fa1640 1 --2- 172.21.15.170:0/1549204705 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbd2803c780 0x7fbd2803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.201+0000 7fbe534b7800 1 Processor -- start 2024-09-12T17:28:59.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.201+0000 7fbe50fa1640 1 --2- 172.21.15.170:0/1549204705 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbd2803c780 0x7fbd2803ec40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbe48010520 tx=0x7fbe4801cf30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.201+0000 7fbe534b7800 1 -- start start 2024-09-12T17:28:59.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.201+0000 7fbe534b7800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca28dfdc60 0x55ca28dfe060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.201+0000 7fbe534b7800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ca28dcbe00 con 0x55ca28dfdc60 2024-09-12T17:28:59.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.201+0000 7fbe517a2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca28dfdc60 0x55ca28dfe060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.201+0000 7fbe517a2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca28dfdc60 0x55ca28dfe060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59752/0 (socket says 172.21.15.170:59752) 2024-09-12T17:28:59.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.201+0000 7fbe517a2640 1 -- 172.21.15.170:0/4152173756 learned_addr learned my addr 172.21.15.170:0/4152173756 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:59.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.201+0000 7fbe517a2640 1 -- 172.21.15.170:0/4152173756 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca28dfe650 con 0x55ca28dfdc60 2024-09-12T17:28:59.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.202+0000 7fbe517a2640 1 --2- 172.21.15.170:0/4152173756 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca28dfdc60 0x55ca28dfe060 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fbe40053230 tx=0x7fbe40053370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37752eec7ee3520c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.202+0000 7fbd27fff640 1 -- 172.21.15.170:0/4152173756 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe40050030 con 0x55ca28dfdc60 2024-09-12T17:28:59.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.202+0000 7fbd27fff640 1 -- 172.21.15.170:0/4152173756 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe40044260 con 0x55ca28dfdc60 2024-09-12T17:28:59.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.202+0000 7fbd27fff640 1 -- 172.21.15.170:0/4152173756 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe400174d0 con 0x55ca28dfdc60 2024-09-12T17:28:59.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.202+0000 7fbe534b7800 1 -- 172.21.15.170:0/4152173756 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca28dfdc60 msgr2=0x55ca28dfe060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.202+0000 7fbe534b7800 1 --2- 172.21.15.170:0/4152173756 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca28dfdc60 0x55ca28dfe060 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fbe40053230 tx=0x7fbe40053370 comp rx=0 tx=0).stop 2024-09-12T17:28:59.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.202+0000 7fbe534b7800 1 -- 172.21.15.170:0/4152173756 shutdown_connections 2024-09-12T17:28:59.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.202+0000 7fbe534b7800 1 --2- 172.21.15.170:0/4152173756 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca28dfdc60 0x55ca28dfe060 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.202+0000 7fbe534b7800 1 -- 172.21.15.170:0/4152173756 >> 172.21.15.170:0/4152173756 conn(0x55ca28dfa060 msgr2=0x55ca28df82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:59.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.202+0000 7fbe534b7800 1 -- 172.21.15.170:0/4152173756 shutdown_connections 2024-09-12T17:28:59.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.202+0000 7fbe534b7800 1 -- 172.21.15.170:0/4152173756 wait complete. 2024-09-12T17:28:59.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.202+0000 7fbe534b7800 1 Processor -- start 2024-09-12T17:28:59.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.203+0000 7fbe534b7800 1 -- start start 2024-09-12T17:28:59.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.203+0000 7fbe534b7800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca28dfdc60 0x55ca28e05290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.203+0000 7fbe534b7800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ca28dfec70 con 0x55ca28dfdc60 2024-09-12T17:28:59.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.203+0000 7fbe517a2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca28dfdc60 0x55ca28e05290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.203+0000 7fbe517a2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca28dfdc60 0x55ca28e05290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59768/0 (socket says 172.21.15.170:59768) 2024-09-12T17:28:59.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.203+0000 7fbe517a2640 1 -- 172.21.15.170:0/2959364428 learned_addr learned my addr 172.21.15.170:0/2959364428 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:59.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.203+0000 7fbe517a2640 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca28e057f0 con 0x55ca28dfdc60 2024-09-12T17:28:59.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.203+0000 7fbe517a2640 1 --2- 172.21.15.170:0/2959364428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca28dfdc60 0x55ca28e05290 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fbe400533b0 tx=0x7fbe400531c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.204+0000 7fbd267fc640 1 -- 172.21.15.170:0/2959364428 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe40030070 con 0x55ca28dfdc60 2024-09-12T17:28:59.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.204+0000 7fbd267fc640 1 -- 172.21.15.170:0/2959364428 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe40013bf0 con 0x55ca28dfdc60 2024-09-12T17:28:59.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.204+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ca28e05a80 con 0x55ca28dfdc60 2024-09-12T17:28:59.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.204+0000 7fbd267fc640 1 -- 172.21.15.170:0/2959364428 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe40050050 con 0x55ca28dfdc60 2024-09-12T17:28:59.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.204+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca28e06400 con 0x55ca28dfdc60 2024-09-12T17:28:59.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.204+0000 7fbd267fc640 1 -- 172.21.15.170:0/2959364428 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fbe40016040 con 0x55ca28dfdc60 2024-09-12T17:28:59.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.205+0000 7fbd267fc640 1 --2- 172.21.15.170:0/2959364428 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbd1c03c780 0x7fbd1c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.205+0000 7fbd267fc640 1 -- 172.21.15.170:0/2959364428 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fbe40051070 con 0x55ca28dfdc60 2024-09-12T17:28:59.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.205+0000 7fbe50fa1640 1 --2- 172.21.15.170:0/2959364428 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbd1c03c780 0x7fbd1c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.205+0000 7fbe534b7800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.205+0000 7fbe534b7800 1 --2- 172.21.15.170:0/2959364428 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55ca28e10af0 0x55ca28e12fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.205+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e13700 con 0x55ca28e10af0 2024-09-12T17:28:59.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.205+0000 7fbe507a0640 1 --2- 172.21.15.170:0/2959364428 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55ca28e10af0 0x55ca28e12fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.205+0000 7fbe50fa1640 1 --2- 172.21.15.170:0/2959364428 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbd1c03c780 0x7fbd1c03ec40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbe4801efd0 tx=0x7fbe48034000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.205+0000 7fbe507a0640 1 --2- 172.21.15.170:0/2959364428 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55ca28e10af0 0x55ca28e12fb0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.206+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe38051070 con 0x55ca28e10af0 2024-09-12T17:28:59.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.206+0000 7fbe534b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:59.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.206+0000 7fbe534b7800 20 realm 2024-09-12T17:28:59.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.206+0000 7fbe534b7800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.206+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e13b30 con 0x55ca28e10af0 2024-09-12T17:28:59.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.206+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe38051070 con 0x55ca28e10af0 2024-09-12T17:28:59.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.206+0000 7fbe534b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:59.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.206+0000 7fbe534b7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:59.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.206+0000 7fbe534b7800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.206+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e14400 con 0x55ca28e10af0 2024-09-12T17:28:59.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.206+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe38051070 con 0x55ca28e10af0 2024-09-12T17:28:59.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.206+0000 7fbe534b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:59.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.206+0000 7fbe534b7800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.206+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e147a0 con 0x55ca28e10af0 2024-09-12T17:28:59.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.206+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbe38051070 con 0x55ca28e10af0 2024-09-12T17:28:59.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.206+0000 7fbe534b7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:59.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.206+0000 7fbe534b7800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.206+0000 7fbe534b7800 1 --2- 172.21.15.170:0/2959364428 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55ca28e15500 0x55ca28e178f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.206+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e17e30 con 0x55ca28e15500 2024-09-12T17:28:59.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.207+0000 7fbe517a2640 1 --2- 172.21.15.170:0/2959364428 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55ca28e15500 0x55ca28e178f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.207+0000 7fbe517a2640 1 --2- 172.21.15.170:0/2959364428 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55ca28e15500 0x55ca28e178f0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.207+0000 7fbe517a2640 1 -- 172.21.15.170:0/2959364428 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbe400083e0 con 0x55ca28e15500 2024-09-12T17:28:59.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.207+0000 7fbe534b7800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:59.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.207+0000 7fbe534b7800 20 searching for the correct realm 2024-09-12T17:28:59.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.207+0000 7fbe534b7800 1 --2- 172.21.15.170:0/2959364428 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55ca28e19e70 0x55ca28e1c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.207+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e1ca00 con 0x55ca28e19e70 2024-09-12T17:28:59.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.207+0000 7fbe50fa1640 1 --2- 172.21.15.170:0/2959364428 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55ca28e19e70 0x55ca28e1c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.208+0000 7fbe50fa1640 1 --2- 172.21.15.170:0/2959364428 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55ca28e19e70 0x55ca28e1c330 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.208+0000 7fbe50fa1640 1 -- 172.21.15.170:0/2959364428 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe4800f030 con 0x55ca28e19e70 2024-09-12T17:28:59.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.208+0000 7fbe50fa1640 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e1ca00 con 0x55ca28e15500 2024-09-12T17:28:59.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.208+0000 7fbe517a2640 1 -- 172.21.15.170:0/2959364428 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe400083e0 con 0x55ca28e15500 2024-09-12T17:28:59.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.208+0000 7fbe517a2640 1 --2- 172.21.15.170:0/2959364428 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fbe40021020 0x7fbe4002d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.208+0000 7fbe517a2640 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e1ca00 con 0x7fbe40021020 2024-09-12T17:28:59.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.208+0000 7fbe507a0640 1 --2- 172.21.15.170:0/2959364428 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fbe40021020 0x7fbe4002d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.209+0000 7fbe507a0640 1 --2- 172.21.15.170:0/2959364428 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fbe40021020 0x7fbe4002d080 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.209+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe38051070 con 0x7fbe40021020 2024-09-12T17:28:59.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.209+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e1ca00 con 0x55ca28e10af0 2024-09-12T17:28:59.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.209+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe38051070 con 0x55ca28e10af0 2024-09-12T17:28:59.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.209+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e1ca00 con 0x55ca28e10af0 2024-09-12T17:28:59.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.209+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe38051070 con 0x55ca28e10af0 2024-09-12T17:28:59.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.209+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e1ca00 con 0x7fbe40021020 2024-09-12T17:28:59.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.210+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe38051070 con 0x7fbe40021020 2024-09-12T17:28:59.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.210+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e1ca00 con 0x7fbe40021020 2024-09-12T17:28:59.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.210+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe38051070 con 0x7fbe40021020 2024-09-12T17:28:59.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.210+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e1ca00 con 0x55ca28e15500 2024-09-12T17:28:59.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.210+0000 7fbe517a2640 1 -- 172.21.15.170:0/2959364428 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe400083e0 con 0x55ca28e15500 2024-09-12T17:28:59.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.210+0000 7fbe517a2640 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e1ca00 con 0x55ca28e19e70 2024-09-12T17:28:59.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.210+0000 7fbe50fa1640 1 -- 172.21.15.170:0/2959364428 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe4800f030 con 0x55ca28e19e70 2024-09-12T17:28:59.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.210+0000 7fbe50fa1640 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e1ca00 con 0x55ca28e10af0 2024-09-12T17:28:59.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.211+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe38051070 con 0x55ca28e10af0 2024-09-12T17:28:59.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.211+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e1ca00 con 0x7fbe40021020 2024-09-12T17:28:59.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.211+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe38051070 con 0x7fbe40021020 2024-09-12T17:28:59.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.211+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e1ca00 con 0x55ca28e10af0 2024-09-12T17:28:59.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.211+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe38051070 con 0x55ca28e10af0 2024-09-12T17:28:59.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.211+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e1ca00 con 0x55ca28e15500 2024-09-12T17:28:59.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.211+0000 7fbe517a2640 1 -- 172.21.15.170:0/2959364428 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fbe400083e0 con 0x55ca28e15500 2024-09-12T17:28:59.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.211+0000 7fbe517a2640 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e1ca00 con 0x55ca28e19e70 2024-09-12T17:28:59.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.212+0000 7fbe50fa1640 1 -- 172.21.15.170:0/2959364428 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe4800f030 con 0x55ca28e19e70 2024-09-12T17:28:59.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.212+0000 7fbe50fa1640 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e1ca00 con 0x55ca28e19e70 2024-09-12T17:28:59.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.212+0000 7fbe50fa1640 1 -- 172.21.15.170:0/2959364428 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe4800f030 con 0x55ca28e19e70 2024-09-12T17:28:59.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.212+0000 7fbe50fa1640 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e1ca00 con 0x55ca28e15500 2024-09-12T17:28:59.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.212+0000 7fbe517a2640 1 -- 172.21.15.170:0/2959364428 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe4005d040 con 0x55ca28e15500 2024-09-12T17:28:59.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.212+0000 7fbe517a2640 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e1ca00 con 0x55ca28e19e70 2024-09-12T17:28:59.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.212+0000 7fbe50fa1640 1 -- 172.21.15.170:0/2959364428 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe4800f030 con 0x55ca28e19e70 2024-09-12T17:28:59.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.212+0000 7fbe50fa1640 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e1ca00 con 0x55ca28e19e70 2024-09-12T17:28:59.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.212+0000 7fbe50fa1640 1 -- 172.21.15.170:0/2959364428 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe4800f030 con 0x55ca28e19e70 2024-09-12T17:28:59.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.213+0000 7fbe50fa1640 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e1ca00 con 0x55ca28e10af0 2024-09-12T17:28:59.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.213+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe38051070 con 0x55ca28e10af0 2024-09-12T17:28:59.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.213+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e1ca00 con 0x55ca28e10af0 2024-09-12T17:28:59.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.213+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbe38051070 con 0x55ca28e10af0 2024-09-12T17:28:59.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.213+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e1ca00 con 0x7fbe40021020 2024-09-12T17:28:59.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.213+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe38051070 con 0x7fbe40021020 2024-09-12T17:28:59.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.213+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e1ca00 con 0x55ca28e19e70 2024-09-12T17:28:59.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.214+0000 7fbe50fa1640 1 -- 172.21.15.170:0/2959364428 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe4800f030 con 0x55ca28e19e70 2024-09-12T17:28:59.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.214+0000 7fbe50fa1640 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e1ca00 con 0x55ca28e15500 2024-09-12T17:28:59.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.214+0000 7fbe517a2640 1 -- 172.21.15.170:0/2959364428 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe4005d040 con 0x55ca28e15500 2024-09-12T17:28:59.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.214+0000 7fbe517a2640 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e1ca00 con 0x55ca28e10af0 2024-09-12T17:28:59.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.214+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe38051070 con 0x55ca28e10af0 2024-09-12T17:28:59.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.214+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e1ca00 con 0x7fbe40021020 2024-09-12T17:28:59.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.214+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe38051070 con 0x7fbe40021020 2024-09-12T17:28:59.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.214+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e1ca00 con 0x55ca28e19e70 2024-09-12T17:28:59.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.215+0000 7fbe50fa1640 1 -- 172.21.15.170:0/2959364428 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe4800f030 con 0x55ca28e19e70 2024-09-12T17:28:59.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.215+0000 7fbe50fa1640 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e1ca00 con 0x7fbe40021020 2024-09-12T17:28:59.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.215+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe38051070 con 0x7fbe40021020 2024-09-12T17:28:59.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.215+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e1ca00 con 0x55ca28e15500 2024-09-12T17:28:59.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.215+0000 7fbe517a2640 1 -- 172.21.15.170:0/2959364428 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe4005d040 con 0x55ca28e15500 2024-09-12T17:28:59.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.215+0000 7fbe517a2640 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e1ca00 con 0x55ca28e19e70 2024-09-12T17:28:59.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.215+0000 7fbe50fa1640 1 -- 172.21.15.170:0/2959364428 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe4800f030 con 0x55ca28e19e70 2024-09-12T17:28:59.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.216+0000 7fbe50fa1640 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e1ca00 con 0x7fbe40021020 2024-09-12T17:28:59.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.216+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe38051070 con 0x7fbe40021020 2024-09-12T17:28:59.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.216+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e1ca00 con 0x55ca28e10af0 2024-09-12T17:28:59.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.216+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbe38051070 con 0x55ca28e10af0 2024-09-12T17:28:59.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.216+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e1ca00 con 0x55ca28e15500 2024-09-12T17:28:59.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.216+0000 7fbe517a2640 1 -- 172.21.15.170:0/2959364428 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(37 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbe4005d040 con 0x55ca28e15500 2024-09-12T17:28:59.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.216+0000 7fbe534b7800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:59.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.216+0000 7fbe534b7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:59.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.216+0000 7fbe534b7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:59.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.216+0000 7fbe534b7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:59.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.216+0000 7fbe534b7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:59.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.216+0000 7fbe534b7800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:59.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.216+0000 7fbe534b7800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.216+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e18870 con 0x55ca28e10af0 2024-09-12T17:28:59.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.217+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe38051070 con 0x55ca28e10af0 2024-09-12T17:28:59.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.217+0000 7fbe534b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:59.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.217+0000 7fbe534b7800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.217+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e18c90 con 0x55ca28e10af0 2024-09-12T17:28:59.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.217+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbe38051070 con 0x55ca28e10af0 2024-09-12T17:28:59.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.217+0000 7fbe534b7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:59.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.217+0000 7fbe534b7800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.217+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e19130 con 0x55ca28e15500 2024-09-12T17:28:59.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.217+0000 7fbe517a2640 1 -- 172.21.15.170:0/2959364428 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbe4005d040 con 0x55ca28e15500 2024-09-12T17:28:59.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.217+0000 7fbe534b7800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:59.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.217+0000 7fbe534b7800 20 zone default found 2024-09-12T17:28:59.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.217+0000 7fbe534b7800 4 Realm: () 2024-09-12T17:28:59.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.217+0000 7fbe534b7800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:59.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.217+0000 7fbe534b7800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:59.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.217+0000 7fbe534b7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:59.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.217+0000 7fbe534b7800 20 zonegroup default 2024-09-12T17:28:59.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.217+0000 7fbe534b7800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.217+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e1ce80 con 0x7fbe40021020 2024-09-12T17:28:59.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.217+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbe38051070 con 0x7fbe40021020 2024-09-12T17:28:59.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.217+0000 7fbe534b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:59.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.217+0000 7fbe534b7800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.217+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e1ed70 con 0x55ca28e19e70 2024-09-12T17:28:59.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.218+0000 7fbe50fa1640 1 -- 172.21.15.170:0/2959364428 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbe4800f030 con 0x55ca28e19e70 2024-09-12T17:28:59.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.218+0000 7fbe534b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:59.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.218+0000 7fbe534b7800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.218+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e1f200 con 0x55ca28e19e70 2024-09-12T17:28:59.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.218+0000 7fbe50fa1640 1 -- 172.21.15.170:0/2959364428 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbe4800f030 con 0x55ca28e19e70 2024-09-12T17:28:59.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.218+0000 7fbe534b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:59.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.218+0000 7fbe534b7800 20 started sync module instance, tier type = 2024-09-12T17:28:59.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.218+0000 7fbe534b7800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:59.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.218+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e1e0b0 con 0x55ca28e15500 2024-09-12T17:28:59.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.219+0000 7fbe517a2640 1 -- 172.21.15.170:0/2959364428 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(44 notify.0 [create] v31'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe4005d040 con 0x55ca28e15500 2024-09-12T17:28:59.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.219+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94326757647824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e1e0b0 con 0x55ca28e15500 2024-09-12T17:28:59.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.219+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e1fdb0 con 0x55ca28e10af0 2024-09-12T17:28:59.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.220+0000 7fbe517a2640 1 -- 172.21.15.170:0/2959364428 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94326757647824] v31'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe4005d040 con 0x55ca28e15500 2024-09-12T17:28:59.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.220+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v31'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe38051070 con 0x55ca28e10af0 2024-09-12T17:28:59.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.220+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94326757652608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e1e0b0 con 0x55ca28e10af0 2024-09-12T17:28:59.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.220+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e20860 con 0x55ca28e19e70 2024-09-12T17:28:59.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.221+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94326757652608] v31'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe38051070 con 0x55ca28e10af0 2024-09-12T17:28:59.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.222+0000 7fbe50fa1640 1 -- 172.21.15.170:0/2959364428 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v31'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe4800f030 con 0x55ca28e19e70 2024-09-12T17:28:59.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.222+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94326757645312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e1e020 con 0x55ca28e19e70 2024-09-12T17:28:59.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.222+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e21720 con 0x55ca28e15500 2024-09-12T17:28:59.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.223+0000 7fbe517a2640 1 -- 172.21.15.170:0/2959364428 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(50 notify.3 [create] v31'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe4005d040 con 0x55ca28e15500 2024-09-12T17:28:59.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.223+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94326757659760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e21fc0 con 0x55ca28e15500 2024-09-12T17:28:59.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.223+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e22ab0 con 0x55ca28e10af0 2024-09-12T17:28:59.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.223+0000 7fbe50fa1640 1 -- 172.21.15.170:0/2959364428 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94326757645312] v31'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe4800f030 con 0x55ca28e19e70 2024-09-12T17:28:59.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.224+0000 7fbe517a2640 1 -- 172.21.15.170:0/2959364428 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94326757659760] v31'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe4005d040 con 0x55ca28e15500 2024-09-12T17:28:59.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.224+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v31'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe38051070 con 0x55ca28e10af0 2024-09-12T17:28:59.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.224+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94326757664128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e21b10 con 0x55ca28e10af0 2024-09-12T17:28:59.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.224+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e23350 con 0x7fbe40021020 2024-09-12T17:28:59.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.225+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(54 notify.5 [create] v31'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe38051070 con 0x7fbe40021020 2024-09-12T17:28:59.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.225+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94326757666352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e23700 con 0x7fbe40021020 2024-09-12T17:28:59.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.225+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e23f50 con 0x7fbe40021020 2024-09-12T17:28:59.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.225+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94326757664128] v31'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe38051070 con 0x55ca28e10af0 2024-09-12T17:28:59.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.226+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94326757666352] v31'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe38051070 con 0x7fbe40021020 2024-09-12T17:28:59.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.226+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v31'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe38051070 con 0x7fbe40021020 2024-09-12T17:28:59.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.226+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94326757667408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e23b20 con 0x7fbe40021020 2024-09-12T17:28:59.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.226+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e24370 con 0x7fbe40021020 2024-09-12T17:28:59.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.227+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(58 notify.7 [create] v31'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe38051070 con 0x7fbe40021020 2024-09-12T17:28:59.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.227+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94326757670144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e24750 con 0x7fbe40021020 2024-09-12T17:28:59.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.227+0000 7fbe534b7800 20 add_watcher() i=0 2024-09-12T17:28:59.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.227+0000 7fbe534b7800 20 add_watcher() i=1 2024-09-12T17:28:59.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.227+0000 7fbe534b7800 20 add_watcher() i=2 2024-09-12T17:28:59.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.227+0000 7fbe534b7800 20 add_watcher() i=3 2024-09-12T17:28:59.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.227+0000 7fbe534b7800 20 add_watcher() i=4 2024-09-12T17:28:59.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.227+0000 7fbe534b7800 20 add_watcher() i=5 2024-09-12T17:28:59.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.227+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94326757667408] v31'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe38051070 con 0x7fbe40021020 2024-09-12T17:28:59.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.227+0000 7fbe534b7800 20 add_watcher() i=6 2024-09-12T17:28:59.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.228+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94326757670144] v31'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe38051070 con 0x7fbe40021020 2024-09-12T17:28:59.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.228+0000 7fbe534b7800 20 add_watcher() i=7 2024-09-12T17:28:59.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.228+0000 7fbe534b7800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:59.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.228+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e23670 con 0x55ca28e10af0 2024-09-12T17:28:59.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.229+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbe38051070 con 0x55ca28e10af0 2024-09-12T17:28:59.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.229+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94326757671392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e23670 con 0x55ca28e10af0 2024-09-12T17:28:59.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.230+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94326757671392] v31'207 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbe38051070 con 0x55ca28e10af0 2024-09-12T17:28:59.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.230+0000 7fbd077e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:59.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.230+0000 7fbe534b7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:59.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.230+0000 7fbe534b7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:59.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.230+0000 7fbe534b7800 5 note: GC not initialized 2024-09-12T17:28:59.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.230+0000 7fbd067e4640 20 reqs_thread_entry: start 2024-09-12T17:28:59.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.230+0000 7fbe534b7800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:59.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.230+0000 7fbe534b7800 20 Filter name: none 2024-09-12T17:28:59.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.230+0000 7fbcfffff640 20 reqs_thread_entry: start 2024-09-12T17:28:59.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.230+0000 7fbe534b7800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.230+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e5a370 con 0x55ca28e10af0 2024-09-12T17:28:59.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.231+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fbe38051070 con 0x55ca28e10af0 2024-09-12T17:28:59.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.231+0000 7fbe534b7800 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:28:59.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.231+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e5b790 con 0x7fbe40021020 2024-09-12T17:28:59.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.231+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fbe38051070 con 0x7fbe40021020 2024-09-12T17:28:59.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.232+0000 7fbd077e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:59.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.232+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94326757671392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e59c90 con 0x55ca28e10af0 2024-09-12T17:28:59.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.233+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94326757671392] v31'208 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbe38051070 con 0x55ca28e10af0 2024-09-12T17:28:59.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.233+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94326757647824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e241a0 con 0x55ca28e15500 2024-09-12T17:28:59.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.234+0000 7fbe517a2640 1 -- 172.21.15.170:0/2959364428 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94326757647824] v31'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe4005d040 con 0x55ca28e15500 2024-09-12T17:28:59.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.234+0000 7fbe534b7800 20 remove_watcher() i=0 2024-09-12T17:28:59.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.234+0000 7fbe534b7800 2 removed watcher, disabling cache 2024-09-12T17:28:59.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.234+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94326757652608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e1e5b0 con 0x55ca28e10af0 2024-09-12T17:28:59.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.235+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94326757652608] v31'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe38051070 con 0x55ca28e10af0 2024-09-12T17:28:59.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.235+0000 7fbe534b7800 20 remove_watcher() i=1 2024-09-12T17:28:59.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.235+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94326757645312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e1f880 con 0x55ca28e19e70 2024-09-12T17:28:59.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.236+0000 7fbe50fa1640 1 -- 172.21.15.170:0/2959364428 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94326757645312] v31'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe4800f030 con 0x55ca28e19e70 2024-09-12T17:28:59.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.236+0000 7fbe534b7800 20 remove_watcher() i=2 2024-09-12T17:28:59.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.236+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94326757659760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e1f880 con 0x55ca28e15500 2024-09-12T17:28:59.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.237+0000 7fbe517a2640 1 -- 172.21.15.170:0/2959364428 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94326757659760] v31'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe4005d040 con 0x55ca28e15500 2024-09-12T17:28:59.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.237+0000 7fbe534b7800 20 remove_watcher() i=3 2024-09-12T17:28:59.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.237+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94326757664128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e1f880 con 0x55ca28e10af0 2024-09-12T17:28:59.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.238+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94326757664128] v31'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe38051070 con 0x55ca28e10af0 2024-09-12T17:28:59.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.238+0000 7fbe534b7800 20 remove_watcher() i=4 2024-09-12T17:28:59.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.238+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94326757666352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e22580 con 0x7fbe40021020 2024-09-12T17:28:59.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.239+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94326757666352] v31'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe38051070 con 0x7fbe40021020 2024-09-12T17:28:59.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.239+0000 7fbe534b7800 20 remove_watcher() i=5 2024-09-12T17:28:59.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.239+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94326757667408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e1f880 con 0x7fbe40021020 2024-09-12T17:28:59.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.240+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94326757667408] v31'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe38051070 con 0x7fbe40021020 2024-09-12T17:28:59.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.240+0000 7fbe534b7800 20 remove_watcher() i=6 2024-09-12T17:28:59.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.240+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94326757670144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ca28e22580 con 0x7fbe40021020 2024-09-12T17:28:59.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.242+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94326757670144] v31'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe38051070 con 0x7fbe40021020 2024-09-12T17:28:59.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.242+0000 7fbe534b7800 20 remove_watcher() i=7 2024-09-12T17:28:59.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.242+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fbe40021020 msgr2=0x7fbe4002d080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.242+0000 7fbe534b7800 1 --2- 172.21.15.170:0/2959364428 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fbe40021020 0x7fbe4002d080 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.242+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55ca28e10af0 msgr2=0x55ca28e12fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.242+0000 7fbe534b7800 1 --2- 172.21.15.170:0/2959364428 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55ca28e10af0 0x55ca28e12fb0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.242+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55ca28e15500 msgr2=0x55ca28e178f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.242+0000 7fbe534b7800 1 --2- 172.21.15.170:0/2959364428 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55ca28e15500 0x55ca28e178f0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.242+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55ca28e19e70 msgr2=0x55ca28e1c330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.242+0000 7fbe534b7800 1 --2- 172.21.15.170:0/2959364428 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55ca28e19e70 0x55ca28e1c330 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.242+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbd1c03c780 msgr2=0x7fbd1c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.242+0000 7fbe534b7800 1 --2- 172.21.15.170:0/2959364428 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbd1c03c780 0x7fbd1c03ec40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbe4801efd0 tx=0x7fbe48034000 comp rx=0 tx=0).stop 2024-09-12T17:28:59.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.242+0000 7fbe507a0640 1 -- 172.21.15.170:0/2959364428 reap_dead start 2024-09-12T17:28:59.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.242+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca28dfdc60 msgr2=0x55ca28e05290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.242+0000 7fbe534b7800 1 --2- 172.21.15.170:0/2959364428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca28dfdc60 0x55ca28e05290 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fbe400533b0 tx=0x7fbe400531c0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.242+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 shutdown_connections 2024-09-12T17:28:59.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.242+0000 7fbe534b7800 1 --2- 172.21.15.170:0/2959364428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca28dfdc60 0x55ca28e05290 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.242+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 >> 172.21.15.170:0/2959364428 conn(0x55ca28dfa060 msgr2=0x55ca28df8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:59.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.242+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 shutdown_connections 2024-09-12T17:28:59.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.242+0000 7fbe534b7800 1 -- 172.21.15.170:0/2959364428 wait complete. 2024-09-12T17:28:59.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.242+0000 7fbe534b7800 1 -- 172.21.15.170:0/1549204705 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbd2803c780 msgr2=0x7fbd2803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.242+0000 7fbe534b7800 1 --2- 172.21.15.170:0/1549204705 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbd2803c780 0x7fbd2803ec40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbe48010520 tx=0x7fbe4801cf30 comp rx=0 tx=0).stop 2024-09-12T17:28:59.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.242+0000 7fbe534b7800 1 -- 172.21.15.170:0/1549204705 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca28df1170 msgr2=0x55ca28df1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.242+0000 7fbe534b7800 1 --2- 172.21.15.170:0/1549204705 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca28df1170 0x55ca28df1590 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x55ca28c504f0 tx=0x7fbe4000bf30 comp rx=0 tx=0).stop 2024-09-12T17:28:59.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.243+0000 7fbe534b7800 1 -- 172.21.15.170:0/1549204705 shutdown_connections 2024-09-12T17:28:59.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.243+0000 7fbe534b7800 1 --2- 172.21.15.170:0/1549204705 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbd2803c780 0x7fbd2803ec40 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.243+0000 7fbe534b7800 1 --2- 172.21.15.170:0/1549204705 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca28df1170 0x55ca28df1590 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.243+0000 7fbe534b7800 1 -- 172.21.15.170:0/1549204705 >> 172.21.15.170:0/1549204705 conn(0x55ca28de5520 msgr2=0x55ca28de5900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:59.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.243+0000 7fbe534b7800 1 -- 172.21.15.170:0/1549204705 shutdown_connections 2024-09-12T17:28:59.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.243+0000 7fbe534b7800 1 -- 172.21.15.170:0/1549204705 wait complete. 2024-09-12T17:28:59.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.243+0000 7fbe534b7800 1 -- 172.21.15.170:0/2656846948 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55ca28cdd210 msgr2=0x55ca28ddd480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.243+0000 7fbe534b7800 1 --2- 172.21.15.170:0/2656846948 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55ca28cdd210 0x55ca28ddd480 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.243+0000 7fbe534b7800 1 -- 172.21.15.170:0/2656846948 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55ca28ddfe40 msgr2=0x55ca28de2230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.243+0000 7fbe534b7800 1 --2- 172.21.15.170:0/2656846948 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55ca28ddfe40 0x55ca28de2230 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.243+0000 7fbe534b7800 1 -- 172.21.15.170:0/2656846948 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbd3803c780 msgr2=0x7fbd3803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.243+0000 7fbe534b7800 1 --2- 172.21.15.170:0/2656846948 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbd3803c780 0x7fbd3803ec40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbe38057000 tx=0x7fbe38052000 comp rx=0 tx=0).stop 2024-09-12T17:28:59.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.243+0000 7fbe534b7800 1 -- 172.21.15.170:0/2656846948 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca28cdbe00 msgr2=0x55ca28c4fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.243+0000 7fbe534b7800 1 --2- 172.21.15.170:0/2656846948 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca28cdbe00 0x55ca28c4fcd0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x55ca28dcc540 tx=0x7fbe48000f40 comp rx=0 tx=0).stop 2024-09-12T17:28:59.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.243+0000 7fbe534b7800 1 -- 172.21.15.170:0/2656846948 shutdown_connections 2024-09-12T17:28:59.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.243+0000 7fbe534b7800 1 --2- 172.21.15.170:0/2656846948 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55ca28ddfe40 0x55ca28de2230 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.243+0000 7fbe534b7800 1 --2- 172.21.15.170:0/2656846948 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbd3803c780 0x7fbd3803ec40 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.243+0000 7fbe534b7800 1 --2- 172.21.15.170:0/2656846948 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55ca28cdd210 0x55ca28ddd480 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.243+0000 7fbe534b7800 1 --2- 172.21.15.170:0/2656846948 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ca28cdbe00 0x55ca28c4fcd0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.243+0000 7fbe534b7800 1 -- 172.21.15.170:0/2656846948 >> 172.21.15.170:0/2656846948 conn(0x55ca28cd71d0 msgr2=0x55ca28dcc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:59.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.243+0000 7fbe534b7800 1 -- 172.21.15.170:0/2656846948 shutdown_connections 2024-09-12T17:28:59.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.243+0000 7fbe534b7800 1 -- 172.21.15.170:0/2656846948 wait complete. 2024-09-12T17:28:59.262 INFO:teuthology.orchestra.run.smithi170.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-12T17:28:59.263 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T17:28:59.263 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-12T17:28:59.263 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-12T17:28:59.263 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-09-12T17:28:59.310 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:59.310 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:59.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.309+0000 7f9516926800 1 Processor -- start 2024-09-12T17:28:59.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.309+0000 7f9516926800 1 -- start start 2024-09-12T17:28:59.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.310+0000 7f9516926800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x564cb5759210 0x564cb575edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.310+0000 7f9516926800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564cb5602e40 con 0x564cb5757e00 2024-09-12T17:28:59.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.310+0000 7f9516926800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x564cb55cd680 con 0x564cb5759210 2024-09-12T17:28:59.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.310+0000 7f9509dd8640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x564cb5759210 0x564cb575edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.310+0000 7f9509dd8640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x564cb5759210 0x564cb575edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59770/0 (socket says 172.21.15.170:59770) 2024-09-12T17:28:59.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.310+0000 7f9509dd8640 1 -- 172.21.15.170:0/2152457231 learned_addr learned my addr 172.21.15.170:0/2152457231 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:59.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.310+0000 7f95125d9640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x564cb5757e00 0x564cb5758b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:57406/0 (socket says 172.21.15.170:57406) 2024-09-12T17:28:59.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.310+0000 7f9509dd8640 1 -- 172.21.15.170:0/2152457231 >> v1:172.21.15.47:6789/0 conn(0x564cb5757e00 legacy=0x564cb5758b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.310+0000 7f9511dd8640 1 -- 172.21.15.170:0/2152457231 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3317149129 0 0) 0x564cb5602e40 con 0x564cb5757e00 2024-09-12T17:28:59.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.310+0000 7f9509dd8640 1 -- 172.21.15.170:0/2152457231 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cb55e96b0 con 0x564cb5759210 2024-09-12T17:28:59.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.312+0000 7f9509dd8640 1 --2- 172.21.15.170:0/2152457231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564cb5759210 0x564cb575edb0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f94fc00a520 tx=0x7f94fc045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56bc6e6a7ef9c9da server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.312+0000 7f9511dd8640 1 -- 172.21.15.170:0/2152457231 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94fc055070 con 0x564cb5759210 2024-09-12T17:28:59.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.312+0000 7f9511dd8640 1 -- 172.21.15.170:0/2152457231 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94fc0515b0 con 0x564cb5759210 2024-09-12T17:28:59.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.312+0000 7f9511dd8640 1 -- 172.21.15.170:0/2152457231 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94fc0518d0 con 0x564cb5759210 2024-09-12T17:28:59.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.313+0000 7f9516926800 1 -- 172.21.15.170:0/2152457231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564cb5759210 msgr2=0x564cb575edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.313+0000 7f9516926800 1 --2- 172.21.15.170:0/2152457231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564cb5759210 0x564cb575edb0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f94fc00a520 tx=0x7f94fc045ba0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.313+0000 7f9516926800 1 -- 172.21.15.170:0/2152457231 shutdown_connections 2024-09-12T17:28:59.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.313+0000 7f9516926800 1 --2- 172.21.15.170:0/2152457231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564cb5759210 0x564cb575edb0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.313+0000 7f9516926800 1 -- 172.21.15.170:0/2152457231 >> 172.21.15.170:0/2152457231 conn(0x564cb57531d0 msgr2=0x564cb5755630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:59.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.313+0000 7f9516926800 1 -- 172.21.15.170:0/2152457231 shutdown_connections 2024-09-12T17:28:59.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.313+0000 7f9516926800 1 -- 172.21.15.170:0/2152457231 wait complete. 2024-09-12T17:28:59.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.327+0000 7f9516926800 1 Processor -- start 2024-09-12T17:28:59.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.327+0000 7f9516926800 1 -- start start 2024-09-12T17:28:59.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.327+0000 7f9516926800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564cb5757e00 0x564cb56cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.327+0000 7f9516926800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564cb55f1dd0 con 0x564cb5757e00 2024-09-12T17:28:59.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.327+0000 7f95125d9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564cb5757e00 0x564cb56cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.327+0000 7f95125d9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564cb5757e00 0x564cb56cbd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59782/0 (socket says 172.21.15.170:59782) 2024-09-12T17:28:59.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.327+0000 7f95125d9640 1 -- 172.21.15.170:0/15359094 learned_addr learned my addr 172.21.15.170:0/15359094 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:59.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.328+0000 7f95125d9640 1 -- 172.21.15.170:0/15359094 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cb560ae10 con 0x564cb5757e00 2024-09-12T17:28:59.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.328+0000 7f95125d9640 1 --2- 172.21.15.170:0/15359094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564cb5757e00 0x564cb56cbd20 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f9504001ea0 tx=0x7f950400b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36138c85228f6836 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.328+0000 7f9400608640 1 -- 172.21.15.170:0/15359094 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9504008070 con 0x564cb5757e00 2024-09-12T17:28:59.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.328+0000 7f9400608640 1 -- 172.21.15.170:0/15359094 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f950400d500 con 0x564cb5757e00 2024-09-12T17:28:59.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.328+0000 7f9400608640 1 -- 172.21.15.170:0/15359094 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f950400d880 con 0x564cb5757e00 2024-09-12T17:28:59.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.329+0000 7f9516926800 1 -- 172.21.15.170:0/15359094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564cb5757e00 msgr2=0x564cb56cbd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.329+0000 7f9516926800 1 --2- 172.21.15.170:0/15359094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564cb5757e00 0x564cb56cbd20 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f9504001ea0 tx=0x7f950400b6a0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.329+0000 7f9516926800 1 -- 172.21.15.170:0/15359094 shutdown_connections 2024-09-12T17:28:59.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.329+0000 7f9516926800 1 --2- 172.21.15.170:0/15359094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564cb5757e00 0x564cb56cbd20 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.329+0000 7f9516926800 1 -- 172.21.15.170:0/15359094 >> 172.21.15.170:0/15359094 conn(0x564cb57531d0 msgr2=0x564cb5842d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:59.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.329+0000 7f9516926800 1 -- 172.21.15.170:0/15359094 shutdown_connections 2024-09-12T17:28:59.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.329+0000 7f9516926800 1 -- 172.21.15.170:0/15359094 wait complete. 2024-09-12T17:28:59.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.329+0000 7f9516926800 1 Processor -- start 2024-09-12T17:28:59.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.329+0000 7f9516926800 1 -- start start 2024-09-12T17:28:59.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.329+0000 7f9516926800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564cb5757e00 0x564cb5852040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.329+0000 7f9516926800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564cb5759900 con 0x564cb5757e00 2024-09-12T17:28:59.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.329+0000 7f95125d9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564cb5757e00 0x564cb5852040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.330+0000 7f95125d9640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564cb5757e00 0x564cb5852040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59796/0 (socket says 172.21.15.170:59796) 2024-09-12T17:28:59.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.330+0000 7f95125d9640 1 -- 172.21.15.170:0/1333141748 learned_addr learned my addr 172.21.15.170:0/1333141748 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:59.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.330+0000 7f95125d9640 1 -- 172.21.15.170:0/1333141748 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cb58525a0 con 0x564cb5757e00 2024-09-12T17:28:59.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.330+0000 7f95125d9640 1 --2- 172.21.15.170:0/1333141748 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564cb5757e00 0x564cb5852040 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f95040012f0 tx=0x7f9504000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.330+0000 7f93fee05640 1 -- 172.21.15.170:0/1333141748 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f950400f9d0 con 0x564cb5757e00 2024-09-12T17:28:59.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.330+0000 7f93fee05640 1 -- 172.21.15.170:0/1333141748 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f950400fb70 con 0x564cb5757e00 2024-09-12T17:28:59.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.330+0000 7f9516926800 1 -- 172.21.15.170:0/1333141748 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564cb5852830 con 0x564cb5757e00 2024-09-12T17:28:59.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.331+0000 7f93fee05640 1 -- 172.21.15.170:0/1333141748 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f950400fe50 con 0x564cb5757e00 2024-09-12T17:28:59.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.331+0000 7f9516926800 1 -- 172.21.15.170:0/1333141748 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cb5853230 con 0x564cb5757e00 2024-09-12T17:28:59.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.331+0000 7f93fee05640 1 -- 172.21.15.170:0/1333141748 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f9504017040 con 0x564cb5757e00 2024-09-12T17:28:59.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.332+0000 7f93fee05640 1 --2- 172.21.15.170:0/1333141748 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f93f803c8d0 0x7f93f803ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.332+0000 7f93fee05640 1 -- 172.21.15.170:0/1333141748 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f9504015020 con 0x564cb5757e00 2024-09-12T17:28:59.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.332+0000 7f9509dd8640 1 --2- 172.21.15.170:0/1333141748 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f93f803c8d0 0x7f93f803ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.332+0000 7f9516926800 1 --2- 172.21.15.170:0/1333141748 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564cb5759210 0x564cb5859690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.332+0000 7f9516926800 1 -- 172.21.15.170:0/1333141748 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564cb5859bd0 con 0x564cb5759210 2024-09-12T17:28:59.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.332+0000 7f9512dda640 1 --2- 172.21.15.170:0/1333141748 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564cb5759210 0x564cb5859690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.332+0000 7f9509dd8640 1 --2- 172.21.15.170:0/1333141748 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f93f803c8d0 0x7f93f803ed90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f94fc057000 tx=0x7f94fc052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.332+0000 7f9512dda640 1 --2- 172.21.15.170:0/1333141748 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564cb5759210 0x564cb5859690 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.333+0000 7f9512dda640 1 -- 172.21.15.170:0/1333141748 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f950c00a4d0 con 0x564cb5759210 2024-09-12T17:28:59.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.333+0000 7f9516926800 1 -- 172.21.15.170:0/1333141748 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564cb5859f70 con 0x564cb5759210 2024-09-12T17:28:59.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.333+0000 7f9512dda640 1 -- 172.21.15.170:0/1333141748 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f950c00a4d0 con 0x564cb5759210 2024-09-12T17:28:59.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.333+0000 7f9516926800 1 --2- 172.21.15.170:0/1333141748 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564cb585ba30 0x564cb585dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.333+0000 7f9516926800 1 -- 172.21.15.170:0/1333141748 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564cb585e630 con 0x564cb585ba30 2024-09-12T17:28:59.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.333+0000 7f95125d9640 1 --2- 172.21.15.170:0/1333141748 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564cb585ba30 0x564cb585dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.333+0000 7f95125d9640 1 --2- 172.21.15.170:0/1333141748 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564cb585ba30 0x564cb585dea0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.334+0000 7f95125d9640 1 -- 172.21.15.170:0/1333141748 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f950402d070 con 0x564cb585ba30 2024-09-12T17:28:59.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.334+0000 7f9516926800 1 -- 172.21.15.170:0/1333141748 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564cb585a7c0 con 0x564cb5759210 2024-09-12T17:28:59.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.334+0000 7f9512dda640 1 -- 172.21.15.170:0/1333141748 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f950c00a4d0 con 0x564cb5759210 2024-09-12T17:28:59.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.334+0000 7f9516926800 1 -- 172.21.15.170:0/1333141748 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564cb585abe0 con 0x564cb585ba30 2024-09-12T17:28:59.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.334+0000 7f95125d9640 1 -- 172.21.15.170:0/1333141748 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f950402d070 con 0x564cb585ba30 2024-09-12T17:28:59.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.334+0000 7f9516926800 1 Processor -- start 2024-09-12T17:28:59.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.335+0000 7f9516926800 1 -- start start 2024-09-12T17:28:59.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.335+0000 7f9516926800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564cb586cee0 0x564cb586d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.335+0000 7f9516926800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564cb564fa00 con 0x564cb586cee0 2024-09-12T17:28:59.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.335+0000 7f9512dda640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564cb586cee0 0x564cb586d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.335+0000 7f9512dda640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564cb586cee0 0x564cb586d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59800/0 (socket says 172.21.15.170:59800) 2024-09-12T17:28:59.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.335+0000 7f9512dda640 1 -- 172.21.15.170:0/1064202403 learned_addr learned my addr 172.21.15.170:0/1064202403 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:59.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.335+0000 7f9512dda640 1 -- 172.21.15.170:0/1064202403 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cb586d940 con 0x564cb586cee0 2024-09-12T17:28:59.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.336+0000 7f9512dda640 1 --2- 172.21.15.170:0/1064202403 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564cb586cee0 0x564cb586d300 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x564cb5853040 tx=0x7f950c0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.336+0000 7f93f7fff640 1 -- 172.21.15.170:0/1064202403 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f950c013640 con 0x564cb586cee0 2024-09-12T17:28:59.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.336+0000 7f93f7fff640 1 -- 172.21.15.170:0/1064202403 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f950c0137e0 con 0x564cb586cee0 2024-09-12T17:28:59.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.336+0000 7f9516926800 1 -- 172.21.15.170:0/1064202403 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564cb586e170 con 0x564cb586cee0 2024-09-12T17:28:59.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.336+0000 7f93f7fff640 1 -- 172.21.15.170:0/1064202403 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f950c013ae0 con 0x564cb586cee0 2024-09-12T17:28:59.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.336+0000 7f9516926800 1 -- 172.21.15.170:0/1064202403 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cb586e710 con 0x564cb586cee0 2024-09-12T17:28:59.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.337+0000 7f93f7fff640 1 -- 172.21.15.170:0/1064202403 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f950c011040 con 0x564cb586cee0 2024-09-12T17:28:59.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.337+0000 7f93f7fff640 1 --2- 172.21.15.170:0/1064202403 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f93ec03c780 0x7f93ec03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.337+0000 7f93f7fff640 1 -- 172.21.15.170:0/1064202403 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f950c00e040 con 0x564cb586cee0 2024-09-12T17:28:59.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.337+0000 7f95125d9640 1 --2- 172.21.15.170:0/1064202403 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f93ec03c780 0x7f93ec03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.337+0000 7f9516926800 1 Processor -- start 2024-09-12T17:28:59.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.337+0000 7f95125d9640 1 --2- 172.21.15.170:0/1064202403 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f93ec03c780 0x7f93ec03ec40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x564cb585ea00 tx=0x7f9504052690 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.337+0000 7f9516926800 1 -- start start 2024-09-12T17:28:59.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.337+0000 7f9516926800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564cb587aa50 0x564cb587ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.337+0000 7f9516926800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564cb584d470 con 0x564cb587aa50 2024-09-12T17:28:59.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.338+0000 7f9512dda640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564cb587aa50 0x564cb587ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.338+0000 7f9512dda640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564cb587aa50 0x564cb587ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59808/0 (socket says 172.21.15.170:59808) 2024-09-12T17:28:59.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.338+0000 7f9512dda640 1 -- 172.21.15.170:0/2337177225 learned_addr learned my addr 172.21.15.170:0/2337177225 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:59.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.338+0000 7f9512dda640 1 -- 172.21.15.170:0/2337177225 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cb587b440 con 0x564cb587aa50 2024-09-12T17:28:59.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.338+0000 7f9512dda640 1 --2- 172.21.15.170:0/2337177225 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564cb587aa50 0x564cb587ae50 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f950c053c30 tx=0x7f950c0143c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb50fe6317a614 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.338+0000 7f93f5ffb640 1 -- 172.21.15.170:0/2337177225 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f950c04a070 con 0x564cb587aa50 2024-09-12T17:28:59.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.338+0000 7f93f5ffb640 1 -- 172.21.15.170:0/2337177225 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f950c021910 con 0x564cb587aa50 2024-09-12T17:28:59.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.338+0000 7f93f5ffb640 1 -- 172.21.15.170:0/2337177225 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f950c021440 con 0x564cb587aa50 2024-09-12T17:28:59.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.339+0000 7f9516926800 1 -- 172.21.15.170:0/2337177225 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564cb587aa50 msgr2=0x564cb587ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.339+0000 7f9516926800 1 --2- 172.21.15.170:0/2337177225 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564cb587aa50 0x564cb587ae50 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f950c053c30 tx=0x7f950c0143c0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.339+0000 7f9516926800 1 -- 172.21.15.170:0/2337177225 shutdown_connections 2024-09-12T17:28:59.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.339+0000 7f9516926800 1 --2- 172.21.15.170:0/2337177225 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564cb587aa50 0x564cb587ae50 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.339+0000 7f9516926800 1 -- 172.21.15.170:0/2337177225 >> 172.21.15.170:0/2337177225 conn(0x564cb5875da0 msgr2=0x564cb5873fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:59.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.339+0000 7f9516926800 1 -- 172.21.15.170:0/2337177225 shutdown_connections 2024-09-12T17:28:59.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.339+0000 7f9516926800 1 -- 172.21.15.170:0/2337177225 wait complete. 2024-09-12T17:28:59.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.339+0000 7f9516926800 1 Processor -- start 2024-09-12T17:28:59.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.339+0000 7f9516926800 1 -- start start 2024-09-12T17:28:59.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.339+0000 7f9516926800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564cb587aa50 0x564cb5881030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.339+0000 7f9516926800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564cb58799e0 con 0x564cb587aa50 2024-09-12T17:28:59.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.339+0000 7f9512dda640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564cb587aa50 0x564cb5881030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.339+0000 7f9512dda640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564cb587aa50 0x564cb5881030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59820/0 (socket says 172.21.15.170:59820) 2024-09-12T17:28:59.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.339+0000 7f9512dda640 1 -- 172.21.15.170:0/1742382602 learned_addr learned my addr 172.21.15.170:0/1742382602 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:59.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.340+0000 7f9512dda640 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cb5881590 con 0x564cb587aa50 2024-09-12T17:28:59.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.340+0000 7f9512dda640 1 --2- 172.21.15.170:0/1742382602 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564cb587aa50 0x564cb5881030 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f950c014570 tx=0x7f950c053c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.340+0000 7f93e3fff640 1 -- 172.21.15.170:0/1742382602 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f950c037070 con 0x564cb587aa50 2024-09-12T17:28:59.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.340+0000 7f93e3fff640 1 -- 172.21.15.170:0/1742382602 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f950c013c80 con 0x564cb587aa50 2024-09-12T17:28:59.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.340+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564cb5881820 con 0x564cb587aa50 2024-09-12T17:28:59.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.340+0000 7f93e3fff640 1 -- 172.21.15.170:0/1742382602 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f950c04a040 con 0x564cb587aa50 2024-09-12T17:28:59.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.340+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cb58821a0 con 0x564cb587aa50 2024-09-12T17:28:59.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.341+0000 7f93e3fff640 1 -- 172.21.15.170:0/1742382602 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f950c03a070 con 0x564cb587aa50 2024-09-12T17:28:59.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.341+0000 7f93e3fff640 1 --2- 172.21.15.170:0/1742382602 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f93dc03c730 0x7f93dc03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.341+0000 7f93e3fff640 1 -- 172.21.15.170:0/1742382602 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f950c03dc10 con 0x564cb587aa50 2024-09-12T17:28:59.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.341+0000 7f95125d9640 1 --2- 172.21.15.170:0/1742382602 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f93dc03c730 0x7f93dc03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.341+0000 7f9516926800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.341+0000 7f9516926800 1 --2- 172.21.15.170:0/1742382602 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564cb588c8e0 0x564cb588eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.341+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564cb588f4f0 con 0x564cb588c8e0 2024-09-12T17:28:59.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.342+0000 7f9509dd8640 1 --2- 172.21.15.170:0/1742382602 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564cb588c8e0 0x564cb588eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.342+0000 7f95125d9640 1 --2- 172.21.15.170:0/1742382602 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f93dc03c730 0x7f93dc03ebf0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9504019fd0 tx=0x7f9504046000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.342+0000 7f9509dd8640 1 --2- 172.21.15.170:0/1742382602 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564cb588c8e0 0x564cb588eda0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.342+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94fc057030 con 0x564cb588c8e0 2024-09-12T17:28:59.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.342+0000 7f9516926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:59.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.342+0000 7f9516926800 20 realm 2024-09-12T17:28:59.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.342+0000 7f9516926800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.342+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564cb588f920 con 0x564cb588c8e0 2024-09-12T17:28:59.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.342+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94fc057030 con 0x564cb588c8e0 2024-09-12T17:28:59.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.342+0000 7f9516926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:59.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.342+0000 7f9516926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:59.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.342+0000 7f9516926800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.342+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564cb58901f0 con 0x564cb588c8e0 2024-09-12T17:28:59.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.343+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94fc057030 con 0x564cb588c8e0 2024-09-12T17:28:59.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.343+0000 7f9516926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:59.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.343+0000 7f9516926800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.343+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564cb5890590 con 0x564cb588c8e0 2024-09-12T17:28:59.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.343+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f94fc057030 con 0x564cb588c8e0 2024-09-12T17:28:59.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.343+0000 7f9516926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:59.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.343+0000 7f9516926800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.343+0000 7f9516926800 1 --2- 172.21.15.170:0/1742382602 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564cb58912f0 0x564cb58936e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.343+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564cb5893c20 con 0x564cb58912f0 2024-09-12T17:28:59.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.343+0000 7f9512dda640 1 --2- 172.21.15.170:0/1742382602 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564cb58912f0 0x564cb58936e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.343+0000 7f9512dda640 1 --2- 172.21.15.170:0/1742382602 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564cb58912f0 0x564cb58936e0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.344+0000 7f9512dda640 1 -- 172.21.15.170:0/1742382602 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f950c039030 con 0x564cb58912f0 2024-09-12T17:28:59.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.344+0000 7f9516926800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:59.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.344+0000 7f9516926800 20 searching for the correct realm 2024-09-12T17:28:59.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.344+0000 7f9516926800 1 --2- 172.21.15.170:0/1742382602 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x564cb5895c90 0x564cb5898150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.344+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cb5898820 con 0x564cb5895c90 2024-09-12T17:28:59.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.344+0000 7f95125d9640 1 --2- 172.21.15.170:0/1742382602 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x564cb5895c90 0x564cb5898150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.344+0000 7f95125d9640 1 --2- 172.21.15.170:0/1742382602 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x564cb5895c90 0x564cb5898150 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.344+0000 7f95125d9640 1 -- 172.21.15.170:0/1742382602 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f950402d070 con 0x564cb5895c90 2024-09-12T17:28:59.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.344+0000 7f95125d9640 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cb5898820 con 0x564cb58912f0 2024-09-12T17:28:59.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.345+0000 7f9512dda640 1 -- 172.21.15.170:0/1742382602 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f950c039030 con 0x564cb58912f0 2024-09-12T17:28:59.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.345+0000 7f9512dda640 1 --2- 172.21.15.170:0/1742382602 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f950c03c060 0x7f950c019230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.345+0000 7f9512dda640 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cb5898820 con 0x7f950c03c060 2024-09-12T17:28:59.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.345+0000 7f9509dd8640 1 --2- 172.21.15.170:0/1742382602 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f950c03c060 0x7f950c019230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.345+0000 7f9509dd8640 1 --2- 172.21.15.170:0/1742382602 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f950c03c060 0x7f950c019230 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.345+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94fc057030 con 0x7f950c03c060 2024-09-12T17:28:59.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.345+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cb5898820 con 0x564cb588c8e0 2024-09-12T17:28:59.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.346+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94fc057030 con 0x564cb588c8e0 2024-09-12T17:28:59.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.346+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cb5898820 con 0x564cb588c8e0 2024-09-12T17:28:59.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.346+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94fc057030 con 0x564cb588c8e0 2024-09-12T17:28:59.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.346+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cb5898820 con 0x7f950c03c060 2024-09-12T17:28:59.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.346+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94fc057030 con 0x7f950c03c060 2024-09-12T17:28:59.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.346+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cb5898820 con 0x7f950c03c060 2024-09-12T17:28:59.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.346+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94fc057030 con 0x7f950c03c060 2024-09-12T17:28:59.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.346+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cb5898820 con 0x564cb58912f0 2024-09-12T17:28:59.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.347+0000 7f9512dda640 1 -- 172.21.15.170:0/1742382602 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f950c060040 con 0x564cb58912f0 2024-09-12T17:28:59.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.347+0000 7f9512dda640 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cb5898820 con 0x564cb5895c90 2024-09-12T17:28:59.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.347+0000 7f95125d9640 1 -- 172.21.15.170:0/1742382602 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f950402d070 con 0x564cb5895c90 2024-09-12T17:28:59.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.347+0000 7f95125d9640 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cb5898820 con 0x564cb588c8e0 2024-09-12T17:28:59.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.347+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94fc057030 con 0x564cb588c8e0 2024-09-12T17:28:59.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.347+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cb5898820 con 0x7f950c03c060 2024-09-12T17:28:59.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.347+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94fc057030 con 0x7f950c03c060 2024-09-12T17:28:59.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.347+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cb5898820 con 0x564cb588c8e0 2024-09-12T17:28:59.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.348+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94fc057030 con 0x564cb588c8e0 2024-09-12T17:28:59.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.348+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cb5898820 con 0x564cb58912f0 2024-09-12T17:28:59.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.348+0000 7f9512dda640 1 -- 172.21.15.170:0/1742382602 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f950c060040 con 0x564cb58912f0 2024-09-12T17:28:59.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.348+0000 7f9512dda640 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cb5898820 con 0x564cb5895c90 2024-09-12T17:28:59.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.348+0000 7f95125d9640 1 -- 172.21.15.170:0/1742382602 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f950402d070 con 0x564cb5895c90 2024-09-12T17:28:59.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.348+0000 7f95125d9640 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cb5898820 con 0x564cb5895c90 2024-09-12T17:28:59.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.348+0000 7f95125d9640 1 -- 172.21.15.170:0/1742382602 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f950402d070 con 0x564cb5895c90 2024-09-12T17:28:59.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.348+0000 7f95125d9640 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cb5898820 con 0x564cb58912f0 2024-09-12T17:28:59.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.349+0000 7f9512dda640 1 -- 172.21.15.170:0/1742382602 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f950c060040 con 0x564cb58912f0 2024-09-12T17:28:59.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.349+0000 7f9512dda640 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cb5898820 con 0x564cb5895c90 2024-09-12T17:28:59.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.349+0000 7f95125d9640 1 -- 172.21.15.170:0/1742382602 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f950402d070 con 0x564cb5895c90 2024-09-12T17:28:59.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.349+0000 7f95125d9640 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cb5898820 con 0x564cb5895c90 2024-09-12T17:28:59.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.349+0000 7f95125d9640 1 -- 172.21.15.170:0/1742382602 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f950402d070 con 0x564cb5895c90 2024-09-12T17:28:59.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.349+0000 7f95125d9640 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cb5898820 con 0x564cb588c8e0 2024-09-12T17:28:59.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.349+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94fc057030 con 0x564cb588c8e0 2024-09-12T17:28:59.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.349+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cb5898820 con 0x564cb588c8e0 2024-09-12T17:28:59.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.349+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f94fc057030 con 0x564cb588c8e0 2024-09-12T17:28:59.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.349+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cb5898820 con 0x7f950c03c060 2024-09-12T17:28:59.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.350+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94fc057030 con 0x7f950c03c060 2024-09-12T17:28:59.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.350+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cb5898820 con 0x564cb5895c90 2024-09-12T17:28:59.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.350+0000 7f95125d9640 1 -- 172.21.15.170:0/1742382602 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f950402d070 con 0x564cb5895c90 2024-09-12T17:28:59.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.350+0000 7f95125d9640 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cb5898820 con 0x564cb58912f0 2024-09-12T17:28:59.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.350+0000 7f9512dda640 1 -- 172.21.15.170:0/1742382602 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f950c060040 con 0x564cb58912f0 2024-09-12T17:28:59.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.350+0000 7f9512dda640 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cb5898820 con 0x564cb588c8e0 2024-09-12T17:28:59.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.350+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94fc057030 con 0x564cb588c8e0 2024-09-12T17:28:59.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.350+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cb5898820 con 0x7f950c03c060 2024-09-12T17:28:59.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.351+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94fc057030 con 0x7f950c03c060 2024-09-12T17:28:59.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.351+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cb5898820 con 0x564cb5895c90 2024-09-12T17:28:59.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.351+0000 7f95125d9640 1 -- 172.21.15.170:0/1742382602 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f950402d070 con 0x564cb5895c90 2024-09-12T17:28:59.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.351+0000 7f95125d9640 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cb5898820 con 0x7f950c03c060 2024-09-12T17:28:59.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.351+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94fc057030 con 0x7f950c03c060 2024-09-12T17:28:59.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.351+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cb5898820 con 0x564cb58912f0 2024-09-12T17:28:59.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.351+0000 7f9512dda640 1 -- 172.21.15.170:0/1742382602 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f950c060040 con 0x564cb58912f0 2024-09-12T17:28:59.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.351+0000 7f9512dda640 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cb5898820 con 0x564cb5895c90 2024-09-12T17:28:59.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.352+0000 7f95125d9640 1 -- 172.21.15.170:0/1742382602 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f950402d070 con 0x564cb5895c90 2024-09-12T17:28:59.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.352+0000 7f95125d9640 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cb5898820 con 0x7f950c03c060 2024-09-12T17:28:59.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.352+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94fc057030 con 0x7f950c03c060 2024-09-12T17:28:59.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.352+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564cb5898820 con 0x564cb588c8e0 2024-09-12T17:28:59.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.352+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f94fc057030 con 0x564cb588c8e0 2024-09-12T17:28:59.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.352+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f94fc082080 con 0x564cb58912f0 2024-09-12T17:28:59.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.352+0000 7f9512dda640 1 -- 172.21.15.170:0/1742382602 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(37 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f950c060040 con 0x564cb58912f0 2024-09-12T17:28:59.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.353+0000 7f9516926800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:59.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.353+0000 7f9516926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:59.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.353+0000 7f9516926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:59.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.353+0000 7f9516926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:59.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.353+0000 7f9516926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:59.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.353+0000 7f9516926800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:59.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.353+0000 7f9516926800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.353+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564cb5894690 con 0x564cb588c8e0 2024-09-12T17:28:59.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.353+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94fc057030 con 0x564cb588c8e0 2024-09-12T17:28:59.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.353+0000 7f9516926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:59.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.353+0000 7f9516926800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.353+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564cb58942d0 con 0x564cb588c8e0 2024-09-12T17:28:59.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.353+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f94fc057030 con 0x564cb588c8e0 2024-09-12T17:28:59.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.353+0000 7f9516926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:59.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.353+0000 7f9516926800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.353+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564cb5894fb0 con 0x564cb58912f0 2024-09-12T17:28:59.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.353+0000 7f9512dda640 1 -- 172.21.15.170:0/1742382602 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f950c060040 con 0x564cb58912f0 2024-09-12T17:28:59.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.353+0000 7f9516926800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:59.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.353+0000 7f9516926800 20 zone default found 2024-09-12T17:28:59.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.353+0000 7f9516926800 4 Realm: () 2024-09-12T17:28:59.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.353+0000 7f9516926800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:59.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.353+0000 7f9516926800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:59.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.353+0000 7f9516926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:59.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.353+0000 7f9516926800 20 zonegroup default 2024-09-12T17:28:59.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.353+0000 7f9516926800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.353+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564cb5894b30 con 0x7f950c03c060 2024-09-12T17:28:59.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.354+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f94fc057030 con 0x7f950c03c060 2024-09-12T17:28:59.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.354+0000 7f9516926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:59.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.354+0000 7f9516926800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.354+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564cb589ab90 con 0x564cb5895c90 2024-09-12T17:28:59.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.354+0000 7f95125d9640 1 -- 172.21.15.170:0/1742382602 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f950402d070 con 0x564cb5895c90 2024-09-12T17:28:59.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.354+0000 7f9516926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:59.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.354+0000 7f9516926800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.354+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564cb589b040 con 0x564cb5895c90 2024-09-12T17:28:59.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.354+0000 7f95125d9640 1 -- 172.21.15.170:0/1742382602 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f950402d070 con 0x564cb5895c90 2024-09-12T17:28:59.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.354+0000 7f9516926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:59.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.354+0000 7f9516926800 20 started sync module instance, tier type = 2024-09-12T17:28:59.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.354+0000 7f9516926800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:59.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.354+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cb589a030 con 0x564cb58912f0 2024-09-12T17:28:59.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.355+0000 7f9512dda640 1 -- 172.21.15.170:0/1742382602 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(44 notify.0 [create] v31'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f950c060040 con 0x564cb58912f0 2024-09-12T17:28:59.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.355+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94887463199776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cb589b950 con 0x564cb58912f0 2024-09-12T17:28:59.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.355+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cb589c1a0 con 0x564cb588c8e0 2024-09-12T17:28:59.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.356+0000 7f9512dda640 1 -- 172.21.15.170:0/1742382602 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94887463199776] v31'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f950c060040 con 0x564cb58912f0 2024-09-12T17:28:59.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.357+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v31'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94fc057030 con 0x564cb588c8e0 2024-09-12T17:28:59.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.357+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94887463204000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cb589be70 con 0x564cb588c8e0 2024-09-12T17:28:59.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.357+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cb589c990 con 0x564cb5895c90 2024-09-12T17:28:59.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.358+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94887463204000] v31'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94fc057030 con 0x564cb588c8e0 2024-09-12T17:28:59.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.358+0000 7f95125d9640 1 -- 172.21.15.170:0/1742382602 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v31'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f950402d070 con 0x564cb5895c90 2024-09-12T17:28:59.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.358+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94887463208032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cb589cd80 con 0x564cb5895c90 2024-09-12T17:28:59.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.358+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cb589d7a0 con 0x564cb58912f0 2024-09-12T17:28:59.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.359+0000 7f9512dda640 1 -- 172.21.15.170:0/1742382602 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(50 notify.3 [create] v31'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f950c060040 con 0x564cb58912f0 2024-09-12T17:28:59.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.359+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94887463211664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cb589e040 con 0x564cb58912f0 2024-09-12T17:28:59.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.359+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cb589eb40 con 0x564cb588c8e0 2024-09-12T17:28:59.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.359+0000 7f95125d9640 1 -- 172.21.15.170:0/1742382602 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94887463208032] v31'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f950402d070 con 0x564cb5895c90 2024-09-12T17:28:59.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.360+0000 7f9512dda640 1 -- 172.21.15.170:0/1742382602 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94887463211664] v31'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f950c060040 con 0x564cb58912f0 2024-09-12T17:28:59.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.360+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v31'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94fc057030 con 0x564cb588c8e0 2024-09-12T17:28:59.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.360+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94887463216688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cb589db90 con 0x564cb588c8e0 2024-09-12T17:28:59.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.360+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cb589f3e0 con 0x7f950c03c060 2024-09-12T17:28:59.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.361+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(54 notify.5 [create] v31'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94fc057030 con 0x7f950c03c060 2024-09-12T17:28:59.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.361+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94887463218768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cb589f720 con 0x7f950c03c060 2024-09-12T17:28:59.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.361+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cb589ff70 con 0x7f950c03c060 2024-09-12T17:28:59.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.361+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94887463216688] v31'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94fc057030 con 0x564cb588c8e0 2024-09-12T17:28:59.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.362+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94887463218768] v31'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94fc057030 con 0x7f950c03c060 2024-09-12T17:28:59.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.363+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v31'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94fc057030 con 0x7f950c03c060 2024-09-12T17:28:59.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.363+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94887463205056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cb589f900 con 0x7f950c03c060 2024-09-12T17:28:59.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.363+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cb58a03f0 con 0x7f950c03c060 2024-09-12T17:28:59.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.364+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(58 notify.7 [create] v31'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94fc057030 con 0x7f950c03c060 2024-09-12T17:28:59.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.364+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94887463222976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cb58a0860 con 0x7f950c03c060 2024-09-12T17:28:59.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.364+0000 7f9516926800 20 add_watcher() i=0 2024-09-12T17:28:59.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.364+0000 7f9516926800 20 add_watcher() i=1 2024-09-12T17:28:59.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.364+0000 7f9516926800 20 add_watcher() i=2 2024-09-12T17:28:59.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.364+0000 7f9516926800 20 add_watcher() i=3 2024-09-12T17:28:59.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.364+0000 7f9516926800 20 add_watcher() i=4 2024-09-12T17:28:59.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.364+0000 7f9516926800 20 add_watcher() i=5 2024-09-12T17:28:59.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.364+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94887463205056] v31'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94fc057030 con 0x7f950c03c060 2024-09-12T17:28:59.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.364+0000 7f9516926800 20 add_watcher() i=6 2024-09-12T17:28:59.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.365+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94887463222976] v31'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94fc057030 con 0x7f950c03c060 2024-09-12T17:28:59.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.365+0000 7f9516926800 20 add_watcher() i=7 2024-09-12T17:28:59.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.365+0000 7f9516926800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:59.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.365+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564cb58a0860 con 0x564cb588c8e0 2024-09-12T17:28:59.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.365+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f94fc057030 con 0x564cb588c8e0 2024-09-12T17:28:59.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.365+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94887463224240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cb58a07d0 con 0x564cb588c8e0 2024-09-12T17:28:59.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.366+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94887463224240] v31'209 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f94fc057030 con 0x564cb588c8e0 2024-09-12T17:28:59.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.366+0000 7f93c8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:59.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.366+0000 7f9516926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:59.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.366+0000 7f9516926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:59.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.366+0000 7f9516926800 5 note: GC not initialized 2024-09-12T17:28:59.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.366+0000 7f93437fe640 20 reqs_thread_entry: start 2024-09-12T17:28:59.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.366+0000 7f9516926800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:59.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.366+0000 7f9516926800 20 Filter name: none 2024-09-12T17:28:59.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.367+0000 7f93417fa640 20 reqs_thread_entry: start 2024-09-12T17:28:59.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.367+0000 7f9516926800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.367+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564cb58d6400 con 0x564cb588c8e0 2024-09-12T17:28:59.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.367+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f94fc057030 con 0x564cb588c8e0 2024-09-12T17:28:59.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.367+0000 7f9516926800 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:28:59.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.367+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564cb58d7820 con 0x7f950c03c060 2024-09-12T17:28:59.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.368+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f94fc057030 con 0x7f950c03c060 2024-09-12T17:28:59.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.369+0000 7f93c8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:59.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.369+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94887463224240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cb58d5d20 con 0x564cb588c8e0 2024-09-12T17:28:59.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.370+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94887463224240] v31'210 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f94fc057030 con 0x564cb588c8e0 2024-09-12T17:28:59.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.370+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94887463199776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cb58a03b0 con 0x564cb58912f0 2024-09-12T17:28:59.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.371+0000 7f9512dda640 1 -- 172.21.15.170:0/1742382602 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94887463199776] v31'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f950c060040 con 0x564cb58912f0 2024-09-12T17:28:59.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.371+0000 7f9516926800 20 remove_watcher() i=0 2024-09-12T17:28:59.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.371+0000 7f9516926800 2 removed watcher, disabling cache 2024-09-12T17:28:59.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.371+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94887463204000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cb58a03b0 con 0x564cb588c8e0 2024-09-12T17:28:59.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.372+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94887463204000] v31'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94fc057030 con 0x564cb588c8e0 2024-09-12T17:28:59.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.372+0000 7f9516926800 20 remove_watcher() i=1 2024-09-12T17:28:59.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.372+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94887463208032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cb589b4a0 con 0x564cb5895c90 2024-09-12T17:28:59.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.373+0000 7f95125d9640 1 -- 172.21.15.170:0/1742382602 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94887463208032] v31'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f950402d070 con 0x564cb5895c90 2024-09-12T17:28:59.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.373+0000 7f9516926800 20 remove_watcher() i=2 2024-09-12T17:28:59.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.373+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94887463211664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cb58a03b0 con 0x564cb58912f0 2024-09-12T17:28:59.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.374+0000 7f9512dda640 1 -- 172.21.15.170:0/1742382602 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94887463211664] v31'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f950c060040 con 0x564cb58912f0 2024-09-12T17:28:59.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.374+0000 7f9516926800 20 remove_watcher() i=3 2024-09-12T17:28:59.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.374+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94887463216688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cb589c460 con 0x564cb588c8e0 2024-09-12T17:28:59.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.375+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94887463216688] v31'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94fc057030 con 0x564cb588c8e0 2024-09-12T17:28:59.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.375+0000 7f9516926800 20 remove_watcher() i=4 2024-09-12T17:28:59.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.375+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94887463218768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cb589b4a0 con 0x7f950c03c060 2024-09-12T17:28:59.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.376+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94887463218768] v31'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94fc057030 con 0x7f950c03c060 2024-09-12T17:28:59.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.376+0000 7f9516926800 20 remove_watcher() i=5 2024-09-12T17:28:59.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.376+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94887463205056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cb58a03b0 con 0x7f950c03c060 2024-09-12T17:28:59.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.377+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94887463205056] v31'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94fc057030 con 0x7f950c03c060 2024-09-12T17:28:59.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.377+0000 7f9516926800 20 remove_watcher() i=6 2024-09-12T17:28:59.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.377+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94887463222976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564cb589c460 con 0x7f950c03c060 2024-09-12T17:28:59.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.378+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94887463222976] v31'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94fc057030 con 0x7f950c03c060 2024-09-12T17:28:59.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.378+0000 7f9516926800 20 remove_watcher() i=7 2024-09-12T17:28:59.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.378+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f950c03c060 msgr2=0x7f950c019230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.378+0000 7f9516926800 1 --2- 172.21.15.170:0/1742382602 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f950c03c060 0x7f950c019230 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.378+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564cb588c8e0 msgr2=0x564cb588eda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.378+0000 7f9516926800 1 --2- 172.21.15.170:0/1742382602 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564cb588c8e0 0x564cb588eda0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.378+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564cb58912f0 msgr2=0x564cb58936e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.378+0000 7f9516926800 1 --2- 172.21.15.170:0/1742382602 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564cb58912f0 0x564cb58936e0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.378+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x564cb5895c90 msgr2=0x564cb5898150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.378+0000 7f9516926800 1 --2- 172.21.15.170:0/1742382602 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x564cb5895c90 0x564cb5898150 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.378+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f93dc03c730 msgr2=0x7f93dc03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.378+0000 7f9516926800 1 --2- 172.21.15.170:0/1742382602 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f93dc03c730 0x7f93dc03ebf0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9504019fd0 tx=0x7f9504046000 comp rx=0 tx=0).stop 2024-09-12T17:28:59.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.378+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564cb587aa50 msgr2=0x564cb5881030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.378+0000 7f9516926800 1 --2- 172.21.15.170:0/1742382602 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564cb587aa50 0x564cb5881030 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f950c014570 tx=0x7f950c053c60 comp rx=0 tx=0).stop 2024-09-12T17:28:59.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.378+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 reap_dead start 2024-09-12T17:28:59.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.378+0000 7f9509dd8640 1 -- 172.21.15.170:0/1742382602 reap_dead start 2024-09-12T17:28:59.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.378+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 shutdown_connections 2024-09-12T17:28:59.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.378+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 >> 172.21.15.170:0/1742382602 conn(0x564cb5875da0 msgr2=0x564cb5873fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:59.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.378+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 shutdown_connections 2024-09-12T17:28:59.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.378+0000 7f9516926800 1 -- 172.21.15.170:0/1742382602 wait complete. 2024-09-12T17:28:59.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.379+0000 7f9516926800 1 -- 172.21.15.170:0/1064202403 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f93ec03c780 msgr2=0x7f93ec03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.379+0000 7f9516926800 1 --2- 172.21.15.170:0/1064202403 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f93ec03c780 0x7f93ec03ec40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x564cb585ea00 tx=0x7f9504052690 comp rx=0 tx=0).stop 2024-09-12T17:28:59.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.379+0000 7f9516926800 1 -- 172.21.15.170:0/1064202403 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564cb586cee0 msgr2=0x564cb586d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.379+0000 7f9516926800 1 --2- 172.21.15.170:0/1064202403 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564cb586cee0 0x564cb586d300 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x564cb5853040 tx=0x7f950c0167b0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.379+0000 7f9516926800 1 -- 172.21.15.170:0/1064202403 shutdown_connections 2024-09-12T17:28:59.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.379+0000 7f9516926800 1 --2- 172.21.15.170:0/1064202403 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f93ec03c780 0x7f93ec03ec40 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.379+0000 7f9516926800 1 --2- 172.21.15.170:0/1064202403 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564cb586cee0 0x564cb586d300 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.379+0000 7f9516926800 1 -- 172.21.15.170:0/1064202403 >> 172.21.15.170:0/1064202403 conn(0x564cb5861290 msgr2=0x564cb5861670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:59.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.379+0000 7f9516926800 1 -- 172.21.15.170:0/1064202403 shutdown_connections 2024-09-12T17:28:59.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.379+0000 7f9516926800 1 -- 172.21.15.170:0/1064202403 wait complete. 2024-09-12T17:28:59.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.379+0000 7f9516926800 1 -- 172.21.15.170:0/1333141748 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564cb5759210 msgr2=0x564cb5859690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.379+0000 7f9516926800 1 --2- 172.21.15.170:0/1333141748 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564cb5759210 0x564cb5859690 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.379+0000 7f9516926800 1 -- 172.21.15.170:0/1333141748 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564cb585ba30 msgr2=0x564cb585dea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.379+0000 7f9516926800 1 --2- 172.21.15.170:0/1333141748 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564cb585ba30 0x564cb585dea0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.379+0000 7f9516926800 1 -- 172.21.15.170:0/1333141748 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f93f803c8d0 msgr2=0x7f93f803ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.379+0000 7f9516926800 1 --2- 172.21.15.170:0/1333141748 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f93f803c8d0 0x7f93f803ed90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f94fc057000 tx=0x7f94fc052000 comp rx=0 tx=0).stop 2024-09-12T17:28:59.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.379+0000 7f9516926800 1 -- 172.21.15.170:0/1333141748 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564cb5757e00 msgr2=0x564cb5852040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.379+0000 7f9516926800 1 --2- 172.21.15.170:0/1333141748 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564cb5757e00 0x564cb5852040 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f95040012f0 tx=0x7f9504000ed0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.379+0000 7f9516926800 1 -- 172.21.15.170:0/1333141748 shutdown_connections 2024-09-12T17:28:59.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.379+0000 7f9516926800 1 --2- 172.21.15.170:0/1333141748 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x564cb585ba30 0x564cb585dea0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.379+0000 7f9516926800 1 --2- 172.21.15.170:0/1333141748 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f93f803c8d0 0x7f93f803ed90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.379+0000 7f9516926800 1 --2- 172.21.15.170:0/1333141748 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x564cb5759210 0x564cb5859690 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.379+0000 7f9516926800 1 --2- 172.21.15.170:0/1333141748 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564cb5757e00 0x564cb5852040 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.379+0000 7f9516926800 1 -- 172.21.15.170:0/1333141748 >> 172.21.15.170:0/1333141748 conn(0x564cb57531d0 msgr2=0x564cb5841520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:59.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.379+0000 7f9516926800 1 -- 172.21.15.170:0/1333141748 shutdown_connections 2024-09-12T17:28:59.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.379+0000 7f9516926800 1 -- 172.21.15.170:0/1333141748 wait complete. 2024-09-12T17:28:59.394 INFO:teuthology.orchestra.run.smithi170.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-12T17:28:59.395 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T17:28:59.395 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-12T17:28:59.395 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-12T17:28:59.395 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-09-12T17:28:59.449 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:59.450 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:59.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.449+0000 7f2e6c322800 1 Processor -- start 2024-09-12T17:28:59.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.449+0000 7f2e6c322800 1 -- start start 2024-09-12T17:28:59.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.449+0000 7f2e6c322800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x560a797b8430 0x560a797b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.449+0000 7f2e6c322800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560a79663e40 con 0x560a797b8d70 2024-09-12T17:28:59.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.449+0000 7f2e6c322800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x560a7962e680 con 0x560a797b8430 2024-09-12T17:28:59.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.449+0000 7f2e67f02640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x560a797b8430 0x560a797b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.449+0000 7f2e67f02640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x560a797b8430 0x560a797b8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59828/0 (socket says 172.21.15.170:59828) 2024-09-12T17:28:59.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.449+0000 7f2e5ffff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x560a797b8d70 0x560a797b9200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:57408/0 (socket says 172.21.15.170:57408) 2024-09-12T17:28:59.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.449+0000 7f2e67f02640 1 -- 172.21.15.170:0/3280818451 learned_addr learned my addr 172.21.15.170:0/3280818451 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:59.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.450+0000 7f2e67f02640 1 -- 172.21.15.170:0/3280818451 >> v1:172.21.15.47:6789/0 conn(0x560a797b8d70 legacy=0x560a797b9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.450+0000 7f2e67f02640 1 -- 172.21.15.170:0/3280818451 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a7964a6b0 con 0x560a797b8430 2024-09-12T17:28:59.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.451+0000 7f2e67f02640 1 --2- 172.21.15.170:0/3280818451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560a797b8430 0x560a797b8830 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f2e5800a520 tx=0x7f2e58045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7d8cbedb508d8a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.452+0000 7f2e67701640 1 -- 172.21.15.170:0/3280818451 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e58055070 con 0x560a797b8430 2024-09-12T17:28:59.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.452+0000 7f2e67701640 1 -- 172.21.15.170:0/3280818451 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e580515b0 con 0x560a797b8430 2024-09-12T17:28:59.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.452+0000 7f2e67701640 1 -- 172.21.15.170:0/3280818451 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e580518d0 con 0x560a797b8430 2024-09-12T17:28:59.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.452+0000 7f2e6c322800 1 -- 172.21.15.170:0/3280818451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560a797b8430 msgr2=0x560a797b8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.452+0000 7f2e6c322800 1 --2- 172.21.15.170:0/3280818451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560a797b8430 0x560a797b8830 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f2e5800a520 tx=0x7f2e58045ba0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.452+0000 7f2e6c322800 1 -- 172.21.15.170:0/3280818451 shutdown_connections 2024-09-12T17:28:59.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.452+0000 7f2e6c322800 1 --2- 172.21.15.170:0/3280818451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560a797b8430 0x560a797b8830 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.452+0000 7f2e6c322800 1 -- 172.21.15.170:0/3280818451 >> 172.21.15.170:0/3280818451 conn(0x560a797b4200 msgr2=0x560a797b6660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:59.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.452+0000 7f2e6c322800 1 -- 172.21.15.170:0/3280818451 shutdown_connections 2024-09-12T17:28:59.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.452+0000 7f2e6c322800 1 -- 172.21.15.170:0/3280818451 wait complete. 2024-09-12T17:28:59.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.466+0000 7f2e6c322800 1 Processor -- start 2024-09-12T17:28:59.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.466+0000 7f2e6c322800 1 -- start start 2024-09-12T17:28:59.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.466+0000 7f2e6c322800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560a797b8430 0x560a798ab930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.466+0000 7f2e6c322800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x560a79652dd0 con 0x560a797b8430 2024-09-12T17:28:59.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.467+0000 7f2e67f02640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560a797b8430 0x560a798ab930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.467+0000 7f2e67f02640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560a797b8430 0x560a798ab930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59836/0 (socket says 172.21.15.170:59836) 2024-09-12T17:28:59.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.467+0000 7f2e67f02640 1 -- 172.21.15.170:0/2523747717 learned_addr learned my addr 172.21.15.170:0/2523747717 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:59.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.467+0000 7f2e67f02640 1 -- 172.21.15.170:0/2523747717 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a7966be10 con 0x560a797b8430 2024-09-12T17:28:59.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.467+0000 7f2e67f02640 1 --2- 172.21.15.170:0/2523747717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560a797b8430 0x560a798ab930 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f2e58000c00 tx=0x7f2e58051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=787cf6ccc66c0218 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.467+0000 7f2d55e0b640 1 -- 172.21.15.170:0/2523747717 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e580519d0 con 0x560a797b8430 2024-09-12T17:28:59.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.467+0000 7f2d55e0b640 1 -- 172.21.15.170:0/2523747717 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e58051b70 con 0x560a797b8430 2024-09-12T17:28:59.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.467+0000 7f2d55e0b640 1 -- 172.21.15.170:0/2523747717 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e58051e50 con 0x560a797b8430 2024-09-12T17:28:59.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.468+0000 7f2e6c322800 1 -- 172.21.15.170:0/2523747717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560a797b8430 msgr2=0x560a798ab930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.468+0000 7f2e6c322800 1 --2- 172.21.15.170:0/2523747717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560a797b8430 0x560a798ab930 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f2e58000c00 tx=0x7f2e58051000 comp rx=0 tx=0).stop 2024-09-12T17:28:59.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.468+0000 7f2e6c322800 1 -- 172.21.15.170:0/2523747717 shutdown_connections 2024-09-12T17:28:59.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.468+0000 7f2e6c322800 1 --2- 172.21.15.170:0/2523747717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560a797b8430 0x560a798ab930 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.468+0000 7f2e6c322800 1 -- 172.21.15.170:0/2523747717 >> 172.21.15.170:0/2523747717 conn(0x560a797b4200 msgr2=0x560a798a72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:59.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.468+0000 7f2e6c322800 1 -- 172.21.15.170:0/2523747717 shutdown_connections 2024-09-12T17:28:59.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.468+0000 7f2e6c322800 1 -- 172.21.15.170:0/2523747717 wait complete. 2024-09-12T17:28:59.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.468+0000 7f2e6c322800 1 Processor -- start 2024-09-12T17:28:59.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.468+0000 7f2e6c322800 1 -- start start 2024-09-12T17:28:59.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.469+0000 7f2e6c322800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560a797b8430 0x560a798b3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.469+0000 7f2e6c322800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x560a797b9d60 con 0x560a797b8430 2024-09-12T17:28:59.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.469+0000 7f2e67f02640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560a797b8430 0x560a798b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.469+0000 7f2e67f02640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560a797b8430 0x560a798b3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59838/0 (socket says 172.21.15.170:59838) 2024-09-12T17:28:59.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.469+0000 7f2e67f02640 1 -- 172.21.15.170:0/98407553 learned_addr learned my addr 172.21.15.170:0/98407553 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:59.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.469+0000 7f2e67f02640 1 -- 172.21.15.170:0/98407553 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a798b36c0 con 0x560a797b8430 2024-09-12T17:28:59.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.470+0000 7f2e67f02640 1 --2- 172.21.15.170:0/98407553 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560a797b8430 0x560a798b3160 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f2e58067040 tx=0x7f2e58002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.470+0000 7f2d4ffff640 1 -- 172.21.15.170:0/98407553 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e58073070 con 0x560a797b8430 2024-09-12T17:28:59.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.470+0000 7f2e6c322800 1 -- 172.21.15.170:0/98407553 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560a798b3950 con 0x560a797b8430 2024-09-12T17:28:59.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.470+0000 7f2d4ffff640 1 -- 172.21.15.170:0/98407553 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e5805a580 con 0x560a797b8430 2024-09-12T17:28:59.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.470+0000 7f2d4ffff640 1 -- 172.21.15.170:0/98407553 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e5805a8a0 con 0x560a797b8430 2024-09-12T17:28:59.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.470+0000 7f2e6c322800 1 -- 172.21.15.170:0/98407553 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a798b4560 con 0x560a797b8430 2024-09-12T17:28:59.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.471+0000 7f2d4ffff640 1 -- 172.21.15.170:0/98407553 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2e58076070 con 0x560a797b8430 2024-09-12T17:28:59.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.471+0000 7f2d4ffff640 1 --2- 172.21.15.170:0/98407553 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2d5003c730 0x7f2d5003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.471+0000 7f2d4ffff640 1 -- 172.21.15.170:0/98407553 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f2e58062070 con 0x560a797b8430 2024-09-12T17:28:59.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.471+0000 7f2e5ffff640 1 --2- 172.21.15.170:0/98407553 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2d5003c730 0x7f2d5003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.471+0000 7f2e6c322800 1 --2- 172.21.15.170:0/98407553 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x560a797b8d70 0x560a798ba7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.471+0000 7f2e6c322800 1 -- 172.21.15.170:0/98407553 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560a798bacf0 con 0x560a797b8d70 2024-09-12T17:28:59.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.471+0000 7f2e68703640 1 --2- 172.21.15.170:0/98407553 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x560a797b8d70 0x560a798ba7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.472+0000 7f2e5ffff640 1 --2- 172.21.15.170:0/98407553 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2d5003c730 0x7f2d5003ebf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2e50001e30 tx=0x7f2e50001390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.472+0000 7f2e68703640 1 --2- 172.21.15.170:0/98407553 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x560a797b8d70 0x560a798ba7b0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.472+0000 7f2e68703640 1 -- 172.21.15.170:0/98407553 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e6000a4d0 con 0x560a797b8d70 2024-09-12T17:28:59.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.472+0000 7f2e6c322800 1 -- 172.21.15.170:0/98407553 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560a798bb090 con 0x560a797b8d70 2024-09-12T17:28:59.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.472+0000 7f2e68703640 1 -- 172.21.15.170:0/98407553 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2e6000a4d0 con 0x560a797b8d70 2024-09-12T17:28:59.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.472+0000 7f2e6c322800 1 --2- 172.21.15.170:0/98407553 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x560a798bcbd0 0x560a798bf040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.472+0000 7f2e6c322800 1 -- 172.21.15.170:0/98407553 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560a798bf7d0 con 0x560a798bcbd0 2024-09-12T17:28:59.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.472+0000 7f2e67f02640 1 --2- 172.21.15.170:0/98407553 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x560a798bcbd0 0x560a798bf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.473+0000 7f2e67f02640 1 --2- 172.21.15.170:0/98407553 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x560a798bcbd0 0x560a798bf040 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.473+0000 7f2e67f02640 1 -- 172.21.15.170:0/98407553 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2e58075030 con 0x560a798bcbd0 2024-09-12T17:28:59.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.473+0000 7f2e6c322800 1 -- 172.21.15.170:0/98407553 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560a798bb8e0 con 0x560a797b8d70 2024-09-12T17:28:59.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.473+0000 7f2e68703640 1 -- 172.21.15.170:0/98407553 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2e6000a4d0 con 0x560a797b8d70 2024-09-12T17:28:59.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.473+0000 7f2e6c322800 1 -- 172.21.15.170:0/98407553 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560a798bbd40 con 0x560a798bcbd0 2024-09-12T17:28:59.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.474+0000 7f2e67f02640 1 -- 172.21.15.170:0/98407553 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2e58075030 con 0x560a798bcbd0 2024-09-12T17:28:59.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.474+0000 7f2e6c322800 1 Processor -- start 2024-09-12T17:28:59.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.474+0000 7f2e6c322800 1 -- start start 2024-09-12T17:28:59.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.474+0000 7f2e6c322800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560a798ce060 0x560a798ce480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.474+0000 7f2e6c322800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x560a796b0a00 con 0x560a798ce060 2024-09-12T17:28:59.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.474+0000 7f2e68703640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560a798ce060 0x560a798ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.474+0000 7f2e68703640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560a798ce060 0x560a798ce480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59850/0 (socket says 172.21.15.170:59850) 2024-09-12T17:28:59.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.474+0000 7f2e68703640 1 -- 172.21.15.170:0/767503129 learned_addr learned my addr 172.21.15.170:0/767503129 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:59.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.475+0000 7f2e68703640 1 -- 172.21.15.170:0/767503129 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a798ceac0 con 0x560a798ce060 2024-09-12T17:28:59.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.475+0000 7f2e68703640 1 --2- 172.21.15.170:0/767503129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560a798ce060 0x560a798ce480 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x560a798b3ff0 tx=0x7f2e600167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.475+0000 7f2d4d7fa640 1 -- 172.21.15.170:0/767503129 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e60013640 con 0x560a798ce060 2024-09-12T17:28:59.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.475+0000 7f2d4d7fa640 1 -- 172.21.15.170:0/767503129 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e600137e0 con 0x560a798ce060 2024-09-12T17:28:59.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.475+0000 7f2e6c322800 1 -- 172.21.15.170:0/767503129 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560a798cf2f0 con 0x560a798ce060 2024-09-12T17:28:59.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.475+0000 7f2d4d7fa640 1 -- 172.21.15.170:0/767503129 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e60013b00 con 0x560a798ce060 2024-09-12T17:28:59.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.475+0000 7f2e6c322800 1 -- 172.21.15.170:0/767503129 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a798cf890 con 0x560a798ce060 2024-09-12T17:28:59.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.476+0000 7f2d4d7fa640 1 -- 172.21.15.170:0/767503129 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2e60011040 con 0x560a798ce060 2024-09-12T17:28:59.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.476+0000 7f2d4d7fa640 1 --2- 172.21.15.170:0/767503129 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2d4003c730 0x7f2d4003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.476+0000 7f2d4d7fa640 1 -- 172.21.15.170:0/767503129 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f2e6000e040 con 0x560a798ce060 2024-09-12T17:28:59.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.476+0000 7f2e67f02640 1 --2- 172.21.15.170:0/767503129 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2d4003c730 0x7f2d4003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.476+0000 7f2e6c322800 1 Processor -- start 2024-09-12T17:28:59.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.476+0000 7f2e6c322800 1 -- start start 2024-09-12T17:28:59.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.476+0000 7f2e67f02640 1 --2- 172.21.15.170:0/767503129 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2d4003c730 0x7f2d4003ebf0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x560a798bfb70 tx=0x7f2e58096630 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.477+0000 7f2e6c322800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560a798dab20 0x560a798daf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.477+0000 7f2e6c322800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x560a798ac0c0 con 0x560a798dab20 2024-09-12T17:28:59.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.477+0000 7f2e68703640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560a798dab20 0x560a798daf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.477+0000 7f2e68703640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560a798dab20 0x560a798daf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59866/0 (socket says 172.21.15.170:59866) 2024-09-12T17:28:59.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.477+0000 7f2e68703640 1 -- 172.21.15.170:0/3211060666 learned_addr learned my addr 172.21.15.170:0/3211060666 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:59.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.477+0000 7f2e68703640 1 -- 172.21.15.170:0/3211060666 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a798db510 con 0x560a798dab20 2024-09-12T17:28:59.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.477+0000 7f2e68703640 1 --2- 172.21.15.170:0/3211060666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560a798dab20 0x560a798daf20 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f2e60020000 tx=0x7f2e6001f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c677d76831e1d821 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.477+0000 7f2d46ffd640 1 -- 172.21.15.170:0/3211060666 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e60052020 con 0x560a798dab20 2024-09-12T17:28:59.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.477+0000 7f2d46ffd640 1 -- 172.21.15.170:0/3211060666 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e6004a070 con 0x560a798dab20 2024-09-12T17:28:59.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.477+0000 7f2d46ffd640 1 -- 172.21.15.170:0/3211060666 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e60055040 con 0x560a798dab20 2024-09-12T17:28:59.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.478+0000 7f2e6c322800 1 -- 172.21.15.170:0/3211060666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560a798dab20 msgr2=0x560a798daf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.478+0000 7f2e6c322800 1 --2- 172.21.15.170:0/3211060666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560a798dab20 0x560a798daf20 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f2e60020000 tx=0x7f2e6001f470 comp rx=0 tx=0).stop 2024-09-12T17:28:59.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.478+0000 7f2e6c322800 1 -- 172.21.15.170:0/3211060666 shutdown_connections 2024-09-12T17:28:59.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.478+0000 7f2e6c322800 1 --2- 172.21.15.170:0/3211060666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560a798dab20 0x560a798daf20 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.478+0000 7f2e6c322800 1 -- 172.21.15.170:0/3211060666 >> 172.21.15.170:0/3211060666 conn(0x560a798d6f20 msgr2=0x560a798d5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:59.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.478+0000 7f2e6c322800 1 -- 172.21.15.170:0/3211060666 shutdown_connections 2024-09-12T17:28:59.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.478+0000 7f2e6c322800 1 -- 172.21.15.170:0/3211060666 wait complete. 2024-09-12T17:28:59.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.478+0000 7f2e6c322800 1 Processor -- start 2024-09-12T17:28:59.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.478+0000 7f2e6c322800 1 -- start start 2024-09-12T17:28:59.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.478+0000 7f2e6c322800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560a798dab20 0x560a798e2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.478+0000 7f2e6c322800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x560a798dbb30 con 0x560a798dab20 2024-09-12T17:28:59.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.479+0000 7f2e68703640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560a798dab20 0x560a798e2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.479+0000 7f2e68703640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560a798dab20 0x560a798e2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59878/0 (socket says 172.21.15.170:59878) 2024-09-12T17:28:59.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.479+0000 7f2e68703640 1 -- 172.21.15.170:0/1846895725 learned_addr learned my addr 172.21.15.170:0/1846895725 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:59.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.479+0000 7f2e68703640 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a798e2660 con 0x560a798dab20 2024-09-12T17:28:59.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.479+0000 7f2e68703640 1 --2- 172.21.15.170:0/1846895725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560a798dab20 0x560a798e2100 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f2e60047000 tx=0x7f2e60053d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.479+0000 7f2d457fa640 1 -- 172.21.15.170:0/1846895725 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e6001f500 con 0x560a798dab20 2024-09-12T17:28:59.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.479+0000 7f2d457fa640 1 -- 172.21.15.170:0/1846895725 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e6001f6a0 con 0x560a798dab20 2024-09-12T17:28:59.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.479+0000 7f2d457fa640 1 -- 172.21.15.170:0/1846895725 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e600551a0 con 0x560a798dab20 2024-09-12T17:28:59.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.479+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560a798e28f0 con 0x560a798dab20 2024-09-12T17:28:59.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.479+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a798e3270 con 0x560a798dab20 2024-09-12T17:28:59.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.480+0000 7f2d457fa640 1 -- 172.21.15.170:0/1846895725 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2e60039060 con 0x560a798dab20 2024-09-12T17:28:59.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.480+0000 7f2d457fa640 1 --2- 172.21.15.170:0/1846895725 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2d3003c780 0x7f2d3003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.480+0000 7f2d457fa640 1 -- 172.21.15.170:0/1846895725 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f2e60033bb0 con 0x560a798dab20 2024-09-12T17:28:59.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.480+0000 7f2e67f02640 1 --2- 172.21.15.170:0/1846895725 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2d3003c780 0x7f2d3003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.481+0000 7f2e67f02640 1 --2- 172.21.15.170:0/1846895725 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2d3003c780 0x7f2d3003ec40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2e580507d0 tx=0x7f2e58092000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.481+0000 7f2e6c322800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.481+0000 7f2e6c322800 1 --2- 172.21.15.170:0/1846895725 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x560a798eda90 0x560a798eff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.481+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560a798f06a0 con 0x560a798eda90 2024-09-12T17:28:59.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.481+0000 7f2e5ffff640 1 --2- 172.21.15.170:0/1846895725 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x560a798eda90 0x560a798eff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.481+0000 7f2e5ffff640 1 --2- 172.21.15.170:0/1846895725 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x560a798eda90 0x560a798eff50 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.482+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e5000f610 con 0x560a798eda90 2024-09-12T17:28:59.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.482+0000 7f2e6c322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:59.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.482+0000 7f2e6c322800 20 realm 2024-09-12T17:28:59.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.482+0000 7f2e6c322800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.482+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560a798ece20 con 0x560a798eda90 2024-09-12T17:28:59.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.482+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e5000f610 con 0x560a798eda90 2024-09-12T17:28:59.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.482+0000 7f2e6c322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:59.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.482+0000 7f2e6c322800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:59.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.482+0000 7f2e6c322800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.482+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560a798f1190 con 0x560a798eda90 2024-09-12T17:28:59.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.482+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e5000f610 con 0x560a798eda90 2024-09-12T17:28:59.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.482+0000 7f2e6c322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:59.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.482+0000 7f2e6c322800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.482+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560a798f1a60 con 0x560a798eda90 2024-09-12T17:28:59.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.482+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2e5000f610 con 0x560a798eda90 2024-09-12T17:28:59.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.482+0000 7f2e6c322800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:59.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.482+0000 7f2e6c322800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.482+0000 7f2e6c322800 1 --2- 172.21.15.170:0/1846895725 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x560a798f2480 0x560a798f4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.482+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560a798f4fb0 con 0x560a798f2480 2024-09-12T17:28:59.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.482+0000 7f2e68703640 1 --2- 172.21.15.170:0/1846895725 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x560a798f2480 0x560a798f4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.483+0000 7f2e68703640 1 --2- 172.21.15.170:0/1846895725 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x560a798f2480 0x560a798f4870 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.483+0000 7f2e68703640 1 -- 172.21.15.170:0/1846895725 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2e60030070 con 0x560a798f2480 2024-09-12T17:28:59.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.483+0000 7f2e6c322800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:59.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.483+0000 7f2e6c322800 20 searching for the correct realm 2024-09-12T17:28:59.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.483+0000 7f2e6c322800 1 --2- 172.21.15.170:0/1846895725 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x560a798f6f60 0x560a798f9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.483+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560a798f9aa0 con 0x560a798f6f60 2024-09-12T17:28:59.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.483+0000 7f2e67f02640 1 --2- 172.21.15.170:0/1846895725 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x560a798f6f60 0x560a798f9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.483+0000 7f2e67f02640 1 --2- 172.21.15.170:0/1846895725 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x560a798f6f60 0x560a798f9420 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.483+0000 7f2e67f02640 1 -- 172.21.15.170:0/1846895725 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e58075030 con 0x560a798f6f60 2024-09-12T17:28:59.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.484+0000 7f2e67f02640 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560a798f9aa0 con 0x560a798f2480 2024-09-12T17:28:59.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.484+0000 7f2e68703640 1 -- 172.21.15.170:0/1846895725 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e60030070 con 0x560a798f2480 2024-09-12T17:28:59.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.484+0000 7f2e68703640 1 --2- 172.21.15.170:0/1846895725 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f2e6003b070 0x7f2e6001baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.484+0000 7f2e68703640 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560a798f9aa0 con 0x7f2e6003b070 2024-09-12T17:28:59.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.484+0000 7f2e5ffff640 1 --2- 172.21.15.170:0/1846895725 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f2e6003b070 0x7f2e6001baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.484+0000 7f2e5ffff640 1 --2- 172.21.15.170:0/1846895725 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f2e6003b070 0x7f2e6001baa0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.485+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e5000f610 con 0x7f2e6003b070 2024-09-12T17:28:59.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.485+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560a798f9aa0 con 0x560a798eda90 2024-09-12T17:28:59.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.485+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e5000f610 con 0x560a798eda90 2024-09-12T17:28:59.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.485+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560a798f9aa0 con 0x560a798eda90 2024-09-12T17:28:59.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.485+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e5002b040 con 0x560a798eda90 2024-09-12T17:28:59.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.485+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560a798f9aa0 con 0x7f2e6003b070 2024-09-12T17:28:59.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.485+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e5002b040 con 0x7f2e6003b070 2024-09-12T17:28:59.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.485+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560a798f9aa0 con 0x7f2e6003b070 2024-09-12T17:28:59.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.486+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e5002b040 con 0x7f2e6003b070 2024-09-12T17:28:59.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.486+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560a798f9aa0 con 0x560a798f2480 2024-09-12T17:28:59.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.486+0000 7f2e68703640 1 -- 172.21.15.170:0/1846895725 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e60030070 con 0x560a798f2480 2024-09-12T17:28:59.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.486+0000 7f2e68703640 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560a798f9aa0 con 0x560a798f6f60 2024-09-12T17:28:59.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.486+0000 7f2e67f02640 1 -- 172.21.15.170:0/1846895725 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e58075030 con 0x560a798f6f60 2024-09-12T17:28:59.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.486+0000 7f2e67f02640 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560a798f9aa0 con 0x560a798eda90 2024-09-12T17:28:59.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.486+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e5002b040 con 0x560a798eda90 2024-09-12T17:28:59.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.486+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560a798f9aa0 con 0x7f2e6003b070 2024-09-12T17:28:59.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.487+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e5002b040 con 0x7f2e6003b070 2024-09-12T17:28:59.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.487+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560a798f9aa0 con 0x560a798eda90 2024-09-12T17:28:59.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.487+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e5002b040 con 0x560a798eda90 2024-09-12T17:28:59.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.487+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560a798f9aa0 con 0x560a798f2480 2024-09-12T17:28:59.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.487+0000 7f2e68703640 1 -- 172.21.15.170:0/1846895725 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f2e60030070 con 0x560a798f2480 2024-09-12T17:28:59.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.487+0000 7f2e68703640 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560a798f9aa0 con 0x560a798f6f60 2024-09-12T17:28:59.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.487+0000 7f2e67f02640 1 -- 172.21.15.170:0/1846895725 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e58075030 con 0x560a798f6f60 2024-09-12T17:28:59.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.487+0000 7f2e67f02640 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560a798f9aa0 con 0x560a798f6f60 2024-09-12T17:28:59.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.487+0000 7f2e67f02640 1 -- 172.21.15.170:0/1846895725 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e58075030 con 0x560a798f6f60 2024-09-12T17:28:59.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.488+0000 7f2e67f02640 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560a798f9aa0 con 0x560a798f2480 2024-09-12T17:28:59.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.488+0000 7f2e68703640 1 -- 172.21.15.170:0/1846895725 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e60030070 con 0x560a798f2480 2024-09-12T17:28:59.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.488+0000 7f2e68703640 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560a798f9aa0 con 0x560a798f6f60 2024-09-12T17:28:59.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.488+0000 7f2e67f02640 1 -- 172.21.15.170:0/1846895725 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e58075030 con 0x560a798f6f60 2024-09-12T17:28:59.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.488+0000 7f2e67f02640 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560a798f9aa0 con 0x560a798f6f60 2024-09-12T17:28:59.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.488+0000 7f2e67f02640 1 -- 172.21.15.170:0/1846895725 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e58075030 con 0x560a798f6f60 2024-09-12T17:28:59.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.488+0000 7f2e67f02640 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560a798f9aa0 con 0x560a798eda90 2024-09-12T17:28:59.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.488+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e5002b040 con 0x560a798eda90 2024-09-12T17:28:59.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.488+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560a798f9aa0 con 0x560a798eda90 2024-09-12T17:28:59.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.489+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2e5002b040 con 0x560a798eda90 2024-09-12T17:28:59.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.489+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560a798f9aa0 con 0x7f2e6003b070 2024-09-12T17:28:59.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.489+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e5002b040 con 0x7f2e6003b070 2024-09-12T17:28:59.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.489+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560a798f9aa0 con 0x560a798f6f60 2024-09-12T17:28:59.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.489+0000 7f2e67f02640 1 -- 172.21.15.170:0/1846895725 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e58075030 con 0x560a798f6f60 2024-09-12T17:28:59.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.489+0000 7f2e67f02640 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560a798f9aa0 con 0x560a798f2480 2024-09-12T17:28:59.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.489+0000 7f2e68703640 1 -- 172.21.15.170:0/1846895725 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e60030070 con 0x560a798f2480 2024-09-12T17:28:59.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.489+0000 7f2e68703640 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560a798f9aa0 con 0x560a798eda90 2024-09-12T17:28:59.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.490+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e5002b040 con 0x560a798eda90 2024-09-12T17:28:59.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.490+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560a798f9aa0 con 0x7f2e6003b070 2024-09-12T17:28:59.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.490+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e5002b040 con 0x7f2e6003b070 2024-09-12T17:28:59.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.490+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560a798f9aa0 con 0x560a798f6f60 2024-09-12T17:28:59.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.490+0000 7f2e67f02640 1 -- 172.21.15.170:0/1846895725 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e58075030 con 0x560a798f6f60 2024-09-12T17:28:59.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.490+0000 7f2e67f02640 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560a798f9aa0 con 0x7f2e6003b070 2024-09-12T17:28:59.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.491+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e5002b040 con 0x7f2e6003b070 2024-09-12T17:28:59.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.491+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560a798f9aa0 con 0x560a798f2480 2024-09-12T17:28:59.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.491+0000 7f2e68703640 1 -- 172.21.15.170:0/1846895725 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e60030070 con 0x560a798f2480 2024-09-12T17:28:59.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.491+0000 7f2e68703640 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560a798f9aa0 con 0x560a798f6f60 2024-09-12T17:28:59.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.491+0000 7f2e67f02640 1 -- 172.21.15.170:0/1846895725 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e58075030 con 0x560a798f6f60 2024-09-12T17:28:59.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.491+0000 7f2e67f02640 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560a798f9aa0 con 0x7f2e6003b070 2024-09-12T17:28:59.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.491+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e5002b040 con 0x7f2e6003b070 2024-09-12T17:28:59.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.491+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560a798f9aa0 con 0x560a798eda90 2024-09-12T17:28:59.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.492+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2e5002b040 con 0x560a798eda90 2024-09-12T17:28:59.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.492+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560a798f9aa0 con 0x560a798f2480 2024-09-12T17:28:59.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.492+0000 7f2e68703640 1 -- 172.21.15.170:0/1846895725 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(37 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2e60030070 con 0x560a798f2480 2024-09-12T17:28:59.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.492+0000 7f2e6c322800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:59.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.492+0000 7f2e6c322800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:59.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.492+0000 7f2e6c322800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:59.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.492+0000 7f2e6c322800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:59.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.492+0000 7f2e6c322800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:59.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.492+0000 7f2e6c322800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:59.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.492+0000 7f2e6c322800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.492+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560a798f5970 con 0x560a798eda90 2024-09-12T17:28:59.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.492+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e5002b040 con 0x560a798eda90 2024-09-12T17:28:59.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.492+0000 7f2e6c322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:59.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.492+0000 7f2e6c322800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.492+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560a798f6210 con 0x560a798eda90 2024-09-12T17:28:59.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.492+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2e5003b040 con 0x560a798eda90 2024-09-12T17:28:59.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.492+0000 7f2e6c322800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:59.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.492+0000 7f2e6c322800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.492+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560a798f55b0 con 0x560a798f2480 2024-09-12T17:28:59.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.493+0000 7f2e68703640 1 -- 172.21.15.170:0/1846895725 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2e60030070 con 0x560a798f2480 2024-09-12T17:28:59.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.493+0000 7f2e6c322800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:59.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.493+0000 7f2e6c322800 20 zone default found 2024-09-12T17:28:59.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.493+0000 7f2e6c322800 4 Realm: () 2024-09-12T17:28:59.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.493+0000 7f2e6c322800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:59.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.493+0000 7f2e6c322800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:59.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.493+0000 7f2e6c322800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:59.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.493+0000 7f2e6c322800 20 zonegroup default 2024-09-12T17:28:59.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.493+0000 7f2e6c322800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.493+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560a798fa3d0 con 0x7f2e6003b070 2024-09-12T17:28:59.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.493+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2e5003b040 con 0x7f2e6003b070 2024-09-12T17:28:59.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.493+0000 7f2e6c322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:59.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.493+0000 7f2e6c322800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.493+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560a798fc610 con 0x560a798f6f60 2024-09-12T17:28:59.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.493+0000 7f2e67f02640 1 -- 172.21.15.170:0/1846895725 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2e58075030 con 0x560a798f6f60 2024-09-12T17:28:59.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.493+0000 7f2e6c322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:59.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.493+0000 7f2e6c322800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.493+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560a798fc9b0 con 0x560a798f6f60 2024-09-12T17:28:59.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.494+0000 7f2e67f02640 1 -- 172.21.15.170:0/1846895725 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2e58075030 con 0x560a798f6f60 2024-09-12T17:28:59.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.494+0000 7f2e6c322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:59.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.494+0000 7f2e6c322800 20 started sync module instance, tier type = 2024-09-12T17:28:59.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.494+0000 7f2e6c322800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:59.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.494+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560a798fbaa0 con 0x560a798f2480 2024-09-12T17:28:59.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.495+0000 7f2e68703640 1 -- 172.21.15.170:0/1846895725 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(44 notify.0 [create] v31'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e60030070 con 0x560a798f2480 2024-09-12T17:28:59.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.495+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94602989125264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560a798fd250 con 0x560a798f2480 2024-09-12T17:28:59.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.495+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560a798fdaa0 con 0x560a798eda90 2024-09-12T17:28:59.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.496+0000 7f2e68703640 1 -- 172.21.15.170:0/1846895725 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94602989125264] v31'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e60030070 con 0x560a798f2480 2024-09-12T17:28:59.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.496+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v31'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e5003b040 con 0x560a798eda90 2024-09-12T17:28:59.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.496+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94602989129120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560a798fd790 con 0x560a798eda90 2024-09-12T17:28:59.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.496+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560a798fe290 con 0x560a798f6f60 2024-09-12T17:28:59.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.497+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94602989129120] v31'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e5003b040 con 0x560a798eda90 2024-09-12T17:28:59.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.498+0000 7f2e67f02640 1 -- 172.21.15.170:0/1846895725 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v31'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e58075030 con 0x560a798f6f60 2024-09-12T17:28:59.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.498+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94602989133184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560a798fe630 con 0x560a798f6f60 2024-09-12T17:28:59.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.498+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560a798ff100 con 0x560a798f2480 2024-09-12T17:28:59.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.499+0000 7f2e68703640 1 -- 172.21.15.170:0/1846895725 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(50 notify.3 [create] v31'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e60030070 con 0x560a798f2480 2024-09-12T17:28:59.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.499+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94602989136880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560a798ff9d0 con 0x560a798f2480 2024-09-12T17:28:59.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.499+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560a799004a0 con 0x560a798eda90 2024-09-12T17:28:59.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.499+0000 7f2e67f02640 1 -- 172.21.15.170:0/1846895725 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94602989133184] v31'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e58075030 con 0x560a798f6f60 2024-09-12T17:28:59.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.500+0000 7f2e68703640 1 -- 172.21.15.170:0/1846895725 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94602989136880] v31'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e60030070 con 0x560a798f2480 2024-09-12T17:28:59.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.500+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v31'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e5003b040 con 0x560a798eda90 2024-09-12T17:28:59.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.500+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94602989141904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560a798ff520 con 0x560a798eda90 2024-09-12T17:28:59.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.500+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560a79900d40 con 0x7f2e6003b070 2024-09-12T17:28:59.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.501+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94602989141904] v31'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e5003b040 con 0x560a798eda90 2024-09-12T17:28:59.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.501+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(54 notify.5 [create] v31'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e5003b040 con 0x7f2e6003b070 2024-09-12T17:28:59.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.501+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94602989130208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560a798ff520 con 0x7f2e6003b070 2024-09-12T17:28:59.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.501+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560a799013a0 con 0x7f2e6003b070 2024-09-12T17:28:59.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.502+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94602989130208] v31'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e5003b040 con 0x7f2e6003b070 2024-09-12T17:28:59.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.502+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v31'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e5003b040 con 0x7f2e6003b070 2024-09-12T17:28:59.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.502+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94602989145712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560a79901360 con 0x7f2e6003b070 2024-09-12T17:28:59.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.502+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560a79901d60 con 0x7f2e6003b070 2024-09-12T17:28:59.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.503+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94602989145712] v31'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e5003b040 con 0x7f2e6003b070 2024-09-12T17:28:59.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.503+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(58 notify.7 [create] v31'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e5003b040 con 0x7f2e6003b070 2024-09-12T17:28:59.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.503+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94602989143888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560a79901d20 con 0x7f2e6003b070 2024-09-12T17:28:59.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.503+0000 7f2e6c322800 20 add_watcher() i=0 2024-09-12T17:28:59.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.503+0000 7f2e6c322800 20 add_watcher() i=1 2024-09-12T17:28:59.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.503+0000 7f2e6c322800 20 add_watcher() i=2 2024-09-12T17:28:59.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.503+0000 7f2e6c322800 20 add_watcher() i=3 2024-09-12T17:28:59.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.503+0000 7f2e6c322800 20 add_watcher() i=4 2024-09-12T17:28:59.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.503+0000 7f2e6c322800 20 add_watcher() i=5 2024-09-12T17:28:59.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.503+0000 7f2e6c322800 20 add_watcher() i=6 2024-09-12T17:28:59.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.504+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94602989143888] v31'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e5003b040 con 0x7f2e6003b070 2024-09-12T17:28:59.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.504+0000 7f2e6c322800 20 add_watcher() i=7 2024-09-12T17:28:59.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.504+0000 7f2e6c322800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:59.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.504+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560a799051b0 con 0x560a798eda90 2024-09-12T17:28:59.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.504+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2e5003b040 con 0x560a798eda90 2024-09-12T17:28:59.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.504+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94602989148736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560a79902700 con 0x560a798eda90 2024-09-12T17:28:59.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.505+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94602989148736] v31'211 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2e5003b040 con 0x560a798eda90 2024-09-12T17:28:59.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.505+0000 7f2d1dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:59.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.505+0000 7f2e6c322800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:59.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.505+0000 7f2e6c322800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:59.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.505+0000 7f2e6c322800 5 note: GC not initialized 2024-09-12T17:28:59.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.506+0000 7f2d1cfe1640 20 reqs_thread_entry: start 2024-09-12T17:28:59.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.506+0000 7f2e6c322800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:59.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.506+0000 7f2e6c322800 20 Filter name: none 2024-09-12T17:28:59.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.506+0000 7f2c967fc640 20 reqs_thread_entry: start 2024-09-12T17:28:59.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.506+0000 7f2e6c322800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-12T17:28:59.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.506+0000 7f2e6c322800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.506+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560a799382a0 con 0x7f2e6003b070 2024-09-12T17:28:59.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.506+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f2e5003b040 con 0x7f2e6003b070 2024-09-12T17:28:59.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.506+0000 7f2e6c322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:59.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.507+0000 7f2e6c322800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-12T17:28:59.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.507+0000 7f2e6c322800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-12T17:28:59.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.507+0000 7f2e6c322800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-12T17:28:59.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.507+0000 7f2e6c322800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.507+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560a79936960 con 0x560a798eda90 2024-09-12T17:28:59.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.507+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f2e5003b040 con 0x560a798eda90 2024-09-12T17:28:59.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.507+0000 7f2e6c322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:59.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.507+0000 7f2e6c322800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-12T17:28:59.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.507+0000 7f2e6c322800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T17:28:59.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.507+0000 7f2e6c322800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-12T17:28:59.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.507+0000 7f2e6c322800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-12T17:28:59.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.507+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560a79937230 con 0x7f2e6003b070 2024-09-12T17:28:59.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.508+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~380] v31'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f2e5003b040 con 0x7f2e6003b070 2024-09-12T17:28:59.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.508+0000 7f2e6c322800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-12T17:28:59.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.508+0000 7f2e6c322800 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-12T17:28:59.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.508+0000 7f2e6c322800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-12T17:28:59.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.508+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 94602989366656 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560a7993bbe0 con 0x7f2e6003b070 2024-09-12T17:28:59.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.508+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== watch-notify(notify (1) cookie 94602989143888 notify 133143986207 ret 0) ==== 598+0+0 (crc 0 0 0) 0x560a799375d0 con 0x7f2e6003b070 2024-09-12T17:28:59.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.508+0000 7f2d46ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986207 cookie 94602989143888 notifier 4722 bl.length()=556 2024-09-12T17:28:59.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.508+0000 7f2d46ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-12T17:28:59.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.508+0000 7f2d46ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-12T17:28:59.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.508+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(65 notify.7 [notify cookie 94602989366656 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2e5003b040 con 0x7f2e6003b070 2024-09-12T17:28:59.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.508+0000 7f2d46ffd640 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f2d2c003ea0 con 0x7f2e6003b070 2024-09-12T17:28:59.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.509+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e5003b040 con 0x7f2e6003b070 2024-09-12T17:28:59.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.509+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== watch-notify(notify_complete (2) cookie 94602989366656 notify 133143986207 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560a79937bf0 con 0x7f2e6003b070 2024-09-12T17:28:59.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.509+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560a79939710 con 0x560a798eda90 2024-09-12T17:28:59.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.510+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v31'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f2e5003b040 con 0x560a798eda90 2024-09-12T17:28:59.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.510+0000 7f2e6c322800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-12T17:28:59.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.510+0000 7f2e6c322800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T17:28:59.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.510+0000 7f2e6c322800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-12T17:28:59.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.510+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94602989366576 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560a7993bbe0 con 0x7f2e6003b070 2024-09-12T17:28:59.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.510+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.0 v2:172.21.15.47:6800/3978157098 22 ==== watch-notify(notify (1) cookie 94602989130208 notify 133143986208 ret 0) ==== 219+0+0 (crc 0 0 0) 0x560a79937bf0 con 0x7f2e6003b070 2024-09-12T17:28:59.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.510+0000 7f2d46ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986208 cookie 94602989130208 notifier 4722 bl.length()=177 2024-09-12T17:28:59.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.510+0000 7f2d46ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-12T17:28:59.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.510+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.0 v2:172.21.15.47:6800/3978157098 23 ==== osd_op_reply(68 notify.5 [notify cookie 94602989366576 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2e5003b040 con 0x7f2e6003b070 2024-09-12T17:28:59.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.510+0000 7f2d46ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T17:28:59.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.510+0000 7f2d46ffd640 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f2d2c003ea0 con 0x7f2e6003b070 2024-09-12T17:28:59.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.511+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.0 v2:172.21.15.47:6800/3978157098 24 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e5003b040 con 0x7f2e6003b070 2024-09-12T17:28:59.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.511+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.0 v2:172.21.15.47:6800/3978157098 25 ==== watch-notify(notify_complete (2) cookie 94602989366576 notify 133143986208 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f2e50018040 con 0x7f2e6003b070 2024-09-12T17:28:59.524 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-12T17:28:59.508157Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:28:59.508145Z","tags":[],"group_ids":[]} 2024-09-12T17:28:59.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.512+0000 7f2d1dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:59.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.512+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94602989148736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560a799360d0 con 0x560a798eda90 2024-09-12T17:28:59.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.513+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94602989148736] v31'212 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2e5003b040 con 0x560a798eda90 2024-09-12T17:28:59.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.513+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94602989125264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560a799360d0 con 0x560a798f2480 2024-09-12T17:28:59.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.514+0000 7f2e68703640 1 -- 172.21.15.170:0/1846895725 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94602989125264] v31'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e60030070 con 0x560a798f2480 2024-09-12T17:28:59.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.514+0000 7f2e6c322800 20 remove_watcher() i=0 2024-09-12T17:28:59.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.514+0000 7f2e6c322800 2 removed watcher, disabling cache 2024-09-12T17:28:59.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.514+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94602989129120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560a799360d0 con 0x560a798eda90 2024-09-12T17:28:59.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.515+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94602989129120] v31'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e5003b040 con 0x560a798eda90 2024-09-12T17:28:59.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.515+0000 7f2e6c322800 20 remove_watcher() i=1 2024-09-12T17:28:59.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.515+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94602989133184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560a799360d0 con 0x560a798f6f60 2024-09-12T17:28:59.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.516+0000 7f2e67f02640 1 -- 172.21.15.170:0/1846895725 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94602989133184] v31'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e58075030 con 0x560a798f6f60 2024-09-12T17:28:59.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.516+0000 7f2e6c322800 20 remove_watcher() i=2 2024-09-12T17:28:59.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.516+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94602989136880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560a799360d0 con 0x560a798f2480 2024-09-12T17:28:59.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.517+0000 7f2e68703640 1 -- 172.21.15.170:0/1846895725 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94602989136880] v31'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e60030070 con 0x560a798f2480 2024-09-12T17:28:59.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.517+0000 7f2e6c322800 20 remove_watcher() i=3 2024-09-12T17:28:59.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.517+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94602989141904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560a799360d0 con 0x560a798eda90 2024-09-12T17:28:59.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.519+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94602989141904] v31'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e5003b040 con 0x560a798eda90 2024-09-12T17:28:59.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.519+0000 7f2e6c322800 20 remove_watcher() i=4 2024-09-12T17:28:59.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.519+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94602989130208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560a799360d0 con 0x7f2e6003b070 2024-09-12T17:28:59.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.520+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.0 v2:172.21.15.47:6800/3978157098 26 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94602989130208] v31'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e5003b040 con 0x7f2e6003b070 2024-09-12T17:28:59.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.520+0000 7f2e6c322800 20 remove_watcher() i=5 2024-09-12T17:28:59.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.520+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94602989145712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560a799360d0 con 0x7f2e6003b070 2024-09-12T17:28:59.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.521+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.0 v2:172.21.15.47:6800/3978157098 27 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94602989145712] v31'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e5003b040 con 0x7f2e6003b070 2024-09-12T17:28:59.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.521+0000 7f2e6c322800 20 remove_watcher() i=6 2024-09-12T17:28:59.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.521+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94602989143888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560a799360d0 con 0x7f2e6003b070 2024-09-12T17:28:59.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.522+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 <== osd.0 v2:172.21.15.47:6800/3978157098 28 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94602989143888] v31'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e5003b040 con 0x7f2e6003b070 2024-09-12T17:28:59.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.522+0000 7f2e6c322800 20 remove_watcher() i=7 2024-09-12T17:28:59.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.522+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f2e6003b070 msgr2=0x7f2e6001baa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.522+0000 7f2e6c322800 1 --2- 172.21.15.170:0/1846895725 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f2e6003b070 0x7f2e6001baa0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.522+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x560a798eda90 msgr2=0x560a798eff50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.522+0000 7f2e6c322800 1 --2- 172.21.15.170:0/1846895725 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x560a798eda90 0x560a798eff50 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.522+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x560a798f2480 msgr2=0x560a798f4870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.522+0000 7f2e6c322800 1 --2- 172.21.15.170:0/1846895725 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x560a798f2480 0x560a798f4870 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.522+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x560a798f6f60 msgr2=0x560a798f9420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.522+0000 7f2e6c322800 1 --2- 172.21.15.170:0/1846895725 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x560a798f6f60 0x560a798f9420 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.522+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2d3003c780 msgr2=0x7f2d3003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.522+0000 7f2e6c322800 1 --2- 172.21.15.170:0/1846895725 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2d3003c780 0x7f2d3003ec40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2e580507d0 tx=0x7f2e58092000 comp rx=0 tx=0).stop 2024-09-12T17:28:59.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.522+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560a798dab20 msgr2=0x560a798e2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.522+0000 7f2e6c322800 1 --2- 172.21.15.170:0/1846895725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560a798dab20 0x560a798e2100 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f2e60047000 tx=0x7f2e60053d30 comp rx=0 tx=0).stop 2024-09-12T17:28:59.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.522+0000 7f2e5ffff640 1 -- 172.21.15.170:0/1846895725 reap_dead start 2024-09-12T17:28:59.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.522+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 shutdown_connections 2024-09-12T17:28:59.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.522+0000 7f2e6c322800 1 --2- 172.21.15.170:0/1846895725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560a798dab20 0x560a798e2100 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.522+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 >> 172.21.15.170:0/1846895725 conn(0x560a798d6f20 msgr2=0x560a798d5130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:59.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.522+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 shutdown_connections 2024-09-12T17:28:59.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.522+0000 7f2e6c322800 1 -- 172.21.15.170:0/1846895725 wait complete. 2024-09-12T17:28:59.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.523+0000 7f2e6c322800 1 -- 172.21.15.170:0/767503129 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2d4003c730 msgr2=0x7f2d4003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.523+0000 7f2e6c322800 1 --2- 172.21.15.170:0/767503129 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2d4003c730 0x7f2d4003ebf0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x560a798bfb70 tx=0x7f2e58096630 comp rx=0 tx=0).stop 2024-09-12T17:28:59.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.523+0000 7f2e6c322800 1 -- 172.21.15.170:0/767503129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560a798ce060 msgr2=0x560a798ce480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.523+0000 7f2e6c322800 1 --2- 172.21.15.170:0/767503129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560a798ce060 0x560a798ce480 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x560a798b3ff0 tx=0x7f2e600167b0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.523+0000 7f2e6c322800 1 -- 172.21.15.170:0/767503129 shutdown_connections 2024-09-12T17:28:59.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.523+0000 7f2e6c322800 1 --2- 172.21.15.170:0/767503129 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2d4003c730 0x7f2d4003ebf0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.523+0000 7f2e6c322800 1 --2- 172.21.15.170:0/767503129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560a798ce060 0x560a798ce480 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.523+0000 7f2e6c322800 1 -- 172.21.15.170:0/767503129 >> 172.21.15.170:0/767503129 conn(0x560a798c2410 msgr2=0x560a798c27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:59.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.523+0000 7f2e6c322800 1 -- 172.21.15.170:0/767503129 shutdown_connections 2024-09-12T17:28:59.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.523+0000 7f2e6c322800 1 -- 172.21.15.170:0/767503129 wait complete. 2024-09-12T17:28:59.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.523+0000 7f2e6c322800 1 -- 172.21.15.170:0/98407553 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x560a797b8d70 msgr2=0x560a798ba7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.523+0000 7f2e6c322800 1 --2- 172.21.15.170:0/98407553 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x560a797b8d70 0x560a798ba7b0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.523+0000 7f2e6c322800 1 -- 172.21.15.170:0/98407553 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x560a798bcbd0 msgr2=0x560a798bf040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.523+0000 7f2e6c322800 1 --2- 172.21.15.170:0/98407553 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x560a798bcbd0 0x560a798bf040 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.523+0000 7f2e6c322800 1 -- 172.21.15.170:0/98407553 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2d5003c730 msgr2=0x7f2d5003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.523+0000 7f2e6c322800 1 --2- 172.21.15.170:0/98407553 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2d5003c730 0x7f2d5003ebf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2e50001e30 tx=0x7f2e50001390 comp rx=0 tx=0).stop 2024-09-12T17:28:59.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.523+0000 7f2e6c322800 1 -- 172.21.15.170:0/98407553 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560a797b8430 msgr2=0x560a798b3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.523+0000 7f2e6c322800 1 --2- 172.21.15.170:0/98407553 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560a797b8430 0x560a798b3160 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f2e58067040 tx=0x7f2e58002fb0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.523+0000 7f2e6c322800 1 -- 172.21.15.170:0/98407553 shutdown_connections 2024-09-12T17:28:59.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.523+0000 7f2e6c322800 1 --2- 172.21.15.170:0/98407553 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x560a798bcbd0 0x560a798bf040 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.523+0000 7f2e6c322800 1 --2- 172.21.15.170:0/98407553 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2d5003c730 0x7f2d5003ebf0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.523+0000 7f2e6c322800 1 --2- 172.21.15.170:0/98407553 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x560a797b8d70 0x560a798ba7b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.523+0000 7f2e6c322800 1 --2- 172.21.15.170:0/98407553 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560a797b8430 0x560a798b3160 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.523+0000 7f2e6c322800 1 -- 172.21.15.170:0/98407553 >> 172.21.15.170:0/98407553 conn(0x560a797b4200 msgr2=0x560a798a5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:59.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.523+0000 7f2e6c322800 1 -- 172.21.15.170:0/98407553 shutdown_connections 2024-09-12T17:28:59.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.523+0000 7f2e6c322800 1 -- 172.21.15.170:0/98407553 wait complete. 2024-09-12T17:28:59.535 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-12T17:28:59.508157Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:28:59.508145Z', 'tags': [], 'group_ids': []} 2024-09-12T17:28:59.548 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:28:59.553 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-09-12T17:28:59.553 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-12T17:28:59.554 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-12T17:28:59.554 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-09-12T17:28:59.600 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:59.600 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:59.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.599+0000 7f2e22b2a800 1 Processor -- start 2024-09-12T17:28:59.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.600+0000 7f2e22b2a800 1 -- start start 2024-09-12T17:28:59.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.600+0000 7f2e22b2a800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55e7c75a0f90 0x55e7c75a9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.600+0000 7f2e22b2a800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e7c744ae40 con 0x55e7c759f470 2024-09-12T17:28:59.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.600+0000 7f2e22b2a800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x55e7c7415680 con 0x55e7c75a0f90 2024-09-12T17:28:59.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.600+0000 7f2e160d9640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55e7c75a0f90 0x55e7c75a9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.600+0000 7f2e1e8da640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x55e7c759f470 0x55e7c759f870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:57412/0 (socket says 172.21.15.170:57412) 2024-09-12T17:28:59.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.600+0000 7f2e1e8da640 1 -- 172.21.15.170:0/3089619130 learned_addr learned my addr 172.21.15.170:0/3089619130 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:28:59.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.600+0000 7f2e160d9640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55e7c75a0f90 0x55e7c75a9ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59894/0 (socket says 172.21.15.170:59894) 2024-09-12T17:28:59.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.600+0000 7f2e160d9640 1 -- 172.21.15.170:0/3089619130 >> v1:172.21.15.47:6789/0 conn(0x55e7c759f470 legacy=0x55e7c759f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.600+0000 7f2e160d9640 1 -- 172.21.15.170:0/3089619130 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7c74316b0 con 0x55e7c75a0f90 2024-09-12T17:28:59.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.602+0000 7f2e160d9640 1 --2- 172.21.15.170:0/3089619130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7c75a0f90 0x55e7c75a9ab0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f2e0800a470 tx=0x7f2e08045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca86a65af2100789 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.602+0000 7f2e1e0d9640 1 -- 172.21.15.170:0/3089619130 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e08053570 con 0x55e7c75a0f90 2024-09-12T17:28:59.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.602+0000 7f2e1e0d9640 1 -- 172.21.15.170:0/3089619130 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e08058070 con 0x55e7c75a0f90 2024-09-12T17:28:59.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.602+0000 7f2e1e0d9640 1 -- 172.21.15.170:0/3089619130 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e08053880 con 0x55e7c75a0f90 2024-09-12T17:28:59.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.603+0000 7f2e22b2a800 1 -- 172.21.15.170:0/3089619130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7c75a0f90 msgr2=0x55e7c75a9ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.603+0000 7f2e22b2a800 1 --2- 172.21.15.170:0/3089619130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7c75a0f90 0x55e7c75a9ab0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f2e0800a470 tx=0x7f2e08045a20 comp rx=0 tx=0).stop 2024-09-12T17:28:59.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.603+0000 7f2e22b2a800 1 -- 172.21.15.170:0/3089619130 shutdown_connections 2024-09-12T17:28:59.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.603+0000 7f2e22b2a800 1 --2- 172.21.15.170:0/3089619130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7c75a0f90 0x55e7c75a9ab0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.603+0000 7f2e22b2a800 1 -- 172.21.15.170:0/3089619130 >> 172.21.15.170:0/3089619130 conn(0x55e7c759b1c0 msgr2=0x55e7c759d620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:59.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.603+0000 7f2e22b2a800 1 -- 172.21.15.170:0/3089619130 shutdown_connections 2024-09-12T17:28:59.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.603+0000 7f2e22b2a800 1 -- 172.21.15.170:0/3089619130 wait complete. 2024-09-12T17:28:59.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.617+0000 7f2e22b2a800 1 Processor -- start 2024-09-12T17:28:59.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.617+0000 7f2e22b2a800 1 -- start start 2024-09-12T17:28:59.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.617+0000 7f2e22b2a800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7c759f470 0x55e7c7692820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.617+0000 7f2e22b2a800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e7c7439dd0 con 0x55e7c759f470 2024-09-12T17:28:59.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.617+0000 7f2e1e8da640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7c759f470 0x55e7c7692820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.617+0000 7f2e1e8da640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7c759f470 0x55e7c7692820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59896/0 (socket says 172.21.15.170:59896) 2024-09-12T17:28:59.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.617+0000 7f2e1e8da640 1 -- 172.21.15.170:0/2334633407 learned_addr learned my addr 172.21.15.170:0/2334633407 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:59.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.618+0000 7f2e1e8da640 1 -- 172.21.15.170:0/2334633407 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7c7452e10 con 0x55e7c759f470 2024-09-12T17:28:59.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.618+0000 7f2e1e8da640 1 --2- 172.21.15.170:0/2334633407 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7c759f470 0x55e7c7692820 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2e10001e40 tx=0x7f2e10001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=560f3e082d27a6d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.618+0000 7f2d0ce09640 1 -- 172.21.15.170:0/2334633407 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e10012020 con 0x55e7c759f470 2024-09-12T17:28:59.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.618+0000 7f2d0ce09640 1 -- 172.21.15.170:0/2334633407 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e1000e5a0 con 0x55e7c759f470 2024-09-12T17:28:59.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.618+0000 7f2d0ce09640 1 -- 172.21.15.170:0/2334633407 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e1000e8a0 con 0x55e7c759f470 2024-09-12T17:28:59.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.619+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2334633407 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7c759f470 msgr2=0x55e7c7692820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.619+0000 7f2e22b2a800 1 --2- 172.21.15.170:0/2334633407 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7c759f470 0x55e7c7692820 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2e10001e40 tx=0x7f2e10001e70 comp rx=0 tx=0).stop 2024-09-12T17:28:59.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.619+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2334633407 shutdown_connections 2024-09-12T17:28:59.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.619+0000 7f2e22b2a800 1 --2- 172.21.15.170:0/2334633407 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7c759f470 0x55e7c7692820 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.619+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2334633407 >> 172.21.15.170:0/2334633407 conn(0x55e7c759b1c0 msgr2=0x55e7c768e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:59.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.619+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2334633407 shutdown_connections 2024-09-12T17:28:59.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.619+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2334633407 wait complete. 2024-09-12T17:28:59.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.619+0000 7f2e22b2a800 1 Processor -- start 2024-09-12T17:28:59.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.619+0000 7f2e22b2a800 1 -- start start 2024-09-12T17:28:59.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.619+0000 7f2e22b2a800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7c759f470 0x55e7c769a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.619+0000 7f2e22b2a800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e7c75aa2f0 con 0x55e7c759f470 2024-09-12T17:28:59.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.620+0000 7f2e1e8da640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7c759f470 0x55e7c769a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.620+0000 7f2e1e8da640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7c759f470 0x55e7c769a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59910/0 (socket says 172.21.15.170:59910) 2024-09-12T17:28:59.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.620+0000 7f2e1e8da640 1 -- 172.21.15.170:0/889672169 learned_addr learned my addr 172.21.15.170:0/889672169 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:59.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.620+0000 7f2e1e8da640 1 -- 172.21.15.170:0/889672169 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7c769a700 con 0x55e7c759f470 2024-09-12T17:28:59.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.620+0000 7f2e1e8da640 1 --2- 172.21.15.170:0/889672169 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7c759f470 0x55e7c769a1a0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f2e1000c010 tx=0x7f2e10000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.620+0000 7f2d0b606640 1 -- 172.21.15.170:0/889672169 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e10012030 con 0x55e7c759f470 2024-09-12T17:28:59.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.620+0000 7f2d0b606640 1 -- 172.21.15.170:0/889672169 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e100014a0 con 0x55e7c759f470 2024-09-12T17:28:59.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.620+0000 7f2e22b2a800 1 -- 172.21.15.170:0/889672169 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e7c769a990 con 0x55e7c759f470 2024-09-12T17:28:59.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.620+0000 7f2d0b606640 1 -- 172.21.15.170:0/889672169 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e1001a7a0 con 0x55e7c759f470 2024-09-12T17:28:59.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.620+0000 7f2e22b2a800 1 -- 172.21.15.170:0/889672169 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7c769b390 con 0x55e7c759f470 2024-09-12T17:28:59.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.621+0000 7f2d0b606640 1 -- 172.21.15.170:0/889672169 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2e10015020 con 0x55e7c759f470 2024-09-12T17:28:59.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.621+0000 7f2d0b606640 1 --2- 172.21.15.170:0/889672169 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2d0403c730 0x7f2d0403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.621+0000 7f2d0b606640 1 -- 172.21.15.170:0/889672169 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f2e10020030 con 0x55e7c759f470 2024-09-12T17:28:59.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.622+0000 7f2e160d9640 1 --2- 172.21.15.170:0/889672169 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2d0403c730 0x7f2d0403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.622+0000 7f2e22b2a800 1 --2- 172.21.15.170:0/889672169 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55e7c75a0f90 0x55e7c76a17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.622+0000 7f2e22b2a800 1 -- 172.21.15.170:0/889672169 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76a1d30 con 0x55e7c75a0f90 2024-09-12T17:28:59.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.622+0000 7f2e1f0db640 1 --2- 172.21.15.170:0/889672169 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55e7c75a0f90 0x55e7c76a17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.622+0000 7f2e160d9640 1 --2- 172.21.15.170:0/889672169 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2d0403c730 0x7f2d0403ebf0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2e08057000 tx=0x7f2e08052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.622+0000 7f2e1f0db640 1 --2- 172.21.15.170:0/889672169 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55e7c75a0f90 0x55e7c76a17f0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.622+0000 7f2e1f0db640 1 -- 172.21.15.170:0/889672169 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e1800a4d0 con 0x55e7c75a0f90 2024-09-12T17:28:59.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.622+0000 7f2e22b2a800 1 -- 172.21.15.170:0/889672169 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76a20d0 con 0x55e7c75a0f90 2024-09-12T17:28:59.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.623+0000 7f2e1f0db640 1 -- 172.21.15.170:0/889672169 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2e1800a4d0 con 0x55e7c75a0f90 2024-09-12T17:28:59.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.623+0000 7f2e22b2a800 1 --2- 172.21.15.170:0/889672169 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55e7c76a3b90 0x55e7c76a6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.623+0000 7f2e22b2a800 1 -- 172.21.15.170:0/889672169 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76a67c0 con 0x55e7c76a3b90 2024-09-12T17:28:59.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.623+0000 7f2e1e8da640 1 --2- 172.21.15.170:0/889672169 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55e7c76a3b90 0x55e7c76a6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.623+0000 7f2e1e8da640 1 --2- 172.21.15.170:0/889672169 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55e7c76a3b90 0x55e7c76a6030 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.623+0000 7f2e1e8da640 1 -- 172.21.15.170:0/889672169 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2e1001ab20 con 0x55e7c76a3b90 2024-09-12T17:28:59.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.623+0000 7f2e22b2a800 1 -- 172.21.15.170:0/889672169 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76a2920 con 0x55e7c75a0f90 2024-09-12T17:28:59.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.624+0000 7f2e1f0db640 1 -- 172.21.15.170:0/889672169 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2e1800a4d0 con 0x55e7c75a0f90 2024-09-12T17:28:59.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.624+0000 7f2e22b2a800 1 -- 172.21.15.170:0/889672169 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76a2d00 con 0x55e7c76a3b90 2024-09-12T17:28:59.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.624+0000 7f2e1e8da640 1 -- 172.21.15.170:0/889672169 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2e1001ab20 con 0x55e7c76a3b90 2024-09-12T17:28:59.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.624+0000 7f2e22b2a800 1 Processor -- start 2024-09-12T17:28:59.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.624+0000 7f2e22b2a800 1 -- start start 2024-09-12T17:28:59.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.624+0000 7f2e22b2a800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7c76b5050 0x55e7c76b5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.624+0000 7f2e22b2a800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e7c7497a00 con 0x55e7c76b5050 2024-09-12T17:28:59.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.625+0000 7f2e1f0db640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7c76b5050 0x55e7c76b5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.625+0000 7f2e1f0db640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7c76b5050 0x55e7c76b5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59924/0 (socket says 172.21.15.170:59924) 2024-09-12T17:28:59.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.625+0000 7f2e1f0db640 1 -- 172.21.15.170:0/3518400891 learned_addr learned my addr 172.21.15.170:0/3518400891 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:59.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.625+0000 7f2e1f0db640 1 -- 172.21.15.170:0/3518400891 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7c76b5ab0 con 0x55e7c76b5050 2024-09-12T17:28:59.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.625+0000 7f2e1f0db640 1 --2- 172.21.15.170:0/3518400891 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7c76b5050 0x55e7c76b5470 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x55e7c769b030 tx=0x7f2e180167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.626+0000 7f2d08e01640 1 -- 172.21.15.170:0/3518400891 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e18013640 con 0x55e7c76b5050 2024-09-12T17:28:59.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.626+0000 7f2d08e01640 1 -- 172.21.15.170:0/3518400891 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e180137e0 con 0x55e7c76b5050 2024-09-12T17:28:59.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.626+0000 7f2d08e01640 1 -- 172.21.15.170:0/3518400891 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e18013ae0 con 0x55e7c76b5050 2024-09-12T17:28:59.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.626+0000 7f2e22b2a800 1 -- 172.21.15.170:0/3518400891 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e7c76b62e0 con 0x55e7c76b5050 2024-09-12T17:28:59.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.626+0000 7f2e22b2a800 1 -- 172.21.15.170:0/3518400891 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7c76b6880 con 0x55e7c76b5050 2024-09-12T17:28:59.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.626+0000 7f2d08e01640 1 -- 172.21.15.170:0/3518400891 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2e18011040 con 0x55e7c76b5050 2024-09-12T17:28:59.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.627+0000 7f2d08e01640 1 --2- 172.21.15.170:0/3518400891 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2cf803c780 0x7f2cf803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.627+0000 7f2d08e01640 1 -- 172.21.15.170:0/3518400891 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f2e1800e040 con 0x55e7c76b5050 2024-09-12T17:28:59.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.627+0000 7f2e1e8da640 1 --2- 172.21.15.170:0/3518400891 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2cf803c780 0x7f2cf803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.627+0000 7f2e22b2a800 1 Processor -- start 2024-09-12T17:28:59.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.627+0000 7f2e1e8da640 1 --2- 172.21.15.170:0/3518400891 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2cf803c780 0x7f2cf803ec40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2e1000c720 tx=0x7f2e10043050 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.627+0000 7f2e22b2a800 1 -- start start 2024-09-12T17:28:59.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.627+0000 7f2e22b2a800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7c76c1b10 0x55e7c76c1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.627+0000 7f2e22b2a800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e7c7693070 con 0x55e7c76c1b10 2024-09-12T17:28:59.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.627+0000 7f2e1f0db640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7c76c1b10 0x55e7c76c1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.627+0000 7f2e1f0db640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7c76c1b10 0x55e7c76c1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59936/0 (socket says 172.21.15.170:59936) 2024-09-12T17:28:59.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.627+0000 7f2e1f0db640 1 -- 172.21.15.170:0/593755005 learned_addr learned my addr 172.21.15.170:0/593755005 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:59.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.628+0000 7f2e1f0db640 1 -- 172.21.15.170:0/593755005 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7c76c2500 con 0x55e7c76c1b10 2024-09-12T17:28:59.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.628+0000 7f2e1f0db640 1 --2- 172.21.15.170:0/593755005 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7c76c1b10 0x55e7c76c1f10 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f2e18016cd0 tx=0x7f2e180203a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1317f0e84532f1f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.628+0000 7f2d027fc640 1 -- 172.21.15.170:0/593755005 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e1804a070 con 0x55e7c76c1b10 2024-09-12T17:28:59.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.628+0000 7f2d027fc640 1 -- 172.21.15.170:0/593755005 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e18055040 con 0x55e7c76c1b10 2024-09-12T17:28:59.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.628+0000 7f2d027fc640 1 -- 172.21.15.170:0/593755005 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e18052070 con 0x55e7c76c1b10 2024-09-12T17:28:59.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.628+0000 7f2e22b2a800 1 -- 172.21.15.170:0/593755005 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7c76c1b10 msgr2=0x55e7c76c1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.628+0000 7f2e22b2a800 1 --2- 172.21.15.170:0/593755005 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7c76c1b10 0x55e7c76c1f10 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f2e18016cd0 tx=0x7f2e180203a0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.629+0000 7f2e22b2a800 1 -- 172.21.15.170:0/593755005 shutdown_connections 2024-09-12T17:28:59.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.629+0000 7f2e22b2a800 1 --2- 172.21.15.170:0/593755005 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7c76c1b10 0x55e7c76c1f10 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.629+0000 7f2e22b2a800 1 -- 172.21.15.170:0/593755005 >> 172.21.15.170:0/593755005 conn(0x55e7c76bdf30 msgr2=0x55e7c76bc170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:59.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.629+0000 7f2e22b2a800 1 -- 172.21.15.170:0/593755005 shutdown_connections 2024-09-12T17:28:59.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.629+0000 7f2e22b2a800 1 -- 172.21.15.170:0/593755005 wait complete. 2024-09-12T17:28:59.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.629+0000 7f2e22b2a800 1 Processor -- start 2024-09-12T17:28:59.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.629+0000 7f2e22b2a800 1 -- start start 2024-09-12T17:28:59.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.629+0000 7f2e22b2a800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7c76c1b10 0x55e7c76c9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.629+0000 7f2e22b2a800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e7c76c2b20 con 0x55e7c76c1b10 2024-09-12T17:28:59.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.629+0000 7f2e1f0db640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7c76c1b10 0x55e7c76c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.629+0000 7f2e1f0db640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7c76c1b10 0x55e7c76c9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59952/0 (socket says 172.21.15.170:59952) 2024-09-12T17:28:59.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.629+0000 7f2e1f0db640 1 -- 172.21.15.170:0/2892076200 learned_addr learned my addr 172.21.15.170:0/2892076200 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:28:59.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.630+0000 7f2e1f0db640 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7c76c96c0 con 0x55e7c76c1b10 2024-09-12T17:28:59.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.630+0000 7f2e1f0db640 1 --2- 172.21.15.170:0/2892076200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7c76c1b10 0x55e7c76c9160 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f2e18022ff0 tx=0x7f2e18053d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.630+0000 7f2d00ff9640 1 -- 172.21.15.170:0/2892076200 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e1804a040 con 0x55e7c76c1b10 2024-09-12T17:28:59.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.630+0000 7f2d00ff9640 1 -- 172.21.15.170:0/2892076200 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e18021910 con 0x55e7c76c1b10 2024-09-12T17:28:59.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.630+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e7c76c9950 con 0x55e7c76c1b10 2024-09-12T17:28:59.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.630+0000 7f2d00ff9640 1 -- 172.21.15.170:0/2892076200 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e18052040 con 0x55e7c76c1b10 2024-09-12T17:28:59.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.630+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7c76ca2d0 con 0x55e7c76c1b10 2024-09-12T17:28:59.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.631+0000 7f2d00ff9640 1 -- 172.21.15.170:0/2892076200 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2e18021440 con 0x55e7c76c1b10 2024-09-12T17:28:59.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.631+0000 7f2d00ff9640 1 --2- 172.21.15.170:0/2892076200 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2ce803c780 0x7f2ce803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.631+0000 7f2d00ff9640 1 -- 172.21.15.170:0/2892076200 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f2e18034bf0 con 0x55e7c76c1b10 2024-09-12T17:28:59.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.631+0000 7f2e1e8da640 1 --2- 172.21.15.170:0/2892076200 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2ce803c780 0x7f2ce803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.632+0000 7f2e1e8da640 1 --2- 172.21.15.170:0/2892076200 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2ce803c780 0x7f2ce803ec40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2e1001a6a0 tx=0x7f2e10030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.632+0000 7f2e22b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.632+0000 7f2e22b2a800 1 --2- 172.21.15.170:0/2892076200 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55e7c76d4ad0 0x55e7c76d6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.632+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76d76e0 con 0x55e7c76d4ad0 2024-09-12T17:28:59.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.632+0000 7f2e160d9640 1 --2- 172.21.15.170:0/2892076200 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55e7c76d4ad0 0x55e7c76d6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.632+0000 7f2e160d9640 1 --2- 172.21.15.170:0/2892076200 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55e7c76d4ad0 0x55e7c76d6f90 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.632+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e08051070 con 0x55e7c76d4ad0 2024-09-12T17:28:59.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.632+0000 7f2e22b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:59.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.632+0000 7f2e22b2a800 20 realm 2024-09-12T17:28:59.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.632+0000 7f2e22b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.632+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76d7b10 con 0x55e7c76d4ad0 2024-09-12T17:28:59.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.633+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e08051070 con 0x55e7c76d4ad0 2024-09-12T17:28:59.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.633+0000 7f2e22b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:59.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.633+0000 7f2e22b2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:28:59.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.633+0000 7f2e22b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.633+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76d83e0 con 0x55e7c76d4ad0 2024-09-12T17:28:59.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.633+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e08051070 con 0x55e7c76d4ad0 2024-09-12T17:28:59.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.633+0000 7f2e22b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:59.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.633+0000 7f2e22b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.633+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76d8780 con 0x55e7c76d4ad0 2024-09-12T17:28:59.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.633+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2e08051070 con 0x55e7c76d4ad0 2024-09-12T17:28:59.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.633+0000 7f2e22b2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:59.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.633+0000 7f2e22b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.633+0000 7f2e22b2a800 1 --2- 172.21.15.170:0/2892076200 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55e7c76d94e0 0x55e7c76db8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.633+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76dbee0 con 0x55e7c76d94e0 2024-09-12T17:28:59.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.633+0000 7f2e1f0db640 1 --2- 172.21.15.170:0/2892076200 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55e7c76d94e0 0x55e7c76db8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.633+0000 7f2e1f0db640 1 --2- 172.21.15.170:0/2892076200 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55e7c76d94e0 0x55e7c76db8d0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.634+0000 7f2e1f0db640 1 -- 172.21.15.170:0/2892076200 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2e18039020 con 0x55e7c76d94e0 2024-09-12T17:28:59.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.634+0000 7f2e22b2a800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:28:59.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.634+0000 7f2e22b2a800 20 searching for the correct realm 2024-09-12T17:28:59.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.634+0000 7f2e22b2a800 1 --2- 172.21.15.170:0/2892076200 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55e7c76dde90 0x55e7c76e0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.634+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e09d0 con 0x55e7c76dde90 2024-09-12T17:28:59.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.634+0000 7f2e1e8da640 1 --2- 172.21.15.170:0/2892076200 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55e7c76dde90 0x55e7c76e0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.634+0000 7f2e1e8da640 1 --2- 172.21.15.170:0/2892076200 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55e7c76dde90 0x55e7c76e0350 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.634+0000 7f2e1e8da640 1 -- 172.21.15.170:0/2892076200 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1001ab20 con 0x55e7c76dde90 2024-09-12T17:28:59.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.634+0000 7f2e1e8da640 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e09d0 con 0x55e7c76d94e0 2024-09-12T17:28:59.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.635+0000 7f2e1f0db640 1 -- 172.21.15.170:0/2892076200 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e18039020 con 0x55e7c76d94e0 2024-09-12T17:28:59.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.635+0000 7f2e1f0db640 1 --2- 172.21.15.170:0/2892076200 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f2e1804e410 0x7f2e18055a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:28:59.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.635+0000 7f2e1f0db640 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e09d0 con 0x7f2e1804e410 2024-09-12T17:28:59.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.635+0000 7f2e160d9640 1 --2- 172.21.15.170:0/2892076200 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f2e1804e410 0x7f2e18055a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:28:59.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.635+0000 7f2e160d9640 1 --2- 172.21.15.170:0/2892076200 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f2e1804e410 0x7f2e18055a30 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:28:59.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.635+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e08051070 con 0x7f2e1804e410 2024-09-12T17:28:59.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.635+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e09d0 con 0x55e7c76d4ad0 2024-09-12T17:28:59.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.636+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e08051070 con 0x55e7c76d4ad0 2024-09-12T17:28:59.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.636+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e09d0 con 0x55e7c76d4ad0 2024-09-12T17:28:59.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.636+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e08051070 con 0x55e7c76d4ad0 2024-09-12T17:28:59.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.636+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e09d0 con 0x7f2e1804e410 2024-09-12T17:28:59.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.636+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e08051070 con 0x7f2e1804e410 2024-09-12T17:28:59.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.636+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e09d0 con 0x7f2e1804e410 2024-09-12T17:28:59.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.636+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e08051070 con 0x7f2e1804e410 2024-09-12T17:28:59.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.636+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e09d0 con 0x55e7c76d94e0 2024-09-12T17:28:59.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.637+0000 7f2e1f0db640 1 -- 172.21.15.170:0/2892076200 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e18039020 con 0x55e7c76d94e0 2024-09-12T17:28:59.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.637+0000 7f2e1f0db640 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e09d0 con 0x55e7c76dde90 2024-09-12T17:28:59.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.637+0000 7f2e1e8da640 1 -- 172.21.15.170:0/2892076200 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1001ab20 con 0x55e7c76dde90 2024-09-12T17:28:59.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.637+0000 7f2e1e8da640 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e09d0 con 0x55e7c76d4ad0 2024-09-12T17:28:59.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.637+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e08051070 con 0x55e7c76d4ad0 2024-09-12T17:28:59.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.637+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e09d0 con 0x7f2e1804e410 2024-09-12T17:28:59.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.637+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e08051070 con 0x7f2e1804e410 2024-09-12T17:28:59.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.637+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e09d0 con 0x55e7c76d4ad0 2024-09-12T17:28:59.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.638+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e08051070 con 0x55e7c76d4ad0 2024-09-12T17:28:59.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.638+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e09d0 con 0x55e7c76d94e0 2024-09-12T17:28:59.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.638+0000 7f2e1f0db640 1 -- 172.21.15.170:0/2892076200 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f2e18039020 con 0x55e7c76d94e0 2024-09-12T17:28:59.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.638+0000 7f2e1f0db640 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e09d0 con 0x55e7c76dde90 2024-09-12T17:28:59.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.638+0000 7f2e1e8da640 1 -- 172.21.15.170:0/2892076200 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1001ab20 con 0x55e7c76dde90 2024-09-12T17:28:59.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.638+0000 7f2e1e8da640 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e09d0 con 0x55e7c76dde90 2024-09-12T17:28:59.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.638+0000 7f2e1e8da640 1 -- 172.21.15.170:0/2892076200 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1001ab20 con 0x55e7c76dde90 2024-09-12T17:28:59.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.638+0000 7f2e1e8da640 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e09d0 con 0x55e7c76d94e0 2024-09-12T17:28:59.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.639+0000 7f2e1f0db640 1 -- 172.21.15.170:0/2892076200 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e18039020 con 0x55e7c76d94e0 2024-09-12T17:28:59.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.639+0000 7f2e1f0db640 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e09d0 con 0x55e7c76dde90 2024-09-12T17:28:59.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.639+0000 7f2e1e8da640 1 -- 172.21.15.170:0/2892076200 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1001ab20 con 0x55e7c76dde90 2024-09-12T17:28:59.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.639+0000 7f2e1e8da640 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e09d0 con 0x55e7c76dde90 2024-09-12T17:28:59.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.639+0000 7f2e1e8da640 1 -- 172.21.15.170:0/2892076200 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1001ab20 con 0x55e7c76dde90 2024-09-12T17:28:59.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.639+0000 7f2e1e8da640 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e09d0 con 0x55e7c76d4ad0 2024-09-12T17:28:59.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.639+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e08051070 con 0x55e7c76d4ad0 2024-09-12T17:28:59.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.639+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e09d0 con 0x55e7c76d4ad0 2024-09-12T17:28:59.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.639+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2e08051070 con 0x55e7c76d4ad0 2024-09-12T17:28:59.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.639+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e09d0 con 0x7f2e1804e410 2024-09-12T17:28:59.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.640+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e08051070 con 0x7f2e1804e410 2024-09-12T17:28:59.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.640+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e09d0 con 0x55e7c76dde90 2024-09-12T17:28:59.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.640+0000 7f2e1e8da640 1 -- 172.21.15.170:0/2892076200 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1001ab20 con 0x55e7c76dde90 2024-09-12T17:28:59.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.640+0000 7f2e1e8da640 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e09d0 con 0x55e7c76d94e0 2024-09-12T17:28:59.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.640+0000 7f2e1f0db640 1 -- 172.21.15.170:0/2892076200 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e18039020 con 0x55e7c76d94e0 2024-09-12T17:28:59.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.640+0000 7f2e1f0db640 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e09d0 con 0x55e7c76d4ad0 2024-09-12T17:28:59.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.640+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e08051070 con 0x55e7c76d4ad0 2024-09-12T17:28:59.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.640+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e09d0 con 0x7f2e1804e410 2024-09-12T17:28:59.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.641+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e08051070 con 0x7f2e1804e410 2024-09-12T17:28:59.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.641+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e09d0 con 0x55e7c76dde90 2024-09-12T17:28:59.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.641+0000 7f2e1e8da640 1 -- 172.21.15.170:0/2892076200 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1001ab20 con 0x55e7c76dde90 2024-09-12T17:28:59.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.641+0000 7f2e1e8da640 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e09d0 con 0x7f2e1804e410 2024-09-12T17:28:59.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.641+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e08051070 con 0x7f2e1804e410 2024-09-12T17:28:59.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.641+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e09d0 con 0x55e7c76d94e0 2024-09-12T17:28:59.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.641+0000 7f2e1f0db640 1 -- 172.21.15.170:0/2892076200 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e18039020 con 0x55e7c76d94e0 2024-09-12T17:28:59.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.641+0000 7f2e1f0db640 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e09d0 con 0x55e7c76dde90 2024-09-12T17:28:59.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.642+0000 7f2e1e8da640 1 -- 172.21.15.170:0/2892076200 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1001ab20 con 0x55e7c76dde90 2024-09-12T17:28:59.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.642+0000 7f2e1e8da640 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e09d0 con 0x7f2e1804e410 2024-09-12T17:28:59.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.642+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e08051070 con 0x7f2e1804e410 2024-09-12T17:28:59.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.642+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e09d0 con 0x55e7c76d4ad0 2024-09-12T17:28:59.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.642+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2e08051070 con 0x55e7c76d4ad0 2024-09-12T17:28:59.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.642+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e09d0 con 0x55e7c76d94e0 2024-09-12T17:28:59.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.642+0000 7f2e1f0db640 1 -- 172.21.15.170:0/2892076200 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(37 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2e18039020 con 0x55e7c76d94e0 2024-09-12T17:28:59.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.642+0000 7f2e22b2a800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:28:59.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.643+0000 7f2e22b2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:28:59.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.643+0000 7f2e22b2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:28:59.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.643+0000 7f2e22b2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:28:59.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.643+0000 7f2e22b2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:28:59.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.643+0000 7f2e22b2a800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:28:59.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.643+0000 7f2e22b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.643+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76dc8a0 con 0x55e7c76d4ad0 2024-09-12T17:28:59.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.643+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e08051070 con 0x55e7c76d4ad0 2024-09-12T17:28:59.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.643+0000 7f2e22b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:59.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.643+0000 7f2e22b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.643+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76dc4e0 con 0x55e7c76d4ad0 2024-09-12T17:28:59.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.643+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2e08051070 con 0x55e7c76d4ad0 2024-09-12T17:28:59.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.643+0000 7f2e22b2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:28:59.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.643+0000 7f2e22b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.643+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76dcce0 con 0x55e7c76d94e0 2024-09-12T17:28:59.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.643+0000 7f2e1f0db640 1 -- 172.21.15.170:0/2892076200 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2e18039020 con 0x55e7c76d94e0 2024-09-12T17:28:59.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.643+0000 7f2e22b2a800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:28:59.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.643+0000 7f2e22b2a800 20 zone default found 2024-09-12T17:28:59.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.643+0000 7f2e22b2a800 4 Realm: () 2024-09-12T17:28:59.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.643+0000 7f2e22b2a800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:28:59.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.643+0000 7f2e22b2a800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:28:59.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.643+0000 7f2e22b2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:28:59.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.643+0000 7f2e22b2a800 20 zonegroup default 2024-09-12T17:28:59.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.643+0000 7f2e22b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.643+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e1300 con 0x7f2e1804e410 2024-09-12T17:28:59.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.644+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2e08051070 con 0x7f2e1804e410 2024-09-12T17:28:59.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.644+0000 7f2e22b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:59.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.644+0000 7f2e22b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.644+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e3540 con 0x55e7c76dde90 2024-09-12T17:28:59.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.644+0000 7f2e1e8da640 1 -- 172.21.15.170:0/2892076200 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2e1001ab20 con 0x55e7c76dde90 2024-09-12T17:28:59.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.644+0000 7f2e22b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:59.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.644+0000 7f2e22b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.644+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e38e0 con 0x55e7c76dde90 2024-09-12T17:28:59.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.644+0000 7f2e1e8da640 1 -- 172.21.15.170:0/2892076200 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2e1001ab20 con 0x55e7c76dde90 2024-09-12T17:28:59.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.644+0000 7f2e22b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:28:59.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.644+0000 7f2e22b2a800 20 started sync module instance, tier type = 2024-09-12T17:28:59.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.644+0000 7f2e22b2a800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:28:59.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.644+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e29d0 con 0x55e7c76d94e0 2024-09-12T17:28:59.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.645+0000 7f2e1f0db640 1 -- 172.21.15.170:0/2892076200 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(44 notify.0 [create] v31'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e18039020 con 0x55e7c76d94e0 2024-09-12T17:28:59.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.645+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94453971692992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e4180 con 0x55e7c76d94e0 2024-09-12T17:28:59.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.645+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e49d0 con 0x55e7c76d4ad0 2024-09-12T17:28:59.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.646+0000 7f2e1f0db640 1 -- 172.21.15.170:0/2892076200 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94453971692992] v31'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e18039020 con 0x55e7c76d94e0 2024-09-12T17:28:59.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.646+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v31'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e08051070 con 0x55e7c76d4ad0 2024-09-12T17:28:59.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.646+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94453971696848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e4680 con 0x55e7c76d4ad0 2024-09-12T17:28:59.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.647+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e51a0 con 0x55e7c76dde90 2024-09-12T17:28:59.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.648+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94453971696848] v31'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e08051070 con 0x55e7c76d4ad0 2024-09-12T17:28:59.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.648+0000 7f2e1e8da640 1 -- 172.21.15.170:0/2892076200 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v31'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e1001ab20 con 0x55e7c76dde90 2024-09-12T17:28:59.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.648+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94453971700848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e5590 con 0x55e7c76dde90 2024-09-12T17:28:59.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.648+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e5fd0 con 0x55e7c76d94e0 2024-09-12T17:28:59.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.649+0000 7f2e1e8da640 1 -- 172.21.15.170:0/2892076200 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94453971700848] v31'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e1001ab20 con 0x55e7c76dde90 2024-09-12T17:28:59.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.649+0000 7f2e1f0db640 1 -- 172.21.15.170:0/2892076200 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(50 notify.3 [create] v31'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e18039020 con 0x55e7c76d94e0 2024-09-12T17:28:59.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.649+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94453971704480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e5f90 con 0x55e7c76d94e0 2024-09-12T17:28:59.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.649+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e6a80 con 0x55e7c76d4ad0 2024-09-12T17:28:59.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.650+0000 7f2e1f0db640 1 -- 172.21.15.170:0/2892076200 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94453971704480] v31'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e18039020 con 0x55e7c76d94e0 2024-09-12T17:28:59.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.650+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v31'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e08051070 con 0x55e7c76d4ad0 2024-09-12T17:28:59.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.650+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94453971697904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e6a80 con 0x55e7c76d4ad0 2024-09-12T17:28:59.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.650+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e7490 con 0x7f2e1804e410 2024-09-12T17:28:59.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.651+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94453971697904] v31'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e08051070 con 0x55e7c76d4ad0 2024-09-12T17:28:59.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.651+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(54 notify.5 [create] v31'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e08051070 con 0x7f2e1804e410 2024-09-12T17:28:59.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.651+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94453971707232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e7490 con 0x7f2e1804e410 2024-09-12T17:28:59.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.651+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e7ea0 con 0x7f2e1804e410 2024-09-12T17:28:59.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.652+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94453971707232] v31'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e08051070 con 0x7f2e1804e410 2024-09-12T17:28:59.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.652+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v31'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e08051070 con 0x7f2e1804e410 2024-09-12T17:28:59.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.652+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94453971709920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e8080 con 0x7f2e1804e410 2024-09-12T17:28:59.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.653+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e88d0 con 0x7f2e1804e410 2024-09-12T17:28:59.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.653+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94453971709920] v31'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e08051070 con 0x7f2e1804e410 2024-09-12T17:28:59.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.653+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(58 notify.7 [create] v31'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e08051070 con 0x7f2e1804e410 2024-09-12T17:28:59.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.653+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94453971713456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e8780 con 0x7f2e1804e410 2024-09-12T17:28:59.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.654+0000 7f2e22b2a800 20 add_watcher() i=0 2024-09-12T17:28:59.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.654+0000 7f2e22b2a800 20 add_watcher() i=1 2024-09-12T17:28:59.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.654+0000 7f2e22b2a800 20 add_watcher() i=2 2024-09-12T17:28:59.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.654+0000 7f2e22b2a800 20 add_watcher() i=3 2024-09-12T17:28:59.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.654+0000 7f2e22b2a800 20 add_watcher() i=4 2024-09-12T17:28:59.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.654+0000 7f2e22b2a800 20 add_watcher() i=5 2024-09-12T17:28:59.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.654+0000 7f2e22b2a800 20 add_watcher() i=6 2024-09-12T17:28:59.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.654+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94453971713456] v31'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e08051070 con 0x7f2e1804e410 2024-09-12T17:28:59.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.654+0000 7f2e22b2a800 20 add_watcher() i=7 2024-09-12T17:28:59.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.654+0000 7f2e22b2a800 2 all 8 watchers are set, enabling cache 2024-09-12T17:28:59.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.654+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76ebcf0 con 0x55e7c76d4ad0 2024-09-12T17:28:59.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.655+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2e08051070 con 0x55e7c76d4ad0 2024-09-12T17:28:59.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.655+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94453971714576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7c76e9240 con 0x55e7c76d4ad0 2024-09-12T17:28:59.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.656+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94453971714576] v31'213 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2e08051070 con 0x55e7c76d4ad0 2024-09-12T17:28:59.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.656+0000 7f2cd57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:59.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.656+0000 7f2e22b2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:28:59.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.656+0000 7f2e22b2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:28:59.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.656+0000 7f2e22b2a800 5 note: GC not initialized 2024-09-12T17:28:59.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.656+0000 7f2c4ffff640 20 reqs_thread_entry: start 2024-09-12T17:28:59.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.656+0000 7f2e22b2a800 20 init_complete bucket index max shards: 11 2024-09-12T17:28:59.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.656+0000 7f2e22b2a800 20 Filter name: none 2024-09-12T17:28:59.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.657+0000 7f2c4dffb640 20 reqs_thread_entry: start 2024-09-12T17:28:59.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.657+0000 7f2e22b2a800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-12T17:28:59.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.657+0000 7f2e22b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.657+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7c771ed10 con 0x7f2e1804e410 2024-09-12T17:28:59.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.657+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(62 bar [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f2e08051070 con 0x7f2e1804e410 2024-09-12T17:28:59.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.657+0000 7f2e22b2a800 20 rados_obj.operate() r=0 bl.length=380 2024-09-12T17:28:59.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.657+0000 7f2e22b2a800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-09-12T17:28:59.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.657+0000 7f2e22b2a800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-12T17:28:59.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.657+0000 7f2e22b2a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:59.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.657+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7c7722e80 con 0x55e7c76d94e0 2024-09-12T17:28:59.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.658+0000 7f2e1f0db640 1 -- 172.21.15.170:0/2892076200 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(63 bud [create,call,writefull 0~206] v31'1 uv1 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f2e18039020 con 0x55e7c76d94e0 2024-09-12T17:28:59.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.658+0000 7f2e22b2a800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-12T17:28:59.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.658+0000 7f2e22b2a800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-12T17:28:59.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.658+0000 7f2e22b2a800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-12T17:28:59.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.658+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94453971949744 in=394b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7c7723b70 con 0x7f2e1804e410 2024-09-12T17:28:59.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.659+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== watch-notify(notify (1) cookie 94453971707232 notify 133143986209 ret 0) ==== 424+0+0 (crc 0 0 0) 0x7f2e08082040 con 0x7f2e1804e410 2024-09-12T17:28:59.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.659+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(64 notify.5 [notify cookie 94453971949744 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2e08051070 con 0x7f2e1804e410 2024-09-12T17:28:59.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.659+0000 7f2d027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986209 cookie 94453971707232 notifier 4729 bl.length()=382 2024-09-12T17:28:59.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.659+0000 7f2d027fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-12T17:28:59.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.659+0000 7f2d027fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-12T17:28:59.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.659+0000 7f2d027fc640 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f2ce4003ea0 con 0x7f2e1804e410 2024-09-12T17:28:59.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.659+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== watch-notify(notify_complete (2) cookie 94453971949744 notify 133143986209 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e7c74316b0 con 0x7f2e1804e410 2024-09-12T17:28:59.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.659+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e08051070 con 0x7f2e1804e410 2024-09-12T17:28:59.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.659+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7c7723a70 con 0x55e7c76d4ad0 2024-09-12T17:28:59.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.660+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv7 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7f2e08051070 con 0x55e7c76d4ad0 2024-09-12T17:28:59.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.660+0000 7f2e22b2a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9 : miss 2024-09-12T17:28:59.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.660+0000 7f2e22b2a800 20 rados->read ofs=0 len=0 2024-09-12T17:28:59.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.660+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:67 8.8 8:12aa0ec1:root::.bucket.meta.myfoo6%3a7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7c7721120 con 0x55e7c76d4ad0 2024-09-12T17:28:59.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.660+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(67 .bucket.meta.myfoo6:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9 [call out=48b,stat out=16b,read 0~388 out=388b,getxattrs out=218b] v0'0 uv4 ondisk = 0) ==== 333+0+670 (crc 0 0 0) 0x7f2e08051070 con 0x55e7c76d4ad0 2024-09-12T17:28:59.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.660+0000 7f2e22b2a800 20 rados_obj.operate() r=0 bl.length=388 2024-09-12T17:28:59.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.660+0000 7f2e22b2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9 info.flags=0x17 2024-09-12T17:28:59.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.660+0000 7f2e22b2a800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9 to cache LRU end 2024-09-12T17:28:59.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.660+0000 7f2e22b2a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:28:59.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.660+0000 7f2e22b2a800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:28:59.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.660+0000 7f2e22b2a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9 2024-09-12T17:28:59.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.660+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 8.8 8:12aa0ec1:root::.bucket.meta.myfoo6%3a7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~388 in=388b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7c772ac70 con 0x55e7c76d4ad0 2024-09-12T17:28:59.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.661+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(68 .bucket.meta.myfoo6:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9 [delete,create,call,call,writefull 0~388,setxattr (117)] v31'5 uv5 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f2e08051070 con 0x55e7c76d4ad0 2024-09-12T17:28:59.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.661+0000 7f2e22b2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9 info.flags=0x17 2024-09-12T17:28:59.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.661+0000 7f2e22b2a800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9 to cache LRU end 2024-09-12T17:28:59.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.661+0000 7f2e22b2a800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-12T17:28:59.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.661+0000 7f2e22b2a800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9, ofs0, ns] 2024-09-12T17:28:59.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.661+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify cookie 94453971949424 in=768b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7c77299f0 con 0x55e7c76dde90 2024-09-12T17:28:59.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.661+0000 7f2e1e8da640 1 -- 172.21.15.170:0/2892076200 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== watch-notify(notify (1) cookie 94453971700848 notify 133143986189 ret 0) ==== 798+0+0 (crc 0 0 0) 0x7f2e10059040 con 0x55e7c76dde90 2024-09-12T17:28:59.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.662+0000 7f2d027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986189 cookie 94453971700848 notifier 4729 bl.length()=756 2024-09-12T17:28:59.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.662+0000 7f2d027fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9 info.flags=0x17 2024-09-12T17:28:59.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.662+0000 7f2d027fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9 to cache LRU end 2024-09-12T17:28:59.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.662+0000 7f2d027fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-12T17:28:59.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.662+0000 7f2d027fc640 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f2ce4003ea0 con 0x55e7c76dde90 2024-09-12T17:28:59.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.662+0000 7f2e1e8da640 1 -- 172.21.15.170:0/2892076200 <== osd.3 v2:172.21.15.170:6816/2664906588 15 ==== osd_op_reply(69 notify.2 [notify cookie 94453971949424 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2e1001ab20 con 0x55e7c76dde90 2024-09-12T17:28:59.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.662+0000 7f2e1e8da640 1 -- 172.21.15.170:0/2892076200 <== osd.3 v2:172.21.15.170:6816/2664906588 16 ==== watch-notify(notify_complete (2) cookie 94453971949424 notify 133143986189 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e7c769b390 con 0x55e7c76dde90 2024-09-12T17:28:59.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.662+0000 7f2e1e8da640 1 -- 172.21.15.170:0/2892076200 <== osd.3 v2:172.21.15.170:6816/2664906588 17 ==== osd_op_reply(70 notify.2 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e1001ab20 con 0x55e7c76dde90 2024-09-12T17:28:59.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.662+0000 7f2e22b2a800 20 handle_bi_update(): bucket=:myfoo6[7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9]): orig_sources= new_sources= 2024-09-12T17:28:59.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.662+0000 7f2e22b2a800 20 handle_bi_update(): bucket=:myfoo6[7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9]): potential sources added=[] removed=[] 2024-09-12T17:28:59.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.662+0000 7f2e22b2a800 20 handle_bi_update(): bucket=:myfoo6[7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9]): orig_dests= new_dests= 2024-09-12T17:28:59.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.662+0000 7f2e22b2a800 20 handle_bi_update(): bucket=:myfoo6[7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9]): potential dests added=[] removed=[] 2024-09-12T17:28:59.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.662+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7c7721770 con 0x55e7c76d4ad0 2024-09-12T17:28:59.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.663+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(71 bud.buckets [call] v31'3 uv0 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f2e08051070 con 0x55e7c76d4ad0 2024-09-12T17:28:59.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.663+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:72 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7c7721770 con 0x55e7c76d4ad0 2024-09-12T17:28:59.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.664+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(72 bud.buckets [call] v31'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f2e08051070 con 0x55e7c76d4ad0 2024-09-12T17:28:59.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.664+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:73 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7c7721770 con 0x55e7c76d4ad0 2024-09-12T17:28:59.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.665+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(73 myfoo6 [delete,create,call,writefull 0~166] v31'17 uv17 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f2e08051070 con 0x55e7c76d4ad0 2024-09-12T17:28:59.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.665+0000 7f2e22b2a800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-12T17:28:59.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.665+0000 7f2e22b2a800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-12T17:28:59.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.665+0000 7f2e22b2a800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-12T17:28:59.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.665+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [notify cookie 94453971949424 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7c77241c0 con 0x55e7c76d94e0 2024-09-12T17:28:59.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.665+0000 7f2e1f0db640 1 -- 172.21.15.170:0/2892076200 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== watch-notify(notify (1) cookie 94453971704480 notify 133143986191 ret 0) ==== 358+0+0 (crc 0 0 0) 0x55e7c76c96c0 con 0x55e7c76d94e0 2024-09-12T17:28:59.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.665+0000 7f2d01ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986191 cookie 94453971704480 notifier 4729 bl.length()=316 2024-09-12T17:28:59.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.665+0000 7f2d01ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-12T17:28:59.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.665+0000 7f2d01ffb640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-12T17:28:59.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.665+0000 7f2d01ffb640 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:75 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f2c54003400 con 0x55e7c76d94e0 2024-09-12T17:28:59.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.665+0000 7f2e1f0db640 1 -- 172.21.15.170:0/2892076200 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(74 notify.3 [notify cookie 94453971949424 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2e18039020 con 0x55e7c76d94e0 2024-09-12T17:28:59.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.665+0000 7f2e1f0db640 1 -- 172.21.15.170:0/2892076200 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== osd_op_reply(75 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e18039020 con 0x55e7c76d94e0 2024-09-12T17:28:59.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.666+0000 7f2e1f0db640 1 -- 172.21.15.170:0/2892076200 <== osd.2 v2:172.21.15.170:6808/3855567754 18 ==== watch-notify(notify_complete (2) cookie 94453971949424 notify 133143986191 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e7c76c2500 con 0x55e7c76d94e0 2024-09-12T17:28:59.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.666+0000 7f2e22b2a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9 : hit (requested=0x17, cached=0x17) 2024-09-12T17:28:59.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.666+0000 7f2e22b2a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9 2024-09-12T17:28:59.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.666+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:76 8.8 8:12aa0ec1:root::.bucket.meta.myfoo6%3a7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~388 in=388b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7c771fdd0 con 0x55e7c76d4ad0 2024-09-12T17:28:59.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.667+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(76 .bucket.meta.myfoo6:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9 [delete,create,call,call,writefull 0~388,setxattr (117)] v31'6 uv6 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f2e08051070 con 0x55e7c76d4ad0 2024-09-12T17:28:59.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.667+0000 7f2e22b2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9 info.flags=0x17 2024-09-12T17:28:59.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.667+0000 7f2e22b2a800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9 to cache LRU end 2024-09-12T17:28:59.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.667+0000 7f2e22b2a800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-12T17:28:59.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.667+0000 7f2e22b2a800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9, ofs0, ns] 2024-09-12T17:28:59.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.667+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [notify cookie 94453971944560 in=768b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7c771f890 con 0x55e7c76dde90 2024-09-12T17:28:59.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.667+0000 7f2e1e8da640 1 -- 172.21.15.170:0/2892076200 <== osd.3 v2:172.21.15.170:6816/2664906588 18 ==== watch-notify(notify (1) cookie 94453971700848 notify 133143986190 ret 0) ==== 798+0+0 (crc 0 0 0) 0x55e7c769b390 con 0x55e7c76dde90 2024-09-12T17:28:59.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.667+0000 7f2d027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986190 cookie 94453971700848 notifier 4729 bl.length()=756 2024-09-12T17:28:59.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.667+0000 7f2d027fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9 info.flags=0x17 2024-09-12T17:28:59.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.667+0000 7f2d027fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9 to cache LRU end 2024-09-12T17:28:59.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.667+0000 7f2d027fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-12T17:28:59.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.667+0000 7f2e1e8da640 1 -- 172.21.15.170:0/2892076200 <== osd.3 v2:172.21.15.170:6816/2664906588 19 ==== osd_op_reply(77 notify.2 [notify cookie 94453971944560 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2e1001ab20 con 0x55e7c76dde90 2024-09-12T17:28:59.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.667+0000 7f2d027fc640 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:78 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f2ce4003ea0 con 0x55e7c76dde90 2024-09-12T17:28:59.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.667+0000 7f2e1e8da640 1 -- 172.21.15.170:0/2892076200 <== osd.3 v2:172.21.15.170:6816/2664906588 20 ==== osd_op_reply(78 notify.2 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e1001ab20 con 0x55e7c76dde90 2024-09-12T17:28:59.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.667+0000 7f2e1e8da640 1 -- 172.21.15.170:0/2892076200 <== osd.3 v2:172.21.15.170:6816/2664906588 21 ==== watch-notify(notify_complete (2) cookie 94453971944560 notify 133143986190 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e7c769a990 con 0x55e7c76dde90 2024-09-12T17:28:59.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.667+0000 7f2e22b2a800 20 handle_bi_update(): bucket=:myfoo6[7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9]): orig_sources= new_sources= 2024-09-12T17:28:59.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.667+0000 7f2e22b2a800 20 handle_bi_update(): bucket=:myfoo6[7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9]): potential sources added=[] removed=[] 2024-09-12T17:28:59.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.667+0000 7f2e22b2a800 20 handle_bi_update(): bucket=:myfoo6[7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9]): orig_dests= new_dests= 2024-09-12T17:28:59.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.667+0000 7f2e22b2a800 20 handle_bi_update(): bucket=:myfoo6[7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9]): potential dests added=[] removed=[] 2024-09-12T17:28:59.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.667+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:79 4.3a 4:5fdc18ce:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7c7720470 con 0x55e7c76dde90 2024-09-12T17:28:59.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.668+0000 7f2e1e8da640 1 -- 172.21.15.170:0/2892076200 <== osd.3 v2:172.21.15.170:6816/2664906588 22 ==== osd_op_reply(79 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.0 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2e1001ab20 con 0x55e7c76dde90 2024-09-12T17:28:59.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.668+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:80 4.5 4:a14b146e:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7c7720470 con 0x55e7c76dde90 2024-09-12T17:28:59.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.668+0000 7f2e1e8da640 1 -- 172.21.15.170:0/2892076200 <== osd.3 v2:172.21.15.170:6816/2664906588 23 ==== osd_op_reply(80 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2e1001ab20 con 0x55e7c76dde90 2024-09-12T17:28:59.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.668+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:81 4.8 4:13a949b8:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7c7720470 con 0x55e7c76dde90 2024-09-12T17:28:59.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.668+0000 7f2e1e8da640 1 -- 172.21.15.170:0/2892076200 <== osd.3 v2:172.21.15.170:6816/2664906588 24 ==== osd_op_reply(81 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.2 [call out=89b] v0'0 uv4 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2e1001ab20 con 0x55e7c76dde90 2024-09-12T17:28:59.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.668+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:82 4.22 4:4632626d:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7c7720470 con 0x55e7c76d4ad0 2024-09-12T17:28:59.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.669+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(82 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2e08051070 con 0x55e7c76d4ad0 2024-09-12T17:28:59.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.669+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:83 4.11 4:8be23baf:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7c7720470 con 0x7f2e1804e410 2024-09-12T17:28:59.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.669+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== osd_op_reply(83 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.4 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2e08051070 con 0x7f2e1804e410 2024-09-12T17:28:59.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.669+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:84 4.9 4:93994fdb:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7c7720470 con 0x55e7c76d4ad0 2024-09-12T17:28:59.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.670+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(84 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.5 [call out=89b] v0'0 uv4 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2e08051070 con 0x55e7c76d4ad0 2024-09-12T17:28:59.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.670+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:85 4.2a 4:56478508:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7c7720470 con 0x55e7c76d4ad0 2024-09-12T17:28:59.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.670+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.1 v2:172.21.15.170:6800/1903654092 30 ==== osd_op_reply(85 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2e08051070 con 0x55e7c76d4ad0 2024-09-12T17:28:59.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.670+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:86 4.2 4:4103a046:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7c7720470 con 0x55e7c76d94e0 2024-09-12T17:28:59.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.670+0000 7f2e1f0db640 1 -- 172.21.15.170:0/2892076200 <== osd.2 v2:172.21.15.170:6808/3855567754 19 ==== osd_op_reply(86 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.7 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2e18039020 con 0x55e7c76d94e0 2024-09-12T17:28:59.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.671+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:87 4.13 4:ca5972e6:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7c7720470 con 0x55e7c76d94e0 2024-09-12T17:28:59.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.671+0000 7f2e1f0db640 1 -- 172.21.15.170:0/2892076200 <== osd.2 v2:172.21.15.170:6808/3855567754 20 ==== osd_op_reply(87 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2e18039020 con 0x55e7c76d94e0 2024-09-12T17:28:59.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.671+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:88 4.21 4:8790b4fe:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7c7720470 con 0x7f2e1804e410 2024-09-12T17:28:59.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.671+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.0 v2:172.21.15.47:6800/3978157098 22 ==== osd_op_reply(88 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.9 [call out=382b] v0'0 uv5 ondisk = 0) ==== 194+0+382 (crc 0 0 0) 0x7f2e08051070 con 0x7f2e1804e410 2024-09-12T17:28:59.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.671+0000 7f2e22b2a800 10 cls_bucket_list_unordered: got thirteen 2024-09-12T17:28:59.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.671+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:89 4.30 4:0d971fc5:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7c7720470 con 0x55e7c76dde90 2024-09-12T17:28:59.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.672+0000 7f2e1e8da640 1 -- 172.21.15.170:0/2892076200 <== osd.3 v2:172.21.15.170:6816/2664906588 25 ==== osd_op_reply(89 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f2e1001ab20 con 0x55e7c76dde90 2024-09-12T17:28:59.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.672+0000 7f2e22b2a800 20 get_obj_state: octx=0x55e7c7723480 obj=myfoo6:thirteen state=0x55e7c7721e98 s->prefetch_data=0 2024-09-12T17:28:59.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.672+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:90 3.0 3:01e7e327:::7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7c7720470 con 0x7f2e1804e410 2024-09-12T17:28:59.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.672+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.0 v2:172.21.15.47:6800/3978157098 23 ==== osd_op_reply(90 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9_thirteen [getxattrs out=856b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 238+0+872 (crc 0 0 0) 0x7f2e08051070 con 0x7f2e1804e410 2024-09-12T17:28:59.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.672+0000 7f2e22b2a800 10 manifest: total_size = 8 2024-09-12T17:28:59.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.672+0000 7f2e22b2a800 20 get_obj_state: setting s->obj_tag to 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10366970256828896820 2024-09-12T17:28:59.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.672+0000 7f2e22b2a800 20 Read xattr rgw_rados: user.rgw.acl 2024-09-12T17:28:59.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.672+0000 7f2e22b2a800 20 Read xattr rgw_rados: user.rgw.content_type 2024-09-12T17:28:59.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.672+0000 7f2e22b2a800 20 Read xattr rgw_rados: user.rgw.etag 2024-09-12T17:28:59.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.672+0000 7f2e22b2a800 20 Read xattr rgw_rados: user.rgw.idtag 2024-09-12T17:28:59.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.672+0000 7f2e22b2a800 20 Read xattr rgw_rados: user.rgw.manifest 2024-09-12T17:28:59.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.672+0000 7f2e22b2a800 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-09-12T17:28:59.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.672+0000 7f2e22b2a800 20 Read xattr rgw_rados: user.rgw.source_zone 2024-09-12T17:28:59.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.672+0000 7f2e22b2a800 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-09-12T17:28:59.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.672+0000 7f2e22b2a800 20 get_obj_state: octx=0x55e7c7723480 obj=myfoo6:thirteen state=0x55e7c7721e98 s->prefetch_data=0 2024-09-12T17:28:59.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.672+0000 7f2e22b2a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9 : hit (requested=0x17, cached=0x17) 2024-09-12T17:28:59.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.672+0000 7f2e22b2a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9 2024-09-12T17:28:59.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.672+0000 7f2e22b2a800 20 bucket index object: :.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.9 2024-09-12T17:28:59.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.672+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:91 4.21 4:8790b4fe:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7c772e400 con 0x7f2e1804e410 2024-09-12T17:28:59.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.673+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.0 v2:172.21.15.47:6800/3978157098 24 ==== osd_op_reply(91 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.9 [stat,call,call] v31'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f2e08051070 con 0x7f2e1804e410 2024-09-12T17:28:59.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.673+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:92 3.0 3:01e7e327:::7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9_thirteen:head [cmpxattr user.rgw.idtag (63) op 1 mode 1 in=77b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7c772c3e0 con 0x7f2e1804e410 2024-09-12T17:28:59.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.674+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.0 v2:172.21.15.47:6800/3978157098 25 ==== osd_op_reply(92 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9_thirteen [cmpxattr (63) op 1 mode 1,setxattr (117),setxattr (33)] v31'2 uv2 ondisk = 0) ==== 280+0+0 (crc 0 0 0) 0x7f2e08051070 con 0x7f2e1804e410 2024-09-12T17:28:59.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.674+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:93 4.21 4:8790b4fe:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=323b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7c772d920 con 0x7f2e1804e410 2024-09-12T17:28:59.698 INFO:teuthology.orchestra.run.smithi170.stderr:1 objects processed in :myfoo6[7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9]). Next marker thirteen 2024-09-12T17:28:59.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.674+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7c7723500 con 0x55e7c76d94e0 2024-09-12T17:28:59.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.675+0000 7f2e1f0db640 1 -- 172.21.15.170:0/2892076200 <== osd.2 v2:172.21.15.170:6808/3855567754 21 ==== osd_op_reply(94 bud [delete,create,call,writefull 0~380] v31'2 uv2 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f2e18039020 con 0x55e7c76d94e0 2024-09-12T17:28:59.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.675+0000 7f2e22b2a800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-12T17:28:59.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.675+0000 7f2e22b2a800 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-12T17:28:59.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.675+0000 7f2e22b2a800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-12T17:28:59.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.675+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [notify cookie 94453971941776 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7c7723500 con 0x7f2e1804e410 2024-09-12T17:28:59.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.675+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.0 v2:172.21.15.47:6800/3978157098 26 ==== osd_op_reply(93 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.9 [stat,call,call] v31'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f2e08051070 con 0x7f2e1804e410 2024-09-12T17:28:59.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.676+0000 7f2d027fc640 20 handle_completion(): completion ok for obj=thirteen 2024-09-12T17:28:59.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.676+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.0 v2:172.21.15.47:6800/3978157098 27 ==== watch-notify(notify (1) cookie 94453971707232 notify 133143986210 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55e7c7723fa0 con 0x7f2e1804e410 2024-09-12T17:28:59.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.676+0000 7f2d01ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986210 cookie 94453971707232 notifier 4729 bl.length()=556 2024-09-12T17:28:59.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.676+0000 7f2d01ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-12T17:28:59.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.676+0000 7f2d01ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-12T17:28:59.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.676+0000 7f2d01ffb640 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f2c54003460 con 0x7f2e1804e410 2024-09-12T17:28:59.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.676+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.0 v2:172.21.15.47:6800/3978157098 28 ==== osd_op_reply(95 notify.5 [notify cookie 94453971941776 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2e08051070 con 0x7f2e1804e410 2024-09-12T17:28:59.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.676+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.0 v2:172.21.15.47:6800/3978157098 29 ==== osd_op_reply(96 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e08051070 con 0x7f2e1804e410 2024-09-12T17:28:59.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.676+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.0 v2:172.21.15.47:6800/3978157098 30 ==== watch-notify(notify_complete (2) cookie 94453971941776 notify 133143986210 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e7c7727fe0 con 0x7f2e1804e410 2024-09-12T17:28:59.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.676+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:97 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7c7723500 con 0x55e7c76d4ad0 2024-09-12T17:28:59.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.677+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.1 v2:172.21.15.170:6800/1903654092 31 ==== osd_op_reply(97 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v31'2 uv2 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f2e08051070 con 0x55e7c76d4ad0 2024-09-12T17:28:59.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.677+0000 7f2e22b2a800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-12T17:28:59.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.677+0000 7f2e22b2a800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T17:28:59.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.677+0000 7f2e22b2a800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-12T17:28:59.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.677+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify cookie 94453971941776 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7c7723500 con 0x7f2e1804e410 2024-09-12T17:28:59.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.677+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.0 v2:172.21.15.47:6800/3978157098 31 ==== watch-notify(notify (1) cookie 94453971707232 notify 133143986211 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55e7c7727fe0 con 0x7f2e1804e410 2024-09-12T17:28:59.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.677+0000 7f2d027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986211 cookie 94453971707232 notifier 4729 bl.length()=177 2024-09-12T17:28:59.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.678+0000 7f2d027fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-12T17:28:59.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.678+0000 7f2d027fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T17:28:59.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.678+0000 7f2d027fc640 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:99 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f2ce4003ea0 con 0x7f2e1804e410 2024-09-12T17:28:59.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.678+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.0 v2:172.21.15.47:6800/3978157098 32 ==== osd_op_reply(98 notify.5 [notify cookie 94453971941776 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2e08051070 con 0x7f2e1804e410 2024-09-12T17:28:59.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.678+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.0 v2:172.21.15.47:6800/3978157098 33 ==== osd_op_reply(99 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e08051070 con 0x7f2e1804e410 2024-09-12T17:28:59.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.678+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.0 v2:172.21.15.47:6800/3978157098 34 ==== watch-notify(notify_complete (2) cookie 94453971941776 notify 133143986211 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e7c7721510 con 0x7f2e1804e410 2024-09-12T17:28:59.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.678+0000 7f2e22b2a800 10 removing user index: bar 2024-09-12T17:28:59.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.678+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:100 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7c7723500 con 0x7f2e1804e410 2024-09-12T17:28:59.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.679+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.0 v2:172.21.15.47:6800/3978157098 35 ==== osd_op_reply(100 bar [delete] v31'4 uv4 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7f2e08051070 con 0x7f2e1804e410 2024-09-12T17:28:59.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.679+0000 7f2e22b2a800 10 removing default.rgw.meta+users.uid+bar from cache 2024-09-12T17:28:59.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.679+0000 7f2e22b2a800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-12T17:28:59.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.679+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:101 7.9 7:93e5b521:::notify.7:head [notify cookie 94453971941776 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e7c7723500 con 0x7f2e1804e410 2024-09-12T17:28:59.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.679+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.0 v2:172.21.15.47:6800/3978157098 36 ==== watch-notify(notify (1) cookie 94453971713456 notify 133143986212 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55e7c7721510 con 0x7f2e1804e410 2024-09-12T17:28:59.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.679+0000 7f2d01ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986212 cookie 94453971713456 notifier 4729 bl.length()=152 2024-09-12T17:28:59.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.679+0000 7f2d01ffb640 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f2c54003460 con 0x7f2e1804e410 2024-09-12T17:28:59.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.679+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.0 v2:172.21.15.47:6800/3978157098 37 ==== osd_op_reply(101 notify.7 [notify cookie 94453971941776 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2e08051070 con 0x7f2e1804e410 2024-09-12T17:28:59.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.679+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.0 v2:172.21.15.47:6800/3978157098 38 ==== watch-notify(notify_complete (2) cookie 94453971941776 notify 133143986212 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e7c77208a0 con 0x7f2e1804e410 2024-09-12T17:28:59.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.679+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.0 v2:172.21.15.47:6800/3978157098 39 ==== osd_op_reply(102 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e08051070 con 0x7f2e1804e410 2024-09-12T17:28:59.702 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-12T17:28:59.508157Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:28:59.508145Z","tags":[],"group_ids":[]} 2024-09-12T17:28:59.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.680+0000 7f2cd57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:28:59.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.680+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94453971714576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7c7723500 con 0x55e7c76d4ad0 2024-09-12T17:28:59.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.681+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.1 v2:172.21.15.170:6800/1903654092 32 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94453971714576] v31'214 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2e08051070 con 0x55e7c76d4ad0 2024-09-12T17:28:59.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.681+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94453971692992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7c7723500 con 0x55e7c76d94e0 2024-09-12T17:28:59.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.682+0000 7f2e1f0db640 1 -- 172.21.15.170:0/2892076200 <== osd.2 v2:172.21.15.170:6808/3855567754 22 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94453971692992] v31'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e18039020 con 0x55e7c76d94e0 2024-09-12T17:28:59.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.682+0000 7f2e22b2a800 20 remove_watcher() i=0 2024-09-12T17:28:59.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.682+0000 7f2e22b2a800 2 removed watcher, disabling cache 2024-09-12T17:28:59.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.682+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94453971696848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7c7723500 con 0x55e7c76d4ad0 2024-09-12T17:28:59.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.683+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.1 v2:172.21.15.170:6800/1903654092 33 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94453971696848] v31'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e08051070 con 0x55e7c76d4ad0 2024-09-12T17:28:59.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.683+0000 7f2e22b2a800 20 remove_watcher() i=1 2024-09-12T17:28:59.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.683+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94453971700848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7c7723500 con 0x55e7c76dde90 2024-09-12T17:28:59.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.684+0000 7f2e1e8da640 1 -- 172.21.15.170:0/2892076200 <== osd.3 v2:172.21.15.170:6816/2664906588 26 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94453971700848] v31'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e1001ab20 con 0x55e7c76dde90 2024-09-12T17:28:59.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.684+0000 7f2e22b2a800 20 remove_watcher() i=2 2024-09-12T17:28:59.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.684+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94453971704480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7c7723500 con 0x55e7c76d94e0 2024-09-12T17:28:59.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.685+0000 7f2e1f0db640 1 -- 172.21.15.170:0/2892076200 <== osd.2 v2:172.21.15.170:6808/3855567754 23 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94453971704480] v31'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e18039020 con 0x55e7c76d94e0 2024-09-12T17:28:59.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.685+0000 7f2e22b2a800 20 remove_watcher() i=3 2024-09-12T17:28:59.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.685+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94453971697904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7c7723500 con 0x55e7c76d4ad0 2024-09-12T17:28:59.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.686+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.1 v2:172.21.15.170:6800/1903654092 34 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94453971697904] v31'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e08051070 con 0x55e7c76d4ad0 2024-09-12T17:28:59.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.686+0000 7f2e22b2a800 20 remove_watcher() i=4 2024-09-12T17:28:59.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.686+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94453971707232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7c7723500 con 0x7f2e1804e410 2024-09-12T17:28:59.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.687+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.0 v2:172.21.15.47:6800/3978157098 40 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94453971707232] v31'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e08051070 con 0x7f2e1804e410 2024-09-12T17:28:59.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.687+0000 7f2e22b2a800 20 remove_watcher() i=5 2024-09-12T17:28:59.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.687+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94453971709920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7c7723500 con 0x7f2e1804e410 2024-09-12T17:28:59.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.689+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.0 v2:172.21.15.47:6800/3978157098 41 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94453971709920] v31'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e08051070 con 0x7f2e1804e410 2024-09-12T17:28:59.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.689+0000 7f2e22b2a800 20 remove_watcher() i=6 2024-09-12T17:28:59.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.689+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94453971713456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e7c7723500 con 0x7f2e1804e410 2024-09-12T17:28:59.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.690+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 <== osd.0 v2:172.21.15.47:6800/3978157098 42 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94453971713456] v31'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e08051070 con 0x7f2e1804e410 2024-09-12T17:28:59.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.690+0000 7f2e22b2a800 20 remove_watcher() i=7 2024-09-12T17:28:59.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.690+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f2e1804e410 msgr2=0x7f2e18055a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.690+0000 7f2e22b2a800 1 --2- 172.21.15.170:0/2892076200 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f2e1804e410 0x7f2e18055a30 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.690+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55e7c76d4ad0 msgr2=0x55e7c76d6f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.690+0000 7f2e22b2a800 1 --2- 172.21.15.170:0/2892076200 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55e7c76d4ad0 0x55e7c76d6f90 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.690+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55e7c76d94e0 msgr2=0x55e7c76db8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.690+0000 7f2e22b2a800 1 --2- 172.21.15.170:0/2892076200 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55e7c76d94e0 0x55e7c76db8d0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.690+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55e7c76dde90 msgr2=0x55e7c76e0350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.690+0000 7f2e22b2a800 1 --2- 172.21.15.170:0/2892076200 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55e7c76dde90 0x55e7c76e0350 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.690+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2ce803c780 msgr2=0x7f2ce803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.690+0000 7f2e22b2a800 1 --2- 172.21.15.170:0/2892076200 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2ce803c780 0x7f2ce803ec40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2e1001a6a0 tx=0x7f2e10030000 comp rx=0 tx=0).stop 2024-09-12T17:28:59.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.690+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7c76c1b10 msgr2=0x55e7c76c9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.690+0000 7f2e160d9640 1 -- 172.21.15.170:0/2892076200 reap_dead start 2024-09-12T17:28:59.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.690+0000 7f2e22b2a800 1 --2- 172.21.15.170:0/2892076200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7c76c1b10 0x55e7c76c9160 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f2e18022ff0 tx=0x7f2e18053d00 comp rx=0 tx=0).stop 2024-09-12T17:28:59.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.690+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 shutdown_connections 2024-09-12T17:28:59.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.690+0000 7f2e22b2a800 1 --2- 172.21.15.170:0/2892076200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7c76c1b10 0x55e7c76c9160 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.690+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 >> 172.21.15.170:0/2892076200 conn(0x55e7c76bdf30 msgr2=0x55e7c76bc140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:59.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.690+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 shutdown_connections 2024-09-12T17:28:59.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.690+0000 7f2e22b2a800 1 -- 172.21.15.170:0/2892076200 wait complete. 2024-09-12T17:28:59.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.690+0000 7f2e22b2a800 1 -- 172.21.15.170:0/3518400891 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2cf803c780 msgr2=0x7f2cf803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.690+0000 7f2e22b2a800 1 --2- 172.21.15.170:0/3518400891 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2cf803c780 0x7f2cf803ec40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2e1000c720 tx=0x7f2e10043050 comp rx=0 tx=0).stop 2024-09-12T17:28:59.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.690+0000 7f2e22b2a800 1 -- 172.21.15.170:0/3518400891 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7c76b5050 msgr2=0x55e7c76b5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.690+0000 7f2e22b2a800 1 --2- 172.21.15.170:0/3518400891 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7c76b5050 0x55e7c76b5470 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x55e7c769b030 tx=0x7f2e180167b0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.690+0000 7f2e22b2a800 1 -- 172.21.15.170:0/3518400891 shutdown_connections 2024-09-12T17:28:59.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.690+0000 7f2e22b2a800 1 --2- 172.21.15.170:0/3518400891 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2cf803c780 0x7f2cf803ec40 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.690+0000 7f2e22b2a800 1 --2- 172.21.15.170:0/3518400891 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7c76b5050 0x55e7c76b5470 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.690+0000 7f2e22b2a800 1 -- 172.21.15.170:0/3518400891 >> 172.21.15.170:0/3518400891 conn(0x55e7c76a9400 msgr2=0x55e7c76a97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:59.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.690+0000 7f2e22b2a800 1 -- 172.21.15.170:0/3518400891 shutdown_connections 2024-09-12T17:28:59.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.690+0000 7f2e22b2a800 1 -- 172.21.15.170:0/3518400891 wait complete. 2024-09-12T17:28:59.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.691+0000 7f2e22b2a800 1 -- 172.21.15.170:0/889672169 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55e7c75a0f90 msgr2=0x55e7c76a17f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.691+0000 7f2e22b2a800 1 --2- 172.21.15.170:0/889672169 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55e7c75a0f90 0x55e7c76a17f0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.691+0000 7f2e22b2a800 1 -- 172.21.15.170:0/889672169 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55e7c76a3b90 msgr2=0x55e7c76a6030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.691+0000 7f2e22b2a800 1 --2- 172.21.15.170:0/889672169 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55e7c76a3b90 0x55e7c76a6030 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.691+0000 7f2e22b2a800 1 -- 172.21.15.170:0/889672169 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2d0403c730 msgr2=0x7f2d0403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.691+0000 7f2e22b2a800 1 --2- 172.21.15.170:0/889672169 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2d0403c730 0x7f2d0403ebf0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2e08057000 tx=0x7f2e08052000 comp rx=0 tx=0).stop 2024-09-12T17:28:59.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.691+0000 7f2e22b2a800 1 -- 172.21.15.170:0/889672169 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7c759f470 msgr2=0x55e7c769a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:28:59.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.691+0000 7f2e22b2a800 1 --2- 172.21.15.170:0/889672169 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7c759f470 0x55e7c769a1a0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f2e1000c010 tx=0x7f2e10000ed0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.691+0000 7f2e22b2a800 1 -- 172.21.15.170:0/889672169 shutdown_connections 2024-09-12T17:28:59.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.691+0000 7f2e22b2a800 1 --2- 172.21.15.170:0/889672169 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55e7c76a3b90 0x55e7c76a6030 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.691+0000 7f2e22b2a800 1 --2- 172.21.15.170:0/889672169 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2d0403c730 0x7f2d0403ebf0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.691+0000 7f2e22b2a800 1 --2- 172.21.15.170:0/889672169 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55e7c75a0f90 0x55e7c76a17f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.691+0000 7f2e22b2a800 1 --2- 172.21.15.170:0/889672169 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e7c759f470 0x55e7c769a1a0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:28:59.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.691+0000 7f2e22b2a800 1 -- 172.21.15.170:0/889672169 >> 172.21.15.170:0/889672169 conn(0x55e7c759b1c0 msgr2=0x55e7c7693b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:28:59.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.691+0000 7f2e22b2a800 1 -- 172.21.15.170:0/889672169 shutdown_connections 2024-09-12T17:28:59.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:28:59.691+0000 7f2e22b2a800 1 -- 172.21.15.170:0/889672169 wait complete. 2024-09-12T17:28:59.713 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-12T17:28:59.508157Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:28:59.508145Z', 'tags': [], 'group_ids': []} 2024-09-12T17:29:04.722 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:29:04.722 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-12T17:29:04.723 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-12T17:29:04.723 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-12T17:29:04.723 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-09-12T17:29:04.784 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:29:04.784 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:29:04.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.783+0000 7f9326212800 1 Processor -- start 2024-09-12T17:29:04.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.783+0000 7f9326212800 1 -- start start 2024-09-12T17:29:04.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.783+0000 7f9326212800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x556b8cef46c0 0x556b8cef6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:04.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.783+0000 7f9326212800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556b8cd9de40 con 0x556b8cef7050 2024-09-12T17:29:04.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.783+0000 7f9326212800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x556b8cd68680 con 0x556b8cef46c0 2024-09-12T17:29:04.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.784+0000 7f93218cb640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x556b8cef46c0 0x556b8cef6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:04.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.784+0000 7f93218cb640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x556b8cef46c0 0x556b8cef6ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:36282/0 (socket says 172.21.15.170:36282) 2024-09-12T17:29:04.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.784+0000 7f931bfff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x556b8cef7050 0x556b8cef9510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:50924/0 (socket says 172.21.15.170:50924) 2024-09-12T17:29:04.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.784+0000 7f93218cb640 1 -- 172.21.15.170:0/2837921010 learned_addr learned my addr 172.21.15.170:0/2837921010 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:04.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.784+0000 7f93218cb640 1 -- 172.21.15.170:0/2837921010 >> v1:172.21.15.47:6789/0 conn(0x556b8cef7050 legacy=0x556b8cef9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:04.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.784+0000 7f93218cb640 1 -- 172.21.15.170:0/2837921010 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b8cd846b0 con 0x556b8cef46c0 2024-09-12T17:29:04.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.786+0000 7f93218cb640 1 --2- 172.21.15.170:0/2837921010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556b8cef46c0 0x556b8cef6ab0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f931400a520 tx=0x7f9314045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6a956ae5450d070 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:04.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.786+0000 7f93210ca640 1 -- 172.21.15.170:0/2837921010 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9314055070 con 0x556b8cef46c0 2024-09-12T17:29:04.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.786+0000 7f93210ca640 1 -- 172.21.15.170:0/2837921010 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93140515b0 con 0x556b8cef46c0 2024-09-12T17:29:04.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.786+0000 7f93210ca640 1 -- 172.21.15.170:0/2837921010 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93140518d0 con 0x556b8cef46c0 2024-09-12T17:29:04.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.787+0000 7f9326212800 1 -- 172.21.15.170:0/2837921010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556b8cef46c0 msgr2=0x556b8cef6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:04.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.787+0000 7f9326212800 1 --2- 172.21.15.170:0/2837921010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556b8cef46c0 0x556b8cef6ab0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f931400a520 tx=0x7f9314045ba0 comp rx=0 tx=0).stop 2024-09-12T17:29:04.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.787+0000 7f9326212800 1 -- 172.21.15.170:0/2837921010 shutdown_connections 2024-09-12T17:29:04.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.787+0000 7f9326212800 1 --2- 172.21.15.170:0/2837921010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556b8cef46c0 0x556b8cef6ab0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:04.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.787+0000 7f9326212800 1 -- 172.21.15.170:0/2837921010 >> 172.21.15.170:0/2837921010 conn(0x556b8ceee200 msgr2=0x556b8cef0660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:04.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.787+0000 7f9326212800 1 -- 172.21.15.170:0/2837921010 shutdown_connections 2024-09-12T17:29:04.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.787+0000 7f9326212800 1 -- 172.21.15.170:0/2837921010 wait complete. 2024-09-12T17:29:04.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.802+0000 7f9326212800 1 Processor -- start 2024-09-12T17:29:04.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.802+0000 7f9326212800 1 -- start start 2024-09-12T17:29:04.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.803+0000 7f9326212800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556b8cef46c0 0x556b8cfe3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:04.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.803+0000 7f9326212800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556b8cd8cdd0 con 0x556b8cef46c0 2024-09-12T17:29:04.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.803+0000 7f93218cb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556b8cef46c0 0x556b8cfe3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:04.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.803+0000 7f93218cb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556b8cef46c0 0x556b8cfe3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:36288/0 (socket says 172.21.15.170:36288) 2024-09-12T17:29:04.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.803+0000 7f93218cb640 1 -- 172.21.15.170:0/1173878133 learned_addr learned my addr 172.21.15.170:0/1173878133 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:04.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.803+0000 7f93218cb640 1 -- 172.21.15.170:0/1173878133 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b8cda5e10 con 0x556b8cef46c0 2024-09-12T17:29:04.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.804+0000 7f93218cb640 1 --2- 172.21.15.170:0/1173878133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556b8cef46c0 0x556b8cfe3750 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f93140460d0 tx=0x7f9314051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccc946cdb16d0273 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:04.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.804+0000 7f920fe07640 1 -- 172.21.15.170:0/1173878133 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93140519d0 con 0x556b8cef46c0 2024-09-12T17:29:04.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.804+0000 7f920fe07640 1 -- 172.21.15.170:0/1173878133 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9314051b70 con 0x556b8cef46c0 2024-09-12T17:29:04.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.804+0000 7f920fe07640 1 -- 172.21.15.170:0/1173878133 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9314051e50 con 0x556b8cef46c0 2024-09-12T17:29:04.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.804+0000 7f9326212800 1 -- 172.21.15.170:0/1173878133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556b8cef46c0 msgr2=0x556b8cfe3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:04.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.804+0000 7f9326212800 1 --2- 172.21.15.170:0/1173878133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556b8cef46c0 0x556b8cfe3750 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f93140460d0 tx=0x7f9314051000 comp rx=0 tx=0).stop 2024-09-12T17:29:04.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.804+0000 7f9326212800 1 -- 172.21.15.170:0/1173878133 shutdown_connections 2024-09-12T17:29:04.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.804+0000 7f9326212800 1 --2- 172.21.15.170:0/1173878133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556b8cef46c0 0x556b8cfe3750 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:04.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.804+0000 7f9326212800 1 -- 172.21.15.170:0/1173878133 >> 172.21.15.170:0/1173878133 conn(0x556b8ceee200 msgr2=0x556b8cfdf0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:04.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.805+0000 7f9326212800 1 -- 172.21.15.170:0/1173878133 shutdown_connections 2024-09-12T17:29:04.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.805+0000 7f9326212800 1 -- 172.21.15.170:0/1173878133 wait complete. 2024-09-12T17:29:04.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.805+0000 7f9326212800 1 Processor -- start 2024-09-12T17:29:04.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.805+0000 7f9326212800 1 -- start start 2024-09-12T17:29:04.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.805+0000 7f9326212800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556b8cef46c0 0x556b8cfeaf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:04.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.805+0000 7f9326212800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556b8cefb070 con 0x556b8cef46c0 2024-09-12T17:29:04.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.805+0000 7f93218cb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556b8cef46c0 0x556b8cfeaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:04.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.805+0000 7f93218cb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556b8cef46c0 0x556b8cfeaf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:36290/0 (socket says 172.21.15.170:36290) 2024-09-12T17:29:04.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.805+0000 7f93218cb640 1 -- 172.21.15.170:0/316890739 learned_addr learned my addr 172.21.15.170:0/316890739 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:04.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.806+0000 7f93218cb640 1 -- 172.21.15.170:0/316890739 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b8cfeb4a0 con 0x556b8cef46c0 2024-09-12T17:29:04.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.806+0000 7f93218cb640 1 --2- 172.21.15.170:0/316890739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556b8cef46c0 0x556b8cfeaf40 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f93140460d0 tx=0x7f9314002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:04.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.806+0000 7f920e604640 1 -- 172.21.15.170:0/316890739 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9314073020 con 0x556b8cef46c0 2024-09-12T17:29:04.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.806+0000 7f920e604640 1 -- 172.21.15.170:0/316890739 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f931406f580 con 0x556b8cef46c0 2024-09-12T17:29:04.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.806+0000 7f9326212800 1 -- 172.21.15.170:0/316890739 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b8cfeb730 con 0x556b8cef46c0 2024-09-12T17:29:04.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.806+0000 7f920e604640 1 -- 172.21.15.170:0/316890739 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f931406f8a0 con 0x556b8cef46c0 2024-09-12T17:29:04.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.806+0000 7f9326212800 1 -- 172.21.15.170:0/316890739 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b8cfec340 con 0x556b8cef46c0 2024-09-12T17:29:04.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.807+0000 7f920e604640 1 -- 172.21.15.170:0/316890739 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f9314076020 con 0x556b8cef46c0 2024-09-12T17:29:04.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.807+0000 7f920e604640 1 --2- 172.21.15.170:0/316890739 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f920803c780 0x7f920803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:04.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.807+0000 7f920e604640 1 -- 172.21.15.170:0/316890739 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f931406b040 con 0x556b8cef46c0 2024-09-12T17:29:04.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.807+0000 7f931bfff640 1 --2- 172.21.15.170:0/316890739 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f920803c780 0x7f920803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:04.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.808+0000 7f9326212800 1 --2- 172.21.15.170:0/316890739 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x556b8cef7050 0x556b8cff2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:04.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.808+0000 7f9326212800 1 -- 172.21.15.170:0/316890739 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b8cff2ad0 con 0x556b8cef7050 2024-09-12T17:29:04.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.808+0000 7f93220cc640 1 --2- 172.21.15.170:0/316890739 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x556b8cef7050 0x556b8cff2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:04.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.808+0000 7f931bfff640 1 --2- 172.21.15.170:0/316890739 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f920803c780 0x7f920803ec40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f930c001e30 tx=0x7f930c001390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:04.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.808+0000 7f93220cc640 1 --2- 172.21.15.170:0/316890739 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x556b8cef7050 0x556b8cff2590 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:04.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.808+0000 7f93220cc640 1 -- 172.21.15.170:0/316890739 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f931c00a4d0 con 0x556b8cef7050 2024-09-12T17:29:04.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.808+0000 7f9326212800 1 -- 172.21.15.170:0/316890739 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b8cff2e70 con 0x556b8cef7050 2024-09-12T17:29:04.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.809+0000 7f93220cc640 1 -- 172.21.15.170:0/316890739 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f931c00a4d0 con 0x556b8cef7050 2024-09-12T17:29:04.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.809+0000 7f9326212800 1 --2- 172.21.15.170:0/316890739 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556b8cff4970 0x556b8cff6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:04.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.809+0000 7f9326212800 1 -- 172.21.15.170:0/316890739 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b8cff75a0 con 0x556b8cff4970 2024-09-12T17:29:04.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.809+0000 7f93218cb640 1 --2- 172.21.15.170:0/316890739 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556b8cff4970 0x556b8cff6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:04.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.809+0000 7f93218cb640 1 --2- 172.21.15.170:0/316890739 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556b8cff4970 0x556b8cff6e10 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:04.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.809+0000 7f93218cb640 1 -- 172.21.15.170:0/316890739 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9314057030 con 0x556b8cff4970 2024-09-12T17:29:04.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.809+0000 7f9326212800 1 -- 172.21.15.170:0/316890739 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b8cff36c0 con 0x556b8cef7050 2024-09-12T17:29:04.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.810+0000 7f93220cc640 1 -- 172.21.15.170:0/316890739 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f931c00a4d0 con 0x556b8cef7050 2024-09-12T17:29:04.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.810+0000 7f9326212800 1 -- 172.21.15.170:0/316890739 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b8cff3b20 con 0x556b8cff4970 2024-09-12T17:29:04.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.810+0000 7f93218cb640 1 -- 172.21.15.170:0/316890739 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9314057030 con 0x556b8cff4970 2024-09-12T17:29:04.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.810+0000 7f9326212800 1 Processor -- start 2024-09-12T17:29:04.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.811+0000 7f9326212800 1 -- start start 2024-09-12T17:29:04.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.811+0000 7f9326212800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556b8cef3e60 0x556b8cef26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:04.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.811+0000 7f9326212800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556b8cdeaa00 con 0x556b8cef3e60 2024-09-12T17:29:04.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.811+0000 7f93220cc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556b8cef3e60 0x556b8cef26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:04.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.811+0000 7f93220cc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556b8cef3e60 0x556b8cef26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:36302/0 (socket says 172.21.15.170:36302) 2024-09-12T17:29:04.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.811+0000 7f93220cc640 1 -- 172.21.15.170:0/1355188111 learned_addr learned my addr 172.21.15.170:0/1355188111 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:04.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.811+0000 7f93220cc640 1 -- 172.21.15.170:0/1355188111 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b8cef4380 con 0x556b8cef3e60 2024-09-12T17:29:04.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.812+0000 7f93220cc640 1 --2- 172.21.15.170:0/1355188111 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556b8cef3e60 0x556b8cef26d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x556b8cfebf40 tx=0x7f931c0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:04.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.812+0000 7f92077fe640 1 -- 172.21.15.170:0/1355188111 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f931c013640 con 0x556b8cef3e60 2024-09-12T17:29:04.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.812+0000 7f92077fe640 1 -- 172.21.15.170:0/1355188111 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f931c0137e0 con 0x556b8cef3e60 2024-09-12T17:29:04.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.812+0000 7f92077fe640 1 -- 172.21.15.170:0/1355188111 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f931c013b00 con 0x556b8cef3e60 2024-09-12T17:29:04.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.812+0000 7f9326212800 1 -- 172.21.15.170:0/1355188111 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b8cef2c10 con 0x556b8cef3e60 2024-09-12T17:29:04.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.812+0000 7f9326212800 1 -- 172.21.15.170:0/1355188111 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b8cef3160 con 0x556b8cef3e60 2024-09-12T17:29:04.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.813+0000 7f92077fe640 1 -- 172.21.15.170:0/1355188111 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f931c011040 con 0x556b8cef3e60 2024-09-12T17:29:04.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.813+0000 7f92077fe640 1 --2- 172.21.15.170:0/1355188111 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f91fc03c780 0x7f91fc03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:04.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.813+0000 7f92077fe640 1 -- 172.21.15.170:0/1355188111 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f931c00e040 con 0x556b8cef3e60 2024-09-12T17:29:04.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.813+0000 7f93218cb640 1 --2- 172.21.15.170:0/1355188111 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f91fc03c780 0x7f91fc03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:04.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.813+0000 7f9326212800 1 Processor -- start 2024-09-12T17:29:04.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.813+0000 7f9326212800 1 -- start start 2024-09-12T17:29:04.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.813+0000 7f93218cb640 1 --2- 172.21.15.170:0/1355188111 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f91fc03c780 0x7f91fc03ec40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x556b8cff7940 tx=0x7f931405adc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:04.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.814+0000 7f9326212800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556b8d014ad0 0x556b8d014ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:04.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.814+0000 7f9326212800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556b8cfe3ee0 con 0x556b8d014ad0 2024-09-12T17:29:04.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.814+0000 7f93220cc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556b8d014ad0 0x556b8d014ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:04.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.814+0000 7f93220cc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556b8d014ad0 0x556b8d014ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:36304/0 (socket says 172.21.15.170:36304) 2024-09-12T17:29:04.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.814+0000 7f93220cc640 1 -- 172.21.15.170:0/2056851677 learned_addr learned my addr 172.21.15.170:0/2056851677 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:04.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.814+0000 7f93220cc640 1 -- 172.21.15.170:0/2056851677 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b8d0154c0 con 0x556b8d014ad0 2024-09-12T17:29:04.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.814+0000 7f93220cc640 1 --2- 172.21.15.170:0/2056851677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556b8d014ad0 0x556b8d014ed0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f931c00afe0 tx=0x7f931c020f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ce6d3df39255ee0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:04.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.814+0000 7f92057fa640 1 -- 172.21.15.170:0/2056851677 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f931c052020 con 0x556b8d014ad0 2024-09-12T17:29:04.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.814+0000 7f92057fa640 1 -- 172.21.15.170:0/2056851677 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f931c04d080 con 0x556b8d014ad0 2024-09-12T17:29:04.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.814+0000 7f92057fa640 1 -- 172.21.15.170:0/2056851677 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f931c055040 con 0x556b8d014ad0 2024-09-12T17:29:04.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.815+0000 7f9326212800 1 -- 172.21.15.170:0/2056851677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556b8d014ad0 msgr2=0x556b8d014ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:04.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.815+0000 7f9326212800 1 --2- 172.21.15.170:0/2056851677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556b8d014ad0 0x556b8d014ed0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f931c00afe0 tx=0x7f931c020f00 comp rx=0 tx=0).stop 2024-09-12T17:29:04.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.815+0000 7f9326212800 1 -- 172.21.15.170:0/2056851677 shutdown_connections 2024-09-12T17:29:04.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.815+0000 7f9326212800 1 --2- 172.21.15.170:0/2056851677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556b8d014ad0 0x556b8d014ed0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:04.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.815+0000 7f9326212800 1 -- 172.21.15.170:0/2056851677 >> 172.21.15.170:0/2056851677 conn(0x556b8d010ed0 msgr2=0x556b8d00f110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:04.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.815+0000 7f9326212800 1 -- 172.21.15.170:0/2056851677 shutdown_connections 2024-09-12T17:29:04.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.815+0000 7f9326212800 1 -- 172.21.15.170:0/2056851677 wait complete. 2024-09-12T17:29:04.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.815+0000 7f9326212800 1 Processor -- start 2024-09-12T17:29:04.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.815+0000 7f9326212800 1 -- start start 2024-09-12T17:29:04.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.815+0000 7f9326212800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556b8d014ad0 0x556b8d01c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:04.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.816+0000 7f9326212800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556b8d015ae0 con 0x556b8d014ad0 2024-09-12T17:29:04.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.816+0000 7f93220cc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556b8d014ad0 0x556b8d01c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:04.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.816+0000 7f93220cc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556b8d014ad0 0x556b8d01c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:36314/0 (socket says 172.21.15.170:36314) 2024-09-12T17:29:04.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.816+0000 7f93220cc640 1 -- 172.21.15.170:0/3161782020 learned_addr learned my addr 172.21.15.170:0/3161782020 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:04.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.816+0000 7f93220cc640 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b8d01c660 con 0x556b8d014ad0 2024-09-12T17:29:04.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.816+0000 7f93220cc640 1 --2- 172.21.15.170:0/3161782020 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556b8d014ad0 0x556b8d01c100 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f931c020f40 tx=0x7f931c053cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:04.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.816+0000 7f91f37fe640 1 -- 172.21.15.170:0/3161782020 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f931c055040 con 0x556b8d014ad0 2024-09-12T17:29:04.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.816+0000 7f91f37fe640 1 -- 172.21.15.170:0/3161782020 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f931c055730 con 0x556b8d014ad0 2024-09-12T17:29:04.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.816+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b8d01c8f0 con 0x556b8d014ad0 2024-09-12T17:29:04.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.816+0000 7f91f37fe640 1 -- 172.21.15.170:0/3161782020 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f931c02a520 con 0x556b8d014ad0 2024-09-12T17:29:04.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.817+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b8d01d270 con 0x556b8d014ad0 2024-09-12T17:29:04.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.818+0000 7f91f37fe640 1 -- 172.21.15.170:0/3161782020 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f931c03b060 con 0x556b8d014ad0 2024-09-12T17:29:04.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.818+0000 7f91f37fe640 1 --2- 172.21.15.170:0/3161782020 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f91ec03c780 0x7f91ec03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:04.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.818+0000 7f91f37fe640 1 -- 172.21.15.170:0/3161782020 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f931c035ba0 con 0x556b8d014ad0 2024-09-12T17:29:04.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.818+0000 7f93218cb640 1 --2- 172.21.15.170:0/3161782020 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f91ec03c780 0x7f91ec03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:04.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.818+0000 7f93218cb640 1 --2- 172.21.15.170:0/3161782020 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f91ec03c780 0x7f91ec03ec40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f93140514a0 tx=0x7f9314084000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:04.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.818+0000 7f9326212800 20 rados->read ofs=0 len=0 2024-09-12T17:29:04.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.818+0000 7f9326212800 1 --2- 172.21.15.170:0/3161782020 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x556b8d027a70 0x556b8d029f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:04.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.818+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b8d02a680 con 0x556b8d027a70 2024-09-12T17:29:04.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.819+0000 7f931bfff640 1 --2- 172.21.15.170:0/3161782020 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x556b8d027a70 0x556b8d029f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:04.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.819+0000 7f931bfff640 1 --2- 172.21.15.170:0/3161782020 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x556b8d027a70 0x556b8d029f30 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:04.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.819+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f930c00f610 con 0x556b8d027a70 2024-09-12T17:29:04.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.819+0000 7f9326212800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:04.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.819+0000 7f9326212800 20 realm 2024-09-12T17:29:04.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.819+0000 7f9326212800 20 rados->read ofs=0 len=0 2024-09-12T17:29:04.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.819+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b8d026dc0 con 0x556b8d027a70 2024-09-12T17:29:04.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.819+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f930c00f610 con 0x556b8d027a70 2024-09-12T17:29:04.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.819+0000 7f9326212800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:04.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.819+0000 7f9326212800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:29:04.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.819+0000 7f9326212800 20 rados->read ofs=0 len=0 2024-09-12T17:29:04.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.819+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b8d02b170 con 0x556b8d027a70 2024-09-12T17:29:04.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.820+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f930c00f610 con 0x556b8d027a70 2024-09-12T17:29:04.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.820+0000 7f9326212800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:04.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.820+0000 7f9326212800 20 rados->read ofs=0 len=0 2024-09-12T17:29:04.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.820+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b8d02ba40 con 0x556b8d027a70 2024-09-12T17:29:04.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.820+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f930c00f610 con 0x556b8d027a70 2024-09-12T17:29:04.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.820+0000 7f9326212800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:04.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.820+0000 7f9326212800 20 rados->read ofs=0 len=0 2024-09-12T17:29:04.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.820+0000 7f9326212800 1 --2- 172.21.15.170:0/3161782020 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556b8d02c460 0x556b8d02e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:04.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.820+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b8d02ef90 con 0x556b8d02c460 2024-09-12T17:29:04.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.820+0000 7f93220cc640 1 --2- 172.21.15.170:0/3161782020 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556b8d02c460 0x556b8d02e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:04.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.820+0000 7f93220cc640 1 --2- 172.21.15.170:0/3161782020 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556b8d02c460 0x556b8d02e850 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:04.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.821+0000 7f93220cc640 1 -- 172.21.15.170:0/3161782020 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f931c03dd70 con 0x556b8d02c460 2024-09-12T17:29:04.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.821+0000 7f9326212800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:29:04.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.821+0000 7f9326212800 20 searching for the correct realm 2024-09-12T17:29:04.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.821+0000 7f9326212800 1 --2- 172.21.15.170:0/3161782020 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x556b8d030f40 0x556b8d033400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:04.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.821+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b8d033a80 con 0x556b8d030f40 2024-09-12T17:29:04.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.821+0000 7f93218cb640 1 --2- 172.21.15.170:0/3161782020 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x556b8d030f40 0x556b8d033400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:04.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.821+0000 7f93218cb640 1 --2- 172.21.15.170:0/3161782020 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x556b8d030f40 0x556b8d033400 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:04.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.821+0000 7f93218cb640 1 -- 172.21.15.170:0/3161782020 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9314057030 con 0x556b8d030f40 2024-09-12T17:29:04.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.821+0000 7f93218cb640 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b8d033a80 con 0x556b8d02c460 2024-09-12T17:29:04.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.822+0000 7f93220cc640 1 -- 172.21.15.170:0/3161782020 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f931c03dd70 con 0x556b8d02c460 2024-09-12T17:29:04.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.822+0000 7f93220cc640 1 --2- 172.21.15.170:0/3161782020 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f931c03d070 0x7f931c02ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:04.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.822+0000 7f93220cc640 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b8d033a80 con 0x7f931c03d070 2024-09-12T17:29:04.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.822+0000 7f931bfff640 1 --2- 172.21.15.170:0/3161782020 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f931c03d070 0x7f931c02ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:04.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.822+0000 7f931bfff640 1 --2- 172.21.15.170:0/3161782020 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f931c03d070 0x7f931c02ca70 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:04.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.823+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f930c00f610 con 0x7f931c03d070 2024-09-12T17:29:04.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.823+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b8d033a80 con 0x556b8d027a70 2024-09-12T17:29:04.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.823+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f930c00f610 con 0x556b8d027a70 2024-09-12T17:29:04.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.823+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b8d033a80 con 0x556b8d027a70 2024-09-12T17:29:04.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.823+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f930c02b040 con 0x556b8d027a70 2024-09-12T17:29:04.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.823+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b8d033a80 con 0x7f931c03d070 2024-09-12T17:29:04.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.823+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f930c02b040 con 0x7f931c03d070 2024-09-12T17:29:04.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.823+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b8d033a80 con 0x7f931c03d070 2024-09-12T17:29:04.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.824+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f930c02b040 con 0x7f931c03d070 2024-09-12T17:29:04.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.824+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b8d033a80 con 0x556b8d02c460 2024-09-12T17:29:04.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.824+0000 7f93220cc640 1 -- 172.21.15.170:0/3161782020 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f931c03dd70 con 0x556b8d02c460 2024-09-12T17:29:04.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.824+0000 7f93220cc640 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b8d033a80 con 0x556b8d030f40 2024-09-12T17:29:04.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.824+0000 7f93218cb640 1 -- 172.21.15.170:0/3161782020 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9314057030 con 0x556b8d030f40 2024-09-12T17:29:04.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.824+0000 7f93218cb640 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b8d033a80 con 0x556b8d027a70 2024-09-12T17:29:04.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.824+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f930c02b040 con 0x556b8d027a70 2024-09-12T17:29:04.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.824+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b8d033a80 con 0x7f931c03d070 2024-09-12T17:29:04.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.825+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f930c02b040 con 0x7f931c03d070 2024-09-12T17:29:04.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.825+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b8d033a80 con 0x556b8d027a70 2024-09-12T17:29:04.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.825+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f930c02b040 con 0x556b8d027a70 2024-09-12T17:29:04.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.825+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b8d033a80 con 0x556b8d02c460 2024-09-12T17:29:04.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.825+0000 7f93220cc640 1 -- 172.21.15.170:0/3161782020 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f931c03dd70 con 0x556b8d02c460 2024-09-12T17:29:04.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.825+0000 7f93220cc640 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b8d033a80 con 0x556b8d030f40 2024-09-12T17:29:04.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.825+0000 7f93218cb640 1 -- 172.21.15.170:0/3161782020 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9314057030 con 0x556b8d030f40 2024-09-12T17:29:04.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.826+0000 7f93218cb640 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b8d033a80 con 0x556b8d030f40 2024-09-12T17:29:04.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.826+0000 7f93218cb640 1 -- 172.21.15.170:0/3161782020 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9314057030 con 0x556b8d030f40 2024-09-12T17:29:04.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.826+0000 7f93218cb640 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b8d033a80 con 0x556b8d02c460 2024-09-12T17:29:04.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.826+0000 7f93220cc640 1 -- 172.21.15.170:0/3161782020 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f931c062040 con 0x556b8d02c460 2024-09-12T17:29:04.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.826+0000 7f93220cc640 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b8d033a80 con 0x556b8d030f40 2024-09-12T17:29:04.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.826+0000 7f93218cb640 1 -- 172.21.15.170:0/3161782020 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9314057030 con 0x556b8d030f40 2024-09-12T17:29:04.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.826+0000 7f93218cb640 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b8d033a80 con 0x556b8d030f40 2024-09-12T17:29:04.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.826+0000 7f93218cb640 1 -- 172.21.15.170:0/3161782020 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9314057030 con 0x556b8d030f40 2024-09-12T17:29:04.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.826+0000 7f93218cb640 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b8d033a80 con 0x556b8d027a70 2024-09-12T17:29:04.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.827+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f930c02b040 con 0x556b8d027a70 2024-09-12T17:29:04.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.827+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b8d033a80 con 0x556b8d027a70 2024-09-12T17:29:04.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.827+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f930c02b040 con 0x556b8d027a70 2024-09-12T17:29:04.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.827+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b8d033a80 con 0x7f931c03d070 2024-09-12T17:29:04.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.827+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f930c02b040 con 0x7f931c03d070 2024-09-12T17:29:04.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.827+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b8d033a80 con 0x556b8d030f40 2024-09-12T17:29:04.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.828+0000 7f93218cb640 1 -- 172.21.15.170:0/3161782020 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9314057030 con 0x556b8d030f40 2024-09-12T17:29:04.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.828+0000 7f93218cb640 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b8d033a80 con 0x556b8d02c460 2024-09-12T17:29:04.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.828+0000 7f93220cc640 1 -- 172.21.15.170:0/3161782020 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f931c062040 con 0x556b8d02c460 2024-09-12T17:29:04.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.828+0000 7f93220cc640 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b8d033a80 con 0x556b8d027a70 2024-09-12T17:29:04.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.828+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f930c02b040 con 0x556b8d027a70 2024-09-12T17:29:04.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.828+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b8d033a80 con 0x7f931c03d070 2024-09-12T17:29:04.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.828+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f930c02b040 con 0x7f931c03d070 2024-09-12T17:29:04.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.828+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b8d033a80 con 0x556b8d030f40 2024-09-12T17:29:04.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.829+0000 7f93218cb640 1 -- 172.21.15.170:0/3161782020 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9314057030 con 0x556b8d030f40 2024-09-12T17:29:04.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.829+0000 7f93218cb640 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b8d033a80 con 0x7f931c03d070 2024-09-12T17:29:04.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.829+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f930c02b040 con 0x7f931c03d070 2024-09-12T17:29:04.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.829+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b8d033a80 con 0x556b8d02c460 2024-09-12T17:29:04.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.829+0000 7f93220cc640 1 -- 172.21.15.170:0/3161782020 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f931c062040 con 0x556b8d02c460 2024-09-12T17:29:04.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.829+0000 7f93220cc640 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b8d033a80 con 0x556b8d030f40 2024-09-12T17:29:04.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.829+0000 7f93218cb640 1 -- 172.21.15.170:0/3161782020 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9314057030 con 0x556b8d030f40 2024-09-12T17:29:04.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.829+0000 7f93218cb640 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b8d033a80 con 0x7f931c03d070 2024-09-12T17:29:04.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.830+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f930c02b040 con 0x7f931c03d070 2024-09-12T17:29:04.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.830+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b8d033a80 con 0x556b8d027a70 2024-09-12T17:29:04.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.830+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f930c02b040 con 0x556b8d027a70 2024-09-12T17:29:04.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.830+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b8d033a80 con 0x556b8d02c460 2024-09-12T17:29:04.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.830+0000 7f93220cc640 1 -- 172.21.15.170:0/3161782020 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(37 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f931c062040 con 0x556b8d02c460 2024-09-12T17:29:04.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.830+0000 7f9326212800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:29:04.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.830+0000 7f9326212800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:29:04.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.830+0000 7f9326212800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:29:04.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.830+0000 7f9326212800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:29:04.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.830+0000 7f9326212800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:29:04.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.830+0000 7f9326212800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:29:04.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.830+0000 7f9326212800 20 rados->read ofs=0 len=0 2024-09-12T17:29:04.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.830+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b8d02f950 con 0x556b8d027a70 2024-09-12T17:29:04.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.831+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f930c02b040 con 0x556b8d027a70 2024-09-12T17:29:04.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.831+0000 7f9326212800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:04.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.831+0000 7f9326212800 20 rados->read ofs=0 len=0 2024-09-12T17:29:04.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.831+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b8d0301f0 con 0x556b8d027a70 2024-09-12T17:29:04.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.831+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f930c03b040 con 0x556b8d027a70 2024-09-12T17:29:04.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.831+0000 7f9326212800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:04.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.831+0000 7f9326212800 20 rados->read ofs=0 len=0 2024-09-12T17:29:04.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.831+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b8d02f590 con 0x556b8d02c460 2024-09-12T17:29:04.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.831+0000 7f93220cc640 1 -- 172.21.15.170:0/3161782020 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f931c062040 con 0x556b8d02c460 2024-09-12T17:29:04.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.831+0000 7f9326212800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:29:04.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.831+0000 7f9326212800 20 zone default found 2024-09-12T17:29:04.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.831+0000 7f9326212800 4 Realm: () 2024-09-12T17:29:04.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.831+0000 7f9326212800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:29:04.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.831+0000 7f9326212800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:29:04.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.831+0000 7f9326212800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:29:04.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.831+0000 7f9326212800 20 zonegroup default 2024-09-12T17:29:04.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.831+0000 7f9326212800 20 rados->read ofs=0 len=0 2024-09-12T17:29:04.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.831+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b8d0343b0 con 0x7f931c03d070 2024-09-12T17:29:04.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.832+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f930c03b040 con 0x7f931c03d070 2024-09-12T17:29:04.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.832+0000 7f9326212800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:04.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.832+0000 7f9326212800 20 rados->read ofs=0 len=0 2024-09-12T17:29:04.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.832+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b8d0365f0 con 0x556b8d030f40 2024-09-12T17:29:04.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.832+0000 7f93218cb640 1 -- 172.21.15.170:0/3161782020 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9314057030 con 0x556b8d030f40 2024-09-12T17:29:04.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.832+0000 7f9326212800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:04.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.832+0000 7f9326212800 20 rados->read ofs=0 len=0 2024-09-12T17:29:04.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.832+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b8d036990 con 0x556b8d030f40 2024-09-12T17:29:04.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.832+0000 7f93218cb640 1 -- 172.21.15.170:0/3161782020 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9314057030 con 0x556b8d030f40 2024-09-12T17:29:04.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.832+0000 7f9326212800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:04.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.832+0000 7f9326212800 20 started sync module instance, tier type = 2024-09-12T17:29:04.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.832+0000 7f9326212800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:29:04.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.832+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b8d035a80 con 0x556b8d02c460 2024-09-12T17:29:04.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.834+0000 7f93220cc640 1 -- 172.21.15.170:0/3161782020 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(44 notify.0 [create] v31'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f931c062040 con 0x556b8d02c460 2024-09-12T17:29:04.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.834+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93920415669872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b8d0356e0 con 0x556b8d02c460 2024-09-12T17:29:04.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.834+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b8d037850 con 0x556b8d027a70 2024-09-12T17:29:04.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.835+0000 7f93220cc640 1 -- 172.21.15.170:0/3161782020 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93920415669872] v31'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f931c062040 con 0x556b8d02c460 2024-09-12T17:29:04.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.835+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v31'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f930c03b040 con 0x556b8d027a70 2024-09-12T17:29:04.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.835+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93920415673728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b8d037850 con 0x556b8d027a70 2024-09-12T17:29:04.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.835+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b8d0382a0 con 0x556b8d030f40 2024-09-12T17:29:04.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.836+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93920415673728] v31'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f930c03b040 con 0x556b8d027a70 2024-09-12T17:29:04.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.836+0000 7f93218cb640 1 -- 172.21.15.170:0/3161782020 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v31'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9314057030 con 0x556b8d030f40 2024-09-12T17:29:04.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.836+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93920415675296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b8d0377c0 con 0x556b8d030f40 2024-09-12T17:29:04.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.836+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b8d039190 con 0x556b8d02c460 2024-09-12T17:29:04.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.837+0000 7f93220cc640 1 -- 172.21.15.170:0/3161782020 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(50 notify.3 [create] v31'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f931c062040 con 0x556b8d02c460 2024-09-12T17:29:04.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.838+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93920415682272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b8d039990 con 0x556b8d02c460 2024-09-12T17:29:04.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.838+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b8d03a4b0 con 0x556b8d027a70 2024-09-12T17:29:04.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.838+0000 7f93218cb640 1 -- 172.21.15.170:0/3161782020 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93920415675296] v31'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9314057030 con 0x556b8d030f40 2024-09-12T17:29:04.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.839+0000 7f93220cc640 1 -- 172.21.15.170:0/3161782020 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93920415682272] v31'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f931c062040 con 0x556b8d02c460 2024-09-12T17:29:04.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.839+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v31'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f930c03b040 con 0x556b8d027a70 2024-09-12T17:29:04.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.839+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93920415686528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b8d03a470 con 0x556b8d027a70 2024-09-12T17:29:04.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.839+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b8d03ad50 con 0x7f931c03d070 2024-09-12T17:29:04.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.840+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93920415686528] v31'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f930c03b040 con 0x556b8d027a70 2024-09-12T17:29:04.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.840+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(54 notify.5 [create] v31'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f930c03b040 con 0x7f931c03d070 2024-09-12T17:29:04.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.840+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93920415680192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b8d03a920 con 0x7f931c03d070 2024-09-12T17:29:04.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.840+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b8d03b360 con 0x7f931c03d070 2024-09-12T17:29:04.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.841+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93920415680192] v31'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f930c03b040 con 0x7f931c03d070 2024-09-12T17:29:04.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.841+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v31'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f930c03b040 con 0x7f931c03d070 2024-09-12T17:29:04.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.841+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93920415690288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b8d03b540 con 0x7f931c03d070 2024-09-12T17:29:04.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.841+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b8d03bd90 con 0x7f931c03d070 2024-09-12T17:29:04.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.843+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(58 notify.7 [create] v31'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f930c03b040 con 0x7f931c03d070 2024-09-12T17:29:04.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.843+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93920415690288] v31'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f930c03b040 con 0x7f931c03d070 2024-09-12T17:29:04.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.843+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93920415692656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b8d03a570 con 0x7f931c03d070 2024-09-12T17:29:04.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.843+0000 7f9326212800 20 add_watcher() i=0 2024-09-12T17:29:04.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.843+0000 7f9326212800 20 add_watcher() i=1 2024-09-12T17:29:04.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.843+0000 7f9326212800 20 add_watcher() i=2 2024-09-12T17:29:04.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.843+0000 7f9326212800 20 add_watcher() i=3 2024-09-12T17:29:04.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.843+0000 7f9326212800 20 add_watcher() i=4 2024-09-12T17:29:04.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.843+0000 7f9326212800 20 add_watcher() i=5 2024-09-12T17:29:04.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.843+0000 7f9326212800 20 add_watcher() i=6 2024-09-12T17:29:04.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.844+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93920415692656] v31'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f930c03b040 con 0x7f931c03d070 2024-09-12T17:29:04.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.844+0000 7f9326212800 20 add_watcher() i=7 2024-09-12T17:29:04.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.844+0000 7f9326212800 2 all 8 watchers are set, enabling cache 2024-09-12T17:29:04.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.844+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b8d03f670 con 0x556b8d027a70 2024-09-12T17:29:04.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.844+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f930c03b040 con 0x556b8d027a70 2024-09-12T17:29:04.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.844+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93920415695248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b8d03ca60 con 0x556b8d027a70 2024-09-12T17:29:04.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.845+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93920415695248] v31'215 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f930c03b040 con 0x556b8d027a70 2024-09-12T17:29:04.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.845+0000 7f91d3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:04.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.845+0000 7f9326212800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:29:04.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.845+0000 7f9326212800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:29:04.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.845+0000 7f9326212800 5 note: GC not initialized 2024-09-12T17:29:04.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.846+0000 7f91d2ffd640 20 reqs_thread_entry: start 2024-09-12T17:29:04.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.846+0000 7f9326212800 20 init_complete bucket index max shards: 11 2024-09-12T17:29:04.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.846+0000 7f9326212800 20 Filter name: none 2024-09-12T17:29:04.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.846+0000 7f91d0ff9640 20 reqs_thread_entry: start 2024-09-12T17:29:04.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.846+0000 7f9326212800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-12T17:29:04.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.846+0000 7f9326212800 20 rados->read ofs=0 len=0 2024-09-12T17:29:04.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.846+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b8d072630 con 0x7f931c03d070 2024-09-12T17:29:04.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.846+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f930c03b040 con 0x7f931c03d070 2024-09-12T17:29:04.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.846+0000 7f9326212800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:04.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.846+0000 7f9326212800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-12T17:29:04.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.846+0000 7f9326212800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T17:29:04.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.846+0000 7f9326212800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-12T17:29:04.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.846+0000 7f9326212800 20 rados->read ofs=0 len=0 2024-09-12T17:29:04.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.846+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b8d070cd0 con 0x7f931c03d070 2024-09-12T17:29:04.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.847+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f930c03b040 con 0x7f931c03d070 2024-09-12T17:29:04.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.847+0000 7f9326212800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:04.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.847+0000 7f9326212800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-12T17:29:04.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.847+0000 7f9326212800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T17:29:04.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.847+0000 7f9326212800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-12T17:29:04.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.847+0000 7f9326212800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-12T17:29:04.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.847+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b8d0715a0 con 0x7f931c03d070 2024-09-12T17:29:04.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.848+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v31'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f930c03b040 con 0x7f931c03d070 2024-09-12T17:29:04.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.848+0000 7f9326212800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-12T17:29:04.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.848+0000 7f9326212800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T17:29:04.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.848+0000 7f9326212800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-12T17:29:04.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.848+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 93920415912176 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b8d075f70 con 0x7f931c03d070 2024-09-12T17:29:04.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.848+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== watch-notify(notify (1) cookie 93920415680192 notify 133143986213 ret 0) ==== 598+0+0 (crc 0 0 0) 0x556b8d071940 con 0x7f931c03d070 2024-09-12T17:29:04.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.848+0000 7f92057fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986213 cookie 93920415680192 notifier 4736 bl.length()=556 2024-09-12T17:29:04.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.848+0000 7f92057fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-12T17:29:04.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.848+0000 7f92057fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T17:29:04.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.848+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(65 notify.5 [notify cookie 93920415912176 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f930c03b040 con 0x7f931c03d070 2024-09-12T17:29:04.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.848+0000 7f92057fa640 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f91e4003ea0 con 0x7f931c03d070 2024-09-12T17:29:04.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.849+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f930c03b040 con 0x7f931c03d070 2024-09-12T17:29:04.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.849+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.0 v2:172.21.15.47:6800/3978157098 22 ==== watch-notify(notify_complete (2) cookie 93920415912176 notify 133143986213 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556b8d071f80 con 0x7f931c03d070 2024-09-12T17:29:04.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.849+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b8d073aa0 con 0x7f931c03d070 2024-09-12T17:29:04.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.850+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.0 v2:172.21.15.47:6800/3978157098 23 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v31'9 uv9 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f930c03b040 con 0x7f931c03d070 2024-09-12T17:29:04.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.850+0000 7f9326212800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-12T17:29:04.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.850+0000 7f9326212800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T17:29:04.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.850+0000 7f9326212800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-12T17:29:04.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.850+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93920415912096 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b8d075f70 con 0x556b8d030f40 2024-09-12T17:29:04.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.851+0000 7f93218cb640 1 -- 172.21.15.170:0/3161782020 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== watch-notify(notify (1) cookie 93920415675296 notify 133143986191 ret 0) ==== 219+0+0 (crc 0 0 0) 0x556b8cfec340 con 0x556b8d030f40 2024-09-12T17:29:04.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.851+0000 7f92057fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986191 cookie 93920415675296 notifier 4736 bl.length()=177 2024-09-12T17:29:04.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.851+0000 7f92057fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-12T17:29:04.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.851+0000 7f92057fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T17:29:04.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.851+0000 7f93218cb640 1 -- 172.21.15.170:0/3161782020 <== osd.3 v2:172.21.15.170:6816/2664906588 15 ==== osd_op_reply(68 notify.2 [notify cookie 93920415912096 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9314057030 con 0x556b8d030f40 2024-09-12T17:29:04.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.851+0000 7f92057fa640 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f91e4003ea0 con 0x556b8d030f40 2024-09-12T17:29:04.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.851+0000 7f93218cb640 1 -- 172.21.15.170:0/3161782020 <== osd.3 v2:172.21.15.170:6816/2664906588 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9314057030 con 0x556b8d030f40 2024-09-12T17:29:04.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.851+0000 7f93218cb640 1 -- 172.21.15.170:0/3161782020 <== osd.3 v2:172.21.15.170:6816/2664906588 17 ==== watch-notify(notify_complete (2) cookie 93920415912096 notify 133143986191 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556b8cfeb730 con 0x556b8d030f40 2024-09-12T17:29:04.867 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-12T17:29:04.847985Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:29:04.847975Z","tags":[],"group_ids":[]} 2024-09-12T17:29:04.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.852+0000 7f91d3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:04.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.852+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93920415695248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b8d070400 con 0x556b8d027a70 2024-09-12T17:29:04.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.853+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93920415695248] v31'216 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f930c03b040 con 0x556b8d027a70 2024-09-12T17:29:04.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.853+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93920415669872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b8d070400 con 0x556b8d02c460 2024-09-12T17:29:04.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.854+0000 7f93220cc640 1 -- 172.21.15.170:0/3161782020 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93920415669872] v31'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f931c062040 con 0x556b8d02c460 2024-09-12T17:29:04.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.854+0000 7f9326212800 20 remove_watcher() i=0 2024-09-12T17:29:04.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.854+0000 7f9326212800 2 removed watcher, disabling cache 2024-09-12T17:29:04.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.854+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93920415673728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b8d070400 con 0x556b8d027a70 2024-09-12T17:29:04.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.855+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93920415673728] v31'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f930c03b040 con 0x556b8d027a70 2024-09-12T17:29:04.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.855+0000 7f9326212800 20 remove_watcher() i=1 2024-09-12T17:29:04.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.855+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93920415675296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b8d070400 con 0x556b8d030f40 2024-09-12T17:29:04.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.856+0000 7f93218cb640 1 -- 172.21.15.170:0/3161782020 <== osd.3 v2:172.21.15.170:6816/2664906588 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93920415675296] v31'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9314057030 con 0x556b8d030f40 2024-09-12T17:29:04.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.856+0000 7f9326212800 20 remove_watcher() i=2 2024-09-12T17:29:04.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.856+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93920415682272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b8d070400 con 0x556b8d02c460 2024-09-12T17:29:04.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.857+0000 7f93220cc640 1 -- 172.21.15.170:0/3161782020 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93920415682272] v31'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f931c062040 con 0x556b8d02c460 2024-09-12T17:29:04.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.857+0000 7f9326212800 20 remove_watcher() i=3 2024-09-12T17:29:04.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.857+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93920415686528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b8d070400 con 0x556b8d027a70 2024-09-12T17:29:04.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.858+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93920415686528] v31'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f930c03b040 con 0x556b8d027a70 2024-09-12T17:29:04.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.858+0000 7f9326212800 20 remove_watcher() i=4 2024-09-12T17:29:04.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.858+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93920415680192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b8d070400 con 0x7f931c03d070 2024-09-12T17:29:04.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.860+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.0 v2:172.21.15.47:6800/3978157098 24 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93920415680192] v31'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f930c03b040 con 0x7f931c03d070 2024-09-12T17:29:04.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.860+0000 7f9326212800 20 remove_watcher() i=5 2024-09-12T17:29:04.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.860+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93920415690288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b8d070400 con 0x7f931c03d070 2024-09-12T17:29:04.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.861+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.0 v2:172.21.15.47:6800/3978157098 25 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93920415690288] v31'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f930c03b040 con 0x7f931c03d070 2024-09-12T17:29:04.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.861+0000 7f9326212800 20 remove_watcher() i=6 2024-09-12T17:29:04.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.861+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93920415692656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b8d070400 con 0x7f931c03d070 2024-09-12T17:29:04.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.862+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 <== osd.0 v2:172.21.15.47:6800/3978157098 26 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93920415692656] v31'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f930c03b040 con 0x7f931c03d070 2024-09-12T17:29:04.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.862+0000 7f9326212800 20 remove_watcher() i=7 2024-09-12T17:29:04.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.862+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f931c03d070 msgr2=0x7f931c02ca70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:04.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.862+0000 7f9326212800 1 --2- 172.21.15.170:0/3161782020 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f931c03d070 0x7f931c02ca70 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:04.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.862+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x556b8d027a70 msgr2=0x556b8d029f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:04.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.862+0000 7f9326212800 1 --2- 172.21.15.170:0/3161782020 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x556b8d027a70 0x556b8d029f30 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:04.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.862+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556b8d02c460 msgr2=0x556b8d02e850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:04.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.862+0000 7f9326212800 1 --2- 172.21.15.170:0/3161782020 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556b8d02c460 0x556b8d02e850 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:04.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.862+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x556b8d030f40 msgr2=0x556b8d033400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:04.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.862+0000 7f9326212800 1 --2- 172.21.15.170:0/3161782020 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x556b8d030f40 0x556b8d033400 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:04.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.862+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f91ec03c780 msgr2=0x7f91ec03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:04.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.862+0000 7f9326212800 1 --2- 172.21.15.170:0/3161782020 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f91ec03c780 0x7f91ec03ec40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f93140514a0 tx=0x7f9314084000 comp rx=0 tx=0).stop 2024-09-12T17:29:04.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.862+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556b8d014ad0 msgr2=0x556b8d01c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:04.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.862+0000 7f931bfff640 1 -- 172.21.15.170:0/3161782020 reap_dead start 2024-09-12T17:29:04.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.862+0000 7f9326212800 1 --2- 172.21.15.170:0/3161782020 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556b8d014ad0 0x556b8d01c100 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f931c020f40 tx=0x7f931c053cf0 comp rx=0 tx=0).stop 2024-09-12T17:29:04.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.862+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 shutdown_connections 2024-09-12T17:29:04.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.862+0000 7f9326212800 1 --2- 172.21.15.170:0/3161782020 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556b8d014ad0 0x556b8d01c100 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:04.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.862+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 >> 172.21.15.170:0/3161782020 conn(0x556b8d010ed0 msgr2=0x556b8d00f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:04.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.862+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 shutdown_connections 2024-09-12T17:29:04.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.862+0000 7f9326212800 1 -- 172.21.15.170:0/3161782020 wait complete. 2024-09-12T17:29:04.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.862+0000 7f9326212800 1 -- 172.21.15.170:0/1355188111 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f91fc03c780 msgr2=0x7f91fc03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:04.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.862+0000 7f9326212800 1 --2- 172.21.15.170:0/1355188111 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f91fc03c780 0x7f91fc03ec40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x556b8cff7940 tx=0x7f931405adc0 comp rx=0 tx=0).stop 2024-09-12T17:29:04.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.862+0000 7f9326212800 1 -- 172.21.15.170:0/1355188111 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556b8cef3e60 msgr2=0x556b8cef26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:04.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.862+0000 7f9326212800 1 --2- 172.21.15.170:0/1355188111 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556b8cef3e60 0x556b8cef26d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x556b8cfebf40 tx=0x7f931c0167b0 comp rx=0 tx=0).stop 2024-09-12T17:29:04.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.862+0000 7f9326212800 1 -- 172.21.15.170:0/1355188111 shutdown_connections 2024-09-12T17:29:04.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.862+0000 7f9326212800 1 --2- 172.21.15.170:0/1355188111 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f91fc03c780 0x7f91fc03ec40 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:04.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.862+0000 7f9326212800 1 --2- 172.21.15.170:0/1355188111 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556b8cef3e60 0x556b8cef26d0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:04.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.862+0000 7f9326212800 1 -- 172.21.15.170:0/1355188111 >> 172.21.15.170:0/1355188111 conn(0x556b8cffa220 msgr2=0x556b8cffa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:04.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.862+0000 7f9326212800 1 -- 172.21.15.170:0/1355188111 shutdown_connections 2024-09-12T17:29:04.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.862+0000 7f9326212800 1 -- 172.21.15.170:0/1355188111 wait complete. 2024-09-12T17:29:04.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.863+0000 7f9326212800 1 -- 172.21.15.170:0/316890739 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x556b8cef7050 msgr2=0x556b8cff2590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:04.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.863+0000 7f9326212800 1 --2- 172.21.15.170:0/316890739 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x556b8cef7050 0x556b8cff2590 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:04.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.863+0000 7f9326212800 1 -- 172.21.15.170:0/316890739 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556b8cff4970 msgr2=0x556b8cff6e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:04.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.863+0000 7f9326212800 1 --2- 172.21.15.170:0/316890739 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556b8cff4970 0x556b8cff6e10 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:04.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.863+0000 7f9326212800 1 -- 172.21.15.170:0/316890739 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f920803c780 msgr2=0x7f920803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:04.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.863+0000 7f9326212800 1 --2- 172.21.15.170:0/316890739 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f920803c780 0x7f920803ec40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f930c001e30 tx=0x7f930c001390 comp rx=0 tx=0).stop 2024-09-12T17:29:04.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.863+0000 7f9326212800 1 -- 172.21.15.170:0/316890739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556b8cef46c0 msgr2=0x556b8cfeaf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:04.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.863+0000 7f9326212800 1 --2- 172.21.15.170:0/316890739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556b8cef46c0 0x556b8cfeaf40 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f93140460d0 tx=0x7f9314002fb0 comp rx=0 tx=0).stop 2024-09-12T17:29:04.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.863+0000 7f9326212800 1 -- 172.21.15.170:0/316890739 shutdown_connections 2024-09-12T17:29:04.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.863+0000 7f9326212800 1 --2- 172.21.15.170:0/316890739 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556b8cff4970 0x556b8cff6e10 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:04.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.863+0000 7f9326212800 1 --2- 172.21.15.170:0/316890739 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f920803c780 0x7f920803ec40 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:04.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.863+0000 7f9326212800 1 --2- 172.21.15.170:0/316890739 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x556b8cef7050 0x556b8cff2590 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:04.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.863+0000 7f9326212800 1 --2- 172.21.15.170:0/316890739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556b8cef46c0 0x556b8cfeaf40 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:04.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.863+0000 7f9326212800 1 -- 172.21.15.170:0/316890739 >> 172.21.15.170:0/316890739 conn(0x556b8ceee200 msgr2=0x556b8cfdd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:04.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.863+0000 7f9326212800 1 -- 172.21.15.170:0/316890739 shutdown_connections 2024-09-12T17:29:04.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.863+0000 7f9326212800 1 -- 172.21.15.170:0/316890739 wait complete. 2024-09-12T17:29:04.879 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-12T17:29:04.847985Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:29:04.847975Z', 'tags': [], 'group_ids': []} 2024-09-12T17:29:04.890 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:29:04.896 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-09-12T17:29:04.896 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-12T17:29:04.896 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-12T17:29:04.896 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-09-12T17:29:04.942 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:29:04.942 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:29:04.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.942+0000 7f1f28faf800 1 Processor -- start 2024-09-12T17:29:04.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.942+0000 7f1f28faf800 1 -- start start 2024-09-12T17:29:04.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.942+0000 7f1f28faf800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5567c83fa4a0 0x5567c83fa8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:04.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.942+0000 7f1f28faf800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5567c82a5e40 con 0x5567c83fade0 2024-09-12T17:29:04.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.942+0000 7f1f28faf800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x5567c8270680 con 0x5567c83fa4a0 2024-09-12T17:29:04.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.942+0000 7f1f26a99640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5567c83fa4a0 0x5567c83fa8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:04.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.942+0000 7f1f1ffff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x5567c83fade0 0x5567c83fb290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:50938/0 (socket says 172.21.15.170:50938) 2024-09-12T17:29:04.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.942+0000 7f1f26a99640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5567c83fa4a0 0x5567c83fa8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:36318/0 (socket says 172.21.15.170:36318) 2024-09-12T17:29:04.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.942+0000 7f1f1ffff640 1 -- 172.21.15.170:0/1902803542 learned_addr learned my addr 172.21.15.170:0/1902803542 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:29:04.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.943+0000 7f1f26a99640 1 -- 172.21.15.170:0/1902803542 >> v1:172.21.15.47:6789/0 conn(0x5567c83fade0 legacy=0x5567c83fb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:04.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.943+0000 7f1f26a99640 1 -- 172.21.15.170:0/1902803542 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567c828c6b0 con 0x5567c83fa4a0 2024-09-12T17:29:04.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.944+0000 7f1f26a99640 1 --2- 172.21.15.170:0/1902803542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5567c83fa4a0 0x5567c83fa8a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f1f1800a470 tx=0x7f1f18045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=579080144150e3d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:04.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.945+0000 7f1f26298640 1 -- 172.21.15.170:0/1902803542 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f18053570 con 0x5567c83fa4a0 2024-09-12T17:29:04.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.945+0000 7f1f26298640 1 -- 172.21.15.170:0/1902803542 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f18058070 con 0x5567c83fa4a0 2024-09-12T17:29:04.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.945+0000 7f1f26298640 1 -- 172.21.15.170:0/1902803542 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f18053880 con 0x5567c83fa4a0 2024-09-12T17:29:04.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.945+0000 7f1f28faf800 1 -- 172.21.15.170:0/1902803542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5567c83fa4a0 msgr2=0x5567c83fa8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:04.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.945+0000 7f1f28faf800 1 --2- 172.21.15.170:0/1902803542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5567c83fa4a0 0x5567c83fa8a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f1f1800a470 tx=0x7f1f18045a20 comp rx=0 tx=0).stop 2024-09-12T17:29:04.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.945+0000 7f1f28faf800 1 -- 172.21.15.170:0/1902803542 shutdown_connections 2024-09-12T17:29:04.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.945+0000 7f1f28faf800 1 --2- 172.21.15.170:0/1902803542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5567c83fa4a0 0x5567c83fa8a0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:04.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.945+0000 7f1f28faf800 1 -- 172.21.15.170:0/1902803542 >> 172.21.15.170:0/1902803542 conn(0x5567c83f61d0 msgr2=0x5567c83f8630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:04.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.945+0000 7f1f28faf800 1 -- 172.21.15.170:0/1902803542 shutdown_connections 2024-09-12T17:29:04.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.945+0000 7f1f28faf800 1 -- 172.21.15.170:0/1902803542 wait complete. 2024-09-12T17:29:04.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.959+0000 7f1f28faf800 1 Processor -- start 2024-09-12T17:29:04.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.959+0000 7f1f28faf800 1 -- start start 2024-09-12T17:29:04.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.959+0000 7f1f28faf800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5567c83fa4a0 0x5567c84ed870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:04.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.959+0000 7f1f28faf800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5567c8294dd0 con 0x5567c83fa4a0 2024-09-12T17:29:04.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.960+0000 7f1f26a99640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5567c83fa4a0 0x5567c84ed870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:04.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.960+0000 7f1f26a99640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5567c83fa4a0 0x5567c84ed870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:36330/0 (socket says 172.21.15.170:36330) 2024-09-12T17:29:04.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.960+0000 7f1f26a99640 1 -- 172.21.15.170:0/175574254 learned_addr learned my addr 172.21.15.170:0/175574254 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:04.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.960+0000 7f1f26a99640 1 -- 172.21.15.170:0/175574254 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567c82ade10 con 0x5567c83fa4a0 2024-09-12T17:29:04.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.960+0000 7f1f26a99640 1 --2- 172.21.15.170:0/175574254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5567c83fa4a0 0x5567c84ed870 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f1f18025c20 tx=0x7f1f18051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffaa87022a65269c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:04.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.960+0000 7f1e14e09640 1 -- 172.21.15.170:0/175574254 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f18053a20 con 0x5567c83fa4a0 2024-09-12T17:29:04.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.960+0000 7f1e14e09640 1 -- 172.21.15.170:0/175574254 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f18063070 con 0x5567c83fa4a0 2024-09-12T17:29:04.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.960+0000 7f1e14e09640 1 -- 172.21.15.170:0/175574254 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f18053cf0 con 0x5567c83fa4a0 2024-09-12T17:29:04.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.961+0000 7f1f28faf800 1 -- 172.21.15.170:0/175574254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5567c83fa4a0 msgr2=0x5567c84ed870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:04.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.961+0000 7f1f28faf800 1 --2- 172.21.15.170:0/175574254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5567c83fa4a0 0x5567c84ed870 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f1f18025c20 tx=0x7f1f18051000 comp rx=0 tx=0).stop 2024-09-12T17:29:04.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.961+0000 7f1f28faf800 1 -- 172.21.15.170:0/175574254 shutdown_connections 2024-09-12T17:29:04.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.961+0000 7f1f28faf800 1 --2- 172.21.15.170:0/175574254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5567c83fa4a0 0x5567c84ed870 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:04.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.961+0000 7f1f28faf800 1 -- 172.21.15.170:0/175574254 >> 172.21.15.170:0/175574254 conn(0x5567c83f61d0 msgr2=0x5567c84e91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:04.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.961+0000 7f1f28faf800 1 -- 172.21.15.170:0/175574254 shutdown_connections 2024-09-12T17:29:04.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.961+0000 7f1f28faf800 1 -- 172.21.15.170:0/175574254 wait complete. 2024-09-12T17:29:04.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.961+0000 7f1f28faf800 1 Processor -- start 2024-09-12T17:29:04.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.961+0000 7f1f28faf800 1 -- start start 2024-09-12T17:29:04.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.961+0000 7f1f28faf800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5567c83fa4a0 0x5567c84f5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:04.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.962+0000 7f1f28faf800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5567c83fbd60 con 0x5567c83fa4a0 2024-09-12T17:29:04.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.962+0000 7f1f26a99640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5567c83fa4a0 0x5567c84f5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:04.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.962+0000 7f1f26a99640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5567c83fa4a0 0x5567c84f5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:36346/0 (socket says 172.21.15.170:36346) 2024-09-12T17:29:04.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.962+0000 7f1f26a99640 1 -- 172.21.15.170:0/15498999 learned_addr learned my addr 172.21.15.170:0/15498999 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:04.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.962+0000 7f1f26a99640 1 -- 172.21.15.170:0/15498999 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567c84f55f0 con 0x5567c83fa4a0 2024-09-12T17:29:04.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.962+0000 7f1f26a99640 1 --2- 172.21.15.170:0/15498999 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5567c83fa4a0 0x5567c84f5090 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f1f18025c20 tx=0x7f1f18002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:04.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.962+0000 7f1e13606640 1 -- 172.21.15.170:0/15498999 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f1806c030 con 0x5567c83fa4a0 2024-09-12T17:29:04.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.962+0000 7f1e13606640 1 -- 172.21.15.170:0/15498999 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f18068660 con 0x5567c83fa4a0 2024-09-12T17:29:04.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.962+0000 7f1f28faf800 1 -- 172.21.15.170:0/15498999 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5567c84f5880 con 0x5567c83fa4a0 2024-09-12T17:29:04.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.962+0000 7f1e13606640 1 -- 172.21.15.170:0/15498999 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f18068940 con 0x5567c83fa4a0 2024-09-12T17:29:04.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.963+0000 7f1f28faf800 1 -- 172.21.15.170:0/15498999 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567c84f6280 con 0x5567c83fa4a0 2024-09-12T17:29:04.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.964+0000 7f1e13606640 1 -- 172.21.15.170:0/15498999 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1f18068ae0 con 0x5567c83fa4a0 2024-09-12T17:29:04.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.964+0000 7f1e13606640 1 --2- 172.21.15.170:0/15498999 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1e0c03c730 0x7f1e0c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:04.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.964+0000 7f1e13606640 1 -- 172.21.15.170:0/15498999 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f1f18097f30 con 0x5567c83fa4a0 2024-09-12T17:29:04.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.964+0000 7f1f1ffff640 1 --2- 172.21.15.170:0/15498999 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1e0c03c730 0x7f1e0c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:04.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.964+0000 7f1f28faf800 1 --2- 172.21.15.170:0/15498999 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5567c83fade0 0x5567c84fc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:04.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.964+0000 7f1f28faf800 1 -- 172.21.15.170:0/15498999 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5567c84fcc20 con 0x5567c83fade0 2024-09-12T17:29:04.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.964+0000 7f1f2729a640 1 --2- 172.21.15.170:0/15498999 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5567c83fade0 0x5567c84fc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:04.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.964+0000 7f1f1ffff640 1 --2- 172.21.15.170:0/15498999 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1e0c03c730 0x7f1e0c03ebf0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1f10001d70 tx=0x7f1f100012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:04.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.964+0000 7f1f2729a640 1 --2- 172.21.15.170:0/15498999 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5567c83fade0 0x5567c84fc6e0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:04.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.965+0000 7f1f2729a640 1 -- 172.21.15.170:0/15498999 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1f2000a4d0 con 0x5567c83fade0 2024-09-12T17:29:04.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.965+0000 7f1f28faf800 1 -- 172.21.15.170:0/15498999 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5567c84fcfc0 con 0x5567c83fade0 2024-09-12T17:29:04.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.965+0000 7f1f2729a640 1 -- 172.21.15.170:0/15498999 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1f2000a4d0 con 0x5567c83fade0 2024-09-12T17:29:04.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.965+0000 7f1f28faf800 1 --2- 172.21.15.170:0/15498999 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5567c84feac0 0x5567c8500f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:04.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.965+0000 7f1f28faf800 1 -- 172.21.15.170:0/15498999 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5567c85016d0 con 0x5567c84feac0 2024-09-12T17:29:04.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.965+0000 7f1f26a99640 1 --2- 172.21.15.170:0/15498999 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5567c84feac0 0x5567c8500f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:04.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.965+0000 7f1f26a99640 1 --2- 172.21.15.170:0/15498999 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5567c84feac0 0x5567c8500f40 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:04.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.966+0000 7f1f26a99640 1 -- 172.21.15.170:0/15498999 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1f18051070 con 0x5567c84feac0 2024-09-12T17:29:04.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.966+0000 7f1f28faf800 1 -- 172.21.15.170:0/15498999 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5567c84fd810 con 0x5567c83fade0 2024-09-12T17:29:04.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.966+0000 7f1f2729a640 1 -- 172.21.15.170:0/15498999 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1f2000a4d0 con 0x5567c83fade0 2024-09-12T17:29:04.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.966+0000 7f1f28faf800 1 -- 172.21.15.170:0/15498999 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5567c84fdc60 con 0x5567c84feac0 2024-09-12T17:29:04.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.966+0000 7f1f26a99640 1 -- 172.21.15.170:0/15498999 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1f18051070 con 0x5567c84feac0 2024-09-12T17:29:04.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.967+0000 7f1f28faf800 1 Processor -- start 2024-09-12T17:29:04.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.967+0000 7f1f28faf800 1 -- start start 2024-09-12T17:29:04.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.967+0000 7f1f28faf800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5567c850ff80 0x5567c85103a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:04.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.967+0000 7f1f28faf800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5567c82f2a00 con 0x5567c850ff80 2024-09-12T17:29:04.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.967+0000 7f1f2729a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5567c850ff80 0x5567c85103a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:04.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.967+0000 7f1f2729a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5567c850ff80 0x5567c85103a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:36352/0 (socket says 172.21.15.170:36352) 2024-09-12T17:29:04.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.967+0000 7f1f2729a640 1 -- 172.21.15.170:0/1239188864 learned_addr learned my addr 172.21.15.170:0/1239188864 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:04.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.967+0000 7f1f2729a640 1 -- 172.21.15.170:0/1239188864 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567c85109e0 con 0x5567c850ff80 2024-09-12T17:29:04.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.968+0000 7f1f2729a640 1 --2- 172.21.15.170:0/1239188864 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5567c850ff80 0x5567c85103a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x5567c84f6090 tx=0x7f1f200167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:04.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.968+0000 7f1e10e01640 1 -- 172.21.15.170:0/1239188864 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f20013640 con 0x5567c850ff80 2024-09-12T17:29:04.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.968+0000 7f1e10e01640 1 -- 172.21.15.170:0/1239188864 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f200137e0 con 0x5567c850ff80 2024-09-12T17:29:04.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.968+0000 7f1e10e01640 1 -- 172.21.15.170:0/1239188864 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f20013ae0 con 0x5567c850ff80 2024-09-12T17:29:04.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.968+0000 7f1f28faf800 1 -- 172.21.15.170:0/1239188864 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5567c8511210 con 0x5567c850ff80 2024-09-12T17:29:04.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.968+0000 7f1f28faf800 1 -- 172.21.15.170:0/1239188864 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567c85117b0 con 0x5567c850ff80 2024-09-12T17:29:04.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.969+0000 7f1e10e01640 1 -- 172.21.15.170:0/1239188864 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1f20011040 con 0x5567c850ff80 2024-09-12T17:29:04.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.969+0000 7f1e10e01640 1 --2- 172.21.15.170:0/1239188864 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1e0003c780 0x7f1e0003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:04.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.969+0000 7f1e10e01640 1 -- 172.21.15.170:0/1239188864 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f1f2000e040 con 0x5567c850ff80 2024-09-12T17:29:04.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.969+0000 7f1f26a99640 1 --2- 172.21.15.170:0/1239188864 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1e0003c780 0x7f1e0003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:04.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.969+0000 7f1f28faf800 1 Processor -- start 2024-09-12T17:29:04.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.969+0000 7f1f28faf800 1 -- start start 2024-09-12T17:29:04.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.969+0000 7f1f26a99640 1 --2- 172.21.15.170:0/1239188864 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1e0003c780 0x7f1e0003ec40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1f18096410 tx=0x7f1f1805fd30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:04.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.970+0000 7f1f28faf800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5567c851ca00 0x5567c851ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:04.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.970+0000 7f1f28faf800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5567c84ee060 con 0x5567c851ca00 2024-09-12T17:29:04.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.970+0000 7f1f2729a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5567c851ca00 0x5567c851ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:04.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.970+0000 7f1f2729a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5567c851ca00 0x5567c851ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:36366/0 (socket says 172.21.15.170:36366) 2024-09-12T17:29:04.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.970+0000 7f1f2729a640 1 -- 172.21.15.170:0/2191180696 learned_addr learned my addr 172.21.15.170:0/2191180696 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:04.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.970+0000 7f1f2729a640 1 -- 172.21.15.170:0/2191180696 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567c851d3f0 con 0x5567c851ca00 2024-09-12T17:29:04.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.970+0000 7f1f2729a640 1 --2- 172.21.15.170:0/2191180696 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5567c851ca00 0x5567c851ce00 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f1f20040fd0 tx=0x7f1f2001fe70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90a4a84b91b9a83c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:04.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.970+0000 7f1e0a7fc640 1 -- 172.21.15.170:0/2191180696 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f20052020 con 0x5567c851ca00 2024-09-12T17:29:04.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.970+0000 7f1e0a7fc640 1 -- 172.21.15.170:0/2191180696 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f2001f340 con 0x5567c851ca00 2024-09-12T17:29:04.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.970+0000 7f1e0a7fc640 1 -- 172.21.15.170:0/2191180696 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f20013c80 con 0x5567c851ca00 2024-09-12T17:29:04.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.971+0000 7f1f28faf800 1 -- 172.21.15.170:0/2191180696 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5567c851ca00 msgr2=0x5567c851ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:04.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.971+0000 7f1f28faf800 1 --2- 172.21.15.170:0/2191180696 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5567c851ca00 0x5567c851ce00 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f1f20040fd0 tx=0x7f1f2001fe70 comp rx=0 tx=0).stop 2024-09-12T17:29:04.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.971+0000 7f1f28faf800 1 -- 172.21.15.170:0/2191180696 shutdown_connections 2024-09-12T17:29:04.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.971+0000 7f1f28faf800 1 --2- 172.21.15.170:0/2191180696 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5567c851ca00 0x5567c851ce00 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:04.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.971+0000 7f1f28faf800 1 -- 172.21.15.170:0/2191180696 >> 172.21.15.170:0/2191180696 conn(0x5567c8518e00 msgr2=0x5567c8517040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:04.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.971+0000 7f1f28faf800 1 -- 172.21.15.170:0/2191180696 shutdown_connections 2024-09-12T17:29:04.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.971+0000 7f1f28faf800 1 -- 172.21.15.170:0/2191180696 wait complete. 2024-09-12T17:29:04.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.971+0000 7f1f28faf800 1 Processor -- start 2024-09-12T17:29:04.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.971+0000 7f1f28faf800 1 -- start start 2024-09-12T17:29:04.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.971+0000 7f1f28faf800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5567c851ca00 0x5567c8524010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:04.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.971+0000 7f1f28faf800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5567c851da10 con 0x5567c851ca00 2024-09-12T17:29:04.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.971+0000 7f1f2729a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5567c851ca00 0x5567c8524010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:04.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.972+0000 7f1f2729a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5567c851ca00 0x5567c8524010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:36376/0 (socket says 172.21.15.170:36376) 2024-09-12T17:29:04.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.972+0000 7f1f2729a640 1 -- 172.21.15.170:0/3268043179 learned_addr learned my addr 172.21.15.170:0/3268043179 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:04.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.972+0000 7f1f2729a640 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567c8524570 con 0x5567c851ca00 2024-09-12T17:29:04.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.972+0000 7f1f2729a640 1 --2- 172.21.15.170:0/3268043179 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5567c851ca00 0x5567c8524010 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f1f20053cd0 tx=0x7f1f20053d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:04.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.972+0000 7f1e08ff9640 1 -- 172.21.15.170:0/3268043179 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f20020800 con 0x5567c851ca00 2024-09-12T17:29:04.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.972+0000 7f1e08ff9640 1 -- 172.21.15.170:0/3268043179 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f200209a0 con 0x5567c851ca00 2024-09-12T17:29:04.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.972+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5567c8524800 con 0x5567c851ca00 2024-09-12T17:29:04.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.972+0000 7f1e08ff9640 1 -- 172.21.15.170:0/3268043179 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f20020c80 con 0x5567c851ca00 2024-09-12T17:29:04.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.972+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567c8525390 con 0x5567c851ca00 2024-09-12T17:29:04.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.973+0000 7f1e08ff9640 1 -- 172.21.15.170:0/3268043179 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1f200145e0 con 0x5567c851ca00 2024-09-12T17:29:04.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.973+0000 7f1e08ff9640 1 --2- 172.21.15.170:0/3268043179 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1df003c780 0x7f1df003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:04.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.973+0000 7f1e08ff9640 1 -- 172.21.15.170:0/3268043179 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f1f20017450 con 0x5567c851ca00 2024-09-12T17:29:04.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.974+0000 7f1f26a99640 1 --2- 172.21.15.170:0/3268043179 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1df003c780 0x7f1df003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:04.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.974+0000 7f1f28faf800 20 rados->read ofs=0 len=0 2024-09-12T17:29:04.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.974+0000 7f1f26a99640 1 --2- 172.21.15.170:0/3268043179 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1df003c780 0x7f1df003ec40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1f18068fd0 tx=0x7f1f18092000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:04.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.974+0000 7f1f28faf800 1 --2- 172.21.15.170:0/3268043179 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5567c852f910 0x5567c8531dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:04.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.974+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5567c8532520 con 0x5567c852f910 2024-09-12T17:29:04.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.974+0000 7f1f1ffff640 1 --2- 172.21.15.170:0/3268043179 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5567c852f910 0x5567c8531dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:04.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.974+0000 7f1f1ffff640 1 --2- 172.21.15.170:0/3268043179 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5567c852f910 0x5567c8531dd0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:04.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.975+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1f10009050 con 0x5567c852f910 2024-09-12T17:29:04.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.975+0000 7f1f28faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:04.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.975+0000 7f1f28faf800 20 realm 2024-09-12T17:29:04.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.975+0000 7f1f28faf800 20 rados->read ofs=0 len=0 2024-09-12T17:29:04.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.975+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5567c852ec60 con 0x5567c852f910 2024-09-12T17:29:04.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.975+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1f10009050 con 0x5567c852f910 2024-09-12T17:29:04.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.975+0000 7f1f28faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:04.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.975+0000 7f1f28faf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:29:04.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.975+0000 7f1f28faf800 20 rados->read ofs=0 len=0 2024-09-12T17:29:04.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.975+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5567c8533010 con 0x5567c852f910 2024-09-12T17:29:04.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.975+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1f10009050 con 0x5567c852f910 2024-09-12T17:29:04.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.975+0000 7f1f28faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:04.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.975+0000 7f1f28faf800 20 rados->read ofs=0 len=0 2024-09-12T17:29:04.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.975+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5567c85338e0 con 0x5567c852f910 2024-09-12T17:29:04.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.975+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1f10009050 con 0x5567c852f910 2024-09-12T17:29:04.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.975+0000 7f1f28faf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:04.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.975+0000 7f1f28faf800 20 rados->read ofs=0 len=0 2024-09-12T17:29:04.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.975+0000 7f1f28faf800 1 --2- 172.21.15.170:0/3268043179 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5567c8534300 0x5567c85366f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:04.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.975+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5567c8536e30 con 0x5567c8534300 2024-09-12T17:29:04.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.975+0000 7f1f2729a640 1 --2- 172.21.15.170:0/3268043179 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5567c8534300 0x5567c85366f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:04.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.976+0000 7f1f2729a640 1 --2- 172.21.15.170:0/3268043179 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5567c8534300 0x5567c85366f0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:04.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.976+0000 7f1f2729a640 1 -- 172.21.15.170:0/3268043179 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1f2000a4d0 con 0x5567c8534300 2024-09-12T17:29:04.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.976+0000 7f1f28faf800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:29:04.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.976+0000 7f1f28faf800 20 searching for the correct realm 2024-09-12T17:29:04.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.976+0000 7f1f28faf800 1 --2- 172.21.15.170:0/3268043179 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5567c8538de0 0x5567c853b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:04.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.976+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5567c853b920 con 0x5567c8538de0 2024-09-12T17:29:04.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.976+0000 7f1f26a99640 1 --2- 172.21.15.170:0/3268043179 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5567c8538de0 0x5567c853b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:04.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.976+0000 7f1f26a99640 1 --2- 172.21.15.170:0/3268043179 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5567c8538de0 0x5567c853b2a0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:04.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.977+0000 7f1f26a99640 1 -- 172.21.15.170:0/3268043179 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f18051070 con 0x5567c8538de0 2024-09-12T17:29:04.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.977+0000 7f1f26a99640 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5567c853b920 con 0x5567c8534300 2024-09-12T17:29:04.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.977+0000 7f1f2729a640 1 -- 172.21.15.170:0/3268043179 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f2000a4d0 con 0x5567c8534300 2024-09-12T17:29:04.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.977+0000 7f1f2729a640 1 --2- 172.21.15.170:0/3268043179 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f1f20033070 0x7f1f200148d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:04.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.977+0000 7f1f2729a640 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5567c853b920 con 0x7f1f20033070 2024-09-12T17:29:04.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.977+0000 7f1f1ffff640 1 --2- 172.21.15.170:0/3268043179 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f1f20033070 0x7f1f200148d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:04.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.977+0000 7f1f1ffff640 1 --2- 172.21.15.170:0/3268043179 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f1f20033070 0x7f1f200148d0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:04.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.978+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f10009050 con 0x7f1f20033070 2024-09-12T17:29:04.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.978+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5567c853b920 con 0x5567c852f910 2024-09-12T17:29:04.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.978+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f10009050 con 0x5567c852f910 2024-09-12T17:29:04.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.978+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5567c853b920 con 0x5567c852f910 2024-09-12T17:29:04.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.978+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f10029040 con 0x5567c852f910 2024-09-12T17:29:04.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.978+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5567c853b920 con 0x7f1f20033070 2024-09-12T17:29:04.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.978+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f10029040 con 0x7f1f20033070 2024-09-12T17:29:04.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.978+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5567c853b920 con 0x7f1f20033070 2024-09-12T17:29:04.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.979+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f10029040 con 0x7f1f20033070 2024-09-12T17:29:04.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.979+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5567c853b920 con 0x5567c8534300 2024-09-12T17:29:04.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.979+0000 7f1f2729a640 1 -- 172.21.15.170:0/3268043179 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f2000a4d0 con 0x5567c8534300 2024-09-12T17:29:04.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.979+0000 7f1f2729a640 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5567c853b920 con 0x5567c8538de0 2024-09-12T17:29:04.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.979+0000 7f1f26a99640 1 -- 172.21.15.170:0/3268043179 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f18051070 con 0x5567c8538de0 2024-09-12T17:29:04.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.979+0000 7f1f26a99640 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5567c853b920 con 0x5567c852f910 2024-09-12T17:29:04.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.979+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f10029040 con 0x5567c852f910 2024-09-12T17:29:04.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.979+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5567c853b920 con 0x7f1f20033070 2024-09-12T17:29:04.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.980+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f10029040 con 0x7f1f20033070 2024-09-12T17:29:04.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.980+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5567c853b920 con 0x5567c852f910 2024-09-12T17:29:04.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.980+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f10029040 con 0x5567c852f910 2024-09-12T17:29:04.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.980+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5567c853b920 con 0x5567c8534300 2024-09-12T17:29:04.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.980+0000 7f1f2729a640 1 -- 172.21.15.170:0/3268043179 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f1f2000a4d0 con 0x5567c8534300 2024-09-12T17:29:04.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.980+0000 7f1f2729a640 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5567c853b920 con 0x5567c8538de0 2024-09-12T17:29:04.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.980+0000 7f1f26a99640 1 -- 172.21.15.170:0/3268043179 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f18051070 con 0x5567c8538de0 2024-09-12T17:29:04.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.980+0000 7f1f26a99640 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5567c853b920 con 0x5567c8538de0 2024-09-12T17:29:04.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.981+0000 7f1f26a99640 1 -- 172.21.15.170:0/3268043179 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f18051070 con 0x5567c8538de0 2024-09-12T17:29:04.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.981+0000 7f1f26a99640 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5567c853b920 con 0x5567c8534300 2024-09-12T17:29:04.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.981+0000 7f1f2729a640 1 -- 172.21.15.170:0/3268043179 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f2000a4d0 con 0x5567c8534300 2024-09-12T17:29:04.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.981+0000 7f1f2729a640 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5567c853b920 con 0x5567c8538de0 2024-09-12T17:29:04.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.981+0000 7f1f26a99640 1 -- 172.21.15.170:0/3268043179 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f18051070 con 0x5567c8538de0 2024-09-12T17:29:04.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.981+0000 7f1f26a99640 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5567c853b920 con 0x5567c8538de0 2024-09-12T17:29:04.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.981+0000 7f1f26a99640 1 -- 172.21.15.170:0/3268043179 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f18051070 con 0x5567c8538de0 2024-09-12T17:29:04.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.981+0000 7f1f26a99640 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5567c853b920 con 0x5567c852f910 2024-09-12T17:29:04.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.982+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f10029040 con 0x5567c852f910 2024-09-12T17:29:04.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.982+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5567c853b920 con 0x5567c852f910 2024-09-12T17:29:04.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.982+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1f10029040 con 0x5567c852f910 2024-09-12T17:29:04.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.982+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5567c853b920 con 0x7f1f20033070 2024-09-12T17:29:05.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.982+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f10029040 con 0x7f1f20033070 2024-09-12T17:29:05.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.982+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5567c853b920 con 0x5567c8538de0 2024-09-12T17:29:05.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.982+0000 7f1f26a99640 1 -- 172.21.15.170:0/3268043179 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f18051070 con 0x5567c8538de0 2024-09-12T17:29:05.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.982+0000 7f1f26a99640 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5567c853b920 con 0x5567c8534300 2024-09-12T17:29:05.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.983+0000 7f1f2729a640 1 -- 172.21.15.170:0/3268043179 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f2000a4d0 con 0x5567c8534300 2024-09-12T17:29:05.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.983+0000 7f1f2729a640 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5567c853b920 con 0x5567c852f910 2024-09-12T17:29:05.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.983+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f10029040 con 0x5567c852f910 2024-09-12T17:29:05.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.983+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5567c853b920 con 0x7f1f20033070 2024-09-12T17:29:05.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.983+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f10029040 con 0x7f1f20033070 2024-09-12T17:29:05.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.983+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5567c853b920 con 0x5567c8538de0 2024-09-12T17:29:05.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.983+0000 7f1f26a99640 1 -- 172.21.15.170:0/3268043179 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f18051070 con 0x5567c8538de0 2024-09-12T17:29:05.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.983+0000 7f1f26a99640 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5567c853b920 con 0x7f1f20033070 2024-09-12T17:29:05.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.984+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f10029040 con 0x7f1f20033070 2024-09-12T17:29:05.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.984+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5567c853b920 con 0x5567c8534300 2024-09-12T17:29:05.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.984+0000 7f1f2729a640 1 -- 172.21.15.170:0/3268043179 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f20066040 con 0x5567c8534300 2024-09-12T17:29:05.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.984+0000 7f1f2729a640 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5567c853b920 con 0x5567c8538de0 2024-09-12T17:29:05.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.984+0000 7f1f26a99640 1 -- 172.21.15.170:0/3268043179 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f18051070 con 0x5567c8538de0 2024-09-12T17:29:05.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.984+0000 7f1f26a99640 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5567c853b920 con 0x7f1f20033070 2024-09-12T17:29:05.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.984+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f10029040 con 0x7f1f20033070 2024-09-12T17:29:05.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.984+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5567c853b920 con 0x5567c852f910 2024-09-12T17:29:05.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.985+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1f10029040 con 0x5567c852f910 2024-09-12T17:29:05.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.985+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5567c853b920 con 0x5567c8534300 2024-09-12T17:29:05.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.985+0000 7f1f2729a640 1 -- 172.21.15.170:0/3268043179 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(37 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1f20066040 con 0x5567c8534300 2024-09-12T17:29:05.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.985+0000 7f1f28faf800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:29:05.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.985+0000 7f1f28faf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:29:05.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.985+0000 7f1f28faf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:29:05.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.985+0000 7f1f28faf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:29:05.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.985+0000 7f1f28faf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:29:05.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.985+0000 7f1f28faf800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:29:05.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.985+0000 7f1f28faf800 20 rados->read ofs=0 len=0 2024-09-12T17:29:05.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.985+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5567c85377f0 con 0x5567c852f910 2024-09-12T17:29:05.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.985+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1f10029040 con 0x5567c852f910 2024-09-12T17:29:05.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.985+0000 7f1f28faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:05.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.985+0000 7f1f28faf800 20 rados->read ofs=0 len=0 2024-09-12T17:29:05.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.985+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5567c8537430 con 0x5567c852f910 2024-09-12T17:29:05.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.985+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1f10029040 con 0x5567c852f910 2024-09-12T17:29:05.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.985+0000 7f1f28faf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:05.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.985+0000 7f1f28faf800 20 rados->read ofs=0 len=0 2024-09-12T17:29:05.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.985+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5567c8537c30 con 0x5567c8534300 2024-09-12T17:29:05.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.986+0000 7f1f2729a640 1 -- 172.21.15.170:0/3268043179 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1f20066040 con 0x5567c8534300 2024-09-12T17:29:05.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.986+0000 7f1f28faf800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:29:05.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.986+0000 7f1f28faf800 20 zone default found 2024-09-12T17:29:05.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.986+0000 7f1f28faf800 4 Realm: () 2024-09-12T17:29:05.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.986+0000 7f1f28faf800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:29:05.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.986+0000 7f1f28faf800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:29:05.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.986+0000 7f1f28faf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:29:05.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.986+0000 7f1f28faf800 20 zonegroup default 2024-09-12T17:29:05.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.986+0000 7f1f28faf800 20 rados->read ofs=0 len=0 2024-09-12T17:29:05.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.986+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5567c853c250 con 0x7f1f20033070 2024-09-12T17:29:05.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.986+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1f10029040 con 0x7f1f20033070 2024-09-12T17:29:05.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.986+0000 7f1f28faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:05.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.986+0000 7f1f28faf800 20 rados->read ofs=0 len=0 2024-09-12T17:29:05.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.986+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5567c853e490 con 0x5567c8538de0 2024-09-12T17:29:05.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.986+0000 7f1f26a99640 1 -- 172.21.15.170:0/3268043179 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1f18051070 con 0x5567c8538de0 2024-09-12T17:29:05.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.986+0000 7f1f28faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:05.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.986+0000 7f1f28faf800 20 rados->read ofs=0 len=0 2024-09-12T17:29:05.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.986+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5567c853e830 con 0x5567c8538de0 2024-09-12T17:29:05.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.987+0000 7f1f26a99640 1 -- 172.21.15.170:0/3268043179 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1f18051070 con 0x5567c8538de0 2024-09-12T17:29:05.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.987+0000 7f1f28faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:05.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.987+0000 7f1f28faf800 20 started sync module instance, tier type = 2024-09-12T17:29:05.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.987+0000 7f1f28faf800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:29:05.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.987+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5567c853d920 con 0x5567c8534300 2024-09-12T17:29:05.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.988+0000 7f1f2729a640 1 -- 172.21.15.170:0/3268043179 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(44 notify.0 [create] v31'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f20066040 con 0x5567c8534300 2024-09-12T17:29:05.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.988+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93904230931728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5567c853d580 con 0x5567c8534300 2024-09-12T17:29:05.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.988+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5567c853f6a0 con 0x5567c852f910 2024-09-12T17:29:05.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.989+0000 7f1f2729a640 1 -- 172.21.15.170:0/3268043179 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93904230931728] v31'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f20066040 con 0x5567c8534300 2024-09-12T17:29:05.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.989+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v31'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f10029040 con 0x5567c852f910 2024-09-12T17:29:05.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.989+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93904230935504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5567c853f6a0 con 0x5567c852f910 2024-09-12T17:29:05.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.989+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5567c85400c0 con 0x5567c8538de0 2024-09-12T17:29:05.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.990+0000 7f1f26a99640 1 -- 172.21.15.170:0/3268043179 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v31'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f18051070 con 0x5567c8538de0 2024-09-12T17:29:05.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.990+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93904230939568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5567c85400c0 con 0x5567c8538de0 2024-09-12T17:29:05.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.991+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5567c85410c0 con 0x5567c8534300 2024-09-12T17:29:05.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.991+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93904230935504] v31'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f10029040 con 0x5567c852f910 2024-09-12T17:29:05.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.991+0000 7f1f26a99640 1 -- 172.21.15.170:0/3268043179 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93904230939568] v31'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f18051070 con 0x5567c8538de0 2024-09-12T17:29:05.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.992+0000 7f1f2729a640 1 -- 172.21.15.170:0/3268043179 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(50 notify.3 [create] v31'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f20066040 con 0x5567c8534300 2024-09-12T17:29:05.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.992+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93904230943664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5567c8541080 con 0x5567c8534300 2024-09-12T17:29:05.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.992+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5567c8541960 con 0x5567c852f910 2024-09-12T17:29:05.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.992+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v31'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f10029040 con 0x5567c852f910 2024-09-12T17:29:05.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.993+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93904230945968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5567c8541d80 con 0x5567c852f910 2024-09-12T17:29:05.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.993+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5567c85425d0 con 0x7f1f20033070 2024-09-12T17:29:05.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.993+0000 7f1f2729a640 1 -- 172.21.15.170:0/3268043179 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93904230943664] v31'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f20066040 con 0x5567c8534300 2024-09-12T17:29:05.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.994+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93904230945968] v31'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f10029040 con 0x5567c852f910 2024-09-12T17:29:05.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.994+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(54 notify.5 [create] v31'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f10029040 con 0x7f1f20033070 2024-09-12T17:29:05.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.994+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93904230947024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5567c85421a0 con 0x7f1f20033070 2024-09-12T17:29:05.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.994+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5567c85429f0 con 0x7f1f20033070 2024-09-12T17:29:05.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.995+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93904230947024] v31'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f10029040 con 0x7f1f20033070 2024-09-12T17:29:05.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.995+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v31'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f10029040 con 0x7f1f20033070 2024-09-12T17:29:05.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.995+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93904230948560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5567c8542880 con 0x7f1f20033070 2024-09-12T17:29:05.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.995+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5567c8543380 con 0x7f1f20033070 2024-09-12T17:29:05.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.996+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(58 notify.7 [create] v31'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f10029040 con 0x7f1f20033070 2024-09-12T17:29:05.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.996+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93904230948560] v31'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f10029040 con 0x7f1f20033070 2024-09-12T17:29:05.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.996+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93904230952560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5567c85437f0 con 0x7f1f20033070 2024-09-12T17:29:05.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.996+0000 7f1f28faf800 20 add_watcher() i=0 2024-09-12T17:29:05.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.996+0000 7f1f28faf800 20 add_watcher() i=1 2024-09-12T17:29:05.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.996+0000 7f1f28faf800 20 add_watcher() i=2 2024-09-12T17:29:05.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.996+0000 7f1f28faf800 20 add_watcher() i=3 2024-09-12T17:29:05.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.996+0000 7f1f28faf800 20 add_watcher() i=4 2024-09-12T17:29:05.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.996+0000 7f1f28faf800 20 add_watcher() i=5 2024-09-12T17:29:05.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.996+0000 7f1f28faf800 20 add_watcher() i=6 2024-09-12T17:29:05.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.997+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93904230952560] v31'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f10029040 con 0x7f1f20033070 2024-09-12T17:29:05.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.997+0000 7f1f28faf800 20 add_watcher() i=7 2024-09-12T17:29:05.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.997+0000 7f1f28faf800 2 all 8 watchers are set, enabling cache 2024-09-12T17:29:05.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.997+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5567c85437f0 con 0x5567c852f910 2024-09-12T17:29:05.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.997+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1f10029040 con 0x5567c852f910 2024-09-12T17:29:05.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.997+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93904230953792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5567c85437d0 con 0x5567c852f910 2024-09-12T17:29:05.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.998+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93904230953792] v31'217 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1f10029040 con 0x5567c852f910 2024-09-12T17:29:05.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.998+0000 7f1dddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:05.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.998+0000 7f1f28faf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:29:05.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.998+0000 7f1f28faf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:29:05.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.999+0000 7f1f28faf800 5 note: GC not initialized 2024-09-12T17:29:05.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.999+0000 7f1ddcfe1640 20 reqs_thread_entry: start 2024-09-12T17:29:05.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.999+0000 7f1f28faf800 20 init_complete bucket index max shards: 11 2024-09-12T17:29:05.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.999+0000 7f1f28faf800 20 Filter name: none 2024-09-12T17:29:05.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.999+0000 7f1dd5ffb640 20 reqs_thread_entry: start 2024-09-12T17:29:05.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.999+0000 7f1f28faf800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-12T17:29:05.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.999+0000 7f1f28faf800 20 rados->read ofs=0 len=0 2024-09-12T17:29:05.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.999+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5567c85798a0 con 0x5567c8534300 2024-09-12T17:29:05.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.999+0000 7f1f2729a640 1 -- 172.21.15.170:0/3268043179 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(62 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f1f20066040 con 0x5567c8534300 2024-09-12T17:29:05.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.999+0000 7f1f28faf800 20 rados_obj.operate() r=0 bl.length=380 2024-09-12T17:29:05.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.999+0000 7f1f28faf800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-12T17:29:05.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.999+0000 7f1f28faf800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-12T17:29:05.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.999+0000 7f1f28faf800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:29:05.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:04.999+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5567c857da50 con 0x7f1f20033070 2024-09-12T17:29:05.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.001+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(63 fud [create,call,writefull 0~206] v31'7 uv5 ondisk = -17 ((17) File exists)) ==== 231+0+0 (crc 0 0 0) 0x7f1f10029040 con 0x7f1f20033070 2024-09-12T17:29:05.026 INFO:teuthology.orchestra.run.smithi170.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-09-12T17:29:05.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.001+0000 7f1dddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:05.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.001+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93904230953792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5567c8577740 con 0x5567c852f910 2024-09-12T17:29:05.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.002+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93904230953792] v31'218 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1f10029040 con 0x5567c852f910 2024-09-12T17:29:05.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.002+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93904230931728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5567c8577740 con 0x5567c8534300 2024-09-12T17:29:05.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.003+0000 7f1f2729a640 1 -- 172.21.15.170:0/3268043179 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93904230931728] v31'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f20066040 con 0x5567c8534300 2024-09-12T17:29:05.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.003+0000 7f1f28faf800 20 remove_watcher() i=0 2024-09-12T17:29:05.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.003+0000 7f1f28faf800 2 removed watcher, disabling cache 2024-09-12T17:29:05.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.003+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93904230935504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5567c8577740 con 0x5567c852f910 2024-09-12T17:29:05.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.004+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93904230935504] v31'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f10029040 con 0x5567c852f910 2024-09-12T17:29:05.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.004+0000 7f1f28faf800 20 remove_watcher() i=1 2024-09-12T17:29:05.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.004+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93904230939568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5567c8577740 con 0x5567c8538de0 2024-09-12T17:29:05.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.006+0000 7f1f26a99640 1 -- 172.21.15.170:0/3268043179 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93904230939568] v31'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f18051070 con 0x5567c8538de0 2024-09-12T17:29:05.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.006+0000 7f1f28faf800 20 remove_watcher() i=2 2024-09-12T17:29:05.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.006+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93904230943664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5567c8577740 con 0x5567c8534300 2024-09-12T17:29:05.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.007+0000 7f1f2729a640 1 -- 172.21.15.170:0/3268043179 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93904230943664] v31'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f20066040 con 0x5567c8534300 2024-09-12T17:29:05.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.007+0000 7f1f28faf800 20 remove_watcher() i=3 2024-09-12T17:29:05.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.007+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93904230945968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5567c8577740 con 0x5567c852f910 2024-09-12T17:29:05.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.008+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93904230945968] v31'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f10029040 con 0x5567c852f910 2024-09-12T17:29:05.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.008+0000 7f1f28faf800 20 remove_watcher() i=4 2024-09-12T17:29:05.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.008+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93904230947024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5567c8577740 con 0x7f1f20033070 2024-09-12T17:29:05.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.009+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93904230947024] v31'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f10029040 con 0x7f1f20033070 2024-09-12T17:29:05.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.009+0000 7f1f28faf800 20 remove_watcher() i=5 2024-09-12T17:29:05.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.009+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93904230948560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5567c8577740 con 0x7f1f20033070 2024-09-12T17:29:05.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.010+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93904230948560] v31'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f10029040 con 0x7f1f20033070 2024-09-12T17:29:05.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.010+0000 7f1f28faf800 20 remove_watcher() i=6 2024-09-12T17:29:05.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.010+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93904230952560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5567c8577740 con 0x7f1f20033070 2024-09-12T17:29:05.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.011+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93904230952560] v31'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f10029040 con 0x7f1f20033070 2024-09-12T17:29:05.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.011+0000 7f1f28faf800 20 remove_watcher() i=7 2024-09-12T17:29:05.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.011+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f1f20033070 msgr2=0x7f1f200148d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:05.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.011+0000 7f1f28faf800 1 --2- 172.21.15.170:0/3268043179 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f1f20033070 0x7f1f200148d0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.011+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5567c852f910 msgr2=0x5567c8531dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:05.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.011+0000 7f1f28faf800 1 --2- 172.21.15.170:0/3268043179 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5567c852f910 0x5567c8531dd0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.011+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5567c8534300 msgr2=0x5567c85366f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:05.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.011+0000 7f1f28faf800 1 --2- 172.21.15.170:0/3268043179 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5567c8534300 0x5567c85366f0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.011+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5567c8538de0 msgr2=0x5567c853b2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:05.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.011+0000 7f1f28faf800 1 --2- 172.21.15.170:0/3268043179 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5567c8538de0 0x5567c853b2a0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.011+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1df003c780 msgr2=0x7f1df003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:05.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.011+0000 7f1f28faf800 1 --2- 172.21.15.170:0/3268043179 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1df003c780 0x7f1df003ec40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1f18068fd0 tx=0x7f1f18092000 comp rx=0 tx=0).stop 2024-09-12T17:29:05.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.011+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5567c851ca00 msgr2=0x5567c8524010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:05.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.011+0000 7f1f28faf800 1 --2- 172.21.15.170:0/3268043179 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5567c851ca00 0x5567c8524010 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f1f20053cd0 tx=0x7f1f20053d00 comp rx=0 tx=0).stop 2024-09-12T17:29:05.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.011+0000 7f1f1ffff640 1 -- 172.21.15.170:0/3268043179 reap_dead start 2024-09-12T17:29:05.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.011+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 shutdown_connections 2024-09-12T17:29:05.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.011+0000 7f1f28faf800 1 --2- 172.21.15.170:0/3268043179 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5567c851ca00 0x5567c8524010 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.011+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 >> 172.21.15.170:0/3268043179 conn(0x5567c8518e00 msgr2=0x5567c8517010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:05.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.011+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 shutdown_connections 2024-09-12T17:29:05.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.012+0000 7f1f28faf800 1 -- 172.21.15.170:0/3268043179 wait complete. 2024-09-12T17:29:05.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.012+0000 7f1f28faf800 1 -- 172.21.15.170:0/1239188864 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1e0003c780 msgr2=0x7f1e0003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:05.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.012+0000 7f1f28faf800 1 --2- 172.21.15.170:0/1239188864 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1e0003c780 0x7f1e0003ec40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1f18096410 tx=0x7f1f1805fd30 comp rx=0 tx=0).stop 2024-09-12T17:29:05.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.012+0000 7f1f28faf800 1 -- 172.21.15.170:0/1239188864 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5567c850ff80 msgr2=0x5567c85103a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:05.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.012+0000 7f1f28faf800 1 --2- 172.21.15.170:0/1239188864 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5567c850ff80 0x5567c85103a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x5567c84f6090 tx=0x7f1f200167b0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.012+0000 7f1f28faf800 1 -- 172.21.15.170:0/1239188864 shutdown_connections 2024-09-12T17:29:05.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.012+0000 7f1f28faf800 1 --2- 172.21.15.170:0/1239188864 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1e0003c780 0x7f1e0003ec40 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.012+0000 7f1f28faf800 1 --2- 172.21.15.170:0/1239188864 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5567c850ff80 0x5567c85103a0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.012+0000 7f1f28faf800 1 -- 172.21.15.170:0/1239188864 >> 172.21.15.170:0/1239188864 conn(0x5567c8504330 msgr2=0x5567c8504710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:05.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.012+0000 7f1f28faf800 1 -- 172.21.15.170:0/1239188864 shutdown_connections 2024-09-12T17:29:05.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.012+0000 7f1f28faf800 1 -- 172.21.15.170:0/1239188864 wait complete. 2024-09-12T17:29:05.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.012+0000 7f1f28faf800 1 -- 172.21.15.170:0/15498999 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5567c83fade0 msgr2=0x5567c84fc6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:05.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.012+0000 7f1f28faf800 1 --2- 172.21.15.170:0/15498999 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5567c83fade0 0x5567c84fc6e0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.012+0000 7f1f28faf800 1 -- 172.21.15.170:0/15498999 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5567c84feac0 msgr2=0x5567c8500f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:05.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.012+0000 7f1f28faf800 1 --2- 172.21.15.170:0/15498999 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5567c84feac0 0x5567c8500f40 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.012+0000 7f1f28faf800 1 -- 172.21.15.170:0/15498999 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1e0c03c730 msgr2=0x7f1e0c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:05.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.012+0000 7f1f28faf800 1 --2- 172.21.15.170:0/15498999 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1e0c03c730 0x7f1e0c03ebf0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1f10001d70 tx=0x7f1f100012d0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.012+0000 7f1f28faf800 1 -- 172.21.15.170:0/15498999 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5567c83fa4a0 msgr2=0x5567c84f5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:05.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.012+0000 7f1f28faf800 1 --2- 172.21.15.170:0/15498999 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5567c83fa4a0 0x5567c84f5090 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f1f18025c20 tx=0x7f1f18002fb0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.012+0000 7f1f28faf800 1 -- 172.21.15.170:0/15498999 shutdown_connections 2024-09-12T17:29:05.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.012+0000 7f1f28faf800 1 --2- 172.21.15.170:0/15498999 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5567c84feac0 0x5567c8500f40 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.012+0000 7f1f28faf800 1 --2- 172.21.15.170:0/15498999 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f1e0c03c730 0x7f1e0c03ebf0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.012+0000 7f1f28faf800 1 --2- 172.21.15.170:0/15498999 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5567c83fade0 0x5567c84fc6e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.012+0000 7f1f28faf800 1 --2- 172.21.15.170:0/15498999 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5567c83fa4a0 0x5567c84f5090 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.012+0000 7f1f28faf800 1 -- 172.21.15.170:0/15498999 >> 172.21.15.170:0/15498999 conn(0x5567c83f61d0 msgr2=0x5567c84e79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:05.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.012+0000 7f1f28faf800 1 -- 172.21.15.170:0/15498999 shutdown_connections 2024-09-12T17:29:05.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.013+0000 7f1f28faf800 1 -- 172.21.15.170:0/15498999 wait complete. 2024-09-12T17:29:05.034 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-12T17:29:05.039 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:29:05.039 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-12T17:29:05.043 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:29:05.043 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-09-12T17:29:05.043 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-12T17:29:05.043 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-12T17:29:05.043 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-09-12T17:29:05.088 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:29:05.089 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:29:05.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.088+0000 7fcc43a0f800 1 Processor -- start 2024-09-12T17:29:05.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.088+0000 7fcc43a0f800 1 -- start start 2024-09-12T17:29:05.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.088+0000 7fcc43a0f800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5622dd94fe00 0x5622dd950b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:05.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.088+0000 7fcc43a0f800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5622dd7fae40 con 0x5622dd951040 2024-09-12T17:29:05.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.088+0000 7fcc43a0f800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x5622dd7c5680 con 0x5622dd94fe00 2024-09-12T17:29:05.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.088+0000 7fcc41500640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5622dd94fe00 0x5622dd950b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:05.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.088+0000 7fcc41500640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5622dd94fe00 0x5622dd950b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:36386/0 (socket says 172.21.15.170:36386) 2024-09-12T17:29:05.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.088+0000 7fcc41500640 1 -- 172.21.15.170:0/2567475015 learned_addr learned my addr 172.21.15.170:0/2567475015 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:05.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.088+0000 7fcc40cff640 1 --1- 172.21.15.170:0/2567475015 >> v1:172.21.15.47:6789/0 conn(0x5622dd951040 0x5622dd955da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:50950/0 (socket says 172.21.15.170:50950) 2024-09-12T17:29:05.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.089+0000 7fcc41500640 1 -- 172.21.15.170:0/2567475015 >> v1:172.21.15.47:6789/0 conn(0x5622dd951040 legacy=0x5622dd955da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:05.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.089+0000 7fcc41500640 1 -- 172.21.15.170:0/2567475015 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622dd7e16b0 con 0x5622dd94fe00 2024-09-12T17:29:05.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.090+0000 7fcc41500640 1 --2- 172.21.15.170:0/2567475015 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622dd94fe00 0x5622dd950b00 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fcc3400a6b0 tx=0x7fcc34047e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=293949823b2d7329 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:05.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.091+0000 7fcc3bfff640 1 -- 172.21.15.170:0/2567475015 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc3400a200 con 0x5622dd94fe00 2024-09-12T17:29:05.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.091+0000 7fcc3bfff640 1 -- 172.21.15.170:0/2567475015 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc3400a3a0 con 0x5622dd94fe00 2024-09-12T17:29:05.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.091+0000 7fcc3bfff640 1 -- 172.21.15.170:0/2567475015 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc34008700 con 0x5622dd94fe00 2024-09-12T17:29:05.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.091+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2567475015 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622dd94fe00 msgr2=0x5622dd950b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:05.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.091+0000 7fcc43a0f800 1 --2- 172.21.15.170:0/2567475015 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622dd94fe00 0x5622dd950b00 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fcc3400a6b0 tx=0x7fcc34047e30 comp rx=0 tx=0).stop 2024-09-12T17:29:05.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.091+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2567475015 shutdown_connections 2024-09-12T17:29:05.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.091+0000 7fcc43a0f800 1 --2- 172.21.15.170:0/2567475015 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622dd94fe00 0x5622dd950b00 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.091+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2567475015 >> 172.21.15.170:0/2567475015 conn(0x5622dd94b1d0 msgr2=0x5622dd94d630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:05.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.091+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2567475015 shutdown_connections 2024-09-12T17:29:05.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.091+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2567475015 wait complete. 2024-09-12T17:29:05.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.105+0000 7fcc43a0f800 1 Processor -- start 2024-09-12T17:29:05.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.105+0000 7fcc43a0f800 1 -- start start 2024-09-12T17:29:05.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.105+0000 7fcc43a0f800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622dd94fe00 0x5622dda3e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:05.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.105+0000 7fcc43a0f800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5622dd7e9dd0 con 0x5622dd94fe00 2024-09-12T17:29:05.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.106+0000 7fcc41500640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622dd94fe00 0x5622dda3e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:05.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.106+0000 7fcc41500640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622dd94fe00 0x5622dda3e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:36388/0 (socket says 172.21.15.170:36388) 2024-09-12T17:29:05.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.106+0000 7fcc41500640 1 -- 172.21.15.170:0/1346188303 learned_addr learned my addr 172.21.15.170:0/1346188303 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:05.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.106+0000 7fcc41500640 1 -- 172.21.15.170:0/1346188303 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622dd802e10 con 0x5622dd94fe00 2024-09-12T17:29:05.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.106+0000 7fcc41500640 1 --2- 172.21.15.170:0/1346188303 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622dd94fe00 0x5622dda3e3f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fcc34027c60 tx=0x7fcc34051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5373b98f57696e2e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:05.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.107+0000 7fcb2f606640 1 -- 172.21.15.170:0/1346188303 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc34008590 con 0x5622dd94fe00 2024-09-12T17:29:05.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.107+0000 7fcb2f606640 1 -- 172.21.15.170:0/1346188303 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc340088f0 con 0x5622dd94fe00 2024-09-12T17:29:05.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.107+0000 7fcb2f606640 1 -- 172.21.15.170:0/1346188303 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc34008bf0 con 0x5622dd94fe00 2024-09-12T17:29:05.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.107+0000 7fcc43a0f800 1 -- 172.21.15.170:0/1346188303 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622dd94fe00 msgr2=0x5622dda3e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:05.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.107+0000 7fcc43a0f800 1 --2- 172.21.15.170:0/1346188303 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622dd94fe00 0x5622dda3e3f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fcc34027c60 tx=0x7fcc34051000 comp rx=0 tx=0).stop 2024-09-12T17:29:05.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.107+0000 7fcc43a0f800 1 -- 172.21.15.170:0/1346188303 shutdown_connections 2024-09-12T17:29:05.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.107+0000 7fcc43a0f800 1 --2- 172.21.15.170:0/1346188303 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622dd94fe00 0x5622dda3e3f0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.107+0000 7fcc43a0f800 1 -- 172.21.15.170:0/1346188303 >> 172.21.15.170:0/1346188303 conn(0x5622dd94b1d0 msgr2=0x5622dda39d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:05.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.107+0000 7fcc43a0f800 1 -- 172.21.15.170:0/1346188303 shutdown_connections 2024-09-12T17:29:05.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.107+0000 7fcc43a0f800 1 -- 172.21.15.170:0/1346188303 wait complete. 2024-09-12T17:29:05.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.108+0000 7fcc43a0f800 1 Processor -- start 2024-09-12T17:29:05.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.108+0000 7fcc43a0f800 1 -- start start 2024-09-12T17:29:05.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.108+0000 7fcc43a0f800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622dd94fe00 0x5622dda45cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:05.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.108+0000 7fcc43a0f800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5622dd951730 con 0x5622dd94fe00 2024-09-12T17:29:05.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.108+0000 7fcc41500640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622dd94fe00 0x5622dda45cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:05.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.108+0000 7fcc41500640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622dd94fe00 0x5622dda45cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:36390/0 (socket says 172.21.15.170:36390) 2024-09-12T17:29:05.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.108+0000 7fcc41500640 1 -- 172.21.15.170:0/336476446 learned_addr learned my addr 172.21.15.170:0/336476446 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:05.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.108+0000 7fcc41500640 1 -- 172.21.15.170:0/336476446 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622dda46250 con 0x5622dd94fe00 2024-09-12T17:29:05.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.109+0000 7fcc41500640 1 --2- 172.21.15.170:0/336476446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622dd94fe00 0x5622dda45cf0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fcc34027c60 tx=0x7fcc34002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:05.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.109+0000 7fcb2de03640 1 -- 172.21.15.170:0/336476446 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc34070070 con 0x5622dd94fe00 2024-09-12T17:29:05.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.109+0000 7fcb2de03640 1 -- 172.21.15.170:0/336476446 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc3404f4c0 con 0x5622dd94fe00 2024-09-12T17:29:05.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.109+0000 7fcc43a0f800 1 -- 172.21.15.170:0/336476446 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5622dda464e0 con 0x5622dd94fe00 2024-09-12T17:29:05.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.109+0000 7fcb2de03640 1 -- 172.21.15.170:0/336476446 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc3404f7c0 con 0x5622dd94fe00 2024-09-12T17:29:05.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.109+0000 7fcc43a0f800 1 -- 172.21.15.170:0/336476446 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622dda46ee0 con 0x5622dd94fe00 2024-09-12T17:29:05.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.110+0000 7fcb2de03640 1 -- 172.21.15.170:0/336476446 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fcc34073070 con 0x5622dd94fe00 2024-09-12T17:29:05.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.110+0000 7fcb2de03640 1 --2- 172.21.15.170:0/336476446 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fcb2803c780 0x7fcb2803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:05.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.110+0000 7fcb2de03640 1 -- 172.21.15.170:0/336476446 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fcc34065020 con 0x5622dd94fe00 2024-09-12T17:29:05.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.110+0000 7fcc40cff640 1 --2- 172.21.15.170:0/336476446 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fcb2803c780 0x7fcb2803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:05.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.110+0000 7fcc43a0f800 1 --2- 172.21.15.170:0/336476446 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5622dd951040 0x5622dda4d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:05.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.110+0000 7fcc43a0f800 1 -- 172.21.15.170:0/336476446 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622dda47aa0 con 0x5622dd951040 2024-09-12T17:29:05.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.110+0000 7fcc41d01640 1 --2- 172.21.15.170:0/336476446 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5622dd951040 0x5622dda4d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:05.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.110+0000 7fcc40cff640 1 --2- 172.21.15.170:0/336476446 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fcb2803c780 0x7fcb2803ec40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c001e30 tx=0x7fcc2c001390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:05.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.111+0000 7fcc41d01640 1 --2- 172.21.15.170:0/336476446 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5622dd951040 0x5622dda4d340 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:05.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.111+0000 7fcc41d01640 1 -- 172.21.15.170:0/336476446 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcc3c00a4d0 con 0x5622dd951040 2024-09-12T17:29:05.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.111+0000 7fcc43a0f800 1 -- 172.21.15.170:0/336476446 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622dda4dd80 con 0x5622dd951040 2024-09-12T17:29:05.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.111+0000 7fcc41d01640 1 -- 172.21.15.170:0/336476446 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcc3c00a4d0 con 0x5622dd951040 2024-09-12T17:29:05.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.111+0000 7fcc43a0f800 1 --2- 172.21.15.170:0/336476446 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5622dda4f690 0x5622dda51b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:05.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.111+0000 7fcc43a0f800 1 -- 172.21.15.170:0/336476446 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622dda522c0 con 0x5622dda4f690 2024-09-12T17:29:05.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.111+0000 7fcc41500640 1 --2- 172.21.15.170:0/336476446 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5622dda4f690 0x5622dda51b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:05.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.112+0000 7fcc41500640 1 --2- 172.21.15.170:0/336476446 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5622dda4f690 0x5622dda51b30 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:05.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.112+0000 7fcc41500640 1 -- 172.21.15.170:0/336476446 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcc3407c070 con 0x5622dda4f690 2024-09-12T17:29:05.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.112+0000 7fcc43a0f800 1 -- 172.21.15.170:0/336476446 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622dda4e5d0 con 0x5622dd951040 2024-09-12T17:29:05.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.112+0000 7fcc41d01640 1 -- 172.21.15.170:0/336476446 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcc3c00a4d0 con 0x5622dd951040 2024-09-12T17:29:05.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.112+0000 7fcc43a0f800 1 -- 172.21.15.170:0/336476446 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622dda4e9b0 con 0x5622dda4f690 2024-09-12T17:29:05.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.112+0000 7fcc41500640 1 -- 172.21.15.170:0/336476446 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcc3407c070 con 0x5622dda4f690 2024-09-12T17:29:05.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.113+0000 7fcc43a0f800 1 Processor -- start 2024-09-12T17:29:05.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.113+0000 7fcc43a0f800 1 -- start start 2024-09-12T17:29:05.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.113+0000 7fcc43a0f800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622dda60b70 0x5622dda60f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:05.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.113+0000 7fcc43a0f800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5622dd847a00 con 0x5622dda60b70 2024-09-12T17:29:05.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.113+0000 7fcc41d01640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622dda60b70 0x5622dda60f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:05.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.113+0000 7fcc41d01640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622dda60b70 0x5622dda60f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:36404/0 (socket says 172.21.15.170:36404) 2024-09-12T17:29:05.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.113+0000 7fcc41d01640 1 -- 172.21.15.170:0/281199280 learned_addr learned my addr 172.21.15.170:0/281199280 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:05.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.113+0000 7fcc41d01640 1 -- 172.21.15.170:0/281199280 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622dda615d0 con 0x5622dda60b70 2024-09-12T17:29:05.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.114+0000 7fcc41d01640 1 --2- 172.21.15.170:0/281199280 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622dda60b70 0x5622dda60f90 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x5622dda46b80 tx=0x7fcc3c0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:05.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.114+0000 7fcb26ffd640 1 -- 172.21.15.170:0/281199280 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc3c013640 con 0x5622dda60b70 2024-09-12T17:29:05.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.114+0000 7fcb26ffd640 1 -- 172.21.15.170:0/281199280 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc3c0137e0 con 0x5622dda60b70 2024-09-12T17:29:05.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.114+0000 7fcc43a0f800 1 -- 172.21.15.170:0/281199280 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5622dda61e00 con 0x5622dda60b70 2024-09-12T17:29:05.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.114+0000 7fcb26ffd640 1 -- 172.21.15.170:0/281199280 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc3c013ae0 con 0x5622dda60b70 2024-09-12T17:29:05.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.114+0000 7fcc43a0f800 1 -- 172.21.15.170:0/281199280 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622dda623a0 con 0x5622dda60b70 2024-09-12T17:29:05.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.115+0000 7fcb26ffd640 1 -- 172.21.15.170:0/281199280 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fcc3c011040 con 0x5622dda60b70 2024-09-12T17:29:05.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.115+0000 7fcb26ffd640 1 --2- 172.21.15.170:0/281199280 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fcb1803c730 0x7fcb1803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:05.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.115+0000 7fcb26ffd640 1 -- 172.21.15.170:0/281199280 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fcc3c00e040 con 0x5622dda60b70 2024-09-12T17:29:05.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.115+0000 7fcc41500640 1 --2- 172.21.15.170:0/281199280 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fcb1803c730 0x7fcb1803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:05.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.115+0000 7fcc43a0f800 1 Processor -- start 2024-09-12T17:29:05.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.115+0000 7fcc43a0f800 1 -- start start 2024-09-12T17:29:05.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.115+0000 7fcc41500640 1 --2- 172.21.15.170:0/281199280 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fcb1803c730 0x7fcb1803ebf0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x5622dda474f0 tx=0x7fcc3400a2e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:05.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.115+0000 7fcc43a0f800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622dda71a60 0x5622dda71e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:05.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.115+0000 7fcc43a0f800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5622dda3ebe0 con 0x5622dda71a60 2024-09-12T17:29:05.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.116+0000 7fcc41d01640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622dda71a60 0x5622dda71e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:05.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.116+0000 7fcc41d01640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622dda71a60 0x5622dda71e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:36418/0 (socket says 172.21.15.170:36418) 2024-09-12T17:29:05.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.116+0000 7fcc41d01640 1 -- 172.21.15.170:0/3742080828 learned_addr learned my addr 172.21.15.170:0/3742080828 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:05.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.116+0000 7fcc41d01640 1 -- 172.21.15.170:0/3742080828 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622dda72430 con 0x5622dda71a60 2024-09-12T17:29:05.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.116+0000 7fcc41d01640 1 --2- 172.21.15.170:0/3742080828 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622dda71a60 0x5622dda71e40 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c053d70 tx=0x7fcc3c0203a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45e25fef0a8bed8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:05.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.116+0000 7fcb24ff9640 1 -- 172.21.15.170:0/3742080828 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc3c0143c0 con 0x5622dda71a60 2024-09-12T17:29:05.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.116+0000 7fcb24ff9640 1 -- 172.21.15.170:0/3742080828 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc3c021910 con 0x5622dda71a60 2024-09-12T17:29:05.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.116+0000 7fcb24ff9640 1 -- 172.21.15.170:0/3742080828 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc3c021440 con 0x5622dda71a60 2024-09-12T17:29:05.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.117+0000 7fcc43a0f800 1 -- 172.21.15.170:0/3742080828 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622dda71a60 msgr2=0x5622dda71e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:05.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.117+0000 7fcc43a0f800 1 --2- 172.21.15.170:0/3742080828 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622dda71a60 0x5622dda71e40 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c053d70 tx=0x7fcc3c0203a0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.117+0000 7fcc43a0f800 1 -- 172.21.15.170:0/3742080828 shutdown_connections 2024-09-12T17:29:05.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.117+0000 7fcc43a0f800 1 --2- 172.21.15.170:0/3742080828 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622dda71a60 0x5622dda71e40 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.117+0000 7fcc43a0f800 1 -- 172.21.15.170:0/3742080828 >> 172.21.15.170:0/3742080828 conn(0x5622dda69a50 msgr2=0x5622dda67c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:05.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.117+0000 7fcc43a0f800 1 -- 172.21.15.170:0/3742080828 shutdown_connections 2024-09-12T17:29:05.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.117+0000 7fcc43a0f800 1 -- 172.21.15.170:0/3742080828 wait complete. 2024-09-12T17:29:05.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.117+0000 7fcc43a0f800 1 Processor -- start 2024-09-12T17:29:05.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.117+0000 7fcc43a0f800 1 -- start start 2024-09-12T17:29:05.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.117+0000 7fcc43a0f800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622dda71a60 0x5622dda79020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:05.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.117+0000 7fcc43a0f800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5622dda72a70 con 0x5622dda71a60 2024-09-12T17:29:05.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.117+0000 7fcc41d01640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622dda71a60 0x5622dda79020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:05.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.117+0000 7fcc41d01640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622dda71a60 0x5622dda79020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:36426/0 (socket says 172.21.15.170:36426) 2024-09-12T17:29:05.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.117+0000 7fcc41d01640 1 -- 172.21.15.170:0/2347861268 learned_addr learned my addr 172.21.15.170:0/2347861268 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:05.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.118+0000 7fcc41d01640 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622dda79580 con 0x5622dda71a60 2024-09-12T17:29:05.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.118+0000 7fcc41d01640 1 --2- 172.21.15.170:0/2347861268 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622dda71a60 0x5622dda79020 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c020790 tx=0x7fcc3c053d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:05.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.118+0000 7fcb16ffd640 1 -- 172.21.15.170:0/2347861268 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc3c01fbd0 con 0x5622dda71a60 2024-09-12T17:29:05.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.118+0000 7fcb16ffd640 1 -- 172.21.15.170:0/2347861268 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc3c0143c0 con 0x5622dda71a60 2024-09-12T17:29:05.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.118+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5622dda79810 con 0x5622dda71a60 2024-09-12T17:29:05.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.118+0000 7fcb16ffd640 1 -- 172.21.15.170:0/2347861268 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc3c020a10 con 0x5622dda71a60 2024-09-12T17:29:05.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.118+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622dda7a190 con 0x5622dda71a60 2024-09-12T17:29:05.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.119+0000 7fcb16ffd640 1 -- 172.21.15.170:0/2347861268 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fcc3c020bb0 con 0x5622dda71a60 2024-09-12T17:29:05.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.119+0000 7fcb16ffd640 1 --2- 172.21.15.170:0/2347861268 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fcb0c03c780 0x7fcb0c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:05.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.119+0000 7fcb16ffd640 1 -- 172.21.15.170:0/2347861268 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fcc3c04a040 con 0x5622dda71a60 2024-09-12T17:29:05.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.119+0000 7fcc41500640 1 --2- 172.21.15.170:0/2347861268 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fcb0c03c780 0x7fcb0c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:05.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.119+0000 7fcc41500640 1 --2- 172.21.15.170:0/2347861268 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fcb0c03c780 0x7fcb0c03ec40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fcc3406afb0 tx=0x7fcc3408f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:05.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.119+0000 7fcc43a0f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:05.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.119+0000 7fcc43a0f800 1 --2- 172.21.15.170:0/2347861268 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5622dda84950 0x5622dda86e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:05.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.120+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622dda87560 con 0x5622dda84950 2024-09-12T17:29:05.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.120+0000 7fcc40cff640 1 --2- 172.21.15.170:0/2347861268 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5622dda84950 0x5622dda86e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:05.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.120+0000 7fcc40cff640 1 --2- 172.21.15.170:0/2347861268 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5622dda84950 0x5622dda86e10 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:05.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.120+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcc2c00f610 con 0x5622dda84950 2024-09-12T17:29:05.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.120+0000 7fcc43a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:05.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.120+0000 7fcc43a0f800 20 realm 2024-09-12T17:29:05.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.120+0000 7fcc43a0f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:05.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.120+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622dda83ca0 con 0x5622dda84950 2024-09-12T17:29:05.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.120+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcc2c00f610 con 0x5622dda84950 2024-09-12T17:29:05.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.120+0000 7fcc43a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:05.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.120+0000 7fcc43a0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:29:05.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.120+0000 7fcc43a0f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:05.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.120+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622dda88050 con 0x5622dda84950 2024-09-12T17:29:05.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.120+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcc2c00f610 con 0x5622dda84950 2024-09-12T17:29:05.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.121+0000 7fcc43a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:05.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.121+0000 7fcc43a0f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:05.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.121+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622dda88920 con 0x5622dda84950 2024-09-12T17:29:05.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.121+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcc2c00f610 con 0x5622dda84950 2024-09-12T17:29:05.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.121+0000 7fcc43a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:05.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.121+0000 7fcc43a0f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:05.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.121+0000 7fcc43a0f800 1 --2- 172.21.15.170:0/2347861268 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5622dda89340 0x5622dda8b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:05.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.121+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622dda8be70 con 0x5622dda89340 2024-09-12T17:29:05.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.121+0000 7fcc41d01640 1 --2- 172.21.15.170:0/2347861268 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5622dda89340 0x5622dda8b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:05.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.121+0000 7fcc41d01640 1 --2- 172.21.15.170:0/2347861268 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5622dda89340 0x5622dda8b730 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:05.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.121+0000 7fcc41d01640 1 -- 172.21.15.170:0/2347861268 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcc3c00a4d0 con 0x5622dda89340 2024-09-12T17:29:05.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.121+0000 7fcc43a0f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:29:05.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.121+0000 7fcc43a0f800 20 searching for the correct realm 2024-09-12T17:29:05.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.121+0000 7fcc43a0f800 1 --2- 172.21.15.170:0/2347861268 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5622dda8de20 0x5622dda902e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:05.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.121+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5622dda90960 con 0x5622dda8de20 2024-09-12T17:29:05.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.122+0000 7fcc41500640 1 --2- 172.21.15.170:0/2347861268 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5622dda8de20 0x5622dda902e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:05.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.122+0000 7fcc41500640 1 --2- 172.21.15.170:0/2347861268 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5622dda8de20 0x5622dda902e0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:05.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.122+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc3407c070 con 0x5622dda8de20 2024-09-12T17:29:05.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.122+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5622dda90960 con 0x5622dda89340 2024-09-12T17:29:05.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.122+0000 7fcc41d01640 1 -- 172.21.15.170:0/2347861268 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc3c00a4d0 con 0x5622dda89340 2024-09-12T17:29:05.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.122+0000 7fcc41d01640 1 --2- 172.21.15.170:0/2347861268 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fcc3c012a50 0x7fcc3c0145e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:05.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.122+0000 7fcc41d01640 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5622dda90960 con 0x7fcc3c012a50 2024-09-12T17:29:05.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.123+0000 7fcc40cff640 1 --2- 172.21.15.170:0/2347861268 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fcc3c012a50 0x7fcc3c0145e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:05.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.123+0000 7fcc40cff640 1 --2- 172.21.15.170:0/2347861268 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fcc3c012a50 0x7fcc3c0145e0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:05.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.123+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc2c00f610 con 0x7fcc3c012a50 2024-09-12T17:29:05.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.123+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5622dda90960 con 0x5622dda84950 2024-09-12T17:29:05.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.123+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc2c00f610 con 0x5622dda84950 2024-09-12T17:29:05.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.123+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5622dda90960 con 0x5622dda84950 2024-09-12T17:29:05.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.124+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc2c02b040 con 0x5622dda84950 2024-09-12T17:29:05.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.124+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5622dda90960 con 0x7fcc3c012a50 2024-09-12T17:29:05.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.124+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc2c02b040 con 0x7fcc3c012a50 2024-09-12T17:29:05.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.124+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5622dda90960 con 0x7fcc3c012a50 2024-09-12T17:29:05.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.124+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc2c02b040 con 0x7fcc3c012a50 2024-09-12T17:29:05.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.124+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5622dda90960 con 0x5622dda89340 2024-09-12T17:29:05.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.124+0000 7fcc41d01640 1 -- 172.21.15.170:0/2347861268 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc3c00a4d0 con 0x5622dda89340 2024-09-12T17:29:05.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.124+0000 7fcc41d01640 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5622dda90960 con 0x5622dda8de20 2024-09-12T17:29:05.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.125+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc340a3040 con 0x5622dda8de20 2024-09-12T17:29:05.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.125+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5622dda90960 con 0x5622dda84950 2024-09-12T17:29:05.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.125+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc2c02b040 con 0x5622dda84950 2024-09-12T17:29:05.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.125+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5622dda90960 con 0x7fcc3c012a50 2024-09-12T17:29:05.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.125+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc2c02b040 con 0x7fcc3c012a50 2024-09-12T17:29:05.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.125+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5622dda90960 con 0x5622dda84950 2024-09-12T17:29:05.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.125+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc2c02b040 con 0x5622dda84950 2024-09-12T17:29:05.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.125+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5622dda90960 con 0x5622dda89340 2024-09-12T17:29:05.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.126+0000 7fcc41d01640 1 -- 172.21.15.170:0/2347861268 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fcc3c00a4d0 con 0x5622dda89340 2024-09-12T17:29:05.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.126+0000 7fcc41d01640 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5622dda90960 con 0x5622dda8de20 2024-09-12T17:29:05.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.126+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc340a3040 con 0x5622dda8de20 2024-09-12T17:29:05.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.126+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5622dda90960 con 0x5622dda8de20 2024-09-12T17:29:05.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.126+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc340a3040 con 0x5622dda8de20 2024-09-12T17:29:05.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.126+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5622dda90960 con 0x5622dda89340 2024-09-12T17:29:05.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.126+0000 7fcc41d01640 1 -- 172.21.15.170:0/2347861268 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc3c00a4d0 con 0x5622dda89340 2024-09-12T17:29:05.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.126+0000 7fcc41d01640 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5622dda90960 con 0x5622dda8de20 2024-09-12T17:29:05.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.126+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc340a3040 con 0x5622dda8de20 2024-09-12T17:29:05.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.126+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5622dda90960 con 0x5622dda8de20 2024-09-12T17:29:05.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.127+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc340a3040 con 0x5622dda8de20 2024-09-12T17:29:05.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.127+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5622dda90960 con 0x5622dda84950 2024-09-12T17:29:05.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.127+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc2c02b040 con 0x5622dda84950 2024-09-12T17:29:05.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.127+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5622dda90960 con 0x5622dda84950 2024-09-12T17:29:05.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.127+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcc2c02b040 con 0x5622dda84950 2024-09-12T17:29:05.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.127+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5622dda90960 con 0x7fcc3c012a50 2024-09-12T17:29:05.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.127+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc2c02b040 con 0x7fcc3c012a50 2024-09-12T17:29:05.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.127+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5622dda90960 con 0x5622dda8de20 2024-09-12T17:29:05.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.127+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc340a3040 con 0x5622dda8de20 2024-09-12T17:29:05.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.128+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5622dda90960 con 0x5622dda89340 2024-09-12T17:29:05.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.128+0000 7fcc41d01640 1 -- 172.21.15.170:0/2347861268 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc3c00a4d0 con 0x5622dda89340 2024-09-12T17:29:05.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.128+0000 7fcc41d01640 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5622dda90960 con 0x5622dda84950 2024-09-12T17:29:05.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.128+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc2c02b040 con 0x5622dda84950 2024-09-12T17:29:05.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.128+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5622dda90960 con 0x7fcc3c012a50 2024-09-12T17:29:05.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.128+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc2c02b040 con 0x7fcc3c012a50 2024-09-12T17:29:05.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.128+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5622dda90960 con 0x5622dda8de20 2024-09-12T17:29:05.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.128+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc340a3040 con 0x5622dda8de20 2024-09-12T17:29:05.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.128+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5622dda90960 con 0x7fcc3c012a50 2024-09-12T17:29:05.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.129+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc2c02b040 con 0x7fcc3c012a50 2024-09-12T17:29:05.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.129+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5622dda90960 con 0x5622dda89340 2024-09-12T17:29:05.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.129+0000 7fcc41d01640 1 -- 172.21.15.170:0/2347861268 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc3c069040 con 0x5622dda89340 2024-09-12T17:29:05.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.129+0000 7fcc41d01640 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5622dda90960 con 0x5622dda8de20 2024-09-12T17:29:05.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.129+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc340a3040 con 0x5622dda8de20 2024-09-12T17:29:05.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.129+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5622dda90960 con 0x7fcc3c012a50 2024-09-12T17:29:05.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.130+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc2c02b040 con 0x7fcc3c012a50 2024-09-12T17:29:05.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.130+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5622dda90960 con 0x5622dda84950 2024-09-12T17:29:05.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.130+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcc2c02b040 con 0x5622dda84950 2024-09-12T17:29:05.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.130+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5622dda90960 con 0x5622dda89340 2024-09-12T17:29:05.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.130+0000 7fcc41d01640 1 -- 172.21.15.170:0/2347861268 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(37 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcc3c069040 con 0x5622dda89340 2024-09-12T17:29:05.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.130+0000 7fcc43a0f800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:29:05.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.130+0000 7fcc43a0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:29:05.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.130+0000 7fcc43a0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:29:05.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.130+0000 7fcc43a0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:29:05.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.130+0000 7fcc43a0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:29:05.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.130+0000 7fcc43a0f800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:29:05.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.130+0000 7fcc43a0f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:05.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.130+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622dda8c830 con 0x5622dda84950 2024-09-12T17:29:05.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.130+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcc2c02b040 con 0x5622dda84950 2024-09-12T17:29:05.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.130+0000 7fcc43a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:05.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.130+0000 7fcc43a0f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:05.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.130+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622dda8d0d0 con 0x5622dda84950 2024-09-12T17:29:05.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.131+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcc2c03b040 con 0x5622dda84950 2024-09-12T17:29:05.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.131+0000 7fcc43a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:05.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.131+0000 7fcc43a0f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:05.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.131+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622dda8c470 con 0x5622dda89340 2024-09-12T17:29:05.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.131+0000 7fcc41d01640 1 -- 172.21.15.170:0/2347861268 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcc3c069040 con 0x5622dda89340 2024-09-12T17:29:05.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.131+0000 7fcc43a0f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:29:05.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.131+0000 7fcc43a0f800 20 zone default found 2024-09-12T17:29:05.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.131+0000 7fcc43a0f800 4 Realm: () 2024-09-12T17:29:05.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.131+0000 7fcc43a0f800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:29:05.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.131+0000 7fcc43a0f800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:29:05.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.131+0000 7fcc43a0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:29:05.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.131+0000 7fcc43a0f800 20 zonegroup default 2024-09-12T17:29:05.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.131+0000 7fcc43a0f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:05.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.131+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622dda91290 con 0x7fcc3c012a50 2024-09-12T17:29:05.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.131+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcc2c03b040 con 0x7fcc3c012a50 2024-09-12T17:29:05.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.131+0000 7fcc43a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:05.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.131+0000 7fcc43a0f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:05.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.131+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622dda934d0 con 0x5622dda8de20 2024-09-12T17:29:05.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.131+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcc340a3040 con 0x5622dda8de20 2024-09-12T17:29:05.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.132+0000 7fcc43a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:05.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.132+0000 7fcc43a0f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:05.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.132+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622dda93870 con 0x5622dda8de20 2024-09-12T17:29:05.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.132+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcc340a3040 con 0x5622dda8de20 2024-09-12T17:29:05.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.132+0000 7fcc43a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:05.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.132+0000 7fcc43a0f800 20 started sync module instance, tier type = 2024-09-12T17:29:05.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.132+0000 7fcc43a0f800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:29:05.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.132+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622dda92960 con 0x5622dda89340 2024-09-12T17:29:05.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.133+0000 7fcc41d01640 1 -- 172.21.15.170:0/2347861268 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(44 notify.0 [create] v31'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc3c069040 con 0x5622dda89340 2024-09-12T17:29:05.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.133+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94707747728720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622dda925c0 con 0x5622dda89340 2024-09-12T17:29:05.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.133+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622dda94730 con 0x5622dda84950 2024-09-12T17:29:05.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.134+0000 7fcc41d01640 1 -- 172.21.15.170:0/2347861268 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94707747728720] v31'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc3c069040 con 0x5622dda89340 2024-09-12T17:29:05.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.134+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v31'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc2c03b040 con 0x5622dda84950 2024-09-12T17:29:05.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.134+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94707747732576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622dda94730 con 0x5622dda84950 2024-09-12T17:29:05.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.134+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622dda95150 con 0x5622dda8de20 2024-09-12T17:29:05.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.135+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94707747732576] v31'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc2c03b040 con 0x5622dda84950 2024-09-12T17:29:05.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.135+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v31'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc340a3040 con 0x5622dda8de20 2024-09-12T17:29:05.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.135+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94707747734144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622dda946a0 con 0x5622dda8de20 2024-09-12T17:29:05.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.135+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622dda96010 con 0x5622dda89340 2024-09-12T17:29:05.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.136+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94707747734144] v31'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc340a3040 con 0x5622dda8de20 2024-09-12T17:29:05.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.136+0000 7fcc41d01640 1 -- 172.21.15.170:0/2347861268 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(50 notify.3 [create] v31'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc3c069040 con 0x5622dda89340 2024-09-12T17:29:05.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.136+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94707747740512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622dda95f80 con 0x5622dda89340 2024-09-12T17:29:05.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.137+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622dda96ed0 con 0x5622dda84950 2024-09-12T17:29:05.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.138+0000 7fcc41d01640 1 -- 172.21.15.170:0/2347861268 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94707747740512] v31'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc3c069040 con 0x5622dda89340 2024-09-12T17:29:05.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.138+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v31'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc2c03b040 con 0x5622dda84950 2024-09-12T17:29:05.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.138+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94707747742720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622dda96ed0 con 0x5622dda84950 2024-09-12T17:29:05.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.138+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622dda97890 con 0x7fcc3c012a50 2024-09-12T17:29:05.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.139+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94707747742720] v31'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc2c03b040 con 0x5622dda84950 2024-09-12T17:29:05.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.139+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(54 notify.5 [create] v31'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc2c03b040 con 0x7fcc3c012a50 2024-09-12T17:29:05.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.139+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94707747747264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622dda96ed0 con 0x7fcc3c012a50 2024-09-12T17:29:05.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.139+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622dda982a0 con 0x7fcc3c012a50 2024-09-12T17:29:05.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.140+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94707747747264] v31'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc2c03b040 con 0x7fcc3c012a50 2024-09-12T17:29:05.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.140+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v31'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc2c03b040 con 0x7fcc3c012a50 2024-09-12T17:29:05.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.140+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94707747744768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622dda982a0 con 0x7fcc3c012a50 2024-09-12T17:29:05.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.140+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622dda98c60 con 0x7fcc3c012a50 2024-09-12T17:29:05.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.141+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(58 notify.7 [create] v31'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc2c03b040 con 0x7fcc3c012a50 2024-09-12T17:29:05.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.141+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94707747751856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622dda99080 con 0x7fcc3c012a50 2024-09-12T17:29:05.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.141+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94707747744768] v31'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc2c03b040 con 0x7fcc3c012a50 2024-09-12T17:29:05.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.141+0000 7fcc43a0f800 20 add_watcher() i=0 2024-09-12T17:29:05.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.141+0000 7fcc43a0f800 20 add_watcher() i=1 2024-09-12T17:29:05.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.141+0000 7fcc43a0f800 20 add_watcher() i=2 2024-09-12T17:29:05.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.141+0000 7fcc43a0f800 20 add_watcher() i=3 2024-09-12T17:29:05.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.141+0000 7fcc43a0f800 20 add_watcher() i=4 2024-09-12T17:29:05.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.141+0000 7fcc43a0f800 20 add_watcher() i=5 2024-09-12T17:29:05.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.141+0000 7fcc43a0f800 20 add_watcher() i=6 2024-09-12T17:29:05.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.142+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94707747751856] v31'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc2c03b040 con 0x7fcc3c012a50 2024-09-12T17:29:05.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.142+0000 7fcc43a0f800 20 add_watcher() i=7 2024-09-12T17:29:05.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.142+0000 7fcc43a0f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:29:05.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.142+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622dda99080 con 0x5622dda84950 2024-09-12T17:29:05.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.142+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcc2c03b040 con 0x5622dda84950 2024-09-12T17:29:05.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.142+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94707747752912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622dda99060 con 0x5622dda84950 2024-09-12T17:29:05.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.143+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94707747752912] v31'219 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcc2c03b040 con 0x5622dda84950 2024-09-12T17:29:05.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.143+0000 7fcaf77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:05.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.143+0000 7fcc43a0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:29:05.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.143+0000 7fcc43a0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:29:05.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.143+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaa49c0 con 0x5622dda84950 2024-09-12T17:29:05.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.145+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcc2c03b040 con 0x5622dda84950 2024-09-12T17:29:05.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.145+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaa49c0 con 0x7fcc3c012a50 2024-09-12T17:29:05.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.146+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcc2c03b040 con 0x7fcc3c012a50 2024-09-12T17:29:05.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.146+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaa5430 con 0x5622dda8de20 2024-09-12T17:29:05.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.147+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcc340a3040 con 0x5622dda8de20 2024-09-12T17:29:05.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.147+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaa3150 con 0x5622dda84950 2024-09-12T17:29:05.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.148+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'220 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcc2c03b040 con 0x5622dda84950 2024-09-12T17:29:05.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.148+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaa3110 con 0x5622dda89340 2024-09-12T17:29:05.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.149+0000 7fcc41d01640 1 -- 172.21.15.170:0/2347861268 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'68 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcc3c069040 con 0x5622dda89340 2024-09-12T17:29:05.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.149+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaa30b0 con 0x5622dda8de20 2024-09-12T17:29:05.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.150+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'45 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcc340a3040 con 0x5622dda8de20 2024-09-12T17:29:05.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.150+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaa31e0 con 0x5622dda84950 2024-09-12T17:29:05.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.151+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcc2c03b040 con 0x5622dda84950 2024-09-12T17:29:05.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.151+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaa33b0 con 0x7fcc3c012a50 2024-09-12T17:29:05.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.152+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'45 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcc2c03b040 con 0x7fcc3c012a50 2024-09-12T17:29:05.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.152+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaa5f90 con 0x5622dda89340 2024-09-12T17:29:05.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.153+0000 7fcc41d01640 1 -- 172.21.15.170:0/2347861268 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'27 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcc3c069040 con 0x5622dda89340 2024-09-12T17:29:05.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.153+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaa6020 con 0x5622dda8de20 2024-09-12T17:29:05.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.154+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcc340a3040 con 0x5622dda8de20 2024-09-12T17:29:05.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.154+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaa60b0 con 0x5622dda89340 2024-09-12T17:29:05.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.155+0000 7fcc41d01640 1 -- 172.21.15.170:0/2347861268 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'69 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc3c069040 con 0x5622dda89340 2024-09-12T17:29:05.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.155+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaa6140 con 0x7fcc3c012a50 2024-09-12T17:29:05.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.156+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'30 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc2c03b040 con 0x7fcc3c012a50 2024-09-12T17:29:05.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.156+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaa6140 con 0x5622dda89340 2024-09-12T17:29:05.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.157+0000 7fcc41d01640 1 -- 172.21.15.170:0/2347861268 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc3c069040 con 0x5622dda89340 2024-09-12T17:29:05.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.157+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaa6140 con 0x7fcc3c012a50 2024-09-12T17:29:05.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.158+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'51 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc2c03b040 con 0x7fcc3c012a50 2024-09-12T17:29:05.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.158+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaa6270 con 0x5622dda84950 2024-09-12T17:29:05.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.159+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'221 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc2c03b040 con 0x5622dda84950 2024-09-12T17:29:05.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.159+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaa6230 con 0x5622dda8de20 2024-09-12T17:29:05.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.161+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'62 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc340a3040 con 0x5622dda8de20 2024-09-12T17:29:05.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.161+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaa62c0 con 0x5622dda89340 2024-09-12T17:29:05.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.162+0000 7fcc41d01640 1 -- 172.21.15.170:0/2347861268 <== osd.2 v2:172.21.15.170:6808/3855567754 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'70 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc3c069040 con 0x5622dda89340 2024-09-12T17:29:05.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.162+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaa66e0 con 0x5622dda8de20 2024-09-12T17:29:05.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.163+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc340a3040 con 0x5622dda8de20 2024-09-12T17:29:05.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.163+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaa6650 con 0x5622dda84950 2024-09-12T17:29:05.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.164+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'36 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc2c03b040 con 0x5622dda84950 2024-09-12T17:29:05.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.164+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaa63d0 con 0x5622dda84950 2024-09-12T17:29:05.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.165+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'222 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc2c03b040 con 0x5622dda84950 2024-09-12T17:29:05.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.165+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaa63d0 con 0x5622dda8de20 2024-09-12T17:29:05.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.166+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'63 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc340a3040 con 0x5622dda8de20 2024-09-12T17:29:05.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.166+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaa63e0 con 0x5622dda89340 2024-09-12T17:29:05.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.166+0000 7fcc41d01640 1 -- 172.21.15.170:0/2347861268 <== osd.2 v2:172.21.15.170:6808/3855567754 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'37 uv32 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc3c069040 con 0x5622dda89340 2024-09-12T17:29:05.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.167+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaa6450 con 0x5622dda8de20 2024-09-12T17:29:05.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.167+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc340a3040 con 0x5622dda8de20 2024-09-12T17:29:05.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.167+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaa6450 con 0x5622dda8de20 2024-09-12T17:29:05.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.168+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc340a3040 con 0x5622dda8de20 2024-09-12T17:29:05.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.168+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaa6490 con 0x5622dda8de20 2024-09-12T17:29:05.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.169+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'22 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc340a3040 con 0x5622dda8de20 2024-09-12T17:29:05.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.169+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaa6490 con 0x5622dda8de20 2024-09-12T17:29:05.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.170+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'46 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc340a3040 con 0x5622dda8de20 2024-09-12T17:29:05.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.170+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaa64d0 con 0x7fcc3c012a50 2024-09-12T17:29:05.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.171+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc2c03b040 con 0x7fcc3c012a50 2024-09-12T17:29:05.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.171+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaa6510 con 0x5622dda8de20 2024-09-12T17:29:05.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.172+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc340a3040 con 0x5622dda8de20 2024-09-12T17:29:05.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.172+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaa6510 con 0x7fcc3c012a50 2024-09-12T17:29:05.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.173+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'46 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc2c03b040 con 0x7fcc3c012a50 2024-09-12T17:29:05.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.173+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaa6510 con 0x5622dda8de20 2024-09-12T17:29:05.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.174+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'64 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc340a3040 con 0x5622dda8de20 2024-09-12T17:29:05.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.174+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaa6510 con 0x7fcc3c012a50 2024-09-12T17:29:05.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.175+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'52 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc2c03b040 con 0x7fcc3c012a50 2024-09-12T17:29:05.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.175+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaa6550 con 0x5622dda89340 2024-09-12T17:29:05.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.176+0000 7fcc41d01640 1 -- 172.21.15.170:0/2347861268 <== osd.2 v2:172.21.15.170:6808/3855567754 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc3c069040 con 0x5622dda89340 2024-09-12T17:29:05.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.176+0000 7fcaf67e4640 20 reqs_thread_entry: start 2024-09-12T17:29:05.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.176+0000 7fcc43a0f800 20 init_complete bucket index max shards: 11 2024-09-12T17:29:05.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.176+0000 7fcc43a0f800 20 Filter name: none 2024-09-12T17:29:05.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.177+0000 7fca67fff640 20 reqs_thread_entry: start 2024-09-12T17:29:05.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.177+0000 7fcc43a0f800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-12T17:29:05.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.177+0000 7fcc43a0f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:05.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.177+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622ddad1470 con 0x5622dda89340 2024-09-12T17:29:05.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.177+0000 7fcc41d01640 1 -- 172.21.15.170:0/2347861268 <== osd.2 v2:172.21.15.170:6808/3855567754 21 ==== osd_op_reply(94 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fcc3c069040 con 0x5622dda89340 2024-09-12T17:29:05.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.177+0000 7fcc43a0f800 20 rados_obj.operate() r=0 bl.length=380 2024-09-12T17:29:05.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.177+0000 7fcc43a0f800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-12T17:29:05.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.177+0000 7fcc43a0f800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-12T17:29:05.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.177+0000 7fcc43a0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:29:05.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.177+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622ddad3ab0 con 0x5622dda84950 2024-09-12T17:29:05.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.177+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(95 bud.buckets [call out=184b] v0'0 uv4 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7fcc2c03b040 con 0x5622dda84950 2024-09-12T17:29:05.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.177+0000 7fcc43a0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9 : miss 2024-09-12T17:29:05.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.177+0000 7fcc43a0f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:05.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.177+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:96 8.8 8:12aa0ec1:root::.bucket.meta.myfoo6%3a7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622ddad3690 con 0x5622dda84950 2024-09-12T17:29:05.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.178+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(96 .bucket.meta.myfoo6:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9 [call out=48b,stat out=16b,read 0~388 out=388b,getxattrs out=212b] v0'0 uv6 ondisk = 0) ==== 333+0+664 (crc 0 0 0) 0x7fcc2c03b040 con 0x5622dda84950 2024-09-12T17:29:05.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.178+0000 7fcc43a0f800 20 rados_obj.operate() r=0 bl.length=388 2024-09-12T17:29:05.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.178+0000 7fcc43a0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9 info.flags=0x17 2024-09-12T17:29:05.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.178+0000 7fcc43a0f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9 to cache LRU end 2024-09-12T17:29:05.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.178+0000 7fcc43a0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:29:05.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.178+0000 7fcc43a0f800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-12T17:29:05.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.178+0000 7fcc43a0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9 2024-09-12T17:29:05.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.178+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:97 4.3a 4:5fdc18ce:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622ddb51320 con 0x5622dda8de20 2024-09-12T17:29:05.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.178+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 26 ==== osd_op_reply(97 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.0 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc340a3040 con 0x5622dda8de20 2024-09-12T17:29:05.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.178+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:98 4.5 4:a14b146e:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622ddb51320 con 0x5622dda8de20 2024-09-12T17:29:05.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.178+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 27 ==== osd_op_reply(98 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc340a3040 con 0x5622dda8de20 2024-09-12T17:29:05.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.178+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:99 4.8 4:13a949b8:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622ddb51320 con 0x5622dda8de20 2024-09-12T17:29:05.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.179+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 28 ==== osd_op_reply(99 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.2 [call out=89b] v0'0 uv4 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc340a3040 con 0x5622dda8de20 2024-09-12T17:29:05.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.179+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:100 4.22 4:4632626d:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622ddb51320 con 0x5622dda84950 2024-09-12T17:29:05.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.179+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(100 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc2c03b040 con 0x5622dda84950 2024-09-12T17:29:05.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.179+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:101 4.11 4:8be23baf:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622ddb51320 con 0x7fcc3c012a50 2024-09-12T17:29:05.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.179+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 23 ==== osd_op_reply(101 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.4 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc2c03b040 con 0x7fcc3c012a50 2024-09-12T17:29:05.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.180+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:102 4.9 4:93994fdb:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622ddb51320 con 0x5622dda84950 2024-09-12T17:29:05.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.180+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 30 ==== osd_op_reply(102 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.5 [call out=89b] v0'0 uv4 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc2c03b040 con 0x5622dda84950 2024-09-12T17:29:05.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.180+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:103 4.2a 4:56478508:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622ddb51320 con 0x5622dda84950 2024-09-12T17:29:05.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.180+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 31 ==== osd_op_reply(103 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc2c03b040 con 0x5622dda84950 2024-09-12T17:29:05.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.180+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:104 4.2 4:4103a046:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622ddb51320 con 0x5622dda89340 2024-09-12T17:29:05.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.180+0000 7fcc41d01640 1 -- 172.21.15.170:0/2347861268 <== osd.2 v2:172.21.15.170:6808/3855567754 22 ==== osd_op_reply(104 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.7 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc3c069040 con 0x5622dda89340 2024-09-12T17:29:05.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.180+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:105 4.13 4:ca5972e6:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622ddb51320 con 0x5622dda89340 2024-09-12T17:29:05.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.181+0000 7fcc41d01640 1 -- 172.21.15.170:0/2347861268 <== osd.2 v2:172.21.15.170:6808/3855567754 23 ==== osd_op_reply(105 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc3c069040 con 0x5622dda89340 2024-09-12T17:29:05.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.181+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:106 4.21 4:8790b4fe:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622ddb51320 con 0x7fcc3c012a50 2024-09-12T17:29:05.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.181+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 24 ==== osd_op_reply(106 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.9 [call out=349b] v0'0 uv7 ondisk = 0) ==== 194+0+349 (crc 0 0 0) 0x7fcc2c03b040 con 0x7fcc3c012a50 2024-09-12T17:29:05.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.181+0000 7fcc43a0f800 10 cls_bucket_list_unordered: got thirteen 2024-09-12T17:29:05.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.181+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:107 4.30 4:0d971fc5:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622ddb51320 con 0x5622dda8de20 2024-09-12T17:29:05.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.181+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 29 ==== osd_op_reply(107 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fcc340a3040 con 0x5622dda8de20 2024-09-12T17:29:05.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.182+0000 7fcc43a0f800 20 get_obj_state: octx=0x5622ddaa4b10 obj=myfoo6:thirteen state=0x5622ddb4f718 s->prefetch_data=0 2024-09-12T17:29:05.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.182+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:108 3.0 3:01e7e327:::7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622ddb50540 con 0x7fcc3c012a50 2024-09-12T17:29:05.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.182+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 25 ==== osd_op_reply(108 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9_thirteen [getxattrs out=820b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 238+0+836 (crc 0 0 0) 0x7fcc2c03b040 con 0x7fcc3c012a50 2024-09-12T17:29:05.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.182+0000 7fcc43a0f800 10 manifest: total_size = 8 2024-09-12T17:29:05.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.182+0000 7fcc43a0f800 20 get_obj_state: setting s->obj_tag to _g5_zQuEZETqZwHb-LtWOjwokQfeZnFt 2024-09-12T17:29:05.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.182+0000 7fcc43a0f800 20 get_obj_state: octx=0x5622ddaa4b10 obj=myfoo6:thirteen state=0x5622ddb4f718 s->prefetch_data=0 2024-09-12T17:29:05.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.182+0000 7fcc43a0f800 20 prepare_atomic_modification: state is not atomic. state=0x5622ddb4f718 2024-09-12T17:29:05.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.182+0000 7fcc43a0f800 20 bucket index object: :.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.9 2024-09-12T17:29:05.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.182+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:109 4.21 4:8790b4fe:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddb50fe0 con 0x7fcc3c012a50 2024-09-12T17:29:05.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.183+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 26 ==== osd_op_reply(109 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.9 [stat,call,call] v31'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fcc2c03b040 con 0x7fcc3c012a50 2024-09-12T17:29:05.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.183+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:110 3.0 3:01e7e327:::7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddb50fe0 con 0x7fcc3c012a50 2024-09-12T17:29:05.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.184+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 27 ==== osd_op_reply(110 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9_thirteen [call] v31'3 uv3 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7fcc2c03b040 con 0x7fcc3c012a50 2024-09-12T17:29:05.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.184+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:111 4.21 4:8790b4fe:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddad8bd0 con 0x7fcc3c012a50 2024-09-12T17:29:05.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.184+0000 7fcc43a0f800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:29:05.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.184+0000 7fcc43a0f800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:29:05.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.184+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:112 4.3a 4:5fdc18ce:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622ddad8bd0 con 0x5622dda8de20 2024-09-12T17:29:05.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.184+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:113 4.5 4:a14b146e:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622ddadce90 con 0x5622dda8de20 2024-09-12T17:29:05.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.184+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:114 4.8 4:13a949b8:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622ddad8bd0 con 0x5622dda8de20 2024-09-12T17:29:05.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.184+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:115 4.22 4:4632626d:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622ddae1cc0 con 0x5622dda84950 2024-09-12T17:29:05.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.184+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:116 4.11 4:8be23baf:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622ddae46b0 con 0x7fcc3c012a50 2024-09-12T17:29:05.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.184+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:117 4.9 4:93994fdb:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622ddae7080 con 0x5622dda84950 2024-09-12T17:29:05.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.184+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:118 4.2a 4:56478508:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622ddae46b0 con 0x5622dda84950 2024-09-12T17:29:05.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.184+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:119 4.2 4:4103a046:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaebfe0 con 0x5622dda89340 2024-09-12T17:29:05.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.184+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:120 4.13 4:ca5972e6:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaeeb00 con 0x5622dda89340 2024-09-12T17:29:05.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.184+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:121 4.21 4:8790b4fe:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaf1860 con 0x7fcc3c012a50 2024-09-12T17:29:05.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.184+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:122 4.30 4:0d971fc5:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaf46b0 con 0x5622dda8de20 2024-09-12T17:29:05.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.184+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 30 ==== osd_op_reply(112 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.0 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc340ac040 con 0x5622dda8de20 2024-09-12T17:29:05.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.184+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 31 ==== osd_op_reply(113 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc340ac040 con 0x5622dda8de20 2024-09-12T17:29:05.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.184+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 32 ==== osd_op_reply(114 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.2 [call out=89b] v0'0 uv4 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc340ac040 con 0x5622dda8de20 2024-09-12T17:29:05.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.185+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 28 ==== osd_op_reply(116 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.4 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc2c03b040 con 0x7fcc3c012a50 2024-09-12T17:29:05.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.185+0000 7fcc41d01640 1 -- 172.21.15.170:0/2347861268 <== osd.2 v2:172.21.15.170:6808/3855567754 24 ==== osd_op_reply(119 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.7 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc3c069040 con 0x5622dda89340 2024-09-12T17:29:05.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.185+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 32 ==== osd_op_reply(115 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc2c03b040 con 0x5622dda84950 2024-09-12T17:29:05.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.185+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 33 ==== osd_op_reply(122 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fcc340ac040 con 0x5622dda8de20 2024-09-12T17:29:05.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.185+0000 7fcc41d01640 1 -- 172.21.15.170:0/2347861268 <== osd.2 v2:172.21.15.170:6808/3855567754 25 ==== osd_op_reply(120 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc3c069040 con 0x5622dda89340 2024-09-12T17:29:05.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.185+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 33 ==== osd_op_reply(118 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc2c03b040 con 0x5622dda84950 2024-09-12T17:29:05.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.185+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 34 ==== osd_op_reply(117 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.5 [call out=89b] v0'0 uv4 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc2c03b040 con 0x5622dda84950 2024-09-12T17:29:05.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.185+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 29 ==== osd_op_reply(111 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.9 [stat,call,call] v31'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fcc2c03b040 con 0x7fcc3c012a50 2024-09-12T17:29:05.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.185+0000 7fcb17fff640 20 handle_completion(): completion ok for obj=thirteen 2024-09-12T17:29:05.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.185+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 30 ==== osd_op_reply(121 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.9 [call out=128b] v0'0 uv9 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fcc2c03b040 con 0x7fcc3c012a50 2024-09-12T17:29:05.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.186+0000 7fcc43a0f800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:29:05.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.186+0000 7fcc43a0f800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:29:05.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.186+0000 7fcc43a0f800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:29:05.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.186+0000 7fcc43a0f800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:29:05.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.186+0000 7fcc43a0f800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9])"; uploads.size()=0; is_truncated=0 2024-09-12T17:29:05.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.186+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:123 4.3a 4:5fdc18ce:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaf18c0 con 0x5622dda8de20 2024-09-12T17:29:05.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.186+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:124 4.5 4:a14b146e:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaeeb00 con 0x5622dda8de20 2024-09-12T17:29:05.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.186+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:125 4.8 4:13a949b8:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaebfe0 con 0x5622dda8de20 2024-09-12T17:29:05.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.186+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:126 4.22 4:4632626d:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaf4630 con 0x5622dda84950 2024-09-12T17:29:05.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.186+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:127 4.11 4:8be23baf:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaf18c0 con 0x7fcc3c012a50 2024-09-12T17:29:05.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.186+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:128 4.9 4:93994fdb:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaebfe0 con 0x5622dda84950 2024-09-12T17:29:05.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.186+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:129 4.2a 4:56478508:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaeeb00 con 0x5622dda84950 2024-09-12T17:29:05.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.186+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:130 4.2 4:4103a046:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622ddada9c0 con 0x5622dda89340 2024-09-12T17:29:05.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.186+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:131 4.13 4:ca5972e6:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaebfe0 con 0x5622dda89340 2024-09-12T17:29:05.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.186+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 34 ==== osd_op_reply(123 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.0 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc340ac040 con 0x5622dda8de20 2024-09-12T17:29:05.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.186+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 35 ==== osd_op_reply(124 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc340ac040 con 0x5622dda8de20 2024-09-12T17:29:05.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.186+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 36 ==== osd_op_reply(125 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.2 [call out=89b] v0'0 uv4 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc340ac040 con 0x5622dda8de20 2024-09-12T17:29:05.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.186+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 31 ==== osd_op_reply(127 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.4 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc2c055040 con 0x7fcc3c012a50 2024-09-12T17:29:05.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.186+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:132 4.21 4:8790b4fe:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaf18c0 con 0x7fcc3c012a50 2024-09-12T17:29:05.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.186+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 35 ==== osd_op_reply(126 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc2c055040 con 0x5622dda84950 2024-09-12T17:29:05.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.186+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:133 4.30 4:0d971fc5:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622ddada9c0 con 0x5622dda8de20 2024-09-12T17:29:05.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.186+0000 7fcc41d01640 1 -- 172.21.15.170:0/2347861268 <== osd.2 v2:172.21.15.170:6808/3855567754 26 ==== osd_op_reply(130 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.7 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc3c069040 con 0x5622dda89340 2024-09-12T17:29:05.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.186+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 36 ==== osd_op_reply(128 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.5 [call out=89b] v0'0 uv4 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc2c055040 con 0x5622dda84950 2024-09-12T17:29:05.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.186+0000 7fcc41d01640 1 -- 172.21.15.170:0/2347861268 <== osd.2 v2:172.21.15.170:6808/3855567754 27 ==== osd_op_reply(131 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc3c069040 con 0x5622dda89340 2024-09-12T17:29:05.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.186+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 37 ==== osd_op_reply(129 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fcc2c055040 con 0x5622dda84950 2024-09-12T17:29:05.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.186+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 37 ==== osd_op_reply(133 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fcc340ac040 con 0x5622dda8de20 2024-09-12T17:29:05.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.187+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 32 ==== osd_op_reply(132 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.9 [call out=128b] v0'0 uv9 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fcc2c055040 con 0x7fcc3c012a50 2024-09-12T17:29:05.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.187+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:134 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaf4630 con 0x5622dda84950 2024-09-12T17:29:05.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.188+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 38 ==== osd_op_reply(134 bud.buckets [call] v31'5 uv5 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fcc2c055040 con 0x5622dda84950 2024-09-12T17:29:05.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.188+0000 7fcc43a0f800 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-09-12T17:29:05.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.188+0000 7fcc43a0f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:05.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.188+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:135 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaebfe0 con 0x5622dda84950 2024-09-12T17:29:05.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.188+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 39 ==== osd_op_reply(135 myfoo6 [call out=48b,read 0~166 out=166b] v0'0 uv17 ondisk = 0) ==== 192+0+214 (crc 0 0 0) 0x7fcc2c055040 con 0x5622dda84950 2024-09-12T17:29:05.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.188+0000 7fcc43a0f800 20 rados_obj.operate() r=0 bl.length=166 2024-09-12T17:29:05.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.188+0000 7fcc43a0f800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x11 2024-09-12T17:29:05.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.188+0000 7fcc43a0f800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-12T17:29:05.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.188+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:136 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaf4630 con 0x5622dda84950 2024-09-12T17:29:05.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.189+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 40 ==== osd_op_reply(136 myfoo6 [call,call,delete] v31'18 uv18 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7fcc2c055040 con 0x5622dda84950 2024-09-12T17:29:05.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.189+0000 7fcc43a0f800 10 removing default.rgw.meta+root+myfoo6 from cache 2024-09-12T17:29:05.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.189+0000 7fcc43a0f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-12T17:29:05.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.189+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94707748116576 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaf4610 con 0x5622dda89340 2024-09-12T17:29:05.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.189+0000 7fcc41d01640 1 -- 172.21.15.170:0/2347861268 <== osd.2 v2:172.21.15.170:6808/3855567754 28 ==== watch-notify(notify (1) cookie 94707747740512 notify 133143986193 ret 0) ==== 192+0+0 (crc 0 0 0) 0x5622dda79810 con 0x5622dda89340 2024-09-12T17:29:05.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.189+0000 7fcb24ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986193 cookie 94707747740512 notifier 4750 bl.length()=150 2024-09-12T17:29:05.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.189+0000 7fcb24ff9640 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fcb04003d60 con 0x5622dda89340 2024-09-12T17:29:05.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.189+0000 7fcc41d01640 1 -- 172.21.15.170:0/2347861268 <== osd.2 v2:172.21.15.170:6808/3855567754 29 ==== osd_op_reply(137 notify.3 [notify cookie 94707748116576 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcc3c069040 con 0x5622dda89340 2024-09-12T17:29:05.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.189+0000 7fcc41d01640 1 -- 172.21.15.170:0/2347861268 <== osd.2 v2:172.21.15.170:6808/3855567754 30 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc3c069040 con 0x5622dda89340 2024-09-12T17:29:05.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.189+0000 7fcc41d01640 1 -- 172.21.15.170:0/2347861268 <== osd.2 v2:172.21.15.170:6808/3855567754 31 ==== watch-notify(notify_complete (2) cookie 94707748116576 notify 133143986193 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5622dda79580 con 0x5622dda89340 2024-09-12T17:29:05.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.190+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:139 8.8 8:12aa0ec1:root::.bucket.meta.myfoo6%3a7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaf4610 con 0x5622dda84950 2024-09-12T17:29:05.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.190+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 41 ==== osd_op_reply(139 .bucket.meta.myfoo6:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9 [call,call,delete] v31'7 uv7 ondisk = 0) ==== 291+0+0 (crc 0 0 0) 0x7fcc2c055040 con 0x5622dda84950 2024-09-12T17:29:05.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.190+0000 7fcc43a0f800 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9 from cache 2024-09-12T17:29:05.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.190+0000 7fcc43a0f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9, ofs0, ns] 2024-09-12T17:29:05.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.190+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:140 7.15 7:a93a5511:::notify.2:head [notify cookie 94707748116576 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaf4610 con 0x5622dda8de20 2024-09-12T17:29:05.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.191+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 38 ==== watch-notify(notify (1) cookie 94707747734144 notify 133143986192 ret 0) ==== 249+0+0 (crc 0 0 0) 0x5622ddaa3760 con 0x5622dda8de20 2024-09-12T17:29:05.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.191+0000 7fcb17fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986192 cookie 94707747734144 notifier 4750 bl.length()=207 2024-09-12T17:29:05.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.191+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 39 ==== osd_op_reply(140 notify.2 [notify cookie 94707748116576 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcc340ac040 con 0x5622dda8de20 2024-09-12T17:29:05.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.191+0000 7fcb17fff640 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:141 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fca74003380 con 0x5622dda8de20 2024-09-12T17:29:05.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.191+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 40 ==== osd_op_reply(141 notify.2 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc340ac040 con 0x5622dda8de20 2024-09-12T17:29:05.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.191+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 41 ==== watch-notify(notify_complete (2) cookie 94707748116576 notify 133143986192 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5622ddaa39b0 con 0x5622dda8de20 2024-09-12T17:29:05.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.191+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:142 4.3a 4:5fdc18ce:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaf45f0 con 0x5622dda8de20 2024-09-12T17:29:05.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.191+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:143 4.5 4:a14b146e:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaf1860 con 0x5622dda8de20 2024-09-12T17:29:05.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.191+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:144 4.8 4:13a949b8:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddad20c0 con 0x5622dda8de20 2024-09-12T17:29:05.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.191+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:145 4.22 4:4632626d:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaf1d80 con 0x5622dda84950 2024-09-12T17:29:05.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.191+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:146 4.11 4:8be23baf:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaf45f0 con 0x7fcc3c012a50 2024-09-12T17:29:05.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.191+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:147 4.9 4:93994fdb:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddb4f020 con 0x5622dda84950 2024-09-12T17:29:05.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.191+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:148 4.2a 4:56478508:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaf1860 con 0x5622dda84950 2024-09-12T17:29:05.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.191+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:149 4.2 4:4103a046:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaf1d80 con 0x5622dda89340 2024-09-12T17:29:05.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.191+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:150 4.13 4:ca5972e6:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddad20c0 con 0x5622dda89340 2024-09-12T17:29:05.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.191+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:151 4.21 4:8790b4fe:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddb4f020 con 0x7fcc3c012a50 2024-09-12T17:29:05.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.191+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:152 4.30 4:0d971fc5:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaf1860 con 0x5622dda8de20 2024-09-12T17:29:05.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.193+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 42 ==== osd_op_reply(142 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.0 [delete] v31'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcc340ac040 con 0x5622dda8de20 2024-09-12T17:29:05.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.193+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 33 ==== osd_op_reply(151 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.9 [delete] v31'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcc2c055040 con 0x7fcc3c012a50 2024-09-12T17:29:05.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.193+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 42 ==== osd_op_reply(147 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.5 [delete] v31'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcc2c055040 con 0x5622dda84950 2024-09-12T17:29:05.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.193+0000 7fcc41d01640 1 -- 172.21.15.170:0/2347861268 <== osd.2 v2:172.21.15.170:6808/3855567754 32 ==== osd_op_reply(149 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.7 [delete] v31'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcc3c069040 con 0x5622dda89340 2024-09-12T17:29:05.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.194+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 43 ==== osd_op_reply(148 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.6 [delete] v31'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcc2c055040 con 0x5622dda84950 2024-09-12T17:29:05.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.194+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 43 ==== osd_op_reply(143 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.1 [delete] v31'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcc340ac040 con 0x5622dda8de20 2024-09-12T17:29:05.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.194+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 44 ==== osd_op_reply(144 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.2 [delete] v31'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcc340ac040 con 0x5622dda8de20 2024-09-12T17:29:05.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.194+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 34 ==== osd_op_reply(146 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.4 [delete] v31'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcc2c055040 con 0x7fcc3c012a50 2024-09-12T17:29:05.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.194+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 44 ==== osd_op_reply(145 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.3 [delete] v31'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcc2c055040 con 0x5622dda84950 2024-09-12T17:29:05.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.194+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 45 ==== osd_op_reply(152 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.10 [delete] v31'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fcc340ac040 con 0x5622dda8de20 2024-09-12T17:29:05.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.194+0000 7fcc41d01640 1 -- 172.21.15.170:0/2347861268 <== osd.2 v2:172.21.15.170:6808/3855567754 33 ==== osd_op_reply(150 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9.8 [delete] v31'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcc3c069040 con 0x5622dda89340 2024-09-12T17:29:05.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.194+0000 7fcc43a0f800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo6/7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9 : miss 2024-09-12T17:29:05.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.194+0000 7fcc43a0f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:05.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.194+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:153 6.18 6:18ad7957:::pubsub..bucket.myfoo6%2f7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaf45f0 con 0x7fcc3c012a50 2024-09-12T17:29:05.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.194+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 35 ==== osd_op_reply(153 pubsub..bucket.myfoo6/7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7fcc2c055040 con 0x7fcc3c012a50 2024-09-12T17:29:05.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.194+0000 7fcc43a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:05.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.194+0000 7fcc43a0f800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo6/7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9 info.flags=0x0 2024-09-12T17:29:05.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.194+0000 7fcc43a0f800 10 adding default.rgw.log++pubsub..bucket.myfoo6/7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9 to cache LRU end 2024-09-12T17:29:05.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.194+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:154 6.18 6:18ad7957:::pubsub..bucket.myfoo6%2f7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaf45f0 con 0x7fcc3c012a50 2024-09-12T17:29:05.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.195+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 36 ==== osd_op_reply(154 pubsub..bucket.myfoo6/7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.9 [delete] v31'27 uv21 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7fcc2c055040 con 0x7fcc3c012a50 2024-09-12T17:29:05.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.195+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:155 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaf45f0 con 0x5622dda84950 2024-09-12T17:29:05.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.196+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 45 ==== osd_op_reply(155 bud.buckets [call] v31'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fcc2c055040 con 0x5622dda84950 2024-09-12T17:29:05.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.196+0000 7fcc43a0f800 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-09-12T17:29:05.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.196+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:156 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaf45f0 con 0x5622dda84950 2024-09-12T17:29:05.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.197+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 46 ==== osd_op_reply(156 NX5QOQKC6BH2IDN8HC7A [delete] v31'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fcc2c055040 con 0x5622dda84950 2024-09-12T17:29:05.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.197+0000 7fcc43a0f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-12T17:29:05.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.197+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:157 7.3 7:c609908c:::notify.5:head [notify cookie 94707748117760 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaf45f0 con 0x7fcc3c012a50 2024-09-12T17:29:05.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.197+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 37 ==== watch-notify(notify (1) cookie 94707747747264 notify 133143986215 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5622ddad2c20 con 0x7fcc3c012a50 2024-09-12T17:29:05.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.197+0000 7fcb24ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986215 cookie 94707747747264 notifier 4750 bl.length()=170 2024-09-12T17:29:05.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.197+0000 7fcb24ff9640 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:158 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fcb04003d60 con 0x7fcc3c012a50 2024-09-12T17:29:05.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.197+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 38 ==== osd_op_reply(157 notify.5 [notify cookie 94707748117760 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcc2c055040 con 0x7fcc3c012a50 2024-09-12T17:29:05.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.198+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 39 ==== osd_op_reply(158 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc2c055040 con 0x7fcc3c012a50 2024-09-12T17:29:05.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.198+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 40 ==== watch-notify(notify_complete (2) cookie 94707748117760 notify 133143986215 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fcc2c05d040 con 0x7fcc3c012a50 2024-09-12T17:29:05.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.198+0000 7fcc43a0f800 10 removing email index: 2024-09-12T17:29:05.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.198+0000 7fcc43a0f800 10 removing user buckets index 2024-09-12T17:29:05.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.198+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:159 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaf45f0 con 0x5622dda84950 2024-09-12T17:29:05.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.199+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 47 ==== osd_op_reply(159 bud.buckets [delete] v31'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fcc2c055040 con 0x5622dda84950 2024-09-12T17:29:05.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.199+0000 7fcc43a0f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-09-12T17:29:05.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.199+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94707748117760 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaf45f0 con 0x7fcc3c012a50 2024-09-12T17:29:05.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.199+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 41 ==== watch-notify(notify (1) cookie 94707747744768 notify 133143986216 ret 0) ==== 202+0+0 (crc 0 0 0) 0x7fcc2c05d040 con 0x7fcc3c012a50 2024-09-12T17:29:05.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.199+0000 7fcb17fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986216 cookie 94707747744768 notifier 4750 bl.length()=160 2024-09-12T17:29:05.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.199+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 42 ==== osd_op_reply(160 notify.6 [notify cookie 94707748117760 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcc2c055040 con 0x7fcc3c012a50 2024-09-12T17:29:05.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.199+0000 7fcb17fff640 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fca74003340 con 0x7fcc3c012a50 2024-09-12T17:29:05.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.200+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 43 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc2c055040 con 0x7fcc3c012a50 2024-09-12T17:29:05.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.200+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 44 ==== watch-notify(notify_complete (2) cookie 94707748117760 notify 133143986216 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5622dda9e270 con 0x7fcc3c012a50 2024-09-12T17:29:05.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.200+0000 7fcc43a0f800 10 removing user index: bud 2024-09-12T17:29:05.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.200+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:162 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaf45f0 con 0x5622dda89340 2024-09-12T17:29:05.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.201+0000 7fcc41d01640 1 -- 172.21.15.170:0/2347861268 <== osd.2 v2:172.21.15.170:6808/3855567754 34 ==== osd_op_reply(162 bud [call,call,delete] v31'3 uv3 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fcc3c069040 con 0x5622dda89340 2024-09-12T17:29:05.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.201+0000 7fcc43a0f800 10 removing default.rgw.meta+users.uid+bud from cache 2024-09-12T17:29:05.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.201+0000 7fcc43a0f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-12T17:29:05.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.201+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94707748117760 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaf45f0 con 0x7fcc3c012a50 2024-09-12T17:29:05.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.201+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 45 ==== watch-notify(notify (1) cookie 94707747747264 notify 133143986217 ret 0) ==== 194+0+0 (crc 0 0 0) 0x5622dda9e270 con 0x7fcc3c012a50 2024-09-12T17:29:05.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.201+0000 7fcb24ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986217 cookie 94707747747264 notifier 4750 bl.length()=152 2024-09-12T17:29:05.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.201+0000 7fcb24ff9640 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fcb04003d60 con 0x7fcc3c012a50 2024-09-12T17:29:05.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.201+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 46 ==== osd_op_reply(163 notify.5 [notify cookie 94707748117760 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcc2c055040 con 0x7fcc3c012a50 2024-09-12T17:29:05.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.201+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 47 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc2c055040 con 0x7fcc3c012a50 2024-09-12T17:29:05.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.202+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 48 ==== watch-notify(notify_complete (2) cookie 94707748117760 notify 133143986217 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5622ddaa4d60 con 0x7fcc3c012a50 2024-09-12T17:29:05.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.202+0000 7fcaf77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:05.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.202+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94707747752912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaf45f0 con 0x5622dda84950 2024-09-12T17:29:05.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.203+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 48 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94707747752912] v31'223 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcc2c055040 con 0x5622dda84950 2024-09-12T17:29:05.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.203+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94707747728720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaf45f0 con 0x5622dda89340 2024-09-12T17:29:05.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.204+0000 7fcc41d01640 1 -- 172.21.15.170:0/2347861268 <== osd.2 v2:172.21.15.170:6808/3855567754 35 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94707747728720] v31'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc3c069040 con 0x5622dda89340 2024-09-12T17:29:05.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.204+0000 7fcc43a0f800 20 remove_watcher() i=0 2024-09-12T17:29:05.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.204+0000 7fcc43a0f800 2 removed watcher, disabling cache 2024-09-12T17:29:05.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.204+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94707747732576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaf45f0 con 0x5622dda84950 2024-09-12T17:29:05.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.205+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 49 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94707747732576] v31'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc2c055040 con 0x5622dda84950 2024-09-12T17:29:05.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.205+0000 7fcc43a0f800 20 remove_watcher() i=1 2024-09-12T17:29:05.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.205+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94707747734144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddaf45f0 con 0x5622dda8de20 2024-09-12T17:29:05.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.206+0000 7fcc41500640 1 -- 172.21.15.170:0/2347861268 <== osd.3 v2:172.21.15.170:6816/2664906588 46 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94707747734144] v31'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc340ac040 con 0x5622dda8de20 2024-09-12T17:29:05.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.206+0000 7fcc43a0f800 20 remove_watcher() i=2 2024-09-12T17:29:05.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.206+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94707747740512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddad8ec0 con 0x5622dda89340 2024-09-12T17:29:05.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.207+0000 7fcc41d01640 1 -- 172.21.15.170:0/2347861268 <== osd.2 v2:172.21.15.170:6808/3855567754 36 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94707747740512] v31'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc3c069040 con 0x5622dda89340 2024-09-12T17:29:05.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.207+0000 7fcc43a0f800 20 remove_watcher() i=3 2024-09-12T17:29:05.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.207+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94707747742720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddad8ec0 con 0x5622dda84950 2024-09-12T17:29:05.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.208+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.1 v2:172.21.15.170:6800/1903654092 50 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94707747742720] v31'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc2c055040 con 0x5622dda84950 2024-09-12T17:29:05.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.209+0000 7fcc43a0f800 20 remove_watcher() i=4 2024-09-12T17:29:05.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.209+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94707747747264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddad8ec0 con 0x7fcc3c012a50 2024-09-12T17:29:05.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.210+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 49 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94707747747264] v31'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc2c055040 con 0x7fcc3c012a50 2024-09-12T17:29:05.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.210+0000 7fcc43a0f800 20 remove_watcher() i=5 2024-09-12T17:29:05.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.210+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94707747744768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddad8ec0 con 0x7fcc3c012a50 2024-09-12T17:29:05.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.211+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 50 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94707747744768] v31'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc2c055040 con 0x7fcc3c012a50 2024-09-12T17:29:05.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.211+0000 7fcc43a0f800 20 remove_watcher() i=6 2024-09-12T17:29:05.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.211+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94707747751856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622ddad8ec0 con 0x7fcc3c012a50 2024-09-12T17:29:05.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.212+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 <== osd.0 v2:172.21.15.47:6800/3978157098 51 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94707747751856] v31'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc2c055040 con 0x7fcc3c012a50 2024-09-12T17:29:05.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.212+0000 7fcc43a0f800 20 remove_watcher() i=7 2024-09-12T17:29:05.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.212+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fcc3c012a50 msgr2=0x7fcc3c0145e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:05.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.212+0000 7fcc43a0f800 1 --2- 172.21.15.170:0/2347861268 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fcc3c012a50 0x7fcc3c0145e0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.212+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5622dda84950 msgr2=0x5622dda86e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:05.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.212+0000 7fcc43a0f800 1 --2- 172.21.15.170:0/2347861268 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5622dda84950 0x5622dda86e10 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.212+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5622dda89340 msgr2=0x5622dda8b730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:05.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.212+0000 7fcc43a0f800 1 --2- 172.21.15.170:0/2347861268 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5622dda89340 0x5622dda8b730 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.212+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5622dda8de20 msgr2=0x5622dda902e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:05.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.212+0000 7fcc43a0f800 1 --2- 172.21.15.170:0/2347861268 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5622dda8de20 0x5622dda902e0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.212+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fcb0c03c780 msgr2=0x7fcb0c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:05.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.212+0000 7fcc43a0f800 1 --2- 172.21.15.170:0/2347861268 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fcb0c03c780 0x7fcb0c03ec40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fcc3406afb0 tx=0x7fcc3408f000 comp rx=0 tx=0).stop 2024-09-12T17:29:05.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.212+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622dda71a60 msgr2=0x5622dda79020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:05.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.212+0000 7fcc43a0f800 1 --2- 172.21.15.170:0/2347861268 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622dda71a60 0x5622dda79020 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c020790 tx=0x7fcc3c053d00 comp rx=0 tx=0).stop 2024-09-12T17:29:05.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.212+0000 7fcc40cff640 1 -- 172.21.15.170:0/2347861268 reap_dead start 2024-09-12T17:29:05.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.212+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 shutdown_connections 2024-09-12T17:29:05.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.212+0000 7fcc43a0f800 1 --2- 172.21.15.170:0/2347861268 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622dda71a60 0x5622dda79020 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.212+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 >> 172.21.15.170:0/2347861268 conn(0x5622dda69a50 msgr2=0x5622dda67c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:05.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.212+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 shutdown_connections 2024-09-12T17:29:05.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.212+0000 7fcc43a0f800 1 -- 172.21.15.170:0/2347861268 wait complete. 2024-09-12T17:29:05.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.212+0000 7fcc43a0f800 1 -- 172.21.15.170:0/281199280 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fcb1803c730 msgr2=0x7fcb1803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:05.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.212+0000 7fcc43a0f800 1 --2- 172.21.15.170:0/281199280 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fcb1803c730 0x7fcb1803ebf0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x5622dda474f0 tx=0x7fcc3400a2e0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.212+0000 7fcc43a0f800 1 -- 172.21.15.170:0/281199280 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622dda60b70 msgr2=0x5622dda60f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:05.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.212+0000 7fcc43a0f800 1 --2- 172.21.15.170:0/281199280 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622dda60b70 0x5622dda60f90 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x5622dda46b80 tx=0x7fcc3c0167b0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.213+0000 7fcc43a0f800 1 -- 172.21.15.170:0/281199280 shutdown_connections 2024-09-12T17:29:05.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.213+0000 7fcc43a0f800 1 --2- 172.21.15.170:0/281199280 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fcb1803c730 0x7fcb1803ebf0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.213+0000 7fcc43a0f800 1 --2- 172.21.15.170:0/281199280 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622dda60b70 0x5622dda60f90 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.213+0000 7fcc43a0f800 1 -- 172.21.15.170:0/281199280 >> 172.21.15.170:0/281199280 conn(0x5622dda54f20 msgr2=0x5622dda55300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:05.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.213+0000 7fcc43a0f800 1 -- 172.21.15.170:0/281199280 shutdown_connections 2024-09-12T17:29:05.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.213+0000 7fcc43a0f800 1 -- 172.21.15.170:0/281199280 wait complete. 2024-09-12T17:29:05.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.213+0000 7fcc43a0f800 1 -- 172.21.15.170:0/336476446 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5622dd951040 msgr2=0x5622dda4d340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:05.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.213+0000 7fcc43a0f800 1 --2- 172.21.15.170:0/336476446 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5622dd951040 0x5622dda4d340 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.213+0000 7fcc43a0f800 1 -- 172.21.15.170:0/336476446 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5622dda4f690 msgr2=0x5622dda51b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:05.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.213+0000 7fcc43a0f800 1 --2- 172.21.15.170:0/336476446 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5622dda4f690 0x5622dda51b30 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.213+0000 7fcc43a0f800 1 -- 172.21.15.170:0/336476446 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fcb2803c780 msgr2=0x7fcb2803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:05.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.213+0000 7fcc43a0f800 1 --2- 172.21.15.170:0/336476446 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fcb2803c780 0x7fcb2803ec40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c001e30 tx=0x7fcc2c001390 comp rx=0 tx=0).stop 2024-09-12T17:29:05.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.213+0000 7fcc43a0f800 1 -- 172.21.15.170:0/336476446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622dd94fe00 msgr2=0x5622dda45cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:05.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.213+0000 7fcc43a0f800 1 --2- 172.21.15.170:0/336476446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622dd94fe00 0x5622dda45cf0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fcc34027c60 tx=0x7fcc34002fb0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.213+0000 7fcc43a0f800 1 -- 172.21.15.170:0/336476446 shutdown_connections 2024-09-12T17:29:05.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.213+0000 7fcc43a0f800 1 --2- 172.21.15.170:0/336476446 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5622dda4f690 0x5622dda51b30 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.213+0000 7fcc43a0f800 1 --2- 172.21.15.170:0/336476446 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fcb2803c780 0x7fcb2803ec40 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.213+0000 7fcc43a0f800 1 --2- 172.21.15.170:0/336476446 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5622dd951040 0x5622dda4d340 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.213+0000 7fcc43a0f800 1 --2- 172.21.15.170:0/336476446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622dd94fe00 0x5622dda45cf0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.213+0000 7fcc43a0f800 1 -- 172.21.15.170:0/336476446 >> 172.21.15.170:0/336476446 conn(0x5622dd94b1d0 msgr2=0x5622dda3f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:05.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.213+0000 7fcc43a0f800 1 -- 172.21.15.170:0/336476446 shutdown_connections 2024-09-12T17:29:05.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.213+0000 7fcc43a0f800 1 -- 172.21.15.170:0/336476446 wait complete. 2024-09-12T17:29:05.223 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-12T17:29:05.223 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-12T17:29:05.223 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-09-12T17:29:05.268 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:29:05.268 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:29:05.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.268+0000 7fe4e2b25800 1 Processor -- start 2024-09-12T17:29:05.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.268+0000 7fe4e2b25800 1 -- start start 2024-09-12T17:29:05.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.268+0000 7fe4e2b25800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55840a2ac210 0x55840a2b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:05.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.268+0000 7fe4e2b25800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55840a155e40 con 0x55840a2aae00 2024-09-12T17:29:05.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.268+0000 7fe4e2b25800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x55840a120680 con 0x55840a2ac210 2024-09-12T17:29:05.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.268+0000 7fe4d7fff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55840a2ac210 0x55840a2b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:05.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.268+0000 7fe4de7ae640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x55840a2aae00 0x55840a2abb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:50964/0 (socket says 172.21.15.170:50964) 2024-09-12T17:29:05.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.268+0000 7fe4d7fff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55840a2ac210 0x55840a2b1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:36428/0 (socket says 172.21.15.170:36428) 2024-09-12T17:29:05.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.268+0000 7fe4de7ae640 1 -- 172.21.15.170:0/838831717 learned_addr learned my addr 172.21.15.170:0/838831717 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:29:05.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.268+0000 7fe4d7fff640 1 -- 172.21.15.170:0/838831717 >> v1:172.21.15.47:6789/0 conn(0x55840a2aae00 legacy=0x55840a2abb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:05.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.268+0000 7fe4d7fff640 1 -- 172.21.15.170:0/838831717 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55840a13c6b0 con 0x55840a2ac210 2024-09-12T17:29:05.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.270+0000 7fe4d7fff640 1 --2- 172.21.15.170:0/838831717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55840a2ac210 0x55840a2b1db0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fe4c800a470 tx=0x7fe4c8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f7213b1970f405e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:05.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.270+0000 7fe4ddfad640 1 -- 172.21.15.170:0/838831717 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4c8053570 con 0x55840a2ac210 2024-09-12T17:29:05.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.270+0000 7fe4ddfad640 1 -- 172.21.15.170:0/838831717 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4c8058070 con 0x55840a2ac210 2024-09-12T17:29:05.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.270+0000 7fe4ddfad640 1 -- 172.21.15.170:0/838831717 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4c8053880 con 0x55840a2ac210 2024-09-12T17:29:05.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.271+0000 7fe4e2b25800 1 -- 172.21.15.170:0/838831717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55840a2ac210 msgr2=0x55840a2b1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:05.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.271+0000 7fe4e2b25800 1 --2- 172.21.15.170:0/838831717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55840a2ac210 0x55840a2b1db0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fe4c800a470 tx=0x7fe4c8045a20 comp rx=0 tx=0).stop 2024-09-12T17:29:05.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.271+0000 7fe4e2b25800 1 -- 172.21.15.170:0/838831717 shutdown_connections 2024-09-12T17:29:05.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.271+0000 7fe4e2b25800 1 --2- 172.21.15.170:0/838831717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55840a2ac210 0x55840a2b1db0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.271+0000 7fe4e2b25800 1 -- 172.21.15.170:0/838831717 >> 172.21.15.170:0/838831717 conn(0x55840a2a61d0 msgr2=0x55840a2a8630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:05.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.271+0000 7fe4e2b25800 1 -- 172.21.15.170:0/838831717 shutdown_connections 2024-09-12T17:29:05.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.271+0000 7fe4e2b25800 1 -- 172.21.15.170:0/838831717 wait complete. 2024-09-12T17:29:05.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.284+0000 7fe4e2b25800 1 Processor -- start 2024-09-12T17:29:05.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.285+0000 7fe4e2b25800 1 -- start start 2024-09-12T17:29:05.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.285+0000 7fe4e2b25800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55840a2aae00 0x55840a39b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:05.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.285+0000 7fe4e2b25800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55840a144dd0 con 0x55840a2aae00 2024-09-12T17:29:05.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.285+0000 7fe4de7ae640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55840a2aae00 0x55840a39b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:05.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.285+0000 7fe4de7ae640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55840a2aae00 0x55840a39b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:36444/0 (socket says 172.21.15.170:36444) 2024-09-12T17:29:05.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.285+0000 7fe4de7ae640 1 -- 172.21.15.170:0/3129137294 learned_addr learned my addr 172.21.15.170:0/3129137294 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:05.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.285+0000 7fe4de7ae640 1 -- 172.21.15.170:0/3129137294 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55840a15de10 con 0x55840a2aae00 2024-09-12T17:29:05.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.286+0000 7fe4de7ae640 1 --2- 172.21.15.170:0/3129137294 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55840a2aae00 0x55840a39b670 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0001e40 tx=0x7fe4d0001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fffe3cf118d2616 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:05.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.286+0000 7fe3cc608640 1 -- 172.21.15.170:0/3129137294 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4d0012020 con 0x55840a2aae00 2024-09-12T17:29:05.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.286+0000 7fe3cc608640 1 -- 172.21.15.170:0/3129137294 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4d000e5a0 con 0x55840a2aae00 2024-09-12T17:29:05.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.286+0000 7fe3cc608640 1 -- 172.21.15.170:0/3129137294 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4d000e8a0 con 0x55840a2aae00 2024-09-12T17:29:05.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.286+0000 7fe4e2b25800 1 -- 172.21.15.170:0/3129137294 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55840a2aae00 msgr2=0x55840a39b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:05.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.286+0000 7fe4e2b25800 1 --2- 172.21.15.170:0/3129137294 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55840a2aae00 0x55840a39b670 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0001e40 tx=0x7fe4d0001e70 comp rx=0 tx=0).stop 2024-09-12T17:29:05.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.286+0000 7fe4e2b25800 1 -- 172.21.15.170:0/3129137294 shutdown_connections 2024-09-12T17:29:05.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.286+0000 7fe4e2b25800 1 --2- 172.21.15.170:0/3129137294 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55840a2aae00 0x55840a39b670 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.286+0000 7fe4e2b25800 1 -- 172.21.15.170:0/3129137294 >> 172.21.15.170:0/3129137294 conn(0x55840a2a61d0 msgr2=0x55840a399a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:05.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.287+0000 7fe4e2b25800 1 -- 172.21.15.170:0/3129137294 shutdown_connections 2024-09-12T17:29:05.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.287+0000 7fe4e2b25800 1 -- 172.21.15.170:0/3129137294 wait complete. 2024-09-12T17:29:05.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.287+0000 7fe4e2b25800 1 Processor -- start 2024-09-12T17:29:05.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.287+0000 7fe4e2b25800 1 -- start start 2024-09-12T17:29:05.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.287+0000 7fe4e2b25800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55840a2aae00 0x55840a397140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:05.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.287+0000 7fe4e2b25800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55840a2ac900 con 0x55840a2aae00 2024-09-12T17:29:05.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.287+0000 7fe4de7ae640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55840a2aae00 0x55840a397140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:05.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.287+0000 7fe4de7ae640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55840a2aae00 0x55840a397140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:36452/0 (socket says 172.21.15.170:36452) 2024-09-12T17:29:05.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.287+0000 7fe4de7ae640 1 -- 172.21.15.170:0/4157801413 learned_addr learned my addr 172.21.15.170:0/4157801413 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:05.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.287+0000 7fe4de7ae640 1 -- 172.21.15.170:0/4157801413 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55840a3976a0 con 0x55840a2aae00 2024-09-12T17:29:05.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.288+0000 7fe4de7ae640 1 --2- 172.21.15.170:0/4157801413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55840a2aae00 0x55840a397140 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fe4d000c010 tx=0x7fe4d0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:05.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.288+0000 7fe3cae05640 1 -- 172.21.15.170:0/4157801413 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4d0012030 con 0x55840a2aae00 2024-09-12T17:29:05.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.288+0000 7fe3cae05640 1 -- 172.21.15.170:0/4157801413 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4d00014a0 con 0x55840a2aae00 2024-09-12T17:29:05.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.288+0000 7fe4e2b25800 1 -- 172.21.15.170:0/4157801413 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55840a395a50 con 0x55840a2aae00 2024-09-12T17:29:05.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.288+0000 7fe3cae05640 1 -- 172.21.15.170:0/4157801413 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4d001a7a0 con 0x55840a2aae00 2024-09-12T17:29:05.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.288+0000 7fe4e2b25800 1 -- 172.21.15.170:0/4157801413 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55840a396010 con 0x55840a2aae00 2024-09-12T17:29:05.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.289+0000 7fe3cae05640 1 -- 172.21.15.170:0/4157801413 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe4d0015020 con 0x55840a2aae00 2024-09-12T17:29:05.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.289+0000 7fe3cae05640 1 --2- 172.21.15.170:0/4157801413 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe3c403c730 0x7fe3c403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:05.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.289+0000 7fe3cae05640 1 -- 172.21.15.170:0/4157801413 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fe4d0020030 con 0x55840a2aae00 2024-09-12T17:29:05.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.289+0000 7fe4d7fff640 1 --2- 172.21.15.170:0/4157801413 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe3c403c730 0x7fe3c403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:05.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.289+0000 7fe4e2b25800 1 --2- 172.21.15.170:0/4157801413 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55840a2ac210 0x55840a3ac540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:05.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.289+0000 7fe4e2b25800 1 -- 172.21.15.170:0/4157801413 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a3aca80 con 0x55840a2ac210 2024-09-12T17:29:05.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.289+0000 7fe4defaf640 1 --2- 172.21.15.170:0/4157801413 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55840a2ac210 0x55840a3ac540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:05.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.290+0000 7fe4d7fff640 1 --2- 172.21.15.170:0/4157801413 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe3c403c730 0x7fe3c403ebf0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8057000 tx=0x7fe4c8052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:05.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.290+0000 7fe4defaf640 1 --2- 172.21.15.170:0/4157801413 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55840a2ac210 0x55840a3ac540 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:05.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.290+0000 7fe4defaf640 1 -- 172.21.15.170:0/4157801413 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4d800a4d0 con 0x55840a2ac210 2024-09-12T17:29:05.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.290+0000 7fe4e2b25800 1 -- 172.21.15.170:0/4157801413 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a396510 con 0x55840a2ac210 2024-09-12T17:29:05.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.290+0000 7fe4defaf640 1 -- 172.21.15.170:0/4157801413 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe4d800a4d0 con 0x55840a2ac210 2024-09-12T17:29:05.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.290+0000 7fe4e2b25800 1 --2- 172.21.15.170:0/4157801413 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55840a3aedb0 0x55840a3b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:05.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.290+0000 7fe4e2b25800 1 -- 172.21.15.170:0/4157801413 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a3b1870 con 0x55840a3aedb0 2024-09-12T17:29:05.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.290+0000 7fe4de7ae640 1 --2- 172.21.15.170:0/4157801413 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55840a3aedb0 0x55840a3b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:05.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.291+0000 7fe4de7ae640 1 --2- 172.21.15.170:0/4157801413 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55840a3aedb0 0x55840a3b11a0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:05.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.291+0000 7fe4de7ae640 1 -- 172.21.15.170:0/4157801413 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe4d001ab20 con 0x55840a3aedb0 2024-09-12T17:29:05.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.291+0000 7fe4e2b25800 1 -- 172.21.15.170:0/4157801413 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a3adc50 con 0x55840a2ac210 2024-09-12T17:29:05.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.291+0000 7fe4defaf640 1 -- 172.21.15.170:0/4157801413 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe4d800a4d0 con 0x55840a2ac210 2024-09-12T17:29:05.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.291+0000 7fe4e2b25800 1 -- 172.21.15.170:0/4157801413 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a3ae0f0 con 0x55840a3aedb0 2024-09-12T17:29:05.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.292+0000 7fe4de7ae640 1 -- 172.21.15.170:0/4157801413 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe4d001ab20 con 0x55840a3aedb0 2024-09-12T17:29:05.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.292+0000 7fe4e2b25800 1 Processor -- start 2024-09-12T17:29:05.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.292+0000 7fe4e2b25800 1 -- start start 2024-09-12T17:29:05.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.292+0000 7fe4e2b25800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55840a3c0100 0x55840a3c0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:05.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.292+0000 7fe4e2b25800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55840a1a2a00 con 0x55840a3c0100 2024-09-12T17:29:05.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.292+0000 7fe4defaf640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55840a3c0100 0x55840a3c0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:05.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.292+0000 7fe4defaf640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55840a3c0100 0x55840a3c0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:36462/0 (socket says 172.21.15.170:36462) 2024-09-12T17:29:05.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.292+0000 7fe4defaf640 1 -- 172.21.15.170:0/3398295512 learned_addr learned my addr 172.21.15.170:0/3398295512 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:05.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.293+0000 7fe4defaf640 1 -- 172.21.15.170:0/3398295512 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55840a3c0b60 con 0x55840a3c0100 2024-09-12T17:29:05.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.293+0000 7fe4defaf640 1 --2- 172.21.15.170:0/3398295512 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55840a3c0100 0x55840a3c0520 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x55840a396b70 tx=0x7fe4d80167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:05.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.293+0000 7fe3c3fff640 1 -- 172.21.15.170:0/3398295512 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4d8013640 con 0x55840a3c0100 2024-09-12T17:29:05.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.293+0000 7fe3c3fff640 1 -- 172.21.15.170:0/3398295512 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4d80137e0 con 0x55840a3c0100 2024-09-12T17:29:05.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.293+0000 7fe3c3fff640 1 -- 172.21.15.170:0/3398295512 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4d8013ae0 con 0x55840a3c0100 2024-09-12T17:29:05.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.293+0000 7fe4e2b25800 1 -- 172.21.15.170:0/3398295512 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55840a3c1390 con 0x55840a3c0100 2024-09-12T17:29:05.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.293+0000 7fe4e2b25800 1 -- 172.21.15.170:0/3398295512 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55840a3c1930 con 0x55840a3c0100 2024-09-12T17:29:05.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.294+0000 7fe3c3fff640 1 -- 172.21.15.170:0/3398295512 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe4d8011040 con 0x55840a3c0100 2024-09-12T17:29:05.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.294+0000 7fe3c3fff640 1 --2- 172.21.15.170:0/3398295512 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe3b803c730 0x7fe3b803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:05.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.294+0000 7fe3c3fff640 1 -- 172.21.15.170:0/3398295512 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fe4d800e040 con 0x55840a3c0100 2024-09-12T17:29:05.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.294+0000 7fe4de7ae640 1 --2- 172.21.15.170:0/3398295512 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe3b803c730 0x7fe3b803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:05.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.294+0000 7fe4e2b25800 1 Processor -- start 2024-09-12T17:29:05.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.294+0000 7fe4de7ae640 1 --2- 172.21.15.170:0/3398295512 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe3b803c730 0x7fe3b803ebf0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe4d000c720 tx=0x7fe4d0043050 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:05.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.294+0000 7fe4e2b25800 1 -- start start 2024-09-12T17:29:05.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.295+0000 7fe4e2b25800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55840a3ccc00 0x55840a3cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:05.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.295+0000 7fe4e2b25800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55840a39bec0 con 0x55840a3ccc00 2024-09-12T17:29:05.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.295+0000 7fe4defaf640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55840a3ccc00 0x55840a3cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:05.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.295+0000 7fe4defaf640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55840a3ccc00 0x55840a3cd000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:36478/0 (socket says 172.21.15.170:36478) 2024-09-12T17:29:05.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.295+0000 7fe4defaf640 1 -- 172.21.15.170:0/3704545603 learned_addr learned my addr 172.21.15.170:0/3704545603 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:05.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.295+0000 7fe4defaf640 1 -- 172.21.15.170:0/3704545603 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55840a3cd5f0 con 0x55840a3ccc00 2024-09-12T17:29:05.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.295+0000 7fe4defaf640 1 --2- 172.21.15.170:0/3704545603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55840a3ccc00 0x55840a3cd000 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8053d60 tx=0x7fe4d801fc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67567e8ba1c3a911 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:05.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.295+0000 7fe3c1ffb640 1 -- 172.21.15.170:0/3704545603 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4d8021a40 con 0x55840a3ccc00 2024-09-12T17:29:05.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.295+0000 7fe3c1ffb640 1 -- 172.21.15.170:0/3704545603 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4d8021440 con 0x55840a3ccc00 2024-09-12T17:29:05.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.295+0000 7fe3c1ffb640 1 -- 172.21.15.170:0/3704545603 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4d801f340 con 0x55840a3ccc00 2024-09-12T17:29:05.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.296+0000 7fe4e2b25800 1 -- 172.21.15.170:0/3704545603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55840a3ccc00 msgr2=0x55840a3cd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:05.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.296+0000 7fe4e2b25800 1 --2- 172.21.15.170:0/3704545603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55840a3ccc00 0x55840a3cd000 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8053d60 tx=0x7fe4d801fc40 comp rx=0 tx=0).stop 2024-09-12T17:29:05.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.296+0000 7fe4e2b25800 1 -- 172.21.15.170:0/3704545603 shutdown_connections 2024-09-12T17:29:05.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.296+0000 7fe4e2b25800 1 --2- 172.21.15.170:0/3704545603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55840a3ccc00 0x55840a3cd000 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.296+0000 7fe4e2b25800 1 -- 172.21.15.170:0/3704545603 >> 172.21.15.170:0/3704545603 conn(0x55840a3c9020 msgr2=0x55840a3c7260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:05.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.296+0000 7fe4e2b25800 1 -- 172.21.15.170:0/3704545603 shutdown_connections 2024-09-12T17:29:05.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.296+0000 7fe4e2b25800 1 -- 172.21.15.170:0/3704545603 wait complete. 2024-09-12T17:29:05.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.296+0000 7fe4e2b25800 1 Processor -- start 2024-09-12T17:29:05.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.296+0000 7fe4e2b25800 1 -- start start 2024-09-12T17:29:05.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.296+0000 7fe4e2b25800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55840a3ccc00 0x55840a3d41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:05.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.296+0000 7fe4e2b25800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55840a3cdc10 con 0x55840a3ccc00 2024-09-12T17:29:05.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.297+0000 7fe4defaf640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55840a3ccc00 0x55840a3d41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:05.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.297+0000 7fe4defaf640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55840a3ccc00 0x55840a3d41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:36482/0 (socket says 172.21.15.170:36482) 2024-09-12T17:29:05.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.297+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 learned_addr learned my addr 172.21.15.170:0/1924501997 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:05.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.297+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55840a3d4740 con 0x55840a3ccc00 2024-09-12T17:29:05.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.297+0000 7fe4defaf640 1 --2- 172.21.15.170:0/1924501997 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55840a3ccc00 0x55840a3d41e0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8047040 tx=0x7fe4d8053cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:05.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.297+0000 7fe3affff640 1 -- 172.21.15.170:0/1924501997 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4d8055720 con 0x55840a3ccc00 2024-09-12T17:29:05.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.297+0000 7fe3affff640 1 -- 172.21.15.170:0/1924501997 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4d8020800 con 0x55840a3ccc00 2024-09-12T17:29:05.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.297+0000 7fe3affff640 1 -- 172.21.15.170:0/1924501997 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4d8020ae0 con 0x55840a3ccc00 2024-09-12T17:29:05.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.297+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55840a3d49d0 con 0x55840a3ccc00 2024-09-12T17:29:05.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.297+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55840a3d5350 con 0x55840a3ccc00 2024-09-12T17:29:05.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.298+0000 7fe3affff640 1 -- 172.21.15.170:0/1924501997 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe4d803b060 con 0x55840a3ccc00 2024-09-12T17:29:05.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.298+0000 7fe3affff640 1 --2- 172.21.15.170:0/1924501997 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe3a803c780 0x7fe3a803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:05.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.298+0000 7fe3affff640 1 -- 172.21.15.170:0/1924501997 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fe4d803ebb0 con 0x55840a3ccc00 2024-09-12T17:29:05.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.298+0000 7fe4de7ae640 1 --2- 172.21.15.170:0/1924501997 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe3a803c780 0x7fe3a803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:05.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.299+0000 7fe4de7ae640 1 --2- 172.21.15.170:0/1924501997 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe3a803c780 0x7fe3a803ec40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0053af0 tx=0x7fe4d0030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:05.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.299+0000 7fe4e2b25800 20 rados->read ofs=0 len=0 2024-09-12T17:29:05.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.299+0000 7fe4e2b25800 1 --2- 172.21.15.170:0/1924501997 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55840a3dfb20 0x55840a3e1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:05.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.299+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a3e2730 con 0x55840a3dfb20 2024-09-12T17:29:05.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.299+0000 7fe4d7fff640 1 --2- 172.21.15.170:0/1924501997 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55840a3dfb20 0x55840a3e1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:05.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.299+0000 7fe4d7fff640 1 --2- 172.21.15.170:0/1924501997 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55840a3dfb20 0x55840a3e1fe0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:05.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.299+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x55840a3dfb20 2024-09-12T17:29:05.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.299+0000 7fe4e2b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:05.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.299+0000 7fe4e2b25800 20 realm 2024-09-12T17:29:05.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.300+0000 7fe4e2b25800 20 rados->read ofs=0 len=0 2024-09-12T17:29:05.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.300+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a3e2b60 con 0x55840a3dfb20 2024-09-12T17:29:05.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.300+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x55840a3dfb20 2024-09-12T17:29:05.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.300+0000 7fe4e2b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:05.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.300+0000 7fe4e2b25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:29:05.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.300+0000 7fe4e2b25800 20 rados->read ofs=0 len=0 2024-09-12T17:29:05.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.300+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a3e3430 con 0x55840a3dfb20 2024-09-12T17:29:05.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.300+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x55840a3dfb20 2024-09-12T17:29:05.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.300+0000 7fe4e2b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:05.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.300+0000 7fe4e2b25800 20 rados->read ofs=0 len=0 2024-09-12T17:29:05.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.300+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a3e37d0 con 0x55840a3dfb20 2024-09-12T17:29:05.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.300+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe4c8051070 con 0x55840a3dfb20 2024-09-12T17:29:05.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.300+0000 7fe4e2b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:05.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.300+0000 7fe4e2b25800 20 rados->read ofs=0 len=0 2024-09-12T17:29:05.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.300+0000 7fe4e2b25800 1 --2- 172.21.15.170:0/1924501997 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55840a3e4530 0x55840a3e6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:05.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.300+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a3e6f30 con 0x55840a3e4530 2024-09-12T17:29:05.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.300+0000 7fe4defaf640 1 --2- 172.21.15.170:0/1924501997 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55840a3e4530 0x55840a3e6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:05.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.301+0000 7fe4defaf640 1 --2- 172.21.15.170:0/1924501997 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55840a3e4530 0x55840a3e6920 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:05.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.301+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe4d800a4d0 con 0x55840a3e4530 2024-09-12T17:29:05.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.301+0000 7fe4e2b25800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:29:05.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.301+0000 7fe4e2b25800 20 searching for the correct realm 2024-09-12T17:29:05.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.301+0000 7fe4e2b25800 1 --2- 172.21.15.170:0/1924501997 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55840a3e8ee0 0x55840a3eb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:05.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.301+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55840a3eba20 con 0x55840a3e8ee0 2024-09-12T17:29:05.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.301+0000 7fe4de7ae640 1 --2- 172.21.15.170:0/1924501997 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55840a3e8ee0 0x55840a3eb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:05.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.301+0000 7fe4de7ae640 1 --2- 172.21.15.170:0/1924501997 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55840a3e8ee0 0x55840a3eb3a0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:05.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.302+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d001ab20 con 0x55840a3e8ee0 2024-09-12T17:29:05.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.302+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55840a3eba20 con 0x55840a3e4530 2024-09-12T17:29:05.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.302+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d800a4d0 con 0x55840a3e4530 2024-09-12T17:29:05.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.302+0000 7fe4defaf640 1 --2- 172.21.15.170:0/1924501997 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fe4d8017450 0x7fe4d8056a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:05.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.302+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55840a3eba20 con 0x7fe4d8017450 2024-09-12T17:29:05.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.302+0000 7fe4d7fff640 1 --2- 172.21.15.170:0/1924501997 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fe4d8017450 0x7fe4d8056a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:05.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.302+0000 7fe4d7fff640 1 --2- 172.21.15.170:0/1924501997 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fe4d8017450 0x7fe4d8056a80 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:05.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.303+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.303+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55840a3eba20 con 0x55840a3dfb20 2024-09-12T17:29:05.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.303+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4c8051070 con 0x55840a3dfb20 2024-09-12T17:29:05.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.303+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55840a3eba20 con 0x55840a3dfb20 2024-09-12T17:29:05.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.303+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4c8051070 con 0x55840a3dfb20 2024-09-12T17:29:05.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.303+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55840a3eba20 con 0x7fe4d8017450 2024-09-12T17:29:05.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.303+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.303+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55840a3eba20 con 0x7fe4d8017450 2024-09-12T17:29:05.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.304+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.304+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55840a3eba20 con 0x55840a3e4530 2024-09-12T17:29:05.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.304+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d800a4d0 con 0x55840a3e4530 2024-09-12T17:29:05.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.304+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55840a3eba20 con 0x55840a3e8ee0 2024-09-12T17:29:05.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.304+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d001ab20 con 0x55840a3e8ee0 2024-09-12T17:29:05.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.304+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55840a3eba20 con 0x55840a3dfb20 2024-09-12T17:29:05.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.304+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4c8051070 con 0x55840a3dfb20 2024-09-12T17:29:05.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.304+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55840a3eba20 con 0x7fe4d8017450 2024-09-12T17:29:05.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.305+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.305+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55840a3eba20 con 0x55840a3dfb20 2024-09-12T17:29:05.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.305+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4c8051070 con 0x55840a3dfb20 2024-09-12T17:29:05.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.305+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55840a3eba20 con 0x55840a3e4530 2024-09-12T17:29:05.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.305+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fe4d800a4d0 con 0x55840a3e4530 2024-09-12T17:29:05.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.305+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55840a3eba20 con 0x55840a3e8ee0 2024-09-12T17:29:05.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.305+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d001ab20 con 0x55840a3e8ee0 2024-09-12T17:29:05.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.305+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55840a3eba20 con 0x55840a3e8ee0 2024-09-12T17:29:05.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.305+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d001ab20 con 0x55840a3e8ee0 2024-09-12T17:29:05.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.306+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55840a3eba20 con 0x55840a3e4530 2024-09-12T17:29:05.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.306+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d800a4d0 con 0x55840a3e4530 2024-09-12T17:29:05.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.306+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55840a3eba20 con 0x55840a3e8ee0 2024-09-12T17:29:05.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.306+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d001ab20 con 0x55840a3e8ee0 2024-09-12T17:29:05.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.306+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55840a3eba20 con 0x55840a3e8ee0 2024-09-12T17:29:05.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.306+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d001ab20 con 0x55840a3e8ee0 2024-09-12T17:29:05.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.306+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55840a3eba20 con 0x55840a3dfb20 2024-09-12T17:29:05.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.306+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4c8051070 con 0x55840a3dfb20 2024-09-12T17:29:05.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.306+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55840a3eba20 con 0x55840a3dfb20 2024-09-12T17:29:05.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.307+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe4c8051070 con 0x55840a3dfb20 2024-09-12T17:29:05.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.307+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55840a3eba20 con 0x7fe4d8017450 2024-09-12T17:29:05.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.307+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.307+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55840a3eba20 con 0x55840a3e8ee0 2024-09-12T17:29:05.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.307+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d001ab20 con 0x55840a3e8ee0 2024-09-12T17:29:05.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.307+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55840a3eba20 con 0x55840a3e4530 2024-09-12T17:29:05.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.307+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d800a4d0 con 0x55840a3e4530 2024-09-12T17:29:05.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.307+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55840a3eba20 con 0x55840a3dfb20 2024-09-12T17:29:05.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.308+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4c8051070 con 0x55840a3dfb20 2024-09-12T17:29:05.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.308+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55840a3eba20 con 0x7fe4d8017450 2024-09-12T17:29:05.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.308+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.308+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55840a3eba20 con 0x55840a3e8ee0 2024-09-12T17:29:05.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.308+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d001ab20 con 0x55840a3e8ee0 2024-09-12T17:29:05.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.308+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55840a3eba20 con 0x7fe4d8017450 2024-09-12T17:29:05.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.308+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.308+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55840a3eba20 con 0x55840a3e4530 2024-09-12T17:29:05.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.309+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d800a4d0 con 0x55840a3e4530 2024-09-12T17:29:05.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.309+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55840a3eba20 con 0x55840a3e8ee0 2024-09-12T17:29:05.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.309+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d001ab20 con 0x55840a3e8ee0 2024-09-12T17:29:05.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.309+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55840a3eba20 con 0x7fe4d8017450 2024-09-12T17:29:05.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.309+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.309+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55840a3eba20 con 0x55840a3dfb20 2024-09-12T17:29:05.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.309+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe4c8051070 con 0x55840a3dfb20 2024-09-12T17:29:05.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.309+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55840a3eba20 con 0x55840a3e4530 2024-09-12T17:29:05.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.310+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(37 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe4d800a4d0 con 0x55840a3e4530 2024-09-12T17:29:05.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.310+0000 7fe4e2b25800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:29:05.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.310+0000 7fe4e2b25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:29:05.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.310+0000 7fe4e2b25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:29:05.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.310+0000 7fe4e2b25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:29:05.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.310+0000 7fe4e2b25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:29:05.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.310+0000 7fe4e2b25800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:29:05.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.310+0000 7fe4e2b25800 20 rados->read ofs=0 len=0 2024-09-12T17:29:05.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.310+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a3e7920 con 0x55840a3dfb20 2024-09-12T17:29:05.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.310+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x55840a3dfb20 2024-09-12T17:29:05.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.310+0000 7fe4e2b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:05.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.310+0000 7fe4e2b25800 20 rados->read ofs=0 len=0 2024-09-12T17:29:05.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.310+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a3e81c0 con 0x55840a3dfb20 2024-09-12T17:29:05.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.310+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe4c8051070 con 0x55840a3dfb20 2024-09-12T17:29:05.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.310+0000 7fe4e2b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:05.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.310+0000 7fe4e2b25800 20 rados->read ofs=0 len=0 2024-09-12T17:29:05.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.310+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a3e7560 con 0x55840a3e4530 2024-09-12T17:29:05.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.310+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe4d800a4d0 con 0x55840a3e4530 2024-09-12T17:29:05.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.310+0000 7fe4e2b25800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:29:05.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.310+0000 7fe4e2b25800 20 zone default found 2024-09-12T17:29:05.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.310+0000 7fe4e2b25800 4 Realm: () 2024-09-12T17:29:05.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.310+0000 7fe4e2b25800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:29:05.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.310+0000 7fe4e2b25800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:29:05.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.310+0000 7fe4e2b25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:29:05.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.310+0000 7fe4e2b25800 20 zonegroup default 2024-09-12T17:29:05.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.310+0000 7fe4e2b25800 20 rados->read ofs=0 len=0 2024-09-12T17:29:05.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.310+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a3ec350 con 0x7fe4d8017450 2024-09-12T17:29:05.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.311+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.311+0000 7fe4e2b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:05.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.311+0000 7fe4e2b25800 20 rados->read ofs=0 len=0 2024-09-12T17:29:05.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.311+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a3ee590 con 0x55840a3e8ee0 2024-09-12T17:29:05.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.311+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe4d001ab20 con 0x55840a3e8ee0 2024-09-12T17:29:05.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.311+0000 7fe4e2b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:05.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.311+0000 7fe4e2b25800 20 rados->read ofs=0 len=0 2024-09-12T17:29:05.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.311+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a3ee930 con 0x55840a3e8ee0 2024-09-12T17:29:05.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.311+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe4d001ab20 con 0x55840a3e8ee0 2024-09-12T17:29:05.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.311+0000 7fe4e2b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:05.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.311+0000 7fe4e2b25800 20 started sync module instance, tier type = 2024-09-12T17:29:05.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.311+0000 7fe4e2b25800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:29:05.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.311+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3eda20 con 0x55840a3e4530 2024-09-12T17:29:05.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.312+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(44 notify.0 [create] v31'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4d800a4d0 con 0x55840a3e4530 2024-09-12T17:29:05.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.312+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94025595936272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3ef1f0 con 0x55840a3e4530 2024-09-12T17:29:05.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.312+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3efa40 con 0x55840a3dfb20 2024-09-12T17:29:05.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.313+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94025595936272] v31'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4d800a4d0 con 0x55840a3e4530 2024-09-12T17:29:05.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.314+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v31'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x55840a3dfb20 2024-09-12T17:29:05.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.314+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94025595940160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3ef770 con 0x55840a3dfb20 2024-09-12T17:29:05.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.314+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3f0260 con 0x55840a3e8ee0 2024-09-12T17:29:05.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.315+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94025595940160] v31'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x55840a3dfb20 2024-09-12T17:29:05.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.315+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v31'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4d001ab20 con 0x55840a3e8ee0 2024-09-12T17:29:05.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.315+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94025595944240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3f0650 con 0x55840a3e8ee0 2024-09-12T17:29:05.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.315+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3f1080 con 0x55840a3e4530 2024-09-12T17:29:05.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.316+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94025595944240] v31'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4d001ab20 con 0x55840a3e8ee0 2024-09-12T17:29:05.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.316+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(50 notify.3 [create] v31'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4d800a4d0 con 0x55840a3e4530 2024-09-12T17:29:05.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.316+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94025595947920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3f1080 con 0x55840a3e4530 2024-09-12T17:29:05.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.316+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3f1b20 con 0x55840a3dfb20 2024-09-12T17:29:05.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.317+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94025595947920] v31'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4d800a4d0 con 0x55840a3e4530 2024-09-12T17:29:05.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.318+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v31'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x55840a3dfb20 2024-09-12T17:29:05.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.318+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94025595950608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3f1ae0 con 0x55840a3dfb20 2024-09-12T17:29:05.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.318+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3f25a0 con 0x7fe4d8017450 2024-09-12T17:29:05.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.319+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94025595950608] v31'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x55840a3dfb20 2024-09-12T17:29:05.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.319+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(54 notify.5 [create] v31'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.319+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94025595941312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3f2560 con 0x7fe4d8017450 2024-09-12T17:29:05.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.319+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3f2fb0 con 0x7fe4d8017450 2024-09-12T17:29:05.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.320+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94025595941312] v31'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.320+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v31'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.320+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94025595953328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3f31b0 con 0x7fe4d8017450 2024-09-12T17:29:05.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.320+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3f3a00 con 0x7fe4d8017450 2024-09-12T17:29:05.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.321+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(58 notify.7 [create] v31'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.321+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94025595958160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3f3da0 con 0x7fe4d8017450 2024-09-12T17:29:05.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.321+0000 7fe4e2b25800 20 add_watcher() i=0 2024-09-12T17:29:05.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.321+0000 7fe4e2b25800 20 add_watcher() i=1 2024-09-12T17:29:05.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.321+0000 7fe4e2b25800 20 add_watcher() i=2 2024-09-12T17:29:05.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.321+0000 7fe4e2b25800 20 add_watcher() i=3 2024-09-12T17:29:05.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.321+0000 7fe4e2b25800 20 add_watcher() i=4 2024-09-12T17:29:05.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.321+0000 7fe4e2b25800 20 add_watcher() i=5 2024-09-12T17:29:05.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.321+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94025595953328] v31'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.321+0000 7fe4e2b25800 20 add_watcher() i=6 2024-09-12T17:29:05.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.321+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94025595958160] v31'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.321+0000 7fe4e2b25800 20 add_watcher() i=7 2024-09-12T17:29:05.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.321+0000 7fe4e2b25800 2 all 8 watchers are set, enabling cache 2024-09-12T17:29:05.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.322+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a3f2ce0 con 0x55840a3dfb20 2024-09-12T17:29:05.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.322+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe4c8051070 con 0x55840a3dfb20 2024-09-12T17:29:05.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.322+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94025595959344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3f2ce0 con 0x55840a3dfb20 2024-09-12T17:29:05.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.323+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94025595959344] v31'224 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x55840a3dfb20 2024-09-12T17:29:05.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.323+0000 7fe394fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:05.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.323+0000 7fe4e2b25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:29:05.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.323+0000 7fe4e2b25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:29:05.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.323+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3ff7c0 con 0x55840a3dfb20 2024-09-12T17:29:05.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.324+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x55840a3dfb20 2024-09-12T17:29:05.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.324+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3ff7c0 con 0x7fe4d8017450 2024-09-12T17:29:05.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.325+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.325+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a4001e0 con 0x55840a3e8ee0 2024-09-12T17:29:05.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.326+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe4d001ab20 con 0x55840a3e8ee0 2024-09-12T17:29:05.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.326+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a400270 con 0x55840a3dfb20 2024-09-12T17:29:05.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.327+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'225 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x55840a3dfb20 2024-09-12T17:29:05.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.327+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a400720 con 0x55840a3e4530 2024-09-12T17:29:05.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.328+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'71 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe4d800a4d0 con 0x55840a3e4530 2024-09-12T17:29:05.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.328+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a400720 con 0x55840a3e8ee0 2024-09-12T17:29:05.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.329+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 <== osd.3 v2:172.21.15.170:6816/2664906588 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'47 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe4d001ab20 con 0x55840a3e8ee0 2024-09-12T17:29:05.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.329+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3fee90 con 0x55840a3dfb20 2024-09-12T17:29:05.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.330+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x55840a3dfb20 2024-09-12T17:29:05.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.330+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3fe980 con 0x7fe4d8017450 2024-09-12T17:29:05.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.331+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'47 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.331+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3fe7b0 con 0x55840a3e4530 2024-09-12T17:29:05.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.332+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'28 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe4d800a4d0 con 0x55840a3e4530 2024-09-12T17:29:05.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.332+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3fee00 con 0x55840a3e8ee0 2024-09-12T17:29:05.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.333+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 <== osd.3 v2:172.21.15.170:6816/2664906588 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe4d001ab20 con 0x55840a3e8ee0 2024-09-12T17:29:05.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.333+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3fec60 con 0x55840a3e4530 2024-09-12T17:29:05.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.334+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'72 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe4d800a4d0 con 0x55840a3e4530 2024-09-12T17:29:05.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.334+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3fec60 con 0x7fe4d8017450 2024-09-12T17:29:05.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.335+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'31 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.335+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3fec60 con 0x55840a3e4530 2024-09-12T17:29:05.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.336+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe4d800a4d0 con 0x55840a3e4530 2024-09-12T17:29:05.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.336+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3fec60 con 0x7fe4d8017450 2024-09-12T17:29:05.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.337+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'53 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.337+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3fec60 con 0x55840a3dfb20 2024-09-12T17:29:05.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.338+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'226 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x55840a3dfb20 2024-09-12T17:29:05.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.338+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3fec60 con 0x55840a3e8ee0 2024-09-12T17:29:05.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.339+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 <== osd.3 v2:172.21.15.170:6816/2664906588 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'65 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe4d001ab20 con 0x55840a3e8ee0 2024-09-12T17:29:05.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.339+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3fec60 con 0x55840a3e4530 2024-09-12T17:29:05.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.340+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'73 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe4d800a4d0 con 0x55840a3e4530 2024-09-12T17:29:05.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.340+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3fec60 con 0x55840a3e8ee0 2024-09-12T17:29:05.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.341+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 <== osd.3 v2:172.21.15.170:6816/2664906588 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe4d001ab20 con 0x55840a3e8ee0 2024-09-12T17:29:05.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.341+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3fec60 con 0x55840a3dfb20 2024-09-12T17:29:05.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.342+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'37 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x55840a3dfb20 2024-09-12T17:29:05.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.342+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3fec60 con 0x55840a3dfb20 2024-09-12T17:29:05.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.343+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'227 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x55840a3dfb20 2024-09-12T17:29:05.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.343+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3fec60 con 0x55840a3e8ee0 2024-09-12T17:29:05.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.344+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 <== osd.3 v2:172.21.15.170:6816/2664906588 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'66 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe4d001ab20 con 0x55840a3e8ee0 2024-09-12T17:29:05.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.344+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3fec60 con 0x55840a3e4530 2024-09-12T17:29:05.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.345+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'38 uv32 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe4d800a4d0 con 0x55840a3e4530 2024-09-12T17:29:05.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.345+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3fec60 con 0x55840a3e8ee0 2024-09-12T17:29:05.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.346+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 <== osd.3 v2:172.21.15.170:6816/2664906588 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe4d001ab20 con 0x55840a3e8ee0 2024-09-12T17:29:05.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.346+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3fec60 con 0x55840a3e8ee0 2024-09-12T17:29:05.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.347+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 <== osd.3 v2:172.21.15.170:6816/2664906588 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe4d001ab20 con 0x55840a3e8ee0 2024-09-12T17:29:05.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.347+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3fec80 con 0x55840a3e8ee0 2024-09-12T17:29:05.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.348+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 <== osd.3 v2:172.21.15.170:6816/2664906588 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'23 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe4d001ab20 con 0x55840a3e8ee0 2024-09-12T17:29:05.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.348+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3fec80 con 0x55840a3e8ee0 2024-09-12T17:29:05.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.349+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 <== osd.3 v2:172.21.15.170:6816/2664906588 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'48 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe4d001ab20 con 0x55840a3e8ee0 2024-09-12T17:29:05.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.349+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3fec80 con 0x7fe4d8017450 2024-09-12T17:29:05.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.350+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.350+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3fec80 con 0x55840a3e8ee0 2024-09-12T17:29:05.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.351+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 <== osd.3 v2:172.21.15.170:6816/2664906588 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe4d001ab20 con 0x55840a3e8ee0 2024-09-12T17:29:05.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.351+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3fec80 con 0x7fe4d8017450 2024-09-12T17:29:05.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.352+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'48 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.352+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3fec80 con 0x55840a3e8ee0 2024-09-12T17:29:05.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.353+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 <== osd.3 v2:172.21.15.170:6816/2664906588 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'67 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe4d001ab20 con 0x55840a3e8ee0 2024-09-12T17:29:05.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.353+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3fec80 con 0x7fe4d8017450 2024-09-12T17:29:05.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.354+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'54 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.354+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3fec80 con 0x55840a3e4530 2024-09-12T17:29:05.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.355+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe4d800a4d0 con 0x55840a3e4530 2024-09-12T17:29:05.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.356+0000 7fe30f7fe640 20 reqs_thread_entry: start 2024-09-12T17:29:05.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.356+0000 7fe4e2b25800 20 init_complete bucket index max shards: 11 2024-09-12T17:29:05.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.356+0000 7fe4e2b25800 20 Filter name: none 2024-09-12T17:29:05.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.356+0000 7fe30d7fa640 20 reqs_thread_entry: start 2024-09-12T17:29:05.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.356+0000 7fe4e2b25800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-12T17:29:05.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.356+0000 7fe4e2b25800 20 rados->read ofs=0 len=0 2024-09-12T17:29:05.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.356+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a42bd80 con 0x7fe4d8017450 2024-09-12T17:29:05.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.357+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 23 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.357+0000 7fe4e2b25800 20 rados_obj.operate() r=0 bl.length=380 2024-09-12T17:29:05.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.357+0000 7fe4e2b25800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-12T17:29:05.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.357+0000 7fe4e2b25800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T17:29:05.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.357+0000 7fe4e2b25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:29:05.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.357+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a42e3c0 con 0x7fe4d8017450 2024-09-12T17:29:05.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.357+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 24 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv5 ondisk = 0) ==== 155+0+186 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.357+0000 7fe4e2b25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10 : miss 2024-09-12T17:29:05.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.358+0000 7fe4e2b25800 20 rados->read ofs=0 len=0 2024-09-12T17:29:05.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.358+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:96 8.e 8:77d7e45a:root::.bucket.meta.myfoo7%3a7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a42dfa0 con 0x7fe4d8017450 2024-09-12T17:29:05.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.358+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 25 ==== osd_op_reply(96 .bucket.meta.myfoo7:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10 [call out=48b,stat out=16b,read 0~390 out=390b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 334+0+672 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.358+0000 7fe4e2b25800 20 rados_obj.operate() r=0 bl.length=390 2024-09-12T17:29:05.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.358+0000 7fe4e2b25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10 info.flags=0x17 2024-09-12T17:29:05.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.358+0000 7fe4e2b25800 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10 to cache LRU end 2024-09-12T17:29:05.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.358+0000 7fe4e2b25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:29:05.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.358+0000 7fe4e2b25800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:29:05.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.358+0000 7fe4e2b25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10 2024-09-12T17:29:05.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.358+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:97 4.c 4:32c24f03:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a4abc00 con 0x55840a3dfb20 2024-09-12T17:29:05.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.359+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(97 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.0 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fe4c8051070 con 0x55840a3dfb20 2024-09-12T17:29:05.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.359+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:98 4.39 4:9e6a2cc2:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a4abc00 con 0x55840a3e8ee0 2024-09-12T17:29:05.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.359+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 <== osd.3 v2:172.21.15.170:6816/2664906588 26 ==== osd_op_reply(98 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fe4d001ab20 con 0x55840a3e8ee0 2024-09-12T17:29:05.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.359+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:99 4.27 4:e5608860:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a4abc00 con 0x55840a3e4530 2024-09-12T17:29:05.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.359+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 21 ==== osd_op_reply(99 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.2 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fe4d800a4d0 con 0x55840a3e4530 2024-09-12T17:29:05.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.359+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:100 4.24 4:26b034cf:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a4abc00 con 0x7fe4d8017450 2024-09-12T17:29:05.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.360+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 26 ==== osd_op_reply(100 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.360+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:101 4.3e 4:7d4ec560:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a4abc00 con 0x55840a3e4530 2024-09-12T17:29:05.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.360+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 22 ==== osd_op_reply(101 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.4 [call out=89b] v0'0 uv11 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fe4d800a4d0 con 0x55840a3e4530 2024-09-12T17:29:05.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.360+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:102 4.3e 4:7ebc5b29:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a4abc00 con 0x55840a3e4530 2024-09-12T17:29:05.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.361+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 23 ==== osd_op_reply(102 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.5 [call out=381b] v0'0 uv14 ondisk = 0) ==== 195+0+381 (crc 0 0 0) 0x7fe4d800a4d0 con 0x55840a3e4530 2024-09-12T17:29:05.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.361+0000 7fe4e2b25800 10 cls_bucket_list_unordered: got fourteen 2024-09-12T17:29:05.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.361+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:103 4.1c 4:3a0af443:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a4abc00 con 0x7fe4d8017450 2024-09-12T17:29:05.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.361+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 27 ==== osd_op_reply(103 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.361+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:104 4.1b 4:db479acb:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a4abc00 con 0x55840a3e4530 2024-09-12T17:29:05.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.362+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 24 ==== osd_op_reply(104 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fe4d800a4d0 con 0x55840a3e4530 2024-09-12T17:29:05.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.362+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:105 4.0 4:02f56745:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a4abc00 con 0x55840a3e8ee0 2024-09-12T17:29:05.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.362+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 <== osd.3 v2:172.21.15.170:6816/2664906588 27 ==== osd_op_reply(105 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.8 [call out=89b] v0'0 uv7 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fe4d001ab20 con 0x55840a3e8ee0 2024-09-12T17:29:05.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.362+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:106 4.34 4:2ee31d42:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a4abc00 con 0x55840a3e4530 2024-09-12T17:29:05.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.362+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 25 ==== osd_op_reply(106 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.9 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fe4d800a4d0 con 0x55840a3e4530 2024-09-12T17:29:05.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.362+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:107 4.1e 4:7a59a140:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a4abc00 con 0x7fe4d8017450 2024-09-12T17:29:05.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.363+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 28 ==== osd_op_reply(107 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.10 [call out=89b] v0'0 uv5 ondisk = 0) ==== 196+0+89 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.363+0000 7fe4e2b25800 20 get_obj_state: octx=0x7fe4d8014ee0 obj=myfoo7:fourteen state=0x55840a4a9ff8 s->prefetch_data=0 2024-09-12T17:29:05.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.363+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:108 3.2d 3:b421d1b0:::7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a4ab000 con 0x55840a3e8ee0 2024-09-12T17:29:05.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.363+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 <== osd.3 v2:172.21.15.170:6816/2664906588 28 ==== osd_op_reply(108 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10_fourteen [getxattrs out=856b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 239+0+872 (crc 0 0 0) 0x7fe4d001ab20 con 0x55840a3e8ee0 2024-09-12T17:29:05.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.363+0000 7fe4e2b25800 10 manifest: total_size = 8 2024-09-12T17:29:05.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.363+0000 7fe4e2b25800 20 get_obj_state: setting s->obj_tag to 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7694643739926867975 2024-09-12T17:29:05.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.363+0000 7fe4e2b25800 20 get_obj_state: octx=0x7fe4d8014ee0 obj=myfoo7:fourteen state=0x55840a4a9ff8 s->prefetch_data=0 2024-09-12T17:29:05.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.363+0000 7fe4e2b25800 20 prepare_atomic_modification: state is not atomic. state=0x55840a4a9ff8 2024-09-12T17:29:05.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.363+0000 7fe4e2b25800 20 bucket index object: :.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.5 2024-09-12T17:29:05.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.363+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:109 4.3e 4:7ebc5b29:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a4ab880 con 0x55840a3e4530 2024-09-12T17:29:05.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.364+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 26 ==== osd_op_reply(109 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.5 [stat,call,call] v31'15 uv15 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fe4d800a4d0 con 0x55840a3e4530 2024-09-12T17:29:05.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.364+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:110 3.2d 3:b421d1b0:::7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a4ab880 con 0x55840a3e8ee0 2024-09-12T17:29:05.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.366+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 <== osd.3 v2:172.21.15.170:6816/2664906588 29 ==== osd_op_reply(110 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10_fourteen [call] v31'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7fe4d001ab20 con 0x55840a3e8ee0 2024-09-12T17:29:05.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.366+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:111 4.3e 4:7ebc5b29:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a4ab7f0 con 0x55840a3e4530 2024-09-12T17:29:05.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.366+0000 7fe4e2b25800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:29:05.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.366+0000 7fe4e2b25800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:29:05.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.366+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:112 4.c 4:32c24f03:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a4ab7f0 con 0x55840a3dfb20 2024-09-12T17:29:05.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.366+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:113 4.39 4:9e6a2cc2:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a437390 con 0x55840a3e8ee0 2024-09-12T17:29:05.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.366+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:114 4.27 4:e5608860:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a439cf0 con 0x55840a3e4530 2024-09-12T17:29:05.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.366+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:115 4.24 4:26b034cf:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a437390 con 0x7fe4d8017450 2024-09-12T17:29:05.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.366+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:116 4.3e 4:7d4ec560:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a43ea30 con 0x55840a3e4530 2024-09-12T17:29:05.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.366+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:117 4.3e 4:7ebc5b29:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a441500 con 0x55840a3e4530 2024-09-12T17:29:05.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.366+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(112 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.0 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fe4c8051070 con 0x55840a3dfb20 2024-09-12T17:29:05.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.366+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:118 4.1c 4:3a0af443:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a4a9db0 con 0x7fe4d8017450 2024-09-12T17:29:05.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.366+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:119 4.1b 4:db479acb:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a444c40 con 0x55840a3e4530 2024-09-12T17:29:05.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.366+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 <== osd.3 v2:172.21.15.170:6816/2664906588 30 ==== osd_op_reply(113 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fe4d001ab20 con 0x55840a3e8ee0 2024-09-12T17:29:05.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.366+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:120 4.0 4:02f56745:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a441500 con 0x55840a3e8ee0 2024-09-12T17:29:05.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.366+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:121 4.34 4:2ee31d42:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a447a60 con 0x55840a3e4530 2024-09-12T17:29:05.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.367+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 29 ==== osd_op_reply(115 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.367+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:122 4.1e 4:7a59a140:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a4a9db0 con 0x7fe4d8017450 2024-09-12T17:29:05.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.367+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 27 ==== osd_op_reply(114 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.2 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fe4d8075040 con 0x55840a3e4530 2024-09-12T17:29:05.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.367+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 28 ==== osd_op_reply(116 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.4 [call out=89b] v0'0 uv11 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fe4d8075040 con 0x55840a3e4530 2024-09-12T17:29:05.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.367+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 30 ==== osd_op_reply(118 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.367+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 <== osd.3 v2:172.21.15.170:6816/2664906588 31 ==== osd_op_reply(120 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.8 [call out=89b] v0'0 uv7 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fe4d001ab20 con 0x55840a3e8ee0 2024-09-12T17:29:05.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.367+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 31 ==== osd_op_reply(122 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.10 [call out=89b] v0'0 uv5 ondisk = 0) ==== 196+0+89 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.367+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 29 ==== osd_op_reply(119 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fe4d8075040 con 0x55840a3e4530 2024-09-12T17:29:05.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.367+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 30 ==== osd_op_reply(121 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.9 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fe4d8075040 con 0x55840a3e4530 2024-09-12T17:29:05.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.367+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 31 ==== osd_op_reply(111 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.5 [stat,call,call] v31'16 uv16 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fe4d8075040 con 0x55840a3e4530 2024-09-12T17:29:05.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.367+0000 7fe3c17fa640 20 handle_completion(): completion ok for obj=fourteen 2024-09-12T17:29:05.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.367+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 32 ==== osd_op_reply(117 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.5 [call out=128b] v0'0 uv16 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7fe4d8075040 con 0x55840a3e4530 2024-09-12T17:29:05.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.367+0000 7fe4e2b25800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:29:05.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.367+0000 7fe4e2b25800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:29:05.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.367+0000 7fe4e2b25800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:29:05.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.367+0000 7fe4e2b25800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:29:05.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.367+0000 7fe4e2b25800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10])"; uploads.size()=0; is_truncated=0 2024-09-12T17:29:05.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.367+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:123 4.c 4:32c24f03:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a444ca0 con 0x55840a3dfb20 2024-09-12T17:29:05.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.367+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:124 4.39 4:9e6a2cc2:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a4a9db0 con 0x55840a3e8ee0 2024-09-12T17:29:05.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.367+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:125 4.27 4:e5608860:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a436ee0 con 0x55840a3e4530 2024-09-12T17:29:05.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.367+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:126 4.24 4:26b034cf:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a43f3d0 con 0x7fe4d8017450 2024-09-12T17:29:05.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.367+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:127 4.3e 4:7d4ec560:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a444ca0 con 0x55840a3e4530 2024-09-12T17:29:05.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.367+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:128 4.3e 4:7ebc5b29:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a447a40 con 0x55840a3e4530 2024-09-12T17:29:05.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.367+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:129 4.1c 4:3a0af443:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a43f3d0 con 0x7fe4d8017450 2024-09-12T17:29:05.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.368+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:130 4.1b 4:db479acb:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a4a9db0 con 0x55840a3e4530 2024-09-12T17:29:05.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.368+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:131 4.0 4:02f56745:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a444ca0 con 0x55840a3e8ee0 2024-09-12T17:29:05.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.368+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:132 4.34 4:2ee31d42:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a4a9db0 con 0x55840a3e4530 2024-09-12T17:29:05.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.368+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:133 4.1e 4:7a59a140:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a43f3d0 con 0x7fe4d8017450 2024-09-12T17:29:05.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.368+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 32 ==== osd_op_reply(129 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.368+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 33 ==== osd_op_reply(126 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.368+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 <== osd.3 v2:172.21.15.170:6816/2664906588 32 ==== osd_op_reply(124 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fe4d0067070 con 0x55840a3e8ee0 2024-09-12T17:29:05.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.368+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(123 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.0 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fe4c8051070 con 0x55840a3dfb20 2024-09-12T17:29:05.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.368+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 <== osd.3 v2:172.21.15.170:6816/2664906588 33 ==== osd_op_reply(131 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.8 [call out=89b] v0'0 uv7 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fe4d0067070 con 0x55840a3e8ee0 2024-09-12T17:29:05.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.368+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 33 ==== osd_op_reply(125 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.2 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fe4d8075040 con 0x55840a3e4530 2024-09-12T17:29:05.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.368+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 34 ==== osd_op_reply(130 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fe4d8075040 con 0x55840a3e4530 2024-09-12T17:29:05.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.368+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 35 ==== osd_op_reply(127 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.4 [call out=89b] v0'0 uv11 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fe4d8075040 con 0x55840a3e4530 2024-09-12T17:29:05.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.368+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 36 ==== osd_op_reply(128 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.5 [call out=128b] v0'0 uv16 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7fe4d8075040 con 0x55840a3e4530 2024-09-12T17:29:05.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.368+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 34 ==== osd_op_reply(133 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.10 [call out=89b] v0'0 uv5 ondisk = 0) ==== 196+0+89 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.368+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 37 ==== osd_op_reply(132 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.9 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fe4d8075040 con 0x55840a3e4530 2024-09-12T17:29:05.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.368+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a4a9db0 con 0x7fe4d8017450 2024-09-12T17:29:05.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.369+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 35 ==== osd_op_reply(134 fud.buckets [call] v31'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.369+0000 7fe4e2b25800 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-09-12T17:29:05.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.369+0000 7fe4e2b25800 20 rados->read ofs=0 len=0 2024-09-12T17:29:05.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.369+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a4a9db0 con 0x55840a3e4530 2024-09-12T17:29:05.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.370+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 38 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv44 ondisk = 0) ==== 192+0+216 (crc 0 0 0) 0x7fe4d8075040 con 0x55840a3e4530 2024-09-12T17:29:05.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.370+0000 7fe4e2b25800 20 rados_obj.operate() r=0 bl.length=168 2024-09-12T17:29:05.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.370+0000 7fe4e2b25800 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-09-12T17:29:05.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.370+0000 7fe4e2b25800 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-09-12T17:29:05.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.370+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:136 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a4a9db0 con 0x55840a3e4530 2024-09-12T17:29:05.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.371+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 39 ==== osd_op_reply(136 myfoo7 [call,call,delete] v31'45 uv45 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7fe4d8075040 con 0x55840a3e4530 2024-09-12T17:29:05.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.371+0000 7fe4e2b25800 10 removing default.rgw.meta+root+myfoo7 from cache 2024-09-12T17:29:05.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.371+0000 7fe4e2b25800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-09-12T17:29:05.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.371+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94025596267056 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a4a9db0 con 0x55840a3e4530 2024-09-12T17:29:05.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.371+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 40 ==== watch-notify(notify (1) cookie 94025595947920 notify 133143986194 ret 0) ==== 192+0+0 (crc 0 0 0) 0x55840a3d49d0 con 0x55840a3e4530 2024-09-12T17:29:05.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.371+0000 7fe3c17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986194 cookie 94025595947920 notifier 4757 bl.length()=150 2024-09-12T17:29:05.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.371+0000 7fe3c17fa640 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fe3140032c0 con 0x55840a3e4530 2024-09-12T17:29:05.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.371+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 41 ==== osd_op_reply(137 notify.3 [notify cookie 94025596267056 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe4d8075040 con 0x55840a3e4530 2024-09-12T17:29:05.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.372+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 42 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4d8075040 con 0x55840a3e4530 2024-09-12T17:29:05.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.372+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 43 ==== watch-notify(notify_complete (2) cookie 94025596267056 notify 133143986194 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55840a3d4740 con 0x55840a3e4530 2024-09-12T17:29:05.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.372+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:139 8.e 8:77d7e45a:root::.bucket.meta.myfoo7%3a7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a4a9db0 con 0x7fe4d8017450 2024-09-12T17:29:05.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.373+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 36 ==== osd_op_reply(139 .bucket.meta.myfoo7:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10 [call,call,delete] v31'8 uv8 ondisk = 0) ==== 292+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.373+0000 7fe4e2b25800 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10 from cache 2024-09-12T17:29:05.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.373+0000 7fe4e2b25800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10, ofs0, ns] 2024-09-12T17:29:05.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.373+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:140 7.9 7:93e5b521:::notify.7:head [notify cookie 94025596267056 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a4a9db0 con 0x7fe4d8017450 2024-09-12T17:29:05.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.373+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 37 ==== watch-notify(notify (1) cookie 94025595958160 notify 133143986218 ret 0) ==== 250+0+0 (crc 0 0 0) 0x55840a42d530 con 0x7fe4d8017450 2024-09-12T17:29:05.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.373+0000 7fe3c1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986218 cookie 94025595958160 notifier 4757 bl.length()=208 2024-09-12T17:29:05.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.373+0000 7fe3c1ffb640 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:141 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fe3a4003d60 con 0x7fe4d8017450 2024-09-12T17:29:05.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.373+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 38 ==== osd_op_reply(140 notify.7 [notify cookie 94025596267056 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.374+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 39 ==== osd_op_reply(141 notify.7 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.374+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 40 ==== watch-notify(notify_complete (2) cookie 94025596267056 notify 133143986218 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55840a3f90d0 con 0x7fe4d8017450 2024-09-12T17:29:05.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.374+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:142 4.c 4:32c24f03:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a4a9db0 con 0x55840a3dfb20 2024-09-12T17:29:05.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.374+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:143 4.39 4:9e6a2cc2:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a43ea30 con 0x55840a3e8ee0 2024-09-12T17:29:05.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.374+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:144 4.27 4:e5608860:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a42ce80 con 0x55840a3e4530 2024-09-12T17:29:05.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.374+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:145 4.24 4:26b034cf:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a433eb0 con 0x7fe4d8017450 2024-09-12T17:29:05.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.374+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:146 4.3e 4:7d4ec560:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a4a9db0 con 0x55840a3e4530 2024-09-12T17:29:05.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.374+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:147 4.3e 4:7ebc5b29:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a434700 con 0x55840a3e4530 2024-09-12T17:29:05.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.374+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:148 4.1c 4:3a0af443:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a444480 con 0x7fe4d8017450 2024-09-12T17:29:05.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.374+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:149 4.1b 4:db479acb:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a433eb0 con 0x55840a3e4530 2024-09-12T17:29:05.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.374+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:150 4.0 4:02f56745:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a43ea30 con 0x55840a3e8ee0 2024-09-12T17:29:05.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.374+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:151 4.34 4:2ee31d42:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a42ce80 con 0x55840a3e4530 2024-09-12T17:29:05.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.374+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:152 4.1e 4:7a59a140:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a4a9db0 con 0x7fe4d8017450 2024-09-12T17:29:05.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.376+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 41 ==== osd_op_reply(152 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.10 [delete] v31'6 uv6 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.376+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 44 ==== osd_op_reply(149 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.7 [delete] v31'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fe4d8075040 con 0x55840a3e4530 2024-09-12T17:29:05.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.376+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 <== osd.3 v2:172.21.15.170:6816/2664906588 34 ==== osd_op_reply(150 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.8 [delete] v31'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fe4d0067070 con 0x55840a3e8ee0 2024-09-12T17:29:05.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.376+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 45 ==== osd_op_reply(144 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.2 [delete] v31'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fe4d8075040 con 0x55840a3e4530 2024-09-12T17:29:05.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.376+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 46 ==== osd_op_reply(146 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.4 [delete] v31'17 uv17 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fe4d8075040 con 0x55840a3e4530 2024-09-12T17:29:05.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.376+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.1 v2:172.21.15.170:6800/1903654092 30 ==== osd_op_reply(142 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.0 [delete] v31'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x55840a3dfb20 2024-09-12T17:29:05.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.376+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 42 ==== osd_op_reply(145 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.3 [delete] v31'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.376+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 47 ==== osd_op_reply(147 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.5 [delete] v31'18 uv18 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fe4d8075040 con 0x55840a3e4530 2024-09-12T17:29:05.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.376+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 43 ==== osd_op_reply(148 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.6 [delete] v31'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.376+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 <== osd.3 v2:172.21.15.170:6816/2664906588 35 ==== osd_op_reply(143 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.1 [delete] v31'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fe4d0067070 con 0x55840a3e8ee0 2024-09-12T17:29:05.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.376+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 48 ==== osd_op_reply(151 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10.9 [delete] v31'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fe4d8075040 con 0x55840a3e4530 2024-09-12T17:29:05.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.376+0000 7fe4e2b25800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10 : miss 2024-09-12T17:29:05.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.376+0000 7fe4e2b25800 20 rados->read ofs=0 len=0 2024-09-12T17:29:05.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.376+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:153 6.8 6:17fbe3ed:::pubsub..bucket.myfoo7%2f7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a444480 con 0x55840a3e8ee0 2024-09-12T17:29:05.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.377+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 <== osd.3 v2:172.21.15.170:6816/2664906588 36 ==== osd_op_reply(153 pubsub..bucket.myfoo7/7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7fe4d0067070 con 0x55840a3e8ee0 2024-09-12T17:29:05.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.377+0000 7fe4e2b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:05.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.377+0000 7fe4e2b25800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10 info.flags=0x0 2024-09-12T17:29:05.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.377+0000 7fe4e2b25800 10 adding default.rgw.log++pubsub..bucket.myfoo7/7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10 to cache LRU end 2024-09-12T17:29:05.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.377+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:154 6.8 6:17fbe3ed:::pubsub..bucket.myfoo7%2f7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a4a9db0 con 0x55840a3e8ee0 2024-09-12T17:29:05.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.378+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 <== osd.3 v2:172.21.15.170:6816/2664906588 37 ==== osd_op_reply(154 pubsub..bucket.myfoo7/7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.10 [delete] v31'34 uv27 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7fe4d0067070 con 0x55840a3e8ee0 2024-09-12T17:29:05.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.378+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:155 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=147b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a4a9db0 con 0x7fe4d8017450 2024-09-12T17:29:05.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.379+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 44 ==== osd_op_reply(155 fud.buckets [call] v31'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.379+0000 7fe4e2b25800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-12T17:29:05.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.379+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:156 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a4a9db0 con 0x7fe4d8017450 2024-09-12T17:29:05.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.380+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 45 ==== osd_op_reply(156 p5YnriCv1nAtykxBrupQ [delete] v31'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.380+0000 7fe4e2b25800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-12T17:29:05.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.380+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:157 7.15 7:a93a5511:::notify.2:head [notify cookie 94025596705024 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a42cec0 con 0x55840a3e8ee0 2024-09-12T17:29:05.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.380+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 <== osd.3 v2:172.21.15.170:6816/2664906588 38 ==== watch-notify(notify (1) cookie 94025595944240 notify 133143986193 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55840a3ffd30 con 0x55840a3e8ee0 2024-09-12T17:29:05.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.380+0000 7fe3c17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986193 cookie 94025595944240 notifier 4757 bl.length()=170 2024-09-12T17:29:05.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.380+0000 7fe3c17fa640 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fe3140032c0 con 0x55840a3e8ee0 2024-09-12T17:29:05.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.380+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 <== osd.3 v2:172.21.15.170:6816/2664906588 39 ==== osd_op_reply(157 notify.2 [notify cookie 94025596705024 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe4d0067070 con 0x55840a3e8ee0 2024-09-12T17:29:05.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.380+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 <== osd.3 v2:172.21.15.170:6816/2664906588 40 ==== osd_op_reply(158 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4d0067070 con 0x55840a3e8ee0 2024-09-12T17:29:05.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.380+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 <== osd.3 v2:172.21.15.170:6816/2664906588 41 ==== watch-notify(notify_complete (2) cookie 94025596705024 notify 133143986193 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe4d0059040 con 0x55840a3e8ee0 2024-09-12T17:29:05.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.380+0000 7fe4e2b25800 10 removing email index: 2024-09-12T17:29:05.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.380+0000 7fe4e2b25800 10 removing user buckets index 2024-09-12T17:29:05.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.380+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:159 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a4a9db0 con 0x7fe4d8017450 2024-09-12T17:29:05.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.381+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 46 ==== osd_op_reply(159 fud.buckets [delete] v31'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.381+0000 7fe4e2b25800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-12T17:29:05.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.381+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94025596705024 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a42cec0 con 0x7fe4d8017450 2024-09-12T17:29:05.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.382+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 47 ==== watch-notify(notify (1) cookie 94025595953328 notify 133143986219 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55840a3f90d0 con 0x7fe4d8017450 2024-09-12T17:29:05.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.382+0000 7fe3c1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986219 cookie 94025595953328 notifier 4757 bl.length()=160 2024-09-12T17:29:05.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.382+0000 7fe3c1ffb640 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fe3a4003d60 con 0x7fe4d8017450 2024-09-12T17:29:05.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.382+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 48 ==== osd_op_reply(160 notify.6 [notify cookie 94025596705024 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.382+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 49 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.382+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 50 ==== watch-notify(notify_complete (2) cookie 94025596705024 notify 133143986219 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55840a3f8f00 con 0x7fe4d8017450 2024-09-12T17:29:05.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.382+0000 7fe4e2b25800 10 removing user index: fud 2024-09-12T17:29:05.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.382+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:162 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a4a9900 con 0x7fe4d8017450 2024-09-12T17:29:05.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.383+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 51 ==== osd_op_reply(162 fud [call,call,delete] v31'9 uv9 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.383+0000 7fe4e2b25800 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-12T17:29:05.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.383+0000 7fe4e2b25800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-12T17:29:05.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.383+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94025596705024 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55840a4a9e20 con 0x7fe4d8017450 2024-09-12T17:29:05.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.383+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 52 ==== watch-notify(notify (1) cookie 94025595941312 notify 133143986220 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55840a3f8f00 con 0x7fe4d8017450 2024-09-12T17:29:05.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.383+0000 7fe3c17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986220 cookie 94025595941312 notifier 4757 bl.length()=152 2024-09-12T17:29:05.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.383+0000 7fe3c17fa640 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fe3140032c0 con 0x7fe4d8017450 2024-09-12T17:29:05.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.384+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 53 ==== osd_op_reply(163 notify.5 [notify cookie 94025596705024 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.384+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 54 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.384+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 55 ==== watch-notify(notify_complete (2) cookie 94025596705024 notify 133143986220 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55840a3ffb60 con 0x7fe4d8017450 2024-09-12T17:29:05.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.385+0000 7fe394fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:05.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.385+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94025595959344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a4a9e20 con 0x55840a3dfb20 2024-09-12T17:29:05.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.386+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.1 v2:172.21.15.170:6800/1903654092 31 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94025595959344] v31'228 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x55840a3dfb20 2024-09-12T17:29:05.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.386+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94025595936272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a4a9e20 con 0x55840a3e4530 2024-09-12T17:29:05.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.387+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 49 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94025595936272] v31'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4d8075040 con 0x55840a3e4530 2024-09-12T17:29:05.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.387+0000 7fe4e2b25800 20 remove_watcher() i=0 2024-09-12T17:29:05.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.387+0000 7fe4e2b25800 2 removed watcher, disabling cache 2024-09-12T17:29:05.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.387+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94025595940160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3ede10 con 0x55840a3dfb20 2024-09-12T17:29:05.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.388+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.1 v2:172.21.15.170:6800/1903654092 32 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94025595940160] v31'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x55840a3dfb20 2024-09-12T17:29:05.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.388+0000 7fe4e2b25800 20 remove_watcher() i=1 2024-09-12T17:29:05.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.388+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94025595944240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3eed40 con 0x55840a3e8ee0 2024-09-12T17:29:05.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.389+0000 7fe4de7ae640 1 -- 172.21.15.170:0/1924501997 <== osd.3 v2:172.21.15.170:6816/2664906588 42 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94025595944240] v31'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4d0067070 con 0x55840a3e8ee0 2024-09-12T17:29:05.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.389+0000 7fe4e2b25800 20 remove_watcher() i=2 2024-09-12T17:29:05.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.389+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94025595947920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3eed40 con 0x55840a3e4530 2024-09-12T17:29:05.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.390+0000 7fe4defaf640 1 -- 172.21.15.170:0/1924501997 <== osd.2 v2:172.21.15.170:6808/3855567754 50 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94025595947920] v31'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4d8075040 con 0x55840a3e4530 2024-09-12T17:29:05.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.390+0000 7fe4e2b25800 20 remove_watcher() i=3 2024-09-12T17:29:05.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.390+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94025595950608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3eed40 con 0x55840a3dfb20 2024-09-12T17:29:05.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.391+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.1 v2:172.21.15.170:6800/1903654092 33 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94025595950608] v31'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x55840a3dfb20 2024-09-12T17:29:05.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.391+0000 7fe4e2b25800 20 remove_watcher() i=4 2024-09-12T17:29:05.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.391+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94025595941312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3f1610 con 0x7fe4d8017450 2024-09-12T17:29:05.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.392+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 56 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94025595941312] v31'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.392+0000 7fe4e2b25800 20 remove_watcher() i=5 2024-09-12T17:29:05.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.392+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94025595953328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3eed40 con 0x7fe4d8017450 2024-09-12T17:29:05.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.393+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 57 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94025595953328] v31'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.393+0000 7fe4e2b25800 20 remove_watcher() i=6 2024-09-12T17:29:05.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.393+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94025595958160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55840a3f1610 con 0x7fe4d8017450 2024-09-12T17:29:05.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.394+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 <== osd.0 v2:172.21.15.47:6800/3978157098 58 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94025595958160] v31'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4c8051070 con 0x7fe4d8017450 2024-09-12T17:29:05.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.394+0000 7fe4e2b25800 20 remove_watcher() i=7 2024-09-12T17:29:05.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.394+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fe4d8017450 msgr2=0x7fe4d8056a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:05.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.394+0000 7fe4e2b25800 1 --2- 172.21.15.170:0/1924501997 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fe4d8017450 0x7fe4d8056a80 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.394+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55840a3dfb20 msgr2=0x55840a3e1fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:05.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.394+0000 7fe4e2b25800 1 --2- 172.21.15.170:0/1924501997 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55840a3dfb20 0x55840a3e1fe0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.394+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55840a3e4530 msgr2=0x55840a3e6920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:05.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.394+0000 7fe4e2b25800 1 --2- 172.21.15.170:0/1924501997 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55840a3e4530 0x55840a3e6920 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.394+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55840a3e8ee0 msgr2=0x55840a3eb3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:05.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.394+0000 7fe4e2b25800 1 --2- 172.21.15.170:0/1924501997 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55840a3e8ee0 0x55840a3eb3a0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.394+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe3a803c780 msgr2=0x7fe3a803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:05.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.394+0000 7fe4e2b25800 1 --2- 172.21.15.170:0/1924501997 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe3a803c780 0x7fe3a803ec40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0053af0 tx=0x7fe4d0030000 comp rx=0 tx=0).stop 2024-09-12T17:29:05.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.394+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55840a3ccc00 msgr2=0x55840a3d41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:05.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.394+0000 7fe4d7fff640 1 -- 172.21.15.170:0/1924501997 reap_dead start 2024-09-12T17:29:05.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.394+0000 7fe4e2b25800 1 --2- 172.21.15.170:0/1924501997 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55840a3ccc00 0x55840a3d41e0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8047040 tx=0x7fe4d8053cc0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.395+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 shutdown_connections 2024-09-12T17:29:05.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.395+0000 7fe4e2b25800 1 --2- 172.21.15.170:0/1924501997 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55840a3ccc00 0x55840a3d41e0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.395+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 >> 172.21.15.170:0/1924501997 conn(0x55840a3c9020 msgr2=0x55840a3c7230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:05.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.395+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 shutdown_connections 2024-09-12T17:29:05.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.395+0000 7fe4e2b25800 1 -- 172.21.15.170:0/1924501997 wait complete. 2024-09-12T17:29:05.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.395+0000 7fe4e2b25800 1 -- 172.21.15.170:0/3398295512 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe3b803c730 msgr2=0x7fe3b803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:05.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.395+0000 7fe4e2b25800 1 --2- 172.21.15.170:0/3398295512 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe3b803c730 0x7fe3b803ebf0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe4d000c720 tx=0x7fe4d0043050 comp rx=0 tx=0).stop 2024-09-12T17:29:05.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.395+0000 7fe4e2b25800 1 -- 172.21.15.170:0/3398295512 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55840a3c0100 msgr2=0x55840a3c0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:05.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.395+0000 7fe4e2b25800 1 --2- 172.21.15.170:0/3398295512 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55840a3c0100 0x55840a3c0520 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x55840a396b70 tx=0x7fe4d80167b0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.395+0000 7fe4e2b25800 1 -- 172.21.15.170:0/3398295512 shutdown_connections 2024-09-12T17:29:05.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.395+0000 7fe4e2b25800 1 --2- 172.21.15.170:0/3398295512 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe3b803c730 0x7fe3b803ebf0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.395+0000 7fe4e2b25800 1 --2- 172.21.15.170:0/3398295512 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55840a3c0100 0x55840a3c0520 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.395+0000 7fe4e2b25800 1 -- 172.21.15.170:0/3398295512 >> 172.21.15.170:0/3398295512 conn(0x55840a3b44b0 msgr2=0x55840a3b4890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:05.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.395+0000 7fe4e2b25800 1 -- 172.21.15.170:0/3398295512 shutdown_connections 2024-09-12T17:29:05.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.395+0000 7fe4e2b25800 1 -- 172.21.15.170:0/3398295512 wait complete. 2024-09-12T17:29:05.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.395+0000 7fe4e2b25800 1 -- 172.21.15.170:0/4157801413 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55840a2ac210 msgr2=0x55840a3ac540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:05.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.395+0000 7fe4e2b25800 1 --2- 172.21.15.170:0/4157801413 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55840a2ac210 0x55840a3ac540 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.395+0000 7fe4e2b25800 1 -- 172.21.15.170:0/4157801413 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55840a3aedb0 msgr2=0x55840a3b11a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:05.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.395+0000 7fe4e2b25800 1 --2- 172.21.15.170:0/4157801413 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55840a3aedb0 0x55840a3b11a0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.395+0000 7fe4e2b25800 1 -- 172.21.15.170:0/4157801413 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe3c403c730 msgr2=0x7fe3c403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:05.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.395+0000 7fe4e2b25800 1 --2- 172.21.15.170:0/4157801413 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe3c403c730 0x7fe3c403ebf0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8057000 tx=0x7fe4c8052000 comp rx=0 tx=0).stop 2024-09-12T17:29:05.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.395+0000 7fe4e2b25800 1 -- 172.21.15.170:0/4157801413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55840a2aae00 msgr2=0x55840a397140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:05.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.395+0000 7fe4e2b25800 1 --2- 172.21.15.170:0/4157801413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55840a2aae00 0x55840a397140 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fe4d000c010 tx=0x7fe4d0000ed0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.396+0000 7fe4e2b25800 1 -- 172.21.15.170:0/4157801413 shutdown_connections 2024-09-12T17:29:05.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.396+0000 7fe4e2b25800 1 --2- 172.21.15.170:0/4157801413 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55840a3aedb0 0x55840a3b11a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.396+0000 7fe4e2b25800 1 --2- 172.21.15.170:0/4157801413 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe3c403c730 0x7fe3c403ebf0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.396+0000 7fe4e2b25800 1 --2- 172.21.15.170:0/4157801413 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55840a2ac210 0x55840a3ac540 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.396+0000 7fe4e2b25800 1 --2- 172.21.15.170:0/4157801413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55840a2aae00 0x55840a397140 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:05.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.396+0000 7fe4e2b25800 1 -- 172.21.15.170:0/4157801413 >> 172.21.15.170:0/4157801413 conn(0x55840a2a61d0 msgr2=0x55840a3946d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:05.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.396+0000 7fe4e2b25800 1 -- 172.21.15.170:0/4157801413 shutdown_connections 2024-09-12T17:29:05.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:05.396+0000 7fe4e2b25800 1 -- 172.21.15.170:0/4157801413 wait complete. 2024-09-12T17:29:45.407 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-09-12T17:29:45.408 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-09-12T17:29:45.409 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-09-12T17:29:45.461 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:29:45.461 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:29:45.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.461+0000 7f9225220800 1 Processor -- start 2024-09-12T17:29:45.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.461+0000 7f9225220800 1 -- start start 2024-09-12T17:29:45.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.461+0000 7f9225220800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55cbcd6af6b0 0x55cbcd6b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.461+0000 7f9225220800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cbcd558e40 con 0x55cbcd6b2040 2024-09-12T17:29:45.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.461+0000 7f9225220800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x55cbcd523680 con 0x55cbcd6af6b0 2024-09-12T17:29:45.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.462+0000 7f9222d11640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55cbcd6af6b0 0x55cbcd6b1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.462+0000 7f921bfff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x55cbcd6b2040 0x55cbcd6b44e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:44782/0 (socket says 172.21.15.170:44782) 2024-09-12T17:29:45.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.462+0000 7f921bfff640 1 -- 172.21.15.170:0/2439890133 learned_addr learned my addr 172.21.15.170:0/2439890133 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:29:45.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.462+0000 7f9222510640 1 -- 172.21.15.170:0/2439890133 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2148157340 0 0) 0x55cbcd558e40 con 0x55cbcd6b2040 2024-09-12T17:29:45.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.462+0000 7f9222510640 1 -- 172.21.15.170:0/2439890133 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9210001e10 con 0x55cbcd6b2040 2024-09-12T17:29:45.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.462+0000 7f9222d11640 1 -- 172.21.15.170:0/2439890133 >> v1:172.21.15.47:6789/0 conn(0x55cbcd6b2040 legacy=0x55cbcd6b44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.462+0000 7f9222d11640 1 -- 172.21.15.170:0/2439890133 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbcd53f6b0 con 0x55cbcd6af6b0 2024-09-12T17:29:45.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.464+0000 7f9222d11640 1 --2- 172.21.15.170:0/2439890133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbcd6af6b0 0x55cbcd6b1aa0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f921400a470 tx=0x7f9214045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=198d5b8f38b741d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.464+0000 7f9222510640 1 -- 172.21.15.170:0/2439890133 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9214059070 con 0x55cbcd6af6b0 2024-09-12T17:29:45.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.464+0000 7f9222510640 1 -- 172.21.15.170:0/2439890133 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9214054570 con 0x55cbcd6af6b0 2024-09-12T17:29:45.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.464+0000 7f9222510640 1 -- 172.21.15.170:0/2439890133 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9214054870 con 0x55cbcd6af6b0 2024-09-12T17:29:45.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.464+0000 7f9225220800 1 -- 172.21.15.170:0/2439890133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbcd6af6b0 msgr2=0x55cbcd6b1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.464+0000 7f9225220800 1 --2- 172.21.15.170:0/2439890133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbcd6af6b0 0x55cbcd6b1aa0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f921400a470 tx=0x7f9214045920 comp rx=0 tx=0).stop 2024-09-12T17:29:45.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.465+0000 7f9225220800 1 -- 172.21.15.170:0/2439890133 shutdown_connections 2024-09-12T17:29:45.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.465+0000 7f9225220800 1 --2- 172.21.15.170:0/2439890133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbcd6af6b0 0x55cbcd6b1aa0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.465+0000 7f9225220800 1 -- 172.21.15.170:0/2439890133 >> 172.21.15.170:0/2439890133 conn(0x55cbcd6a91f0 msgr2=0x55cbcd6ab630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:45.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.465+0000 7f9225220800 1 -- 172.21.15.170:0/2439890133 shutdown_connections 2024-09-12T17:29:45.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.465+0000 7f9225220800 1 -- 172.21.15.170:0/2439890133 wait complete. 2024-09-12T17:29:45.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.481+0000 7f9225220800 1 Processor -- start 2024-09-12T17:29:45.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.481+0000 7f9225220800 1 -- start start 2024-09-12T17:29:45.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.481+0000 7f9225220800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbcd6af6b0 0x55cbcd79e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.481+0000 7f9225220800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55cbcd547dd0 con 0x55cbcd6af6b0 2024-09-12T17:29:45.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.481+0000 7f9222d11640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbcd6af6b0 0x55cbcd79e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.481+0000 7f9222d11640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbcd6af6b0 0x55cbcd79e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34336/0 (socket says 172.21.15.170:34336) 2024-09-12T17:29:45.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.481+0000 7f9222d11640 1 -- 172.21.15.170:0/3767306801 learned_addr learned my addr 172.21.15.170:0/3767306801 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:45.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.482+0000 7f9222d11640 1 -- 172.21.15.170:0/3767306801 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbcd560e10 con 0x55cbcd6af6b0 2024-09-12T17:29:45.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.482+0000 7f9222d11640 1 --2- 172.21.15.170:0/3767306801 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbcd6af6b0 0x55cbcd79e4a0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f921400a470 tx=0x7f921404e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=816072d040a3f060 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.482+0000 7f9110e09640 1 -- 172.21.15.170:0/3767306801 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9214065070 con 0x55cbcd6af6b0 2024-09-12T17:29:45.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.482+0000 7f9110e09640 1 -- 172.21.15.170:0/3767306801 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f921405a040 con 0x55cbcd6af6b0 2024-09-12T17:29:45.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.482+0000 7f9110e09640 1 -- 172.21.15.170:0/3767306801 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9214059070 con 0x55cbcd6af6b0 2024-09-12T17:29:45.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.483+0000 7f9225220800 1 -- 172.21.15.170:0/3767306801 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbcd6af6b0 msgr2=0x55cbcd79e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.483+0000 7f9225220800 1 --2- 172.21.15.170:0/3767306801 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbcd6af6b0 0x55cbcd79e4a0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f921400a470 tx=0x7f921404e000 comp rx=0 tx=0).stop 2024-09-12T17:29:45.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.483+0000 7f9225220800 1 -- 172.21.15.170:0/3767306801 shutdown_connections 2024-09-12T17:29:45.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.483+0000 7f9225220800 1 --2- 172.21.15.170:0/3767306801 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbcd6af6b0 0x55cbcd79e4a0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.483+0000 7f9225220800 1 -- 172.21.15.170:0/3767306801 >> 172.21.15.170:0/3767306801 conn(0x55cbcd6a91f0 msgr2=0x55cbcd799e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:45.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.483+0000 7f9225220800 1 -- 172.21.15.170:0/3767306801 shutdown_connections 2024-09-12T17:29:45.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.483+0000 7f9225220800 1 -- 172.21.15.170:0/3767306801 wait complete. 2024-09-12T17:29:45.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.483+0000 7f9225220800 1 Processor -- start 2024-09-12T17:29:45.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.483+0000 7f9225220800 1 -- start start 2024-09-12T17:29:45.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.483+0000 7f9225220800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbcd6af6b0 0x55cbcd7a5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.483+0000 7f9225220800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55cbcd6b6040 con 0x55cbcd6af6b0 2024-09-12T17:29:45.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.484+0000 7f9222d11640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbcd6af6b0 0x55cbcd7a5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.484+0000 7f9222d11640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbcd6af6b0 0x55cbcd7a5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34342/0 (socket says 172.21.15.170:34342) 2024-09-12T17:29:45.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.484+0000 7f9222d11640 1 -- 172.21.15.170:0/3957952158 learned_addr learned my addr 172.21.15.170:0/3957952158 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:45.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.484+0000 7f9222d11640 1 -- 172.21.15.170:0/3957952158 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbcd7a61b0 con 0x55cbcd6af6b0 2024-09-12T17:29:45.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.484+0000 7f9222d11640 1 --2- 172.21.15.170:0/3957952158 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbcd6af6b0 0x55cbcd7a5c50 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f9214025b20 tx=0x7f9214002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.484+0000 7f910f606640 1 -- 172.21.15.170:0/3957952158 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9214071070 con 0x55cbcd6af6b0 2024-09-12T17:29:45.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.484+0000 7f910f606640 1 -- 172.21.15.170:0/3957952158 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9214066040 con 0x55cbcd6af6b0 2024-09-12T17:29:45.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.484+0000 7f9225220800 1 -- 172.21.15.170:0/3957952158 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cbcd7a6440 con 0x55cbcd6af6b0 2024-09-12T17:29:45.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.484+0000 7f910f606640 1 -- 172.21.15.170:0/3957952158 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9214065050 con 0x55cbcd6af6b0 2024-09-12T17:29:45.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.485+0000 7f9225220800 1 -- 172.21.15.170:0/3957952158 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbcd7a6e40 con 0x55cbcd6af6b0 2024-09-12T17:29:45.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.485+0000 7f910f606640 1 -- 172.21.15.170:0/3957952158 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f9214074070 con 0x55cbcd6af6b0 2024-09-12T17:29:45.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.486+0000 7f910f606640 1 --2- 172.21.15.170:0/3957952158 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f910803c730 0x7f910803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.486+0000 7f910f606640 1 -- 172.21.15.170:0/3957952158 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f9214096730 con 0x55cbcd6af6b0 2024-09-12T17:29:45.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.486+0000 7f921bfff640 1 --2- 172.21.15.170:0/3957952158 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f910803c730 0x7f910803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.486+0000 7f9225220800 1 --2- 172.21.15.170:0/3957952158 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55cbcd6b2040 0x55cbcd7ad2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.486+0000 7f9225220800 1 -- 172.21.15.170:0/3957952158 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7ad7e0 con 0x55cbcd6b2040 2024-09-12T17:29:45.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.486+0000 7f9223512640 1 --2- 172.21.15.170:0/3957952158 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55cbcd6b2040 0x55cbcd7ad2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.486+0000 7f921bfff640 1 --2- 172.21.15.170:0/3957952158 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f910803c730 0x7f910803ebf0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f920c001db0 tx=0x7f920c001310 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.486+0000 7f9223512640 1 --2- 172.21.15.170:0/3957952158 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55cbcd6b2040 0x55cbcd7ad2a0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.487+0000 7f9223512640 1 -- 172.21.15.170:0/3957952158 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f921c00a4d0 con 0x55cbcd6b2040 2024-09-12T17:29:45.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.487+0000 7f9225220800 1 -- 172.21.15.170:0/3957952158 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7adb80 con 0x55cbcd6b2040 2024-09-12T17:29:45.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.487+0000 7f9223512640 1 -- 172.21.15.170:0/3957952158 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f921c00a4d0 con 0x55cbcd6b2040 2024-09-12T17:29:45.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.487+0000 7f9225220800 1 --2- 172.21.15.170:0/3957952158 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55cbcd7af680 0x55cbcd7b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.487+0000 7f9225220800 1 -- 172.21.15.170:0/3957952158 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7b2290 con 0x55cbcd7af680 2024-09-12T17:29:45.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.487+0000 7f9222d11640 1 --2- 172.21.15.170:0/3957952158 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55cbcd7af680 0x55cbcd7b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.487+0000 7f9222d11640 1 --2- 172.21.15.170:0/3957952158 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55cbcd7af680 0x55cbcd7b1b00 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.488+0000 7f9222d11640 1 -- 172.21.15.170:0/3957952158 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9214091420 con 0x55cbcd7af680 2024-09-12T17:29:45.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.488+0000 7f9225220800 1 -- 172.21.15.170:0/3957952158 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7ae3d0 con 0x55cbcd6b2040 2024-09-12T17:29:45.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.488+0000 7f9223512640 1 -- 172.21.15.170:0/3957952158 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f921c00a4d0 con 0x55cbcd6b2040 2024-09-12T17:29:45.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.488+0000 7f9225220800 1 -- 172.21.15.170:0/3957952158 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7ae820 con 0x55cbcd7af680 2024-09-12T17:29:45.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.488+0000 7f9222d11640 1 -- 172.21.15.170:0/3957952158 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9214091040 con 0x55cbcd7af680 2024-09-12T17:29:45.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.489+0000 7f9225220800 1 Processor -- start 2024-09-12T17:29:45.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.489+0000 7f9225220800 1 -- start start 2024-09-12T17:29:45.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.489+0000 7f9225220800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbcd6aee50 0x55cbcd6ad6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.489+0000 7f9225220800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55cbcd5a5a00 con 0x55cbcd6aee50 2024-09-12T17:29:45.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.489+0000 7f9223512640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbcd6aee50 0x55cbcd6ad6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.489+0000 7f9223512640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbcd6aee50 0x55cbcd6ad6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34358/0 (socket says 172.21.15.170:34358) 2024-09-12T17:29:45.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.489+0000 7f9223512640 1 -- 172.21.15.170:0/1097048890 learned_addr learned my addr 172.21.15.170:0/1097048890 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:45.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.490+0000 7f9223512640 1 -- 172.21.15.170:0/1097048890 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbcd6af370 con 0x55cbcd6aee50 2024-09-12T17:29:45.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.490+0000 7f9223512640 1 --2- 172.21.15.170:0/1097048890 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbcd6aee50 0x55cbcd6ad6c0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x55cbcd7a6c50 tx=0x7f921c0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.490+0000 7f910ce01640 1 -- 172.21.15.170:0/1097048890 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f921c013640 con 0x55cbcd6aee50 2024-09-12T17:29:45.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.490+0000 7f910ce01640 1 -- 172.21.15.170:0/1097048890 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f921c0137e0 con 0x55cbcd6aee50 2024-09-12T17:29:45.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.490+0000 7f9225220800 1 -- 172.21.15.170:0/1097048890 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cbcd6adc00 con 0x55cbcd6aee50 2024-09-12T17:29:45.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.490+0000 7f910ce01640 1 -- 172.21.15.170:0/1097048890 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f921c013ac0 con 0x55cbcd6aee50 2024-09-12T17:29:45.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.490+0000 7f9225220800 1 -- 172.21.15.170:0/1097048890 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbcd6ae150 con 0x55cbcd6aee50 2024-09-12T17:29:45.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.491+0000 7f910ce01640 1 -- 172.21.15.170:0/1097048890 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f921c011040 con 0x55cbcd6aee50 2024-09-12T17:29:45.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.491+0000 7f910ce01640 1 --2- 172.21.15.170:0/1097048890 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f90fc03c730 0x7f90fc03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.491+0000 7f910ce01640 1 -- 172.21.15.170:0/1097048890 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f921c00e040 con 0x55cbcd6aee50 2024-09-12T17:29:45.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.491+0000 7f9222d11640 1 --2- 172.21.15.170:0/1097048890 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f90fc03c730 0x7f90fc03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.492+0000 7f9225220800 1 Processor -- start 2024-09-12T17:29:45.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.492+0000 7f9222d11640 1 --2- 172.21.15.170:0/1097048890 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f90fc03c730 0x7f90fc03ebf0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f921405fa50 tx=0x7f921406a670 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.492+0000 7f9225220800 1 -- start start 2024-09-12T17:29:45.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.492+0000 7f9225220800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbcd7cf730 0x55cbcd7cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.492+0000 7f9225220800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55cbcd79ec30 con 0x55cbcd7cf730 2024-09-12T17:29:45.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.492+0000 7f9223512640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbcd7cf730 0x55cbcd7cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.492+0000 7f9223512640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbcd7cf730 0x55cbcd7cfb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34362/0 (socket says 172.21.15.170:34362) 2024-09-12T17:29:45.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.492+0000 7f9223512640 1 -- 172.21.15.170:0/3035852663 learned_addr learned my addr 172.21.15.170:0/3035852663 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:45.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.493+0000 7f9223512640 1 -- 172.21.15.170:0/3035852663 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbcd7d0120 con 0x55cbcd7cf730 2024-09-12T17:29:45.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.493+0000 7f9223512640 1 --2- 172.21.15.170:0/3035852663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbcd7cf730 0x55cbcd7cfb30 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f921c040fd0 tx=0x7f921c01fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34221d5e06e44ff2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.493+0000 7f91067fc640 1 -- 172.21.15.170:0/3035852663 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f921c04a070 con 0x55cbcd7cf730 2024-09-12T17:29:45.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.493+0000 7f91067fc640 1 -- 172.21.15.170:0/3035852663 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f921c055040 con 0x55cbcd7cf730 2024-09-12T17:29:45.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.493+0000 7f91067fc640 1 -- 172.21.15.170:0/3035852663 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f921c021a40 con 0x55cbcd7cf730 2024-09-12T17:29:45.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.494+0000 7f9225220800 1 -- 172.21.15.170:0/3035852663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbcd7cf730 msgr2=0x55cbcd7cfb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.494+0000 7f9225220800 1 --2- 172.21.15.170:0/3035852663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbcd7cf730 0x55cbcd7cfb30 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f921c040fd0 tx=0x7f921c01fc90 comp rx=0 tx=0).stop 2024-09-12T17:29:45.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.494+0000 7f9225220800 1 -- 172.21.15.170:0/3035852663 shutdown_connections 2024-09-12T17:29:45.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.494+0000 7f9225220800 1 --2- 172.21.15.170:0/3035852663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbcd7cf730 0x55cbcd7cfb30 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.494+0000 7f9225220800 1 -- 172.21.15.170:0/3035852663 >> 172.21.15.170:0/3035852663 conn(0x55cbcd7cbb30 msgr2=0x55cbcd7c9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:45.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.494+0000 7f9225220800 1 -- 172.21.15.170:0/3035852663 shutdown_connections 2024-09-12T17:29:45.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.494+0000 7f9225220800 1 -- 172.21.15.170:0/3035852663 wait complete. 2024-09-12T17:29:45.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.494+0000 7f9225220800 1 Processor -- start 2024-09-12T17:29:45.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.494+0000 7f9225220800 1 -- start start 2024-09-12T17:29:45.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.494+0000 7f9225220800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbcd7cf730 0x55cbcd7d6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.494+0000 7f9225220800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55cbcd7d0740 con 0x55cbcd7cf730 2024-09-12T17:29:45.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.494+0000 7f9223512640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbcd7cf730 0x55cbcd7d6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.494+0000 7f9223512640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbcd7cf730 0x55cbcd7d6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34378/0 (socket says 172.21.15.170:34378) 2024-09-12T17:29:45.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.494+0000 7f9223512640 1 -- 172.21.15.170:0/2686729863 learned_addr learned my addr 172.21.15.170:0/2686729863 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:45.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.495+0000 7f9223512640 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbcd7d7230 con 0x55cbcd7cf730 2024-09-12T17:29:45.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.495+0000 7f9223512640 1 --2- 172.21.15.170:0/2686729863 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbcd7cf730 0x55cbcd7d6cd0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f921c01fcd0 tx=0x7f921c053d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.495+0000 7f9104ff9640 1 -- 172.21.15.170:0/2686729863 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f921c039070 con 0x55cbcd7cf730 2024-09-12T17:29:45.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.495+0000 7f9104ff9640 1 -- 172.21.15.170:0/2686729863 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f921c013c60 con 0x55cbcd7cf730 2024-09-12T17:29:45.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.495+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cbcd7d74c0 con 0x55cbcd7cf730 2024-09-12T17:29:45.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.495+0000 7f9104ff9640 1 -- 172.21.15.170:0/2686729863 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f921c04a040 con 0x55cbcd7cf730 2024-09-12T17:29:45.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.495+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbcd7d8050 con 0x55cbcd7cf730 2024-09-12T17:29:45.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.496+0000 7f9104ff9640 1 -- 172.21.15.170:0/2686729863 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f921c03c070 con 0x55cbcd7cf730 2024-09-12T17:29:45.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.496+0000 7f9104ff9640 1 --2- 172.21.15.170:0/2686729863 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f90ec03c730 0x7f90ec03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.496+0000 7f9104ff9640 1 -- 172.21.15.170:0/2686729863 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f921c031070 con 0x55cbcd7cf730 2024-09-12T17:29:45.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.496+0000 7f9222d11640 1 --2- 172.21.15.170:0/2686729863 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f90ec03c730 0x7f90ec03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.497+0000 7f9222d11640 1 --2- 172.21.15.170:0/2686729863 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f90ec03c730 0x7f90ec03ebf0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f921406a760 tx=0x7f9214082000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.497+0000 7f9225220800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.497+0000 7f9225220800 1 --2- 172.21.15.170:0/2686729863 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55cbcd7e2700 0x55cbcd7e4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.497+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7e5310 con 0x55cbcd7e2700 2024-09-12T17:29:45.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.497+0000 7f921bfff640 1 --2- 172.21.15.170:0/2686729863 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55cbcd7e2700 0x55cbcd7e4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.497+0000 7f921bfff640 1 --2- 172.21.15.170:0/2686729863 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55cbcd7e2700 0x55cbcd7e4bc0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.498+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f920c009050 con 0x55cbcd7e2700 2024-09-12T17:29:45.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.498+0000 7f9225220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.498+0000 7f9225220800 20 realm 2024-09-12T17:29:45.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.498+0000 7f9225220800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.498+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7e1a50 con 0x55cbcd7e2700 2024-09-12T17:29:45.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.498+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f920c009050 con 0x55cbcd7e2700 2024-09-12T17:29:45.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.498+0000 7f9225220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.498+0000 7f9225220800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:29:45.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.498+0000 7f9225220800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.498+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7e5e00 con 0x55cbcd7e2700 2024-09-12T17:29:45.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.498+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f920c009050 con 0x55cbcd7e2700 2024-09-12T17:29:45.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.498+0000 7f9225220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.498+0000 7f9225220800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.498+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7e66d0 con 0x55cbcd7e2700 2024-09-12T17:29:45.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.499+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f920c009050 con 0x55cbcd7e2700 2024-09-12T17:29:45.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.499+0000 7f9225220800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:45.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.499+0000 7f9225220800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.499+0000 7f9225220800 1 --2- 172.21.15.170:0/2686729863 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55cbcd7e70f0 0x55cbcd7e94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.499+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7e9c20 con 0x55cbcd7e70f0 2024-09-12T17:29:45.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.499+0000 7f9223512640 1 --2- 172.21.15.170:0/2686729863 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55cbcd7e70f0 0x55cbcd7e94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.499+0000 7f9223512640 1 --2- 172.21.15.170:0/2686729863 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55cbcd7e70f0 0x55cbcd7e94e0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.499+0000 7f9223512640 1 -- 172.21.15.170:0/2686729863 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f921c03b030 con 0x55cbcd7e70f0 2024-09-12T17:29:45.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.499+0000 7f9225220800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:29:45.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.499+0000 7f9225220800 20 searching for the correct realm 2024-09-12T17:29:45.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.499+0000 7f9225220800 1 --2- 172.21.15.170:0/2686729863 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55cbcd7ebbf0 0x55cbcd7ee0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.499+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7ee780 con 0x55cbcd7ebbf0 2024-09-12T17:29:45.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.499+0000 7f9222d11640 1 --2- 172.21.15.170:0/2686729863 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55cbcd7ebbf0 0x55cbcd7ee0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.500+0000 7f9222d11640 1 --2- 172.21.15.170:0/2686729863 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55cbcd7ebbf0 0x55cbcd7ee0b0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.500+0000 7f9222d11640 1 -- 172.21.15.170:0/2686729863 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9214091040 con 0x55cbcd7ebbf0 2024-09-12T17:29:45.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.500+0000 7f9222d11640 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7ee780 con 0x55cbcd7e70f0 2024-09-12T17:29:45.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.500+0000 7f9223512640 1 -- 172.21.15.170:0/2686729863 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f921c03b030 con 0x55cbcd7e70f0 2024-09-12T17:29:45.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.500+0000 7f9223512640 1 --2- 172.21.15.170:0/2686729863 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f921c03e060 0x7f921c04e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.500+0000 7f9223512640 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7ee780 con 0x7f921c03e060 2024-09-12T17:29:45.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.501+0000 7f921bfff640 1 --2- 172.21.15.170:0/2686729863 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f921c03e060 0x7f921c04e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.501+0000 7f921bfff640 1 --2- 172.21.15.170:0/2686729863 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f921c03e060 0x7f921c04e440 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.501+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f920c009050 con 0x7f921c03e060 2024-09-12T17:29:45.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.501+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7ee780 con 0x55cbcd7e2700 2024-09-12T17:29:45.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.502+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f920c009050 con 0x55cbcd7e2700 2024-09-12T17:29:45.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.502+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7ee780 con 0x55cbcd7e2700 2024-09-12T17:29:45.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.502+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f920c029040 con 0x55cbcd7e2700 2024-09-12T17:29:45.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.502+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7ee780 con 0x7f921c03e060 2024-09-12T17:29:45.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.502+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f920c029040 con 0x7f921c03e060 2024-09-12T17:29:45.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.502+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7ee780 con 0x7f921c03e060 2024-09-12T17:29:45.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.503+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f920c029040 con 0x7f921c03e060 2024-09-12T17:29:45.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.503+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7ee780 con 0x55cbcd7e70f0 2024-09-12T17:29:45.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.503+0000 7f9223512640 1 -- 172.21.15.170:0/2686729863 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f921c03b030 con 0x55cbcd7e70f0 2024-09-12T17:29:45.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.503+0000 7f9223512640 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7ee780 con 0x55cbcd7ebbf0 2024-09-12T17:29:45.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.503+0000 7f9222d11640 1 -- 172.21.15.170:0/2686729863 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9214091040 con 0x55cbcd7ebbf0 2024-09-12T17:29:45.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.503+0000 7f9222d11640 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7ee780 con 0x55cbcd7e2700 2024-09-12T17:29:45.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.503+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f920c029040 con 0x55cbcd7e2700 2024-09-12T17:29:45.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.503+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7ee780 con 0x7f921c03e060 2024-09-12T17:29:45.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.504+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f920c029040 con 0x7f921c03e060 2024-09-12T17:29:45.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.504+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7ee780 con 0x55cbcd7e2700 2024-09-12T17:29:45.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.504+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f920c029040 con 0x55cbcd7e2700 2024-09-12T17:29:45.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.504+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7ee780 con 0x55cbcd7e70f0 2024-09-12T17:29:45.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.504+0000 7f9223512640 1 -- 172.21.15.170:0/2686729863 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f921c03b030 con 0x55cbcd7e70f0 2024-09-12T17:29:45.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.504+0000 7f9223512640 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7ee780 con 0x55cbcd7ebbf0 2024-09-12T17:29:45.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.504+0000 7f9222d11640 1 -- 172.21.15.170:0/2686729863 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9214091040 con 0x55cbcd7ebbf0 2024-09-12T17:29:45.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.504+0000 7f9222d11640 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7ee780 con 0x55cbcd7ebbf0 2024-09-12T17:29:45.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.505+0000 7f9222d11640 1 -- 172.21.15.170:0/2686729863 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9214091040 con 0x55cbcd7ebbf0 2024-09-12T17:29:45.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.505+0000 7f9222d11640 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7ee780 con 0x55cbcd7e70f0 2024-09-12T17:29:45.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.505+0000 7f9223512640 1 -- 172.21.15.170:0/2686729863 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f921c03b030 con 0x55cbcd7e70f0 2024-09-12T17:29:45.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.505+0000 7f9223512640 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7ee780 con 0x55cbcd7ebbf0 2024-09-12T17:29:45.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.505+0000 7f9222d11640 1 -- 172.21.15.170:0/2686729863 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9214091040 con 0x55cbcd7ebbf0 2024-09-12T17:29:45.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.505+0000 7f9222d11640 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7ee780 con 0x55cbcd7ebbf0 2024-09-12T17:29:45.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.505+0000 7f9222d11640 1 -- 172.21.15.170:0/2686729863 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9214091040 con 0x55cbcd7ebbf0 2024-09-12T17:29:45.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.505+0000 7f9222d11640 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7ee780 con 0x55cbcd7e2700 2024-09-12T17:29:45.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.505+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f920c029040 con 0x55cbcd7e2700 2024-09-12T17:29:45.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.505+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7ee780 con 0x55cbcd7e2700 2024-09-12T17:29:45.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.506+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f920c029040 con 0x55cbcd7e2700 2024-09-12T17:29:45.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.506+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7ee780 con 0x7f921c03e060 2024-09-12T17:29:45.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.506+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f920c029040 con 0x7f921c03e060 2024-09-12T17:29:45.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.506+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7ee780 con 0x55cbcd7ebbf0 2024-09-12T17:29:45.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.506+0000 7f9222d11640 1 -- 172.21.15.170:0/2686729863 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9214091040 con 0x55cbcd7ebbf0 2024-09-12T17:29:45.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.506+0000 7f9222d11640 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7ee780 con 0x55cbcd7e70f0 2024-09-12T17:29:45.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.506+0000 7f9223512640 1 -- 172.21.15.170:0/2686729863 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f921c03b030 con 0x55cbcd7e70f0 2024-09-12T17:29:45.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.506+0000 7f9223512640 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7ee780 con 0x55cbcd7e2700 2024-09-12T17:29:45.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.507+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f920c029040 con 0x55cbcd7e2700 2024-09-12T17:29:45.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.507+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7ee780 con 0x7f921c03e060 2024-09-12T17:29:45.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.507+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f920c029040 con 0x7f921c03e060 2024-09-12T17:29:45.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.507+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7ee780 con 0x55cbcd7ebbf0 2024-09-12T17:29:45.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.507+0000 7f9222d11640 1 -- 172.21.15.170:0/2686729863 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9214091040 con 0x55cbcd7ebbf0 2024-09-12T17:29:45.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.507+0000 7f9222d11640 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7ee780 con 0x7f921c03e060 2024-09-12T17:29:45.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.508+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f920c029040 con 0x7f921c03e060 2024-09-12T17:29:45.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.508+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7ee780 con 0x55cbcd7e70f0 2024-09-12T17:29:45.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.508+0000 7f9223512640 1 -- 172.21.15.170:0/2686729863 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f921c067040 con 0x55cbcd7e70f0 2024-09-12T17:29:45.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.508+0000 7f9223512640 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7ee780 con 0x55cbcd7ebbf0 2024-09-12T17:29:45.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.508+0000 7f9222d11640 1 -- 172.21.15.170:0/2686729863 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9214091040 con 0x55cbcd7ebbf0 2024-09-12T17:29:45.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.508+0000 7f9222d11640 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7ee780 con 0x7f921c03e060 2024-09-12T17:29:45.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.509+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f920c029040 con 0x7f921c03e060 2024-09-12T17:29:45.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.509+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7ee780 con 0x55cbcd7e2700 2024-09-12T17:29:45.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.509+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f920c029040 con 0x55cbcd7e2700 2024-09-12T17:29:45.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.509+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7ee780 con 0x55cbcd7e70f0 2024-09-12T17:29:45.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.509+0000 7f9223512640 1 -- 172.21.15.170:0/2686729863 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(37 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f921c067040 con 0x55cbcd7e70f0 2024-09-12T17:29:45.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.509+0000 7f9225220800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:29:45.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.509+0000 7f9225220800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:29:45.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.509+0000 7f9225220800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:29:45.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.509+0000 7f9225220800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:29:45.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.509+0000 7f9225220800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:29:45.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.509+0000 7f9225220800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:29:45.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.509+0000 7f9225220800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.509+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7ea5e0 con 0x55cbcd7e2700 2024-09-12T17:29:45.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.509+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f920c029040 con 0x55cbcd7e2700 2024-09-12T17:29:45.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.509+0000 7f9225220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.509+0000 7f9225220800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.509+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7eae80 con 0x55cbcd7e2700 2024-09-12T17:29:45.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.510+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f920c029040 con 0x55cbcd7e2700 2024-09-12T17:29:45.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.510+0000 7f9225220800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:45.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.510+0000 7f9225220800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.510+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7ea220 con 0x55cbcd7e70f0 2024-09-12T17:29:45.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.510+0000 7f9223512640 1 -- 172.21.15.170:0/2686729863 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f921c067040 con 0x55cbcd7e70f0 2024-09-12T17:29:45.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.510+0000 7f9225220800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:29:45.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.510+0000 7f9225220800 20 zone default found 2024-09-12T17:29:45.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.510+0000 7f9225220800 4 Realm: () 2024-09-12T17:29:45.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.510+0000 7f9225220800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:29:45.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.510+0000 7f9225220800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:29:45.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.510+0000 7f9225220800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:29:45.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.510+0000 7f9225220800 20 zonegroup default 2024-09-12T17:29:45.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.510+0000 7f9225220800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.510+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7ef0b0 con 0x7f921c03e060 2024-09-12T17:29:45.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.510+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f920c029040 con 0x7f921c03e060 2024-09-12T17:29:45.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.510+0000 7f9225220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.510+0000 7f9225220800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.510+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7f12f0 con 0x55cbcd7ebbf0 2024-09-12T17:29:45.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.510+0000 7f9222d11640 1 -- 172.21.15.170:0/2686729863 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9214091040 con 0x55cbcd7ebbf0 2024-09-12T17:29:45.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.511+0000 7f9225220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.511+0000 7f9225220800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.511+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7f1690 con 0x55cbcd7ebbf0 2024-09-12T17:29:45.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.511+0000 7f9222d11640 1 -- 172.21.15.170:0/2686729863 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9214091040 con 0x55cbcd7ebbf0 2024-09-12T17:29:45.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.511+0000 7f9225220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.511+0000 7f9225220800 20 started sync module instance, tier type = 2024-09-12T17:29:45.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.511+0000 7f9225220800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:29:45.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.511+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7f0780 con 0x55cbcd7e70f0 2024-09-12T17:29:45.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.512+0000 7f9223512640 1 -- 172.21.15.170:0/2686729863 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(44 notify.0 [create] v31'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f921c067040 con 0x55cbcd7e70f0 2024-09-12T17:29:45.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.512+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94333814377648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7f0780 con 0x55cbcd7e70f0 2024-09-12T17:29:45.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.512+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7f2100 con 0x55cbcd7e2700 2024-09-12T17:29:45.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.513+0000 7f9223512640 1 -- 172.21.15.170:0/2686729863 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94333814377648] v31'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f921c067040 con 0x55cbcd7e70f0 2024-09-12T17:29:45.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.513+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v31'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f920c029040 con 0x55cbcd7e2700 2024-09-12T17:29:45.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.513+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94333814381552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7f0780 con 0x55cbcd7e2700 2024-09-12T17:29:45.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.514+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7f2ba0 con 0x55cbcd7ebbf0 2024-09-12T17:29:45.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.515+0000 7f9222d11640 1 -- 172.21.15.170:0/2686729863 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v31'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9214091040 con 0x55cbcd7ebbf0 2024-09-12T17:29:45.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.515+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94333814384272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7f3470 con 0x55cbcd7ebbf0 2024-09-12T17:29:45.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.515+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7f3f40 con 0x55cbcd7e70f0 2024-09-12T17:29:45.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.515+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94333814381552] v31'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f920c029040 con 0x55cbcd7e2700 2024-09-12T17:29:45.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.516+0000 7f9223512640 1 -- 172.21.15.170:0/2686729863 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(50 notify.3 [create] v31'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f921c067040 con 0x55cbcd7e70f0 2024-09-12T17:29:45.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.516+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94333814389296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7f4330 con 0x55cbcd7e70f0 2024-09-12T17:29:45.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.516+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7f4d70 con 0x55cbcd7e2700 2024-09-12T17:29:45.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.516+0000 7f9222d11640 1 -- 172.21.15.170:0/2686729863 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94333814384272] v31'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9214091040 con 0x55cbcd7ebbf0 2024-09-12T17:29:45.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.517+0000 7f9223512640 1 -- 172.21.15.170:0/2686729863 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94333814389296] v31'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f921c067040 con 0x55cbcd7e70f0 2024-09-12T17:29:45.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.517+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v31'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f920c029040 con 0x55cbcd7e2700 2024-09-12T17:29:45.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.517+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94333814375120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7f4d30 con 0x55cbcd7e2700 2024-09-12T17:29:45.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.517+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7f5610 con 0x7f921c03e060 2024-09-12T17:29:45.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.518+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94333814375120] v31'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f920c029040 con 0x55cbcd7e2700 2024-09-12T17:29:45.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.518+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(54 notify.5 [create] v31'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f920c029040 con 0x7f921c03e060 2024-09-12T17:29:45.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.518+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94333814392896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7f4d30 con 0x7f921c03e060 2024-09-12T17:29:45.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.518+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7f5c40 con 0x7f921c03e060 2024-09-12T17:29:45.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.519+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94333814392896] v31'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f920c029040 con 0x7f921c03e060 2024-09-12T17:29:45.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.520+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v31'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f920c029040 con 0x7f921c03e060 2024-09-12T17:29:45.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.520+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94333814396720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7f5c00 con 0x7f921c03e060 2024-09-12T17:29:45.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.520+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7f6620 con 0x7f921c03e060 2024-09-12T17:29:45.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.521+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(58 notify.7 [create] v31'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f920c029040 con 0x7f921c03e060 2024-09-12T17:29:45.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.521+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94333814396720] v31'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f920c029040 con 0x7f921c03e060 2024-09-12T17:29:45.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.521+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94333814399248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7f6a90 con 0x7f921c03e060 2024-09-12T17:29:45.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.521+0000 7f9225220800 20 add_watcher() i=0 2024-09-12T17:29:45.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.521+0000 7f9225220800 20 add_watcher() i=1 2024-09-12T17:29:45.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.521+0000 7f9225220800 20 add_watcher() i=2 2024-09-12T17:29:45.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.521+0000 7f9225220800 20 add_watcher() i=3 2024-09-12T17:29:45.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.521+0000 7f9225220800 20 add_watcher() i=4 2024-09-12T17:29:45.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.521+0000 7f9225220800 20 add_watcher() i=5 2024-09-12T17:29:45.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.521+0000 7f9225220800 20 add_watcher() i=6 2024-09-12T17:29:45.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.522+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94333814399248] v31'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f920c029040 con 0x7f921c03e060 2024-09-12T17:29:45.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.522+0000 7f9225220800 20 add_watcher() i=7 2024-09-12T17:29:45.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.522+0000 7f9225220800 2 all 8 watchers are set, enabling cache 2024-09-12T17:29:45.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.522+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7f6a90 con 0x55cbcd7e2700 2024-09-12T17:29:45.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.522+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f920c029040 con 0x55cbcd7e2700 2024-09-12T17:29:45.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.522+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94333814400480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7f6a00 con 0x55cbcd7e2700 2024-09-12T17:29:45.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.523+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94333814400480] v31'229 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f920c029040 con 0x55cbcd7e2700 2024-09-12T17:29:45.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.523+0000 7f90d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:45.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.523+0000 7f9225220800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:29:45.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.523+0000 7f9225220800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:29:45.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.524+0000 7f9225220800 5 note: GC not initialized 2024-09-12T17:29:45.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.524+0000 7f9053fff640 20 reqs_thread_entry: start 2024-09-12T17:29:45.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.524+0000 7f9225220800 20 init_complete bucket index max shards: 11 2024-09-12T17:29:45.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.524+0000 7f9225220800 20 Filter name: none 2024-09-12T17:29:45.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.524+0000 7f9051ffb640 20 reqs_thread_entry: start 2024-09-12T17:29:45.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.524+0000 7f9225220800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:29:45.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.524+0000 7f9225220800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.524+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd82cb90 con 0x55cbcd7e2700 2024-09-12T17:29:45.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.524+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f920c029040 con 0x55cbcd7e2700 2024-09-12T17:29:45.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.524+0000 7f9225220800 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:29:45.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.524+0000 7f9225220800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T17:29:45.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.524+0000 7f9225220800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:29:45.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.524+0000 7f9225220800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:29:45.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.524+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd82f4c0 con 0x7f921c03e060 2024-09-12T17:29:45.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.526+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(63 usage.10 [call] v31'32 uv32 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f920c029040 con 0x7f921c03e060 2024-09-12T17:29:45.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.526+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd82f4c0 con 0x7f921c03e060 2024-09-12T17:29:45.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.527+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(64 usage.10 [call] v31'33 uv32 ondisk = -61 ((61) No data available)) ==== 152+0+0 (crc 0 0 0) 0x7f920c029040 con 0x7f921c03e060 2024-09-12T17:29:45.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.528+0000 7f90d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:45.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.528+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94333814400480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7ded40 con 0x55cbcd7e2700 2024-09-12T17:29:45.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.529+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94333814400480] v31'230 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f920c029040 con 0x55cbcd7e2700 2024-09-12T17:29:45.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.529+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94333814377648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7f65e0 con 0x55cbcd7e70f0 2024-09-12T17:29:45.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.530+0000 7f9223512640 1 -- 172.21.15.170:0/2686729863 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94333814377648] v31'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f921c067040 con 0x55cbcd7e70f0 2024-09-12T17:29:45.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.530+0000 7f9225220800 20 remove_watcher() i=0 2024-09-12T17:29:45.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.530+0000 7f9225220800 2 removed watcher, disabling cache 2024-09-12T17:29:45.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.530+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94333814381552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7f0cb0 con 0x55cbcd7e2700 2024-09-12T17:29:45.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.531+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94333814381552] v31'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f920c029040 con 0x55cbcd7e2700 2024-09-12T17:29:45.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.531+0000 7f9225220800 20 remove_watcher() i=1 2024-09-12T17:29:45.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.531+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94333814384272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7f0cb0 con 0x55cbcd7ebbf0 2024-09-12T17:29:45.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.533+0000 7f9222d11640 1 -- 172.21.15.170:0/2686729863 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94333814384272] v31'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9214091040 con 0x55cbcd7ebbf0 2024-09-12T17:29:45.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.533+0000 7f9225220800 20 remove_watcher() i=2 2024-09-12T17:29:45.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.533+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94333814389296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7f1bf0 con 0x55cbcd7e70f0 2024-09-12T17:29:45.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.534+0000 7f9223512640 1 -- 172.21.15.170:0/2686729863 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94333814389296] v31'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f921c067040 con 0x55cbcd7e70f0 2024-09-12T17:29:45.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.534+0000 7f9225220800 20 remove_watcher() i=3 2024-09-12T17:29:45.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.534+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94333814375120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7f1bf0 con 0x55cbcd7e2700 2024-09-12T17:29:45.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.535+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94333814375120] v31'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f920c029040 con 0x55cbcd7e2700 2024-09-12T17:29:45.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.535+0000 7f9225220800 20 remove_watcher() i=4 2024-09-12T17:29:45.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.535+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94333814392896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7f02d0 con 0x7f921c03e060 2024-09-12T17:29:45.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.536+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94333814392896] v31'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f920c029040 con 0x7f921c03e060 2024-09-12T17:29:45.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.536+0000 7f9225220800 20 remove_watcher() i=5 2024-09-12T17:29:45.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.536+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94333814396720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7f1bf0 con 0x7f921c03e060 2024-09-12T17:29:45.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.537+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94333814396720] v31'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f920c029040 con 0x7f921c03e060 2024-09-12T17:29:45.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.537+0000 7f9225220800 20 remove_watcher() i=6 2024-09-12T17:29:45.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.537+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94333814399248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cbcd7f02d0 con 0x7f921c03e060 2024-09-12T17:29:45.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.538+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94333814399248] v31'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f920c029040 con 0x7f921c03e060 2024-09-12T17:29:45.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.538+0000 7f9225220800 20 remove_watcher() i=7 2024-09-12T17:29:45.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.538+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f921c03e060 msgr2=0x7f921c04e440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.538+0000 7f9225220800 1 --2- 172.21.15.170:0/2686729863 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f921c03e060 0x7f921c04e440 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.538+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55cbcd7e2700 msgr2=0x55cbcd7e4bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.538+0000 7f9225220800 1 --2- 172.21.15.170:0/2686729863 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55cbcd7e2700 0x55cbcd7e4bc0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.538+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55cbcd7e70f0 msgr2=0x55cbcd7e94e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.538+0000 7f9225220800 1 --2- 172.21.15.170:0/2686729863 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55cbcd7e70f0 0x55cbcd7e94e0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.538+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55cbcd7ebbf0 msgr2=0x55cbcd7ee0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.538+0000 7f9225220800 1 --2- 172.21.15.170:0/2686729863 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55cbcd7ebbf0 0x55cbcd7ee0b0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.538+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f90ec03c730 msgr2=0x7f90ec03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.538+0000 7f9225220800 1 --2- 172.21.15.170:0/2686729863 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f90ec03c730 0x7f90ec03ebf0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f921406a760 tx=0x7f9214082000 comp rx=0 tx=0).stop 2024-09-12T17:29:45.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.538+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbcd7cf730 msgr2=0x55cbcd7d6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.538+0000 7f921bfff640 1 -- 172.21.15.170:0/2686729863 reap_dead start 2024-09-12T17:29:45.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.538+0000 7f9225220800 1 --2- 172.21.15.170:0/2686729863 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbcd7cf730 0x55cbcd7d6cd0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f921c01fcd0 tx=0x7f921c053d00 comp rx=0 tx=0).stop 2024-09-12T17:29:45.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.538+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 shutdown_connections 2024-09-12T17:29:45.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.538+0000 7f9225220800 1 --2- 172.21.15.170:0/2686729863 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbcd7cf730 0x55cbcd7d6cd0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.538+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 >> 172.21.15.170:0/2686729863 conn(0x55cbcd7cbb30 msgr2=0x55cbcd7c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:45.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.538+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 shutdown_connections 2024-09-12T17:29:45.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.538+0000 7f9225220800 1 -- 172.21.15.170:0/2686729863 wait complete. 2024-09-12T17:29:45.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.539+0000 7f9225220800 1 -- 172.21.15.170:0/1097048890 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f90fc03c730 msgr2=0x7f90fc03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.539+0000 7f9225220800 1 --2- 172.21.15.170:0/1097048890 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f90fc03c730 0x7f90fc03ebf0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f921405fa50 tx=0x7f921406a670 comp rx=0 tx=0).stop 2024-09-12T17:29:45.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.539+0000 7f9225220800 1 -- 172.21.15.170:0/1097048890 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbcd6aee50 msgr2=0x55cbcd6ad6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.539+0000 7f9225220800 1 --2- 172.21.15.170:0/1097048890 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbcd6aee50 0x55cbcd6ad6c0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x55cbcd7a6c50 tx=0x7f921c0167b0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.539+0000 7f9225220800 1 -- 172.21.15.170:0/1097048890 shutdown_connections 2024-09-12T17:29:45.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.539+0000 7f9225220800 1 --2- 172.21.15.170:0/1097048890 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f90fc03c730 0x7f90fc03ebf0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.539+0000 7f9225220800 1 --2- 172.21.15.170:0/1097048890 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbcd6aee50 0x55cbcd6ad6c0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.539+0000 7f9225220800 1 -- 172.21.15.170:0/1097048890 >> 172.21.15.170:0/1097048890 conn(0x55cbcd7b4ed0 msgr2=0x55cbcd7b52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:45.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.539+0000 7f9225220800 1 -- 172.21.15.170:0/1097048890 shutdown_connections 2024-09-12T17:29:45.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.539+0000 7f9225220800 1 -- 172.21.15.170:0/1097048890 wait complete. 2024-09-12T17:29:45.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.539+0000 7f9225220800 1 -- 172.21.15.170:0/3957952158 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55cbcd6b2040 msgr2=0x55cbcd7ad2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.539+0000 7f9225220800 1 --2- 172.21.15.170:0/3957952158 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55cbcd6b2040 0x55cbcd7ad2a0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.539+0000 7f9225220800 1 -- 172.21.15.170:0/3957952158 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55cbcd7af680 msgr2=0x55cbcd7b1b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.539+0000 7f9225220800 1 --2- 172.21.15.170:0/3957952158 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55cbcd7af680 0x55cbcd7b1b00 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.539+0000 7f9225220800 1 -- 172.21.15.170:0/3957952158 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f910803c730 msgr2=0x7f910803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.539+0000 7f9225220800 1 --2- 172.21.15.170:0/3957952158 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f910803c730 0x7f910803ebf0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f920c001db0 tx=0x7f920c001310 comp rx=0 tx=0).stop 2024-09-12T17:29:45.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.539+0000 7f9225220800 1 -- 172.21.15.170:0/3957952158 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbcd6af6b0 msgr2=0x55cbcd7a5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.539+0000 7f9225220800 1 --2- 172.21.15.170:0/3957952158 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbcd6af6b0 0x55cbcd7a5c50 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f9214025b20 tx=0x7f9214002fb0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.539+0000 7f9225220800 1 -- 172.21.15.170:0/3957952158 shutdown_connections 2024-09-12T17:29:45.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.539+0000 7f9225220800 1 --2- 172.21.15.170:0/3957952158 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55cbcd7af680 0x55cbcd7b1b00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.539+0000 7f9225220800 1 --2- 172.21.15.170:0/3957952158 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f910803c730 0x7f910803ebf0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.539+0000 7f9225220800 1 --2- 172.21.15.170:0/3957952158 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55cbcd6b2040 0x55cbcd7ad2a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.539+0000 7f9225220800 1 --2- 172.21.15.170:0/3957952158 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cbcd6af6b0 0x55cbcd7a5c50 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.539+0000 7f9225220800 1 -- 172.21.15.170:0/3957952158 >> 172.21.15.170:0/3957952158 conn(0x55cbcd6a91f0 msgr2=0x55cbcd79f660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:45.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.540+0000 7f9225220800 1 -- 172.21.15.170:0/3957952158 shutdown_connections 2024-09-12T17:29:45.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.540+0000 7f9225220800 1 -- 172.21.15.170:0/3957952158 wait complete. 2024-09-12T17:29:45.550 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-12T17:29:45.550 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-12T17:29:45.550 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-12T17:29:45.595 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:29:45.595 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:29:45.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.595+0000 7fef1673a800 1 Processor -- start 2024-09-12T17:29:45.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.595+0000 7fef1673a800 1 -- start start 2024-09-12T17:29:45.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.595+0000 7fef1673a800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55902a01fff0 0x55902a028b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.595+0000 7fef1673a800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559029ec9e40 con 0x55902a01e4d0 2024-09-12T17:29:45.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.595+0000 7fef1673a800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x559029e94680 con 0x55902a01fff0 2024-09-12T17:29:45.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.595+0000 7fef09c80640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55902a01fff0 0x55902a028b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.595+0000 7fef12481640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x55902a01e4d0 0x55902a01e8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:44796/0 (socket says 172.21.15.170:44796) 2024-09-12T17:29:45.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.595+0000 7fef12481640 1 -- 172.21.15.170:0/3455062492 learned_addr learned my addr 172.21.15.170:0/3455062492 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:29:45.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.596+0000 7fef09c80640 1 -- 172.21.15.170:0/3455062492 >> v1:172.21.15.47:6789/0 conn(0x55902a01e4d0 legacy=0x55902a01e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.596+0000 7fef09c80640 1 -- 172.21.15.170:0/3455062492 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559029eb06b0 con 0x55902a01fff0 2024-09-12T17:29:45.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.597+0000 7fef09c80640 1 --2- 172.21.15.170:0/3455062492 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55902a01fff0 0x55902a028b10 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7feefc00a470 tx=0x7feefc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4751dea9029c279b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.598+0000 7fef11c80640 1 -- 172.21.15.170:0/3455062492 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feefc053570 con 0x55902a01fff0 2024-09-12T17:29:45.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.598+0000 7fef11c80640 1 -- 172.21.15.170:0/3455062492 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feefc058070 con 0x55902a01fff0 2024-09-12T17:29:45.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.598+0000 7fef11c80640 1 -- 172.21.15.170:0/3455062492 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feefc053880 con 0x55902a01fff0 2024-09-12T17:29:45.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.598+0000 7fef1673a800 1 -- 172.21.15.170:0/3455062492 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55902a01fff0 msgr2=0x55902a028b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.598+0000 7fef1673a800 1 --2- 172.21.15.170:0/3455062492 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55902a01fff0 0x55902a028b10 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7feefc00a470 tx=0x7feefc045a20 comp rx=0 tx=0).stop 2024-09-12T17:29:45.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.598+0000 7fef1673a800 1 -- 172.21.15.170:0/3455062492 shutdown_connections 2024-09-12T17:29:45.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.598+0000 7fef1673a800 1 --2- 172.21.15.170:0/3455062492 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55902a01fff0 0x55902a028b10 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.598+0000 7fef1673a800 1 -- 172.21.15.170:0/3455062492 >> 172.21.15.170:0/3455062492 conn(0x55902a01a1c0 msgr2=0x55902a01c620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:45.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.598+0000 7fef1673a800 1 -- 172.21.15.170:0/3455062492 shutdown_connections 2024-09-12T17:29:45.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.598+0000 7fef1673a800 1 -- 172.21.15.170:0/3455062492 wait complete. 2024-09-12T17:29:45.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.612+0000 7fef1673a800 1 Processor -- start 2024-09-12T17:29:45.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.612+0000 7fef1673a800 1 -- start start 2024-09-12T17:29:45.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.612+0000 7fef1673a800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55902a01e4d0 0x55902a111810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.612+0000 7fef1673a800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559029eb8dd0 con 0x55902a01e4d0 2024-09-12T17:29:45.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.613+0000 7fef12481640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55902a01e4d0 0x55902a111810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.613+0000 7fef12481640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55902a01e4d0 0x55902a111810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34402/0 (socket says 172.21.15.170:34402) 2024-09-12T17:29:45.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.613+0000 7fef12481640 1 -- 172.21.15.170:0/1334817096 learned_addr learned my addr 172.21.15.170:0/1334817096 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:45.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.613+0000 7fef12481640 1 -- 172.21.15.170:0/1334817096 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559029ed1e10 con 0x55902a01e4d0 2024-09-12T17:29:45.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.613+0000 7fef12481640 1 --2- 172.21.15.170:0/1334817096 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55902a01e4d0 0x55902a111810 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fef04001e40 tx=0x7fef04001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ae967aef7874550 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.613+0000 7fee00608640 1 -- 172.21.15.170:0/1334817096 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef04012020 con 0x55902a01e4d0 2024-09-12T17:29:45.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.613+0000 7fee00608640 1 -- 172.21.15.170:0/1334817096 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef0400e5a0 con 0x55902a01e4d0 2024-09-12T17:29:45.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.613+0000 7fee00608640 1 -- 172.21.15.170:0/1334817096 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef0400e8a0 con 0x55902a01e4d0 2024-09-12T17:29:45.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.614+0000 7fef1673a800 1 -- 172.21.15.170:0/1334817096 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55902a01e4d0 msgr2=0x55902a111810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.614+0000 7fef1673a800 1 --2- 172.21.15.170:0/1334817096 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55902a01e4d0 0x55902a111810 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fef04001e40 tx=0x7fef04001e70 comp rx=0 tx=0).stop 2024-09-12T17:29:45.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.614+0000 7fef1673a800 1 -- 172.21.15.170:0/1334817096 shutdown_connections 2024-09-12T17:29:45.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.614+0000 7fef1673a800 1 --2- 172.21.15.170:0/1334817096 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55902a01e4d0 0x55902a111810 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.614+0000 7fef1673a800 1 -- 172.21.15.170:0/1334817096 >> 172.21.15.170:0/1334817096 conn(0x55902a01a1c0 msgr2=0x55902a10d190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:45.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.614+0000 7fef1673a800 1 -- 172.21.15.170:0/1334817096 shutdown_connections 2024-09-12T17:29:45.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.614+0000 7fef1673a800 1 -- 172.21.15.170:0/1334817096 wait complete. 2024-09-12T17:29:45.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.614+0000 7fef1673a800 1 Processor -- start 2024-09-12T17:29:45.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.614+0000 7fef1673a800 1 -- start start 2024-09-12T17:29:45.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.615+0000 7fef1673a800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55902a01e4d0 0x55902a1191c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.615+0000 7fef1673a800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55902a029350 con 0x55902a01e4d0 2024-09-12T17:29:45.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.615+0000 7fef12481640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55902a01e4d0 0x55902a1191c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.615+0000 7fef12481640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55902a01e4d0 0x55902a1191c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34416/0 (socket says 172.21.15.170:34416) 2024-09-12T17:29:45.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.615+0000 7fef12481640 1 -- 172.21.15.170:0/1299831800 learned_addr learned my addr 172.21.15.170:0/1299831800 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:45.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.615+0000 7fef12481640 1 -- 172.21.15.170:0/1299831800 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55902a119720 con 0x55902a01e4d0 2024-09-12T17:29:45.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.615+0000 7fef12481640 1 --2- 172.21.15.170:0/1299831800 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55902a01e4d0 0x55902a1191c0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fef0400c010 tx=0x7fef04000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.616+0000 7fedfee05640 1 -- 172.21.15.170:0/1299831800 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef04012030 con 0x55902a01e4d0 2024-09-12T17:29:45.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.616+0000 7fedfee05640 1 -- 172.21.15.170:0/1299831800 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef040014a0 con 0x55902a01e4d0 2024-09-12T17:29:45.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.616+0000 7fedfee05640 1 -- 172.21.15.170:0/1299831800 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef0401a7a0 con 0x55902a01e4d0 2024-09-12T17:29:45.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.616+0000 7fef1673a800 1 -- 172.21.15.170:0/1299831800 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55902a1199b0 con 0x55902a01e4d0 2024-09-12T17:29:45.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.616+0000 7fef1673a800 1 -- 172.21.15.170:0/1299831800 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55902a11a3b0 con 0x55902a01e4d0 2024-09-12T17:29:45.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.617+0000 7fedfee05640 1 -- 172.21.15.170:0/1299831800 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fef04015020 con 0x55902a01e4d0 2024-09-12T17:29:45.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.617+0000 7fedfee05640 1 --2- 172.21.15.170:0/1299831800 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fedf803c780 0x7fedf803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.617+0000 7fedfee05640 1 -- 172.21.15.170:0/1299831800 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fef04020030 con 0x55902a01e4d0 2024-09-12T17:29:45.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.617+0000 7fef09c80640 1 --2- 172.21.15.170:0/1299831800 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fedf803c780 0x7fedf803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.617+0000 7fef1673a800 1 --2- 172.21.15.170:0/1299831800 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55902a01fff0 0x55902a120810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.617+0000 7fef1673a800 1 -- 172.21.15.170:0/1299831800 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55902a11af40 con 0x55902a01fff0 2024-09-12T17:29:45.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.617+0000 7fef12c82640 1 --2- 172.21.15.170:0/1299831800 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55902a01fff0 0x55902a120810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.617+0000 7fef09c80640 1 --2- 172.21.15.170:0/1299831800 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fedf803c780 0x7fedf803ec40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7feefc057000 tx=0x7feefc052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.618+0000 7fef12c82640 1 --2- 172.21.15.170:0/1299831800 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55902a01fff0 0x55902a120810 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.618+0000 7fef12c82640 1 -- 172.21.15.170:0/1299831800 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef0c00a4d0 con 0x55902a01fff0 2024-09-12T17:29:45.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.618+0000 7fef1673a800 1 -- 172.21.15.170:0/1299831800 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55902a11a840 con 0x55902a01fff0 2024-09-12T17:29:45.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.618+0000 7fef12c82640 1 -- 172.21.15.170:0/1299831800 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fef0c00a4d0 con 0x55902a01fff0 2024-09-12T17:29:45.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.618+0000 7fef1673a800 1 --2- 172.21.15.170:0/1299831800 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55902a122c80 0x55902a125070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.618+0000 7fef1673a800 1 -- 172.21.15.170:0/1299831800 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55902a125740 con 0x55902a122c80 2024-09-12T17:29:45.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.618+0000 7fef12481640 1 --2- 172.21.15.170:0/1299831800 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55902a122c80 0x55902a125070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.618+0000 7fef12481640 1 --2- 172.21.15.170:0/1299831800 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55902a122c80 0x55902a125070 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.619+0000 7fef12481640 1 -- 172.21.15.170:0/1299831800 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fef040187b0 con 0x55902a122c80 2024-09-12T17:29:45.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.619+0000 7fef1673a800 1 -- 172.21.15.170:0/1299831800 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55902a121b20 con 0x55902a01fff0 2024-09-12T17:29:45.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.619+0000 7fef12c82640 1 -- 172.21.15.170:0/1299831800 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fef0c00a4d0 con 0x55902a01fff0 2024-09-12T17:29:45.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.619+0000 7fef1673a800 1 -- 172.21.15.170:0/1299831800 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55902a121fc0 con 0x55902a122c80 2024-09-12T17:29:45.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.619+0000 7fef12481640 1 -- 172.21.15.170:0/1299831800 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fef040187b0 con 0x55902a122c80 2024-09-12T17:29:45.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.620+0000 7fef1673a800 1 Processor -- start 2024-09-12T17:29:45.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.620+0000 7fef1673a800 1 -- start start 2024-09-12T17:29:45.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.620+0000 7fef1673a800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55902a133ff0 0x55902a134410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.620+0000 7fef1673a800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559029f16a00 con 0x55902a133ff0 2024-09-12T17:29:45.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.620+0000 7fef12c82640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55902a133ff0 0x55902a134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.620+0000 7fef12c82640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55902a133ff0 0x55902a134410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34418/0 (socket says 172.21.15.170:34418) 2024-09-12T17:29:45.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.620+0000 7fef12c82640 1 -- 172.21.15.170:0/1512408661 learned_addr learned my addr 172.21.15.170:0/1512408661 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:45.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.620+0000 7fef12c82640 1 -- 172.21.15.170:0/1512408661 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55902a134a50 con 0x55902a133ff0 2024-09-12T17:29:45.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.621+0000 7fef12c82640 1 --2- 172.21.15.170:0/1512408661 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55902a133ff0 0x55902a134410 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x55902a11a050 tx=0x7fef0c0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.621+0000 7fedf7fff640 1 -- 172.21.15.170:0/1512408661 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef0c013640 con 0x55902a133ff0 2024-09-12T17:29:45.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.621+0000 7fedf7fff640 1 -- 172.21.15.170:0/1512408661 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef0c0137e0 con 0x55902a133ff0 2024-09-12T17:29:45.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.621+0000 7fef1673a800 1 -- 172.21.15.170:0/1512408661 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55902a135280 con 0x55902a133ff0 2024-09-12T17:29:45.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.621+0000 7fedf7fff640 1 -- 172.21.15.170:0/1512408661 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef0c013ac0 con 0x55902a133ff0 2024-09-12T17:29:45.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.621+0000 7fef1673a800 1 -- 172.21.15.170:0/1512408661 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55902a135820 con 0x55902a133ff0 2024-09-12T17:29:45.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.622+0000 7fedf7fff640 1 -- 172.21.15.170:0/1512408661 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fef0c011040 con 0x55902a133ff0 2024-09-12T17:29:45.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.622+0000 7fedf7fff640 1 --2- 172.21.15.170:0/1512408661 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fedec03c780 0x7fedec03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.622+0000 7fedf7fff640 1 -- 172.21.15.170:0/1512408661 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fef0c00e040 con 0x55902a133ff0 2024-09-12T17:29:45.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.622+0000 7fef12481640 1 --2- 172.21.15.170:0/1512408661 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fedec03c780 0x7fedec03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.622+0000 7fef1673a800 1 Processor -- start 2024-09-12T17:29:45.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.622+0000 7fef12481640 1 --2- 172.21.15.170:0/1512408661 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fedec03c780 0x7fedec03ec40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x55902a120e20 tx=0x7fef04040040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.622+0000 7fef1673a800 1 -- start start 2024-09-12T17:29:45.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.623+0000 7fef1673a800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55902a140a70 0x55902a140e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.623+0000 7fef1673a800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55902a112060 con 0x55902a140a70 2024-09-12T17:29:45.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.623+0000 7fef12c82640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55902a140a70 0x55902a140e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.623+0000 7fef12c82640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55902a140a70 0x55902a140e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34434/0 (socket says 172.21.15.170:34434) 2024-09-12T17:29:45.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.623+0000 7fef12c82640 1 -- 172.21.15.170:0/2915392081 learned_addr learned my addr 172.21.15.170:0/2915392081 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:45.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.623+0000 7fef12c82640 1 -- 172.21.15.170:0/2915392081 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55902a141460 con 0x55902a140a70 2024-09-12T17:29:45.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.623+0000 7fef12c82640 1 --2- 172.21.15.170:0/2915392081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55902a140a70 0x55902a140e70 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fef0c013dd0 tx=0x7fef0c013f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=887ad24fcd21d104 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.623+0000 7fedf5ffb640 1 -- 172.21.15.170:0/2915392081 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef0c021a90 con 0x55902a140a70 2024-09-12T17:29:45.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.623+0000 7fedf5ffb640 1 -- 172.21.15.170:0/2915392081 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef0c021440 con 0x55902a140a70 2024-09-12T17:29:45.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.623+0000 7fedf5ffb640 1 -- 172.21.15.170:0/2915392081 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef0c020bd0 con 0x55902a140a70 2024-09-12T17:29:45.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.624+0000 7fef1673a800 1 -- 172.21.15.170:0/2915392081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55902a140a70 msgr2=0x55902a140e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.624+0000 7fef1673a800 1 --2- 172.21.15.170:0/2915392081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55902a140a70 0x55902a140e70 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fef0c013dd0 tx=0x7fef0c013f00 comp rx=0 tx=0).stop 2024-09-12T17:29:45.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.624+0000 7fef1673a800 1 -- 172.21.15.170:0/2915392081 shutdown_connections 2024-09-12T17:29:45.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.624+0000 7fef1673a800 1 --2- 172.21.15.170:0/2915392081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55902a140a70 0x55902a140e70 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.624+0000 7fef1673a800 1 -- 172.21.15.170:0/2915392081 >> 172.21.15.170:0/2915392081 conn(0x55902a13ce70 msgr2=0x55902a13b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:45.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.624+0000 7fef1673a800 1 -- 172.21.15.170:0/2915392081 shutdown_connections 2024-09-12T17:29:45.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.624+0000 7fef1673a800 1 -- 172.21.15.170:0/2915392081 wait complete. 2024-09-12T17:29:45.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.624+0000 7fef1673a800 1 Processor -- start 2024-09-12T17:29:45.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.624+0000 7fef1673a800 1 -- start start 2024-09-12T17:29:45.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.624+0000 7fef1673a800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55902a140a70 0x55902a147f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.624+0000 7fef1673a800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55902a141a50 con 0x55902a140a70 2024-09-12T17:29:45.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.625+0000 7fef12c82640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55902a140a70 0x55902a147f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.625+0000 7fef12c82640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55902a140a70 0x55902a147f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34438/0 (socket says 172.21.15.170:34438) 2024-09-12T17:29:45.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.625+0000 7fef12c82640 1 -- 172.21.15.170:0/2384520538 learned_addr learned my addr 172.21.15.170:0/2384520538 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:45.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.625+0000 7fef12c82640 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55902a1484e0 con 0x55902a140a70 2024-09-12T17:29:45.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.625+0000 7fef12c82640 1 --2- 172.21.15.170:0/2384520538 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55902a140a70 0x55902a147f80 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fef0c020b60 tx=0x7fef0c053ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.625+0000 7fede3fff640 1 -- 172.21.15.170:0/2384520538 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef0c037070 con 0x55902a140a70 2024-09-12T17:29:45.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.625+0000 7fede3fff640 1 -- 172.21.15.170:0/2384520538 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef0c04b040 con 0x55902a140a70 2024-09-12T17:29:45.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.625+0000 7fede3fff640 1 -- 172.21.15.170:0/2384520538 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef0c01f760 con 0x55902a140a70 2024-09-12T17:29:45.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.625+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55902a148770 con 0x55902a140a70 2024-09-12T17:29:45.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.625+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55902a149300 con 0x55902a140a70 2024-09-12T17:29:45.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.626+0000 7fede3fff640 1 -- 172.21.15.170:0/2384520538 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fef0c03a070 con 0x55902a140a70 2024-09-12T17:29:45.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.626+0000 7fef1673a800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.626+0000 7fede3fff640 1 --2- 172.21.15.170:0/2384520538 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7feddc03c730 0x7feddc03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.627+0000 7fede3fff640 1 -- 172.21.15.170:0/2384520538 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fef0c03dbf0 con 0x55902a140a70 2024-09-12T17:29:45.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.627+0000 7fef12481640 1 --2- 172.21.15.170:0/2384520538 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7feddc03c730 0x7feddc03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.627+0000 7fef1673a800 1 --2- 172.21.15.170:0/2384520538 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55902a153930 0x55902a155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.627+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55902a156510 con 0x55902a153930 2024-09-12T17:29:45.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.627+0000 7fef09c80640 1 --2- 172.21.15.170:0/2384520538 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55902a153930 0x55902a155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.627+0000 7fef12481640 1 --2- 172.21.15.170:0/2384520538 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7feddc03c730 0x7feddc03ebf0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fef04018ac0 tx=0x7fef0404f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.627+0000 7fef09c80640 1 --2- 172.21.15.170:0/2384520538 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55902a153930 0x55902a155dc0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.627+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feefc051070 con 0x55902a153930 2024-09-12T17:29:45.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.627+0000 7fef1673a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.627+0000 7fef1673a800 20 realm 2024-09-12T17:29:45.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.627+0000 7fef1673a800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.627+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55902a156940 con 0x55902a153930 2024-09-12T17:29:45.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.628+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feefc051070 con 0x55902a153930 2024-09-12T17:29:45.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.628+0000 7fef1673a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.628+0000 7fef1673a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:29:45.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.628+0000 7fef1673a800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.628+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55902a157210 con 0x55902a153930 2024-09-12T17:29:45.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.628+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feefc051070 con 0x55902a153930 2024-09-12T17:29:45.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.628+0000 7fef1673a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.628+0000 7fef1673a800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.628+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55902a1575b0 con 0x55902a153930 2024-09-12T17:29:45.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.628+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7feefc051070 con 0x55902a153930 2024-09-12T17:29:45.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.628+0000 7fef1673a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:45.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.628+0000 7fef1673a800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.628+0000 7fef1673a800 1 --2- 172.21.15.170:0/2384520538 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55902a158310 0x55902a15a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.628+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55902a15ac40 con 0x55902a158310 2024-09-12T17:29:45.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.628+0000 7fef12c82640 1 --2- 172.21.15.170:0/2384520538 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55902a158310 0x55902a15a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.628+0000 7fef12c82640 1 --2- 172.21.15.170:0/2384520538 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55902a158310 0x55902a15a700 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.629+0000 7fef12c82640 1 -- 172.21.15.170:0/2384520538 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fef0c039030 con 0x55902a158310 2024-09-12T17:29:45.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.629+0000 7fef1673a800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:29:45.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.629+0000 7fef1673a800 20 searching for the correct realm 2024-09-12T17:29:45.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.629+0000 7fef1673a800 1 --2- 172.21.15.170:0/2384520538 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55902a15cc80 0x55902a15f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.629+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55902a15f810 con 0x55902a15cc80 2024-09-12T17:29:45.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.629+0000 7fef12481640 1 --2- 172.21.15.170:0/2384520538 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55902a15cc80 0x55902a15f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.629+0000 7fef12481640 1 --2- 172.21.15.170:0/2384520538 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55902a15cc80 0x55902a15f140 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.629+0000 7fef12481640 1 -- 172.21.15.170:0/2384520538 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef04036040 con 0x55902a15cc80 2024-09-12T17:29:45.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.629+0000 7fef12481640 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55902a15f810 con 0x55902a158310 2024-09-12T17:29:45.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.630+0000 7fef12c82640 1 -- 172.21.15.170:0/2384520538 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef0c039030 con 0x55902a158310 2024-09-12T17:29:45.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.630+0000 7fef12c82640 1 --2- 172.21.15.170:0/2384520538 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fef0c03c060 0x7fef0c056200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.630+0000 7fef12c82640 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55902a15f810 con 0x7fef0c03c060 2024-09-12T17:29:45.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.630+0000 7fef09c80640 1 --2- 172.21.15.170:0/2384520538 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fef0c03c060 0x7fef0c056200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.630+0000 7fef09c80640 1 --2- 172.21.15.170:0/2384520538 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fef0c03c060 0x7fef0c056200 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.631+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feefc051070 con 0x7fef0c03c060 2024-09-12T17:29:45.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.631+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55902a15f810 con 0x55902a153930 2024-09-12T17:29:45.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.631+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feefc051070 con 0x55902a153930 2024-09-12T17:29:45.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.631+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55902a15f810 con 0x55902a153930 2024-09-12T17:29:45.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.631+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feefc051070 con 0x55902a153930 2024-09-12T17:29:45.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.631+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55902a15f810 con 0x7fef0c03c060 2024-09-12T17:29:45.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.631+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feefc051070 con 0x7fef0c03c060 2024-09-12T17:29:45.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.631+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55902a15f810 con 0x7fef0c03c060 2024-09-12T17:29:45.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.632+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feefc051070 con 0x7fef0c03c060 2024-09-12T17:29:45.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.632+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55902a15f810 con 0x55902a158310 2024-09-12T17:29:45.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.632+0000 7fef12c82640 1 -- 172.21.15.170:0/2384520538 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef0c039030 con 0x55902a158310 2024-09-12T17:29:45.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.632+0000 7fef12c82640 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55902a15f810 con 0x55902a15cc80 2024-09-12T17:29:45.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.632+0000 7fef12481640 1 -- 172.21.15.170:0/2384520538 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef04036040 con 0x55902a15cc80 2024-09-12T17:29:45.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.632+0000 7fef12481640 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55902a15f810 con 0x55902a153930 2024-09-12T17:29:45.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.632+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feefc051070 con 0x55902a153930 2024-09-12T17:29:45.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.632+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55902a15f810 con 0x7fef0c03c060 2024-09-12T17:29:45.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.633+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feefc051070 con 0x7fef0c03c060 2024-09-12T17:29:45.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.633+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55902a15f810 con 0x55902a153930 2024-09-12T17:29:45.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.633+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feefc051070 con 0x55902a153930 2024-09-12T17:29:45.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.633+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55902a15f810 con 0x55902a158310 2024-09-12T17:29:45.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.633+0000 7fef12c82640 1 -- 172.21.15.170:0/2384520538 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fef0c039030 con 0x55902a158310 2024-09-12T17:29:45.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.633+0000 7fef12c82640 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55902a15f810 con 0x55902a15cc80 2024-09-12T17:29:45.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.633+0000 7fef12481640 1 -- 172.21.15.170:0/2384520538 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef04036040 con 0x55902a15cc80 2024-09-12T17:29:45.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.633+0000 7fef12481640 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55902a15f810 con 0x55902a15cc80 2024-09-12T17:29:45.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.633+0000 7fef12481640 1 -- 172.21.15.170:0/2384520538 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef04036040 con 0x55902a15cc80 2024-09-12T17:29:45.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.633+0000 7fef12481640 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55902a15f810 con 0x55902a158310 2024-09-12T17:29:45.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.634+0000 7fef12c82640 1 -- 172.21.15.170:0/2384520538 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef0c039030 con 0x55902a158310 2024-09-12T17:29:45.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.634+0000 7fef12c82640 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55902a15f810 con 0x55902a15cc80 2024-09-12T17:29:45.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.634+0000 7fef12481640 1 -- 172.21.15.170:0/2384520538 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef04036040 con 0x55902a15cc80 2024-09-12T17:29:45.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.634+0000 7fef12481640 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55902a15f810 con 0x55902a15cc80 2024-09-12T17:29:45.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.634+0000 7fef12481640 1 -- 172.21.15.170:0/2384520538 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef04036040 con 0x55902a15cc80 2024-09-12T17:29:45.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.634+0000 7fef12481640 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55902a15f810 con 0x55902a153930 2024-09-12T17:29:45.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.634+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feefc051070 con 0x55902a153930 2024-09-12T17:29:45.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.634+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55902a15f810 con 0x55902a153930 2024-09-12T17:29:45.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.635+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7feefc051070 con 0x55902a153930 2024-09-12T17:29:45.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.635+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55902a15f810 con 0x7fef0c03c060 2024-09-12T17:29:45.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.635+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feefc051070 con 0x7fef0c03c060 2024-09-12T17:29:45.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.635+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55902a15f810 con 0x55902a15cc80 2024-09-12T17:29:45.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.635+0000 7fef12481640 1 -- 172.21.15.170:0/2384520538 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef04036040 con 0x55902a15cc80 2024-09-12T17:29:45.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.635+0000 7fef12481640 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55902a15f810 con 0x55902a158310 2024-09-12T17:29:45.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.635+0000 7fef12c82640 1 -- 172.21.15.170:0/2384520538 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef0c039030 con 0x55902a158310 2024-09-12T17:29:45.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.635+0000 7fef12c82640 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55902a15f810 con 0x55902a153930 2024-09-12T17:29:45.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.635+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feefc051070 con 0x55902a153930 2024-09-12T17:29:45.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.635+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55902a15f810 con 0x7fef0c03c060 2024-09-12T17:29:45.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.636+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feefc051070 con 0x7fef0c03c060 2024-09-12T17:29:45.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.636+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55902a15f810 con 0x55902a15cc80 2024-09-12T17:29:45.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.636+0000 7fef12481640 1 -- 172.21.15.170:0/2384520538 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef04036040 con 0x55902a15cc80 2024-09-12T17:29:45.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.636+0000 7fef12481640 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55902a15f810 con 0x7fef0c03c060 2024-09-12T17:29:45.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.636+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feefc051070 con 0x7fef0c03c060 2024-09-12T17:29:45.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.637+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55902a15f810 con 0x55902a158310 2024-09-12T17:29:45.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.637+0000 7fef12c82640 1 -- 172.21.15.170:0/2384520538 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef0c069040 con 0x55902a158310 2024-09-12T17:29:45.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.637+0000 7fef12c82640 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55902a15f810 con 0x55902a15cc80 2024-09-12T17:29:45.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.637+0000 7fef12481640 1 -- 172.21.15.170:0/2384520538 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef04036040 con 0x55902a15cc80 2024-09-12T17:29:45.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.637+0000 7fef12481640 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55902a15f810 con 0x7fef0c03c060 2024-09-12T17:29:45.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.637+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feefc051070 con 0x7fef0c03c060 2024-09-12T17:29:45.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.637+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55902a15f810 con 0x55902a153930 2024-09-12T17:29:45.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.638+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7feefc051070 con 0x55902a153930 2024-09-12T17:29:45.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.638+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55902a15f810 con 0x55902a158310 2024-09-12T17:29:45.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.638+0000 7fef12c82640 1 -- 172.21.15.170:0/2384520538 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(37 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fef0c069040 con 0x55902a158310 2024-09-12T17:29:45.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.638+0000 7fef1673a800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:29:45.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.638+0000 7fef1673a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:29:45.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.638+0000 7fef1673a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:29:45.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.638+0000 7fef1673a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:29:45.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.638+0000 7fef1673a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:29:45.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.638+0000 7fef1673a800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:29:45.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.638+0000 7fef1673a800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.638+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55902a15b680 con 0x55902a153930 2024-09-12T17:29:45.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.638+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feefc051070 con 0x55902a153930 2024-09-12T17:29:45.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.638+0000 7fef1673a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.638+0000 7fef1673a800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.638+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55902a15b260 con 0x55902a153930 2024-09-12T17:29:45.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.638+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7feefc051070 con 0x55902a153930 2024-09-12T17:29:45.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.638+0000 7fef1673a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:45.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.638+0000 7fef1673a800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.638+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55902a15bfa0 con 0x55902a158310 2024-09-12T17:29:45.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.639+0000 7fef12c82640 1 -- 172.21.15.170:0/2384520538 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fef0c069040 con 0x55902a158310 2024-09-12T17:29:45.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.639+0000 7fef1673a800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:29:45.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.639+0000 7fef1673a800 20 zone default found 2024-09-12T17:29:45.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.639+0000 7fef1673a800 4 Realm: () 2024-09-12T17:29:45.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.639+0000 7fef1673a800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:29:45.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.639+0000 7fef1673a800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:29:45.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.639+0000 7fef1673a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:29:45.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.639+0000 7fef1673a800 20 zonegroup default 2024-09-12T17:29:45.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.639+0000 7fef1673a800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.639+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55902a15bb20 con 0x7fef0c03c060 2024-09-12T17:29:45.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.639+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7feefc051070 con 0x7fef0c03c060 2024-09-12T17:29:45.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.639+0000 7fef1673a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.639+0000 7fef1673a800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.639+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55902a162060 con 0x55902a15cc80 2024-09-12T17:29:45.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.639+0000 7fef12481640 1 -- 172.21.15.170:0/2384520538 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fef04036040 con 0x55902a15cc80 2024-09-12T17:29:45.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.639+0000 7fef1673a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.639+0000 7fef1673a800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.639+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55902a162430 con 0x55902a15cc80 2024-09-12T17:29:45.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.640+0000 7fef12481640 1 -- 172.21.15.170:0/2384520538 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fef04036040 con 0x55902a15cc80 2024-09-12T17:29:45.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.640+0000 7fef1673a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.640+0000 7fef1673a800 20 started sync module instance, tier type = 2024-09-12T17:29:45.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.640+0000 7fef1673a800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:29:45.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.640+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55902a1614f0 con 0x55902a158310 2024-09-12T17:29:45.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.641+0000 7fef12c82640 1 -- 172.21.15.170:0/2384520538 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(44 notify.0 [create] v31'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef0c069040 con 0x55902a158310 2024-09-12T17:29:45.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.641+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94077669742816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55902a161150 con 0x55902a158310 2024-09-12T17:29:45.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.641+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55902a163340 con 0x55902a153930 2024-09-12T17:29:45.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.642+0000 7fef12c82640 1 -- 172.21.15.170:0/2384520538 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94077669742816] v31'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef0c069040 con 0x55902a158310 2024-09-12T17:29:45.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.642+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v31'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feefc051070 con 0x55902a153930 2024-09-12T17:29:45.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.642+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94077669746800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55902a163340 con 0x55902a153930 2024-09-12T17:29:45.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.642+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55902a163d90 con 0x55902a15cc80 2024-09-12T17:29:45.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.643+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94077669746800] v31'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feefc051070 con 0x55902a153930 2024-09-12T17:29:45.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.643+0000 7fef12481640 1 -- 172.21.15.170:0/2384520538 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v31'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef04036040 con 0x55902a15cc80 2024-09-12T17:29:45.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.643+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94077669748368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55902a1632b0 con 0x55902a15cc80 2024-09-12T17:29:45.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.643+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55902a164c80 con 0x55902a158310 2024-09-12T17:29:45.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.644+0000 7fef12481640 1 -- 172.21.15.170:0/2384520538 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94077669748368] v31'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef04036040 con 0x55902a15cc80 2024-09-12T17:29:45.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.644+0000 7fef12c82640 1 -- 172.21.15.170:0/2384520538 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(50 notify.3 [create] v31'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef0c069040 con 0x55902a158310 2024-09-12T17:29:45.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.644+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94077669754832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55902a164bf0 con 0x55902a158310 2024-09-12T17:29:45.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.644+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55902a165b40 con 0x55902a153930 2024-09-12T17:29:45.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.645+0000 7fef12c82640 1 -- 172.21.15.170:0/2384520538 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94077669754832] v31'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef0c069040 con 0x55902a158310 2024-09-12T17:29:45.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.645+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v31'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feefc051070 con 0x55902a153930 2024-09-12T17:29:45.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.645+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94077669757040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55902a165b40 con 0x55902a153930 2024-09-12T17:29:45.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.645+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55902a166500 con 0x7fef0c03c060 2024-09-12T17:29:45.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.646+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94077669757040] v31'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feefc051070 con 0x55902a153930 2024-09-12T17:29:45.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.647+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(54 notify.5 [create] v31'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feefc051070 con 0x7fef0c03c060 2024-09-12T17:29:45.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.647+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94077669761584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55902a165b40 con 0x7fef0c03c060 2024-09-12T17:29:45.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.647+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55902a166f10 con 0x7fef0c03c060 2024-09-12T17:29:45.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.648+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94077669761584] v31'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feefc051070 con 0x7fef0c03c060 2024-09-12T17:29:45.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.648+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v31'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feefc051070 con 0x7fef0c03c060 2024-09-12T17:29:45.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.648+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94077669759088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55902a166f10 con 0x7fef0c03c060 2024-09-12T17:29:45.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.648+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55902a1678d0 con 0x7fef0c03c060 2024-09-12T17:29:45.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.649+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94077669759088] v31'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feefc051070 con 0x7fef0c03c060 2024-09-12T17:29:45.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.649+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(58 notify.7 [create] v31'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feefc051070 con 0x7fef0c03c060 2024-09-12T17:29:45.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.649+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94077669763680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55902a167ab0 con 0x7fef0c03c060 2024-09-12T17:29:45.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.649+0000 7fef1673a800 20 add_watcher() i=0 2024-09-12T17:29:45.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.649+0000 7fef1673a800 20 add_watcher() i=1 2024-09-12T17:29:45.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.649+0000 7fef1673a800 20 add_watcher() i=2 2024-09-12T17:29:45.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.649+0000 7fef1673a800 20 add_watcher() i=3 2024-09-12T17:29:45.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.649+0000 7fef1673a800 20 add_watcher() i=4 2024-09-12T17:29:45.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.649+0000 7fef1673a800 20 add_watcher() i=5 2024-09-12T17:29:45.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.649+0000 7fef1673a800 20 add_watcher() i=6 2024-09-12T17:29:45.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.650+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94077669763680] v31'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feefc051070 con 0x7fef0c03c060 2024-09-12T17:29:45.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.650+0000 7fef1673a800 20 add_watcher() i=7 2024-09-12T17:29:45.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.650+0000 7fef1673a800 2 all 8 watchers are set, enabling cache 2024-09-12T17:29:45.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.650+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55902a16ac40 con 0x55902a153930 2024-09-12T17:29:45.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.650+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7feefc051070 con 0x55902a153930 2024-09-12T17:29:45.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.650+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94077669778928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55902a167a00 con 0x55902a153930 2024-09-12T17:29:45.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.651+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94077669778928] v31'231 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7feefc051070 con 0x55902a153930 2024-09-12T17:29:45.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.651+0000 7fedc8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:45.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.651+0000 7fef1673a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:29:45.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.651+0000 7fef1673a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:29:45.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.651+0000 7fef1673a800 5 note: GC not initialized 2024-09-12T17:29:45.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.652+0000 7fed437fe640 20 reqs_thread_entry: start 2024-09-12T17:29:45.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.652+0000 7fef1673a800 20 init_complete bucket index max shards: 11 2024-09-12T17:29:45.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.652+0000 7fef1673a800 20 Filter name: none 2024-09-12T17:29:45.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.652+0000 7fed417fa640 20 reqs_thread_entry: start 2024-09-12T17:29:45.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.652+0000 7fef1673a800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.652+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55902a19d940 con 0x55902a153930 2024-09-12T17:29:45.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.652+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7feefc051070 con 0x55902a153930 2024-09-12T17:29:45.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.652+0000 7fef1673a800 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:29:45.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.652+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55902a19ed60 con 0x7fef0c03c060 2024-09-12T17:29:45.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.653+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv32 ondisk = 0) ==== 152+0+15 (crc 0 0 0) 0x7feefc051070 con 0x7fef0c03c060 2024-09-12T17:29:45.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.654+0000 7fedc8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:45.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.654+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94077669778928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55902a168cd0 con 0x55902a153930 2024-09-12T17:29:45.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.655+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94077669778928] v31'232 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7feefc051070 con 0x55902a153930 2024-09-12T17:29:45.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.655+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94077669742816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55902a16a5f0 con 0x55902a158310 2024-09-12T17:29:45.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.656+0000 7fef12c82640 1 -- 172.21.15.170:0/2384520538 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94077669742816] v31'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef0c069040 con 0x55902a158310 2024-09-12T17:29:45.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.656+0000 7fef1673a800 20 remove_watcher() i=0 2024-09-12T17:29:45.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.656+0000 7fef1673a800 2 removed watcher, disabling cache 2024-09-12T17:29:45.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.656+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94077669746800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55902a1618e0 con 0x55902a153930 2024-09-12T17:29:45.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.657+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94077669746800] v31'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feefc051070 con 0x55902a153930 2024-09-12T17:29:45.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.657+0000 7fef1673a800 20 remove_watcher() i=1 2024-09-12T17:29:45.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.657+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94077669748368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55902a1618e0 con 0x55902a15cc80 2024-09-12T17:29:45.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.658+0000 7fef12481640 1 -- 172.21.15.170:0/2384520538 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94077669748368] v31'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef04036040 con 0x55902a15cc80 2024-09-12T17:29:45.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.658+0000 7fef1673a800 20 remove_watcher() i=2 2024-09-12T17:29:45.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.658+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94077669754832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55902a1618e0 con 0x55902a158310 2024-09-12T17:29:45.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.659+0000 7fef12c82640 1 -- 172.21.15.170:0/2384520538 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94077669754832] v31'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef0c069040 con 0x55902a158310 2024-09-12T17:29:45.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.659+0000 7fef1673a800 20 remove_watcher() i=3 2024-09-12T17:29:45.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.659+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94077669757040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55902a1647d0 con 0x55902a153930 2024-09-12T17:29:45.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.660+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94077669757040] v31'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feefc051070 con 0x55902a153930 2024-09-12T17:29:45.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.660+0000 7fef1673a800 20 remove_watcher() i=4 2024-09-12T17:29:45.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.660+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94077669761584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55902a1618e0 con 0x7fef0c03c060 2024-09-12T17:29:45.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.661+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94077669761584] v31'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feefc051070 con 0x7fef0c03c060 2024-09-12T17:29:45.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.661+0000 7fef1673a800 20 remove_watcher() i=5 2024-09-12T17:29:45.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.661+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94077669759088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55902a165070 con 0x7fef0c03c060 2024-09-12T17:29:45.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.662+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94077669759088] v31'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feefc051070 con 0x7fef0c03c060 2024-09-12T17:29:45.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.662+0000 7fef1673a800 20 remove_watcher() i=6 2024-09-12T17:29:45.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.662+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94077669763680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55902a1647d0 con 0x7fef0c03c060 2024-09-12T17:29:45.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.663+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94077669763680] v31'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feefc051070 con 0x7fef0c03c060 2024-09-12T17:29:45.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.663+0000 7fef1673a800 20 remove_watcher() i=7 2024-09-12T17:29:45.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.663+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fef0c03c060 msgr2=0x7fef0c056200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.663+0000 7fef1673a800 1 --2- 172.21.15.170:0/2384520538 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fef0c03c060 0x7fef0c056200 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.663+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55902a153930 msgr2=0x55902a155dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.663+0000 7fef1673a800 1 --2- 172.21.15.170:0/2384520538 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55902a153930 0x55902a155dc0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.663+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55902a158310 msgr2=0x55902a15a700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.663+0000 7fef1673a800 1 --2- 172.21.15.170:0/2384520538 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55902a158310 0x55902a15a700 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.663+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55902a15cc80 msgr2=0x55902a15f140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.663+0000 7fef1673a800 1 --2- 172.21.15.170:0/2384520538 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55902a15cc80 0x55902a15f140 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.663+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7feddc03c730 msgr2=0x7feddc03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.663+0000 7fef1673a800 1 --2- 172.21.15.170:0/2384520538 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7feddc03c730 0x7feddc03ebf0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fef04018ac0 tx=0x7fef0404f000 comp rx=0 tx=0).stop 2024-09-12T17:29:45.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.663+0000 7fef09c80640 1 -- 172.21.15.170:0/2384520538 reap_dead start 2024-09-12T17:29:45.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.663+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55902a140a70 msgr2=0x55902a147f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.663+0000 7fef1673a800 1 --2- 172.21.15.170:0/2384520538 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55902a140a70 0x55902a147f80 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fef0c020b60 tx=0x7fef0c053ca0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.663+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 shutdown_connections 2024-09-12T17:29:45.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.663+0000 7fef1673a800 1 --2- 172.21.15.170:0/2384520538 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55902a140a70 0x55902a147f80 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.663+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 >> 172.21.15.170:0/2384520538 conn(0x55902a13ce70 msgr2=0x55902a13b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:45.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.664+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 shutdown_connections 2024-09-12T17:29:45.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.664+0000 7fef1673a800 1 -- 172.21.15.170:0/2384520538 wait complete. 2024-09-12T17:29:45.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.664+0000 7fef1673a800 1 -- 172.21.15.170:0/1512408661 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fedec03c780 msgr2=0x7fedec03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.664+0000 7fef1673a800 1 --2- 172.21.15.170:0/1512408661 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fedec03c780 0x7fedec03ec40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x55902a120e20 tx=0x7fef04040040 comp rx=0 tx=0).stop 2024-09-12T17:29:45.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.664+0000 7fef1673a800 1 -- 172.21.15.170:0/1512408661 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55902a133ff0 msgr2=0x55902a134410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.664+0000 7fef1673a800 1 --2- 172.21.15.170:0/1512408661 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55902a133ff0 0x55902a134410 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x55902a11a050 tx=0x7fef0c0167b0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.664+0000 7fef1673a800 1 -- 172.21.15.170:0/1512408661 shutdown_connections 2024-09-12T17:29:45.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.664+0000 7fef1673a800 1 --2- 172.21.15.170:0/1512408661 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fedec03c780 0x7fedec03ec40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.664+0000 7fef1673a800 1 --2- 172.21.15.170:0/1512408661 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55902a133ff0 0x55902a134410 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.664+0000 7fef1673a800 1 -- 172.21.15.170:0/1512408661 >> 172.21.15.170:0/1512408661 conn(0x55902a1283a0 msgr2=0x55902a128780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:45.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.664+0000 7fef1673a800 1 -- 172.21.15.170:0/1512408661 shutdown_connections 2024-09-12T17:29:45.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.664+0000 7fef1673a800 1 -- 172.21.15.170:0/1512408661 wait complete. 2024-09-12T17:29:45.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.664+0000 7fef1673a800 1 -- 172.21.15.170:0/1299831800 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55902a01fff0 msgr2=0x55902a120810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.664+0000 7fef1673a800 1 --2- 172.21.15.170:0/1299831800 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55902a01fff0 0x55902a120810 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.664+0000 7fef1673a800 1 -- 172.21.15.170:0/1299831800 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55902a122c80 msgr2=0x55902a125070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.664+0000 7fef1673a800 1 --2- 172.21.15.170:0/1299831800 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55902a122c80 0x55902a125070 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.664+0000 7fef1673a800 1 -- 172.21.15.170:0/1299831800 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fedf803c780 msgr2=0x7fedf803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.664+0000 7fef1673a800 1 --2- 172.21.15.170:0/1299831800 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fedf803c780 0x7fedf803ec40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7feefc057000 tx=0x7feefc052000 comp rx=0 tx=0).stop 2024-09-12T17:29:45.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.664+0000 7fef1673a800 1 -- 172.21.15.170:0/1299831800 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55902a01e4d0 msgr2=0x55902a1191c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.664+0000 7fef1673a800 1 --2- 172.21.15.170:0/1299831800 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55902a01e4d0 0x55902a1191c0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fef0400c010 tx=0x7fef04000ed0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.664+0000 7fef1673a800 1 -- 172.21.15.170:0/1299831800 shutdown_connections 2024-09-12T17:29:45.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.664+0000 7fef1673a800 1 --2- 172.21.15.170:0/1299831800 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55902a122c80 0x55902a125070 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.664+0000 7fef1673a800 1 --2- 172.21.15.170:0/1299831800 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fedf803c780 0x7fedf803ec40 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.664+0000 7fef1673a800 1 --2- 172.21.15.170:0/1299831800 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55902a01fff0 0x55902a120810 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.664+0000 7fef1673a800 1 --2- 172.21.15.170:0/1299831800 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55902a01e4d0 0x55902a1191c0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.664+0000 7fef1673a800 1 -- 172.21.15.170:0/1299831800 >> 172.21.15.170:0/1299831800 conn(0x55902a01a1c0 msgr2=0x55902a112af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:45.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.665+0000 7fef1673a800 1 -- 172.21.15.170:0/1299831800 shutdown_connections 2024-09-12T17:29:45.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.665+0000 7fef1673a800 1 -- 172.21.15.170:0/1299831800 wait complete. 2024-09-12T17:29:45.677 INFO:teuthology.orchestra.run.smithi170.stdout:{"entries":[],"summary":[]} 2024-09-12T17:29:45.677 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-12T17:29:45.677 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-12T17:29:45.677 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-12T17:29:45.677 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-09-12T17:29:45.722 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:29:45.723 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:29:45.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.722+0000 7f288c937800 1 Processor -- start 2024-09-12T17:29:45.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.722+0000 7f288c937800 1 -- start start 2024-09-12T17:29:45.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.722+0000 7f288c937800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55efc7e11740 0x55efc7e13b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.722+0000 7f288c937800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55efc7cbae40 con 0x55efc7e14070 2024-09-12T17:29:45.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.722+0000 7f288c937800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x55efc7c85680 con 0x55efc7e11740 2024-09-12T17:29:45.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.723+0000 7f2888621640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55efc7e11740 0x55efc7e13b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.723+0000 7f2887e20640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x55efc7e14070 0x55efc7e16500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:44802/0 (socket says 172.21.15.170:44802) 2024-09-12T17:29:45.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.723+0000 7f2887e20640 1 -- 172.21.15.170:0/3368866729 learned_addr learned my addr 172.21.15.170:0/3368866729 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:29:45.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.723+0000 7f288761f640 1 -- 172.21.15.170:0/3368866729 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1869918085 0 0) 0x55efc7cbae40 con 0x55efc7e14070 2024-09-12T17:29:45.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.723+0000 7f288761f640 1 -- 172.21.15.170:0/3368866729 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2874001e10 con 0x55efc7e14070 2024-09-12T17:29:45.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.723+0000 7f2888621640 1 -- 172.21.15.170:0/3368866729 >> v1:172.21.15.47:6789/0 conn(0x55efc7e14070 legacy=0x55efc7e16500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.723+0000 7f2888621640 1 -- 172.21.15.170:0/3368866729 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efc7ca16b0 con 0x55efc7e11740 2024-09-12T17:29:45.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.725+0000 7f2888621640 1 --2- 172.21.15.170:0/3368866729 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efc7e11740 0x55efc7e13b30 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f288000a470 tx=0x7f2880045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=467540e45e1abcc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.725+0000 7f288761f640 1 -- 172.21.15.170:0/3368866729 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2880059070 con 0x55efc7e11740 2024-09-12T17:29:45.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.725+0000 7f288761f640 1 -- 172.21.15.170:0/3368866729 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2880054570 con 0x55efc7e11740 2024-09-12T17:29:45.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.725+0000 7f288761f640 1 -- 172.21.15.170:0/3368866729 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2880054870 con 0x55efc7e11740 2024-09-12T17:29:45.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.725+0000 7f288c937800 1 -- 172.21.15.170:0/3368866729 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efc7e11740 msgr2=0x55efc7e13b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.725+0000 7f288c937800 1 --2- 172.21.15.170:0/3368866729 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efc7e11740 0x55efc7e13b30 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f288000a470 tx=0x7f2880045920 comp rx=0 tx=0).stop 2024-09-12T17:29:45.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.725+0000 7f288c937800 1 -- 172.21.15.170:0/3368866729 shutdown_connections 2024-09-12T17:29:45.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.725+0000 7f288c937800 1 --2- 172.21.15.170:0/3368866729 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efc7e11740 0x55efc7e13b30 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.725+0000 7f288c937800 1 -- 172.21.15.170:0/3368866729 >> 172.21.15.170:0/3368866729 conn(0x55efc7e0b200 msgr2=0x55efc7e0d640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:45.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.726+0000 7f288c937800 1 -- 172.21.15.170:0/3368866729 shutdown_connections 2024-09-12T17:29:45.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.726+0000 7f288c937800 1 -- 172.21.15.170:0/3368866729 wait complete. 2024-09-12T17:29:45.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.739+0000 7f288c937800 1 Processor -- start 2024-09-12T17:29:45.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.739+0000 7f288c937800 1 -- start start 2024-09-12T17:29:45.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.739+0000 7f288c937800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efc7e11740 0x55efc7f004b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.739+0000 7f288c937800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55efc7ca9dd0 con 0x55efc7e11740 2024-09-12T17:29:45.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.740+0000 7f2888621640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efc7e11740 0x55efc7f004b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.740+0000 7f2888621640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efc7e11740 0x55efc7f004b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34454/0 (socket says 172.21.15.170:34454) 2024-09-12T17:29:45.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.740+0000 7f2888621640 1 -- 172.21.15.170:0/2380458857 learned_addr learned my addr 172.21.15.170:0/2380458857 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:45.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.740+0000 7f2888621640 1 -- 172.21.15.170:0/2380458857 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efc7cc2e10 con 0x55efc7e11740 2024-09-12T17:29:45.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.740+0000 7f2888621640 1 --2- 172.21.15.170:0/2380458857 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efc7e11740 0x55efc7f004b0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f288000a470 tx=0x7f288004e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21affbce4ab9d966 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.740+0000 7f277660c640 1 -- 172.21.15.170:0/2380458857 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2880065070 con 0x55efc7e11740 2024-09-12T17:29:45.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.740+0000 7f277660c640 1 -- 172.21.15.170:0/2380458857 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f288005a040 con 0x55efc7e11740 2024-09-12T17:29:45.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.740+0000 7f277660c640 1 -- 172.21.15.170:0/2380458857 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2880059070 con 0x55efc7e11740 2024-09-12T17:29:45.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.741+0000 7f288c937800 1 -- 172.21.15.170:0/2380458857 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efc7e11740 msgr2=0x55efc7f004b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.741+0000 7f288c937800 1 --2- 172.21.15.170:0/2380458857 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efc7e11740 0x55efc7f004b0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f288000a470 tx=0x7f288004e000 comp rx=0 tx=0).stop 2024-09-12T17:29:45.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.741+0000 7f288c937800 1 -- 172.21.15.170:0/2380458857 shutdown_connections 2024-09-12T17:29:45.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.741+0000 7f288c937800 1 --2- 172.21.15.170:0/2380458857 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efc7e11740 0x55efc7f004b0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.741+0000 7f288c937800 1 -- 172.21.15.170:0/2380458857 >> 172.21.15.170:0/2380458857 conn(0x55efc7e0b200 msgr2=0x55efc7efbe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:45.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.741+0000 7f288c937800 1 -- 172.21.15.170:0/2380458857 shutdown_connections 2024-09-12T17:29:45.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.741+0000 7f288c937800 1 -- 172.21.15.170:0/2380458857 wait complete. 2024-09-12T17:29:45.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.741+0000 7f288c937800 1 Processor -- start 2024-09-12T17:29:45.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.741+0000 7f288c937800 1 -- start start 2024-09-12T17:29:45.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.742+0000 7f288c937800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efc7e14070 0x55efc7f07fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.742+0000 7f288c937800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55efc7e18060 con 0x55efc7e14070 2024-09-12T17:29:45.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.742+0000 7f2888621640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efc7e14070 0x55efc7f07fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.742+0000 7f2888621640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efc7e14070 0x55efc7f07fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34462/0 (socket says 172.21.15.170:34462) 2024-09-12T17:29:45.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.742+0000 7f2888621640 1 -- 172.21.15.170:0/700655787 learned_addr learned my addr 172.21.15.170:0/700655787 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:45.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.742+0000 7f2888621640 1 -- 172.21.15.170:0/700655787 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efc7f08520 con 0x55efc7e14070 2024-09-12T17:29:45.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.743+0000 7f2888621640 1 --2- 172.21.15.170:0/700655787 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efc7e14070 0x55efc7f07fc0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f2880025b20 tx=0x7f2880002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.743+0000 7f2774e09640 1 -- 172.21.15.170:0/700655787 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2880071070 con 0x55efc7e14070 2024-09-12T17:29:45.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.743+0000 7f2774e09640 1 -- 172.21.15.170:0/700655787 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2880066040 con 0x55efc7e14070 2024-09-12T17:29:45.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.743+0000 7f288c937800 1 -- 172.21.15.170:0/700655787 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55efc7f087b0 con 0x55efc7e14070 2024-09-12T17:29:45.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.743+0000 7f2774e09640 1 -- 172.21.15.170:0/700655787 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2880065050 con 0x55efc7e14070 2024-09-12T17:29:45.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.743+0000 7f288c937800 1 -- 172.21.15.170:0/700655787 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efc7f091b0 con 0x55efc7e14070 2024-09-12T17:29:45.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.744+0000 7f2774e09640 1 -- 172.21.15.170:0/700655787 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2880074070 con 0x55efc7e14070 2024-09-12T17:29:45.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.744+0000 7f2774e09640 1 --2- 172.21.15.170:0/700655787 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f277003c780 0x7f277003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.744+0000 7f2774e09640 1 -- 172.21.15.170:0/700655787 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f2880096390 con 0x55efc7e14070 2024-09-12T17:29:45.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.744+0000 7f2887e20640 1 --2- 172.21.15.170:0/700655787 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f277003c780 0x7f277003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.744+0000 7f288c937800 1 --2- 172.21.15.170:0/700655787 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55efc7f09cb0 0x55efc7f0f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.744+0000 7f288c937800 1 -- 172.21.15.170:0/700655787 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f0fb50 con 0x55efc7f09cb0 2024-09-12T17:29:45.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.744+0000 7f2888e22640 1 --2- 172.21.15.170:0/700655787 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55efc7f09cb0 0x55efc7f0f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.744+0000 7f2887e20640 1 --2- 172.21.15.170:0/700655787 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f277003c780 0x7f277003ec40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2870001db0 tx=0x7f2870001310 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.744+0000 7f2888e22640 1 --2- 172.21.15.170:0/700655787 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55efc7f09cb0 0x55efc7f0f610 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.745+0000 7f2888e22640 1 -- 172.21.15.170:0/700655787 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f287800a4d0 con 0x55efc7f09cb0 2024-09-12T17:29:45.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.745+0000 7f288c937800 1 -- 172.21.15.170:0/700655787 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f09660 con 0x55efc7f09cb0 2024-09-12T17:29:45.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.745+0000 7f2888e22640 1 -- 172.21.15.170:0/700655787 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f287800a4d0 con 0x55efc7f09cb0 2024-09-12T17:29:45.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.745+0000 7f288c937800 1 --2- 172.21.15.170:0/700655787 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55efc7f11ea0 0x55efc7f14290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.745+0000 7f288c937800 1 -- 172.21.15.170:0/700655787 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f14960 con 0x55efc7f11ea0 2024-09-12T17:29:45.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.745+0000 7f2888621640 1 --2- 172.21.15.170:0/700655787 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55efc7f11ea0 0x55efc7f14290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.745+0000 7f2888621640 1 --2- 172.21.15.170:0/700655787 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55efc7f11ea0 0x55efc7f14290 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.746+0000 7f2888621640 1 -- 172.21.15.170:0/700655787 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2880073030 con 0x55efc7f11ea0 2024-09-12T17:29:45.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.746+0000 7f288c937800 1 -- 172.21.15.170:0/700655787 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f10d10 con 0x55efc7f09cb0 2024-09-12T17:29:45.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.746+0000 7f2888e22640 1 -- 172.21.15.170:0/700655787 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f287800a4d0 con 0x55efc7f09cb0 2024-09-12T17:29:45.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.746+0000 7f288c937800 1 -- 172.21.15.170:0/700655787 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f111b0 con 0x55efc7f11ea0 2024-09-12T17:29:45.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.746+0000 7f2888621640 1 -- 172.21.15.170:0/700655787 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2880073030 con 0x55efc7f11ea0 2024-09-12T17:29:45.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.747+0000 7f288c937800 1 Processor -- start 2024-09-12T17:29:45.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.747+0000 7f288c937800 1 -- start start 2024-09-12T17:29:45.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.747+0000 7f288c937800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efc7e10ee0 0x55efc7e0f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.747+0000 7f288c937800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55efc7d07a00 con 0x55efc7e10ee0 2024-09-12T17:29:45.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.747+0000 7f2888e22640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efc7e10ee0 0x55efc7e0f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.747+0000 7f2888e22640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efc7e10ee0 0x55efc7e0f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34472/0 (socket says 172.21.15.170:34472) 2024-09-12T17:29:45.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.747+0000 7f2888e22640 1 -- 172.21.15.170:0/1897305403 learned_addr learned my addr 172.21.15.170:0/1897305403 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:45.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.747+0000 7f2888e22640 1 -- 172.21.15.170:0/1897305403 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efc7e11400 con 0x55efc7e10ee0 2024-09-12T17:29:45.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.748+0000 7f2888e22640 1 --2- 172.21.15.170:0/1897305403 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efc7e10ee0 0x55efc7e0f750 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x55efc7f08fc0 tx=0x7f28780167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.748+0000 7f276dffb640 1 -- 172.21.15.170:0/1897305403 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2878013640 con 0x55efc7e10ee0 2024-09-12T17:29:45.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.748+0000 7f276dffb640 1 -- 172.21.15.170:0/1897305403 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28780137e0 con 0x55efc7e10ee0 2024-09-12T17:29:45.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.748+0000 7f288c937800 1 -- 172.21.15.170:0/1897305403 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55efc7e0fc90 con 0x55efc7e10ee0 2024-09-12T17:29:45.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.748+0000 7f276dffb640 1 -- 172.21.15.170:0/1897305403 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2878013ac0 con 0x55efc7e10ee0 2024-09-12T17:29:45.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.748+0000 7f288c937800 1 -- 172.21.15.170:0/1897305403 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efc7e101e0 con 0x55efc7e10ee0 2024-09-12T17:29:45.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.749+0000 7f276dffb640 1 -- 172.21.15.170:0/1897305403 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2878011040 con 0x55efc7e10ee0 2024-09-12T17:29:45.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.749+0000 7f276dffb640 1 --2- 172.21.15.170:0/1897305403 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f276003c730 0x7f276003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.749+0000 7f276dffb640 1 -- 172.21.15.170:0/1897305403 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f287800e040 con 0x55efc7e10ee0 2024-09-12T17:29:45.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.749+0000 7f2888621640 1 --2- 172.21.15.170:0/1897305403 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f276003c730 0x7f276003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.749+0000 7f288c937800 1 Processor -- start 2024-09-12T17:29:45.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.749+0000 7f2888621640 1 --2- 172.21.15.170:0/1897305403 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f276003c730 0x7f276003ebf0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x55efc7f10020 tx=0x7f288006af60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.749+0000 7f288c937800 1 -- start start 2024-09-12T17:29:45.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.750+0000 7f288c937800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efc7f31e40 0x55efc7f32240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.750+0000 7f288c937800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55efc7f00c40 con 0x55efc7f31e40 2024-09-12T17:29:45.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.750+0000 7f2888e22640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efc7f31e40 0x55efc7f32240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.750+0000 7f2888e22640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efc7f31e40 0x55efc7f32240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34488/0 (socket says 172.21.15.170:34488) 2024-09-12T17:29:45.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.750+0000 7f2888e22640 1 -- 172.21.15.170:0/2248318976 learned_addr learned my addr 172.21.15.170:0/2248318976 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:45.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.750+0000 7f2888e22640 1 -- 172.21.15.170:0/2248318976 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efc7f32830 con 0x55efc7f31e40 2024-09-12T17:29:45.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.750+0000 7f2888e22640 1 --2- 172.21.15.170:0/2248318976 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efc7f31e40 0x55efc7f32240 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f287801fef0 tx=0x7f287801fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=152cc37306f4af9d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.750+0000 7f27677fe640 1 -- 172.21.15.170:0/2248318976 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2878021a40 con 0x55efc7f31e40 2024-09-12T17:29:45.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.750+0000 7f27677fe640 1 -- 172.21.15.170:0/2248318976 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2878021440 con 0x55efc7f31e40 2024-09-12T17:29:45.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.750+0000 7f27677fe640 1 -- 172.21.15.170:0/2248318976 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2878013c60 con 0x55efc7f31e40 2024-09-12T17:29:45.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.751+0000 7f288c937800 1 -- 172.21.15.170:0/2248318976 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efc7f31e40 msgr2=0x55efc7f32240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.751+0000 7f288c937800 1 --2- 172.21.15.170:0/2248318976 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efc7f31e40 0x55efc7f32240 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f287801fef0 tx=0x7f287801fc90 comp rx=0 tx=0).stop 2024-09-12T17:29:45.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.751+0000 7f288c937800 1 -- 172.21.15.170:0/2248318976 shutdown_connections 2024-09-12T17:29:45.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.751+0000 7f288c937800 1 --2- 172.21.15.170:0/2248318976 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efc7f31e40 0x55efc7f32240 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.751+0000 7f288c937800 1 -- 172.21.15.170:0/2248318976 >> 172.21.15.170:0/2248318976 conn(0x55efc7f2e240 msgr2=0x55efc7f2c480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:45.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.751+0000 7f288c937800 1 -- 172.21.15.170:0/2248318976 shutdown_connections 2024-09-12T17:29:45.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.751+0000 7f288c937800 1 -- 172.21.15.170:0/2248318976 wait complete. 2024-09-12T17:29:45.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.751+0000 7f288c937800 1 Processor -- start 2024-09-12T17:29:45.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.751+0000 7f288c937800 1 -- start start 2024-09-12T17:29:45.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.751+0000 7f288c937800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efc7f31e40 0x55efc7f39450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.751+0000 7f288c937800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55efc7f32e50 con 0x55efc7f31e40 2024-09-12T17:29:45.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.752+0000 7f2888e22640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efc7f31e40 0x55efc7f39450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.752+0000 7f2888e22640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efc7f31e40 0x55efc7f39450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34498/0 (socket says 172.21.15.170:34498) 2024-09-12T17:29:45.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.752+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 learned_addr learned my addr 172.21.15.170:0/3702380452 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:45.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.752+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efc7f399b0 con 0x55efc7f31e40 2024-09-12T17:29:45.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.752+0000 7f2888e22640 1 --2- 172.21.15.170:0/3702380452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efc7f31e40 0x55efc7f39450 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f287801fef0 tx=0x7f2878053d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.752+0000 7f2765ffb640 1 -- 172.21.15.170:0/3702380452 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2878020800 con 0x55efc7f31e40 2024-09-12T17:29:45.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.752+0000 7f2765ffb640 1 -- 172.21.15.170:0/3702380452 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28780209a0 con 0x55efc7f31e40 2024-09-12T17:29:45.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.752+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55efc7f39c40 con 0x55efc7f31e40 2024-09-12T17:29:45.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.752+0000 7f2765ffb640 1 -- 172.21.15.170:0/3702380452 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2878020c80 con 0x55efc7f31e40 2024-09-12T17:29:45.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.752+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efc7f3a5c0 con 0x55efc7f31e40 2024-09-12T17:29:45.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.753+0000 7f2765ffb640 1 -- 172.21.15.170:0/3702380452 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f28780145e0 con 0x55efc7f31e40 2024-09-12T17:29:45.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.753+0000 7f2765ffb640 1 --2- 172.21.15.170:0/3702380452 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f275803c730 0x7f275803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.753+0000 7f2765ffb640 1 -- 172.21.15.170:0/3702380452 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f2878034c00 con 0x55efc7f31e40 2024-09-12T17:29:45.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.753+0000 7f2888621640 1 --2- 172.21.15.170:0/3702380452 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f275803c730 0x7f275803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.754+0000 7f2888621640 1 --2- 172.21.15.170:0/3702380452 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f275803c730 0x7f275803ebf0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2880001eb0 tx=0x7f288007f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.754+0000 7f288c937800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.754+0000 7f288c937800 1 --2- 172.21.15.170:0/3702380452 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55efc7f44d30 0x55efc7f471f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.754+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f47940 con 0x55efc7f44d30 2024-09-12T17:29:45.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.754+0000 7f2887e20640 1 --2- 172.21.15.170:0/3702380452 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55efc7f44d30 0x55efc7f471f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.754+0000 7f2887e20640 1 --2- 172.21.15.170:0/3702380452 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55efc7f44d30 0x55efc7f471f0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.755+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2870009050 con 0x55efc7f44d30 2024-09-12T17:29:45.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.755+0000 7f288c937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.755+0000 7f288c937800 20 realm 2024-09-12T17:29:45.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.755+0000 7f288c937800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.755+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f44080 con 0x55efc7f44d30 2024-09-12T17:29:45.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.755+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2870009050 con 0x55efc7f44d30 2024-09-12T17:29:45.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.755+0000 7f288c937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.755+0000 7f288c937800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:29:45.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.755+0000 7f288c937800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.755+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f48430 con 0x55efc7f44d30 2024-09-12T17:29:45.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.755+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2870009050 con 0x55efc7f44d30 2024-09-12T17:29:45.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.755+0000 7f288c937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.755+0000 7f288c937800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.755+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f48d00 con 0x55efc7f44d30 2024-09-12T17:29:45.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.755+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2870009050 con 0x55efc7f44d30 2024-09-12T17:29:45.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.755+0000 7f288c937800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:45.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.755+0000 7f288c937800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.755+0000 7f288c937800 1 --2- 172.21.15.170:0/3702380452 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55efc7f49720 0x55efc7f4bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.755+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f4c250 con 0x55efc7f49720 2024-09-12T17:29:45.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.755+0000 7f2888e22640 1 --2- 172.21.15.170:0/3702380452 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55efc7f49720 0x55efc7f4bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.756+0000 7f2888e22640 1 --2- 172.21.15.170:0/3702380452 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55efc7f49720 0x55efc7f4bb10 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.756+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f287800a4d0 con 0x55efc7f49720 2024-09-12T17:29:45.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.756+0000 7f288c937800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:29:45.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.756+0000 7f288c937800 20 searching for the correct realm 2024-09-12T17:29:45.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.756+0000 7f288c937800 1 --2- 172.21.15.170:0/3702380452 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55efc7f4e220 0x55efc7f506e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.756+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f50db0 con 0x55efc7f4e220 2024-09-12T17:29:45.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.756+0000 7f2888621640 1 --2- 172.21.15.170:0/3702380452 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55efc7f4e220 0x55efc7f506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.756+0000 7f2888621640 1 --2- 172.21.15.170:0/3702380452 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55efc7f4e220 0x55efc7f506e0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.757+0000 7f2888621640 1 -- 172.21.15.170:0/3702380452 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2880073030 con 0x55efc7f4e220 2024-09-12T17:29:45.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.757+0000 7f2888621640 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f50db0 con 0x55efc7f49720 2024-09-12T17:29:45.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.757+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f287800a4d0 con 0x55efc7f49720 2024-09-12T17:29:45.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.757+0000 7f2888e22640 1 --2- 172.21.15.170:0/3702380452 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f2878033070 0x7f2878056a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.757+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f50db0 con 0x7f2878033070 2024-09-12T17:29:45.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.757+0000 7f2887e20640 1 --2- 172.21.15.170:0/3702380452 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f2878033070 0x7f2878056a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.757+0000 7f2887e20640 1 --2- 172.21.15.170:0/3702380452 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f2878033070 0x7f2878056a80 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.758+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2870009050 con 0x7f2878033070 2024-09-12T17:29:45.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.758+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f50db0 con 0x55efc7f44d30 2024-09-12T17:29:45.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.758+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2870009050 con 0x55efc7f44d30 2024-09-12T17:29:45.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.758+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f50db0 con 0x55efc7f44d30 2024-09-12T17:29:45.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.758+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2870029040 con 0x55efc7f44d30 2024-09-12T17:29:45.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.758+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f50db0 con 0x7f2878033070 2024-09-12T17:29:45.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.759+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.759+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f50db0 con 0x7f2878033070 2024-09-12T17:29:45.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.759+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.759+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f50db0 con 0x55efc7f49720 2024-09-12T17:29:45.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.759+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f287800a4d0 con 0x55efc7f49720 2024-09-12T17:29:45.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.759+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f50db0 con 0x55efc7f4e220 2024-09-12T17:29:45.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.759+0000 7f2888621640 1 -- 172.21.15.170:0/3702380452 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2880073030 con 0x55efc7f4e220 2024-09-12T17:29:45.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.759+0000 7f2888621640 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f50db0 con 0x55efc7f44d30 2024-09-12T17:29:45.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.760+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2870029040 con 0x55efc7f44d30 2024-09-12T17:29:45.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.760+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f50db0 con 0x7f2878033070 2024-09-12T17:29:45.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.760+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.760+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f50db0 con 0x55efc7f44d30 2024-09-12T17:29:45.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.760+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2870029040 con 0x55efc7f44d30 2024-09-12T17:29:45.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.760+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f50db0 con 0x55efc7f49720 2024-09-12T17:29:45.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.760+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f287800a4d0 con 0x55efc7f49720 2024-09-12T17:29:45.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.760+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f50db0 con 0x55efc7f4e220 2024-09-12T17:29:45.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.760+0000 7f2888621640 1 -- 172.21.15.170:0/3702380452 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2880073030 con 0x55efc7f4e220 2024-09-12T17:29:45.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.761+0000 7f2888621640 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f50db0 con 0x55efc7f4e220 2024-09-12T17:29:45.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.761+0000 7f2888621640 1 -- 172.21.15.170:0/3702380452 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2880073030 con 0x55efc7f4e220 2024-09-12T17:29:45.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.761+0000 7f2888621640 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f50db0 con 0x55efc7f49720 2024-09-12T17:29:45.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.761+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f287800a4d0 con 0x55efc7f49720 2024-09-12T17:29:45.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.761+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f50db0 con 0x55efc7f4e220 2024-09-12T17:29:45.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.761+0000 7f2888621640 1 -- 172.21.15.170:0/3702380452 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2880073030 con 0x55efc7f4e220 2024-09-12T17:29:45.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.761+0000 7f2888621640 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f50db0 con 0x55efc7f4e220 2024-09-12T17:29:45.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.761+0000 7f2888621640 1 -- 172.21.15.170:0/3702380452 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2880073030 con 0x55efc7f4e220 2024-09-12T17:29:45.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.761+0000 7f2888621640 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f50db0 con 0x55efc7f44d30 2024-09-12T17:29:45.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.762+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2870029040 con 0x55efc7f44d30 2024-09-12T17:29:45.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.762+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f50db0 con 0x55efc7f44d30 2024-09-12T17:29:45.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.762+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2870029040 con 0x55efc7f44d30 2024-09-12T17:29:45.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.762+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f50db0 con 0x7f2878033070 2024-09-12T17:29:45.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.762+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.762+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f50db0 con 0x55efc7f4e220 2024-09-12T17:29:45.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.762+0000 7f2888621640 1 -- 172.21.15.170:0/3702380452 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2880073030 con 0x55efc7f4e220 2024-09-12T17:29:45.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.762+0000 7f2888621640 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f50db0 con 0x55efc7f49720 2024-09-12T17:29:45.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.763+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f287800a4d0 con 0x55efc7f49720 2024-09-12T17:29:45.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.763+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f50db0 con 0x55efc7f44d30 2024-09-12T17:29:45.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.763+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2870029040 con 0x55efc7f44d30 2024-09-12T17:29:45.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.763+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f50db0 con 0x7f2878033070 2024-09-12T17:29:45.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.763+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.763+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f50db0 con 0x55efc7f4e220 2024-09-12T17:29:45.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.763+0000 7f2888621640 1 -- 172.21.15.170:0/3702380452 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2880073030 con 0x55efc7f4e220 2024-09-12T17:29:45.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.763+0000 7f2888621640 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f50db0 con 0x7f2878033070 2024-09-12T17:29:45.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.764+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.764+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f50db0 con 0x55efc7f49720 2024-09-12T17:29:45.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.764+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f287800a4d0 con 0x55efc7f49720 2024-09-12T17:29:45.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.764+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f50db0 con 0x55efc7f4e220 2024-09-12T17:29:45.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.764+0000 7f2888621640 1 -- 172.21.15.170:0/3702380452 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2880073030 con 0x55efc7f4e220 2024-09-12T17:29:45.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.764+0000 7f2888621640 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f50db0 con 0x7f2878033070 2024-09-12T17:29:45.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.765+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.765+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f50db0 con 0x55efc7f44d30 2024-09-12T17:29:45.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.765+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2870029040 con 0x55efc7f44d30 2024-09-12T17:29:45.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.765+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f50db0 con 0x55efc7f49720 2024-09-12T17:29:45.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.765+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(37 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f287800a4d0 con 0x55efc7f49720 2024-09-12T17:29:45.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.765+0000 7f288c937800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:29:45.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.765+0000 7f288c937800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:29:45.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.765+0000 7f288c937800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:29:45.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.765+0000 7f288c937800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:29:45.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.765+0000 7f288c937800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:29:45.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.765+0000 7f288c937800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:29:45.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.765+0000 7f288c937800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.765+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f4cc40 con 0x55efc7f44d30 2024-09-12T17:29:45.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.765+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2870029040 con 0x55efc7f44d30 2024-09-12T17:29:45.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.765+0000 7f288c937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.765+0000 7f288c937800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.765+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f4d4e0 con 0x55efc7f44d30 2024-09-12T17:29:45.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.765+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2870029040 con 0x55efc7f44d30 2024-09-12T17:29:45.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.765+0000 7f288c937800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:45.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.766+0000 7f288c937800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.766+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f4c880 con 0x55efc7f49720 2024-09-12T17:29:45.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.766+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f287800a4d0 con 0x55efc7f49720 2024-09-12T17:29:45.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.766+0000 7f288c937800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:29:45.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.766+0000 7f288c937800 20 zone default found 2024-09-12T17:29:45.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.766+0000 7f288c937800 4 Realm: () 2024-09-12T17:29:45.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.766+0000 7f288c937800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:29:45.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.766+0000 7f288c937800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:29:45.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.766+0000 7f288c937800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:29:45.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.766+0000 7f288c937800 20 zonegroup default 2024-09-12T17:29:45.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.766+0000 7f288c937800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.766+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f516e0 con 0x7f2878033070 2024-09-12T17:29:45.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.766+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.766+0000 7f288c937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.766+0000 7f288c937800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.766+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f53920 con 0x55efc7f4e220 2024-09-12T17:29:45.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.767+0000 7f2888621640 1 -- 172.21.15.170:0/3702380452 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2880073030 con 0x55efc7f4e220 2024-09-12T17:29:45.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.767+0000 7f288c937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.767+0000 7f288c937800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.767+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f53cc0 con 0x55efc7f4e220 2024-09-12T17:29:45.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.767+0000 7f2888621640 1 -- 172.21.15.170:0/3702380452 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2880073030 con 0x55efc7f4e220 2024-09-12T17:29:45.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.767+0000 7f288c937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.767+0000 7f288c937800 20 started sync module instance, tier type = 2024-09-12T17:29:45.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.767+0000 7f288c937800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:29:45.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.767+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f52db0 con 0x55efc7f49720 2024-09-12T17:29:45.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.768+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(44 notify.0 [create] v31'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f287800a4d0 con 0x55efc7f49720 2024-09-12T17:29:45.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.768+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94488340279712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f54560 con 0x55efc7f49720 2024-09-12T17:29:45.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.768+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f54db0 con 0x55efc7f44d30 2024-09-12T17:29:45.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.769+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94488340279712] v31'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f287800a4d0 con 0x55efc7f49720 2024-09-12T17:29:45.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.769+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v31'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2870029040 con 0x55efc7f44d30 2024-09-12T17:29:45.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.769+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94488340283568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f54a60 con 0x55efc7f44d30 2024-09-12T17:29:45.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.769+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f55550 con 0x55efc7f4e220 2024-09-12T17:29:45.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.770+0000 7f2888621640 1 -- 172.21.15.170:0/3702380452 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v31'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2880073030 con 0x55efc7f4e220 2024-09-12T17:29:45.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.770+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94488340287520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f55df0 con 0x55efc7f4e220 2024-09-12T17:29:45.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.770+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f568f0 con 0x55efc7f49720 2024-09-12T17:29:45.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.771+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94488340283568] v31'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2870029040 con 0x55efc7f44d30 2024-09-12T17:29:45.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.771+0000 7f2888621640 1 -- 172.21.15.170:0/3702380452 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94488340287520] v31'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2880073030 con 0x55efc7f4e220 2024-09-12T17:29:45.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.771+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(50 notify.3 [create] v31'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f287800a4d0 con 0x55efc7f49720 2024-09-12T17:29:45.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.771+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94488340289856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f544d0 con 0x55efc7f49720 2024-09-12T17:29:45.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.772+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f57300 con 0x55efc7f44d30 2024-09-12T17:29:45.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.772+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94488340289856] v31'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2878070040 con 0x55efc7f49720 2024-09-12T17:29:45.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.773+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v31'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2870029040 con 0x55efc7f44d30 2024-09-12T17:29:45.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.773+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94488340292576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f57300 con 0x55efc7f44d30 2024-09-12T17:29:45.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.773+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f57bf0 con 0x7f2878033070 2024-09-12T17:29:45.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.774+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(54 notify.5 [create] v31'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.774+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94488340296448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f57720 con 0x7f2878033070 2024-09-12T17:29:45.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.774+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94488340292576] v31'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2870029040 con 0x55efc7f44d30 2024-09-12T17:29:45.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.774+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f56e50 con 0x7f2878033070 2024-09-12T17:29:45.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.775+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94488340296448] v31'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.775+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v31'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.775+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94488340301408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f56e50 con 0x7f2878033070 2024-09-12T17:29:45.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.775+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f59040 con 0x7f2878033070 2024-09-12T17:29:45.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.776+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(58 notify.7 [create] v31'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.776+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94488340302672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f59480 con 0x7f2878033070 2024-09-12T17:29:45.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.776+0000 7f288c937800 20 add_watcher() i=0 2024-09-12T17:29:45.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.776+0000 7f288c937800 20 add_watcher() i=1 2024-09-12T17:29:45.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.776+0000 7f288c937800 20 add_watcher() i=2 2024-09-12T17:29:45.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.776+0000 7f288c937800 20 add_watcher() i=3 2024-09-12T17:29:45.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.776+0000 7f288c937800 20 add_watcher() i=4 2024-09-12T17:29:45.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.776+0000 7f288c937800 20 add_watcher() i=5 2024-09-12T17:29:45.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.776+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94488340301408] v31'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.776+0000 7f288c937800 20 add_watcher() i=6 2024-09-12T17:29:45.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.777+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94488340302672] v31'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.777+0000 7f288c937800 20 add_watcher() i=7 2024-09-12T17:29:45.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.777+0000 7f288c937800 2 all 8 watchers are set, enabling cache 2024-09-12T17:29:45.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.777+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f57fe0 con 0x55efc7f44d30 2024-09-12T17:29:45.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.777+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2870029040 con 0x55efc7f44d30 2024-09-12T17:29:45.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.777+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94488340303728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f57fe0 con 0x55efc7f44d30 2024-09-12T17:29:45.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.778+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94488340303728] v31'233 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2870029040 con 0x55efc7f44d30 2024-09-12T17:29:45.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.778+0000 7f273e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:45.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.778+0000 7f288c937800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:29:45.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.778+0000 7f288c937800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:29:45.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.778+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f64de0 con 0x55efc7f44d30 2024-09-12T17:29:45.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.779+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2870029040 con 0x55efc7f44d30 2024-09-12T17:29:45.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.779+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f64de0 con 0x7f2878033070 2024-09-12T17:29:45.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.781+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.781+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f65800 con 0x55efc7f4e220 2024-09-12T17:29:45.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.782+0000 7f2888621640 1 -- 172.21.15.170:0/3702380452 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2880073030 con 0x55efc7f4e220 2024-09-12T17:29:45.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.782+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f634d0 con 0x55efc7f44d30 2024-09-12T17:29:45.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.783+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'234 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2870029040 con 0x55efc7f44d30 2024-09-12T17:29:45.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.783+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f634d0 con 0x55efc7f49720 2024-09-12T17:29:45.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.784+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'74 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2878070040 con 0x55efc7f49720 2024-09-12T17:29:45.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.784+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f634d0 con 0x55efc7f4e220 2024-09-12T17:29:45.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.784+0000 7f2888621640 1 -- 172.21.15.170:0/3702380452 <== osd.3 v2:172.21.15.170:6816/2664906588 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'49 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2880073030 con 0x55efc7f4e220 2024-09-12T17:29:45.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.784+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f66360 con 0x55efc7f44d30 2024-09-12T17:29:45.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.786+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2870029040 con 0x55efc7f44d30 2024-09-12T17:29:45.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.786+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f66360 con 0x7f2878033070 2024-09-12T17:29:45.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.788+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'49 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.788+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f66360 con 0x55efc7f49720 2024-09-12T17:29:45.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.789+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'29 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2878070040 con 0x55efc7f49720 2024-09-12T17:29:45.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.789+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f66360 con 0x55efc7f4e220 2024-09-12T17:29:45.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.789+0000 7f2888621640 1 -- 172.21.15.170:0/3702380452 <== osd.3 v2:172.21.15.170:6816/2664906588 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2880073030 con 0x55efc7f4e220 2024-09-12T17:29:45.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.790+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f66360 con 0x55efc7f49720 2024-09-12T17:29:45.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.790+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'75 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2878070040 con 0x55efc7f49720 2024-09-12T17:29:45.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.790+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f66360 con 0x7f2878033070 2024-09-12T17:29:45.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.792+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'34 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.792+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f66360 con 0x55efc7f49720 2024-09-12T17:29:45.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.793+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2878070040 con 0x55efc7f49720 2024-09-12T17:29:45.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.793+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f66490 con 0x7f2878033070 2024-09-12T17:29:45.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.794+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'55 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.794+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f66490 con 0x55efc7f44d30 2024-09-12T17:29:45.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.795+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'235 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2870029040 con 0x55efc7f44d30 2024-09-12T17:29:45.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.795+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f66490 con 0x55efc7f4e220 2024-09-12T17:29:45.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.796+0000 7f2888621640 1 -- 172.21.15.170:0/3702380452 <== osd.3 v2:172.21.15.170:6816/2664906588 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'68 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2880073030 con 0x55efc7f4e220 2024-09-12T17:29:45.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.796+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f66aa0 con 0x55efc7f49720 2024-09-12T17:29:45.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.797+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 <== osd.2 v2:172.21.15.170:6808/3855567754 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'76 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2878070040 con 0x55efc7f49720 2024-09-12T17:29:45.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.797+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f66a20 con 0x55efc7f4e220 2024-09-12T17:29:45.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.798+0000 7f2888621640 1 -- 172.21.15.170:0/3702380452 <== osd.3 v2:172.21.15.170:6816/2664906588 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2880073030 con 0x55efc7f4e220 2024-09-12T17:29:45.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.798+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f66a20 con 0x55efc7f44d30 2024-09-12T17:29:45.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.799+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'38 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2870029040 con 0x55efc7f44d30 2024-09-12T17:29:45.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.799+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f66a20 con 0x55efc7f44d30 2024-09-12T17:29:45.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.800+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'236 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2870029040 con 0x55efc7f44d30 2024-09-12T17:29:45.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.800+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f66a20 con 0x55efc7f4e220 2024-09-12T17:29:45.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.802+0000 7f2888621640 1 -- 172.21.15.170:0/3702380452 <== osd.3 v2:172.21.15.170:6816/2664906588 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'69 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2880073030 con 0x55efc7f4e220 2024-09-12T17:29:45.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.802+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f66a20 con 0x55efc7f49720 2024-09-12T17:29:45.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.803+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 <== osd.2 v2:172.21.15.170:6808/3855567754 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'39 uv32 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2878070040 con 0x55efc7f49720 2024-09-12T17:29:45.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.803+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f66a00 con 0x55efc7f4e220 2024-09-12T17:29:45.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.804+0000 7f2888621640 1 -- 172.21.15.170:0/3702380452 <== osd.3 v2:172.21.15.170:6816/2664906588 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2880073030 con 0x55efc7f4e220 2024-09-12T17:29:45.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.804+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f669d0 con 0x55efc7f4e220 2024-09-12T17:29:45.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.805+0000 7f2888621640 1 -- 172.21.15.170:0/3702380452 <== osd.3 v2:172.21.15.170:6816/2664906588 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2880073030 con 0x55efc7f4e220 2024-09-12T17:29:45.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.805+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f66940 con 0x55efc7f4e220 2024-09-12T17:29:45.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.805+0000 7f2888621640 1 -- 172.21.15.170:0/3702380452 <== osd.3 v2:172.21.15.170:6816/2664906588 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'24 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2880073030 con 0x55efc7f4e220 2024-09-12T17:29:45.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.805+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f66940 con 0x55efc7f4e220 2024-09-12T17:29:45.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.806+0000 7f2888621640 1 -- 172.21.15.170:0/3702380452 <== osd.3 v2:172.21.15.170:6816/2664906588 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'50 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2880073030 con 0x55efc7f4e220 2024-09-12T17:29:45.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.807+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f66940 con 0x7f2878033070 2024-09-12T17:29:45.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.808+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.808+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f66940 con 0x55efc7f4e220 2024-09-12T17:29:45.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.809+0000 7f2888621640 1 -- 172.21.15.170:0/3702380452 <== osd.3 v2:172.21.15.170:6816/2664906588 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2880073030 con 0x55efc7f4e220 2024-09-12T17:29:45.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.809+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f66940 con 0x7f2878033070 2024-09-12T17:29:45.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.810+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'50 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.810+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f66940 con 0x55efc7f4e220 2024-09-12T17:29:45.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.811+0000 7f2888621640 1 -- 172.21.15.170:0/3702380452 <== osd.3 v2:172.21.15.170:6816/2664906588 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'70 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2880073030 con 0x55efc7f4e220 2024-09-12T17:29:45.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.811+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f66940 con 0x7f2878033070 2024-09-12T17:29:45.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.813+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'56 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.813+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f66940 con 0x55efc7f49720 2024-09-12T17:29:45.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.814+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 <== osd.2 v2:172.21.15.170:6808/3855567754 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2878070040 con 0x55efc7f49720 2024-09-12T17:29:45.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.814+0000 7f273d7e2640 20 reqs_thread_entry: start 2024-09-12T17:29:45.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.814+0000 7f288c937800 20 init_complete bucket index max shards: 11 2024-09-12T17:29:45.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.814+0000 7f288c937800 20 Filter name: none 2024-09-12T17:29:45.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.814+0000 7f26aeffd640 20 reqs_thread_entry: start 2024-09-12T17:29:45.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.814+0000 7f288c937800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:29:45.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.814+0000 7f288c937800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.814+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f91470 con 0x55efc7f44d30 2024-09-12T17:29:45.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.815+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2870029040 con 0x55efc7f44d30 2024-09-12T17:29:45.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.815+0000 7f288c937800 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:29:45.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.815+0000 7f288c937800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T17:29:45.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.815+0000 7f288c937800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:29:45.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.815+0000 7f288c937800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:29:45.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.815+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f93da0 con 0x55efc7f49720 2024-09-12T17:29:45.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.815+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 <== osd.2 v2:172.21.15.170:6808/3855567754 21 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv43 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f2878070040 con 0x55efc7f49720 2024-09-12T17:29:45.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.815+0000 7f288c937800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7 : miss 2024-09-12T17:29:45.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.815+0000 7f288c937800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.815+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:96 8.8 8:1059e8e7:root::.bucket.meta.myfoo%3a7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f93a50 con 0x55efc7f44d30 2024-09-12T17:29:45.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.815+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(96 .bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f2870029040 con 0x55efc7f44d30 2024-09-12T17:29:45.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.816+0000 7f288c937800 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T17:29:45.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.816+0000 7f288c937800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7 info.flags=0x17 2024-09-12T17:29:45.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.816+0000 7f288c937800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7 to cache LRU end 2024-09-12T17:29:45.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.816+0000 7f288c937800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:29:45.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.816+0000 7f288c937800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:29:45.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.816+0000 7f288c937800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7 2024-09-12T17:29:45.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.816+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:97 4.3 4:c2d56f7c:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc8011010 con 0x55efc7f44d30 2024-09-12T17:29:45.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.816+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(97 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.0 [call out=89b] v0'0 uv23 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2870029040 con 0x55efc7f44d30 2024-09-12T17:29:45.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.816+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:98 4.2c 4:37f59190:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc8011090 con 0x55efc7f44d30 2024-09-12T17:29:45.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.816+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 30 ==== osd_op_reply(98 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2870029040 con 0x55efc7f44d30 2024-09-12T17:29:45.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.816+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:99 4.8 4:1246ca73:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc8011090 con 0x55efc7f4e220 2024-09-12T17:29:45.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.816+0000 7f2888621640 1 -- 172.21.15.170:0/3702380452 <== osd.3 v2:172.21.15.170:6816/2664906588 26 ==== osd_op_reply(99 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.2 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2880073030 con 0x55efc7f4e220 2024-09-12T17:29:45.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.817+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:100 4.9 4:9146d8d3:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc8011600 con 0x55efc7f44d30 2024-09-12T17:29:45.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.817+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 31 ==== osd_op_reply(100 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2870029040 con 0x55efc7f44d30 2024-09-12T17:29:45.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.817+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:101 4.2d 4:b6fbe136:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc8011600 con 0x7f2878033070 2024-09-12T17:29:45.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.818+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 23 ==== osd_op_reply(101 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.4 [call out=430b] v0'0 uv3 ondisk = 0) ==== 194+0+430 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.818+0000 7f288c937800 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-09-12T17:29:45.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.818+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:102 4.4 4:208fbbae:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc80115e0 con 0x7f2878033070 2024-09-12T17:29:45.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.818+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 24 ==== osd_op_reply(102 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.818+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:103 4.37 4:ecd1968e:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc80115e0 con 0x7f2878033070 2024-09-12T17:29:45.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.819+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 25 ==== osd_op_reply(103 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.819+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:104 4.17 4:e9433da8:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc80115e0 con 0x7f2878033070 2024-09-12T17:29:45.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.819+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 26 ==== osd_op_reply(104 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.7 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.819+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:105 4.29 4:94d4b88b:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc80115e0 con 0x55efc7f4e220 2024-09-12T17:29:45.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.819+0000 7f2888621640 1 -- 172.21.15.170:0/3702380452 <== osd.3 v2:172.21.15.170:6816/2664906588 27 ==== osd_op_reply(105 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.8 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2880073030 con 0x55efc7f4e220 2024-09-12T17:29:45.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.819+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:106 4.26 4:66cdb0cc:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc80115e0 con 0x7f2878033070 2024-09-12T17:29:45.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.820+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 27 ==== osd_op_reply(106 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.820+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:107 4.1a 4:5b107bef:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc80115e0 con 0x55efc7f49720 2024-09-12T17:29:45.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.820+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 <== osd.2 v2:172.21.15.170:6808/3855567754 22 ==== osd_op_reply(107 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.10 [call out=89b] v0'0 uv7 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f2878070040 con 0x55efc7f49720 2024-09-12T17:29:45.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.820+0000 7f288c937800 20 get_obj_state: octx=0x7f287803be90 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x55efc800f098 s->prefetch_data=0 2024-09-12T17:29:45.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.820+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:108 3.36 3:6db11520:::7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc800ff80 con 0x55efc7f49720 2024-09-12T17:29:45.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.821+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 <== osd.2 v2:172.21.15.170:6808/3855567754 23 ==== osd_op_reply(108 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7f2878070040 con 0x55efc7f49720 2024-09-12T17:29:45.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.821+0000 7f288c937800 10 manifest: total_size = 6 2024-09-12T17:29:45.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.821+0000 7f288c937800 20 get_obj_state: setting s->obj_tag to 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.12310206359599799944 2024-09-12T17:29:45.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.821+0000 7f288c937800 20 get_obj_state: octx=0x7f287803be90 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x55efc800f098 s->prefetch_data=0 2024-09-12T17:29:45.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.821+0000 7f288c937800 20 prepare_atomic_modification: state is not atomic. state=0x55efc800f098 2024-09-12T17:29:45.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.821+0000 7f288c937800 20 bucket index object: :.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.4 2024-09-12T17:29:45.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.821+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:109 4.2d 4:b6fbe136:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc80109c0 con 0x7f2878033070 2024-09-12T17:29:45.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.822+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 28 ==== osd_op_reply(109 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.4 [stat,call,call] v31'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.822+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:110 3.36 3:6db11520:::7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc80103d0 con 0x55efc7f49720 2024-09-12T17:29:45.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.823+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 <== osd.2 v2:172.21.15.170:6808/3855567754 24 ==== osd_op_reply(110 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7_15f6f8dc036519d7fe15b39338f6e5db [call] v31'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f2878070040 con 0x55efc7f49720 2024-09-12T17:29:45.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.823+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:111 4.2d 4:b6fbe136:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f98800 con 0x7f2878033070 2024-09-12T17:29:45.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.823+0000 7f288c937800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:29:45.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.823+0000 7f288c937800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:29:45.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.823+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:112 4.3 4:c2d56f7c:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f98800 con 0x55efc7f44d30 2024-09-12T17:29:45.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.823+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:113 4.2c 4:37f59190:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f9caf0 con 0x55efc7f44d30 2024-09-12T17:29:45.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.823+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:114 4.8 4:1246ca73:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f98800 con 0x55efc7f4e220 2024-09-12T17:29:45.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.823+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:115 4.9 4:9146d8d3:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f9caf0 con 0x55efc7f44d30 2024-09-12T17:29:45.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.823+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:116 4.2d 4:b6fbe136:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7fa3dd0 con 0x7f2878033070 2024-09-12T17:29:45.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.823+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:117 4.4 4:208fbbae:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7fa62a0 con 0x7f2878033070 2024-09-12T17:29:45.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.823+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:118 4.37 4:ecd1968e:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7fa8c40 con 0x7f2878033070 2024-09-12T17:29:45.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.823+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:119 4.17 4:e9433da8:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7fab620 con 0x7f2878033070 2024-09-12T17:29:45.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.824+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 32 ==== osd_op_reply(112 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.0 [call out=89b] v0'0 uv23 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2870029040 con 0x55efc7f44d30 2024-09-12T17:29:45.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.824+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 33 ==== osd_op_reply(115 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2870029040 con 0x55efc7f44d30 2024-09-12T17:29:45.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.824+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:120 4.29 4:94d4b88b:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7fabae0 con 0x55efc7f4e220 2024-09-12T17:29:45.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.824+0000 7f2888621640 1 -- 172.21.15.170:0/3702380452 <== osd.3 v2:172.21.15.170:6816/2664906588 28 ==== osd_op_reply(114 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.2 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2880073030 con 0x55efc7f4e220 2024-09-12T17:29:45.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.824+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:121 4.26 4:66cdb0cc:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7fac450 con 0x7f2878033070 2024-09-12T17:29:45.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.824+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 34 ==== osd_op_reply(113 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2870029040 con 0x55efc7f44d30 2024-09-12T17:29:45.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.824+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:122 4.1a 4:5b107bef:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f9f090 con 0x55efc7f49720 2024-09-12T17:29:45.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.824+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 29 ==== osd_op_reply(117 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.824+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 30 ==== osd_op_reply(118 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.824+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 31 ==== osd_op_reply(119 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.7 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.824+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 32 ==== osd_op_reply(121 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.824+0000 7f2888621640 1 -- 172.21.15.170:0/3702380452 <== osd.3 v2:172.21.15.170:6816/2664906588 29 ==== osd_op_reply(120 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.8 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2880073030 con 0x55efc7f4e220 2024-09-12T17:29:45.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.824+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 <== osd.2 v2:172.21.15.170:6808/3855567754 25 ==== osd_op_reply(122 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.10 [call out=89b] v0'0 uv7 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f2878070040 con 0x55efc7f49720 2024-09-12T17:29:45.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.824+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 33 ==== osd_op_reply(111 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.4 [stat,call,call] v31'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.824+0000 7f2766ffd640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-09-12T17:29:45.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.825+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 34 ==== osd_op_reply(116 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.4 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.825+0000 7f288c937800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:29:45.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.825+0000 7f288c937800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:29:45.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.825+0000 7f288c937800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:29:45.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.825+0000 7f288c937800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:29:45.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.825+0000 7f288c937800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7])"; uploads.size()=0; is_truncated=0 2024-09-12T17:29:45.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.825+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:123 4.3 4:c2d56f7c:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7fac430 con 0x55efc7f44d30 2024-09-12T17:29:45.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.825+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:124 4.2c 4:37f59190:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7fabac0 con 0x55efc7f44d30 2024-09-12T17:29:45.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.825+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:125 4.8 4:1246ca73:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f9a170 con 0x55efc7f4e220 2024-09-12T17:29:45.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.825+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:126 4.9 4:9146d8d3:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f9cf60 con 0x55efc7f44d30 2024-09-12T17:29:45.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.825+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:127 4.2d 4:b6fbe136:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7fac430 con 0x7f2878033070 2024-09-12T17:29:45.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.825+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:128 4.4 4:208fbbae:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7fa0d80 con 0x7f2878033070 2024-09-12T17:29:45.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.825+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:129 4.37 4:ecd1968e:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7fabac0 con 0x7f2878033070 2024-09-12T17:29:45.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.825+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:130 4.17 4:e9433da8:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f9a170 con 0x7f2878033070 2024-09-12T17:29:45.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.825+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:131 4.29 4:94d4b88b:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7fa0d80 con 0x55efc7f4e220 2024-09-12T17:29:45.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.825+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:132 4.26 4:66cdb0cc:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f98600 con 0x7f2878033070 2024-09-12T17:29:45.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.825+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:133 4.1a 4:5b107bef:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7fafea0 con 0x55efc7f49720 2024-09-12T17:29:45.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.825+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 35 ==== osd_op_reply(123 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.0 [call out=89b] v0'0 uv23 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2870029040 con 0x55efc7f44d30 2024-09-12T17:29:45.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.825+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 36 ==== osd_op_reply(124 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2870029040 con 0x55efc7f44d30 2024-09-12T17:29:45.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.825+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 37 ==== osd_op_reply(126 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2870029040 con 0x55efc7f44d30 2024-09-12T17:29:45.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.825+0000 7f2888621640 1 -- 172.21.15.170:0/3702380452 <== osd.3 v2:172.21.15.170:6816/2664906588 30 ==== osd_op_reply(125 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.2 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f28800a7070 con 0x55efc7f4e220 2024-09-12T17:29:45.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.825+0000 7f2888621640 1 -- 172.21.15.170:0/3702380452 <== osd.3 v2:172.21.15.170:6816/2664906588 31 ==== osd_op_reply(131 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.8 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f28800a7070 con 0x55efc7f4e220 2024-09-12T17:29:45.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.825+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 <== osd.2 v2:172.21.15.170:6808/3855567754 26 ==== osd_op_reply(133 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.10 [call out=89b] v0'0 uv7 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f2878070040 con 0x55efc7f49720 2024-09-12T17:29:45.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.825+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 35 ==== osd_op_reply(127 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.4 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.826+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 36 ==== osd_op_reply(128 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.826+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 37 ==== osd_op_reply(129 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.826+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 38 ==== osd_op_reply(130 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.7 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.826+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 39 ==== osd_op_reply(132 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.826+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f9a170 con 0x55efc7f49720 2024-09-12T17:29:45.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.827+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 <== osd.2 v2:172.21.15.170:6808/3855567754 27 ==== osd_op_reply(134 foo.buckets [call] v31'46 uv46 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f287807c040 con 0x55efc7f49720 2024-09-12T17:29:45.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.827+0000 7f288c937800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T17:29:45.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.827+0000 7f288c937800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.827+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f9a170 con 0x55efc7f49720 2024-09-12T17:29:45.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.827+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 <== osd.2 v2:172.21.15.170:6808/3855567754 28 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv40 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f287807c040 con 0x55efc7f49720 2024-09-12T17:29:45.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.827+0000 7f288c937800 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T17:29:45.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.827+0000 7f288c937800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-12T17:29:45.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.827+0000 7f288c937800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:29:45.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.827+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:136 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7fabac0 con 0x55efc7f49720 2024-09-12T17:29:45.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.828+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 <== osd.2 v2:172.21.15.170:6808/3855567754 29 ==== osd_op_reply(136 myfoo [call,call,delete] v31'47 uv47 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f287807c040 con 0x55efc7f49720 2024-09-12T17:29:45.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.828+0000 7f288c937800 10 removing default.rgw.meta+root+myfoo from cache 2024-09-12T17:29:45.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.828+0000 7f288c937800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-12T17:29:45.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.828+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94488340642496 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7faae40 con 0x7f2878033070 2024-09-12T17:29:45.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.828+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 40 ==== watch-notify(notify (1) cookie 94488340301408 notify 133143986221 ret 0) ==== 191+0+0 (crc 0 0 0) 0x55efc7f930b0 con 0x7f2878033070 2024-09-12T17:29:45.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.828+0000 7f27677fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986221 cookie 94488340301408 notifier 4778 bl.length()=149 2024-09-12T17:29:45.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.828+0000 7f27677fe640 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:138 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f274c003d60 con 0x7f2878033070 2024-09-12T17:29:45.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.828+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 41 ==== osd_op_reply(137 notify.6 [notify cookie 94488340642496 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.829+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 42 ==== osd_op_reply(138 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.829+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 43 ==== watch-notify(notify_complete (2) cookie 94488340642496 notify 133143986221 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55efc7f62dc0 con 0x7f2878033070 2024-09-12T17:29:45.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.829+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:139 8.8 8:1059e8e7:root::.bucket.meta.myfoo%3a7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7faae40 con 0x55efc7f44d30 2024-09-12T17:29:45.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.830+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 38 ==== osd_op_reply(139 .bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7 [call,call,delete] v31'8 uv8 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f2870029040 con 0x55efc7f44d30 2024-09-12T17:29:45.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.830+0000 7f288c937800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7 from cache 2024-09-12T17:29:45.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.830+0000 7f288c937800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7, ofs0, ns] 2024-09-12T17:29:45.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.830+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:140 7.9 7:93e5b521:::notify.7:head [notify cookie 94488340643712 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7fa9e30 con 0x7f2878033070 2024-09-12T17:29:45.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.830+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 44 ==== watch-notify(notify (1) cookie 94488340302672 notify 133143986222 ret 0) ==== 248+0+0 (crc 0 0 0) 0x55efc7f62dc0 con 0x7f2878033070 2024-09-12T17:29:45.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.830+0000 7f2766ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986222 cookie 94488340302672 notifier 4778 bl.length()=206 2024-09-12T17:29:45.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.830+0000 7f2766ffd640 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:141 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f26bc0032c0 con 0x7f2878033070 2024-09-12T17:29:45.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.830+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 45 ==== osd_op_reply(140 notify.7 [notify cookie 94488340643712 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.830+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 46 ==== osd_op_reply(141 notify.7 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.830+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 47 ==== watch-notify(notify_complete (2) cookie 94488340643712 notify 133143986222 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55efc7f5e730 con 0x7f2878033070 2024-09-12T17:29:45.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.830+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:142 4.3 4:c2d56f7c:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f93940 con 0x55efc7f44d30 2024-09-12T17:29:45.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.830+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:143 4.2c 4:37f59190:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f923f0 con 0x55efc7f44d30 2024-09-12T17:29:45.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.831+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:144 4.8 4:1246ca73:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7fa8e20 con 0x55efc7f4e220 2024-09-12T17:29:45.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.831+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:145 4.9 4:9146d8d3:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7fa9200 con 0x55efc7f44d30 2024-09-12T17:29:45.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.831+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:146 4.2d 4:b6fbe136:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f923f0 con 0x7f2878033070 2024-09-12T17:29:45.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.831+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:147 4.4 4:208fbbae:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7fa9f80 con 0x7f2878033070 2024-09-12T17:29:45.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.831+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:148 4.37 4:ecd1968e:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7faa880 con 0x7f2878033070 2024-09-12T17:29:45.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.831+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:149 4.17 4:e9433da8:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7fa9200 con 0x7f2878033070 2024-09-12T17:29:45.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.831+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:150 4.29 4:94d4b88b:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7fa68b0 con 0x55efc7f4e220 2024-09-12T17:29:45.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.831+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:151 4.26 4:66cdb0cc:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7fa7280 con 0x7f2878033070 2024-09-12T17:29:45.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.831+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:152 4.1a 4:5b107bef:::.dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f923f0 con 0x55efc7f49720 2024-09-12T17:29:45.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.832+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 <== osd.2 v2:172.21.15.170:6808/3855567754 30 ==== osd_op_reply(152 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.10 [delete] v31'10 uv10 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f287807c040 con 0x55efc7f49720 2024-09-12T17:29:45.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.832+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 48 ==== osd_op_reply(147 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.5 [delete] v31'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.832+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 49 ==== osd_op_reply(146 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.4 [delete] v31'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.832+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 39 ==== osd_op_reply(145 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.3 [delete] v31'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f2870029040 con 0x55efc7f44d30 2024-09-12T17:29:45.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.832+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 40 ==== osd_op_reply(142 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.0 [delete] v31'24 uv24 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f2870029040 con 0x55efc7f44d30 2024-09-12T17:29:45.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.832+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 41 ==== osd_op_reply(143 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.1 [delete] v31'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f2870029040 con 0x55efc7f44d30 2024-09-12T17:29:45.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.832+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 50 ==== osd_op_reply(151 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.9 [delete] v31'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.833+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 51 ==== osd_op_reply(148 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.6 [delete] v31'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.833+0000 7f2888621640 1 -- 172.21.15.170:0/3702380452 <== osd.3 v2:172.21.15.170:6816/2664906588 32 ==== osd_op_reply(144 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.2 [delete] v31'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f28800a7070 con 0x55efc7f4e220 2024-09-12T17:29:45.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.833+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 52 ==== osd_op_reply(149 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.7 [delete] v31'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.833+0000 7f2888621640 1 -- 172.21.15.170:0/3702380452 <== osd.3 v2:172.21.15.170:6816/2664906588 33 ==== osd_op_reply(150 .dir.7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7.8 [delete] v31'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f28800a7070 con 0x55efc7f4e220 2024-09-12T17:29:45.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.833+0000 7f288c937800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7 : miss 2024-09-12T17:29:45.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.833+0000 7f288c937800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.833+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:153 6.1a 6:5974a7f5:::pubsub..bucket.myfoo%2f7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7fa8e20 con 0x55efc7f4e220 2024-09-12T17:29:45.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.833+0000 7f2888621640 1 -- 172.21.15.170:0/3702380452 <== osd.3 v2:172.21.15.170:6816/2664906588 34 ==== osd_op_reply(153 pubsub..bucket.myfoo/7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f28800a7070 con 0x55efc7f4e220 2024-09-12T17:29:45.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.833+0000 7f288c937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.833+0000 7f288c937800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7 info.flags=0x0 2024-09-12T17:29:45.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.833+0000 7f288c937800 10 adding default.rgw.log++pubsub..bucket.myfoo/7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7 to cache LRU end 2024-09-12T17:29:45.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.833+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:154 6.1a 6:5974a7f5:::pubsub..bucket.myfoo%2f7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc8010280 con 0x55efc7f4e220 2024-09-12T17:29:45.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.834+0000 7f2888621640 1 -- 172.21.15.170:0/3702380452 <== osd.3 v2:172.21.15.170:6816/2664906588 35 ==== osd_op_reply(154 pubsub..bucket.myfoo/7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.7 [delete] v31'30 uv28 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f28800a7070 con 0x55efc7f4e220 2024-09-12T17:29:45.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.834+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:155 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc8010280 con 0x55efc7f49720 2024-09-12T17:29:45.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.835+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 <== osd.2 v2:172.21.15.170:6808/3855567754 31 ==== osd_op_reply(155 foo.buckets [call] v31'48 uv48 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f287807c040 con 0x55efc7f49720 2024-09-12T17:29:45.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.835+0000 7f288c937800 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-09-12T17:29:45.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.835+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:156 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc8010280 con 0x7f2878033070 2024-09-12T17:29:45.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.836+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 53 ==== osd_op_reply(156 9te6NH5mcdcq0Tc5i8i1 [delete] v31'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.836+0000 7f288c937800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-12T17:29:45.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.836+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:157 7.e 7:7759931f:::notify.3:head [notify cookie 94488340635184 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc8010280 con 0x55efc7f49720 2024-09-12T17:29:45.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.836+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 <== osd.2 v2:172.21.15.170:6808/3855567754 32 ==== watch-notify(notify (1) cookie 94488340289856 notify 133143986195 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55efc7f39c40 con 0x55efc7f49720 2024-09-12T17:29:45.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.836+0000 7f27677fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986195 cookie 94488340289856 notifier 4778 bl.length()=170 2024-09-12T17:29:45.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.836+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 <== osd.2 v2:172.21.15.170:6808/3855567754 33 ==== osd_op_reply(157 notify.3 [notify cookie 94488340635184 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f287807c040 con 0x55efc7f49720 2024-09-12T17:29:45.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.836+0000 7f27677fe640 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f274c003d60 con 0x55efc7f49720 2024-09-12T17:29:45.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.836+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 <== osd.2 v2:172.21.15.170:6808/3855567754 34 ==== osd_op_reply(158 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f287807c040 con 0x55efc7f49720 2024-09-12T17:29:45.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.836+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 <== osd.2 v2:172.21.15.170:6808/3855567754 35 ==== watch-notify(notify_complete (2) cookie 94488340635184 notify 133143986195 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55efc7f399b0 con 0x55efc7f49720 2024-09-12T17:29:45.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.836+0000 7f288c937800 10 removing email index: foo@foo.com 2024-09-12T17:29:45.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.836+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:159 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc8010280 con 0x55efc7f44d30 2024-09-12T17:29:45.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.837+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 42 ==== osd_op_reply(159 foo@foo.com [delete] v31'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f2870029040 con 0x55efc7f44d30 2024-09-12T17:29:45.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.837+0000 7f288c937800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-12T17:29:45.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.837+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:160 7.e 7:7759931f:::notify.3:head [notify cookie 94488340635184 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc8010280 con 0x55efc7f49720 2024-09-12T17:29:45.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.838+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 <== osd.2 v2:172.21.15.170:6808/3855567754 36 ==== watch-notify(notify (1) cookie 94488340289856 notify 133143986196 ret 0) ==== 204+0+0 (crc 0 0 0) 0x55efc7f399b0 con 0x55efc7f49720 2024-09-12T17:29:45.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.838+0000 7f2766ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986196 cookie 94488340289856 notifier 4778 bl.length()=162 2024-09-12T17:29:45.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.838+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 <== osd.2 v2:172.21.15.170:6808/3855567754 37 ==== osd_op_reply(160 notify.3 [notify cookie 94488340635184 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f287807c040 con 0x55efc7f49720 2024-09-12T17:29:45.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.838+0000 7f2766ffd640 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f26bc0032c0 con 0x55efc7f49720 2024-09-12T17:29:45.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.838+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 <== osd.2 v2:172.21.15.170:6808/3855567754 38 ==== osd_op_reply(161 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f287807c040 con 0x55efc7f49720 2024-09-12T17:29:45.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.838+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 <== osd.2 v2:172.21.15.170:6808/3855567754 39 ==== watch-notify(notify_complete (2) cookie 94488340635184 notify 133143986196 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55efc7f32830 con 0x55efc7f49720 2024-09-12T17:29:45.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.838+0000 7f288c937800 10 removing user buckets index 2024-09-12T17:29:45.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.838+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:162 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc8010280 con 0x55efc7f49720 2024-09-12T17:29:45.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.839+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 <== osd.2 v2:172.21.15.170:6808/3855567754 40 ==== osd_op_reply(162 foo.buckets [delete] v31'49 uv49 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f287807c040 con 0x55efc7f49720 2024-09-12T17:29:45.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.839+0000 7f288c937800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-09-12T17:29:45.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.839+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94488340635184 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc8010280 con 0x7f2878033070 2024-09-12T17:29:45.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.839+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 54 ==== watch-notify(notify (1) cookie 94488340296448 notify 133143986223 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55efc7f5e730 con 0x7f2878033070 2024-09-12T17:29:45.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.839+0000 7f27677fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986223 cookie 94488340296448 notifier 4778 bl.length()=160 2024-09-12T17:29:45.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.839+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 55 ==== osd_op_reply(163 notify.5 [notify cookie 94488340635184 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.839+0000 7f27677fe640 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f274c003d60 con 0x7f2878033070 2024-09-12T17:29:45.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.840+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 56 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.840+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 57 ==== watch-notify(notify_complete (2) cookie 94488340635184 notify 133143986223 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55efc7f5e520 con 0x7f2878033070 2024-09-12T17:29:45.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.840+0000 7f288c937800 10 removing user index: foo 2024-09-12T17:29:45.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.840+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:165 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc8010280 con 0x55efc7f44d30 2024-09-12T17:29:45.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.841+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 43 ==== osd_op_reply(165 foo [call,call,delete] v31'19 uv19 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f2870029040 con 0x55efc7f44d30 2024-09-12T17:29:45.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.841+0000 7f288c937800 10 removing default.rgw.meta+users.uid+foo from cache 2024-09-12T17:29:45.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.841+0000 7f288c937800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T17:29:45.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.841+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:166 7.d 7:b4812045:::notify.4:head [notify cookie 94488341053968 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f93910 con 0x55efc7f44d30 2024-09-12T17:29:45.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.841+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 44 ==== watch-notify(notify (1) cookie 94488340292576 notify 133143986194 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55efc7f5e520 con 0x55efc7f44d30 2024-09-12T17:29:45.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.841+0000 7f2766ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986194 cookie 94488340292576 notifier 4778 bl.length()=152 2024-09-12T17:29:45.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.841+0000 7f2766ffd640 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f26bc0032c0 con 0x55efc7f44d30 2024-09-12T17:29:45.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.841+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 45 ==== osd_op_reply(166 notify.4 [notify cookie 94488341053968 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2870029040 con 0x55efc7f44d30 2024-09-12T17:29:45.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.841+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 46 ==== osd_op_reply(167 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2870029040 con 0x55efc7f44d30 2024-09-12T17:29:45.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.841+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 47 ==== watch-notify(notify_complete (2) cookie 94488341053968 notify 133143986194 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55efc7f65180 con 0x55efc7f44d30 2024-09-12T17:29:45.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.842+0000 7f273e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:45.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.842+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:168 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94488340303728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc8010210 con 0x55efc7f44d30 2024-09-12T17:29:45.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.843+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 48 ==== osd_op_reply(168 data_loggenerations_metadata [watch unwatch cookie 94488340303728] v31'237 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2870029040 con 0x55efc7f44d30 2024-09-12T17:29:45.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.843+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:169 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94488340279712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc8010210 con 0x55efc7f49720 2024-09-12T17:29:45.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.844+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 <== osd.2 v2:172.21.15.170:6808/3855567754 41 ==== osd_op_reply(169 notify.0 [watch unwatch cookie 94488340279712] v31'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f287807c040 con 0x55efc7f49720 2024-09-12T17:29:45.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.844+0000 7f288c937800 20 remove_watcher() i=0 2024-09-12T17:29:45.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.844+0000 7f288c937800 2 removed watcher, disabling cache 2024-09-12T17:29:45.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.844+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:170 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94488340283568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f531a0 con 0x55efc7f44d30 2024-09-12T17:29:45.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.845+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 49 ==== osd_op_reply(170 notify.1 [watch unwatch cookie 94488340283568] v31'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2870029040 con 0x55efc7f44d30 2024-09-12T17:29:45.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.845+0000 7f288c937800 20 remove_watcher() i=1 2024-09-12T17:29:45.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.845+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:171 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94488340287520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f531a0 con 0x55efc7f4e220 2024-09-12T17:29:45.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.847+0000 7f2888621640 1 -- 172.21.15.170:0/3702380452 <== osd.3 v2:172.21.15.170:6816/2664906588 36 ==== osd_op_reply(171 notify.2 [watch unwatch cookie 94488340287520] v31'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28800a7070 con 0x55efc7f4e220 2024-09-12T17:29:45.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.847+0000 7f288c937800 20 remove_watcher() i=2 2024-09-12T17:29:45.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.847+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:172 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94488340289856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f540b0 con 0x55efc7f49720 2024-09-12T17:29:45.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.847+0000 7f2888e22640 1 -- 172.21.15.170:0/3702380452 <== osd.2 v2:172.21.15.170:6808/3855567754 42 ==== osd_op_reply(172 notify.3 [watch unwatch cookie 94488340289856] v31'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f287807c040 con 0x55efc7f49720 2024-09-12T17:29:45.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.848+0000 7f288c937800 20 remove_watcher() i=3 2024-09-12T17:29:45.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.848+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:173 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94488340292576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f540b0 con 0x55efc7f44d30 2024-09-12T17:29:45.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.849+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.1 v2:172.21.15.170:6800/1903654092 50 ==== osd_op_reply(173 notify.4 [watch unwatch cookie 94488340292576] v31'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2870029040 con 0x55efc7f44d30 2024-09-12T17:29:45.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.849+0000 7f288c937800 20 remove_watcher() i=4 2024-09-12T17:29:45.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.849+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:174 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94488340296448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f563e0 con 0x7f2878033070 2024-09-12T17:29:45.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.850+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 58 ==== osd_op_reply(174 notify.5 [watch unwatch cookie 94488340296448] v31'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.850+0000 7f288c937800 20 remove_watcher() i=5 2024-09-12T17:29:45.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.850+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:175 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94488340301408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f57300 con 0x7f2878033070 2024-09-12T17:29:45.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.850+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 59 ==== osd_op_reply(175 notify.6 [watch unwatch cookie 94488340301408] v31'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.851+0000 7f288c937800 20 remove_watcher() i=6 2024-09-12T17:29:45.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.851+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:176 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94488340302672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55efc7f563e0 con 0x7f2878033070 2024-09-12T17:29:45.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.852+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 <== osd.0 v2:172.21.15.47:6800/3978157098 60 ==== osd_op_reply(176 notify.7 [watch unwatch cookie 94488340302672] v31'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2870029040 con 0x7f2878033070 2024-09-12T17:29:45.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.852+0000 7f288c937800 20 remove_watcher() i=7 2024-09-12T17:29:45.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.852+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f2878033070 msgr2=0x7f2878056a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.852+0000 7f288c937800 1 --2- 172.21.15.170:0/3702380452 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f2878033070 0x7f2878056a80 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.852+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55efc7f44d30 msgr2=0x55efc7f471f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.852+0000 7f288c937800 1 --2- 172.21.15.170:0/3702380452 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55efc7f44d30 0x55efc7f471f0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.852+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55efc7f49720 msgr2=0x55efc7f4bb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.852+0000 7f288c937800 1 --2- 172.21.15.170:0/3702380452 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55efc7f49720 0x55efc7f4bb10 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.852+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55efc7f4e220 msgr2=0x55efc7f506e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.852+0000 7f288c937800 1 --2- 172.21.15.170:0/3702380452 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55efc7f4e220 0x55efc7f506e0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.852+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f275803c730 msgr2=0x7f275803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.852+0000 7f288c937800 1 --2- 172.21.15.170:0/3702380452 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f275803c730 0x7f275803ebf0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2880001eb0 tx=0x7f288007f000 comp rx=0 tx=0).stop 2024-09-12T17:29:45.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.852+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efc7f31e40 msgr2=0x55efc7f39450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.852+0000 7f2887e20640 1 -- 172.21.15.170:0/3702380452 reap_dead start 2024-09-12T17:29:45.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.852+0000 7f288c937800 1 --2- 172.21.15.170:0/3702380452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efc7f31e40 0x55efc7f39450 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f287801fef0 tx=0x7f2878053d00 comp rx=0 tx=0).stop 2024-09-12T17:29:45.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.852+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 shutdown_connections 2024-09-12T17:29:45.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.852+0000 7f288c937800 1 --2- 172.21.15.170:0/3702380452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efc7f31e40 0x55efc7f39450 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.852+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 >> 172.21.15.170:0/3702380452 conn(0x55efc7f2e240 msgr2=0x55efc7f2c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:45.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.852+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 shutdown_connections 2024-09-12T17:29:45.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.852+0000 7f288c937800 1 -- 172.21.15.170:0/3702380452 wait complete. 2024-09-12T17:29:45.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.852+0000 7f288c937800 1 -- 172.21.15.170:0/1897305403 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f276003c730 msgr2=0x7f276003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.852+0000 7f288c937800 1 --2- 172.21.15.170:0/1897305403 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f276003c730 0x7f276003ebf0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x55efc7f10020 tx=0x7f288006af60 comp rx=0 tx=0).stop 2024-09-12T17:29:45.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.852+0000 7f288c937800 1 -- 172.21.15.170:0/1897305403 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efc7e10ee0 msgr2=0x55efc7e0f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.852+0000 7f288c937800 1 --2- 172.21.15.170:0/1897305403 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efc7e10ee0 0x55efc7e0f750 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x55efc7f08fc0 tx=0x7f28780167b0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.852+0000 7f288c937800 1 -- 172.21.15.170:0/1897305403 shutdown_connections 2024-09-12T17:29:45.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.852+0000 7f288c937800 1 --2- 172.21.15.170:0/1897305403 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f276003c730 0x7f276003ebf0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.852+0000 7f288c937800 1 --2- 172.21.15.170:0/1897305403 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efc7e10ee0 0x55efc7e0f750 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.853+0000 7f288c937800 1 -- 172.21.15.170:0/1897305403 >> 172.21.15.170:0/1897305403 conn(0x55efc7f175a0 msgr2=0x55efc7f17980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:45.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.853+0000 7f288c937800 1 -- 172.21.15.170:0/1897305403 shutdown_connections 2024-09-12T17:29:45.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.853+0000 7f288c937800 1 -- 172.21.15.170:0/1897305403 wait complete. 2024-09-12T17:29:45.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.853+0000 7f288c937800 1 -- 172.21.15.170:0/700655787 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55efc7f09cb0 msgr2=0x55efc7f0f610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.853+0000 7f288c937800 1 --2- 172.21.15.170:0/700655787 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55efc7f09cb0 0x55efc7f0f610 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.853+0000 7f288c937800 1 -- 172.21.15.170:0/700655787 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55efc7f11ea0 msgr2=0x55efc7f14290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.853+0000 7f288c937800 1 --2- 172.21.15.170:0/700655787 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55efc7f11ea0 0x55efc7f14290 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.853+0000 7f288c937800 1 -- 172.21.15.170:0/700655787 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f277003c780 msgr2=0x7f277003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.853+0000 7f288c937800 1 --2- 172.21.15.170:0/700655787 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f277003c780 0x7f277003ec40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2870001db0 tx=0x7f2870001310 comp rx=0 tx=0).stop 2024-09-12T17:29:45.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.853+0000 7f288c937800 1 -- 172.21.15.170:0/700655787 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efc7e14070 msgr2=0x55efc7f07fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.853+0000 7f288c937800 1 --2- 172.21.15.170:0/700655787 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efc7e14070 0x55efc7f07fc0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f2880025b20 tx=0x7f2880002fb0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.853+0000 7f288c937800 1 -- 172.21.15.170:0/700655787 shutdown_connections 2024-09-12T17:29:45.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.853+0000 7f288c937800 1 --2- 172.21.15.170:0/700655787 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55efc7f11ea0 0x55efc7f14290 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.853+0000 7f288c937800 1 --2- 172.21.15.170:0/700655787 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f277003c780 0x7f277003ec40 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.853+0000 7f288c937800 1 --2- 172.21.15.170:0/700655787 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55efc7f09cb0 0x55efc7f0f610 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.853+0000 7f288c937800 1 --2- 172.21.15.170:0/700655787 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efc7e14070 0x55efc7f07fc0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.853+0000 7f288c937800 1 -- 172.21.15.170:0/700655787 >> 172.21.15.170:0/700655787 conn(0x55efc7e0b200 msgr2=0x55efc7f016f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:45.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.853+0000 7f288c937800 1 -- 172.21.15.170:0/700655787 shutdown_connections 2024-09-12T17:29:45.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.853+0000 7f288c937800 1 -- 172.21.15.170:0/700655787 wait complete. 2024-09-12T17:29:45.884 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-12T17:29:45.884 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-12T17:29:45.884 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-12T17:29:45.928 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:29:45.929 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:29:45.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.928+0000 7f4cc8e11800 1 Processor -- start 2024-09-12T17:29:45.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.928+0000 7f4cc8e11800 1 -- start start 2024-09-12T17:29:45.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.928+0000 7f4cc8e11800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5622873cedf0 0x5622873cfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.928+0000 7f4cc8e11800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562287279e40 con 0x5622873d0030 2024-09-12T17:29:45.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.928+0000 7f4cc8e11800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x562287244680 con 0x5622873cedf0 2024-09-12T17:29:45.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.928+0000 7f4cc4522640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5622873cedf0 0x5622873cfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.928+0000 7f4cbbfff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x5622873d0030 0x5622873d4d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:44818/0 (socket says 172.21.15.170:44818) 2024-09-12T17:29:45.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.928+0000 7f4cc4522640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5622873cedf0 0x5622873cfaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34500/0 (socket says 172.21.15.170:34500) 2024-09-12T17:29:45.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.928+0000 7f4cbbfff640 1 -- 172.21.15.170:0/2919726080 learned_addr learned my addr 172.21.15.170:0/2919726080 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:29:45.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.929+0000 7f4cc4522640 1 -- 172.21.15.170:0/2919726080 >> v1:172.21.15.47:6789/0 conn(0x5622873d0030 legacy=0x5622873d4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.929+0000 7f4cc4522640 1 -- 172.21.15.170:0/2919726080 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622872606b0 con 0x5622873cedf0 2024-09-12T17:29:45.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.931+0000 7f4cc4522640 1 --2- 172.21.15.170:0/2919726080 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622873cedf0 0x5622873cfaf0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f4cb400a470 tx=0x7f4cb4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc11fb4ad0cd76e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.931+0000 7f4cc3d21640 1 -- 172.21.15.170:0/2919726080 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cb4053570 con 0x5622873cedf0 2024-09-12T17:29:45.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.931+0000 7f4cc3d21640 1 -- 172.21.15.170:0/2919726080 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cb4058070 con 0x5622873cedf0 2024-09-12T17:29:45.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.931+0000 7f4cc3d21640 1 -- 172.21.15.170:0/2919726080 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cb4053880 con 0x5622873cedf0 2024-09-12T17:29:45.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.931+0000 7f4cc8e11800 1 -- 172.21.15.170:0/2919726080 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622873cedf0 msgr2=0x5622873cfaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.931+0000 7f4cc8e11800 1 --2- 172.21.15.170:0/2919726080 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622873cedf0 0x5622873cfaf0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f4cb400a470 tx=0x7f4cb4045a20 comp rx=0 tx=0).stop 2024-09-12T17:29:45.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.931+0000 7f4cc8e11800 1 -- 172.21.15.170:0/2919726080 shutdown_connections 2024-09-12T17:29:45.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.931+0000 7f4cc8e11800 1 --2- 172.21.15.170:0/2919726080 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622873cedf0 0x5622873cfaf0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.931+0000 7f4cc8e11800 1 -- 172.21.15.170:0/2919726080 >> 172.21.15.170:0/2919726080 conn(0x5622873ca1c0 msgr2=0x5622873cc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:45.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.931+0000 7f4cc8e11800 1 -- 172.21.15.170:0/2919726080 shutdown_connections 2024-09-12T17:29:45.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.931+0000 7f4cc8e11800 1 -- 172.21.15.170:0/2919726080 wait complete. 2024-09-12T17:29:45.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.945+0000 7f4cc8e11800 1 Processor -- start 2024-09-12T17:29:45.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.945+0000 7f4cc8e11800 1 -- start start 2024-09-12T17:29:45.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.945+0000 7f4cc8e11800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622873cedf0 0x5622874bb190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.945+0000 7f4cc8e11800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562287268dd0 con 0x5622873cedf0 2024-09-12T17:29:45.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.946+0000 7f4cc4522640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622873cedf0 0x5622874bb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.946+0000 7f4cc4522640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622873cedf0 0x5622874bb190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34514/0 (socket says 172.21.15.170:34514) 2024-09-12T17:29:45.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.946+0000 7f4cc4522640 1 -- 172.21.15.170:0/4107044270 learned_addr learned my addr 172.21.15.170:0/4107044270 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:45.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.946+0000 7f4cc4522640 1 -- 172.21.15.170:0/4107044270 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562287281e10 con 0x5622873cedf0 2024-09-12T17:29:45.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.946+0000 7f4cc4522640 1 --2- 172.21.15.170:0/4107044270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622873cedf0 0x5622874bb190 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4025c20 tx=0x7f4cb4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d21e2e71ae80e953 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.946+0000 7f4bb260c640 1 -- 172.21.15.170:0/4107044270 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cb4053a20 con 0x5622873cedf0 2024-09-12T17:29:45.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.946+0000 7f4bb260c640 1 -- 172.21.15.170:0/4107044270 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cb4063070 con 0x5622873cedf0 2024-09-12T17:29:45.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.946+0000 7f4bb260c640 1 -- 172.21.15.170:0/4107044270 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cb4053cf0 con 0x5622873cedf0 2024-09-12T17:29:45.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.947+0000 7f4cc8e11800 1 -- 172.21.15.170:0/4107044270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622873cedf0 msgr2=0x5622874bb190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.947+0000 7f4cc8e11800 1 --2- 172.21.15.170:0/4107044270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622873cedf0 0x5622874bb190 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4025c20 tx=0x7f4cb4051000 comp rx=0 tx=0).stop 2024-09-12T17:29:45.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.947+0000 7f4cc8e11800 1 -- 172.21.15.170:0/4107044270 shutdown_connections 2024-09-12T17:29:45.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.947+0000 7f4cc8e11800 1 --2- 172.21.15.170:0/4107044270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622873cedf0 0x5622874bb190 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.947+0000 7f4cc8e11800 1 -- 172.21.15.170:0/4107044270 >> 172.21.15.170:0/4107044270 conn(0x5622873ca1c0 msgr2=0x5622874bda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:45.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.947+0000 7f4cc8e11800 1 -- 172.21.15.170:0/4107044270 shutdown_connections 2024-09-12T17:29:45.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.947+0000 7f4cc8e11800 1 -- 172.21.15.170:0/4107044270 wait complete. 2024-09-12T17:29:45.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.947+0000 7f4cc8e11800 1 Processor -- start 2024-09-12T17:29:45.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.947+0000 7f4cc8e11800 1 -- start start 2024-09-12T17:29:45.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.948+0000 7f4cc8e11800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622873cedf0 0x5622874c9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.948+0000 7f4cc8e11800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5622873d0720 con 0x5622873cedf0 2024-09-12T17:29:45.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.948+0000 7f4cc4522640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622873cedf0 0x5622874c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.948+0000 7f4cc4522640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622873cedf0 0x5622874c9120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34518/0 (socket says 172.21.15.170:34518) 2024-09-12T17:29:45.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.948+0000 7f4cc4522640 1 -- 172.21.15.170:0/4037685334 learned_addr learned my addr 172.21.15.170:0/4037685334 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:45.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.948+0000 7f4cc4522640 1 -- 172.21.15.170:0/4037685334 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622874c9680 con 0x5622873cedf0 2024-09-12T17:29:45.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.948+0000 7f4cc4522640 1 --2- 172.21.15.170:0/4037685334 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622873cedf0 0x5622874c9120 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4025c20 tx=0x7f4cb4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.948+0000 7f4bb0e09640 1 -- 172.21.15.170:0/4037685334 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cb4068660 con 0x5622873cedf0 2024-09-12T17:29:45.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.948+0000 7f4bb0e09640 1 -- 172.21.15.170:0/4037685334 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cb4068800 con 0x5622873cedf0 2024-09-12T17:29:45.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.948+0000 7f4cc8e11800 1 -- 172.21.15.170:0/4037685334 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5622874c9910 con 0x5622873cedf0 2024-09-12T17:29:45.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.948+0000 7f4bb0e09640 1 -- 172.21.15.170:0/4037685334 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cb4068ae0 con 0x5622873cedf0 2024-09-12T17:29:45.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.948+0000 7f4cc8e11800 1 -- 172.21.15.170:0/4037685334 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622874ca520 con 0x5622873cedf0 2024-09-12T17:29:45.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.949+0000 7f4bb0e09640 1 -- 172.21.15.170:0/4037685334 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f4cb4068c80 con 0x5622873cedf0 2024-09-12T17:29:45.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.949+0000 7f4bb0e09640 1 --2- 172.21.15.170:0/4037685334 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f4bac03c780 0x7f4bac03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.949+0000 7f4bb0e09640 1 -- 172.21.15.170:0/4037685334 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f4cb4098200 con 0x5622873cedf0 2024-09-12T17:29:45.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.950+0000 7f4cbbfff640 1 --2- 172.21.15.170:0/4037685334 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f4bac03c780 0x7f4bac03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.950+0000 7f4cc8e11800 1 --2- 172.21.15.170:0/4037685334 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5622873d0030 0x5622874d0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.950+0000 7f4cc8e11800 1 -- 172.21.15.170:0/4037685334 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622874d0cb0 con 0x5622873d0030 2024-09-12T17:29:45.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.950+0000 7f4cc4d23640 1 --2- 172.21.15.170:0/4037685334 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5622873d0030 0x5622874d0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.950+0000 7f4cbbfff640 1 --2- 172.21.15.170:0/4037685334 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f4bac03c780 0x7f4bac03ec40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4cac004170 tx=0x7f4cac001330 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.950+0000 7f4cc4d23640 1 --2- 172.21.15.170:0/4037685334 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5622873d0030 0x5622874d0770 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.950+0000 7f4cc4d23640 1 -- 172.21.15.170:0/4037685334 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4cbc00a4d0 con 0x5622873d0030 2024-09-12T17:29:45.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.950+0000 7f4cc8e11800 1 -- 172.21.15.170:0/4037685334 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622874d1050 con 0x5622873d0030 2024-09-12T17:29:45.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.951+0000 7f4cc4d23640 1 -- 172.21.15.170:0/4037685334 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4cbc00a4d0 con 0x5622873d0030 2024-09-12T17:29:45.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.951+0000 7f4cc8e11800 1 --2- 172.21.15.170:0/4037685334 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5622874d2ad0 0x5622874d4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.951+0000 7f4cc8e11800 1 -- 172.21.15.170:0/4037685334 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622874d5700 con 0x5622874d2ad0 2024-09-12T17:29:45.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.951+0000 7f4cc4522640 1 --2- 172.21.15.170:0/4037685334 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5622874d2ad0 0x5622874d4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.951+0000 7f4cc4522640 1 --2- 172.21.15.170:0/4037685334 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5622874d2ad0 0x5622874d4f70 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.951+0000 7f4cc4522640 1 -- 172.21.15.170:0/4037685334 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4cb4051070 con 0x5622874d2ad0 2024-09-12T17:29:45.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.951+0000 7f4cc8e11800 1 -- 172.21.15.170:0/4037685334 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622874d18a0 con 0x5622873d0030 2024-09-12T17:29:45.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.952+0000 7f4cc4d23640 1 -- 172.21.15.170:0/4037685334 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4cbc00a4d0 con 0x5622873d0030 2024-09-12T17:29:45.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.952+0000 7f4cc8e11800 1 -- 172.21.15.170:0/4037685334 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622874d1c80 con 0x5622874d2ad0 2024-09-12T17:29:45.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.952+0000 7f4cc4522640 1 -- 172.21.15.170:0/4037685334 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4cb4051070 con 0x5622874d2ad0 2024-09-12T17:29:45.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.952+0000 7f4cc8e11800 1 Processor -- start 2024-09-12T17:29:45.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.952+0000 7f4cc8e11800 1 -- start start 2024-09-12T17:29:45.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.952+0000 7f4cc8e11800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622874e3f90 0x5622874e43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.952+0000 7f4cc8e11800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5622872c6a00 con 0x5622874e3f90 2024-09-12T17:29:45.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.953+0000 7f4cc4d23640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622874e3f90 0x5622874e43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.953+0000 7f4cc4d23640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622874e3f90 0x5622874e43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34532/0 (socket says 172.21.15.170:34532) 2024-09-12T17:29:45.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.953+0000 7f4cc4d23640 1 -- 172.21.15.170:0/1496386075 learned_addr learned my addr 172.21.15.170:0/1496386075 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:45.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.953+0000 7f4cc4d23640 1 -- 172.21.15.170:0/1496386075 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622874e49f0 con 0x5622874e3f90 2024-09-12T17:29:45.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.953+0000 7f4cc4d23640 1 --2- 172.21.15.170:0/1496386075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622874e3f90 0x5622874e43b0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x5622874ca120 tx=0x7f4cbc0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.953+0000 7f4ba9ffb640 1 -- 172.21.15.170:0/1496386075 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cbc021570 con 0x5622874e3f90 2024-09-12T17:29:45.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.953+0000 7f4ba9ffb640 1 -- 172.21.15.170:0/1496386075 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cbc021710 con 0x5622874e3f90 2024-09-12T17:29:45.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.953+0000 7f4cc8e11800 1 -- 172.21.15.170:0/1496386075 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5622874e5220 con 0x5622874e3f90 2024-09-12T17:29:45.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.953+0000 7f4ba9ffb640 1 -- 172.21.15.170:0/1496386075 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cbc0219f0 con 0x5622874e3f90 2024-09-12T17:29:45.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.953+0000 7f4cc8e11800 1 -- 172.21.15.170:0/1496386075 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622874e57c0 con 0x5622874e3f90 2024-09-12T17:29:45.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.954+0000 7f4ba9ffb640 1 -- 172.21.15.170:0/1496386075 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f4cbc011040 con 0x5622874e3f90 2024-09-12T17:29:45.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.954+0000 7f4ba9ffb640 1 --2- 172.21.15.170:0/1496386075 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f4b9c03c730 0x7f4b9c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.954+0000 7f4ba9ffb640 1 -- 172.21.15.170:0/1496386075 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f4cbc00e040 con 0x5622874e3f90 2024-09-12T17:29:45.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.954+0000 7f4cc4522640 1 --2- 172.21.15.170:0/1496386075 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f4b9c03c730 0x7f4b9c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.955+0000 7f4cc8e11800 1 Processor -- start 2024-09-12T17:29:45.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.955+0000 7f4cc4522640 1 --2- 172.21.15.170:0/1496386075 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f4b9c03c730 0x7f4b9c03ebf0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x5622874cb1e0 tx=0x7f4cb4045e60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.955+0000 7f4cc8e11800 1 -- start start 2024-09-12T17:29:45.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.955+0000 7f4cc8e11800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622874f0a70 0x5622874f0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.955+0000 7f4cc8e11800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5622874b9a30 con 0x5622874f0a70 2024-09-12T17:29:45.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.955+0000 7f4cc4d23640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622874f0a70 0x5622874f0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.955+0000 7f4cc4d23640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622874f0a70 0x5622874f0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34538/0 (socket says 172.21.15.170:34538) 2024-09-12T17:29:45.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.955+0000 7f4cc4d23640 1 -- 172.21.15.170:0/3233395193 learned_addr learned my addr 172.21.15.170:0/3233395193 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:45.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.955+0000 7f4cc4d23640 1 -- 172.21.15.170:0/3233395193 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622874f1460 con 0x5622874f0a70 2024-09-12T17:29:45.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.956+0000 7f4cc4d23640 1 --2- 172.21.15.170:0/3233395193 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622874f0a70 0x5622874f0e70 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc053dc0 tx=0x7f4cbc054090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eae14f63b0c4a053 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.956+0000 7f4ba37fe640 1 -- 172.21.15.170:0/3233395193 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cbc01fa30 con 0x5622874f0a70 2024-09-12T17:29:45.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.956+0000 7f4ba37fe640 1 -- 172.21.15.170:0/3233395193 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cbc051030 con 0x5622874f0a70 2024-09-12T17:29:45.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.956+0000 7f4ba37fe640 1 -- 172.21.15.170:0/3233395193 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cbc021b90 con 0x5622874f0a70 2024-09-12T17:29:45.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.956+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3233395193 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622874f0a70 msgr2=0x5622874f0e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:45.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.956+0000 7f4cc8e11800 1 --2- 172.21.15.170:0/3233395193 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622874f0a70 0x5622874f0e70 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc053dc0 tx=0x7f4cbc054090 comp rx=0 tx=0).stop 2024-09-12T17:29:45.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.956+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3233395193 shutdown_connections 2024-09-12T17:29:45.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.956+0000 7f4cc8e11800 1 --2- 172.21.15.170:0/3233395193 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622874f0a70 0x5622874f0e70 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:45.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.956+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3233395193 >> 172.21.15.170:0/3233395193 conn(0x5622874ece70 msgr2=0x5622874eb0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:45.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.956+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3233395193 shutdown_connections 2024-09-12T17:29:45.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.956+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3233395193 wait complete. 2024-09-12T17:29:45.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.957+0000 7f4cc8e11800 1 Processor -- start 2024-09-12T17:29:45.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.957+0000 7f4cc8e11800 1 -- start start 2024-09-12T17:29:45.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.957+0000 7f4cc8e11800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622874f0a70 0x5622874f8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.957+0000 7f4cc8e11800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5622874f1a80 con 0x5622874f0a70 2024-09-12T17:29:45.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.957+0000 7f4cc4d23640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622874f0a70 0x5622874f8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.957+0000 7f4cc4d23640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622874f0a70 0x5622874f8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34540/0 (socket says 172.21.15.170:34540) 2024-09-12T17:29:45.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.957+0000 7f4cc4d23640 1 -- 172.21.15.170:0/3367716844 learned_addr learned my addr 172.21.15.170:0/3367716844 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:45.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.957+0000 7f4cc4d23640 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622874f85a0 con 0x5622874f0a70 2024-09-12T17:29:45.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.958+0000 7f4cc4d23640 1 --2- 172.21.15.170:0/3367716844 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622874f0a70 0x5622874f8040 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc053dc0 tx=0x7f4cbc053d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.958+0000 7f4ba1ffb640 1 -- 172.21.15.170:0/3367716844 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cbc01f340 con 0x5622874f0a70 2024-09-12T17:29:45.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.958+0000 7f4ba1ffb640 1 -- 172.21.15.170:0/3367716844 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cbc01f520 con 0x5622874f0a70 2024-09-12T17:29:45.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.958+0000 7f4ba1ffb640 1 -- 172.21.15.170:0/3367716844 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cbc029ab0 con 0x5622874f0a70 2024-09-12T17:29:45.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.958+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5622874f8830 con 0x5622874f0a70 2024-09-12T17:29:45.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.958+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622874f8830 con 0x5622874f0a70 2024-09-12T17:29:45.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.958+0000 7f4ba1ffb640 1 -- 172.21.15.170:0/3367716844 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f4cbc0143c0 con 0x5622874f0a70 2024-09-12T17:29:45.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.959+0000 7f4ba1ffb640 1 --2- 172.21.15.170:0/3367716844 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f4b9403c730 0x7f4b9403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.959+0000 7f4ba1ffb640 1 -- 172.21.15.170:0/3367716844 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f4cbc055070 con 0x5622874f0a70 2024-09-12T17:29:45.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.959+0000 7f4cc4522640 1 --2- 172.21.15.170:0/3367716844 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f4b9403c730 0x7f4b9403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.959+0000 7f4cc4522640 1 --2- 172.21.15.170:0/3367716844 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f4b9403c730 0x7f4b9403ebf0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4cb405dac0 tx=0x7f4cb4089000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.959+0000 7f4cc8e11800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.959+0000 7f4cc8e11800 1 --2- 172.21.15.170:0/3367716844 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x562287503710 0x562287505bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.959+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562287506320 con 0x562287503710 2024-09-12T17:29:45.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.959+0000 7f4cbbfff640 1 --2- 172.21.15.170:0/3367716844 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x562287503710 0x562287505bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.960+0000 7f4cbbfff640 1 --2- 172.21.15.170:0/3367716844 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x562287503710 0x562287505bd0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.960+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4cac009050 con 0x562287503710 2024-09-12T17:29:45.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.960+0000 7f4cc8e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.960+0000 7f4cc8e11800 20 realm 2024-09-12T17:29:45.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.960+0000 7f4cc8e11800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.960+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562287502a60 con 0x562287503710 2024-09-12T17:29:45.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.960+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4cac009050 con 0x562287503710 2024-09-12T17:29:45.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.960+0000 7f4cc8e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.960+0000 7f4cc8e11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:29:45.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.960+0000 7f4cc8e11800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.960+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562287506e00 con 0x562287503710 2024-09-12T17:29:45.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.960+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4cac009050 con 0x562287503710 2024-09-12T17:29:45.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.960+0000 7f4cc8e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.960+0000 7f4cc8e11800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.960+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5622875076d0 con 0x562287503710 2024-09-12T17:29:45.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.961+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4cac009050 con 0x562287503710 2024-09-12T17:29:45.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.961+0000 7f4cc8e11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:45.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.961+0000 7f4cc8e11800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.961+0000 7f4cc8e11800 1 --2- 172.21.15.170:0/3367716844 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x562287507f80 0x56228750a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.961+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56228750aad0 con 0x562287507f80 2024-09-12T17:29:45.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.961+0000 7f4cc4d23640 1 --2- 172.21.15.170:0/3367716844 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x562287507f80 0x56228750a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.961+0000 7f4cc4d23640 1 --2- 172.21.15.170:0/3367716844 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x562287507f80 0x56228750a370 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.961+0000 7f4cc4d23640 1 -- 172.21.15.170:0/3367716844 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4cbc039020 con 0x562287507f80 2024-09-12T17:29:45.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.961+0000 7f4cc8e11800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:29:45.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.961+0000 7f4cc8e11800 20 searching for the correct realm 2024-09-12T17:29:45.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.961+0000 7f4cc8e11800 1 --2- 172.21.15.170:0/3367716844 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x56228750cbd0 0x56228750f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.961+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56228750f760 con 0x56228750cbd0 2024-09-12T17:29:45.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.961+0000 7f4cc4522640 1 --2- 172.21.15.170:0/3367716844 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x56228750cbd0 0x56228750f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.962+0000 7f4cc4522640 1 --2- 172.21.15.170:0/3367716844 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x56228750cbd0 0x56228750f090 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.962+0000 7f4cc4522640 1 -- 172.21.15.170:0/3367716844 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cb4051070 con 0x56228750cbd0 2024-09-12T17:29:45.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.962+0000 7f4cc4522640 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56228750f760 con 0x562287507f80 2024-09-12T17:29:45.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.962+0000 7f4cc4d23640 1 -- 172.21.15.170:0/3367716844 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cbc039020 con 0x562287507f80 2024-09-12T17:29:45.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.962+0000 7f4cc4d23640 1 --2- 172.21.15.170:0/3367716844 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f4cbc056b10 0x7f4cbc002c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:45.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.962+0000 7f4cc4d23640 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56228750f760 con 0x7f4cbc056b10 2024-09-12T17:29:45.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.962+0000 7f4cbbfff640 1 --2- 172.21.15.170:0/3367716844 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f4cbc056b10 0x7f4cbc002c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:45.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.963+0000 7f4cbbfff640 1 --2- 172.21.15.170:0/3367716844 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f4cbc056b10 0x7f4cbc002c80 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:45.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.963+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cac009050 con 0x7f4cbc056b10 2024-09-12T17:29:45.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.963+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56228750f760 con 0x562287503710 2024-09-12T17:29:45.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.963+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cac009050 con 0x562287503710 2024-09-12T17:29:45.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.963+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56228750f760 con 0x562287503710 2024-09-12T17:29:45.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.963+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cac029040 con 0x562287503710 2024-09-12T17:29:45.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.963+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56228750f760 con 0x7f4cbc056b10 2024-09-12T17:29:45.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.964+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cac029040 con 0x7f4cbc056b10 2024-09-12T17:29:45.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.964+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56228750f760 con 0x7f4cbc056b10 2024-09-12T17:29:45.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.964+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cac029040 con 0x7f4cbc056b10 2024-09-12T17:29:45.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.964+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56228750f760 con 0x562287507f80 2024-09-12T17:29:45.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.964+0000 7f4cc4d23640 1 -- 172.21.15.170:0/3367716844 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cbc039020 con 0x562287507f80 2024-09-12T17:29:45.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.964+0000 7f4cc4d23640 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56228750f760 con 0x56228750cbd0 2024-09-12T17:29:45.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.964+0000 7f4cc4522640 1 -- 172.21.15.170:0/3367716844 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cb4051070 con 0x56228750cbd0 2024-09-12T17:29:45.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.964+0000 7f4cc4522640 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56228750f760 con 0x562287503710 2024-09-12T17:29:45.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.965+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cac029040 con 0x562287503710 2024-09-12T17:29:45.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.965+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56228750f760 con 0x7f4cbc056b10 2024-09-12T17:29:45.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.965+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cac029040 con 0x7f4cbc056b10 2024-09-12T17:29:45.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.965+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56228750f760 con 0x562287503710 2024-09-12T17:29:45.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.965+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cac029040 con 0x562287503710 2024-09-12T17:29:45.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.965+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56228750f760 con 0x562287507f80 2024-09-12T17:29:45.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.965+0000 7f4cc4d23640 1 -- 172.21.15.170:0/3367716844 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f4cbc039020 con 0x562287507f80 2024-09-12T17:29:45.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.965+0000 7f4cc4d23640 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56228750f760 con 0x56228750cbd0 2024-09-12T17:29:45.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.966+0000 7f4cc4522640 1 -- 172.21.15.170:0/3367716844 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cb4051070 con 0x56228750cbd0 2024-09-12T17:29:45.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.966+0000 7f4cc4522640 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56228750f760 con 0x56228750cbd0 2024-09-12T17:29:45.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.966+0000 7f4cc4522640 1 -- 172.21.15.170:0/3367716844 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cb4051070 con 0x56228750cbd0 2024-09-12T17:29:45.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.966+0000 7f4cc4522640 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56228750f760 con 0x562287507f80 2024-09-12T17:29:45.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.966+0000 7f4cc4d23640 1 -- 172.21.15.170:0/3367716844 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cbc039020 con 0x562287507f80 2024-09-12T17:29:45.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.966+0000 7f4cc4d23640 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56228750f760 con 0x56228750cbd0 2024-09-12T17:29:45.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.966+0000 7f4cc4522640 1 -- 172.21.15.170:0/3367716844 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cb4051070 con 0x56228750cbd0 2024-09-12T17:29:45.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.966+0000 7f4cc4522640 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56228750f760 con 0x56228750cbd0 2024-09-12T17:29:45.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.966+0000 7f4cc4522640 1 -- 172.21.15.170:0/3367716844 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cb4051070 con 0x56228750cbd0 2024-09-12T17:29:45.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.966+0000 7f4cc4522640 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56228750f760 con 0x562287503710 2024-09-12T17:29:45.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.967+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cac029040 con 0x562287503710 2024-09-12T17:29:45.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.967+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56228750f760 con 0x562287503710 2024-09-12T17:29:45.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.967+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4cac029040 con 0x562287503710 2024-09-12T17:29:45.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.967+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56228750f760 con 0x7f4cbc056b10 2024-09-12T17:29:45.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.967+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cac029040 con 0x7f4cbc056b10 2024-09-12T17:29:45.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.967+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56228750f760 con 0x56228750cbd0 2024-09-12T17:29:45.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.967+0000 7f4cc4522640 1 -- 172.21.15.170:0/3367716844 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cb4051070 con 0x56228750cbd0 2024-09-12T17:29:45.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.967+0000 7f4cc4522640 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56228750f760 con 0x562287507f80 2024-09-12T17:29:45.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.968+0000 7f4cc4d23640 1 -- 172.21.15.170:0/3367716844 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cbc039020 con 0x562287507f80 2024-09-12T17:29:45.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.968+0000 7f4cc4d23640 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56228750f760 con 0x562287503710 2024-09-12T17:29:45.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.968+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cac029040 con 0x562287503710 2024-09-12T17:29:45.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.968+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56228750f760 con 0x7f4cbc056b10 2024-09-12T17:29:45.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.968+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cac029040 con 0x7f4cbc056b10 2024-09-12T17:29:45.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.968+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56228750f760 con 0x56228750cbd0 2024-09-12T17:29:45.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.969+0000 7f4cc4522640 1 -- 172.21.15.170:0/3367716844 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cb4051070 con 0x56228750cbd0 2024-09-12T17:29:45.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.969+0000 7f4cc4522640 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56228750f760 con 0x7f4cbc056b10 2024-09-12T17:29:45.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.969+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cac029040 con 0x7f4cbc056b10 2024-09-12T17:29:45.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.969+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56228750f760 con 0x562287507f80 2024-09-12T17:29:45.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.969+0000 7f4cc4d23640 1 -- 172.21.15.170:0/3367716844 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cbc039020 con 0x562287507f80 2024-09-12T17:29:45.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.969+0000 7f4cc4d23640 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56228750f760 con 0x56228750cbd0 2024-09-12T17:29:45.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.969+0000 7f4cc4522640 1 -- 172.21.15.170:0/3367716844 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cb4051070 con 0x56228750cbd0 2024-09-12T17:29:45.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.969+0000 7f4cc4522640 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56228750f760 con 0x7f4cbc056b10 2024-09-12T17:29:45.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.970+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cac029040 con 0x7f4cbc056b10 2024-09-12T17:29:45.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.970+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56228750f760 con 0x562287503710 2024-09-12T17:29:45.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.970+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4cac029040 con 0x562287503710 2024-09-12T17:29:45.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.970+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56228750f760 con 0x562287507f80 2024-09-12T17:29:45.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.970+0000 7f4cc4d23640 1 -- 172.21.15.170:0/3367716844 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(37 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4cbc039020 con 0x562287507f80 2024-09-12T17:29:45.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.970+0000 7f4cc8e11800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:29:45.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.970+0000 7f4cc8e11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:29:45.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.970+0000 7f4cc8e11800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:29:45.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.970+0000 7f4cc8e11800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:29:45.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.970+0000 7f4cc8e11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:29:45.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.970+0000 7f4cc8e11800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:29:45.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.970+0000 7f4cc8e11800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.970+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56228750b5d0 con 0x562287503710 2024-09-12T17:29:45.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.970+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4cac029040 con 0x562287503710 2024-09-12T17:29:45.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.970+0000 7f4cc8e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.970+0000 7f4cc8e11800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.970+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56228750b1b0 con 0x562287503710 2024-09-12T17:29:45.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.970+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4cac029040 con 0x562287503710 2024-09-12T17:29:45.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.971+0000 7f4cc8e11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:45.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.971+0000 7f4cc8e11800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.971+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56228750bef0 con 0x562287507f80 2024-09-12T17:29:45.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.971+0000 7f4cc4d23640 1 -- 172.21.15.170:0/3367716844 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4cbc039020 con 0x562287507f80 2024-09-12T17:29:45.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.971+0000 7f4cc8e11800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:29:45.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.971+0000 7f4cc8e11800 20 zone default found 2024-09-12T17:29:45.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.971+0000 7f4cc8e11800 4 Realm: () 2024-09-12T17:29:45.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.971+0000 7f4cc8e11800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:29:45.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.971+0000 7f4cc8e11800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:29:45.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.971+0000 7f4cc8e11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:29:45.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.971+0000 7f4cc8e11800 20 zonegroup default 2024-09-12T17:29:45.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.971+0000 7f4cc8e11800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.971+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56228750ba70 con 0x7f4cbc056b10 2024-09-12T17:29:45.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.971+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4cac029040 con 0x7f4cbc056b10 2024-09-12T17:29:45.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.971+0000 7f4cc8e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.971+0000 7f4cc8e11800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.971+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562287511fb0 con 0x56228750cbd0 2024-09-12T17:29:45.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.971+0000 7f4cc4522640 1 -- 172.21.15.170:0/3367716844 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4cb4051070 con 0x56228750cbd0 2024-09-12T17:29:45.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.971+0000 7f4cc8e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.971+0000 7f4cc8e11800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.971+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562287512380 con 0x56228750cbd0 2024-09-12T17:29:45.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.972+0000 7f4cc4522640 1 -- 172.21.15.170:0/3367716844 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4cb4051070 con 0x56228750cbd0 2024-09-12T17:29:45.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.972+0000 7f4cc8e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.972+0000 7f4cc8e11800 20 started sync module instance, tier type = 2024-09-12T17:29:45.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.972+0000 7f4cc8e11800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:29:45.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.972+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562287511440 con 0x562287507f80 2024-09-12T17:29:45.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.973+0000 7f4cc4d23640 1 -- 172.21.15.170:0/3367716844 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(44 notify.0 [create] v31'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cbc039020 con 0x562287507f80 2024-09-12T17:29:45.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.973+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94706299115568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622875110a0 con 0x562287507f80 2024-09-12T17:29:45.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.973+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562287513290 con 0x562287503710 2024-09-12T17:29:46.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.974+0000 7f4cc4d23640 1 -- 172.21.15.170:0/3367716844 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94706299115568] v31'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cbc039020 con 0x562287507f80 2024-09-12T17:29:46.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.974+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v31'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cac029040 con 0x562287503710 2024-09-12T17:29:46.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.974+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94706299119552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562287513290 con 0x562287503710 2024-09-12T17:29:46.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.974+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562287513cd0 con 0x56228750cbd0 2024-09-12T17:29:46.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.975+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94706299119552] v31'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cac029040 con 0x562287503710 2024-09-12T17:29:46.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.975+0000 7f4cc4522640 1 -- 172.21.15.170:0/3367716844 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v31'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cb4051070 con 0x56228750cbd0 2024-09-12T17:29:46.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.975+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94706299121120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562287513200 con 0x56228750cbd0 2024-09-12T17:29:46.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.975+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562287514b90 con 0x562287507f80 2024-09-12T17:29:46.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.976+0000 7f4cc4d23640 1 -- 172.21.15.170:0/3367716844 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(50 notify.3 [create] v31'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cbc039020 con 0x562287507f80 2024-09-12T17:29:46.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.976+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94706299127520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562287514b40 con 0x562287507f80 2024-09-12T17:29:46.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.976+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562287515b30 con 0x562287503710 2024-09-12T17:29:46.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.976+0000 7f4cc4522640 1 -- 172.21.15.170:0/3367716844 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94706299121120] v31'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cb4051070 con 0x56228750cbd0 2024-09-12T17:29:46.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.977+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v31'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cac029040 con 0x562287503710 2024-09-12T17:29:46.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.977+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94706299131392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562287515af0 con 0x562287503710 2024-09-12T17:29:46.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.977+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562287516580 con 0x7f4cbc056b10 2024-09-12T17:29:46.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.977+0000 7f4cc4d23640 1 -- 172.21.15.170:0/3367716844 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94706299127520] v31'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cbc070040 con 0x562287507f80 2024-09-12T17:29:46.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.978+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(54 notify.5 [create] v31'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cac029040 con 0x7f4cbc056b10 2024-09-12T17:29:46.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.978+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94706299129728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562287516540 con 0x7f4cbc056b10 2024-09-12T17:29:46.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.978+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562287516fc0 con 0x7f4cbc056b10 2024-09-12T17:29:46.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.978+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94706299131392] v31'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cac029040 con 0x562287503710 2024-09-12T17:29:46.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.979+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94706299129728] v31'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cac029040 con 0x7f4cbc056b10 2024-09-12T17:29:46.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.979+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v31'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cac029040 con 0x7f4cbc056b10 2024-09-12T17:29:46.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.979+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94706299134096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622875164b0 con 0x7f4cbc056b10 2024-09-12T17:29:46.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.979+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562287517470 con 0x7f4cbc056b10 2024-09-12T17:29:46.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.980+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94706299134096] v31'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cac029040 con 0x7f4cbc056b10 2024-09-12T17:29:46.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.980+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(58 notify.7 [create] v31'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cac029040 con 0x7f4cbc056b10 2024-09-12T17:29:46.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.980+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94706299136784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5622875173e0 con 0x7f4cbc056b10 2024-09-12T17:29:46.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.980+0000 7f4cc8e11800 20 add_watcher() i=0 2024-09-12T17:29:46.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.980+0000 7f4cc8e11800 20 add_watcher() i=1 2024-09-12T17:29:46.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.980+0000 7f4cc8e11800 20 add_watcher() i=2 2024-09-12T17:29:46.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.980+0000 7f4cc8e11800 20 add_watcher() i=3 2024-09-12T17:29:46.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.980+0000 7f4cc8e11800 20 add_watcher() i=4 2024-09-12T17:29:46.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.980+0000 7f4cc8e11800 20 add_watcher() i=5 2024-09-12T17:29:46.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.980+0000 7f4cc8e11800 20 add_watcher() i=6 2024-09-12T17:29:46.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.981+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94706299136784] v31'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cac029040 con 0x7f4cbc056b10 2024-09-12T17:29:46.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.981+0000 7f4cc8e11800 20 add_watcher() i=7 2024-09-12T17:29:46.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.981+0000 7f4cc8e11800 2 all 8 watchers are set, enabling cache 2024-09-12T17:29:46.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.981+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56228751a890 con 0x562287503710 2024-09-12T17:29:46.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.982+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4cac029040 con 0x562287503710 2024-09-12T17:29:46.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.982+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94706299138304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562287517d90 con 0x562287503710 2024-09-12T17:29:46.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.983+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94706299138304] v31'238 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4cac029040 con 0x562287503710 2024-09-12T17:29:46.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.983+0000 7f4b7a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:46.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.983+0000 7f4cc8e11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:29:46.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.983+0000 7f4cc8e11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:29:46.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.983+0000 7f4cc8e11800 5 note: GC not initialized 2024-09-12T17:29:46.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.983+0000 7f4b797e2640 20 reqs_thread_entry: start 2024-09-12T17:29:46.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.983+0000 7f4cc8e11800 20 init_complete bucket index max shards: 11 2024-09-12T17:29:46.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.983+0000 7f4cc8e11800 20 Filter name: none 2024-09-12T17:29:46.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.983+0000 7f4aeaffd640 20 reqs_thread_entry: start 2024-09-12T17:29:46.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.984+0000 7f4cc8e11800 20 rados->read ofs=0 len=0 2024-09-12T17:29:46.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.984+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56228754d440 con 0x562287503710 2024-09-12T17:29:46.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.984+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f4cac029040 con 0x562287503710 2024-09-12T17:29:46.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.984+0000 7f4cc8e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:46.009 INFO:teuthology.orchestra.run.smithi170.stderr:could not fetch user info: no user info saved 2024-09-12T17:29:46.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.985+0000 7f4b7a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:46.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.985+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94706299138304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56228754d400 con 0x562287503710 2024-09-12T17:29:46.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.985+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94706299138304] v31'239 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4cac029040 con 0x562287503710 2024-09-12T17:29:46.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.985+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94706299115568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56228754d400 con 0x562287507f80 2024-09-12T17:29:46.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.986+0000 7f4cc4d23640 1 -- 172.21.15.170:0/3367716844 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94706299115568] v31'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cbc070040 con 0x562287507f80 2024-09-12T17:29:46.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.986+0000 7f4cc8e11800 20 remove_watcher() i=0 2024-09-12T17:29:46.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.986+0000 7f4cc8e11800 2 removed watcher, disabling cache 2024-09-12T17:29:46.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.986+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94706299119552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56228754d400 con 0x562287503710 2024-09-12T17:29:46.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.987+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94706299119552] v31'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cac029040 con 0x562287503710 2024-09-12T17:29:46.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.987+0000 7f4cc8e11800 20 remove_watcher() i=1 2024-09-12T17:29:46.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.987+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94706299121120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56228754d400 con 0x56228750cbd0 2024-09-12T17:29:46.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.989+0000 7f4cc4522640 1 -- 172.21.15.170:0/3367716844 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94706299121120] v31'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cb4051070 con 0x56228750cbd0 2024-09-12T17:29:46.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.989+0000 7f4cc8e11800 20 remove_watcher() i=2 2024-09-12T17:29:46.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.989+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94706299127520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56228754d400 con 0x562287507f80 2024-09-12T17:29:46.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.990+0000 7f4cc4d23640 1 -- 172.21.15.170:0/3367716844 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94706299127520] v31'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cbc070040 con 0x562287507f80 2024-09-12T17:29:46.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.990+0000 7f4cc8e11800 20 remove_watcher() i=3 2024-09-12T17:29:46.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.990+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94706299131392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56228754d400 con 0x562287503710 2024-09-12T17:29:46.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.991+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94706299131392] v31'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cac029040 con 0x562287503710 2024-09-12T17:29:46.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.991+0000 7f4cc8e11800 20 remove_watcher() i=4 2024-09-12T17:29:46.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.991+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94706299129728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56228754d400 con 0x7f4cbc056b10 2024-09-12T17:29:46.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.992+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94706299129728] v31'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cac029040 con 0x7f4cbc056b10 2024-09-12T17:29:46.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.992+0000 7f4cc8e11800 20 remove_watcher() i=5 2024-09-12T17:29:46.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.992+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94706299134096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56228754d400 con 0x7f4cbc056b10 2024-09-12T17:29:46.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.993+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94706299134096] v31'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cac029040 con 0x7f4cbc056b10 2024-09-12T17:29:46.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.993+0000 7f4cc8e11800 20 remove_watcher() i=6 2024-09-12T17:29:46.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.993+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94706299136784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56228754d400 con 0x7f4cbc056b10 2024-09-12T17:29:46.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.994+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94706299136784] v31'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cac029040 con 0x7f4cbc056b10 2024-09-12T17:29:46.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.994+0000 7f4cc8e11800 20 remove_watcher() i=7 2024-09-12T17:29:46.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.994+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f4cbc056b10 msgr2=0x7f4cbc002c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.994+0000 7f4cc8e11800 1 --2- 172.21.15.170:0/3367716844 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f4cbc056b10 0x7f4cbc002c80 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.994+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x562287503710 msgr2=0x562287505bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.994+0000 7f4cc8e11800 1 --2- 172.21.15.170:0/3367716844 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x562287503710 0x562287505bd0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.994+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x562287507f80 msgr2=0x56228750a370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.994+0000 7f4cc8e11800 1 --2- 172.21.15.170:0/3367716844 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x562287507f80 0x56228750a370 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.994+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x56228750cbd0 msgr2=0x56228750f090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.994+0000 7f4cc8e11800 1 --2- 172.21.15.170:0/3367716844 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x56228750cbd0 0x56228750f090 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.994+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f4b9403c730 msgr2=0x7f4b9403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.994+0000 7f4cc8e11800 1 --2- 172.21.15.170:0/3367716844 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f4b9403c730 0x7f4b9403ebf0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4cb405dac0 tx=0x7f4cb4089000 comp rx=0 tx=0).stop 2024-09-12T17:29:46.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.994+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622874f0a70 msgr2=0x5622874f8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.994+0000 7f4cbbfff640 1 -- 172.21.15.170:0/3367716844 reap_dead start 2024-09-12T17:29:46.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.994+0000 7f4cc8e11800 1 --2- 172.21.15.170:0/3367716844 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622874f0a70 0x5622874f8040 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc053dc0 tx=0x7f4cbc053d50 comp rx=0 tx=0).stop 2024-09-12T17:29:46.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.994+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 shutdown_connections 2024-09-12T17:29:46.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.994+0000 7f4cc8e11800 1 --2- 172.21.15.170:0/3367716844 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622874f0a70 0x5622874f8040 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.994+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 >> 172.21.15.170:0/3367716844 conn(0x5622874ece70 msgr2=0x5622874eb080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:46.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.994+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 shutdown_connections 2024-09-12T17:29:46.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.994+0000 7f4cc8e11800 1 -- 172.21.15.170:0/3367716844 wait complete. 2024-09-12T17:29:46.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.995+0000 7f4cc8e11800 1 -- 172.21.15.170:0/1496386075 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f4b9c03c730 msgr2=0x7f4b9c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.995+0000 7f4cc8e11800 1 --2- 172.21.15.170:0/1496386075 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f4b9c03c730 0x7f4b9c03ebf0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x5622874cb1e0 tx=0x7f4cb4045e60 comp rx=0 tx=0).stop 2024-09-12T17:29:46.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.995+0000 7f4cc8e11800 1 -- 172.21.15.170:0/1496386075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622874e3f90 msgr2=0x5622874e43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.995+0000 7f4cc8e11800 1 --2- 172.21.15.170:0/1496386075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622874e3f90 0x5622874e43b0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x5622874ca120 tx=0x7f4cbc0167b0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.995+0000 7f4cc8e11800 1 -- 172.21.15.170:0/1496386075 shutdown_connections 2024-09-12T17:29:46.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.995+0000 7f4cc8e11800 1 --2- 172.21.15.170:0/1496386075 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f4b9c03c730 0x7f4b9c03ebf0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.995+0000 7f4cc8e11800 1 --2- 172.21.15.170:0/1496386075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622874e3f90 0x5622874e43b0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.995+0000 7f4cc8e11800 1 -- 172.21.15.170:0/1496386075 >> 172.21.15.170:0/1496386075 conn(0x5622874d8340 msgr2=0x5622874d8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:46.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.995+0000 7f4cc8e11800 1 -- 172.21.15.170:0/1496386075 shutdown_connections 2024-09-12T17:29:46.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.995+0000 7f4cc8e11800 1 -- 172.21.15.170:0/1496386075 wait complete. 2024-09-12T17:29:46.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.995+0000 7f4cc8e11800 1 -- 172.21.15.170:0/4037685334 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5622873d0030 msgr2=0x5622874d0770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.995+0000 7f4cc8e11800 1 --2- 172.21.15.170:0/4037685334 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5622873d0030 0x5622874d0770 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.995+0000 7f4cc8e11800 1 -- 172.21.15.170:0/4037685334 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5622874d2ad0 msgr2=0x5622874d4f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.995+0000 7f4cc8e11800 1 --2- 172.21.15.170:0/4037685334 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5622874d2ad0 0x5622874d4f70 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.995+0000 7f4cc8e11800 1 -- 172.21.15.170:0/4037685334 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f4bac03c780 msgr2=0x7f4bac03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.995+0000 7f4cc8e11800 1 --2- 172.21.15.170:0/4037685334 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f4bac03c780 0x7f4bac03ec40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4cac004170 tx=0x7f4cac001330 comp rx=0 tx=0).stop 2024-09-12T17:29:46.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.995+0000 7f4cc8e11800 1 -- 172.21.15.170:0/4037685334 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622873cedf0 msgr2=0x5622874c9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.995+0000 7f4cc8e11800 1 --2- 172.21.15.170:0/4037685334 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622873cedf0 0x5622874c9120 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4025c20 tx=0x7f4cb4002fb0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.995+0000 7f4cc8e11800 1 -- 172.21.15.170:0/4037685334 shutdown_connections 2024-09-12T17:29:46.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.995+0000 7f4cc8e11800 1 --2- 172.21.15.170:0/4037685334 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5622874d2ad0 0x5622874d4f70 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.995+0000 7f4cc8e11800 1 --2- 172.21.15.170:0/4037685334 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f4bac03c780 0x7f4bac03ec40 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.995+0000 7f4cc8e11800 1 --2- 172.21.15.170:0/4037685334 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5622873d0030 0x5622874d0770 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.995+0000 7f4cc8e11800 1 --2- 172.21.15.170:0/4037685334 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5622873cedf0 0x5622874c9120 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.995+0000 7f4cc8e11800 1 -- 172.21.15.170:0/4037685334 >> 172.21.15.170:0/4037685334 conn(0x5622873ca1c0 msgr2=0x5622874b86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:46.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.995+0000 7f4cc8e11800 1 -- 172.21.15.170:0/4037685334 shutdown_connections 2024-09-12T17:29:46.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:45.995+0000 7f4cc8e11800 1 -- 172.21.15.170:0/4037685334 wait complete. 2024-09-12T17:29:46.015 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T17:29:46.016 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-09-12T17:29:46.016 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-09-12T17:29:46.016 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-09-12T17:29:46.059 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:29:46.060 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:29:46.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.059+0000 7fda1cb35800 1 Processor -- start 2024-09-12T17:29:46.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.059+0000 7fda1cb35800 1 -- start start 2024-09-12T17:29:46.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.059+0000 7fda1cb35800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55593fcf9390 0x55593fcfef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.059+0000 7fda1cb35800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55593fba1e40 con 0x55593fcf80c0 2024-09-12T17:29:46.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.059+0000 7fda1cb35800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x55593fb6c680 con 0x55593fcf9390 2024-09-12T17:29:46.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.059+0000 7fda0ffff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55593fcf9390 0x55593fcfef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.060+0000 7fda187c3640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x55593fcf80c0 0x55593fcf8c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:44824/0 (socket says 172.21.15.170:44824) 2024-09-12T17:29:46.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.060+0000 7fda187c3640 1 -- 172.21.15.170:0/1590074069 learned_addr learned my addr 172.21.15.170:0/1590074069 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:29:46.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.060+0000 7fda0ffff640 1 --2- 172.21.15.170:0/1590074069 >> v2:172.21.15.47:3300/0 conn(0x55593fcf9390 0x55593fcfef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34546/0 (socket says 172.21.15.170:34546) 2024-09-12T17:29:46.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.060+0000 7fda0ffff640 1 -- 172.21.15.170:0/1590074069 >> v1:172.21.15.47:6789/0 conn(0x55593fcf80c0 legacy=0x55593fcf8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.060+0000 7fda0ffff640 1 -- 172.21.15.170:0/1590074069 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55593fb886b0 con 0x55593fcf9390 2024-09-12T17:29:46.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.062+0000 7fda0ffff640 1 --2- 172.21.15.170:0/1590074069 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55593fcf9390 0x55593fcfef30 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fda0000a470 tx=0x7fda00045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aba19608cc7e7532 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.062+0000 7fda17fc2640 1 -- 172.21.15.170:0/1590074069 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda00053570 con 0x55593fcf9390 2024-09-12T17:29:46.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.062+0000 7fda17fc2640 1 -- 172.21.15.170:0/1590074069 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda00058070 con 0x55593fcf9390 2024-09-12T17:29:46.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.062+0000 7fda17fc2640 1 -- 172.21.15.170:0/1590074069 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda00053880 con 0x55593fcf9390 2024-09-12T17:29:46.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.062+0000 7fda1cb35800 1 -- 172.21.15.170:0/1590074069 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55593fcf9390 msgr2=0x55593fcfef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.062+0000 7fda1cb35800 1 --2- 172.21.15.170:0/1590074069 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55593fcf9390 0x55593fcfef30 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fda0000a470 tx=0x7fda00045a20 comp rx=0 tx=0).stop 2024-09-12T17:29:46.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.062+0000 7fda1cb35800 1 -- 172.21.15.170:0/1590074069 shutdown_connections 2024-09-12T17:29:46.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.062+0000 7fda1cb35800 1 --2- 172.21.15.170:0/1590074069 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55593fcf9390 0x55593fcfef30 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.062+0000 7fda1cb35800 1 -- 172.21.15.170:0/1590074069 >> 172.21.15.170:0/1590074069 conn(0x55593fcf3490 msgr2=0x55593fcf58f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:46.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.062+0000 7fda1cb35800 1 -- 172.21.15.170:0/1590074069 shutdown_connections 2024-09-12T17:29:46.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.062+0000 7fda1cb35800 1 -- 172.21.15.170:0/1590074069 wait complete. 2024-09-12T17:29:46.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.076+0000 7fda1cb35800 1 Processor -- start 2024-09-12T17:29:46.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.076+0000 7fda1cb35800 1 -- start start 2024-09-12T17:29:46.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.076+0000 7fda1cb35800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55593fcf80c0 0x55593fc6d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.076+0000 7fda1cb35800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55593fb90dd0 con 0x55593fcf80c0 2024-09-12T17:29:46.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.077+0000 7fda187c3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55593fcf80c0 0x55593fc6d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.077+0000 7fda187c3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55593fcf80c0 0x55593fc6d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34554/0 (socket says 172.21.15.170:34554) 2024-09-12T17:29:46.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.077+0000 7fda187c3640 1 -- 172.21.15.170:0/3574828569 learned_addr learned my addr 172.21.15.170:0/3574828569 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:46.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.077+0000 7fda187c3640 1 -- 172.21.15.170:0/3574828569 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55593fba9e10 con 0x55593fcf80c0 2024-09-12T17:29:46.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.077+0000 7fda187c3640 1 --2- 172.21.15.170:0/3574828569 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55593fcf80c0 0x55593fc6d7c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fda08001e40 tx=0x7fda08001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab49b1feb9656bf4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.077+0000 7fd90660c640 1 -- 172.21.15.170:0/3574828569 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda08012020 con 0x55593fcf80c0 2024-09-12T17:29:46.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.077+0000 7fd90660c640 1 -- 172.21.15.170:0/3574828569 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda0800e5a0 con 0x55593fcf80c0 2024-09-12T17:29:46.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.077+0000 7fd90660c640 1 -- 172.21.15.170:0/3574828569 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda0800e8a0 con 0x55593fcf80c0 2024-09-12T17:29:46.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.078+0000 7fda1cb35800 1 -- 172.21.15.170:0/3574828569 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55593fcf80c0 msgr2=0x55593fc6d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.078+0000 7fda1cb35800 1 --2- 172.21.15.170:0/3574828569 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55593fcf80c0 0x55593fc6d7c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fda08001e40 tx=0x7fda08001e70 comp rx=0 tx=0).stop 2024-09-12T17:29:46.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.078+0000 7fda1cb35800 1 -- 172.21.15.170:0/3574828569 shutdown_connections 2024-09-12T17:29:46.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.078+0000 7fda1cb35800 1 --2- 172.21.15.170:0/3574828569 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55593fcf80c0 0x55593fc6d7c0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.078+0000 7fda1cb35800 1 -- 172.21.15.170:0/3574828569 >> 172.21.15.170:0/3574828569 conn(0x55593fcf3490 msgr2=0x55593fde3040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:46.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.078+0000 7fda1cb35800 1 -- 172.21.15.170:0/3574828569 shutdown_connections 2024-09-12T17:29:46.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.078+0000 7fda1cb35800 1 -- 172.21.15.170:0/3574828569 wait complete. 2024-09-12T17:29:46.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.078+0000 7fda1cb35800 1 Processor -- start 2024-09-12T17:29:46.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.078+0000 7fda1cb35800 1 -- start start 2024-09-12T17:29:46.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.079+0000 7fda1cb35800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55593fcf80c0 0x55593fdf1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.079+0000 7fda1cb35800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55593fcf9a80 con 0x55593fcf80c0 2024-09-12T17:29:46.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.079+0000 7fda187c3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55593fcf80c0 0x55593fdf1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.079+0000 7fda187c3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55593fcf80c0 0x55593fdf1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34566/0 (socket says 172.21.15.170:34566) 2024-09-12T17:29:46.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.079+0000 7fda187c3640 1 -- 172.21.15.170:0/2491175367 learned_addr learned my addr 172.21.15.170:0/2491175367 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:46.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.079+0000 7fda187c3640 1 -- 172.21.15.170:0/2491175367 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55593fdf17c0 con 0x55593fcf80c0 2024-09-12T17:29:46.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.079+0000 7fda187c3640 1 --2- 172.21.15.170:0/2491175367 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55593fcf80c0 0x55593fdf1260 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fda0800c010 tx=0x7fda08000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.079+0000 7fd904e09640 1 -- 172.21.15.170:0/2491175367 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda08012030 con 0x55593fcf80c0 2024-09-12T17:29:46.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.079+0000 7fd904e09640 1 -- 172.21.15.170:0/2491175367 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda080014a0 con 0x55593fcf80c0 2024-09-12T17:29:46.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.079+0000 7fda1cb35800 1 -- 172.21.15.170:0/2491175367 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55593fdf1a50 con 0x55593fcf80c0 2024-09-12T17:29:46.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.079+0000 7fd904e09640 1 -- 172.21.15.170:0/2491175367 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda0801a7a0 con 0x55593fcf80c0 2024-09-12T17:29:46.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.079+0000 7fda1cb35800 1 -- 172.21.15.170:0/2491175367 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55593fdf2450 con 0x55593fcf80c0 2024-09-12T17:29:46.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.080+0000 7fda1cb35800 1 Processor -- start 2024-09-12T17:29:46.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.080+0000 7fda1cb35800 1 -- start start 2024-09-12T17:29:46.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.080+0000 7fda1cb35800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55593fdfe750 0x55593fe00b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.080+0000 7fda1cb35800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55593fbeea00 con 0x55593fdfe750 2024-09-12T17:29:46.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.080+0000 7fd904e09640 1 -- 172.21.15.170:0/2491175367 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fda08015020 con 0x55593fcf80c0 2024-09-12T17:29:46.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.081+0000 7fda18fc4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55593fdfe750 0x55593fe00b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.081+0000 7fda18fc4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55593fdfe750 0x55593fe00b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34582/0 (socket says 172.21.15.170:34582) 2024-09-12T17:29:46.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.081+0000 7fda18fc4640 1 -- 172.21.15.170:0/2776123435 learned_addr learned my addr 172.21.15.170:0/2776123435 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:46.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.081+0000 7fd904e09640 1 --2- 172.21.15.170:0/2491175367 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd90003c780 0x7fd90003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.081+0000 7fd904e09640 1 -- 172.21.15.170:0/2491175367 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fda08020030 con 0x55593fcf80c0 2024-09-12T17:29:46.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.081+0000 7fda187c3640 1 --2- 172.21.15.170:0/2491175367 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd90003c780 0x7fd90003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.081+0000 7fda18fc4640 1 -- 172.21.15.170:0/2776123435 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55593fe01110 con 0x55593fdfe750 2024-09-12T17:29:46.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.081+0000 7fda18fc4640 1 --2- 172.21.15.170:0/2776123435 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55593fdfe750 0x55593fe00b40 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fda1000a3e0 tx=0x7fda1000a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1492366444197d4e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.081+0000 7fda187c3640 1 --2- 172.21.15.170:0/2491175367 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd90003c780 0x7fd90003ec40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fda0800df90 tx=0x7fda08018b80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.081+0000 7fd8fe7fc640 1 -- 172.21.15.170:0/2776123435 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda10015070 con 0x55593fdfe750 2024-09-12T17:29:46.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.081+0000 7fd8fe7fc640 1 -- 172.21.15.170:0/2776123435 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda10001670 con 0x55593fdfe750 2024-09-12T17:29:46.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.081+0000 7fd8fe7fc640 1 -- 172.21.15.170:0/2776123435 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda10001990 con 0x55593fdfe750 2024-09-12T17:29:46.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.082+0000 7fda1cb35800 1 -- 172.21.15.170:0/2776123435 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55593fdfe750 msgr2=0x55593fe00b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.082+0000 7fda1cb35800 1 --2- 172.21.15.170:0/2776123435 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55593fdfe750 0x55593fe00b40 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fda1000a3e0 tx=0x7fda1000a8a0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.082+0000 7fda1cb35800 1 -- 172.21.15.170:0/2776123435 shutdown_connections 2024-09-12T17:29:46.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.082+0000 7fda1cb35800 1 --2- 172.21.15.170:0/2776123435 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55593fdfe750 0x55593fe00b40 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.082+0000 7fda1cb35800 1 -- 172.21.15.170:0/2776123435 >> 172.21.15.170:0/2776123435 conn(0x55593fcf9390 msgr2=0x55593fdf9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:46.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.082+0000 7fda1cb35800 1 -- 172.21.15.170:0/2776123435 shutdown_connections 2024-09-12T17:29:46.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.082+0000 7fda1cb35800 1 -- 172.21.15.170:0/2776123435 wait complete. 2024-09-12T17:29:46.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.082+0000 7fda1cb35800 1 Processor -- start 2024-09-12T17:29:46.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.082+0000 7fda1cb35800 1 -- start start 2024-09-12T17:29:46.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.082+0000 7fda1cb35800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55593fdfe750 0x55593fe054e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.082+0000 7fda1cb35800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55593fe013d0 con 0x55593fdfe750 2024-09-12T17:29:46.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.082+0000 7fda18fc4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55593fdfe750 0x55593fe054e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.083+0000 7fda18fc4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55593fdfe750 0x55593fe054e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34588/0 (socket says 172.21.15.170:34588) 2024-09-12T17:29:46.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.083+0000 7fda18fc4640 1 -- 172.21.15.170:0/96951887 learned_addr learned my addr 172.21.15.170:0/96951887 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:46.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.083+0000 7fda18fc4640 1 -- 172.21.15.170:0/96951887 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55593fe05a40 con 0x55593fdfe750 2024-09-12T17:29:46.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.083+0000 7fda18fc4640 1 --2- 172.21.15.170:0/96951887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55593fdfe750 0x55593fe054e0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x55593fdf9a50 tx=0x7fda10003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.083+0000 7fd8fcff9640 1 -- 172.21.15.170:0/96951887 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda10020020 con 0x55593fdfe750 2024-09-12T17:29:46.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.083+0000 7fd8fcff9640 1 -- 172.21.15.170:0/96951887 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda10010780 con 0x55593fdfe750 2024-09-12T17:29:46.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.083+0000 7fd8fcff9640 1 -- 172.21.15.170:0/96951887 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda10015040 con 0x55593fdfe750 2024-09-12T17:29:46.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.083+0000 7fda1cb35800 1 -- 172.21.15.170:0/96951887 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55593fe05cd0 con 0x55593fdfe750 2024-09-12T17:29:46.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.083+0000 7fda1cb35800 1 -- 172.21.15.170:0/96951887 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55593fe06650 con 0x55593fdfe750 2024-09-12T17:29:46.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.084+0000 7fd8fcff9640 1 -- 172.21.15.170:0/96951887 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fda10023020 con 0x55593fdfe750 2024-09-12T17:29:46.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.084+0000 7fd8fcff9640 1 --2- 172.21.15.170:0/96951887 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd8f003c780 0x7fd8f003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.084+0000 7fd8fcff9640 1 -- 172.21.15.170:0/96951887 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fda100532e0 con 0x55593fdfe750 2024-09-12T17:29:46.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.085+0000 7fda0ffff640 1 --2- 172.21.15.170:0/96951887 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd8f003c780 0x7fd8f003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.085+0000 7fda1cb35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:29:46.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.085+0000 7fda1cb35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:29:46.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.085+0000 7fda0ffff640 1 --2- 172.21.15.170:0/96951887 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd8f003c780 0x7fd8f003ec40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fda00057000 tx=0x7fda00052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.085+0000 7fda1cb35800 1 Processor -- start 2024-09-12T17:29:46.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.085+0000 7fda1cb35800 1 -- start start 2024-09-12T17:29:46.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.085+0000 7fda1cb35800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55593fe1f370 0x55593fe1f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.085+0000 7fda1cb35800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55593fc6c060 con 0x55593fe1f370 2024-09-12T17:29:46.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.086+0000 7fda187c3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55593fe1f370 0x55593fe1f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.086+0000 7fda187c3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55593fe1f370 0x55593fe1f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34598/0 (socket says 172.21.15.170:34598) 2024-09-12T17:29:46.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.086+0000 7fda187c3640 1 -- 172.21.15.170:0/77362769 learned_addr learned my addr 172.21.15.170:0/77362769 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:46.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.086+0000 7fda187c3640 1 -- 172.21.15.170:0/77362769 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55593fe1fdd0 con 0x55593fe1f370 2024-09-12T17:29:46.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.086+0000 7fda187c3640 1 --2- 172.21.15.170:0/77362769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55593fe1f370 0x55593fe1f790 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fda08051f20 tx=0x7fda08051e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.086+0000 7fd8dcfe1640 1 -- 172.21.15.170:0/77362769 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda08018430 con 0x55593fe1f370 2024-09-12T17:29:46.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.086+0000 7fd8dcfe1640 1 -- 172.21.15.170:0/77362769 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda08053040 con 0x55593fe1f370 2024-09-12T17:29:46.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.086+0000 7fda1cb35800 1 -- 172.21.15.170:0/77362769 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55593fe20600 con 0x55593fe1f370 2024-09-12T17:29:46.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.086+0000 7fd8dcfe1640 1 -- 172.21.15.170:0/77362769 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda08053320 con 0x55593fe1f370 2024-09-12T17:29:46.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.086+0000 7fda1cb35800 1 -- 172.21.15.170:0/77362769 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55593fe20ba0 con 0x55593fe1f370 2024-09-12T17:29:46.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.087+0000 7fd8dcfe1640 1 -- 172.21.15.170:0/77362769 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fda080534c0 con 0x55593fe1f370 2024-09-12T17:29:46.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.087+0000 7fd8dcfe1640 1 --2- 172.21.15.170:0/77362769 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd85803c780 0x7fd85803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.087+0000 7fd8dcfe1640 1 -- 172.21.15.170:0/77362769 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fda08038bf0 con 0x55593fe1f370 2024-09-12T17:29:46.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.087+0000 7fda0ffff640 1 --2- 172.21.15.170:0/77362769 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd85803c780 0x7fd85803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.088+0000 7fd87e7fc640 20 reqs_thread_entry: start 2024-09-12T17:29:46.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.088+0000 7fda0ffff640 1 --2- 172.21.15.170:0/77362769 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd85803c780 0x7fd85803ec40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fda00045a60 tx=0x7fda00005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.088+0000 7fda1cb35800 1 --2- 172.21.15.170:0/2491175367 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55593fe2cce0 0x55593fe2f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.088+0000 7fda1cb35800 1 -- 172.21.15.170:0/2491175367 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55593fe2f840 con 0x55593fe2cce0 2024-09-12T17:29:46.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.088+0000 7fda18fc4640 1 --2- 172.21.15.170:0/2491175367 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55593fe2cce0 0x55593fe2f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.088+0000 7fda18fc4640 1 --2- 172.21.15.170:0/2491175367 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55593fe2cce0 0x55593fe2f170 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.088+0000 7fda18fc4640 1 -- 172.21.15.170:0/2491175367 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fda1000e070 con 0x55593fe2cce0 2024-09-12T17:29:46.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.088+0000 7fda1cb35800 1 --2- 172.21.15.170:0/2491175367 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55593fe31610 0x55593fe33a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.088+0000 7fda1cb35800 1 -- 172.21.15.170:0/2491175367 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:2 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55593fe34140 con 0x55593fe31610 2024-09-12T17:29:46.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.089+0000 7fda187c3640 1 --2- 172.21.15.170:0/2491175367 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55593fe31610 0x55593fe33a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.089+0000 7fda187c3640 1 --2- 172.21.15.170:0/2491175367 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55593fe31610 0x55593fe33a00 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.089+0000 7fda187c3640 1 -- 172.21.15.170:0/2491175367 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(2 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fda0802fcf0 con 0x55593fe31610 2024-09-12T17:29:46.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.090+0000 7fda1cb35800 1 -- 172.21.15.170:0/96951887 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd8f003c780 msgr2=0x7fd8f003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.090+0000 7fda1cb35800 1 --2- 172.21.15.170:0/96951887 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd8f003c780 0x7fd8f003ec40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fda00057000 tx=0x7fda00052000 comp rx=0 tx=0).stop 2024-09-12T17:29:46.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.090+0000 7fda1cb35800 1 -- 172.21.15.170:0/96951887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55593fdfe750 msgr2=0x55593fe054e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.090+0000 7fda1cb35800 1 --2- 172.21.15.170:0/96951887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55593fdfe750 0x55593fe054e0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x55593fdf9a50 tx=0x7fda10003370 comp rx=0 tx=0).stop 2024-09-12T17:29:46.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.090+0000 7fda1cb35800 1 -- 172.21.15.170:0/96951887 shutdown_connections 2024-09-12T17:29:46.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.090+0000 7fda1cb35800 1 --2- 172.21.15.170:0/96951887 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd8f003c780 0x7fd8f003ec40 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.090+0000 7fda1cb35800 1 --2- 172.21.15.170:0/96951887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55593fdfe750 0x55593fe054e0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.090+0000 7fda1cb35800 1 -- 172.21.15.170:0/96951887 >> 172.21.15.170:0/96951887 conn(0x55593fcf9390 msgr2=0x55593fdf9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:46.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.090+0000 7fda1cb35800 1 -- 172.21.15.170:0/96951887 shutdown_connections 2024-09-12T17:29:46.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.090+0000 7fda1cb35800 1 -- 172.21.15.170:0/96951887 wait complete. 2024-09-12T17:29:46.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.090+0000 7fda1cb35800 1 -- 172.21.15.170:0/77362769 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd85803c780 msgr2=0x7fd85803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.090+0000 7fda1cb35800 1 --2- 172.21.15.170:0/77362769 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd85803c780 0x7fd85803ec40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fda00045a60 tx=0x7fda00005a00 comp rx=0 tx=0).stop 2024-09-12T17:29:46.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.090+0000 7fda1cb35800 1 -- 172.21.15.170:0/77362769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55593fe1f370 msgr2=0x55593fe1f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.090+0000 7fda1cb35800 1 --2- 172.21.15.170:0/77362769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55593fe1f370 0x55593fe1f790 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fda08051f20 tx=0x7fda08051e80 comp rx=0 tx=0).stop 2024-09-12T17:29:46.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.090+0000 7fda1cb35800 1 -- 172.21.15.170:0/77362769 shutdown_connections 2024-09-12T17:29:46.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.090+0000 7fda1cb35800 1 --2- 172.21.15.170:0/77362769 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd85803c780 0x7fd85803ec40 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.090+0000 7fda1cb35800 1 --2- 172.21.15.170:0/77362769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55593fe1f370 0x55593fe1f790 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.090+0000 7fda1cb35800 1 -- 172.21.15.170:0/77362769 >> 172.21.15.170:0/77362769 conn(0x55593fe148b0 msgr2=0x55593fe14c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:46.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.090+0000 7fda1cb35800 1 -- 172.21.15.170:0/77362769 shutdown_connections 2024-09-12T17:29:46.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.090+0000 7fda1cb35800 1 -- 172.21.15.170:0/77362769 wait complete. 2024-09-12T17:29:46.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.091+0000 7fda1cb35800 1 -- 172.21.15.170:0/2491175367 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55593fe2cce0 msgr2=0x55593fe2f170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.091+0000 7fda1cb35800 1 --2- 172.21.15.170:0/2491175367 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55593fe2cce0 0x55593fe2f170 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.091+0000 7fda1cb35800 1 -- 172.21.15.170:0/2491175367 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55593fe31610 msgr2=0x55593fe33a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.091+0000 7fda1cb35800 1 --2- 172.21.15.170:0/2491175367 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55593fe31610 0x55593fe33a00 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.091+0000 7fda1cb35800 1 -- 172.21.15.170:0/2491175367 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd90003c780 msgr2=0x7fd90003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.091+0000 7fda1cb35800 1 --2- 172.21.15.170:0/2491175367 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd90003c780 0x7fd90003ec40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fda0800df90 tx=0x7fda08018b80 comp rx=0 tx=0).stop 2024-09-12T17:29:46.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.091+0000 7fda1cb35800 1 -- 172.21.15.170:0/2491175367 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55593fcf80c0 msgr2=0x55593fdf1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.091+0000 7fda1cb35800 1 --2- 172.21.15.170:0/2491175367 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55593fcf80c0 0x55593fdf1260 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fda0800c010 tx=0x7fda08000ed0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.091+0000 7fda1cb35800 1 -- 172.21.15.170:0/2491175367 shutdown_connections 2024-09-12T17:29:46.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.091+0000 7fda1cb35800 1 --2- 172.21.15.170:0/2491175367 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55593fe31610 0x55593fe33a00 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.091+0000 7fda1cb35800 1 --2- 172.21.15.170:0/2491175367 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd90003c780 0x7fd90003ec40 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.091+0000 7fda1cb35800 1 --2- 172.21.15.170:0/2491175367 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55593fe2cce0 0x55593fe2f170 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.091+0000 7fda1cb35800 1 --2- 172.21.15.170:0/2491175367 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55593fcf80c0 0x55593fdf1260 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.091+0000 7fda1cb35800 1 -- 172.21.15.170:0/2491175367 >> 172.21.15.170:0/2491175367 conn(0x55593fcf3490 msgr2=0x55593fde2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:46.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.091+0000 7fda1cb35800 1 -- 172.21.15.170:0/2491175367 shutdown_connections 2024-09-12T17:29:46.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.091+0000 7fda1cb35800 1 -- 172.21.15.170:0/2491175367 wait complete. 2024-09-12T17:29:46.102 INFO:teuthology.orchestra.run.smithi170.stdout:{"id":"7f05c86a-1902-4046-a99f-31d6f38ce8f7","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T17:29:46.102 DEBUG:tasks.util.rgw: json result: {'id': '7f05c86a-1902-4046-a99f-31d6f38ce8f7', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T17:29:46.103 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-09-12T17:29:46.103 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-09-12T17:29:46.103 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-09-12T17:29:46.184 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:29:46.185 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:29:46.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.184+0000 7f3f1bf25800 1 Processor -- start 2024-09-12T17:29:46.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.184+0000 7f3f1bf25800 1 -- start start 2024-09-12T17:29:46.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.184+0000 7f3f1bf25800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55e9675271f0 0x55e9675296b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.184+0000 7f3f1bf25800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e9673cce40 con 0x55e9675235f0 2024-09-12T17:29:46.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.184+0000 7f3f1bf25800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x55e967397680 con 0x55e9675271f0 2024-09-12T17:29:46.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.184+0000 7f3f173b4640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55e9675271f0 0x55e9675296b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.185+0000 7f3f173b4640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55e9675271f0 0x55e9675296b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34608/0 (socket says 172.21.15.170:34608) 2024-09-12T17:29:46.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.185+0000 7f3f17bb5640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x55e9675235f0 0x55e9675259e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:44832/0 (socket says 172.21.15.170:44832) 2024-09-12T17:29:46.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.185+0000 7f3f173b4640 1 -- 172.21.15.170:0/926651231 learned_addr learned my addr 172.21.15.170:0/926651231 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:46.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.185+0000 7f3f173b4640 1 -- 172.21.15.170:0/926651231 >> v1:172.21.15.47:6789/0 conn(0x55e9675235f0 legacy=0x55e9675259e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.185+0000 7f3f173b4640 1 -- 172.21.15.170:0/926651231 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9673b36b0 con 0x55e9675271f0 2024-09-12T17:29:46.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.187+0000 7f3f173b4640 1 --2- 172.21.15.170:0/926651231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e9675271f0 0x55e9675296b0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c00a520 tx=0x7f3f0c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7db9cea86caea1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.187+0000 7f3f16bb3640 1 -- 172.21.15.170:0/926651231 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f0c055070 con 0x55e9675271f0 2024-09-12T17:29:46.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.187+0000 7f3f16bb3640 1 -- 172.21.15.170:0/926651231 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f0c0515b0 con 0x55e9675271f0 2024-09-12T17:29:46.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.187+0000 7f3f16bb3640 1 -- 172.21.15.170:0/926651231 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f0c0518d0 con 0x55e9675271f0 2024-09-12T17:29:46.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.187+0000 7f3f1bf25800 1 -- 172.21.15.170:0/926651231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e9675271f0 msgr2=0x55e9675296b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.187+0000 7f3f1bf25800 1 --2- 172.21.15.170:0/926651231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e9675271f0 0x55e9675296b0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c00a520 tx=0x7f3f0c045ba0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.187+0000 7f3f1bf25800 1 -- 172.21.15.170:0/926651231 shutdown_connections 2024-09-12T17:29:46.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.187+0000 7f3f1bf25800 1 --2- 172.21.15.170:0/926651231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e9675271f0 0x55e9675296b0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.187+0000 7f3f1bf25800 1 -- 172.21.15.170:0/926651231 >> 172.21.15.170:0/926651231 conn(0x55e96751d1b0 msgr2=0x55e96751f610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:46.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.187+0000 7f3f1bf25800 1 -- 172.21.15.170:0/926651231 shutdown_connections 2024-09-12T17:29:46.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.187+0000 7f3f1bf25800 1 -- 172.21.15.170:0/926651231 wait complete. 2024-09-12T17:29:46.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.201+0000 7f3f1bf25800 1 Processor -- start 2024-09-12T17:29:46.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.201+0000 7f3f1bf25800 1 -- start start 2024-09-12T17:29:46.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.201+0000 7f3f1bf25800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e9675235f0 0x55e967522d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.201+0000 7f3f1bf25800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e9673bbdd0 con 0x55e9675235f0 2024-09-12T17:29:46.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.202+0000 7f3f17bb5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e9675235f0 0x55e967522d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.202+0000 7f3f17bb5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e9675235f0 0x55e967522d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34622/0 (socket says 172.21.15.170:34622) 2024-09-12T17:29:46.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.202+0000 7f3f17bb5640 1 -- 172.21.15.170:0/121941615 learned_addr learned my addr 172.21.15.170:0/121941615 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:46.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.202+0000 7f3f17bb5640 1 -- 172.21.15.170:0/121941615 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9673d4e10 con 0x55e9675235f0 2024-09-12T17:29:46.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.202+0000 7f3f17bb5640 1 --2- 172.21.15.170:0/121941615 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e9675235f0 0x55e967522d60 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f3f0800b260 tx=0x7f3f0800b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6afd1ad07218fb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.202+0000 7f3e05e0b640 1 -- 172.21.15.170:0/121941615 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f0800be60 con 0x55e9675235f0 2024-09-12T17:29:46.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.202+0000 7f3e05e0b640 1 -- 172.21.15.170:0/121941615 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f08006070 con 0x55e9675235f0 2024-09-12T17:29:46.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.202+0000 7f3e05e0b640 1 -- 172.21.15.170:0/121941615 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f0800e710 con 0x55e9675235f0 2024-09-12T17:29:46.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.203+0000 7f3f1bf25800 1 -- 172.21.15.170:0/121941615 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e9675235f0 msgr2=0x55e967522d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.203+0000 7f3f1bf25800 1 --2- 172.21.15.170:0/121941615 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e9675235f0 0x55e967522d60 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f3f0800b260 tx=0x7f3f0800b660 comp rx=0 tx=0).stop 2024-09-12T17:29:46.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.203+0000 7f3f1bf25800 1 -- 172.21.15.170:0/121941615 shutdown_connections 2024-09-12T17:29:46.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.203+0000 7f3f1bf25800 1 --2- 172.21.15.170:0/121941615 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e9675235f0 0x55e967522d60 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.203+0000 7f3f1bf25800 1 -- 172.21.15.170:0/121941615 >> 172.21.15.170:0/121941615 conn(0x55e96751d1b0 msgr2=0x55e96760dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:46.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.203+0000 7f3f1bf25800 1 -- 172.21.15.170:0/121941615 shutdown_connections 2024-09-12T17:29:46.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.203+0000 7f3f1bf25800 1 -- 172.21.15.170:0/121941615 wait complete. 2024-09-12T17:29:46.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.203+0000 7f3f1bf25800 1 Processor -- start 2024-09-12T17:29:46.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.204+0000 7f3f1bf25800 1 -- start start 2024-09-12T17:29:46.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.204+0000 7f3f1bf25800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e9675235f0 0x55e96761c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.204+0000 7f3f1bf25800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e96752a030 con 0x55e9675235f0 2024-09-12T17:29:46.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.204+0000 7f3f17bb5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e9675235f0 0x55e96761c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.204+0000 7f3f17bb5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e9675235f0 0x55e96761c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34638/0 (socket says 172.21.15.170:34638) 2024-09-12T17:29:46.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.204+0000 7f3f17bb5640 1 -- 172.21.15.170:0/2756496832 learned_addr learned my addr 172.21.15.170:0/2756496832 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:46.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.204+0000 7f3f17bb5640 1 -- 172.21.15.170:0/2756496832 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e96761c780 con 0x55e9675235f0 2024-09-12T17:29:46.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.204+0000 7f3f17bb5640 1 --2- 172.21.15.170:0/2756496832 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e9675235f0 0x55e96761c220 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x55e967522890 tx=0x7f3f08000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.205+0000 7f3dfffff640 1 -- 172.21.15.170:0/2756496832 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f0800ee10 con 0x55e9675235f0 2024-09-12T17:29:46.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.205+0000 7f3dfffff640 1 -- 172.21.15.170:0/2756496832 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f0800fa30 con 0x55e9675235f0 2024-09-12T17:29:46.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.205+0000 7f3f1bf25800 1 -- 172.21.15.170:0/2756496832 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e96761ca10 con 0x55e9675235f0 2024-09-12T17:29:46.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.205+0000 7f3dfffff640 1 -- 172.21.15.170:0/2756496832 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f0800fd30 con 0x55e9675235f0 2024-09-12T17:29:46.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.205+0000 7f3f1bf25800 1 -- 172.21.15.170:0/2756496832 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e96761d410 con 0x55e9675235f0 2024-09-12T17:29:46.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.205+0000 7f3f1bf25800 1 Processor -- start 2024-09-12T17:29:46.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.206+0000 7f3f1bf25800 1 -- start start 2024-09-12T17:29:46.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.206+0000 7f3f1bf25800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e967629710 0x55e96762bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.206+0000 7f3f1bf25800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e967419a00 con 0x55e967629710 2024-09-12T17:29:46.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.206+0000 7f3dfffff640 1 -- 172.21.15.170:0/2756496832 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3f08017070 con 0x55e9675235f0 2024-09-12T17:29:46.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.206+0000 7f3f183b6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e967629710 0x55e96762bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.206+0000 7f3f183b6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e967629710 0x55e96762bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34652/0 (socket says 172.21.15.170:34652) 2024-09-12T17:29:46.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.206+0000 7f3f183b6640 1 -- 172.21.15.170:0/3400993746 learned_addr learned my addr 172.21.15.170:0/3400993746 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:46.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.206+0000 7f3dfffff640 1 --2- 172.21.15.170:0/2756496832 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3e0003c730 0x7f3e0003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.206+0000 7f3dfffff640 1 -- 172.21.15.170:0/2756496832 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f3f08015020 con 0x55e9675235f0 2024-09-12T17:29:46.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.206+0000 7f3f17bb5640 1 --2- 172.21.15.170:0/2756496832 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3e0003c730 0x7f3e0003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.206+0000 7f3f183b6640 1 -- 172.21.15.170:0/3400993746 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e96762c0d0 con 0x55e967629710 2024-09-12T17:29:46.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.206+0000 7f3f183b6640 1 --2- 172.21.15.170:0/3400993746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e967629710 0x55e96762bb00 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f3f1000a3e0 tx=0x7f3f1000a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab308c1b53bd4f3d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.206+0000 7f3f17bb5640 1 --2- 172.21.15.170:0/2756496832 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3e0003c730 0x7f3e0003ebf0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3f08001710 tx=0x7f3f08035040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.207+0000 7f3dfdffb640 1 -- 172.21.15.170:0/3400993746 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f10015070 con 0x55e967629710 2024-09-12T17:29:46.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.207+0000 7f3dfdffb640 1 -- 172.21.15.170:0/3400993746 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f10001670 con 0x55e967629710 2024-09-12T17:29:46.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.207+0000 7f3dfdffb640 1 -- 172.21.15.170:0/3400993746 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f10001990 con 0x55e967629710 2024-09-12T17:29:46.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.207+0000 7f3f1bf25800 1 -- 172.21.15.170:0/3400993746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e967629710 msgr2=0x55e96762bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.207+0000 7f3f1bf25800 1 --2- 172.21.15.170:0/3400993746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e967629710 0x55e96762bb00 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f3f1000a3e0 tx=0x7f3f1000a8a0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.207+0000 7f3f1bf25800 1 -- 172.21.15.170:0/3400993746 shutdown_connections 2024-09-12T17:29:46.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.207+0000 7f3f1bf25800 1 --2- 172.21.15.170:0/3400993746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e967629710 0x55e96762bb00 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.207+0000 7f3f1bf25800 1 -- 172.21.15.170:0/3400993746 >> 172.21.15.170:0/3400993746 conn(0x55e9675271f0 msgr2=0x55e967624030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:46.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.207+0000 7f3f1bf25800 1 -- 172.21.15.170:0/3400993746 shutdown_connections 2024-09-12T17:29:46.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.207+0000 7f3f1bf25800 1 -- 172.21.15.170:0/3400993746 wait complete. 2024-09-12T17:29:46.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.207+0000 7f3f1bf25800 1 Processor -- start 2024-09-12T17:29:46.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.207+0000 7f3f1bf25800 1 -- start start 2024-09-12T17:29:46.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.207+0000 7f3f1bf25800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e967629710 0x55e9676305b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.207+0000 7f3f1bf25800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e96762c420 con 0x55e967629710 2024-09-12T17:29:46.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.208+0000 7f3f183b6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e967629710 0x55e9676305b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.208+0000 7f3f183b6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e967629710 0x55e9676305b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34662/0 (socket says 172.21.15.170:34662) 2024-09-12T17:29:46.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.208+0000 7f3f183b6640 1 -- 172.21.15.170:0/1971313668 learned_addr learned my addr 172.21.15.170:0/1971313668 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:46.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.208+0000 7f3f183b6640 1 -- 172.21.15.170:0/1971313668 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e967630b10 con 0x55e967629710 2024-09-12T17:29:46.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.209+0000 7f3f183b6640 1 --2- 172.21.15.170:0/1971313668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e967629710 0x55e9676305b0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x55e967624a10 tx=0x7f3f10003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.209+0000 7f3df7fff640 1 -- 172.21.15.170:0/1971313668 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f10020020 con 0x55e967629710 2024-09-12T17:29:46.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.209+0000 7f3df7fff640 1 -- 172.21.15.170:0/1971313668 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f10010780 con 0x55e967629710 2024-09-12T17:29:46.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.209+0000 7f3f1bf25800 1 -- 172.21.15.170:0/1971313668 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e967630da0 con 0x55e967629710 2024-09-12T17:29:46.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.209+0000 7f3df7fff640 1 -- 172.21.15.170:0/1971313668 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f10015040 con 0x55e967629710 2024-09-12T17:29:46.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.209+0000 7f3f1bf25800 1 -- 172.21.15.170:0/1971313668 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e967631720 con 0x55e967629710 2024-09-12T17:29:46.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.210+0000 7f3df7fff640 1 -- 172.21.15.170:0/1971313668 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3f10023020 con 0x55e967629710 2024-09-12T17:29:46.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.210+0000 7f3df7fff640 1 --2- 172.21.15.170:0/1971313668 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3df003c730 0x7f3df003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.210+0000 7f3df7fff640 1 -- 172.21.15.170:0/1971313668 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f3f10053270 con 0x55e967629710 2024-09-12T17:29:46.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.210+0000 7f3f173b4640 1 --2- 172.21.15.170:0/1971313668 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3df003c730 0x7f3df003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.210+0000 7f3f1bf25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:29:46.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.210+0000 7f3f1bf25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:29:46.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.211+0000 7f3f1bf25800 1 Processor -- start 2024-09-12T17:29:46.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.211+0000 7f3f173b4640 1 --2- 172.21.15.170:0/1971313668 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3df003c730 0x7f3df003ebf0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c057000 tx=0x7f3f0c052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.211+0000 7f3f1bf25800 1 -- start start 2024-09-12T17:29:46.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.211+0000 7f3f1bf25800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e96764a460 0x55e96764a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.211+0000 7f3f1bf25800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e967521600 con 0x55e96764a460 2024-09-12T17:29:46.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.211+0000 7f3f17bb5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e96764a460 0x55e96764a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.211+0000 7f3f17bb5640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e96764a460 0x55e96764a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34670/0 (socket says 172.21.15.170:34670) 2024-09-12T17:29:46.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.211+0000 7f3f17bb5640 1 -- 172.21.15.170:0/2108188088 learned_addr learned my addr 172.21.15.170:0/2108188088 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:46.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.211+0000 7f3f17bb5640 1 -- 172.21.15.170:0/2108188088 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e96764aec0 con 0x55e96764a460 2024-09-12T17:29:46.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.212+0000 7f3f17bb5640 1 --2- 172.21.15.170:0/2108188088 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e96764a460 0x55e96764a880 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f3f0801b760 tx=0x7f3f08001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.212+0000 7f3d97fff640 1 -- 172.21.15.170:0/2108188088 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f0801ae50 con 0x55e96764a460 2024-09-12T17:29:46.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.212+0000 7f3d97fff640 1 -- 172.21.15.170:0/2108188088 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f0801b3d0 con 0x55e96764a460 2024-09-12T17:29:46.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.212+0000 7f3f1bf25800 1 -- 172.21.15.170:0/2108188088 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e96764b6f0 con 0x55e96764a460 2024-09-12T17:29:46.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.212+0000 7f3d97fff640 1 -- 172.21.15.170:0/2108188088 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f08017720 con 0x55e96764a460 2024-09-12T17:29:46.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.212+0000 7f3f1bf25800 1 -- 172.21.15.170:0/2108188088 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e96764bc90 con 0x55e96764a460 2024-09-12T17:29:46.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.212+0000 7f3d97fff640 1 -- 172.21.15.170:0/2108188088 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3f0803a070 con 0x55e96764a460 2024-09-12T17:29:46.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.213+0000 7f3d97fff640 1 --2- 172.21.15.170:0/2108188088 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3d5803c8d0 0x7f3d5803ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.213+0000 7f3d97fff640 1 -- 172.21.15.170:0/2108188088 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f3f08045030 con 0x55e96764a460 2024-09-12T17:29:46.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.213+0000 7f3f173b4640 1 --2- 172.21.15.170:0/2108188088 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3d5803c8d0 0x7f3d5803ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.213+0000 7f3d95ffb640 20 reqs_thread_entry: start 2024-09-12T17:29:46.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.213+0000 7f3f173b4640 1 --2- 172.21.15.170:0/2108188088 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3d5803c8d0 0x7f3d5803ed90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c000c00 tx=0x7f3f0c005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.213+0000 7f3f1bf25800 1 --2- 172.21.15.170:0/2756496832 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55e967657d80 0x55e96765a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.213+0000 7f3f1bf25800 1 -- 172.21.15.170:0/2756496832 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e96765a810 con 0x55e967657d80 2024-09-12T17:29:46.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.213+0000 7f3f183b6640 1 --2- 172.21.15.170:0/2756496832 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55e967657d80 0x55e96765a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.213+0000 7f3f183b6640 1 --2- 172.21.15.170:0/2756496832 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55e967657d80 0x55e96765a1d0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.214+0000 7f3f183b6640 1 -- 172.21.15.170:0/2756496832 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f1000e070 con 0x55e967657d80 2024-09-12T17:29:46.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.214+0000 7f3f1bf25800 1 -- 172.21.15.170:0/2756496832 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e96765b0f0 con 0x55e967657d80 2024-09-12T17:29:46.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.214+0000 7f3f183b6640 1 -- 172.21.15.170:0/2756496832 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3f1000e070 con 0x55e967657d80 2024-09-12T17:29:46.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.214+0000 7f3f1bf25800 1 --2- 172.21.15.170:0/2756496832 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55e96765ca00 0x55e96765ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.214+0000 7f3f1bf25800 1 -- 172.21.15.170:0/2756496832 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e96765f5e0 con 0x55e96765ca00 2024-09-12T17:29:46.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.214+0000 7f3f17bb5640 1 --2- 172.21.15.170:0/2756496832 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55e96765ca00 0x55e96765ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.214+0000 7f3f17bb5640 1 --2- 172.21.15.170:0/2756496832 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55e96765ca00 0x55e96765ee50 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.215+0000 7f3f17bb5640 1 -- 172.21.15.170:0/2756496832 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3f0802e070 con 0x55e96765ca00 2024-09-12T17:29:46.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.215+0000 7f3f1bf25800 1 -- 172.21.15.170:0/2756496832 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e96766c700 con 0x55e967657d80 2024-09-12T17:29:46.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.215+0000 7f3f183b6640 1 -- 172.21.15.170:0/2756496832 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f1000e070 con 0x55e967657d80 2024-09-12T17:29:46.232 INFO:teuthology.orchestra.run.smithi170.stderr:NOTICE: set zone's realm_id= 2024-09-12T17:29:46.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.215+0000 7f3f1bf25800 1 --2- 172.21.15.170:0/2756496832 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55e967663ac0 0x55e9676669f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.215+0000 7f3f1bf25800 1 -- 172.21.15.170:0/2756496832 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e967666570 con 0x55e967663ac0 2024-09-12T17:29:46.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.215+0000 7f3f173b4640 1 --2- 172.21.15.170:0/2756496832 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55e967663ac0 0x55e9676669f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.216+0000 7f3f173b4640 1 --2- 172.21.15.170:0/2756496832 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55e967663ac0 0x55e9676669f0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.216+0000 7f3f173b4640 1 -- 172.21.15.170:0/2756496832 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(5 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f0c057030 con 0x55e967663ac0 2024-09-12T17:29:46.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.216+0000 7f3f173b4640 1 -- 172.21.15.170:0/2756496832 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e967666570 con 0x55e96765ca00 2024-09-12T17:29:46.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.216+0000 7f3f17bb5640 1 -- 172.21.15.170:0/2756496832 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f0802e070 con 0x55e96765ca00 2024-09-12T17:29:46.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.216+0000 7f3f17bb5640 1 --2- 172.21.15.170:0/2756496832 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f3f0800f070 0x7f3f0803d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.216+0000 7f3f17bb5640 1 -- 172.21.15.170:0/2756496832 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e967666570 con 0x7f3f0800f070 2024-09-12T17:29:46.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.216+0000 7f3f183b6640 1 --2- 172.21.15.170:0/2756496832 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f3f0800f070 0x7f3f0803d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.217+0000 7f3f183b6640 1 --2- 172.21.15.170:0/2756496832 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f3f0800f070 0x7f3f0803d870 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.217+0000 7f3f183b6640 1 -- 172.21.15.170:0/2756496832 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f1000e070 con 0x7f3f0800f070 2024-09-12T17:29:46.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.217+0000 7f3f183b6640 1 -- 172.21.15.170:0/2756496832 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e967666570 con 0x55e967657d80 2024-09-12T17:29:46.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.217+0000 7f3f183b6640 1 -- 172.21.15.170:0/2756496832 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f1000e070 con 0x55e967657d80 2024-09-12T17:29:46.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.217+0000 7f3f183b6640 1 -- 172.21.15.170:0/2756496832 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e967666570 con 0x55e967657d80 2024-09-12T17:29:46.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.217+0000 7f3f183b6640 1 -- 172.21.15.170:0/2756496832 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f1000e070 con 0x55e967657d80 2024-09-12T17:29:46.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.217+0000 7f3f183b6640 1 -- 172.21.15.170:0/2756496832 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e967666570 con 0x7f3f0800f070 2024-09-12T17:29:46.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.218+0000 7f3f183b6640 1 -- 172.21.15.170:0/2756496832 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f1000e070 con 0x7f3f0800f070 2024-09-12T17:29:46.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.218+0000 7f3f183b6640 1 -- 172.21.15.170:0/2756496832 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e967666570 con 0x7f3f0800f070 2024-09-12T17:29:46.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.218+0000 7f3f183b6640 1 -- 172.21.15.170:0/2756496832 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f1000e070 con 0x7f3f0800f070 2024-09-12T17:29:46.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.218+0000 7f3f183b6640 1 -- 172.21.15.170:0/2756496832 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e967666570 con 0x55e96765ca00 2024-09-12T17:29:46.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.218+0000 7f3f17bb5640 1 -- 172.21.15.170:0/2756496832 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f0802e070 con 0x55e96765ca00 2024-09-12T17:29:46.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.218+0000 7f3f17bb5640 1 -- 172.21.15.170:0/2756496832 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e967666570 con 0x55e967663ac0 2024-09-12T17:29:46.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.218+0000 7f3f173b4640 1 -- 172.21.15.170:0/2756496832 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f0c057030 con 0x55e967663ac0 2024-09-12T17:29:46.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.218+0000 7f3f173b4640 1 -- 172.21.15.170:0/2756496832 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e967666570 con 0x55e967657d80 2024-09-12T17:29:46.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.218+0000 7f3f183b6640 1 -- 172.21.15.170:0/2756496832 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f1000e070 con 0x55e967657d80 2024-09-12T17:29:46.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.218+0000 7f3f183b6640 1 -- 172.21.15.170:0/2756496832 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e967666570 con 0x7f3f0800f070 2024-09-12T17:29:46.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.219+0000 7f3f183b6640 1 -- 172.21.15.170:0/2756496832 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f1000e070 con 0x7f3f0800f070 2024-09-12T17:29:46.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.219+0000 7f3f183b6640 1 -- 172.21.15.170:0/2756496832 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e967666570 con 0x55e967657d80 2024-09-12T17:29:46.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.219+0000 7f3f183b6640 1 -- 172.21.15.170:0/2756496832 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f1000e070 con 0x55e967657d80 2024-09-12T17:29:46.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.219+0000 7f3f183b6640 1 -- 172.21.15.170:0/2756496832 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e967666570 con 0x55e96765ca00 2024-09-12T17:29:46.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.219+0000 7f3f17bb5640 1 -- 172.21.15.170:0/2756496832 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(17 [pgnls start_epoch 31 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f3f0802e070 con 0x55e96765ca00 2024-09-12T17:29:46.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.219+0000 7f3f17bb5640 1 -- 172.21.15.170:0/2756496832 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e967666570 con 0x55e967663ac0 2024-09-12T17:29:46.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.219+0000 7f3f173b4640 1 -- 172.21.15.170:0/2756496832 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f0c057030 con 0x55e967663ac0 2024-09-12T17:29:46.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.219+0000 7f3f173b4640 1 -- 172.21.15.170:0/2756496832 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e967666570 con 0x55e967663ac0 2024-09-12T17:29:46.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.220+0000 7f3f173b4640 1 -- 172.21.15.170:0/2756496832 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f0c057030 con 0x55e967663ac0 2024-09-12T17:29:46.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.220+0000 7f3f173b4640 1 -- 172.21.15.170:0/2756496832 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e967666570 con 0x55e96765ca00 2024-09-12T17:29:46.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.220+0000 7f3f17bb5640 1 -- 172.21.15.170:0/2756496832 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f0802e070 con 0x55e96765ca00 2024-09-12T17:29:46.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.220+0000 7f3f17bb5640 1 -- 172.21.15.170:0/2756496832 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e967666570 con 0x55e967663ac0 2024-09-12T17:29:46.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.220+0000 7f3f173b4640 1 -- 172.21.15.170:0/2756496832 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f0c057030 con 0x55e967663ac0 2024-09-12T17:29:46.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.220+0000 7f3f173b4640 1 -- 172.21.15.170:0/2756496832 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e967666570 con 0x55e967663ac0 2024-09-12T17:29:46.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.220+0000 7f3f173b4640 1 -- 172.21.15.170:0/2756496832 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f0c057030 con 0x55e967663ac0 2024-09-12T17:29:46.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.220+0000 7f3f173b4640 1 -- 172.21.15.170:0/2756496832 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e967666570 con 0x55e967657d80 2024-09-12T17:29:46.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.220+0000 7f3f183b6640 1 -- 172.21.15.170:0/2756496832 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f1000e070 con 0x55e967657d80 2024-09-12T17:29:46.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.220+0000 7f3f183b6640 1 -- 172.21.15.170:0/2756496832 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e967666570 con 0x55e967657d80 2024-09-12T17:29:46.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.221+0000 7f3f183b6640 1 -- 172.21.15.170:0/2756496832 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3f1000e070 con 0x55e967657d80 2024-09-12T17:29:46.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.221+0000 7f3f183b6640 1 -- 172.21.15.170:0/2756496832 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e967666570 con 0x7f3f0800f070 2024-09-12T17:29:46.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.221+0000 7f3f183b6640 1 -- 172.21.15.170:0/2756496832 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(25 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f1000e070 con 0x7f3f0800f070 2024-09-12T17:29:46.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.221+0000 7f3f183b6640 1 -- 172.21.15.170:0/2756496832 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e967666570 con 0x55e967663ac0 2024-09-12T17:29:46.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.221+0000 7f3f173b4640 1 -- 172.21.15.170:0/2756496832 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f0c057030 con 0x55e967663ac0 2024-09-12T17:29:46.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.221+0000 7f3f173b4640 1 -- 172.21.15.170:0/2756496832 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e967666570 con 0x55e96765ca00 2024-09-12T17:29:46.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.221+0000 7f3f17bb5640 1 -- 172.21.15.170:0/2756496832 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f0802e070 con 0x55e96765ca00 2024-09-12T17:29:46.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.221+0000 7f3f17bb5640 1 -- 172.21.15.170:0/2756496832 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e967666570 con 0x55e967657d80 2024-09-12T17:29:46.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.222+0000 7f3f183b6640 1 -- 172.21.15.170:0/2756496832 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f1000e070 con 0x55e967657d80 2024-09-12T17:29:46.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.222+0000 7f3f183b6640 1 -- 172.21.15.170:0/2756496832 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e967666570 con 0x7f3f0800f070 2024-09-12T17:29:46.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.222+0000 7f3f183b6640 1 -- 172.21.15.170:0/2756496832 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f1000e070 con 0x7f3f0800f070 2024-09-12T17:29:46.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.222+0000 7f3f183b6640 1 -- 172.21.15.170:0/2756496832 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e967666570 con 0x55e967663ac0 2024-09-12T17:29:46.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.222+0000 7f3f173b4640 1 -- 172.21.15.170:0/2756496832 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f0c057030 con 0x55e967663ac0 2024-09-12T17:29:46.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.222+0000 7f3f173b4640 1 -- 172.21.15.170:0/2756496832 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e967666570 con 0x7f3f0800f070 2024-09-12T17:29:46.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.222+0000 7f3f183b6640 1 -- 172.21.15.170:0/2756496832 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f1000e070 con 0x7f3f0800f070 2024-09-12T17:29:46.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.222+0000 7f3f183b6640 1 -- 172.21.15.170:0/2756496832 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e967666570 con 0x55e96765ca00 2024-09-12T17:29:46.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.223+0000 7f3f17bb5640 1 -- 172.21.15.170:0/2756496832 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f0806d040 con 0x55e96765ca00 2024-09-12T17:29:46.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.223+0000 7f3f17bb5640 1 -- 172.21.15.170:0/2756496832 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e967666570 con 0x55e967663ac0 2024-09-12T17:29:46.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.223+0000 7f3f173b4640 1 -- 172.21.15.170:0/2756496832 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f0c057030 con 0x55e967663ac0 2024-09-12T17:29:46.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.223+0000 7f3f173b4640 1 -- 172.21.15.170:0/2756496832 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e967666570 con 0x7f3f0800f070 2024-09-12T17:29:46.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.223+0000 7f3f183b6640 1 -- 172.21.15.170:0/2756496832 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f1000e070 con 0x7f3f0800f070 2024-09-12T17:29:46.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.223+0000 7f3f183b6640 1 -- 172.21.15.170:0/2756496832 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e967666570 con 0x55e967657d80 2024-09-12T17:29:46.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.223+0000 7f3f183b6640 1 -- 172.21.15.170:0/2756496832 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(35 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3f1000e070 con 0x55e967657d80 2024-09-12T17:29:46.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.223+0000 7f3f183b6640 1 -- 172.21.15.170:0/2756496832 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e967666570 con 0x55e96765ca00 2024-09-12T17:29:46.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.224+0000 7f3f17bb5640 1 -- 172.21.15.170:0/2756496832 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(36 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3f0806d040 con 0x55e96765ca00 2024-09-12T17:29:46.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.224+0000 7f3f1bf25800 1 -- 172.21.15.170:0/2756496832 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e96766a5d0 con 0x55e967657d80 2024-09-12T17:29:46.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.224+0000 7f3f183b6640 1 -- 172.21.15.170:0/2756496832 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3f1000e070 con 0x55e967657d80 2024-09-12T17:29:46.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.224+0000 7f3f1bf25800 1 -- 172.21.15.170:0/2756496832 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:38 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e967668f50 con 0x55e96765ca00 2024-09-12T17:29:46.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.224+0000 7f3f17bb5640 1 -- 172.21.15.170:0/2756496832 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(38 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3f0806d040 con 0x55e96765ca00 2024-09-12T17:29:46.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.224+0000 7f3f1bf25800 1 -- 172.21.15.170:0/2756496832 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:39 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [create,call version.set in=58b,writefull 0~1155 in=1155b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e967665e00 con 0x55e96765ca00 2024-09-12T17:29:46.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.225+0000 7f3f17bb5640 1 -- 172.21.15.170:0/2756496832 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(39 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [create,call,writefull 0~1155] v31'3 uv3 ondisk = 0) ==== 274+0+0 (crc 0 0 0) 0x7f3f0806d040 con 0x55e96765ca00 2024-09-12T17:29:46.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.225+0000 7f3f1bf25800 1 -- 172.21.15.170:0/2756496832 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e967667ba0 con 0x55e967657d80 2024-09-12T17:29:46.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.227+0000 7f3f183b6640 1 -- 172.21.15.170:0/2756496832 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v31'3 uv3 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f3f1000e070 con 0x55e967657d80 2024-09-12T17:29:46.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.227+0000 7f3f1bf25800 1 -- 172.21.15.170:0/2756496832 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e96766bfa0 con 0x55e967657d80 2024-09-12T17:29:46.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.228+0000 7f3f183b6640 1 -- 172.21.15.170:0/2756496832 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v31'2 uv1 ondisk = -17 ((17) File exists)) ==== 199+0+0 (crc 0 0 0) 0x7f3f1000e070 con 0x55e967657d80 2024-09-12T17:29:46.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.228+0000 7f3f1bf25800 1 -- 172.21.15.170:0/1971313668 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3df003c730 msgr2=0x7f3df003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.228+0000 7f3f1bf25800 1 --2- 172.21.15.170:0/1971313668 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3df003c730 0x7f3df003ebf0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c057000 tx=0x7f3f0c052000 comp rx=0 tx=0).stop 2024-09-12T17:29:46.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.228+0000 7f3f1bf25800 1 -- 172.21.15.170:0/1971313668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e967629710 msgr2=0x55e9676305b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.228+0000 7f3f1bf25800 1 --2- 172.21.15.170:0/1971313668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e967629710 0x55e9676305b0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x55e967624a10 tx=0x7f3f10003370 comp rx=0 tx=0).stop 2024-09-12T17:29:46.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.228+0000 7f3f1bf25800 1 -- 172.21.15.170:0/1971313668 shutdown_connections 2024-09-12T17:29:46.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.228+0000 7f3f1bf25800 1 --2- 172.21.15.170:0/1971313668 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3df003c730 0x7f3df003ebf0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.228+0000 7f3f1bf25800 1 --2- 172.21.15.170:0/1971313668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e967629710 0x55e9676305b0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.228+0000 7f3f1bf25800 1 -- 172.21.15.170:0/1971313668 >> 172.21.15.170:0/1971313668 conn(0x55e9675271f0 msgr2=0x55e967624000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:46.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.229+0000 7f3f1bf25800 1 -- 172.21.15.170:0/1971313668 shutdown_connections 2024-09-12T17:29:46.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.229+0000 7f3f1bf25800 1 -- 172.21.15.170:0/1971313668 wait complete. 2024-09-12T17:29:46.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.229+0000 7f3f1bf25800 1 -- 172.21.15.170:0/2108188088 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3d5803c8d0 msgr2=0x7f3d5803ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.229+0000 7f3f1bf25800 1 --2- 172.21.15.170:0/2108188088 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3d5803c8d0 0x7f3d5803ed90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c000c00 tx=0x7f3f0c005ac0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.229+0000 7f3f1bf25800 1 -- 172.21.15.170:0/2108188088 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e96764a460 msgr2=0x55e96764a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.229+0000 7f3f1bf25800 1 --2- 172.21.15.170:0/2108188088 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e96764a460 0x55e96764a880 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f3f0801b760 tx=0x7f3f08001640 comp rx=0 tx=0).stop 2024-09-12T17:29:46.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.229+0000 7f3f1bf25800 1 -- 172.21.15.170:0/2108188088 shutdown_connections 2024-09-12T17:29:46.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.229+0000 7f3f1bf25800 1 --2- 172.21.15.170:0/2108188088 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3d5803c8d0 0x7f3d5803ed90 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.229+0000 7f3f1bf25800 1 --2- 172.21.15.170:0/2108188088 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e96764a460 0x55e96764a880 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.229+0000 7f3f1bf25800 1 -- 172.21.15.170:0/2108188088 >> 172.21.15.170:0/2108188088 conn(0x55e96763f9c0 msgr2=0x55e96763fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:46.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.229+0000 7f3f1bf25800 1 -- 172.21.15.170:0/2108188088 shutdown_connections 2024-09-12T17:29:46.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.229+0000 7f3f1bf25800 1 -- 172.21.15.170:0/2108188088 wait complete. 2024-09-12T17:29:46.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.229+0000 7f3f1bf25800 1 -- 172.21.15.170:0/2756496832 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f3f0800f070 msgr2=0x7f3f0803d870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.229+0000 7f3f1bf25800 1 --2- 172.21.15.170:0/2756496832 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f3f0800f070 0x7f3f0803d870 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.229+0000 7f3f1bf25800 1 -- 172.21.15.170:0/2756496832 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55e967657d80 msgr2=0x55e96765a1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.229+0000 7f3f1bf25800 1 --2- 172.21.15.170:0/2756496832 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55e967657d80 0x55e96765a1d0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.229+0000 7f3f1bf25800 1 -- 172.21.15.170:0/2756496832 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55e96765ca00 msgr2=0x55e96765ee50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.229+0000 7f3f1bf25800 1 --2- 172.21.15.170:0/2756496832 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55e96765ca00 0x55e96765ee50 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.229+0000 7f3f1bf25800 1 -- 172.21.15.170:0/2756496832 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55e967663ac0 msgr2=0x55e9676669f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.229+0000 7f3f1bf25800 1 --2- 172.21.15.170:0/2756496832 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55e967663ac0 0x55e9676669f0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.229+0000 7f3f1bf25800 1 -- 172.21.15.170:0/2756496832 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3e0003c730 msgr2=0x7f3e0003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.229+0000 7f3f1bf25800 1 --2- 172.21.15.170:0/2756496832 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3e0003c730 0x7f3e0003ebf0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3f08001710 tx=0x7f3f08035040 comp rx=0 tx=0).stop 2024-09-12T17:29:46.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.229+0000 7f3f183b6640 1 -- 172.21.15.170:0/2756496832 reap_dead start 2024-09-12T17:29:46.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.229+0000 7f3f1bf25800 1 -- 172.21.15.170:0/2756496832 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e9675235f0 msgr2=0x55e96761c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.229+0000 7f3f1bf25800 1 --2- 172.21.15.170:0/2756496832 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e9675235f0 0x55e96761c220 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x55e967522890 tx=0x7f3f08000ed0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.230+0000 7f3f1bf25800 1 -- 172.21.15.170:0/2756496832 shutdown_connections 2024-09-12T17:29:46.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.230+0000 7f3f1bf25800 1 --2- 172.21.15.170:0/2756496832 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e9675235f0 0x55e96761c220 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.230+0000 7f3f1bf25800 1 -- 172.21.15.170:0/2756496832 >> 172.21.15.170:0/2756496832 conn(0x55e96751d1b0 msgr2=0x55e96760db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:46.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.230+0000 7f3f1bf25800 1 -- 172.21.15.170:0/2756496832 shutdown_connections 2024-09-12T17:29:46.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.230+0000 7f3f1bf25800 1 -- 172.21.15.170:0/2756496832 wait complete. 2024-09-12T17:29:46.243 INFO:teuthology.orchestra.run.smithi170.stdout:{"id":"7f05c86a-1902-4046-a99f-31d6f38ce8f7","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T17:29:46.243 DEBUG:tasks.util.rgw: json result: {'id': '7f05c86a-1902-4046-a99f-31d6f38ce8f7', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T17:29:46.243 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-09-12T17:29:46.243 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-09-12T17:29:46.244 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-09-12T17:29:46.326 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:29:46.326 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:29:46.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.325+0000 7f058e416800 1 Processor -- start 2024-09-12T17:29:46.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.325+0000 7f058e416800 1 -- start start 2024-09-12T17:29:46.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.325+0000 7f058e416800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x556a4f39a1f0 0x556a4f39c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.325+0000 7f058e416800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556a4f23fe40 con 0x556a4f3965f0 2024-09-12T17:29:46.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.325+0000 7f058e416800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x556a4f20a680 con 0x556a4f39a1f0 2024-09-12T17:29:46.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.326+0000 7f05893e6640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x556a4f39a1f0 0x556a4f39c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.326+0000 7f05893e6640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x556a4f39a1f0 0x556a4f39c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34674/0 (socket says 172.21.15.170:34674) 2024-09-12T17:29:46.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.326+0000 7f05893e6640 1 -- 172.21.15.170:0/1590396652 learned_addr learned my addr 172.21.15.170:0/1590396652 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:46.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.326+0000 7f05893e6640 1 -- 172.21.15.170:0/1590396652 >> v1:172.21.15.47:6789/0 conn(0x556a4f3965f0 legacy=0x556a4f3989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.326+0000 7f05893e6640 1 -- 172.21.15.170:0/1590396652 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a4f2266b0 con 0x556a4f39a1f0 2024-09-12T17:29:46.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.328+0000 7f05893e6640 1 --2- 172.21.15.170:0/1590396652 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a4f39a1f0 0x556a4f39c6b0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f057400a520 tx=0x7f0574045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25b10a3efd6bdd2c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.328+0000 7f0588be5640 1 -- 172.21.15.170:0/1590396652 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0574055070 con 0x556a4f39a1f0 2024-09-12T17:29:46.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.328+0000 7f0588be5640 1 -- 172.21.15.170:0/1590396652 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05740515b0 con 0x556a4f39a1f0 2024-09-12T17:29:46.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.328+0000 7f0588be5640 1 -- 172.21.15.170:0/1590396652 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05740518d0 con 0x556a4f39a1f0 2024-09-12T17:29:46.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.329+0000 7f058e416800 1 -- 172.21.15.170:0/1590396652 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a4f39a1f0 msgr2=0x556a4f39c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.329+0000 7f058e416800 1 --2- 172.21.15.170:0/1590396652 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a4f39a1f0 0x556a4f39c6b0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f057400a520 tx=0x7f0574045ba0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.329+0000 7f058e416800 1 -- 172.21.15.170:0/1590396652 shutdown_connections 2024-09-12T17:29:46.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.329+0000 7f058e416800 1 --2- 172.21.15.170:0/1590396652 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a4f39a1f0 0x556a4f39c6b0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.329+0000 7f058e416800 1 -- 172.21.15.170:0/1590396652 >> 172.21.15.170:0/1590396652 conn(0x556a4f3901b0 msgr2=0x556a4f392610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:46.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.329+0000 7f058e416800 1 -- 172.21.15.170:0/1590396652 shutdown_connections 2024-09-12T17:29:46.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.329+0000 7f058e416800 1 -- 172.21.15.170:0/1590396652 wait complete. 2024-09-12T17:29:46.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.342+0000 7f058e416800 1 Processor -- start 2024-09-12T17:29:46.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.342+0000 7f058e416800 1 -- start start 2024-09-12T17:29:46.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.343+0000 7f058e416800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a4f3965f0 0x556a4f485670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.343+0000 7f058e416800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556a4f22edd0 con 0x556a4f3965f0 2024-09-12T17:29:46.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.343+0000 7f0589be7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a4f3965f0 0x556a4f485670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.343+0000 7f0589be7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a4f3965f0 0x556a4f485670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34676/0 (socket says 172.21.15.170:34676) 2024-09-12T17:29:46.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.343+0000 7f0589be7640 1 -- 172.21.15.170:0/1925770606 learned_addr learned my addr 172.21.15.170:0/1925770606 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:46.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.343+0000 7f0589be7640 1 -- 172.21.15.170:0/1925770606 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a4f247e10 con 0x556a4f3965f0 2024-09-12T17:29:46.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.343+0000 7f0589be7640 1 --2- 172.21.15.170:0/1925770606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a4f3965f0 0x556a4f485670 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f057c001da0 tx=0x7f057c00b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bebe7be49c7d6dc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.344+0000 7f0477e07640 1 -- 172.21.15.170:0/1925770606 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f057c00f400 con 0x556a4f3965f0 2024-09-12T17:29:46.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.344+0000 7f0477e07640 1 -- 172.21.15.170:0/1925770606 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f057c00f5a0 con 0x556a4f3965f0 2024-09-12T17:29:46.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.344+0000 7f0477e07640 1 -- 172.21.15.170:0/1925770606 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f057c00f8c0 con 0x556a4f3965f0 2024-09-12T17:29:46.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.344+0000 7f058e416800 1 -- 172.21.15.170:0/1925770606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a4f3965f0 msgr2=0x556a4f485670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.344+0000 7f058e416800 1 --2- 172.21.15.170:0/1925770606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a4f3965f0 0x556a4f485670 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f057c001da0 tx=0x7f057c00b5b0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.344+0000 7f058e416800 1 -- 172.21.15.170:0/1925770606 shutdown_connections 2024-09-12T17:29:46.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.344+0000 7f058e416800 1 --2- 172.21.15.170:0/1925770606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a4f3965f0 0x556a4f485670 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.344+0000 7f058e416800 1 -- 172.21.15.170:0/1925770606 >> 172.21.15.170:0/1925770606 conn(0x556a4f3901b0 msgr2=0x556a4f480ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:46.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.344+0000 7f058e416800 1 -- 172.21.15.170:0/1925770606 shutdown_connections 2024-09-12T17:29:46.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.344+0000 7f058e416800 1 -- 172.21.15.170:0/1925770606 wait complete. 2024-09-12T17:29:46.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.345+0000 7f058e416800 1 Processor -- start 2024-09-12T17:29:46.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.345+0000 7f058e416800 1 -- start start 2024-09-12T17:29:46.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.345+0000 7f058e416800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a4f3965f0 0x556a4f48cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.345+0000 7f058e416800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556a4f39d030 con 0x556a4f3965f0 2024-09-12T17:29:46.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.345+0000 7f0589be7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a4f3965f0 0x556a4f48cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.345+0000 7f0589be7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a4f3965f0 0x556a4f48cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34682/0 (socket says 172.21.15.170:34682) 2024-09-12T17:29:46.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.345+0000 7f0589be7640 1 -- 172.21.15.170:0/406814303 learned_addr learned my addr 172.21.15.170:0/406814303 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:46.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.345+0000 7f0589be7640 1 -- 172.21.15.170:0/406814303 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a4f48d530 con 0x556a4f3965f0 2024-09-12T17:29:46.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.346+0000 7f0589be7640 1 --2- 172.21.15.170:0/406814303 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a4f3965f0 0x556a4f48cfd0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x556a4f486600 tx=0x7f057c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.346+0000 7f0476604640 1 -- 172.21.15.170:0/406814303 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f057c01a7c0 con 0x556a4f3965f0 2024-09-12T17:29:46.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.346+0000 7f0476604640 1 -- 172.21.15.170:0/406814303 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f057c01a980 con 0x556a4f3965f0 2024-09-12T17:29:46.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.346+0000 7f058e416800 1 -- 172.21.15.170:0/406814303 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556a4f48d7c0 con 0x556a4f3965f0 2024-09-12T17:29:46.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.346+0000 7f0476604640 1 -- 172.21.15.170:0/406814303 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f057c01aca0 con 0x556a4f3965f0 2024-09-12T17:29:46.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.346+0000 7f058e416800 1 -- 172.21.15.170:0/406814303 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a4f48e3d0 con 0x556a4f3965f0 2024-09-12T17:29:46.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.346+0000 7f058e416800 1 Processor -- start 2024-09-12T17:29:46.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.347+0000 7f058e416800 1 -- start start 2024-09-12T17:29:46.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.347+0000 7f058e416800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a4f49a520 0x556a4f49c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.347+0000 7f058e416800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556a4f28ca00 con 0x556a4f49a520 2024-09-12T17:29:46.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.347+0000 7f0476604640 1 -- 172.21.15.170:0/406814303 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f057c017070 con 0x556a4f3965f0 2024-09-12T17:29:46.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.347+0000 7f058a3e8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a4f49a520 0x556a4f49c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.347+0000 7f058a3e8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a4f49a520 0x556a4f49c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34684/0 (socket says 172.21.15.170:34684) 2024-09-12T17:29:46.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.347+0000 7f058a3e8640 1 -- 172.21.15.170:0/3632286008 learned_addr learned my addr 172.21.15.170:0/3632286008 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:46.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.347+0000 7f0476604640 1 --2- 172.21.15.170:0/406814303 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f047003c7d0 0x7f047003ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.347+0000 7f0476604640 1 -- 172.21.15.170:0/406814303 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f057c015020 con 0x556a4f3965f0 2024-09-12T17:29:46.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.347+0000 7f0589be7640 1 --2- 172.21.15.170:0/406814303 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f047003c7d0 0x7f047003ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.347+0000 7f058a3e8640 1 -- 172.21.15.170:0/3632286008 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a4f49cee0 con 0x556a4f49a520 2024-09-12T17:29:46.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.347+0000 7f058a3e8640 1 --2- 172.21.15.170:0/3632286008 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a4f49a520 0x556a4f49c910 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f058400a3e0 tx=0x7f058400a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62a99d2e5077a6be server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.347+0000 7f0589be7640 1 --2- 172.21.15.170:0/406814303 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f047003c7d0 0x7f047003ec90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f057c00bfb0 tx=0x7f057c034040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.348+0000 7f046ffff640 1 -- 172.21.15.170:0/3632286008 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0584015070 con 0x556a4f49a520 2024-09-12T17:29:46.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.348+0000 7f046ffff640 1 -- 172.21.15.170:0/3632286008 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0584001670 con 0x556a4f49a520 2024-09-12T17:29:46.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.348+0000 7f046ffff640 1 -- 172.21.15.170:0/3632286008 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0584001990 con 0x556a4f49a520 2024-09-12T17:29:46.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.348+0000 7f058e416800 1 -- 172.21.15.170:0/3632286008 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a4f49a520 msgr2=0x556a4f49c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.348+0000 7f058e416800 1 --2- 172.21.15.170:0/3632286008 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a4f49a520 0x556a4f49c910 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f058400a3e0 tx=0x7f058400a8a0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.348+0000 7f058e416800 1 -- 172.21.15.170:0/3632286008 shutdown_connections 2024-09-12T17:29:46.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.348+0000 7f058e416800 1 --2- 172.21.15.170:0/3632286008 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a4f49a520 0x556a4f49c910 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.348+0000 7f058e416800 1 -- 172.21.15.170:0/3632286008 >> 172.21.15.170:0/3632286008 conn(0x556a4f39a1f0 msgr2=0x556a4f494e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:46.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.348+0000 7f058e416800 1 -- 172.21.15.170:0/3632286008 shutdown_connections 2024-09-12T17:29:46.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.348+0000 7f058e416800 1 -- 172.21.15.170:0/3632286008 wait complete. 2024-09-12T17:29:46.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.348+0000 7f058e416800 1 Processor -- start 2024-09-12T17:29:46.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.348+0000 7f058e416800 1 -- start start 2024-09-12T17:29:46.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.349+0000 7f058e416800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a4f49a520 0x556a4f395d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.349+0000 7f058e416800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556a4f49d170 con 0x556a4f49a520 2024-09-12T17:29:46.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.349+0000 7f058a3e8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a4f49a520 0x556a4f395d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.349+0000 7f058a3e8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a4f49a520 0x556a4f395d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34686/0 (socket says 172.21.15.170:34686) 2024-09-12T17:29:46.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.349+0000 7f058a3e8640 1 -- 172.21.15.170:0/1719869249 learned_addr learned my addr 172.21.15.170:0/1719869249 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:46.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.349+0000 7f058a3e8640 1 -- 172.21.15.170:0/1719869249 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a4f396270 con 0x556a4f49a520 2024-09-12T17:29:46.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.349+0000 7f058a3e8640 1 --2- 172.21.15.170:0/1719869249 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a4f49a520 0x556a4f395d10 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x556a4f495820 tx=0x7f0584003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.350+0000 7f046e7fc640 1 -- 172.21.15.170:0/1719869249 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0584020020 con 0x556a4f49a520 2024-09-12T17:29:46.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.350+0000 7f046e7fc640 1 -- 172.21.15.170:0/1719869249 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0584010780 con 0x556a4f49a520 2024-09-12T17:29:46.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.350+0000 7f058e416800 1 -- 172.21.15.170:0/1719869249 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556a4f394620 con 0x556a4f49a520 2024-09-12T17:29:46.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.350+0000 7f046e7fc640 1 -- 172.21.15.170:0/1719869249 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0584015040 con 0x556a4f49a520 2024-09-12T17:29:46.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.350+0000 7f058e416800 1 -- 172.21.15.170:0/1719869249 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a4f394b60 con 0x556a4f49a520 2024-09-12T17:29:46.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.350+0000 7f046e7fc640 1 -- 172.21.15.170:0/1719869249 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f0584023020 con 0x556a4f49a520 2024-09-12T17:29:46.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.351+0000 7f046e7fc640 1 --2- 172.21.15.170:0/1719869249 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f046403c730 0x7f046403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.351+0000 7f046e7fc640 1 -- 172.21.15.170:0/1719869249 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f0584053330 con 0x556a4f49a520 2024-09-12T17:29:46.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.351+0000 7f05893e6640 1 --2- 172.21.15.170:0/1719869249 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f046403c730 0x7f046403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.351+0000 7f058e416800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:29:46.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.351+0000 7f058e416800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:29:46.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.351+0000 7f05893e6640 1 --2- 172.21.15.170:0/1719869249 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f046403c730 0x7f046403ebf0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0574057000 tx=0x7f0574052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.351+0000 7f058e416800 1 Processor -- start 2024-09-12T17:29:46.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.352+0000 7f058e416800 1 -- start start 2024-09-12T17:29:46.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.352+0000 7f058e416800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a4f4bd390 0x556a4f4bd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.352+0000 7f058e416800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556a4f485ec0 con 0x556a4f4bd390 2024-09-12T17:29:46.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.352+0000 7f0589be7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a4f4bd390 0x556a4f4bd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.352+0000 7f0589be7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a4f4bd390 0x556a4f4bd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34700/0 (socket says 172.21.15.170:34700) 2024-09-12T17:29:46.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.352+0000 7f0589be7640 1 -- 172.21.15.170:0/1625986284 learned_addr learned my addr 172.21.15.170:0/1625986284 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:46.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.352+0000 7f0589be7640 1 -- 172.21.15.170:0/1625986284 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a4f4bddf0 con 0x556a4f4bd390 2024-09-12T17:29:46.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.352+0000 7f0589be7640 1 --2- 172.21.15.170:0/1625986284 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a4f4bd390 0x556a4f4bd7b0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f057c000c00 tx=0x7f057c017950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.353+0000 7f044efe5640 1 -- 172.21.15.170:0/1625986284 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f057c02c070 con 0x556a4f4bd390 2024-09-12T17:29:46.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.353+0000 7f044efe5640 1 -- 172.21.15.170:0/1625986284 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f057c043020 con 0x556a4f4bd390 2024-09-12T17:29:46.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.353+0000 7f058e416800 1 -- 172.21.15.170:0/1625986284 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556a4f4be620 con 0x556a4f4bd390 2024-09-12T17:29:46.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.353+0000 7f044efe5640 1 -- 172.21.15.170:0/1625986284 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f057c00e700 con 0x556a4f4bd390 2024-09-12T17:29:46.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.353+0000 7f058e416800 1 -- 172.21.15.170:0/1625986284 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a4f4be620 con 0x556a4f4bd390 2024-09-12T17:29:46.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.353+0000 7f044efe5640 1 -- 172.21.15.170:0/1625986284 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f057c00e070 con 0x556a4f4bd390 2024-09-12T17:29:46.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.353+0000 7f044efe5640 1 --2- 172.21.15.170:0/1625986284 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f03c003c690 0x7f03c003eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.353+0000 7f044efe5640 1 -- 172.21.15.170:0/1625986284 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f057c044030 con 0x556a4f4bd390 2024-09-12T17:29:46.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.354+0000 7f05893e6640 1 --2- 172.21.15.170:0/1625986284 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f03c003c690 0x7f03c003eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.354+0000 7f044cfe1640 20 reqs_thread_entry: start 2024-09-12T17:29:46.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.354+0000 7f05893e6640 1 --2- 172.21.15.170:0/1625986284 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f03c003c690 0x7f03c003eb50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0574000c00 tx=0x7f0574005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.354+0000 7f058e416800 1 --2- 172.21.15.170:0/406814303 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x556a4f4caaa0 0x556a4f4ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.354+0000 7f058e416800 1 -- 172.21.15.170:0/406814303 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556a4f4cd5b0 con 0x556a4f4caaa0 2024-09-12T17:29:46.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.354+0000 7f058a3e8640 1 --2- 172.21.15.170:0/406814303 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x556a4f4caaa0 0x556a4f4ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.354+0000 7f058a3e8640 1 --2- 172.21.15.170:0/406814303 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x556a4f4caaa0 0x556a4f4ccf30 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.355+0000 7f058a3e8640 1 -- 172.21.15.170:0/406814303 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f058400e070 con 0x556a4f4caaa0 2024-09-12T17:29:46.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.355+0000 7f058e416800 1 -- 172.21.15.170:0/406814303 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556a4f4cde60 con 0x556a4f4caaa0 2024-09-12T17:29:46.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.355+0000 7f058a3e8640 1 -- 172.21.15.170:0/406814303 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f058400e070 con 0x556a4f4caaa0 2024-09-12T17:29:46.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.355+0000 7f058e416800 1 --2- 172.21.15.170:0/406814303 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556a4f4cf720 0x556a4f4d1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.355+0000 7f058e416800 1 -- 172.21.15.170:0/406814303 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556a4f4d2340 con 0x556a4f4cf720 2024-09-12T17:29:46.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.355+0000 7f0589be7640 1 --2- 172.21.15.170:0/406814303 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556a4f4cf720 0x556a4f4d1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.355+0000 7f0589be7640 1 --2- 172.21.15.170:0/406814303 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556a4f4cf720 0x556a4f4d1bb0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.356+0000 7f0589be7640 1 -- 172.21.15.170:0/406814303 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f057c038040 con 0x556a4f4cf720 2024-09-12T17:29:46.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.356+0000 7f058e416800 1 -- 172.21.15.170:0/1719869249 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f046403c730 msgr2=0x7f046403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.356+0000 7f058e416800 1 --2- 172.21.15.170:0/1719869249 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f046403c730 0x7f046403ebf0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0574057000 tx=0x7f0574052000 comp rx=0 tx=0).stop 2024-09-12T17:29:46.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.356+0000 7f058e416800 1 -- 172.21.15.170:0/1719869249 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a4f49a520 msgr2=0x556a4f395d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.356+0000 7f058e416800 1 --2- 172.21.15.170:0/1719869249 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a4f49a520 0x556a4f395d10 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x556a4f495820 tx=0x7f0584003370 comp rx=0 tx=0).stop 2024-09-12T17:29:46.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.356+0000 7f058e416800 1 -- 172.21.15.170:0/1719869249 shutdown_connections 2024-09-12T17:29:46.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.356+0000 7f058e416800 1 --2- 172.21.15.170:0/1719869249 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f046403c730 0x7f046403ebf0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.356+0000 7f058e416800 1 --2- 172.21.15.170:0/1719869249 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a4f49a520 0x556a4f395d10 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.356+0000 7f058e416800 1 -- 172.21.15.170:0/1719869249 >> 172.21.15.170:0/1719869249 conn(0x556a4f39a1f0 msgr2=0x556a4f494e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:46.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.356+0000 7f058e416800 1 -- 172.21.15.170:0/1719869249 shutdown_connections 2024-09-12T17:29:46.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.356+0000 7f058e416800 1 -- 172.21.15.170:0/1719869249 wait complete. 2024-09-12T17:29:46.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.357+0000 7f058e416800 1 -- 172.21.15.170:0/1625986284 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f03c003c690 msgr2=0x7f03c003eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.357+0000 7f058e416800 1 --2- 172.21.15.170:0/1625986284 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f03c003c690 0x7f03c003eb50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0574000c00 tx=0x7f0574005ac0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.357+0000 7f058e416800 1 -- 172.21.15.170:0/1625986284 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a4f4bd390 msgr2=0x556a4f4bd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.357+0000 7f058e416800 1 --2- 172.21.15.170:0/1625986284 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a4f4bd390 0x556a4f4bd7b0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f057c000c00 tx=0x7f057c017950 comp rx=0 tx=0).stop 2024-09-12T17:29:46.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.357+0000 7f058e416800 1 -- 172.21.15.170:0/1625986284 shutdown_connections 2024-09-12T17:29:46.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.357+0000 7f058e416800 1 --2- 172.21.15.170:0/1625986284 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f03c003c690 0x7f03c003eb50 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.357+0000 7f058e416800 1 --2- 172.21.15.170:0/1625986284 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a4f4bd390 0x556a4f4bd7b0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.357+0000 7f058e416800 1 -- 172.21.15.170:0/1625986284 >> 172.21.15.170:0/1625986284 conn(0x556a4f4b28f0 msgr2=0x556a4f4b2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:46.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.357+0000 7f058e416800 1 -- 172.21.15.170:0/1625986284 shutdown_connections 2024-09-12T17:29:46.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.357+0000 7f058e416800 1 -- 172.21.15.170:0/1625986284 wait complete. 2024-09-12T17:29:46.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.357+0000 7f058e416800 1 -- 172.21.15.170:0/406814303 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x556a4f4caaa0 msgr2=0x556a4f4ccf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.357+0000 7f058e416800 1 --2- 172.21.15.170:0/406814303 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x556a4f4caaa0 0x556a4f4ccf30 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.357+0000 7f058e416800 1 -- 172.21.15.170:0/406814303 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556a4f4cf720 msgr2=0x556a4f4d1bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.357+0000 7f058e416800 1 --2- 172.21.15.170:0/406814303 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556a4f4cf720 0x556a4f4d1bb0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.357+0000 7f058e416800 1 -- 172.21.15.170:0/406814303 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f047003c7d0 msgr2=0x7f047003ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.357+0000 7f058e416800 1 --2- 172.21.15.170:0/406814303 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f047003c7d0 0x7f047003ec90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f057c00bfb0 tx=0x7f057c034040 comp rx=0 tx=0).stop 2024-09-12T17:29:46.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.357+0000 7f058e416800 1 -- 172.21.15.170:0/406814303 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a4f3965f0 msgr2=0x556a4f48cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.357+0000 7f058e416800 1 --2- 172.21.15.170:0/406814303 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a4f3965f0 0x556a4f48cfd0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x556a4f486600 tx=0x7f057c000ed0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.357+0000 7f058e416800 1 -- 172.21.15.170:0/406814303 shutdown_connections 2024-09-12T17:29:46.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.357+0000 7f058e416800 1 --2- 172.21.15.170:0/406814303 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556a4f4cf720 0x556a4f4d1bb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.357+0000 7f058e416800 1 --2- 172.21.15.170:0/406814303 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f047003c7d0 0x7f047003ec90 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.357+0000 7f058e416800 1 --2- 172.21.15.170:0/406814303 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x556a4f4caaa0 0x556a4f4ccf30 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.357+0000 7f058e416800 1 --2- 172.21.15.170:0/406814303 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a4f3965f0 0x556a4f48cfd0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.357+0000 7f058e416800 1 -- 172.21.15.170:0/406814303 >> 172.21.15.170:0/406814303 conn(0x556a4f3901b0 msgr2=0x556a4f486950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:46.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.357+0000 7f058e416800 1 -- 172.21.15.170:0/406814303 shutdown_connections 2024-09-12T17:29:46.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.357+0000 7f058e416800 1 -- 172.21.15.170:0/406814303 wait complete. 2024-09-12T17:29:46.382 INFO:teuthology.orchestra.run.smithi170.stdout:{"id":"7f05c86a-1902-4046-a99f-31d6f38ce8f7","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T17:29:46.382 DEBUG:tasks.util.rgw: json result: {'id': '7f05c86a-1902-4046-a99f-31d6f38ce8f7', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T17:29:46.383 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-12T17:29:46.383 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-12T17:29:46.383 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-12T17:29:46.470 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:29:46.471 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:29:46.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.470+0000 7ff525210800 1 Processor -- start 2024-09-12T17:29:46.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.470+0000 7ff525210800 1 -- start start 2024-09-12T17:29:46.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.470+0000 7ff525210800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5584b91a97c0 0x5584b91abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.470+0000 7ff525210800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5584b9052e40 con 0x5584b91ac150 2024-09-12T17:29:46.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.470+0000 7ff525210800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x5584b901d680 con 0x5584b91a97c0 2024-09-12T17:29:46.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.470+0000 7ff5209bc640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5584b91a97c0 0x5584b91abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.470+0000 7ff5181bb640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x5584b91ac150 0x5584b91ae610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:44860/0 (socket says 172.21.15.170:44860) 2024-09-12T17:29:46.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.470+0000 7ff5209bc640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5584b91a97c0 0x5584b91abbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34704/0 (socket says 172.21.15.170:34704) 2024-09-12T17:29:46.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.470+0000 7ff5181bb640 1 -- 172.21.15.170:0/2500188120 learned_addr learned my addr 172.21.15.170:0/2500188120 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:29:46.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.471+0000 7ff5209bc640 1 -- 172.21.15.170:0/2500188120 >> v1:172.21.15.47:6789/0 conn(0x5584b91ac150 legacy=0x5584b91ae610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.471+0000 7ff5209bc640 1 -- 172.21.15.170:0/2500188120 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584b90396b0 con 0x5584b91a97c0 2024-09-12T17:29:46.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.472+0000 7ff5209bc640 1 --2- 172.21.15.170:0/2500188120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5584b91a97c0 0x5584b91abbb0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7ff51000a470 tx=0x7ff510045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=507a78ddef41e352 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.473+0000 7ff51bfff640 1 -- 172.21.15.170:0/2500188120 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff510053570 con 0x5584b91a97c0 2024-09-12T17:29:46.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.473+0000 7ff51bfff640 1 -- 172.21.15.170:0/2500188120 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff510058070 con 0x5584b91a97c0 2024-09-12T17:29:46.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.473+0000 7ff51bfff640 1 -- 172.21.15.170:0/2500188120 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff510053880 con 0x5584b91a97c0 2024-09-12T17:29:46.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.473+0000 7ff525210800 1 -- 172.21.15.170:0/2500188120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5584b91a97c0 msgr2=0x5584b91abbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.473+0000 7ff525210800 1 --2- 172.21.15.170:0/2500188120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5584b91a97c0 0x5584b91abbb0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7ff51000a470 tx=0x7ff510045a20 comp rx=0 tx=0).stop 2024-09-12T17:29:46.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.473+0000 7ff525210800 1 -- 172.21.15.170:0/2500188120 shutdown_connections 2024-09-12T17:29:46.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.473+0000 7ff525210800 1 --2- 172.21.15.170:0/2500188120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5584b91a97c0 0x5584b91abbb0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.473+0000 7ff525210800 1 -- 172.21.15.170:0/2500188120 >> 172.21.15.170:0/2500188120 conn(0x5584b91a3320 msgr2=0x5584b91a5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:46.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.473+0000 7ff525210800 1 -- 172.21.15.170:0/2500188120 shutdown_connections 2024-09-12T17:29:46.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.473+0000 7ff525210800 1 -- 172.21.15.170:0/2500188120 wait complete. 2024-09-12T17:29:46.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.487+0000 7ff525210800 1 Processor -- start 2024-09-12T17:29:46.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.487+0000 7ff525210800 1 -- start start 2024-09-12T17:29:46.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.487+0000 7ff525210800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5584b91a97c0 0x5584b9298750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.487+0000 7ff525210800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5584b9041dd0 con 0x5584b91a97c0 2024-09-12T17:29:46.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.488+0000 7ff5209bc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5584b91a97c0 0x5584b9298750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.488+0000 7ff5209bc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5584b91a97c0 0x5584b9298750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34706/0 (socket says 172.21.15.170:34706) 2024-09-12T17:29:46.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.488+0000 7ff5209bc640 1 -- 172.21.15.170:0/3064808065 learned_addr learned my addr 172.21.15.170:0/3064808065 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:46.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.488+0000 7ff5209bc640 1 -- 172.21.15.170:0/3064808065 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584b905ae10 con 0x5584b91a97c0 2024-09-12T17:29:46.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.488+0000 7ff5209bc640 1 --2- 172.21.15.170:0/3064808065 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5584b91a97c0 0x5584b9298750 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7ff510025c20 tx=0x7ff510051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a34be5428a44016a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.488+0000 7ff40ee0d640 1 -- 172.21.15.170:0/3064808065 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff510053a20 con 0x5584b91a97c0 2024-09-12T17:29:46.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.488+0000 7ff40ee0d640 1 -- 172.21.15.170:0/3064808065 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff510063070 con 0x5584b91a97c0 2024-09-12T17:29:46.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.488+0000 7ff40ee0d640 1 -- 172.21.15.170:0/3064808065 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff510053cf0 con 0x5584b91a97c0 2024-09-12T17:29:46.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.489+0000 7ff525210800 1 -- 172.21.15.170:0/3064808065 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5584b91a97c0 msgr2=0x5584b9298750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.489+0000 7ff525210800 1 --2- 172.21.15.170:0/3064808065 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5584b91a97c0 0x5584b9298750 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7ff510025c20 tx=0x7ff510051000 comp rx=0 tx=0).stop 2024-09-12T17:29:46.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.489+0000 7ff525210800 1 -- 172.21.15.170:0/3064808065 shutdown_connections 2024-09-12T17:29:46.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.489+0000 7ff525210800 1 --2- 172.21.15.170:0/3064808065 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5584b91a97c0 0x5584b9298750 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.489+0000 7ff525210800 1 -- 172.21.15.170:0/3064808065 >> 172.21.15.170:0/3064808065 conn(0x5584b91a3320 msgr2=0x5584b92940d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:46.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.489+0000 7ff525210800 1 -- 172.21.15.170:0/3064808065 shutdown_connections 2024-09-12T17:29:46.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.489+0000 7ff525210800 1 -- 172.21.15.170:0/3064808065 wait complete. 2024-09-12T17:29:46.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.489+0000 7ff525210800 1 Processor -- start 2024-09-12T17:29:46.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.490+0000 7ff525210800 1 -- start start 2024-09-12T17:29:46.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.490+0000 7ff525210800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5584b91ac150 0x5584b92a02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.490+0000 7ff525210800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5584b91b0170 con 0x5584b91ac150 2024-09-12T17:29:46.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.490+0000 7ff5209bc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5584b91ac150 0x5584b92a02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.490+0000 7ff5209bc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5584b91ac150 0x5584b92a02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34708/0 (socket says 172.21.15.170:34708) 2024-09-12T17:29:46.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.490+0000 7ff5209bc640 1 -- 172.21.15.170:0/233222732 learned_addr learned my addr 172.21.15.170:0/233222732 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:46.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.490+0000 7ff5209bc640 1 -- 172.21.15.170:0/233222732 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584b92a0800 con 0x5584b91ac150 2024-09-12T17:29:46.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.490+0000 7ff5209bc640 1 --2- 172.21.15.170:0/233222732 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5584b91ac150 0x5584b92a02a0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7ff510025c20 tx=0x7ff510002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.491+0000 7ff40d60a640 1 -- 172.21.15.170:0/233222732 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5100745b0 con 0x5584b91ac150 2024-09-12T17:29:46.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.491+0000 7ff40d60a640 1 -- 172.21.15.170:0/233222732 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff510074750 con 0x5584b91ac150 2024-09-12T17:29:46.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.491+0000 7ff525210800 1 -- 172.21.15.170:0/233222732 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5584b92a0a90 con 0x5584b91ac150 2024-09-12T17:29:46.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.491+0000 7ff40d60a640 1 -- 172.21.15.170:0/233222732 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff510074a30 con 0x5584b91ac150 2024-09-12T17:29:46.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.491+0000 7ff525210800 1 -- 172.21.15.170:0/233222732 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584b92a16a0 con 0x5584b91ac150 2024-09-12T17:29:46.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.491+0000 7ff525210800 1 Processor -- start 2024-09-12T17:29:46.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.491+0000 7ff525210800 1 -- start start 2024-09-12T17:29:46.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.492+0000 7ff525210800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5584b91a8870 0x5584b91a8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.492+0000 7ff525210800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5584b909fa00 con 0x5584b91a8870 2024-09-12T17:29:46.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.492+0000 7ff40d60a640 1 -- 172.21.15.170:0/233222732 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ff510074bd0 con 0x5584b91ac150 2024-09-12T17:29:46.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.492+0000 7ff5211bd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5584b91a8870 0x5584b91a8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.492+0000 7ff40d60a640 1 --2- 172.21.15.170:0/233222732 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff40803c780 0x7ff40803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.492+0000 7ff5211bd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5584b91a8870 0x5584b91a8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34720/0 (socket says 172.21.15.170:34720) 2024-09-12T17:29:46.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.492+0000 7ff5211bd640 1 -- 172.21.15.170:0/3770160931 learned_addr learned my addr 172.21.15.170:0/3770160931 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:46.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.492+0000 7ff40d60a640 1 -- 172.21.15.170:0/233222732 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7ff510098100 con 0x5584b91ac150 2024-09-12T17:29:46.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.492+0000 7ff5209bc640 1 --2- 172.21.15.170:0/233222732 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff40803c780 0x7ff40803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.492+0000 7ff5211bd640 1 -- 172.21.15.170:0/3770160931 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584b91a91b0 con 0x5584b91a8870 2024-09-12T17:29:46.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.492+0000 7ff5209bc640 1 --2- 172.21.15.170:0/233222732 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff40803c780 0x7ff40803ec40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff51005f780 tx=0x7ff51005f710 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.492+0000 7ff5211bd640 1 --2- 172.21.15.170:0/3770160931 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5584b91a8870 0x5584b91a8c70 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7ff51c00a3e0 tx=0x7ff51c00a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=533294f0eed7bc9a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.493+0000 7ff406ffd640 1 -- 172.21.15.170:0/3770160931 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff51c015070 con 0x5584b91a8870 2024-09-12T17:29:46.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.493+0000 7ff406ffd640 1 -- 172.21.15.170:0/3770160931 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff51c001670 con 0x5584b91a8870 2024-09-12T17:29:46.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.493+0000 7ff406ffd640 1 -- 172.21.15.170:0/3770160931 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff51c001990 con 0x5584b91a8870 2024-09-12T17:29:46.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.493+0000 7ff525210800 1 -- 172.21.15.170:0/3770160931 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5584b91a8870 msgr2=0x5584b91a8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.493+0000 7ff525210800 1 --2- 172.21.15.170:0/3770160931 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5584b91a8870 0x5584b91a8c70 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7ff51c00a3e0 tx=0x7ff51c00a8a0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.493+0000 7ff525210800 1 -- 172.21.15.170:0/3770160931 shutdown_connections 2024-09-12T17:29:46.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.493+0000 7ff525210800 1 --2- 172.21.15.170:0/3770160931 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5584b91a8870 0x5584b91a8c70 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.493+0000 7ff525210800 1 -- 172.21.15.170:0/3770160931 >> 172.21.15.170:0/3770160931 conn(0x5584b92a9e70 msgr2=0x5584b92a80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:46.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.493+0000 7ff525210800 1 -- 172.21.15.170:0/3770160931 shutdown_connections 2024-09-12T17:29:46.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.493+0000 7ff525210800 1 -- 172.21.15.170:0/3770160931 wait complete. 2024-09-12T17:29:46.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.493+0000 7ff525210800 1 Processor -- start 2024-09-12T17:29:46.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.493+0000 7ff525210800 1 -- start start 2024-09-12T17:29:46.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.494+0000 7ff525210800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5584b91a8870 0x5584b92b6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.494+0000 7ff525210800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5584b91a75b0 con 0x5584b91a8870 2024-09-12T17:29:46.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.494+0000 7ff5211bd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5584b91a8870 0x5584b92b6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.494+0000 7ff5211bd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5584b91a8870 0x5584b92b6c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34726/0 (socket says 172.21.15.170:34726) 2024-09-12T17:29:46.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.494+0000 7ff5211bd640 1 -- 172.21.15.170:0/3567618036 learned_addr learned my addr 172.21.15.170:0/3567618036 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:46.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.494+0000 7ff5211bd640 1 -- 172.21.15.170:0/3567618036 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584b92b71d0 con 0x5584b91a8870 2024-09-12T17:29:46.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.494+0000 7ff5211bd640 1 --2- 172.21.15.170:0/3567618036 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5584b91a8870 0x5584b92b6c70 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x5584b92a8e60 tx=0x7ff51c003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.494+0000 7ff4057fa640 1 -- 172.21.15.170:0/3567618036 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff51c020020 con 0x5584b91a8870 2024-09-12T17:29:46.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.494+0000 7ff4057fa640 1 -- 172.21.15.170:0/3567618036 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff51c010780 con 0x5584b91a8870 2024-09-12T17:29:46.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.494+0000 7ff525210800 1 -- 172.21.15.170:0/3567618036 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5584b92b7460 con 0x5584b91a8870 2024-09-12T17:29:46.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.494+0000 7ff4057fa640 1 -- 172.21.15.170:0/3567618036 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff51c015040 con 0x5584b91a8870 2024-09-12T17:29:46.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.494+0000 7ff525210800 1 -- 172.21.15.170:0/3567618036 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584b92b7de0 con 0x5584b91a8870 2024-09-12T17:29:46.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.495+0000 7ff4057fa640 1 -- 172.21.15.170:0/3567618036 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ff51c023020 con 0x5584b91a8870 2024-09-12T17:29:46.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.496+0000 7ff525210800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:29:46.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.496+0000 7ff525210800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:29:46.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.496+0000 7ff4057fa640 1 --2- 172.21.15.170:0/3567618036 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff3f803c730 0x7ff3f803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.496+0000 7ff4057fa640 1 -- 172.21.15.170:0/3567618036 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7ff51c053330 con 0x5584b91a8870 2024-09-12T17:29:46.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.496+0000 7ff5181bb640 1 --2- 172.21.15.170:0/3567618036 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff3f803c730 0x7ff3f803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.496+0000 7ff525210800 1 Processor -- start 2024-09-12T17:29:46.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.496+0000 7ff525210800 1 -- start start 2024-09-12T17:29:46.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.496+0000 7ff5181bb640 1 --2- 172.21.15.170:0/3567618036 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff3f803c730 0x7ff3f803ebf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff508001cf0 tx=0x7ff508001250 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.496+0000 7ff525210800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5584b92d0ab0 0x5584b92d0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.496+0000 7ff525210800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5584b9298f40 con 0x5584b92d0ab0 2024-09-12T17:29:46.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.497+0000 7ff5209bc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5584b92d0ab0 0x5584b92d0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.497+0000 7ff5209bc640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5584b92d0ab0 0x5584b92d0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34740/0 (socket says 172.21.15.170:34740) 2024-09-12T17:29:46.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.497+0000 7ff5209bc640 1 -- 172.21.15.170:0/1059413363 learned_addr learned my addr 172.21.15.170:0/1059413363 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:46.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.497+0000 7ff5209bc640 1 -- 172.21.15.170:0/1059413363 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584b92d1510 con 0x5584b92d0ab0 2024-09-12T17:29:46.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.497+0000 7ff5209bc640 1 --2- 172.21.15.170:0/1059413363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5584b92d0ab0 0x5584b92d0ed0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7ff510053730 tx=0x7ff51005eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.497+0000 7ff3e57e2640 1 -- 172.21.15.170:0/1059413363 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5100961b0 con 0x5584b92d0ab0 2024-09-12T17:29:46.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.497+0000 7ff3e57e2640 1 -- 172.21.15.170:0/1059413363 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff510068470 con 0x5584b92d0ab0 2024-09-12T17:29:46.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.497+0000 7ff3e57e2640 1 -- 172.21.15.170:0/1059413363 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff510068750 con 0x5584b92d0ab0 2024-09-12T17:29:46.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.497+0000 7ff525210800 1 -- 172.21.15.170:0/1059413363 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5584b92d1d40 con 0x5584b92d0ab0 2024-09-12T17:29:46.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.497+0000 7ff525210800 1 -- 172.21.15.170:0/1059413363 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584b92d22e0 con 0x5584b92d0ab0 2024-09-12T17:29:46.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.498+0000 7ff3e57e2640 1 -- 172.21.15.170:0/1059413363 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ff510086070 con 0x5584b92d0ab0 2024-09-12T17:29:46.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.498+0000 7ff3e57e2640 1 --2- 172.21.15.170:0/1059413363 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff36003c730 0x7ff36003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.498+0000 7ff3e57e2640 1 -- 172.21.15.170:0/1059413363 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7ff510091070 con 0x5584b92d0ab0 2024-09-12T17:29:46.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.498+0000 7ff5181bb640 1 --2- 172.21.15.170:0/1059413363 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff36003c730 0x7ff36003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.499+0000 7ff37effd640 20 reqs_thread_entry: start 2024-09-12T17:29:46.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.499+0000 7ff5181bb640 1 --2- 172.21.15.170:0/1059413363 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff36003c730 0x7ff36003ebf0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff508000f60 tx=0x7ff50800f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.499+0000 7ff525210800 1 --2- 172.21.15.170:0/233222732 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5584b92de3d0 0x5584b92e0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.499+0000 7ff525210800 1 -- 172.21.15.170:0/233222732 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5584b92e0f20 con 0x5584b92de3d0 2024-09-12T17:29:46.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.499+0000 7ff5211bd640 1 --2- 172.21.15.170:0/233222732 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5584b92de3d0 0x5584b92e0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.499+0000 7ff5211bd640 1 --2- 172.21.15.170:0/233222732 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5584b92de3d0 0x5584b92e0850 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.499+0000 7ff5211bd640 1 -- 172.21.15.170:0/233222732 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff51c00e070 con 0x5584b92de3d0 2024-09-12T17:29:46.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.499+0000 7ff525210800 1 --2- 172.21.15.170:0/233222732 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5584b92e2cf0 0x5584b92e50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.499+0000 7ff525210800 1 -- 172.21.15.170:0/233222732 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:2 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5584b92e57b0 con 0x5584b92e2cf0 2024-09-12T17:29:46.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.499+0000 7ff5209bc640 1 --2- 172.21.15.170:0/233222732 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5584b92e2cf0 0x5584b92e50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.500+0000 7ff5209bc640 1 --2- 172.21.15.170:0/233222732 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5584b92e2cf0 0x5584b92e50e0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.500+0000 7ff5209bc640 1 -- 172.21.15.170:0/233222732 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(2 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7ff510085030 con 0x5584b92e2cf0 2024-09-12T17:29:46.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.500+0000 7ff525210800 1 -- 172.21.15.170:0/233222732 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5584b92e23c0 con 0x5584b92e2cf0 2024-09-12T17:29:46.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.501+0000 7ff5209bc640 1 -- 172.21.15.170:0/233222732 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [stat,call,call,writefull 0~993] v31'4 uv4 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7ff510085030 con 0x5584b92e2cf0 2024-09-12T17:29:46.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.502+0000 7ff525210800 1 -- 172.21.15.170:0/3567618036 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff3f803c730 msgr2=0x7ff3f803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.502+0000 7ff525210800 1 --2- 172.21.15.170:0/3567618036 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff3f803c730 0x7ff3f803ebf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff508001cf0 tx=0x7ff508001250 comp rx=0 tx=0).stop 2024-09-12T17:29:46.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.502+0000 7ff525210800 1 -- 172.21.15.170:0/3567618036 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5584b91a8870 msgr2=0x5584b92b6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.502+0000 7ff525210800 1 --2- 172.21.15.170:0/3567618036 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5584b91a8870 0x5584b92b6c70 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x5584b92a8e60 tx=0x7ff51c003370 comp rx=0 tx=0).stop 2024-09-12T17:29:46.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.502+0000 7ff525210800 1 -- 172.21.15.170:0/3567618036 shutdown_connections 2024-09-12T17:29:46.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.502+0000 7ff525210800 1 --2- 172.21.15.170:0/3567618036 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff3f803c730 0x7ff3f803ebf0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.502+0000 7ff525210800 1 --2- 172.21.15.170:0/3567618036 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5584b91a8870 0x5584b92b6c70 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.502+0000 7ff525210800 1 -- 172.21.15.170:0/3567618036 >> 172.21.15.170:0/3567618036 conn(0x5584b92a9e70 msgr2=0x5584b92a8080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:46.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.502+0000 7ff525210800 1 -- 172.21.15.170:0/3567618036 shutdown_connections 2024-09-12T17:29:46.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.502+0000 7ff525210800 1 -- 172.21.15.170:0/3567618036 wait complete. 2024-09-12T17:29:46.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.503+0000 7ff525210800 1 -- 172.21.15.170:0/1059413363 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff36003c730 msgr2=0x7ff36003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.503+0000 7ff525210800 1 --2- 172.21.15.170:0/1059413363 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff36003c730 0x7ff36003ebf0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff508000f60 tx=0x7ff50800f000 comp rx=0 tx=0).stop 2024-09-12T17:29:46.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.503+0000 7ff525210800 1 -- 172.21.15.170:0/1059413363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5584b92d0ab0 msgr2=0x5584b92d0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.503+0000 7ff525210800 1 --2- 172.21.15.170:0/1059413363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5584b92d0ab0 0x5584b92d0ed0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7ff510053730 tx=0x7ff51005eed0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.503+0000 7ff525210800 1 -- 172.21.15.170:0/1059413363 shutdown_connections 2024-09-12T17:29:46.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.503+0000 7ff525210800 1 --2- 172.21.15.170:0/1059413363 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff36003c730 0x7ff36003ebf0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.503+0000 7ff525210800 1 --2- 172.21.15.170:0/1059413363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5584b92d0ab0 0x5584b92d0ed0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.503+0000 7ff525210800 1 -- 172.21.15.170:0/1059413363 >> 172.21.15.170:0/1059413363 conn(0x5584b92c60b0 msgr2=0x5584b92c6490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:46.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.503+0000 7ff525210800 1 -- 172.21.15.170:0/1059413363 shutdown_connections 2024-09-12T17:29:46.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.503+0000 7ff525210800 1 -- 172.21.15.170:0/1059413363 wait complete. 2024-09-12T17:29:46.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.503+0000 7ff525210800 1 -- 172.21.15.170:0/233222732 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5584b92de3d0 msgr2=0x5584b92e0850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.503+0000 7ff525210800 1 --2- 172.21.15.170:0/233222732 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5584b92de3d0 0x5584b92e0850 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.503+0000 7ff525210800 1 -- 172.21.15.170:0/233222732 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5584b92e2cf0 msgr2=0x5584b92e50e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.503+0000 7ff525210800 1 --2- 172.21.15.170:0/233222732 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5584b92e2cf0 0x5584b92e50e0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.503+0000 7ff525210800 1 -- 172.21.15.170:0/233222732 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff40803c780 msgr2=0x7ff40803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.503+0000 7ff525210800 1 --2- 172.21.15.170:0/233222732 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff40803c780 0x7ff40803ec40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff51005f780 tx=0x7ff51005f710 comp rx=0 tx=0).stop 2024-09-12T17:29:46.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.503+0000 7ff525210800 1 -- 172.21.15.170:0/233222732 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5584b91ac150 msgr2=0x5584b92a02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.503+0000 7ff525210800 1 --2- 172.21.15.170:0/233222732 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5584b91ac150 0x5584b92a02a0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7ff510025c20 tx=0x7ff510002fb0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.503+0000 7ff525210800 1 -- 172.21.15.170:0/233222732 shutdown_connections 2024-09-12T17:29:46.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.503+0000 7ff525210800 1 --2- 172.21.15.170:0/233222732 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5584b92e2cf0 0x5584b92e50e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.503+0000 7ff525210800 1 --2- 172.21.15.170:0/233222732 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff40803c780 0x7ff40803ec40 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.503+0000 7ff525210800 1 --2- 172.21.15.170:0/233222732 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5584b92de3d0 0x5584b92e0850 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.503+0000 7ff525210800 1 --2- 172.21.15.170:0/233222732 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5584b91ac150 0x5584b92a02a0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.503+0000 7ff525210800 1 -- 172.21.15.170:0/233222732 >> 172.21.15.170:0/233222732 conn(0x5584b91a3320 msgr2=0x5584b92928c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:46.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.503+0000 7ff525210800 1 -- 172.21.15.170:0/233222732 shutdown_connections 2024-09-12T17:29:46.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.503+0000 7ff525210800 1 -- 172.21.15.170:0/233222732 wait complete. 2024-09-12T17:29:46.531 INFO:teuthology.orchestra.run.smithi170.stdout:{"id":"7f05c86a-1902-4046-a99f-31d6f38ce8f7","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T17:29:46.532 DEBUG:tasks.util.rgw: json result: {'id': '7f05c86a-1902-4046-a99f-31d6f38ce8f7', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T17:29:46.532 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-09-12T17:29:46.532 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-09-12T17:29:46.532 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-09-12T17:29:46.575 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:29:46.575 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:29:46.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.574+0000 7f7b87d40800 1 Processor -- start 2024-09-12T17:29:46.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.575+0000 7f7b87d40800 1 -- start start 2024-09-12T17:29:46.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.575+0000 7f7b87d40800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55e306f44dd0 0x55e306f45ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.575+0000 7f7b87d40800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e306defe40 con 0x55e306f46010 2024-09-12T17:29:46.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.575+0000 7f7b87d40800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x55e306dba680 con 0x55e306f44dd0 2024-09-12T17:29:46.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.575+0000 7f7b83a86640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55e306f44dd0 0x55e306f45ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.575+0000 7f7b83a86640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55e306f44dd0 0x55e306f45ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34754/0 (socket says 172.21.15.170:34754) 2024-09-12T17:29:46.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.575+0000 7f7b83a86640 1 -- 172.21.15.170:0/1571120264 learned_addr learned my addr 172.21.15.170:0/1571120264 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:46.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.575+0000 7f7b7bfff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x55e306f46010 0x55e306f4ad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:44870/0 (socket says 172.21.15.170:44870) 2024-09-12T17:29:46.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.575+0000 7f7b83a86640 1 -- 172.21.15.170:0/1571120264 >> v1:172.21.15.47:6789/0 conn(0x55e306f46010 legacy=0x55e306f4ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.575+0000 7f7b83a86640 1 -- 172.21.15.170:0/1571120264 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e306dd66b0 con 0x55e306f44dd0 2024-09-12T17:29:46.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.577+0000 7f7b83a86640 1 --2- 172.21.15.170:0/1571120264 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e306f44dd0 0x55e306f45ad0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f7b7400a6b0 tx=0x7f7b74047e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5faad00b0fd76e8e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.577+0000 7f7b83285640 1 -- 172.21.15.170:0/1571120264 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b7400a200 con 0x55e306f44dd0 2024-09-12T17:29:46.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.577+0000 7f7b83285640 1 -- 172.21.15.170:0/1571120264 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b7400a3a0 con 0x55e306f44dd0 2024-09-12T17:29:46.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.577+0000 7f7b83285640 1 -- 172.21.15.170:0/1571120264 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b74008700 con 0x55e306f44dd0 2024-09-12T17:29:46.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.578+0000 7f7b87d40800 1 -- 172.21.15.170:0/1571120264 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e306f44dd0 msgr2=0x55e306f45ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.578+0000 7f7b87d40800 1 --2- 172.21.15.170:0/1571120264 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e306f44dd0 0x55e306f45ad0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f7b7400a6b0 tx=0x7f7b74047e30 comp rx=0 tx=0).stop 2024-09-12T17:29:46.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.578+0000 7f7b87d40800 1 -- 172.21.15.170:0/1571120264 shutdown_connections 2024-09-12T17:29:46.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.578+0000 7f7b87d40800 1 --2- 172.21.15.170:0/1571120264 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e306f44dd0 0x55e306f45ad0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.578+0000 7f7b87d40800 1 -- 172.21.15.170:0/1571120264 >> 172.21.15.170:0/1571120264 conn(0x55e306f401a0 msgr2=0x55e306f42600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:46.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.578+0000 7f7b87d40800 1 -- 172.21.15.170:0/1571120264 shutdown_connections 2024-09-12T17:29:46.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.578+0000 7f7b87d40800 1 -- 172.21.15.170:0/1571120264 wait complete. 2024-09-12T17:29:46.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.591+0000 7f7b87d40800 1 Processor -- start 2024-09-12T17:29:46.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.592+0000 7f7b87d40800 1 -- start start 2024-09-12T17:29:46.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.592+0000 7f7b87d40800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e306f44dd0 0x55e307037820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.592+0000 7f7b87d40800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e306ddedd0 con 0x55e306f44dd0 2024-09-12T17:29:46.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.592+0000 7f7b83a86640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e306f44dd0 0x55e307037820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.592+0000 7f7b83a86640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e306f44dd0 0x55e307037820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34768/0 (socket says 172.21.15.170:34768) 2024-09-12T17:29:46.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.592+0000 7f7b83a86640 1 -- 172.21.15.170:0/2142390703 learned_addr learned my addr 172.21.15.170:0/2142390703 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:46.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.592+0000 7f7b83a86640 1 -- 172.21.15.170:0/2142390703 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e306df7e10 con 0x55e306f44dd0 2024-09-12T17:29:46.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.593+0000 7f7b83a86640 1 --2- 172.21.15.170:0/2142390703 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e306f44dd0 0x55e307037820 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f7b74027c60 tx=0x7f7b74051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21e18694330f48d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.593+0000 7f7a71e0b640 1 -- 172.21.15.170:0/2142390703 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b7404f5f0 con 0x55e306f44dd0 2024-09-12T17:29:46.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.593+0000 7f7a71e0b640 1 -- 172.21.15.170:0/2142390703 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b7404f790 con 0x55e306f44dd0 2024-09-12T17:29:46.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.593+0000 7f7a71e0b640 1 -- 172.21.15.170:0/2142390703 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b7404fab0 con 0x55e306f44dd0 2024-09-12T17:29:46.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.594+0000 7f7b87d40800 1 -- 172.21.15.170:0/2142390703 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e306f44dd0 msgr2=0x55e307037820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.594+0000 7f7b87d40800 1 --2- 172.21.15.170:0/2142390703 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e306f44dd0 0x55e307037820 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f7b74027c60 tx=0x7f7b74051000 comp rx=0 tx=0).stop 2024-09-12T17:29:46.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.594+0000 7f7b87d40800 1 -- 172.21.15.170:0/2142390703 shutdown_connections 2024-09-12T17:29:46.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.594+0000 7f7b87d40800 1 --2- 172.21.15.170:0/2142390703 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e306f44dd0 0x55e307037820 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.594+0000 7f7b87d40800 1 -- 172.21.15.170:0/2142390703 >> 172.21.15.170:0/2142390703 conn(0x55e306f401a0 msgr2=0x55e30702ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:46.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.594+0000 7f7b87d40800 1 -- 172.21.15.170:0/2142390703 shutdown_connections 2024-09-12T17:29:46.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.594+0000 7f7b87d40800 1 -- 172.21.15.170:0/2142390703 wait complete. 2024-09-12T17:29:46.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.594+0000 7f7b87d40800 1 Processor -- start 2024-09-12T17:29:46.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.594+0000 7f7b87d40800 1 -- start start 2024-09-12T17:29:46.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.594+0000 7f7b87d40800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e306f44dd0 0x55e30703f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.594+0000 7f7b87d40800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e306f46700 con 0x55e306f44dd0 2024-09-12T17:29:46.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.594+0000 7f7b83a86640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e306f44dd0 0x55e30703f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.594+0000 7f7b83a86640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e306f44dd0 0x55e30703f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34780/0 (socket says 172.21.15.170:34780) 2024-09-12T17:29:46.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.594+0000 7f7b83a86640 1 -- 172.21.15.170:0/2354286750 learned_addr learned my addr 172.21.15.170:0/2354286750 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:46.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.595+0000 7f7b83a86640 1 -- 172.21.15.170:0/2354286750 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e30703f5f0 con 0x55e306f44dd0 2024-09-12T17:29:46.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.595+0000 7f7b83a86640 1 --2- 172.21.15.170:0/2354286750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e306f44dd0 0x55e30703f090 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f7b7400a370 tx=0x7f7b74002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.595+0000 7f7a6bfff640 1 -- 172.21.15.170:0/2354286750 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b7406d030 con 0x55e306f44dd0 2024-09-12T17:29:46.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.595+0000 7f7a6bfff640 1 -- 172.21.15.170:0/2354286750 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b7404fb70 con 0x55e306f44dd0 2024-09-12T17:29:46.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.595+0000 7f7b87d40800 1 -- 172.21.15.170:0/2354286750 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e30703f880 con 0x55e306f44dd0 2024-09-12T17:29:46.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.595+0000 7f7a6bfff640 1 -- 172.21.15.170:0/2354286750 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b74069460 con 0x55e306f44dd0 2024-09-12T17:29:46.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.595+0000 7f7b87d40800 1 -- 172.21.15.170:0/2354286750 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e307040490 con 0x55e306f44dd0 2024-09-12T17:29:46.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.596+0000 7f7b87d40800 1 Processor -- start 2024-09-12T17:29:46.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.596+0000 7f7b87d40800 1 -- start start 2024-09-12T17:29:46.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.596+0000 7f7b87d40800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e30704c5e0 0x55e30704e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.596+0000 7f7b87d40800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e306e3ca00 con 0x55e30704c5e0 2024-09-12T17:29:46.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.596+0000 7f7a6bfff640 1 -- 172.21.15.170:0/2354286750 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f7b74070070 con 0x55e306f44dd0 2024-09-12T17:29:46.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.596+0000 7f7a6bfff640 1 --2- 172.21.15.170:0/2354286750 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f7a6c03c730 0x7f7a6c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.596+0000 7f7b84287640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e30704c5e0 0x55e30704e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.596+0000 7f7b84287640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e30704c5e0 0x55e30704e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34784/0 (socket says 172.21.15.170:34784) 2024-09-12T17:29:46.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.596+0000 7f7b84287640 1 -- 172.21.15.170:0/1540163305 learned_addr learned my addr 172.21.15.170:0/1540163305 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:46.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.596+0000 7f7a6bfff640 1 -- 172.21.15.170:0/2354286750 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f7b7406e070 con 0x55e306f44dd0 2024-09-12T17:29:46.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.596+0000 7f7b83a86640 1 --2- 172.21.15.170:0/2354286750 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f7a6c03c730 0x7f7a6c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.597+0000 7f7b84287640 1 -- 172.21.15.170:0/1540163305 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e30704efa0 con 0x55e30704c5e0 2024-09-12T17:29:46.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.597+0000 7f7b83a86640 1 --2- 172.21.15.170:0/2354286750 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f7a6c03c730 0x7f7a6c03ebf0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7b74005770 tx=0x7f7b7404fe90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.597+0000 7f7b84287640 1 --2- 172.21.15.170:0/1540163305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e30704c5e0 0x55e30704e9d0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c00a3e0 tx=0x7f7b7c00a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=737d75411545e67f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.597+0000 7f7a69ffb640 1 -- 172.21.15.170:0/1540163305 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b7c015070 con 0x55e30704c5e0 2024-09-12T17:29:46.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.597+0000 7f7a69ffb640 1 -- 172.21.15.170:0/1540163305 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b7c001670 con 0x55e30704c5e0 2024-09-12T17:29:46.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.597+0000 7f7a69ffb640 1 -- 172.21.15.170:0/1540163305 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b7c001990 con 0x55e30704c5e0 2024-09-12T17:29:46.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.598+0000 7f7b87d40800 1 -- 172.21.15.170:0/1540163305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e30704c5e0 msgr2=0x55e30704e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.598+0000 7f7b87d40800 1 --2- 172.21.15.170:0/1540163305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e30704c5e0 0x55e30704e9d0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c00a3e0 tx=0x7f7b7c00a8a0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.598+0000 7f7b87d40800 1 -- 172.21.15.170:0/1540163305 shutdown_connections 2024-09-12T17:29:46.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.598+0000 7f7b87d40800 1 --2- 172.21.15.170:0/1540163305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e30704c5e0 0x55e30704e9d0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.598+0000 7f7b87d40800 1 -- 172.21.15.170:0/1540163305 >> 172.21.15.170:0/1540163305 conn(0x55e306f46010 msgr2=0x55e307046f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:46.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.598+0000 7f7b87d40800 1 -- 172.21.15.170:0/1540163305 shutdown_connections 2024-09-12T17:29:46.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.598+0000 7f7b87d40800 1 -- 172.21.15.170:0/1540163305 wait complete. 2024-09-12T17:29:46.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.598+0000 7f7b87d40800 1 Processor -- start 2024-09-12T17:29:46.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.598+0000 7f7b87d40800 1 -- start start 2024-09-12T17:29:46.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.598+0000 7f7b87d40800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e30704c5e0 0x55e3070533d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.598+0000 7f7b87d40800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e30704f260 con 0x55e30704c5e0 2024-09-12T17:29:46.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.598+0000 7f7b84287640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e30704c5e0 0x55e3070533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.598+0000 7f7b84287640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e30704c5e0 0x55e3070533d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34788/0 (socket says 172.21.15.170:34788) 2024-09-12T17:29:46.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.598+0000 7f7b84287640 1 -- 172.21.15.170:0/4237870858 learned_addr learned my addr 172.21.15.170:0/4237870858 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:46.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.599+0000 7f7b84287640 1 -- 172.21.15.170:0/4237870858 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e307053930 con 0x55e30704c5e0 2024-09-12T17:29:46.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.599+0000 7f7b84287640 1 --2- 172.21.15.170:0/4237870858 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e30704c5e0 0x55e3070533d0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x55e3070478e0 tx=0x7f7b7c003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.599+0000 7f7a63fff640 1 -- 172.21.15.170:0/4237870858 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b7c020020 con 0x55e30704c5e0 2024-09-12T17:29:46.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.599+0000 7f7a63fff640 1 -- 172.21.15.170:0/4237870858 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b7c010780 con 0x55e30704c5e0 2024-09-12T17:29:46.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.599+0000 7f7b87d40800 1 -- 172.21.15.170:0/4237870858 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e307053bc0 con 0x55e30704c5e0 2024-09-12T17:29:46.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.599+0000 7f7a63fff640 1 -- 172.21.15.170:0/4237870858 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b7c015040 con 0x55e30704c5e0 2024-09-12T17:29:46.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.599+0000 7f7b87d40800 1 -- 172.21.15.170:0/4237870858 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e307054540 con 0x55e30704c5e0 2024-09-12T17:29:46.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.600+0000 7f7a63fff640 1 -- 172.21.15.170:0/4237870858 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f7b7c023020 con 0x55e30704c5e0 2024-09-12T17:29:46.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.600+0000 7f7a63fff640 1 --2- 172.21.15.170:0/4237870858 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f7a5c03c730 0x7f7a5c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.600+0000 7f7a63fff640 1 -- 172.21.15.170:0/4237870858 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f7b7c053270 con 0x55e30704c5e0 2024-09-12T17:29:46.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.600+0000 7f7b87d40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:29:46.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.600+0000 7f7b87d40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:29:46.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.600+0000 7f7b7bfff640 1 --2- 172.21.15.170:0/4237870858 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f7a5c03c730 0x7f7a5c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.601+0000 7f7b87d40800 1 Processor -- start 2024-09-12T17:29:46.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.601+0000 7f7b87d40800 1 -- start start 2024-09-12T17:29:46.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.601+0000 7f7b7bfff640 1 --2- 172.21.15.170:0/4237870858 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f7a5c03c730 0x7f7a5c03ebf0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c001db0 tx=0x7f7b6c001310 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.601+0000 7f7b87d40800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e30706d260 0x55e30706d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.601+0000 7f7b87d40800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e307037fb0 con 0x55e30706d260 2024-09-12T17:29:46.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.601+0000 7f7b83a86640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e30706d260 0x55e30706d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.601+0000 7f7b83a86640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e30706d260 0x55e30706d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34800/0 (socket says 172.21.15.170:34800) 2024-09-12T17:29:46.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.601+0000 7f7b83a86640 1 -- 172.21.15.170:0/3845702230 learned_addr learned my addr 172.21.15.170:0/3845702230 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:46.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.602+0000 7f7b83a86640 1 -- 172.21.15.170:0/3845702230 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e30706dcc0 con 0x55e30706d260 2024-09-12T17:29:46.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.602+0000 7f7b83a86640 1 --2- 172.21.15.170:0/3845702230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e30706d260 0x55e30706d680 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f7b74094b80 tx=0x7f7b74094ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.602+0000 7f7a0bfff640 1 -- 172.21.15.170:0/3845702230 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b74057ab0 con 0x55e30706d260 2024-09-12T17:29:46.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.602+0000 7f7a0bfff640 1 -- 172.21.15.170:0/3845702230 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b7408c070 con 0x55e30706d260 2024-09-12T17:29:46.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.602+0000 7f7b87d40800 1 -- 172.21.15.170:0/3845702230 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e30706e4f0 con 0x55e30706d260 2024-09-12T17:29:46.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.602+0000 7f7a0bfff640 1 -- 172.21.15.170:0/3845702230 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b74069b20 con 0x55e30706d260 2024-09-12T17:29:46.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.602+0000 7f7b87d40800 1 -- 172.21.15.170:0/3845702230 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e30706ea90 con 0x55e30706d260 2024-09-12T17:29:46.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.603+0000 7f7a0bfff640 1 -- 172.21.15.170:0/3845702230 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f7b740713c0 con 0x55e30706d260 2024-09-12T17:29:46.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.603+0000 7f7a0bfff640 1 --2- 172.21.15.170:0/3845702230 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f79c403c780 0x7f79c403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.603+0000 7f7a0bfff640 1 -- 172.21.15.170:0/3845702230 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f7b74074060 con 0x55e30706d260 2024-09-12T17:29:46.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.603+0000 7f7b7bfff640 1 --2- 172.21.15.170:0/3845702230 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f79c403c780 0x7f79c403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.603+0000 7f7a09ffb640 20 reqs_thread_entry: start 2024-09-12T17:29:46.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.603+0000 7f7b7bfff640 1 --2- 172.21.15.170:0/3845702230 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f79c403c780 0x7f79c403ec40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c000f60 tx=0x7f7b6c00f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.603+0000 7f7b87d40800 1 --2- 172.21.15.170:0/2354286750 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55e30707ab30 0x55e30707cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.603+0000 7f7b87d40800 1 -- 172.21.15.170:0/2354286750 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e30707d640 con 0x55e30707ab30 2024-09-12T17:29:46.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.603+0000 7f7b84287640 1 --2- 172.21.15.170:0/2354286750 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55e30707ab30 0x55e30707cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.604+0000 7f7b84287640 1 --2- 172.21.15.170:0/2354286750 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55e30707ab30 0x55e30707cfc0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.604+0000 7f7b84287640 1 -- 172.21.15.170:0/2354286750 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b7c00e070 con 0x55e30707ab30 2024-09-12T17:29:46.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.604+0000 7f7b87d40800 1 -- 172.21.15.170:0/2354286750 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e30707df20 con 0x55e30707ab30 2024-09-12T17:29:46.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.604+0000 7f7b84287640 1 -- 172.21.15.170:0/2354286750 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7b7c00e070 con 0x55e30707ab30 2024-09-12T17:29:46.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.604+0000 7f7b87d40800 1 --2- 172.21.15.170:0/2354286750 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55e30707f830 0x55e307081cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.604+0000 7f7b87d40800 1 -- 172.21.15.170:0/2354286750 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e307082420 con 0x55e30707f830 2024-09-12T17:29:46.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.604+0000 7f7b83a86640 1 --2- 172.21.15.170:0/2354286750 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55e30707f830 0x55e307081cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.605+0000 7f7b83a86640 1 --2- 172.21.15.170:0/2354286750 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55e30707f830 0x55e307081cc0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.605+0000 7f7b83a86640 1 -- 172.21.15.170:0/2354286750 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7b74096d20 con 0x55e30707f830 2024-09-12T17:29:46.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.606+0000 7f7b87d40800 1 -- 172.21.15.170:0/4237870858 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f7a5c03c730 msgr2=0x7f7a5c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.606+0000 7f7b87d40800 1 --2- 172.21.15.170:0/4237870858 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f7a5c03c730 0x7f7a5c03ebf0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c001db0 tx=0x7f7b6c001310 comp rx=0 tx=0).stop 2024-09-12T17:29:46.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.606+0000 7f7b87d40800 1 -- 172.21.15.170:0/4237870858 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e30704c5e0 msgr2=0x55e3070533d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.606+0000 7f7b87d40800 1 --2- 172.21.15.170:0/4237870858 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e30704c5e0 0x55e3070533d0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x55e3070478e0 tx=0x7f7b7c003370 comp rx=0 tx=0).stop 2024-09-12T17:29:46.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.606+0000 7f7b87d40800 1 -- 172.21.15.170:0/4237870858 shutdown_connections 2024-09-12T17:29:46.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.606+0000 7f7b87d40800 1 --2- 172.21.15.170:0/4237870858 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f7a5c03c730 0x7f7a5c03ebf0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.606+0000 7f7b87d40800 1 --2- 172.21.15.170:0/4237870858 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e30704c5e0 0x55e3070533d0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.606+0000 7f7b87d40800 1 -- 172.21.15.170:0/4237870858 >> 172.21.15.170:0/4237870858 conn(0x55e306f46010 msgr2=0x55e307046ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:46.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.606+0000 7f7b87d40800 1 -- 172.21.15.170:0/4237870858 shutdown_connections 2024-09-12T17:29:46.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.606+0000 7f7b87d40800 1 -- 172.21.15.170:0/4237870858 wait complete. 2024-09-12T17:29:46.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.606+0000 7f7b87d40800 1 -- 172.21.15.170:0/3845702230 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f79c403c780 msgr2=0x7f79c403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.606+0000 7f7b87d40800 1 --2- 172.21.15.170:0/3845702230 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f79c403c780 0x7f79c403ec40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c000f60 tx=0x7f7b6c00f000 comp rx=0 tx=0).stop 2024-09-12T17:29:46.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.606+0000 7f7b87d40800 1 -- 172.21.15.170:0/3845702230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e30706d260 msgr2=0x55e30706d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.606+0000 7f7b87d40800 1 --2- 172.21.15.170:0/3845702230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e30706d260 0x55e30706d680 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f7b74094b80 tx=0x7f7b74094ae0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.606+0000 7f7b87d40800 1 -- 172.21.15.170:0/3845702230 shutdown_connections 2024-09-12T17:29:46.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.606+0000 7f7b87d40800 1 --2- 172.21.15.170:0/3845702230 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f79c403c780 0x7f79c403ec40 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.606+0000 7f7b87d40800 1 --2- 172.21.15.170:0/3845702230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e30706d260 0x55e30706d680 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.606+0000 7f7b87d40800 1 -- 172.21.15.170:0/3845702230 >> 172.21.15.170:0/3845702230 conn(0x55e3070627e0 msgr2=0x55e307062bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:46.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.606+0000 7f7b87d40800 1 -- 172.21.15.170:0/3845702230 shutdown_connections 2024-09-12T17:29:46.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.606+0000 7f7b87d40800 1 -- 172.21.15.170:0/3845702230 wait complete. 2024-09-12T17:29:46.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.606+0000 7f7b87d40800 1 -- 172.21.15.170:0/2354286750 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55e30707ab30 msgr2=0x55e30707cfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.606+0000 7f7b87d40800 1 --2- 172.21.15.170:0/2354286750 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55e30707ab30 0x55e30707cfc0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.606+0000 7f7b87d40800 1 -- 172.21.15.170:0/2354286750 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55e30707f830 msgr2=0x55e307081cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.606+0000 7f7b87d40800 1 --2- 172.21.15.170:0/2354286750 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55e30707f830 0x55e307081cc0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.607+0000 7f7b87d40800 1 -- 172.21.15.170:0/2354286750 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f7a6c03c730 msgr2=0x7f7a6c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.607+0000 7f7b87d40800 1 --2- 172.21.15.170:0/2354286750 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f7a6c03c730 0x7f7a6c03ebf0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7b74005770 tx=0x7f7b7404fe90 comp rx=0 tx=0).stop 2024-09-12T17:29:46.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.607+0000 7f7b87d40800 1 -- 172.21.15.170:0/2354286750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e306f44dd0 msgr2=0x55e30703f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.607+0000 7f7b87d40800 1 --2- 172.21.15.170:0/2354286750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e306f44dd0 0x55e30703f090 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f7b7400a370 tx=0x7f7b74002fb0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.607+0000 7f7b87d40800 1 -- 172.21.15.170:0/2354286750 shutdown_connections 2024-09-12T17:29:46.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.607+0000 7f7b87d40800 1 --2- 172.21.15.170:0/2354286750 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55e30707f830 0x55e307081cc0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.607+0000 7f7b87d40800 1 --2- 172.21.15.170:0/2354286750 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f7a6c03c730 0x7f7a6c03ebf0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.607+0000 7f7b87d40800 1 --2- 172.21.15.170:0/2354286750 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55e30707ab30 0x55e30707cfc0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.607+0000 7f7b87d40800 1 --2- 172.21.15.170:0/2354286750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e306f44dd0 0x55e30703f090 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.607+0000 7f7b87d40800 1 -- 172.21.15.170:0/2354286750 >> 172.21.15.170:0/2354286750 conn(0x55e306f401a0 msgr2=0x55e3070389e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:46.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.607+0000 7f7b87d40800 1 -- 172.21.15.170:0/2354286750 shutdown_connections 2024-09-12T17:29:46.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.607+0000 7f7b87d40800 1 -- 172.21.15.170:0/2354286750 wait complete. 2024-09-12T17:29:46.626 INFO:teuthology.orchestra.run.smithi170.stdout:{"id":"dc43fae2-274b-4ee4-ac82-d8ac27e45bf4","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"7f05c86a-1902-4046-a99f-31d6f38ce8f7","zones":[{"id":"7f05c86a-1902-4046-a99f-31d6f38ce8f7","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-09-12T17:29:46.626 DEBUG:tasks.util.rgw: json result: {'id': 'dc43fae2-274b-4ee4-ac82-d8ac27e45bf4', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': '7f05c86a-1902-4046-a99f-31d6f38ce8f7', 'zones': [{'id': '7f05c86a-1902-4046-a99f-31d6f38ce8f7', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['notification_v2', 'resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['notification_v2', 'resharding']} 2024-09-12T17:29:46.629 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2024-09-12T17:29:46.654 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-12T17:29:46.654 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-12T17:29:46.655 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2024-09-12T17:29:46.722 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:29:46.722 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:29:46.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.721+0000 7f3bc61af800 1 Processor -- start 2024-09-12T17:29:46.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.721+0000 7f3bc61af800 1 -- start start 2024-09-12T17:29:46.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.721+0000 7f3bc61af800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5612fcc07660 0x5612fcc09a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.721+0000 7f3bc61af800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5612fcab0e40 con 0x5612fcc0a080 2024-09-12T17:29:46.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.721+0000 7f3bc61af800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x5612fca7b680 con 0x5612fcc07660 2024-09-12T17:29:46.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.722+0000 7f3bc3ca0640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5612fcc07660 0x5612fcc09a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.722+0000 7f3bc349f640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x5612fcc0a080 0x5612fcc0c540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:44874/0 (socket says 172.21.15.170:44874) 2024-09-12T17:29:46.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.722+0000 7f3bc3ca0640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5612fcc07660 0x5612fcc09a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34804/0 (socket says 172.21.15.170:34804) 2024-09-12T17:29:46.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.722+0000 7f3bc349f640 1 -- 172.21.15.170:0/436049324 learned_addr learned my addr 172.21.15.170:0/436049324 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:29:46.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.722+0000 7f3bc3ca0640 1 -- 172.21.15.170:0/436049324 >> v1:172.21.15.47:6789/0 conn(0x5612fcc0a080 legacy=0x5612fcc0c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.722+0000 7f3bc3ca0640 1 -- 172.21.15.170:0/436049324 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612fca976b0 con 0x5612fcc07660 2024-09-12T17:29:46.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.724+0000 7f3bc3ca0640 1 --2- 172.21.15.170:0/436049324 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5612fcc07660 0x5612fcc09a50 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f3bb400a470 tx=0x7f3bb4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98f29c255c0abbc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.724+0000 7f3bc2c9e640 1 -- 172.21.15.170:0/436049324 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bb4053570 con 0x5612fcc07660 2024-09-12T17:29:46.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.724+0000 7f3bc2c9e640 1 -- 172.21.15.170:0/436049324 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bb4058070 con 0x5612fcc07660 2024-09-12T17:29:46.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.724+0000 7f3bc2c9e640 1 -- 172.21.15.170:0/436049324 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bb4053880 con 0x5612fcc07660 2024-09-12T17:29:46.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.724+0000 7f3bc61af800 1 -- 172.21.15.170:0/436049324 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5612fcc07660 msgr2=0x5612fcc09a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.724+0000 7f3bc61af800 1 --2- 172.21.15.170:0/436049324 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5612fcc07660 0x5612fcc09a50 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f3bb400a470 tx=0x7f3bb4045a20 comp rx=0 tx=0).stop 2024-09-12T17:29:46.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.725+0000 7f3bc61af800 1 -- 172.21.15.170:0/436049324 shutdown_connections 2024-09-12T17:29:46.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.725+0000 7f3bc61af800 1 --2- 172.21.15.170:0/436049324 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5612fcc07660 0x5612fcc09a50 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.725+0000 7f3bc61af800 1 -- 172.21.15.170:0/436049324 >> 172.21.15.170:0/436049324 conn(0x5612fcc01220 msgr2=0x5612fcc03680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:46.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.725+0000 7f3bc61af800 1 -- 172.21.15.170:0/436049324 shutdown_connections 2024-09-12T17:29:46.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.725+0000 7f3bc61af800 1 -- 172.21.15.170:0/436049324 wait complete. 2024-09-12T17:29:46.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.738+0000 7f3bc61af800 1 Processor -- start 2024-09-12T17:29:46.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.739+0000 7f3bc61af800 1 -- start start 2024-09-12T17:29:46.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.739+0000 7f3bc61af800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5612fcc07660 0x5612fcc06dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.739+0000 7f3bc61af800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5612fca9fdd0 con 0x5612fcc07660 2024-09-12T17:29:46.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.739+0000 7f3bc3ca0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5612fcc07660 0x5612fcc06dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.739+0000 7f3bc3ca0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5612fcc07660 0x5612fcc06dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34812/0 (socket says 172.21.15.170:34812) 2024-09-12T17:29:46.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.739+0000 7f3bc3ca0640 1 -- 172.21.15.170:0/3001952826 learned_addr learned my addr 172.21.15.170:0/3001952826 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:46.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.739+0000 7f3bc3ca0640 1 -- 172.21.15.170:0/3001952826 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612fcab8e10 con 0x5612fcc07660 2024-09-12T17:29:46.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.739+0000 7f3bc3ca0640 1 --2- 172.21.15.170:0/3001952826 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5612fcc07660 0x5612fcc06dd0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4025c20 tx=0x7f3bb4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcf82cf5dec25442 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.740+0000 7f3ab1e0b640 1 -- 172.21.15.170:0/3001952826 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bb4053a20 con 0x5612fcc07660 2024-09-12T17:29:46.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.740+0000 7f3ab1e0b640 1 -- 172.21.15.170:0/3001952826 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bb4063070 con 0x5612fcc07660 2024-09-12T17:29:46.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.740+0000 7f3ab1e0b640 1 -- 172.21.15.170:0/3001952826 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bb4053cf0 con 0x5612fcc07660 2024-09-12T17:29:46.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.740+0000 7f3bc61af800 1 -- 172.21.15.170:0/3001952826 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5612fcc07660 msgr2=0x5612fcc06dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.740+0000 7f3bc61af800 1 --2- 172.21.15.170:0/3001952826 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5612fcc07660 0x5612fcc06dd0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4025c20 tx=0x7f3bb4051000 comp rx=0 tx=0).stop 2024-09-12T17:29:46.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.740+0000 7f3bc61af800 1 -- 172.21.15.170:0/3001952826 shutdown_connections 2024-09-12T17:29:46.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.740+0000 7f3bc61af800 1 --2- 172.21.15.170:0/3001952826 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5612fcc07660 0x5612fcc06dd0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.740+0000 7f3bc61af800 1 -- 172.21.15.170:0/3001952826 >> 172.21.15.170:0/3001952826 conn(0x5612fcc01220 msgr2=0x5612fccf2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:46.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.740+0000 7f3bc61af800 1 -- 172.21.15.170:0/3001952826 shutdown_connections 2024-09-12T17:29:46.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.741+0000 7f3bc61af800 1 -- 172.21.15.170:0/3001952826 wait complete. 2024-09-12T17:29:46.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.741+0000 7f3bc61af800 1 Processor -- start 2024-09-12T17:29:46.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.741+0000 7f3bc61af800 1 -- start start 2024-09-12T17:29:46.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.741+0000 7f3bc61af800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5612fcc07660 0x5612fcd002b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.741+0000 7f3bc61af800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5612fcc0e0a0 con 0x5612fcc07660 2024-09-12T17:29:46.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.741+0000 7f3bc3ca0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5612fcc07660 0x5612fcd002b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.741+0000 7f3bc3ca0640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5612fcc07660 0x5612fcd002b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34822/0 (socket says 172.21.15.170:34822) 2024-09-12T17:29:46.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.741+0000 7f3bc3ca0640 1 -- 172.21.15.170:0/4278564772 learned_addr learned my addr 172.21.15.170:0/4278564772 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:46.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.742+0000 7f3bc3ca0640 1 -- 172.21.15.170:0/4278564772 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612fcd00810 con 0x5612fcc07660 2024-09-12T17:29:46.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.742+0000 7f3bc3ca0640 1 --2- 172.21.15.170:0/4278564772 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5612fcc07660 0x5612fcd002b0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4025c20 tx=0x7f3bb4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.742+0000 7f3aabfff640 1 -- 172.21.15.170:0/4278564772 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bb406c030 con 0x5612fcc07660 2024-09-12T17:29:46.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.742+0000 7f3aabfff640 1 -- 172.21.15.170:0/4278564772 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bb4068660 con 0x5612fcc07660 2024-09-12T17:29:46.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.742+0000 7f3aabfff640 1 -- 172.21.15.170:0/4278564772 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bb4068940 con 0x5612fcc07660 2024-09-12T17:29:46.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.742+0000 7f3bc61af800 1 -- 172.21.15.170:0/4278564772 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5612fcd00aa0 con 0x5612fcc07660 2024-09-12T17:29:46.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.742+0000 7f3bc61af800 1 -- 172.21.15.170:0/4278564772 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612fcd014a0 con 0x5612fcc07660 2024-09-12T17:29:46.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.743+0000 7f3aabfff640 1 -- 172.21.15.170:0/4278564772 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3bb4068ae0 con 0x5612fcc07660 2024-09-12T17:29:46.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.743+0000 7f3aabfff640 1 --2- 172.21.15.170:0/4278564772 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3aac03c730 0x7f3aac03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.743+0000 7f3aabfff640 1 -- 172.21.15.170:0/4278564772 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f3bb4097eb0 con 0x5612fcc07660 2024-09-12T17:29:46.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.743+0000 7f3bc349f640 1 --2- 172.21.15.170:0/4278564772 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3aac03c730 0x7f3aac03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.743+0000 7f3bc61af800 1 --2- 172.21.15.170:0/4278564772 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5612fcc0a080 0x5612fcd07900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.743+0000 7f3bc61af800 1 -- 172.21.15.170:0/4278564772 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd07e40 con 0x5612fcc0a080 2024-09-12T17:29:46.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.743+0000 7f3bc44a1640 1 --2- 172.21.15.170:0/4278564772 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5612fcc0a080 0x5612fcd07900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.744+0000 7f3bc349f640 1 --2- 172.21.15.170:0/4278564772 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3aac03c730 0x7f3aac03ebf0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3bb8001d70 tx=0x7f3bb80012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.744+0000 7f3bc44a1640 1 --2- 172.21.15.170:0/4278564772 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5612fcc0a080 0x5612fcd07900 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.744+0000 7f3bc44a1640 1 -- 172.21.15.170:0/4278564772 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3bbc00a4d0 con 0x5612fcc0a080 2024-09-12T17:29:46.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.744+0000 7f3bc61af800 1 -- 172.21.15.170:0/4278564772 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd081e0 con 0x5612fcc0a080 2024-09-12T17:29:46.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.744+0000 7f3bc44a1640 1 -- 172.21.15.170:0/4278564772 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3bbc00a4d0 con 0x5612fcc0a080 2024-09-12T17:29:46.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.744+0000 7f3bc61af800 1 --2- 172.21.15.170:0/4278564772 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5612fcd09ce0 0x5612fcd0c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.744+0000 7f3bc61af800 1 -- 172.21.15.170:0/4278564772 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd0c8f0 con 0x5612fcd09ce0 2024-09-12T17:29:46.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.745+0000 7f3bc3ca0640 1 --2- 172.21.15.170:0/4278564772 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5612fcd09ce0 0x5612fcd0c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.745+0000 7f3bc3ca0640 1 --2- 172.21.15.170:0/4278564772 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5612fcd09ce0 0x5612fcd0c160 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.745+0000 7f3bc3ca0640 1 -- 172.21.15.170:0/4278564772 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3bb4051070 con 0x5612fcd09ce0 2024-09-12T17:29:46.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.745+0000 7f3bc61af800 1 -- 172.21.15.170:0/4278564772 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd08a30 con 0x5612fcc0a080 2024-09-12T17:29:46.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.745+0000 7f3bc44a1640 1 -- 172.21.15.170:0/4278564772 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3bbc00a4d0 con 0x5612fcc0a080 2024-09-12T17:29:46.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.745+0000 7f3bc61af800 1 -- 172.21.15.170:0/4278564772 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd08e80 con 0x5612fcd09ce0 2024-09-12T17:29:46.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.746+0000 7f3bc3ca0640 1 -- 172.21.15.170:0/4278564772 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3bb4051070 con 0x5612fcd09ce0 2024-09-12T17:29:46.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.746+0000 7f3bc61af800 1 Processor -- start 2024-09-12T17:29:46.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.746+0000 7f3bc61af800 1 -- start start 2024-09-12T17:29:46.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.746+0000 7f3bc61af800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5612fcd1b1a0 0x5612fcd1b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.746+0000 7f3bc61af800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5612fcafda00 con 0x5612fcd1b1a0 2024-09-12T17:29:46.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.746+0000 7f3bc44a1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5612fcd1b1a0 0x5612fcd1b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.746+0000 7f3bc44a1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5612fcd1b1a0 0x5612fcd1b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34838/0 (socket says 172.21.15.170:34838) 2024-09-12T17:29:46.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.746+0000 7f3bc44a1640 1 -- 172.21.15.170:0/3796150527 learned_addr learned my addr 172.21.15.170:0/3796150527 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:46.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.747+0000 7f3bc44a1640 1 -- 172.21.15.170:0/3796150527 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612fcd1bc00 con 0x5612fcd1b1a0 2024-09-12T17:29:46.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.747+0000 7f3bc44a1640 1 --2- 172.21.15.170:0/3796150527 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5612fcd1b1a0 0x5612fcd1b5c0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x5612fcd012b0 tx=0x7f3bbc0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.747+0000 7f3aa97fa640 1 -- 172.21.15.170:0/3796150527 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bbc013640 con 0x5612fcd1b1a0 2024-09-12T17:29:46.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.747+0000 7f3bc61af800 1 -- 172.21.15.170:0/3796150527 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5612fcd1c430 con 0x5612fcd1b1a0 2024-09-12T17:29:46.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.747+0000 7f3aa97fa640 1 -- 172.21.15.170:0/3796150527 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bbc0137e0 con 0x5612fcd1b1a0 2024-09-12T17:29:46.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.747+0000 7f3aa97fa640 1 -- 172.21.15.170:0/3796150527 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bbc013ae0 con 0x5612fcd1b1a0 2024-09-12T17:29:46.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.747+0000 7f3bc61af800 1 -- 172.21.15.170:0/3796150527 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612fcd1c9d0 con 0x5612fcd1b1a0 2024-09-12T17:29:46.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.748+0000 7f3aa97fa640 1 -- 172.21.15.170:0/3796150527 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3bbc011040 con 0x5612fcd1b1a0 2024-09-12T17:29:46.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.748+0000 7f3aa97fa640 1 --2- 172.21.15.170:0/3796150527 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3a9c03c730 0x7f3a9c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.748+0000 7f3aa97fa640 1 -- 172.21.15.170:0/3796150527 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f3bbc00e040 con 0x5612fcd1b1a0 2024-09-12T17:29:46.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.748+0000 7f3bc3ca0640 1 --2- 172.21.15.170:0/3796150527 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3a9c03c730 0x7f3a9c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.749+0000 7f3bc61af800 1 Processor -- start 2024-09-12T17:29:46.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.749+0000 7f3bc3ca0640 1 --2- 172.21.15.170:0/3796150527 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3a9c03c730 0x7f3a9c03ebf0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4096410 tx=0x7f3bb405fe70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.749+0000 7f3bc61af800 1 -- start start 2024-09-12T17:29:46.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.749+0000 7f3bc61af800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5612fcd27cc0 0x5612fcd280c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.749+0000 7f3bc61af800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5612fcc05670 con 0x5612fcd27cc0 2024-09-12T17:29:46.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.749+0000 7f3bc44a1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5612fcd27cc0 0x5612fcd280c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.749+0000 7f3bc44a1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5612fcd27cc0 0x5612fcd280c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34842/0 (socket says 172.21.15.170:34842) 2024-09-12T17:29:46.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.749+0000 7f3bc44a1640 1 -- 172.21.15.170:0/3694961128 learned_addr learned my addr 172.21.15.170:0/3694961128 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:46.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.749+0000 7f3bc44a1640 1 -- 172.21.15.170:0/3694961128 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612fcd286b0 con 0x5612fcd27cc0 2024-09-12T17:29:46.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.750+0000 7f3bc44a1640 1 --2- 172.21.15.170:0/3694961128 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5612fcd27cc0 0x5612fcd280c0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc053d60 tx=0x7f3bbc01fc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20089765a7f61d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.750+0000 7f3aa2ffd640 1 -- 172.21.15.170:0/3694961128 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bbc021a40 con 0x5612fcd27cc0 2024-09-12T17:29:46.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.750+0000 7f3aa2ffd640 1 -- 172.21.15.170:0/3694961128 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bbc021440 con 0x5612fcd27cc0 2024-09-12T17:29:46.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.750+0000 7f3aa2ffd640 1 -- 172.21.15.170:0/3694961128 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bbc01f340 con 0x5612fcd27cc0 2024-09-12T17:29:46.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.750+0000 7f3bc61af800 1 -- 172.21.15.170:0/3694961128 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5612fcd27cc0 msgr2=0x5612fcd280c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.750+0000 7f3bc61af800 1 --2- 172.21.15.170:0/3694961128 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5612fcd27cc0 0x5612fcd280c0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc053d60 tx=0x7f3bbc01fc40 comp rx=0 tx=0).stop 2024-09-12T17:29:46.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.750+0000 7f3bc61af800 1 -- 172.21.15.170:0/3694961128 shutdown_connections 2024-09-12T17:29:46.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.750+0000 7f3bc61af800 1 --2- 172.21.15.170:0/3694961128 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5612fcd27cc0 0x5612fcd280c0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.750+0000 7f3bc61af800 1 -- 172.21.15.170:0/3694961128 >> 172.21.15.170:0/3694961128 conn(0x5612fcd240c0 msgr2=0x5612fcd22300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:46.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.750+0000 7f3bc61af800 1 -- 172.21.15.170:0/3694961128 shutdown_connections 2024-09-12T17:29:46.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.750+0000 7f3bc61af800 1 -- 172.21.15.170:0/3694961128 wait complete. 2024-09-12T17:29:46.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.751+0000 7f3bc61af800 1 Processor -- start 2024-09-12T17:29:46.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.751+0000 7f3bc61af800 1 -- start start 2024-09-12T17:29:46.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.751+0000 7f3bc61af800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5612fcd27cc0 0x5612fcd2f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.751+0000 7f3bc61af800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5612fcd28cd0 con 0x5612fcd27cc0 2024-09-12T17:29:46.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.751+0000 7f3bc44a1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5612fcd27cc0 0x5612fcd2f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.751+0000 7f3bc44a1640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5612fcd27cc0 0x5612fcd2f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34848/0 (socket says 172.21.15.170:34848) 2024-09-12T17:29:46.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.751+0000 7f3bc44a1640 1 -- 172.21.15.170:0/2762702445 learned_addr learned my addr 172.21.15.170:0/2762702445 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:46.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.751+0000 7f3bc44a1640 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612fcd2f7e0 con 0x5612fcd27cc0 2024-09-12T17:29:46.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.752+0000 7f3bc44a1640 1 --2- 172.21.15.170:0/2762702445 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5612fcd27cc0 0x5612fcd2f280 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc047040 tx=0x7f3bbc053cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.752+0000 7f3aa17fa640 1 -- 172.21.15.170:0/2762702445 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bbc055720 con 0x5612fcd27cc0 2024-09-12T17:29:46.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.752+0000 7f3aa17fa640 1 -- 172.21.15.170:0/2762702445 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bbc020800 con 0x5612fcd27cc0 2024-09-12T17:29:46.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.752+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5612fcd2fa70 con 0x5612fcd27cc0 2024-09-12T17:29:46.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.752+0000 7f3aa17fa640 1 -- 172.21.15.170:0/2762702445 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bbc020ae0 con 0x5612fcd27cc0 2024-09-12T17:29:46.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.752+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612fcd303f0 con 0x5612fcd27cc0 2024-09-12T17:29:46.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.753+0000 7f3aa17fa640 1 -- 172.21.15.170:0/2762702445 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3bbc03b060 con 0x5612fcd27cc0 2024-09-12T17:29:46.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.753+0000 7f3aa17fa640 1 --2- 172.21.15.170:0/2762702445 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3a8c03c730 0x7f3a8c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.753+0000 7f3aa17fa640 1 -- 172.21.15.170:0/2762702445 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f3bbc03ebb0 con 0x5612fcd27cc0 2024-09-12T17:29:46.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.753+0000 7f3bc3ca0640 1 --2- 172.21.15.170:0/2762702445 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3a8c03c730 0x7f3a8c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.753+0000 7f3bc3ca0640 1 --2- 172.21.15.170:0/2762702445 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3a8c03c730 0x7f3a8c03ebf0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4068fd0 tx=0x7f3bb4092000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.753+0000 7f3bc61af800 20 rados->read ofs=0 len=0 2024-09-12T17:29:46.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.753+0000 7f3bc61af800 1 --2- 172.21.15.170:0/2762702445 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5612fcd3ac00 0x5612fcd3d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.753+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd3d810 con 0x5612fcd3ac00 2024-09-12T17:29:46.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.754+0000 7f3bc349f640 1 --2- 172.21.15.170:0/2762702445 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5612fcd3ac00 0x5612fcd3d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.754+0000 7f3bc349f640 1 --2- 172.21.15.170:0/2762702445 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5612fcd3ac00 0x5612fcd3d0c0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.754+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3bb8009050 con 0x5612fcd3ac00 2024-09-12T17:29:46.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.754+0000 7f3bc61af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:46.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.754+0000 7f3bc61af800 20 realm 2024-09-12T17:29:46.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.754+0000 7f3bc61af800 20 rados->read ofs=0 len=0 2024-09-12T17:29:46.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.754+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd39f50 con 0x5612fcd3ac00 2024-09-12T17:29:46.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.754+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3bb8009050 con 0x5612fcd3ac00 2024-09-12T17:29:46.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.754+0000 7f3bc61af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:46.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.754+0000 7f3bc61af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:29:46.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.754+0000 7f3bc61af800 20 rados->read ofs=0 len=0 2024-09-12T17:29:46.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.754+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd3e300 con 0x5612fcd3ac00 2024-09-12T17:29:46.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.754+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3bb8009050 con 0x5612fcd3ac00 2024-09-12T17:29:46.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.754+0000 7f3bc61af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:46.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.754+0000 7f3bc61af800 20 rados->read ofs=0 len=0 2024-09-12T17:29:46.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.755+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd3ebd0 con 0x5612fcd3ac00 2024-09-12T17:29:46.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.755+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3bb8009050 con 0x5612fcd3ac00 2024-09-12T17:29:46.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.755+0000 7f3bc61af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:46.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.755+0000 7f3bc61af800 20 rados->read ofs=0 len=0 2024-09-12T17:29:46.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.755+0000 7f3bc61af800 1 --2- 172.21.15.170:0/2762702445 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5612fcd3f5f0 0x5612fcd419e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.755+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd42120 con 0x5612fcd3f5f0 2024-09-12T17:29:46.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.755+0000 7f3bc44a1640 1 --2- 172.21.15.170:0/2762702445 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5612fcd3f5f0 0x5612fcd419e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.755+0000 7f3bc44a1640 1 --2- 172.21.15.170:0/2762702445 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5612fcd3f5f0 0x5612fcd419e0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.755+0000 7f3bc44a1640 1 -- 172.21.15.170:0/2762702445 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3bbc00a4d0 con 0x5612fcd3f5f0 2024-09-12T17:29:46.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.755+0000 7f3bc61af800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:29:46.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.755+0000 7f3bc61af800 20 searching for the correct realm 2024-09-12T17:29:46.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.755+0000 7f3bc61af800 1 --2- 172.21.15.170:0/2762702445 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5612fcd440d0 0x5612fcd46590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.756+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd46c10 con 0x5612fcd440d0 2024-09-12T17:29:46.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.756+0000 7f3bc3ca0640 1 --2- 172.21.15.170:0/2762702445 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5612fcd440d0 0x5612fcd46590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.756+0000 7f3bc3ca0640 1 --2- 172.21.15.170:0/2762702445 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5612fcd440d0 0x5612fcd46590 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.756+0000 7f3bc3ca0640 1 -- 172.21.15.170:0/2762702445 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bb4051070 con 0x5612fcd440d0 2024-09-12T17:29:46.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.756+0000 7f3bc3ca0640 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd46c10 con 0x5612fcd3f5f0 2024-09-12T17:29:46.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.756+0000 7f3bc44a1640 1 -- 172.21.15.170:0/2762702445 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bbc00a4d0 con 0x5612fcd3f5f0 2024-09-12T17:29:46.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.756+0000 7f3bc44a1640 1 --2- 172.21.15.170:0/2762702445 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f3bbc048ae0 0x7f3bbc045980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.756+0000 7f3bc44a1640 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd46c10 con 0x7f3bbc048ae0 2024-09-12T17:29:46.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.757+0000 7f3bc349f640 1 --2- 172.21.15.170:0/2762702445 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f3bbc048ae0 0x7f3bbc045980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.757+0000 7f3bc349f640 1 --2- 172.21.15.170:0/2762702445 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f3bbc048ae0 0x7f3bbc045980 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.758+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bb8009050 con 0x7f3bbc048ae0 2024-09-12T17:29:46.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.758+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd46c10 con 0x5612fcd3ac00 2024-09-12T17:29:46.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.758+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bb8009050 con 0x5612fcd3ac00 2024-09-12T17:29:46.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.758+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd46c10 con 0x5612fcd3ac00 2024-09-12T17:29:46.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.758+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bb8029040 con 0x5612fcd3ac00 2024-09-12T17:29:46.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.758+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd46c10 con 0x7f3bbc048ae0 2024-09-12T17:29:46.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.759+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bb8029040 con 0x7f3bbc048ae0 2024-09-12T17:29:46.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.759+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd46c10 con 0x7f3bbc048ae0 2024-09-12T17:29:46.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.759+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bb8029040 con 0x7f3bbc048ae0 2024-09-12T17:29:46.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.759+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd46c10 con 0x5612fcd3f5f0 2024-09-12T17:29:46.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.759+0000 7f3bc44a1640 1 -- 172.21.15.170:0/2762702445 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bbc00a4d0 con 0x5612fcd3f5f0 2024-09-12T17:29:46.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.759+0000 7f3bc44a1640 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd46c10 con 0x5612fcd440d0 2024-09-12T17:29:46.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.760+0000 7f3bc3ca0640 1 -- 172.21.15.170:0/2762702445 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bb4051070 con 0x5612fcd440d0 2024-09-12T17:29:46.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.760+0000 7f3bc3ca0640 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd46c10 con 0x5612fcd3ac00 2024-09-12T17:29:46.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.760+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bb8029040 con 0x5612fcd3ac00 2024-09-12T17:29:46.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.760+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd46c10 con 0x7f3bbc048ae0 2024-09-12T17:29:46.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.760+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bb8029040 con 0x7f3bbc048ae0 2024-09-12T17:29:46.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.760+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd46c10 con 0x5612fcd3ac00 2024-09-12T17:29:46.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.760+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bb8029040 con 0x5612fcd3ac00 2024-09-12T17:29:46.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.760+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd46c10 con 0x5612fcd3f5f0 2024-09-12T17:29:46.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.761+0000 7f3bc44a1640 1 -- 172.21.15.170:0/2762702445 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f3bbc00a4d0 con 0x5612fcd3f5f0 2024-09-12T17:29:46.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.761+0000 7f3bc44a1640 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd46c10 con 0x5612fcd440d0 2024-09-12T17:29:46.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.761+0000 7f3bc3ca0640 1 -- 172.21.15.170:0/2762702445 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bb4051070 con 0x5612fcd440d0 2024-09-12T17:29:46.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.761+0000 7f3bc3ca0640 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd46c10 con 0x5612fcd440d0 2024-09-12T17:29:46.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.761+0000 7f3bc3ca0640 1 -- 172.21.15.170:0/2762702445 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bb4051070 con 0x5612fcd440d0 2024-09-12T17:29:46.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.761+0000 7f3bc3ca0640 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd46c10 con 0x5612fcd3f5f0 2024-09-12T17:29:46.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.761+0000 7f3bc44a1640 1 -- 172.21.15.170:0/2762702445 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bbc00a4d0 con 0x5612fcd3f5f0 2024-09-12T17:29:46.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.761+0000 7f3bc44a1640 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd46c10 con 0x5612fcd440d0 2024-09-12T17:29:46.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.761+0000 7f3bc3ca0640 1 -- 172.21.15.170:0/2762702445 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bb4051070 con 0x5612fcd440d0 2024-09-12T17:29:46.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.761+0000 7f3bc3ca0640 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd46c10 con 0x5612fcd440d0 2024-09-12T17:29:46.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.762+0000 7f3bc3ca0640 1 -- 172.21.15.170:0/2762702445 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bb4051070 con 0x5612fcd440d0 2024-09-12T17:29:46.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.762+0000 7f3bc3ca0640 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd46c10 con 0x5612fcd3ac00 2024-09-12T17:29:46.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.762+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bb8029040 con 0x5612fcd3ac00 2024-09-12T17:29:46.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.762+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd46c10 con 0x5612fcd3ac00 2024-09-12T17:29:46.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.762+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v31'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3bb8029040 con 0x5612fcd3ac00 2024-09-12T17:29:46.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.762+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd46c10 con 0x7f3bbc048ae0 2024-09-12T17:29:46.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.762+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bb8029040 con 0x7f3bbc048ae0 2024-09-12T17:29:46.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.762+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd46c10 con 0x5612fcd440d0 2024-09-12T17:29:46.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.762+0000 7f3bc3ca0640 1 -- 172.21.15.170:0/2762702445 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bb4051070 con 0x5612fcd440d0 2024-09-12T17:29:46.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.763+0000 7f3bc3ca0640 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd46c10 con 0x5612fcd3f5f0 2024-09-12T17:29:46.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.763+0000 7f3bc44a1640 1 -- 172.21.15.170:0/2762702445 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bbc00a4d0 con 0x5612fcd3f5f0 2024-09-12T17:29:46.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.763+0000 7f3bc44a1640 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd46c10 con 0x5612fcd3ac00 2024-09-12T17:29:46.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.763+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bb8029040 con 0x5612fcd3ac00 2024-09-12T17:29:46.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.763+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd46c10 con 0x7f3bbc048ae0 2024-09-12T17:29:46.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.763+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bb8029040 con 0x7f3bbc048ae0 2024-09-12T17:29:46.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.763+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd46c10 con 0x5612fcd440d0 2024-09-12T17:29:46.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.763+0000 7f3bc3ca0640 1 -- 172.21.15.170:0/2762702445 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bb4051070 con 0x5612fcd440d0 2024-09-12T17:29:46.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.764+0000 7f3bc3ca0640 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd46c10 con 0x7f3bbc048ae0 2024-09-12T17:29:46.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.764+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bb8029040 con 0x7f3bbc048ae0 2024-09-12T17:29:46.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.764+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd46c10 con 0x5612fcd3f5f0 2024-09-12T17:29:46.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.764+0000 7f3bc44a1640 1 -- 172.21.15.170:0/2762702445 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bbc00a4d0 con 0x5612fcd3f5f0 2024-09-12T17:29:46.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.764+0000 7f3bc44a1640 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd46c10 con 0x5612fcd440d0 2024-09-12T17:29:46.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.764+0000 7f3bc3ca0640 1 -- 172.21.15.170:0/2762702445 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bb4051070 con 0x5612fcd440d0 2024-09-12T17:29:46.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.764+0000 7f3bc3ca0640 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd46c10 con 0x7f3bbc048ae0 2024-09-12T17:29:46.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.764+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bb8029040 con 0x7f3bbc048ae0 2024-09-12T17:29:46.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.764+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd46c10 con 0x5612fcd3ac00 2024-09-12T17:29:46.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.765+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3bb8029040 con 0x5612fcd3ac00 2024-09-12T17:29:46.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.765+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd46c10 con 0x5612fcd3f5f0 2024-09-12T17:29:46.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.765+0000 7f3bc44a1640 1 -- 172.21.15.170:0/2762702445 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(37 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3bbc00a4d0 con 0x5612fcd3f5f0 2024-09-12T17:29:46.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.765+0000 7f3bc61af800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:29:46.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.765+0000 7f3bc61af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:29:46.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.765+0000 7f3bc61af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:29:46.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.765+0000 7f3bc61af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:29:46.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.765+0000 7f3bc61af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:29:46.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.765+0000 7f3bc61af800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:29:46.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.765+0000 7f3bc61af800 20 rados->read ofs=0 len=0 2024-09-12T17:29:46.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.765+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd42ae0 con 0x5612fcd3ac00 2024-09-12T17:29:46.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.765+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3bb8029040 con 0x5612fcd3ac00 2024-09-12T17:29:46.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.765+0000 7f3bc61af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:46.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.765+0000 7f3bc61af800 20 rados->read ofs=0 len=0 2024-09-12T17:29:46.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.765+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd42720 con 0x5612fcd3ac00 2024-09-12T17:29:46.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.766+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3bb8029040 con 0x5612fcd3ac00 2024-09-12T17:29:46.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.766+0000 7f3bc61af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:46.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.766+0000 7f3bc61af800 20 rados->read ofs=0 len=0 2024-09-12T17:29:46.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.766+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd42f20 con 0x5612fcd3f5f0 2024-09-12T17:29:46.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.766+0000 7f3bc44a1640 1 -- 172.21.15.170:0/2762702445 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3bbc00a4d0 con 0x5612fcd3f5f0 2024-09-12T17:29:46.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.766+0000 7f3bc61af800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:29:46.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.766+0000 7f3bc61af800 20 zone default found 2024-09-12T17:29:46.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.766+0000 7f3bc61af800 4 Realm: () 2024-09-12T17:29:46.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.766+0000 7f3bc61af800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:29:46.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.766+0000 7f3bc61af800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:29:46.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.766+0000 7f3bc61af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:29:46.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.766+0000 7f3bc61af800 20 zonegroup default 2024-09-12T17:29:46.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.766+0000 7f3bc61af800 20 rados->read ofs=0 len=0 2024-09-12T17:29:46.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.766+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd47540 con 0x7f3bbc048ae0 2024-09-12T17:29:46.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.767+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3bb8029040 con 0x7f3bbc048ae0 2024-09-12T17:29:46.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.767+0000 7f3bc61af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:46.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.767+0000 7f3bc61af800 20 rados->read ofs=0 len=0 2024-09-12T17:29:46.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.767+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd49780 con 0x5612fcd440d0 2024-09-12T17:29:46.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.767+0000 7f3bc3ca0640 1 -- 172.21.15.170:0/2762702445 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3bb4051070 con 0x5612fcd440d0 2024-09-12T17:29:46.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.767+0000 7f3bc61af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:46.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.767+0000 7f3bc61af800 20 rados->read ofs=0 len=0 2024-09-12T17:29:46.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.767+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd49b20 con 0x5612fcd440d0 2024-09-12T17:29:46.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.767+0000 7f3bc3ca0640 1 -- 172.21.15.170:0/2762702445 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3bb4051070 con 0x5612fcd440d0 2024-09-12T17:29:46.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.767+0000 7f3bc61af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:46.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.767+0000 7f3bc61af800 20 started sync module instance, tier type = 2024-09-12T17:29:46.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.767+0000 7f3bc61af800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:29:46.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.767+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd48bc0 con 0x5612fcd3f5f0 2024-09-12T17:29:46.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.768+0000 7f3bc44a1640 1 -- 172.21.15.170:0/2762702445 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(44 notify.0 [create] v31'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bbc00a4d0 con 0x5612fcd3f5f0 2024-09-12T17:29:46.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.768+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94639551188912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd493d0 con 0x5612fcd3f5f0 2024-09-12T17:29:46.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.768+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd4a5f0 con 0x5612fcd3ac00 2024-09-12T17:29:46.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.769+0000 7f3bc44a1640 1 -- 172.21.15.170:0/2762702445 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94639551188912] v31'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bbc00a4d0 con 0x5612fcd3f5f0 2024-09-12T17:29:46.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.769+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v31'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bb8029040 con 0x5612fcd3ac00 2024-09-12T17:29:46.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.769+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94639551193408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd4aa10 con 0x5612fcd3ac00 2024-09-12T17:29:46.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.769+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd4b3d0 con 0x5612fcd440d0 2024-09-12T17:29:46.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.771+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94639551193408] v31'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bb8029040 con 0x5612fcd3ac00 2024-09-12T17:29:46.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.771+0000 7f3bc3ca0640 1 -- 172.21.15.170:0/2762702445 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v31'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bb4051070 con 0x5612fcd440d0 2024-09-12T17:29:46.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.771+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94639551197440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd4aa10 con 0x5612fcd440d0 2024-09-12T17:29:46.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.771+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd4be60 con 0x5612fcd3f5f0 2024-09-12T17:29:46.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.772+0000 7f3bc3ca0640 1 -- 172.21.15.170:0/2762702445 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94639551197440] v31'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bb4051070 con 0x5612fcd440d0 2024-09-12T17:29:46.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.772+0000 7f3bc44a1640 1 -- 172.21.15.170:0/2762702445 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(50 notify.3 [create] v31'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bbc00a4d0 con 0x5612fcd3f5f0 2024-09-12T17:29:46.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.772+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94639551199536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd4be20 con 0x5612fcd3f5f0 2024-09-12T17:29:46.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.772+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd4c940 con 0x5612fcd3ac00 2024-09-12T17:29:46.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.773+0000 7f3bc44a1640 1 -- 172.21.15.170:0/2762702445 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94639551199536] v31'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bbc00a4d0 con 0x5612fcd3f5f0 2024-09-12T17:29:46.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.773+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v31'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bb8029040 con 0x5612fcd3ac00 2024-09-12T17:29:46.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.773+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94639551202320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd4c900 con 0x5612fcd3ac00 2024-09-12T17:29:46.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.773+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd4d380 con 0x7f3bbc048ae0 2024-09-12T17:29:46.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.774+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(54 notify.5 [create] v31'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bb8029040 con 0x7f3bbc048ae0 2024-09-12T17:29:46.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.774+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94639551205072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd4d2f0 con 0x7f3bbc048ae0 2024-09-12T17:29:46.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.774+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd4e2f0 con 0x7f3bbc048ae0 2024-09-12T17:29:46.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.775+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94639551202320] v31'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bb8029040 con 0x5612fcd3ac00 2024-09-12T17:29:46.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.775+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94639551205072] v31'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bb8029040 con 0x7f3bbc048ae0 2024-09-12T17:29:46.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.776+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v31'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bb8029040 con 0x7f3bbc048ae0 2024-09-12T17:29:46.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.776+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94639551207328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd4ddf0 con 0x7f3bbc048ae0 2024-09-12T17:29:46.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.776+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd4e7a0 con 0x7f3bbc048ae0 2024-09-12T17:29:46.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.777+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94639551207328] v31'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bb8029040 con 0x7f3bbc048ae0 2024-09-12T17:29:46.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.777+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(58 notify.7 [create] v31'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bb8029040 con 0x7f3bbc048ae0 2024-09-12T17:29:46.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.777+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94639551194464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd4e7a0 con 0x7f3bbc048ae0 2024-09-12T17:29:46.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.777+0000 7f3bc61af800 20 add_watcher() i=0 2024-09-12T17:29:46.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.777+0000 7f3bc61af800 20 add_watcher() i=1 2024-09-12T17:29:46.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.777+0000 7f3bc61af800 20 add_watcher() i=2 2024-09-12T17:29:46.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.777+0000 7f3bc61af800 20 add_watcher() i=3 2024-09-12T17:29:46.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.777+0000 7f3bc61af800 20 add_watcher() i=4 2024-09-12T17:29:46.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.777+0000 7f3bc61af800 20 add_watcher() i=5 2024-09-12T17:29:46.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.777+0000 7f3bc61af800 20 add_watcher() i=6 2024-09-12T17:29:46.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.778+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94639551194464] v31'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bb8029040 con 0x7f3bbc048ae0 2024-09-12T17:29:46.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.778+0000 7f3bc61af800 20 add_watcher() i=7 2024-09-12T17:29:46.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.778+0000 7f3bc61af800 2 all 8 watchers are set, enabling cache 2024-09-12T17:29:46.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.778+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd51ba0 con 0x5612fcd3ac00 2024-09-12T17:29:46.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.778+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3bb8029040 con 0x5612fcd3ac00 2024-09-12T17:29:46.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.778+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94639551210688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd4f0f0 con 0x5612fcd3ac00 2024-09-12T17:29:46.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.779+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94639551210688] v31'240 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3bb8029040 con 0x5612fcd3ac00 2024-09-12T17:29:46.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.779+0000 7f3a79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:46.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.779+0000 7f3bc61af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:29:46.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.779+0000 7f3bc61af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:29:46.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.779+0000 7f3bc61af800 5 note: GC not initialized 2024-09-12T17:29:46.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.780+0000 7f3a78fe1640 20 reqs_thread_entry: start 2024-09-12T17:29:46.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.780+0000 7f3bc61af800 20 init_complete bucket index max shards: 11 2024-09-12T17:29:46.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.780+0000 7f3bc61af800 20 Filter name: none 2024-09-12T17:29:46.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.780+0000 7f39f27fc640 20 reqs_thread_entry: start 2024-09-12T17:29:46.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.780+0000 7f3bc61af800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-12T17:29:46.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.780+0000 7f3bc61af800 20 rados->read ofs=0 len=0 2024-09-12T17:29:46.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.780+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd84c80 con 0x7f3bbc048ae0 2024-09-12T17:29:46.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.780+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(62 ada [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f3bb8029040 con 0x7f3bbc048ae0 2024-09-12T17:29:46.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.780+0000 7f3bc61af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:46.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.780+0000 7f3bc61af800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2024-09-12T17:29:46.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.780+0000 7f3bc61af800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:29:46.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.780+0000 7f3bc61af800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2024-09-12T17:29:46.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.780+0000 7f3bc61af800 20 rados->read ofs=0 len=0 2024-09-12T17:29:46.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.780+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:63 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd83340 con 0x5612fcd3ac00 2024-09-12T17:29:46.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.781+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(63 MH1WC2XQ1S8UISFDZC8W [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f3bb8029040 con 0x5612fcd3ac00 2024-09-12T17:29:46.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.781+0000 7f3bc61af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:46.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.781+0000 7f3bc61af800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2024-09-12T17:29:46.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.781+0000 7f3bc61af800 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-12T17:29:46.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.781+0000 7f3bc61af800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-12T17:29:46.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.781+0000 7f3bc61af800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-12T17:29:46.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.781+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:64 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd83c10 con 0x7f3bbc048ae0 2024-09-12T17:29:46.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.782+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(64 ada [delete,create,call,writefull 0~473] v31'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f3bb8029040 con 0x7f3bbc048ae0 2024-09-12T17:29:46.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.782+0000 7f3bc61af800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T17:29:46.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.782+0000 7f3bc61af800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:29:46.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.782+0000 7f3bc61af800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-12T17:29:46.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.782+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94639551428448 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd885c0 con 0x5612fcd3ac00 2024-09-12T17:29:46.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.782+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== watch-notify(notify (1) cookie 94639551202320 notify 133143986195 ret 0) ==== 691+0+0 (crc 0 0 0) 0x5612fcd83fb0 con 0x5612fcd3ac00 2024-09-12T17:29:46.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.782+0000 7f3aa2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986195 cookie 94639551202320 notifier 4827 bl.length()=649 2024-09-12T17:29:46.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.782+0000 7f3aa2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T17:29:46.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.782+0000 7f3aa2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:29:46.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.782+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(65 notify.4 [notify cookie 94639551428448 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3bb8029040 con 0x5612fcd3ac00 2024-09-12T17:29:46.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.782+0000 7f3aa2ffd640 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f3a88003ea0 con 0x5612fcd3ac00 2024-09-12T17:29:46.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.783+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bb8029040 con 0x5612fcd3ac00 2024-09-12T17:29:46.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.783+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== watch-notify(notify_complete (2) cookie 94639551428448 notify 133143986195 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5612fcd847a0 con 0x5612fcd3ac00 2024-09-12T17:29:46.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.783+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:67 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd83710 con 0x5612fcd3ac00 2024-09-12T17:29:46.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.784+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(67 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v31'20 uv20 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f3bb8029040 con 0x5612fcd3ac00 2024-09-12T17:29:46.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.784+0000 7f3bc61af800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-12T17:29:46.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.784+0000 7f3bc61af800 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-12T17:29:46.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.784+0000 7f3bc61af800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2024-09-12T17:29:46.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.784+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94639551439088 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd83710 con 0x5612fcd440d0 2024-09-12T17:29:46.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.784+0000 7f3bc3ca0640 1 -- 172.21.15.170:0/2762702445 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== watch-notify(notify (1) cookie 94639551197440 notify 133143986194 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f3bb40a1040 con 0x5612fcd440d0 2024-09-12T17:29:46.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.784+0000 7f3aa27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986194 cookie 94639551197440 notifier 4827 bl.length()=177 2024-09-12T17:29:46.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.784+0000 7f3aa27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-12T17:29:46.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.784+0000 7f3aa27fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-12T17:29:46.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.784+0000 7f3aa27fc640 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f39f8003400 con 0x5612fcd440d0 2024-09-12T17:29:46.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.784+0000 7f3bc3ca0640 1 -- 172.21.15.170:0/2762702445 <== osd.3 v2:172.21.15.170:6816/2664906588 15 ==== osd_op_reply(68 notify.2 [notify cookie 94639551439088 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3bb4051070 con 0x5612fcd440d0 2024-09-12T17:29:46.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.784+0000 7f3bc3ca0640 1 -- 172.21.15.170:0/2762702445 <== osd.3 v2:172.21.15.170:6816/2664906588 16 ==== watch-notify(notify_complete (2) cookie 94639551439088 notify 133143986194 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5612fcd014a0 con 0x5612fcd440d0 2024-09-12T17:29:46.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.784+0000 7f3bc3ca0640 1 -- 172.21.15.170:0/2762702445 <== osd.3 v2:172.21.15.170:6816/2664906588 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bb4051070 con 0x5612fcd440d0 2024-09-12T17:29:46.798 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-12T17:29:46.782056Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:29:46.782042Z","tags":[],"group_ids":[]} 2024-09-12T17:29:46.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.785+0000 7f3a79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:46.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.785+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94639551210688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd82ab0 con 0x5612fcd3ac00 2024-09-12T17:29:46.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.786+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94639551210688] v31'241 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3bb8029040 con 0x5612fcd3ac00 2024-09-12T17:29:46.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.786+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94639551188912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd82ab0 con 0x5612fcd3f5f0 2024-09-12T17:29:46.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.787+0000 7f3bc44a1640 1 -- 172.21.15.170:0/2762702445 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94639551188912] v31'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bbc00a4d0 con 0x5612fcd3f5f0 2024-09-12T17:29:46.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.787+0000 7f3bc61af800 20 remove_watcher() i=0 2024-09-12T17:29:46.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.787+0000 7f3bc61af800 2 removed watcher, disabling cache 2024-09-12T17:29:46.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.787+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94639551193408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd82ab0 con 0x5612fcd3ac00 2024-09-12T17:29:46.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.788+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94639551193408] v31'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bb8029040 con 0x5612fcd3ac00 2024-09-12T17:29:46.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.788+0000 7f3bc61af800 20 remove_watcher() i=1 2024-09-12T17:29:46.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.788+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94639551197440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd82ab0 con 0x5612fcd440d0 2024-09-12T17:29:46.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.790+0000 7f3bc3ca0640 1 -- 172.21.15.170:0/2762702445 <== osd.3 v2:172.21.15.170:6816/2664906588 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94639551197440] v31'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bb4051070 con 0x5612fcd440d0 2024-09-12T17:29:46.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.790+0000 7f3bc61af800 20 remove_watcher() i=2 2024-09-12T17:29:46.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.790+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94639551199536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd82ab0 con 0x5612fcd3f5f0 2024-09-12T17:29:46.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.791+0000 7f3bc44a1640 1 -- 172.21.15.170:0/2762702445 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94639551199536] v31'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bbc00a4d0 con 0x5612fcd3f5f0 2024-09-12T17:29:46.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.791+0000 7f3bc61af800 20 remove_watcher() i=3 2024-09-12T17:29:46.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.791+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94639551202320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd82ab0 con 0x5612fcd3ac00 2024-09-12T17:29:46.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.792+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94639551202320] v31'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bb8029040 con 0x5612fcd3ac00 2024-09-12T17:29:46.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.792+0000 7f3bc61af800 20 remove_watcher() i=4 2024-09-12T17:29:46.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.792+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94639551205072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd82ab0 con 0x7f3bbc048ae0 2024-09-12T17:29:46.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.793+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94639551205072] v31'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bb8029040 con 0x7f3bbc048ae0 2024-09-12T17:29:46.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.793+0000 7f3bc61af800 20 remove_watcher() i=5 2024-09-12T17:29:46.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.793+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94639551207328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd82ab0 con 0x7f3bbc048ae0 2024-09-12T17:29:46.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.794+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94639551207328] v31'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bb8029040 con 0x7f3bbc048ae0 2024-09-12T17:29:46.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.794+0000 7f3bc61af800 20 remove_watcher() i=6 2024-09-12T17:29:46.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.794+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94639551194464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5612fcd82ab0 con 0x7f3bbc048ae0 2024-09-12T17:29:46.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.795+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94639551194464] v31'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bb8029040 con 0x7f3bbc048ae0 2024-09-12T17:29:46.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.795+0000 7f3bc61af800 20 remove_watcher() i=7 2024-09-12T17:29:46.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.795+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f3bbc048ae0 msgr2=0x7f3bbc045980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.795+0000 7f3bc61af800 1 --2- 172.21.15.170:0/2762702445 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f3bbc048ae0 0x7f3bbc045980 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.795+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5612fcd3ac00 msgr2=0x5612fcd3d0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.795+0000 7f3bc61af800 1 --2- 172.21.15.170:0/2762702445 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5612fcd3ac00 0x5612fcd3d0c0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.795+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5612fcd3f5f0 msgr2=0x5612fcd419e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.795+0000 7f3bc61af800 1 --2- 172.21.15.170:0/2762702445 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5612fcd3f5f0 0x5612fcd419e0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.795+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5612fcd440d0 msgr2=0x5612fcd46590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.795+0000 7f3bc61af800 1 --2- 172.21.15.170:0/2762702445 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5612fcd440d0 0x5612fcd46590 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.795+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3a8c03c730 msgr2=0x7f3a8c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.795+0000 7f3bc61af800 1 --2- 172.21.15.170:0/2762702445 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3a8c03c730 0x7f3a8c03ebf0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4068fd0 tx=0x7f3bb4092000 comp rx=0 tx=0).stop 2024-09-12T17:29:46.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.795+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5612fcd27cc0 msgr2=0x5612fcd2f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.795+0000 7f3bc349f640 1 -- 172.21.15.170:0/2762702445 reap_dead start 2024-09-12T17:29:46.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.795+0000 7f3bc61af800 1 --2- 172.21.15.170:0/2762702445 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5612fcd27cc0 0x5612fcd2f280 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc047040 tx=0x7f3bbc053cc0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.795+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 shutdown_connections 2024-09-12T17:29:46.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.795+0000 7f3bc61af800 1 --2- 172.21.15.170:0/2762702445 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5612fcd27cc0 0x5612fcd2f280 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.795+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 >> 172.21.15.170:0/2762702445 conn(0x5612fcd240c0 msgr2=0x5612fcd222d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:46.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.795+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 shutdown_connections 2024-09-12T17:29:46.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.795+0000 7f3bc61af800 1 -- 172.21.15.170:0/2762702445 wait complete. 2024-09-12T17:29:46.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.796+0000 7f3bc61af800 1 -- 172.21.15.170:0/3796150527 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3a9c03c730 msgr2=0x7f3a9c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.796+0000 7f3bc61af800 1 --2- 172.21.15.170:0/3796150527 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3a9c03c730 0x7f3a9c03ebf0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4096410 tx=0x7f3bb405fe70 comp rx=0 tx=0).stop 2024-09-12T17:29:46.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.796+0000 7f3bc61af800 1 -- 172.21.15.170:0/3796150527 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5612fcd1b1a0 msgr2=0x5612fcd1b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.796+0000 7f3bc61af800 1 --2- 172.21.15.170:0/3796150527 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5612fcd1b1a0 0x5612fcd1b5c0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x5612fcd012b0 tx=0x7f3bbc0167b0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.796+0000 7f3bc61af800 1 -- 172.21.15.170:0/3796150527 shutdown_connections 2024-09-12T17:29:46.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.796+0000 7f3bc61af800 1 --2- 172.21.15.170:0/3796150527 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3a9c03c730 0x7f3a9c03ebf0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.796+0000 7f3bc61af800 1 --2- 172.21.15.170:0/3796150527 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5612fcd1b1a0 0x5612fcd1b5c0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.796+0000 7f3bc61af800 1 -- 172.21.15.170:0/3796150527 >> 172.21.15.170:0/3796150527 conn(0x5612fcd0f550 msgr2=0x5612fcd0f930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:46.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.796+0000 7f3bc61af800 1 -- 172.21.15.170:0/3796150527 shutdown_connections 2024-09-12T17:29:46.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.796+0000 7f3bc61af800 1 -- 172.21.15.170:0/3796150527 wait complete. 2024-09-12T17:29:46.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.796+0000 7f3bc61af800 1 -- 172.21.15.170:0/4278564772 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5612fcc0a080 msgr2=0x5612fcd07900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.796+0000 7f3bc61af800 1 --2- 172.21.15.170:0/4278564772 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5612fcc0a080 0x5612fcd07900 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.796+0000 7f3bc61af800 1 -- 172.21.15.170:0/4278564772 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5612fcd09ce0 msgr2=0x5612fcd0c160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.796+0000 7f3bc61af800 1 --2- 172.21.15.170:0/4278564772 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5612fcd09ce0 0x5612fcd0c160 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.796+0000 7f3bc61af800 1 -- 172.21.15.170:0/4278564772 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3aac03c730 msgr2=0x7f3aac03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.796+0000 7f3bc61af800 1 --2- 172.21.15.170:0/4278564772 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3aac03c730 0x7f3aac03ebf0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3bb8001d70 tx=0x7f3bb80012d0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.796+0000 7f3bc61af800 1 -- 172.21.15.170:0/4278564772 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5612fcc07660 msgr2=0x5612fcd002b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.796+0000 7f3bc61af800 1 --2- 172.21.15.170:0/4278564772 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5612fcc07660 0x5612fcd002b0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4025c20 tx=0x7f3bb4002fb0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.796+0000 7f3bc61af800 1 -- 172.21.15.170:0/4278564772 shutdown_connections 2024-09-12T17:29:46.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.796+0000 7f3bc61af800 1 --2- 172.21.15.170:0/4278564772 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5612fcd09ce0 0x5612fcd0c160 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.796+0000 7f3bc61af800 1 --2- 172.21.15.170:0/4278564772 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f3aac03c730 0x7f3aac03ebf0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.796+0000 7f3bc61af800 1 --2- 172.21.15.170:0/4278564772 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5612fcc0a080 0x5612fcd07900 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.796+0000 7f3bc61af800 1 --2- 172.21.15.170:0/4278564772 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5612fcc07660 0x5612fcd002b0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.796+0000 7f3bc61af800 1 -- 172.21.15.170:0/4278564772 >> 172.21.15.170:0/4278564772 conn(0x5612fcc01220 msgr2=0x5612fccf1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:46.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.796+0000 7f3bc61af800 1 -- 172.21.15.170:0/4278564772 shutdown_connections 2024-09-12T17:29:46.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.796+0000 7f3bc61af800 1 -- 172.21.15.170:0/4278564772 wait complete. 2024-09-12T17:29:46.810 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T17:29:46.782056Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:29:46.782042Z', 'tags': [], 'group_ids': []} 2024-09-12T17:29:46.810 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T17:29:46.782056Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:29:46.782042Z', 'tags': [], 'group_ids': []} 2024-09-12T17:29:46.810 ERROR:root:0 2024-09-12T17:29:46.811 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T17:29:46.819 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx0000020bec07d13a44004-0066e3250a-4225-default', 'HostId': '4225-default-default'} 2024-09-12T17:29:46.819 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2024-09-12T17:29:46.829 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:29:46.830 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2024-09-12T17:29:46.842 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2024-09-12T17:29:46.842 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2024-09-12T17:29:46.856 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-12T17:29:46.857 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-12T17:29:46.865 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2024-09-12T17:29:46.866 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T17:29:46.871 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:29:46.871 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2024-09-12T17:29:46.875 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:29:46.876 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-12T17:29:46.876 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-12T17:29:46.876 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write' 2024-09-12T17:29:46.923 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:29:46.923 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:29:46.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.922+0000 7f41b5f3e800 1 Processor -- start 2024-09-12T17:29:46.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.922+0000 7f41b5f3e800 1 -- start start 2024-09-12T17:29:46.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.923+0000 7f41b5f3e800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55b47c4826a0 0x55b47c484a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.923+0000 7f41b5f3e800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b47c32be40 con 0x55b47c485030 2024-09-12T17:29:46.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.923+0000 7f41b5f3e800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x55b47c2f6680 con 0x55b47c4826a0 2024-09-12T17:29:46.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.923+0000 7f41b1c86640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55b47c4826a0 0x55b47c484a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.923+0000 7f41b1485640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x55b47c485030 0x55b47c4874f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:44882/0 (socket says 172.21.15.170:44882) 2024-09-12T17:29:46.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.923+0000 7f41b1485640 1 -- 172.21.15.170:0/3063656430 learned_addr learned my addr 172.21.15.170:0/3063656430 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:29:46.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.923+0000 7f41b1c86640 1 -- 172.21.15.170:0/3063656430 >> v1:172.21.15.47:6789/0 conn(0x55b47c485030 legacy=0x55b47c4874f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.923+0000 7f41b1c86640 1 -- 172.21.15.170:0/3063656430 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b47c3126b0 con 0x55b47c4826a0 2024-09-12T17:29:46.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.925+0000 7f41b1c86640 1 --2- 172.21.15.170:0/3063656430 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b47c4826a0 0x55b47c484a90 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f41a4005fd0 tx=0x7f41a4045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2173f31400e82565 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.925+0000 7f41b0c84640 1 -- 172.21.15.170:0/3063656430 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41a4058530 con 0x55b47c4826a0 2024-09-12T17:29:46.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.925+0000 7f41b0c84640 1 -- 172.21.15.170:0/3063656430 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41a40586d0 con 0x55b47c4826a0 2024-09-12T17:29:46.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.925+0000 7f41b0c84640 1 -- 172.21.15.170:0/3063656430 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41a40589d0 con 0x55b47c4826a0 2024-09-12T17:29:46.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.926+0000 7f41b5f3e800 1 -- 172.21.15.170:0/3063656430 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b47c4826a0 msgr2=0x55b47c484a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.926+0000 7f41b5f3e800 1 --2- 172.21.15.170:0/3063656430 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b47c4826a0 0x55b47c484a90 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f41a4005fd0 tx=0x7f41a4045c30 comp rx=0 tx=0).stop 2024-09-12T17:29:46.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.926+0000 7f41b5f3e800 1 -- 172.21.15.170:0/3063656430 shutdown_connections 2024-09-12T17:29:46.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.926+0000 7f41b5f3e800 1 --2- 172.21.15.170:0/3063656430 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b47c4826a0 0x55b47c484a90 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.926+0000 7f41b5f3e800 1 -- 172.21.15.170:0/3063656430 >> 172.21.15.170:0/3063656430 conn(0x55b47c47c200 msgr2=0x55b47c47e640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:46.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.926+0000 7f41b5f3e800 1 -- 172.21.15.170:0/3063656430 shutdown_connections 2024-09-12T17:29:46.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.926+0000 7f41b5f3e800 1 -- 172.21.15.170:0/3063656430 wait complete. 2024-09-12T17:29:46.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.940+0000 7f41b5f3e800 1 Processor -- start 2024-09-12T17:29:46.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.940+0000 7f41b5f3e800 1 -- start start 2024-09-12T17:29:46.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.940+0000 7f41b5f3e800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b47c4826a0 0x55b47c5716e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.940+0000 7f41b5f3e800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b47c31add0 con 0x55b47c4826a0 2024-09-12T17:29:46.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.940+0000 7f41b1c86640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b47c4826a0 0x55b47c5716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.940+0000 7f41b1c86640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b47c4826a0 0x55b47c5716e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34864/0 (socket says 172.21.15.170:34864) 2024-09-12T17:29:46.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.940+0000 7f41b1c86640 1 -- 172.21.15.170:0/1231317128 learned_addr learned my addr 172.21.15.170:0/1231317128 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:46.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.941+0000 7f41b1c86640 1 -- 172.21.15.170:0/1231317128 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b47c333e10 con 0x55b47c4826a0 2024-09-12T17:29:46.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.941+0000 7f41b1c86640 1 --2- 172.21.15.170:0/1231317128 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b47c4826a0 0x55b47c5716e0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f41a4025a60 tx=0x7f41a4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2566f2307db17d2f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.941+0000 7f409fe07640 1 -- 172.21.15.170:0/1231317128 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41a40589b0 con 0x55b47c4826a0 2024-09-12T17:29:46.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.941+0000 7f409fe07640 1 -- 172.21.15.170:0/1231317128 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41a4068070 con 0x55b47c4826a0 2024-09-12T17:29:46.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.941+0000 7f409fe07640 1 -- 172.21.15.170:0/1231317128 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41a4058c80 con 0x55b47c4826a0 2024-09-12T17:29:46.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.942+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1231317128 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b47c4826a0 msgr2=0x55b47c5716e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.942+0000 7f41b5f3e800 1 --2- 172.21.15.170:0/1231317128 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b47c4826a0 0x55b47c5716e0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f41a4025a60 tx=0x7f41a4051000 comp rx=0 tx=0).stop 2024-09-12T17:29:46.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.942+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1231317128 shutdown_connections 2024-09-12T17:29:46.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.942+0000 7f41b5f3e800 1 --2- 172.21.15.170:0/1231317128 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b47c4826a0 0x55b47c5716e0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.942+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1231317128 >> 172.21.15.170:0/1231317128 conn(0x55b47c47c200 msgr2=0x55b47c56d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:46.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.942+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1231317128 shutdown_connections 2024-09-12T17:29:46.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.942+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1231317128 wait complete. 2024-09-12T17:29:46.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.942+0000 7f41b5f3e800 1 Processor -- start 2024-09-12T17:29:46.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.942+0000 7f41b5f3e800 1 -- start start 2024-09-12T17:29:46.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.942+0000 7f41b5f3e800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b47c4826a0 0x55b47c481dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.942+0000 7f41b5f3e800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b47c489050 con 0x55b47c4826a0 2024-09-12T17:29:46.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.943+0000 7f41b1c86640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b47c4826a0 0x55b47c481dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.943+0000 7f41b1c86640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b47c4826a0 0x55b47c481dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34880/0 (socket says 172.21.15.170:34880) 2024-09-12T17:29:46.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.943+0000 7f41b1c86640 1 -- 172.21.15.170:0/3635842367 learned_addr learned my addr 172.21.15.170:0/3635842367 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:46.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.943+0000 7f41b1c86640 1 -- 172.21.15.170:0/3635842367 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b47c482320 con 0x55b47c4826a0 2024-09-12T17:29:46.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.943+0000 7f41b1c86640 1 --2- 172.21.15.170:0/3635842367 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b47c4826a0 0x55b47c481dc0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f41a4025a60 tx=0x7f41a4003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.943+0000 7f409e604640 1 -- 172.21.15.170:0/3635842367 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41a4063650 con 0x55b47c4826a0 2024-09-12T17:29:46.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.943+0000 7f409e604640 1 -- 172.21.15.170:0/3635842367 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41a40637f0 con 0x55b47c4826a0 2024-09-12T17:29:46.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.943+0000 7f41b5f3e800 1 -- 172.21.15.170:0/3635842367 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b47c4806d0 con 0x55b47c4826a0 2024-09-12T17:29:46.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.943+0000 7f409e604640 1 -- 172.21.15.170:0/3635842367 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41a4063af0 con 0x55b47c4826a0 2024-09-12T17:29:46.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.943+0000 7f41b5f3e800 1 -- 172.21.15.170:0/3635842367 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b47c480cf0 con 0x55b47c4826a0 2024-09-12T17:29:46.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.944+0000 7f409e604640 1 -- 172.21.15.170:0/3635842367 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f41a4063c90 con 0x55b47c4826a0 2024-09-12T17:29:46.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.944+0000 7f409e604640 1 --2- 172.21.15.170:0/3635842367 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f409803c730 0x7f409803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.945+0000 7f409e604640 1 -- 172.21.15.170:0/3635842367 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f41a4097ca0 con 0x55b47c4826a0 2024-09-12T17:29:46.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.945+0000 7f41b1485640 1 --2- 172.21.15.170:0/3635842367 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f409803c730 0x7f409803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.945+0000 7f41b5f3e800 1 --2- 172.21.15.170:0/3635842367 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b47c485030 0x55b47c582440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.945+0000 7f41b5f3e800 1 -- 172.21.15.170:0/3635842367 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b47c582980 con 0x55b47c485030 2024-09-12T17:29:46.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.945+0000 7f41b2487640 1 --2- 172.21.15.170:0/3635842367 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b47c485030 0x55b47c582440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.945+0000 7f41b1485640 1 --2- 172.21.15.170:0/3635842367 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f409803c730 0x7f409803ebf0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f41a8001d70 tx=0x7f41a80012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.945+0000 7f41b2487640 1 --2- 172.21.15.170:0/3635842367 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b47c485030 0x55b47c582440 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.945+0000 7f41b2487640 1 -- 172.21.15.170:0/3635842367 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f41ac0083e0 con 0x55b47c485030 2024-09-12T17:29:46.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.945+0000 7f41b5f3e800 1 -- 172.21.15.170:0/3635842367 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b47c583260 con 0x55b47c485030 2024-09-12T17:29:46.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.946+0000 7f41b2487640 1 -- 172.21.15.170:0/3635842367 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f41ac0083e0 con 0x55b47c485030 2024-09-12T17:29:46.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.946+0000 7f41b5f3e800 1 --2- 172.21.15.170:0/3635842367 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b47c584b70 0x55b47c587010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.946+0000 7f41b5f3e800 1 -- 172.21.15.170:0/3635842367 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5877a0 con 0x55b47c584b70 2024-09-12T17:29:46.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.946+0000 7f41b1c86640 1 --2- 172.21.15.170:0/3635842367 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b47c584b70 0x55b47c587010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.946+0000 7f41b1c86640 1 --2- 172.21.15.170:0/3635842367 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b47c584b70 0x55b47c587010 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.946+0000 7f41b1c86640 1 -- 172.21.15.170:0/3635842367 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f41a40743e0 con 0x55b47c584b70 2024-09-12T17:29:46.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.946+0000 7f41b5f3e800 1 -- 172.21.15.170:0/3635842367 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b47c583ab0 con 0x55b47c485030 2024-09-12T17:29:46.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.947+0000 7f41b2487640 1 -- 172.21.15.170:0/3635842367 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f41ac0083e0 con 0x55b47c485030 2024-09-12T17:29:46.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.947+0000 7f41b5f3e800 1 -- 172.21.15.170:0/3635842367 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b47c583e90 con 0x55b47c584b70 2024-09-12T17:29:46.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.947+0000 7f41b1c86640 1 -- 172.21.15.170:0/3635842367 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f41a40743e0 con 0x55b47c584b70 2024-09-12T17:29:46.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.947+0000 7f41b5f3e800 1 Processor -- start 2024-09-12T17:29:46.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.947+0000 7f41b5f3e800 1 -- start start 2024-09-12T17:29:46.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.947+0000 7f41b5f3e800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b47c596050 0x55b47c596470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.947+0000 7f41b5f3e800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b47c378a00 con 0x55b47c596050 2024-09-12T17:29:46.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.948+0000 7f41b2487640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b47c596050 0x55b47c596470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.948+0000 7f41b2487640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b47c596050 0x55b47c596470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34888/0 (socket says 172.21.15.170:34888) 2024-09-12T17:29:46.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.948+0000 7f41b2487640 1 -- 172.21.15.170:0/311312032 learned_addr learned my addr 172.21.15.170:0/311312032 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:46.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.948+0000 7f41b2487640 1 -- 172.21.15.170:0/311312032 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b47c596ab0 con 0x55b47c596050 2024-09-12T17:29:46.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.948+0000 7f41b2487640 1 --2- 172.21.15.170:0/311312032 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b47c596050 0x55b47c596470 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x55b47c481140 tx=0x7f41ac00bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.948+0000 7f40977fe640 1 -- 172.21.15.170:0/311312032 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41ac01c020 con 0x55b47c596050 2024-09-12T17:29:46.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.948+0000 7f40977fe640 1 -- 172.21.15.170:0/311312032 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41ac007c90 con 0x55b47c596050 2024-09-12T17:29:46.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.948+0000 7f41b5f3e800 1 -- 172.21.15.170:0/311312032 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b47c5972e0 con 0x55b47c596050 2024-09-12T17:29:46.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.948+0000 7f40977fe640 1 -- 172.21.15.170:0/311312032 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41ac018440 con 0x55b47c596050 2024-09-12T17:29:46.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.948+0000 7f41b5f3e800 1 -- 172.21.15.170:0/311312032 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b47c597880 con 0x55b47c596050 2024-09-12T17:29:46.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.949+0000 7f40977fe640 1 -- 172.21.15.170:0/311312032 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f41ac01f020 con 0x55b47c596050 2024-09-12T17:29:46.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.949+0000 7f40977fe640 1 --2- 172.21.15.170:0/311312032 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f408c03c730 0x7f408c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.949+0000 7f40977fe640 1 -- 172.21.15.170:0/311312032 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f41ac054ef0 con 0x55b47c596050 2024-09-12T17:29:46.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.950+0000 7f41b1c86640 1 --2- 172.21.15.170:0/311312032 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f408c03c730 0x7f408c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.950+0000 7f41b5f3e800 1 Processor -- start 2024-09-12T17:29:46.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.950+0000 7f41b1c86640 1 --2- 172.21.15.170:0/311312032 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f408c03c730 0x7f408c03ebf0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f41a4096180 tx=0x7f41a407e680 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.950+0000 7f41b5f3e800 1 -- start start 2024-09-12T17:29:46.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.950+0000 7f41b5f3e800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b47c5a2b50 0x55b47c5a2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.950+0000 7f41b5f3e800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b47c571e70 con 0x55b47c5a2b50 2024-09-12T17:29:46.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.950+0000 7f41b2487640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b47c5a2b50 0x55b47c5a2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.950+0000 7f41b2487640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b47c5a2b50 0x55b47c5a2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34890/0 (socket says 172.21.15.170:34890) 2024-09-12T17:29:46.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.950+0000 7f41b2487640 1 -- 172.21.15.170:0/721199604 learned_addr learned my addr 172.21.15.170:0/721199604 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:46.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.950+0000 7f41b2487640 1 -- 172.21.15.170:0/721199604 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b47c5a3540 con 0x55b47c5a2b50 2024-09-12T17:29:46.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.951+0000 7f41b2487640 1 --2- 172.21.15.170:0/721199604 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b47c5a2b50 0x55b47c5a2f50 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f41ac0532d0 tx=0x7f41ac0156f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb79a3586fc3552b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.951+0000 7f40957fa640 1 -- 172.21.15.170:0/721199604 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41ac050020 con 0x55b47c5a2b50 2024-09-12T17:29:46.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.951+0000 7f40957fa640 1 -- 172.21.15.170:0/721199604 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41ac044130 con 0x55b47c5a2b50 2024-09-12T17:29:46.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.951+0000 7f40957fa640 1 -- 172.21.15.170:0/721199604 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41ac0173a0 con 0x55b47c5a2b50 2024-09-12T17:29:46.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.951+0000 7f41b5f3e800 1 -- 172.21.15.170:0/721199604 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b47c5a2b50 msgr2=0x55b47c5a2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:46.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.951+0000 7f41b5f3e800 1 --2- 172.21.15.170:0/721199604 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b47c5a2b50 0x55b47c5a2f50 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f41ac0532d0 tx=0x7f41ac0156f0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.951+0000 7f41b5f3e800 1 -- 172.21.15.170:0/721199604 shutdown_connections 2024-09-12T17:29:46.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.951+0000 7f41b5f3e800 1 --2- 172.21.15.170:0/721199604 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b47c5a2b50 0x55b47c5a2f50 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:46.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.951+0000 7f41b5f3e800 1 -- 172.21.15.170:0/721199604 >> 172.21.15.170:0/721199604 conn(0x55b47c59ef70 msgr2=0x55b47c59d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:46.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.951+0000 7f41b5f3e800 1 -- 172.21.15.170:0/721199604 shutdown_connections 2024-09-12T17:29:46.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.951+0000 7f41b5f3e800 1 -- 172.21.15.170:0/721199604 wait complete. 2024-09-12T17:29:46.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.952+0000 7f41b5f3e800 1 Processor -- start 2024-09-12T17:29:46.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.952+0000 7f41b5f3e800 1 -- start start 2024-09-12T17:29:46.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.952+0000 7f41b5f3e800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b47c5a2b50 0x55b47c5aa130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.952+0000 7f41b5f3e800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b47c5a3b60 con 0x55b47c5a2b50 2024-09-12T17:29:46.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.952+0000 7f41b2487640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b47c5a2b50 0x55b47c5aa130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.952+0000 7f41b2487640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b47c5a2b50 0x55b47c5aa130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34898/0 (socket says 172.21.15.170:34898) 2024-09-12T17:29:46.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.952+0000 7f41b2487640 1 -- 172.21.15.170:0/1366099682 learned_addr learned my addr 172.21.15.170:0/1366099682 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:46.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.952+0000 7f41b2487640 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b47c5aa690 con 0x55b47c5a2b50 2024-09-12T17:29:46.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.952+0000 7f41b2487640 1 --2- 172.21.15.170:0/1366099682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b47c5a2b50 0x55b47c5aa130 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f41ac016010 tx=0x7f41ac053260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.953+0000 7f40837fe640 1 -- 172.21.15.170:0/1366099682 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41ac00b160 con 0x55b47c5a2b50 2024-09-12T17:29:46.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.953+0000 7f40837fe640 1 -- 172.21.15.170:0/1366099682 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41ac00b320 con 0x55b47c5a2b50 2024-09-12T17:29:46.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.953+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b47c5aa920 con 0x55b47c5a2b50 2024-09-12T17:29:46.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.953+0000 7f40837fe640 1 -- 172.21.15.170:0/1366099682 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41ac013b50 con 0x55b47c5a2b50 2024-09-12T17:29:46.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.953+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b47c5ab2a0 con 0x55b47c5a2b50 2024-09-12T17:29:46.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.954+0000 7f40837fe640 1 -- 172.21.15.170:0/1366099682 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f41ac032020 con 0x55b47c5a2b50 2024-09-12T17:29:46.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.954+0000 7f40837fe640 1 --2- 172.21.15.170:0/1366099682 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f407c03c6e0 0x7f407c03eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.954+0000 7f40837fe640 1 -- 172.21.15.170:0/1366099682 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f41ac030020 con 0x55b47c5a2b50 2024-09-12T17:29:46.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.954+0000 7f41b1c86640 1 --2- 172.21.15.170:0/1366099682 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f407c03c6e0 0x7f407c03eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.954+0000 7f41b1c86640 1 --2- 172.21.15.170:0/1366099682 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f407c03c6e0 0x7f407c03eba0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f41a404ea70 tx=0x7f41a4085000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.955+0000 7f41b5f3e800 20 rados->read ofs=0 len=0 2024-09-12T17:29:46.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.955+0000 7f41b5f3e800 1 --2- 172.21.15.170:0/1366099682 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b47c5b5a60 0x55b47c5b7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.955+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5b8670 con 0x55b47c5b5a60 2024-09-12T17:29:46.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.955+0000 7f41b1485640 1 --2- 172.21.15.170:0/1366099682 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b47c5b5a60 0x55b47c5b7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.955+0000 7f41b1485640 1 --2- 172.21.15.170:0/1366099682 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b47c5b5a60 0x55b47c5b7f20 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.955+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f41a8009050 con 0x55b47c5b5a60 2024-09-12T17:29:46.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.955+0000 7f41b5f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:46.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.955+0000 7f41b5f3e800 20 realm 2024-09-12T17:29:46.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.955+0000 7f41b5f3e800 20 rados->read ofs=0 len=0 2024-09-12T17:29:46.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.955+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5b4db0 con 0x55b47c5b5a60 2024-09-12T17:29:46.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.956+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f41a8009050 con 0x55b47c5b5a60 2024-09-12T17:29:46.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.956+0000 7f41b5f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:46.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.956+0000 7f41b5f3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:29:46.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.956+0000 7f41b5f3e800 20 rados->read ofs=0 len=0 2024-09-12T17:29:46.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.956+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5b9160 con 0x55b47c5b5a60 2024-09-12T17:29:46.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.956+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f41a8009050 con 0x55b47c5b5a60 2024-09-12T17:29:46.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.956+0000 7f41b5f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:46.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.956+0000 7f41b5f3e800 20 rados->read ofs=0 len=0 2024-09-12T17:29:46.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.956+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5b9a30 con 0x55b47c5b5a60 2024-09-12T17:29:46.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.956+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f41a8009050 con 0x55b47c5b5a60 2024-09-12T17:29:46.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.956+0000 7f41b5f3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:46.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.956+0000 7f41b5f3e800 20 rados->read ofs=0 len=0 2024-09-12T17:29:46.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.956+0000 7f41b5f3e800 1 --2- 172.21.15.170:0/1366099682 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b47c5ba450 0x55b47c5bc840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.956+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5bcf80 con 0x55b47c5ba450 2024-09-12T17:29:46.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.956+0000 7f41b2487640 1 --2- 172.21.15.170:0/1366099682 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b47c5ba450 0x55b47c5bc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.956+0000 7f41b2487640 1 --2- 172.21.15.170:0/1366099682 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b47c5ba450 0x55b47c5bc840 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.957+0000 7f41b2487640 1 -- 172.21.15.170:0/1366099682 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f41ac0083e0 con 0x55b47c5ba450 2024-09-12T17:29:46.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.957+0000 7f41b5f3e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:29:46.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.957+0000 7f41b5f3e800 20 searching for the correct realm 2024-09-12T17:29:46.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.957+0000 7f41b5f3e800 1 --2- 172.21.15.170:0/1366099682 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55b47c5bef30 0x55b47c5c13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.957+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c1a70 con 0x55b47c5bef30 2024-09-12T17:29:46.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.957+0000 7f41b1c86640 1 --2- 172.21.15.170:0/1366099682 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55b47c5bef30 0x55b47c5c13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.957+0000 7f41b1c86640 1 --2- 172.21.15.170:0/1366099682 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55b47c5bef30 0x55b47c5c13f0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.957+0000 7f41b1c86640 1 -- 172.21.15.170:0/1366099682 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41a40743e0 con 0x55b47c5bef30 2024-09-12T17:29:46.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.957+0000 7f41b1c86640 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c1a70 con 0x55b47c5ba450 2024-09-12T17:29:46.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.958+0000 7f41b2487640 1 -- 172.21.15.170:0/1366099682 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41ac0083e0 con 0x55b47c5ba450 2024-09-12T17:29:46.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.958+0000 7f41b2487640 1 --2- 172.21.15.170:0/1366099682 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f41ac021020 0x7f41ac0472a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:46.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.958+0000 7f41b2487640 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c1a70 con 0x7f41ac021020 2024-09-12T17:29:46.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.958+0000 7f41b1485640 1 --2- 172.21.15.170:0/1366099682 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f41ac021020 0x7f41ac0472a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:46.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.958+0000 7f41b1485640 1 --2- 172.21.15.170:0/1366099682 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f41ac021020 0x7f41ac0472a0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:46.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.958+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41a8009050 con 0x7f41ac021020 2024-09-12T17:29:46.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.958+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c1a70 con 0x55b47c5b5a60 2024-09-12T17:29:46.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.959+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41a8009050 con 0x55b47c5b5a60 2024-09-12T17:29:46.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.959+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c1a70 con 0x55b47c5b5a60 2024-09-12T17:29:46.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.959+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41a8029040 con 0x55b47c5b5a60 2024-09-12T17:29:46.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.959+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c1a70 con 0x7f41ac021020 2024-09-12T17:29:46.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.959+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41a8029040 con 0x7f41ac021020 2024-09-12T17:29:46.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.959+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c1a70 con 0x7f41ac021020 2024-09-12T17:29:46.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.959+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41a8029040 con 0x7f41ac021020 2024-09-12T17:29:46.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.959+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c1a70 con 0x55b47c5ba450 2024-09-12T17:29:46.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.960+0000 7f41b2487640 1 -- 172.21.15.170:0/1366099682 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41ac0083e0 con 0x55b47c5ba450 2024-09-12T17:29:46.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.960+0000 7f41b2487640 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c1a70 con 0x55b47c5bef30 2024-09-12T17:29:46.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.960+0000 7f41b1c86640 1 -- 172.21.15.170:0/1366099682 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41a40a1040 con 0x55b47c5bef30 2024-09-12T17:29:46.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.960+0000 7f41b1c86640 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c1a70 con 0x55b47c5b5a60 2024-09-12T17:29:46.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.960+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41a8029040 con 0x55b47c5b5a60 2024-09-12T17:29:46.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.960+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c1a70 con 0x7f41ac021020 2024-09-12T17:29:46.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.961+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41a8029040 con 0x7f41ac021020 2024-09-12T17:29:46.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.961+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c1a70 con 0x55b47c5b5a60 2024-09-12T17:29:46.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.961+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41a8029040 con 0x55b47c5b5a60 2024-09-12T17:29:46.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.961+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c1a70 con 0x55b47c5ba450 2024-09-12T17:29:46.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.961+0000 7f41b2487640 1 -- 172.21.15.170:0/1366099682 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f41ac0083e0 con 0x55b47c5ba450 2024-09-12T17:29:46.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.961+0000 7f41b2487640 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c1a70 con 0x55b47c5bef30 2024-09-12T17:29:46.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.961+0000 7f41b1c86640 1 -- 172.21.15.170:0/1366099682 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41a40a1040 con 0x55b47c5bef30 2024-09-12T17:29:46.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.961+0000 7f41b1c86640 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c1a70 con 0x55b47c5bef30 2024-09-12T17:29:46.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.962+0000 7f41b1c86640 1 -- 172.21.15.170:0/1366099682 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41a40a1040 con 0x55b47c5bef30 2024-09-12T17:29:46.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.962+0000 7f41b1c86640 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c1a70 con 0x55b47c5ba450 2024-09-12T17:29:46.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.962+0000 7f41b2487640 1 -- 172.21.15.170:0/1366099682 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41ac0083e0 con 0x55b47c5ba450 2024-09-12T17:29:46.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.962+0000 7f41b2487640 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c1a70 con 0x55b47c5bef30 2024-09-12T17:29:46.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.962+0000 7f41b1c86640 1 -- 172.21.15.170:0/1366099682 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41a40a1040 con 0x55b47c5bef30 2024-09-12T17:29:46.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.962+0000 7f41b1c86640 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c1a70 con 0x55b47c5bef30 2024-09-12T17:29:46.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.962+0000 7f41b1c86640 1 -- 172.21.15.170:0/1366099682 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41a40a1040 con 0x55b47c5bef30 2024-09-12T17:29:46.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.962+0000 7f41b1c86640 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c1a70 con 0x55b47c5b5a60 2024-09-12T17:29:46.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.962+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41a8029040 con 0x55b47c5b5a60 2024-09-12T17:29:46.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.962+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c1a70 con 0x55b47c5b5a60 2024-09-12T17:29:46.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.963+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v31'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f41a8029040 con 0x55b47c5b5a60 2024-09-12T17:29:46.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.963+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c1a70 con 0x7f41ac021020 2024-09-12T17:29:46.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.963+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41a8029040 con 0x7f41ac021020 2024-09-12T17:29:46.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.963+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c1a70 con 0x55b47c5bef30 2024-09-12T17:29:46.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.963+0000 7f41b1c86640 1 -- 172.21.15.170:0/1366099682 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41a40a1040 con 0x55b47c5bef30 2024-09-12T17:29:46.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.963+0000 7f41b1c86640 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c1a70 con 0x55b47c5ba450 2024-09-12T17:29:46.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.963+0000 7f41b2487640 1 -- 172.21.15.170:0/1366099682 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41ac0083e0 con 0x55b47c5ba450 2024-09-12T17:29:46.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.964+0000 7f41b2487640 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c1a70 con 0x55b47c5b5a60 2024-09-12T17:29:46.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.964+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41a8029040 con 0x55b47c5b5a60 2024-09-12T17:29:46.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.964+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c1a70 con 0x7f41ac021020 2024-09-12T17:29:46.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.964+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41a8029040 con 0x7f41ac021020 2024-09-12T17:29:46.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.964+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c1a70 con 0x55b47c5bef30 2024-09-12T17:29:46.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.964+0000 7f41b1c86640 1 -- 172.21.15.170:0/1366099682 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41a40a1040 con 0x55b47c5bef30 2024-09-12T17:29:46.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.964+0000 7f41b1c86640 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c1a70 con 0x7f41ac021020 2024-09-12T17:29:46.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.965+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41a8029040 con 0x7f41ac021020 2024-09-12T17:29:46.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.965+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c1a70 con 0x55b47c5ba450 2024-09-12T17:29:46.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.965+0000 7f41b2487640 1 -- 172.21.15.170:0/1366099682 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41ac064040 con 0x55b47c5ba450 2024-09-12T17:29:46.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.965+0000 7f41b2487640 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c1a70 con 0x55b47c5bef30 2024-09-12T17:29:46.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.965+0000 7f41b1c86640 1 -- 172.21.15.170:0/1366099682 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41a40a1040 con 0x55b47c5bef30 2024-09-12T17:29:46.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.965+0000 7f41b1c86640 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c1a70 con 0x7f41ac021020 2024-09-12T17:29:46.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.965+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41a8029040 con 0x7f41ac021020 2024-09-12T17:29:46.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.965+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c1a70 con 0x55b47c5b5a60 2024-09-12T17:29:46.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.966+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f41a8029040 con 0x55b47c5b5a60 2024-09-12T17:29:46.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.966+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c1a70 con 0x55b47c5ba450 2024-09-12T17:29:46.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.966+0000 7f41b2487640 1 -- 172.21.15.170:0/1366099682 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(37 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f41ac064040 con 0x55b47c5ba450 2024-09-12T17:29:46.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.966+0000 7f41b5f3e800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:29:46.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.966+0000 7f41b5f3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:29:46.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.966+0000 7f41b5f3e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:29:46.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.966+0000 7f41b5f3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:29:46.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.966+0000 7f41b5f3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:29:46.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.966+0000 7f41b5f3e800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:29:46.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.966+0000 7f41b5f3e800 20 rados->read ofs=0 len=0 2024-09-12T17:29:46.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.966+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5bd940 con 0x55b47c5b5a60 2024-09-12T17:29:46.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.966+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f41a8029040 con 0x55b47c5b5a60 2024-09-12T17:29:46.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.966+0000 7f41b5f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:46.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.966+0000 7f41b5f3e800 20 rados->read ofs=0 len=0 2024-09-12T17:29:46.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.966+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5bd580 con 0x55b47c5b5a60 2024-09-12T17:29:46.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.966+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f41a8029040 con 0x55b47c5b5a60 2024-09-12T17:29:46.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.966+0000 7f41b5f3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:46.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.966+0000 7f41b5f3e800 20 rados->read ofs=0 len=0 2024-09-12T17:29:46.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.966+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5bdd80 con 0x55b47c5ba450 2024-09-12T17:29:46.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.967+0000 7f41b2487640 1 -- 172.21.15.170:0/1366099682 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f41ac064040 con 0x55b47c5ba450 2024-09-12T17:29:46.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.967+0000 7f41b5f3e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:29:46.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.967+0000 7f41b5f3e800 20 zone default found 2024-09-12T17:29:46.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.967+0000 7f41b5f3e800 4 Realm: () 2024-09-12T17:29:46.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.967+0000 7f41b5f3e800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:29:46.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.967+0000 7f41b5f3e800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:29:46.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.967+0000 7f41b5f3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:29:46.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.967+0000 7f41b5f3e800 20 zonegroup default 2024-09-12T17:29:46.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.967+0000 7f41b5f3e800 20 rados->read ofs=0 len=0 2024-09-12T17:29:46.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.967+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c1ef0 con 0x7f41ac021020 2024-09-12T17:29:46.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.967+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f41a8029040 con 0x7f41ac021020 2024-09-12T17:29:46.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.967+0000 7f41b5f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:46.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.967+0000 7f41b5f3e800 20 rados->read ofs=0 len=0 2024-09-12T17:29:46.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.967+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c4180 con 0x55b47c5bef30 2024-09-12T17:29:46.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.967+0000 7f41b1c86640 1 -- 172.21.15.170:0/1366099682 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f41a40a1040 con 0x55b47c5bef30 2024-09-12T17:29:46.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.967+0000 7f41b5f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:46.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.967+0000 7f41b5f3e800 20 rados->read ofs=0 len=0 2024-09-12T17:29:46.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.967+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c4520 con 0x55b47c5bef30 2024-09-12T17:29:46.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.967+0000 7f41b1c86640 1 -- 172.21.15.170:0/1366099682 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f41a40a1040 con 0x55b47c5bef30 2024-09-12T17:29:46.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.968+0000 7f41b5f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:46.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.968+0000 7f41b5f3e800 20 started sync module instance, tier type = 2024-09-12T17:29:46.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.968+0000 7f41b5f3e800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:29:46.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.968+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c3610 con 0x55b47c5ba450 2024-09-12T17:29:46.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.969+0000 7f41b2487640 1 -- 172.21.15.170:0/1366099682 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(44 notify.0 [create] v31'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41ac064040 con 0x55b47c5ba450 2024-09-12T17:29:46.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.969+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94233668893456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c3610 con 0x55b47c5ba450 2024-09-12T17:29:46.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.969+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c5060 con 0x55b47c5b5a60 2024-09-12T17:29:46.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.970+0000 7f41b2487640 1 -- 172.21.15.170:0/1366099682 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94233668893456] v31'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41ac064040 con 0x55b47c5ba450 2024-09-12T17:29:46.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.970+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v31'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41a8029040 con 0x55b47c5b5a60 2024-09-12T17:29:46.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.970+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94233668897600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c3610 con 0x55b47c5b5a60 2024-09-12T17:29:46.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.970+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c5ab0 con 0x55b47c5bef30 2024-09-12T17:29:46.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.971+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94233668897600] v31'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41a8029040 con 0x55b47c5b5a60 2024-09-12T17:29:46.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.971+0000 7f41b1c86640 1 -- 172.21.15.170:0/1366099682 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v31'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41a40a1040 con 0x55b47c5bef30 2024-09-12T17:29:46.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.971+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94233668890976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c3580 con 0x55b47c5bef30 2024-09-12T17:29:46.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.971+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c69a0 con 0x55b47c5ba450 2024-09-12T17:29:46.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.972+0000 7f41b1c86640 1 -- 172.21.15.170:0/1366099682 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94233668890976] v31'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41a40a1040 con 0x55b47c5bef30 2024-09-12T17:29:46.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.972+0000 7f41b2487640 1 -- 172.21.15.170:0/1366099682 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(50 notify.3 [create] v31'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41ac064040 con 0x55b47c5ba450 2024-09-12T17:29:46.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.972+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94233668904176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c6dc0 con 0x55b47c5ba450 2024-09-12T17:29:46.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.972+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c7780 con 0x55b47c5b5a60 2024-09-12T17:29:46.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.973+0000 7f41b2487640 1 -- 172.21.15.170:0/1366099682 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94233668904176] v31'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41ac064040 con 0x55b47c5ba450 2024-09-12T17:29:46.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.974+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v31'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41a8029040 con 0x55b47c5b5a60 2024-09-12T17:29:46.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.974+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94233668905712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c7780 con 0x55b47c5b5a60 2024-09-12T17:29:46.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.974+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c8140 con 0x7f41ac021020 2024-09-12T17:29:46.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.975+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(54 notify.5 [create] v31'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41a8029040 con 0x7f41ac021020 2024-09-12T17:29:46.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.975+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94233668905712] v31'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41a8029040 con 0x55b47c5b5a60 2024-09-12T17:29:46.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.975+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94233668910224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c80b0 con 0x7f41ac021020 2024-09-12T17:29:46.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.975+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c8b90 con 0x7f41ac021020 2024-09-12T17:29:46.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.976+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94233668910224] v31'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41a8029040 con 0x7f41ac021020 2024-09-12T17:29:46.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.976+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v31'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41a8029040 con 0x7f41ac021020 2024-09-12T17:29:46.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.976+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94233668907728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c8b50 con 0x7f41ac021020 2024-09-12T17:29:46.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.976+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c9550 con 0x7f41ac021020 2024-09-12T17:29:46.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.977+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94233668907728] v31'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41a8029040 con 0x7f41ac021020 2024-09-12T17:29:46.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.977+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(58 notify.7 [create] v31'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41a8029040 con 0x7f41ac021020 2024-09-12T17:29:46.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.977+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94233668912800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c9510 con 0x7f41ac021020 2024-09-12T17:29:46.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.977+0000 7f41b5f3e800 20 add_watcher() i=0 2024-09-12T17:29:46.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.977+0000 7f41b5f3e800 20 add_watcher() i=1 2024-09-12T17:29:46.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.977+0000 7f41b5f3e800 20 add_watcher() i=2 2024-09-12T17:29:46.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.977+0000 7f41b5f3e800 20 add_watcher() i=3 2024-09-12T17:29:46.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.977+0000 7f41b5f3e800 20 add_watcher() i=4 2024-09-12T17:29:46.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.977+0000 7f41b5f3e800 20 add_watcher() i=5 2024-09-12T17:29:46.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.977+0000 7f41b5f3e800 20 add_watcher() i=6 2024-09-12T17:29:46.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.978+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94233668912800] v31'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41a8029040 con 0x7f41ac021020 2024-09-12T17:29:46.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.978+0000 7f41b5f3e800 20 add_watcher() i=7 2024-09-12T17:29:46.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.978+0000 7f41b5f3e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:29:46.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.978+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5cc970 con 0x55b47c5b5a60 2024-09-12T17:29:46.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.978+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f41a8029040 con 0x55b47c5b5a60 2024-09-12T17:29:46.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.978+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94233668915760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c9e90 con 0x55b47c5b5a60 2024-09-12T17:29:46.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.979+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94233668915760] v31'242 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f41a8029040 con 0x55b47c5b5a60 2024-09-12T17:29:46.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.979+0000 7f40637fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:46.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.979+0000 7f41b5f3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:29:46.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.979+0000 7f41b5f3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:29:46.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.979+0000 7f41b5f3e800 5 note: GC not initialized 2024-09-12T17:29:46.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.980+0000 7f40627fc640 20 reqs_thread_entry: start 2024-09-12T17:29:46.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.980+0000 7f41b5f3e800 20 init_complete bucket index max shards: 11 2024-09-12T17:29:46.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.980+0000 7f41b5f3e800 20 Filter name: none 2024-09-12T17:29:46.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.980+0000 7f3fd3fff640 20 reqs_thread_entry: start 2024-09-12T17:29:46.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.980+0000 7f41b5f3e800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-12T17:29:46.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.980+0000 7f41b5f3e800 20 rados->read ofs=0 len=0 2024-09-12T17:29:46.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.980+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5ffa40 con 0x7f41ac021020 2024-09-12T17:29:46.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.981+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f41a8029040 con 0x7f41ac021020 2024-09-12T17:29:46.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.981+0000 7f41b5f3e800 20 rados_obj.operate() r=0 bl.length=473 2024-09-12T17:29:46.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.981+0000 7f41b5f3e800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-12T17:29:46.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.981+0000 7f41b5f3e800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:29:46.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.981+0000 7f41b5f3e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:29:46.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.981+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47c6061c0 con 0x7f41ac021020 2024-09-12T17:29:46.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.982+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v31'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f41a8029040 con 0x7f41ac021020 2024-09-12T17:29:46.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.982+0000 7f41b5f3e800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T17:29:46.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.982+0000 7f41b5f3e800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:29:46.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.982+0000 7f41b5f3e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-12T17:29:46.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.982+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94233669163968 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b47c601860 con 0x55b47c5b5a60 2024-09-12T17:29:46.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.982+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== watch-notify(notify (1) cookie 94233668905712 notify 133143986197 ret 0) ==== 678+0+0 (crc 0 0 0) 0x55b47c32be40 con 0x55b47c5b5a60 2024-09-12T17:29:46.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.982+0000 7f40957fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986197 cookie 94233668905712 notifier 4834 bl.length()=636 2024-09-12T17:29:46.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.982+0000 7f40957fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T17:29:46.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.982+0000 7f40957fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:29:46.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.982+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(64 notify.4 [notify cookie 94233669163968 out=8b] v0'0 uv243 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f41a8040020 con 0x55b47c5b5a60 2024-09-12T17:29:46.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.982+0000 7f40957fa640 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f4074003ea0 con 0x55b47c5b5a60 2024-09-12T17:29:46.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.983+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41a8040020 con 0x55b47c5b5a60 2024-09-12T17:29:46.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.983+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== watch-notify(notify_complete (2) cookie 94233669163968 notify 133143986197 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f41a802f5a0 con 0x55b47c5b5a60 2024-09-12T17:29:46.995 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-12T17:29:46.782056Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:29:46.782042Z","tags":[],"group_ids":[]} 2024-09-12T17:29:47.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.984+0000 7f40637fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:47.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.984+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94233668915760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5fd8d0 con 0x55b47c5b5a60 2024-09-12T17:29:47.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.985+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94233668915760] v31'243 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f41a8040020 con 0x55b47c5b5a60 2024-09-12T17:29:47.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.985+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94233668893456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5fd8d0 con 0x55b47c5ba450 2024-09-12T17:29:47.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.986+0000 7f41b2487640 1 -- 172.21.15.170:0/1366099682 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94233668893456] v31'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41ac064040 con 0x55b47c5ba450 2024-09-12T17:29:47.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.986+0000 7f41b5f3e800 20 remove_watcher() i=0 2024-09-12T17:29:47.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.986+0000 7f41b5f3e800 2 removed watcher, disabling cache 2024-09-12T17:29:47.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.986+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94233668897600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5fd8d0 con 0x55b47c5b5a60 2024-09-12T17:29:47.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.987+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94233668897600] v31'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41a8040020 con 0x55b47c5b5a60 2024-09-12T17:29:47.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.987+0000 7f41b5f3e800 20 remove_watcher() i=1 2024-09-12T17:29:47.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.987+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94233668890976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5fd8d0 con 0x55b47c5bef30 2024-09-12T17:29:47.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.988+0000 7f41b1c86640 1 -- 172.21.15.170:0/1366099682 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94233668890976] v31'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41a40a1040 con 0x55b47c5bef30 2024-09-12T17:29:47.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.988+0000 7f41b5f3e800 20 remove_watcher() i=2 2024-09-12T17:29:47.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.988+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94233668904176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c3160 con 0x55b47c5ba450 2024-09-12T17:29:47.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.989+0000 7f41b2487640 1 -- 172.21.15.170:0/1366099682 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94233668904176] v31'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41ac064040 con 0x55b47c5ba450 2024-09-12T17:29:47.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.989+0000 7f41b5f3e800 20 remove_watcher() i=3 2024-09-12T17:29:47.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.989+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94233668905712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c64f0 con 0x55b47c5b5a60 2024-09-12T17:29:47.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.990+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94233668905712] v31'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41a8040020 con 0x55b47c5b5a60 2024-09-12T17:29:47.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.990+0000 7f41b5f3e800 20 remove_watcher() i=4 2024-09-12T17:29:47.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.990+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94233668910224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c3160 con 0x7f41ac021020 2024-09-12T17:29:47.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.991+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94233668910224] v31'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41a8040020 con 0x7f41ac021020 2024-09-12T17:29:47.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.991+0000 7f41b5f3e800 20 remove_watcher() i=5 2024-09-12T17:29:47.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.991+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94233668907728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c6af0 con 0x7f41ac021020 2024-09-12T17:29:47.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.992+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94233668907728] v31'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41a8040020 con 0x7f41ac021020 2024-09-12T17:29:47.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.992+0000 7f41b5f3e800 20 remove_watcher() i=6 2024-09-12T17:29:47.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.992+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94233668912800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47c5c64f0 con 0x7f41ac021020 2024-09-12T17:29:47.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.993+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94233668912800] v31'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41a8040020 con 0x7f41ac021020 2024-09-12T17:29:47.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.993+0000 7f41b5f3e800 20 remove_watcher() i=7 2024-09-12T17:29:47.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.993+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f41ac021020 msgr2=0x7f41ac0472a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.993+0000 7f41b5f3e800 1 --2- 172.21.15.170:0/1366099682 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f41ac021020 0x7f41ac0472a0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.993+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b47c5b5a60 msgr2=0x55b47c5b7f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.993+0000 7f41b5f3e800 1 --2- 172.21.15.170:0/1366099682 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b47c5b5a60 0x55b47c5b7f20 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.993+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b47c5ba450 msgr2=0x55b47c5bc840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.993+0000 7f41b5f3e800 1 --2- 172.21.15.170:0/1366099682 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b47c5ba450 0x55b47c5bc840 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.993+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55b47c5bef30 msgr2=0x55b47c5c13f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.993+0000 7f41b5f3e800 1 --2- 172.21.15.170:0/1366099682 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55b47c5bef30 0x55b47c5c13f0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.993+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f407c03c6e0 msgr2=0x7f407c03eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.993+0000 7f41b5f3e800 1 --2- 172.21.15.170:0/1366099682 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f407c03c6e0 0x7f407c03eba0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f41a404ea70 tx=0x7f41a4085000 comp rx=0 tx=0).stop 2024-09-12T17:29:47.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.993+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b47c5a2b50 msgr2=0x55b47c5aa130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.993+0000 7f41b5f3e800 1 --2- 172.21.15.170:0/1366099682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b47c5a2b50 0x55b47c5aa130 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f41ac016010 tx=0x7f41ac053260 comp rx=0 tx=0).stop 2024-09-12T17:29:47.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.993+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 reap_dead start 2024-09-12T17:29:47.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.993+0000 7f41b1485640 1 -- 172.21.15.170:0/1366099682 reap_dead start 2024-09-12T17:29:47.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.993+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 shutdown_connections 2024-09-12T17:29:47.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.993+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 >> 172.21.15.170:0/1366099682 conn(0x55b47c59ef70 msgr2=0x55b47c59d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:47.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.993+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 shutdown_connections 2024-09-12T17:29:47.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.993+0000 7f41b5f3e800 1 -- 172.21.15.170:0/1366099682 wait complete. 2024-09-12T17:29:47.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.994+0000 7f41b5f3e800 1 -- 172.21.15.170:0/311312032 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f408c03c730 msgr2=0x7f408c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.994+0000 7f41b5f3e800 1 --2- 172.21.15.170:0/311312032 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f408c03c730 0x7f408c03ebf0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f41a4096180 tx=0x7f41a407e680 comp rx=0 tx=0).stop 2024-09-12T17:29:47.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.994+0000 7f41b5f3e800 1 -- 172.21.15.170:0/311312032 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b47c596050 msgr2=0x55b47c596470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.994+0000 7f41b5f3e800 1 --2- 172.21.15.170:0/311312032 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b47c596050 0x55b47c596470 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x55b47c481140 tx=0x7f41ac00bf30 comp rx=0 tx=0).stop 2024-09-12T17:29:47.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.994+0000 7f41b5f3e800 1 -- 172.21.15.170:0/311312032 shutdown_connections 2024-09-12T17:29:47.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.994+0000 7f41b5f3e800 1 --2- 172.21.15.170:0/311312032 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f408c03c730 0x7f408c03ebf0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.994+0000 7f41b5f3e800 1 --2- 172.21.15.170:0/311312032 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b47c596050 0x55b47c596470 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.994+0000 7f41b5f3e800 1 -- 172.21.15.170:0/311312032 >> 172.21.15.170:0/311312032 conn(0x55b47c58a400 msgr2=0x55b47c58a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:47.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.994+0000 7f41b5f3e800 1 -- 172.21.15.170:0/311312032 shutdown_connections 2024-09-12T17:29:47.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.994+0000 7f41b5f3e800 1 -- 172.21.15.170:0/311312032 wait complete. 2024-09-12T17:29:47.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.994+0000 7f41b5f3e800 1 -- 172.21.15.170:0/3635842367 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b47c485030 msgr2=0x55b47c582440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.994+0000 7f41b5f3e800 1 --2- 172.21.15.170:0/3635842367 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b47c485030 0x55b47c582440 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.994+0000 7f41b5f3e800 1 -- 172.21.15.170:0/3635842367 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b47c584b70 msgr2=0x55b47c587010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.994+0000 7f41b5f3e800 1 --2- 172.21.15.170:0/3635842367 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b47c584b70 0x55b47c587010 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.994+0000 7f41b5f3e800 1 -- 172.21.15.170:0/3635842367 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f409803c730 msgr2=0x7f409803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.994+0000 7f41b5f3e800 1 --2- 172.21.15.170:0/3635842367 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f409803c730 0x7f409803ebf0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f41a8001d70 tx=0x7f41a80012d0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.994+0000 7f41b5f3e800 1 -- 172.21.15.170:0/3635842367 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b47c4826a0 msgr2=0x55b47c481dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.994+0000 7f41b5f3e800 1 --2- 172.21.15.170:0/3635842367 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b47c4826a0 0x55b47c481dc0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f41a4025a60 tx=0x7f41a4003330 comp rx=0 tx=0).stop 2024-09-12T17:29:47.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.994+0000 7f41b5f3e800 1 -- 172.21.15.170:0/3635842367 shutdown_connections 2024-09-12T17:29:47.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.994+0000 7f41b5f3e800 1 --2- 172.21.15.170:0/3635842367 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b47c584b70 0x55b47c587010 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.994+0000 7f41b5f3e800 1 --2- 172.21.15.170:0/3635842367 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f409803c730 0x7f409803ebf0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.994+0000 7f41b5f3e800 1 --2- 172.21.15.170:0/3635842367 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b47c485030 0x55b47c582440 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.994+0000 7f41b5f3e800 1 --2- 172.21.15.170:0/3635842367 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b47c4826a0 0x55b47c481dc0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.994+0000 7f41b5f3e800 1 -- 172.21.15.170:0/3635842367 >> 172.21.15.170:0/3635842367 conn(0x55b47c47c200 msgr2=0x55b47c56b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:47.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.994+0000 7f41b5f3e800 1 -- 172.21.15.170:0/3635842367 shutdown_connections 2024-09-12T17:29:47.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:46.994+0000 7f41b5f3e800 1 -- 172.21.15.170:0/3635842367 wait complete. 2024-09-12T17:29:47.007 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T17:29:46.782056Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:29:46.782042Z', 'tags': [], 'group_ids': []} 2024-09-12T17:29:47.007 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T17:29:46.782056Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:29:46.782042Z', 'tags': [], 'group_ids': []} 2024-09-12T17:29:47.007 ERROR:root:0 2024-09-12T17:29:47.007 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-12T17:29:47.007 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-12T17:29:47.008 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid system_user --display-name 'System User' --access-key system_akey --secret system_skey --caps user-info-without-keys=read --system 2024-09-12T17:29:47.061 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:29:47.061 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:29:47.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.061+0000 7f19250b9800 1 Processor -- start 2024-09-12T17:29:47.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.061+0000 7f19250b9800 1 -- start start 2024-09-12T17:29:47.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.061+0000 7f19250b9800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5610afa9d6e0 0x5610afa9fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.061+0000 7f19250b9800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5610af946e40 con 0x5610afaa0070 2024-09-12T17:29:47.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.061+0000 7f19250b9800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x5610af911680 con 0x5610afa9d6e0 2024-09-12T17:29:47.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.061+0000 7f1922ba3640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5610afa9d6e0 0x5610afa9fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.061+0000 7f191bfff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x5610afaa0070 0x5610afaa2530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:44886/0 (socket says 172.21.15.170:44886) 2024-09-12T17:29:47.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.061+0000 7f191bfff640 1 -- 172.21.15.170:0/2212789491 learned_addr learned my addr 172.21.15.170:0/2212789491 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:29:47.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.062+0000 7f1922ba3640 1 -- 172.21.15.170:0/2212789491 >> v1:172.21.15.47:6789/0 conn(0x5610afaa0070 legacy=0x5610afaa2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.062+0000 7f1922ba3640 1 -- 172.21.15.170:0/2212789491 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610af92d6b0 con 0x5610afa9d6e0 2024-09-12T17:29:47.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.063+0000 7f1922ba3640 1 --2- 172.21.15.170:0/2212789491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5610afa9d6e0 0x5610afa9fad0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f191400a470 tx=0x7f1914045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=143ad6057487047e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.063+0000 7f19223a2640 1 -- 172.21.15.170:0/2212789491 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1914053570 con 0x5610afa9d6e0 2024-09-12T17:29:47.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.064+0000 7f19223a2640 1 -- 172.21.15.170:0/2212789491 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1914058070 con 0x5610afa9d6e0 2024-09-12T17:29:47.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.064+0000 7f19223a2640 1 -- 172.21.15.170:0/2212789491 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1914053880 con 0x5610afa9d6e0 2024-09-12T17:29:47.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.064+0000 7f19250b9800 1 -- 172.21.15.170:0/2212789491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5610afa9d6e0 msgr2=0x5610afa9fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.064+0000 7f19250b9800 1 --2- 172.21.15.170:0/2212789491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5610afa9d6e0 0x5610afa9fad0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f191400a470 tx=0x7f1914045a20 comp rx=0 tx=0).stop 2024-09-12T17:29:47.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.064+0000 7f19250b9800 1 -- 172.21.15.170:0/2212789491 shutdown_connections 2024-09-12T17:29:47.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.064+0000 7f19250b9800 1 --2- 172.21.15.170:0/2212789491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5610afa9d6e0 0x5610afa9fad0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.064+0000 7f19250b9800 1 -- 172.21.15.170:0/2212789491 >> 172.21.15.170:0/2212789491 conn(0x5610afa97220 msgr2=0x5610afa99680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:47.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.064+0000 7f19250b9800 1 -- 172.21.15.170:0/2212789491 shutdown_connections 2024-09-12T17:29:47.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.064+0000 7f19250b9800 1 -- 172.21.15.170:0/2212789491 wait complete. 2024-09-12T17:29:47.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.078+0000 7f19250b9800 1 Processor -- start 2024-09-12T17:29:47.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.078+0000 7f19250b9800 1 -- start start 2024-09-12T17:29:47.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.078+0000 7f19250b9800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5610afa9d6e0 0x5610afa9ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.078+0000 7f19250b9800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5610af935dd0 con 0x5610afa9d6e0 2024-09-12T17:29:47.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.078+0000 7f1922ba3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5610afa9d6e0 0x5610afa9ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.078+0000 7f1922ba3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5610afa9d6e0 0x5610afa9ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34928/0 (socket says 172.21.15.170:34928) 2024-09-12T17:29:47.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.078+0000 7f1922ba3640 1 -- 172.21.15.170:0/3786457441 learned_addr learned my addr 172.21.15.170:0/3786457441 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:47.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.079+0000 7f1922ba3640 1 -- 172.21.15.170:0/3786457441 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610af94ee10 con 0x5610afa9d6e0 2024-09-12T17:29:47.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.079+0000 7f1922ba3640 1 --2- 172.21.15.170:0/3786457441 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5610afa9d6e0 0x5610afa9ce50 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f1914025c20 tx=0x7f1914051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8ca44d02bb204a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.079+0000 7f1810e09640 1 -- 172.21.15.170:0/3786457441 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1914053a20 con 0x5610afa9d6e0 2024-09-12T17:29:47.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.079+0000 7f1810e09640 1 -- 172.21.15.170:0/3786457441 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1914063070 con 0x5610afa9d6e0 2024-09-12T17:29:47.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.079+0000 7f1810e09640 1 -- 172.21.15.170:0/3786457441 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1914053cf0 con 0x5610afa9d6e0 2024-09-12T17:29:47.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.080+0000 7f19250b9800 1 -- 172.21.15.170:0/3786457441 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5610afa9d6e0 msgr2=0x5610afa9ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.080+0000 7f19250b9800 1 --2- 172.21.15.170:0/3786457441 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5610afa9d6e0 0x5610afa9ce50 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f1914025c20 tx=0x7f1914051000 comp rx=0 tx=0).stop 2024-09-12T17:29:47.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.080+0000 7f19250b9800 1 -- 172.21.15.170:0/3786457441 shutdown_connections 2024-09-12T17:29:47.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.080+0000 7f19250b9800 1 --2- 172.21.15.170:0/3786457441 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5610afa9d6e0 0x5610afa9ce50 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.080+0000 7f19250b9800 1 -- 172.21.15.170:0/3786457441 >> 172.21.15.170:0/3786457441 conn(0x5610afa97220 msgr2=0x5610afb880c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:47.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.080+0000 7f19250b9800 1 -- 172.21.15.170:0/3786457441 shutdown_connections 2024-09-12T17:29:47.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.080+0000 7f19250b9800 1 -- 172.21.15.170:0/3786457441 wait complete. 2024-09-12T17:29:47.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.080+0000 7f19250b9800 1 Processor -- start 2024-09-12T17:29:47.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.080+0000 7f19250b9800 1 -- start start 2024-09-12T17:29:47.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.080+0000 7f19250b9800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5610afa9d6e0 0x5610afb96210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.081+0000 7f19250b9800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5610afaa4090 con 0x5610afa9d6e0 2024-09-12T17:29:47.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.081+0000 7f1922ba3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5610afa9d6e0 0x5610afb96210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.081+0000 7f1922ba3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5610afa9d6e0 0x5610afb96210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34942/0 (socket says 172.21.15.170:34942) 2024-09-12T17:29:47.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.081+0000 7f1922ba3640 1 -- 172.21.15.170:0/963828398 learned_addr learned my addr 172.21.15.170:0/963828398 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:47.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.081+0000 7f1922ba3640 1 -- 172.21.15.170:0/963828398 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610afb96770 con 0x5610afa9d6e0 2024-09-12T17:29:47.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.081+0000 7f1922ba3640 1 --2- 172.21.15.170:0/963828398 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5610afa9d6e0 0x5610afb96210 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f1914025c20 tx=0x7f1914002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.081+0000 7f180f606640 1 -- 172.21.15.170:0/963828398 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1914068660 con 0x5610afa9d6e0 2024-09-12T17:29:47.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.081+0000 7f180f606640 1 -- 172.21.15.170:0/963828398 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1914068800 con 0x5610afa9d6e0 2024-09-12T17:29:47.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.081+0000 7f180f606640 1 -- 172.21.15.170:0/963828398 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1914068ae0 con 0x5610afa9d6e0 2024-09-12T17:29:47.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.081+0000 7f19250b9800 1 -- 172.21.15.170:0/963828398 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5610afb96a00 con 0x5610afa9d6e0 2024-09-12T17:29:47.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.081+0000 7f19250b9800 1 -- 172.21.15.170:0/963828398 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610afb975c0 con 0x5610afa9d6e0 2024-09-12T17:29:47.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.082+0000 7f180f606640 1 -- 172.21.15.170:0/963828398 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1914068c80 con 0x5610afa9d6e0 2024-09-12T17:29:47.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.082+0000 7f180f606640 1 --2- 172.21.15.170:0/963828398 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f180803c780 0x7f180803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.082+0000 7f180f606640 1 -- 172.21.15.170:0/963828398 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f1914098200 con 0x5610afa9d6e0 2024-09-12T17:29:47.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.083+0000 7f191bfff640 1 --2- 172.21.15.170:0/963828398 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f180803c780 0x7f180803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.083+0000 7f19250b9800 1 --2- 172.21.15.170:0/963828398 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5610afaa0070 0x5610afb9d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.083+0000 7f19250b9800 1 -- 172.21.15.170:0/963828398 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5610afb9dd50 con 0x5610afaa0070 2024-09-12T17:29:47.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.083+0000 7f19233a4640 1 --2- 172.21.15.170:0/963828398 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5610afaa0070 0x5610afb9d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.083+0000 7f191bfff640 1 --2- 172.21.15.170:0/963828398 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f180803c780 0x7f180803ec40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f190c004170 tx=0x7f190c001330 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.083+0000 7f19233a4640 1 --2- 172.21.15.170:0/963828398 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5610afaa0070 0x5610afb9d810 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.083+0000 7f19233a4640 1 -- 172.21.15.170:0/963828398 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f191c00a4d0 con 0x5610afaa0070 2024-09-12T17:29:47.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.083+0000 7f19250b9800 1 -- 172.21.15.170:0/963828398 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5610afb9e0f0 con 0x5610afaa0070 2024-09-12T17:29:47.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.084+0000 7f19233a4640 1 -- 172.21.15.170:0/963828398 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f191c00a4d0 con 0x5610afaa0070 2024-09-12T17:29:47.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.084+0000 7f19250b9800 1 --2- 172.21.15.170:0/963828398 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5610afb9fbb0 0x5610afba2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.084+0000 7f19250b9800 1 -- 172.21.15.170:0/963828398 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5610afba27c0 con 0x5610afb9fbb0 2024-09-12T17:29:47.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.084+0000 7f1922ba3640 1 --2- 172.21.15.170:0/963828398 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5610afb9fbb0 0x5610afba2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.084+0000 7f1922ba3640 1 --2- 172.21.15.170:0/963828398 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5610afb9fbb0 0x5610afba2030 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.084+0000 7f1922ba3640 1 -- 172.21.15.170:0/963828398 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1914051070 con 0x5610afb9fbb0 2024-09-12T17:29:47.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.084+0000 7f19250b9800 1 -- 172.21.15.170:0/963828398 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5610afb9e940 con 0x5610afaa0070 2024-09-12T17:29:47.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.085+0000 7f19233a4640 1 -- 172.21.15.170:0/963828398 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f191c00a4d0 con 0x5610afaa0070 2024-09-12T17:29:47.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.085+0000 7f19250b9800 1 -- 172.21.15.170:0/963828398 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5610afb9ed20 con 0x5610afb9fbb0 2024-09-12T17:29:47.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.085+0000 7f1922ba3640 1 -- 172.21.15.170:0/963828398 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1914051070 con 0x5610afb9fbb0 2024-09-12T17:29:47.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.085+0000 7f19250b9800 1 Processor -- start 2024-09-12T17:29:47.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.085+0000 7f19250b9800 1 -- start start 2024-09-12T17:29:47.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.086+0000 7f19250b9800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5610afbb1050 0x5610afbb1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.086+0000 7f19250b9800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5610af993a00 con 0x5610afbb1050 2024-09-12T17:29:47.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.086+0000 7f19233a4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5610afbb1050 0x5610afbb1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.086+0000 7f19233a4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5610afbb1050 0x5610afbb1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34946/0 (socket says 172.21.15.170:34946) 2024-09-12T17:29:47.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.086+0000 7f19233a4640 1 -- 172.21.15.170:0/1884272788 learned_addr learned my addr 172.21.15.170:0/1884272788 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:47.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.086+0000 7f19233a4640 1 -- 172.21.15.170:0/1884272788 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610afbb1ab0 con 0x5610afbb1050 2024-09-12T17:29:47.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.086+0000 7f19233a4640 1 --2- 172.21.15.170:0/1884272788 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5610afbb1050 0x5610afbb1470 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x5610afb96f20 tx=0x7f191c0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.087+0000 7f180ce01640 1 -- 172.21.15.170:0/1884272788 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f191c013640 con 0x5610afbb1050 2024-09-12T17:29:47.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.087+0000 7f180ce01640 1 -- 172.21.15.170:0/1884272788 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f191c0137e0 con 0x5610afbb1050 2024-09-12T17:29:47.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.087+0000 7f180ce01640 1 -- 172.21.15.170:0/1884272788 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f191c013ae0 con 0x5610afbb1050 2024-09-12T17:29:47.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.087+0000 7f19250b9800 1 -- 172.21.15.170:0/1884272788 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5610afbb22e0 con 0x5610afbb1050 2024-09-12T17:29:47.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.087+0000 7f19250b9800 1 -- 172.21.15.170:0/1884272788 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610afbb2880 con 0x5610afbb1050 2024-09-12T17:29:47.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.087+0000 7f180ce01640 1 -- 172.21.15.170:0/1884272788 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f191c011040 con 0x5610afbb1050 2024-09-12T17:29:47.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.088+0000 7f180ce01640 1 --2- 172.21.15.170:0/1884272788 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f17fc03c730 0x7f17fc03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.088+0000 7f180ce01640 1 -- 172.21.15.170:0/1884272788 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f191c00e040 con 0x5610afbb1050 2024-09-12T17:29:47.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.088+0000 7f1922ba3640 1 --2- 172.21.15.170:0/1884272788 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f17fc03c730 0x7f17fc03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.088+0000 7f19250b9800 1 Processor -- start 2024-09-12T17:29:47.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.088+0000 7f19250b9800 1 -- start start 2024-09-12T17:29:47.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.088+0000 7f1922ba3640 1 --2- 172.21.15.170:0/1884272788 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f17fc03c730 0x7f17fc03ebf0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x5610afb982a0 tx=0x7f1914045e60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.088+0000 7f19250b9800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5610afbbdb70 0x5610afbbdf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.088+0000 7f19250b9800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5610afa9b6f0 con 0x5610afbbdb70 2024-09-12T17:29:47.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.088+0000 7f19233a4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5610afbbdb70 0x5610afbbdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.088+0000 7f19233a4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5610afbbdb70 0x5610afbbdf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34954/0 (socket says 172.21.15.170:34954) 2024-09-12T17:29:47.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.088+0000 7f19233a4640 1 -- 172.21.15.170:0/3224659364 learned_addr learned my addr 172.21.15.170:0/3224659364 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:47.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.089+0000 7f19233a4640 1 -- 172.21.15.170:0/3224659364 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610afbbe560 con 0x5610afbbdb70 2024-09-12T17:29:47.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.089+0000 7f19233a4640 1 --2- 172.21.15.170:0/3224659364 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5610afbbdb70 0x5610afbbdf70 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f191c020000 tx=0x7f191c01f400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ec32c60e4212a4e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.089+0000 7f18067fc640 1 -- 172.21.15.170:0/3224659364 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f191c055040 con 0x5610afbbdb70 2024-09-12T17:29:47.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.089+0000 7f18067fc640 1 -- 172.21.15.170:0/3224659364 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f191c021960 con 0x5610afbbdb70 2024-09-12T17:29:47.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.089+0000 7f18067fc640 1 -- 172.21.15.170:0/3224659364 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f191c021440 con 0x5610afbbdb70 2024-09-12T17:29:47.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.089+0000 7f19250b9800 1 -- 172.21.15.170:0/3224659364 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5610afbbdb70 msgr2=0x5610afbbdf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.089+0000 7f19250b9800 1 --2- 172.21.15.170:0/3224659364 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5610afbbdb70 0x5610afbbdf70 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f191c020000 tx=0x7f191c01f400 comp rx=0 tx=0).stop 2024-09-12T17:29:47.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.089+0000 7f19250b9800 1 -- 172.21.15.170:0/3224659364 shutdown_connections 2024-09-12T17:29:47.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.090+0000 7f19250b9800 1 --2- 172.21.15.170:0/3224659364 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5610afbbdb70 0x5610afbbdf70 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.090+0000 7f19250b9800 1 -- 172.21.15.170:0/3224659364 >> 172.21.15.170:0/3224659364 conn(0x5610afbb9f70 msgr2=0x5610afbb81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:47.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.090+0000 7f19250b9800 1 -- 172.21.15.170:0/3224659364 shutdown_connections 2024-09-12T17:29:47.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.090+0000 7f19250b9800 1 -- 172.21.15.170:0/3224659364 wait complete. 2024-09-12T17:29:47.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.090+0000 7f19250b9800 1 Processor -- start 2024-09-12T17:29:47.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.090+0000 7f19250b9800 1 -- start start 2024-09-12T17:29:47.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.090+0000 7f19250b9800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5610afbbdb70 0x5610afbc5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.090+0000 7f19250b9800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5610afbbeb80 con 0x5610afbbdb70 2024-09-12T17:29:47.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.090+0000 7f19233a4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5610afbbdb70 0x5610afbc5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.090+0000 7f19233a4640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5610afbbdb70 0x5610afbc5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34958/0 (socket says 172.21.15.170:34958) 2024-09-12T17:29:47.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.090+0000 7f19233a4640 1 -- 172.21.15.170:0/891664579 learned_addr learned my addr 172.21.15.170:0/891664579 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:47.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.090+0000 7f19233a4640 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610afbc56c0 con 0x5610afbbdb70 2024-09-12T17:29:47.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.091+0000 7f19233a4640 1 --2- 172.21.15.170:0/891664579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5610afbbdb70 0x5610afbc5160 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f191c0208e0 tx=0x7f191c053cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.091+0000 7f1804ff9640 1 -- 172.21.15.170:0/891664579 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f191c055050 con 0x5610afbbdb70 2024-09-12T17:29:47.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.091+0000 7f1804ff9640 1 -- 172.21.15.170:0/891664579 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f191c01fd90 con 0x5610afbbdb70 2024-09-12T17:29:47.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.091+0000 7f1804ff9640 1 -- 172.21.15.170:0/891664579 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f191c01f840 con 0x5610afbbdb70 2024-09-12T17:29:47.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.091+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5610afbc5950 con 0x5610afbbdb70 2024-09-12T17:29:47.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.091+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610afbc62d0 con 0x5610afbbdb70 2024-09-12T17:29:47.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.092+0000 7f1804ff9640 1 -- 172.21.15.170:0/891664579 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f191c0551f0 con 0x5610afbbdb70 2024-09-12T17:29:47.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.092+0000 7f1804ff9640 1 --2- 172.21.15.170:0/891664579 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f17ec03c730 0x7f17ec03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.092+0000 7f1804ff9640 1 -- 172.21.15.170:0/891664579 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f191c034bf0 con 0x5610afbbdb70 2024-09-12T17:29:47.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.092+0000 7f1922ba3640 1 --2- 172.21.15.170:0/891664579 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f17ec03c730 0x7f17ec03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.092+0000 7f19250b9800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.092+0000 7f1922ba3640 1 --2- 172.21.15.170:0/891664579 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f17ec03c730 0x7f17ec03ebf0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f191405dac0 tx=0x7f1914089000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.092+0000 7f19250b9800 1 --2- 172.21.15.170:0/891664579 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5610afbd0a30 0x5610afbd2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.092+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5610afbd3640 con 0x5610afbd0a30 2024-09-12T17:29:47.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.093+0000 7f191bfff640 1 --2- 172.21.15.170:0/891664579 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5610afbd0a30 0x5610afbd2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.093+0000 7f191bfff640 1 --2- 172.21.15.170:0/891664579 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5610afbd0a30 0x5610afbd2ef0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.093+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f190c009050 con 0x5610afbd0a30 2024-09-12T17:29:47.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.093+0000 7f19250b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.093+0000 7f19250b9800 20 realm 2024-09-12T17:29:47.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.093+0000 7f19250b9800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.093+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5610afbcfdc0 con 0x5610afbd0a30 2024-09-12T17:29:47.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.093+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f190c009050 con 0x5610afbd0a30 2024-09-12T17:29:47.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.093+0000 7f19250b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.093+0000 7f19250b9800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:29:47.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.093+0000 7f19250b9800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.093+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5610afbd4130 con 0x5610afbd0a30 2024-09-12T17:29:47.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.094+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f190c009050 con 0x5610afbd0a30 2024-09-12T17:29:47.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.094+0000 7f19250b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.094+0000 7f19250b9800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.094+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5610afbd4a00 con 0x5610afbd0a30 2024-09-12T17:29:47.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.094+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f190c009050 con 0x5610afbd0a30 2024-09-12T17:29:47.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.094+0000 7f19250b9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:47.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.094+0000 7f19250b9800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.094+0000 7f19250b9800 1 --2- 172.21.15.170:0/891664579 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5610afbd5420 0x5610afbd7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.094+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5610afbd7ee0 con 0x5610afbd5420 2024-09-12T17:29:47.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.094+0000 7f19233a4640 1 --2- 172.21.15.170:0/891664579 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5610afbd5420 0x5610afbd7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.094+0000 7f19233a4640 1 --2- 172.21.15.170:0/891664579 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5610afbd5420 0x5610afbd7810 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.094+0000 7f19233a4640 1 -- 172.21.15.170:0/891664579 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f191c00a4d0 con 0x5610afbd5420 2024-09-12T17:29:47.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.094+0000 7f19250b9800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:29:47.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.095+0000 7f19250b9800 20 searching for the correct realm 2024-09-12T17:29:47.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.095+0000 7f19250b9800 1 --2- 172.21.15.170:0/891664579 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5610afbd9ee0 0x5610afbdc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.095+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610afbdca70 con 0x5610afbd9ee0 2024-09-12T17:29:47.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.095+0000 7f1922ba3640 1 --2- 172.21.15.170:0/891664579 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5610afbd9ee0 0x5610afbdc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.095+0000 7f1922ba3640 1 --2- 172.21.15.170:0/891664579 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5610afbd9ee0 0x5610afbdc3a0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.095+0000 7f1922ba3640 1 -- 172.21.15.170:0/891664579 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1914051070 con 0x5610afbd9ee0 2024-09-12T17:29:47.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.095+0000 7f1922ba3640 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610afbdca70 con 0x5610afbd5420 2024-09-12T17:29:47.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.095+0000 7f19233a4640 1 -- 172.21.15.170:0/891664579 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f191c00a4d0 con 0x5610afbd5420 2024-09-12T17:29:47.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.095+0000 7f19233a4640 1 --2- 172.21.15.170:0/891664579 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f191c04e940 0x7f191c0123d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.095+0000 7f19233a4640 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610afbdca70 con 0x7f191c04e940 2024-09-12T17:29:47.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.096+0000 7f191bfff640 1 --2- 172.21.15.170:0/891664579 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f191c04e940 0x7f191c0123d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.096+0000 7f191bfff640 1 --2- 172.21.15.170:0/891664579 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f191c04e940 0x7f191c0123d0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.096+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f190c009050 con 0x7f191c04e940 2024-09-12T17:29:47.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.096+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610afbdca70 con 0x5610afbd0a30 2024-09-12T17:29:47.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.097+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f190c009050 con 0x5610afbd0a30 2024-09-12T17:29:47.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.097+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610afbdca70 con 0x5610afbd0a30 2024-09-12T17:29:47.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.097+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f190c029040 con 0x5610afbd0a30 2024-09-12T17:29:47.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.097+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610afbdca70 con 0x7f191c04e940 2024-09-12T17:29:47.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.097+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f190c029040 con 0x7f191c04e940 2024-09-12T17:29:47.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.097+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610afbdca70 con 0x7f191c04e940 2024-09-12T17:29:47.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.097+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f190c029040 con 0x7f191c04e940 2024-09-12T17:29:47.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.097+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610afbdca70 con 0x5610afbd5420 2024-09-12T17:29:47.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.098+0000 7f19233a4640 1 -- 172.21.15.170:0/891664579 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f191c00a4d0 con 0x5610afbd5420 2024-09-12T17:29:47.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.098+0000 7f19233a4640 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610afbdca70 con 0x5610afbd9ee0 2024-09-12T17:29:47.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.098+0000 7f1922ba3640 1 -- 172.21.15.170:0/891664579 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1914051070 con 0x5610afbd9ee0 2024-09-12T17:29:47.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.098+0000 7f1922ba3640 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610afbdca70 con 0x5610afbd0a30 2024-09-12T17:29:47.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.098+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f190c029040 con 0x5610afbd0a30 2024-09-12T17:29:47.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.098+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610afbdca70 con 0x7f191c04e940 2024-09-12T17:29:47.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.098+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f190c029040 con 0x7f191c04e940 2024-09-12T17:29:47.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.098+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610afbdca70 con 0x5610afbd0a30 2024-09-12T17:29:47.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.099+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f190c029040 con 0x5610afbd0a30 2024-09-12T17:29:47.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.099+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610afbdca70 con 0x5610afbd5420 2024-09-12T17:29:47.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.099+0000 7f19233a4640 1 -- 172.21.15.170:0/891664579 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f191c00a4d0 con 0x5610afbd5420 2024-09-12T17:29:47.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.099+0000 7f19233a4640 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610afbdca70 con 0x5610afbd9ee0 2024-09-12T17:29:47.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.099+0000 7f1922ba3640 1 -- 172.21.15.170:0/891664579 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1914051070 con 0x5610afbd9ee0 2024-09-12T17:29:47.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.099+0000 7f1922ba3640 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610afbdca70 con 0x5610afbd9ee0 2024-09-12T17:29:47.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.099+0000 7f1922ba3640 1 -- 172.21.15.170:0/891664579 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1914051070 con 0x5610afbd9ee0 2024-09-12T17:29:47.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.099+0000 7f1922ba3640 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610afbdca70 con 0x5610afbd5420 2024-09-12T17:29:47.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.100+0000 7f19233a4640 1 -- 172.21.15.170:0/891664579 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f191c00a4d0 con 0x5610afbd5420 2024-09-12T17:29:47.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.100+0000 7f19233a4640 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610afbdca70 con 0x5610afbd9ee0 2024-09-12T17:29:47.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.100+0000 7f1922ba3640 1 -- 172.21.15.170:0/891664579 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1914051070 con 0x5610afbd9ee0 2024-09-12T17:29:47.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.100+0000 7f1922ba3640 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610afbdca70 con 0x5610afbd9ee0 2024-09-12T17:29:47.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.100+0000 7f1922ba3640 1 -- 172.21.15.170:0/891664579 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1914051070 con 0x5610afbd9ee0 2024-09-12T17:29:47.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.100+0000 7f1922ba3640 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610afbdca70 con 0x5610afbd0a30 2024-09-12T17:29:47.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.100+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f190c029040 con 0x5610afbd0a30 2024-09-12T17:29:47.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.100+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610afbdca70 con 0x5610afbd0a30 2024-09-12T17:29:47.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.100+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v31'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f190c029040 con 0x5610afbd0a30 2024-09-12T17:29:47.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.100+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610afbdca70 con 0x7f191c04e940 2024-09-12T17:29:47.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.101+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f190c029040 con 0x7f191c04e940 2024-09-12T17:29:47.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.101+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610afbdca70 con 0x5610afbd9ee0 2024-09-12T17:29:47.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.101+0000 7f1922ba3640 1 -- 172.21.15.170:0/891664579 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1914051070 con 0x5610afbd9ee0 2024-09-12T17:29:47.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.101+0000 7f1922ba3640 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610afbdca70 con 0x5610afbd5420 2024-09-12T17:29:47.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.101+0000 7f19233a4640 1 -- 172.21.15.170:0/891664579 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f191c00a4d0 con 0x5610afbd5420 2024-09-12T17:29:47.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.101+0000 7f19233a4640 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610afbdca70 con 0x5610afbd0a30 2024-09-12T17:29:47.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.101+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f190c029040 con 0x5610afbd0a30 2024-09-12T17:29:47.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.101+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610afbdca70 con 0x7f191c04e940 2024-09-12T17:29:47.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.102+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f190c029040 con 0x7f191c04e940 2024-09-12T17:29:47.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.102+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610afbdca70 con 0x5610afbd9ee0 2024-09-12T17:29:47.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.102+0000 7f1922ba3640 1 -- 172.21.15.170:0/891664579 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1914051070 con 0x5610afbd9ee0 2024-09-12T17:29:47.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.102+0000 7f1922ba3640 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610afbdca70 con 0x7f191c04e940 2024-09-12T17:29:47.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.102+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f190c029040 con 0x7f191c04e940 2024-09-12T17:29:47.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.102+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610afbdca70 con 0x5610afbd5420 2024-09-12T17:29:47.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.102+0000 7f19233a4640 1 -- 172.21.15.170:0/891664579 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f191c067040 con 0x5610afbd5420 2024-09-12T17:29:47.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.102+0000 7f19233a4640 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610afbdca70 con 0x5610afbd9ee0 2024-09-12T17:29:47.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.103+0000 7f1922ba3640 1 -- 172.21.15.170:0/891664579 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1914051070 con 0x5610afbd9ee0 2024-09-12T17:29:47.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.103+0000 7f1922ba3640 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610afbdca70 con 0x7f191c04e940 2024-09-12T17:29:47.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.103+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f190c029040 con 0x7f191c04e940 2024-09-12T17:29:47.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.103+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610afbdca70 con 0x5610afbd0a30 2024-09-12T17:29:47.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.103+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f190c029040 con 0x5610afbd0a30 2024-09-12T17:29:47.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.103+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610afbdca70 con 0x5610afbd5420 2024-09-12T17:29:47.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.103+0000 7f19233a4640 1 -- 172.21.15.170:0/891664579 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(37 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f191c067040 con 0x5610afbd5420 2024-09-12T17:29:47.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.104+0000 7f19250b9800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:29:47.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.104+0000 7f19250b9800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:29:47.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.104+0000 7f19250b9800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:29:47.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.104+0000 7f19250b9800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:29:47.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.104+0000 7f19250b9800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:29:47.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.104+0000 7f19250b9800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:29:47.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.104+0000 7f19250b9800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.104+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5610afbd87a0 con 0x5610afbd0a30 2024-09-12T17:29:47.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.104+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f190c029040 con 0x5610afbd0a30 2024-09-12T17:29:47.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.104+0000 7f19250b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.104+0000 7f19250b9800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.104+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5610afbd8b90 con 0x5610afbd0a30 2024-09-12T17:29:47.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.104+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f190c029040 con 0x5610afbd0a30 2024-09-12T17:29:47.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.104+0000 7f19250b9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:47.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.104+0000 7f19250b9800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.104+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5610afbdcef0 con 0x5610afbd5420 2024-09-12T17:29:47.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.104+0000 7f19233a4640 1 -- 172.21.15.170:0/891664579 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f191c067040 con 0x5610afbd5420 2024-09-12T17:29:47.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.104+0000 7f19250b9800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:29:47.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.104+0000 7f19250b9800 20 zone default found 2024-09-12T17:29:47.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.104+0000 7f19250b9800 4 Realm: () 2024-09-12T17:29:47.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.104+0000 7f19250b9800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:29:47.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.104+0000 7f19250b9800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:29:47.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.104+0000 7f19250b9800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:29:47.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.104+0000 7f19250b9800 20 zonegroup default 2024-09-12T17:29:47.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.104+0000 7f19250b9800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.104+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5610afbdd290 con 0x7f191c04e940 2024-09-12T17:29:47.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.105+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f190c029040 con 0x7f191c04e940 2024-09-12T17:29:47.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.105+0000 7f19250b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.105+0000 7f19250b9800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.105+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5610afbdf550 con 0x5610afbd9ee0 2024-09-12T17:29:47.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.105+0000 7f1922ba3640 1 -- 172.21.15.170:0/891664579 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1914051070 con 0x5610afbd9ee0 2024-09-12T17:29:47.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.105+0000 7f19250b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.105+0000 7f19250b9800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.105+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5610afbdf8f0 con 0x5610afbd9ee0 2024-09-12T17:29:47.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.105+0000 7f1922ba3640 1 -- 172.21.15.170:0/891664579 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1914051070 con 0x5610afbd9ee0 2024-09-12T17:29:47.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.105+0000 7f19250b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.105+0000 7f19250b9800 20 started sync module instance, tier type = 2024-09-12T17:29:47.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.105+0000 7f19250b9800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:29:47.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.105+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610afbde9e0 con 0x5610afbd5420 2024-09-12T17:29:47.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.106+0000 7f19233a4640 1 -- 172.21.15.170:0/891664579 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(44 notify.0 [create] v31'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f191c067040 con 0x5610afbd5420 2024-09-12T17:29:47.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.106+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94629667925456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610afbde640 con 0x5610afbd5420 2024-09-12T17:29:47.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.106+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610afbe0820 con 0x5610afbd0a30 2024-09-12T17:29:47.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.107+0000 7f19233a4640 1 -- 172.21.15.170:0/891664579 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94629667925456] v31'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f191c067040 con 0x5610afbd5420 2024-09-12T17:29:47.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.107+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v31'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f190c029040 con 0x5610afbd0a30 2024-09-12T17:29:47.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.107+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94629667929424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610afbe0820 con 0x5610afbd0a30 2024-09-12T17:29:47.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.107+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610afbe1220 con 0x5610afbd9ee0 2024-09-12T17:29:47.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.109+0000 7f1922ba3640 1 -- 172.21.15.170:0/891664579 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v31'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1914051070 con 0x5610afbd9ee0 2024-09-12T17:29:47.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.109+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94629667929424] v31'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f190c029040 con 0x5610afbd0a30 2024-09-12T17:29:47.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.109+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94629667930992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610afbe0790 con 0x5610afbd9ee0 2024-09-12T17:29:47.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.109+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610afbe20e0 con 0x5610afbd5420 2024-09-12T17:29:47.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.110+0000 7f1922ba3640 1 -- 172.21.15.170:0/891664579 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94629667930992] v31'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1914051070 con 0x5610afbd9ee0 2024-09-12T17:29:47.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.110+0000 7f19233a4640 1 -- 172.21.15.170:0/891664579 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(50 notify.3 [create] v31'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f191c067040 con 0x5610afbd5420 2024-09-12T17:29:47.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.110+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94629667935760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610afbe20e0 con 0x5610afbd5420 2024-09-12T17:29:47.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.110+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610afbe2ae0 con 0x5610afbd0a30 2024-09-12T17:29:47.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.111+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v31'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f190c029040 con 0x5610afbd0a30 2024-09-12T17:29:47.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.111+0000 7f19233a4640 1 -- 172.21.15.170:0/891664579 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94629667935760] v31'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f191c067040 con 0x5610afbd5420 2024-09-12T17:29:47.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.111+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94629667939824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610afbe20e0 con 0x5610afbd0a30 2024-09-12T17:29:47.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.111+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610afbe3530 con 0x7f191c04e940 2024-09-12T17:29:47.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.112+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(54 notify.5 [create] v31'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f190c029040 con 0x7f191c04e940 2024-09-12T17:29:47.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.112+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94629667942464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610afbe3460 con 0x7f191c04e940 2024-09-12T17:29:47.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.112+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610afbe4480 con 0x7f191c04e940 2024-09-12T17:29:47.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.112+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94629667939824] v31'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f190c029040 con 0x5610afbd0a30 2024-09-12T17:29:47.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.113+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(56 notify.6 [create] v31'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f190c029040 con 0x7f191c04e940 2024-09-12T17:29:47.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.113+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94629667946352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610afbe4440 con 0x7f191c04e940 2024-09-12T17:29:47.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.113+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610afbe4e80 con 0x7f191c04e940 2024-09-12T17:29:47.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.113+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94629667942464] v31'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f190c029040 con 0x7f191c04e940 2024-09-12T17:29:47.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.114+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94629667946352] v31'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f190c029040 con 0x7f191c04e940 2024-09-12T17:29:47.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.114+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(58 notify.7 [create] v31'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f190c029040 con 0x7f191c04e940 2024-09-12T17:29:47.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.114+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94629667937328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610afbe4e40 con 0x7f191c04e940 2024-09-12T17:29:47.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.114+0000 7f19250b9800 20 add_watcher() i=0 2024-09-12T17:29:47.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.114+0000 7f19250b9800 20 add_watcher() i=1 2024-09-12T17:29:47.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.114+0000 7f19250b9800 20 add_watcher() i=2 2024-09-12T17:29:47.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.114+0000 7f19250b9800 20 add_watcher() i=3 2024-09-12T17:29:47.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.114+0000 7f19250b9800 20 add_watcher() i=4 2024-09-12T17:29:47.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.114+0000 7f19250b9800 20 add_watcher() i=5 2024-09-12T17:29:47.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.114+0000 7f19250b9800 20 add_watcher() i=6 2024-09-12T17:29:47.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.115+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94629667937328] v31'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f190c029040 con 0x7f191c04e940 2024-09-12T17:29:47.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.115+0000 7f19250b9800 20 add_watcher() i=7 2024-09-12T17:29:47.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.115+0000 7f19250b9800 2 all 8 watchers are set, enabling cache 2024-09-12T17:29:47.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.115+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5610afbe3900 con 0x5610afbd0a30 2024-09-12T17:29:47.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.116+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f190c029040 con 0x5610afbd0a30 2024-09-12T17:29:47.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.116+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94629667948880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610afbe38e0 con 0x5610afbd0a30 2024-09-12T17:29:47.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.117+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94629667948880] v31'244 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f190c029040 con 0x5610afbd0a30 2024-09-12T17:29:47.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.117+0000 7f17d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:47.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.117+0000 7f19250b9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:29:47.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.117+0000 7f19250b9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:29:47.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.117+0000 7f19250b9800 5 note: GC not initialized 2024-09-12T17:29:47.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.117+0000 7f1753fff640 20 reqs_thread_entry: start 2024-09-12T17:29:47.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.117+0000 7f19250b9800 20 init_complete bucket index max shards: 11 2024-09-12T17:29:47.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.117+0000 7f19250b9800 20 Filter name: none 2024-09-12T17:29:47.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.117+0000 7f1751ffb640 20 reqs_thread_entry: start 2024-09-12T17:29:47.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.118+0000 7f19250b9800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-12T17:29:47.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.118+0000 7f19250b9800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.118+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:62 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5610afc1ae30 con 0x7f191c04e940 2024-09-12T17:29:47.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.118+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(62 system_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 239+0+0 (crc 0 0 0) 0x7f190c029040 con 0x7f191c04e940 2024-09-12T17:29:47.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.118+0000 7f19250b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.118+0000 7f19250b9800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x0 2024-09-12T17:29:47.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.118+0000 7f19250b9800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-12T17:29:47.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.118+0000 7f19250b9800 10 cache get: name=default.rgw.meta+users.keys+system_akey : miss 2024-09-12T17:29:47.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.118+0000 7f19250b9800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.118+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:63 8.0 8:01223cbf:users.keys::system_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5610afc194f0 con 0x5610afbd9ee0 2024-09-12T17:29:47.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.118+0000 7f1922ba3640 1 -- 172.21.15.170:0/891664579 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(63 system_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f1914051070 con 0x5610afbd9ee0 2024-09-12T17:29:47.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.119+0000 7f19250b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.119+0000 7f19250b9800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x0 2024-09-12T17:29:47.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.119+0000 7f19250b9800 10 adding default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-12T17:29:47.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.119+0000 7f19250b9800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-12T17:29:47.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.119+0000 7f19250b9800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-12T17:29:47.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.119+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:64 8.1e 8:78ce4db0:users.uid::system_user:head [delete,create,call version.set in=58b,writefull 0~349 in=349b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610afc19dc0 con 0x7f191c04e940 2024-09-12T17:29:47.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.120+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(64 system_user [delete,create,call,writefull 0~349] v31'3 uv3 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f190c029040 con 0x7f191c04e940 2024-09-12T17:29:47.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.120+0000 7f19250b9800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-12T17:29:47.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.120+0000 7f19250b9800 10 moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-12T17:29:47.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.120+0000 7f19250b9800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-12T17:29:47.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.120+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94629668165904 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5610afc1e770 con 0x5610afbd5420 2024-09-12T17:29:47.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.120+0000 7f19233a4640 1 -- 172.21.15.170:0/891664579 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== watch-notify(notify (1) cookie 94629667925456 notify 133143986199 ret 0) ==== 575+0+0 (crc 0 0 0) 0x5610afbc5950 con 0x5610afbd5420 2024-09-12T17:29:47.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.120+0000 7f18067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986199 cookie 94629667925456 notifier 4841 bl.length()=533 2024-09-12T17:29:47.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.120+0000 7f18067fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-12T17:29:47.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.120+0000 7f18067fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-12T17:29:47.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.120+0000 7f19233a4640 1 -- 172.21.15.170:0/891664579 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(65 notify.0 [notify cookie 94629668165904 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f191c067040 con 0x5610afbd5420 2024-09-12T17:29:47.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.120+0000 7f18067fc640 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f17e8003ea0 con 0x5610afbd5420 2024-09-12T17:29:47.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.120+0000 7f19233a4640 1 -- 172.21.15.170:0/891664579 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(66 notify.0 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f191c067040 con 0x5610afbd5420 2024-09-12T17:29:47.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.120+0000 7f19233a4640 1 -- 172.21.15.170:0/891664579 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== watch-notify(notify_complete (2) cookie 94629668165904 notify 133143986199 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5610afbc56c0 con 0x5610afbd5420 2024-09-12T17:29:47.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.120+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:67 8.0 8:01223cbf:users.keys::system_akey:head [delete,create,writefull 0~15 in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610afc19910 con 0x5610afbd9ee0 2024-09-12T17:29:47.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.121+0000 7f1922ba3640 1 -- 172.21.15.170:0/891664579 <== osd.3 v2:172.21.15.170:6816/2664906588 15 ==== osd_op_reply(67 system_akey [delete,create,writefull 0~15] v31'5 uv5 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f1914051070 con 0x5610afbd9ee0 2024-09-12T17:29:47.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.121+0000 7f19250b9800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-12T17:29:47.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.121+0000 7f19250b9800 10 moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-12T17:29:47.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.121+0000 7f19250b9800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-12T17:29:47.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.121+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify cookie 94629668165904 in=188b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5610afc1e770 con 0x5610afbd0a30 2024-09-12T17:29:47.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.122+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== watch-notify(notify (1) cookie 94629667929424 notify 133143986198 ret 0) ==== 218+0+0 (crc 0 0 0) 0x5610afc1a160 con 0x5610afbd0a30 2024-09-12T17:29:47.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.122+0000 7f1805ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986198 cookie 94629667929424 notifier 4841 bl.length()=176 2024-09-12T17:29:47.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.122+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(68 notify.1 [notify cookie 94629668165904 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f190c029040 con 0x5610afbd0a30 2024-09-12T17:29:47.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.122+0000 7f1805ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-12T17:29:47.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.122+0000 7f1805ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-12T17:29:47.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.122+0000 7f1805ffb640 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f1758003400 con 0x5610afbd0a30 2024-09-12T17:29:47.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.122+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(69 notify.1 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f190c029040 con 0x5610afbd0a30 2024-09-12T17:29:47.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.122+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== watch-notify(notify_complete (2) cookie 94629668165904 notify 133143986198 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5610afc196c0 con 0x5610afbd0a30 2024-09-12T17:29:47.146 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"system_user","display_name":"System User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"system_user","access_key":"system_akey","secret_key":"system_skey","active":true,"create_date":"2024-09-12T17:29:47.119913Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","system":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:29:47.119899Z","tags":[],"group_ids":[]} 2024-09-12T17:29:47.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.123+0000 7f17d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:47.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.123+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94629667948880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610afc18ca0 con 0x5610afbd0a30 2024-09-12T17:29:47.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.124+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94629667948880] v31'245 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f190c029040 con 0x5610afbd0a30 2024-09-12T17:29:47.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.124+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94629667925456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610afc18ca0 con 0x5610afbd5420 2024-09-12T17:29:47.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.125+0000 7f19233a4640 1 -- 172.21.15.170:0/891664579 <== osd.2 v2:172.21.15.170:6808/3855567754 18 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94629667925456] v31'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f191c067040 con 0x5610afbd5420 2024-09-12T17:29:47.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.125+0000 7f19250b9800 20 remove_watcher() i=0 2024-09-12T17:29:47.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.125+0000 7f19250b9800 2 removed watcher, disabling cache 2024-09-12T17:29:47.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.125+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94629667929424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610afc18ca0 con 0x5610afbd0a30 2024-09-12T17:29:47.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.126+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94629667929424] v31'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f190c029040 con 0x5610afbd0a30 2024-09-12T17:29:47.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.126+0000 7f19250b9800 20 remove_watcher() i=1 2024-09-12T17:29:47.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.126+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94629667930992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610afc18ca0 con 0x5610afbd9ee0 2024-09-12T17:29:47.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.127+0000 7f1922ba3640 1 -- 172.21.15.170:0/891664579 <== osd.3 v2:172.21.15.170:6816/2664906588 16 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94629667930992] v31'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1914051070 con 0x5610afbd9ee0 2024-09-12T17:29:47.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.127+0000 7f19250b9800 20 remove_watcher() i=2 2024-09-12T17:29:47.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.127+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94629667935760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610afc18ca0 con 0x5610afbd5420 2024-09-12T17:29:47.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.128+0000 7f19233a4640 1 -- 172.21.15.170:0/891664579 <== osd.2 v2:172.21.15.170:6808/3855567754 19 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94629667935760] v31'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f191c067040 con 0x5610afbd5420 2024-09-12T17:29:47.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.128+0000 7f19250b9800 20 remove_watcher() i=3 2024-09-12T17:29:47.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.128+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94629667939824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610afc18ca0 con 0x5610afbd0a30 2024-09-12T17:29:47.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.129+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94629667939824] v31'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f190c029040 con 0x5610afbd0a30 2024-09-12T17:29:47.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.129+0000 7f19250b9800 20 remove_watcher() i=4 2024-09-12T17:29:47.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.129+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94629667942464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610afc18ca0 con 0x7f191c04e940 2024-09-12T17:29:47.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.130+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94629667942464] v31'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f190c029040 con 0x7f191c04e940 2024-09-12T17:29:47.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.130+0000 7f19250b9800 20 remove_watcher() i=5 2024-09-12T17:29:47.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.130+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94629667946352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610afc18ca0 con 0x7f191c04e940 2024-09-12T17:29:47.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.131+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94629667946352] v31'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f190c029040 con 0x7f191c04e940 2024-09-12T17:29:47.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.131+0000 7f19250b9800 20 remove_watcher() i=6 2024-09-12T17:29:47.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.131+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94629667937328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610afc18ca0 con 0x7f191c04e940 2024-09-12T17:29:47.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.132+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94629667937328] v31'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f190c029040 con 0x7f191c04e940 2024-09-12T17:29:47.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.132+0000 7f19250b9800 20 remove_watcher() i=7 2024-09-12T17:29:47.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.132+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f191c04e940 msgr2=0x7f191c0123d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.132+0000 7f19250b9800 1 --2- 172.21.15.170:0/891664579 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f191c04e940 0x7f191c0123d0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.132+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5610afbd0a30 msgr2=0x5610afbd2ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.132+0000 7f19250b9800 1 --2- 172.21.15.170:0/891664579 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5610afbd0a30 0x5610afbd2ef0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.132+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5610afbd5420 msgr2=0x5610afbd7810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.132+0000 7f19250b9800 1 --2- 172.21.15.170:0/891664579 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5610afbd5420 0x5610afbd7810 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.132+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5610afbd9ee0 msgr2=0x5610afbdc3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.132+0000 7f19250b9800 1 --2- 172.21.15.170:0/891664579 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5610afbd9ee0 0x5610afbdc3a0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.132+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f17ec03c730 msgr2=0x7f17ec03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.132+0000 7f19250b9800 1 --2- 172.21.15.170:0/891664579 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f17ec03c730 0x7f17ec03ebf0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f191405dac0 tx=0x7f1914089000 comp rx=0 tx=0).stop 2024-09-12T17:29:47.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.132+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5610afbbdb70 msgr2=0x5610afbc5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.132+0000 7f191bfff640 1 -- 172.21.15.170:0/891664579 reap_dead start 2024-09-12T17:29:47.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.132+0000 7f19250b9800 1 --2- 172.21.15.170:0/891664579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5610afbbdb70 0x5610afbc5160 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f191c0208e0 tx=0x7f191c053cf0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.133+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 shutdown_connections 2024-09-12T17:29:47.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.133+0000 7f19250b9800 1 --2- 172.21.15.170:0/891664579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5610afbbdb70 0x5610afbc5160 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.133+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 >> 172.21.15.170:0/891664579 conn(0x5610afbb9f70 msgr2=0x5610afbb8180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:47.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.133+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 shutdown_connections 2024-09-12T17:29:47.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.133+0000 7f19250b9800 1 -- 172.21.15.170:0/891664579 wait complete. 2024-09-12T17:29:47.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.133+0000 7f19250b9800 1 -- 172.21.15.170:0/1884272788 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f17fc03c730 msgr2=0x7f17fc03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.133+0000 7f19250b9800 1 --2- 172.21.15.170:0/1884272788 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f17fc03c730 0x7f17fc03ebf0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x5610afb982a0 tx=0x7f1914045e60 comp rx=0 tx=0).stop 2024-09-12T17:29:47.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.133+0000 7f19250b9800 1 -- 172.21.15.170:0/1884272788 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5610afbb1050 msgr2=0x5610afbb1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.133+0000 7f19250b9800 1 --2- 172.21.15.170:0/1884272788 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5610afbb1050 0x5610afbb1470 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x5610afb96f20 tx=0x7f191c0167b0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.133+0000 7f19250b9800 1 -- 172.21.15.170:0/1884272788 shutdown_connections 2024-09-12T17:29:47.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.133+0000 7f19250b9800 1 --2- 172.21.15.170:0/1884272788 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f17fc03c730 0x7f17fc03ebf0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.133+0000 7f19250b9800 1 --2- 172.21.15.170:0/1884272788 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5610afbb1050 0x5610afbb1470 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.133+0000 7f19250b9800 1 -- 172.21.15.170:0/1884272788 >> 172.21.15.170:0/1884272788 conn(0x5610afba5400 msgr2=0x5610afba57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:47.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.133+0000 7f19250b9800 1 -- 172.21.15.170:0/1884272788 shutdown_connections 2024-09-12T17:29:47.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.133+0000 7f19250b9800 1 -- 172.21.15.170:0/1884272788 wait complete. 2024-09-12T17:29:47.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.133+0000 7f19250b9800 1 -- 172.21.15.170:0/963828398 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5610afaa0070 msgr2=0x5610afb9d810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.133+0000 7f19250b9800 1 --2- 172.21.15.170:0/963828398 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5610afaa0070 0x5610afb9d810 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.133+0000 7f19250b9800 1 -- 172.21.15.170:0/963828398 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5610afb9fbb0 msgr2=0x5610afba2030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.133+0000 7f19250b9800 1 --2- 172.21.15.170:0/963828398 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5610afb9fbb0 0x5610afba2030 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.133+0000 7f19250b9800 1 -- 172.21.15.170:0/963828398 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f180803c780 msgr2=0x7f180803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.133+0000 7f19250b9800 1 --2- 172.21.15.170:0/963828398 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f180803c780 0x7f180803ec40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f190c004170 tx=0x7f190c001330 comp rx=0 tx=0).stop 2024-09-12T17:29:47.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.133+0000 7f19250b9800 1 -- 172.21.15.170:0/963828398 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5610afa9d6e0 msgr2=0x5610afb96210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.133+0000 7f19250b9800 1 --2- 172.21.15.170:0/963828398 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5610afa9d6e0 0x5610afb96210 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f1914025c20 tx=0x7f1914002fb0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.133+0000 7f19250b9800 1 -- 172.21.15.170:0/963828398 shutdown_connections 2024-09-12T17:29:47.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.133+0000 7f19250b9800 1 --2- 172.21.15.170:0/963828398 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5610afb9fbb0 0x5610afba2030 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.133+0000 7f19250b9800 1 --2- 172.21.15.170:0/963828398 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f180803c780 0x7f180803ec40 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.133+0000 7f19250b9800 1 --2- 172.21.15.170:0/963828398 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5610afaa0070 0x5610afb9d810 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.133+0000 7f19250b9800 1 --2- 172.21.15.170:0/963828398 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5610afa9d6e0 0x5610afb96210 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.134+0000 7f19250b9800 1 -- 172.21.15.170:0/963828398 >> 172.21.15.170:0/963828398 conn(0x5610afa97220 msgr2=0x5610afb87c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:47.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.134+0000 7f19250b9800 1 -- 172.21.15.170:0/963828398 shutdown_connections 2024-09-12T17:29:47.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.134+0000 7f19250b9800 1 -- 172.21.15.170:0/963828398 wait complete. 2024-09-12T17:29:47.160 DEBUG:tasks.util.rgw: json result: {'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-12T17:29:47.119913Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:29:47.119899Z', 'tags': [], 'group_ids': []} 2024-09-12T17:29:47.160 ERROR:root:{'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-12T17:29:47.119913Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:29:47.119899Z', 'tags': [], 'group_ids': []} 2024-09-12T17:29:47.160 ERROR:root:0 2024-09-12T17:29:47.161 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T17:29:47.165 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:29:47.166 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'system_user'] 2024-09-12T17:29:47.166 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'system_user'] 2024-09-12T17:29:47.166 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid system_user 2024-09-12T17:29:47.212 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:29:47.212 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:29:47.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.211+0000 7f5c82925800 1 Processor -- start 2024-09-12T17:29:47.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.212+0000 7f5c82925800 1 -- start start 2024-09-12T17:29:47.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.212+0000 7f5c82925800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x557e9d764fb0 0x557e9d76dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.212+0000 7f5c82925800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557e9d60ee40 con 0x557e9d763490 2024-09-12T17:29:47.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.212+0000 7f5c82925800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x557e9d5d9680 con 0x557e9d764fb0 2024-09-12T17:29:47.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.212+0000 7f5c7dd32640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x557e9d764fb0 0x557e9d76dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.212+0000 7f5c7e533640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x557e9d763490 0x557e9d763890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:44888/0 (socket says 172.21.15.170:44888) 2024-09-12T17:29:47.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.212+0000 7f5c7e533640 1 -- 172.21.15.170:0/4158523842 learned_addr learned my addr 172.21.15.170:0/4158523842 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:29:47.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.212+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4158523842 >> v1:172.21.15.47:6789/0 conn(0x557e9d763490 legacy=0x557e9d763890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.212+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4158523842 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e9d5f56b0 con 0x557e9d764fb0 2024-09-12T17:29:47.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.214+0000 7f5c7dd32640 1 --2- 172.21.15.170:0/4158523842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557e9d764fb0 0x557e9d76dad0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f5c7400a470 tx=0x7f5c74045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79c1abefccf94883 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.214+0000 7f5c7d531640 1 -- 172.21.15.170:0/4158523842 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c74053570 con 0x557e9d764fb0 2024-09-12T17:29:47.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.214+0000 7f5c7d531640 1 -- 172.21.15.170:0/4158523842 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c74058070 con 0x557e9d764fb0 2024-09-12T17:29:47.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.214+0000 7f5c7d531640 1 -- 172.21.15.170:0/4158523842 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c74053880 con 0x557e9d764fb0 2024-09-12T17:29:47.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.215+0000 7f5c82925800 1 -- 172.21.15.170:0/4158523842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557e9d764fb0 msgr2=0x557e9d76dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.215+0000 7f5c82925800 1 --2- 172.21.15.170:0/4158523842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557e9d764fb0 0x557e9d76dad0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f5c7400a470 tx=0x7f5c74045a20 comp rx=0 tx=0).stop 2024-09-12T17:29:47.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.215+0000 7f5c82925800 1 -- 172.21.15.170:0/4158523842 shutdown_connections 2024-09-12T17:29:47.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.215+0000 7f5c82925800 1 --2- 172.21.15.170:0/4158523842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557e9d764fb0 0x557e9d76dad0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.215+0000 7f5c82925800 1 -- 172.21.15.170:0/4158523842 >> 172.21.15.170:0/4158523842 conn(0x557e9d75f1c0 msgr2=0x557e9d761620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:47.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.215+0000 7f5c82925800 1 -- 172.21.15.170:0/4158523842 shutdown_connections 2024-09-12T17:29:47.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.215+0000 7f5c82925800 1 -- 172.21.15.170:0/4158523842 wait complete. 2024-09-12T17:29:47.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.229+0000 7f5c82925800 1 Processor -- start 2024-09-12T17:29:47.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.229+0000 7f5c82925800 1 -- start start 2024-09-12T17:29:47.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.229+0000 7f5c82925800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557e9d763490 0x557e9d856860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.229+0000 7f5c82925800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557e9d5fddd0 con 0x557e9d763490 2024-09-12T17:29:47.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.229+0000 7f5c7e533640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557e9d763490 0x557e9d856860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.229+0000 7f5c7e533640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557e9d763490 0x557e9d856860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34982/0 (socket says 172.21.15.170:34982) 2024-09-12T17:29:47.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.229+0000 7f5c7e533640 1 -- 172.21.15.170:0/859964759 learned_addr learned my addr 172.21.15.170:0/859964759 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:47.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.230+0000 7f5c7e533640 1 -- 172.21.15.170:0/859964759 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e9d616e10 con 0x557e9d763490 2024-09-12T17:29:47.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.230+0000 7f5c7e533640 1 --2- 172.21.15.170:0/859964759 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557e9d763490 0x557e9d856860 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f5c70001e40 tx=0x7f5c70001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1729bdd30e343167 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.230+0000 7f5b6c608640 1 -- 172.21.15.170:0/859964759 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c70012020 con 0x557e9d763490 2024-09-12T17:29:47.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.230+0000 7f5b6c608640 1 -- 172.21.15.170:0/859964759 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c7000e5a0 con 0x557e9d763490 2024-09-12T17:29:47.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.230+0000 7f5b6c608640 1 -- 172.21.15.170:0/859964759 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c7000e8a0 con 0x557e9d763490 2024-09-12T17:29:47.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.231+0000 7f5c82925800 1 -- 172.21.15.170:0/859964759 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557e9d763490 msgr2=0x557e9d856860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.231+0000 7f5c82925800 1 --2- 172.21.15.170:0/859964759 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557e9d763490 0x557e9d856860 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f5c70001e40 tx=0x7f5c70001e70 comp rx=0 tx=0).stop 2024-09-12T17:29:47.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.231+0000 7f5c82925800 1 -- 172.21.15.170:0/859964759 shutdown_connections 2024-09-12T17:29:47.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.231+0000 7f5c82925800 1 --2- 172.21.15.170:0/859964759 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557e9d763490 0x557e9d856860 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.231+0000 7f5c82925800 1 -- 172.21.15.170:0/859964759 >> 172.21.15.170:0/859964759 conn(0x557e9d75f1c0 msgr2=0x557e9d8521e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:47.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.231+0000 7f5c82925800 1 -- 172.21.15.170:0/859964759 shutdown_connections 2024-09-12T17:29:47.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.231+0000 7f5c82925800 1 -- 172.21.15.170:0/859964759 wait complete. 2024-09-12T17:29:47.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.231+0000 7f5c82925800 1 Processor -- start 2024-09-12T17:29:47.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.231+0000 7f5c82925800 1 -- start start 2024-09-12T17:29:47.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.231+0000 7f5c82925800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557e9d763490 0x557e9d85e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.231+0000 7f5c82925800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557e9d76e2e0 con 0x557e9d763490 2024-09-12T17:29:47.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.231+0000 7f5c7e533640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557e9d763490 0x557e9d85e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.231+0000 7f5c7e533640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557e9d763490 0x557e9d85e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:34998/0 (socket says 172.21.15.170:34998) 2024-09-12T17:29:47.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.231+0000 7f5c7e533640 1 -- 172.21.15.170:0/1638251620 learned_addr learned my addr 172.21.15.170:0/1638251620 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:47.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.232+0000 7f5c7e533640 1 -- 172.21.15.170:0/1638251620 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e9d85e710 con 0x557e9d763490 2024-09-12T17:29:47.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.232+0000 7f5c7e533640 1 --2- 172.21.15.170:0/1638251620 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557e9d763490 0x557e9d85e1b0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f5c700012b0 tx=0x7f5c70000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.232+0000 7f5b6ae05640 1 -- 172.21.15.170:0/1638251620 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c70012030 con 0x557e9d763490 2024-09-12T17:29:47.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.232+0000 7f5b6ae05640 1 -- 172.21.15.170:0/1638251620 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c7001a750 con 0x557e9d763490 2024-09-12T17:29:47.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.232+0000 7f5c82925800 1 -- 172.21.15.170:0/1638251620 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557e9d85e9a0 con 0x557e9d763490 2024-09-12T17:29:47.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.232+0000 7f5b6ae05640 1 -- 172.21.15.170:0/1638251620 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c7001aa70 con 0x557e9d763490 2024-09-12T17:29:47.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.232+0000 7f5c82925800 1 -- 172.21.15.170:0/1638251620 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e9d85f3a0 con 0x557e9d763490 2024-09-12T17:29:47.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.233+0000 7f5b6ae05640 1 -- 172.21.15.170:0/1638251620 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f5c70015020 con 0x557e9d763490 2024-09-12T17:29:47.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.233+0000 7f5b6ae05640 1 --2- 172.21.15.170:0/1638251620 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5b6403c730 0x7f5b6403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.233+0000 7f5b6ae05640 1 -- 172.21.15.170:0/1638251620 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f5c70020030 con 0x557e9d763490 2024-09-12T17:29:47.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.233+0000 7f5c7dd32640 1 --2- 172.21.15.170:0/1638251620 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5b6403c730 0x7f5b6403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.233+0000 7f5c82925800 1 --2- 172.21.15.170:0/1638251620 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x557e9d764fb0 0x557e9d865800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.233+0000 7f5c82925800 1 -- 172.21.15.170:0/1638251620 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557e9d85ff60 con 0x557e9d764fb0 2024-09-12T17:29:47.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.233+0000 7f5c7ed34640 1 --2- 172.21.15.170:0/1638251620 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x557e9d764fb0 0x557e9d865800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.234+0000 7f5c7dd32640 1 --2- 172.21.15.170:0/1638251620 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5b6403c730 0x7f5b6403ebf0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5c74057000 tx=0x7f5c74052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.234+0000 7f5c7ed34640 1 --2- 172.21.15.170:0/1638251620 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x557e9d764fb0 0x557e9d865800 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.234+0000 7f5c7ed34640 1 -- 172.21.15.170:0/1638251620 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5c7800a4d0 con 0x557e9d764fb0 2024-09-12T17:29:47.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.234+0000 7f5c82925800 1 -- 172.21.15.170:0/1638251620 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557e9d85f850 con 0x557e9d764fb0 2024-09-12T17:29:47.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.234+0000 7f5c7ed34640 1 -- 172.21.15.170:0/1638251620 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5c7800a4d0 con 0x557e9d764fb0 2024-09-12T17:29:47.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.234+0000 7f5c82925800 1 --2- 172.21.15.170:0/1638251620 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x557e9d867cd0 0x557e9d86a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.234+0000 7f5c82925800 1 -- 172.21.15.170:0/1638251620 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557e9d86a790 con 0x557e9d867cd0 2024-09-12T17:29:47.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.234+0000 7f5c7e533640 1 --2- 172.21.15.170:0/1638251620 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x557e9d867cd0 0x557e9d86a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.235+0000 7f5c7e533640 1 --2- 172.21.15.170:0/1638251620 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x557e9d867cd0 0x557e9d86a0c0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.235+0000 7f5c7e533640 1 -- 172.21.15.170:0/1638251620 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5c70018ce0 con 0x557e9d867cd0 2024-09-12T17:29:47.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.235+0000 7f5c82925800 1 -- 172.21.15.170:0/1638251620 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557e9d866b70 con 0x557e9d764fb0 2024-09-12T17:29:47.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.235+0000 7f5c7ed34640 1 -- 172.21.15.170:0/1638251620 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5c7800a4d0 con 0x557e9d764fb0 2024-09-12T17:29:47.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.235+0000 7f5c82925800 1 -- 172.21.15.170:0/1638251620 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557e9d867010 con 0x557e9d867cd0 2024-09-12T17:29:47.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.236+0000 7f5c7e533640 1 -- 172.21.15.170:0/1638251620 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5c70018ce0 con 0x557e9d867cd0 2024-09-12T17:29:47.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.236+0000 7f5c82925800 1 Processor -- start 2024-09-12T17:29:47.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.236+0000 7f5c82925800 1 -- start start 2024-09-12T17:29:47.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.236+0000 7f5c82925800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557e9d879040 0x557e9d879460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.236+0000 7f5c82925800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557e9d65ba00 con 0x557e9d879040 2024-09-12T17:29:47.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.236+0000 7f5c7ed34640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557e9d879040 0x557e9d879460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.236+0000 7f5c7ed34640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557e9d879040 0x557e9d879460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35008/0 (socket says 172.21.15.170:35008) 2024-09-12T17:29:47.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.236+0000 7f5c7ed34640 1 -- 172.21.15.170:0/834530463 learned_addr learned my addr 172.21.15.170:0/834530463 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:47.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.237+0000 7f5c7ed34640 1 -- 172.21.15.170:0/834530463 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e9d879aa0 con 0x557e9d879040 2024-09-12T17:29:47.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.237+0000 7f5c7ed34640 1 --2- 172.21.15.170:0/834530463 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557e9d879040 0x557e9d879460 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x557e9d85f040 tx=0x7f5c780167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.237+0000 7f5b63fff640 1 -- 172.21.15.170:0/834530463 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c78013640 con 0x557e9d879040 2024-09-12T17:29:47.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.237+0000 7f5b63fff640 1 -- 172.21.15.170:0/834530463 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c780137e0 con 0x557e9d879040 2024-09-12T17:29:47.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.237+0000 7f5c82925800 1 -- 172.21.15.170:0/834530463 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557e9d87a2d0 con 0x557e9d879040 2024-09-12T17:29:47.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.237+0000 7f5b63fff640 1 -- 172.21.15.170:0/834530463 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c78013ac0 con 0x557e9d879040 2024-09-12T17:29:47.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.237+0000 7f5c82925800 1 -- 172.21.15.170:0/834530463 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e9d87a870 con 0x557e9d879040 2024-09-12T17:29:47.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.238+0000 7f5b63fff640 1 -- 172.21.15.170:0/834530463 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f5c78011040 con 0x557e9d879040 2024-09-12T17:29:47.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.238+0000 7f5b63fff640 1 --2- 172.21.15.170:0/834530463 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5b5803c730 0x7f5b5803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.238+0000 7f5b63fff640 1 -- 172.21.15.170:0/834530463 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f5c7800e040 con 0x557e9d879040 2024-09-12T17:29:47.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.238+0000 7f5c7e533640 1 --2- 172.21.15.170:0/834530463 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5b5803c730 0x7f5b5803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.238+0000 7f5c82925800 1 Processor -- start 2024-09-12T17:29:47.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.238+0000 7f5c82925800 1 -- start start 2024-09-12T17:29:47.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.238+0000 7f5c7e533640 1 --2- 172.21.15.170:0/834530463 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5b5803c730 0x7f5b5803ebf0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5c700520e0 tx=0x7f5c7002df10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.239+0000 7f5c82925800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557e9d885b00 0x557e9d885f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.239+0000 7f5c82925800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557e9d8570b0 con 0x557e9d885b00 2024-09-12T17:29:47.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.239+0000 7f5c7ed34640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557e9d885b00 0x557e9d885f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.239+0000 7f5c7ed34640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557e9d885b00 0x557e9d885f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35016/0 (socket says 172.21.15.170:35016) 2024-09-12T17:29:47.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.239+0000 7f5c7ed34640 1 -- 172.21.15.170:0/3481242657 learned_addr learned my addr 172.21.15.170:0/3481242657 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:47.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.239+0000 7f5c7ed34640 1 -- 172.21.15.170:0/3481242657 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e9d8864f0 con 0x557e9d885b00 2024-09-12T17:29:47.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.239+0000 7f5c7ed34640 1 --2- 172.21.15.170:0/3481242657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557e9d885b00 0x557e9d885f00 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f5c78020000 tx=0x7f5c78013f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64e5f4f3d6d318a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.239+0000 7f5b61ffb640 1 -- 172.21.15.170:0/3481242657 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c78052070 con 0x557e9d885b00 2024-09-12T17:29:47.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.239+0000 7f5b61ffb640 1 -- 172.21.15.170:0/3481242657 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c7804a020 con 0x557e9d885b00 2024-09-12T17:29:47.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.239+0000 7f5b61ffb640 1 -- 172.21.15.170:0/3481242657 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c78055040 con 0x557e9d885b00 2024-09-12T17:29:47.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.240+0000 7f5c82925800 1 -- 172.21.15.170:0/3481242657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557e9d885b00 msgr2=0x557e9d885f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.240+0000 7f5c82925800 1 --2- 172.21.15.170:0/3481242657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557e9d885b00 0x557e9d885f00 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f5c78020000 tx=0x7f5c78013f00 comp rx=0 tx=0).stop 2024-09-12T17:29:47.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.240+0000 7f5c82925800 1 -- 172.21.15.170:0/3481242657 shutdown_connections 2024-09-12T17:29:47.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.240+0000 7f5c82925800 1 --2- 172.21.15.170:0/3481242657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557e9d885b00 0x557e9d885f00 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.240+0000 7f5c82925800 1 -- 172.21.15.170:0/3481242657 >> 172.21.15.170:0/3481242657 conn(0x557e9d881f00 msgr2=0x557e9d880140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:47.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.240+0000 7f5c82925800 1 -- 172.21.15.170:0/3481242657 shutdown_connections 2024-09-12T17:29:47.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.240+0000 7f5c82925800 1 -- 172.21.15.170:0/3481242657 wait complete. 2024-09-12T17:29:47.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.240+0000 7f5c82925800 1 Processor -- start 2024-09-12T17:29:47.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.240+0000 7f5c82925800 1 -- start start 2024-09-12T17:29:47.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.240+0000 7f5c82925800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557e9d885b00 0x557e9d88d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.240+0000 7f5c82925800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557e9d886b10 con 0x557e9d885b00 2024-09-12T17:29:47.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.241+0000 7f5c7ed34640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557e9d885b00 0x557e9d88d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.241+0000 7f5c7ed34640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557e9d885b00 0x557e9d88d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35028/0 (socket says 172.21.15.170:35028) 2024-09-12T17:29:47.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.241+0000 7f5c7ed34640 1 -- 172.21.15.170:0/4135034145 learned_addr learned my addr 172.21.15.170:0/4135034145 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:47.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.241+0000 7f5c7ed34640 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e9d88d660 con 0x557e9d885b00 2024-09-12T17:29:47.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.241+0000 7f5c7ed34640 1 --2- 172.21.15.170:0/4135034145 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557e9d885b00 0x557e9d88d100 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f5c780208e0 tx=0x7f5c78053d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.241+0000 7f5b4ffff640 1 -- 172.21.15.170:0/4135034145 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c78037070 con 0x557e9d885b00 2024-09-12T17:29:47.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.241+0000 7f5b4ffff640 1 -- 172.21.15.170:0/4135034145 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c7801f500 con 0x557e9d885b00 2024-09-12T17:29:47.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.241+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557e9d88d8f0 con 0x557e9d885b00 2024-09-12T17:29:47.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.241+0000 7f5b4ffff640 1 -- 172.21.15.170:0/4135034145 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c7801f7e0 con 0x557e9d885b00 2024-09-12T17:29:47.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.241+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e9d88e270 con 0x557e9d885b00 2024-09-12T17:29:47.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.242+0000 7f5b4ffff640 1 -- 172.21.15.170:0/4135034145 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f5c7803a070 con 0x557e9d885b00 2024-09-12T17:29:47.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.242+0000 7f5b4ffff640 1 --2- 172.21.15.170:0/4135034145 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5b4803c6e0 0x7f5b4803eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.242+0000 7f5b4ffff640 1 -- 172.21.15.170:0/4135034145 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f5c7804b070 con 0x557e9d885b00 2024-09-12T17:29:47.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.242+0000 7f5c7e533640 1 --2- 172.21.15.170:0/4135034145 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5b4803c6e0 0x7f5b4803eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.243+0000 7f5c7e533640 1 --2- 172.21.15.170:0/4135034145 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5b4803c6e0 0x7f5b4803eba0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5c70018f90 tx=0x7f5c70034000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.243+0000 7f5c82925800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.243+0000 7f5c82925800 1 --2- 172.21.15.170:0/4135034145 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x557e9d8989f0 0x557e9d89aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.243+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557e9d89b600 con 0x557e9d8989f0 2024-09-12T17:29:47.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.243+0000 7f5c7dd32640 1 --2- 172.21.15.170:0/4135034145 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x557e9d8989f0 0x557e9d89aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.243+0000 7f5c7dd32640 1 --2- 172.21.15.170:0/4135034145 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x557e9d8989f0 0x557e9d89aeb0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.244+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5c74051070 con 0x557e9d8989f0 2024-09-12T17:29:47.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.244+0000 7f5c82925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.244+0000 7f5c82925800 20 realm 2024-09-12T17:29:47.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.244+0000 7f5c82925800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.244+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557e9d89ba30 con 0x557e9d8989f0 2024-09-12T17:29:47.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.244+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5c74051070 con 0x557e9d8989f0 2024-09-12T17:29:47.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.244+0000 7f5c82925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.244+0000 7f5c82925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:29:47.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.244+0000 7f5c82925800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.244+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557e9d89c300 con 0x557e9d8989f0 2024-09-12T17:29:47.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.244+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5c74051070 con 0x557e9d8989f0 2024-09-12T17:29:47.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.244+0000 7f5c82925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.244+0000 7f5c82925800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.244+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557e9d89c6a0 con 0x557e9d8989f0 2024-09-12T17:29:47.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.244+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5c74051070 con 0x557e9d8989f0 2024-09-12T17:29:47.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.244+0000 7f5c82925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:47.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.244+0000 7f5c82925800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.244+0000 7f5c82925800 1 --2- 172.21.15.170:0/4135034145 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x557e9d89d400 0x557e9d89f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.244+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557e9d89fe00 con 0x557e9d89d400 2024-09-12T17:29:47.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.244+0000 7f5c7ed34640 1 --2- 172.21.15.170:0/4135034145 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x557e9d89d400 0x557e9d89f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.245+0000 7f5c7ed34640 1 --2- 172.21.15.170:0/4135034145 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x557e9d89d400 0x557e9d89f7f0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.245+0000 7f5c7ed34640 1 -- 172.21.15.170:0/4135034145 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5c78039030 con 0x557e9d89d400 2024-09-12T17:29:47.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.245+0000 7f5c82925800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:29:47.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.245+0000 7f5c82925800 20 searching for the correct realm 2024-09-12T17:29:47.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.245+0000 7f5c82925800 1 --2- 172.21.15.170:0/4135034145 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x557e9d8a1db0 0x557e9d8a4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.245+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a48f0 con 0x557e9d8a1db0 2024-09-12T17:29:47.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.245+0000 7f5c7e533640 1 --2- 172.21.15.170:0/4135034145 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x557e9d8a1db0 0x557e9d8a4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.245+0000 7f5c7e533640 1 --2- 172.21.15.170:0/4135034145 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x557e9d8a1db0 0x557e9d8a4270 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.246+0000 7f5c7e533640 1 -- 172.21.15.170:0/4135034145 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c70055d70 con 0x557e9d8a1db0 2024-09-12T17:29:47.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.246+0000 7f5c7e533640 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a48f0 con 0x557e9d89d400 2024-09-12T17:29:47.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.246+0000 7f5c7ed34640 1 -- 172.21.15.170:0/4135034145 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c78039030 con 0x557e9d89d400 2024-09-12T17:29:47.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.246+0000 7f5c7ed34640 1 --2- 172.21.15.170:0/4135034145 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f5c7803c060 0x7f5c7803b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.246+0000 7f5c7ed34640 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a48f0 con 0x7f5c7803c060 2024-09-12T17:29:47.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.246+0000 7f5c7dd32640 1 --2- 172.21.15.170:0/4135034145 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f5c7803c060 0x7f5c7803b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.246+0000 7f5c7dd32640 1 --2- 172.21.15.170:0/4135034145 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f5c7803c060 0x7f5c7803b3b0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.247+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c74051070 con 0x7f5c7803c060 2024-09-12T17:29:47.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.247+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a48f0 con 0x557e9d8989f0 2024-09-12T17:29:47.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.247+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c74051070 con 0x557e9d8989f0 2024-09-12T17:29:47.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.247+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a48f0 con 0x557e9d8989f0 2024-09-12T17:29:47.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.247+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c74051070 con 0x557e9d8989f0 2024-09-12T17:29:47.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.247+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a48f0 con 0x7f5c7803c060 2024-09-12T17:29:47.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.247+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c74051070 con 0x7f5c7803c060 2024-09-12T17:29:47.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.247+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a48f0 con 0x7f5c7803c060 2024-09-12T17:29:47.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.248+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c74051070 con 0x7f5c7803c060 2024-09-12T17:29:47.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.248+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a48f0 con 0x557e9d89d400 2024-09-12T17:29:47.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.248+0000 7f5c7ed34640 1 -- 172.21.15.170:0/4135034145 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c78060040 con 0x557e9d89d400 2024-09-12T17:29:47.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.248+0000 7f5c7ed34640 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a48f0 con 0x557e9d8a1db0 2024-09-12T17:29:47.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.248+0000 7f5c7e533640 1 -- 172.21.15.170:0/4135034145 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c70055d70 con 0x557e9d8a1db0 2024-09-12T17:29:47.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.248+0000 7f5c7e533640 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a48f0 con 0x557e9d8989f0 2024-09-12T17:29:47.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.249+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c74051070 con 0x557e9d8989f0 2024-09-12T17:29:47.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.249+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a48f0 con 0x7f5c7803c060 2024-09-12T17:29:47.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.249+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c74051070 con 0x7f5c7803c060 2024-09-12T17:29:47.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.249+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a48f0 con 0x557e9d8989f0 2024-09-12T17:29:47.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.249+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c74051070 con 0x557e9d8989f0 2024-09-12T17:29:47.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.249+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a48f0 con 0x557e9d89d400 2024-09-12T17:29:47.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.249+0000 7f5c7ed34640 1 -- 172.21.15.170:0/4135034145 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f5c78060040 con 0x557e9d89d400 2024-09-12T17:29:47.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.249+0000 7f5c7ed34640 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a48f0 con 0x557e9d8a1db0 2024-09-12T17:29:47.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.250+0000 7f5c7e533640 1 -- 172.21.15.170:0/4135034145 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c70055d70 con 0x557e9d8a1db0 2024-09-12T17:29:47.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.250+0000 7f5c7e533640 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a48f0 con 0x557e9d8a1db0 2024-09-12T17:29:47.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.250+0000 7f5c7e533640 1 -- 172.21.15.170:0/4135034145 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c70055d70 con 0x557e9d8a1db0 2024-09-12T17:29:47.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.250+0000 7f5c7e533640 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a48f0 con 0x557e9d89d400 2024-09-12T17:29:47.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.250+0000 7f5c7ed34640 1 -- 172.21.15.170:0/4135034145 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c78060040 con 0x557e9d89d400 2024-09-12T17:29:47.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.250+0000 7f5c7ed34640 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a48f0 con 0x557e9d8a1db0 2024-09-12T17:29:47.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.250+0000 7f5c7e533640 1 -- 172.21.15.170:0/4135034145 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c70055d70 con 0x557e9d8a1db0 2024-09-12T17:29:47.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.250+0000 7f5c7e533640 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a48f0 con 0x557e9d8a1db0 2024-09-12T17:29:47.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.250+0000 7f5c7e533640 1 -- 172.21.15.170:0/4135034145 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c70055d70 con 0x557e9d8a1db0 2024-09-12T17:29:47.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.250+0000 7f5c7e533640 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a48f0 con 0x557e9d8989f0 2024-09-12T17:29:47.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.251+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c74051070 con 0x557e9d8989f0 2024-09-12T17:29:47.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.251+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a48f0 con 0x557e9d8989f0 2024-09-12T17:29:47.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.251+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v31'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5c74051070 con 0x557e9d8989f0 2024-09-12T17:29:47.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.251+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a48f0 con 0x7f5c7803c060 2024-09-12T17:29:47.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.251+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c74051070 con 0x7f5c7803c060 2024-09-12T17:29:47.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.251+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a48f0 con 0x557e9d8a1db0 2024-09-12T17:29:47.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.251+0000 7f5c7e533640 1 -- 172.21.15.170:0/4135034145 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c70055d70 con 0x557e9d8a1db0 2024-09-12T17:29:47.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.251+0000 7f5c7e533640 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a48f0 con 0x557e9d89d400 2024-09-12T17:29:47.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.252+0000 7f5c7ed34640 1 -- 172.21.15.170:0/4135034145 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c78060040 con 0x557e9d89d400 2024-09-12T17:29:47.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.252+0000 7f5c7ed34640 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a48f0 con 0x557e9d8989f0 2024-09-12T17:29:47.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.252+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c74051070 con 0x557e9d8989f0 2024-09-12T17:29:47.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.252+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a48f0 con 0x7f5c7803c060 2024-09-12T17:29:47.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.252+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c74051070 con 0x7f5c7803c060 2024-09-12T17:29:47.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.252+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a48f0 con 0x557e9d8a1db0 2024-09-12T17:29:47.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.252+0000 7f5c7e533640 1 -- 172.21.15.170:0/4135034145 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c70055d70 con 0x557e9d8a1db0 2024-09-12T17:29:47.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.252+0000 7f5c7e533640 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a48f0 con 0x7f5c7803c060 2024-09-12T17:29:47.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.253+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c74051070 con 0x7f5c7803c060 2024-09-12T17:29:47.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.253+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a48f0 con 0x557e9d89d400 2024-09-12T17:29:47.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.253+0000 7f5c7ed34640 1 -- 172.21.15.170:0/4135034145 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c78060040 con 0x557e9d89d400 2024-09-12T17:29:47.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.253+0000 7f5c7ed34640 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a48f0 con 0x557e9d8a1db0 2024-09-12T17:29:47.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.253+0000 7f5c7e533640 1 -- 172.21.15.170:0/4135034145 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c70055d70 con 0x557e9d8a1db0 2024-09-12T17:29:47.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.253+0000 7f5c7e533640 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a48f0 con 0x7f5c7803c060 2024-09-12T17:29:47.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.254+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c74051070 con 0x7f5c7803c060 2024-09-12T17:29:47.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.254+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a48f0 con 0x557e9d8989f0 2024-09-12T17:29:47.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.254+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5c74051070 con 0x557e9d8989f0 2024-09-12T17:29:47.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.254+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a48f0 con 0x557e9d89d400 2024-09-12T17:29:47.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.254+0000 7f5c7ed34640 1 -- 172.21.15.170:0/4135034145 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(37 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5c78060040 con 0x557e9d89d400 2024-09-12T17:29:47.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.254+0000 7f5c82925800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:29:47.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.254+0000 7f5c82925800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:29:47.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.254+0000 7f5c82925800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:29:47.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.254+0000 7f5c82925800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:29:47.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.254+0000 7f5c82925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:29:47.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.254+0000 7f5c82925800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:29:47.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.254+0000 7f5c82925800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.254+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a07c0 con 0x557e9d8989f0 2024-09-12T17:29:47.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.254+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5c74051070 con 0x557e9d8989f0 2024-09-12T17:29:47.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.254+0000 7f5c82925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.254+0000 7f5c82925800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.254+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a0400 con 0x557e9d8989f0 2024-09-12T17:29:47.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.254+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5c74051070 con 0x557e9d8989f0 2024-09-12T17:29:47.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.254+0000 7f5c82925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:47.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.254+0000 7f5c82925800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.254+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a0c00 con 0x557e9d89d400 2024-09-12T17:29:47.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.255+0000 7f5c7ed34640 1 -- 172.21.15.170:0/4135034145 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5c78060040 con 0x557e9d89d400 2024-09-12T17:29:47.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.255+0000 7f5c82925800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:29:47.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.255+0000 7f5c82925800 20 zone default found 2024-09-12T17:29:47.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.255+0000 7f5c82925800 4 Realm: () 2024-09-12T17:29:47.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.255+0000 7f5c82925800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:29:47.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.255+0000 7f5c82925800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:29:47.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.255+0000 7f5c82925800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:29:47.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.255+0000 7f5c82925800 20 zonegroup default 2024-09-12T17:29:47.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.255+0000 7f5c82925800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.255+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a5220 con 0x7f5c7803c060 2024-09-12T17:29:47.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.255+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5c74051070 con 0x7f5c7803c060 2024-09-12T17:29:47.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.255+0000 7f5c82925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.255+0000 7f5c82925800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.255+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a7460 con 0x557e9d8a1db0 2024-09-12T17:29:47.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.255+0000 7f5c7e533640 1 -- 172.21.15.170:0/4135034145 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5c70055d70 con 0x557e9d8a1db0 2024-09-12T17:29:47.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.255+0000 7f5c82925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.255+0000 7f5c82925800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.255+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a7800 con 0x557e9d8a1db0 2024-09-12T17:29:47.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.256+0000 7f5c7e533640 1 -- 172.21.15.170:0/4135034145 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5c70055d70 con 0x557e9d8a1db0 2024-09-12T17:29:47.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.256+0000 7f5c82925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.256+0000 7f5c82925800 20 started sync module instance, tier type = 2024-09-12T17:29:47.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.256+0000 7f5c82925800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:29:47.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.256+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a68f0 con 0x557e9d89d400 2024-09-12T17:29:47.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.257+0000 7f5c7ed34640 1 -- 172.21.15.170:0/4135034145 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(44 notify.0 [create] v31'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c78060040 con 0x557e9d89d400 2024-09-12T17:29:47.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.257+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94002297335008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a8050 con 0x557e9d89d400 2024-09-12T17:29:47.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.257+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a88a0 con 0x557e9d8989f0 2024-09-12T17:29:47.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.258+0000 7f5c7ed34640 1 -- 172.21.15.170:0/4135034145 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94002297335008] v31'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c78060040 con 0x557e9d89d400 2024-09-12T17:29:47.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.258+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v31'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c74051070 con 0x557e9d8989f0 2024-09-12T17:29:47.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.258+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94002297338784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a8590 con 0x557e9d8989f0 2024-09-12T17:29:47.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.258+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a90b0 con 0x557e9d8a1db0 2024-09-12T17:29:47.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.259+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94002297338784] v31'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c74051070 con 0x557e9d8989f0 2024-09-12T17:29:47.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.259+0000 7f5c7e533640 1 -- 172.21.15.170:0/4135034145 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v31'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c70055d70 con 0x557e9d8a1db0 2024-09-12T17:29:47.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.259+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94002297342848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a94a0 con 0x557e9d8a1db0 2024-09-12T17:29:47.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.259+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a9ea0 con 0x557e9d89d400 2024-09-12T17:29:47.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.260+0000 7f5c7ed34640 1 -- 172.21.15.170:0/4135034145 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(50 notify.3 [create] v31'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c78060040 con 0x557e9d89d400 2024-09-12T17:29:47.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.260+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94002297346480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8aa770 con 0x557e9d89d400 2024-09-12T17:29:47.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.260+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8ab200 con 0x557e9d8989f0 2024-09-12T17:29:47.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.261+0000 7f5c7e533640 1 -- 172.21.15.170:0/4135034145 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94002297342848] v31'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c70055d70 con 0x557e9d8a1db0 2024-09-12T17:29:47.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.261+0000 7f5c7ed34640 1 -- 172.21.15.170:0/4135034145 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94002297346480] v31'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c78060040 con 0x557e9d89d400 2024-09-12T17:29:47.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.261+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v31'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c74051070 con 0x557e9d8989f0 2024-09-12T17:29:47.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.261+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94002297339904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8aa2c0 con 0x557e9d8989f0 2024-09-12T17:29:47.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.261+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8abad0 con 0x7f5c7803c060 2024-09-12T17:29:47.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.262+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(54 notify.5 [create] v31'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c74051070 con 0x7f5c7803c060 2024-09-12T17:29:47.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.262+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94002297353616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8abe60 con 0x7f5c7803c060 2024-09-12T17:29:47.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.262+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8ac6b0 con 0x7f5c7803c060 2024-09-12T17:29:47.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.263+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94002297339904] v31'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c74051070 con 0x557e9d8989f0 2024-09-12T17:29:47.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.263+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94002297353616] v31'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c74051070 con 0x7f5c7803c060 2024-09-12T17:29:47.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.263+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v31'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c74051070 con 0x7f5c7803c060 2024-09-12T17:29:47.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.264+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94002297354672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8ac280 con 0x7f5c7803c060 2024-09-12T17:29:47.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.264+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8acad0 con 0x7f5c7803c060 2024-09-12T17:29:47.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.265+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94002297354672] v31'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c74051070 con 0x7f5c7803c060 2024-09-12T17:29:47.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.265+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(58 notify.7 [create] v31'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c74051070 con 0x7f5c7803c060 2024-09-12T17:29:47.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.265+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94002297356208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8ac980 con 0x7f5c7803c060 2024-09-12T17:29:47.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.265+0000 7f5c82925800 20 add_watcher() i=0 2024-09-12T17:29:47.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.265+0000 7f5c82925800 20 add_watcher() i=1 2024-09-12T17:29:47.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.265+0000 7f5c82925800 20 add_watcher() i=2 2024-09-12T17:29:47.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.265+0000 7f5c82925800 20 add_watcher() i=3 2024-09-12T17:29:47.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.265+0000 7f5c82925800 20 add_watcher() i=4 2024-09-12T17:29:47.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.265+0000 7f5c82925800 20 add_watcher() i=5 2024-09-12T17:29:47.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.265+0000 7f5c82925800 20 add_watcher() i=6 2024-09-12T17:29:47.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.266+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94002297356208] v31'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c74051070 con 0x7f5c7803c060 2024-09-12T17:29:47.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.266+0000 7f5c82925800 20 add_watcher() i=7 2024-09-12T17:29:47.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.266+0000 7f5c82925800 2 all 8 watchers are set, enabling cache 2024-09-12T17:29:47.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.266+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8afef0 con 0x557e9d8989f0 2024-09-12T17:29:47.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.266+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5c74051070 con 0x557e9d8989f0 2024-09-12T17:29:47.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.266+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94002297357328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8ad3b0 con 0x557e9d8989f0 2024-09-12T17:29:47.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.267+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94002297357328] v31'246 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5c74051070 con 0x557e9d8989f0 2024-09-12T17:29:47.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.267+0000 7f5b34fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:47.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.267+0000 7f5c82925800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:29:47.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.267+0000 7f5c82925800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:29:47.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.267+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8b8740 con 0x557e9d8989f0 2024-09-12T17:29:47.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.268+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5c74051070 con 0x557e9d8989f0 2024-09-12T17:29:47.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.268+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8b8df0 con 0x7f5c7803c060 2024-09-12T17:29:47.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.269+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5c74051070 con 0x7f5c7803c060 2024-09-12T17:29:47.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.269+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8b9210 con 0x557e9d8a1db0 2024-09-12T17:29:47.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.270+0000 7f5c7e533640 1 -- 172.21.15.170:0/4135034145 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5c70055d70 con 0x557e9d8a1db0 2024-09-12T17:29:47.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.270+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8b9a60 con 0x557e9d8989f0 2024-09-12T17:29:47.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.271+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'247 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5c74051070 con 0x557e9d8989f0 2024-09-12T17:29:47.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.271+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8b9e50 con 0x557e9d89d400 2024-09-12T17:29:47.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.272+0000 7f5c7ed34640 1 -- 172.21.15.170:0/4135034145 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'77 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5c78060040 con 0x557e9d89d400 2024-09-12T17:29:47.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.272+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8b9e50 con 0x557e9d8a1db0 2024-09-12T17:29:47.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.273+0000 7f5c7e533640 1 -- 172.21.15.170:0/4135034145 <== osd.3 v2:172.21.15.170:6816/2664906588 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'51 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5c70055d70 con 0x557e9d8a1db0 2024-09-12T17:29:47.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.273+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8b9e50 con 0x557e9d8989f0 2024-09-12T17:29:47.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.274+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5c74051070 con 0x557e9d8989f0 2024-09-12T17:29:47.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.274+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8b9e50 con 0x7f5c7803c060 2024-09-12T17:29:47.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.275+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'51 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5c74051070 con 0x7f5c7803c060 2024-09-12T17:29:47.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.275+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8b9ee0 con 0x557e9d89d400 2024-09-12T17:29:47.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.276+0000 7f5c7ed34640 1 -- 172.21.15.170:0/4135034145 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'30 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5c78060040 con 0x557e9d89d400 2024-09-12T17:29:47.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.276+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8ba010 con 0x557e9d8a1db0 2024-09-12T17:29:47.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.277+0000 7f5c7e533640 1 -- 172.21.15.170:0/4135034145 <== osd.3 v2:172.21.15.170:6816/2664906588 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5c70055d70 con 0x557e9d8a1db0 2024-09-12T17:29:47.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.277+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8ba0a0 con 0x557e9d89d400 2024-09-12T17:29:47.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.278+0000 7f5c7ed34640 1 -- 172.21.15.170:0/4135034145 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'78 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c78060040 con 0x557e9d89d400 2024-09-12T17:29:47.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.278+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8ba1d0 con 0x7f5c7803c060 2024-09-12T17:29:47.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.279+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'35 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c74051070 con 0x7f5c7803c060 2024-09-12T17:29:47.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.279+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8ba660 con 0x557e9d89d400 2024-09-12T17:29:47.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.280+0000 7f5c7ed34640 1 -- 172.21.15.170:0/4135034145 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c78060040 con 0x557e9d89d400 2024-09-12T17:29:47.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.280+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8ba660 con 0x7f5c7803c060 2024-09-12T17:29:47.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.282+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'57 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c74051070 con 0x7f5c7803c060 2024-09-12T17:29:47.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.282+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8ba660 con 0x557e9d8989f0 2024-09-12T17:29:47.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.283+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'248 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c74051070 con 0x557e9d8989f0 2024-09-12T17:29:47.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.283+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8ba660 con 0x557e9d8a1db0 2024-09-12T17:29:47.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.284+0000 7f5c7e533640 1 -- 172.21.15.170:0/4135034145 <== osd.3 v2:172.21.15.170:6816/2664906588 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'71 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c70055d70 con 0x557e9d8a1db0 2024-09-12T17:29:47.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.284+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8ba660 con 0x557e9d89d400 2024-09-12T17:29:47.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.285+0000 7f5c7ed34640 1 -- 172.21.15.170:0/4135034145 <== osd.2 v2:172.21.15.170:6808/3855567754 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'79 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c78060040 con 0x557e9d89d400 2024-09-12T17:29:47.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.285+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8ba660 con 0x557e9d8a1db0 2024-09-12T17:29:47.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.286+0000 7f5c7e533640 1 -- 172.21.15.170:0/4135034145 <== osd.3 v2:172.21.15.170:6816/2664906588 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c70055d70 con 0x557e9d8a1db0 2024-09-12T17:29:47.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.286+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8ba660 con 0x557e9d8989f0 2024-09-12T17:29:47.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.287+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'39 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c74051070 con 0x557e9d8989f0 2024-09-12T17:29:47.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.287+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8ba660 con 0x557e9d8989f0 2024-09-12T17:29:47.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.288+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'249 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c74051070 con 0x557e9d8989f0 2024-09-12T17:29:47.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.288+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8ba660 con 0x557e9d8a1db0 2024-09-12T17:29:47.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.289+0000 7f5c7e533640 1 -- 172.21.15.170:0/4135034145 <== osd.3 v2:172.21.15.170:6816/2664906588 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'72 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c70055d70 con 0x557e9d8a1db0 2024-09-12T17:29:47.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.289+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8ba660 con 0x557e9d89d400 2024-09-12T17:29:47.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.290+0000 7f5c7ed34640 1 -- 172.21.15.170:0/4135034145 <== osd.2 v2:172.21.15.170:6808/3855567754 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'40 uv32 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c78060040 con 0x557e9d89d400 2024-09-12T17:29:47.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.290+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8ba660 con 0x557e9d8a1db0 2024-09-12T17:29:47.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.291+0000 7f5c7e533640 1 -- 172.21.15.170:0/4135034145 <== osd.3 v2:172.21.15.170:6816/2664906588 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c70055d70 con 0x557e9d8a1db0 2024-09-12T17:29:47.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.291+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8ba660 con 0x557e9d8a1db0 2024-09-12T17:29:47.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.292+0000 7f5c7e533640 1 -- 172.21.15.170:0/4135034145 <== osd.3 v2:172.21.15.170:6816/2664906588 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c70055d70 con 0x557e9d8a1db0 2024-09-12T17:29:47.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.292+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8ba660 con 0x557e9d8a1db0 2024-09-12T17:29:47.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.293+0000 7f5c7e533640 1 -- 172.21.15.170:0/4135034145 <== osd.3 v2:172.21.15.170:6816/2664906588 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'25 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c70055d70 con 0x557e9d8a1db0 2024-09-12T17:29:47.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.293+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8ba660 con 0x557e9d8a1db0 2024-09-12T17:29:47.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.294+0000 7f5c7e533640 1 -- 172.21.15.170:0/4135034145 <== osd.3 v2:172.21.15.170:6816/2664906588 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'52 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c70055d70 con 0x557e9d8a1db0 2024-09-12T17:29:47.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.294+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8ba660 con 0x7f5c7803c060 2024-09-12T17:29:47.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.295+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c74051070 con 0x7f5c7803c060 2024-09-12T17:29:47.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.295+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8ba660 con 0x557e9d8a1db0 2024-09-12T17:29:47.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.296+0000 7f5c7e533640 1 -- 172.21.15.170:0/4135034145 <== osd.3 v2:172.21.15.170:6816/2664906588 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c70055d70 con 0x557e9d8a1db0 2024-09-12T17:29:47.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.296+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8ba660 con 0x7f5c7803c060 2024-09-12T17:29:47.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.297+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'52 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c74051070 con 0x7f5c7803c060 2024-09-12T17:29:47.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.297+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8ba660 con 0x557e9d8a1db0 2024-09-12T17:29:47.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.299+0000 7f5c7e533640 1 -- 172.21.15.170:0/4135034145 <== osd.3 v2:172.21.15.170:6816/2664906588 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'73 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c70055d70 con 0x557e9d8a1db0 2024-09-12T17:29:47.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.299+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8ba660 con 0x7f5c7803c060 2024-09-12T17:29:47.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.299+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.0 v2:172.21.15.47:6800/3978157098 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'58 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c74051070 con 0x7f5c7803c060 2024-09-12T17:29:47.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.300+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8ba660 con 0x557e9d89d400 2024-09-12T17:29:47.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.301+0000 7f5c7ed34640 1 -- 172.21.15.170:0/4135034145 <== osd.2 v2:172.21.15.170:6808/3855567754 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5c78060040 con 0x557e9d89d400 2024-09-12T17:29:47.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.301+0000 7f5aaf7fe640 20 reqs_thread_entry: start 2024-09-12T17:29:47.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.301+0000 7f5c82925800 20 init_complete bucket index max shards: 11 2024-09-12T17:29:47.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.301+0000 7f5c82925800 20 Filter name: none 2024-09-12T17:29:47.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.301+0000 7f5aad7fa640 20 reqs_thread_entry: start 2024-09-12T17:29:47.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.301+0000 7f5c82925800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-12T17:29:47.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.301+0000 7f5c82925800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.301+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:94 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8e53b0 con 0x7f5c7803c060 2024-09-12T17:29:47.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.302+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.0 v2:172.21.15.47:6800/3978157098 23 ==== osd_op_reply(94 system_user [call out=48b,read 0~349 out=349b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 239+0+472 (crc 0 0 0) 0x7f5c74051070 con 0x7f5c7803c060 2024-09-12T17:29:47.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.302+0000 7f5c82925800 20 rados_obj.operate() r=0 bl.length=349 2024-09-12T17:29:47.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.302+0000 7f5c82925800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x13 2024-09-12T17:29:47.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.302+0000 7f5c82925800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-12T17:29:47.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.302+0000 7f5c82925800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:29:47.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.302+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:95 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8e77f0 con 0x7f5c7803c060 2024-09-12T17:29:47.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.302+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.0 v2:172.21.15.47:6800/3978157098 24 ==== osd_op_reply(95 system_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f5c74051070 con 0x7f5c7803c060 2024-09-12T17:29:47.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.302+0000 7f5c82925800 10 removing key index: system_akey 2024-09-12T17:29:47.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.302+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:96 8.0 8:01223cbf:users.keys::system_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8e56c0 con 0x557e9d8a1db0 2024-09-12T17:29:47.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.303+0000 7f5c7e533640 1 -- 172.21.15.170:0/4135034145 <== osd.3 v2:172.21.15.170:6816/2664906588 26 ==== osd_op_reply(96 system_akey [delete] v31'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f5c70055d70 con 0x557e9d8a1db0 2024-09-12T17:29:47.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.303+0000 7f5c82925800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-12T17:29:47.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.303+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [notify cookie 94002297590432 in=173b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8e5e50 con 0x557e9d8989f0 2024-09-12T17:29:47.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.303+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== watch-notify(notify (1) cookie 94002297338784 notify 133143986199 ret 0) ==== 203+0+0 (crc 0 0 0) 0x557e9d8b8df0 con 0x557e9d8989f0 2024-09-12T17:29:47.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.303+0000 7f5b61ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986199 cookie 94002297338784 notifier 4848 bl.length()=161 2024-09-12T17:29:47.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.303+0000 7f5b61ffb640 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f5b44003d60 con 0x557e9d8989f0 2024-09-12T17:29:47.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.303+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(97 notify.1 [notify cookie 94002297590432 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5c74051070 con 0x557e9d8989f0 2024-09-12T17:29:47.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.303+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(98 notify.1 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c74051070 con 0x557e9d8989f0 2024-09-12T17:29:47.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.303+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.1 v2:172.21.15.170:6800/1903654092 30 ==== watch-notify(notify_complete (2) cookie 94002297590432 notify 133143986199 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557e9d8b88d0 con 0x557e9d8989f0 2024-09-12T17:29:47.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.303+0000 7f5c82925800 10 removing email index: 2024-09-12T17:29:47.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.303+0000 7f5c82925800 10 removing user buckets index 2024-09-12T17:29:47.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.303+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:99 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8e5db0 con 0x7f5c7803c060 2024-09-12T17:29:47.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.305+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.0 v2:172.21.15.47:6800/3978157098 25 ==== osd_op_reply(99 system_user.buckets [delete] v31'4 uv3 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f5c74051070 con 0x7f5c7803c060 2024-09-12T17:29:47.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.305+0000 7f5c82925800 10 removing user index: system_user 2024-09-12T17:29:47.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.305+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:100 8.1e 8:78ce4db0:users.uid::system_user:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8e5270 con 0x7f5c7803c060 2024-09-12T17:29:47.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.305+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.0 v2:172.21.15.47:6800/3978157098 26 ==== osd_op_reply(100 system_user [call,call,delete] v31'5 uv5 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f5c74051070 con 0x7f5c7803c060 2024-09-12T17:29:47.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.305+0000 7f5c82925800 10 removing default.rgw.meta+users.uid+system_user from cache 2024-09-12T17:29:47.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.305+0000 7f5c82925800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-12T17:29:47.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.306+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94002297590336 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8e7260 con 0x557e9d89d400 2024-09-12T17:29:47.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.306+0000 7f5c7ed34640 1 -- 172.21.15.170:0/4135034145 <== osd.2 v2:172.21.15.170:6808/3855567754 21 ==== watch-notify(notify (1) cookie 94002297335008 notify 133143986200 ret 0) ==== 202+0+0 (crc 0 0 0) 0x557e9d88d8f0 con 0x557e9d89d400 2024-09-12T17:29:47.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.306+0000 7f5b617fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986200 cookie 94002297335008 notifier 4848 bl.length()=160 2024-09-12T17:29:47.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.306+0000 7f5b617fa640 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f5ab40032c0 con 0x557e9d89d400 2024-09-12T17:29:47.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.306+0000 7f5c7ed34640 1 -- 172.21.15.170:0/4135034145 <== osd.2 v2:172.21.15.170:6808/3855567754 22 ==== osd_op_reply(101 notify.0 [notify cookie 94002297590336 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5c78060040 con 0x557e9d89d400 2024-09-12T17:29:47.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.306+0000 7f5c7ed34640 1 -- 172.21.15.170:0/4135034145 <== osd.2 v2:172.21.15.170:6808/3855567754 23 ==== osd_op_reply(102 notify.0 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c78060040 con 0x557e9d89d400 2024-09-12T17:29:47.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.306+0000 7f5c7ed34640 1 -- 172.21.15.170:0/4135034145 <== osd.2 v2:172.21.15.170:6808/3855567754 24 ==== watch-notify(notify_complete (2) cookie 94002297590336 notify 133143986200 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557e9d88d660 con 0x557e9d89d400 2024-09-12T17:29:47.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.307+0000 7f5b34fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:47.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.307+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94002297357328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8b62d0 con 0x557e9d8989f0 2024-09-12T17:29:47.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.308+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.1 v2:172.21.15.170:6800/1903654092 31 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94002297357328] v31'250 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5c74051070 con 0x557e9d8989f0 2024-09-12T17:29:47.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.308+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94002297335008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8b62d0 con 0x557e9d89d400 2024-09-12T17:29:47.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.309+0000 7f5c7ed34640 1 -- 172.21.15.170:0/4135034145 <== osd.2 v2:172.21.15.170:6808/3855567754 25 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94002297335008] v31'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c78060040 con 0x557e9d89d400 2024-09-12T17:29:47.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.309+0000 7f5c82925800 20 remove_watcher() i=0 2024-09-12T17:29:47.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.309+0000 7f5c82925800 2 removed watcher, disabling cache 2024-09-12T17:29:47.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.309+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94002297338784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a6ce0 con 0x557e9d8989f0 2024-09-12T17:29:47.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.310+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.1 v2:172.21.15.170:6800/1903654092 32 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94002297338784] v31'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c74051070 con 0x557e9d8989f0 2024-09-12T17:29:47.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.310+0000 7f5c82925800 20 remove_watcher() i=1 2024-09-12T17:29:47.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.310+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94002297342848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a6ce0 con 0x557e9d8a1db0 2024-09-12T17:29:47.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.311+0000 7f5c7e533640 1 -- 172.21.15.170:0/4135034145 <== osd.3 v2:172.21.15.170:6816/2664906588 27 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94002297342848] v31'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c70055d70 con 0x557e9d8a1db0 2024-09-12T17:29:47.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.311+0000 7f5c82925800 20 remove_watcher() i=2 2024-09-12T17:29:47.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.311+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94002297346480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a6ce0 con 0x557e9d89d400 2024-09-12T17:29:47.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.312+0000 7f5c7ed34640 1 -- 172.21.15.170:0/4135034145 <== osd.2 v2:172.21.15.170:6808/3855567754 26 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94002297346480] v31'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c78060040 con 0x557e9d89d400 2024-09-12T17:29:47.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.312+0000 7f5c82925800 20 remove_watcher() i=3 2024-09-12T17:29:47.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.312+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94002297339904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a6ce0 con 0x557e9d8989f0 2024-09-12T17:29:47.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.313+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.1 v2:172.21.15.170:6800/1903654092 33 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94002297339904] v31'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c74051070 con 0x557e9d8989f0 2024-09-12T17:29:47.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.313+0000 7f5c82925800 20 remove_watcher() i=4 2024-09-12T17:29:47.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.313+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94002297353616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a6ce0 con 0x7f5c7803c060 2024-09-12T17:29:47.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.314+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.0 v2:172.21.15.47:6800/3978157098 27 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94002297353616] v31'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c74051070 con 0x7f5c7803c060 2024-09-12T17:29:47.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.314+0000 7f5c82925800 20 remove_watcher() i=5 2024-09-12T17:29:47.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.314+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94002297354672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8ab590 con 0x7f5c7803c060 2024-09-12T17:29:47.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.315+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.0 v2:172.21.15.47:6800/3978157098 28 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94002297354672] v31'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c74051070 con 0x7f5c7803c060 2024-09-12T17:29:47.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.315+0000 7f5c82925800 20 remove_watcher() i=6 2024-09-12T17:29:47.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.315+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94002297356208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557e9d8a6ce0 con 0x7f5c7803c060 2024-09-12T17:29:47.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.316+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 <== osd.0 v2:172.21.15.47:6800/3978157098 29 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94002297356208] v31'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c74051070 con 0x7f5c7803c060 2024-09-12T17:29:47.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.316+0000 7f5c82925800 20 remove_watcher() i=7 2024-09-12T17:29:47.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.316+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f5c7803c060 msgr2=0x7f5c7803b3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.316+0000 7f5c82925800 1 --2- 172.21.15.170:0/4135034145 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f5c7803c060 0x7f5c7803b3b0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.316+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x557e9d8989f0 msgr2=0x557e9d89aeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.316+0000 7f5c82925800 1 --2- 172.21.15.170:0/4135034145 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x557e9d8989f0 0x557e9d89aeb0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.316+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x557e9d89d400 msgr2=0x557e9d89f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.316+0000 7f5c82925800 1 --2- 172.21.15.170:0/4135034145 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x557e9d89d400 0x557e9d89f7f0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.317+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x557e9d8a1db0 msgr2=0x557e9d8a4270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.317+0000 7f5c82925800 1 --2- 172.21.15.170:0/4135034145 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x557e9d8a1db0 0x557e9d8a4270 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.317+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5b4803c6e0 msgr2=0x7f5b4803eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.317+0000 7f5c82925800 1 --2- 172.21.15.170:0/4135034145 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5b4803c6e0 0x7f5b4803eba0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5c70018f90 tx=0x7f5c70034000 comp rx=0 tx=0).stop 2024-09-12T17:29:47.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.317+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557e9d885b00 msgr2=0x557e9d88d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.317+0000 7f5c82925800 1 --2- 172.21.15.170:0/4135034145 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557e9d885b00 0x557e9d88d100 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f5c780208e0 tx=0x7f5c78053d30 comp rx=0 tx=0).stop 2024-09-12T17:29:47.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.317+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 reap_dead start 2024-09-12T17:29:47.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.317+0000 7f5c7dd32640 1 -- 172.21.15.170:0/4135034145 reap_dead start 2024-09-12T17:29:47.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.317+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 shutdown_connections 2024-09-12T17:29:47.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.317+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 >> 172.21.15.170:0/4135034145 conn(0x557e9d881f00 msgr2=0x557e9d880110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:47.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.317+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 shutdown_connections 2024-09-12T17:29:47.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.317+0000 7f5c82925800 1 -- 172.21.15.170:0/4135034145 wait complete. 2024-09-12T17:29:47.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.317+0000 7f5c82925800 1 -- 172.21.15.170:0/834530463 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5b5803c730 msgr2=0x7f5b5803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.317+0000 7f5c82925800 1 --2- 172.21.15.170:0/834530463 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5b5803c730 0x7f5b5803ebf0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5c700520e0 tx=0x7f5c7002df10 comp rx=0 tx=0).stop 2024-09-12T17:29:47.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.317+0000 7f5c82925800 1 -- 172.21.15.170:0/834530463 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557e9d879040 msgr2=0x557e9d879460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.317+0000 7f5c82925800 1 --2- 172.21.15.170:0/834530463 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557e9d879040 0x557e9d879460 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x557e9d85f040 tx=0x7f5c780167b0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.317+0000 7f5c82925800 1 -- 172.21.15.170:0/834530463 shutdown_connections 2024-09-12T17:29:47.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.317+0000 7f5c82925800 1 --2- 172.21.15.170:0/834530463 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5b5803c730 0x7f5b5803ebf0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.317+0000 7f5c82925800 1 --2- 172.21.15.170:0/834530463 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557e9d879040 0x557e9d879460 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.317+0000 7f5c82925800 1 -- 172.21.15.170:0/834530463 >> 172.21.15.170:0/834530463 conn(0x557e9d86d3f0 msgr2=0x557e9d86d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:47.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.317+0000 7f5c82925800 1 -- 172.21.15.170:0/834530463 shutdown_connections 2024-09-12T17:29:47.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.317+0000 7f5c82925800 1 -- 172.21.15.170:0/834530463 wait complete. 2024-09-12T17:29:47.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.318+0000 7f5c82925800 1 -- 172.21.15.170:0/1638251620 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x557e9d764fb0 msgr2=0x557e9d865800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.318+0000 7f5c82925800 1 --2- 172.21.15.170:0/1638251620 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x557e9d764fb0 0x557e9d865800 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.318+0000 7f5c82925800 1 -- 172.21.15.170:0/1638251620 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x557e9d867cd0 msgr2=0x557e9d86a0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.318+0000 7f5c82925800 1 --2- 172.21.15.170:0/1638251620 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x557e9d867cd0 0x557e9d86a0c0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.318+0000 7f5c82925800 1 -- 172.21.15.170:0/1638251620 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5b6403c730 msgr2=0x7f5b6403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.318+0000 7f5c82925800 1 --2- 172.21.15.170:0/1638251620 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5b6403c730 0x7f5b6403ebf0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5c74057000 tx=0x7f5c74052000 comp rx=0 tx=0).stop 2024-09-12T17:29:47.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.318+0000 7f5c82925800 1 -- 172.21.15.170:0/1638251620 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557e9d763490 msgr2=0x557e9d85e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.318+0000 7f5c82925800 1 --2- 172.21.15.170:0/1638251620 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557e9d763490 0x557e9d85e1b0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f5c700012b0 tx=0x7f5c70000ed0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.318+0000 7f5c82925800 1 -- 172.21.15.170:0/1638251620 shutdown_connections 2024-09-12T17:29:47.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.318+0000 7f5c82925800 1 --2- 172.21.15.170:0/1638251620 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x557e9d867cd0 0x557e9d86a0c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.318+0000 7f5c82925800 1 --2- 172.21.15.170:0/1638251620 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5b6403c730 0x7f5b6403ebf0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.318+0000 7f5c82925800 1 --2- 172.21.15.170:0/1638251620 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x557e9d764fb0 0x557e9d865800 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.318+0000 7f5c82925800 1 --2- 172.21.15.170:0/1638251620 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557e9d763490 0x557e9d85e1b0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.318+0000 7f5c82925800 1 -- 172.21.15.170:0/1638251620 >> 172.21.15.170:0/1638251620 conn(0x557e9d75f1c0 msgr2=0x557e9d857b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:47.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.318+0000 7f5c82925800 1 -- 172.21.15.170:0/1638251620 shutdown_connections 2024-09-12T17:29:47.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.318+0000 7f5c82925800 1 -- 172.21.15.170:0/1638251620 wait complete. 2024-09-12T17:29:47.327 ERROR:root:None 2024-09-12T17:29:47.328 ERROR:root:0 2024-09-12T17:29:47.328 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-12T17:29:47.328 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-12T17:29:47.328 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid a_user --display-name 'True Admin User' --access-key true_admin_akey --secret true_admin_skey --caps user-info-without-keys=read --admin 2024-09-12T17:29:47.382 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:29:47.382 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:29:47.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.381+0000 7fa302d2e800 1 Processor -- start 2024-09-12T17:29:47.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.381+0000 7fa302d2e800 1 -- start start 2024-09-12T17:29:47.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.381+0000 7fa302d2e800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x560977ebf010 0x560977ec7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.381+0000 7fa302d2e800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560977d68e40 con 0x560977ebd4f0 2024-09-12T17:29:47.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.381+0000 7fa302d2e800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x560977d33680 con 0x560977ebf010 2024-09-12T17:29:47.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.382+0000 7fa2fe163640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x560977ebf010 0x560977ec7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.382+0000 7fa2fe964640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x560977ebd4f0 0x560977ebd8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:44896/0 (socket says 172.21.15.170:44896) 2024-09-12T17:29:47.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.382+0000 7fa2fe964640 1 -- 172.21.15.170:0/4240710200 learned_addr learned my addr 172.21.15.170:0/4240710200 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:29:47.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.382+0000 7fa2fe163640 1 -- 172.21.15.170:0/4240710200 >> v1:172.21.15.47:6789/0 conn(0x560977ebd4f0 legacy=0x560977ebd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.382+0000 7fa2fe163640 1 -- 172.21.15.170:0/4240710200 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560977d4f6b0 con 0x560977ebf010 2024-09-12T17:29:47.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.384+0000 7fa2fe163640 1 --2- 172.21.15.170:0/4240710200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560977ebf010 0x560977ec7b30 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fa2f400a470 tx=0x7fa2f4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2eaac9fae2f3f80 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.384+0000 7fa2fd962640 1 -- 172.21.15.170:0/4240710200 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2f4053570 con 0x560977ebf010 2024-09-12T17:29:47.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.384+0000 7fa2fd962640 1 -- 172.21.15.170:0/4240710200 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2f4058070 con 0x560977ebf010 2024-09-12T17:29:47.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.384+0000 7fa2fd962640 1 -- 172.21.15.170:0/4240710200 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2f4053880 con 0x560977ebf010 2024-09-12T17:29:47.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.384+0000 7fa302d2e800 1 -- 172.21.15.170:0/4240710200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560977ebf010 msgr2=0x560977ec7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.384+0000 7fa302d2e800 1 --2- 172.21.15.170:0/4240710200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560977ebf010 0x560977ec7b30 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fa2f400a470 tx=0x7fa2f4045a20 comp rx=0 tx=0).stop 2024-09-12T17:29:47.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.384+0000 7fa302d2e800 1 -- 172.21.15.170:0/4240710200 shutdown_connections 2024-09-12T17:29:47.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.384+0000 7fa302d2e800 1 --2- 172.21.15.170:0/4240710200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560977ebf010 0x560977ec7b30 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.384+0000 7fa302d2e800 1 -- 172.21.15.170:0/4240710200 >> 172.21.15.170:0/4240710200 conn(0x560977eb9220 msgr2=0x560977ebb680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:47.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.384+0000 7fa302d2e800 1 -- 172.21.15.170:0/4240710200 shutdown_connections 2024-09-12T17:29:47.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.384+0000 7fa302d2e800 1 -- 172.21.15.170:0/4240710200 wait complete. 2024-09-12T17:29:47.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.398+0000 7fa302d2e800 1 Processor -- start 2024-09-12T17:29:47.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.398+0000 7fa302d2e800 1 -- start start 2024-09-12T17:29:47.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.398+0000 7fa302d2e800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560977ebd4f0 0x560977fb0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.398+0000 7fa302d2e800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x560977d57dd0 con 0x560977ebd4f0 2024-09-12T17:29:47.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.398+0000 7fa2fe964640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560977ebd4f0 0x560977fb0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.398+0000 7fa2fe964640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560977ebd4f0 0x560977fb0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35044/0 (socket says 172.21.15.170:35044) 2024-09-12T17:29:47.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.398+0000 7fa2fe964640 1 -- 172.21.15.170:0/127062336 learned_addr learned my addr 172.21.15.170:0/127062336 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:47.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.399+0000 7fa2fe964640 1 -- 172.21.15.170:0/127062336 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560977d70e10 con 0x560977ebd4f0 2024-09-12T17:29:47.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.399+0000 7fa2fe964640 1 --2- 172.21.15.170:0/127062336 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560977ebd4f0 0x560977fb0920 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0001e40 tx=0x7fa2f0001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1caf8d6f201f4fcf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.399+0000 7fa1ece09640 1 -- 172.21.15.170:0/127062336 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2f0012020 con 0x560977ebd4f0 2024-09-12T17:29:47.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.399+0000 7fa1ece09640 1 -- 172.21.15.170:0/127062336 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2f000e5a0 con 0x560977ebd4f0 2024-09-12T17:29:47.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.399+0000 7fa1ece09640 1 -- 172.21.15.170:0/127062336 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2f000e8a0 con 0x560977ebd4f0 2024-09-12T17:29:47.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.400+0000 7fa302d2e800 1 -- 172.21.15.170:0/127062336 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560977ebd4f0 msgr2=0x560977fb0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.400+0000 7fa302d2e800 1 --2- 172.21.15.170:0/127062336 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560977ebd4f0 0x560977fb0920 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0001e40 tx=0x7fa2f0001e70 comp rx=0 tx=0).stop 2024-09-12T17:29:47.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.400+0000 7fa302d2e800 1 -- 172.21.15.170:0/127062336 shutdown_connections 2024-09-12T17:29:47.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.400+0000 7fa302d2e800 1 --2- 172.21.15.170:0/127062336 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560977ebd4f0 0x560977fb0920 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.400+0000 7fa302d2e800 1 -- 172.21.15.170:0/127062336 >> 172.21.15.170:0/127062336 conn(0x560977eb9220 msgr2=0x560977fac2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:47.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.400+0000 7fa302d2e800 1 -- 172.21.15.170:0/127062336 shutdown_connections 2024-09-12T17:29:47.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.400+0000 7fa302d2e800 1 -- 172.21.15.170:0/127062336 wait complete. 2024-09-12T17:29:47.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.400+0000 7fa302d2e800 1 Processor -- start 2024-09-12T17:29:47.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.400+0000 7fa302d2e800 1 -- start start 2024-09-12T17:29:47.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.400+0000 7fa302d2e800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560977ebd4f0 0x560977fb82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.400+0000 7fa302d2e800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x560977ec8340 con 0x560977ebd4f0 2024-09-12T17:29:47.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.400+0000 7fa2fe964640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560977ebd4f0 0x560977fb82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.400+0000 7fa2fe964640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560977ebd4f0 0x560977fb82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35050/0 (socket says 172.21.15.170:35050) 2024-09-12T17:29:47.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.400+0000 7fa2fe964640 1 -- 172.21.15.170:0/1666619865 learned_addr learned my addr 172.21.15.170:0/1666619865 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:47.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.401+0000 7fa2fe964640 1 -- 172.21.15.170:0/1666619865 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560977fb8830 con 0x560977ebd4f0 2024-09-12T17:29:47.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.401+0000 7fa2fe964640 1 --2- 172.21.15.170:0/1666619865 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560977ebd4f0 0x560977fb82d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fa2f000c010 tx=0x7fa2f0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.401+0000 7fa1eb606640 1 -- 172.21.15.170:0/1666619865 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2f0012030 con 0x560977ebd4f0 2024-09-12T17:29:47.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.401+0000 7fa1eb606640 1 -- 172.21.15.170:0/1666619865 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2f00014a0 con 0x560977ebd4f0 2024-09-12T17:29:47.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.401+0000 7fa1eb606640 1 -- 172.21.15.170:0/1666619865 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2f001a7a0 con 0x560977ebd4f0 2024-09-12T17:29:47.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.401+0000 7fa302d2e800 1 -- 172.21.15.170:0/1666619865 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560977fb8ac0 con 0x560977ebd4f0 2024-09-12T17:29:47.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.401+0000 7fa302d2e800 1 -- 172.21.15.170:0/1666619865 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560977fb94c0 con 0x560977ebd4f0 2024-09-12T17:29:47.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.402+0000 7fa1eb606640 1 -- 172.21.15.170:0/1666619865 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fa2f0015020 con 0x560977ebd4f0 2024-09-12T17:29:47.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.402+0000 7fa1eb606640 1 --2- 172.21.15.170:0/1666619865 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa1e403c730 0x7fa1e403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.402+0000 7fa1eb606640 1 -- 172.21.15.170:0/1666619865 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fa2f0020030 con 0x560977ebd4f0 2024-09-12T17:29:47.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.402+0000 7fa2fe163640 1 --2- 172.21.15.170:0/1666619865 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa1e403c730 0x7fa1e403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.402+0000 7fa302d2e800 1 --2- 172.21.15.170:0/1666619865 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x560977ebf010 0x560977fbf920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.402+0000 7fa302d2e800 1 -- 172.21.15.170:0/1666619865 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560977fbfe60 con 0x560977ebf010 2024-09-12T17:29:47.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.403+0000 7fa2ff165640 1 --2- 172.21.15.170:0/1666619865 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x560977ebf010 0x560977fbf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.403+0000 7fa2fe163640 1 --2- 172.21.15.170:0/1666619865 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa1e403c730 0x7fa1e403ebf0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4057000 tx=0x7fa2f4052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.403+0000 7fa2ff165640 1 --2- 172.21.15.170:0/1666619865 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x560977ebf010 0x560977fbf920 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.403+0000 7fa2ff165640 1 -- 172.21.15.170:0/1666619865 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa2f800a4d0 con 0x560977ebf010 2024-09-12T17:29:47.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.403+0000 7fa302d2e800 1 -- 172.21.15.170:0/1666619865 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560977fc0200 con 0x560977ebf010 2024-09-12T17:29:47.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.403+0000 7fa2ff165640 1 -- 172.21.15.170:0/1666619865 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa2f800a4d0 con 0x560977ebf010 2024-09-12T17:29:47.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.403+0000 7fa302d2e800 1 --2- 172.21.15.170:0/1666619865 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x560977fc1cc0 0x560977fc4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.403+0000 7fa302d2e800 1 -- 172.21.15.170:0/1666619865 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560977fc48f0 con 0x560977fc1cc0 2024-09-12T17:29:47.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.404+0000 7fa2fe964640 1 --2- 172.21.15.170:0/1666619865 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x560977fc1cc0 0x560977fc4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.404+0000 7fa2fe964640 1 --2- 172.21.15.170:0/1666619865 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x560977fc1cc0 0x560977fc4160 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.404+0000 7fa2fe964640 1 -- 172.21.15.170:0/1666619865 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa2f001ab20 con 0x560977fc1cc0 2024-09-12T17:29:47.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.404+0000 7fa302d2e800 1 -- 172.21.15.170:0/1666619865 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560977fc0a50 con 0x560977ebf010 2024-09-12T17:29:47.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.404+0000 7fa2ff165640 1 -- 172.21.15.170:0/1666619865 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa2f800a4d0 con 0x560977ebf010 2024-09-12T17:29:47.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.404+0000 7fa302d2e800 1 -- 172.21.15.170:0/1666619865 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560977fc0e30 con 0x560977fc1cc0 2024-09-12T17:29:47.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.405+0000 7fa2fe964640 1 -- 172.21.15.170:0/1666619865 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa2f001ab20 con 0x560977fc1cc0 2024-09-12T17:29:47.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.405+0000 7fa302d2e800 1 Processor -- start 2024-09-12T17:29:47.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.405+0000 7fa302d2e800 1 -- start start 2024-09-12T17:29:47.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.405+0000 7fa302d2e800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560977fd3180 0x560977fd35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.405+0000 7fa302d2e800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x560977db5a00 con 0x560977fd3180 2024-09-12T17:29:47.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.405+0000 7fa2ff165640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560977fd3180 0x560977fd35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.406+0000 7fa2ff165640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560977fd3180 0x560977fd35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35062/0 (socket says 172.21.15.170:35062) 2024-09-12T17:29:47.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.406+0000 7fa2ff165640 1 -- 172.21.15.170:0/3251106769 learned_addr learned my addr 172.21.15.170:0/3251106769 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:47.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.406+0000 7fa2ff165640 1 -- 172.21.15.170:0/3251106769 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560977fd3be0 con 0x560977fd3180 2024-09-12T17:29:47.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.406+0000 7fa2ff165640 1 --2- 172.21.15.170:0/3251106769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560977fd3180 0x560977fd35a0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x560977fb9160 tx=0x7fa2f80167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.406+0000 7fa1e8e01640 1 -- 172.21.15.170:0/3251106769 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2f8013640 con 0x560977fd3180 2024-09-12T17:29:47.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.406+0000 7fa1e8e01640 1 -- 172.21.15.170:0/3251106769 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2f80137e0 con 0x560977fd3180 2024-09-12T17:29:47.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.406+0000 7fa1e8e01640 1 -- 172.21.15.170:0/3251106769 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2f8013ae0 con 0x560977fd3180 2024-09-12T17:29:47.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.406+0000 7fa302d2e800 1 -- 172.21.15.170:0/3251106769 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560977fd4410 con 0x560977fd3180 2024-09-12T17:29:47.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.406+0000 7fa302d2e800 1 -- 172.21.15.170:0/3251106769 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560977fd49b0 con 0x560977fd3180 2024-09-12T17:29:47.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.407+0000 7fa1e8e01640 1 -- 172.21.15.170:0/3251106769 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fa2f8011040 con 0x560977fd3180 2024-09-12T17:29:47.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.408+0000 7fa1e8e01640 1 --2- 172.21.15.170:0/3251106769 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa1d803c730 0x7fa1d803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.408+0000 7fa1e8e01640 1 -- 172.21.15.170:0/3251106769 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fa2f800e040 con 0x560977fd3180 2024-09-12T17:29:47.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.408+0000 7fa2fe964640 1 --2- 172.21.15.170:0/3251106769 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa1d803c730 0x7fa1d803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.408+0000 7fa302d2e800 1 Processor -- start 2024-09-12T17:29:47.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.408+0000 7fa2fe964640 1 --2- 172.21.15.170:0/3251106769 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa1d803c730 0x7fa1d803ebf0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa2f000c720 tx=0x7fa2f0043050 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.408+0000 7fa302d2e800 1 -- start start 2024-09-12T17:29:47.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.408+0000 7fa302d2e800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560977fdfc80 0x560977fe0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.408+0000 7fa302d2e800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x560977fb1170 con 0x560977fdfc80 2024-09-12T17:29:47.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.409+0000 7fa2ff165640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560977fdfc80 0x560977fe0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.409+0000 7fa2ff165640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560977fdfc80 0x560977fe0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35066/0 (socket says 172.21.15.170:35066) 2024-09-12T17:29:47.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.409+0000 7fa2ff165640 1 -- 172.21.15.170:0/2939990850 learned_addr learned my addr 172.21.15.170:0/2939990850 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:47.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.409+0000 7fa2ff165640 1 -- 172.21.15.170:0/2939990850 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560977fe0670 con 0x560977fdfc80 2024-09-12T17:29:47.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.409+0000 7fa2ff165640 1 --2- 172.21.15.170:0/2939990850 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560977fdfc80 0x560977fe0080 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8020000 tx=0x7fa2f801f400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73bc84bbec6c514e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.409+0000 7fa1e27fc640 1 -- 172.21.15.170:0/2939990850 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2f8055040 con 0x560977fdfc80 2024-09-12T17:29:47.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.409+0000 7fa1e27fc640 1 -- 172.21.15.170:0/2939990850 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2f8021960 con 0x560977fdfc80 2024-09-12T17:29:47.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.409+0000 7fa1e27fc640 1 -- 172.21.15.170:0/2939990850 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2f8021440 con 0x560977fdfc80 2024-09-12T17:29:47.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.409+0000 7fa302d2e800 1 -- 172.21.15.170:0/2939990850 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560977fdfc80 msgr2=0x560977fe0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.409+0000 7fa302d2e800 1 --2- 172.21.15.170:0/2939990850 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560977fdfc80 0x560977fe0080 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8020000 tx=0x7fa2f801f400 comp rx=0 tx=0).stop 2024-09-12T17:29:47.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.410+0000 7fa302d2e800 1 -- 172.21.15.170:0/2939990850 shutdown_connections 2024-09-12T17:29:47.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.410+0000 7fa302d2e800 1 --2- 172.21.15.170:0/2939990850 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560977fdfc80 0x560977fe0080 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.410+0000 7fa302d2e800 1 -- 172.21.15.170:0/2939990850 >> 172.21.15.170:0/2939990850 conn(0x560977fdc0a0 msgr2=0x560977fda2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:47.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.410+0000 7fa302d2e800 1 -- 172.21.15.170:0/2939990850 shutdown_connections 2024-09-12T17:29:47.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.410+0000 7fa302d2e800 1 -- 172.21.15.170:0/2939990850 wait complete. 2024-09-12T17:29:47.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.410+0000 7fa302d2e800 1 Processor -- start 2024-09-12T17:29:47.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.410+0000 7fa302d2e800 1 -- start start 2024-09-12T17:29:47.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.410+0000 7fa302d2e800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560977fdfc80 0x560977fe7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.410+0000 7fa302d2e800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x560977fe0c90 con 0x560977fdfc80 2024-09-12T17:29:47.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.410+0000 7fa2ff165640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560977fdfc80 0x560977fe7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.410+0000 7fa2ff165640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560977fdfc80 0x560977fe7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35070/0 (socket says 172.21.15.170:35070) 2024-09-12T17:29:47.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.410+0000 7fa2ff165640 1 -- 172.21.15.170:0/1671490334 learned_addr learned my addr 172.21.15.170:0/1671490334 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:47.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.411+0000 7fa2ff165640 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560977fe77c0 con 0x560977fdfc80 2024-09-12T17:29:47.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.411+0000 7fa2ff165640 1 --2- 172.21.15.170:0/1671490334 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560977fdfc80 0x560977fe7260 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fa2f80147d0 tx=0x7fa2f8053cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.411+0000 7fa1e0ff9640 1 -- 172.21.15.170:0/1671490334 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2f8055050 con 0x560977fdfc80 2024-09-12T17:29:47.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.411+0000 7fa1e0ff9640 1 -- 172.21.15.170:0/1671490334 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2f8053f60 con 0x560977fdfc80 2024-09-12T17:29:47.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.411+0000 7fa1e0ff9640 1 -- 172.21.15.170:0/1671490334 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2f801f840 con 0x560977fdfc80 2024-09-12T17:29:47.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.411+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560977fe7a50 con 0x560977fdfc80 2024-09-12T17:29:47.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.411+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560977fe83d0 con 0x560977fdfc80 2024-09-12T17:29:47.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.412+0000 7fa1e0ff9640 1 -- 172.21.15.170:0/1671490334 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fa2f80551f0 con 0x560977fdfc80 2024-09-12T17:29:47.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.412+0000 7fa1e0ff9640 1 --2- 172.21.15.170:0/1671490334 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa1c803c730 0x7fa1c803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.412+0000 7fa1e0ff9640 1 -- 172.21.15.170:0/1671490334 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fa2f8034bf0 con 0x560977fdfc80 2024-09-12T17:29:47.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.412+0000 7fa2fe964640 1 --2- 172.21.15.170:0/1671490334 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa1c803c730 0x7fa1c803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.413+0000 7fa2fe964640 1 --2- 172.21.15.170:0/1671490334 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa1c803c730 0x7fa1c803ebf0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0053af0 tx=0x7fa2f0030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.413+0000 7fa302d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.413+0000 7fa302d2e800 1 --2- 172.21.15.170:0/1671490334 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x560977ff2b80 0x560977ff5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.413+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560977ff5790 con 0x560977ff2b80 2024-09-12T17:29:47.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.413+0000 7fa2fe163640 1 --2- 172.21.15.170:0/1671490334 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x560977ff2b80 0x560977ff5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.413+0000 7fa2fe163640 1 --2- 172.21.15.170:0/1671490334 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x560977ff2b80 0x560977ff5040 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.413+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa2f4051070 con 0x560977ff2b80 2024-09-12T17:29:47.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.413+0000 7fa302d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.413+0000 7fa302d2e800 20 realm 2024-09-12T17:29:47.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.414+0000 7fa302d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.414+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560977ff5bc0 con 0x560977ff2b80 2024-09-12T17:29:47.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.414+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa2f4051070 con 0x560977ff2b80 2024-09-12T17:29:47.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.414+0000 7fa302d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.414+0000 7fa302d2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:29:47.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.414+0000 7fa302d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.414+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560977ff6490 con 0x560977ff2b80 2024-09-12T17:29:47.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.414+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa2f4051070 con 0x560977ff2b80 2024-09-12T17:29:47.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.414+0000 7fa302d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.414+0000 7fa302d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.414+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560977ff6830 con 0x560977ff2b80 2024-09-12T17:29:47.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.414+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa2f4051070 con 0x560977ff2b80 2024-09-12T17:29:47.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.414+0000 7fa302d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:47.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.414+0000 7fa302d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.414+0000 7fa302d2e800 1 --2- 172.21.15.170:0/1671490334 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x560977ff7590 0x560977ff9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.414+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560977ff9f90 con 0x560977ff7590 2024-09-12T17:29:47.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.414+0000 7fa2ff165640 1 --2- 172.21.15.170:0/1671490334 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x560977ff7590 0x560977ff9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.415+0000 7fa2ff165640 1 --2- 172.21.15.170:0/1671490334 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x560977ff7590 0x560977ff9980 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.415+0000 7fa2ff165640 1 -- 172.21.15.170:0/1671490334 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa2f800a4d0 con 0x560977ff7590 2024-09-12T17:29:47.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.415+0000 7fa302d2e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:29:47.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.415+0000 7fa302d2e800 20 searching for the correct realm 2024-09-12T17:29:47.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.415+0000 7fa302d2e800 1 --2- 172.21.15.170:0/1671490334 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x560977ffbf40 0x560977ffe400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.415+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560977ffea80 con 0x560977ffbf40 2024-09-12T17:29:47.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.415+0000 7fa2fe964640 1 --2- 172.21.15.170:0/1671490334 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x560977ffbf40 0x560977ffe400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.415+0000 7fa2fe964640 1 --2- 172.21.15.170:0/1671490334 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x560977ffbf40 0x560977ffe400 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.415+0000 7fa2fe964640 1 -- 172.21.15.170:0/1671490334 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2f001ab20 con 0x560977ffbf40 2024-09-12T17:29:47.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.415+0000 7fa2fe964640 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560977ffea80 con 0x560977ff7590 2024-09-12T17:29:47.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.416+0000 7fa2ff165640 1 -- 172.21.15.170:0/1671490334 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2f800a4d0 con 0x560977ff7590 2024-09-12T17:29:47.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.416+0000 7fa2ff165640 1 --2- 172.21.15.170:0/1671490334 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fa2f804e940 0x7fa2f803c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.416+0000 7fa2ff165640 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560977ffea80 con 0x7fa2f804e940 2024-09-12T17:29:47.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.416+0000 7fa2fe163640 1 --2- 172.21.15.170:0/1671490334 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fa2f804e940 0x7fa2f803c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.416+0000 7fa2fe163640 1 --2- 172.21.15.170:0/1671490334 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fa2f804e940 0x7fa2f803c3f0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.417+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2f4051070 con 0x7fa2f804e940 2024-09-12T17:29:47.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.417+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560977ffea80 con 0x560977ff2b80 2024-09-12T17:29:47.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.417+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2f4051070 con 0x560977ff2b80 2024-09-12T17:29:47.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.417+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560977ffea80 con 0x560977ff2b80 2024-09-12T17:29:47.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.417+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2f4051070 con 0x560977ff2b80 2024-09-12T17:29:47.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.417+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560977ffea80 con 0x7fa2f804e940 2024-09-12T17:29:47.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.417+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2f4051070 con 0x7fa2f804e940 2024-09-12T17:29:47.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.417+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560977ffea80 con 0x7fa2f804e940 2024-09-12T17:29:47.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.418+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2f4051070 con 0x7fa2f804e940 2024-09-12T17:29:47.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.418+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560977ffea80 con 0x560977ff7590 2024-09-12T17:29:47.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.418+0000 7fa2ff165640 1 -- 172.21.15.170:0/1671490334 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2f800a4d0 con 0x560977ff7590 2024-09-12T17:29:47.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.418+0000 7fa2ff165640 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560977ffea80 con 0x560977ffbf40 2024-09-12T17:29:47.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.418+0000 7fa2fe964640 1 -- 172.21.15.170:0/1671490334 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2f001ab20 con 0x560977ffbf40 2024-09-12T17:29:47.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.418+0000 7fa2fe964640 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560977ffea80 con 0x560977ff2b80 2024-09-12T17:29:47.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.418+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2f4051070 con 0x560977ff2b80 2024-09-12T17:29:47.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.418+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560977ffea80 con 0x7fa2f804e940 2024-09-12T17:29:47.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.419+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2f4051070 con 0x7fa2f804e940 2024-09-12T17:29:47.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.419+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560977ffea80 con 0x560977ff2b80 2024-09-12T17:29:47.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.419+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2f4051070 con 0x560977ff2b80 2024-09-12T17:29:47.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.419+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560977ffea80 con 0x560977ff7590 2024-09-12T17:29:47.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.419+0000 7fa2ff165640 1 -- 172.21.15.170:0/1671490334 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fa2f800a4d0 con 0x560977ff7590 2024-09-12T17:29:47.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.419+0000 7fa2ff165640 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560977ffea80 con 0x560977ffbf40 2024-09-12T17:29:47.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.419+0000 7fa2fe964640 1 -- 172.21.15.170:0/1671490334 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2f001ab20 con 0x560977ffbf40 2024-09-12T17:29:47.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.419+0000 7fa2fe964640 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560977ffea80 con 0x560977ffbf40 2024-09-12T17:29:47.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.420+0000 7fa2fe964640 1 -- 172.21.15.170:0/1671490334 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2f001ab20 con 0x560977ffbf40 2024-09-12T17:29:47.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.420+0000 7fa2fe964640 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560977ffea80 con 0x560977ff7590 2024-09-12T17:29:47.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.420+0000 7fa2ff165640 1 -- 172.21.15.170:0/1671490334 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2f800a4d0 con 0x560977ff7590 2024-09-12T17:29:47.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.420+0000 7fa2ff165640 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560977ffea80 con 0x560977ffbf40 2024-09-12T17:29:47.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.420+0000 7fa2fe964640 1 -- 172.21.15.170:0/1671490334 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2f001ab20 con 0x560977ffbf40 2024-09-12T17:29:47.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.420+0000 7fa2fe964640 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560977ffea80 con 0x560977ffbf40 2024-09-12T17:29:47.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.420+0000 7fa2fe964640 1 -- 172.21.15.170:0/1671490334 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2f001ab20 con 0x560977ffbf40 2024-09-12T17:29:47.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.420+0000 7fa2fe964640 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560977ffea80 con 0x560977ff2b80 2024-09-12T17:29:47.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.421+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2f4051070 con 0x560977ff2b80 2024-09-12T17:29:47.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.421+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560977ffea80 con 0x560977ff2b80 2024-09-12T17:29:47.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.421+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v31'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa2f4051070 con 0x560977ff2b80 2024-09-12T17:29:47.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.421+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560977ffea80 con 0x7fa2f804e940 2024-09-12T17:29:47.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.421+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2f4051070 con 0x7fa2f804e940 2024-09-12T17:29:47.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.421+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560977ffea80 con 0x560977ffbf40 2024-09-12T17:29:47.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.421+0000 7fa2fe964640 1 -- 172.21.15.170:0/1671490334 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2f001ab20 con 0x560977ffbf40 2024-09-12T17:29:47.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.421+0000 7fa2fe964640 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560977ffea80 con 0x560977ff7590 2024-09-12T17:29:47.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.422+0000 7fa2ff165640 1 -- 172.21.15.170:0/1671490334 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2f800a4d0 con 0x560977ff7590 2024-09-12T17:29:47.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.422+0000 7fa2ff165640 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560977ffea80 con 0x560977ff2b80 2024-09-12T17:29:47.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.422+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2f4051070 con 0x560977ff2b80 2024-09-12T17:29:47.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.422+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560977ffea80 con 0x7fa2f804e940 2024-09-12T17:29:47.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.422+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2f4051070 con 0x7fa2f804e940 2024-09-12T17:29:47.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.422+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560977ffea80 con 0x560977ffbf40 2024-09-12T17:29:47.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.422+0000 7fa2fe964640 1 -- 172.21.15.170:0/1671490334 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2f001ab20 con 0x560977ffbf40 2024-09-12T17:29:47.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.422+0000 7fa2fe964640 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560977ffea80 con 0x7fa2f804e940 2024-09-12T17:29:47.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.423+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2f4051070 con 0x7fa2f804e940 2024-09-12T17:29:47.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.423+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560977ffea80 con 0x560977ff7590 2024-09-12T17:29:47.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.423+0000 7fa2ff165640 1 -- 172.21.15.170:0/1671490334 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2f8066040 con 0x560977ff7590 2024-09-12T17:29:47.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.423+0000 7fa2ff165640 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560977ffea80 con 0x560977ffbf40 2024-09-12T17:29:47.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.423+0000 7fa2fe964640 1 -- 172.21.15.170:0/1671490334 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2f001ab20 con 0x560977ffbf40 2024-09-12T17:29:47.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.423+0000 7fa2fe964640 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560977ffea80 con 0x7fa2f804e940 2024-09-12T17:29:47.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.423+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2f4051070 con 0x7fa2f804e940 2024-09-12T17:29:47.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.423+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560977ffea80 con 0x560977ff2b80 2024-09-12T17:29:47.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.424+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa2f4051070 con 0x560977ff2b80 2024-09-12T17:29:47.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.424+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560977ffea80 con 0x560977ff7590 2024-09-12T17:29:47.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.424+0000 7fa2ff165640 1 -- 172.21.15.170:0/1671490334 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(37 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa2f8066040 con 0x560977ff7590 2024-09-12T17:29:47.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.424+0000 7fa302d2e800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:29:47.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.424+0000 7fa302d2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:29:47.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.424+0000 7fa302d2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:29:47.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.424+0000 7fa302d2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:29:47.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.424+0000 7fa302d2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:29:47.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.424+0000 7fa302d2e800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:29:47.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.424+0000 7fa302d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.424+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560977ffa980 con 0x560977ff2b80 2024-09-12T17:29:47.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.424+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa2f4051070 con 0x560977ff2b80 2024-09-12T17:29:47.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.424+0000 7fa302d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.424+0000 7fa302d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.424+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560977ffb220 con 0x560977ff2b80 2024-09-12T17:29:47.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.424+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa2f4051070 con 0x560977ff2b80 2024-09-12T17:29:47.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.424+0000 7fa302d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:47.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.424+0000 7fa302d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.424+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560977ffa5c0 con 0x560977ff7590 2024-09-12T17:29:47.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.425+0000 7fa2ff165640 1 -- 172.21.15.170:0/1671490334 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa2f8066040 con 0x560977ff7590 2024-09-12T17:29:47.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.425+0000 7fa302d2e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:29:47.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.425+0000 7fa302d2e800 20 zone default found 2024-09-12T17:29:47.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.425+0000 7fa302d2e800 4 Realm: () 2024-09-12T17:29:47.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.425+0000 7fa302d2e800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:29:47.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.425+0000 7fa302d2e800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:29:47.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.425+0000 7fa302d2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:29:47.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.425+0000 7fa302d2e800 20 zonegroup default 2024-09-12T17:29:47.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.425+0000 7fa302d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.425+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560977fff3b0 con 0x7fa2f804e940 2024-09-12T17:29:47.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.425+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa2f4051070 con 0x7fa2f804e940 2024-09-12T17:29:47.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.425+0000 7fa302d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.425+0000 7fa302d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.425+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5609780015f0 con 0x560977ffbf40 2024-09-12T17:29:47.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.425+0000 7fa2fe964640 1 -- 172.21.15.170:0/1671490334 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa2f001ab20 con 0x560977ffbf40 2024-09-12T17:29:47.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.425+0000 7fa302d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.425+0000 7fa302d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.425+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560978001990 con 0x560977ffbf40 2024-09-12T17:29:47.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.426+0000 7fa2fe964640 1 -- 172.21.15.170:0/1671490334 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa2f001ab20 con 0x560977ffbf40 2024-09-12T17:29:47.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.426+0000 7fa302d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.426+0000 7fa302d2e800 20 started sync module instance, tier type = 2024-09-12T17:29:47.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.426+0000 7fa302d2e800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:29:47.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.426+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560978000a80 con 0x560977ff7590 2024-09-12T17:29:47.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.427+0000 7fa2ff165640 1 -- 172.21.15.170:0/1671490334 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(44 notify.0 [create] v31'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2f8066040 con 0x560977ff7590 2024-09-12T17:29:47.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.427+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94598667964016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5609780006e0 con 0x560977ff7590 2024-09-12T17:29:47.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.427+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560978002870 con 0x560977ff2b80 2024-09-12T17:29:47.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.427+0000 7fa2ff165640 1 -- 172.21.15.170:0/1671490334 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94598667964016] v31'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2f8066040 con 0x560977ff7590 2024-09-12T17:29:47.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.428+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v31'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2f4051070 con 0x560977ff2b80 2024-09-12T17:29:47.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.428+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94598667967904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560978002870 con 0x560977ff2b80 2024-09-12T17:29:47.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.428+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560978003290 con 0x560977ffbf40 2024-09-12T17:29:47.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.429+0000 7fa2fe964640 1 -- 172.21.15.170:0/1671490334 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v31'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2f001ab20 con 0x560977ffbf40 2024-09-12T17:29:47.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.429+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94598667967904] v31'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2f4051070 con 0x560977ff2b80 2024-09-12T17:29:47.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.429+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94598667969472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5609780027e0 con 0x560977ffbf40 2024-09-12T17:29:47.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.429+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560978004180 con 0x560977ff7590 2024-09-12T17:29:47.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.430+0000 7fa2fe964640 1 -- 172.21.15.170:0/1671490334 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94598667969472] v31'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2f001ab20 con 0x560977ffbf40 2024-09-12T17:29:47.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.430+0000 7fa2ff165640 1 -- 172.21.15.170:0/1671490334 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(50 notify.3 [create] v31'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2f8066040 con 0x560977ff7590 2024-09-12T17:29:47.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.430+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94598667974320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560978004180 con 0x560977ff7590 2024-09-12T17:29:47.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.430+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560978004bd0 con 0x560977ff2b80 2024-09-12T17:29:47.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.431+0000 7fa2ff165640 1 -- 172.21.15.170:0/1671490334 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94598667974320] v31'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2f8066040 con 0x560977ff7590 2024-09-12T17:29:47.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.431+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v31'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2f4051070 con 0x560977ff2b80 2024-09-12T17:29:47.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.431+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94598667978464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560978004180 con 0x560977ff2b80 2024-09-12T17:29:47.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.431+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560978005620 con 0x7fa2f804e940 2024-09-12T17:29:47.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.432+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(54 notify.5 [create] v31'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2f4051070 con 0x7fa2f804e940 2024-09-12T17:29:47.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.432+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94598667981104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560978005590 con 0x7fa2f804e940 2024-09-12T17:29:47.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.432+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560978006580 con 0x7fa2f804e940 2024-09-12T17:29:47.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.432+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94598667978464] v31'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2f4051070 con 0x560977ff2b80 2024-09-12T17:29:47.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.433+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94598667981104] v31'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2f4051070 con 0x7fa2f804e940 2024-09-12T17:29:47.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.433+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v31'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2f4051070 con 0x7fa2f804e940 2024-09-12T17:29:47.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.434+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94598667985040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560978006580 con 0x7fa2f804e940 2024-09-12T17:29:47.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.434+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560978005b20 con 0x7fa2f804e940 2024-09-12T17:29:47.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.434+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94598667985040] v31'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2f4051070 con 0x7fa2f804e940 2024-09-12T17:29:47.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.435+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(58 notify.7 [create] v31'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2f4051070 con 0x7fa2f804e940 2024-09-12T17:29:47.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.435+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94598667975888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560978005b20 con 0x7fa2f804e940 2024-09-12T17:29:47.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.435+0000 7fa302d2e800 20 add_watcher() i=0 2024-09-12T17:29:47.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.435+0000 7fa302d2e800 20 add_watcher() i=1 2024-09-12T17:29:47.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.435+0000 7fa302d2e800 20 add_watcher() i=2 2024-09-12T17:29:47.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.435+0000 7fa302d2e800 20 add_watcher() i=3 2024-09-12T17:29:47.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.435+0000 7fa302d2e800 20 add_watcher() i=4 2024-09-12T17:29:47.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.435+0000 7fa302d2e800 20 add_watcher() i=5 2024-09-12T17:29:47.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.435+0000 7fa302d2e800 20 add_watcher() i=6 2024-09-12T17:29:47.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.436+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94598667975888] v31'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2f4051070 con 0x7fa2f804e940 2024-09-12T17:29:47.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.436+0000 7fa302d2e800 20 add_watcher() i=7 2024-09-12T17:29:47.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.436+0000 7fa302d2e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:29:47.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.436+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560978009e80 con 0x560977ff2b80 2024-09-12T17:29:47.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.436+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa2f4051070 con 0x560977ff2b80 2024-09-12T17:29:47.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.436+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94598667987360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560978007350 con 0x560977ff2b80 2024-09-12T17:29:47.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.437+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94598667987360] v31'251 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa2f4051070 con 0x560977ff2b80 2024-09-12T17:29:47.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.437+0000 7fa1b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:47.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.437+0000 7fa302d2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:29:47.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.437+0000 7fa302d2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:29:47.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.438+0000 7fa302d2e800 5 note: GC not initialized 2024-09-12T17:29:47.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.438+0000 7fa12ffff640 20 reqs_thread_entry: start 2024-09-12T17:29:47.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.438+0000 7fa302d2e800 20 init_complete bucket index max shards: 11 2024-09-12T17:29:47.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.438+0000 7fa302d2e800 20 Filter name: none 2024-09-12T17:29:47.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.438+0000 7fa12dffb640 20 reqs_thread_entry: start 2024-09-12T17:29:47.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.438+0000 7fa302d2e800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-12T17:29:47.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.438+0000 7fa302d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.438+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:62 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56097803ce70 con 0x560977ffbf40 2024-09-12T17:29:47.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.438+0000 7fa2fe964640 1 -- 172.21.15.170:0/1671490334 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(62 a_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 234+0+0 (crc 0 0 0) 0x7fa2f001ab20 con 0x560977ffbf40 2024-09-12T17:29:47.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.438+0000 7fa302d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.438+0000 7fa302d2e800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x0 2024-09-12T17:29:47.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.438+0000 7fa302d2e800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-12T17:29:47.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.438+0000 7fa302d2e800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : miss 2024-09-12T17:29:47.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.438+0000 7fa302d2e800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.438+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:63 8.15 8:afe09604:users.keys::true_admin_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56097803b530 con 0x560977ffbf40 2024-09-12T17:29:47.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.439+0000 7fa2fe964640 1 -- 172.21.15.170:0/1671490334 <== osd.3 v2:172.21.15.170:6816/2664906588 15 ==== osd_op_reply(63 true_admin_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 201+0+0 (crc 0 0 0) 0x7fa2f001ab20 con 0x560977ffbf40 2024-09-12T17:29:47.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.439+0000 7fa302d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.439+0000 7fa302d2e800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x0 2024-09-12T17:29:47.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.439+0000 7fa302d2e800 10 adding default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-12T17:29:47.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.439+0000 7fa302d2e800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-12T17:29:47.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.439+0000 7fa302d2e800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-12T17:29:47.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.439+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:64 8.14 8:2efb937b:users.uid::a_user:head [delete,create,call version.set in=58b,writefull 0~363 in=363b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56097803bdd0 con 0x560977ffbf40 2024-09-12T17:29:47.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.440+0000 7fa2fe964640 1 -- 172.21.15.170:0/1671490334 <== osd.3 v2:172.21.15.170:6816/2664906588 16 ==== osd_op_reply(64 a_user [delete,create,call,writefull 0~363] v31'1 uv1 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7fa2f001ab20 con 0x560977ffbf40 2024-09-12T17:29:47.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.440+0000 7fa302d2e800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-12T17:29:47.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.440+0000 7fa302d2e800 10 moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-12T17:29:47.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.440+0000 7fa302d2e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-12T17:29:47.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.440+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [notify cookie 94598668204320 in=554b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56097803c000 con 0x560977ffbf40 2024-09-12T17:29:47.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.440+0000 7fa2fe964640 1 -- 172.21.15.170:0/1671490334 <== osd.3 v2:172.21.15.170:6816/2664906588 17 ==== watch-notify(notify (1) cookie 94598667969472 notify 133143986195 ret 0) ==== 584+0+0 (crc 0 0 0) 0x56097803c7c0 con 0x560977ffbf40 2024-09-12T17:29:47.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.440+0000 7fa1e27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986195 cookie 94598667969472 notifier 4855 bl.length()=542 2024-09-12T17:29:47.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.440+0000 7fa1e27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-12T17:29:47.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.440+0000 7fa2fe964640 1 -- 172.21.15.170:0/1671490334 <== osd.3 v2:172.21.15.170:6816/2664906588 18 ==== osd_op_reply(65 notify.2 [notify cookie 94598668204320 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa2f001ab20 con 0x560977ffbf40 2024-09-12T17:29:47.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.440+0000 7fa1e27fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-12T17:29:47.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.440+0000 7fa1e27fc640 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fa1c4003ea0 con 0x560977ffbf40 2024-09-12T17:29:47.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.440+0000 7fa2fe964640 1 -- 172.21.15.170:0/1671490334 <== osd.3 v2:172.21.15.170:6816/2664906588 19 ==== osd_op_reply(66 notify.2 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2f001ab20 con 0x560977ffbf40 2024-09-12T17:29:47.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.440+0000 7fa2fe964640 1 -- 172.21.15.170:0/1671490334 <== osd.3 v2:172.21.15.170:6816/2664906588 20 ==== watch-notify(notify_complete (2) cookie 94598668204320 notify 133143986195 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa2f0059040 con 0x560977ffbf40 2024-09-12T17:29:47.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.440+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:67 8.15 8:afe09604:users.keys::true_admin_akey:head [delete,create,writefull 0~10 in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56097803b920 con 0x560977ffbf40 2024-09-12T17:29:47.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.442+0000 7fa2fe964640 1 -- 172.21.15.170:0/1671490334 <== osd.3 v2:172.21.15.170:6816/2664906588 21 ==== osd_op_reply(67 true_admin_akey [delete,create,writefull 0~10] v31'3 uv3 ondisk = 0) ==== 243+0+0 (crc 0 0 0) 0x7fa2f001ab20 con 0x560977ffbf40 2024-09-12T17:29:47.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.442+0000 7fa302d2e800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-12T17:29:47.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.442+0000 7fa302d2e800 10 moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-12T17:29:47.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.442+0000 7fa302d2e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-12T17:29:47.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.442+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94598668204320 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56097803f950 con 0x7fa2f804e940 2024-09-12T17:29:47.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.442+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== watch-notify(notify (1) cookie 94598667981104 notify 133143986224 ret 0) ==== 217+0+0 (crc 0 0 0) 0x7fa2f4082040 con 0x7fa2f804e940 2024-09-12T17:29:47.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.442+0000 7fa1e27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986224 cookie 94598667981104 notifier 4855 bl.length()=175 2024-09-12T17:29:47.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.442+0000 7fa1e27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-12T17:29:47.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.442+0000 7fa1e27fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-12T17:29:47.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.442+0000 7fa1e27fc640 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fa1c4003ea0 con 0x7fa2f804e940 2024-09-12T17:29:47.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.442+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(68 notify.5 [notify cookie 94598668204320 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa2f4051070 con 0x7fa2f804e940 2024-09-12T17:29:47.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.442+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2f4051070 con 0x7fa2f804e940 2024-09-12T17:29:47.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.442+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== watch-notify(notify_complete (2) cookie 94598668204320 notify 133143986224 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560977d4f6b0 con 0x7fa2f804e940 2024-09-12T17:29:47.457 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"a_user","display_name":"True Admin User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"a_user","access_key":"true_admin_akey","secret_key":"true_admin_skey","active":true,"create_date":"2024-09-12T17:29:47.439997Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","admin":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:29:47.439984Z","tags":[],"group_ids":[]} 2024-09-12T17:29:47.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.443+0000 7fa1b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:47.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.443+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94598667987360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56097803f950 con 0x560977ff2b80 2024-09-12T17:29:47.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.444+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94598667987360] v31'252 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa2f4051070 con 0x560977ff2b80 2024-09-12T17:29:47.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.444+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94598667964016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56097803ace0 con 0x560977ff7590 2024-09-12T17:29:47.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.445+0000 7fa2ff165640 1 -- 172.21.15.170:0/1671490334 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94598667964016] v31'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2f8066040 con 0x560977ff7590 2024-09-12T17:29:47.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.445+0000 7fa302d2e800 20 remove_watcher() i=0 2024-09-12T17:29:47.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.445+0000 7fa302d2e800 2 removed watcher, disabling cache 2024-09-12T17:29:47.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.445+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94598667967904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56097803f950 con 0x560977ff2b80 2024-09-12T17:29:47.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.446+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94598667967904] v31'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2f4051070 con 0x560977ff2b80 2024-09-12T17:29:47.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.446+0000 7fa302d2e800 20 remove_watcher() i=1 2024-09-12T17:29:47.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.446+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94598667969472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56097803ace0 con 0x560977ffbf40 2024-09-12T17:29:47.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.447+0000 7fa2fe964640 1 -- 172.21.15.170:0/1671490334 <== osd.3 v2:172.21.15.170:6816/2664906588 22 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94598667969472] v31'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2f001ab20 con 0x560977ffbf40 2024-09-12T17:29:47.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.447+0000 7fa302d2e800 20 remove_watcher() i=2 2024-09-12T17:29:47.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.447+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94598667974320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56097803f950 con 0x560977ff7590 2024-09-12T17:29:47.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.448+0000 7fa2ff165640 1 -- 172.21.15.170:0/1671490334 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94598667974320] v31'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2f8066040 con 0x560977ff7590 2024-09-12T17:29:47.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.448+0000 7fa302d2e800 20 remove_watcher() i=3 2024-09-12T17:29:47.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.448+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94598667978464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56097803ace0 con 0x560977ff2b80 2024-09-12T17:29:47.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.449+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94598667978464] v31'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2f4051070 con 0x560977ff2b80 2024-09-12T17:29:47.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.449+0000 7fa302d2e800 20 remove_watcher() i=4 2024-09-12T17:29:47.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.449+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94598667981104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56097803f950 con 0x7fa2f804e940 2024-09-12T17:29:47.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.450+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94598667981104] v31'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2f4051070 con 0x7fa2f804e940 2024-09-12T17:29:47.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.450+0000 7fa302d2e800 20 remove_watcher() i=5 2024-09-12T17:29:47.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.450+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94598667985040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56097803ace0 con 0x7fa2f804e940 2024-09-12T17:29:47.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.451+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94598667985040] v31'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2f4051070 con 0x7fa2f804e940 2024-09-12T17:29:47.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.451+0000 7fa302d2e800 20 remove_watcher() i=6 2024-09-12T17:29:47.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.451+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94598667975888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56097803f950 con 0x7fa2f804e940 2024-09-12T17:29:47.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.452+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 <== osd.0 v2:172.21.15.47:6800/3978157098 22 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94598667975888] v31'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2f4051070 con 0x7fa2f804e940 2024-09-12T17:29:47.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.452+0000 7fa302d2e800 20 remove_watcher() i=7 2024-09-12T17:29:47.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.453+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fa2f804e940 msgr2=0x7fa2f803c3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.453+0000 7fa302d2e800 1 --2- 172.21.15.170:0/1671490334 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fa2f804e940 0x7fa2f803c3f0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.453+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x560977ff2b80 msgr2=0x560977ff5040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.453+0000 7fa302d2e800 1 --2- 172.21.15.170:0/1671490334 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x560977ff2b80 0x560977ff5040 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.453+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x560977ff7590 msgr2=0x560977ff9980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.453+0000 7fa302d2e800 1 --2- 172.21.15.170:0/1671490334 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x560977ff7590 0x560977ff9980 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.453+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x560977ffbf40 msgr2=0x560977ffe400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.453+0000 7fa302d2e800 1 --2- 172.21.15.170:0/1671490334 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x560977ffbf40 0x560977ffe400 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.453+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa1c803c730 msgr2=0x7fa1c803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.453+0000 7fa302d2e800 1 --2- 172.21.15.170:0/1671490334 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa1c803c730 0x7fa1c803ebf0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0053af0 tx=0x7fa2f0030000 comp rx=0 tx=0).stop 2024-09-12T17:29:47.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.453+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560977fdfc80 msgr2=0x560977fe7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.453+0000 7fa302d2e800 1 --2- 172.21.15.170:0/1671490334 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560977fdfc80 0x560977fe7260 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fa2f80147d0 tx=0x7fa2f8053cf0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.453+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 reap_dead start 2024-09-12T17:29:47.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.453+0000 7fa2fe163640 1 -- 172.21.15.170:0/1671490334 reap_dead start 2024-09-12T17:29:47.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.453+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 shutdown_connections 2024-09-12T17:29:47.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.453+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 >> 172.21.15.170:0/1671490334 conn(0x560977fdc0a0 msgr2=0x560977fda2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:47.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.453+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 shutdown_connections 2024-09-12T17:29:47.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.453+0000 7fa302d2e800 1 -- 172.21.15.170:0/1671490334 wait complete. 2024-09-12T17:29:47.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.453+0000 7fa302d2e800 1 -- 172.21.15.170:0/3251106769 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa1d803c730 msgr2=0x7fa1d803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.453+0000 7fa302d2e800 1 --2- 172.21.15.170:0/3251106769 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa1d803c730 0x7fa1d803ebf0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa2f000c720 tx=0x7fa2f0043050 comp rx=0 tx=0).stop 2024-09-12T17:29:47.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.453+0000 7fa302d2e800 1 -- 172.21.15.170:0/3251106769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560977fd3180 msgr2=0x560977fd35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.453+0000 7fa302d2e800 1 --2- 172.21.15.170:0/3251106769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560977fd3180 0x560977fd35a0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x560977fb9160 tx=0x7fa2f80167b0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.453+0000 7fa302d2e800 1 -- 172.21.15.170:0/3251106769 shutdown_connections 2024-09-12T17:29:47.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.453+0000 7fa302d2e800 1 --2- 172.21.15.170:0/3251106769 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa1d803c730 0x7fa1d803ebf0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.453+0000 7fa302d2e800 1 --2- 172.21.15.170:0/3251106769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560977fd3180 0x560977fd35a0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.453+0000 7fa302d2e800 1 -- 172.21.15.170:0/3251106769 >> 172.21.15.170:0/3251106769 conn(0x560977fc7530 msgr2=0x560977fc7910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:47.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.453+0000 7fa302d2e800 1 -- 172.21.15.170:0/3251106769 shutdown_connections 2024-09-12T17:29:47.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.453+0000 7fa302d2e800 1 -- 172.21.15.170:0/3251106769 wait complete. 2024-09-12T17:29:47.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.453+0000 7fa302d2e800 1 -- 172.21.15.170:0/1666619865 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x560977ebf010 msgr2=0x560977fbf920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.453+0000 7fa302d2e800 1 --2- 172.21.15.170:0/1666619865 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x560977ebf010 0x560977fbf920 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.453+0000 7fa302d2e800 1 -- 172.21.15.170:0/1666619865 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x560977fc1cc0 msgr2=0x560977fc4160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.453+0000 7fa302d2e800 1 --2- 172.21.15.170:0/1666619865 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x560977fc1cc0 0x560977fc4160 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.454+0000 7fa302d2e800 1 -- 172.21.15.170:0/1666619865 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa1e403c730 msgr2=0x7fa1e403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.454+0000 7fa302d2e800 1 --2- 172.21.15.170:0/1666619865 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa1e403c730 0x7fa1e403ebf0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4057000 tx=0x7fa2f4052000 comp rx=0 tx=0).stop 2024-09-12T17:29:47.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.454+0000 7fa302d2e800 1 -- 172.21.15.170:0/1666619865 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560977ebd4f0 msgr2=0x560977fb82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.454+0000 7fa302d2e800 1 --2- 172.21.15.170:0/1666619865 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560977ebd4f0 0x560977fb82d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fa2f000c010 tx=0x7fa2f0000ed0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.454+0000 7fa302d2e800 1 -- 172.21.15.170:0/1666619865 shutdown_connections 2024-09-12T17:29:47.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.454+0000 7fa302d2e800 1 --2- 172.21.15.170:0/1666619865 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x560977fc1cc0 0x560977fc4160 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.454+0000 7fa302d2e800 1 --2- 172.21.15.170:0/1666619865 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa1e403c730 0x7fa1e403ebf0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.454+0000 7fa302d2e800 1 --2- 172.21.15.170:0/1666619865 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x560977ebf010 0x560977fbf920 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.454+0000 7fa302d2e800 1 --2- 172.21.15.170:0/1666619865 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560977ebd4f0 0x560977fb82d0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.454+0000 7fa302d2e800 1 -- 172.21.15.170:0/1666619865 >> 172.21.15.170:0/1666619865 conn(0x560977eb9220 msgr2=0x560977fb1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:47.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.454+0000 7fa302d2e800 1 -- 172.21.15.170:0/1666619865 shutdown_connections 2024-09-12T17:29:47.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.454+0000 7fa302d2e800 1 -- 172.21.15.170:0/1666619865 wait complete. 2024-09-12T17:29:47.469 DEBUG:tasks.util.rgw: json result: {'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-12T17:29:47.439997Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:29:47.439984Z', 'tags': [], 'group_ids': []} 2024-09-12T17:29:47.469 ERROR:root:{'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-12T17:29:47.439997Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:29:47.439984Z', 'tags': [], 'group_ids': []} 2024-09-12T17:29:47.469 ERROR:root:0 2024-09-12T17:29:47.470 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T17:29:47.475 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:29:47.476 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'a_user'] 2024-09-12T17:29:47.476 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'a_user'] 2024-09-12T17:29:47.476 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid a_user 2024-09-12T17:29:47.521 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:29:47.521 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:29:47.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.520+0000 7f93eec96800 1 Processor -- start 2024-09-12T17:29:47.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.520+0000 7f93eec96800 1 -- start start 2024-09-12T17:29:47.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.520+0000 7f93eec96800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x563d84674df0 0x563d84675af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.520+0000 7f93eec96800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563d8451fe40 con 0x563d84676030 2024-09-12T17:29:47.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.520+0000 7f93eec96800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x563d844ea680 con 0x563d84674df0 2024-09-12T17:29:47.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.521+0000 7f93ec780640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x563d84674df0 0x563d84675af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.521+0000 7f93e3f7f640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x563d84676030 0x563d8467ad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:44902/0 (socket says 172.21.15.170:44902) 2024-09-12T17:29:47.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.521+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2484203978 learned_addr learned my addr 172.21.15.170:0/2484203978 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:29:47.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.521+0000 7f93ec780640 1 -- 172.21.15.170:0/2484203978 >> v1:172.21.15.47:6789/0 conn(0x563d84676030 legacy=0x563d8467ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.521+0000 7f93ec780640 1 -- 172.21.15.170:0/2484203978 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d845066b0 con 0x563d84674df0 2024-09-12T17:29:47.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.523+0000 7f93ec780640 1 --2- 172.21.15.170:0/2484203978 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563d84674df0 0x563d84675af0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f93dc00a470 tx=0x7f93dc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fa02f3f3c7ff57 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.523+0000 7f93ebf7f640 1 -- 172.21.15.170:0/2484203978 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93dc053570 con 0x563d84674df0 2024-09-12T17:29:47.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.523+0000 7f93ebf7f640 1 -- 172.21.15.170:0/2484203978 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93dc058070 con 0x563d84674df0 2024-09-12T17:29:47.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.523+0000 7f93ebf7f640 1 -- 172.21.15.170:0/2484203978 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93dc053880 con 0x563d84674df0 2024-09-12T17:29:47.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.523+0000 7f93eec96800 1 -- 172.21.15.170:0/2484203978 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563d84674df0 msgr2=0x563d84675af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.523+0000 7f93eec96800 1 --2- 172.21.15.170:0/2484203978 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563d84674df0 0x563d84675af0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f93dc00a470 tx=0x7f93dc045a20 comp rx=0 tx=0).stop 2024-09-12T17:29:47.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.523+0000 7f93eec96800 1 -- 172.21.15.170:0/2484203978 shutdown_connections 2024-09-12T17:29:47.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.523+0000 7f93eec96800 1 --2- 172.21.15.170:0/2484203978 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563d84674df0 0x563d84675af0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.523+0000 7f93eec96800 1 -- 172.21.15.170:0/2484203978 >> 172.21.15.170:0/2484203978 conn(0x563d846701c0 msgr2=0x563d84672620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:47.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.523+0000 7f93eec96800 1 -- 172.21.15.170:0/2484203978 shutdown_connections 2024-09-12T17:29:47.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.523+0000 7f93eec96800 1 -- 172.21.15.170:0/2484203978 wait complete. 2024-09-12T17:29:47.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.537+0000 7f93eec96800 1 Processor -- start 2024-09-12T17:29:47.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.537+0000 7f93eec96800 1 -- start start 2024-09-12T17:29:47.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.537+0000 7f93eec96800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563d84674df0 0x563d84767870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.537+0000 7f93eec96800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x563d8450edd0 con 0x563d84674df0 2024-09-12T17:29:47.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.537+0000 7f93ec780640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563d84674df0 0x563d84767870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.538+0000 7f93ec780640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563d84674df0 0x563d84767870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35076/0 (socket says 172.21.15.170:35076) 2024-09-12T17:29:47.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.538+0000 7f93ec780640 1 -- 172.21.15.170:0/4092322110 learned_addr learned my addr 172.21.15.170:0/4092322110 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:47.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.538+0000 7f93ec780640 1 -- 172.21.15.170:0/4092322110 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d84527e10 con 0x563d84674df0 2024-09-12T17:29:47.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.538+0000 7f93ec780640 1 --2- 172.21.15.170:0/4092322110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563d84674df0 0x563d84767870 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f93dc025c20 tx=0x7f93dc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=829c7ce3d526d5c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.538+0000 7f92da60c640 1 -- 172.21.15.170:0/4092322110 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93dc053a20 con 0x563d84674df0 2024-09-12T17:29:47.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.538+0000 7f92da60c640 1 -- 172.21.15.170:0/4092322110 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93dc063070 con 0x563d84674df0 2024-09-12T17:29:47.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.538+0000 7f92da60c640 1 -- 172.21.15.170:0/4092322110 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93dc053cf0 con 0x563d84674df0 2024-09-12T17:29:47.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.539+0000 7f93eec96800 1 -- 172.21.15.170:0/4092322110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563d84674df0 msgr2=0x563d84767870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.539+0000 7f93eec96800 1 --2- 172.21.15.170:0/4092322110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563d84674df0 0x563d84767870 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f93dc025c20 tx=0x7f93dc051000 comp rx=0 tx=0).stop 2024-09-12T17:29:47.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.539+0000 7f93eec96800 1 -- 172.21.15.170:0/4092322110 shutdown_connections 2024-09-12T17:29:47.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.539+0000 7f93eec96800 1 --2- 172.21.15.170:0/4092322110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563d84674df0 0x563d84767870 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.539+0000 7f93eec96800 1 -- 172.21.15.170:0/4092322110 >> 172.21.15.170:0/4092322110 conn(0x563d846701c0 msgr2=0x563d8475ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:47.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.539+0000 7f93eec96800 1 -- 172.21.15.170:0/4092322110 shutdown_connections 2024-09-12T17:29:47.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.539+0000 7f93eec96800 1 -- 172.21.15.170:0/4092322110 wait complete. 2024-09-12T17:29:47.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.539+0000 7f93eec96800 1 Processor -- start 2024-09-12T17:29:47.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.539+0000 7f93eec96800 1 -- start start 2024-09-12T17:29:47.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.539+0000 7f93eec96800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563d84674df0 0x563d8476f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.539+0000 7f93eec96800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x563d84676720 con 0x563d84674df0 2024-09-12T17:29:47.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.540+0000 7f93ec780640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563d84674df0 0x563d8476f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.540+0000 7f93ec780640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563d84674df0 0x563d8476f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35080/0 (socket says 172.21.15.170:35080) 2024-09-12T17:29:47.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.540+0000 7f93ec780640 1 -- 172.21.15.170:0/350406953 learned_addr learned my addr 172.21.15.170:0/350406953 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:47.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.540+0000 7f93ec780640 1 -- 172.21.15.170:0/350406953 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d8476f5f0 con 0x563d84674df0 2024-09-12T17:29:47.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.540+0000 7f93ec780640 1 --2- 172.21.15.170:0/350406953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563d84674df0 0x563d8476f090 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f93dc025c20 tx=0x7f93dc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.540+0000 7f92d8e09640 1 -- 172.21.15.170:0/350406953 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93dc06c030 con 0x563d84674df0 2024-09-12T17:29:47.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.540+0000 7f92d8e09640 1 -- 172.21.15.170:0/350406953 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93dc068660 con 0x563d84674df0 2024-09-12T17:29:47.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.540+0000 7f93eec96800 1 -- 172.21.15.170:0/350406953 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563d8476f880 con 0x563d84674df0 2024-09-12T17:29:47.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.540+0000 7f92d8e09640 1 -- 172.21.15.170:0/350406953 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93dc068940 con 0x563d84674df0 2024-09-12T17:29:47.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.540+0000 7f93eec96800 1 -- 172.21.15.170:0/350406953 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d84770280 con 0x563d84674df0 2024-09-12T17:29:47.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.541+0000 7f92d8e09640 1 -- 172.21.15.170:0/350406953 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f93dc068ae0 con 0x563d84674df0 2024-09-12T17:29:47.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.541+0000 7f92d8e09640 1 --2- 172.21.15.170:0/350406953 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f92d403c780 0x7f92d403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.541+0000 7f92d8e09640 1 -- 172.21.15.170:0/350406953 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f93dc097f10 con 0x563d84674df0 2024-09-12T17:29:47.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.541+0000 7f93e3f7f640 1 --2- 172.21.15.170:0/350406953 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f92d403c780 0x7f92d403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.541+0000 7f93eec96800 1 --2- 172.21.15.170:0/350406953 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x563d84676030 0x563d847766e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.542+0000 7f93eec96800 1 -- 172.21.15.170:0/350406953 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563d84770e70 con 0x563d84676030 2024-09-12T17:29:47.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.542+0000 7f93ecf81640 1 --2- 172.21.15.170:0/350406953 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x563d84676030 0x563d847766e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.542+0000 7f93e3f7f640 1 --2- 172.21.15.170:0/350406953 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f92d403c780 0x7f92d403ec40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f93d4001d70 tx=0x7f93d40012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.542+0000 7f93ecf81640 1 --2- 172.21.15.170:0/350406953 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x563d84676030 0x563d847766e0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.542+0000 7f93ecf81640 1 -- 172.21.15.170:0/350406953 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f93e400a4d0 con 0x563d84676030 2024-09-12T17:29:47.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.542+0000 7f93eec96800 1 -- 172.21.15.170:0/350406953 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563d84777140 con 0x563d84676030 2024-09-12T17:29:47.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.542+0000 7f93ecf81640 1 -- 172.21.15.170:0/350406953 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f93e400a4d0 con 0x563d84676030 2024-09-12T17:29:47.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.542+0000 7f93eec96800 1 --2- 172.21.15.170:0/350406953 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x563d84778a50 0x563d8477aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.542+0000 7f93eec96800 1 -- 172.21.15.170:0/350406953 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563d8477b680 con 0x563d84778a50 2024-09-12T17:29:47.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.543+0000 7f93ec780640 1 --2- 172.21.15.170:0/350406953 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x563d84778a50 0x563d8477aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.543+0000 7f93ec780640 1 --2- 172.21.15.170:0/350406953 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x563d84778a50 0x563d8477aef0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.543+0000 7f93ec780640 1 -- 172.21.15.170:0/350406953 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f93dc051070 con 0x563d84778a50 2024-09-12T17:29:47.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.543+0000 7f93eec96800 1 -- 172.21.15.170:0/350406953 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563d84777990 con 0x563d84676030 2024-09-12T17:29:47.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.543+0000 7f93ecf81640 1 -- 172.21.15.170:0/350406953 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f93e400a4d0 con 0x563d84676030 2024-09-12T17:29:47.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.543+0000 7f93eec96800 1 -- 172.21.15.170:0/350406953 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563d84777d30 con 0x563d84778a50 2024-09-12T17:29:47.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.544+0000 7f93ec780640 1 -- 172.21.15.170:0/350406953 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f93dc051070 con 0x563d84778a50 2024-09-12T17:29:47.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.544+0000 7f93eec96800 1 Processor -- start 2024-09-12T17:29:47.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.544+0000 7f93eec96800 1 -- start start 2024-09-12T17:29:47.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.544+0000 7f93eec96800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563d84789f10 0x563d8478a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.544+0000 7f93eec96800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x563d8456ca00 con 0x563d84789f10 2024-09-12T17:29:47.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.545+0000 7f93ecf81640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563d84789f10 0x563d8478a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.545+0000 7f93ecf81640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563d84789f10 0x563d8478a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35090/0 (socket says 172.21.15.170:35090) 2024-09-12T17:29:47.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.545+0000 7f93ecf81640 1 -- 172.21.15.170:0/4005786180 learned_addr learned my addr 172.21.15.170:0/4005786180 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:47.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.545+0000 7f93ecf81640 1 -- 172.21.15.170:0/4005786180 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d8478a970 con 0x563d84789f10 2024-09-12T17:29:47.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.545+0000 7f93ecf81640 1 --2- 172.21.15.170:0/4005786180 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563d84789f10 0x563d8478a330 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x563d84770090 tx=0x7f93e40167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.546+0000 7f92d1ffb640 1 -- 172.21.15.170:0/4005786180 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93e4013640 con 0x563d84789f10 2024-09-12T17:29:47.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.546+0000 7f92d1ffb640 1 -- 172.21.15.170:0/4005786180 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93e40137e0 con 0x563d84789f10 2024-09-12T17:29:47.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.546+0000 7f93eec96800 1 -- 172.21.15.170:0/4005786180 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563d8478b1a0 con 0x563d84789f10 2024-09-12T17:29:47.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.546+0000 7f92d1ffb640 1 -- 172.21.15.170:0/4005786180 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93e4013ae0 con 0x563d84789f10 2024-09-12T17:29:47.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.546+0000 7f93eec96800 1 -- 172.21.15.170:0/4005786180 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d8478b740 con 0x563d84789f10 2024-09-12T17:29:47.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.547+0000 7f92d1ffb640 1 -- 172.21.15.170:0/4005786180 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f93e4011040 con 0x563d84789f10 2024-09-12T17:29:47.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.547+0000 7f92d1ffb640 1 --2- 172.21.15.170:0/4005786180 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f92c403c780 0x7f92c403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.547+0000 7f92d1ffb640 1 -- 172.21.15.170:0/4005786180 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f93e400e040 con 0x563d84789f10 2024-09-12T17:29:47.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.547+0000 7f93ec780640 1 --2- 172.21.15.170:0/4005786180 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f92c403c780 0x7f92c403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.547+0000 7f93eec96800 1 Processor -- start 2024-09-12T17:29:47.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.547+0000 7f93eec96800 1 -- start start 2024-09-12T17:29:47.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.547+0000 7f93ec780640 1 --2- 172.21.15.170:0/4005786180 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f92c403c780 0x7f92c403ec40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x563d847708d0 tx=0x7f93dc068eb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.547+0000 7f93eec96800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563d84796a10 0x563d84796df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.547+0000 7f93eec96800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x563d84768060 con 0x563d84796a10 2024-09-12T17:29:47.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.548+0000 7f93ecf81640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563d84796a10 0x563d84796df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.548+0000 7f93ecf81640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563d84796a10 0x563d84796df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35104/0 (socket says 172.21.15.170:35104) 2024-09-12T17:29:47.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.548+0000 7f93ecf81640 1 -- 172.21.15.170:0/2348544410 learned_addr learned my addr 172.21.15.170:0/2348544410 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:47.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.548+0000 7f93ecf81640 1 -- 172.21.15.170:0/2348544410 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d847973e0 con 0x563d84796a10 2024-09-12T17:29:47.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.548+0000 7f93ecf81640 1 --2- 172.21.15.170:0/2348544410 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563d84796a10 0x563d84796df0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f93e4053d70 tx=0x7f93e4020690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9489346125b25a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.548+0000 7f92cb7fe640 1 -- 172.21.15.170:0/2348544410 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93e404a070 con 0x563d84796a10 2024-09-12T17:29:47.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.548+0000 7f92cb7fe640 1 -- 172.21.15.170:0/2348544410 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93e4055040 con 0x563d84796a10 2024-09-12T17:29:47.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.548+0000 7f92cb7fe640 1 -- 172.21.15.170:0/2348544410 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93e4052070 con 0x563d84796a10 2024-09-12T17:29:47.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.549+0000 7f93eec96800 1 -- 172.21.15.170:0/2348544410 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563d84796a10 msgr2=0x563d84796df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.549+0000 7f93eec96800 1 --2- 172.21.15.170:0/2348544410 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563d84796a10 0x563d84796df0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f93e4053d70 tx=0x7f93e4020690 comp rx=0 tx=0).stop 2024-09-12T17:29:47.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.549+0000 7f93eec96800 1 -- 172.21.15.170:0/2348544410 shutdown_connections 2024-09-12T17:29:47.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.549+0000 7f93eec96800 1 --2- 172.21.15.170:0/2348544410 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563d84796a10 0x563d84796df0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.549+0000 7f93eec96800 1 -- 172.21.15.170:0/2348544410 >> 172.21.15.170:0/2348544410 conn(0x563d84792e10 msgr2=0x563d84791050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:47.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.549+0000 7f93eec96800 1 -- 172.21.15.170:0/2348544410 shutdown_connections 2024-09-12T17:29:47.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.549+0000 7f93eec96800 1 -- 172.21.15.170:0/2348544410 wait complete. 2024-09-12T17:29:47.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.549+0000 7f93eec96800 1 Processor -- start 2024-09-12T17:29:47.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.549+0000 7f93eec96800 1 -- start start 2024-09-12T17:29:47.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.549+0000 7f93eec96800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563d84796a10 0x563d8479dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.549+0000 7f93eec96800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x563d84797a20 con 0x563d84796a10 2024-09-12T17:29:47.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.549+0000 7f93ecf81640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563d84796a10 0x563d8479dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.549+0000 7f93ecf81640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563d84796a10 0x563d8479dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35116/0 (socket says 172.21.15.170:35116) 2024-09-12T17:29:47.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.549+0000 7f93ecf81640 1 -- 172.21.15.170:0/2305886957 learned_addr learned my addr 172.21.15.170:0/2305886957 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:47.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.550+0000 7f93ecf81640 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d8479e520 con 0x563d84796a10 2024-09-12T17:29:47.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.550+0000 7f93ecf81640 1 --2- 172.21.15.170:0/2305886957 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563d84796a10 0x563d8479dfc0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f93e40206d0 tx=0x7f93e4053d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.550+0000 7f92c9ffb640 1 -- 172.21.15.170:0/2305886957 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93e404a070 con 0x563d84796a10 2024-09-12T17:29:47.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.550+0000 7f92c9ffb640 1 -- 172.21.15.170:0/2305886957 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93e404b040 con 0x563d84796a10 2024-09-12T17:29:47.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.550+0000 7f92c9ffb640 1 -- 172.21.15.170:0/2305886957 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93e4052050 con 0x563d84796a10 2024-09-12T17:29:47.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.550+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563d8479e7b0 con 0x563d84796a10 2024-09-12T17:29:47.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.550+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d8479f130 con 0x563d84796a10 2024-09-12T17:29:47.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.551+0000 7f92c9ffb640 1 -- 172.21.15.170:0/2305886957 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f93e4021440 con 0x563d84796a10 2024-09-12T17:29:47.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.551+0000 7f92c9ffb640 1 --2- 172.21.15.170:0/2305886957 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f92bc03c6e0 0x7f92bc03eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.551+0000 7f92c9ffb640 1 -- 172.21.15.170:0/2305886957 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f93e4019000 con 0x563d84796a10 2024-09-12T17:29:47.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.551+0000 7f93ec780640 1 --2- 172.21.15.170:0/2305886957 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f92bc03c6e0 0x7f92bc03eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.552+0000 7f93ec780640 1 --2- 172.21.15.170:0/2305886957 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f92bc03c6e0 0x7f92bc03eba0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f93dc05ffd0 tx=0x7f93dc087000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.552+0000 7f93eec96800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.552+0000 7f93eec96800 1 --2- 172.21.15.170:0/2305886957 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x563d847a98d0 0x563d847abd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.552+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563d847ac4e0 con 0x563d847a98d0 2024-09-12T17:29:47.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.552+0000 7f93e3f7f640 1 --2- 172.21.15.170:0/2305886957 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x563d847a98d0 0x563d847abd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.552+0000 7f93e3f7f640 1 --2- 172.21.15.170:0/2305886957 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x563d847a98d0 0x563d847abd90 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.552+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f93d4009050 con 0x563d847a98d0 2024-09-12T17:29:47.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.552+0000 7f93eec96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.552+0000 7f93eec96800 20 realm 2024-09-12T17:29:47.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.552+0000 7f93eec96800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.552+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563d847a8c60 con 0x563d847a98d0 2024-09-12T17:29:47.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.553+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f93d4009050 con 0x563d847a98d0 2024-09-12T17:29:47.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.553+0000 7f93eec96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.553+0000 7f93eec96800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:29:47.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.553+0000 7f93eec96800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.553+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563d847acfd0 con 0x563d847a98d0 2024-09-12T17:29:47.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.553+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f93d4009050 con 0x563d847a98d0 2024-09-12T17:29:47.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.553+0000 7f93eec96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.553+0000 7f93eec96800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.553+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563d847ad8a0 con 0x563d847a98d0 2024-09-12T17:29:47.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.553+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f93d4009050 con 0x563d847a98d0 2024-09-12T17:29:47.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.553+0000 7f93eec96800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:47.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.553+0000 7f93eec96800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.553+0000 7f93eec96800 1 --2- 172.21.15.170:0/2305886957 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x563d847ae2c0 0x563d847b06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.553+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563d847b0df0 con 0x563d847ae2c0 2024-09-12T17:29:47.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.553+0000 7f93ecf81640 1 --2- 172.21.15.170:0/2305886957 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x563d847ae2c0 0x563d847b06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.553+0000 7f93ecf81640 1 --2- 172.21.15.170:0/2305886957 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x563d847ae2c0 0x563d847b06b0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.554+0000 7f93ecf81640 1 -- 172.21.15.170:0/2305886957 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f93e404d070 con 0x563d847ae2c0 2024-09-12T17:29:47.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.554+0000 7f93eec96800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:29:47.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.554+0000 7f93eec96800 20 searching for the correct realm 2024-09-12T17:29:47.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.554+0000 7f93eec96800 1 --2- 172.21.15.170:0/2305886957 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x563d847b2da0 0x563d847b5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.554+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563d847b58e0 con 0x563d847b2da0 2024-09-12T17:29:47.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.554+0000 7f93ec780640 1 --2- 172.21.15.170:0/2305886957 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x563d847b2da0 0x563d847b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.554+0000 7f93ec780640 1 --2- 172.21.15.170:0/2305886957 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x563d847b2da0 0x563d847b5260 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.554+0000 7f93ec780640 1 -- 172.21.15.170:0/2305886957 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93dc051070 con 0x563d847b2da0 2024-09-12T17:29:47.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.554+0000 7f93ec780640 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563d847b58e0 con 0x563d847ae2c0 2024-09-12T17:29:47.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.555+0000 7f93ecf81640 1 -- 172.21.15.170:0/2305886957 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93e404d070 con 0x563d847ae2c0 2024-09-12T17:29:47.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.555+0000 7f93ecf81640 1 --2- 172.21.15.170:0/2305886957 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f93e4012c00 0x7f93e401aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.555+0000 7f93ecf81640 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563d847b58e0 con 0x7f93e4012c00 2024-09-12T17:29:47.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.555+0000 7f93e3f7f640 1 --2- 172.21.15.170:0/2305886957 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f93e4012c00 0x7f93e401aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.555+0000 7f93e3f7f640 1 --2- 172.21.15.170:0/2305886957 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f93e4012c00 0x7f93e401aa70 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.556+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93d4009050 con 0x7f93e4012c00 2024-09-12T17:29:47.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.556+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563d847b58e0 con 0x563d847a98d0 2024-09-12T17:29:47.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.556+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93d4009050 con 0x563d847a98d0 2024-09-12T17:29:47.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.556+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563d847b58e0 con 0x563d847a98d0 2024-09-12T17:29:47.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.556+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93d4029040 con 0x563d847a98d0 2024-09-12T17:29:47.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.556+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563d847b58e0 con 0x7f93e4012c00 2024-09-12T17:29:47.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.556+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93d4029040 con 0x7f93e4012c00 2024-09-12T17:29:47.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.556+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563d847b58e0 con 0x7f93e4012c00 2024-09-12T17:29:47.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.557+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93d4029040 con 0x7f93e4012c00 2024-09-12T17:29:47.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.557+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563d847b58e0 con 0x563d847ae2c0 2024-09-12T17:29:47.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.557+0000 7f93ecf81640 1 -- 172.21.15.170:0/2305886957 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93e404d070 con 0x563d847ae2c0 2024-09-12T17:29:47.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.557+0000 7f93ecf81640 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563d847b58e0 con 0x563d847b2da0 2024-09-12T17:29:47.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.557+0000 7f93ec780640 1 -- 172.21.15.170:0/2305886957 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93dc051070 con 0x563d847b2da0 2024-09-12T17:29:47.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.557+0000 7f93ec780640 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563d847b58e0 con 0x563d847a98d0 2024-09-12T17:29:47.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.557+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93d4029040 con 0x563d847a98d0 2024-09-12T17:29:47.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.557+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563d847b58e0 con 0x7f93e4012c00 2024-09-12T17:29:47.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.558+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93d4029040 con 0x7f93e4012c00 2024-09-12T17:29:47.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.558+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563d847b58e0 con 0x563d847a98d0 2024-09-12T17:29:47.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.558+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93d4029040 con 0x563d847a98d0 2024-09-12T17:29:47.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.558+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563d847b58e0 con 0x563d847ae2c0 2024-09-12T17:29:47.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.558+0000 7f93ecf81640 1 -- 172.21.15.170:0/2305886957 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f93e404d070 con 0x563d847ae2c0 2024-09-12T17:29:47.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.558+0000 7f93ecf81640 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563d847b58e0 con 0x563d847b2da0 2024-09-12T17:29:47.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.558+0000 7f93ec780640 1 -- 172.21.15.170:0/2305886957 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93dc051070 con 0x563d847b2da0 2024-09-12T17:29:47.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.558+0000 7f93ec780640 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563d847b58e0 con 0x563d847b2da0 2024-09-12T17:29:47.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.559+0000 7f93ec780640 1 -- 172.21.15.170:0/2305886957 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93dc051070 con 0x563d847b2da0 2024-09-12T17:29:47.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.559+0000 7f93ec780640 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563d847b58e0 con 0x563d847ae2c0 2024-09-12T17:29:47.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.559+0000 7f93ecf81640 1 -- 172.21.15.170:0/2305886957 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93e404d070 con 0x563d847ae2c0 2024-09-12T17:29:47.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.559+0000 7f93ecf81640 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563d847b58e0 con 0x563d847b2da0 2024-09-12T17:29:47.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.559+0000 7f93ec780640 1 -- 172.21.15.170:0/2305886957 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93dc051070 con 0x563d847b2da0 2024-09-12T17:29:47.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.559+0000 7f93ec780640 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563d847b58e0 con 0x563d847b2da0 2024-09-12T17:29:47.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.559+0000 7f93ec780640 1 -- 172.21.15.170:0/2305886957 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93dc051070 con 0x563d847b2da0 2024-09-12T17:29:47.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.559+0000 7f93ec780640 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563d847b58e0 con 0x563d847a98d0 2024-09-12T17:29:47.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.559+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93d4029040 con 0x563d847a98d0 2024-09-12T17:29:47.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.560+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563d847b58e0 con 0x563d847a98d0 2024-09-12T17:29:47.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.560+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v31'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f93d4029040 con 0x563d847a98d0 2024-09-12T17:29:47.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.560+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563d847b58e0 con 0x7f93e4012c00 2024-09-12T17:29:47.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.560+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93d4029040 con 0x7f93e4012c00 2024-09-12T17:29:47.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.560+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563d847b58e0 con 0x563d847b2da0 2024-09-12T17:29:47.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.560+0000 7f93ec780640 1 -- 172.21.15.170:0/2305886957 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93dc051070 con 0x563d847b2da0 2024-09-12T17:29:47.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.560+0000 7f93ec780640 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563d847b58e0 con 0x563d847ae2c0 2024-09-12T17:29:47.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.561+0000 7f93ecf81640 1 -- 172.21.15.170:0/2305886957 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93e404d070 con 0x563d847ae2c0 2024-09-12T17:29:47.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.561+0000 7f93ecf81640 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563d847b58e0 con 0x563d847a98d0 2024-09-12T17:29:47.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.561+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93d4029040 con 0x563d847a98d0 2024-09-12T17:29:47.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.561+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563d847b58e0 con 0x7f93e4012c00 2024-09-12T17:29:47.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.561+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93d4029040 con 0x7f93e4012c00 2024-09-12T17:29:47.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.561+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563d847b58e0 con 0x563d847b2da0 2024-09-12T17:29:47.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.561+0000 7f93ec780640 1 -- 172.21.15.170:0/2305886957 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93dc051070 con 0x563d847b2da0 2024-09-12T17:29:47.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.561+0000 7f93ec780640 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563d847b58e0 con 0x7f93e4012c00 2024-09-12T17:29:47.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.562+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93d4029040 con 0x7f93e4012c00 2024-09-12T17:29:47.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.562+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563d847b58e0 con 0x563d847ae2c0 2024-09-12T17:29:47.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.562+0000 7f93ecf81640 1 -- 172.21.15.170:0/2305886957 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93e4066040 con 0x563d847ae2c0 2024-09-12T17:29:47.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.562+0000 7f93ecf81640 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563d847b58e0 con 0x563d847b2da0 2024-09-12T17:29:47.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.562+0000 7f93ec780640 1 -- 172.21.15.170:0/2305886957 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93dc051070 con 0x563d847b2da0 2024-09-12T17:29:47.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.562+0000 7f93ec780640 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563d847b58e0 con 0x7f93e4012c00 2024-09-12T17:29:47.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.562+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93d4029040 con 0x7f93e4012c00 2024-09-12T17:29:47.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.562+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563d847b58e0 con 0x563d847a98d0 2024-09-12T17:29:47.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.563+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f93d4029040 con 0x563d847a98d0 2024-09-12T17:29:47.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.563+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563d847b58e0 con 0x563d847ae2c0 2024-09-12T17:29:47.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.563+0000 7f93ecf81640 1 -- 172.21.15.170:0/2305886957 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(37 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f93e4066040 con 0x563d847ae2c0 2024-09-12T17:29:47.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.563+0000 7f93eec96800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:29:47.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.563+0000 7f93eec96800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:29:47.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.563+0000 7f93eec96800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:29:47.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.563+0000 7f93eec96800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:29:47.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.563+0000 7f93eec96800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:29:47.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.563+0000 7f93eec96800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:29:47.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.563+0000 7f93eec96800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.563+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563d847b17b0 con 0x563d847a98d0 2024-09-12T17:29:47.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.563+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f93d4029040 con 0x563d847a98d0 2024-09-12T17:29:47.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.563+0000 7f93eec96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.563+0000 7f93eec96800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.563+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563d847b2050 con 0x563d847a98d0 2024-09-12T17:29:47.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.563+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f93d4029040 con 0x563d847a98d0 2024-09-12T17:29:47.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.563+0000 7f93eec96800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:47.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.563+0000 7f93eec96800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.563+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563d847b13f0 con 0x563d847ae2c0 2024-09-12T17:29:47.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.564+0000 7f93ecf81640 1 -- 172.21.15.170:0/2305886957 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f93e4066040 con 0x563d847ae2c0 2024-09-12T17:29:47.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.564+0000 7f93eec96800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:29:47.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.564+0000 7f93eec96800 20 zone default found 2024-09-12T17:29:47.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.564+0000 7f93eec96800 4 Realm: () 2024-09-12T17:29:47.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.564+0000 7f93eec96800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:29:47.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.564+0000 7f93eec96800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:29:47.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.564+0000 7f93eec96800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:29:47.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.564+0000 7f93eec96800 20 zonegroup default 2024-09-12T17:29:47.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.564+0000 7f93eec96800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.564+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563d847b6210 con 0x7f93e4012c00 2024-09-12T17:29:47.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.564+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f93d4029040 con 0x7f93e4012c00 2024-09-12T17:29:47.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.564+0000 7f93eec96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.564+0000 7f93eec96800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.564+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563d847b8450 con 0x563d847b2da0 2024-09-12T17:29:47.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.564+0000 7f93ec780640 1 -- 172.21.15.170:0/2305886957 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f93dc051070 con 0x563d847b2da0 2024-09-12T17:29:47.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.564+0000 7f93eec96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.564+0000 7f93eec96800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.564+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563d847b87f0 con 0x563d847b2da0 2024-09-12T17:29:47.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.564+0000 7f93ec780640 1 -- 172.21.15.170:0/2305886957 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f93dc051070 con 0x563d847b2da0 2024-09-12T17:29:47.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.564+0000 7f93eec96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.564+0000 7f93eec96800 20 started sync module instance, tier type = 2024-09-12T17:29:47.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.564+0000 7f93eec96800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:29:47.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.564+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847b78e0 con 0x563d847ae2c0 2024-09-12T17:29:47.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.565+0000 7f93ecf81640 1 -- 172.21.15.170:0/2305886957 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(44 notify.0 [create] v31'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93e4066040 con 0x563d847ae2c0 2024-09-12T17:29:47.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.565+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94822215679184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847b7540 con 0x563d847ae2c0 2024-09-12T17:29:47.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.565+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847b96b0 con 0x563d847a98d0 2024-09-12T17:29:47.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.566+0000 7f93ecf81640 1 -- 172.21.15.170:0/2305886957 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94822215679184] v31'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93e4066040 con 0x563d847ae2c0 2024-09-12T17:29:47.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.567+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v31'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93d4029040 con 0x563d847a98d0 2024-09-12T17:29:47.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.567+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94822215683040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847b96b0 con 0x563d847a98d0 2024-09-12T17:29:47.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.567+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847ba100 con 0x563d847b2da0 2024-09-12T17:29:47.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.568+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94822215683040] v31'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93d4029040 con 0x563d847a98d0 2024-09-12T17:29:47.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.568+0000 7f93ec780640 1 -- 172.21.15.170:0/2305886957 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v31'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93dc051070 con 0x563d847b2da0 2024-09-12T17:29:47.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.568+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94822215684608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847b9620 con 0x563d847b2da0 2024-09-12T17:29:47.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.568+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847bafc0 con 0x563d847ae2c0 2024-09-12T17:29:47.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.569+0000 7f93ecf81640 1 -- 172.21.15.170:0/2305886957 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(50 notify.3 [create] v31'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93e4066040 con 0x563d847ae2c0 2024-09-12T17:29:47.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.569+0000 7f93ec780640 1 -- 172.21.15.170:0/2305886957 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94822215684608] v31'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93dc051070 con 0x563d847b2da0 2024-09-12T17:29:47.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.569+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94822215689456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847bafc0 con 0x563d847ae2c0 2024-09-12T17:29:47.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.569+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847bb980 con 0x563d847a98d0 2024-09-12T17:29:47.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.570+0000 7f93ecf81640 1 -- 172.21.15.170:0/2305886957 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94822215689456] v31'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93e4066040 con 0x563d847ae2c0 2024-09-12T17:29:47.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.570+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v31'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93d4029040 con 0x563d847a98d0 2024-09-12T17:29:47.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.570+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94822215694000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847bafc0 con 0x563d847a98d0 2024-09-12T17:29:47.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.570+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847bc3d0 con 0x7f93e4012c00 2024-09-12T17:29:47.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.571+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94822215694000] v31'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93d4029040 con 0x563d847a98d0 2024-09-12T17:29:47.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.571+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(54 notify.5 [create] v31'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93d4029040 con 0x7f93e4012c00 2024-09-12T17:29:47.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.571+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94822215696096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847bafc0 con 0x7f93e4012c00 2024-09-12T17:29:47.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.571+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847bcde0 con 0x7f93e4012c00 2024-09-12T17:29:47.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.573+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94822215696096] v31'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93d4029040 con 0x7f93e4012c00 2024-09-12T17:29:47.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.573+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v31'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93d4029040 con 0x7f93e4012c00 2024-09-12T17:29:47.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.573+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94822215691024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847bcfc0 con 0x7f93e4012c00 2024-09-12T17:29:47.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.573+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847bd810 con 0x7f93e4012c00 2024-09-12T17:29:47.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.574+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94822215691024] v31'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93d4029040 con 0x7f93e4012c00 2024-09-12T17:29:47.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.574+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(58 notify.7 [create] v31'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93d4029040 con 0x7f93e4012c00 2024-09-12T17:29:47.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.574+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94822215699696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847bd6a0 con 0x7f93e4012c00 2024-09-12T17:29:47.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.574+0000 7f93eec96800 20 add_watcher() i=0 2024-09-12T17:29:47.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.574+0000 7f93eec96800 20 add_watcher() i=1 2024-09-12T17:29:47.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.574+0000 7f93eec96800 20 add_watcher() i=2 2024-09-12T17:29:47.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.574+0000 7f93eec96800 20 add_watcher() i=3 2024-09-12T17:29:47.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.574+0000 7f93eec96800 20 add_watcher() i=4 2024-09-12T17:29:47.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.574+0000 7f93eec96800 20 add_watcher() i=5 2024-09-12T17:29:47.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.574+0000 7f93eec96800 20 add_watcher() i=6 2024-09-12T17:29:47.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.575+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94822215699696] v31'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93d4029040 con 0x7f93e4012c00 2024-09-12T17:29:47.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.575+0000 7f93eec96800 20 add_watcher() i=7 2024-09-12T17:29:47.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.575+0000 7f93eec96800 2 all 8 watchers are set, enabling cache 2024-09-12T17:29:47.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.575+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563d847c0bb0 con 0x563d847a98d0 2024-09-12T17:29:47.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.575+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f93d4029040 con 0x563d847a98d0 2024-09-12T17:29:47.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.575+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94822215700816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847be0a0 con 0x563d847a98d0 2024-09-12T17:29:47.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.576+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94822215700816] v31'253 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f93d4029040 con 0x563d847a98d0 2024-09-12T17:29:47.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.576+0000 7f92a27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:47.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.576+0000 7f93eec96800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:29:47.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.576+0000 7f93eec96800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:29:47.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.576+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847c9410 con 0x563d847a98d0 2024-09-12T17:29:47.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.578+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f93d4029040 con 0x563d847a98d0 2024-09-12T17:29:47.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.578+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847c9a60 con 0x7f93e4012c00 2024-09-12T17:29:47.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.579+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f93d4029040 con 0x7f93e4012c00 2024-09-12T17:29:47.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.579+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847c9ec0 con 0x563d847b2da0 2024-09-12T17:29:47.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.580+0000 7f93ec780640 1 -- 172.21.15.170:0/2305886957 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f93dc051070 con 0x563d847b2da0 2024-09-12T17:29:47.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.580+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847ca430 con 0x563d847a98d0 2024-09-12T17:29:47.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.581+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'254 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f93d4029040 con 0x563d847a98d0 2024-09-12T17:29:47.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.581+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847ca8e0 con 0x563d847ae2c0 2024-09-12T17:29:47.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.581+0000 7f93ecf81640 1 -- 172.21.15.170:0/2305886957 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'80 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f93e4066040 con 0x563d847ae2c0 2024-09-12T17:29:47.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.582+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847ca8e0 con 0x563d847b2da0 2024-09-12T17:29:47.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.582+0000 7f93ec780640 1 -- 172.21.15.170:0/2305886957 <== osd.3 v2:172.21.15.170:6816/2664906588 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'53 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f93dc051070 con 0x563d847b2da0 2024-09-12T17:29:47.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.582+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847c7250 con 0x563d847a98d0 2024-09-12T17:29:47.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.583+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f93d4029040 con 0x563d847a98d0 2024-09-12T17:29:47.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.584+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847c7250 con 0x7f93e4012c00 2024-09-12T17:29:47.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.584+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'53 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f93d4029040 con 0x7f93e4012c00 2024-09-12T17:29:47.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.585+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847c7080 con 0x563d847ae2c0 2024-09-12T17:29:47.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.585+0000 7f93ecf81640 1 -- 172.21.15.170:0/2305886957 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'31 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f93e4066040 con 0x563d847ae2c0 2024-09-12T17:29:47.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.586+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847c7080 con 0x563d847b2da0 2024-09-12T17:29:47.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.586+0000 7f93ec780640 1 -- 172.21.15.170:0/2305886957 <== osd.3 v2:172.21.15.170:6816/2664906588 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f93dc051070 con 0x563d847b2da0 2024-09-12T17:29:47.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.586+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847c7080 con 0x563d847ae2c0 2024-09-12T17:29:47.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.587+0000 7f93ecf81640 1 -- 172.21.15.170:0/2305886957 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'81 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f93e4066040 con 0x563d847ae2c0 2024-09-12T17:29:47.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.587+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847c71b0 con 0x7f93e4012c00 2024-09-12T17:29:47.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.589+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'36 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f93d4029040 con 0x7f93e4012c00 2024-09-12T17:29:47.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.589+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847c71b0 con 0x563d847ae2c0 2024-09-12T17:29:47.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.589+0000 7f93ecf81640 1 -- 172.21.15.170:0/2305886957 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f93e4066040 con 0x563d847ae2c0 2024-09-12T17:29:47.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.589+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847c71b0 con 0x7f93e4012c00 2024-09-12T17:29:47.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.591+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'59 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f93d4029040 con 0x7f93e4012c00 2024-09-12T17:29:47.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.591+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847c71b0 con 0x563d847a98d0 2024-09-12T17:29:47.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.592+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'255 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f93d4029040 con 0x563d847a98d0 2024-09-12T17:29:47.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.592+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847c71b0 con 0x563d847b2da0 2024-09-12T17:29:47.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.593+0000 7f93ec780640 1 -- 172.21.15.170:0/2305886957 <== osd.3 v2:172.21.15.170:6816/2664906588 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'74 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f93dc051070 con 0x563d847b2da0 2024-09-12T17:29:47.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.593+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847c71b0 con 0x563d847ae2c0 2024-09-12T17:29:47.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.594+0000 7f93ecf81640 1 -- 172.21.15.170:0/2305886957 <== osd.2 v2:172.21.15.170:6808/3855567754 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'82 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f93e4066040 con 0x563d847ae2c0 2024-09-12T17:29:47.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.594+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847c71b0 con 0x563d847b2da0 2024-09-12T17:29:47.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.595+0000 7f93ec780640 1 -- 172.21.15.170:0/2305886957 <== osd.3 v2:172.21.15.170:6816/2664906588 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f93dc051070 con 0x563d847b2da0 2024-09-12T17:29:47.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.595+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847c71b0 con 0x563d847a98d0 2024-09-12T17:29:47.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.596+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'40 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f93d4029040 con 0x563d847a98d0 2024-09-12T17:29:47.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.596+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847c71b0 con 0x563d847a98d0 2024-09-12T17:29:47.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.597+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'256 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f93d4029040 con 0x563d847a98d0 2024-09-12T17:29:47.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.597+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847c71b0 con 0x563d847b2da0 2024-09-12T17:29:47.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.598+0000 7f93ec780640 1 -- 172.21.15.170:0/2305886957 <== osd.3 v2:172.21.15.170:6816/2664906588 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'75 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f93dc051070 con 0x563d847b2da0 2024-09-12T17:29:47.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.598+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847c71b0 con 0x563d847ae2c0 2024-09-12T17:29:47.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.599+0000 7f93ecf81640 1 -- 172.21.15.170:0/2305886957 <== osd.2 v2:172.21.15.170:6808/3855567754 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'41 uv32 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f93e4066040 con 0x563d847ae2c0 2024-09-12T17:29:47.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.599+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847c71b0 con 0x563d847b2da0 2024-09-12T17:29:47.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.600+0000 7f93ec780640 1 -- 172.21.15.170:0/2305886957 <== osd.3 v2:172.21.15.170:6816/2664906588 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f93dc051070 con 0x563d847b2da0 2024-09-12T17:29:47.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.600+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847c71b0 con 0x563d847b2da0 2024-09-12T17:29:47.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.601+0000 7f93ec780640 1 -- 172.21.15.170:0/2305886957 <== osd.3 v2:172.21.15.170:6816/2664906588 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f93dc051070 con 0x563d847b2da0 2024-09-12T17:29:47.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.601+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847c71b0 con 0x563d847b2da0 2024-09-12T17:29:47.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.602+0000 7f93ec780640 1 -- 172.21.15.170:0/2305886957 <== osd.3 v2:172.21.15.170:6816/2664906588 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'26 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f93dc051070 con 0x563d847b2da0 2024-09-12T17:29:47.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.602+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847c71b0 con 0x563d847b2da0 2024-09-12T17:29:47.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.603+0000 7f93ec780640 1 -- 172.21.15.170:0/2305886957 <== osd.3 v2:172.21.15.170:6816/2664906588 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'54 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f93dc051070 con 0x563d847b2da0 2024-09-12T17:29:47.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.603+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847c71b0 con 0x7f93e4012c00 2024-09-12T17:29:47.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.604+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f93d4029040 con 0x7f93e4012c00 2024-09-12T17:29:47.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.604+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847c71b0 con 0x563d847b2da0 2024-09-12T17:29:47.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.605+0000 7f93ec780640 1 -- 172.21.15.170:0/2305886957 <== osd.3 v2:172.21.15.170:6816/2664906588 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'32 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f93dc051070 con 0x563d847b2da0 2024-09-12T17:29:47.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.605+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847c71b0 con 0x7f93e4012c00 2024-09-12T17:29:47.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.606+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'54 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f93d4029040 con 0x7f93e4012c00 2024-09-12T17:29:47.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.606+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847c71b0 con 0x563d847b2da0 2024-09-12T17:29:47.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.607+0000 7f93ec780640 1 -- 172.21.15.170:0/2305886957 <== osd.3 v2:172.21.15.170:6816/2664906588 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'76 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f93dc051070 con 0x563d847b2da0 2024-09-12T17:29:47.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.607+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847c71b0 con 0x7f93e4012c00 2024-09-12T17:29:47.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.608+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.0 v2:172.21.15.47:6800/3978157098 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'60 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f93d4029040 con 0x7f93e4012c00 2024-09-12T17:29:47.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.608+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847c71b0 con 0x563d847ae2c0 2024-09-12T17:29:47.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.609+0000 7f93ecf81640 1 -- 172.21.15.170:0/2305886957 <== osd.2 v2:172.21.15.170:6808/3855567754 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f93e4066040 con 0x563d847ae2c0 2024-09-12T17:29:47.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.609+0000 7f92a17e2640 20 reqs_thread_entry: start 2024-09-12T17:29:47.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.609+0000 7f93eec96800 20 init_complete bucket index max shards: 11 2024-09-12T17:29:47.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.609+0000 7f93eec96800 20 Filter name: none 2024-09-12T17:29:47.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.609+0000 7f9212ffd640 20 reqs_thread_entry: start 2024-09-12T17:29:47.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.609+0000 7f93eec96800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-12T17:29:47.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.609+0000 7f93eec96800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.609+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:94 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563d847f5ff0 con 0x563d847b2da0 2024-09-12T17:29:47.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.610+0000 7f93ec780640 1 -- 172.21.15.170:0/2305886957 <== osd.3 v2:172.21.15.170:6816/2664906588 26 ==== osd_op_reply(94 a_user [call out=48b,read 0~363 out=363b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 234+0+486 (crc 0 0 0) 0x7f93dc051070 con 0x563d847b2da0 2024-09-12T17:29:47.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.610+0000 7f93eec96800 20 rados_obj.operate() r=0 bl.length=363 2024-09-12T17:29:47.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.610+0000 7f93eec96800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x13 2024-09-12T17:29:47.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.610+0000 7f93eec96800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-12T17:29:47.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.610+0000 7f93eec96800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:29:47.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.610+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:95 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563d847f8560 con 0x563d847b2da0 2024-09-12T17:29:47.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.610+0000 7f93ec780640 1 -- 172.21.15.170:0/2305886957 <== osd.3 v2:172.21.15.170:6816/2664906588 27 ==== osd_op_reply(95 a_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f93dc051070 con 0x563d847b2da0 2024-09-12T17:29:47.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.610+0000 7f93eec96800 10 removing key index: true_admin_akey 2024-09-12T17:29:47.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.610+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:96 8.15 8:afe09604:users.keys::true_admin_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847f8520 con 0x563d847b2da0 2024-09-12T17:29:47.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.611+0000 7f93ec780640 1 -- 172.21.15.170:0/2305886957 <== osd.3 v2:172.21.15.170:6816/2664906588 28 ==== osd_op_reply(96 true_admin_akey [delete] v31'4 uv4 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f93dc051070 con 0x563d847b2da0 2024-09-12T17:29:47.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.611+0000 7f93eec96800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-12T17:29:47.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.611+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify cookie 94822215942320 in=177b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563d847f74f0 con 0x7f93e4012c00 2024-09-12T17:29:47.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.611+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.0 v2:172.21.15.47:6800/3978157098 23 ==== watch-notify(notify (1) cookie 94822215696096 notify 133143986225 ret 0) ==== 207+0+0 (crc 0 0 0) 0x563d8479e7b0 con 0x7f93e4012c00 2024-09-12T17:29:47.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.611+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.0 v2:172.21.15.47:6800/3978157098 24 ==== osd_op_reply(97 notify.5 [notify cookie 94822215942320 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f93d4029040 con 0x7f93e4012c00 2024-09-12T17:29:47.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.611+0000 7f92cb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986225 cookie 94822215696096 notifier 4862 bl.length()=165 2024-09-12T17:29:47.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.611+0000 7f92cb7fe640 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f92b0003d60 con 0x7f93e4012c00 2024-09-12T17:29:47.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.612+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.0 v2:172.21.15.47:6800/3978157098 25 ==== osd_op_reply(98 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93d4029040 con 0x7f93e4012c00 2024-09-12T17:29:47.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.612+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.0 v2:172.21.15.47:6800/3978157098 26 ==== watch-notify(notify_complete (2) cookie 94822215942320 notify 133143986225 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563d847c9e00 con 0x7f93e4012c00 2024-09-12T17:29:47.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.612+0000 7f93eec96800 10 removing email index: 2024-09-12T17:29:47.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.612+0000 7f93eec96800 10 removing user buckets index 2024-09-12T17:29:47.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.612+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:99 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847f80b0 con 0x563d847b2da0 2024-09-12T17:29:47.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.613+0000 7f93ec780640 1 -- 172.21.15.170:0/2305886957 <== osd.3 v2:172.21.15.170:6816/2664906588 29 ==== osd_op_reply(99 a_user.buckets [delete] v31'1 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f93dc051070 con 0x563d847b2da0 2024-09-12T17:29:47.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.613+0000 7f93eec96800 10 removing user index: a_user 2024-09-12T17:29:47.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.613+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:100 8.14 8:2efb937b:users.uid::a_user:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847f7040 con 0x563d847b2da0 2024-09-12T17:29:47.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.613+0000 7f93ec780640 1 -- 172.21.15.170:0/2305886957 <== osd.3 v2:172.21.15.170:6816/2664906588 30 ==== osd_op_reply(100 a_user [call,call,delete] v31'2 uv2 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f93dc051070 con 0x563d847b2da0 2024-09-12T17:29:47.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.613+0000 7f93eec96800 10 removing default.rgw.meta+users.uid+a_user from cache 2024-09-12T17:29:47.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.613+0000 7f93eec96800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-12T17:29:47.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.613+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify cookie 94822215940320 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563d847f6ff0 con 0x563d847b2da0 2024-09-12T17:29:47.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.614+0000 7f93ec780640 1 -- 172.21.15.170:0/2305886957 <== osd.3 v2:172.21.15.170:6816/2664906588 31 ==== watch-notify(notify (1) cookie 94822215684608 notify 133143986196 ret 0) ==== 197+0+0 (crc 0 0 0) 0x563d847c8dc0 con 0x563d847b2da0 2024-09-12T17:29:47.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.614+0000 7f92cb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986196 cookie 94822215684608 notifier 4862 bl.length()=155 2024-09-12T17:29:47.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.614+0000 7f93ec780640 1 -- 172.21.15.170:0/2305886957 <== osd.3 v2:172.21.15.170:6816/2664906588 32 ==== osd_op_reply(101 notify.2 [notify cookie 94822215940320 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f93dc051070 con 0x563d847b2da0 2024-09-12T17:29:47.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.614+0000 7f92cb7fe640 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:102 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f92b0003d60 con 0x563d847b2da0 2024-09-12T17:29:47.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.614+0000 7f93ec780640 1 -- 172.21.15.170:0/2305886957 <== osd.3 v2:172.21.15.170:6816/2664906588 33 ==== watch-notify(notify_complete (2) cookie 94822215940320 notify 133143986196 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563d847c9a40 con 0x563d847b2da0 2024-09-12T17:29:47.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.614+0000 7f93ec780640 1 -- 172.21.15.170:0/2305886957 <== osd.3 v2:172.21.15.170:6816/2664906588 34 ==== osd_op_reply(102 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93dc051070 con 0x563d847b2da0 2024-09-12T17:29:47.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.615+0000 7f92a27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:47.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.615+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94822215700816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847c7db0 con 0x563d847a98d0 2024-09-12T17:29:47.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.616+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94822215700816] v31'257 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f93d4029040 con 0x563d847a98d0 2024-09-12T17:29:47.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.616+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94822215679184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847bd110 con 0x563d847ae2c0 2024-09-12T17:29:47.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.617+0000 7f93ecf81640 1 -- 172.21.15.170:0/2305886957 <== osd.2 v2:172.21.15.170:6808/3855567754 21 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94822215679184] v31'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93e4066040 con 0x563d847ae2c0 2024-09-12T17:29:47.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.617+0000 7f93eec96800 20 remove_watcher() i=0 2024-09-12T17:29:47.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.617+0000 7f93eec96800 2 removed watcher, disabling cache 2024-09-12T17:29:47.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.617+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94822215683040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847b7cd0 con 0x563d847a98d0 2024-09-12T17:29:47.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.618+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94822215683040] v31'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93d4029040 con 0x563d847a98d0 2024-09-12T17:29:47.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.618+0000 7f93eec96800 20 remove_watcher() i=1 2024-09-12T17:29:47.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.618+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94822215684608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847b8be0 con 0x563d847b2da0 2024-09-12T17:29:47.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.619+0000 7f93ec780640 1 -- 172.21.15.170:0/2305886957 <== osd.3 v2:172.21.15.170:6816/2664906588 35 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94822215684608] v31'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93dc051070 con 0x563d847b2da0 2024-09-12T17:29:47.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.619+0000 7f93eec96800 20 remove_watcher() i=2 2024-09-12T17:29:47.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.619+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94822215689456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847b8be0 con 0x563d847ae2c0 2024-09-12T17:29:47.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.620+0000 7f93ecf81640 1 -- 172.21.15.170:0/2305886957 <== osd.2 v2:172.21.15.170:6808/3855567754 22 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94822215689456] v31'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93e4066040 con 0x563d847ae2c0 2024-09-12T17:29:47.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.620+0000 7f93eec96800 20 remove_watcher() i=3 2024-09-12T17:29:47.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.620+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94822215694000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847ba4f0 con 0x563d847a98d0 2024-09-12T17:29:47.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.621+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94822215694000] v31'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93d4029040 con 0x563d847a98d0 2024-09-12T17:29:47.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.621+0000 7f93eec96800 20 remove_watcher() i=4 2024-09-12T17:29:47.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.621+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94822215696096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847b8be0 con 0x7f93e4012c00 2024-09-12T17:29:47.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.622+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.0 v2:172.21.15.47:6800/3978157098 27 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94822215696096] v31'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93d4029040 con 0x7f93e4012c00 2024-09-12T17:29:47.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.622+0000 7f93eec96800 20 remove_watcher() i=5 2024-09-12T17:29:47.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.622+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94822215691024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847bbee0 con 0x7f93e4012c00 2024-09-12T17:29:47.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.623+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.0 v2:172.21.15.47:6800/3978157098 28 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94822215691024] v31'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93d4029040 con 0x7f93e4012c00 2024-09-12T17:29:47.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.623+0000 7f93eec96800 20 remove_watcher() i=6 2024-09-12T17:29:47.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.623+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94822215699696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563d847b8be0 con 0x7f93e4012c00 2024-09-12T17:29:47.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.624+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 <== osd.0 v2:172.21.15.47:6800/3978157098 29 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94822215699696] v31'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93d4029040 con 0x7f93e4012c00 2024-09-12T17:29:47.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.624+0000 7f93eec96800 20 remove_watcher() i=7 2024-09-12T17:29:47.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.624+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f93e4012c00 msgr2=0x7f93e401aa70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.624+0000 7f93eec96800 1 --2- 172.21.15.170:0/2305886957 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f93e4012c00 0x7f93e401aa70 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.624+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x563d847a98d0 msgr2=0x563d847abd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.624+0000 7f93eec96800 1 --2- 172.21.15.170:0/2305886957 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x563d847a98d0 0x563d847abd90 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.624+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x563d847ae2c0 msgr2=0x563d847b06b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.624+0000 7f93eec96800 1 --2- 172.21.15.170:0/2305886957 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x563d847ae2c0 0x563d847b06b0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.624+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x563d847b2da0 msgr2=0x563d847b5260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.624+0000 7f93eec96800 1 --2- 172.21.15.170:0/2305886957 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x563d847b2da0 0x563d847b5260 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.624+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f92bc03c6e0 msgr2=0x7f92bc03eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.624+0000 7f93eec96800 1 --2- 172.21.15.170:0/2305886957 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f92bc03c6e0 0x7f92bc03eba0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f93dc05ffd0 tx=0x7f93dc087000 comp rx=0 tx=0).stop 2024-09-12T17:29:47.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.624+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563d84796a10 msgr2=0x563d8479dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.624+0000 7f93e3f7f640 1 -- 172.21.15.170:0/2305886957 reap_dead start 2024-09-12T17:29:47.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.624+0000 7f93eec96800 1 --2- 172.21.15.170:0/2305886957 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563d84796a10 0x563d8479dfc0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f93e40206d0 tx=0x7f93e4053d00 comp rx=0 tx=0).stop 2024-09-12T17:29:47.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.624+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 shutdown_connections 2024-09-12T17:29:47.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.624+0000 7f93eec96800 1 --2- 172.21.15.170:0/2305886957 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563d84796a10 0x563d8479dfc0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.624+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 >> 172.21.15.170:0/2305886957 conn(0x563d84792e10 msgr2=0x563d84791020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:47.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.624+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 shutdown_connections 2024-09-12T17:29:47.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.624+0000 7f93eec96800 1 -- 172.21.15.170:0/2305886957 wait complete. 2024-09-12T17:29:47.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.625+0000 7f93eec96800 1 -- 172.21.15.170:0/4005786180 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f92c403c780 msgr2=0x7f92c403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.625+0000 7f93eec96800 1 --2- 172.21.15.170:0/4005786180 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f92c403c780 0x7f92c403ec40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x563d847708d0 tx=0x7f93dc068eb0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.625+0000 7f93eec96800 1 -- 172.21.15.170:0/4005786180 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563d84789f10 msgr2=0x563d8478a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.625+0000 7f93eec96800 1 --2- 172.21.15.170:0/4005786180 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563d84789f10 0x563d8478a330 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x563d84770090 tx=0x7f93e40167b0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.625+0000 7f93eec96800 1 -- 172.21.15.170:0/4005786180 shutdown_connections 2024-09-12T17:29:47.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.625+0000 7f93eec96800 1 --2- 172.21.15.170:0/4005786180 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f92c403c780 0x7f92c403ec40 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.625+0000 7f93eec96800 1 --2- 172.21.15.170:0/4005786180 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563d84789f10 0x563d8478a330 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.625+0000 7f93eec96800 1 -- 172.21.15.170:0/4005786180 >> 172.21.15.170:0/4005786180 conn(0x563d8477e2c0 msgr2=0x563d8477e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:47.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.625+0000 7f93eec96800 1 -- 172.21.15.170:0/4005786180 shutdown_connections 2024-09-12T17:29:47.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.625+0000 7f93eec96800 1 -- 172.21.15.170:0/4005786180 wait complete. 2024-09-12T17:29:47.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.625+0000 7f93eec96800 1 -- 172.21.15.170:0/350406953 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x563d84676030 msgr2=0x563d847766e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.625+0000 7f93eec96800 1 --2- 172.21.15.170:0/350406953 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x563d84676030 0x563d847766e0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.625+0000 7f93eec96800 1 -- 172.21.15.170:0/350406953 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x563d84778a50 msgr2=0x563d8477aef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.625+0000 7f93eec96800 1 --2- 172.21.15.170:0/350406953 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x563d84778a50 0x563d8477aef0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.625+0000 7f93eec96800 1 -- 172.21.15.170:0/350406953 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f92d403c780 msgr2=0x7f92d403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.625+0000 7f93eec96800 1 --2- 172.21.15.170:0/350406953 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f92d403c780 0x7f92d403ec40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f93d4001d70 tx=0x7f93d40012d0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.625+0000 7f93eec96800 1 -- 172.21.15.170:0/350406953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563d84674df0 msgr2=0x563d8476f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.625+0000 7f93eec96800 1 --2- 172.21.15.170:0/350406953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563d84674df0 0x563d8476f090 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f93dc025c20 tx=0x7f93dc002fb0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.625+0000 7f93eec96800 1 -- 172.21.15.170:0/350406953 shutdown_connections 2024-09-12T17:29:47.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.625+0000 7f93eec96800 1 --2- 172.21.15.170:0/350406953 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x563d84778a50 0x563d8477aef0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.625+0000 7f93eec96800 1 --2- 172.21.15.170:0/350406953 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f92d403c780 0x7f92d403ec40 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.625+0000 7f93eec96800 1 --2- 172.21.15.170:0/350406953 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x563d84676030 0x563d847766e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.625+0000 7f93eec96800 1 --2- 172.21.15.170:0/350406953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563d84674df0 0x563d8476f090 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.625+0000 7f93eec96800 1 -- 172.21.15.170:0/350406953 >> 172.21.15.170:0/350406953 conn(0x563d846701c0 msgr2=0x563d8475d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:47.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.625+0000 7f93eec96800 1 -- 172.21.15.170:0/350406953 shutdown_connections 2024-09-12T17:29:47.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.625+0000 7f93eec96800 1 -- 172.21.15.170:0/350406953 wait complete. 2024-09-12T17:29:47.635 ERROR:root:None 2024-09-12T17:29:47.635 ERROR:root:0 2024-09-12T17:29:47.635 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-12T17:29:47.635 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-12T17:29:47.635 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=read 2024-09-12T17:29:47.724 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:29:47.724 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:29:47.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.721+0000 7fa3e6d33800 1 Processor -- start 2024-09-12T17:29:47.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.721+0000 7fa3e6d33800 1 -- start start 2024-09-12T17:29:47.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.721+0000 7fa3e6d33800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5568909034b0 0x5568909038b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.721+0000 7fa3e6d33800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5568907aee40 con 0x556890903df0 2024-09-12T17:29:47.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.721+0000 7fa3e6d33800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x556890779680 con 0x5568909034b0 2024-09-12T17:29:47.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.722+0000 7fa3e2a76640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5568909034b0 0x5568909038b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.722+0000 7fa3e2a76640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5568909034b0 0x5568909038b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35128/0 (socket says 172.21.15.170:35128) 2024-09-12T17:29:47.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.722+0000 7fa3e2275640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x556890903df0 0x5568909042a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:44912/0 (socket says 172.21.15.170:44912) 2024-09-12T17:29:47.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.722+0000 7fa3e2a76640 1 -- 172.21.15.170:0/4239028462 learned_addr learned my addr 172.21.15.170:0/4239028462 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:47.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.722+0000 7fa3e2a76640 1 -- 172.21.15.170:0/4239028462 >> v1:172.21.15.47:6789/0 conn(0x556890903df0 legacy=0x5568909042a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.722+0000 7fa3e2a76640 1 -- 172.21.15.170:0/4239028462 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568907956b0 con 0x5568909034b0 2024-09-12T17:29:47.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.724+0000 7fa3e2a76640 1 --2- 172.21.15.170:0/4239028462 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568909034b0 0x5568909038b0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4005fd0 tx=0x7fa3d4045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93b072837b9cc78c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.724+0000 7fa3e1a74640 1 -- 172.21.15.170:0/4239028462 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3d404e600 con 0x5568909034b0 2024-09-12T17:29:47.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.724+0000 7fa3e1a74640 1 -- 172.21.15.170:0/4239028462 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3d404e7a0 con 0x5568909034b0 2024-09-12T17:29:47.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.724+0000 7fa3e1a74640 1 -- 172.21.15.170:0/4239028462 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3d404eaa0 con 0x5568909034b0 2024-09-12T17:29:47.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.724+0000 7fa3e6d33800 1 -- 172.21.15.170:0/4239028462 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568909034b0 msgr2=0x5568909038b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.724+0000 7fa3e6d33800 1 --2- 172.21.15.170:0/4239028462 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568909034b0 0x5568909038b0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4005fd0 tx=0x7fa3d4045cf0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.725+0000 7fa3e6d33800 1 -- 172.21.15.170:0/4239028462 shutdown_connections 2024-09-12T17:29:47.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.725+0000 7fa3e6d33800 1 --2- 172.21.15.170:0/4239028462 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568909034b0 0x5568909038b0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.725+0000 7fa3e6d33800 1 -- 172.21.15.170:0/4239028462 >> 172.21.15.170:0/4239028462 conn(0x5568908ff1c0 msgr2=0x556890901620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:47.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.725+0000 7fa3e6d33800 1 -- 172.21.15.170:0/4239028462 shutdown_connections 2024-09-12T17:29:47.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.725+0000 7fa3e6d33800 1 -- 172.21.15.170:0/4239028462 wait complete. 2024-09-12T17:29:47.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.738+0000 7fa3e6d33800 1 Processor -- start 2024-09-12T17:29:47.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.738+0000 7fa3e6d33800 1 -- start start 2024-09-12T17:29:47.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.739+0000 7fa3e6d33800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568909034b0 0x5568909f68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.739+0000 7fa3e6d33800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55689079ddd0 con 0x5568909034b0 2024-09-12T17:29:47.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.739+0000 7fa3e2a76640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568909034b0 0x5568909f68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.739+0000 7fa3e2a76640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568909034b0 0x5568909f68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35130/0 (socket says 172.21.15.170:35130) 2024-09-12T17:29:47.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.739+0000 7fa3e2a76640 1 -- 172.21.15.170:0/3034383325 learned_addr learned my addr 172.21.15.170:0/3034383325 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:47.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.739+0000 7fa3e2a76640 1 -- 172.21.15.170:0/3034383325 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568907b6e10 con 0x5568909034b0 2024-09-12T17:29:47.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.739+0000 7fa3e2a76640 1 --2- 172.21.15.170:0/3034383325 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568909034b0 0x5568909f68e0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4005fd0 tx=0x7fa3d4050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee1e331248e1013c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.739+0000 7fa2d0e09640 1 -- 172.21.15.170:0/3034383325 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3d404eb40 con 0x5568909034b0 2024-09-12T17:29:47.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.739+0000 7fa2d0e09640 1 -- 172.21.15.170:0/3034383325 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3d4066070 con 0x5568909034b0 2024-09-12T17:29:47.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.739+0000 7fa2d0e09640 1 -- 172.21.15.170:0/3034383325 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3d404ee50 con 0x5568909034b0 2024-09-12T17:29:47.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.740+0000 7fa3e6d33800 1 -- 172.21.15.170:0/3034383325 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568909034b0 msgr2=0x5568909f68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.740+0000 7fa3e6d33800 1 --2- 172.21.15.170:0/3034383325 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568909034b0 0x5568909f68e0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4005fd0 tx=0x7fa3d4050000 comp rx=0 tx=0).stop 2024-09-12T17:29:47.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.740+0000 7fa3e6d33800 1 -- 172.21.15.170:0/3034383325 shutdown_connections 2024-09-12T17:29:47.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.740+0000 7fa3e6d33800 1 --2- 172.21.15.170:0/3034383325 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568909034b0 0x5568909f68e0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.740+0000 7fa3e6d33800 1 -- 172.21.15.170:0/3034383325 >> 172.21.15.170:0/3034383325 conn(0x5568908ff1c0 msgr2=0x5568909f2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:47.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.740+0000 7fa3e6d33800 1 -- 172.21.15.170:0/3034383325 shutdown_connections 2024-09-12T17:29:47.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.740+0000 7fa3e6d33800 1 -- 172.21.15.170:0/3034383325 wait complete. 2024-09-12T17:29:47.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.741+0000 7fa3e6d33800 1 Processor -- start 2024-09-12T17:29:47.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.741+0000 7fa3e6d33800 1 -- start start 2024-09-12T17:29:47.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.741+0000 7fa3e6d33800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568909034b0 0x5568909fe150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.741+0000 7fa3e6d33800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556890904d10 con 0x5568909034b0 2024-09-12T17:29:47.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.741+0000 7fa3e2a76640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568909034b0 0x5568909fe150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.741+0000 7fa3e2a76640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568909034b0 0x5568909fe150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35134/0 (socket says 172.21.15.170:35134) 2024-09-12T17:29:47.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.741+0000 7fa3e2a76640 1 -- 172.21.15.170:0/1322380465 learned_addr learned my addr 172.21.15.170:0/1322380465 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:47.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.741+0000 7fa3e2a76640 1 -- 172.21.15.170:0/1322380465 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568909fe6b0 con 0x5568909034b0 2024-09-12T17:29:47.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.741+0000 7fa3e2a76640 1 --2- 172.21.15.170:0/1322380465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568909034b0 0x5568909fe150 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4063040 tx=0x7fa3d4003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.742+0000 7fa2cf606640 1 -- 172.21.15.170:0/1322380465 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3d406d550 con 0x5568909034b0 2024-09-12T17:29:47.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.742+0000 7fa2cf606640 1 -- 172.21.15.170:0/1322380465 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3d4071030 con 0x5568909034b0 2024-09-12T17:29:47.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.742+0000 7fa3e6d33800 1 -- 172.21.15.170:0/1322380465 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5568909fe940 con 0x5568909034b0 2024-09-12T17:29:47.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.742+0000 7fa2cf606640 1 -- 172.21.15.170:0/1322380465 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3d406d820 con 0x5568909034b0 2024-09-12T17:29:47.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.742+0000 7fa3e6d33800 1 -- 172.21.15.170:0/1322380465 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568909ff340 con 0x5568909034b0 2024-09-12T17:29:47.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.742+0000 7fa2cf606640 1 -- 172.21.15.170:0/1322380465 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fa3d406d9c0 con 0x5568909034b0 2024-09-12T17:29:47.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.743+0000 7fa2cf606640 1 --2- 172.21.15.170:0/1322380465 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa2c803c780 0x7fa2c803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.743+0000 7fa2cf606640 1 -- 172.21.15.170:0/1322380465 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fa3d4098150 con 0x5568909034b0 2024-09-12T17:29:47.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.743+0000 7fa3e2275640 1 --2- 172.21.15.170:0/1322380465 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa2c803c780 0x7fa2c803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.743+0000 7fa3e6d33800 1 --2- 172.21.15.170:0/1322380465 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x556890903df0 0x556890a057a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.743+0000 7fa3e6d33800 1 -- 172.21.15.170:0/1322380465 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5568909fff30 con 0x556890903df0 2024-09-12T17:29:47.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.743+0000 7fa3e3277640 1 --2- 172.21.15.170:0/1322380465 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x556890903df0 0x556890a057a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.743+0000 7fa3e2275640 1 --2- 172.21.15.170:0/1322380465 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa2c803c780 0x7fa2c803ec40 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc001e30 tx=0x7fa3cc001390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.743+0000 7fa3e3277640 1 --2- 172.21.15.170:0/1322380465 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x556890903df0 0x556890a057a0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.744+0000 7fa3e3277640 1 -- 172.21.15.170:0/1322380465 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa3dc0083e0 con 0x556890903df0 2024-09-12T17:29:47.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.744+0000 7fa3e6d33800 1 -- 172.21.15.170:0/1322380465 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556890a06220 con 0x556890903df0 2024-09-12T17:29:47.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.744+0000 7fa3e3277640 1 -- 172.21.15.170:0/1322380465 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa3dc0083e0 con 0x556890903df0 2024-09-12T17:29:47.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.744+0000 7fa3e6d33800 1 --2- 172.21.15.170:0/1322380465 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556890a07b30 0x556890a09fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.744+0000 7fa3e6d33800 1 -- 172.21.15.170:0/1322380465 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556890a0a760 con 0x556890a07b30 2024-09-12T17:29:47.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.744+0000 7fa3e2a76640 1 --2- 172.21.15.170:0/1322380465 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556890a07b30 0x556890a09fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.744+0000 7fa3e2a76640 1 --2- 172.21.15.170:0/1322380465 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556890a07b30 0x556890a09fd0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.745+0000 7fa3e2a76640 1 -- 172.21.15.170:0/1322380465 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa3d407d070 con 0x556890a07b30 2024-09-12T17:29:47.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.745+0000 7fa3e6d33800 1 -- 172.21.15.170:0/1322380465 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556890a06a70 con 0x556890903df0 2024-09-12T17:29:47.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.745+0000 7fa3e3277640 1 -- 172.21.15.170:0/1322380465 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa3dc0083e0 con 0x556890903df0 2024-09-12T17:29:47.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.745+0000 7fa3e6d33800 1 -- 172.21.15.170:0/1322380465 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556890a06e10 con 0x556890a07b30 2024-09-12T17:29:47.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.745+0000 7fa3e2a76640 1 -- 172.21.15.170:0/1322380465 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa3d407d070 con 0x556890a07b30 2024-09-12T17:29:47.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.746+0000 7fa3e6d33800 1 Processor -- start 2024-09-12T17:29:47.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.746+0000 7fa3e6d33800 1 -- start start 2024-09-12T17:29:47.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.746+0000 7fa3e6d33800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556890a19030 0x556890a19450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.746+0000 7fa3e6d33800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5568907fba00 con 0x556890a19030 2024-09-12T17:29:47.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.746+0000 7fa3e3277640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556890a19030 0x556890a19450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.746+0000 7fa3e3277640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556890a19030 0x556890a19450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35148/0 (socket says 172.21.15.170:35148) 2024-09-12T17:29:47.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.746+0000 7fa3e3277640 1 -- 172.21.15.170:0/1316627587 learned_addr learned my addr 172.21.15.170:0/1316627587 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:47.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.746+0000 7fa3e3277640 1 -- 172.21.15.170:0/1316627587 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556890a19a90 con 0x556890a19030 2024-09-12T17:29:47.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.747+0000 7fa3e3277640 1 --2- 172.21.15.170:0/1316627587 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556890a19030 0x556890a19450 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x5568909ff740 tx=0x7fa3dc00bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.747+0000 7fa2cce01640 1 -- 172.21.15.170:0/1316627587 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3dc01c020 con 0x556890a19030 2024-09-12T17:29:47.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.747+0000 7fa2cce01640 1 -- 172.21.15.170:0/1316627587 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3dc007c90 con 0x556890a19030 2024-09-12T17:29:47.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.747+0000 7fa3e6d33800 1 -- 172.21.15.170:0/1316627587 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556890a1a2c0 con 0x556890a19030 2024-09-12T17:29:47.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.747+0000 7fa2cce01640 1 -- 172.21.15.170:0/1316627587 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3dc018440 con 0x556890a19030 2024-09-12T17:29:47.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.747+0000 7fa3e6d33800 1 -- 172.21.15.170:0/1316627587 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556890a1a860 con 0x556890a19030 2024-09-12T17:29:47.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.748+0000 7fa2cce01640 1 -- 172.21.15.170:0/1316627587 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fa3dc01f020 con 0x556890a19030 2024-09-12T17:29:47.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.748+0000 7fa2cce01640 1 --2- 172.21.15.170:0/1316627587 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa2bc03c730 0x7fa2bc03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.748+0000 7fa2cce01640 1 -- 172.21.15.170:0/1316627587 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fa3dc054ef0 con 0x556890a19030 2024-09-12T17:29:47.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.748+0000 7fa3e2a76640 1 --2- 172.21.15.170:0/1316627587 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa2bc03c730 0x7fa2bc03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.748+0000 7fa3e6d33800 1 Processor -- start 2024-09-12T17:29:47.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.748+0000 7fa3e2a76640 1 --2- 172.21.15.170:0/1316627587 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa2bc03c730 0x7fa2bc03ebf0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa3d406ce00 tx=0x7fa3d40581c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.748+0000 7fa3e6d33800 1 -- start start 2024-09-12T17:29:47.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.748+0000 7fa3e6d33800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556890a25b10 0x556890a25f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.748+0000 7fa3e6d33800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5568909f7070 con 0x556890a25b10 2024-09-12T17:29:47.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.749+0000 7fa3e3277640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556890a25b10 0x556890a25f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.749+0000 7fa3e3277640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556890a25b10 0x556890a25f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35164/0 (socket says 172.21.15.170:35164) 2024-09-12T17:29:47.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.749+0000 7fa3e3277640 1 -- 172.21.15.170:0/2760711009 learned_addr learned my addr 172.21.15.170:0/2760711009 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:47.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.749+0000 7fa3e3277640 1 -- 172.21.15.170:0/2760711009 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556890a26500 con 0x556890a25b10 2024-09-12T17:29:47.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.749+0000 7fa3e3277640 1 --2- 172.21.15.170:0/2760711009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556890a25b10 0x556890a25f10 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc0532d0 tx=0x7fa3dc053410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9de427176431bbf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.749+0000 7fa2c67fc640 1 -- 172.21.15.170:0/2760711009 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3dc050030 con 0x556890a25b10 2024-09-12T17:29:47.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.749+0000 7fa2c67fc640 1 -- 172.21.15.170:0/2760711009 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3dc028d50 con 0x556890a25b10 2024-09-12T17:29:47.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.749+0000 7fa2c67fc640 1 -- 172.21.15.170:0/2760711009 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3dc017510 con 0x556890a25b10 2024-09-12T17:29:47.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.750+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2760711009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556890a25b10 msgr2=0x556890a25f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.750+0000 7fa3e6d33800 1 --2- 172.21.15.170:0/2760711009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556890a25b10 0x556890a25f10 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc0532d0 tx=0x7fa3dc053410 comp rx=0 tx=0).stop 2024-09-12T17:29:47.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.750+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2760711009 shutdown_connections 2024-09-12T17:29:47.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.750+0000 7fa3e6d33800 1 --2- 172.21.15.170:0/2760711009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556890a25b10 0x556890a25f10 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.750+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2760711009 >> 172.21.15.170:0/2760711009 conn(0x556890a21f10 msgr2=0x556890a20150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:47.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.750+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2760711009 shutdown_connections 2024-09-12T17:29:47.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.750+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2760711009 wait complete. 2024-09-12T17:29:47.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.750+0000 7fa3e6d33800 1 Processor -- start 2024-09-12T17:29:47.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.750+0000 7fa3e6d33800 1 -- start start 2024-09-12T17:29:47.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.750+0000 7fa3e6d33800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556890a25b10 0x556890a2d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.750+0000 7fa3e6d33800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556890a26b20 con 0x556890a25b10 2024-09-12T17:29:47.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.750+0000 7fa3e3277640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556890a25b10 0x556890a2d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.750+0000 7fa3e3277640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556890a25b10 0x556890a2d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35170/0 (socket says 172.21.15.170:35170) 2024-09-12T17:29:47.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.750+0000 7fa3e3277640 1 -- 172.21.15.170:0/2061563966 learned_addr learned my addr 172.21.15.170:0/2061563966 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:47.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.751+0000 7fa3e3277640 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556890a2d690 con 0x556890a25b10 2024-09-12T17:29:47.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.751+0000 7fa3e3277640 1 --2- 172.21.15.170:0/2061563966 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556890a25b10 0x556890a2d130 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc0521a0 tx=0x7fa3dc053260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.751+0000 7fa2c4ff9640 1 -- 172.21.15.170:0/2061563966 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3dc020890 con 0x556890a25b10 2024-09-12T17:29:47.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.751+0000 7fa2c4ff9640 1 -- 172.21.15.170:0/2061563966 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3dc03d070 con 0x556890a25b10 2024-09-12T17:29:47.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.751+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556890a2d920 con 0x556890a25b10 2024-09-12T17:29:47.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.751+0000 7fa2c4ff9640 1 -- 172.21.15.170:0/2061563966 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3dc020b60 con 0x556890a25b10 2024-09-12T17:29:47.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.751+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556890a2e2a0 con 0x556890a25b10 2024-09-12T17:29:47.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.752+0000 7fa2c4ff9640 1 -- 172.21.15.170:0/2061563966 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fa3dc016040 con 0x556890a25b10 2024-09-12T17:29:47.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.752+0000 7fa2c4ff9640 1 --2- 172.21.15.170:0/2061563966 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa2ac03c780 0x7fa2ac03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.752+0000 7fa2c4ff9640 1 -- 172.21.15.170:0/2061563966 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fa3dc051070 con 0x556890a25b10 2024-09-12T17:29:47.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.752+0000 7fa3e2a76640 1 --2- 172.21.15.170:0/2061563966 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa2ac03c780 0x7fa2ac03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.752+0000 7fa3e2a76640 1 --2- 172.21.15.170:0/2061563966 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa2ac03c780 0x7fa2ac03ec40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa3d406b010 tx=0x7fa3d408a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.753+0000 7fa3e6d33800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.753+0000 7fa3e6d33800 1 --2- 172.21.15.170:0/2061563966 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x556890a38a80 0x556890a3af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.753+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556890a3b690 con 0x556890a38a80 2024-09-12T17:29:47.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.753+0000 7fa3e2275640 1 --2- 172.21.15.170:0/2061563966 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x556890a38a80 0x556890a3af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.753+0000 7fa3e2275640 1 --2- 172.21.15.170:0/2061563966 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x556890a38a80 0x556890a3af40 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.753+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa3cc00f610 con 0x556890a38a80 2024-09-12T17:29:47.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.753+0000 7fa3e6d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.753+0000 7fa3e6d33800 20 realm 2024-09-12T17:29:47.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.753+0000 7fa3e6d33800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.753+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556890a37dd0 con 0x556890a38a80 2024-09-12T17:29:47.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.753+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa3cc00f610 con 0x556890a38a80 2024-09-12T17:29:47.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.753+0000 7fa3e6d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.753+0000 7fa3e6d33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:29:47.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.753+0000 7fa3e6d33800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.754+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556890a3c180 con 0x556890a38a80 2024-09-12T17:29:47.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.754+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa3cc00f610 con 0x556890a38a80 2024-09-12T17:29:47.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.754+0000 7fa3e6d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.754+0000 7fa3e6d33800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.754+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556890a3ca50 con 0x556890a38a80 2024-09-12T17:29:47.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.754+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa3cc00f610 con 0x556890a38a80 2024-09-12T17:29:47.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.754+0000 7fa3e6d33800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:47.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.754+0000 7fa3e6d33800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.754+0000 7fa3e6d33800 1 --2- 172.21.15.170:0/2061563966 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556890a3d470 0x556890a3f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.754+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556890a3ffa0 con 0x556890a3d470 2024-09-12T17:29:47.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.754+0000 7fa3e3277640 1 --2- 172.21.15.170:0/2061563966 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556890a3d470 0x556890a3f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.754+0000 7fa3e3277640 1 --2- 172.21.15.170:0/2061563966 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556890a3d470 0x556890a3f860 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.755+0000 7fa3e3277640 1 -- 172.21.15.170:0/2061563966 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa3dc0083e0 con 0x556890a3d470 2024-09-12T17:29:47.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.755+0000 7fa3e6d33800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:29:47.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.755+0000 7fa3e6d33800 20 searching for the correct realm 2024-09-12T17:29:47.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.755+0000 7fa3e6d33800 1 --2- 172.21.15.170:0/2061563966 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x556890a41f50 0x556890a44410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.755+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556890a44a90 con 0x556890a41f50 2024-09-12T17:29:47.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.755+0000 7fa3e2a76640 1 --2- 172.21.15.170:0/2061563966 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x556890a41f50 0x556890a44410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.755+0000 7fa3e2a76640 1 --2- 172.21.15.170:0/2061563966 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x556890a41f50 0x556890a44410 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.755+0000 7fa3e2a76640 1 -- 172.21.15.170:0/2061563966 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d408a070 con 0x556890a41f50 2024-09-12T17:29:47.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.755+0000 7fa3e2a76640 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556890a44a90 con 0x556890a3d470 2024-09-12T17:29:47.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.756+0000 7fa3e3277640 1 -- 172.21.15.170:0/2061563966 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3dc0083e0 con 0x556890a3d470 2024-09-12T17:29:47.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.756+0000 7fa3e3277640 1 --2- 172.21.15.170:0/2061563966 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fa3dc038070 0x7fa3dc02b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.756+0000 7fa3e3277640 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556890a44a90 con 0x7fa3dc038070 2024-09-12T17:29:47.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.756+0000 7fa3e2275640 1 --2- 172.21.15.170:0/2061563966 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fa3dc038070 0x7fa3dc02b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.756+0000 7fa3e2275640 1 --2- 172.21.15.170:0/2061563966 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fa3dc038070 0x7fa3dc02b440 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.757+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3cc00f610 con 0x7fa3dc038070 2024-09-12T17:29:47.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.757+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556890a44a90 con 0x556890a38a80 2024-09-12T17:29:47.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.757+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3cc00f610 con 0x556890a38a80 2024-09-12T17:29:47.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.757+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556890a44a90 con 0x556890a38a80 2024-09-12T17:29:47.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.757+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3cc02b040 con 0x556890a38a80 2024-09-12T17:29:47.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.757+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556890a44a90 con 0x7fa3dc038070 2024-09-12T17:29:47.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.757+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3cc02b040 con 0x7fa3dc038070 2024-09-12T17:29:47.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.757+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556890a44a90 con 0x7fa3dc038070 2024-09-12T17:29:47.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.757+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3cc02b040 con 0x7fa3dc038070 2024-09-12T17:29:47.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.757+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556890a44a90 con 0x556890a3d470 2024-09-12T17:29:47.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.758+0000 7fa3e3277640 1 -- 172.21.15.170:0/2061563966 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3dc0083e0 con 0x556890a3d470 2024-09-12T17:29:47.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.758+0000 7fa3e3277640 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556890a44a90 con 0x556890a41f50 2024-09-12T17:29:47.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.758+0000 7fa3e2a76640 1 -- 172.21.15.170:0/2061563966 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d408a070 con 0x556890a41f50 2024-09-12T17:29:47.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.758+0000 7fa3e2a76640 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556890a44a90 con 0x556890a38a80 2024-09-12T17:29:47.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.758+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3cc02b040 con 0x556890a38a80 2024-09-12T17:29:47.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.758+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556890a44a90 con 0x7fa3dc038070 2024-09-12T17:29:47.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.758+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3cc02b040 con 0x7fa3dc038070 2024-09-12T17:29:47.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.758+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556890a44a90 con 0x556890a38a80 2024-09-12T17:29:47.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.759+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3cc02b040 con 0x556890a38a80 2024-09-12T17:29:47.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.759+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556890a44a90 con 0x556890a3d470 2024-09-12T17:29:47.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.759+0000 7fa3e3277640 1 -- 172.21.15.170:0/2061563966 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fa3dc0083e0 con 0x556890a3d470 2024-09-12T17:29:47.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.759+0000 7fa3e3277640 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556890a44a90 con 0x556890a41f50 2024-09-12T17:29:47.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.759+0000 7fa3e2a76640 1 -- 172.21.15.170:0/2061563966 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d408a070 con 0x556890a41f50 2024-09-12T17:29:47.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.759+0000 7fa3e2a76640 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556890a44a90 con 0x556890a41f50 2024-09-12T17:29:47.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.759+0000 7fa3e2a76640 1 -- 172.21.15.170:0/2061563966 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d408a070 con 0x556890a41f50 2024-09-12T17:29:47.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.759+0000 7fa3e2a76640 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556890a44a90 con 0x556890a3d470 2024-09-12T17:29:47.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.760+0000 7fa3e3277640 1 -- 172.21.15.170:0/2061563966 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3dc0083e0 con 0x556890a3d470 2024-09-12T17:29:47.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.760+0000 7fa3e3277640 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556890a44a90 con 0x556890a41f50 2024-09-12T17:29:47.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.760+0000 7fa3e2a76640 1 -- 172.21.15.170:0/2061563966 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d408a070 con 0x556890a41f50 2024-09-12T17:29:47.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.760+0000 7fa3e2a76640 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556890a44a90 con 0x556890a41f50 2024-09-12T17:29:47.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.760+0000 7fa3e2a76640 1 -- 172.21.15.170:0/2061563966 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d408a070 con 0x556890a41f50 2024-09-12T17:29:47.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.760+0000 7fa3e2a76640 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556890a44a90 con 0x556890a38a80 2024-09-12T17:29:47.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.760+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3cc02b040 con 0x556890a38a80 2024-09-12T17:29:47.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.760+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556890a44a90 con 0x556890a38a80 2024-09-12T17:29:47.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.760+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v31'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa3cc02b040 con 0x556890a38a80 2024-09-12T17:29:47.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.760+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556890a44a90 con 0x7fa3dc038070 2024-09-12T17:29:47.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.761+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3cc02b040 con 0x7fa3dc038070 2024-09-12T17:29:47.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.761+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556890a44a90 con 0x556890a41f50 2024-09-12T17:29:47.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.761+0000 7fa3e2a76640 1 -- 172.21.15.170:0/2061563966 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d408a070 con 0x556890a41f50 2024-09-12T17:29:47.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.761+0000 7fa3e2a76640 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556890a44a90 con 0x556890a3d470 2024-09-12T17:29:47.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.761+0000 7fa3e3277640 1 -- 172.21.15.170:0/2061563966 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3dc0083e0 con 0x556890a3d470 2024-09-12T17:29:47.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.761+0000 7fa3e3277640 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556890a44a90 con 0x556890a38a80 2024-09-12T17:29:47.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.761+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3cc02b040 con 0x556890a38a80 2024-09-12T17:29:47.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.761+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556890a44a90 con 0x7fa3dc038070 2024-09-12T17:29:47.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.762+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3cc02b040 con 0x7fa3dc038070 2024-09-12T17:29:47.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.762+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556890a44a90 con 0x556890a41f50 2024-09-12T17:29:47.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.762+0000 7fa3e2a76640 1 -- 172.21.15.170:0/2061563966 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d408a070 con 0x556890a41f50 2024-09-12T17:29:47.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.762+0000 7fa3e2a76640 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556890a44a90 con 0x7fa3dc038070 2024-09-12T17:29:47.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.762+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3cc02b040 con 0x7fa3dc038070 2024-09-12T17:29:47.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.762+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556890a44a90 con 0x556890a3d470 2024-09-12T17:29:47.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.762+0000 7fa3e3277640 1 -- 172.21.15.170:0/2061563966 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3dc0083e0 con 0x556890a3d470 2024-09-12T17:29:47.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.762+0000 7fa3e3277640 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556890a44a90 con 0x556890a41f50 2024-09-12T17:29:47.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.763+0000 7fa3e2a76640 1 -- 172.21.15.170:0/2061563966 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d408a070 con 0x556890a41f50 2024-09-12T17:29:47.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.763+0000 7fa3e2a76640 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556890a44a90 con 0x7fa3dc038070 2024-09-12T17:29:47.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.763+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3cc02b040 con 0x7fa3dc038070 2024-09-12T17:29:47.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.763+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556890a44a90 con 0x556890a38a80 2024-09-12T17:29:47.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.763+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa3cc02b040 con 0x556890a38a80 2024-09-12T17:29:47.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.763+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556890a44a90 con 0x556890a3d470 2024-09-12T17:29:47.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.763+0000 7fa3e3277640 1 -- 172.21.15.170:0/2061563966 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(37 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa3dc0083e0 con 0x556890a3d470 2024-09-12T17:29:47.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.764+0000 7fa3e6d33800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:29:47.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.764+0000 7fa3e6d33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:29:47.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.764+0000 7fa3e6d33800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:29:47.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.764+0000 7fa3e6d33800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:29:47.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.764+0000 7fa3e6d33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:29:47.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.764+0000 7fa3e6d33800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:29:47.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.764+0000 7fa3e6d33800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.764+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556890a40990 con 0x556890a38a80 2024-09-12T17:29:47.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.764+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa3cc02b040 con 0x556890a38a80 2024-09-12T17:29:47.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.764+0000 7fa3e6d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.764+0000 7fa3e6d33800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.764+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556890a41230 con 0x556890a38a80 2024-09-12T17:29:47.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.764+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa3cc03b040 con 0x556890a38a80 2024-09-12T17:29:47.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.764+0000 7fa3e6d33800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:47.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.764+0000 7fa3e6d33800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.764+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556890a405d0 con 0x556890a3d470 2024-09-12T17:29:47.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.764+0000 7fa3e3277640 1 -- 172.21.15.170:0/2061563966 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa3dc0083e0 con 0x556890a3d470 2024-09-12T17:29:47.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.764+0000 7fa3e6d33800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:29:47.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.764+0000 7fa3e6d33800 20 zone default found 2024-09-12T17:29:47.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.764+0000 7fa3e6d33800 4 Realm: () 2024-09-12T17:29:47.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.764+0000 7fa3e6d33800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:29:47.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.764+0000 7fa3e6d33800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:29:47.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.764+0000 7fa3e6d33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:29:47.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.764+0000 7fa3e6d33800 20 zonegroup default 2024-09-12T17:29:47.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.764+0000 7fa3e6d33800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.764+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556890a453c0 con 0x7fa3dc038070 2024-09-12T17:29:47.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.765+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa3cc03b040 con 0x7fa3dc038070 2024-09-12T17:29:47.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.765+0000 7fa3e6d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.765+0000 7fa3e6d33800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.765+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556890a47600 con 0x556890a41f50 2024-09-12T17:29:47.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.765+0000 7fa3e2a76640 1 -- 172.21.15.170:0/2061563966 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa3d408a070 con 0x556890a41f50 2024-09-12T17:29:47.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.765+0000 7fa3e6d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.765+0000 7fa3e6d33800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.765+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556890a479a0 con 0x556890a41f50 2024-09-12T17:29:47.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.765+0000 7fa3e2a76640 1 -- 172.21.15.170:0/2061563966 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa3d408a070 con 0x556890a41f50 2024-09-12T17:29:47.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.765+0000 7fa3e6d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.765+0000 7fa3e6d33800 20 started sync module instance, tier type = 2024-09-12T17:29:47.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.765+0000 7fa3e6d33800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:29:47.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.765+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556890a46a90 con 0x556890a3d470 2024-09-12T17:29:47.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.766+0000 7fa3e3277640 1 -- 172.21.15.170:0/2061563966 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(44 notify.0 [create] v31'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3dc0083e0 con 0x556890a3d470 2024-09-12T17:29:47.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.766+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93907591655312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556890a46a90 con 0x556890a3d470 2024-09-12T17:29:47.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.766+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556890a48470 con 0x556890a38a80 2024-09-12T17:29:47.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.767+0000 7fa3e3277640 1 -- 172.21.15.170:0/2061563966 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93907591655312] v31'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3dc0083e0 con 0x556890a3d470 2024-09-12T17:29:47.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.767+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v31'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3cc03b040 con 0x556890a38a80 2024-09-12T17:29:47.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.767+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93907591659360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556890a46a90 con 0x556890a38a80 2024-09-12T17:29:47.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.768+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556890a48ee0 con 0x556890a41f50 2024-09-12T17:29:47.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.769+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93907591659360] v31'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3cc03b040 con 0x556890a38a80 2024-09-12T17:29:47.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.769+0000 7fa3e2a76640 1 -- 172.21.15.170:0/2061563966 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v31'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3d408a070 con 0x556890a41f50 2024-09-12T17:29:47.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.769+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93907591652832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556890a46a00 con 0x556890a41f50 2024-09-12T17:29:47.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.769+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556890a49dd0 con 0x556890a3d470 2024-09-12T17:29:47.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.770+0000 7fa3e2a76640 1 -- 172.21.15.170:0/2061563966 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93907591652832] v31'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3d408a070 con 0x556890a41f50 2024-09-12T17:29:47.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.770+0000 7fa3e3277640 1 -- 172.21.15.170:0/2061563966 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(50 notify.3 [create] v31'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3dc0083e0 con 0x556890a3d470 2024-09-12T17:29:47.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.770+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93907591665952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556890a49d40 con 0x556890a3d470 2024-09-12T17:29:47.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.770+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556890a4ac90 con 0x556890a38a80 2024-09-12T17:29:47.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.771+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v31'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3cc03b040 con 0x556890a38a80 2024-09-12T17:29:47.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.771+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93907591669728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556890a4ac40 con 0x556890a38a80 2024-09-12T17:29:47.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.771+0000 7fa3e3277640 1 -- 172.21.15.170:0/2061563966 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93907591665952] v31'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3dc0083e0 con 0x556890a3d470 2024-09-12T17:29:47.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.771+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556890a4bc30 con 0x7fa3dc038070 2024-09-12T17:29:47.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.772+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(54 notify.5 [create] v31'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3cc03b040 con 0x7fa3dc038070 2024-09-12T17:29:47.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.772+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93907591673600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556890a4bbf0 con 0x7fa3dc038070 2024-09-12T17:29:47.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.772+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556890a4c640 con 0x7fa3dc038070 2024-09-12T17:29:47.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.772+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93907591669728] v31'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3cc03b040 con 0x556890a38a80 2024-09-12T17:29:47.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.773+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93907591673600] v31'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3cc03b040 con 0x7fa3dc038070 2024-09-12T17:29:47.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.773+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v31'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3cc03b040 con 0x7fa3dc038070 2024-09-12T17:29:47.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.773+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93907591668160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556890a4c190 con 0x7fa3dc038070 2024-09-12T17:29:47.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.773+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556890a4ca40 con 0x7fa3dc038070 2024-09-12T17:29:47.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.774+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93907591668160] v31'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3cc03b040 con 0x7fa3dc038070 2024-09-12T17:29:47.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.774+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(58 notify.7 [create] v31'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3cc03b040 con 0x7fa3dc038070 2024-09-12T17:29:47.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.774+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93907591671984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556890a4cc20 con 0x7fa3dc038070 2024-09-12T17:29:47.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.774+0000 7fa3e6d33800 20 add_watcher() i=0 2024-09-12T17:29:47.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.774+0000 7fa3e6d33800 20 add_watcher() i=1 2024-09-12T17:29:47.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.774+0000 7fa3e6d33800 20 add_watcher() i=2 2024-09-12T17:29:47.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.774+0000 7fa3e6d33800 20 add_watcher() i=3 2024-09-12T17:29:47.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.774+0000 7fa3e6d33800 20 add_watcher() i=4 2024-09-12T17:29:47.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.774+0000 7fa3e6d33800 20 add_watcher() i=5 2024-09-12T17:29:47.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.774+0000 7fa3e6d33800 20 add_watcher() i=6 2024-09-12T17:29:47.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.775+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93907591671984] v31'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3cc03b040 con 0x7fa3dc038070 2024-09-12T17:29:47.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.775+0000 7fa3e6d33800 20 add_watcher() i=7 2024-09-12T17:29:47.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.775+0000 7fa3e6d33800 2 all 8 watchers are set, enabling cache 2024-09-12T17:29:47.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.775+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556890a4fff0 con 0x556890a38a80 2024-09-12T17:29:47.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.776+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa3cc03b040 con 0x556890a38a80 2024-09-12T17:29:47.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.776+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93907591678736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556890a4d450 con 0x556890a38a80 2024-09-12T17:29:47.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.777+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93907591678736] v31'258 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa3cc03b040 con 0x556890a38a80 2024-09-12T17:29:47.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.777+0000 7fa299fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:47.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.777+0000 7fa3e6d33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:29:47.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.777+0000 7fa3e6d33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:29:47.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.777+0000 7fa3e6d33800 5 note: GC not initialized 2024-09-12T17:29:47.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.777+0000 7fa298fe1640 20 reqs_thread_entry: start 2024-09-12T17:29:47.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.777+0000 7fa3e6d33800 20 init_complete bucket index max shards: 11 2024-09-12T17:29:47.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.777+0000 7fa3e6d33800 20 Filter name: none 2024-09-12T17:29:47.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.777+0000 7fa291ffb640 20 reqs_thread_entry: start 2024-09-12T17:29:47.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.777+0000 7fa3e6d33800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-12T17:29:47.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.777+0000 7fa3e6d33800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.777+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556890a82f40 con 0x7fa3dc038070 2024-09-12T17:29:47.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.778+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7fa3cc03b040 con 0x7fa3dc038070 2024-09-12T17:29:47.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.778+0000 7fa3e6d33800 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T17:29:47.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.778+0000 7fa3e6d33800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-12T17:29:47.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.778+0000 7fa3e6d33800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:29:47.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.778+0000 7fa3e6d33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:29:47.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.778+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556890a893b0 con 0x7fa3dc038070 2024-09-12T17:29:47.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.779+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v31'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fa3cc03b040 con 0x7fa3dc038070 2024-09-12T17:29:47.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.780+0000 7fa3e6d33800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T17:29:47.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.780+0000 7fa3e6d33800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:29:47.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.780+0000 7fa3e6d33800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-12T17:29:47.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.780+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93907591925104 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556890a849d0 con 0x556890a38a80 2024-09-12T17:29:47.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.780+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== watch-notify(notify (1) cookie 93907591669728 notify 133143986200 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7fa3cc018040 con 0x556890a38a80 2024-09-12T17:29:47.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.780+0000 7fa2c67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986200 cookie 93907591669728 notifier 4869 bl.length()=666 2024-09-12T17:29:47.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.780+0000 7fa2c67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T17:29:47.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.780+0000 7fa2c67fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:29:47.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.780+0000 7fa2c67fc640 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fa2a8003ea0 con 0x556890a38a80 2024-09-12T17:29:47.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.780+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(64 notify.4 [notify cookie 93907591925104 out=8b] v0'0 uv258 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa3cc03b040 con 0x556890a38a80 2024-09-12T17:29:47.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.780+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3cc03b040 con 0x556890a38a80 2024-09-12T17:29:47.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.780+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== watch-notify(notify_complete (2) cookie 93907591925104 notify 133143986200 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa3cc009050 con 0x556890a38a80 2024-09-12T17:29:47.804 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-12T17:29:46.782056Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"read"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:29:46.782042Z","tags":[],"group_ids":[]} 2024-09-12T17:29:47.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.781+0000 7fa299fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:47.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.781+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93907591678736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556890a80db0 con 0x556890a38a80 2024-09-12T17:29:47.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.782+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93907591678736] v31'259 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa3cc03b040 con 0x556890a38a80 2024-09-12T17:29:47.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.782+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93907591655312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556890a80db0 con 0x556890a3d470 2024-09-12T17:29:47.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.783+0000 7fa3e3277640 1 -- 172.21.15.170:0/2061563966 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93907591655312] v31'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3dc0083e0 con 0x556890a3d470 2024-09-12T17:29:47.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.783+0000 7fa3e6d33800 20 remove_watcher() i=0 2024-09-12T17:29:47.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.783+0000 7fa3e6d33800 2 removed watcher, disabling cache 2024-09-12T17:29:47.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.783+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93907591659360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556890a80db0 con 0x556890a38a80 2024-09-12T17:29:47.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.784+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93907591659360] v31'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3cc03b040 con 0x556890a38a80 2024-09-12T17:29:47.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.784+0000 7fa3e6d33800 20 remove_watcher() i=1 2024-09-12T17:29:47.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.784+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93907591652832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556890a80db0 con 0x556890a41f50 2024-09-12T17:29:47.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.785+0000 7fa3e2a76640 1 -- 172.21.15.170:0/2061563966 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93907591652832] v31'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3d408a070 con 0x556890a41f50 2024-09-12T17:29:47.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.785+0000 7fa3e6d33800 20 remove_watcher() i=2 2024-09-12T17:29:47.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.785+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93907591665952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556890a80db0 con 0x556890a3d470 2024-09-12T17:29:47.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.786+0000 7fa3e3277640 1 -- 172.21.15.170:0/2061563966 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93907591665952] v31'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3dc0083e0 con 0x556890a3d470 2024-09-12T17:29:47.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.786+0000 7fa3e6d33800 20 remove_watcher() i=3 2024-09-12T17:29:47.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.786+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93907591669728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556890a80db0 con 0x556890a38a80 2024-09-12T17:29:47.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.787+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93907591669728] v31'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3cc03b040 con 0x556890a38a80 2024-09-12T17:29:47.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.787+0000 7fa3e6d33800 20 remove_watcher() i=4 2024-09-12T17:29:47.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.787+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93907591673600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556890a80db0 con 0x7fa3dc038070 2024-09-12T17:29:47.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.788+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93907591673600] v31'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3cc03b040 con 0x7fa3dc038070 2024-09-12T17:29:47.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.788+0000 7fa3e6d33800 20 remove_watcher() i=5 2024-09-12T17:29:47.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.788+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93907591668160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556890a80db0 con 0x7fa3dc038070 2024-09-12T17:29:47.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.789+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93907591668160] v31'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3cc03b040 con 0x7fa3dc038070 2024-09-12T17:29:47.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.789+0000 7fa3e6d33800 20 remove_watcher() i=6 2024-09-12T17:29:47.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.789+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93907591671984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556890a80db0 con 0x7fa3dc038070 2024-09-12T17:29:47.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.790+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93907591671984] v31'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3cc03b040 con 0x7fa3dc038070 2024-09-12T17:29:47.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.790+0000 7fa3e6d33800 20 remove_watcher() i=7 2024-09-12T17:29:47.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.790+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fa3dc038070 msgr2=0x7fa3dc02b440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.790+0000 7fa3e6d33800 1 --2- 172.21.15.170:0/2061563966 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fa3dc038070 0x7fa3dc02b440 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.790+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x556890a38a80 msgr2=0x556890a3af40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.790+0000 7fa3e6d33800 1 --2- 172.21.15.170:0/2061563966 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x556890a38a80 0x556890a3af40 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.790+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556890a3d470 msgr2=0x556890a3f860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.790+0000 7fa3e6d33800 1 --2- 172.21.15.170:0/2061563966 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556890a3d470 0x556890a3f860 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.790+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x556890a41f50 msgr2=0x556890a44410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.790+0000 7fa3e6d33800 1 --2- 172.21.15.170:0/2061563966 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x556890a41f50 0x556890a44410 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.791+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa2ac03c780 msgr2=0x7fa2ac03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.791+0000 7fa3e6d33800 1 --2- 172.21.15.170:0/2061563966 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa2ac03c780 0x7fa2ac03ec40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa3d406b010 tx=0x7fa3d408a000 comp rx=0 tx=0).stop 2024-09-12T17:29:47.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.791+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556890a25b10 msgr2=0x556890a2d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.791+0000 7fa3e6d33800 1 --2- 172.21.15.170:0/2061563966 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556890a25b10 0x556890a2d130 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc0521a0 tx=0x7fa3dc053260 comp rx=0 tx=0).stop 2024-09-12T17:29:47.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.791+0000 7fa3e2275640 1 -- 172.21.15.170:0/2061563966 reap_dead start 2024-09-12T17:29:47.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.791+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 shutdown_connections 2024-09-12T17:29:47.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.791+0000 7fa3e6d33800 1 --2- 172.21.15.170:0/2061563966 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556890a25b10 0x556890a2d130 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.791+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 >> 172.21.15.170:0/2061563966 conn(0x556890a21f10 msgr2=0x556890a20120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:47.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.791+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 shutdown_connections 2024-09-12T17:29:47.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.791+0000 7fa3e6d33800 1 -- 172.21.15.170:0/2061563966 wait complete. 2024-09-12T17:29:47.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.791+0000 7fa3e6d33800 1 -- 172.21.15.170:0/1316627587 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa2bc03c730 msgr2=0x7fa2bc03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.791+0000 7fa3e6d33800 1 --2- 172.21.15.170:0/1316627587 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa2bc03c730 0x7fa2bc03ebf0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa3d406ce00 tx=0x7fa3d40581c0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.791+0000 7fa3e6d33800 1 -- 172.21.15.170:0/1316627587 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556890a19030 msgr2=0x556890a19450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.791+0000 7fa3e6d33800 1 --2- 172.21.15.170:0/1316627587 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556890a19030 0x556890a19450 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x5568909ff740 tx=0x7fa3dc00bf30 comp rx=0 tx=0).stop 2024-09-12T17:29:47.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.791+0000 7fa3e6d33800 1 -- 172.21.15.170:0/1316627587 shutdown_connections 2024-09-12T17:29:47.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.791+0000 7fa3e6d33800 1 --2- 172.21.15.170:0/1316627587 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa2bc03c730 0x7fa2bc03ebf0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.791+0000 7fa3e6d33800 1 --2- 172.21.15.170:0/1316627587 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556890a19030 0x556890a19450 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.791+0000 7fa3e6d33800 1 -- 172.21.15.170:0/1316627587 >> 172.21.15.170:0/1316627587 conn(0x556890a0d3e0 msgr2=0x556890a0d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:47.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.791+0000 7fa3e6d33800 1 -- 172.21.15.170:0/1316627587 shutdown_connections 2024-09-12T17:29:47.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.791+0000 7fa3e6d33800 1 -- 172.21.15.170:0/1316627587 wait complete. 2024-09-12T17:29:47.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.791+0000 7fa3e6d33800 1 -- 172.21.15.170:0/1322380465 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x556890903df0 msgr2=0x556890a057a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.791+0000 7fa3e6d33800 1 --2- 172.21.15.170:0/1322380465 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x556890903df0 0x556890a057a0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.791+0000 7fa3e6d33800 1 -- 172.21.15.170:0/1322380465 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556890a07b30 msgr2=0x556890a09fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.791+0000 7fa3e6d33800 1 --2- 172.21.15.170:0/1322380465 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556890a07b30 0x556890a09fd0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.791+0000 7fa3e6d33800 1 -- 172.21.15.170:0/1322380465 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa2c803c780 msgr2=0x7fa2c803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.792+0000 7fa3e6d33800 1 --2- 172.21.15.170:0/1322380465 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa2c803c780 0x7fa2c803ec40 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc001e30 tx=0x7fa3cc001390 comp rx=0 tx=0).stop 2024-09-12T17:29:47.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.792+0000 7fa3e6d33800 1 -- 172.21.15.170:0/1322380465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568909034b0 msgr2=0x5568909fe150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.792+0000 7fa3e6d33800 1 --2- 172.21.15.170:0/1322380465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568909034b0 0x5568909fe150 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4063040 tx=0x7fa3d4003330 comp rx=0 tx=0).stop 2024-09-12T17:29:47.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.792+0000 7fa3e6d33800 1 -- 172.21.15.170:0/1322380465 shutdown_connections 2024-09-12T17:29:47.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.792+0000 7fa3e6d33800 1 --2- 172.21.15.170:0/1322380465 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x556890a07b30 0x556890a09fd0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.792+0000 7fa3e6d33800 1 --2- 172.21.15.170:0/1322380465 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fa2c803c780 0x7fa2c803ec40 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.792+0000 7fa3e6d33800 1 --2- 172.21.15.170:0/1322380465 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x556890903df0 0x556890a057a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.792+0000 7fa3e6d33800 1 --2- 172.21.15.170:0/1322380465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5568909034b0 0x5568909fe150 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.792+0000 7fa3e6d33800 1 -- 172.21.15.170:0/1322380465 >> 172.21.15.170:0/1322380465 conn(0x5568908ff1c0 msgr2=0x5568909f7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:47.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.792+0000 7fa3e6d33800 1 -- 172.21.15.170:0/1322380465 shutdown_connections 2024-09-12T17:29:47.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.792+0000 7fa3e6d33800 1 -- 172.21.15.170:0/1322380465 wait complete. 2024-09-12T17:29:47.819 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T17:29:46.782056Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:29:46.782042Z', 'tags': [], 'group_ids': []} 2024-09-12T17:29:47.819 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T17:29:46.782056Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:29:46.782042Z', 'tags': [], 'group_ids': []} 2024-09-12T17:29:47.819 ERROR:root:0 2024-09-12T17:29:47.819 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T17:29:47.824 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:29:47.824 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-12T17:29:47.825 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-12T17:29:47.825 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'user-info-without-keys=*' 2024-09-12T17:29:47.873 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:29:47.874 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:29:47.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.873+0000 7fe5f5231800 1 Processor -- start 2024-09-12T17:29:47.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.873+0000 7fe5f5231800 1 -- start start 2024-09-12T17:29:47.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.873+0000 7fe5f5231800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x56288fc0a200 0x56288fc0c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.873+0000 7fe5f5231800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56288faafe40 con 0x56288fc06690 2024-09-12T17:29:47.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.873+0000 7fe5f5231800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x56288fa7a680 con 0x56288fc0a200 2024-09-12T17:29:47.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.874+0000 7fe5efd8a640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x56288fc0a200 0x56288fc0c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.874+0000 7fe5f058b640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x56288fc06690 0x56288fc08a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:44926/0 (socket says 172.21.15.170:44926) 2024-09-12T17:29:47.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.874+0000 7fe5f058b640 1 -- 172.21.15.170:0/3942246105 learned_addr learned my addr 172.21.15.170:0/3942246105 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:29:47.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.874+0000 7fe5ef589640 1 -- 172.21.15.170:0/3942246105 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4164460785 0 0) 0x56288faafe40 con 0x56288fc06690 2024-09-12T17:29:47.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.874+0000 7fe5ef589640 1 -- 172.21.15.170:0/3942246105 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe5d8001e10 con 0x56288fc06690 2024-09-12T17:29:47.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.874+0000 7fe5efd8a640 1 -- 172.21.15.170:0/3942246105 >> v1:172.21.15.47:6789/0 conn(0x56288fc06690 legacy=0x56288fc08a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.874+0000 7fe5efd8a640 1 -- 172.21.15.170:0/3942246105 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56288fa966b0 con 0x56288fc0a200 2024-09-12T17:29:47.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.876+0000 7fe5efd8a640 1 --2- 172.21.15.170:0/3942246105 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56288fc0a200 0x56288fc0c6c0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fe5e400a470 tx=0x7fe5e4045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c91f2fa9186aa0a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.876+0000 7fe5ef589640 1 -- 172.21.15.170:0/3942246105 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5e4059070 con 0x56288fc0a200 2024-09-12T17:29:47.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.876+0000 7fe5ef589640 1 -- 172.21.15.170:0/3942246105 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5e4054570 con 0x56288fc0a200 2024-09-12T17:29:47.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.876+0000 7fe5ef589640 1 -- 172.21.15.170:0/3942246105 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5e4054870 con 0x56288fc0a200 2024-09-12T17:29:47.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.877+0000 7fe5f5231800 1 -- 172.21.15.170:0/3942246105 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56288fc0a200 msgr2=0x56288fc0c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.877+0000 7fe5f5231800 1 --2- 172.21.15.170:0/3942246105 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56288fc0a200 0x56288fc0c6c0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fe5e400a470 tx=0x7fe5e4045920 comp rx=0 tx=0).stop 2024-09-12T17:29:47.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.877+0000 7fe5f5231800 1 -- 172.21.15.170:0/3942246105 shutdown_connections 2024-09-12T17:29:47.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.877+0000 7fe5f5231800 1 --2- 172.21.15.170:0/3942246105 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56288fc0a200 0x56288fc0c6c0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.877+0000 7fe5f5231800 1 -- 172.21.15.170:0/3942246105 >> 172.21.15.170:0/3942246105 conn(0x56288fc001d0 msgr2=0x56288fc02630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:47.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.877+0000 7fe5f5231800 1 -- 172.21.15.170:0/3942246105 shutdown_connections 2024-09-12T17:29:47.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.877+0000 7fe5f5231800 1 -- 172.21.15.170:0/3942246105 wait complete. 2024-09-12T17:29:47.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.891+0000 7fe5f5231800 1 Processor -- start 2024-09-12T17:29:47.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.891+0000 7fe5f5231800 1 -- start start 2024-09-12T17:29:47.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.891+0000 7fe5f5231800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56288fc06690 0x56288fcf5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.891+0000 7fe5f5231800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56288fa9edd0 con 0x56288fc06690 2024-09-12T17:29:47.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.891+0000 7fe5f058b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56288fc06690 0x56288fcf5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.891+0000 7fe5f058b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56288fc06690 0x56288fcf5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35190/0 (socket says 172.21.15.170:35190) 2024-09-12T17:29:47.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.891+0000 7fe5f058b640 1 -- 172.21.15.170:0/1501724110 learned_addr learned my addr 172.21.15.170:0/1501724110 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:47.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.892+0000 7fe5f058b640 1 -- 172.21.15.170:0/1501724110 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56288fab7e10 con 0x56288fc06690 2024-09-12T17:29:47.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.892+0000 7fe5f058b640 1 --2- 172.21.15.170:0/1501724110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56288fc06690 0x56288fcf5550 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0001e30 tx=0x7fe5e000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b7cddf077aae8ed server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.892+0000 7fe4de60c640 1 -- 172.21.15.170:0/1501724110 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5e0012020 con 0x56288fc06690 2024-09-12T17:29:47.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.892+0000 7fe4de60c640 1 -- 172.21.15.170:0/1501724110 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5e000e470 con 0x56288fc06690 2024-09-12T17:29:47.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.892+0000 7fe4de60c640 1 -- 172.21.15.170:0/1501724110 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5e000e790 con 0x56288fc06690 2024-09-12T17:29:47.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.893+0000 7fe5f5231800 1 -- 172.21.15.170:0/1501724110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56288fc06690 msgr2=0x56288fcf5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.893+0000 7fe5f5231800 1 --2- 172.21.15.170:0/1501724110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56288fc06690 0x56288fcf5550 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0001e30 tx=0x7fe5e000b780 comp rx=0 tx=0).stop 2024-09-12T17:29:47.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.893+0000 7fe5f5231800 1 -- 172.21.15.170:0/1501724110 shutdown_connections 2024-09-12T17:29:47.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.893+0000 7fe5f5231800 1 --2- 172.21.15.170:0/1501724110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56288fc06690 0x56288fcf5550 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.893+0000 7fe5f5231800 1 -- 172.21.15.170:0/1501724110 >> 172.21.15.170:0/1501724110 conn(0x56288fc001d0 msgr2=0x56288fcf0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:47.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.893+0000 7fe5f5231800 1 -- 172.21.15.170:0/1501724110 shutdown_connections 2024-09-12T17:29:47.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.893+0000 7fe5f5231800 1 -- 172.21.15.170:0/1501724110 wait complete. 2024-09-12T17:29:47.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.893+0000 7fe5f5231800 1 Processor -- start 2024-09-12T17:29:47.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.893+0000 7fe5f5231800 1 -- start start 2024-09-12T17:29:47.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.893+0000 7fe5f5231800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56288fc06690 0x56288fc05d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.893+0000 7fe5f5231800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56288fc0d040 con 0x56288fc06690 2024-09-12T17:29:47.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.894+0000 7fe5f058b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56288fc06690 0x56288fc05d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.894+0000 7fe5f058b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56288fc06690 0x56288fc05d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35196/0 (socket says 172.21.15.170:35196) 2024-09-12T17:29:47.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.894+0000 7fe5f058b640 1 -- 172.21.15.170:0/3067779824 learned_addr learned my addr 172.21.15.170:0/3067779824 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:47.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.894+0000 7fe5f058b640 1 -- 172.21.15.170:0/3067779824 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56288fc062f0 con 0x56288fc06690 2024-09-12T17:29:47.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.894+0000 7fe5f058b640 1 --2- 172.21.15.170:0/3067779824 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56288fc06690 0x56288fc05d90 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x56288fcf64e0 tx=0x7fe5e00040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.894+0000 7fe4dce09640 1 -- 172.21.15.170:0/3067779824 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5e0012030 con 0x56288fc06690 2024-09-12T17:29:47.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.894+0000 7fe4dce09640 1 -- 172.21.15.170:0/3067779824 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5e001a7a0 con 0x56288fc06690 2024-09-12T17:29:47.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.894+0000 7fe5f5231800 1 -- 172.21.15.170:0/3067779824 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56288fc046a0 con 0x56288fc06690 2024-09-12T17:29:47.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.894+0000 7fe4dce09640 1 -- 172.21.15.170:0/3067779824 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5e001aaa0 con 0x56288fc06690 2024-09-12T17:29:47.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.894+0000 7fe5f5231800 1 -- 172.21.15.170:0/3067779824 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56288fc04c60 con 0x56288fc06690 2024-09-12T17:29:47.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.895+0000 7fe4dce09640 1 -- 172.21.15.170:0/3067779824 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe5e0015020 con 0x56288fc06690 2024-09-12T17:29:47.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.895+0000 7fe4dce09640 1 --2- 172.21.15.170:0/3067779824 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe4d803c780 0x7fe4d803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.895+0000 7fe4dce09640 1 -- 172.21.15.170:0/3067779824 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fe5e0020070 con 0x56288fc06690 2024-09-12T17:29:47.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.895+0000 7fe5efd8a640 1 --2- 172.21.15.170:0/3067779824 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe4d803c780 0x7fe4d803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.896+0000 7fe5f5231800 1 --2- 172.21.15.170:0/3067779824 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56288fc0a200 0x56288fd06270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.896+0000 7fe5f5231800 1 -- 172.21.15.170:0/3067779824 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56288fd06890 con 0x56288fc0a200 2024-09-12T17:29:47.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.896+0000 7fe5f0d8c640 1 --2- 172.21.15.170:0/3067779824 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56288fc0a200 0x56288fd06270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.896+0000 7fe5efd8a640 1 --2- 172.21.15.170:0/3067779824 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe4d803c780 0x7fe4d803ec40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x56288fb784d0 tx=0x7fe5e4050000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.896+0000 7fe5f0d8c640 1 --2- 172.21.15.170:0/3067779824 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56288fc0a200 0x56288fd06270 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.896+0000 7fe5f0d8c640 1 -- 172.21.15.170:0/3067779824 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe5e800a4d0 con 0x56288fc0a200 2024-09-12T17:29:47.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.896+0000 7fe5f5231800 1 -- 172.21.15.170:0/3067779824 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56288fd07170 con 0x56288fc0a200 2024-09-12T17:29:47.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.897+0000 7fe5f0d8c640 1 -- 172.21.15.170:0/3067779824 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe5e800a4d0 con 0x56288fc0a200 2024-09-12T17:29:47.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.897+0000 7fe5f5231800 1 --2- 172.21.15.170:0/3067779824 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56288fd08ba0 0x56288fd0aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.897+0000 7fe5f5231800 1 -- 172.21.15.170:0/3067779824 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56288fd0b780 con 0x56288fd08ba0 2024-09-12T17:29:47.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.897+0000 7fe5f058b640 1 --2- 172.21.15.170:0/3067779824 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56288fd08ba0 0x56288fd0aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.897+0000 7fe5f058b640 1 --2- 172.21.15.170:0/3067779824 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56288fd08ba0 0x56288fd0aff0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.897+0000 7fe5f058b640 1 -- 172.21.15.170:0/3067779824 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe5e0018950 con 0x56288fd08ba0 2024-09-12T17:29:47.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.897+0000 7fe5f5231800 1 -- 172.21.15.170:0/3067779824 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56288fd079c0 con 0x56288fc0a200 2024-09-12T17:29:47.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.897+0000 7fe5f0d8c640 1 -- 172.21.15.170:0/3067779824 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe5e800a4d0 con 0x56288fc0a200 2024-09-12T17:29:47.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.897+0000 7fe5f5231800 1 -- 172.21.15.170:0/3067779824 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56288fd07da0 con 0x56288fd08ba0 2024-09-12T17:29:47.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.898+0000 7fe5f058b640 1 -- 172.21.15.170:0/3067779824 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe5e0018950 con 0x56288fd08ba0 2024-09-12T17:29:47.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.898+0000 7fe5f5231800 1 Processor -- start 2024-09-12T17:29:47.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.898+0000 7fe5f5231800 1 -- start start 2024-09-12T17:29:47.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.898+0000 7fe5f5231800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56288fd19ff0 0x56288fd1a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.898+0000 7fe5f5231800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56288fafca00 con 0x56288fd19ff0 2024-09-12T17:29:47.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.899+0000 7fe5f0d8c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56288fd19ff0 0x56288fd1a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.899+0000 7fe5f0d8c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56288fd19ff0 0x56288fd1a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35206/0 (socket says 172.21.15.170:35206) 2024-09-12T17:29:47.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.899+0000 7fe5f0d8c640 1 -- 172.21.15.170:0/2003887901 learned_addr learned my addr 172.21.15.170:0/2003887901 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:47.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.899+0000 7fe5f0d8c640 1 -- 172.21.15.170:0/2003887901 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56288fd1aa50 con 0x56288fd19ff0 2024-09-12T17:29:47.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.899+0000 7fe5f0d8c640 1 --2- 172.21.15.170:0/2003887901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56288fd19ff0 0x56288fd1a410 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x56288fc04e80 tx=0x7fe5e80167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.899+0000 7fe4d5ffb640 1 -- 172.21.15.170:0/2003887901 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5e8013640 con 0x56288fd19ff0 2024-09-12T17:29:47.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.899+0000 7fe4d5ffb640 1 -- 172.21.15.170:0/2003887901 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5e80137e0 con 0x56288fd19ff0 2024-09-12T17:29:47.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.899+0000 7fe5f5231800 1 -- 172.21.15.170:0/2003887901 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56288fd1b280 con 0x56288fd19ff0 2024-09-12T17:29:47.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.899+0000 7fe4d5ffb640 1 -- 172.21.15.170:0/2003887901 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5e8013b00 con 0x56288fd19ff0 2024-09-12T17:29:47.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.899+0000 7fe5f5231800 1 -- 172.21.15.170:0/2003887901 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56288fd1b820 con 0x56288fd19ff0 2024-09-12T17:29:47.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.900+0000 7fe4d5ffb640 1 -- 172.21.15.170:0/2003887901 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe5e8011040 con 0x56288fd19ff0 2024-09-12T17:29:47.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.900+0000 7fe4d5ffb640 1 --2- 172.21.15.170:0/2003887901 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe4c803c730 0x7fe4c803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.900+0000 7fe4d5ffb640 1 -- 172.21.15.170:0/2003887901 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fe5e800e040 con 0x56288fd19ff0 2024-09-12T17:29:47.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.900+0000 7fe5f058b640 1 --2- 172.21.15.170:0/2003887901 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe4c803c730 0x7fe4c803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.901+0000 7fe5f5231800 1 Processor -- start 2024-09-12T17:29:47.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.901+0000 7fe5f5231800 1 -- start start 2024-09-12T17:29:47.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.901+0000 7fe5f058b640 1 --2- 172.21.15.170:0/2003887901 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe4c803c730 0x7fe4c803ebf0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0052150 tx=0x7fe5e0017f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.901+0000 7fe5f5231800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56288fd269b0 0x56288fd26db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.901+0000 7fe5f5231800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56288fcf5da0 con 0x56288fd269b0 2024-09-12T17:29:47.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.901+0000 7fe5f0d8c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56288fd269b0 0x56288fd26db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.901+0000 7fe5f0d8c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56288fd269b0 0x56288fd26db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35210/0 (socket says 172.21.15.170:35210) 2024-09-12T17:29:47.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.901+0000 7fe5f0d8c640 1 -- 172.21.15.170:0/1120515361 learned_addr learned my addr 172.21.15.170:0/1120515361 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:47.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.901+0000 7fe5f0d8c640 1 -- 172.21.15.170:0/1120515361 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56288fd273a0 con 0x56288fd269b0 2024-09-12T17:29:47.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.902+0000 7fe5f0d8c640 1 --2- 172.21.15.170:0/1120515361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56288fd269b0 0x56288fd26db0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8053ce0 tx=0x7fe5e8020ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4def83e217ee6c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.902+0000 7fe4cf7fe640 1 -- 172.21.15.170:0/1120515361 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5e8052020 con 0x56288fd269b0 2024-09-12T17:29:47.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.902+0000 7fe4cf7fe640 1 -- 172.21.15.170:0/1120515361 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5e804d0a0 con 0x56288fd269b0 2024-09-12T17:29:47.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.902+0000 7fe4cf7fe640 1 -- 172.21.15.170:0/1120515361 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5e802aa40 con 0x56288fd269b0 2024-09-12T17:29:47.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.902+0000 7fe5f5231800 1 -- 172.21.15.170:0/1120515361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56288fd269b0 msgr2=0x56288fd26db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.902+0000 7fe5f5231800 1 --2- 172.21.15.170:0/1120515361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56288fd269b0 0x56288fd26db0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8053ce0 tx=0x7fe5e8020ee0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.902+0000 7fe5f5231800 1 -- 172.21.15.170:0/1120515361 shutdown_connections 2024-09-12T17:29:47.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.902+0000 7fe5f5231800 1 --2- 172.21.15.170:0/1120515361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56288fd269b0 0x56288fd26db0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.902+0000 7fe5f5231800 1 -- 172.21.15.170:0/1120515361 >> 172.21.15.170:0/1120515361 conn(0x56288fd22db0 msgr2=0x56288fd20ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:47.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.902+0000 7fe5f5231800 1 -- 172.21.15.170:0/1120515361 shutdown_connections 2024-09-12T17:29:47.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.902+0000 7fe5f5231800 1 -- 172.21.15.170:0/1120515361 wait complete. 2024-09-12T17:29:47.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.903+0000 7fe5f5231800 1 Processor -- start 2024-09-12T17:29:47.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.903+0000 7fe5f5231800 1 -- start start 2024-09-12T17:29:47.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.903+0000 7fe5f5231800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56288fd269b0 0x56288fd2df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.903+0000 7fe5f5231800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56288fd279c0 con 0x56288fd269b0 2024-09-12T17:29:47.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.903+0000 7fe5f0d8c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56288fd269b0 0x56288fd2df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.903+0000 7fe5f0d8c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56288fd269b0 0x56288fd2df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35218/0 (socket says 172.21.15.170:35218) 2024-09-12T17:29:47.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.903+0000 7fe5f0d8c640 1 -- 172.21.15.170:0/227790048 learned_addr learned my addr 172.21.15.170:0/227790048 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:47.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.903+0000 7fe5f0d8c640 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56288fd2e4d0 con 0x56288fd269b0 2024-09-12T17:29:47.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.903+0000 7fe5f0d8c640 1 --2- 172.21.15.170:0/227790048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56288fd269b0 0x56288fd2df70 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fe5e800afe0 tx=0x7fe5e8053d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.904+0000 7fe4cdffb640 1 -- 172.21.15.170:0/227790048 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5e8037070 con 0x56288fd269b0 2024-09-12T17:29:47.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.904+0000 7fe4cdffb640 1 -- 172.21.15.170:0/227790048 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5e8055750 con 0x56288fd269b0 2024-09-12T17:29:47.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.904+0000 7fe4cdffb640 1 -- 172.21.15.170:0/227790048 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5e80204d0 con 0x56288fd269b0 2024-09-12T17:29:47.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.904+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56288fd2e760 con 0x56288fd269b0 2024-09-12T17:29:47.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.904+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56288fd2f2f0 con 0x56288fd269b0 2024-09-12T17:29:47.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.904+0000 7fe4cdffb640 1 -- 172.21.15.170:0/227790048 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe5e803a070 con 0x56288fd269b0 2024-09-12T17:29:47.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.905+0000 7fe4cdffb640 1 --2- 172.21.15.170:0/227790048 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe4c003c780 0x7fe4c003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.905+0000 7fe4cdffb640 1 -- 172.21.15.170:0/227790048 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fe5e803dbf0 con 0x56288fd269b0 2024-09-12T17:29:47.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.905+0000 7fe5f058b640 1 --2- 172.21.15.170:0/227790048 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe4c003c780 0x7fe4c003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.905+0000 7fe5f058b640 1 --2- 172.21.15.170:0/227790048 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe4c003c780 0x7fe4c003ec40 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe5e004b650 tx=0x7fe5e002f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.905+0000 7fe5f5231800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.905+0000 7fe5f5231800 1 --2- 172.21.15.170:0/227790048 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56288fd39840 0x56288fd3bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.905+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56288fd3c450 con 0x56288fd39840 2024-09-12T17:29:47.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.905+0000 7fe5efd8a640 1 --2- 172.21.15.170:0/227790048 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56288fd39840 0x56288fd3bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.906+0000 7fe5efd8a640 1 --2- 172.21.15.170:0/227790048 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56288fd39840 0x56288fd3bd00 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.906+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe5e4061430 con 0x56288fd39840 2024-09-12T17:29:47.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.906+0000 7fe5f5231800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.906+0000 7fe5f5231800 20 realm 2024-09-12T17:29:47.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.906+0000 7fe5f5231800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.906+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56288fd3c820 con 0x56288fd39840 2024-09-12T17:29:47.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.906+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe5e4061430 con 0x56288fd39840 2024-09-12T17:29:47.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.906+0000 7fe5f5231800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.906+0000 7fe5f5231800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:29:47.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.906+0000 7fe5f5231800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.906+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56288fd3d0f0 con 0x56288fd39840 2024-09-12T17:29:47.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.906+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe5e4061430 con 0x56288fd39840 2024-09-12T17:29:47.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.906+0000 7fe5f5231800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.906+0000 7fe5f5231800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.906+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56288fd3d490 con 0x56288fd39840 2024-09-12T17:29:47.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.907+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe5e4061430 con 0x56288fd39840 2024-09-12T17:29:47.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.907+0000 7fe5f5231800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:47.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.907+0000 7fe5f5231800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.907+0000 7fe5f5231800 1 --2- 172.21.15.170:0/227790048 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56288fd3e1f0 0x56288fd405e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.907+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56288fd40ba0 con 0x56288fd3e1f0 2024-09-12T17:29:47.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.907+0000 7fe5f0d8c640 1 --2- 172.21.15.170:0/227790048 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56288fd3e1f0 0x56288fd405e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.907+0000 7fe5f0d8c640 1 --2- 172.21.15.170:0/227790048 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56288fd3e1f0 0x56288fd405e0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.907+0000 7fe5f0d8c640 1 -- 172.21.15.170:0/227790048 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe5e8039030 con 0x56288fd3e1f0 2024-09-12T17:29:47.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.907+0000 7fe5f5231800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:29:47.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.907+0000 7fe5f5231800 20 searching for the correct realm 2024-09-12T17:29:47.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.907+0000 7fe5f5231800 1 --2- 172.21.15.170:0/227790048 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x56288fd42b70 0x56288fd45030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.907+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56288fd45700 con 0x56288fd42b70 2024-09-12T17:29:47.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.907+0000 7fe5f058b640 1 --2- 172.21.15.170:0/227790048 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x56288fd42b70 0x56288fd45030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.908+0000 7fe5f058b640 1 --2- 172.21.15.170:0/227790048 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x56288fd42b70 0x56288fd45030 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.908+0000 7fe5f058b640 1 -- 172.21.15.170:0/227790048 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5e0018950 con 0x56288fd42b70 2024-09-12T17:29:47.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.908+0000 7fe5f058b640 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56288fd45700 con 0x56288fd3e1f0 2024-09-12T17:29:47.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.908+0000 7fe5f0d8c640 1 -- 172.21.15.170:0/227790048 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5e8039030 con 0x56288fd3e1f0 2024-09-12T17:29:47.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.908+0000 7fe5f0d8c640 1 --2- 172.21.15.170:0/227790048 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fe5e803c060 0x7fe5e8004db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:47.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.908+0000 7fe5f0d8c640 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56288fd45700 con 0x7fe5e803c060 2024-09-12T17:29:47.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.908+0000 7fe5efd8a640 1 --2- 172.21.15.170:0/227790048 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fe5e803c060 0x7fe5e8004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:47.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.909+0000 7fe5efd8a640 1 --2- 172.21.15.170:0/227790048 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fe5e803c060 0x7fe5e8004db0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:47.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.909+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5e4061430 con 0x7fe5e803c060 2024-09-12T17:29:47.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.909+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56288fd45700 con 0x56288fd39840 2024-09-12T17:29:47.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.909+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5e4061430 con 0x56288fd39840 2024-09-12T17:29:47.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.909+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56288fd45700 con 0x56288fd39840 2024-09-12T17:29:47.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.909+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5e4061430 con 0x56288fd39840 2024-09-12T17:29:47.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.909+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56288fd45700 con 0x7fe5e803c060 2024-09-12T17:29:47.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.910+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5e4061430 con 0x7fe5e803c060 2024-09-12T17:29:47.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.910+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56288fd45700 con 0x7fe5e803c060 2024-09-12T17:29:47.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.910+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5e4061430 con 0x7fe5e803c060 2024-09-12T17:29:47.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.910+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56288fd45700 con 0x56288fd3e1f0 2024-09-12T17:29:47.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.910+0000 7fe5f0d8c640 1 -- 172.21.15.170:0/227790048 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5e8039030 con 0x56288fd3e1f0 2024-09-12T17:29:47.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.910+0000 7fe5f0d8c640 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56288fd45700 con 0x56288fd42b70 2024-09-12T17:29:47.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.910+0000 7fe5f058b640 1 -- 172.21.15.170:0/227790048 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5e0018950 con 0x56288fd42b70 2024-09-12T17:29:47.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.910+0000 7fe5f058b640 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56288fd45700 con 0x56288fd39840 2024-09-12T17:29:47.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.911+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5e4061430 con 0x56288fd39840 2024-09-12T17:29:47.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.911+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56288fd45700 con 0x7fe5e803c060 2024-09-12T17:29:47.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.911+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5e4061430 con 0x7fe5e803c060 2024-09-12T17:29:47.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.911+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56288fd45700 con 0x56288fd39840 2024-09-12T17:29:47.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.911+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5e4061430 con 0x56288fd39840 2024-09-12T17:29:47.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.911+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56288fd45700 con 0x56288fd3e1f0 2024-09-12T17:29:47.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.911+0000 7fe5f0d8c640 1 -- 172.21.15.170:0/227790048 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fe5e8039030 con 0x56288fd3e1f0 2024-09-12T17:29:47.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.911+0000 7fe5f0d8c640 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56288fd45700 con 0x56288fd42b70 2024-09-12T17:29:47.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.911+0000 7fe5f058b640 1 -- 172.21.15.170:0/227790048 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5e0018950 con 0x56288fd42b70 2024-09-12T17:29:47.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.911+0000 7fe5f058b640 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56288fd45700 con 0x56288fd42b70 2024-09-12T17:29:47.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.912+0000 7fe5f058b640 1 -- 172.21.15.170:0/227790048 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5e0018950 con 0x56288fd42b70 2024-09-12T17:29:47.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.912+0000 7fe5f058b640 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56288fd45700 con 0x56288fd3e1f0 2024-09-12T17:29:47.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.912+0000 7fe5f0d8c640 1 -- 172.21.15.170:0/227790048 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5e8039030 con 0x56288fd3e1f0 2024-09-12T17:29:47.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.912+0000 7fe5f0d8c640 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56288fd45700 con 0x56288fd42b70 2024-09-12T17:29:47.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.912+0000 7fe5f058b640 1 -- 172.21.15.170:0/227790048 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5e0018950 con 0x56288fd42b70 2024-09-12T17:29:47.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.912+0000 7fe5f058b640 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56288fd45700 con 0x56288fd42b70 2024-09-12T17:29:47.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.912+0000 7fe5f058b640 1 -- 172.21.15.170:0/227790048 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5e0018950 con 0x56288fd42b70 2024-09-12T17:29:47.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.912+0000 7fe5f058b640 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56288fd45700 con 0x56288fd39840 2024-09-12T17:29:47.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.913+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5e4061430 con 0x56288fd39840 2024-09-12T17:29:47.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.913+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56288fd45700 con 0x56288fd39840 2024-09-12T17:29:47.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.913+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v31'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe5e4061430 con 0x56288fd39840 2024-09-12T17:29:47.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.913+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56288fd45700 con 0x7fe5e803c060 2024-09-12T17:29:47.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.913+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5e4061430 con 0x7fe5e803c060 2024-09-12T17:29:47.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.913+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56288fd45700 con 0x56288fd42b70 2024-09-12T17:29:47.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.913+0000 7fe5f058b640 1 -- 172.21.15.170:0/227790048 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5e0018950 con 0x56288fd42b70 2024-09-12T17:29:47.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.913+0000 7fe5f058b640 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56288fd45700 con 0x56288fd3e1f0 2024-09-12T17:29:47.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.914+0000 7fe5f0d8c640 1 -- 172.21.15.170:0/227790048 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5e8039030 con 0x56288fd3e1f0 2024-09-12T17:29:47.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.914+0000 7fe5f0d8c640 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56288fd45700 con 0x56288fd39840 2024-09-12T17:29:47.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.914+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5e4061430 con 0x56288fd39840 2024-09-12T17:29:47.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.914+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56288fd45700 con 0x7fe5e803c060 2024-09-12T17:29:47.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.914+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5e4061430 con 0x7fe5e803c060 2024-09-12T17:29:47.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.914+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56288fd45700 con 0x56288fd42b70 2024-09-12T17:29:47.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.914+0000 7fe5f058b640 1 -- 172.21.15.170:0/227790048 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5e0018950 con 0x56288fd42b70 2024-09-12T17:29:47.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.915+0000 7fe5f058b640 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56288fd45700 con 0x7fe5e803c060 2024-09-12T17:29:47.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.915+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5e4061430 con 0x7fe5e803c060 2024-09-12T17:29:47.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.915+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56288fd45700 con 0x56288fd3e1f0 2024-09-12T17:29:47.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.915+0000 7fe5f0d8c640 1 -- 172.21.15.170:0/227790048 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5e806b040 con 0x56288fd3e1f0 2024-09-12T17:29:47.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.915+0000 7fe5f0d8c640 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56288fd45700 con 0x56288fd42b70 2024-09-12T17:29:47.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.915+0000 7fe5f058b640 1 -- 172.21.15.170:0/227790048 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5e0018950 con 0x56288fd42b70 2024-09-12T17:29:47.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.915+0000 7fe5f058b640 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56288fd45700 con 0x7fe5e803c060 2024-09-12T17:29:47.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.916+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5e4061430 con 0x7fe5e803c060 2024-09-12T17:29:47.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.916+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56288fd45700 con 0x56288fd39840 2024-09-12T17:29:47.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.916+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe5e4061430 con 0x56288fd39840 2024-09-12T17:29:47.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.916+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fe5e4083080 con 0x56288fd3e1f0 2024-09-12T17:29:47.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.916+0000 7fe5f0d8c640 1 -- 172.21.15.170:0/227790048 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(37 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe5e806b040 con 0x56288fd3e1f0 2024-09-12T17:29:47.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.916+0000 7fe5f5231800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:29:47.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.916+0000 7fe5f5231800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:29:47.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.916+0000 7fe5f5231800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:29:47.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.916+0000 7fe5f5231800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:29:47.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.916+0000 7fe5f5231800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:29:47.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.916+0000 7fe5f5231800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:29:47.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.916+0000 7fe5f5231800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.916+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56288fd41590 con 0x56288fd39840 2024-09-12T17:29:47.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.916+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe5e4061430 con 0x56288fd39840 2024-09-12T17:29:47.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.916+0000 7fe5f5231800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.916+0000 7fe5f5231800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.916+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56288fd41e30 con 0x56288fd39840 2024-09-12T17:29:47.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.917+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe5e4061430 con 0x56288fd39840 2024-09-12T17:29:47.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.917+0000 7fe5f5231800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:47.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.917+0000 7fe5f5231800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.917+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56288fd411d0 con 0x56288fd3e1f0 2024-09-12T17:29:47.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.917+0000 7fe5f0d8c640 1 -- 172.21.15.170:0/227790048 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe5e806b040 con 0x56288fd3e1f0 2024-09-12T17:29:47.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.917+0000 7fe5f5231800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:29:47.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.917+0000 7fe5f5231800 20 zone default found 2024-09-12T17:29:47.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.917+0000 7fe5f5231800 4 Realm: () 2024-09-12T17:29:47.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.917+0000 7fe5f5231800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:29:47.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.917+0000 7fe5f5231800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:29:47.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.917+0000 7fe5f5231800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:29:47.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.917+0000 7fe5f5231800 20 zonegroup default 2024-09-12T17:29:47.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.917+0000 7fe5f5231800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.917+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56288fd45b80 con 0x7fe5e803c060 2024-09-12T17:29:47.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.917+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe5e4061430 con 0x7fe5e803c060 2024-09-12T17:29:47.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.917+0000 7fe5f5231800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.917+0000 7fe5f5231800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.917+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56288fd479b0 con 0x56288fd42b70 2024-09-12T17:29:47.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.917+0000 7fe5f058b640 1 -- 172.21.15.170:0/227790048 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe5e0018950 con 0x56288fd42b70 2024-09-12T17:29:47.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.918+0000 7fe5f5231800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.918+0000 7fe5f5231800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.918+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56288fd47e90 con 0x56288fd42b70 2024-09-12T17:29:47.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.918+0000 7fe5f058b640 1 -- 172.21.15.170:0/227790048 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe5e0018950 con 0x56288fd42b70 2024-09-12T17:29:47.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.918+0000 7fe5f5231800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:47.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.918+0000 7fe5f5231800 20 started sync module instance, tier type = 2024-09-12T17:29:47.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.918+0000 7fe5f5231800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:29:47.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.918+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56288fd46e50 con 0x56288fd3e1f0 2024-09-12T17:29:47.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.919+0000 7fe5f0d8c640 1 -- 172.21.15.170:0/227790048 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(44 notify.0 [create] v31'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5e806b040 con 0x56288fd3e1f0 2024-09-12T17:29:47.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.919+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94732211745344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56288fd46ab0 con 0x56288fd3e1f0 2024-09-12T17:29:47.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.919+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56288fd48dc0 con 0x56288fd39840 2024-09-12T17:29:47.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.920+0000 7fe5f0d8c640 1 -- 172.21.15.170:0/227790048 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94732211745344] v31'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5e806b040 con 0x56288fd3e1f0 2024-09-12T17:29:47.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.920+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v31'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5e4061430 con 0x56288fd39840 2024-09-12T17:29:47.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.920+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94732211749616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56288fd48dc0 con 0x56288fd39840 2024-09-12T17:29:47.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.920+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56288fd49780 con 0x56288fd42b70 2024-09-12T17:29:47.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.921+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94732211749616] v31'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5e4061430 con 0x56288fd39840 2024-09-12T17:29:47.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.921+0000 7fe5f058b640 1 -- 172.21.15.170:0/227790048 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v31'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5e0018950 con 0x56288fd42b70 2024-09-12T17:29:47.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.921+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94732211751184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56288fd48d30 con 0x56288fd42b70 2024-09-12T17:29:47.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.921+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56288fd4a640 con 0x56288fd3e1f0 2024-09-12T17:29:47.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.922+0000 7fe5f0d8c640 1 -- 172.21.15.170:0/227790048 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(50 notify.3 [create] v31'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5e806b040 con 0x56288fd3e1f0 2024-09-12T17:29:47.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.922+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94732211757936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56288fd4ae00 con 0x56288fd3e1f0 2024-09-12T17:29:47.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.922+0000 7fe5f058b640 1 -- 172.21.15.170:0/227790048 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94732211751184] v31'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5e0018950 con 0x56288fd42b70 2024-09-12T17:29:47.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.922+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56288fd49b70 con 0x56288fd39840 2024-09-12T17:29:47.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.924+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v31'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5e4061430 con 0x56288fd39840 2024-09-12T17:29:47.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.924+0000 7fe5f0d8c640 1 -- 172.21.15.170:0/227790048 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94732211757936] v31'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5e806b040 con 0x56288fd3e1f0 2024-09-12T17:29:47.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.924+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94732211762160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56288fd49b70 con 0x56288fd39840 2024-09-12T17:29:47.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.924+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56288fd4a890 con 0x7fe5e803c060 2024-09-12T17:29:47.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.925+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94732211762160] v31'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5e4061430 con 0x56288fd39840 2024-09-12T17:29:47.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.925+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(54 notify.5 [create] v31'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5e4061430 con 0x7fe5e803c060 2024-09-12T17:29:47.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.925+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94732211763424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56288fd4a850 con 0x7fe5e803c060 2024-09-12T17:29:47.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.925+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56288fd4c860 con 0x7fe5e803c060 2024-09-12T17:29:47.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.926+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94732211763424] v31'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5e4061430 con 0x7fe5e803c060 2024-09-12T17:29:47.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.926+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v31'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5e4061430 con 0x7fe5e803c060 2024-09-12T17:29:47.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.926+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94732211764992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56288fd4c7d0 con 0x7fe5e803c060 2024-09-12T17:29:47.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.926+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56288fd4d1f0 con 0x7fe5e803c060 2024-09-12T17:29:47.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.927+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(58 notify.7 [create] v31'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5e4061430 con 0x7fe5e803c060 2024-09-12T17:29:47.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.927+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94732211768544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56288fd4d660 con 0x7fe5e803c060 2024-09-12T17:29:47.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.927+0000 7fe5f5231800 20 add_watcher() i=0 2024-09-12T17:29:47.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.927+0000 7fe5f5231800 20 add_watcher() i=1 2024-09-12T17:29:47.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.927+0000 7fe5f5231800 20 add_watcher() i=2 2024-09-12T17:29:47.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.927+0000 7fe5f5231800 20 add_watcher() i=3 2024-09-12T17:29:47.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.927+0000 7fe5f5231800 20 add_watcher() i=4 2024-09-12T17:29:47.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.927+0000 7fe5f5231800 20 add_watcher() i=5 2024-09-12T17:29:47.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.927+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94732211764992] v31'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5e4061430 con 0x7fe5e803c060 2024-09-12T17:29:47.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.927+0000 7fe5f5231800 20 add_watcher() i=6 2024-09-12T17:29:47.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.928+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94732211768544] v31'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5e4061430 con 0x7fe5e803c060 2024-09-12T17:29:47.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.928+0000 7fe5f5231800 20 add_watcher() i=7 2024-09-12T17:29:47.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.928+0000 7fe5f5231800 2 all 8 watchers are set, enabling cache 2024-09-12T17:29:47.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.928+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56288fd4d660 con 0x56288fd39840 2024-09-12T17:29:47.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.929+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe5e4061430 con 0x56288fd39840 2024-09-12T17:29:47.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.929+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94732211769776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56288fd4d5d0 con 0x56288fd39840 2024-09-12T17:29:47.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.930+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94732211769776] v31'260 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe5e4061430 con 0x56288fd39840 2024-09-12T17:29:47.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.930+0000 7fe4a6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:47.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.930+0000 7fe5f5231800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:29:47.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.930+0000 7fe5f5231800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:29:47.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.930+0000 7fe5f5231800 5 note: GC not initialized 2024-09-12T17:29:47.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.930+0000 7fe4a5fe3640 20 reqs_thread_entry: start 2024-09-12T17:29:47.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.930+0000 7fe5f5231800 20 init_complete bucket index max shards: 11 2024-09-12T17:29:47.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.930+0000 7fe5f5231800 20 Filter name: none 2024-09-12T17:29:47.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.930+0000 7fe49effd640 20 reqs_thread_entry: start 2024-09-12T17:29:47.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.930+0000 7fe5f5231800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-12T17:29:47.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.930+0000 7fe5f5231800 20 rados->read ofs=0 len=0 2024-09-12T17:29:47.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.930+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56288fd836d0 con 0x7fe5e803c060 2024-09-12T17:29:47.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.931+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fe5e4061430 con 0x7fe5e803c060 2024-09-12T17:29:47.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.931+0000 7fe5f5231800 20 rados_obj.operate() r=0 bl.length=490 2024-09-12T17:29:47.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.931+0000 7fe5f5231800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-12T17:29:47.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.931+0000 7fe5f5231800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:29:47.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.931+0000 7fe5f5231800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:29:47.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.931+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56288fd89c60 con 0x7fe5e803c060 2024-09-12T17:29:47.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.932+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v31'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fe5e4061430 con 0x7fe5e803c060 2024-09-12T17:29:47.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.932+0000 7fe5f5231800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T17:29:47.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.932+0000 7fe5f5231800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:29:47.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.932+0000 7fe5f5231800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-12T17:29:47.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.932+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94732212016672 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56288fd852a0 con 0x56288fd39840 2024-09-12T17:29:47.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.932+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== watch-notify(notify (1) cookie 94732211762160 notify 133143986201 ret 0) ==== 708+0+0 (crc 0 0 0) 0x56288fa966b0 con 0x56288fd39840 2024-09-12T17:29:47.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.932+0000 7fe4cf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986201 cookie 94732211762160 notifier 4876 bl.length()=666 2024-09-12T17:29:47.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.932+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(64 notify.4 [notify cookie 94732212016672 out=8b] v0'0 uv261 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe5e4061430 con 0x56288fd39840 2024-09-12T17:29:47.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.933+0000 7fe4cf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T17:29:47.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.933+0000 7fe4cf7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:29:47.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.933+0000 7fe4cf7fe640 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fe4b4003ea0 con 0x56288fd39840 2024-09-12T17:29:47.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.933+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5e4061430 con 0x56288fd39840 2024-09-12T17:29:47.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.933+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== watch-notify(notify_complete (2) cookie 94732212016672 notify 133143986201 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe5e4061e10 con 0x56288fd39840 2024-09-12T17:29:47.950 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-12T17:29:46.782056Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:29:46.782042Z","tags":[],"group_ids":[]} 2024-09-12T17:29:47.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.934+0000 7fe4a6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:47.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.934+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94732211769776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56288fd81520 con 0x56288fd39840 2024-09-12T17:29:47.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.935+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94732211769776] v31'261 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe5e4061430 con 0x56288fd39840 2024-09-12T17:29:47.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.935+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94732211745344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56288fd81520 con 0x56288fd3e1f0 2024-09-12T17:29:47.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.936+0000 7fe5f0d8c640 1 -- 172.21.15.170:0/227790048 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94732211745344] v31'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5e806b040 con 0x56288fd3e1f0 2024-09-12T17:29:47.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.936+0000 7fe5f5231800 20 remove_watcher() i=0 2024-09-12T17:29:47.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.936+0000 7fe5f5231800 2 removed watcher, disabling cache 2024-09-12T17:29:47.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.936+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94732211749616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56288fd81520 con 0x56288fd39840 2024-09-12T17:29:47.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.937+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94732211749616] v31'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5e4061430 con 0x56288fd39840 2024-09-12T17:29:47.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.937+0000 7fe5f5231800 20 remove_watcher() i=1 2024-09-12T17:29:47.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.937+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94732211751184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56288fd81520 con 0x56288fd42b70 2024-09-12T17:29:47.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.938+0000 7fe5f058b640 1 -- 172.21.15.170:0/227790048 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94732211751184] v31'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5e0018950 con 0x56288fd42b70 2024-09-12T17:29:47.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.938+0000 7fe5f5231800 20 remove_watcher() i=2 2024-09-12T17:29:47.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.938+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94732211757936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56288fd47240 con 0x56288fd3e1f0 2024-09-12T17:29:47.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.939+0000 7fe5f0d8c640 1 -- 172.21.15.170:0/227790048 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94732211757936] v31'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5e806b040 con 0x56288fd3e1f0 2024-09-12T17:29:47.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.939+0000 7fe5f5231800 20 remove_watcher() i=3 2024-09-12T17:29:47.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.939+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94732211762160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56288fd48910 con 0x56288fd39840 2024-09-12T17:29:47.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.940+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94732211762160] v31'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5e4061430 con 0x56288fd39840 2024-09-12T17:29:47.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.940+0000 7fe5f5231800 20 remove_watcher() i=4 2024-09-12T17:29:47.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.940+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94732211763424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56288fd4a370 con 0x7fe5e803c060 2024-09-12T17:29:47.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.942+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94732211763424] v31'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5e4061430 con 0x7fe5e803c060 2024-09-12T17:29:47.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.942+0000 7fe5f5231800 20 remove_watcher() i=5 2024-09-12T17:29:47.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.942+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94732211764992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56288fd47240 con 0x7fe5e803c060 2024-09-12T17:29:47.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.942+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94732211764992] v31'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5e4061430 con 0x7fe5e803c060 2024-09-12T17:29:47.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.943+0000 7fe5f5231800 20 remove_watcher() i=6 2024-09-12T17:29:47.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.943+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94732211768544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56288fd48910 con 0x7fe5e803c060 2024-09-12T17:29:47.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.943+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94732211768544] v31'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5e4061430 con 0x7fe5e803c060 2024-09-12T17:29:47.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.943+0000 7fe5f5231800 20 remove_watcher() i=7 2024-09-12T17:29:47.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.944+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fe5e803c060 msgr2=0x7fe5e8004db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.944+0000 7fe5f5231800 1 --2- 172.21.15.170:0/227790048 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fe5e803c060 0x7fe5e8004db0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.944+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56288fd39840 msgr2=0x56288fd3bd00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.944+0000 7fe5f5231800 1 --2- 172.21.15.170:0/227790048 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56288fd39840 0x56288fd3bd00 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.944+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56288fd3e1f0 msgr2=0x56288fd405e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.944+0000 7fe5f5231800 1 --2- 172.21.15.170:0/227790048 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56288fd3e1f0 0x56288fd405e0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.944+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x56288fd42b70 msgr2=0x56288fd45030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.944+0000 7fe5f5231800 1 --2- 172.21.15.170:0/227790048 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x56288fd42b70 0x56288fd45030 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.944+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe4c003c780 msgr2=0x7fe4c003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.944+0000 7fe5f5231800 1 --2- 172.21.15.170:0/227790048 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe4c003c780 0x7fe4c003ec40 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe5e004b650 tx=0x7fe5e002f000 comp rx=0 tx=0).stop 2024-09-12T17:29:47.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.944+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56288fd269b0 msgr2=0x56288fd2df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.944+0000 7fe5f5231800 1 --2- 172.21.15.170:0/227790048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56288fd269b0 0x56288fd2df70 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fe5e800afe0 tx=0x7fe5e8053d10 comp rx=0 tx=0).stop 2024-09-12T17:29:47.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.944+0000 7fe5efd8a640 1 -- 172.21.15.170:0/227790048 reap_dead start 2024-09-12T17:29:47.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.944+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 shutdown_connections 2024-09-12T17:29:47.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.944+0000 7fe5f5231800 1 --2- 172.21.15.170:0/227790048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56288fd269b0 0x56288fd2df70 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.944+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 >> 172.21.15.170:0/227790048 conn(0x56288fd22db0 msgr2=0x56288fd20fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:47.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.944+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 shutdown_connections 2024-09-12T17:29:47.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.944+0000 7fe5f5231800 1 -- 172.21.15.170:0/227790048 wait complete. 2024-09-12T17:29:47.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.944+0000 7fe5f5231800 1 -- 172.21.15.170:0/2003887901 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe4c803c730 msgr2=0x7fe4c803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.944+0000 7fe5f5231800 1 --2- 172.21.15.170:0/2003887901 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe4c803c730 0x7fe4c803ebf0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0052150 tx=0x7fe5e0017f90 comp rx=0 tx=0).stop 2024-09-12T17:29:47.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.944+0000 7fe5f5231800 1 -- 172.21.15.170:0/2003887901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56288fd19ff0 msgr2=0x56288fd1a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.944+0000 7fe5f5231800 1 --2- 172.21.15.170:0/2003887901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56288fd19ff0 0x56288fd1a410 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x56288fc04e80 tx=0x7fe5e80167b0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.944+0000 7fe5f5231800 1 -- 172.21.15.170:0/2003887901 shutdown_connections 2024-09-12T17:29:47.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.944+0000 7fe5f5231800 1 --2- 172.21.15.170:0/2003887901 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe4c803c730 0x7fe4c803ebf0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.944+0000 7fe5f5231800 1 --2- 172.21.15.170:0/2003887901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56288fd19ff0 0x56288fd1a410 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.944+0000 7fe5f5231800 1 -- 172.21.15.170:0/2003887901 >> 172.21.15.170:0/2003887901 conn(0x56288fd0e3a0 msgr2=0x56288fd0e780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:47.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.944+0000 7fe5f5231800 1 -- 172.21.15.170:0/2003887901 shutdown_connections 2024-09-12T17:29:47.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.944+0000 7fe5f5231800 1 -- 172.21.15.170:0/2003887901 wait complete. 2024-09-12T17:29:47.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.945+0000 7fe5f5231800 1 -- 172.21.15.170:0/3067779824 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56288fc0a200 msgr2=0x56288fd06270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.945+0000 7fe5f5231800 1 --2- 172.21.15.170:0/3067779824 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56288fc0a200 0x56288fd06270 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.945+0000 7fe5f5231800 1 -- 172.21.15.170:0/3067779824 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56288fd08ba0 msgr2=0x56288fd0aff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.945+0000 7fe5f5231800 1 --2- 172.21.15.170:0/3067779824 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56288fd08ba0 0x56288fd0aff0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.945+0000 7fe5f5231800 1 -- 172.21.15.170:0/3067779824 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe4d803c780 msgr2=0x7fe4d803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.945+0000 7fe5f5231800 1 --2- 172.21.15.170:0/3067779824 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe4d803c780 0x7fe4d803ec40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x56288fb784d0 tx=0x7fe5e4050000 comp rx=0 tx=0).stop 2024-09-12T17:29:47.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.945+0000 7fe5f5231800 1 -- 172.21.15.170:0/3067779824 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56288fc06690 msgr2=0x56288fc05d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:47.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.945+0000 7fe5f5231800 1 --2- 172.21.15.170:0/3067779824 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56288fc06690 0x56288fc05d90 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x56288fcf64e0 tx=0x7fe5e00040e0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.945+0000 7fe5f5231800 1 -- 172.21.15.170:0/3067779824 shutdown_connections 2024-09-12T17:29:47.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.945+0000 7fe5f5231800 1 --2- 172.21.15.170:0/3067779824 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x56288fd08ba0 0x56288fd0aff0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.945+0000 7fe5f5231800 1 --2- 172.21.15.170:0/3067779824 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe4d803c780 0x7fe4d803ec40 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.945+0000 7fe5f5231800 1 --2- 172.21.15.170:0/3067779824 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x56288fc0a200 0x56288fd06270 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.945+0000 7fe5f5231800 1 --2- 172.21.15.170:0/3067779824 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56288fc06690 0x56288fc05d90 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:47.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.945+0000 7fe5f5231800 1 -- 172.21.15.170:0/3067779824 >> 172.21.15.170:0/3067779824 conn(0x56288fc001d0 msgr2=0x56288fcf6830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:47.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.945+0000 7fe5f5231800 1 -- 172.21.15.170:0/3067779824 shutdown_connections 2024-09-12T17:29:47.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:47.945+0000 7fe5f5231800 1 -- 172.21.15.170:0/3067779824 wait complete. 2024-09-12T17:29:47.960 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T17:29:46.782056Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:29:46.782042Z', 'tags': [], 'group_ids': []} 2024-09-12T17:29:47.961 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T17:29:46.782056Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:29:46.782042Z', 'tags': [], 'group_ids': []} 2024-09-12T17:29:47.961 ERROR:root:0 2024-09-12T17:29:47.961 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T17:29:47.965 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:29:47.968 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-12T17:29:47.969 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-12T17:29:47.969 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-12T17:29:48.015 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:29:48.015 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:29:48.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.015+0000 7fefd9f1f800 1 Processor -- start 2024-09-12T17:29:48.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.015+0000 7fefd9f1f800 1 -- start start 2024-09-12T17:29:48.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.015+0000 7fefd9f1f800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55fb22a36570 0x55fb22a3bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.015+0000 7fefd9f1f800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fb228dee40 con 0x55fb22a33450 2024-09-12T17:29:48.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.015+0000 7fefd9f1f800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x55fb228a9680 con 0x55fb22a36570 2024-09-12T17:29:48.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.015+0000 7fefcffff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55fb22a36570 0x55fb22a3bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.015+0000 7fefd5c0c640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x55fb22a33450 0x55fb22a35e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:44940/0 (socket says 172.21.15.170:44940) 2024-09-12T17:29:48.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.015+0000 7fefd5c0c640 1 -- 172.21.15.170:0/2273158646 learned_addr learned my addr 172.21.15.170:0/2273158646 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:29:48.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.016+0000 7fefd540b640 1 -- 172.21.15.170:0/2273158646 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 567155021 0 0) 0x55fb228dee40 con 0x55fb22a33450 2024-09-12T17:29:48.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.016+0000 7fefd540b640 1 -- 172.21.15.170:0/2273158646 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fefc4001e10 con 0x55fb22a33450 2024-09-12T17:29:48.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.016+0000 7fefcffff640 1 -- 172.21.15.170:0/2273158646 >> v1:172.21.15.47:6789/0 conn(0x55fb22a33450 legacy=0x55fb22a35e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.016+0000 7fefcffff640 1 -- 172.21.15.170:0/2273158646 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb228c56b0 con 0x55fb22a36570 2024-09-12T17:29:48.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.018+0000 7fefcffff640 1 --2- 172.21.15.170:0/2273158646 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fb22a36570 0x55fb22a3bec0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fefc000a470 tx=0x7fefc0045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e333fba146cddaba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.018+0000 7fefd540b640 1 -- 172.21.15.170:0/2273158646 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefc0059070 con 0x55fb22a36570 2024-09-12T17:29:48.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.018+0000 7fefd540b640 1 -- 172.21.15.170:0/2273158646 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefc0054570 con 0x55fb22a36570 2024-09-12T17:29:48.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.018+0000 7fefd540b640 1 -- 172.21.15.170:0/2273158646 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefc0054870 con 0x55fb22a36570 2024-09-12T17:29:48.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.018+0000 7fefd9f1f800 1 -- 172.21.15.170:0/2273158646 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fb22a36570 msgr2=0x55fb22a3bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.018+0000 7fefd9f1f800 1 --2- 172.21.15.170:0/2273158646 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fb22a36570 0x55fb22a3bec0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fefc000a470 tx=0x7fefc0045920 comp rx=0 tx=0).stop 2024-09-12T17:29:48.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.018+0000 7fefd9f1f800 1 -- 172.21.15.170:0/2273158646 shutdown_connections 2024-09-12T17:29:48.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.018+0000 7fefd9f1f800 1 --2- 172.21.15.170:0/2273158646 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fb22a36570 0x55fb22a3bec0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.018+0000 7fefd9f1f800 1 -- 172.21.15.170:0/2273158646 >> 172.21.15.170:0/2273158646 conn(0x55fb22a2e930 msgr2=0x55fb22a30db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:48.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.018+0000 7fefd9f1f800 1 -- 172.21.15.170:0/2273158646 shutdown_connections 2024-09-12T17:29:48.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.018+0000 7fefd9f1f800 1 -- 172.21.15.170:0/2273158646 wait complete. 2024-09-12T17:29:48.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.032+0000 7fefd9f1f800 1 Processor -- start 2024-09-12T17:29:48.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.032+0000 7fefd9f1f800 1 -- start start 2024-09-12T17:29:48.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.032+0000 7fefd9f1f800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fb22a33450 0x55fb22a355d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.032+0000 7fefd9f1f800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55fb228cddd0 con 0x55fb22a33450 2024-09-12T17:29:48.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.033+0000 7fefd5c0c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fb22a33450 0x55fb22a355d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.033+0000 7fefd5c0c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fb22a33450 0x55fb22a355d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35230/0 (socket says 172.21.15.170:35230) 2024-09-12T17:29:48.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.033+0000 7fefd5c0c640 1 -- 172.21.15.170:0/80527575 learned_addr learned my addr 172.21.15.170:0/80527575 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:48.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.033+0000 7fefd5c0c640 1 -- 172.21.15.170:0/80527575 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb228e6e10 con 0x55fb22a33450 2024-09-12T17:29:48.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.033+0000 7fefd5c0c640 1 --2- 172.21.15.170:0/80527575 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fb22a33450 0x55fb22a355d0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fefc8001e30 tx=0x7fefc800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9202e5c3b0a2b72 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.034+0000 7feec3e07640 1 -- 172.21.15.170:0/80527575 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefc8012020 con 0x55fb22a33450 2024-09-12T17:29:48.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.034+0000 7feec3e07640 1 -- 172.21.15.170:0/80527575 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefc800e470 con 0x55fb22a33450 2024-09-12T17:29:48.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.034+0000 7feec3e07640 1 -- 172.21.15.170:0/80527575 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefc800e790 con 0x55fb22a33450 2024-09-12T17:29:48.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.034+0000 7fefd9f1f800 1 -- 172.21.15.170:0/80527575 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fb22a33450 msgr2=0x55fb22a355d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.034+0000 7fefd9f1f800 1 --2- 172.21.15.170:0/80527575 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fb22a33450 0x55fb22a355d0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fefc8001e30 tx=0x7fefc800b780 comp rx=0 tx=0).stop 2024-09-12T17:29:48.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.034+0000 7fefd9f1f800 1 -- 172.21.15.170:0/80527575 shutdown_connections 2024-09-12T17:29:48.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.034+0000 7fefd9f1f800 1 --2- 172.21.15.170:0/80527575 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fb22a33450 0x55fb22a355d0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.034+0000 7fefd9f1f800 1 -- 172.21.15.170:0/80527575 >> 172.21.15.170:0/80527575 conn(0x55fb22a2e930 msgr2=0x55fb22b200f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:48.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.034+0000 7fefd9f1f800 1 -- 172.21.15.170:0/80527575 shutdown_connections 2024-09-12T17:29:48.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.034+0000 7fefd9f1f800 1 -- 172.21.15.170:0/80527575 wait complete. 2024-09-12T17:29:48.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.035+0000 7fefd9f1f800 1 Processor -- start 2024-09-12T17:29:48.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.035+0000 7fefd9f1f800 1 -- start start 2024-09-12T17:29:48.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.035+0000 7fefd9f1f800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fb22a36570 0x55fb22b2e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.035+0000 7fefd9f1f800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55fb22a3c400 con 0x55fb22a36570 2024-09-12T17:29:48.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.035+0000 7fefd5c0c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fb22a36570 0x55fb22b2e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.035+0000 7fefd5c0c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fb22a36570 0x55fb22b2e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35242/0 (socket says 172.21.15.170:35242) 2024-09-12T17:29:48.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.035+0000 7fefd5c0c640 1 -- 172.21.15.170:0/3072169738 learned_addr learned my addr 172.21.15.170:0/3072169738 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:48.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.036+0000 7fefd5c0c640 1 -- 172.21.15.170:0/3072169738 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb22b2ea50 con 0x55fb22a36570 2024-09-12T17:29:48.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.036+0000 7fefd5c0c640 1 --2- 172.21.15.170:0/3072169738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fb22a36570 0x55fb22b2e4f0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x55fb22a35100 tx=0x7fefc80040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.036+0000 7feec2604640 1 -- 172.21.15.170:0/3072169738 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefc8012030 con 0x55fb22a36570 2024-09-12T17:29:48.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.036+0000 7feec2604640 1 -- 172.21.15.170:0/3072169738 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefc801a700 con 0x55fb22a36570 2024-09-12T17:29:48.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.036+0000 7feec2604640 1 -- 172.21.15.170:0/3072169738 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefc801aa20 con 0x55fb22a36570 2024-09-12T17:29:48.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.036+0000 7fefd9f1f800 1 -- 172.21.15.170:0/3072169738 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fb22b2ece0 con 0x55fb22a36570 2024-09-12T17:29:48.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.036+0000 7fefd9f1f800 1 -- 172.21.15.170:0/3072169738 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb22b2f6e0 con 0x55fb22a36570 2024-09-12T17:29:48.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.037+0000 7feec2604640 1 -- 172.21.15.170:0/3072169738 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fefc8015020 con 0x55fb22a36570 2024-09-12T17:29:48.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.037+0000 7feec2604640 1 --2- 172.21.15.170:0/3072169738 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7feebc03c780 0x7feebc03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.037+0000 7feec2604640 1 -- 172.21.15.170:0/3072169738 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fefc8020070 con 0x55fb22a36570 2024-09-12T17:29:48.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.037+0000 7fefcffff640 1 --2- 172.21.15.170:0/3072169738 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7feebc03c780 0x7feebc03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.037+0000 7fefd9f1f800 1 --2- 172.21.15.170:0/3072169738 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55fb22b30230 0x55fb22b35b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.037+0000 7fefd9f1f800 1 -- 172.21.15.170:0/3072169738 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b360d0 con 0x55fb22b30230 2024-09-12T17:29:48.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.037+0000 7fefd640d640 1 --2- 172.21.15.170:0/3072169738 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55fb22b30230 0x55fb22b35b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.038+0000 7fefcffff640 1 --2- 172.21.15.170:0/3072169738 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7feebc03c780 0x7feebc03ec40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x55fb229981c0 tx=0x7fefc0050000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.038+0000 7fefd640d640 1 --2- 172.21.15.170:0/3072169738 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55fb22b30230 0x55fb22b35b40 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.038+0000 7fefd640d640 1 -- 172.21.15.170:0/3072169738 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fefd000a4d0 con 0x55fb22b30230 2024-09-12T17:29:48.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.038+0000 7fefd9f1f800 1 -- 172.21.15.170:0/3072169738 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b2fbc0 con 0x55fb22b30230 2024-09-12T17:29:48.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.038+0000 7fefd640d640 1 -- 172.21.15.170:0/3072169738 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fefd000a4d0 con 0x55fb22b30230 2024-09-12T17:29:48.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.038+0000 7fefd9f1f800 1 --2- 172.21.15.170:0/3072169738 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55fb22b38400 0x55fb22b3a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.038+0000 7fefd9f1f800 1 -- 172.21.15.170:0/3072169738 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b3aec0 con 0x55fb22b38400 2024-09-12T17:29:48.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.038+0000 7fefd5c0c640 1 --2- 172.21.15.170:0/3072169738 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55fb22b38400 0x55fb22b3a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.039+0000 7fefd5c0c640 1 --2- 172.21.15.170:0/3072169738 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55fb22b38400 0x55fb22b3a7f0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.039+0000 7fefd5c0c640 1 -- 172.21.15.170:0/3072169738 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fefc8018ce0 con 0x55fb22b38400 2024-09-12T17:29:48.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.039+0000 7fefd9f1f800 1 -- 172.21.15.170:0/3072169738 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b372a0 con 0x55fb22b30230 2024-09-12T17:29:48.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.039+0000 7fefd640d640 1 -- 172.21.15.170:0/3072169738 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fefd000a4d0 con 0x55fb22b30230 2024-09-12T17:29:48.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.039+0000 7fefd9f1f800 1 -- 172.21.15.170:0/3072169738 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b37740 con 0x55fb22b38400 2024-09-12T17:29:48.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.040+0000 7fefd5c0c640 1 -- 172.21.15.170:0/3072169738 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fefc8018ce0 con 0x55fb22b38400 2024-09-12T17:29:48.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.040+0000 7fefd9f1f800 1 Processor -- start 2024-09-12T17:29:48.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.040+0000 7fefd9f1f800 1 -- start start 2024-09-12T17:29:48.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.040+0000 7fefd9f1f800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fb22b49750 0x55fb22b49b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.040+0000 7fefd9f1f800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55fb2292ba00 con 0x55fb22b49750 2024-09-12T17:29:48.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.040+0000 7fefd640d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fb22b49750 0x55fb22b49b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.040+0000 7fefd640d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fb22b49750 0x55fb22b49b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35246/0 (socket says 172.21.15.170:35246) 2024-09-12T17:29:48.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.040+0000 7fefd640d640 1 -- 172.21.15.170:0/3119230412 learned_addr learned my addr 172.21.15.170:0/3119230412 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:48.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.041+0000 7fefd640d640 1 -- 172.21.15.170:0/3119230412 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb22b4a1b0 con 0x55fb22b49750 2024-09-12T17:29:48.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.041+0000 7fefd640d640 1 --2- 172.21.15.170:0/3119230412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fb22b49750 0x55fb22b49b70 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x55fb22b2f8b0 tx=0x7fefd00167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.041+0000 7feebb7fe640 1 -- 172.21.15.170:0/3119230412 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefd0013640 con 0x55fb22b49750 2024-09-12T17:29:48.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.041+0000 7feebb7fe640 1 -- 172.21.15.170:0/3119230412 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefd00137e0 con 0x55fb22b49750 2024-09-12T17:29:48.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.041+0000 7fefd9f1f800 1 -- 172.21.15.170:0/3119230412 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fb22b4a9e0 con 0x55fb22b49750 2024-09-12T17:29:48.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.041+0000 7feebb7fe640 1 -- 172.21.15.170:0/3119230412 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefd0013ae0 con 0x55fb22b49750 2024-09-12T17:29:48.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.041+0000 7fefd9f1f800 1 -- 172.21.15.170:0/3119230412 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb22b4af80 con 0x55fb22b49750 2024-09-12T17:29:48.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.042+0000 7feebb7fe640 1 -- 172.21.15.170:0/3119230412 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fefd0011040 con 0x55fb22b49750 2024-09-12T17:29:48.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.042+0000 7feebb7fe640 1 --2- 172.21.15.170:0/3119230412 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7feeb003c730 0x7feeb003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.042+0000 7feebb7fe640 1 -- 172.21.15.170:0/3119230412 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fefd000e040 con 0x55fb22b49750 2024-09-12T17:29:48.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.042+0000 7fefd5c0c640 1 --2- 172.21.15.170:0/3119230412 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7feeb003c730 0x7feeb003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.042+0000 7fefd9f1f800 1 Processor -- start 2024-09-12T17:29:48.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.042+0000 7fefd5c0c640 1 --2- 172.21.15.170:0/3119230412 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7feeb003c730 0x7feeb003ebf0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x55fb22b36580 tx=0x7fefc800beb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.042+0000 7fefd9f1f800 1 -- start start 2024-09-12T17:29:48.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.043+0000 7fefd9f1f800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fb22b56270 0x55fb22b56670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.043+0000 7fefd9f1f800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55fb22a33e70 con 0x55fb22b56270 2024-09-12T17:29:48.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.043+0000 7fefd640d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fb22b56270 0x55fb22b56670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.043+0000 7fefd640d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fb22b56270 0x55fb22b56670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35262/0 (socket says 172.21.15.170:35262) 2024-09-12T17:29:48.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.043+0000 7fefd640d640 1 -- 172.21.15.170:0/939277040 learned_addr learned my addr 172.21.15.170:0/939277040 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:48.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.043+0000 7fefd640d640 1 -- 172.21.15.170:0/939277040 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb22b56c60 con 0x55fb22b56270 2024-09-12T17:29:48.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.043+0000 7fefd640d640 1 --2- 172.21.15.170:0/939277040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fb22b56270 0x55fb22b56670 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fefd0005a30 tx=0x7fefd001fee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c40557fce594fe0b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.043+0000 7feeb97fa640 1 -- 172.21.15.170:0/939277040 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefd004a070 con 0x55fb22b56270 2024-09-12T17:29:48.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.043+0000 7feeb97fa640 1 -- 172.21.15.170:0/939277040 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefd0021a90 con 0x55fb22b56270 2024-09-12T17:29:48.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.043+0000 7feeb97fa640 1 -- 172.21.15.170:0/939277040 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefd001f490 con 0x55fb22b56270 2024-09-12T17:29:48.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.044+0000 7fefd9f1f800 1 -- 172.21.15.170:0/939277040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fb22b56270 msgr2=0x55fb22b56670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.044+0000 7fefd9f1f800 1 --2- 172.21.15.170:0/939277040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fb22b56270 0x55fb22b56670 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fefd0005a30 tx=0x7fefd001fee0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.044+0000 7fefd9f1f800 1 -- 172.21.15.170:0/939277040 shutdown_connections 2024-09-12T17:29:48.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.044+0000 7fefd9f1f800 1 --2- 172.21.15.170:0/939277040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fb22b56270 0x55fb22b56670 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.044+0000 7fefd9f1f800 1 -- 172.21.15.170:0/939277040 >> 172.21.15.170:0/939277040 conn(0x55fb22b52670 msgr2=0x55fb22b508b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:48.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.044+0000 7fefd9f1f800 1 -- 172.21.15.170:0/939277040 shutdown_connections 2024-09-12T17:29:48.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.044+0000 7fefd9f1f800 1 -- 172.21.15.170:0/939277040 wait complete. 2024-09-12T17:29:48.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.044+0000 7fefd9f1f800 1 Processor -- start 2024-09-12T17:29:48.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.044+0000 7fefd9f1f800 1 -- start start 2024-09-12T17:29:48.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.044+0000 7fefd9f1f800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fb22b56270 0x55fb22b5d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.044+0000 7fefd9f1f800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55fb22b57280 con 0x55fb22b56270 2024-09-12T17:29:48.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.045+0000 7fefd640d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fb22b56270 0x55fb22b5d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.045+0000 7fefd640d640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fb22b56270 0x55fb22b5d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35278/0 (socket says 172.21.15.170:35278) 2024-09-12T17:29:48.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.045+0000 7fefd640d640 1 -- 172.21.15.170:0/226596646 learned_addr learned my addr 172.21.15.170:0/226596646 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:48.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.045+0000 7fefd640d640 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb22b5dd90 con 0x55fb22b56270 2024-09-12T17:29:48.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.045+0000 7fefd640d640 1 --2- 172.21.15.170:0/226596646 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fb22b56270 0x55fb22b5d830 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fefd0020560 tx=0x7fefd0053d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.045+0000 7feea77fe640 1 -- 172.21.15.170:0/226596646 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefd004a040 con 0x55fb22b56270 2024-09-12T17:29:48.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.045+0000 7feea77fe640 1 -- 172.21.15.170:0/226596646 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefd0021440 con 0x55fb22b56270 2024-09-12T17:29:48.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.045+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fb22b5e020 con 0x55fb22b56270 2024-09-12T17:29:48.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.045+0000 7feea77fe640 1 -- 172.21.15.170:0/226596646 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefd0020800 con 0x55fb22b56270 2024-09-12T17:29:48.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.045+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb22b5e9a0 con 0x55fb22b56270 2024-09-12T17:29:48.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.046+0000 7feea77fe640 1 -- 172.21.15.170:0/226596646 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fefd003b060 con 0x55fb22b56270 2024-09-12T17:29:48.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.046+0000 7feea77fe640 1 --2- 172.21.15.170:0/226596646 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7feea003c730 0x7feea003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.046+0000 7feea77fe640 1 -- 172.21.15.170:0/226596646 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fefd0035ba0 con 0x55fb22b56270 2024-09-12T17:29:48.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.046+0000 7fefd5c0c640 1 --2- 172.21.15.170:0/226596646 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7feea003c730 0x7feea003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.047+0000 7fefd5c0c640 1 --2- 172.21.15.170:0/226596646 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7feea003c730 0x7feea003ebf0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fefc800dfd0 tx=0x7fefc802f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.047+0000 7fefd9f1f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.047+0000 7fefd9f1f800 1 --2- 172.21.15.170:0/226596646 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55fb22b691d0 0x55fb22b6b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.047+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b6bde0 con 0x55fb22b691d0 2024-09-12T17:29:48.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.047+0000 7fefcffff640 1 --2- 172.21.15.170:0/226596646 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55fb22b691d0 0x55fb22b6b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.047+0000 7fefcffff640 1 --2- 172.21.15.170:0/226596646 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55fb22b691d0 0x55fb22b6b690 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.047+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fefc0061430 con 0x55fb22b691d0 2024-09-12T17:29:48.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.047+0000 7fefd9f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.047+0000 7fefd9f1f800 20 realm 2024-09-12T17:29:48.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.047+0000 7fefd9f1f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.047+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b6c1b0 con 0x55fb22b691d0 2024-09-12T17:29:48.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.048+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fefc0061430 con 0x55fb22b691d0 2024-09-12T17:29:48.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.048+0000 7fefd9f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.048+0000 7fefd9f1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:29:48.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.048+0000 7fefd9f1f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.048+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b6ca80 con 0x55fb22b691d0 2024-09-12T17:29:48.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.048+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fefc0061430 con 0x55fb22b691d0 2024-09-12T17:29:48.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.048+0000 7fefd9f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.048+0000 7fefd9f1f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.048+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b6ce20 con 0x55fb22b691d0 2024-09-12T17:29:48.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.048+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fefc0061430 con 0x55fb22b691d0 2024-09-12T17:29:48.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.048+0000 7fefd9f1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:48.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.048+0000 7fefd9f1f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.048+0000 7fefd9f1f800 1 --2- 172.21.15.170:0/226596646 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55fb22b6db80 0x55fb22b6ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.048+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b70530 con 0x55fb22b6db80 2024-09-12T17:29:48.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.048+0000 7fefd640d640 1 --2- 172.21.15.170:0/226596646 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55fb22b6db80 0x55fb22b6ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.049+0000 7fefd640d640 1 --2- 172.21.15.170:0/226596646 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55fb22b6db80 0x55fb22b6ff70 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.049+0000 7fefd640d640 1 -- 172.21.15.170:0/226596646 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fefd004d040 con 0x55fb22b6db80 2024-09-12T17:29:48.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.049+0000 7fefd9f1f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:29:48.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.049+0000 7fefd9f1f800 20 searching for the correct realm 2024-09-12T17:29:48.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.049+0000 7fefd9f1f800 1 --2- 172.21.15.170:0/226596646 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55fb22b72500 0x55fb22b749c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.049+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b75090 con 0x55fb22b72500 2024-09-12T17:29:48.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.049+0000 7fefd5c0c640 1 --2- 172.21.15.170:0/226596646 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55fb22b72500 0x55fb22b749c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.049+0000 7fefd5c0c640 1 --2- 172.21.15.170:0/226596646 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55fb22b72500 0x55fb22b749c0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.049+0000 7fefd5c0c640 1 -- 172.21.15.170:0/226596646 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc8018ce0 con 0x55fb22b72500 2024-09-12T17:29:48.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.049+0000 7fefd5c0c640 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b75090 con 0x55fb22b6db80 2024-09-12T17:29:48.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.050+0000 7fefd640d640 1 -- 172.21.15.170:0/226596646 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefd004d040 con 0x55fb22b6db80 2024-09-12T17:29:48.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.050+0000 7fefd640d640 1 --2- 172.21.15.170:0/226596646 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fefd003d070 0x7fefd0055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.050+0000 7fefd640d640 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b75090 con 0x7fefd003d070 2024-09-12T17:29:48.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.050+0000 7fefcffff640 1 --2- 172.21.15.170:0/226596646 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fefd003d070 0x7fefd0055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.050+0000 7fefcffff640 1 --2- 172.21.15.170:0/226596646 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fefd003d070 0x7fefd0055a70 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.051+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc0061430 con 0x7fefd003d070 2024-09-12T17:29:48.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.051+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b75090 con 0x55fb22b691d0 2024-09-12T17:29:48.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.051+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc0061430 con 0x55fb22b691d0 2024-09-12T17:29:48.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.051+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b75090 con 0x55fb22b691d0 2024-09-12T17:29:48.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.051+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc0061430 con 0x55fb22b691d0 2024-09-12T17:29:48.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.051+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b75090 con 0x7fefd003d070 2024-09-12T17:29:48.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.051+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc0061430 con 0x7fefd003d070 2024-09-12T17:29:48.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.051+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b75090 con 0x7fefd003d070 2024-09-12T17:29:48.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.051+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc0061430 con 0x7fefd003d070 2024-09-12T17:29:48.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.051+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b75090 con 0x55fb22b6db80 2024-09-12T17:29:48.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.052+0000 7fefd640d640 1 -- 172.21.15.170:0/226596646 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefd004d040 con 0x55fb22b6db80 2024-09-12T17:29:48.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.052+0000 7fefd640d640 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b75090 con 0x55fb22b72500 2024-09-12T17:29:48.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.052+0000 7fefd5c0c640 1 -- 172.21.15.170:0/226596646 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc8018ce0 con 0x55fb22b72500 2024-09-12T17:29:48.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.052+0000 7fefd5c0c640 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b75090 con 0x55fb22b691d0 2024-09-12T17:29:48.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.052+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc0061430 con 0x55fb22b691d0 2024-09-12T17:29:48.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.052+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b75090 con 0x7fefd003d070 2024-09-12T17:29:48.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.052+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc0061430 con 0x7fefd003d070 2024-09-12T17:29:48.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.052+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b75090 con 0x55fb22b691d0 2024-09-12T17:29:48.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.053+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc0061430 con 0x55fb22b691d0 2024-09-12T17:29:48.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.053+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b75090 con 0x55fb22b6db80 2024-09-12T17:29:48.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.053+0000 7fefd640d640 1 -- 172.21.15.170:0/226596646 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fefd004d040 con 0x55fb22b6db80 2024-09-12T17:29:48.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.053+0000 7fefd640d640 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b75090 con 0x55fb22b72500 2024-09-12T17:29:48.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.053+0000 7fefd5c0c640 1 -- 172.21.15.170:0/226596646 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc8018ce0 con 0x55fb22b72500 2024-09-12T17:29:48.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.053+0000 7fefd5c0c640 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b75090 con 0x55fb22b72500 2024-09-12T17:29:48.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.053+0000 7fefd5c0c640 1 -- 172.21.15.170:0/226596646 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc8018ce0 con 0x55fb22b72500 2024-09-12T17:29:48.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.053+0000 7fefd5c0c640 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b75090 con 0x55fb22b6db80 2024-09-12T17:29:48.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.053+0000 7fefd640d640 1 -- 172.21.15.170:0/226596646 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefd004d040 con 0x55fb22b6db80 2024-09-12T17:29:48.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.053+0000 7fefd640d640 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b75090 con 0x55fb22b72500 2024-09-12T17:29:48.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.054+0000 7fefd5c0c640 1 -- 172.21.15.170:0/226596646 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc8018ce0 con 0x55fb22b72500 2024-09-12T17:29:48.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.054+0000 7fefd5c0c640 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b75090 con 0x55fb22b72500 2024-09-12T17:29:48.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.054+0000 7fefd5c0c640 1 -- 172.21.15.170:0/226596646 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc8018ce0 con 0x55fb22b72500 2024-09-12T17:29:48.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.054+0000 7fefd5c0c640 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b75090 con 0x55fb22b691d0 2024-09-12T17:29:48.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.054+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc0061430 con 0x55fb22b691d0 2024-09-12T17:29:48.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.054+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b75090 con 0x55fb22b691d0 2024-09-12T17:29:48.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.054+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v31'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fefc0061430 con 0x55fb22b691d0 2024-09-12T17:29:48.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.054+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b75090 con 0x7fefd003d070 2024-09-12T17:29:48.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.055+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc0061430 con 0x7fefd003d070 2024-09-12T17:29:48.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.055+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b75090 con 0x55fb22b72500 2024-09-12T17:29:48.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.055+0000 7fefd5c0c640 1 -- 172.21.15.170:0/226596646 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc8018ce0 con 0x55fb22b72500 2024-09-12T17:29:48.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.055+0000 7fefd5c0c640 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b75090 con 0x55fb22b6db80 2024-09-12T17:29:48.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.055+0000 7fefd640d640 1 -- 172.21.15.170:0/226596646 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefd004d040 con 0x55fb22b6db80 2024-09-12T17:29:48.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.055+0000 7fefd640d640 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b75090 con 0x55fb22b691d0 2024-09-12T17:29:48.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.055+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc0061430 con 0x55fb22b691d0 2024-09-12T17:29:48.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.055+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b75090 con 0x7fefd003d070 2024-09-12T17:29:48.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.056+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc0061430 con 0x7fefd003d070 2024-09-12T17:29:48.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.056+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b75090 con 0x55fb22b72500 2024-09-12T17:29:48.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.056+0000 7fefd5c0c640 1 -- 172.21.15.170:0/226596646 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc8018ce0 con 0x55fb22b72500 2024-09-12T17:29:48.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.056+0000 7fefd5c0c640 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b75090 con 0x7fefd003d070 2024-09-12T17:29:48.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.056+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc0061430 con 0x7fefd003d070 2024-09-12T17:29:48.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.056+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b75090 con 0x55fb22b6db80 2024-09-12T17:29:48.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.056+0000 7fefd640d640 1 -- 172.21.15.170:0/226596646 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefd004d040 con 0x55fb22b6db80 2024-09-12T17:29:48.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.056+0000 7fefd640d640 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b75090 con 0x55fb22b72500 2024-09-12T17:29:48.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.057+0000 7fefd5c0c640 1 -- 172.21.15.170:0/226596646 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc8018ce0 con 0x55fb22b72500 2024-09-12T17:29:48.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.057+0000 7fefd5c0c640 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b75090 con 0x7fefd003d070 2024-09-12T17:29:48.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.057+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc0061430 con 0x7fefd003d070 2024-09-12T17:29:48.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.057+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b75090 con 0x55fb22b691d0 2024-09-12T17:29:48.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.057+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fefc0061430 con 0x55fb22b691d0 2024-09-12T17:29:48.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.057+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fefc0083080 con 0x55fb22b6db80 2024-09-12T17:29:48.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.057+0000 7fefd640d640 1 -- 172.21.15.170:0/226596646 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(37 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fefd004d040 con 0x55fb22b6db80 2024-09-12T17:29:48.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.057+0000 7fefd9f1f800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:29:48.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.057+0000 7fefd9f1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:29:48.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.057+0000 7fefd9f1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:29:48.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.057+0000 7fefd9f1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:29:48.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.057+0000 7fefd9f1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:29:48.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.057+0000 7fefd9f1f800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:29:48.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.057+0000 7fefd9f1f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.057+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b70ef0 con 0x55fb22b691d0 2024-09-12T17:29:48.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.058+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fefc0061430 con 0x55fb22b691d0 2024-09-12T17:29:48.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.058+0000 7fefd9f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.058+0000 7fefd9f1f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.058+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b70b30 con 0x55fb22b691d0 2024-09-12T17:29:48.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.058+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fefc0061430 con 0x55fb22b691d0 2024-09-12T17:29:48.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.058+0000 7fefd9f1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:48.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.058+0000 7fefd9f1f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.058+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b71810 con 0x55fb22b6db80 2024-09-12T17:29:48.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.058+0000 7fefd640d640 1 -- 172.21.15.170:0/226596646 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fefd004d040 con 0x55fb22b6db80 2024-09-12T17:29:48.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.058+0000 7fefd9f1f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:29:48.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.058+0000 7fefd9f1f800 20 zone default found 2024-09-12T17:29:48.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.058+0000 7fefd9f1f800 4 Realm: () 2024-09-12T17:29:48.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.058+0000 7fefd9f1f800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:29:48.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.058+0000 7fefd9f1f800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:29:48.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.058+0000 7fefd9f1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:29:48.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.058+0000 7fefd9f1f800 20 zonegroup default 2024-09-12T17:29:48.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.058+0000 7fefd9f1f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.058+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b75510 con 0x7fefd003d070 2024-09-12T17:29:48.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.059+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fefc0061430 con 0x7fefd003d070 2024-09-12T17:29:48.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.059+0000 7fefd9f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.059+0000 7fefd9f1f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.059+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b773b0 con 0x55fb22b72500 2024-09-12T17:29:48.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.059+0000 7fefd5c0c640 1 -- 172.21.15.170:0/226596646 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fefc8018ce0 con 0x55fb22b72500 2024-09-12T17:29:48.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.059+0000 7fefd9f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.059+0000 7fefd9f1f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.059+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b77750 con 0x55fb22b72500 2024-09-12T17:29:48.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.059+0000 7fefd5c0c640 1 -- 172.21.15.170:0/226596646 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fefc8018ce0 con 0x55fb22b72500 2024-09-12T17:29:48.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.059+0000 7fefd9f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.059+0000 7fefd9f1f800 20 started sync module instance, tier type = 2024-09-12T17:29:48.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.059+0000 7fefd9f1f800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:29:48.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.059+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b767f0 con 0x55fb22b6db80 2024-09-12T17:29:48.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.060+0000 7fefd640d640 1 -- 172.21.15.170:0/226596646 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(44 notify.0 [create] v31'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefd004d040 con 0x55fb22b6db80 2024-09-12T17:29:48.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.060+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94537107598304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b77000 con 0x55fb22b6db80 2024-09-12T17:29:48.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.060+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b78450 con 0x55fb22b691d0 2024-09-12T17:29:48.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.061+0000 7fefd640d640 1 -- 172.21.15.170:0/226596646 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94537107598304] v31'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefd004d040 con 0x55fb22b6db80 2024-09-12T17:29:48.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.061+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v31'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefc0061430 con 0x55fb22b691d0 2024-09-12T17:29:48.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.061+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94537107602640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b78840 con 0x55fb22b691d0 2024-09-12T17:29:48.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.061+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b79260 con 0x55fb22b72500 2024-09-12T17:29:48.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.062+0000 7fefd5c0c640 1 -- 172.21.15.170:0/226596646 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v31'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefc8018ce0 con 0x55fb22b72500 2024-09-12T17:29:48.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.062+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94537107606864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b79af0 con 0x55fb22b72500 2024-09-12T17:29:48.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.062+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b7a5f0 con 0x55fb22b6db80 2024-09-12T17:29:48.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.063+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94537107602640] v31'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefc0061430 con 0x55fb22b691d0 2024-09-12T17:29:48.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.063+0000 7fefd5c0c640 1 -- 172.21.15.170:0/226596646 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94537107606864] v31'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefc8018ce0 con 0x55fb22b72500 2024-09-12T17:29:48.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.064+0000 7fefd640d640 1 -- 172.21.15.170:0/226596646 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(50 notify.3 [create] v31'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefd004d040 con 0x55fb22b6db80 2024-09-12T17:29:48.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.064+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94537107611872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b79600 con 0x55fb22b6db80 2024-09-12T17:29:48.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.064+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b7b030 con 0x55fb22b691d0 2024-09-12T17:29:48.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.065+0000 7fefd640d640 1 -- 172.21.15.170:0/226596646 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94537107611872] v31'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefd004d040 con 0x55fb22b6db80 2024-09-12T17:29:48.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.065+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v31'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefc0061430 con 0x55fb22b691d0 2024-09-12T17:29:48.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.065+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94537107603792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b7b030 con 0x55fb22b691d0 2024-09-12T17:29:48.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.065+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b7b9f0 con 0x7fefd003d070 2024-09-12T17:29:48.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.066+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(54 notify.5 [create] v31'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefc0061430 con 0x7fefd003d070 2024-09-12T17:29:48.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.066+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94537107617088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b7be10 con 0x7fefd003d070 2024-09-12T17:29:48.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.066+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b7c890 con 0x7fefd003d070 2024-09-12T17:29:48.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.066+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94537107603792] v31'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefc0061430 con 0x55fb22b691d0 2024-09-12T17:29:48.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.067+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94537107617088] v31'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefc0061430 con 0x7fefd003d070 2024-09-12T17:29:48.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.067+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v31'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefc0061430 con 0x7fefd003d070 2024-09-12T17:29:48.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.067+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94537107620736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b7b960 con 0x7fefd003d070 2024-09-12T17:29:48.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.067+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b7d130 con 0x7fefd003d070 2024-09-12T17:29:48.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.068+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94537107620736] v31'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefc0061430 con 0x7fefd003d070 2024-09-12T17:29:48.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.068+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(58 notify.7 [create] v31'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefc0061430 con 0x7fefd003d070 2024-09-12T17:29:48.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.068+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94537107614592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b7b960 con 0x7fefd003d070 2024-09-12T17:29:48.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.068+0000 7fefd9f1f800 20 add_watcher() i=0 2024-09-12T17:29:48.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.068+0000 7fefd9f1f800 20 add_watcher() i=1 2024-09-12T17:29:48.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.068+0000 7fefd9f1f800 20 add_watcher() i=2 2024-09-12T17:29:48.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.068+0000 7fefd9f1f800 20 add_watcher() i=3 2024-09-12T17:29:48.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.068+0000 7fefd9f1f800 20 add_watcher() i=4 2024-09-12T17:29:48.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.068+0000 7fefd9f1f800 20 add_watcher() i=5 2024-09-12T17:29:48.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.068+0000 7fefd9f1f800 20 add_watcher() i=6 2024-09-12T17:29:48.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.069+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94537107614592] v31'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefc0061430 con 0x7fefd003d070 2024-09-12T17:29:48.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.069+0000 7fefd9f1f800 20 add_watcher() i=7 2024-09-12T17:29:48.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.069+0000 7fefd9f1f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:29:48.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.069+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b80160 con 0x55fb22b691d0 2024-09-12T17:29:48.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.069+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fefc0061430 con 0x55fb22b691d0 2024-09-12T17:29:48.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.069+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94537107623040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b7d620 con 0x55fb22b691d0 2024-09-12T17:29:48.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.070+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94537107623040] v31'262 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fefc0061430 con 0x55fb22b691d0 2024-09-12T17:29:48.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.070+0000 7fee877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:48.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.071+0000 7fefd9f1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:29:48.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.071+0000 7fefd9f1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:29:48.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.071+0000 7fefd9f1f800 5 note: GC not initialized 2024-09-12T17:29:48.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.071+0000 7fee867fc640 20 reqs_thread_entry: start 2024-09-12T17:29:48.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.071+0000 7fefd9f1f800 20 init_complete bucket index max shards: 11 2024-09-12T17:29:48.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.071+0000 7fefd9f1f800 20 Filter name: none 2024-09-12T17:29:48.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.071+0000 7fedf7fff640 20 reqs_thread_entry: start 2024-09-12T17:29:48.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.071+0000 7fefd9f1f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-12T17:29:48.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.071+0000 7fefd9f1f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.071+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fb22bb3140 con 0x7fefd003d070 2024-09-12T17:29:48.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.072+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fefc0061430 con 0x7fefd003d070 2024-09-12T17:29:48.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.072+0000 7fefd9f1f800 20 rados_obj.operate() r=0 bl.length=490 2024-09-12T17:29:48.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.072+0000 7fefd9f1f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-12T17:29:48.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.072+0000 7fefd9f1f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:29:48.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.072+0000 7fefd9f1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:29:48.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.072+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~503 in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fb22bb9680 con 0x7fefd003d070 2024-09-12T17:29:48.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.073+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~503] v31'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fefc0061430 con 0x7fefd003d070 2024-09-12T17:29:48.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.073+0000 7fefd9f1f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T17:29:48.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.073+0000 7fefd9f1f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:29:48.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.073+0000 7fefd9f1f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-12T17:29:48.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.073+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94537107869824 in=691b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fb22bb4ce0 con 0x55fb22b691d0 2024-09-12T17:29:48.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.073+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== watch-notify(notify (1) cookie 94537107603792 notify 133143986202 ret 0) ==== 721+0+0 (crc 0 0 0) 0x55fb228c56b0 con 0x55fb22b691d0 2024-09-12T17:29:48.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.073+0000 7feeb97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986202 cookie 94537107603792 notifier 4883 bl.length()=679 2024-09-12T17:29:48.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.073+0000 7feeb97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T17:29:48.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.073+0000 7feeb97fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:29:48.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.073+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(64 notify.4 [notify cookie 94537107869824 out=8b] v0'0 uv264 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fefc0061430 con 0x55fb22b691d0 2024-09-12T17:29:48.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.073+0000 7feeb97fa640 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fee98003ea0 con 0x55fb22b691d0 2024-09-12T17:29:48.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.073+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefc0061430 con 0x55fb22b691d0 2024-09-12T17:29:48.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.074+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== watch-notify(notify_complete (2) cookie 94537107869824 notify 133143986202 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fefc0061df0 con 0x55fb22b691d0 2024-09-12T17:29:48.086 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-12T17:29:46.782056Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:29:46.782042Z","tags":[],"group_ids":[]} 2024-09-12T17:29:48.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.074+0000 7fee877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:48.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.074+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94537107623040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fb22bb0f90 con 0x55fb22b691d0 2024-09-12T17:29:48.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.075+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94537107623040] v31'263 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fefc0061430 con 0x55fb22b691d0 2024-09-12T17:29:48.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.075+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94537107598304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fb22bb0f90 con 0x55fb22b6db80 2024-09-12T17:29:48.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.076+0000 7fefd640d640 1 -- 172.21.15.170:0/226596646 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94537107598304] v31'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefd004d040 con 0x55fb22b6db80 2024-09-12T17:29:48.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.076+0000 7fefd9f1f800 20 remove_watcher() i=0 2024-09-12T17:29:48.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.076+0000 7fefd9f1f800 2 removed watcher, disabling cache 2024-09-12T17:29:48.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.076+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94537107602640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fb22bb0f90 con 0x55fb22b691d0 2024-09-12T17:29:48.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.077+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94537107602640] v31'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefc0061430 con 0x55fb22b691d0 2024-09-12T17:29:48.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.077+0000 7fefd9f1f800 20 remove_watcher() i=1 2024-09-12T17:29:48.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.077+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94537107606864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fb22bb0f90 con 0x55fb22b72500 2024-09-12T17:29:48.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.079+0000 7fefd5c0c640 1 -- 172.21.15.170:0/226596646 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94537107606864] v31'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefc8018ce0 con 0x55fb22b72500 2024-09-12T17:29:48.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.079+0000 7fefd9f1f800 20 remove_watcher() i=2 2024-09-12T17:29:48.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.079+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94537107611872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b76be0 con 0x55fb22b6db80 2024-09-12T17:29:48.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.080+0000 7fefd640d640 1 -- 172.21.15.170:0/226596646 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94537107611872] v31'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefd004d040 con 0x55fb22b6db80 2024-09-12T17:29:48.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.080+0000 7fefd9f1f800 20 remove_watcher() i=3 2024-09-12T17:29:48.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.080+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94537107603792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b77cd0 con 0x55fb22b691d0 2024-09-12T17:29:48.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.081+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94537107603792] v31'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefc0061430 con 0x55fb22b691d0 2024-09-12T17:29:48.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.081+0000 7fefd9f1f800 20 remove_watcher() i=4 2024-09-12T17:29:48.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.081+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94537107617088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b76be0 con 0x7fefd003d070 2024-09-12T17:29:48.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.082+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94537107617088] v31'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefc0061430 con 0x7fefd003d070 2024-09-12T17:29:48.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.082+0000 7fefd9f1f800 20 remove_watcher() i=5 2024-09-12T17:29:48.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.082+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94537107620736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b77cd0 con 0x7fefd003d070 2024-09-12T17:29:48.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.083+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94537107620736] v31'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefc0061430 con 0x7fefd003d070 2024-09-12T17:29:48.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.083+0000 7fefd9f1f800 20 remove_watcher() i=6 2024-09-12T17:29:48.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.083+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94537107614592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fb22b7b540 con 0x7fefd003d070 2024-09-12T17:29:48.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.084+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94537107614592] v31'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefc0061430 con 0x7fefd003d070 2024-09-12T17:29:48.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.084+0000 7fefd9f1f800 20 remove_watcher() i=7 2024-09-12T17:29:48.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.084+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fefd003d070 msgr2=0x7fefd0055a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.084+0000 7fefd9f1f800 1 --2- 172.21.15.170:0/226596646 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fefd003d070 0x7fefd0055a70 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.084+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55fb22b691d0 msgr2=0x55fb22b6b690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.084+0000 7fefd9f1f800 1 --2- 172.21.15.170:0/226596646 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55fb22b691d0 0x55fb22b6b690 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.084+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55fb22b6db80 msgr2=0x55fb22b6ff70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.084+0000 7fefd9f1f800 1 --2- 172.21.15.170:0/226596646 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55fb22b6db80 0x55fb22b6ff70 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.084+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55fb22b72500 msgr2=0x55fb22b749c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.084+0000 7fefd9f1f800 1 --2- 172.21.15.170:0/226596646 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55fb22b72500 0x55fb22b749c0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.084+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7feea003c730 msgr2=0x7feea003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.084+0000 7fefd9f1f800 1 --2- 172.21.15.170:0/226596646 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7feea003c730 0x7feea003ebf0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fefc800dfd0 tx=0x7fefc802f000 comp rx=0 tx=0).stop 2024-09-12T17:29:48.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.084+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fb22b56270 msgr2=0x55fb22b5d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.084+0000 7fefd9f1f800 1 --2- 172.21.15.170:0/226596646 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fb22b56270 0x55fb22b5d830 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fefd0020560 tx=0x7fefd0053d00 comp rx=0 tx=0).stop 2024-09-12T17:29:48.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.084+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 reap_dead start 2024-09-12T17:29:48.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.084+0000 7fefcffff640 1 -- 172.21.15.170:0/226596646 reap_dead start 2024-09-12T17:29:48.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.084+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 shutdown_connections 2024-09-12T17:29:48.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.084+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 >> 172.21.15.170:0/226596646 conn(0x55fb22b52670 msgr2=0x55fb22b50880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:48.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.084+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 shutdown_connections 2024-09-12T17:29:48.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.084+0000 7fefd9f1f800 1 -- 172.21.15.170:0/226596646 wait complete. 2024-09-12T17:29:48.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.084+0000 7fefd9f1f800 1 -- 172.21.15.170:0/3119230412 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7feeb003c730 msgr2=0x7feeb003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.084+0000 7fefd9f1f800 1 --2- 172.21.15.170:0/3119230412 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7feeb003c730 0x7feeb003ebf0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x55fb22b36580 tx=0x7fefc800beb0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.084+0000 7fefd9f1f800 1 -- 172.21.15.170:0/3119230412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fb22b49750 msgr2=0x55fb22b49b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.084+0000 7fefd9f1f800 1 --2- 172.21.15.170:0/3119230412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fb22b49750 0x55fb22b49b70 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x55fb22b2f8b0 tx=0x7fefd00167b0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.084+0000 7fefd9f1f800 1 -- 172.21.15.170:0/3119230412 shutdown_connections 2024-09-12T17:29:48.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.084+0000 7fefd9f1f800 1 --2- 172.21.15.170:0/3119230412 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7feeb003c730 0x7feeb003ebf0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.084+0000 7fefd9f1f800 1 --2- 172.21.15.170:0/3119230412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fb22b49750 0x55fb22b49b70 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.084+0000 7fefd9f1f800 1 -- 172.21.15.170:0/3119230412 >> 172.21.15.170:0/3119230412 conn(0x55fb22b3db00 msgr2=0x55fb22b3dee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:48.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.085+0000 7fefd9f1f800 1 -- 172.21.15.170:0/3119230412 shutdown_connections 2024-09-12T17:29:48.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.085+0000 7fefd9f1f800 1 -- 172.21.15.170:0/3119230412 wait complete. 2024-09-12T17:29:48.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.085+0000 7fefd9f1f800 1 -- 172.21.15.170:0/3072169738 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55fb22b30230 msgr2=0x55fb22b35b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.085+0000 7fefd9f1f800 1 --2- 172.21.15.170:0/3072169738 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55fb22b30230 0x55fb22b35b40 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.085+0000 7fefd9f1f800 1 -- 172.21.15.170:0/3072169738 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55fb22b38400 msgr2=0x55fb22b3a7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.085+0000 7fefd9f1f800 1 --2- 172.21.15.170:0/3072169738 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55fb22b38400 0x55fb22b3a7f0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.085+0000 7fefd9f1f800 1 -- 172.21.15.170:0/3072169738 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7feebc03c780 msgr2=0x7feebc03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.085+0000 7fefd9f1f800 1 --2- 172.21.15.170:0/3072169738 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7feebc03c780 0x7feebc03ec40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x55fb229981c0 tx=0x7fefc0050000 comp rx=0 tx=0).stop 2024-09-12T17:29:48.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.085+0000 7fefd9f1f800 1 -- 172.21.15.170:0/3072169738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fb22a36570 msgr2=0x55fb22b2e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.085+0000 7fefd9f1f800 1 --2- 172.21.15.170:0/3072169738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fb22a36570 0x55fb22b2e4f0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x55fb22a35100 tx=0x7fefc80040e0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.085+0000 7fefd9f1f800 1 -- 172.21.15.170:0/3072169738 shutdown_connections 2024-09-12T17:29:48.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.085+0000 7fefd9f1f800 1 --2- 172.21.15.170:0/3072169738 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55fb22b38400 0x55fb22b3a7f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.085+0000 7fefd9f1f800 1 --2- 172.21.15.170:0/3072169738 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7feebc03c780 0x7feebc03ec40 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.085+0000 7fefd9f1f800 1 --2- 172.21.15.170:0/3072169738 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55fb22b30230 0x55fb22b35b40 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.085+0000 7fefd9f1f800 1 --2- 172.21.15.170:0/3072169738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fb22a36570 0x55fb22b2e4f0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.085+0000 7fefd9f1f800 1 -- 172.21.15.170:0/3072169738 >> 172.21.15.170:0/3072169738 conn(0x55fb22a2e930 msgr2=0x55fb22b1fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:48.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.085+0000 7fefd9f1f800 1 -- 172.21.15.170:0/3072169738 shutdown_connections 2024-09-12T17:29:48.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.085+0000 7fefd9f1f800 1 -- 172.21.15.170:0/3072169738 wait complete. 2024-09-12T17:29:48.097 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T17:29:46.782056Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:29:46.782042Z', 'tags': [], 'group_ids': []} 2024-09-12T17:29:48.098 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T17:29:46.782056Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:29:46.782042Z', 'tags': [], 'group_ids': []} 2024-09-12T17:29:48.098 ERROR:root:0 2024-09-12T17:29:48.098 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T17:29:48.102 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:29:48.102 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-12T17:29:48.102 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-12T17:29:48.103 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write; user-info-without-keys=*' 2024-09-12T17:29:48.149 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:29:48.149 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:29:48.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.149+0000 7f843c946800 1 Processor -- start 2024-09-12T17:29:48.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.149+0000 7f843c946800 1 -- start start 2024-09-12T17:29:48.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.149+0000 7f843c946800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55b1ceb3de00 0x55b1ceb3eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.149+0000 7f843c946800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b1ce9e8e40 con 0x55b1ceb3f040 2024-09-12T17:29:48.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.149+0000 7f843c946800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x55b1ce9b3680 con 0x55b1ceb3de00 2024-09-12T17:29:48.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.149+0000 7f843a437640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55b1ceb3de00 0x55b1ceb3eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.149+0000 7f8431c36640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x55b1ceb3f040 0x55b1ceb43da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:44954/0 (socket says 172.21.15.170:44954) 2024-09-12T17:29:48.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.149+0000 7f8431c36640 1 -- 172.21.15.170:0/3031813847 learned_addr learned my addr 172.21.15.170:0/3031813847 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:29:48.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.150+0000 7f8439c36640 1 -- 172.21.15.170:0/3031813847 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2255997615 0 0) 0x55b1ce9e8e40 con 0x55b1ceb3f040 2024-09-12T17:29:48.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.150+0000 7f8439c36640 1 -- 172.21.15.170:0/3031813847 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8428001e10 con 0x55b1ceb3f040 2024-09-12T17:29:48.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.150+0000 7f843a437640 1 -- 172.21.15.170:0/3031813847 >> v1:172.21.15.47:6789/0 conn(0x55b1ceb3f040 legacy=0x55b1ceb43da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.150+0000 7f843a437640 1 -- 172.21.15.170:0/3031813847 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1ce9cf6b0 con 0x55b1ceb3de00 2024-09-12T17:29:48.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.151+0000 7f843a437640 1 --2- 172.21.15.170:0/3031813847 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1ceb3de00 0x55b1ceb3eb00 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f842c00a470 tx=0x7f842c045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=423844236f22e5a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.152+0000 7f8439c36640 1 -- 172.21.15.170:0/3031813847 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f842c059070 con 0x55b1ceb3de00 2024-09-12T17:29:48.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.152+0000 7f8439c36640 1 -- 172.21.15.170:0/3031813847 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f842c054570 con 0x55b1ceb3de00 2024-09-12T17:29:48.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.152+0000 7f8439c36640 1 -- 172.21.15.170:0/3031813847 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f842c054870 con 0x55b1ceb3de00 2024-09-12T17:29:48.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.152+0000 7f843c946800 1 -- 172.21.15.170:0/3031813847 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1ceb3de00 msgr2=0x55b1ceb3eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.152+0000 7f843c946800 1 --2- 172.21.15.170:0/3031813847 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1ceb3de00 0x55b1ceb3eb00 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f842c00a470 tx=0x7f842c045920 comp rx=0 tx=0).stop 2024-09-12T17:29:48.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.152+0000 7f843c946800 1 -- 172.21.15.170:0/3031813847 shutdown_connections 2024-09-12T17:29:48.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.152+0000 7f843c946800 1 --2- 172.21.15.170:0/3031813847 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1ceb3de00 0x55b1ceb3eb00 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.152+0000 7f843c946800 1 -- 172.21.15.170:0/3031813847 >> 172.21.15.170:0/3031813847 conn(0x55b1ceb391d0 msgr2=0x55b1ceb3b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:48.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.152+0000 7f843c946800 1 -- 172.21.15.170:0/3031813847 shutdown_connections 2024-09-12T17:29:48.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.152+0000 7f843c946800 1 -- 172.21.15.170:0/3031813847 wait complete. 2024-09-12T17:29:48.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.166+0000 7f843c946800 1 Processor -- start 2024-09-12T17:29:48.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.166+0000 7f843c946800 1 -- start start 2024-09-12T17:29:48.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.166+0000 7f843c946800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1ceb3de00 0x55b1cec2e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.166+0000 7f843c946800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b1ce9d7dd0 con 0x55b1ceb3de00 2024-09-12T17:29:48.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.166+0000 7f843a437640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1ceb3de00 0x55b1cec2e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.166+0000 7f843a437640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1ceb3de00 0x55b1cec2e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35290/0 (socket says 172.21.15.170:35290) 2024-09-12T17:29:48.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.166+0000 7f843a437640 1 -- 172.21.15.170:0/3073010894 learned_addr learned my addr 172.21.15.170:0/3073010894 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:48.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.167+0000 7f843a437640 1 -- 172.21.15.170:0/3073010894 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1ce9f0e10 con 0x55b1ceb3de00 2024-09-12T17:29:48.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.167+0000 7f843a437640 1 --2- 172.21.15.170:0/3073010894 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1ceb3de00 0x55b1cec2e540 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f842c00a470 tx=0x7f842c04e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=995a999db0ceaa85 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.167+0000 7f8328608640 1 -- 172.21.15.170:0/3073010894 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f842c065070 con 0x55b1ceb3de00 2024-09-12T17:29:48.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.167+0000 7f8328608640 1 -- 172.21.15.170:0/3073010894 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f842c05a040 con 0x55b1ceb3de00 2024-09-12T17:29:48.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.167+0000 7f8328608640 1 -- 172.21.15.170:0/3073010894 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f842c059070 con 0x55b1ceb3de00 2024-09-12T17:29:48.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.168+0000 7f843c946800 1 -- 172.21.15.170:0/3073010894 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1ceb3de00 msgr2=0x55b1cec2e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.168+0000 7f843c946800 1 --2- 172.21.15.170:0/3073010894 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1ceb3de00 0x55b1cec2e540 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f842c00a470 tx=0x7f842c04e000 comp rx=0 tx=0).stop 2024-09-12T17:29:48.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.168+0000 7f843c946800 1 -- 172.21.15.170:0/3073010894 shutdown_connections 2024-09-12T17:29:48.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.168+0000 7f843c946800 1 --2- 172.21.15.170:0/3073010894 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1ceb3de00 0x55b1cec2e540 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.168+0000 7f843c946800 1 -- 172.21.15.170:0/3073010894 >> 172.21.15.170:0/3073010894 conn(0x55b1ceb391d0 msgr2=0x55b1cec29ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:48.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.168+0000 7f843c946800 1 -- 172.21.15.170:0/3073010894 shutdown_connections 2024-09-12T17:29:48.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.168+0000 7f843c946800 1 -- 172.21.15.170:0/3073010894 wait complete. 2024-09-12T17:29:48.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.168+0000 7f843c946800 1 Processor -- start 2024-09-12T17:29:48.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.168+0000 7f843c946800 1 -- start start 2024-09-12T17:29:48.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.168+0000 7f843c946800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1ceb3de00 0x55b1cec35e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.168+0000 7f843c946800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b1ceb3f6b0 con 0x55b1ceb3de00 2024-09-12T17:29:48.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.169+0000 7f843a437640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1ceb3de00 0x55b1cec35e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.169+0000 7f843a437640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1ceb3de00 0x55b1cec35e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35306/0 (socket says 172.21.15.170:35306) 2024-09-12T17:29:48.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.169+0000 7f843a437640 1 -- 172.21.15.170:0/817074257 learned_addr learned my addr 172.21.15.170:0/817074257 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:48.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.169+0000 7f843a437640 1 -- 172.21.15.170:0/817074257 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1cec36360 con 0x55b1ceb3de00 2024-09-12T17:29:48.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.169+0000 7f843a437640 1 --2- 172.21.15.170:0/817074257 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1ceb3de00 0x55b1cec35e00 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f842c025b20 tx=0x7f842c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.169+0000 7f8326e05640 1 -- 172.21.15.170:0/817074257 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f842c071070 con 0x55b1ceb3de00 2024-09-12T17:29:48.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.169+0000 7f8326e05640 1 -- 172.21.15.170:0/817074257 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f842c066040 con 0x55b1ceb3de00 2024-09-12T17:29:48.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.169+0000 7f843c946800 1 -- 172.21.15.170:0/817074257 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b1cec365f0 con 0x55b1ceb3de00 2024-09-12T17:29:48.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.169+0000 7f8326e05640 1 -- 172.21.15.170:0/817074257 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f842c065050 con 0x55b1ceb3de00 2024-09-12T17:29:48.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.169+0000 7f843c946800 1 -- 172.21.15.170:0/817074257 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1cec36ff0 con 0x55b1ceb3de00 2024-09-12T17:29:48.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.170+0000 7f8326e05640 1 -- 172.21.15.170:0/817074257 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f842c074070 con 0x55b1ceb3de00 2024-09-12T17:29:48.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.170+0000 7f8326e05640 1 --2- 172.21.15.170:0/817074257 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f832003c780 0x7f832003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.170+0000 7f8326e05640 1 -- 172.21.15.170:0/817074257 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f842c096700 con 0x55b1ceb3de00 2024-09-12T17:29:48.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.170+0000 7f8431c36640 1 --2- 172.21.15.170:0/817074257 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f832003c780 0x7f832003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.171+0000 7f843c946800 1 --2- 172.21.15.170:0/817074257 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b1ceb3f040 0x55b1cec3d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.171+0000 7f843c946800 1 -- 172.21.15.170:0/817074257 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec3d990 con 0x55b1ceb3f040 2024-09-12T17:29:48.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.171+0000 7f843ac38640 1 --2- 172.21.15.170:0/817074257 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b1ceb3f040 0x55b1cec3d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.171+0000 7f8431c36640 1 --2- 172.21.15.170:0/817074257 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f832003c780 0x7f832003ec40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8424001db0 tx=0x7f8424001310 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.171+0000 7f843ac38640 1 --2- 172.21.15.170:0/817074257 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b1ceb3f040 0x55b1cec3d450 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.171+0000 7f843ac38640 1 -- 172.21.15.170:0/817074257 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f843400a4d0 con 0x55b1ceb3f040 2024-09-12T17:29:48.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.171+0000 7f843c946800 1 -- 172.21.15.170:0/817074257 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec3dd30 con 0x55b1ceb3f040 2024-09-12T17:29:48.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.171+0000 7f843ac38640 1 -- 172.21.15.170:0/817074257 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f843400a4d0 con 0x55b1ceb3f040 2024-09-12T17:29:48.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.172+0000 7f843c946800 1 --2- 172.21.15.170:0/817074257 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b1cec3f7f0 0x55b1cec41c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.172+0000 7f843c946800 1 -- 172.21.15.170:0/817074257 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec423f0 con 0x55b1cec3f7f0 2024-09-12T17:29:48.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.172+0000 7f843a437640 1 --2- 172.21.15.170:0/817074257 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b1cec3f7f0 0x55b1cec41c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.172+0000 7f843a437640 1 --2- 172.21.15.170:0/817074257 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b1cec3f7f0 0x55b1cec41c60 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.172+0000 7f843a437640 1 -- 172.21.15.170:0/817074257 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f842c073030 con 0x55b1cec3f7f0 2024-09-12T17:29:48.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.172+0000 7f843c946800 1 -- 172.21.15.170:0/817074257 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec3e580 con 0x55b1ceb3f040 2024-09-12T17:29:48.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.172+0000 7f843ac38640 1 -- 172.21.15.170:0/817074257 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f843400a4d0 con 0x55b1ceb3f040 2024-09-12T17:29:48.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.172+0000 7f843c946800 1 -- 172.21.15.170:0/817074257 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec3e960 con 0x55b1cec3f7f0 2024-09-12T17:29:48.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.173+0000 7f843a437640 1 -- 172.21.15.170:0/817074257 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f842c073030 con 0x55b1cec3f7f0 2024-09-12T17:29:48.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.173+0000 7f843c946800 1 Processor -- start 2024-09-12T17:29:48.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.173+0000 7f843c946800 1 -- start start 2024-09-12T17:29:48.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.173+0000 7f843c946800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1cec50ca0 0x55b1cec510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.173+0000 7f843c946800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b1cea35a00 con 0x55b1cec50ca0 2024-09-12T17:29:48.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.174+0000 7f843ac38640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1cec50ca0 0x55b1cec510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.174+0000 7f843ac38640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1cec50ca0 0x55b1cec510c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35314/0 (socket says 172.21.15.170:35314) 2024-09-12T17:29:48.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.174+0000 7f843ac38640 1 -- 172.21.15.170:0/2995488861 learned_addr learned my addr 172.21.15.170:0/2995488861 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:48.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.174+0000 7f843ac38640 1 -- 172.21.15.170:0/2995488861 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1cec51700 con 0x55b1cec50ca0 2024-09-12T17:29:48.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.174+0000 7f843ac38640 1 --2- 172.21.15.170:0/2995488861 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1cec50ca0 0x55b1cec510c0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x55b1cec36e00 tx=0x7f84340167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.174+0000 7f831ffff640 1 -- 172.21.15.170:0/2995488861 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8434013640 con 0x55b1cec50ca0 2024-09-12T17:29:48.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.174+0000 7f831ffff640 1 -- 172.21.15.170:0/2995488861 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84340137e0 con 0x55b1cec50ca0 2024-09-12T17:29:48.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.174+0000 7f843c946800 1 -- 172.21.15.170:0/2995488861 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b1cec51f30 con 0x55b1cec50ca0 2024-09-12T17:29:48.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.174+0000 7f831ffff640 1 -- 172.21.15.170:0/2995488861 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8434013ae0 con 0x55b1cec50ca0 2024-09-12T17:29:48.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.174+0000 7f843c946800 1 -- 172.21.15.170:0/2995488861 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1cec524d0 con 0x55b1cec50ca0 2024-09-12T17:29:48.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.175+0000 7f831ffff640 1 -- 172.21.15.170:0/2995488861 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8434011040 con 0x55b1cec50ca0 2024-09-12T17:29:48.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.175+0000 7f831ffff640 1 --2- 172.21.15.170:0/2995488861 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f831403c780 0x7f831403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.175+0000 7f831ffff640 1 -- 172.21.15.170:0/2995488861 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f843400e040 con 0x55b1cec50ca0 2024-09-12T17:29:48.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.175+0000 7f843a437640 1 --2- 172.21.15.170:0/2995488861 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f831403c780 0x7f831403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.176+0000 7f843c946800 1 Processor -- start 2024-09-12T17:29:48.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.176+0000 7f843a437640 1 --2- 172.21.15.170:0/2995488861 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f831403c780 0x7f831403ec40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x55b1cec37ed0 tx=0x7f842c093040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.176+0000 7f843c946800 1 -- start start 2024-09-12T17:29:48.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.176+0000 7f843c946800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1cec5d780 0x55b1cec5db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.176+0000 7f843c946800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b1cec2ecd0 con 0x55b1cec5d780 2024-09-12T17:29:48.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.176+0000 7f843ac38640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1cec5d780 0x55b1cec5db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.176+0000 7f843ac38640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1cec5d780 0x55b1cec5db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35322/0 (socket says 172.21.15.170:35322) 2024-09-12T17:29:48.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.176+0000 7f843ac38640 1 -- 172.21.15.170:0/1365540957 learned_addr learned my addr 172.21.15.170:0/1365540957 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:48.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.176+0000 7f843ac38640 1 -- 172.21.15.170:0/1365540957 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1cec5e170 con 0x55b1cec5d780 2024-09-12T17:29:48.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.177+0000 7f843ac38640 1 --2- 172.21.15.170:0/1365540957 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1cec5d780 0x55b1cec5db80 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f8434053d60 tx=0x7f8434020460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f77e817746d7f39 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.177+0000 7f831dffb640 1 -- 172.21.15.170:0/1365540957 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8434052020 con 0x55b1cec5d780 2024-09-12T17:29:48.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.177+0000 7f831dffb640 1 -- 172.21.15.170:0/1365540957 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8434021e20 con 0x55b1cec5d780 2024-09-12T17:29:48.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.177+0000 7f831dffb640 1 -- 172.21.15.170:0/1365540957 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8434021ab0 con 0x55b1cec5d780 2024-09-12T17:29:48.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.177+0000 7f843c946800 1 -- 172.21.15.170:0/1365540957 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1cec5d780 msgr2=0x55b1cec5db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.177+0000 7f843c946800 1 --2- 172.21.15.170:0/1365540957 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1cec5d780 0x55b1cec5db80 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f8434053d60 tx=0x7f8434020460 comp rx=0 tx=0).stop 2024-09-12T17:29:48.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.177+0000 7f843c946800 1 -- 172.21.15.170:0/1365540957 shutdown_connections 2024-09-12T17:29:48.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.177+0000 7f843c946800 1 --2- 172.21.15.170:0/1365540957 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1cec5d780 0x55b1cec5db80 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.177+0000 7f843c946800 1 -- 172.21.15.170:0/1365540957 >> 172.21.15.170:0/1365540957 conn(0x55b1cec59b80 msgr2=0x55b1cec57dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:48.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.177+0000 7f843c946800 1 -- 172.21.15.170:0/1365540957 shutdown_connections 2024-09-12T17:29:48.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.177+0000 7f843c946800 1 -- 172.21.15.170:0/1365540957 wait complete. 2024-09-12T17:29:48.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.177+0000 7f843c946800 1 Processor -- start 2024-09-12T17:29:48.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.178+0000 7f843c946800 1 -- start start 2024-09-12T17:29:48.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.178+0000 7f843c946800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1cec5d780 0x55b1cec64d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.178+0000 7f843c946800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b1cec5e790 con 0x55b1cec5d780 2024-09-12T17:29:48.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.178+0000 7f843ac38640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1cec5d780 0x55b1cec64d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.178+0000 7f843ac38640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1cec5d780 0x55b1cec64d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35330/0 (socket says 172.21.15.170:35330) 2024-09-12T17:29:48.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.178+0000 7f843ac38640 1 -- 172.21.15.170:0/2686216603 learned_addr learned my addr 172.21.15.170:0/2686216603 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:48.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.178+0000 7f843ac38640 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1cec652a0 con 0x55b1cec5d780 2024-09-12T17:29:48.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.178+0000 7f843ac38640 1 --2- 172.21.15.170:0/2686216603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1cec5d780 0x55b1cec64d40 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f84340208e0 tx=0x7f8434053cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.178+0000 7f830bfff640 1 -- 172.21.15.170:0/2686216603 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f843401fa90 con 0x55b1cec5d780 2024-09-12T17:29:48.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.178+0000 7f830bfff640 1 -- 172.21.15.170:0/2686216603 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f843401fc30 con 0x55b1cec5d780 2024-09-12T17:29:48.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.178+0000 7f830bfff640 1 -- 172.21.15.170:0/2686216603 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f843401f500 con 0x55b1cec5d780 2024-09-12T17:29:48.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.178+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b1cec65530 con 0x55b1cec5d780 2024-09-12T17:29:48.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.179+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1cec65eb0 con 0x55b1cec5d780 2024-09-12T17:29:48.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.179+0000 7f830bfff640 1 -- 172.21.15.170:0/2686216603 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f843401f6a0 con 0x55b1cec5d780 2024-09-12T17:29:48.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.179+0000 7f830bfff640 1 --2- 172.21.15.170:0/2686216603 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f830403c730 0x7f830403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.179+0000 7f830bfff640 1 -- 172.21.15.170:0/2686216603 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f843403cc80 con 0x55b1cec5d780 2024-09-12T17:29:48.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.180+0000 7f843a437640 1 --2- 172.21.15.170:0/2686216603 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f830403c730 0x7f830403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.180+0000 7f843a437640 1 --2- 172.21.15.170:0/2686216603 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f830403c730 0x7f830403ebf0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f842c075550 tx=0x7f842c078420 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.180+0000 7f843c946800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.180+0000 7f843c946800 1 --2- 172.21.15.170:0/2686216603 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b1cec706c0 0x55b1cec72b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.180+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec732d0 con 0x55b1cec706c0 2024-09-12T17:29:48.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.180+0000 7f8431c36640 1 --2- 172.21.15.170:0/2686216603 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b1cec706c0 0x55b1cec72b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.180+0000 7f8431c36640 1 --2- 172.21.15.170:0/2686216603 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b1cec706c0 0x55b1cec72b80 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.181+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8424009050 con 0x55b1cec706c0 2024-09-12T17:29:48.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.181+0000 7f843c946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.181+0000 7f843c946800 20 realm 2024-09-12T17:29:48.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.181+0000 7f843c946800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.181+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec6fa10 con 0x55b1cec706c0 2024-09-12T17:29:48.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.181+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8424009050 con 0x55b1cec706c0 2024-09-12T17:29:48.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.181+0000 7f843c946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.181+0000 7f843c946800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:29:48.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.181+0000 7f843c946800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.181+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec73dc0 con 0x55b1cec706c0 2024-09-12T17:29:48.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.181+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8424009050 con 0x55b1cec706c0 2024-09-12T17:29:48.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.181+0000 7f843c946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.181+0000 7f843c946800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.181+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec74690 con 0x55b1cec706c0 2024-09-12T17:29:48.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.181+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8424009050 con 0x55b1cec706c0 2024-09-12T17:29:48.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.181+0000 7f843c946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:48.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.181+0000 7f843c946800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.181+0000 7f843c946800 1 --2- 172.21.15.170:0/2686216603 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b1cec750b0 0x55b1cec774a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.181+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec77be0 con 0x55b1cec750b0 2024-09-12T17:29:48.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.182+0000 7f843ac38640 1 --2- 172.21.15.170:0/2686216603 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b1cec750b0 0x55b1cec774a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.182+0000 7f843ac38640 1 --2- 172.21.15.170:0/2686216603 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b1cec750b0 0x55b1cec774a0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.182+0000 7f843ac38640 1 -- 172.21.15.170:0/2686216603 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8434038020 con 0x55b1cec750b0 2024-09-12T17:29:48.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.182+0000 7f843c946800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:29:48.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.182+0000 7f843c946800 20 searching for the correct realm 2024-09-12T17:29:48.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.182+0000 7f843c946800 1 --2- 172.21.15.170:0/2686216603 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55b1cec79bb0 0x55b1cec7c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.182+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec7c740 con 0x55b1cec79bb0 2024-09-12T17:29:48.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.182+0000 7f843a437640 1 --2- 172.21.15.170:0/2686216603 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55b1cec79bb0 0x55b1cec7c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.182+0000 7f843a437640 1 --2- 172.21.15.170:0/2686216603 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55b1cec79bb0 0x55b1cec7c070 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.183+0000 7f843a437640 1 -- 172.21.15.170:0/2686216603 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f842c073030 con 0x55b1cec79bb0 2024-09-12T17:29:48.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.183+0000 7f843a437640 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec7c740 con 0x55b1cec750b0 2024-09-12T17:29:48.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.183+0000 7f843ac38640 1 -- 172.21.15.170:0/2686216603 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8434038020 con 0x55b1cec750b0 2024-09-12T17:29:48.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.183+0000 7f843ac38640 1 --2- 172.21.15.170:0/2686216603 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f8434045030 0x7f84340559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.183+0000 7f843ac38640 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec7c740 con 0x7f8434045030 2024-09-12T17:29:48.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.183+0000 7f8431c36640 1 --2- 172.21.15.170:0/2686216603 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f8434045030 0x7f84340559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.184+0000 7f8431c36640 1 --2- 172.21.15.170:0/2686216603 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f8434045030 0x7f84340559f0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.184+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8424009050 con 0x7f8434045030 2024-09-12T17:29:48.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.184+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec7c740 con 0x55b1cec706c0 2024-09-12T17:29:48.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.184+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8424009050 con 0x55b1cec706c0 2024-09-12T17:29:48.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.184+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec7c740 con 0x55b1cec706c0 2024-09-12T17:29:48.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.184+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8424029040 con 0x55b1cec706c0 2024-09-12T17:29:48.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.184+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec7c740 con 0x7f8434045030 2024-09-12T17:29:48.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.185+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8424029040 con 0x7f8434045030 2024-09-12T17:29:48.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.185+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec7c740 con 0x7f8434045030 2024-09-12T17:29:48.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.185+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8424029040 con 0x7f8434045030 2024-09-12T17:29:48.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.185+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec7c740 con 0x55b1cec750b0 2024-09-12T17:29:48.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.185+0000 7f843ac38640 1 -- 172.21.15.170:0/2686216603 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8434038020 con 0x55b1cec750b0 2024-09-12T17:29:48.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.185+0000 7f843ac38640 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec7c740 con 0x55b1cec79bb0 2024-09-12T17:29:48.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.185+0000 7f843a437640 1 -- 172.21.15.170:0/2686216603 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f842c073030 con 0x55b1cec79bb0 2024-09-12T17:29:48.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.185+0000 7f843a437640 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec7c740 con 0x55b1cec706c0 2024-09-12T17:29:48.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.186+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8424029040 con 0x55b1cec706c0 2024-09-12T17:29:48.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.186+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec7c740 con 0x7f8434045030 2024-09-12T17:29:48.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.186+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8424029040 con 0x7f8434045030 2024-09-12T17:29:48.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.186+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec7c740 con 0x55b1cec706c0 2024-09-12T17:29:48.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.186+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8424029040 con 0x55b1cec706c0 2024-09-12T17:29:48.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.186+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec7c740 con 0x55b1cec750b0 2024-09-12T17:29:48.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.187+0000 7f843ac38640 1 -- 172.21.15.170:0/2686216603 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f8434038020 con 0x55b1cec750b0 2024-09-12T17:29:48.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.187+0000 7f843ac38640 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec7c740 con 0x55b1cec79bb0 2024-09-12T17:29:48.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.187+0000 7f843a437640 1 -- 172.21.15.170:0/2686216603 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f842c073030 con 0x55b1cec79bb0 2024-09-12T17:29:48.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.187+0000 7f843a437640 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec7c740 con 0x55b1cec79bb0 2024-09-12T17:29:48.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.187+0000 7f843a437640 1 -- 172.21.15.170:0/2686216603 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f842c073030 con 0x55b1cec79bb0 2024-09-12T17:29:48.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.187+0000 7f843a437640 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec7c740 con 0x55b1cec750b0 2024-09-12T17:29:48.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.187+0000 7f843ac38640 1 -- 172.21.15.170:0/2686216603 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8434038020 con 0x55b1cec750b0 2024-09-12T17:29:48.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.187+0000 7f843ac38640 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec7c740 con 0x55b1cec79bb0 2024-09-12T17:29:48.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.187+0000 7f843a437640 1 -- 172.21.15.170:0/2686216603 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f842c073030 con 0x55b1cec79bb0 2024-09-12T17:29:48.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.187+0000 7f843a437640 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec7c740 con 0x55b1cec79bb0 2024-09-12T17:29:48.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.188+0000 7f843a437640 1 -- 172.21.15.170:0/2686216603 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f842c073030 con 0x55b1cec79bb0 2024-09-12T17:29:48.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.188+0000 7f843a437640 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec7c740 con 0x55b1cec706c0 2024-09-12T17:29:48.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.188+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8424029040 con 0x55b1cec706c0 2024-09-12T17:29:48.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.188+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec7c740 con 0x55b1cec706c0 2024-09-12T17:29:48.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.188+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v31'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8424029040 con 0x55b1cec706c0 2024-09-12T17:29:48.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.188+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec7c740 con 0x7f8434045030 2024-09-12T17:29:48.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.188+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8424029040 con 0x7f8434045030 2024-09-12T17:29:48.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.188+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec7c740 con 0x55b1cec79bb0 2024-09-12T17:29:48.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.189+0000 7f843a437640 1 -- 172.21.15.170:0/2686216603 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f842c073030 con 0x55b1cec79bb0 2024-09-12T17:29:48.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.189+0000 7f843a437640 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec7c740 con 0x55b1cec750b0 2024-09-12T17:29:48.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.189+0000 7f843ac38640 1 -- 172.21.15.170:0/2686216603 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8434038020 con 0x55b1cec750b0 2024-09-12T17:29:48.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.189+0000 7f843ac38640 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec7c740 con 0x55b1cec706c0 2024-09-12T17:29:48.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.189+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8424029040 con 0x55b1cec706c0 2024-09-12T17:29:48.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.189+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec7c740 con 0x7f8434045030 2024-09-12T17:29:48.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.189+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8424029040 con 0x7f8434045030 2024-09-12T17:29:48.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.189+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec7c740 con 0x55b1cec79bb0 2024-09-12T17:29:48.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.190+0000 7f843a437640 1 -- 172.21.15.170:0/2686216603 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f842c073030 con 0x55b1cec79bb0 2024-09-12T17:29:48.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.190+0000 7f843a437640 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec7c740 con 0x7f8434045030 2024-09-12T17:29:48.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.190+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8424029040 con 0x7f8434045030 2024-09-12T17:29:48.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.190+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec7c740 con 0x55b1cec750b0 2024-09-12T17:29:48.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.190+0000 7f843ac38640 1 -- 172.21.15.170:0/2686216603 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8434067040 con 0x55b1cec750b0 2024-09-12T17:29:48.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.190+0000 7f843ac38640 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec7c740 con 0x55b1cec79bb0 2024-09-12T17:29:48.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.190+0000 7f843a437640 1 -- 172.21.15.170:0/2686216603 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f842c073030 con 0x55b1cec79bb0 2024-09-12T17:29:48.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.190+0000 7f843a437640 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec7c740 con 0x7f8434045030 2024-09-12T17:29:48.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.191+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8424029040 con 0x7f8434045030 2024-09-12T17:29:48.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.191+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec7c740 con 0x55b1cec706c0 2024-09-12T17:29:48.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.191+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8424029040 con 0x55b1cec706c0 2024-09-12T17:29:48.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.191+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec7c740 con 0x55b1cec750b0 2024-09-12T17:29:48.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.191+0000 7f843ac38640 1 -- 172.21.15.170:0/2686216603 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(37 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8434067040 con 0x55b1cec750b0 2024-09-12T17:29:48.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.191+0000 7f843c946800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:29:48.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.191+0000 7f843c946800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:29:48.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.191+0000 7f843c946800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:29:48.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.191+0000 7f843c946800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:29:48.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.191+0000 7f843c946800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:29:48.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.191+0000 7f843c946800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:29:48.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.191+0000 7f843c946800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.191+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec785a0 con 0x55b1cec706c0 2024-09-12T17:29:48.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.191+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8424029040 con 0x55b1cec706c0 2024-09-12T17:29:48.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.191+0000 7f843c946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.191+0000 7f843c946800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.191+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec781e0 con 0x55b1cec706c0 2024-09-12T17:29:48.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.191+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8424029040 con 0x55b1cec706c0 2024-09-12T17:29:48.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.191+0000 7f843c946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:48.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.192+0000 7f843c946800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.192+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec78f80 con 0x55b1cec750b0 2024-09-12T17:29:48.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.192+0000 7f843ac38640 1 -- 172.21.15.170:0/2686216603 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8434067040 con 0x55b1cec750b0 2024-09-12T17:29:48.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.192+0000 7f843c946800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:29:48.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.192+0000 7f843c946800 20 zone default found 2024-09-12T17:29:48.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.192+0000 7f843c946800 4 Realm: () 2024-09-12T17:29:48.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.192+0000 7f843c946800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:29:48.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.192+0000 7f843c946800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:29:48.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.192+0000 7f843c946800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:29:48.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.192+0000 7f843c946800 20 zonegroup default 2024-09-12T17:29:48.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.192+0000 7f843c946800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.192+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec7d070 con 0x7f8434045030 2024-09-12T17:29:48.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.192+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8424029040 con 0x7f8434045030 2024-09-12T17:29:48.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.192+0000 7f843c946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.192+0000 7f843c946800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.192+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec7f2b0 con 0x55b1cec79bb0 2024-09-12T17:29:48.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.192+0000 7f843a437640 1 -- 172.21.15.170:0/2686216603 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f842c073030 con 0x55b1cec79bb0 2024-09-12T17:29:48.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.192+0000 7f843c946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.192+0000 7f843c946800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.192+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec7f650 con 0x55b1cec79bb0 2024-09-12T17:29:48.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.193+0000 7f843a437640 1 -- 172.21.15.170:0/2686216603 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f842c073030 con 0x55b1cec79bb0 2024-09-12T17:29:48.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.193+0000 7f843c946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.193+0000 7f843c946800 20 started sync module instance, tier type = 2024-09-12T17:29:48.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.193+0000 7f843c946800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:29:48.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.193+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec7e740 con 0x55b1cec750b0 2024-09-12T17:29:48.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.194+0000 7f843ac38640 1 -- 172.21.15.170:0/2686216603 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(44 notify.0 [create] v31'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8434067040 con 0x55b1cec750b0 2024-09-12T17:29:48.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.194+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94222166780720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec7e3a0 con 0x55b1cec750b0 2024-09-12T17:29:48.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.194+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec804c0 con 0x55b1cec706c0 2024-09-12T17:29:48.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.195+0000 7f843ac38640 1 -- 172.21.15.170:0/2686216603 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94222166780720] v31'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8434067040 con 0x55b1cec750b0 2024-09-12T17:29:48.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.195+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v31'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8424029040 con 0x55b1cec706c0 2024-09-12T17:29:48.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.195+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94222166784496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec804c0 con 0x55b1cec706c0 2024-09-12T17:29:48.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.195+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec80ec0 con 0x55b1cec79bb0 2024-09-12T17:29:48.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.196+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94222166784496] v31'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8424029040 con 0x55b1cec706c0 2024-09-12T17:29:48.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.197+0000 7f843a437640 1 -- 172.21.15.170:0/2686216603 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v31'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f842c073030 con 0x55b1cec79bb0 2024-09-12T17:29:48.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.197+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94222166786064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec80430 con 0x55b1cec79bb0 2024-09-12T17:29:48.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.197+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec81d80 con 0x55b1cec750b0 2024-09-12T17:29:48.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.198+0000 7f843a437640 1 -- 172.21.15.170:0/2686216603 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94222166786064] v31'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f842c073030 con 0x55b1cec79bb0 2024-09-12T17:29:48.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.198+0000 7f843ac38640 1 -- 172.21.15.170:0/2686216603 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(50 notify.3 [create] v31'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8434067040 con 0x55b1cec750b0 2024-09-12T17:29:48.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.198+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94222166792400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec81cf0 con 0x55b1cec750b0 2024-09-12T17:29:48.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.198+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec82c40 con 0x55b1cec706c0 2024-09-12T17:29:48.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.199+0000 7f843ac38640 1 -- 172.21.15.170:0/2686216603 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94222166792400] v31'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8434067040 con 0x55b1cec750b0 2024-09-12T17:29:48.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.199+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v31'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8424029040 con 0x55b1cec706c0 2024-09-12T17:29:48.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.199+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94222166794608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec82c40 con 0x55b1cec706c0 2024-09-12T17:29:48.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.199+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec83600 con 0x7f8434045030 2024-09-12T17:29:48.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.200+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94222166794608] v31'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8424029040 con 0x55b1cec706c0 2024-09-12T17:29:48.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.200+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(54 notify.5 [create] v31'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8424029040 con 0x7f8434045030 2024-09-12T17:29:48.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.200+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94222166799152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec82c40 con 0x7f8434045030 2024-09-12T17:29:48.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.200+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec84010 con 0x7f8434045030 2024-09-12T17:29:48.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.201+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94222166799152] v31'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8424029040 con 0x7f8434045030 2024-09-12T17:29:48.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.201+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v31'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8424029040 con 0x7f8434045030 2024-09-12T17:29:48.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.201+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94222166796176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec841f0 con 0x7f8434045030 2024-09-12T17:29:48.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.201+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec84a40 con 0x7f8434045030 2024-09-12T17:29:48.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.202+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94222166796176] v31'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8424029040 con 0x7f8434045030 2024-09-12T17:29:48.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.202+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(58 notify.7 [create] v31'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8424029040 con 0x7f8434045030 2024-09-12T17:29:48.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.202+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94222166802208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec84850 con 0x7f8434045030 2024-09-12T17:29:48.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.202+0000 7f843c946800 20 add_watcher() i=0 2024-09-12T17:29:48.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.202+0000 7f843c946800 20 add_watcher() i=1 2024-09-12T17:29:48.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.202+0000 7f843c946800 20 add_watcher() i=2 2024-09-12T17:29:48.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.202+0000 7f843c946800 20 add_watcher() i=3 2024-09-12T17:29:48.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.202+0000 7f843c946800 20 add_watcher() i=4 2024-09-12T17:29:48.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.202+0000 7f843c946800 20 add_watcher() i=5 2024-09-12T17:29:48.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.202+0000 7f843c946800 20 add_watcher() i=6 2024-09-12T17:29:48.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.203+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94222166802208] v31'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8424029040 con 0x7f8434045030 2024-09-12T17:29:48.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.203+0000 7f843c946800 20 add_watcher() i=7 2024-09-12T17:29:48.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.203+0000 7f843c946800 2 all 8 watchers are set, enabling cache 2024-09-12T17:29:48.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.203+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec87dc0 con 0x55b1cec706c0 2024-09-12T17:29:48.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.203+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8424029040 con 0x55b1cec706c0 2024-09-12T17:29:48.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.204+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94222166803264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec85280 con 0x55b1cec706c0 2024-09-12T17:29:48.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.204+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94222166803264] v31'264 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8424029040 con 0x55b1cec706c0 2024-09-12T17:29:48.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.205+0000 7f82f0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:48.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.205+0000 7f843c946800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:29:48.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.205+0000 7f843c946800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:29:48.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.205+0000 7f843c946800 5 note: GC not initialized 2024-09-12T17:29:48.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.205+0000 7f826b7fe640 20 reqs_thread_entry: start 2024-09-12T17:29:48.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.205+0000 7f843c946800 20 init_complete bucket index max shards: 11 2024-09-12T17:29:48.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.205+0000 7f843c946800 20 Filter name: none 2024-09-12T17:29:48.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.205+0000 7f82697fa640 20 reqs_thread_entry: start 2024-09-12T17:29:48.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.205+0000 7f843c946800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-12T17:29:48.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.205+0000 7f843c946800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.205+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b1cecbaf10 con 0x7f8434045030 2024-09-12T17:29:48.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.206+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(62 ada [call out=48b,read 0~503 out=503b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+626 (crc 0 0 0) 0x7f8424029040 con 0x7f8434045030 2024-09-12T17:29:48.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.206+0000 7f843c946800 20 rados_obj.operate() r=0 bl.length=503 2024-09-12T17:29:48.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.206+0000 7f843c946800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-12T17:29:48.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.206+0000 7f843c946800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:29:48.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.206+0000 7f843c946800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:29:48.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.206+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b1cecc16e0 con 0x7f8434045030 2024-09-12T17:29:48.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.207+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v31'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f8424029040 con 0x7f8434045030 2024-09-12T17:29:48.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.207+0000 7f843c946800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T17:29:48.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.207+0000 7f843c946800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:29:48.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.207+0000 7f843c946800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-12T17:29:48.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.207+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94222167052544 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b1cecbce00 con 0x55b1cec706c0 2024-09-12T17:29:48.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.208+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== watch-notify(notify (1) cookie 94222166794608 notify 133143986203 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7f8428001e10 con 0x55b1cec706c0 2024-09-12T17:29:48.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.208+0000 7f831dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986203 cookie 94222166794608 notifier 4890 bl.length()=636 2024-09-12T17:29:48.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.208+0000 7f831dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T17:29:48.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.208+0000 7f831dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:29:48.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.208+0000 7f831dffb640 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f8300003ea0 con 0x55b1cec706c0 2024-09-12T17:29:48.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.208+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(64 notify.4 [notify cookie 94222167052544 out=8b] v0'0 uv267 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8424029040 con 0x55b1cec706c0 2024-09-12T17:29:48.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.208+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8424029040 con 0x55b1cec706c0 2024-09-12T17:29:48.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.208+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== watch-notify(notify_complete (2) cookie 94222167052544 notify 133143986203 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f842402f760 con 0x55b1cec706c0 2024-09-12T17:29:48.224 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-12T17:29:46.782056Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:29:46.782042Z","tags":[],"group_ids":[]} 2024-09-12T17:29:48.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.209+0000 7f82f0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:48.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.209+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94222166803264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b1cecb8d30 con 0x55b1cec706c0 2024-09-12T17:29:48.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.210+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94222166803264] v31'265 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8424029040 con 0x55b1cec706c0 2024-09-12T17:29:48.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.210+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94222166780720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b1cecb8d30 con 0x55b1cec750b0 2024-09-12T17:29:48.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.211+0000 7f843ac38640 1 -- 172.21.15.170:0/2686216603 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94222166780720] v31'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8434067040 con 0x55b1cec750b0 2024-09-12T17:29:48.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.211+0000 7f843c946800 20 remove_watcher() i=0 2024-09-12T17:29:48.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.211+0000 7f843c946800 2 removed watcher, disabling cache 2024-09-12T17:29:48.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.211+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94222166784496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b1cecb8d30 con 0x55b1cec706c0 2024-09-12T17:29:48.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.212+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94222166784496] v31'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8424029040 con 0x55b1cec706c0 2024-09-12T17:29:48.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.212+0000 7f843c946800 20 remove_watcher() i=1 2024-09-12T17:29:48.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.212+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94222166786064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b1cecb8d30 con 0x55b1cec79bb0 2024-09-12T17:29:48.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.213+0000 7f843a437640 1 -- 172.21.15.170:0/2686216603 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94222166786064] v31'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f842c073030 con 0x55b1cec79bb0 2024-09-12T17:29:48.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.213+0000 7f843c946800 20 remove_watcher() i=2 2024-09-12T17:29:48.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.213+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94222166792400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec7eb30 con 0x55b1cec750b0 2024-09-12T17:29:48.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.214+0000 7f843ac38640 1 -- 172.21.15.170:0/2686216603 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94222166792400] v31'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8434067040 con 0x55b1cec750b0 2024-09-12T17:29:48.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.214+0000 7f843c946800 20 remove_watcher() i=3 2024-09-12T17:29:48.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.214+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94222166794608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec80010 con 0x55b1cec706c0 2024-09-12T17:29:48.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.215+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94222166794608] v31'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8424029040 con 0x55b1cec706c0 2024-09-12T17:29:48.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.215+0000 7f843c946800 20 remove_watcher() i=4 2024-09-12T17:29:48.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.215+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94222166799152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec818d0 con 0x7f8434045030 2024-09-12T17:29:48.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.216+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94222166799152] v31'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8424029040 con 0x7f8434045030 2024-09-12T17:29:48.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.216+0000 7f843c946800 20 remove_watcher() i=5 2024-09-12T17:29:48.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.216+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94222166796176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec7eb30 con 0x7f8434045030 2024-09-12T17:29:48.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.217+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94222166796176] v31'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8424029040 con 0x7f8434045030 2024-09-12T17:29:48.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.217+0000 7f843c946800 20 remove_watcher() i=6 2024-09-12T17:29:48.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.217+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94222166802208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b1cec80010 con 0x7f8434045030 2024-09-12T17:29:48.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.218+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94222166802208] v31'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8424029040 con 0x7f8434045030 2024-09-12T17:29:48.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.218+0000 7f843c946800 20 remove_watcher() i=7 2024-09-12T17:29:48.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.218+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f8434045030 msgr2=0x7f84340559f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.218+0000 7f843c946800 1 --2- 172.21.15.170:0/2686216603 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f8434045030 0x7f84340559f0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.218+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b1cec706c0 msgr2=0x55b1cec72b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.218+0000 7f843c946800 1 --2- 172.21.15.170:0/2686216603 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b1cec706c0 0x55b1cec72b80 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.218+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b1cec750b0 msgr2=0x55b1cec774a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.218+0000 7f843c946800 1 --2- 172.21.15.170:0/2686216603 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b1cec750b0 0x55b1cec774a0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.218+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55b1cec79bb0 msgr2=0x55b1cec7c070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.218+0000 7f843c946800 1 --2- 172.21.15.170:0/2686216603 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55b1cec79bb0 0x55b1cec7c070 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.218+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f830403c730 msgr2=0x7f830403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.218+0000 7f843c946800 1 --2- 172.21.15.170:0/2686216603 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f830403c730 0x7f830403ebf0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f842c075550 tx=0x7f842c078420 comp rx=0 tx=0).stop 2024-09-12T17:29:48.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.218+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1cec5d780 msgr2=0x55b1cec64d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.218+0000 7f843c946800 1 --2- 172.21.15.170:0/2686216603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1cec5d780 0x55b1cec64d40 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f84340208e0 tx=0x7f8434053cc0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.218+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 reap_dead start 2024-09-12T17:29:48.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.218+0000 7f8431c36640 1 -- 172.21.15.170:0/2686216603 reap_dead start 2024-09-12T17:29:48.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.218+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 shutdown_connections 2024-09-12T17:29:48.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.218+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 >> 172.21.15.170:0/2686216603 conn(0x55b1cec59b80 msgr2=0x55b1cec57d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:48.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.218+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 shutdown_connections 2024-09-12T17:29:48.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.218+0000 7f843c946800 1 -- 172.21.15.170:0/2686216603 wait complete. 2024-09-12T17:29:48.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.218+0000 7f843c946800 1 -- 172.21.15.170:0/2995488861 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f831403c780 msgr2=0x7f831403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.218+0000 7f843c946800 1 --2- 172.21.15.170:0/2995488861 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f831403c780 0x7f831403ec40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x55b1cec37ed0 tx=0x7f842c093040 comp rx=0 tx=0).stop 2024-09-12T17:29:48.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.218+0000 7f843c946800 1 -- 172.21.15.170:0/2995488861 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1cec50ca0 msgr2=0x55b1cec510c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.218+0000 7f843c946800 1 --2- 172.21.15.170:0/2995488861 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1cec50ca0 0x55b1cec510c0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x55b1cec36e00 tx=0x7f84340167b0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.218+0000 7f843c946800 1 -- 172.21.15.170:0/2995488861 shutdown_connections 2024-09-12T17:29:48.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.218+0000 7f843c946800 1 --2- 172.21.15.170:0/2995488861 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f831403c780 0x7f831403ec40 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.219+0000 7f843c946800 1 --2- 172.21.15.170:0/2995488861 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1cec50ca0 0x55b1cec510c0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.219+0000 7f843c946800 1 -- 172.21.15.170:0/2995488861 >> 172.21.15.170:0/2995488861 conn(0x55b1cec45050 msgr2=0x55b1cec45430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:48.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.219+0000 7f843c946800 1 -- 172.21.15.170:0/2995488861 shutdown_connections 2024-09-12T17:29:48.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.219+0000 7f843c946800 1 -- 172.21.15.170:0/2995488861 wait complete. 2024-09-12T17:29:48.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.219+0000 7f843c946800 1 -- 172.21.15.170:0/817074257 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b1ceb3f040 msgr2=0x55b1cec3d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.219+0000 7f843c946800 1 --2- 172.21.15.170:0/817074257 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b1ceb3f040 0x55b1cec3d450 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.219+0000 7f843c946800 1 -- 172.21.15.170:0/817074257 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b1cec3f7f0 msgr2=0x55b1cec41c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.219+0000 7f843c946800 1 --2- 172.21.15.170:0/817074257 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b1cec3f7f0 0x55b1cec41c60 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.219+0000 7f843c946800 1 -- 172.21.15.170:0/817074257 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f832003c780 msgr2=0x7f832003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.219+0000 7f843c946800 1 --2- 172.21.15.170:0/817074257 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f832003c780 0x7f832003ec40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8424001db0 tx=0x7f8424001310 comp rx=0 tx=0).stop 2024-09-12T17:29:48.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.219+0000 7f843c946800 1 -- 172.21.15.170:0/817074257 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1ceb3de00 msgr2=0x55b1cec35e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.219+0000 7f843c946800 1 --2- 172.21.15.170:0/817074257 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1ceb3de00 0x55b1cec35e00 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f842c025b20 tx=0x7f842c002fb0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.219+0000 7f843c946800 1 -- 172.21.15.170:0/817074257 shutdown_connections 2024-09-12T17:29:48.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.219+0000 7f843c946800 1 --2- 172.21.15.170:0/817074257 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55b1cec3f7f0 0x55b1cec41c60 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.219+0000 7f843c946800 1 --2- 172.21.15.170:0/817074257 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f832003c780 0x7f832003ec40 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.219+0000 7f843c946800 1 --2- 172.21.15.170:0/817074257 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55b1ceb3f040 0x55b1cec3d450 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.219+0000 7f843c946800 1 --2- 172.21.15.170:0/817074257 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1ceb3de00 0x55b1cec35e00 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.219+0000 7f843c946800 1 -- 172.21.15.170:0/817074257 >> 172.21.15.170:0/817074257 conn(0x55b1ceb391d0 msgr2=0x55b1cec2f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:48.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.219+0000 7f843c946800 1 -- 172.21.15.170:0/817074257 shutdown_connections 2024-09-12T17:29:48.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.219+0000 7f843c946800 1 -- 172.21.15.170:0/817074257 wait complete. 2024-09-12T17:29:48.236 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T17:29:46.782056Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:29:46.782042Z', 'tags': [], 'group_ids': []} 2024-09-12T17:29:48.236 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T17:29:46.782056Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:29:46.782042Z', 'tags': [], 'group_ids': []} 2024-09-12T17:29:48.236 ERROR:root:0 2024-09-12T17:29:48.236 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-12T17:29:48.236 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-12T17:29:48.236 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=write 2024-09-12T17:29:48.283 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:29:48.283 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:29:48.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.282+0000 7f77efd1f800 1 Processor -- start 2024-09-12T17:29:48.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.282+0000 7f77efd1f800 1 -- start start 2024-09-12T17:29:48.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.283+0000 7f77efd1f800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55f5b7cbc210 0x55f5b7cbe6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.283+0000 7f77efd1f800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f5b7b61e40 con 0x55f5b7cb86a0 2024-09-12T17:29:48.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.283+0000 7f77efd1f800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x55f5b7b2c680 con 0x55f5b7cbc210 2024-09-12T17:29:48.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.283+0000 7f77e32a1640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55f5b7cbc210 0x55f5b7cbe6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.283+0000 7f77ebaa2640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x55f5b7cb86a0 0x55f5b7cbaa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:44958/0 (socket says 172.21.15.170:44958) 2024-09-12T17:29:48.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.283+0000 7f77e32a1640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55f5b7cbc210 0x55f5b7cbe6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35338/0 (socket says 172.21.15.170:35338) 2024-09-12T17:29:48.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.283+0000 7f77ebaa2640 1 -- 172.21.15.170:0/372898942 learned_addr learned my addr 172.21.15.170:0/372898942 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:29:48.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.283+0000 7f77e32a1640 1 -- 172.21.15.170:0/372898942 >> v1:172.21.15.47:6789/0 conn(0x55f5b7cb86a0 legacy=0x55f5b7cbaa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.283+0000 7f77e32a1640 1 -- 172.21.15.170:0/372898942 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5b7b486b0 con 0x55f5b7cbc210 2024-09-12T17:29:48.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.283+0000 7f77eb2a1640 1 -- 172.21.15.170:0/372898942 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2992424472 0 0) 0x55f5b7b61e40 con 0x55f5b7cb86a0 2024-09-12T17:29:48.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.285+0000 7f77e32a1640 1 --2- 172.21.15.170:0/372898942 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f5b7cbc210 0x55f5b7cbe6d0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f77d400a470 tx=0x7f77d4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fcaddcd8026b55a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.285+0000 7f77eb2a1640 1 -- 172.21.15.170:0/372898942 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77d4053570 con 0x55f5b7cbc210 2024-09-12T17:29:48.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.285+0000 7f77eb2a1640 1 -- 172.21.15.170:0/372898942 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77d4058070 con 0x55f5b7cbc210 2024-09-12T17:29:48.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.285+0000 7f77eb2a1640 1 -- 172.21.15.170:0/372898942 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77d4053880 con 0x55f5b7cbc210 2024-09-12T17:29:48.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.286+0000 7f77efd1f800 1 -- 172.21.15.170:0/372898942 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f5b7cbc210 msgr2=0x55f5b7cbe6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.286+0000 7f77efd1f800 1 --2- 172.21.15.170:0/372898942 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f5b7cbc210 0x55f5b7cbe6d0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f77d400a470 tx=0x7f77d4045a20 comp rx=0 tx=0).stop 2024-09-12T17:29:48.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.286+0000 7f77efd1f800 1 -- 172.21.15.170:0/372898942 shutdown_connections 2024-09-12T17:29:48.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.286+0000 7f77efd1f800 1 --2- 172.21.15.170:0/372898942 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f5b7cbc210 0x55f5b7cbe6d0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.286+0000 7f77efd1f800 1 -- 172.21.15.170:0/372898942 >> 172.21.15.170:0/372898942 conn(0x55f5b7cb2200 msgr2=0x55f5b7cb4640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:48.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.286+0000 7f77efd1f800 1 -- 172.21.15.170:0/372898942 shutdown_connections 2024-09-12T17:29:48.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.286+0000 7f77efd1f800 1 -- 172.21.15.170:0/372898942 wait complete. 2024-09-12T17:29:48.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.299+0000 7f77efd1f800 1 Processor -- start 2024-09-12T17:29:48.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.300+0000 7f77efd1f800 1 -- start start 2024-09-12T17:29:48.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.300+0000 7f77efd1f800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f5b7cb86a0 0x55f5b7da74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.300+0000 7f77efd1f800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f5b7b50dd0 con 0x55f5b7cb86a0 2024-09-12T17:29:48.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.300+0000 7f77ebaa2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f5b7cb86a0 0x55f5b7da74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.300+0000 7f77ebaa2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f5b7cb86a0 0x55f5b7da74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35344/0 (socket says 172.21.15.170:35344) 2024-09-12T17:29:48.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.300+0000 7f77ebaa2640 1 -- 172.21.15.170:0/4186049174 learned_addr learned my addr 172.21.15.170:0/4186049174 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:48.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.300+0000 7f77ebaa2640 1 -- 172.21.15.170:0/4186049174 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5b7b69e10 con 0x55f5b7cb86a0 2024-09-12T17:29:48.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.301+0000 7f77ebaa2640 1 --2- 172.21.15.170:0/4186049174 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f5b7cb86a0 0x55f5b7da74f0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f77dc001ea0 tx=0x7f77dc00b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e160c573ab11ac7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.301+0000 7f76d9e0b640 1 -- 172.21.15.170:0/4186049174 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77dc008070 con 0x55f5b7cb86a0 2024-09-12T17:29:48.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.301+0000 7f76d9e0b640 1 -- 172.21.15.170:0/4186049174 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77dc00d500 con 0x55f5b7cb86a0 2024-09-12T17:29:48.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.301+0000 7f76d9e0b640 1 -- 172.21.15.170:0/4186049174 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77dc00d880 con 0x55f5b7cb86a0 2024-09-12T17:29:48.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.302+0000 7f77efd1f800 1 -- 172.21.15.170:0/4186049174 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f5b7cb86a0 msgr2=0x55f5b7da74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.302+0000 7f77efd1f800 1 --2- 172.21.15.170:0/4186049174 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f5b7cb86a0 0x55f5b7da74f0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f77dc001ea0 tx=0x7f77dc00b6a0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.302+0000 7f77efd1f800 1 -- 172.21.15.170:0/4186049174 shutdown_connections 2024-09-12T17:29:48.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.302+0000 7f77efd1f800 1 --2- 172.21.15.170:0/4186049174 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f5b7cb86a0 0x55f5b7da74f0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.302+0000 7f77efd1f800 1 -- 172.21.15.170:0/4186049174 >> 172.21.15.170:0/4186049174 conn(0x55f5b7cb2200 msgr2=0x55f5b7da2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:48.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.302+0000 7f77efd1f800 1 -- 172.21.15.170:0/4186049174 shutdown_connections 2024-09-12T17:29:48.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.302+0000 7f77efd1f800 1 -- 172.21.15.170:0/4186049174 wait complete. 2024-09-12T17:29:48.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.302+0000 7f77efd1f800 1 Processor -- start 2024-09-12T17:29:48.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.302+0000 7f77efd1f800 1 -- start start 2024-09-12T17:29:48.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.302+0000 7f77efd1f800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f5b7cb86a0 0x55f5b7daee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.302+0000 7f77efd1f800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f5b7cbf050 con 0x55f5b7cb86a0 2024-09-12T17:29:48.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.303+0000 7f77ebaa2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f5b7cb86a0 0x55f5b7daee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.303+0000 7f77ebaa2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f5b7cb86a0 0x55f5b7daee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35346/0 (socket says 172.21.15.170:35346) 2024-09-12T17:29:48.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.303+0000 7f77ebaa2640 1 -- 172.21.15.170:0/571334162 learned_addr learned my addr 172.21.15.170:0/571334162 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:48.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.303+0000 7f77ebaa2640 1 -- 172.21.15.170:0/571334162 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5b7daf3a0 con 0x55f5b7cb86a0 2024-09-12T17:29:48.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.303+0000 7f77ebaa2640 1 --2- 172.21.15.170:0/571334162 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f5b7cb86a0 0x55f5b7daee40 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f77dc0012f0 tx=0x7f77dc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.303+0000 7f76d3fff640 1 -- 172.21.15.170:0/571334162 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77dc00f9d0 con 0x55f5b7cb86a0 2024-09-12T17:29:48.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.303+0000 7f76d3fff640 1 -- 172.21.15.170:0/571334162 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77dc00fb70 con 0x55f5b7cb86a0 2024-09-12T17:29:48.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.303+0000 7f76d3fff640 1 -- 172.21.15.170:0/571334162 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77dc00fe50 con 0x55f5b7cb86a0 2024-09-12T17:29:48.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.303+0000 7f77efd1f800 1 -- 172.21.15.170:0/571334162 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f5b7daf630 con 0x55f5b7cb86a0 2024-09-12T17:29:48.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.303+0000 7f77efd1f800 1 -- 172.21.15.170:0/571334162 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5b7db0030 con 0x55f5b7cb86a0 2024-09-12T17:29:48.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.304+0000 7f76d3fff640 1 -- 172.21.15.170:0/571334162 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f77dc017040 con 0x55f5b7cb86a0 2024-09-12T17:29:48.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.304+0000 7f76d3fff640 1 --2- 172.21.15.170:0/571334162 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f76d403c920 0x7f76d403ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.304+0000 7f76d3fff640 1 -- 172.21.15.170:0/571334162 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f77dc015020 con 0x55f5b7cb86a0 2024-09-12T17:29:48.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.304+0000 7f77e32a1640 1 --2- 172.21.15.170:0/571334162 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f76d403c920 0x7f76d403ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.305+0000 7f77efd1f800 1 --2- 172.21.15.170:0/571334162 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55f5b7cbc210 0x55f5b7db6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.305+0000 7f77efd1f800 1 -- 172.21.15.170:0/571334162 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7db69d0 con 0x55f5b7cbc210 2024-09-12T17:29:48.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.305+0000 7f77ec2a3640 1 --2- 172.21.15.170:0/571334162 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55f5b7cbc210 0x55f5b7db6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.305+0000 7f77e32a1640 1 --2- 172.21.15.170:0/571334162 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f76d403c920 0x7f76d403ede0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f77d4057000 tx=0x7f77d4052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.305+0000 7f77ec2a3640 1 --2- 172.21.15.170:0/571334162 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55f5b7cbc210 0x55f5b7db6490 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.305+0000 7f77ec2a3640 1 -- 172.21.15.170:0/571334162 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77e400a4d0 con 0x55f5b7cbc210 2024-09-12T17:29:48.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.305+0000 7f77efd1f800 1 -- 172.21.15.170:0/571334162 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7db6d70 con 0x55f5b7cbc210 2024-09-12T17:29:48.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.306+0000 7f77ec2a3640 1 -- 172.21.15.170:0/571334162 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f77e400a4d0 con 0x55f5b7cbc210 2024-09-12T17:29:48.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.306+0000 7f77efd1f800 1 --2- 172.21.15.170:0/571334162 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55f5b7db8870 0x55f5b7dbacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.306+0000 7f77efd1f800 1 -- 172.21.15.170:0/571334162 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7dbb480 con 0x55f5b7db8870 2024-09-12T17:29:48.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.306+0000 7f77ebaa2640 1 --2- 172.21.15.170:0/571334162 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55f5b7db8870 0x55f5b7dbacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.306+0000 7f77ebaa2640 1 --2- 172.21.15.170:0/571334162 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55f5b7db8870 0x55f5b7dbacf0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.306+0000 7f77ebaa2640 1 -- 172.21.15.170:0/571334162 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f77dc02d070 con 0x55f5b7db8870 2024-09-12T17:29:48.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.306+0000 7f77efd1f800 1 -- 172.21.15.170:0/571334162 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7db75c0 con 0x55f5b7cbc210 2024-09-12T17:29:48.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.306+0000 7f77ec2a3640 1 -- 172.21.15.170:0/571334162 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f77e400a4d0 con 0x55f5b7cbc210 2024-09-12T17:29:48.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.306+0000 7f77efd1f800 1 -- 172.21.15.170:0/571334162 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7db7a10 con 0x55f5b7db8870 2024-09-12T17:29:48.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.307+0000 7f77ebaa2640 1 -- 172.21.15.170:0/571334162 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f77dc02d070 con 0x55f5b7db8870 2024-09-12T17:29:48.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.307+0000 7f77efd1f800 1 Processor -- start 2024-09-12T17:29:48.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.307+0000 7f77efd1f800 1 -- start start 2024-09-12T17:29:48.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.307+0000 7f77efd1f800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f5b7dc9d10 0x55f5b7dca130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.307+0000 7f77efd1f800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f5b7baea00 con 0x55f5b7dc9d10 2024-09-12T17:29:48.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.308+0000 7f77ec2a3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f5b7dc9d10 0x55f5b7dca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.308+0000 7f77ec2a3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f5b7dc9d10 0x55f5b7dca130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35348/0 (socket says 172.21.15.170:35348) 2024-09-12T17:29:48.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.308+0000 7f77ec2a3640 1 -- 172.21.15.170:0/6412579 learned_addr learned my addr 172.21.15.170:0/6412579 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:48.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.308+0000 7f77ec2a3640 1 -- 172.21.15.170:0/6412579 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5b7dca770 con 0x55f5b7dc9d10 2024-09-12T17:29:48.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.308+0000 7f77ec2a3640 1 --2- 172.21.15.170:0/6412579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f5b7dc9d10 0x55f5b7dca130 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x55f5b7dafe40 tx=0x7f77e40167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.308+0000 7f76d17fa640 1 -- 172.21.15.170:0/6412579 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77e4013640 con 0x55f5b7dc9d10 2024-09-12T17:29:48.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.308+0000 7f76d17fa640 1 -- 172.21.15.170:0/6412579 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77e40137e0 con 0x55f5b7dc9d10 2024-09-12T17:29:48.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.308+0000 7f77efd1f800 1 -- 172.21.15.170:0/6412579 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f5b7dcafa0 con 0x55f5b7dc9d10 2024-09-12T17:29:48.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.308+0000 7f76d17fa640 1 -- 172.21.15.170:0/6412579 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77e4013ae0 con 0x55f5b7dc9d10 2024-09-12T17:29:48.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.308+0000 7f77efd1f800 1 -- 172.21.15.170:0/6412579 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5b7dcb540 con 0x55f5b7dc9d10 2024-09-12T17:29:48.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.309+0000 7f76d17fa640 1 -- 172.21.15.170:0/6412579 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f77e4011040 con 0x55f5b7dc9d10 2024-09-12T17:29:48.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.309+0000 7f76d17fa640 1 --2- 172.21.15.170:0/6412579 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f76c403c780 0x7f76c403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.309+0000 7f76d17fa640 1 -- 172.21.15.170:0/6412579 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f77e400e040 con 0x55f5b7dc9d10 2024-09-12T17:29:48.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.309+0000 7f77ebaa2640 1 --2- 172.21.15.170:0/6412579 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f76c403c780 0x7f76c403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.310+0000 7f77efd1f800 1 Processor -- start 2024-09-12T17:29:48.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.310+0000 7f77ebaa2640 1 --2- 172.21.15.170:0/6412579 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f76c403c780 0x7f76c403ec40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f77dc052740 tx=0x7f77dc054110 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.310+0000 7f77efd1f800 1 -- start start 2024-09-12T17:29:48.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.310+0000 7f77efd1f800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f5b7dd6770 0x55f5b7dd6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.310+0000 7f77efd1f800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f5b7da7d40 con 0x55f5b7dd6770 2024-09-12T17:29:48.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.310+0000 7f77ec2a3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f5b7dd6770 0x55f5b7dd6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.310+0000 7f77ec2a3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f5b7dd6770 0x55f5b7dd6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35358/0 (socket says 172.21.15.170:35358) 2024-09-12T17:29:48.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.310+0000 7f77ec2a3640 1 -- 172.21.15.170:0/177762250 learned_addr learned my addr 172.21.15.170:0/177762250 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:48.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.310+0000 7f77ec2a3640 1 -- 172.21.15.170:0/177762250 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5b7dd7160 con 0x55f5b7dd6770 2024-09-12T17:29:48.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.311+0000 7f77ec2a3640 1 --2- 172.21.15.170:0/177762250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f5b7dd6770 0x55f5b7dd6b70 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f77e4053d00 tx=0x7f77e401fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b84d2101be325ad1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.311+0000 7f76caffd640 1 -- 172.21.15.170:0/177762250 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77e4021910 con 0x55f5b7dd6770 2024-09-12T17:29:48.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.311+0000 7f76caffd640 1 -- 172.21.15.170:0/177762250 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77e4021440 con 0x55f5b7dd6770 2024-09-12T17:29:48.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.311+0000 7f76caffd640 1 -- 172.21.15.170:0/177762250 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77e4021ab0 con 0x55f5b7dd6770 2024-09-12T17:29:48.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.311+0000 7f77efd1f800 1 -- 172.21.15.170:0/177762250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f5b7dd6770 msgr2=0x55f5b7dd6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.311+0000 7f77efd1f800 1 --2- 172.21.15.170:0/177762250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f5b7dd6770 0x55f5b7dd6b70 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f77e4053d00 tx=0x7f77e401fc80 comp rx=0 tx=0).stop 2024-09-12T17:29:48.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.311+0000 7f77efd1f800 1 -- 172.21.15.170:0/177762250 shutdown_connections 2024-09-12T17:29:48.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.311+0000 7f77efd1f800 1 --2- 172.21.15.170:0/177762250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f5b7dd6770 0x55f5b7dd6b70 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.311+0000 7f77efd1f800 1 -- 172.21.15.170:0/177762250 >> 172.21.15.170:0/177762250 conn(0x55f5b7dd2b90 msgr2=0x55f5b7dd0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:48.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.311+0000 7f77efd1f800 1 -- 172.21.15.170:0/177762250 shutdown_connections 2024-09-12T17:29:48.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.311+0000 7f77efd1f800 1 -- 172.21.15.170:0/177762250 wait complete. 2024-09-12T17:29:48.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.312+0000 7f77efd1f800 1 Processor -- start 2024-09-12T17:29:48.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.312+0000 7f77efd1f800 1 -- start start 2024-09-12T17:29:48.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.312+0000 7f77efd1f800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f5b7dd6770 0x55f5b7dddd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.312+0000 7f77efd1f800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f5b7dd7750 con 0x55f5b7dd6770 2024-09-12T17:29:48.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.312+0000 7f77ec2a3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f5b7dd6770 0x55f5b7dddd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.312+0000 7f77ec2a3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f5b7dd6770 0x55f5b7dddd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35368/0 (socket says 172.21.15.170:35368) 2024-09-12T17:29:48.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.312+0000 7f77ec2a3640 1 -- 172.21.15.170:0/2925935439 learned_addr learned my addr 172.21.15.170:0/2925935439 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:48.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.312+0000 7f77ec2a3640 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5b7dde270 con 0x55f5b7dd6770 2024-09-12T17:29:48.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.313+0000 7f77ec2a3640 1 --2- 172.21.15.170:0/2925935439 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f5b7dd6770 0x55f5b7dddd10 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f77e4022ff0 tx=0x7f77e4053c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.313+0000 7f76c97fa640 1 -- 172.21.15.170:0/2925935439 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77e402adb0 con 0x55f5b7dd6770 2024-09-12T17:29:48.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.313+0000 7f76c97fa640 1 -- 172.21.15.170:0/2925935439 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77e40556a0 con 0x55f5b7dd6770 2024-09-12T17:29:48.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.313+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f5b7dde500 con 0x55f5b7dd6770 2024-09-12T17:29:48.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.313+0000 7f76c97fa640 1 -- 172.21.15.170:0/2925935439 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77e4020800 con 0x55f5b7dd6770 2024-09-12T17:29:48.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.313+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5b7ddf090 con 0x55f5b7dd6770 2024-09-12T17:29:48.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.313+0000 7f76c97fa640 1 -- 172.21.15.170:0/2925935439 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f77e40209a0 con 0x55f5b7dd6770 2024-09-12T17:29:48.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.314+0000 7f76c97fa640 1 --2- 172.21.15.170:0/2925935439 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f76b403c730 0x7f76b403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.314+0000 7f76c97fa640 1 -- 172.21.15.170:0/2925935439 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f77e4052c70 con 0x55f5b7dd6770 2024-09-12T17:29:48.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.314+0000 7f77ebaa2640 1 --2- 172.21.15.170:0/2925935439 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f76b403c730 0x7f76b403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.314+0000 7f77ebaa2640 1 --2- 172.21.15.170:0/2925935439 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f76b403c730 0x7f76b403ebf0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f77dc0540e0 tx=0x7f77dc027000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.314+0000 7f77efd1f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.314+0000 7f77efd1f800 1 --2- 172.21.15.170:0/2925935439 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55f5b7de9730 0x55f5b7debbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.314+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7dec340 con 0x55f5b7de9730 2024-09-12T17:29:48.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.315+0000 7f77e32a1640 1 --2- 172.21.15.170:0/2925935439 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55f5b7de9730 0x55f5b7debbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.315+0000 7f77e32a1640 1 --2- 172.21.15.170:0/2925935439 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55f5b7de9730 0x55f5b7debbf0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.315+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77d4051070 con 0x55f5b7de9730 2024-09-12T17:29:48.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.315+0000 7f77efd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.315+0000 7f77efd1f800 20 realm 2024-09-12T17:29:48.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.315+0000 7f77efd1f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.315+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7dec770 con 0x55f5b7de9730 2024-09-12T17:29:48.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.315+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77d4051070 con 0x55f5b7de9730 2024-09-12T17:29:48.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.315+0000 7f77efd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.315+0000 7f77efd1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:29:48.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.315+0000 7f77efd1f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.315+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7ded040 con 0x55f5b7de9730 2024-09-12T17:29:48.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.315+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77d4051070 con 0x55f5b7de9730 2024-09-12T17:29:48.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.315+0000 7f77efd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.315+0000 7f77efd1f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.315+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7ded3e0 con 0x55f5b7de9730 2024-09-12T17:29:48.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.316+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f77d4051070 con 0x55f5b7de9730 2024-09-12T17:29:48.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.316+0000 7f77efd1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:48.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.316+0000 7f77efd1f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.316+0000 7f77efd1f800 1 --2- 172.21.15.170:0/2925935439 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55f5b7dee140 0x55f5b7df0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.316+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7df0b40 con 0x55f5b7dee140 2024-09-12T17:29:48.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.316+0000 7f77ec2a3640 1 --2- 172.21.15.170:0/2925935439 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55f5b7dee140 0x55f5b7df0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.316+0000 7f77ec2a3640 1 --2- 172.21.15.170:0/2925935439 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55f5b7dee140 0x55f5b7df0530 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.316+0000 7f77ec2a3640 1 -- 172.21.15.170:0/2925935439 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f77e400a4d0 con 0x55f5b7dee140 2024-09-12T17:29:48.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.316+0000 7f77efd1f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:29:48.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.316+0000 7f77efd1f800 20 searching for the correct realm 2024-09-12T17:29:48.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.316+0000 7f77efd1f800 1 --2- 172.21.15.170:0/2925935439 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55f5b7df2b20 0x55f5b7df4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.316+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7df5660 con 0x55f5b7df2b20 2024-09-12T17:29:48.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.317+0000 7f77ebaa2640 1 --2- 172.21.15.170:0/2925935439 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55f5b7df2b20 0x55f5b7df4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.317+0000 7f77ebaa2640 1 --2- 172.21.15.170:0/2925935439 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55f5b7df2b20 0x55f5b7df4fe0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.317+0000 7f77ebaa2640 1 -- 172.21.15.170:0/2925935439 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77dc02d070 con 0x55f5b7df2b20 2024-09-12T17:29:48.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.317+0000 7f77ebaa2640 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7df5660 con 0x55f5b7dee140 2024-09-12T17:29:48.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.317+0000 7f77ec2a3640 1 -- 172.21.15.170:0/2925935439 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77e400a4d0 con 0x55f5b7dee140 2024-09-12T17:29:48.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.317+0000 7f77ec2a3640 1 --2- 172.21.15.170:0/2925935439 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f77e4020c90 0x7f77e40123d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.317+0000 7f77ec2a3640 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7df5660 con 0x7f77e4020c90 2024-09-12T17:29:48.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.318+0000 7f77e32a1640 1 --2- 172.21.15.170:0/2925935439 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f77e4020c90 0x7f77e40123d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.318+0000 7f77e32a1640 1 --2- 172.21.15.170:0/2925935439 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f77e4020c90 0x7f77e40123d0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.318+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77d4051070 con 0x7f77e4020c90 2024-09-12T17:29:48.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.318+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7df5660 con 0x55f5b7de9730 2024-09-12T17:29:48.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.319+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77d4051070 con 0x55f5b7de9730 2024-09-12T17:29:48.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.319+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7df5660 con 0x55f5b7de9730 2024-09-12T17:29:48.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.319+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77d4051070 con 0x55f5b7de9730 2024-09-12T17:29:48.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.319+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7df5660 con 0x7f77e4020c90 2024-09-12T17:29:48.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.319+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77d4051070 con 0x7f77e4020c90 2024-09-12T17:29:48.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.319+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7df5660 con 0x7f77e4020c90 2024-09-12T17:29:48.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.319+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77d4051070 con 0x7f77e4020c90 2024-09-12T17:29:48.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.319+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7df5660 con 0x55f5b7dee140 2024-09-12T17:29:48.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.320+0000 7f77ec2a3640 1 -- 172.21.15.170:0/2925935439 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77e400a4d0 con 0x55f5b7dee140 2024-09-12T17:29:48.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.320+0000 7f77ec2a3640 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7df5660 con 0x55f5b7df2b20 2024-09-12T17:29:48.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.320+0000 7f77ebaa2640 1 -- 172.21.15.170:0/2925935439 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77dc02d070 con 0x55f5b7df2b20 2024-09-12T17:29:48.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.320+0000 7f77ebaa2640 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7df5660 con 0x55f5b7de9730 2024-09-12T17:29:48.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.320+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77d4051070 con 0x55f5b7de9730 2024-09-12T17:29:48.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.320+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7df5660 con 0x7f77e4020c90 2024-09-12T17:29:48.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.320+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77d4051070 con 0x7f77e4020c90 2024-09-12T17:29:48.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.320+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7df5660 con 0x55f5b7de9730 2024-09-12T17:29:48.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.321+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77d4051070 con 0x55f5b7de9730 2024-09-12T17:29:48.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.321+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7df5660 con 0x55f5b7dee140 2024-09-12T17:29:48.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.321+0000 7f77ec2a3640 1 -- 172.21.15.170:0/2925935439 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f77e400a4d0 con 0x55f5b7dee140 2024-09-12T17:29:48.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.321+0000 7f77ec2a3640 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7df5660 con 0x55f5b7df2b20 2024-09-12T17:29:48.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.321+0000 7f77ebaa2640 1 -- 172.21.15.170:0/2925935439 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77dc02d070 con 0x55f5b7df2b20 2024-09-12T17:29:48.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.321+0000 7f77ebaa2640 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7df5660 con 0x55f5b7df2b20 2024-09-12T17:29:48.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.321+0000 7f77ebaa2640 1 -- 172.21.15.170:0/2925935439 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77dc02d070 con 0x55f5b7df2b20 2024-09-12T17:29:48.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.321+0000 7f77ebaa2640 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7df5660 con 0x55f5b7dee140 2024-09-12T17:29:48.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.321+0000 7f77ec2a3640 1 -- 172.21.15.170:0/2925935439 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77e400a4d0 con 0x55f5b7dee140 2024-09-12T17:29:48.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.321+0000 7f77ec2a3640 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7df5660 con 0x55f5b7df2b20 2024-09-12T17:29:48.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.322+0000 7f77ebaa2640 1 -- 172.21.15.170:0/2925935439 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77dc02d070 con 0x55f5b7df2b20 2024-09-12T17:29:48.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.322+0000 7f77ebaa2640 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7df5660 con 0x55f5b7df2b20 2024-09-12T17:29:48.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.322+0000 7f77ebaa2640 1 -- 172.21.15.170:0/2925935439 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77dc02d070 con 0x55f5b7df2b20 2024-09-12T17:29:48.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.322+0000 7f77ebaa2640 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7df5660 con 0x55f5b7de9730 2024-09-12T17:29:48.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.322+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77d4051070 con 0x55f5b7de9730 2024-09-12T17:29:48.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.322+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7df5660 con 0x55f5b7de9730 2024-09-12T17:29:48.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.322+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v31'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f77d4051070 con 0x55f5b7de9730 2024-09-12T17:29:48.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.322+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7df5660 con 0x7f77e4020c90 2024-09-12T17:29:48.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.323+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77d4051070 con 0x7f77e4020c90 2024-09-12T17:29:48.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.323+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7df5660 con 0x55f5b7df2b20 2024-09-12T17:29:48.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.323+0000 7f77ebaa2640 1 -- 172.21.15.170:0/2925935439 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77dc02d070 con 0x55f5b7df2b20 2024-09-12T17:29:48.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.323+0000 7f77ebaa2640 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7df5660 con 0x55f5b7dee140 2024-09-12T17:29:48.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.323+0000 7f77ec2a3640 1 -- 172.21.15.170:0/2925935439 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77e400a4d0 con 0x55f5b7dee140 2024-09-12T17:29:48.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.323+0000 7f77ec2a3640 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7df5660 con 0x55f5b7de9730 2024-09-12T17:29:48.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.323+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77d4051070 con 0x55f5b7de9730 2024-09-12T17:29:48.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.323+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7df5660 con 0x7f77e4020c90 2024-09-12T17:29:48.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.324+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77d4051070 con 0x7f77e4020c90 2024-09-12T17:29:48.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.324+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7df5660 con 0x55f5b7df2b20 2024-09-12T17:29:48.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.324+0000 7f77ebaa2640 1 -- 172.21.15.170:0/2925935439 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77dc02d070 con 0x55f5b7df2b20 2024-09-12T17:29:48.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.324+0000 7f77ebaa2640 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7df5660 con 0x7f77e4020c90 2024-09-12T17:29:48.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.324+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77d4051070 con 0x7f77e4020c90 2024-09-12T17:29:48.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.324+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7df5660 con 0x55f5b7dee140 2024-09-12T17:29:48.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.324+0000 7f77ec2a3640 1 -- 172.21.15.170:0/2925935439 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77e406d040 con 0x55f5b7dee140 2024-09-12T17:29:48.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.324+0000 7f77ec2a3640 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7df5660 con 0x55f5b7df2b20 2024-09-12T17:29:48.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.325+0000 7f77ebaa2640 1 -- 172.21.15.170:0/2925935439 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77dc02d070 con 0x55f5b7df2b20 2024-09-12T17:29:48.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.325+0000 7f77ebaa2640 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7df5660 con 0x7f77e4020c90 2024-09-12T17:29:48.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.325+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77d4051070 con 0x7f77e4020c90 2024-09-12T17:29:48.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.325+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7df5660 con 0x55f5b7de9730 2024-09-12T17:29:48.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.325+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f77d4051070 con 0x55f5b7de9730 2024-09-12T17:29:48.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.325+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7df5660 con 0x55f5b7dee140 2024-09-12T17:29:48.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.326+0000 7f77ec2a3640 1 -- 172.21.15.170:0/2925935439 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(37 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f77e406d040 con 0x55f5b7dee140 2024-09-12T17:29:48.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.326+0000 7f77efd1f800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:29:48.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.326+0000 7f77efd1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:29:48.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.326+0000 7f77efd1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:29:48.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.326+0000 7f77efd1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:29:48.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.326+0000 7f77efd1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:29:48.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.326+0000 7f77efd1f800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:29:48.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.326+0000 7f77efd1f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.326+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7df2090 con 0x55f5b7de9730 2024-09-12T17:29:48.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.326+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77d4051070 con 0x55f5b7de9730 2024-09-12T17:29:48.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.326+0000 7f77efd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.326+0000 7f77efd1f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.326+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7df1900 con 0x55f5b7de9730 2024-09-12T17:29:48.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.326+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f77d4051070 con 0x55f5b7de9730 2024-09-12T17:29:48.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.326+0000 7f77efd1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:48.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.326+0000 7f77efd1f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.326+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7df1040 con 0x55f5b7dee140 2024-09-12T17:29:48.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.326+0000 7f77ec2a3640 1 -- 172.21.15.170:0/2925935439 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f77e406d040 con 0x55f5b7dee140 2024-09-12T17:29:48.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.326+0000 7f77efd1f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:29:48.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.326+0000 7f77efd1f800 20 zone default found 2024-09-12T17:29:48.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.326+0000 7f77efd1f800 4 Realm: () 2024-09-12T17:29:48.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.326+0000 7f77efd1f800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:29:48.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.326+0000 7f77efd1f800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:29:48.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.326+0000 7f77efd1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:29:48.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.326+0000 7f77efd1f800 20 zonegroup default 2024-09-12T17:29:48.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.326+0000 7f77efd1f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.326+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7df5f90 con 0x7f77e4020c90 2024-09-12T17:29:48.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.327+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f77d4051070 con 0x7f77e4020c90 2024-09-12T17:29:48.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.327+0000 7f77efd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.327+0000 7f77efd1f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.327+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7df81d0 con 0x55f5b7df2b20 2024-09-12T17:29:48.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.327+0000 7f77ebaa2640 1 -- 172.21.15.170:0/2925935439 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f77dc02d070 con 0x55f5b7df2b20 2024-09-12T17:29:48.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.327+0000 7f77efd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.327+0000 7f77efd1f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.327+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7df8570 con 0x55f5b7df2b20 2024-09-12T17:29:48.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.328+0000 7f77ebaa2640 1 -- 172.21.15.170:0/2925935439 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f77dc02d070 con 0x55f5b7df2b20 2024-09-12T17:29:48.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.328+0000 7f77efd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.328+0000 7f77efd1f800 20 started sync module instance, tier type = 2024-09-12T17:29:48.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.328+0000 7f77efd1f800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:29:48.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.328+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7df7660 con 0x55f5b7dee140 2024-09-12T17:29:48.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.329+0000 7f77ec2a3640 1 -- 172.21.15.170:0/2925935439 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(44 notify.0 [create] v31'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77e406d040 con 0x55f5b7dee140 2024-09-12T17:29:48.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.329+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94513840225120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7df7660 con 0x55f5b7dee140 2024-09-12T17:29:48.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.329+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7df9030 con 0x55f5b7de9730 2024-09-12T17:29:48.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.330+0000 7f77ec2a3640 1 -- 172.21.15.170:0/2925935439 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94513840225120] v31'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77e406d040 con 0x55f5b7dee140 2024-09-12T17:29:48.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.330+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v31'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77d4051070 con 0x55f5b7de9730 2024-09-12T17:29:48.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.330+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94513840222640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7df75d0 con 0x55f5b7de9730 2024-09-12T17:29:48.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.330+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7df9ef0 con 0x55f5b7df2b20 2024-09-12T17:29:48.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.331+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94513840222640] v31'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77d4051070 con 0x55f5b7de9730 2024-09-12T17:29:48.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.331+0000 7f77ebaa2640 1 -- 172.21.15.170:0/2925935439 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v31'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77dc02d070 con 0x55f5b7df2b20 2024-09-12T17:29:48.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.331+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94513840233024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7dfa2e0 con 0x55f5b7df2b20 2024-09-12T17:29:48.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.331+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7dface0 con 0x55f5b7dee140 2024-09-12T17:29:48.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.332+0000 7f77ebaa2640 1 -- 172.21.15.170:0/2925935439 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94513840233024] v31'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77dc02d070 con 0x55f5b7df2b20 2024-09-12T17:29:48.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.332+0000 7f77ec2a3640 1 -- 172.21.15.170:0/2925935439 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(50 notify.3 [create] v31'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77e406d040 con 0x55f5b7dee140 2024-09-12T17:29:48.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.332+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94513840231456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7dfb0d0 con 0x55f5b7dee140 2024-09-12T17:29:48.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.332+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7dfbb50 con 0x55f5b7de9730 2024-09-12T17:29:48.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.333+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v31'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77d4051070 con 0x55f5b7de9730 2024-09-12T17:29:48.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.333+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94513840240192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7dfbb10 con 0x55f5b7de9730 2024-09-12T17:29:48.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.333+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7dfcb00 con 0x7f77e4020c90 2024-09-12T17:29:48.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.333+0000 7f77ec2a3640 1 -- 172.21.15.170:0/2925935439 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94513840231456] v31'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77e406d040 con 0x55f5b7dee140 2024-09-12T17:29:48.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.334+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(54 notify.5 [create] v31'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77d4051070 con 0x7f77e4020c90 2024-09-12T17:29:48.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.334+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94513840240192] v31'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77d4051070 con 0x55f5b7de9730 2024-09-12T17:29:48.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.334+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94513840236528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7dfcb00 con 0x7f77e4020c90 2024-09-12T17:29:48.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.334+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7dfcb00 con 0x7f77e4020c90 2024-09-12T17:29:48.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.335+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94513840236528] v31'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77d4051070 con 0x7f77e4020c90 2024-09-12T17:29:48.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.335+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v31'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77d4051070 con 0x7f77e4020c90 2024-09-12T17:29:48.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.335+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94513840242576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7dfd190 con 0x7f77e4020c90 2024-09-12T17:29:48.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.335+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7dfd9e0 con 0x7f77e4020c90 2024-09-12T17:29:48.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.336+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94513840242576] v31'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77d4051070 con 0x7f77e4020c90 2024-09-12T17:29:48.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.336+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(58 notify.7 [create] v31'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77d4051070 con 0x7f77e4020c90 2024-09-12T17:29:48.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.336+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94513840246464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7dfd810 con 0x7f77e4020c90 2024-09-12T17:29:48.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.336+0000 7f77efd1f800 20 add_watcher() i=0 2024-09-12T17:29:48.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.336+0000 7f77efd1f800 20 add_watcher() i=1 2024-09-12T17:29:48.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.336+0000 7f77efd1f800 20 add_watcher() i=2 2024-09-12T17:29:48.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.336+0000 7f77efd1f800 20 add_watcher() i=3 2024-09-12T17:29:48.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.336+0000 7f77efd1f800 20 add_watcher() i=4 2024-09-12T17:29:48.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.336+0000 7f77efd1f800 20 add_watcher() i=5 2024-09-12T17:29:48.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.336+0000 7f77efd1f800 20 add_watcher() i=6 2024-09-12T17:29:48.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.337+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94513840246464] v31'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77d4051070 con 0x7f77e4020c90 2024-09-12T17:29:48.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.337+0000 7f77efd1f800 20 add_watcher() i=7 2024-09-12T17:29:48.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.337+0000 7f77efd1f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:29:48.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.337+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7e00d80 con 0x55f5b7de9730 2024-09-12T17:29:48.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.337+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f77d4051070 con 0x55f5b7de9730 2024-09-12T17:29:48.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.337+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94513840247520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7dfe2d0 con 0x55f5b7de9730 2024-09-12T17:29:48.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.338+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94513840247520] v31'266 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f77d4051070 con 0x55f5b7de9730 2024-09-12T17:29:48.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.338+0000 7f76a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:48.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.339+0000 7f77efd1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:29:48.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.339+0000 7f77efd1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:29:48.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.339+0000 7f77efd1f800 5 note: GC not initialized 2024-09-12T17:29:48.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.339+0000 7f76a0fe1640 20 reqs_thread_entry: start 2024-09-12T17:29:48.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.339+0000 7f77efd1f800 20 init_complete bucket index max shards: 11 2024-09-12T17:29:48.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.339+0000 7f77efd1f800 20 Filter name: none 2024-09-12T17:29:48.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.339+0000 7f761a7fc640 20 reqs_thread_entry: start 2024-09-12T17:29:48.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.339+0000 7f77efd1f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-12T17:29:48.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.339+0000 7f77efd1f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.339+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7e33e00 con 0x7f77e4020c90 2024-09-12T17:29:48.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.340+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f77d4051070 con 0x7f77e4020c90 2024-09-12T17:29:48.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.340+0000 7f77efd1f800 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T17:29:48.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.340+0000 7f77efd1f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-12T17:29:48.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.340+0000 7f77efd1f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:29:48.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.340+0000 7f77efd1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:29:48.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.340+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7e3a1f0 con 0x7f77e4020c90 2024-09-12T17:29:48.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.341+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v31'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f77d4051070 con 0x7f77e4020c90 2024-09-12T17:29:48.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.341+0000 7f77efd1f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T17:29:48.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.341+0000 7f77efd1f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:29:48.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.341+0000 7f77efd1f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-12T17:29:48.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.341+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94513840495712 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7e358e0 con 0x55f5b7de9730 2024-09-12T17:29:48.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.341+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== watch-notify(notify (1) cookie 94513840240192 notify 133143986204 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7f77d4082040 con 0x55f5b7de9730 2024-09-12T17:29:48.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.341+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(64 notify.4 [notify cookie 94513840495712 out=8b] v0'0 uv270 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f77d4051070 con 0x55f5b7de9730 2024-09-12T17:29:48.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.341+0000 7f76caffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986204 cookie 94513840240192 notifier 4897 bl.length()=666 2024-09-12T17:29:48.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.341+0000 7f76caffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T17:29:48.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.341+0000 7f76caffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:29:48.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.341+0000 7f76caffd640 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f76b0003ea0 con 0x55f5b7de9730 2024-09-12T17:29:48.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.342+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77d4051070 con 0x55f5b7de9730 2024-09-12T17:29:48.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.342+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== watch-notify(notify_complete (2) cookie 94513840495712 notify 133143986204 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f5b7b486b0 con 0x55f5b7de9730 2024-09-12T17:29:48.354 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-12T17:29:46.782056Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"write"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:29:46.782042Z","tags":[],"group_ids":[]} 2024-09-12T17:29:48.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.343+0000 7f76a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:48.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.343+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94513840247520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7e31c70 con 0x55f5b7de9730 2024-09-12T17:29:48.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.344+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94513840247520] v31'267 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f77d4051070 con 0x55f5b7de9730 2024-09-12T17:29:48.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.344+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94513840225120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7e31c70 con 0x55f5b7dee140 2024-09-12T17:29:48.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.345+0000 7f77ec2a3640 1 -- 172.21.15.170:0/2925935439 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94513840225120] v31'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77e406d040 con 0x55f5b7dee140 2024-09-12T17:29:48.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.345+0000 7f77efd1f800 20 remove_watcher() i=0 2024-09-12T17:29:48.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.345+0000 7f77efd1f800 2 removed watcher, disabling cache 2024-09-12T17:29:48.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.345+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94513840222640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7e31c70 con 0x55f5b7de9730 2024-09-12T17:29:48.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.346+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94513840222640] v31'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77d4051070 con 0x55f5b7de9730 2024-09-12T17:29:48.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.346+0000 7f77efd1f800 20 remove_watcher() i=1 2024-09-12T17:29:48.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.346+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94513840233024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7e31c70 con 0x55f5b7df2b20 2024-09-12T17:29:48.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.347+0000 7f77ebaa2640 1 -- 172.21.15.170:0/2925935439 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94513840233024] v31'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77dc02d070 con 0x55f5b7df2b20 2024-09-12T17:29:48.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.347+0000 7f77efd1f800 20 remove_watcher() i=2 2024-09-12T17:29:48.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.347+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94513840231456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7e31c70 con 0x55f5b7dee140 2024-09-12T17:29:48.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.348+0000 7f77ec2a3640 1 -- 172.21.15.170:0/2925935439 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94513840231456] v31'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77e406d040 con 0x55f5b7dee140 2024-09-12T17:29:48.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.348+0000 7f77efd1f800 20 remove_watcher() i=3 2024-09-12T17:29:48.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.348+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94513840240192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7e31c70 con 0x55f5b7de9730 2024-09-12T17:29:48.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.349+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94513840240192] v31'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77d4051070 con 0x55f5b7de9730 2024-09-12T17:29:48.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.349+0000 7f77efd1f800 20 remove_watcher() i=4 2024-09-12T17:29:48.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.349+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94513840236528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7e31c70 con 0x7f77e4020c90 2024-09-12T17:29:48.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.350+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94513840236528] v31'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77d4051070 con 0x7f77e4020c90 2024-09-12T17:29:48.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.350+0000 7f77efd1f800 20 remove_watcher() i=5 2024-09-12T17:29:48.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.350+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94513840242576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7e31c70 con 0x7f77e4020c90 2024-09-12T17:29:48.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.351+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94513840242576] v31'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77d4051070 con 0x7f77e4020c90 2024-09-12T17:29:48.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.351+0000 7f77efd1f800 20 remove_watcher() i=6 2024-09-12T17:29:48.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.351+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94513840246464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f5b7e31c70 con 0x7f77e4020c90 2024-09-12T17:29:48.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.352+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94513840246464] v31'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77d4051070 con 0x7f77e4020c90 2024-09-12T17:29:48.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.352+0000 7f77efd1f800 20 remove_watcher() i=7 2024-09-12T17:29:48.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.352+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f77e4020c90 msgr2=0x7f77e40123d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.352+0000 7f77efd1f800 1 --2- 172.21.15.170:0/2925935439 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f77e4020c90 0x7f77e40123d0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.352+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55f5b7de9730 msgr2=0x55f5b7debbf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.352+0000 7f77efd1f800 1 --2- 172.21.15.170:0/2925935439 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55f5b7de9730 0x55f5b7debbf0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.352+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55f5b7dee140 msgr2=0x55f5b7df0530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.352+0000 7f77efd1f800 1 --2- 172.21.15.170:0/2925935439 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55f5b7dee140 0x55f5b7df0530 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.352+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55f5b7df2b20 msgr2=0x55f5b7df4fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.352+0000 7f77efd1f800 1 --2- 172.21.15.170:0/2925935439 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55f5b7df2b20 0x55f5b7df4fe0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.352+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f76b403c730 msgr2=0x7f76b403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.352+0000 7f77efd1f800 1 --2- 172.21.15.170:0/2925935439 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f76b403c730 0x7f76b403ebf0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f77dc0540e0 tx=0x7f77dc027000 comp rx=0 tx=0).stop 2024-09-12T17:29:48.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.352+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f5b7dd6770 msgr2=0x55f5b7dddd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.352+0000 7f77e32a1640 1 -- 172.21.15.170:0/2925935439 reap_dead start 2024-09-12T17:29:48.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.352+0000 7f77efd1f800 1 --2- 172.21.15.170:0/2925935439 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f5b7dd6770 0x55f5b7dddd10 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f77e4022ff0 tx=0x7f77e4053c60 comp rx=0 tx=0).stop 2024-09-12T17:29:48.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.352+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 shutdown_connections 2024-09-12T17:29:48.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.352+0000 7f77efd1f800 1 --2- 172.21.15.170:0/2925935439 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f5b7dd6770 0x55f5b7dddd10 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.352+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 >> 172.21.15.170:0/2925935439 conn(0x55f5b7dd2b90 msgr2=0x55f5b7dd0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:48.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.352+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 shutdown_connections 2024-09-12T17:29:48.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.352+0000 7f77efd1f800 1 -- 172.21.15.170:0/2925935439 wait complete. 2024-09-12T17:29:48.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.353+0000 7f77efd1f800 1 -- 172.21.15.170:0/6412579 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f76c403c780 msgr2=0x7f76c403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.353+0000 7f77efd1f800 1 --2- 172.21.15.170:0/6412579 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f76c403c780 0x7f76c403ec40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f77dc052740 tx=0x7f77dc054110 comp rx=0 tx=0).stop 2024-09-12T17:29:48.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.353+0000 7f77efd1f800 1 -- 172.21.15.170:0/6412579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f5b7dc9d10 msgr2=0x55f5b7dca130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.353+0000 7f77efd1f800 1 --2- 172.21.15.170:0/6412579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f5b7dc9d10 0x55f5b7dca130 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x55f5b7dafe40 tx=0x7f77e40167b0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.353+0000 7f77efd1f800 1 -- 172.21.15.170:0/6412579 shutdown_connections 2024-09-12T17:29:48.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.353+0000 7f77efd1f800 1 --2- 172.21.15.170:0/6412579 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f76c403c780 0x7f76c403ec40 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.353+0000 7f77efd1f800 1 --2- 172.21.15.170:0/6412579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f5b7dc9d10 0x55f5b7dca130 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.353+0000 7f77efd1f800 1 -- 172.21.15.170:0/6412579 >> 172.21.15.170:0/6412579 conn(0x55f5b7dbe0c0 msgr2=0x55f5b7dbe4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:48.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.353+0000 7f77efd1f800 1 -- 172.21.15.170:0/6412579 shutdown_connections 2024-09-12T17:29:48.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.353+0000 7f77efd1f800 1 -- 172.21.15.170:0/6412579 wait complete. 2024-09-12T17:29:48.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.353+0000 7f77efd1f800 1 -- 172.21.15.170:0/571334162 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55f5b7cbc210 msgr2=0x55f5b7db6490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.353+0000 7f77efd1f800 1 --2- 172.21.15.170:0/571334162 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55f5b7cbc210 0x55f5b7db6490 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.353+0000 7f77efd1f800 1 -- 172.21.15.170:0/571334162 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55f5b7db8870 msgr2=0x55f5b7dbacf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.353+0000 7f77efd1f800 1 --2- 172.21.15.170:0/571334162 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55f5b7db8870 0x55f5b7dbacf0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.353+0000 7f77efd1f800 1 -- 172.21.15.170:0/571334162 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f76d403c920 msgr2=0x7f76d403ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.353+0000 7f77efd1f800 1 --2- 172.21.15.170:0/571334162 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f76d403c920 0x7f76d403ede0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f77d4057000 tx=0x7f77d4052000 comp rx=0 tx=0).stop 2024-09-12T17:29:48.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.353+0000 7f77efd1f800 1 -- 172.21.15.170:0/571334162 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f5b7cb86a0 msgr2=0x55f5b7daee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.353+0000 7f77efd1f800 1 --2- 172.21.15.170:0/571334162 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f5b7cb86a0 0x55f5b7daee40 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f77dc0012f0 tx=0x7f77dc000ed0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.353+0000 7f77efd1f800 1 -- 172.21.15.170:0/571334162 shutdown_connections 2024-09-12T17:29:48.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.353+0000 7f77efd1f800 1 --2- 172.21.15.170:0/571334162 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55f5b7db8870 0x55f5b7dbacf0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.353+0000 7f77efd1f800 1 --2- 172.21.15.170:0/571334162 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f76d403c920 0x7f76d403ede0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.353+0000 7f77efd1f800 1 --2- 172.21.15.170:0/571334162 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55f5b7cbc210 0x55f5b7db6490 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.353+0000 7f77efd1f800 1 --2- 172.21.15.170:0/571334162 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f5b7cb86a0 0x55f5b7daee40 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.353+0000 7f77efd1f800 1 -- 172.21.15.170:0/571334162 >> 172.21.15.170:0/571334162 conn(0x55f5b7cb2200 msgr2=0x55f5b7da87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:48.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.353+0000 7f77efd1f800 1 -- 172.21.15.170:0/571334162 shutdown_connections 2024-09-12T17:29:48.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.353+0000 7f77efd1f800 1 -- 172.21.15.170:0/571334162 wait complete. 2024-09-12T17:29:48.365 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T17:29:46.782056Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:29:46.782042Z', 'tags': [], 'group_ids': []} 2024-09-12T17:29:48.365 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T17:29:46.782056Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:29:46.782042Z', 'tags': [], 'group_ids': []} 2024-09-12T17:29:48.365 ERROR:root:0 2024-09-12T17:29:48.365 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T17:29:48.370 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'AccessDenied', 'Message': '', 'RequestId': 'tx000008ac30e436cb103e3-0066e3250c-4225-default', 'HostId': '4225-default-default'} 2024-09-12T17:29:48.370 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-12T17:29:48.370 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-12T17:29:48.371 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps user-info-without-keys=write 2024-09-12T17:29:48.417 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:29:48.417 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:29:48.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.416+0000 7f1481f2c800 1 Processor -- start 2024-09-12T17:29:48.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.416+0000 7f1481f2c800 1 -- start start 2024-09-12T17:29:48.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.416+0000 7f1481f2c800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55892abdffc0 0x55892abe8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.416+0000 7f1481f2c800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55892aa89e40 con 0x55892abde4a0 2024-09-12T17:29:48.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.416+0000 7f1481f2c800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x55892aa54680 con 0x55892abdffc0 2024-09-12T17:29:48.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.417+0000 7f1475360640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55892abdffc0 0x55892abe8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.417+0000 7f147db61640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x55892abde4a0 0x55892abde8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:44972/0 (socket says 172.21.15.170:44972) 2024-09-12T17:29:48.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.417+0000 7f1475360640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55892abdffc0 0x55892abe8ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35382/0 (socket says 172.21.15.170:35382) 2024-09-12T17:29:48.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.417+0000 7f1475360640 1 -- 172.21.15.170:0/3837338853 learned_addr learned my addr 172.21.15.170:0/3837338853 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:48.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.417+0000 7f1475360640 1 -- 172.21.15.170:0/3837338853 >> v1:172.21.15.47:6789/0 conn(0x55892abde4a0 legacy=0x55892abde8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.417+0000 7f1475360640 1 -- 172.21.15.170:0/3837338853 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55892aa706b0 con 0x55892abdffc0 2024-09-12T17:29:48.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.419+0000 7f1475360640 1 --2- 172.21.15.170:0/3837338853 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55892abdffc0 0x55892abe8ae0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f146800a520 tx=0x7f1468045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41df050f2a0f6d80 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.419+0000 7f147d360640 1 -- 172.21.15.170:0/3837338853 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1468055070 con 0x55892abdffc0 2024-09-12T17:29:48.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.419+0000 7f147d360640 1 -- 172.21.15.170:0/3837338853 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14680515b0 con 0x55892abdffc0 2024-09-12T17:29:48.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.419+0000 7f147d360640 1 -- 172.21.15.170:0/3837338853 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14680518d0 con 0x55892abdffc0 2024-09-12T17:29:48.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.419+0000 7f1481f2c800 1 -- 172.21.15.170:0/3837338853 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55892abdffc0 msgr2=0x55892abe8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.419+0000 7f1481f2c800 1 --2- 172.21.15.170:0/3837338853 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55892abdffc0 0x55892abe8ae0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f146800a520 tx=0x7f1468045ba0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.420+0000 7f1481f2c800 1 -- 172.21.15.170:0/3837338853 shutdown_connections 2024-09-12T17:29:48.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.420+0000 7f1481f2c800 1 --2- 172.21.15.170:0/3837338853 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55892abdffc0 0x55892abe8ae0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.420+0000 7f1481f2c800 1 -- 172.21.15.170:0/3837338853 >> 172.21.15.170:0/3837338853 conn(0x55892abda1d0 msgr2=0x55892abdc630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:48.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.420+0000 7f1481f2c800 1 -- 172.21.15.170:0/3837338853 shutdown_connections 2024-09-12T17:29:48.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.420+0000 7f1481f2c800 1 -- 172.21.15.170:0/3837338853 wait complete. 2024-09-12T17:29:48.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.435+0000 7f1481f2c800 1 Processor -- start 2024-09-12T17:29:48.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.435+0000 7f1481f2c800 1 -- start start 2024-09-12T17:29:48.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.435+0000 7f1481f2c800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55892abde4a0 0x55892acd18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.435+0000 7f1481f2c800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55892aa78dd0 con 0x55892abde4a0 2024-09-12T17:29:48.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.436+0000 7f147db61640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55892abde4a0 0x55892acd18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.436+0000 7f147db61640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55892abde4a0 0x55892acd18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35388/0 (socket says 172.21.15.170:35388) 2024-09-12T17:29:48.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.436+0000 7f147db61640 1 -- 172.21.15.170:0/2797954494 learned_addr learned my addr 172.21.15.170:0/2797954494 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:48.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.436+0000 7f147db61640 1 -- 172.21.15.170:0/2797954494 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55892aa91e10 con 0x55892abde4a0 2024-09-12T17:29:48.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.436+0000 7f147db61640 1 --2- 172.21.15.170:0/2797954494 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55892abde4a0 0x55892acd18d0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f147000b260 tx=0x7f147000b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=177f3086e09975c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.436+0000 7f136be07640 1 -- 172.21.15.170:0/2797954494 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f147000be60 con 0x55892abde4a0 2024-09-12T17:29:48.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.436+0000 7f136be07640 1 -- 172.21.15.170:0/2797954494 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1470006070 con 0x55892abde4a0 2024-09-12T17:29:48.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.436+0000 7f136be07640 1 -- 172.21.15.170:0/2797954494 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f147000e710 con 0x55892abde4a0 2024-09-12T17:29:48.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.437+0000 7f1481f2c800 1 -- 172.21.15.170:0/2797954494 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55892abde4a0 msgr2=0x55892acd18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.437+0000 7f1481f2c800 1 --2- 172.21.15.170:0/2797954494 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55892abde4a0 0x55892acd18d0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f147000b260 tx=0x7f147000b660 comp rx=0 tx=0).stop 2024-09-12T17:29:48.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.437+0000 7f1481f2c800 1 -- 172.21.15.170:0/2797954494 shutdown_connections 2024-09-12T17:29:48.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.437+0000 7f1481f2c800 1 --2- 172.21.15.170:0/2797954494 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55892abde4a0 0x55892acd18d0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.437+0000 7f1481f2c800 1 -- 172.21.15.170:0/2797954494 >> 172.21.15.170:0/2797954494 conn(0x55892abda1d0 msgr2=0x55892accd250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:48.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.437+0000 7f1481f2c800 1 -- 172.21.15.170:0/2797954494 shutdown_connections 2024-09-12T17:29:48.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.437+0000 7f1481f2c800 1 -- 172.21.15.170:0/2797954494 wait complete. 2024-09-12T17:29:48.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.437+0000 7f1481f2c800 1 Processor -- start 2024-09-12T17:29:48.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.438+0000 7f1481f2c800 1 -- start start 2024-09-12T17:29:48.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.438+0000 7f1481f2c800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55892abde4a0 0x55892acd9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.438+0000 7f1481f2c800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55892abe92f0 con 0x55892abde4a0 2024-09-12T17:29:48.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.438+0000 7f147db61640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55892abde4a0 0x55892acd9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.438+0000 7f147db61640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55892abde4a0 0x55892acd9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35404/0 (socket says 172.21.15.170:35404) 2024-09-12T17:29:48.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.438+0000 7f147db61640 1 -- 172.21.15.170:0/890562595 learned_addr learned my addr 172.21.15.170:0/890562595 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:48.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.438+0000 7f147db61640 1 -- 172.21.15.170:0/890562595 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55892acd9560 con 0x55892abde4a0 2024-09-12T17:29:48.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.438+0000 7f147db61640 1 --2- 172.21.15.170:0/890562595 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55892abde4a0 0x55892acd9000 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x55892acd2860 tx=0x7f1470000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.439+0000 7f136a604640 1 -- 172.21.15.170:0/890562595 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f147000fa30 con 0x55892abde4a0 2024-09-12T17:29:48.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.439+0000 7f136a604640 1 -- 172.21.15.170:0/890562595 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f147000fbd0 con 0x55892abde4a0 2024-09-12T17:29:48.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.439+0000 7f136a604640 1 -- 172.21.15.170:0/890562595 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f147001a480 con 0x55892abde4a0 2024-09-12T17:29:48.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.439+0000 7f1481f2c800 1 -- 172.21.15.170:0/890562595 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55892acd97f0 con 0x55892abde4a0 2024-09-12T17:29:48.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.439+0000 7f1481f2c800 1 -- 172.21.15.170:0/890562595 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55892acda1f0 con 0x55892abde4a0 2024-09-12T17:29:48.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.440+0000 7f136a604640 1 -- 172.21.15.170:0/890562595 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1470017070 con 0x55892abde4a0 2024-09-12T17:29:48.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.440+0000 7f136a604640 1 --2- 172.21.15.170:0/890562595 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f136403c730 0x7f136403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.440+0000 7f136a604640 1 -- 172.21.15.170:0/890562595 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f1470015020 con 0x55892abde4a0 2024-09-12T17:29:48.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.440+0000 7f1475360640 1 --2- 172.21.15.170:0/890562595 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f136403c730 0x7f136403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.440+0000 7f1481f2c800 1 --2- 172.21.15.170:0/890562595 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55892abdffc0 0x55892ace0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.440+0000 7f1481f2c800 1 -- 172.21.15.170:0/890562595 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55892ace0b90 con 0x55892abdffc0 2024-09-12T17:29:48.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.441+0000 7f147e362640 1 --2- 172.21.15.170:0/890562595 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55892abdffc0 0x55892ace0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.441+0000 7f1475360640 1 --2- 172.21.15.170:0/890562595 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f136403c730 0x7f136403ebf0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1468057000 tx=0x7f1468052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.441+0000 7f147e362640 1 --2- 172.21.15.170:0/890562595 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55892abdffc0 0x55892ace0650 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.441+0000 7f147e362640 1 -- 172.21.15.170:0/890562595 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f147800a4d0 con 0x55892abdffc0 2024-09-12T17:29:48.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.441+0000 7f1481f2c800 1 -- 172.21.15.170:0/890562595 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55892ace0f30 con 0x55892abdffc0 2024-09-12T17:29:48.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.442+0000 7f147e362640 1 -- 172.21.15.170:0/890562595 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f147800a4d0 con 0x55892abdffc0 2024-09-12T17:29:48.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.442+0000 7f1481f2c800 1 --2- 172.21.15.170:0/890562595 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55892ace29f0 0x55892ace4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.442+0000 7f1481f2c800 1 -- 172.21.15.170:0/890562595 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55892ace5620 con 0x55892ace29f0 2024-09-12T17:29:48.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.442+0000 7f147db61640 1 --2- 172.21.15.170:0/890562595 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55892ace29f0 0x55892ace4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.442+0000 7f147db61640 1 --2- 172.21.15.170:0/890562595 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55892ace29f0 0x55892ace4e90 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.442+0000 7f147db61640 1 -- 172.21.15.170:0/890562595 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f147002e070 con 0x55892ace29f0 2024-09-12T17:29:48.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.442+0000 7f1481f2c800 1 -- 172.21.15.170:0/890562595 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55892ace1780 con 0x55892abdffc0 2024-09-12T17:29:48.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.443+0000 7f147e362640 1 -- 172.21.15.170:0/890562595 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f147800a4d0 con 0x55892abdffc0 2024-09-12T17:29:48.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.443+0000 7f1481f2c800 1 -- 172.21.15.170:0/890562595 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55892ace1bd0 con 0x55892ace29f0 2024-09-12T17:29:48.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.443+0000 7f147db61640 1 -- 172.21.15.170:0/890562595 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f147002e070 con 0x55892ace29f0 2024-09-12T17:29:48.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.443+0000 7f1481f2c800 1 Processor -- start 2024-09-12T17:29:48.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.443+0000 7f1481f2c800 1 -- start start 2024-09-12T17:29:48.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.443+0000 7f1481f2c800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55892acf3f10 0x55892acf4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.443+0000 7f1481f2c800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55892aad6a00 con 0x55892acf3f10 2024-09-12T17:29:48.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.444+0000 7f147e362640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55892acf3f10 0x55892acf4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.444+0000 7f147e362640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55892acf3f10 0x55892acf4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35418/0 (socket says 172.21.15.170:35418) 2024-09-12T17:29:48.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.444+0000 7f147e362640 1 -- 172.21.15.170:0/2042998645 learned_addr learned my addr 172.21.15.170:0/2042998645 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:48.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.444+0000 7f147e362640 1 -- 172.21.15.170:0/2042998645 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55892acf4970 con 0x55892acf3f10 2024-09-12T17:29:48.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.444+0000 7f147e362640 1 --2- 172.21.15.170:0/2042998645 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55892acf3f10 0x55892acf4330 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x55892acda3c0 tx=0x7f14780167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.444+0000 7f13637fe640 1 -- 172.21.15.170:0/2042998645 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1478013640 con 0x55892acf3f10 2024-09-12T17:29:48.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.444+0000 7f13637fe640 1 -- 172.21.15.170:0/2042998645 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14780137e0 con 0x55892acf3f10 2024-09-12T17:29:48.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.444+0000 7f13637fe640 1 -- 172.21.15.170:0/2042998645 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1478013ae0 con 0x55892acf3f10 2024-09-12T17:29:48.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.444+0000 7f1481f2c800 1 -- 172.21.15.170:0/2042998645 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55892acf51a0 con 0x55892acf3f10 2024-09-12T17:29:48.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.444+0000 7f1481f2c800 1 -- 172.21.15.170:0/2042998645 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55892acf5740 con 0x55892acf3f10 2024-09-12T17:29:48.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.445+0000 7f13637fe640 1 -- 172.21.15.170:0/2042998645 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1478011040 con 0x55892acf3f10 2024-09-12T17:29:48.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.445+0000 7f13637fe640 1 --2- 172.21.15.170:0/2042998645 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f135803c780 0x7f135803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.445+0000 7f13637fe640 1 -- 172.21.15.170:0/2042998645 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f147800e040 con 0x55892acf3f10 2024-09-12T17:29:48.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.445+0000 7f147db61640 1 --2- 172.21.15.170:0/2042998645 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f135803c780 0x7f135803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.446+0000 7f1481f2c800 1 Processor -- start 2024-09-12T17:29:48.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.446+0000 7f147db61640 1 --2- 172.21.15.170:0/2042998645 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f135803c780 0x7f135803ec40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1470001530 tx=0x7f14700014a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.446+0000 7f1481f2c800 1 -- start start 2024-09-12T17:29:48.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.446+0000 7f1481f2c800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55892ad009b0 0x55892ad00d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.446+0000 7f1481f2c800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55892acd2120 con 0x55892ad009b0 2024-09-12T17:29:48.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.446+0000 7f147e362640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55892ad009b0 0x55892ad00d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.446+0000 7f147e362640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55892ad009b0 0x55892ad00d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35428/0 (socket says 172.21.15.170:35428) 2024-09-12T17:29:48.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.446+0000 7f147e362640 1 -- 172.21.15.170:0/236231912 learned_addr learned my addr 172.21.15.170:0/236231912 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:48.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.446+0000 7f147e362640 1 -- 172.21.15.170:0/236231912 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55892ad01380 con 0x55892ad009b0 2024-09-12T17:29:48.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.447+0000 7f147e362640 1 --2- 172.21.15.170:0/236231912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55892ad009b0 0x55892ad00d90 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f1478053d70 tx=0x7f147801fe70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ce4014b8692619c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.447+0000 7f13617fa640 1 -- 172.21.15.170:0/236231912 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f147804a070 con 0x55892ad009b0 2024-09-12T17:29:48.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.447+0000 7f13617fa640 1 -- 172.21.15.170:0/236231912 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1478055040 con 0x55892ad009b0 2024-09-12T17:29:48.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.447+0000 7f13617fa640 1 -- 172.21.15.170:0/236231912 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1478052070 con 0x55892ad009b0 2024-09-12T17:29:48.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.447+0000 7f1481f2c800 1 -- 172.21.15.170:0/236231912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55892ad009b0 msgr2=0x55892ad00d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.447+0000 7f1481f2c800 1 --2- 172.21.15.170:0/236231912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55892ad009b0 0x55892ad00d90 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f1478053d70 tx=0x7f147801fe70 comp rx=0 tx=0).stop 2024-09-12T17:29:48.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.447+0000 7f1481f2c800 1 -- 172.21.15.170:0/236231912 shutdown_connections 2024-09-12T17:29:48.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.447+0000 7f1481f2c800 1 --2- 172.21.15.170:0/236231912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55892ad009b0 0x55892ad00d90 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.447+0000 7f1481f2c800 1 -- 172.21.15.170:0/236231912 >> 172.21.15.170:0/236231912 conn(0x55892acfcdb0 msgr2=0x55892acfaff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:48.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.447+0000 7f1481f2c800 1 -- 172.21.15.170:0/236231912 shutdown_connections 2024-09-12T17:29:48.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.447+0000 7f1481f2c800 1 -- 172.21.15.170:0/236231912 wait complete. 2024-09-12T17:29:48.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.447+0000 7f1481f2c800 1 Processor -- start 2024-09-12T17:29:48.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.448+0000 7f1481f2c800 1 -- start start 2024-09-12T17:29:48.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.448+0000 7f1481f2c800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55892ad009b0 0x55892ad07fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.448+0000 7f1481f2c800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55892ad019c0 con 0x55892ad009b0 2024-09-12T17:29:48.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.448+0000 7f147e362640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55892ad009b0 0x55892ad07fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.448+0000 7f147e362640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55892ad009b0 0x55892ad07fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35432/0 (socket says 172.21.15.170:35432) 2024-09-12T17:29:48.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.448+0000 7f147e362640 1 -- 172.21.15.170:0/3104996805 learned_addr learned my addr 172.21.15.170:0/3104996805 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:48.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.448+0000 7f147e362640 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55892ad08530 con 0x55892ad009b0 2024-09-12T17:29:48.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.448+0000 7f147e362640 1 --2- 172.21.15.170:0/3104996805 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55892ad009b0 0x55892ad07fd0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f1478048040 tx=0x7f1478053d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.448+0000 7f134f7fe640 1 -- 172.21.15.170:0/3104996805 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f147804a040 con 0x55892ad009b0 2024-09-12T17:29:48.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.448+0000 7f134f7fe640 1 -- 172.21.15.170:0/3104996805 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14780143c0 con 0x55892ad009b0 2024-09-12T17:29:48.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.448+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55892ad087c0 con 0x55892ad009b0 2024-09-12T17:29:48.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.448+0000 7f134f7fe640 1 -- 172.21.15.170:0/3104996805 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1478021a90 con 0x55892ad009b0 2024-09-12T17:29:48.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.449+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55892ad09350 con 0x55892ad009b0 2024-09-12T17:29:48.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.450+0000 7f134f7fe640 1 -- 172.21.15.170:0/3104996805 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f147804d070 con 0x55892ad009b0 2024-09-12T17:29:48.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.450+0000 7f134f7fe640 1 --2- 172.21.15.170:0/3104996805 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f134803c730 0x7f134803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.450+0000 7f134f7fe640 1 -- 172.21.15.170:0/3104996805 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f1478036be0 con 0x55892ad009b0 2024-09-12T17:29:48.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.450+0000 7f147db61640 1 --2- 172.21.15.170:0/3104996805 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f134803c730 0x7f134803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.451+0000 7f1481f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.451+0000 7f147db61640 1 --2- 172.21.15.170:0/3104996805 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f134803c730 0x7f134803ebf0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f147001c020 tx=0x7f1470032000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.451+0000 7f1481f2c800 1 --2- 172.21.15.170:0/3104996805 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55892ad138a0 0x55892ad15d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.451+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55892ad164b0 con 0x55892ad138a0 2024-09-12T17:29:48.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.451+0000 7f1475360640 1 --2- 172.21.15.170:0/3104996805 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55892ad138a0 0x55892ad15d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.451+0000 7f1475360640 1 --2- 172.21.15.170:0/3104996805 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55892ad138a0 0x55892ad15d60 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.452+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1468057030 con 0x55892ad138a0 2024-09-12T17:29:48.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.452+0000 7f1481f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.452+0000 7f1481f2c800 20 realm 2024-09-12T17:29:48.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.452+0000 7f1481f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.452+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55892ad168e0 con 0x55892ad138a0 2024-09-12T17:29:48.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.452+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1468057030 con 0x55892ad138a0 2024-09-12T17:29:48.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.452+0000 7f1481f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.452+0000 7f1481f2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:29:48.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.452+0000 7f1481f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.452+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55892ad171b0 con 0x55892ad138a0 2024-09-12T17:29:48.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.452+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1468057030 con 0x55892ad138a0 2024-09-12T17:29:48.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.452+0000 7f1481f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.452+0000 7f1481f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.452+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55892ad17550 con 0x55892ad138a0 2024-09-12T17:29:48.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.452+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1468057030 con 0x55892ad138a0 2024-09-12T17:29:48.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.452+0000 7f1481f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:48.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.452+0000 7f1481f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.452+0000 7f1481f2c800 1 --2- 172.21.15.170:0/3104996805 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55892ad182b0 0x55892ad1a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.452+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55892ad1acb0 con 0x55892ad182b0 2024-09-12T17:29:48.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.453+0000 7f147e362640 1 --2- 172.21.15.170:0/3104996805 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55892ad182b0 0x55892ad1a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.453+0000 7f147e362640 1 --2- 172.21.15.170:0/3104996805 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55892ad182b0 0x55892ad1a6a0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.453+0000 7f147e362640 1 -- 172.21.15.170:0/3104996805 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f147803b020 con 0x55892ad182b0 2024-09-12T17:29:48.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.453+0000 7f1481f2c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:29:48.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.453+0000 7f1481f2c800 20 searching for the correct realm 2024-09-12T17:29:48.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.453+0000 7f1481f2c800 1 --2- 172.21.15.170:0/3104996805 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55892ad1cc80 0x55892ad1f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.453+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55892ad1f7c0 con 0x55892ad1cc80 2024-09-12T17:29:48.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.453+0000 7f147db61640 1 --2- 172.21.15.170:0/3104996805 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55892ad1cc80 0x55892ad1f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.453+0000 7f147db61640 1 --2- 172.21.15.170:0/3104996805 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55892ad1cc80 0x55892ad1f140 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.454+0000 7f147db61640 1 -- 172.21.15.170:0/3104996805 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f147003b040 con 0x55892ad1cc80 2024-09-12T17:29:48.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.454+0000 7f147db61640 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55892ad1f7c0 con 0x55892ad182b0 2024-09-12T17:29:48.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.454+0000 7f147e362640 1 -- 172.21.15.170:0/3104996805 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f147803b020 con 0x55892ad182b0 2024-09-12T17:29:48.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.454+0000 7f147e362640 1 --2- 172.21.15.170:0/3104996805 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f147800caf0 0x7f147804ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.454+0000 7f147e362640 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55892ad1f7c0 con 0x7f147800caf0 2024-09-12T17:29:48.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.454+0000 7f1475360640 1 --2- 172.21.15.170:0/3104996805 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f147800caf0 0x7f147804ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.455+0000 7f1475360640 1 --2- 172.21.15.170:0/3104996805 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f147800caf0 0x7f147804ea30 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.455+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1468057030 con 0x7f147800caf0 2024-09-12T17:29:48.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.455+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55892ad1f7c0 con 0x55892ad138a0 2024-09-12T17:29:48.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.455+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1468057030 con 0x55892ad138a0 2024-09-12T17:29:48.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.455+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55892ad1f7c0 con 0x55892ad138a0 2024-09-12T17:29:48.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.455+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1468057030 con 0x55892ad138a0 2024-09-12T17:29:48.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.455+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55892ad1f7c0 con 0x7f147800caf0 2024-09-12T17:29:48.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.456+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1468057030 con 0x7f147800caf0 2024-09-12T17:29:48.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.456+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55892ad1f7c0 con 0x7f147800caf0 2024-09-12T17:29:48.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.456+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1468057030 con 0x7f147800caf0 2024-09-12T17:29:48.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.456+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55892ad1f7c0 con 0x55892ad182b0 2024-09-12T17:29:48.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.456+0000 7f147e362640 1 -- 172.21.15.170:0/3104996805 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f147803b020 con 0x55892ad182b0 2024-09-12T17:29:48.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.456+0000 7f147e362640 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55892ad1f7c0 con 0x55892ad1cc80 2024-09-12T17:29:48.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.456+0000 7f147db61640 1 -- 172.21.15.170:0/3104996805 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f147003b040 con 0x55892ad1cc80 2024-09-12T17:29:48.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.456+0000 7f147db61640 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55892ad1f7c0 con 0x55892ad138a0 2024-09-12T17:29:48.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.456+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1468057030 con 0x55892ad138a0 2024-09-12T17:29:48.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.456+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55892ad1f7c0 con 0x7f147800caf0 2024-09-12T17:29:48.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.457+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1468057030 con 0x7f147800caf0 2024-09-12T17:29:48.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.457+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55892ad1f7c0 con 0x55892ad138a0 2024-09-12T17:29:48.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.457+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1468057030 con 0x55892ad138a0 2024-09-12T17:29:48.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.457+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55892ad1f7c0 con 0x55892ad182b0 2024-09-12T17:29:48.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.457+0000 7f147e362640 1 -- 172.21.15.170:0/3104996805 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f147803b020 con 0x55892ad182b0 2024-09-12T17:29:48.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.457+0000 7f147e362640 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55892ad1f7c0 con 0x55892ad1cc80 2024-09-12T17:29:48.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.457+0000 7f147db61640 1 -- 172.21.15.170:0/3104996805 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f147003b040 con 0x55892ad1cc80 2024-09-12T17:29:48.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.457+0000 7f147db61640 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55892ad1f7c0 con 0x55892ad1cc80 2024-09-12T17:29:48.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.458+0000 7f147db61640 1 -- 172.21.15.170:0/3104996805 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f147003b040 con 0x55892ad1cc80 2024-09-12T17:29:48.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.458+0000 7f147db61640 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55892ad1f7c0 con 0x55892ad182b0 2024-09-12T17:29:48.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.458+0000 7f147e362640 1 -- 172.21.15.170:0/3104996805 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f147803b020 con 0x55892ad182b0 2024-09-12T17:29:48.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.458+0000 7f147e362640 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55892ad1f7c0 con 0x55892ad1cc80 2024-09-12T17:29:48.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.458+0000 7f147db61640 1 -- 172.21.15.170:0/3104996805 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f147003b040 con 0x55892ad1cc80 2024-09-12T17:29:48.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.458+0000 7f147db61640 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55892ad1f7c0 con 0x55892ad1cc80 2024-09-12T17:29:48.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.458+0000 7f147db61640 1 -- 172.21.15.170:0/3104996805 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f147003b040 con 0x55892ad1cc80 2024-09-12T17:29:48.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.458+0000 7f147db61640 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55892ad1f7c0 con 0x55892ad138a0 2024-09-12T17:29:48.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.459+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1468057030 con 0x55892ad138a0 2024-09-12T17:29:48.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.459+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55892ad1f7c0 con 0x55892ad138a0 2024-09-12T17:29:48.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.459+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v31'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1468057030 con 0x55892ad138a0 2024-09-12T17:29:48.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.459+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55892ad1f7c0 con 0x7f147800caf0 2024-09-12T17:29:48.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.459+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1468057030 con 0x7f147800caf0 2024-09-12T17:29:48.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.459+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55892ad1f7c0 con 0x55892ad1cc80 2024-09-12T17:29:48.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.459+0000 7f147db61640 1 -- 172.21.15.170:0/3104996805 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f147003b040 con 0x55892ad1cc80 2024-09-12T17:29:48.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.459+0000 7f147db61640 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55892ad1f7c0 con 0x55892ad182b0 2024-09-12T17:29:48.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.460+0000 7f147e362640 1 -- 172.21.15.170:0/3104996805 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f147803b020 con 0x55892ad182b0 2024-09-12T17:29:48.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.460+0000 7f147e362640 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55892ad1f7c0 con 0x55892ad138a0 2024-09-12T17:29:48.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.460+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1468057030 con 0x55892ad138a0 2024-09-12T17:29:48.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.460+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55892ad1f7c0 con 0x7f147800caf0 2024-09-12T17:29:48.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.460+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1468057030 con 0x7f147800caf0 2024-09-12T17:29:48.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.460+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55892ad1f7c0 con 0x55892ad1cc80 2024-09-12T17:29:48.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.460+0000 7f147db61640 1 -- 172.21.15.170:0/3104996805 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f147003b040 con 0x55892ad1cc80 2024-09-12T17:29:48.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.460+0000 7f147db61640 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55892ad1f7c0 con 0x7f147800caf0 2024-09-12T17:29:48.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.461+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1468057030 con 0x7f147800caf0 2024-09-12T17:29:48.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.461+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55892ad1f7c0 con 0x55892ad182b0 2024-09-12T17:29:48.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.461+0000 7f147e362640 1 -- 172.21.15.170:0/3104996805 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f147806a040 con 0x55892ad182b0 2024-09-12T17:29:48.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.461+0000 7f147e362640 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55892ad1f7c0 con 0x55892ad1cc80 2024-09-12T17:29:48.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.461+0000 7f147db61640 1 -- 172.21.15.170:0/3104996805 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f147003b040 con 0x55892ad1cc80 2024-09-12T17:29:48.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.461+0000 7f147db61640 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55892ad1f7c0 con 0x7f147800caf0 2024-09-12T17:29:48.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.461+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1468057030 con 0x7f147800caf0 2024-09-12T17:29:48.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.461+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55892ad1f7c0 con 0x55892ad138a0 2024-09-12T17:29:48.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.462+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1468057030 con 0x55892ad138a0 2024-09-12T17:29:48.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.462+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55892ad1f7c0 con 0x55892ad182b0 2024-09-12T17:29:48.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.462+0000 7f147e362640 1 -- 172.21.15.170:0/3104996805 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(37 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f147806a040 con 0x55892ad182b0 2024-09-12T17:29:48.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.462+0000 7f1481f2c800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:29:48.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.462+0000 7f1481f2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:29:48.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.462+0000 7f1481f2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:29:48.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.462+0000 7f1481f2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:29:48.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.462+0000 7f1481f2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:29:48.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.462+0000 7f1481f2c800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:29:48.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.462+0000 7f1481f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.462+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55892ad1b670 con 0x55892ad138a0 2024-09-12T17:29:48.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.462+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1468057030 con 0x55892ad138a0 2024-09-12T17:29:48.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.462+0000 7f1481f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.462+0000 7f1481f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.462+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55892ad1bf10 con 0x55892ad138a0 2024-09-12T17:29:48.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.462+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1468057030 con 0x55892ad138a0 2024-09-12T17:29:48.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.462+0000 7f1481f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:48.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.462+0000 7f1481f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.462+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55892ad1b2b0 con 0x55892ad182b0 2024-09-12T17:29:48.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.463+0000 7f147e362640 1 -- 172.21.15.170:0/3104996805 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f147806a040 con 0x55892ad182b0 2024-09-12T17:29:48.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.463+0000 7f1481f2c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:29:48.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.463+0000 7f1481f2c800 20 zone default found 2024-09-12T17:29:48.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.463+0000 7f1481f2c800 4 Realm: () 2024-09-12T17:29:48.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.463+0000 7f1481f2c800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:29:48.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.463+0000 7f1481f2c800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:29:48.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.463+0000 7f1481f2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:29:48.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.463+0000 7f1481f2c800 20 zonegroup default 2024-09-12T17:29:48.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.463+0000 7f1481f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.463+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55892ad200f0 con 0x7f147800caf0 2024-09-12T17:29:48.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.463+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1468057030 con 0x7f147800caf0 2024-09-12T17:29:48.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.463+0000 7f1481f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.463+0000 7f1481f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.463+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55892ad22330 con 0x55892ad1cc80 2024-09-12T17:29:48.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.463+0000 7f147db61640 1 -- 172.21.15.170:0/3104996805 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f147003b040 con 0x55892ad1cc80 2024-09-12T17:29:48.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.463+0000 7f1481f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.463+0000 7f1481f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.463+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55892ad226d0 con 0x55892ad1cc80 2024-09-12T17:29:48.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.463+0000 7f147db61640 1 -- 172.21.15.170:0/3104996805 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f147003b040 con 0x55892ad1cc80 2024-09-12T17:29:48.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.463+0000 7f1481f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.463+0000 7f1481f2c800 20 started sync module instance, tier type = 2024-09-12T17:29:48.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.463+0000 7f1481f2c800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:29:48.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.463+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55892ad21770 con 0x55892ad182b0 2024-09-12T17:29:48.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.464+0000 7f147e362640 1 -- 172.21.15.170:0/3104996805 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(44 notify.0 [create] v31'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f147806a040 con 0x55892ad182b0 2024-09-12T17:29:48.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.464+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94047617293152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55892ad21f80 con 0x55892ad182b0 2024-09-12T17:29:48.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.465+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55892ad23540 con 0x55892ad138a0 2024-09-12T17:29:48.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.465+0000 7f147e362640 1 -- 172.21.15.170:0/3104996805 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94047617293152] v31'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f147806a040 con 0x55892ad182b0 2024-09-12T17:29:48.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.466+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v31'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1468057030 con 0x55892ad138a0 2024-09-12T17:29:48.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.466+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94047617298576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55892ad234b0 con 0x55892ad138a0 2024-09-12T17:29:48.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.466+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55892ad24400 con 0x55892ad1cc80 2024-09-12T17:29:48.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.467+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94047617298576] v31'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1468057030 con 0x55892ad138a0 2024-09-12T17:29:48.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.467+0000 7f147db61640 1 -- 172.21.15.170:0/3104996805 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v31'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f147003b040 con 0x55892ad1cc80 2024-09-12T17:29:48.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.467+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94047617302352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55892ad247f0 con 0x55892ad1cc80 2024-09-12T17:29:48.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.467+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55892ad251f0 con 0x55892ad182b0 2024-09-12T17:29:48.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.468+0000 7f147db61640 1 -- 172.21.15.170:0/3104996805 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94047617302352] v31'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f147003b040 con 0x55892ad1cc80 2024-09-12T17:29:48.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.468+0000 7f147e362640 1 -- 172.21.15.170:0/3104996805 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(50 notify.3 [create] v31'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f147806a040 con 0x55892ad182b0 2024-09-12T17:29:48.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.468+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94047617300784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55892ad255e0 con 0x55892ad182b0 2024-09-12T17:29:48.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.468+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55892ad26000 con 0x55892ad138a0 2024-09-12T17:29:48.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.469+0000 7f147e362640 1 -- 172.21.15.170:0/3104996805 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94047617300784] v31'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f147806a040 con 0x55892ad182b0 2024-09-12T17:29:48.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.469+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v31'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1468057030 con 0x55892ad138a0 2024-09-12T17:29:48.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.469+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94047617309424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55892ad25fc0 con 0x55892ad138a0 2024-09-12T17:29:48.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.469+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55892ad26a90 con 0x7f147800caf0 2024-09-12T17:29:48.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.470+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94047617309424] v31'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1468057030 con 0x55892ad138a0 2024-09-12T17:29:48.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.470+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(54 notify.5 [create] v31'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1468057030 con 0x7f147800caf0 2024-09-12T17:29:48.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.470+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94047617305856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55892ad26a90 con 0x7f147800caf0 2024-09-12T17:29:48.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.470+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55892ad274a0 con 0x7f147800caf0 2024-09-12T17:29:48.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.471+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94047617305856] v31'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1468057030 con 0x7f147800caf0 2024-09-12T17:29:48.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.472+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v31'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1468057030 con 0x7f147800caf0 2024-09-12T17:29:48.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.472+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94047617312144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55892ad274a0 con 0x7f147800caf0 2024-09-12T17:29:48.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.472+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55892ad27e60 con 0x7f147800caf0 2024-09-12T17:29:48.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.472+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94047617312144] v31'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1468057030 con 0x7f147800caf0 2024-09-12T17:29:48.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.473+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(58 notify.7 [create] v31'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1468057030 con 0x7f147800caf0 2024-09-12T17:29:48.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.473+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94047617314800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55892ad28040 con 0x7f147800caf0 2024-09-12T17:29:48.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.473+0000 7f1481f2c800 20 add_watcher() i=0 2024-09-12T17:29:48.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.473+0000 7f1481f2c800 20 add_watcher() i=1 2024-09-12T17:29:48.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.473+0000 7f1481f2c800 20 add_watcher() i=2 2024-09-12T17:29:48.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.473+0000 7f1481f2c800 20 add_watcher() i=3 2024-09-12T17:29:48.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.473+0000 7f1481f2c800 20 add_watcher() i=4 2024-09-12T17:29:48.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.473+0000 7f1481f2c800 20 add_watcher() i=5 2024-09-12T17:29:48.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.473+0000 7f1481f2c800 20 add_watcher() i=6 2024-09-12T17:29:48.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.473+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94047617314800] v31'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1468057030 con 0x7f147800caf0 2024-09-12T17:29:48.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.473+0000 7f1481f2c800 20 add_watcher() i=7 2024-09-12T17:29:48.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.473+0000 7f1481f2c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:29:48.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.473+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55892ad2b1f0 con 0x55892ad138a0 2024-09-12T17:29:48.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.474+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1468057030 con 0x55892ad138a0 2024-09-12T17:29:48.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.474+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94047617330048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55892ad27f90 con 0x55892ad138a0 2024-09-12T17:29:48.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.475+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94047617330048] v31'268 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1468057030 con 0x55892ad138a0 2024-09-12T17:29:48.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.475+0000 7f132f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:48.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.475+0000 7f1481f2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:29:48.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.475+0000 7f1481f2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:29:48.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.475+0000 7f1481f2c800 5 note: GC not initialized 2024-09-12T17:29:48.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.475+0000 7f132e7fc640 20 reqs_thread_entry: start 2024-09-12T17:29:48.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.475+0000 7f1481f2c800 20 init_complete bucket index max shards: 11 2024-09-12T17:29:48.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.475+0000 7f1481f2c800 20 Filter name: none 2024-09-12T17:29:48.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.475+0000 7f129ffff640 20 reqs_thread_entry: start 2024-09-12T17:29:48.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.476+0000 7f1481f2c800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-12T17:29:48.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.476+0000 7f1481f2c800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.476+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55892ad5e390 con 0x7f147800caf0 2024-09-12T17:29:48.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.476+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f1468057030 con 0x7f147800caf0 2024-09-12T17:29:48.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.476+0000 7f1481f2c800 20 rados_obj.operate() r=0 bl.length=490 2024-09-12T17:29:48.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.476+0000 7f1481f2c800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-12T17:29:48.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.476+0000 7f1481f2c800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:29:48.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.476+0000 7f1481f2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:29:48.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.476+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55892ad648d0 con 0x7f147800caf0 2024-09-12T17:29:48.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.477+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v31'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f1468089040 con 0x7f147800caf0 2024-09-12T17:29:48.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.477+0000 7f1481f2c800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T17:29:48.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.477+0000 7f1481f2c800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:29:48.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.477+0000 7f1481f2c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-12T17:29:48.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.477+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94047617565328 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55892ad5ff10 con 0x55892ad138a0 2024-09-12T17:29:48.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.478+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== watch-notify(notify (1) cookie 94047617309424 notify 133143986205 ret 0) ==== 678+0+0 (crc 0 0 0) 0x55892aa706b0 con 0x55892ad138a0 2024-09-12T17:29:48.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.478+0000 7f13617fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986205 cookie 94047617309424 notifier 4904 bl.length()=636 2024-09-12T17:29:48.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.478+0000 7f13617fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T17:29:48.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.478+0000 7f13617fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:29:48.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.478+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(64 notify.4 [notify cookie 94047617565328 out=8b] v0'0 uv273 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1468089040 con 0x55892ad138a0 2024-09-12T17:29:48.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.478+0000 7f13617fa640 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f1340003ea0 con 0x55892ad138a0 2024-09-12T17:29:48.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.478+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1468089040 con 0x55892ad138a0 2024-09-12T17:29:48.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.478+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== watch-notify(notify_complete (2) cookie 94047617565328 notify 133143986205 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f146805ba90 con 0x55892ad138a0 2024-09-12T17:29:48.490 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-12T17:29:46.782056Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:29:46.782042Z","tags":[],"group_ids":[]} 2024-09-12T17:29:48.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.479+0000 7f132f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:48.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.479+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94047617330048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55892ad5c1e0 con 0x55892ad138a0 2024-09-12T17:29:48.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.480+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94047617330048] v31'269 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1468089040 con 0x55892ad138a0 2024-09-12T17:29:48.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.480+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94047617293152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55892ad5c1e0 con 0x55892ad182b0 2024-09-12T17:29:48.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.481+0000 7f147e362640 1 -- 172.21.15.170:0/3104996805 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94047617293152] v31'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f147806a040 con 0x55892ad182b0 2024-09-12T17:29:48.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.481+0000 7f1481f2c800 20 remove_watcher() i=0 2024-09-12T17:29:48.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.481+0000 7f1481f2c800 2 removed watcher, disabling cache 2024-09-12T17:29:48.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.481+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94047617298576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55892ad5c1e0 con 0x55892ad138a0 2024-09-12T17:29:48.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.482+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94047617298576] v31'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1468089040 con 0x55892ad138a0 2024-09-12T17:29:48.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.482+0000 7f1481f2c800 20 remove_watcher() i=1 2024-09-12T17:29:48.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.482+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94047617302352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55892ad5c1e0 con 0x55892ad1cc80 2024-09-12T17:29:48.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.483+0000 7f147db61640 1 -- 172.21.15.170:0/3104996805 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94047617302352] v31'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f147003b040 con 0x55892ad1cc80 2024-09-12T17:29:48.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.483+0000 7f1481f2c800 20 remove_watcher() i=2 2024-09-12T17:29:48.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.483+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94047617300784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55892ad23090 con 0x55892ad182b0 2024-09-12T17:29:48.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.484+0000 7f147e362640 1 -- 172.21.15.170:0/3104996805 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94047617300784] v31'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f147806a040 con 0x55892ad182b0 2024-09-12T17:29:48.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.484+0000 7f1481f2c800 20 remove_watcher() i=3 2024-09-12T17:29:48.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.484+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94047617309424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55892ad23090 con 0x55892ad138a0 2024-09-12T17:29:48.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.485+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94047617309424] v31'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1468089040 con 0x55892ad138a0 2024-09-12T17:29:48.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.485+0000 7f1481f2c800 20 remove_watcher() i=4 2024-09-12T17:29:48.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.485+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94047617305856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55892ad25af0 con 0x7f147800caf0 2024-09-12T17:29:48.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.487+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94047617305856] v31'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1468089040 con 0x7f147800caf0 2024-09-12T17:29:48.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.487+0000 7f1481f2c800 20 remove_watcher() i=5 2024-09-12T17:29:48.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.487+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94047617312144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55892ad23090 con 0x7f147800caf0 2024-09-12T17:29:48.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.488+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94047617312144] v31'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1468089040 con 0x7f147800caf0 2024-09-12T17:29:48.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.488+0000 7f1481f2c800 20 remove_watcher() i=6 2024-09-12T17:29:48.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.488+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94047617314800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55892ad24d00 con 0x7f147800caf0 2024-09-12T17:29:48.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.489+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94047617314800] v31'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1468089040 con 0x7f147800caf0 2024-09-12T17:29:48.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.489+0000 7f1481f2c800 20 remove_watcher() i=7 2024-09-12T17:29:48.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.489+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f147800caf0 msgr2=0x7f147804ea30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.489+0000 7f1481f2c800 1 --2- 172.21.15.170:0/3104996805 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f147800caf0 0x7f147804ea30 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.489+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55892ad138a0 msgr2=0x55892ad15d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.489+0000 7f1481f2c800 1 --2- 172.21.15.170:0/3104996805 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55892ad138a0 0x55892ad15d60 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.489+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55892ad182b0 msgr2=0x55892ad1a6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.489+0000 7f1481f2c800 1 --2- 172.21.15.170:0/3104996805 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55892ad182b0 0x55892ad1a6a0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.489+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55892ad1cc80 msgr2=0x55892ad1f140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.489+0000 7f1481f2c800 1 --2- 172.21.15.170:0/3104996805 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55892ad1cc80 0x55892ad1f140 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.489+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f134803c730 msgr2=0x7f134803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.489+0000 7f1481f2c800 1 --2- 172.21.15.170:0/3104996805 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f134803c730 0x7f134803ebf0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f147001c020 tx=0x7f1470032000 comp rx=0 tx=0).stop 2024-09-12T17:29:48.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.489+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55892ad009b0 msgr2=0x55892ad07fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.489+0000 7f1475360640 1 -- 172.21.15.170:0/3104996805 reap_dead start 2024-09-12T17:29:48.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.489+0000 7f1481f2c800 1 --2- 172.21.15.170:0/3104996805 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55892ad009b0 0x55892ad07fd0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f1478048040 tx=0x7f1478053d00 comp rx=0 tx=0).stop 2024-09-12T17:29:48.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.489+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 shutdown_connections 2024-09-12T17:29:48.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.489+0000 7f1481f2c800 1 --2- 172.21.15.170:0/3104996805 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55892ad009b0 0x55892ad07fd0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.489+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 >> 172.21.15.170:0/3104996805 conn(0x55892acfcdb0 msgr2=0x55892acfafc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:48.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.489+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 shutdown_connections 2024-09-12T17:29:48.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.489+0000 7f1481f2c800 1 -- 172.21.15.170:0/3104996805 wait complete. 2024-09-12T17:29:48.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.489+0000 7f1481f2c800 1 -- 172.21.15.170:0/2042998645 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f135803c780 msgr2=0x7f135803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.489+0000 7f1481f2c800 1 --2- 172.21.15.170:0/2042998645 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f135803c780 0x7f135803ec40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1470001530 tx=0x7f14700014a0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.489+0000 7f1481f2c800 1 -- 172.21.15.170:0/2042998645 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55892acf3f10 msgr2=0x55892acf4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.489+0000 7f1481f2c800 1 --2- 172.21.15.170:0/2042998645 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55892acf3f10 0x55892acf4330 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x55892acda3c0 tx=0x7f14780167b0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.489+0000 7f1481f2c800 1 -- 172.21.15.170:0/2042998645 shutdown_connections 2024-09-12T17:29:48.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.489+0000 7f1481f2c800 1 --2- 172.21.15.170:0/2042998645 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f135803c780 0x7f135803ec40 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.489+0000 7f1481f2c800 1 --2- 172.21.15.170:0/2042998645 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55892acf3f10 0x55892acf4330 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.489+0000 7f1481f2c800 1 -- 172.21.15.170:0/2042998645 >> 172.21.15.170:0/2042998645 conn(0x55892ace82c0 msgr2=0x55892ace86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:48.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.489+0000 7f1481f2c800 1 -- 172.21.15.170:0/2042998645 shutdown_connections 2024-09-12T17:29:48.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.489+0000 7f1481f2c800 1 -- 172.21.15.170:0/2042998645 wait complete. 2024-09-12T17:29:48.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.490+0000 7f1481f2c800 1 -- 172.21.15.170:0/890562595 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55892abdffc0 msgr2=0x55892ace0650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.490+0000 7f1481f2c800 1 --2- 172.21.15.170:0/890562595 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55892abdffc0 0x55892ace0650 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.490+0000 7f1481f2c800 1 -- 172.21.15.170:0/890562595 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55892ace29f0 msgr2=0x55892ace4e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.490+0000 7f1481f2c800 1 --2- 172.21.15.170:0/890562595 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55892ace29f0 0x55892ace4e90 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.490+0000 7f1481f2c800 1 -- 172.21.15.170:0/890562595 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f136403c730 msgr2=0x7f136403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.490+0000 7f1481f2c800 1 --2- 172.21.15.170:0/890562595 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f136403c730 0x7f136403ebf0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1468057000 tx=0x7f1468052000 comp rx=0 tx=0).stop 2024-09-12T17:29:48.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.490+0000 7f1481f2c800 1 -- 172.21.15.170:0/890562595 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55892abde4a0 msgr2=0x55892acd9000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.490+0000 7f1481f2c800 1 --2- 172.21.15.170:0/890562595 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55892abde4a0 0x55892acd9000 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x55892acd2860 tx=0x7f1470000ed0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.490+0000 7f1481f2c800 1 -- 172.21.15.170:0/890562595 shutdown_connections 2024-09-12T17:29:48.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.490+0000 7f1481f2c800 1 --2- 172.21.15.170:0/890562595 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55892ace29f0 0x55892ace4e90 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.490+0000 7f1481f2c800 1 --2- 172.21.15.170:0/890562595 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f136403c730 0x7f136403ebf0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.490+0000 7f1481f2c800 1 --2- 172.21.15.170:0/890562595 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55892abdffc0 0x55892ace0650 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.490+0000 7f1481f2c800 1 --2- 172.21.15.170:0/890562595 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55892abde4a0 0x55892acd9000 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.490+0000 7f1481f2c800 1 -- 172.21.15.170:0/890562595 >> 172.21.15.170:0/890562595 conn(0x55892abda1d0 msgr2=0x55892acd2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:48.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.490+0000 7f1481f2c800 1 -- 172.21.15.170:0/890562595 shutdown_connections 2024-09-12T17:29:48.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.490+0000 7f1481f2c800 1 -- 172.21.15.170:0/890562595 wait complete. 2024-09-12T17:29:48.502 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T17:29:46.782056Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:29:46.782042Z', 'tags': [], 'group_ids': []} 2024-09-12T17:29:48.502 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T17:29:46.782056Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:29:46.782042Z', 'tags': [], 'group_ids': []} 2024-09-12T17:29:48.502 ERROR:root:0 2024-09-12T17:29:48.502 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-12T17:29:48.502 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-12T17:29:48.503 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-12T17:29:48.549 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:29:48.550 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:29:48.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.549+0000 7fe5b1135800 1 Processor -- start 2024-09-12T17:29:48.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.549+0000 7fe5b1135800 1 -- start start 2024-09-12T17:29:48.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.549+0000 7fe5b1135800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55a5565656b0 0x55a556567aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.549+0000 7fe5b1135800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a55640ee40 con 0x55a556568040 2024-09-12T17:29:48.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.549+0000 7fe5b1135800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x55a5563d9680 con 0x55a5565656b0 2024-09-12T17:29:48.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.549+0000 7fe5ace21640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x55a5565656b0 0x55a556567aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.549+0000 7fe5ac620640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x55a556568040 0x55a55656a4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:44974/0 (socket says 172.21.15.170:44974) 2024-09-12T17:29:48.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.549+0000 7fe5ac620640 1 -- 172.21.15.170:0/1399938630 learned_addr learned my addr 172.21.15.170:0/1399938630 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:29:48.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.549+0000 7fe5abe1f640 1 -- 172.21.15.170:0/1399938630 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3671095941 0 0) 0x55a55640ee40 con 0x55a556568040 2024-09-12T17:29:48.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.549+0000 7fe5abe1f640 1 -- 172.21.15.170:0/1399938630 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe598001e10 con 0x55a556568040 2024-09-12T17:29:48.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.550+0000 7fe5ace21640 1 -- 172.21.15.170:0/1399938630 >> v1:172.21.15.47:6789/0 conn(0x55a556568040 legacy=0x55a55656a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.550+0000 7fe5ace21640 1 -- 172.21.15.170:0/1399938630 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5563f56b0 con 0x55a5565656b0 2024-09-12T17:29:48.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.551+0000 7fe5ace21640 1 --2- 172.21.15.170:0/1399938630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5565656b0 0x55a556567aa0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4005fd0 tx=0x7fe5a4045b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3904ceb5f12c23c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.551+0000 7fe5abe1f640 1 -- 172.21.15.170:0/1399938630 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5a4055070 con 0x55a5565656b0 2024-09-12T17:29:48.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.551+0000 7fe5abe1f640 1 -- 172.21.15.170:0/1399938630 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5a4051540 con 0x55a5565656b0 2024-09-12T17:29:48.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.551+0000 7fe5abe1f640 1 -- 172.21.15.170:0/1399938630 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5a4051820 con 0x55a5565656b0 2024-09-12T17:29:48.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.552+0000 7fe5b1135800 1 -- 172.21.15.170:0/1399938630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5565656b0 msgr2=0x55a556567aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.552+0000 7fe5b1135800 1 --2- 172.21.15.170:0/1399938630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5565656b0 0x55a556567aa0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4005fd0 tx=0x7fe5a4045b30 comp rx=0 tx=0).stop 2024-09-12T17:29:48.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.552+0000 7fe5b1135800 1 -- 172.21.15.170:0/1399938630 shutdown_connections 2024-09-12T17:29:48.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.552+0000 7fe5b1135800 1 --2- 172.21.15.170:0/1399938630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5565656b0 0x55a556567aa0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.552+0000 7fe5b1135800 1 -- 172.21.15.170:0/1399938630 >> 172.21.15.170:0/1399938630 conn(0x55a55655f1d0 msgr2=0x55a556561630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:48.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.552+0000 7fe5b1135800 1 -- 172.21.15.170:0/1399938630 shutdown_connections 2024-09-12T17:29:48.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.552+0000 7fe5b1135800 1 -- 172.21.15.170:0/1399938630 wait complete. 2024-09-12T17:29:48.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.566+0000 7fe5b1135800 1 Processor -- start 2024-09-12T17:29:48.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.566+0000 7fe5b1135800 1 -- start start 2024-09-12T17:29:48.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.566+0000 7fe5b1135800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5565656b0 0x55a556654530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.566+0000 7fe5b1135800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a5563fddd0 con 0x55a5565656b0 2024-09-12T17:29:48.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.566+0000 7fe5ace21640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5565656b0 0x55a556654530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.566+0000 7fe5ace21640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5565656b0 0x55a556654530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35454/0 (socket says 172.21.15.170:35454) 2024-09-12T17:29:48.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.566+0000 7fe5ace21640 1 -- 172.21.15.170:0/3857732757 learned_addr learned my addr 172.21.15.170:0/3857732757 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:48.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.567+0000 7fe5ace21640 1 -- 172.21.15.170:0/3857732757 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a556416e10 con 0x55a5565656b0 2024-09-12T17:29:48.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.567+0000 7fe5ace21640 1 --2- 172.21.15.170:0/3857732757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5565656b0 0x55a556654530 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4045b70 tx=0x7fe5a4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49f56d4577dd790d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.567+0000 7fe49ae0d640 1 -- 172.21.15.170:0/3857732757 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5a4055040 con 0x55a5565656b0 2024-09-12T17:29:48.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.567+0000 7fe49ae0d640 1 -- 172.21.15.170:0/3857732757 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5a4051a10 con 0x55a5565656b0 2024-09-12T17:29:48.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.567+0000 7fe49ae0d640 1 -- 172.21.15.170:0/3857732757 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5a4051cf0 con 0x55a5565656b0 2024-09-12T17:29:48.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.568+0000 7fe5b1135800 1 -- 172.21.15.170:0/3857732757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5565656b0 msgr2=0x55a556654530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.568+0000 7fe5b1135800 1 --2- 172.21.15.170:0/3857732757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5565656b0 0x55a556654530 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4045b70 tx=0x7fe5a4051000 comp rx=0 tx=0).stop 2024-09-12T17:29:48.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.568+0000 7fe5b1135800 1 -- 172.21.15.170:0/3857732757 shutdown_connections 2024-09-12T17:29:48.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.568+0000 7fe5b1135800 1 --2- 172.21.15.170:0/3857732757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5565656b0 0x55a556654530 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.568+0000 7fe5b1135800 1 -- 172.21.15.170:0/3857732757 >> 172.21.15.170:0/3857732757 conn(0x55a55655f1d0 msgr2=0x55a55664feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:48.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.568+0000 7fe5b1135800 1 -- 172.21.15.170:0/3857732757 shutdown_connections 2024-09-12T17:29:48.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.568+0000 7fe5b1135800 1 -- 172.21.15.170:0/3857732757 wait complete. 2024-09-12T17:29:48.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.568+0000 7fe5b1135800 1 Processor -- start 2024-09-12T17:29:48.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.568+0000 7fe5b1135800 1 -- start start 2024-09-12T17:29:48.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.568+0000 7fe5b1135800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5565656b0 0x55a55665bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.568+0000 7fe5b1135800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a55656c040 con 0x55a5565656b0 2024-09-12T17:29:48.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.568+0000 7fe5ace21640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5565656b0 0x55a55665bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.569+0000 7fe5ace21640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5565656b0 0x55a55665bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35458/0 (socket says 172.21.15.170:35458) 2024-09-12T17:29:48.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.569+0000 7fe5ace21640 1 -- 172.21.15.170:0/2661302616 learned_addr learned my addr 172.21.15.170:0/2661302616 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:48.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.569+0000 7fe5ace21640 1 -- 172.21.15.170:0/2661302616 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a55665c260 con 0x55a5565656b0 2024-09-12T17:29:48.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.569+0000 7fe5ace21640 1 --2- 172.21.15.170:0/2661302616 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5565656b0 0x55a55665bd00 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4045b70 tx=0x7fe5a4003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.569+0000 7fe49960a640 1 -- 172.21.15.170:0/2661302616 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5a4071020 con 0x55a5565656b0 2024-09-12T17:29:48.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.569+0000 7fe49960a640 1 -- 172.21.15.170:0/2661302616 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5a405a940 con 0x55a5565656b0 2024-09-12T17:29:48.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.569+0000 7fe5b1135800 1 -- 172.21.15.170:0/2661302616 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a55665c4f0 con 0x55a5565656b0 2024-09-12T17:29:48.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.569+0000 7fe49960a640 1 -- 172.21.15.170:0/2661302616 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5a4055030 con 0x55a5565656b0 2024-09-12T17:29:48.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.569+0000 7fe5b1135800 1 -- 172.21.15.170:0/2661302616 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a55665cef0 con 0x55a5565656b0 2024-09-12T17:29:48.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.570+0000 7fe49960a640 1 -- 172.21.15.170:0/2661302616 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe5a4074020 con 0x55a5565656b0 2024-09-12T17:29:48.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.570+0000 7fe49960a640 1 --2- 172.21.15.170:0/2661302616 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe49403c730 0x7fe49403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.570+0000 7fe49960a640 1 -- 172.21.15.170:0/2661302616 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fe5a406a040 con 0x55a5565656b0 2024-09-12T17:29:48.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.570+0000 7fe5ac620640 1 --2- 172.21.15.170:0/2661302616 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe49403c730 0x7fe49403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.570+0000 7fe5b1135800 1 --2- 172.21.15.170:0/2661302616 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a556568040 0x55a556663350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.570+0000 7fe5b1135800 1 -- 172.21.15.170:0/2661302616 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a556663890 con 0x55a556568040 2024-09-12T17:29:48.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.571+0000 7fe5ad622640 1 --2- 172.21.15.170:0/2661302616 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a556568040 0x55a556663350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.571+0000 7fe5ac620640 1 --2- 172.21.15.170:0/2661302616 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe49403c730 0x7fe49403ebf0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe594001db0 tx=0x7fe594001310 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.571+0000 7fe5ad622640 1 --2- 172.21.15.170:0/2661302616 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a556568040 0x55a556663350 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.571+0000 7fe5ad622640 1 -- 172.21.15.170:0/2661302616 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe59c0083e0 con 0x55a556568040 2024-09-12T17:29:48.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.571+0000 7fe5b1135800 1 -- 172.21.15.170:0/2661302616 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a556663c30 con 0x55a556568040 2024-09-12T17:29:48.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.571+0000 7fe5ad622640 1 -- 172.21.15.170:0/2661302616 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe59c0083e0 con 0x55a556568040 2024-09-12T17:29:48.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.571+0000 7fe5b1135800 1 --2- 172.21.15.170:0/2661302616 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a556665730 0x55a556667bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.571+0000 7fe5b1135800 1 -- 172.21.15.170:0/2661302616 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a556668360 con 0x55a556665730 2024-09-12T17:29:48.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.571+0000 7fe5ace21640 1 --2- 172.21.15.170:0/2661302616 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a556665730 0x55a556667bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.572+0000 7fe5ace21640 1 --2- 172.21.15.170:0/2661302616 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a556665730 0x55a556667bd0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.572+0000 7fe5ace21640 1 -- 172.21.15.170:0/2661302616 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe5a4093420 con 0x55a556665730 2024-09-12T17:29:48.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.572+0000 7fe5b1135800 1 -- 172.21.15.170:0/2661302616 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a556664480 con 0x55a556568040 2024-09-12T17:29:48.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.572+0000 7fe5ad622640 1 -- 172.21.15.170:0/2661302616 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe59c0083e0 con 0x55a556568040 2024-09-12T17:29:48.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.572+0000 7fe5b1135800 1 -- 172.21.15.170:0/2661302616 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5566648d0 con 0x55a556665730 2024-09-12T17:29:48.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.573+0000 7fe5ace21640 1 -- 172.21.15.170:0/2661302616 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe5a4093040 con 0x55a556665730 2024-09-12T17:29:48.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.573+0000 7fe5b1135800 1 Processor -- start 2024-09-12T17:29:48.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.573+0000 7fe5b1135800 1 -- start start 2024-09-12T17:29:48.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.573+0000 7fe5b1135800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a556564e50 0x55a5565636c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.573+0000 7fe5b1135800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a55645ba00 con 0x55a556564e50 2024-09-12T17:29:48.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.573+0000 7fe5ad622640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a556564e50 0x55a5565636c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.573+0000 7fe5ad622640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a556564e50 0x55a5565636c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35460/0 (socket says 172.21.15.170:35460) 2024-09-12T17:29:48.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.573+0000 7fe5ad622640 1 -- 172.21.15.170:0/760958305 learned_addr learned my addr 172.21.15.170:0/760958305 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:48.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.574+0000 7fe5ad622640 1 -- 172.21.15.170:0/760958305 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a556565370 con 0x55a556564e50 2024-09-12T17:29:48.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.574+0000 7fe5ad622640 1 --2- 172.21.15.170:0/760958305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a556564e50 0x55a5565636c0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x55a55665cd00 tx=0x7fe59c00bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.574+0000 7fe4927fc640 1 -- 172.21.15.170:0/760958305 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe59c01c020 con 0x55a556564e50 2024-09-12T17:29:48.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.574+0000 7fe4927fc640 1 -- 172.21.15.170:0/760958305 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe59c007c90 con 0x55a556564e50 2024-09-12T17:29:48.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.574+0000 7fe5b1135800 1 -- 172.21.15.170:0/760958305 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a556563c00 con 0x55a556564e50 2024-09-12T17:29:48.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.574+0000 7fe4927fc640 1 -- 172.21.15.170:0/760958305 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe59c018440 con 0x55a556564e50 2024-09-12T17:29:48.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.574+0000 7fe5b1135800 1 -- 172.21.15.170:0/760958305 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a556564150 con 0x55a556564e50 2024-09-12T17:29:48.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.575+0000 7fe4927fc640 1 -- 172.21.15.170:0/760958305 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe59c01f020 con 0x55a556564e50 2024-09-12T17:29:48.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.575+0000 7fe4927fc640 1 --2- 172.21.15.170:0/760958305 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe48403c780 0x7fe48403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.575+0000 7fe4927fc640 1 -- 172.21.15.170:0/760958305 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fe59c054e70 con 0x55a556564e50 2024-09-12T17:29:48.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.575+0000 7fe5ace21640 1 --2- 172.21.15.170:0/760958305 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe48403c780 0x7fe48403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.575+0000 7fe5b1135800 1 Processor -- start 2024-09-12T17:29:48.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.575+0000 7fe5ace21640 1 --2- 172.21.15.170:0/760958305 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe48403c780 0x7fe48403ec40 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x55a556664820 tx=0x7fe5a406df50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.575+0000 7fe5b1135800 1 -- start start 2024-09-12T17:29:48.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.576+0000 7fe5b1135800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a556685900 0x55a556685d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.576+0000 7fe5b1135800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a556654cc0 con 0x55a556685900 2024-09-12T17:29:48.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.576+0000 7fe5ad622640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a556685900 0x55a556685d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.576+0000 7fe5ad622640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a556685900 0x55a556685d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35474/0 (socket says 172.21.15.170:35474) 2024-09-12T17:29:48.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.576+0000 7fe5ad622640 1 -- 172.21.15.170:0/1536096608 learned_addr learned my addr 172.21.15.170:0/1536096608 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:48.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.576+0000 7fe5ad622640 1 -- 172.21.15.170:0/1536096608 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5566862f0 con 0x55a556685900 2024-09-12T17:29:48.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.576+0000 7fe5ad622640 1 --2- 172.21.15.170:0/1536096608 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a556685900 0x55a556685d00 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fe59c053280 tx=0x7fe59c053500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3ced7ac322b1787 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.576+0000 7fe483fff640 1 -- 172.21.15.170:0/1536096608 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe59c050020 con 0x55a556685900 2024-09-12T17:29:48.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.576+0000 7fe483fff640 1 -- 172.21.15.170:0/1536096608 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe59c0174d0 con 0x55a556685900 2024-09-12T17:29:48.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.576+0000 7fe483fff640 1 -- 172.21.15.170:0/1536096608 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe59c015820 con 0x55a556685900 2024-09-12T17:29:48.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.577+0000 7fe5b1135800 1 -- 172.21.15.170:0/1536096608 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a556685900 msgr2=0x55a556685d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.577+0000 7fe5b1135800 1 --2- 172.21.15.170:0/1536096608 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a556685900 0x55a556685d00 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fe59c053280 tx=0x7fe59c053500 comp rx=0 tx=0).stop 2024-09-12T17:29:48.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.577+0000 7fe5b1135800 1 -- 172.21.15.170:0/1536096608 shutdown_connections 2024-09-12T17:29:48.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.577+0000 7fe5b1135800 1 --2- 172.21.15.170:0/1536096608 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a556685900 0x55a556685d00 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.577+0000 7fe5b1135800 1 -- 172.21.15.170:0/1536096608 >> 172.21.15.170:0/1536096608 conn(0x55a556681d00 msgr2=0x55a55667ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:48.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.577+0000 7fe5b1135800 1 -- 172.21.15.170:0/1536096608 shutdown_connections 2024-09-12T17:29:48.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.577+0000 7fe5b1135800 1 -- 172.21.15.170:0/1536096608 wait complete. 2024-09-12T17:29:48.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.577+0000 7fe5b1135800 1 Processor -- start 2024-09-12T17:29:48.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.577+0000 7fe5b1135800 1 -- start start 2024-09-12T17:29:48.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.577+0000 7fe5b1135800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a556685900 0x55a55668cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.577+0000 7fe5b1135800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a556686910 con 0x55a556685900 2024-09-12T17:29:48.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.578+0000 7fe5ad622640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a556685900 0x55a55668cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.578+0000 7fe5ad622640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a556685900 0x55a55668cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35490/0 (socket says 172.21.15.170:35490) 2024-09-12T17:29:48.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.578+0000 7fe5ad622640 1 -- 172.21.15.170:0/3982474996 learned_addr learned my addr 172.21.15.170:0/3982474996 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:48.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.578+0000 7fe5ad622640 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a55668d490 con 0x55a556685900 2024-09-12T17:29:48.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.578+0000 7fe5ad622640 1 --2- 172.21.15.170:0/3982474996 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a556685900 0x55a55668cf30 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fe59c008fd0 tx=0x7fe59c0531e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.578+0000 7fe4827fc640 1 -- 172.21.15.170:0/3982474996 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe59c02e070 con 0x55a556685900 2024-09-12T17:29:48.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.578+0000 7fe4827fc640 1 -- 172.21.15.170:0/3982474996 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe59c0139e0 con 0x55a556685900 2024-09-12T17:29:48.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.578+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a55668d720 con 0x55a556685900 2024-09-12T17:29:48.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.578+0000 7fe4827fc640 1 -- 172.21.15.170:0/3982474996 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe59c04a040 con 0x55a556685900 2024-09-12T17:29:48.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.578+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a55668e0a0 con 0x55a556685900 2024-09-12T17:29:48.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.579+0000 7fe4827fc640 1 -- 172.21.15.170:0/3982474996 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe59c031070 con 0x55a556685900 2024-09-12T17:29:48.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.579+0000 7fe4827fc640 1 --2- 172.21.15.170:0/3982474996 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe47803c730 0x7fe47803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.579+0000 7fe4827fc640 1 -- 172.21.15.170:0/3982474996 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fe59c034c40 con 0x55a556685900 2024-09-12T17:29:48.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.579+0000 7fe5ace21640 1 --2- 172.21.15.170:0/3982474996 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe47803c730 0x7fe47803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.580+0000 7fe5ace21640 1 --2- 172.21.15.170:0/3982474996 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe47803c730 0x7fe47803ebf0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe5a40933f0 tx=0x7fe5a4088000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.580+0000 7fe5b1135800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.580+0000 7fe5b1135800 1 --2- 172.21.15.170:0/3982474996 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a556698880 0x55a55669ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.580+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a55669b490 con 0x55a556698880 2024-09-12T17:29:48.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.580+0000 7fe5ac620640 1 --2- 172.21.15.170:0/3982474996 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a556698880 0x55a55669ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.580+0000 7fe5ac620640 1 --2- 172.21.15.170:0/3982474996 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a556698880 0x55a55669ad40 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.581+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe594009050 con 0x55a556698880 2024-09-12T17:29:48.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.581+0000 7fe5b1135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.581+0000 7fe5b1135800 20 realm 2024-09-12T17:29:48.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.581+0000 7fe5b1135800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.581+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a556697bd0 con 0x55a556698880 2024-09-12T17:29:48.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.581+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe594009050 con 0x55a556698880 2024-09-12T17:29:48.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.581+0000 7fe5b1135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.581+0000 7fe5b1135800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:29:48.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.581+0000 7fe5b1135800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.581+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a55669bf80 con 0x55a556698880 2024-09-12T17:29:48.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.581+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe594009050 con 0x55a556698880 2024-09-12T17:29:48.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.581+0000 7fe5b1135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.581+0000 7fe5b1135800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.581+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a55669c850 con 0x55a556698880 2024-09-12T17:29:48.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.581+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe594009050 con 0x55a556698880 2024-09-12T17:29:48.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.581+0000 7fe5b1135800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:48.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.581+0000 7fe5b1135800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.581+0000 7fe5b1135800 1 --2- 172.21.15.170:0/3982474996 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a55669d270 0x55a55669f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.581+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a55669fda0 con 0x55a55669d270 2024-09-12T17:29:48.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.582+0000 7fe5ad622640 1 --2- 172.21.15.170:0/3982474996 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a55669d270 0x55a55669f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.582+0000 7fe5ad622640 1 --2- 172.21.15.170:0/3982474996 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a55669d270 0x55a55669f660 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.582+0000 7fe5ad622640 1 -- 172.21.15.170:0/3982474996 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe59c03a070 con 0x55a55669d270 2024-09-12T17:29:48.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.582+0000 7fe5b1135800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:29:48.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.582+0000 7fe5b1135800 20 searching for the correct realm 2024-09-12T17:29:48.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.582+0000 7fe5b1135800 1 --2- 172.21.15.170:0/3982474996 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55a5566a1d70 0x55a5566a4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.582+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a4900 con 0x55a5566a1d70 2024-09-12T17:29:48.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.582+0000 7fe5ace21640 1 --2- 172.21.15.170:0/3982474996 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55a5566a1d70 0x55a5566a4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.582+0000 7fe5ace21640 1 --2- 172.21.15.170:0/3982474996 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55a5566a1d70 0x55a5566a4230 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.583+0000 7fe5ace21640 1 -- 172.21.15.170:0/3982474996 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5a40a1040 con 0x55a5566a1d70 2024-09-12T17:29:48.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.583+0000 7fe5ace21640 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a4900 con 0x55a55669d270 2024-09-12T17:29:48.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.583+0000 7fe5ad622640 1 -- 172.21.15.170:0/3982474996 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe59c03a070 con 0x55a55669d270 2024-09-12T17:29:48.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.583+0000 7fe5ad622640 1 --2- 172.21.15.170:0/3982474996 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fe59c033070 0x7fe59c0535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.583+0000 7fe5ad622640 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a4900 con 0x7fe59c033070 2024-09-12T17:29:48.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.583+0000 7fe5ac620640 1 --2- 172.21.15.170:0/3982474996 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fe59c033070 0x7fe59c0535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.584+0000 7fe5ac620640 1 --2- 172.21.15.170:0/3982474996 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fe59c033070 0x7fe59c0535f0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.584+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe594009050 con 0x7fe59c033070 2024-09-12T17:29:48.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.584+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a4900 con 0x55a556698880 2024-09-12T17:29:48.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.584+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe594009050 con 0x55a556698880 2024-09-12T17:29:48.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.584+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a4900 con 0x55a556698880 2024-09-12T17:29:48.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.584+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe594029040 con 0x55a556698880 2024-09-12T17:29:48.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.584+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a4900 con 0x7fe59c033070 2024-09-12T17:29:48.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.585+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe594029040 con 0x7fe59c033070 2024-09-12T17:29:48.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.585+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a4900 con 0x7fe59c033070 2024-09-12T17:29:48.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.585+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe594029040 con 0x7fe59c033070 2024-09-12T17:29:48.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.585+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a4900 con 0x55a55669d270 2024-09-12T17:29:48.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.585+0000 7fe5ad622640 1 -- 172.21.15.170:0/3982474996 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe59c03a070 con 0x55a55669d270 2024-09-12T17:29:48.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.585+0000 7fe5ad622640 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a4900 con 0x55a5566a1d70 2024-09-12T17:29:48.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.585+0000 7fe5ace21640 1 -- 172.21.15.170:0/3982474996 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5a40a1040 con 0x55a5566a1d70 2024-09-12T17:29:48.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.585+0000 7fe5ace21640 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a4900 con 0x55a556698880 2024-09-12T17:29:48.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.585+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe594029040 con 0x55a556698880 2024-09-12T17:29:48.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.585+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a4900 con 0x7fe59c033070 2024-09-12T17:29:48.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.586+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe594029040 con 0x7fe59c033070 2024-09-12T17:29:48.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.586+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a4900 con 0x55a556698880 2024-09-12T17:29:48.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.586+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe594029040 con 0x55a556698880 2024-09-12T17:29:48.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.586+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a4900 con 0x55a55669d270 2024-09-12T17:29:48.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.586+0000 7fe5ad622640 1 -- 172.21.15.170:0/3982474996 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fe59c03a070 con 0x55a55669d270 2024-09-12T17:29:48.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.586+0000 7fe5ad622640 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a4900 con 0x55a5566a1d70 2024-09-12T17:29:48.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.586+0000 7fe5ace21640 1 -- 172.21.15.170:0/3982474996 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5a40a1040 con 0x55a5566a1d70 2024-09-12T17:29:48.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.586+0000 7fe5ace21640 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a4900 con 0x55a5566a1d70 2024-09-12T17:29:48.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.587+0000 7fe5ace21640 1 -- 172.21.15.170:0/3982474996 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5a40a1040 con 0x55a5566a1d70 2024-09-12T17:29:48.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.587+0000 7fe5ace21640 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a4900 con 0x55a55669d270 2024-09-12T17:29:48.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.587+0000 7fe5ad622640 1 -- 172.21.15.170:0/3982474996 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe59c03a070 con 0x55a55669d270 2024-09-12T17:29:48.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.587+0000 7fe5ad622640 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a4900 con 0x55a5566a1d70 2024-09-12T17:29:48.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.587+0000 7fe5ace21640 1 -- 172.21.15.170:0/3982474996 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5a40a1040 con 0x55a5566a1d70 2024-09-12T17:29:48.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.587+0000 7fe5ace21640 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a4900 con 0x55a5566a1d70 2024-09-12T17:29:48.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.587+0000 7fe5ace21640 1 -- 172.21.15.170:0/3982474996 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5a40a1040 con 0x55a5566a1d70 2024-09-12T17:29:48.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.587+0000 7fe5ace21640 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a4900 con 0x55a556698880 2024-09-12T17:29:48.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.587+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe594029040 con 0x55a556698880 2024-09-12T17:29:48.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.588+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a4900 con 0x55a556698880 2024-09-12T17:29:48.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.588+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v31'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe594029040 con 0x55a556698880 2024-09-12T17:29:48.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.588+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a4900 con 0x7fe59c033070 2024-09-12T17:29:48.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.588+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe594029040 con 0x7fe59c033070 2024-09-12T17:29:48.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.588+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a4900 con 0x55a5566a1d70 2024-09-12T17:29:48.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.588+0000 7fe5ace21640 1 -- 172.21.15.170:0/3982474996 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5a40a1040 con 0x55a5566a1d70 2024-09-12T17:29:48.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.588+0000 7fe5ace21640 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a4900 con 0x55a55669d270 2024-09-12T17:29:48.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.589+0000 7fe5ad622640 1 -- 172.21.15.170:0/3982474996 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe59c03a070 con 0x55a55669d270 2024-09-12T17:29:48.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.589+0000 7fe5ad622640 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a4900 con 0x55a556698880 2024-09-12T17:29:48.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.589+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe594029040 con 0x55a556698880 2024-09-12T17:29:48.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.589+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a4900 con 0x7fe59c033070 2024-09-12T17:29:48.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.589+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe594029040 con 0x7fe59c033070 2024-09-12T17:29:48.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.589+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a4900 con 0x55a5566a1d70 2024-09-12T17:29:48.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.589+0000 7fe5ace21640 1 -- 172.21.15.170:0/3982474996 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5a40a1040 con 0x55a5566a1d70 2024-09-12T17:29:48.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.589+0000 7fe5ace21640 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a4900 con 0x7fe59c033070 2024-09-12T17:29:48.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.590+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe594029040 con 0x7fe59c033070 2024-09-12T17:29:48.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.590+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a4900 con 0x55a55669d270 2024-09-12T17:29:48.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.590+0000 7fe5ad622640 1 -- 172.21.15.170:0/3982474996 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe59c03a070 con 0x55a55669d270 2024-09-12T17:29:48.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.590+0000 7fe5ad622640 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a4900 con 0x55a5566a1d70 2024-09-12T17:29:48.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.590+0000 7fe5ace21640 1 -- 172.21.15.170:0/3982474996 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5a40a1040 con 0x55a5566a1d70 2024-09-12T17:29:48.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.590+0000 7fe5ace21640 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a4900 con 0x7fe59c033070 2024-09-12T17:29:48.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.590+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe594029040 con 0x7fe59c033070 2024-09-12T17:29:48.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.590+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a4900 con 0x55a556698880 2024-09-12T17:29:48.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.591+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe594029040 con 0x55a556698880 2024-09-12T17:29:48.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.591+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a4900 con 0x55a55669d270 2024-09-12T17:29:48.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.591+0000 7fe5ad622640 1 -- 172.21.15.170:0/3982474996 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(37 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe59c03a070 con 0x55a55669d270 2024-09-12T17:29:48.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.591+0000 7fe5b1135800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:29:48.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.591+0000 7fe5b1135800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:29:48.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.591+0000 7fe5b1135800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:29:48.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.591+0000 7fe5b1135800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:29:48.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.591+0000 7fe5b1135800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:29:48.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.591+0000 7fe5b1135800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:29:48.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.591+0000 7fe5b1135800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.591+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a0760 con 0x55a556698880 2024-09-12T17:29:48.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.591+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe594029040 con 0x55a556698880 2024-09-12T17:29:48.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.591+0000 7fe5b1135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.591+0000 7fe5b1135800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.591+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a1000 con 0x55a556698880 2024-09-12T17:29:48.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.591+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe594029040 con 0x55a556698880 2024-09-12T17:29:48.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.591+0000 7fe5b1135800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:48.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.591+0000 7fe5b1135800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.591+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a03a0 con 0x55a55669d270 2024-09-12T17:29:48.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.592+0000 7fe5ad622640 1 -- 172.21.15.170:0/3982474996 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe59c03a070 con 0x55a55669d270 2024-09-12T17:29:48.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.592+0000 7fe5b1135800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:29:48.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.592+0000 7fe5b1135800 20 zone default found 2024-09-12T17:29:48.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.592+0000 7fe5b1135800 4 Realm: () 2024-09-12T17:29:48.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.592+0000 7fe5b1135800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:29:48.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.592+0000 7fe5b1135800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:29:48.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.592+0000 7fe5b1135800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:29:48.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.592+0000 7fe5b1135800 20 zonegroup default 2024-09-12T17:29:48.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.592+0000 7fe5b1135800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.592+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a5230 con 0x7fe59c033070 2024-09-12T17:29:48.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.592+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe594029040 con 0x7fe59c033070 2024-09-12T17:29:48.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.592+0000 7fe5b1135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.592+0000 7fe5b1135800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.592+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a7470 con 0x55a5566a1d70 2024-09-12T17:29:48.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.592+0000 7fe5ace21640 1 -- 172.21.15.170:0/3982474996 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe5a40a1040 con 0x55a5566a1d70 2024-09-12T17:29:48.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.592+0000 7fe5b1135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.592+0000 7fe5b1135800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.592+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a7810 con 0x55a5566a1d70 2024-09-12T17:29:48.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.592+0000 7fe5ace21640 1 -- 172.21.15.170:0/3982474996 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe5a40a1040 con 0x55a5566a1d70 2024-09-12T17:29:48.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.593+0000 7fe5b1135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.593+0000 7fe5b1135800 20 started sync module instance, tier type = 2024-09-12T17:29:48.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.593+0000 7fe5b1135800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:29:48.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.593+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a6900 con 0x55a55669d270 2024-09-12T17:29:48.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.594+0000 7fe5ad622640 1 -- 172.21.15.170:0/3982474996 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(44 notify.0 [create] v31'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe59c03a070 con 0x55a55669d270 2024-09-12T17:29:48.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.594+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94168607780432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a6900 con 0x55a55669d270 2024-09-12T17:29:48.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.594+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a8210 con 0x55a556698880 2024-09-12T17:29:48.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.595+0000 7fe5ad622640 1 -- 172.21.15.170:0/3982474996 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94168607780432] v31'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe59c03a070 con 0x55a55669d270 2024-09-12T17:29:48.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.595+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v31'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe594029040 con 0x55a556698880 2024-09-12T17:29:48.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.595+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94168607784224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a6900 con 0x55a556698880 2024-09-12T17:29:48.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.595+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a8c90 con 0x55a5566a1d70 2024-09-12T17:29:48.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.596+0000 7fe5ace21640 1 -- 172.21.15.170:0/3982474996 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v31'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5a40a1040 con 0x55a5566a1d70 2024-09-12T17:29:48.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.596+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94168607784224] v31'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe594029040 con 0x55a556698880 2024-09-12T17:29:48.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.596+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94168607777872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a6870 con 0x55a5566a1d70 2024-09-12T17:29:48.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.596+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a9b50 con 0x55a55669d270 2024-09-12T17:29:48.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.597+0000 7fe5ad622640 1 -- 172.21.15.170:0/3982474996 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(50 notify.3 [create] v31'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe59c03a070 con 0x55a55669d270 2024-09-12T17:29:48.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.597+0000 7fe5ace21640 1 -- 172.21.15.170:0/3982474996 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94168607777872] v31'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5a40a1040 con 0x55a5566a1d70 2024-09-12T17:29:48.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.597+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94168607791232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5566a9120 con 0x55a55669d270 2024-09-12T17:29:48.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.597+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5566aa8a0 con 0x55a556698880 2024-09-12T17:29:48.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.598+0000 7fe5ad622640 1 -- 172.21.15.170:0/3982474996 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94168607791232] v31'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe59c03a070 con 0x55a55669d270 2024-09-12T17:29:48.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.599+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v31'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe594029040 con 0x55a556698880 2024-09-12T17:29:48.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.599+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94168607792352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5566aa8a0 con 0x55a556698880 2024-09-12T17:29:48.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.599+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5566ab2f0 con 0x7fe59c033070 2024-09-12T17:29:48.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.600+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94168607792352] v31'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe594029040 con 0x55a556698880 2024-09-12T17:29:48.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.600+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(54 notify.5 [create] v31'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe594029040 con 0x7fe59c033070 2024-09-12T17:29:48.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.600+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94168607794048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5566ab2b0 con 0x7fe59c033070 2024-09-12T17:29:48.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.600+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5566abd30 con 0x7fe59c033070 2024-09-12T17:29:48.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.601+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94168607794048] v31'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe594029040 con 0x7fe59c033070 2024-09-12T17:29:48.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.601+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v31'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe594029040 con 0x7fe59c033070 2024-09-12T17:29:48.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.601+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94168607797216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5566abd30 con 0x7fe59c033070 2024-09-12T17:29:48.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.601+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5566ac6f0 con 0x7fe59c033070 2024-09-12T17:29:48.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.602+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(58 notify.7 [create] v31'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe594029040 con 0x7fe59c033070 2024-09-12T17:29:48.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.602+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94168607801920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5566ac660 con 0x7fe59c033070 2024-09-12T17:29:48.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.602+0000 7fe5b1135800 20 add_watcher() i=0 2024-09-12T17:29:48.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.602+0000 7fe5b1135800 20 add_watcher() i=1 2024-09-12T17:29:48.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.602+0000 7fe5b1135800 20 add_watcher() i=2 2024-09-12T17:29:48.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.602+0000 7fe5b1135800 20 add_watcher() i=3 2024-09-12T17:29:48.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.602+0000 7fe5b1135800 20 add_watcher() i=4 2024-09-12T17:29:48.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.602+0000 7fe5b1135800 20 add_watcher() i=5 2024-09-12T17:29:48.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.602+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94168607797216] v31'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe594029040 con 0x7fe59c033070 2024-09-12T17:29:48.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.602+0000 7fe5b1135800 20 add_watcher() i=6 2024-09-12T17:29:48.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.603+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94168607801920] v31'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe594029040 con 0x7fe59c033070 2024-09-12T17:29:48.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.603+0000 7fe5b1135800 20 add_watcher() i=7 2024-09-12T17:29:48.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.603+0000 7fe5b1135800 2 all 8 watchers are set, enabling cache 2024-09-12T17:29:48.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.603+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5566ab880 con 0x55a556698880 2024-09-12T17:29:48.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.603+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe594029040 con 0x55a556698880 2024-09-12T17:29:48.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.603+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94168607804048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5566ab880 con 0x55a556698880 2024-09-12T17:29:48.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.604+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94168607804048] v31'270 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe594029040 con 0x55a556698880 2024-09-12T17:29:48.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.604+0000 7fe462fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:48.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.604+0000 7fe5b1135800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:29:48.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.604+0000 7fe5b1135800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:29:48.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.604+0000 7fe5b1135800 5 note: GC not initialized 2024-09-12T17:29:48.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.605+0000 7fe461fe3640 20 reqs_thread_entry: start 2024-09-12T17:29:48.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.605+0000 7fe5b1135800 20 init_complete bucket index max shards: 11 2024-09-12T17:29:48.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.605+0000 7fe5b1135800 20 Filter name: none 2024-09-12T17:29:48.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.605+0000 7fe3d37fe640 20 reqs_thread_entry: start 2024-09-12T17:29:48.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.605+0000 7fe5b1135800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-12T17:29:48.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.605+0000 7fe5b1135800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.605+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5566e2cb0 con 0x7fe59c033070 2024-09-12T17:29:48.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.606+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7fe594029040 con 0x7fe59c033070 2024-09-12T17:29:48.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.606+0000 7fe5b1135800 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T17:29:48.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.606+0000 7fe5b1135800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-12T17:29:48.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.606+0000 7fe5b1135800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:29:48.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.606+0000 7fe5b1135800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:29:48.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.606+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5566e90c0 con 0x7fe59c033070 2024-09-12T17:29:48.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.607+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v31'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fe594029040 con 0x7fe59c033070 2024-09-12T17:29:48.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.607+0000 7fe5b1135800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T17:29:48.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.607+0000 7fe5b1135800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:29:48.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.607+0000 7fe5b1135800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-12T17:29:48.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.607+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94168608049856 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5566e4760 con 0x55a556698880 2024-09-12T17:29:48.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.607+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== watch-notify(notify (1) cookie 94168607792352 notify 133143986206 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7fe598001e10 con 0x55a556698880 2024-09-12T17:29:48.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.607+0000 7fe483fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986206 cookie 94168607792352 notifier 4911 bl.length()=649 2024-09-12T17:29:48.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.607+0000 7fe483fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T17:29:48.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.607+0000 7fe483fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:29:48.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.607+0000 7fe483fff640 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fe470003ea0 con 0x55a556698880 2024-09-12T17:29:48.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.607+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(64 notify.4 [notify cookie 94168608049856 out=8b] v0'0 uv276 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe594029040 con 0x55a556698880 2024-09-12T17:29:48.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.607+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe594029040 con 0x55a556698880 2024-09-12T17:29:48.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.608+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== watch-notify(notify_complete (2) cookie 94168608049856 notify 133143986206 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe59402f450 con 0x55a556698880 2024-09-12T17:29:48.624 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-12T17:29:46.782056Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:29:46.782042Z","tags":[],"group_ids":[]} 2024-09-12T17:29:48.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.608+0000 7fe462fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:48.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.608+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94168607804048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5566e1f80 con 0x55a556698880 2024-09-12T17:29:48.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.609+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94168607804048] v31'271 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe594029040 con 0x55a556698880 2024-09-12T17:29:48.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.609+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94168607780432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5566e1f80 con 0x55a55669d270 2024-09-12T17:29:48.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.610+0000 7fe5ad622640 1 -- 172.21.15.170:0/3982474996 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94168607780432] v31'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe59c03a070 con 0x55a55669d270 2024-09-12T17:29:48.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.610+0000 7fe5b1135800 20 remove_watcher() i=0 2024-09-12T17:29:48.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.610+0000 7fe5b1135800 2 removed watcher, disabling cache 2024-09-12T17:29:48.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.610+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94168607784224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5566e0ae0 con 0x55a556698880 2024-09-12T17:29:48.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.612+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94168607784224] v31'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe594029040 con 0x55a556698880 2024-09-12T17:29:48.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.612+0000 7fe5b1135800 20 remove_watcher() i=1 2024-09-12T17:29:48.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.612+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94168607777872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5566e0ae0 con 0x55a5566a1d70 2024-09-12T17:29:48.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.613+0000 7fe5ace21640 1 -- 172.21.15.170:0/3982474996 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94168607777872] v31'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5a40a1040 con 0x55a5566a1d70 2024-09-12T17:29:48.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.613+0000 7fe5b1135800 20 remove_watcher() i=2 2024-09-12T17:29:48.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.613+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94168607791232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5566e0ae0 con 0x55a55669d270 2024-09-12T17:29:48.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.614+0000 7fe5ad622640 1 -- 172.21.15.170:0/3982474996 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94168607791232] v31'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe59c03a070 con 0x55a55669d270 2024-09-12T17:29:48.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.614+0000 7fe5b1135800 20 remove_watcher() i=3 2024-09-12T17:29:48.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.614+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94168607792352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5566e0ae0 con 0x55a556698880 2024-09-12T17:29:48.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.615+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94168607792352] v31'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe594029040 con 0x55a556698880 2024-09-12T17:29:48.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.615+0000 7fe5b1135800 20 remove_watcher() i=4 2024-09-12T17:29:48.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.615+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94168607794048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5566e0ae0 con 0x7fe59c033070 2024-09-12T17:29:48.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.616+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94168607794048] v31'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe594029040 con 0x7fe59c033070 2024-09-12T17:29:48.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.616+0000 7fe5b1135800 20 remove_watcher() i=5 2024-09-12T17:29:48.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.616+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94168607797216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5566e0ae0 con 0x7fe59c033070 2024-09-12T17:29:48.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.617+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94168607797216] v31'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe594029040 con 0x7fe59c033070 2024-09-12T17:29:48.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.617+0000 7fe5b1135800 20 remove_watcher() i=6 2024-09-12T17:29:48.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.617+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94168607801920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5566e0ae0 con 0x7fe59c033070 2024-09-12T17:29:48.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.618+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94168607801920] v31'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe594029040 con 0x7fe59c033070 2024-09-12T17:29:48.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.618+0000 7fe5b1135800 20 remove_watcher() i=7 2024-09-12T17:29:48.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.618+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fe59c033070 msgr2=0x7fe59c0535f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.618+0000 7fe5b1135800 1 --2- 172.21.15.170:0/3982474996 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7fe59c033070 0x7fe59c0535f0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.618+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a556698880 msgr2=0x55a55669ad40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.618+0000 7fe5b1135800 1 --2- 172.21.15.170:0/3982474996 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a556698880 0x55a55669ad40 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.618+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a55669d270 msgr2=0x55a55669f660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.618+0000 7fe5b1135800 1 --2- 172.21.15.170:0/3982474996 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a55669d270 0x55a55669f660 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.618+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55a5566a1d70 msgr2=0x55a5566a4230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.618+0000 7fe5b1135800 1 --2- 172.21.15.170:0/3982474996 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x55a5566a1d70 0x55a5566a4230 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.619+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe47803c730 msgr2=0x7fe47803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.619+0000 7fe5b1135800 1 --2- 172.21.15.170:0/3982474996 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe47803c730 0x7fe47803ebf0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe5a40933f0 tx=0x7fe5a4088000 comp rx=0 tx=0).stop 2024-09-12T17:29:48.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.619+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a556685900 msgr2=0x55a55668cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.619+0000 7fe5ac620640 1 -- 172.21.15.170:0/3982474996 reap_dead start 2024-09-12T17:29:48.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.619+0000 7fe5b1135800 1 --2- 172.21.15.170:0/3982474996 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a556685900 0x55a55668cf30 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fe59c008fd0 tx=0x7fe59c0531e0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.619+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 shutdown_connections 2024-09-12T17:29:48.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.619+0000 7fe5b1135800 1 --2- 172.21.15.170:0/3982474996 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a556685900 0x55a55668cf30 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.619+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 >> 172.21.15.170:0/3982474996 conn(0x55a556681d00 msgr2=0x55a55667ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:48.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.619+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 shutdown_connections 2024-09-12T17:29:48.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.619+0000 7fe5b1135800 1 -- 172.21.15.170:0/3982474996 wait complete. 2024-09-12T17:29:48.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.619+0000 7fe5b1135800 1 -- 172.21.15.170:0/760958305 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe48403c780 msgr2=0x7fe48403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.619+0000 7fe5b1135800 1 --2- 172.21.15.170:0/760958305 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe48403c780 0x7fe48403ec40 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x55a556664820 tx=0x7fe5a406df50 comp rx=0 tx=0).stop 2024-09-12T17:29:48.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.619+0000 7fe5b1135800 1 -- 172.21.15.170:0/760958305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a556564e50 msgr2=0x55a5565636c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.619+0000 7fe5b1135800 1 --2- 172.21.15.170:0/760958305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a556564e50 0x55a5565636c0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x55a55665cd00 tx=0x7fe59c00bf30 comp rx=0 tx=0).stop 2024-09-12T17:29:48.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.619+0000 7fe5b1135800 1 -- 172.21.15.170:0/760958305 shutdown_connections 2024-09-12T17:29:48.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.619+0000 7fe5b1135800 1 --2- 172.21.15.170:0/760958305 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe48403c780 0x7fe48403ec40 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.619+0000 7fe5b1135800 1 --2- 172.21.15.170:0/760958305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a556564e50 0x55a5565636c0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.619+0000 7fe5b1135800 1 -- 172.21.15.170:0/760958305 >> 172.21.15.170:0/760958305 conn(0x55a55666b000 msgr2=0x55a55666b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:48.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.619+0000 7fe5b1135800 1 -- 172.21.15.170:0/760958305 shutdown_connections 2024-09-12T17:29:48.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.619+0000 7fe5b1135800 1 -- 172.21.15.170:0/760958305 wait complete. 2024-09-12T17:29:48.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.619+0000 7fe5b1135800 1 -- 172.21.15.170:0/2661302616 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a556568040 msgr2=0x55a556663350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.619+0000 7fe5b1135800 1 --2- 172.21.15.170:0/2661302616 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a556568040 0x55a556663350 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.619+0000 7fe5b1135800 1 -- 172.21.15.170:0/2661302616 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a556665730 msgr2=0x55a556667bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.619+0000 7fe5b1135800 1 --2- 172.21.15.170:0/2661302616 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a556665730 0x55a556667bd0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.619+0000 7fe5b1135800 1 -- 172.21.15.170:0/2661302616 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe49403c730 msgr2=0x7fe49403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.619+0000 7fe5b1135800 1 --2- 172.21.15.170:0/2661302616 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe49403c730 0x7fe49403ebf0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe594001db0 tx=0x7fe594001310 comp rx=0 tx=0).stop 2024-09-12T17:29:48.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.620+0000 7fe5b1135800 1 -- 172.21.15.170:0/2661302616 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5565656b0 msgr2=0x55a55665bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.620+0000 7fe5b1135800 1 --2- 172.21.15.170:0/2661302616 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5565656b0 0x55a55665bd00 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4045b70 tx=0x7fe5a4003330 comp rx=0 tx=0).stop 2024-09-12T17:29:48.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.620+0000 7fe5b1135800 1 -- 172.21.15.170:0/2661302616 shutdown_connections 2024-09-12T17:29:48.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.620+0000 7fe5b1135800 1 --2- 172.21.15.170:0/2661302616 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x55a556665730 0x55a556667bd0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.620+0000 7fe5b1135800 1 --2- 172.21.15.170:0/2661302616 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe49403c730 0x7fe49403ebf0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.620+0000 7fe5b1135800 1 --2- 172.21.15.170:0/2661302616 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x55a556568040 0x55a556663350 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.620+0000 7fe5b1135800 1 --2- 172.21.15.170:0/2661302616 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5565656b0 0x55a55665bd00 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.620+0000 7fe5b1135800 1 -- 172.21.15.170:0/2661302616 >> 172.21.15.170:0/2661302616 conn(0x55a55655f1d0 msgr2=0x55a55664e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:48.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.620+0000 7fe5b1135800 1 -- 172.21.15.170:0/2661302616 shutdown_connections 2024-09-12T17:29:48.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.620+0000 7fe5b1135800 1 -- 172.21.15.170:0/2661302616 wait complete. 2024-09-12T17:29:48.635 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T17:29:46.782056Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:29:46.782042Z', 'tags': [], 'group_ids': []} 2024-09-12T17:29:48.636 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T17:29:46.782056Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:29:46.782042Z', 'tags': [], 'group_ids': []} 2024-09-12T17:29:48.636 ERROR:root:0 2024-09-12T17:29:48.636 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-12T17:29:48.636 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-12T17:29:48.636 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-12T17:29:48.682 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:29:48.683 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:29:48.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.682+0000 7f8b9d62f800 1 Processor -- start 2024-09-12T17:29:48.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.682+0000 7f8b9d62f800 1 -- start start 2024-09-12T17:29:48.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.682+0000 7f8b9d62f800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x559247b99a90 0x559247c2db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.682+0000 7f8b9d62f800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559247acee40 con 0x559247b98f80 2024-09-12T17:29:48.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.682+0000 7f8b9d62f800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x559247a99680 con 0x559247b99a90 2024-09-12T17:29:48.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.683+0000 7f8b9a918640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x559247b99a90 0x559247c2db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.683+0000 7f8b9b119640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x559247b98f80 0x559247b99380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:44986/0 (socket says 172.21.15.170:44986) 2024-09-12T17:29:48.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.683+0000 7f8b9b119640 1 -- 172.21.15.170:0/2022748429 learned_addr learned my addr 172.21.15.170:0/2022748429 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:29:48.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.683+0000 7f8b9a918640 1 -- 172.21.15.170:0/2022748429 >> v1:172.21.15.47:6789/0 conn(0x559247b98f80 legacy=0x559247b99380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.683+0000 7f8b9a918640 1 -- 172.21.15.170:0/2022748429 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559247ab56b0 con 0x559247b99a90 2024-09-12T17:29:48.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.685+0000 7f8b9a918640 1 --2- 172.21.15.170:0/2022748429 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559247b99a90 0x559247c2db00 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f8b8400a470 tx=0x7f8b84045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3efe5571db3eccde server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.685+0000 7f8b9a117640 1 -- 172.21.15.170:0/2022748429 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b84053570 con 0x559247b99a90 2024-09-12T17:29:48.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.685+0000 7f8b9a117640 1 -- 172.21.15.170:0/2022748429 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b84058070 con 0x559247b99a90 2024-09-12T17:29:48.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.685+0000 7f8b9a117640 1 -- 172.21.15.170:0/2022748429 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b84053880 con 0x559247b99a90 2024-09-12T17:29:48.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.685+0000 7f8b9d62f800 1 -- 172.21.15.170:0/2022748429 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559247b99a90 msgr2=0x559247c2db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.685+0000 7f8b9d62f800 1 --2- 172.21.15.170:0/2022748429 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559247b99a90 0x559247c2db00 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f8b8400a470 tx=0x7f8b84045a20 comp rx=0 tx=0).stop 2024-09-12T17:29:48.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.685+0000 7f8b9d62f800 1 -- 172.21.15.170:0/2022748429 shutdown_connections 2024-09-12T17:29:48.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.685+0000 7f8b9d62f800 1 --2- 172.21.15.170:0/2022748429 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559247b99a90 0x559247c2db00 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.685+0000 7f8b9d62f800 1 -- 172.21.15.170:0/2022748429 >> 172.21.15.170:0/2022748429 conn(0x559247c203d0 msgr2=0x559247c22830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:48.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.685+0000 7f8b9d62f800 1 -- 172.21.15.170:0/2022748429 shutdown_connections 2024-09-12T17:29:48.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.686+0000 7f8b9d62f800 1 -- 172.21.15.170:0/2022748429 wait complete. 2024-09-12T17:29:48.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.699+0000 7f8b9d62f800 1 Processor -- start 2024-09-12T17:29:48.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.699+0000 7f8b9d62f800 1 -- start start 2024-09-12T17:29:48.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.699+0000 7f8b9d62f800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559247b98f80 0x559247d16850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.699+0000 7f8b9d62f800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559247abddd0 con 0x559247b98f80 2024-09-12T17:29:48.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.700+0000 7f8b9b119640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559247b98f80 0x559247d16850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.700+0000 7f8b9b119640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559247b98f80 0x559247d16850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35516/0 (socket says 172.21.15.170:35516) 2024-09-12T17:29:48.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.700+0000 7f8b9b119640 1 -- 172.21.15.170:0/2463649779 learned_addr learned my addr 172.21.15.170:0/2463649779 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:48.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.700+0000 7f8b9b119640 1 -- 172.21.15.170:0/2463649779 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559247ad6e10 con 0x559247b98f80 2024-09-12T17:29:48.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.700+0000 7f8b9b119640 1 --2- 172.21.15.170:0/2463649779 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559247b98f80 0x559247d16850 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c001800 tx=0x7f8b8c001cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8cd58847fab3525 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.700+0000 7f8a8960a640 1 -- 172.21.15.170:0/2463649779 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b8c004520 con 0x559247b98f80 2024-09-12T17:29:48.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.700+0000 7f8a8960a640 1 -- 172.21.15.170:0/2463649779 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b8c0046c0 con 0x559247b98f80 2024-09-12T17:29:48.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.700+0000 7f8a8960a640 1 -- 172.21.15.170:0/2463649779 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b8c0049e0 con 0x559247b98f80 2024-09-12T17:29:48.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.701+0000 7f8b9d62f800 1 -- 172.21.15.170:0/2463649779 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559247b98f80 msgr2=0x559247d16850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.701+0000 7f8b9d62f800 1 --2- 172.21.15.170:0/2463649779 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559247b98f80 0x559247d16850 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c001800 tx=0x7f8b8c001cc0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.701+0000 7f8b9d62f800 1 -- 172.21.15.170:0/2463649779 shutdown_connections 2024-09-12T17:29:48.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.701+0000 7f8b9d62f800 1 --2- 172.21.15.170:0/2463649779 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559247b98f80 0x559247d16850 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.701+0000 7f8b9d62f800 1 -- 172.21.15.170:0/2463649779 >> 172.21.15.170:0/2463649779 conn(0x559247c203d0 msgr2=0x559247d121d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:48.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.701+0000 7f8b9d62f800 1 -- 172.21.15.170:0/2463649779 shutdown_connections 2024-09-12T17:29:48.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.701+0000 7f8b9d62f800 1 -- 172.21.15.170:0/2463649779 wait complete. 2024-09-12T17:29:48.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.701+0000 7f8b9d62f800 1 Processor -- start 2024-09-12T17:29:48.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.701+0000 7f8b9d62f800 1 -- start start 2024-09-12T17:29:48.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.702+0000 7f8b9d62f800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559247b98f80 0x559247d1e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.702+0000 7f8b9d62f800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559247c2e310 con 0x559247b98f80 2024-09-12T17:29:48.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.702+0000 7f8b9b119640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559247b98f80 0x559247d1e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.702+0000 7f8b9b119640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559247b98f80 0x559247d1e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35530/0 (socket says 172.21.15.170:35530) 2024-09-12T17:29:48.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.702+0000 7f8b9b119640 1 -- 172.21.15.170:0/3228495720 learned_addr learned my addr 172.21.15.170:0/3228495720 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:48.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.702+0000 7f8b9b119640 1 -- 172.21.15.170:0/3228495720 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559247d1e6d0 con 0x559247b98f80 2024-09-12T17:29:48.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.702+0000 7f8b9b119640 1 --2- 172.21.15.170:0/3228495720 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559247b98f80 0x559247d1e170 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c0066b0 tx=0x7f8b8c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.702+0000 7f8a87e07640 1 -- 172.21.15.170:0/3228495720 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b8c022020 con 0x559247b98f80 2024-09-12T17:29:48.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.702+0000 7f8a87e07640 1 -- 172.21.15.170:0/3228495720 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b8c0148c0 con 0x559247b98f80 2024-09-12T17:29:48.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.702+0000 7f8b9d62f800 1 -- 172.21.15.170:0/3228495720 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559247d1e960 con 0x559247b98f80 2024-09-12T17:29:48.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.702+0000 7f8a87e07640 1 -- 172.21.15.170:0/3228495720 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b8c014be0 con 0x559247b98f80 2024-09-12T17:29:48.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.703+0000 7f8b9d62f800 1 -- 172.21.15.170:0/3228495720 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559247d1f360 con 0x559247b98f80 2024-09-12T17:29:48.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.703+0000 7f8a87e07640 1 -- 172.21.15.170:0/3228495720 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8b8c025020 con 0x559247b98f80 2024-09-12T17:29:48.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.703+0000 7f8a87e07640 1 --2- 172.21.15.170:0/3228495720 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8a8003c730 0x7f8a8003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.704+0000 7f8a87e07640 1 -- 172.21.15.170:0/3228495720 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f8b8c018030 con 0x559247b98f80 2024-09-12T17:29:48.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.704+0000 7f8b9a918640 1 --2- 172.21.15.170:0/3228495720 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8a8003c730 0x7f8a8003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.704+0000 7f8b9d62f800 1 --2- 172.21.15.170:0/3228495720 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x559247b99a90 0x559247d257c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.704+0000 7f8b9d62f800 1 -- 172.21.15.170:0/3228495720 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559247d25d00 con 0x559247b99a90 2024-09-12T17:29:48.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.704+0000 7f8b9b91a640 1 --2- 172.21.15.170:0/3228495720 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x559247b99a90 0x559247d257c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.704+0000 7f8b9a918640 1 --2- 172.21.15.170:0/3228495720 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8a8003c730 0x7f8a8003ebf0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8b84057000 tx=0x7f8b84052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.704+0000 7f8b9b91a640 1 --2- 172.21.15.170:0/3228495720 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x559247b99a90 0x559247d257c0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.704+0000 7f8b9b91a640 1 -- 172.21.15.170:0/3228495720 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b940083e0 con 0x559247b99a90 2024-09-12T17:29:48.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.704+0000 7f8b9d62f800 1 -- 172.21.15.170:0/3228495720 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559247d260a0 con 0x559247b99a90 2024-09-12T17:29:48.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.705+0000 7f8b9b91a640 1 -- 172.21.15.170:0/3228495720 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8b940083e0 con 0x559247b99a90 2024-09-12T17:29:48.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.705+0000 7f8b9d62f800 1 --2- 172.21.15.170:0/3228495720 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x559247d27ba0 0x559247d2a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.705+0000 7f8b9d62f800 1 -- 172.21.15.170:0/3228495720 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559247d2a7b0 con 0x559247d27ba0 2024-09-12T17:29:48.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.705+0000 7f8b9b119640 1 --2- 172.21.15.170:0/3228495720 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x559247d27ba0 0x559247d2a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.705+0000 7f8b9b119640 1 --2- 172.21.15.170:0/3228495720 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x559247d27ba0 0x559247d2a020 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.705+0000 7f8b9b119640 1 -- 172.21.15.170:0/3228495720 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8b8c01b070 con 0x559247d27ba0 2024-09-12T17:29:48.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.705+0000 7f8b9d62f800 1 -- 172.21.15.170:0/3228495720 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559247d268f0 con 0x559247b99a90 2024-09-12T17:29:48.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.706+0000 7f8b9b91a640 1 -- 172.21.15.170:0/3228495720 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8b940083e0 con 0x559247b99a90 2024-09-12T17:29:48.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.706+0000 7f8b9d62f800 1 -- 172.21.15.170:0/3228495720 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559247d26d40 con 0x559247d27ba0 2024-09-12T17:29:48.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.706+0000 7f8b9b119640 1 -- 172.21.15.170:0/3228495720 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8b8c01b070 con 0x559247d27ba0 2024-09-12T17:29:48.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.706+0000 7f8b9d62f800 1 Processor -- start 2024-09-12T17:29:48.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.706+0000 7f8b9d62f800 1 -- start start 2024-09-12T17:29:48.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.706+0000 7f8b9d62f800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559247d39060 0x559247d39480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.706+0000 7f8b9d62f800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559247b1ba00 con 0x559247d39060 2024-09-12T17:29:48.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.707+0000 7f8b9b91a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559247d39060 0x559247d39480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.707+0000 7f8b9b91a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559247d39060 0x559247d39480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35540/0 (socket says 172.21.15.170:35540) 2024-09-12T17:29:48.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.707+0000 7f8b9b91a640 1 -- 172.21.15.170:0/1489203659 learned_addr learned my addr 172.21.15.170:0/1489203659 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:48.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.707+0000 7f8b9b91a640 1 -- 172.21.15.170:0/1489203659 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559247d39ac0 con 0x559247d39060 2024-09-12T17:29:48.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.707+0000 7f8b9b91a640 1 --2- 172.21.15.170:0/1489203659 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559247d39060 0x559247d39480 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x559247d200a0 tx=0x7f8b9400bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.707+0000 7f8a85602640 1 -- 172.21.15.170:0/1489203659 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b9401c020 con 0x559247d39060 2024-09-12T17:29:48.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.707+0000 7f8a85602640 1 -- 172.21.15.170:0/1489203659 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b94007c90 con 0x559247d39060 2024-09-12T17:29:48.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.707+0000 7f8b9d62f800 1 -- 172.21.15.170:0/1489203659 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559247d3a2f0 con 0x559247d39060 2024-09-12T17:29:48.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.707+0000 7f8a85602640 1 -- 172.21.15.170:0/1489203659 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b94018440 con 0x559247d39060 2024-09-12T17:29:48.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.707+0000 7f8b9d62f800 1 -- 172.21.15.170:0/1489203659 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559247d3a890 con 0x559247d39060 2024-09-12T17:29:48.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.708+0000 7f8a85602640 1 -- 172.21.15.170:0/1489203659 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8b9401f020 con 0x559247d39060 2024-09-12T17:29:48.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.708+0000 7f8a85602640 1 --2- 172.21.15.170:0/1489203659 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8a7403c780 0x7f8a7403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.708+0000 7f8a85602640 1 -- 172.21.15.170:0/1489203659 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f8b94054e90 con 0x559247d39060 2024-09-12T17:29:48.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.709+0000 7f8b9b119640 1 --2- 172.21.15.170:0/1489203659 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8a7403c780 0x7f8a7403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.709+0000 7f8b9d62f800 1 Processor -- start 2024-09-12T17:29:48.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.709+0000 7f8b9d62f800 1 -- start start 2024-09-12T17:29:48.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.709+0000 7f8b9b119640 1 --2- 172.21.15.170:0/1489203659 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8a7403c780 0x7f8a7403ec40 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c01dcf0 tx=0x7f8b8c051f80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.709+0000 7f8b9d62f800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559247d45ac0 0x559247d45ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.709+0000 7f8b9d62f800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559247d170a0 con 0x559247d45ac0 2024-09-12T17:29:48.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.709+0000 7f8b9b91a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559247d45ac0 0x559247d45ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.709+0000 7f8b9b91a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559247d45ac0 0x559247d45ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35544/0 (socket says 172.21.15.170:35544) 2024-09-12T17:29:48.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.709+0000 7f8b9b91a640 1 -- 172.21.15.170:0/2231419040 learned_addr learned my addr 172.21.15.170:0/2231419040 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:48.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.709+0000 7f8b9b91a640 1 -- 172.21.15.170:0/2231419040 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559247d464b0 con 0x559247d45ac0 2024-09-12T17:29:48.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.710+0000 7f8b9b91a640 1 --2- 172.21.15.170:0/2231419040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559247d45ac0 0x559247d45ec0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f8b940532a0 tx=0x7f8b94053470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=192e19dbde8f6913 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.710+0000 7f8a7effd640 1 -- 172.21.15.170:0/2231419040 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b94043030 con 0x559247d45ac0 2024-09-12T17:29:48.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.710+0000 7f8a7effd640 1 -- 172.21.15.170:0/2231419040 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b94044130 con 0x559247d45ac0 2024-09-12T17:29:48.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.710+0000 7f8a7effd640 1 -- 172.21.15.170:0/2231419040 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b94016c50 con 0x559247d45ac0 2024-09-12T17:29:48.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.710+0000 7f8b9d62f800 1 -- 172.21.15.170:0/2231419040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559247d45ac0 msgr2=0x559247d45ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.710+0000 7f8b9d62f800 1 --2- 172.21.15.170:0/2231419040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559247d45ac0 0x559247d45ec0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f8b940532a0 tx=0x7f8b94053470 comp rx=0 tx=0).stop 2024-09-12T17:29:48.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.710+0000 7f8b9d62f800 1 -- 172.21.15.170:0/2231419040 shutdown_connections 2024-09-12T17:29:48.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.710+0000 7f8b9d62f800 1 --2- 172.21.15.170:0/2231419040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559247d45ac0 0x559247d45ec0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.710+0000 7f8b9d62f800 1 -- 172.21.15.170:0/2231419040 >> 172.21.15.170:0/2231419040 conn(0x559247d41ec0 msgr2=0x559247d40100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:48.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.710+0000 7f8b9d62f800 1 -- 172.21.15.170:0/2231419040 shutdown_connections 2024-09-12T17:29:48.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.710+0000 7f8b9d62f800 1 -- 172.21.15.170:0/2231419040 wait complete. 2024-09-12T17:29:48.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.710+0000 7f8b9d62f800 1 Processor -- start 2024-09-12T17:29:48.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.711+0000 7f8b9d62f800 1 -- start start 2024-09-12T17:29:48.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.711+0000 7f8b9d62f800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559247d45ac0 0x559247d4d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.711+0000 7f8b9d62f800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559247d46ad0 con 0x559247d45ac0 2024-09-12T17:29:48.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.711+0000 7f8b9b91a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559247d45ac0 0x559247d4d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.711+0000 7f8b9b91a640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559247d45ac0 0x559247d4d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:35560/0 (socket says 172.21.15.170:35560) 2024-09-12T17:29:48.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.711+0000 7f8b9b91a640 1 -- 172.21.15.170:0/295708082 learned_addr learned my addr 172.21.15.170:0/295708082 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:29:48.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.711+0000 7f8b9b91a640 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559247d4d650 con 0x559247d45ac0 2024-09-12T17:29:48.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.711+0000 7f8b9b91a640 1 --2- 172.21.15.170:0/295708082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559247d45ac0 0x559247d4d0f0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f8b940531d0 tx=0x7f8b94053200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.711+0000 7f8a7d7fa640 1 -- 172.21.15.170:0/295708082 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b9402e020 con 0x559247d45ac0 2024-09-12T17:29:48.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.711+0000 7f8a7d7fa640 1 -- 172.21.15.170:0/295708082 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b940208c0 con 0x559247d45ac0 2024-09-12T17:29:48.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.711+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559247d4d8e0 con 0x559247d45ac0 2024-09-12T17:29:48.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.711+0000 7f8a7d7fa640 1 -- 172.21.15.170:0/295708082 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b94015510 con 0x559247d45ac0 2024-09-12T17:29:48.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.712+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559247d4e470 con 0x559247d45ac0 2024-09-12T17:29:48.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.712+0000 7f8a7d7fa640 1 -- 172.21.15.170:0/295708082 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8b94031020 con 0x559247d45ac0 2024-09-12T17:29:48.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.713+0000 7f8a7d7fa640 1 --2- 172.21.15.170:0/295708082 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8a6403c780 0x7f8a6403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.713+0000 7f8a7d7fa640 1 -- 172.21.15.170:0/295708082 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f8b94033be0 con 0x559247d45ac0 2024-09-12T17:29:48.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.713+0000 7f8b9b119640 1 --2- 172.21.15.170:0/295708082 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8a6403c780 0x7f8a6403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.713+0000 7f8b9b119640 1 --2- 172.21.15.170:0/295708082 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8a6403c780 0x7f8a6403ec40 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c004bb0 tx=0x7f8b8c045000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.713+0000 7f8b9d62f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.713+0000 7f8b9d62f800 1 --2- 172.21.15.170:0/295708082 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x559247d58a60 0x559247d5af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.713+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559247d5b670 con 0x559247d58a60 2024-09-12T17:29:48.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.713+0000 7f8b9a918640 1 --2- 172.21.15.170:0/295708082 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x559247d58a60 0x559247d5af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.714+0000 7f8b9a918640 1 --2- 172.21.15.170:0/295708082 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x559247d58a60 0x559247d5af20 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.714+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b84051070 con 0x559247d58a60 2024-09-12T17:29:48.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.714+0000 7f8b9d62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.714+0000 7f8b9d62f800 20 realm 2024-09-12T17:29:48.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.714+0000 7f8b9d62f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.714+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559247d5baa0 con 0x559247d58a60 2024-09-12T17:29:48.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.714+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b84051070 con 0x559247d58a60 2024-09-12T17:29:48.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.714+0000 7f8b9d62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.714+0000 7f8b9d62f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:29:48.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.714+0000 7f8b9d62f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.714+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559247d5c370 con 0x559247d58a60 2024-09-12T17:29:48.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.714+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b84051070 con 0x559247d58a60 2024-09-12T17:29:48.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.714+0000 7f8b9d62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.714+0000 7f8b9d62f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.714+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559247d5c710 con 0x559247d58a60 2024-09-12T17:29:48.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.714+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8b84051070 con 0x559247d58a60 2024-09-12T17:29:48.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.714+0000 7f8b9d62f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:48.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.714+0000 7f8b9d62f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.715+0000 7f8b9d62f800 1 --2- 172.21.15.170:0/295708082 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x559247d5d470 0x559247d5f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.715+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559247d5fe70 con 0x559247d5d470 2024-09-12T17:29:48.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.715+0000 7f8b9b91a640 1 --2- 172.21.15.170:0/295708082 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x559247d5d470 0x559247d5f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.715+0000 7f8b9b91a640 1 --2- 172.21.15.170:0/295708082 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x559247d5d470 0x559247d5f860 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.715+0000 7f8b9b91a640 1 -- 172.21.15.170:0/295708082 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8b940083e0 con 0x559247d5d470 2024-09-12T17:29:48.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.715+0000 7f8b9d62f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:29:48.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.715+0000 7f8b9d62f800 20 searching for the correct realm 2024-09-12T17:29:48.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.715+0000 7f8b9d62f800 1 --2- 172.21.15.170:0/295708082 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x559247d61e20 0x559247d642e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.715+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559247d64960 con 0x559247d61e20 2024-09-12T17:29:48.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.715+0000 7f8b9b119640 1 --2- 172.21.15.170:0/295708082 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x559247d61e20 0x559247d642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.716+0000 7f8b9b119640 1 --2- 172.21.15.170:0/295708082 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x559247d61e20 0x559247d642e0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.716+0000 7f8b9b119640 1 -- 172.21.15.170:0/295708082 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b8c04e050 con 0x559247d61e20 2024-09-12T17:29:48.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.716+0000 7f8b9b119640 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559247d64960 con 0x559247d5d470 2024-09-12T17:29:48.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.716+0000 7f8b9b91a640 1 -- 172.21.15.170:0/295708082 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b940083e0 con 0x559247d5d470 2024-09-12T17:29:48.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.716+0000 7f8b9b91a640 1 --2- 172.21.15.170:0/295708082 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f8b9403e040 0x7f8b94045220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:29:48.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.716+0000 7f8b9b91a640 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559247d64960 con 0x7f8b9403e040 2024-09-12T17:29:48.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.716+0000 7f8b9a918640 1 --2- 172.21.15.170:0/295708082 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f8b9403e040 0x7f8b94045220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:29:48.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.717+0000 7f8b9a918640 1 --2- 172.21.15.170:0/295708082 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f8b9403e040 0x7f8b94045220 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:29:48.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.717+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b84051070 con 0x7f8b9403e040 2024-09-12T17:29:48.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.717+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559247d64960 con 0x559247d58a60 2024-09-12T17:29:48.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.717+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b84051070 con 0x559247d58a60 2024-09-12T17:29:48.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.717+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559247d64960 con 0x559247d58a60 2024-09-12T17:29:48.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.717+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b84051070 con 0x559247d58a60 2024-09-12T17:29:48.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.717+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559247d64960 con 0x7f8b9403e040 2024-09-12T17:29:48.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.718+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b84051070 con 0x7f8b9403e040 2024-09-12T17:29:48.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.718+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559247d64960 con 0x7f8b9403e040 2024-09-12T17:29:48.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.718+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b84051070 con 0x7f8b9403e040 2024-09-12T17:29:48.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.718+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559247d64960 con 0x559247d5d470 2024-09-12T17:29:48.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.718+0000 7f8b9b91a640 1 -- 172.21.15.170:0/295708082 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b940083e0 con 0x559247d5d470 2024-09-12T17:29:48.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.718+0000 7f8b9b91a640 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559247d64960 con 0x559247d61e20 2024-09-12T17:29:48.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.718+0000 7f8b9b119640 1 -- 172.21.15.170:0/295708082 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b8c05d040 con 0x559247d61e20 2024-09-12T17:29:48.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.718+0000 7f8b9b119640 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559247d64960 con 0x559247d58a60 2024-09-12T17:29:48.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.718+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b84051070 con 0x559247d58a60 2024-09-12T17:29:48.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.718+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559247d64960 con 0x7f8b9403e040 2024-09-12T17:29:48.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.719+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b84051070 con 0x7f8b9403e040 2024-09-12T17:29:48.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.719+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559247d64960 con 0x559247d58a60 2024-09-12T17:29:48.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.719+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b84051070 con 0x559247d58a60 2024-09-12T17:29:48.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.719+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559247d64960 con 0x559247d5d470 2024-09-12T17:29:48.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.719+0000 7f8b9b91a640 1 -- 172.21.15.170:0/295708082 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f8b940083e0 con 0x559247d5d470 2024-09-12T17:29:48.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.719+0000 7f8b9b91a640 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559247d64960 con 0x559247d61e20 2024-09-12T17:29:48.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.719+0000 7f8b9b119640 1 -- 172.21.15.170:0/295708082 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b8c05d040 con 0x559247d61e20 2024-09-12T17:29:48.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.719+0000 7f8b9b119640 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559247d64960 con 0x559247d61e20 2024-09-12T17:29:48.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.720+0000 7f8b9b119640 1 -- 172.21.15.170:0/295708082 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b8c05d040 con 0x559247d61e20 2024-09-12T17:29:48.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.720+0000 7f8b9b119640 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559247d64960 con 0x559247d5d470 2024-09-12T17:29:48.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.720+0000 7f8b9b91a640 1 -- 172.21.15.170:0/295708082 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b940083e0 con 0x559247d5d470 2024-09-12T17:29:48.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.720+0000 7f8b9b91a640 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559247d64960 con 0x559247d61e20 2024-09-12T17:29:48.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.720+0000 7f8b9b119640 1 -- 172.21.15.170:0/295708082 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b8c05d040 con 0x559247d61e20 2024-09-12T17:29:48.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.720+0000 7f8b9b119640 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559247d64960 con 0x559247d61e20 2024-09-12T17:29:48.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.720+0000 7f8b9b119640 1 -- 172.21.15.170:0/295708082 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b8c05d040 con 0x559247d61e20 2024-09-12T17:29:48.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.720+0000 7f8b9b119640 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559247d64960 con 0x559247d58a60 2024-09-12T17:29:48.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.721+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b84051070 con 0x559247d58a60 2024-09-12T17:29:48.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.721+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559247d64960 con 0x559247d58a60 2024-09-12T17:29:48.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.721+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v31'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8b84051070 con 0x559247d58a60 2024-09-12T17:29:48.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.721+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559247d64960 con 0x7f8b9403e040 2024-09-12T17:29:48.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.721+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b84051070 con 0x7f8b9403e040 2024-09-12T17:29:48.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.721+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559247d64960 con 0x559247d61e20 2024-09-12T17:29:48.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.721+0000 7f8b9b119640 1 -- 172.21.15.170:0/295708082 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b8c05d040 con 0x559247d61e20 2024-09-12T17:29:48.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.721+0000 7f8b9b119640 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559247d64960 con 0x559247d5d470 2024-09-12T17:29:48.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.721+0000 7f8b9b91a640 1 -- 172.21.15.170:0/295708082 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b940083e0 con 0x559247d5d470 2024-09-12T17:29:48.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.722+0000 7f8b9b91a640 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559247d64960 con 0x559247d58a60 2024-09-12T17:29:48.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.722+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b84051070 con 0x559247d58a60 2024-09-12T17:29:48.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.722+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559247d64960 con 0x7f8b9403e040 2024-09-12T17:29:48.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.722+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b84051070 con 0x7f8b9403e040 2024-09-12T17:29:48.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.722+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559247d64960 con 0x559247d61e20 2024-09-12T17:29:48.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.722+0000 7f8b9b119640 1 -- 172.21.15.170:0/295708082 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b8c05d040 con 0x559247d61e20 2024-09-12T17:29:48.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.722+0000 7f8b9b119640 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559247d64960 con 0x7f8b9403e040 2024-09-12T17:29:48.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.723+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b84051070 con 0x7f8b9403e040 2024-09-12T17:29:48.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.723+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559247d64960 con 0x559247d5d470 2024-09-12T17:29:48.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.723+0000 7f8b9b91a640 1 -- 172.21.15.170:0/295708082 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b94066040 con 0x559247d5d470 2024-09-12T17:29:48.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.723+0000 7f8b9b91a640 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559247d64960 con 0x559247d61e20 2024-09-12T17:29:48.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.723+0000 7f8b9b119640 1 -- 172.21.15.170:0/295708082 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b8c05d040 con 0x559247d61e20 2024-09-12T17:29:48.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.723+0000 7f8b9b119640 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559247d64960 con 0x7f8b9403e040 2024-09-12T17:29:48.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.723+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b84051070 con 0x7f8b9403e040 2024-09-12T17:29:48.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.723+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559247d64960 con 0x559247d58a60 2024-09-12T17:29:48.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.724+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8b84051070 con 0x559247d58a60 2024-09-12T17:29:48.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.724+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559247d64960 con 0x559247d5d470 2024-09-12T17:29:48.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.724+0000 7f8b9b91a640 1 -- 172.21.15.170:0/295708082 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(37 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8b94066040 con 0x559247d5d470 2024-09-12T17:29:48.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.724+0000 7f8b9d62f800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:29:48.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.724+0000 7f8b9d62f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:29:48.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.724+0000 7f8b9d62f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:29:48.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.724+0000 7f8b9d62f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:29:48.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.724+0000 7f8b9d62f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:29:48.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.724+0000 7f8b9d62f800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:29:48.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.724+0000 7f8b9d62f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.724+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559247d60830 con 0x559247d58a60 2024-09-12T17:29:48.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.724+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b84051070 con 0x559247d58a60 2024-09-12T17:29:48.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.724+0000 7f8b9d62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.724+0000 7f8b9d62f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.724+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559247d610d0 con 0x559247d58a60 2024-09-12T17:29:48.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.724+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8b84051070 con 0x559247d58a60 2024-09-12T17:29:48.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.724+0000 7f8b9d62f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:48.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.724+0000 7f8b9d62f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.724+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559247d60470 con 0x559247d5d470 2024-09-12T17:29:48.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.724+0000 7f8b9b91a640 1 -- 172.21.15.170:0/295708082 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8b94066040 con 0x559247d5d470 2024-09-12T17:29:48.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.724+0000 7f8b9d62f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:29:48.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.725+0000 7f8b9d62f800 20 zone default found 2024-09-12T17:29:48.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.725+0000 7f8b9d62f800 4 Realm: () 2024-09-12T17:29:48.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.725+0000 7f8b9d62f800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:29:48.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.725+0000 7f8b9d62f800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:29:48.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.725+0000 7f8b9d62f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:29:48.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.725+0000 7f8b9d62f800 20 zonegroup default 2024-09-12T17:29:48.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.725+0000 7f8b9d62f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.725+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559247d65290 con 0x7f8b9403e040 2024-09-12T17:29:48.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.725+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8b84051070 con 0x7f8b9403e040 2024-09-12T17:29:48.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.725+0000 7f8b9d62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.725+0000 7f8b9d62f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.725+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559247d674d0 con 0x559247d61e20 2024-09-12T17:29:48.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.725+0000 7f8b9b119640 1 -- 172.21.15.170:0/295708082 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8b8c05d040 con 0x559247d61e20 2024-09-12T17:29:48.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.725+0000 7f8b9d62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.725+0000 7f8b9d62f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.725+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559247d67870 con 0x559247d61e20 2024-09-12T17:29:48.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.725+0000 7f8b9b119640 1 -- 172.21.15.170:0/295708082 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8b8c05d040 con 0x559247d61e20 2024-09-12T17:29:48.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.725+0000 7f8b9d62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:48.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.725+0000 7f8b9d62f800 20 started sync module instance, tier type = 2024-09-12T17:29:48.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.725+0000 7f8b9d62f800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:29:48.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.725+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559247d66960 con 0x559247d5d470 2024-09-12T17:29:48.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.726+0000 7f8b9b91a640 1 -- 172.21.15.170:0/295708082 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(44 notify.0 [create] v31'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b94066040 con 0x559247d5d470 2024-09-12T17:29:48.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.726+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94086758821472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559247d66960 con 0x559247d5d470 2024-09-12T17:29:48.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.726+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559247d68300 con 0x559247d58a60 2024-09-12T17:29:48.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.727+0000 7f8b9b91a640 1 -- 172.21.15.170:0/295708082 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94086758821472] v31'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b94066040 con 0x559247d5d470 2024-09-12T17:29:48.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.728+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v31'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b84051070 con 0x559247d58a60 2024-09-12T17:29:48.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.728+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94086758825424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559247d66960 con 0x559247d58a60 2024-09-12T17:29:48.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.728+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559247d68db0 con 0x559247d61e20 2024-09-12T17:29:48.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.729+0000 7f8b9b119640 1 -- 172.21.15.170:0/295708082 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v31'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b8c05d040 con 0x559247d61e20 2024-09-12T17:29:48.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.729+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94086758828176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559247d69650 con 0x559247d61e20 2024-09-12T17:29:48.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.729+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559247d6a110 con 0x559247d5d470 2024-09-12T17:29:48.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.729+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94086758825424] v31'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b84051070 con 0x559247d58a60 2024-09-12T17:29:48.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.730+0000 7f8b9b119640 1 -- 172.21.15.170:0/295708082 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94086758828176] v31'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b8c05d040 con 0x559247d61e20 2024-09-12T17:29:48.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.730+0000 7f8b9b91a640 1 -- 172.21.15.170:0/295708082 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(50 notify.3 [create] v31'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b94066040 con 0x559247d5d470 2024-09-12T17:29:48.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.730+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94086758830496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559247d664b0 con 0x559247d5d470 2024-09-12T17:29:48.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.730+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559247d6a9f0 con 0x559247d58a60 2024-09-12T17:29:48.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.731+0000 7f8b9b91a640 1 -- 172.21.15.170:0/295708082 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94086758830496] v31'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b94066040 con 0x559247d5d470 2024-09-12T17:29:48.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.731+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v31'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b84051070 con 0x559247d58a60 2024-09-12T17:29:48.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.731+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94086758833120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559247d6a9b0 con 0x559247d58a60 2024-09-12T17:29:48.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.731+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559247d6b450 con 0x7f8b9403e040 2024-09-12T17:29:48.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.732+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94086758833120] v31'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b84051070 con 0x559247d58a60 2024-09-12T17:29:48.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.732+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(54 notify.5 [create] v31'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b84051070 con 0x7f8b9403e040 2024-09-12T17:29:48.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.732+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94086758838144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559247d6a9b0 con 0x7f8b9403e040 2024-09-12T17:29:48.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.732+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559247d6bea0 con 0x7f8b9403e040 2024-09-12T17:29:48.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.733+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94086758838144] v31'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b84051070 con 0x7f8b9403e040 2024-09-12T17:29:48.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.733+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v31'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b84051070 con 0x7f8b9403e040 2024-09-12T17:29:48.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.733+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94086758840752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559247d6a9b0 con 0x7f8b9403e040 2024-09-12T17:29:48.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.733+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559247d6c8b0 con 0x7f8b9403e040 2024-09-12T17:29:48.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.734+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94086758840752] v31'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b84051070 con 0x7f8b9403e040 2024-09-12T17:29:48.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.734+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(58 notify.7 [create] v31'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b84051070 con 0x7f8b9403e040 2024-09-12T17:29:48.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.734+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94086758835456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559247d6ca90 con 0x7f8b9403e040 2024-09-12T17:29:48.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.734+0000 7f8b9d62f800 20 add_watcher() i=0 2024-09-12T17:29:48.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.734+0000 7f8b9d62f800 20 add_watcher() i=1 2024-09-12T17:29:48.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.734+0000 7f8b9d62f800 20 add_watcher() i=2 2024-09-12T17:29:48.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.734+0000 7f8b9d62f800 20 add_watcher() i=3 2024-09-12T17:29:48.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.734+0000 7f8b9d62f800 20 add_watcher() i=4 2024-09-12T17:29:48.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.734+0000 7f8b9d62f800 20 add_watcher() i=5 2024-09-12T17:29:48.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.734+0000 7f8b9d62f800 20 add_watcher() i=6 2024-09-12T17:29:48.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.735+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94086758835456] v31'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b84051070 con 0x7f8b9403e040 2024-09-12T17:29:48.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.735+0000 7f8b9d62f800 20 add_watcher() i=7 2024-09-12T17:29:48.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.735+0000 7f8b9d62f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:29:48.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.735+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559247d6fc60 con 0x559247d58a60 2024-09-12T17:29:48.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.736+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8b84051070 con 0x559247d58a60 2024-09-12T17:29:48.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.736+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94086758843968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559247d6cf10 con 0x559247d58a60 2024-09-12T17:29:48.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.737+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94086758843968] v31'272 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8b84051070 con 0x559247d58a60 2024-09-12T17:29:48.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.737+0000 7f8a51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:48.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.737+0000 7f8b9d62f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:29:48.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.737+0000 7f8b9d62f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:29:48.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.737+0000 7f8b9d62f800 5 note: GC not initialized 2024-09-12T17:29:48.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.737+0000 7f8a50fe1640 20 reqs_thread_entry: start 2024-09-12T17:29:48.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.737+0000 7f8b9d62f800 20 init_complete bucket index max shards: 11 2024-09-12T17:29:48.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.737+0000 7f8b9d62f800 20 Filter name: none 2024-09-12T17:29:48.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.737+0000 7f89ca7fc640 20 reqs_thread_entry: start 2024-09-12T17:29:48.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.737+0000 7f8b9d62f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-12T17:29:48.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.737+0000 7f8b9d62f800 20 rados->read ofs=0 len=0 2024-09-12T17:29:48.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.738+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559247da2d60 con 0x7f8b9403e040 2024-09-12T17:29:48.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.738+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f8b84051070 con 0x7f8b9403e040 2024-09-12T17:29:48.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.738+0000 7f8b9d62f800 20 rados_obj.operate() r=0 bl.length=473 2024-09-12T17:29:48.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.738+0000 7f8b9d62f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-12T17:29:48.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.738+0000 7f8b9d62f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:29:48.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.738+0000 7f8b9d62f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:29:48.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.738+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559247da9490 con 0x7f8b9403e040 2024-09-12T17:29:48.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.739+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v31'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f8b84051070 con 0x7f8b9403e040 2024-09-12T17:29:48.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.739+0000 7f8b9d62f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T17:29:48.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.739+0000 7f8b9d62f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:29:48.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.739+0000 7f8b9d62f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-12T17:29:48.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.739+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94086759091856 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559247da4b30 con 0x559247d58a60 2024-09-12T17:29:48.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.740+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== watch-notify(notify (1) cookie 94086758833120 notify 133143986207 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7f8b84082040 con 0x559247d58a60 2024-09-12T17:29:48.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.740+0000 7f8a7effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986207 cookie 94086758833120 notifier 4918 bl.length()=649 2024-09-12T17:29:48.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.740+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(64 notify.4 [notify cookie 94086759091856 out=8b] v0'0 uv279 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8b84051070 con 0x559247d58a60 2024-09-12T17:29:48.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.740+0000 7f8a7effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T17:29:48.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.740+0000 7f8a7effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:29:48.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.740+0000 7f8a7effd640 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f8a60003ea0 con 0x559247d58a60 2024-09-12T17:29:48.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.740+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b84051070 con 0x559247d58a60 2024-09-12T17:29:48.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.740+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== watch-notify(notify_complete (2) cookie 94086759091856 notify 133143986207 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559247ab56b0 con 0x559247d58a60 2024-09-12T17:29:48.754 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-12T17:29:46.782056Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:29:46.782042Z","tags":[],"group_ids":[]} 2024-09-12T17:29:48.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.741+0000 7f8a51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:48.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.741+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94086758843968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559247da0bd0 con 0x559247d58a60 2024-09-12T17:29:48.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.742+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94086758843968] v31'273 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8b84051070 con 0x559247d58a60 2024-09-12T17:29:48.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.742+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94086758821472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559247da0bd0 con 0x559247d5d470 2024-09-12T17:29:48.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.743+0000 7f8b9b91a640 1 -- 172.21.15.170:0/295708082 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94086758821472] v31'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b94066040 con 0x559247d5d470 2024-09-12T17:29:48.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.743+0000 7f8b9d62f800 20 remove_watcher() i=0 2024-09-12T17:29:48.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.743+0000 7f8b9d62f800 2 removed watcher, disabling cache 2024-09-12T17:29:48.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.743+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94086758825424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559247da0bd0 con 0x559247d58a60 2024-09-12T17:29:48.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.744+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94086758825424] v31'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b84051070 con 0x559247d58a60 2024-09-12T17:29:48.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.744+0000 7f8b9d62f800 20 remove_watcher() i=1 2024-09-12T17:29:48.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.744+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94086758828176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559247da0bd0 con 0x559247d61e20 2024-09-12T17:29:48.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.745+0000 7f8b9b119640 1 -- 172.21.15.170:0/295708082 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94086758828176] v31'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b8c05d040 con 0x559247d61e20 2024-09-12T17:29:48.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.745+0000 7f8b9d62f800 20 remove_watcher() i=2 2024-09-12T17:29:48.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.745+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94086758830496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559247da0bd0 con 0x559247d5d470 2024-09-12T17:29:48.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.746+0000 7f8b9b91a640 1 -- 172.21.15.170:0/295708082 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94086758830496] v31'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b94066040 con 0x559247d5d470 2024-09-12T17:29:48.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.746+0000 7f8b9d62f800 20 remove_watcher() i=3 2024-09-12T17:29:48.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.746+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94086758833120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559247da0bd0 con 0x559247d58a60 2024-09-12T17:29:48.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.747+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94086758833120] v31'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b84051070 con 0x559247d58a60 2024-09-12T17:29:48.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.747+0000 7f8b9d62f800 20 remove_watcher() i=4 2024-09-12T17:29:48.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.747+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94086758838144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559247da0bd0 con 0x7f8b9403e040 2024-09-12T17:29:48.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.748+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94086758838144] v31'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b84051070 con 0x7f8b9403e040 2024-09-12T17:29:48.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.748+0000 7f8b9d62f800 20 remove_watcher() i=5 2024-09-12T17:29:48.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.748+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94086758840752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559247da0bd0 con 0x7f8b9403e040 2024-09-12T17:29:48.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.749+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94086758840752] v31'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b84051070 con 0x7f8b9403e040 2024-09-12T17:29:48.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.749+0000 7f8b9d62f800 20 remove_watcher() i=6 2024-09-12T17:29:48.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.749+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94086758835456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559247da0bd0 con 0x7f8b9403e040 2024-09-12T17:29:48.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.750+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94086758835456] v31'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b84051070 con 0x7f8b9403e040 2024-09-12T17:29:48.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.750+0000 7f8b9d62f800 20 remove_watcher() i=7 2024-09-12T17:29:48.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.751+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f8b9403e040 msgr2=0x7f8b94045220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.751+0000 7f8b9d62f800 1 --2- 172.21.15.170:0/295708082 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f8b9403e040 0x7f8b94045220 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.751+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x559247d58a60 msgr2=0x559247d5af20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.751+0000 7f8b9d62f800 1 --2- 172.21.15.170:0/295708082 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x559247d58a60 0x559247d5af20 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.751+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x559247d5d470 msgr2=0x559247d5f860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.751+0000 7f8b9d62f800 1 --2- 172.21.15.170:0/295708082 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x559247d5d470 0x559247d5f860 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.751+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x559247d61e20 msgr2=0x559247d642e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.751+0000 7f8b9d62f800 1 --2- 172.21.15.170:0/295708082 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x559247d61e20 0x559247d642e0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.751+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8a6403c780 msgr2=0x7f8a6403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.751+0000 7f8b9d62f800 1 --2- 172.21.15.170:0/295708082 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8a6403c780 0x7f8a6403ec40 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c004bb0 tx=0x7f8b8c045000 comp rx=0 tx=0).stop 2024-09-12T17:29:48.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.751+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559247d45ac0 msgr2=0x559247d4d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.751+0000 7f8b9a918640 1 -- 172.21.15.170:0/295708082 reap_dead start 2024-09-12T17:29:48.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.751+0000 7f8b9d62f800 1 --2- 172.21.15.170:0/295708082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559247d45ac0 0x559247d4d0f0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f8b940531d0 tx=0x7f8b94053200 comp rx=0 tx=0).stop 2024-09-12T17:29:48.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.751+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 shutdown_connections 2024-09-12T17:29:48.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.751+0000 7f8b9d62f800 1 --2- 172.21.15.170:0/295708082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559247d45ac0 0x559247d4d0f0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.751+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 >> 172.21.15.170:0/295708082 conn(0x559247d41ec0 msgr2=0x559247d400d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:48.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.751+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 shutdown_connections 2024-09-12T17:29:48.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.751+0000 7f8b9d62f800 1 -- 172.21.15.170:0/295708082 wait complete. 2024-09-12T17:29:48.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.751+0000 7f8b9d62f800 1 -- 172.21.15.170:0/1489203659 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8a7403c780 msgr2=0x7f8a7403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.751+0000 7f8b9d62f800 1 --2- 172.21.15.170:0/1489203659 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8a7403c780 0x7f8a7403ec40 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c01dcf0 tx=0x7f8b8c051f80 comp rx=0 tx=0).stop 2024-09-12T17:29:48.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.751+0000 7f8b9d62f800 1 -- 172.21.15.170:0/1489203659 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559247d39060 msgr2=0x559247d39480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.751+0000 7f8b9d62f800 1 --2- 172.21.15.170:0/1489203659 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559247d39060 0x559247d39480 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x559247d200a0 tx=0x7f8b9400bf30 comp rx=0 tx=0).stop 2024-09-12T17:29:48.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.751+0000 7f8b9d62f800 1 -- 172.21.15.170:0/1489203659 shutdown_connections 2024-09-12T17:29:48.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.751+0000 7f8b9d62f800 1 --2- 172.21.15.170:0/1489203659 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8a7403c780 0x7f8a7403ec40 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.751+0000 7f8b9d62f800 1 --2- 172.21.15.170:0/1489203659 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559247d39060 0x559247d39480 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.751+0000 7f8b9d62f800 1 -- 172.21.15.170:0/1489203659 >> 172.21.15.170:0/1489203659 conn(0x559247d2d410 msgr2=0x559247d2d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:48.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.751+0000 7f8b9d62f800 1 -- 172.21.15.170:0/1489203659 shutdown_connections 2024-09-12T17:29:48.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.751+0000 7f8b9d62f800 1 -- 172.21.15.170:0/1489203659 wait complete. 2024-09-12T17:29:48.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.752+0000 7f8b9d62f800 1 -- 172.21.15.170:0/3228495720 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x559247b99a90 msgr2=0x559247d257c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.752+0000 7f8b9d62f800 1 --2- 172.21.15.170:0/3228495720 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x559247b99a90 0x559247d257c0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.752+0000 7f8b9d62f800 1 -- 172.21.15.170:0/3228495720 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x559247d27ba0 msgr2=0x559247d2a020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.752+0000 7f8b9d62f800 1 --2- 172.21.15.170:0/3228495720 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x559247d27ba0 0x559247d2a020 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.752+0000 7f8b9d62f800 1 -- 172.21.15.170:0/3228495720 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8a8003c730 msgr2=0x7f8a8003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.752+0000 7f8b9d62f800 1 --2- 172.21.15.170:0/3228495720 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8a8003c730 0x7f8a8003ebf0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8b84057000 tx=0x7f8b84052000 comp rx=0 tx=0).stop 2024-09-12T17:29:48.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.752+0000 7f8b9d62f800 1 -- 172.21.15.170:0/3228495720 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559247b98f80 msgr2=0x559247d1e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:29:48.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.752+0000 7f8b9d62f800 1 --2- 172.21.15.170:0/3228495720 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559247b98f80 0x559247d1e170 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c0066b0 tx=0x7f8b8c001250 comp rx=0 tx=0).stop 2024-09-12T17:29:48.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.752+0000 7f8b9d62f800 1 -- 172.21.15.170:0/3228495720 shutdown_connections 2024-09-12T17:29:48.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.752+0000 7f8b9d62f800 1 --2- 172.21.15.170:0/3228495720 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x559247d27ba0 0x559247d2a020 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.752+0000 7f8b9d62f800 1 --2- 172.21.15.170:0/3228495720 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f8a8003c730 0x7f8a8003ebf0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.752+0000 7f8b9d62f800 1 --2- 172.21.15.170:0/3228495720 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x559247b99a90 0x559247d257c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.752+0000 7f8b9d62f800 1 --2- 172.21.15.170:0/3228495720 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559247b98f80 0x559247d1e170 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:29:48.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.752+0000 7f8b9d62f800 1 -- 172.21.15.170:0/3228495720 >> 172.21.15.170:0/3228495720 conn(0x559247c203d0 msgr2=0x559247d17b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:29:48.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.752+0000 7f8b9d62f800 1 -- 172.21.15.170:0/3228495720 shutdown_connections 2024-09-12T17:29:48.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:29:48.752+0000 7f8b9d62f800 1 -- 172.21.15.170:0/3228495720 wait complete. 2024-09-12T17:29:48.765 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T17:29:46.782056Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:29:46.782042Z', 'tags': [], 'group_ids': []} 2024-09-12T17:29:48.765 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T17:29:46.782056Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:29:46.782042Z', 'tags': [], 'group_ids': []} 2024-09-12T17:29:48.766 ERROR:root:0 2024-09-12T17:29:48.766 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-12T17:29:48.772 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:29:48.773 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T17:29:48.776 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:29:48.777 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-12T17:29:48.782 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:29:48.782 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T17:29:48.788 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:29:48.789 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2024-09-12T17:29:48.796 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}] 2024-09-12T17:29:48.797 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T17:29:48.800 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:29:48.801 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2024-09-12T17:29:48.808 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T17:29:48.808 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T17:29:48.811 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:29:48.812 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2024-09-12T17:29:48.818 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2024-09-12T17:29:48.819 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T17:29:48.822 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:29:48.822 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2024-09-12T17:29:48.830 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2024-09-12T17:29:48.830 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T17:29:48.834 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:29:48.834 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2024-09-12T17:29:48.841 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T17:29:48.841 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T17:29:48.845 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:29:48.845 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2024-09-12T17:29:48.849 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T17:29:48.850 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T17:29:48.853 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:29:48.853 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2024-09-12T17:29:48.861 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T17:29:48.861 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T17:29:48.866 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:29:48.867 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-12T17:29:48.871 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-12T17:29:48.872 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-12T17:29:48.876 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-12T17:29:48.887 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-12T17:29:48.892 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2024-09-12T17:29:48.892 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-12T17:29:48.896 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'dc43fae2-274b-4ee4-ac82-d8ac27e45bf4', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.11', 'marker': '7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-12T17:29:48.883193Z', 'creation_time': '2024-09-12T17:29:48.880697Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-12T17:29:48.896 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-12T17:29:48.901 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'dc43fae2-274b-4ee4-ac82-d8ac27e45bf4', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.11', 'marker': '7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-12T17:29:48.883193Z', 'creation_time': '2024-09-12T17:29:48.880697Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1}] 2024-09-12T17:29:48.905 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-12T17:29:48.909 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'dc43fae2-274b-4ee4-ac82-d8ac27e45bf4', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.11', 'marker': '7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-12T17:29:48.883193Z', 'creation_time': '2024-09-12T17:29:48.880697Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-12T17:29:48.910 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2024-09-12T17:29:48.914 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'Message': '', 'RequestId': 'tx00000558096810430e296-0066e3250c-4225-default', 'HostId': '4225-default-default'} 2024-09-12T17:29:48.918 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2024-09-12T17:29:48.925 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T17:29:48.925 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2024-09-12T17:29:48.935 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'fud', 'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:29:48.986 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': '7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.11'} 2024-09-12T17:29:48.996 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T17:29:48.999 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': '7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.11'} 2024-09-12T17:29:49.008 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T17:29:49.009 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2024-09-12T17:29:49.018 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T17:29:49.024 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2024-09-12T17:29:49.033 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T17:29:49.033 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-12T17:29:49.038 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'dc43fae2-274b-4ee4-ac82-d8ac27e45bf4', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.11', 'marker': '7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-12T17:29:49.004339Z', 'creation_time': '2024-09-12T17:29:48.880697Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 3} 2024-09-12T17:30:49.081 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2024-09-12T17:30:49.101 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'anonymous', 'categories': [], 's3select': {}}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'bar', 'categories': [], 's3select': {}}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'bud', 'categories': [], 's3select': {}}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'fud', 'categories': [], 's3select': {}}, {'bucket': 'myfoo7', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'fud', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T17:30:49.102 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2024-09-12T17:30:49.119 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'useless-bucket', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo7', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 242, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T17:30:49.120 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-12T17:30:49.126 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'useless-bucket', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T17:30:49.127 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2024-09-12T17:30:49.132 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T17:30:49.133 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2024-09-12T17:30:49.139 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T17:30:49.139 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2024-09-12T17:30:49.144 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T17:30:49.145 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2024-09-12T17:30:49.149 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T17:30:49.149 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2024-09-12T17:30:49.155 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T17:30:49.156 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-12T17:30:49.161 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2024-09-12T17:30:49.161 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-12T17:30:49.171 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:30:49.176 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-12T17:30:49.185 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:30:49.893 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-12T17:30:49.898 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000760b0eafc7b81033-0066e32549-4225-default', 'HostId': '4225-default-default'} 2024-09-12T17:30:49.998 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-12T17:30:50.004 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-12T17:30:50.009 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-12T17:30:50.014 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'group': 1, 'permission': {'flags': 1}}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-12T17:30:50.125 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2024-09-12T17:30:50.158 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T17:30:50.158 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-12T17:30:50.167 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2024-09-12T17:30:50.168 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-12T17:30:50.177 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-12T17:30:50.187 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-12T17:30:50.192 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000927aecf0beca3275-0066e3254a-4225-default', 'HostId': '4225-default-default'} 2024-09-12T17:30:50.211 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2024-09-12T17:30:50.242 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T17:30:50.243 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T17:30:50.249 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000810dc5beda2df47b-0066e3254a-4225-default', 'HostId': '4225-default-default'} 2024-09-12T17:30:50.249 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2024-09-12T17:30:50.252 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': 'e43073ba-e4e6-405e-a192-e8c972c1bee5'}]}} 2024-09-12T17:30:50.253 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2024-09-12T17:30:50.263 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'ratelimit_user', 'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:30:50.263 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-12T17:30:50.267 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-12T17:30:50.267 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2024-09-12T17:30:50.272 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000c1271e5359d6939a-0066e3254a-4225-default', 'HostId': '4225-default-default'} 2024-09-12T17:30:50.272 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2024-09-12T17:30:50.277 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx0000080a90acd316655c5-0066e3254a-4225-default', 'HostId': '4225-default-default'} 2024-09-12T17:30:50.286 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-12T17:30:50.291 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-12T17:30:50.291 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2024-09-12T17:30:50.295 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx0000037bdf461d0f786cd-0066e3254a-4225-default', 'HostId': '4225-default-default'} 2024-09-12T17:30:50.295 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2024-09-12T17:30:50.299 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000b7516074a1e44866-0066e3254a-4225-default', 'HostId': '4225-default-default'} 2024-09-12T17:30:50.300 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2024-09-12T17:30:50.304 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-12T17:30:50.305 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2024-09-12T17:30:50.309 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx0000027f7435e14f33f76-0066e3254a-4225-default', 'HostId': '4225-default-default'} 2024-09-12T17:30:50.310 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2024-09-12T17:30:50.313 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000163f75f567b511ef-0066e3254a-4225-default', 'HostId': '4225-default-default'} 2024-09-12T17:30:50.314 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2024-09-12T17:30:50.319 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx0000017b85537aee4a42b-0066e3254a-4225-default', 'HostId': '4225-default-default'} 2024-09-12T17:30:50.319 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2024-09-12T17:30:50.325 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000001c34dde2b4d3ab33-0066e3254a-4225-default', 'HostId': '4225-default-default'} 2024-09-12T17:30:50.326 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2024-09-12T17:30:50.335 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T17:30:50.335 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-12T17:30:50.339 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2024-09-12T17:30:50.339 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2024-09-12T17:30:50.345 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T17:30:50.345 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-12T17:30:50.348 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2024-09-12T17:30:50.349 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2024-09-12T17:30:50.355 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T17:30:50.361 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-12T17:30:50.370 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-12T17:30:50.370 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T17:30:50.371 INFO:tasks.rgw.client.0.smithi170.stdout:2024-09-12T17:30:50.369+0000 7fdcdaee6640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 35048) UID: 0 2024-09-12T17:30:50.371 INFO:tasks.rgw.client.0.smithi170.stdout:2024-09-12T17:30:50.369+0000 7fdcde746880 -1 shutting down 2024-09-12T17:30:55.220 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-09-12T17:30:56.472 INFO:tasks.rgw.client.0:Stopped 2024-09-12T17:30:56.473 DEBUG:teuthology.orchestra.run.smithi170:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-12T17:30:56.493 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f /etc/ceph/vault-root-token 2024-09-12T17:30:56.563 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-12T17:30:56.633 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-12T17:30:56.633 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-12T17:30:56.633 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-12T17:30:56.721 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:56.721 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:56.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.721+0000 7f30aeb33800 1 Processor -- start 2024-09-12T17:30:56.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.721+0000 7f30aeb33800 1 -- start start 2024-09-12T17:30:56.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.721+0000 7f30aeb33800 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5587061b34a0 0x5587061b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:30:56.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.721+0000 7f30aeb33800 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55870605ee40 con 0x5587061b3de0 2024-09-12T17:30:56.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.721+0000 7f30aeb33800 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x558706029680 con 0x5587061b34a0 2024-09-12T17:30:56.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.721+0000 7f30aa876640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x5587061b34a0 0x5587061b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:30:56.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.721+0000 7f30a3fff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x5587061b3de0 0x5587061b4290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.170:36104/0 (socket says 172.21.15.170:36104) 2024-09-12T17:30:56.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.722+0000 7f30a3fff640 1 -- 172.21.15.170:0/376455635 learned_addr learned my addr 172.21.15.170:0/376455635 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-09-12T17:30:56.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.722+0000 7f30aa876640 1 -- 172.21.15.170:0/376455635 >> v1:172.21.15.47:6789/0 conn(0x5587061b3de0 legacy=0x5587061b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:56.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.722+0000 7f30aa876640 1 -- 172.21.15.170:0/376455635 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587060456b0 con 0x5587061b34a0 2024-09-12T17:30:56.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.724+0000 7f30aa876640 1 --2- 172.21.15.170:0/376455635 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587061b34a0 0x5587061b38a0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f309c00a470 tx=0x7f309c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82deeb8166f56812 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:30:56.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.724+0000 7f30aa075640 1 -- 172.21.15.170:0/376455635 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f309c053570 con 0x5587061b34a0 2024-09-12T17:30:56.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.724+0000 7f30aa075640 1 -- 172.21.15.170:0/376455635 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f309c058070 con 0x5587061b34a0 2024-09-12T17:30:56.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.724+0000 7f30aa075640 1 -- 172.21.15.170:0/376455635 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f309c053880 con 0x5587061b34a0 2024-09-12T17:30:56.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.725+0000 7f30aeb33800 1 -- 172.21.15.170:0/376455635 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587061b34a0 msgr2=0x5587061b38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:56.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.725+0000 7f30aeb33800 1 --2- 172.21.15.170:0/376455635 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587061b34a0 0x5587061b38a0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f309c00a470 tx=0x7f309c045a20 comp rx=0 tx=0).stop 2024-09-12T17:30:56.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.725+0000 7f30aeb33800 1 -- 172.21.15.170:0/376455635 shutdown_connections 2024-09-12T17:30:56.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.725+0000 7f30aeb33800 1 --2- 172.21.15.170:0/376455635 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587061b34a0 0x5587061b38a0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:30:56.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.725+0000 7f30aeb33800 1 -- 172.21.15.170:0/376455635 >> 172.21.15.170:0/376455635 conn(0x5587061af1f0 msgr2=0x5587061b1630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:30:56.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.725+0000 7f30aeb33800 1 -- 172.21.15.170:0/376455635 shutdown_connections 2024-09-12T17:30:56.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.725+0000 7f30aeb33800 1 -- 172.21.15.170:0/376455635 wait complete. 2024-09-12T17:30:56.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.740+0000 7f30aeb33800 1 Processor -- start 2024-09-12T17:30:56.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.740+0000 7f30aeb33800 1 -- start start 2024-09-12T17:30:56.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.740+0000 7f30aeb33800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587061b34a0 0x5587062a6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:30:56.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.740+0000 7f30aeb33800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55870604ddd0 con 0x5587061b34a0 2024-09-12T17:30:56.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.741+0000 7f30aa876640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587061b34a0 0x5587062a6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:30:56.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.741+0000 7f30aa876640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587061b34a0 0x5587062a6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59990/0 (socket says 172.21.15.170:59990) 2024-09-12T17:30:56.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.741+0000 7f30aa876640 1 -- 172.21.15.170:0/4020709554 learned_addr learned my addr 172.21.15.170:0/4020709554 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:30:56.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.741+0000 7f30aa876640 1 -- 172.21.15.170:0/4020709554 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558706066e10 con 0x5587061b34a0 2024-09-12T17:30:56.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.741+0000 7f30aa876640 1 --2- 172.21.15.170:0/4020709554 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587061b34a0 0x5587062a6810 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f309c025c20 tx=0x7f309c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2799a26d10b4889 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:30:56.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.741+0000 7f2f98e09640 1 -- 172.21.15.170:0/4020709554 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f309c053a20 con 0x5587061b34a0 2024-09-12T17:30:56.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.741+0000 7f2f98e09640 1 -- 172.21.15.170:0/4020709554 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f309c063070 con 0x5587061b34a0 2024-09-12T17:30:56.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.741+0000 7f2f98e09640 1 -- 172.21.15.170:0/4020709554 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f309c053cf0 con 0x5587061b34a0 2024-09-12T17:30:56.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.742+0000 7f30aeb33800 1 -- 172.21.15.170:0/4020709554 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587061b34a0 msgr2=0x5587062a6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:56.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.742+0000 7f30aeb33800 1 --2- 172.21.15.170:0/4020709554 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587061b34a0 0x5587062a6810 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f309c025c20 tx=0x7f309c051000 comp rx=0 tx=0).stop 2024-09-12T17:30:56.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.742+0000 7f30aeb33800 1 -- 172.21.15.170:0/4020709554 shutdown_connections 2024-09-12T17:30:56.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.742+0000 7f30aeb33800 1 --2- 172.21.15.170:0/4020709554 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587061b34a0 0x5587062a6810 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:30:56.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.742+0000 7f30aeb33800 1 -- 172.21.15.170:0/4020709554 >> 172.21.15.170:0/4020709554 conn(0x5587061af1f0 msgr2=0x5587062a2190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:30:56.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.742+0000 7f30aeb33800 1 -- 172.21.15.170:0/4020709554 shutdown_connections 2024-09-12T17:30:56.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.742+0000 7f30aeb33800 1 -- 172.21.15.170:0/4020709554 wait complete. 2024-09-12T17:30:56.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.742+0000 7f30aeb33800 1 Processor -- start 2024-09-12T17:30:56.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.743+0000 7f30aeb33800 1 -- start start 2024-09-12T17:30:56.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.743+0000 7f30aeb33800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587061b34a0 0x5587062ae010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:30:56.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.743+0000 7f30aeb33800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5587061b4d60 con 0x5587061b34a0 2024-09-12T17:30:56.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.743+0000 7f30aa876640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587061b34a0 0x5587062ae010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:30:56.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.743+0000 7f30aa876640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587061b34a0 0x5587062ae010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:59996/0 (socket says 172.21.15.170:59996) 2024-09-12T17:30:56.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.743+0000 7f30aa876640 1 -- 172.21.15.170:0/4204720956 learned_addr learned my addr 172.21.15.170:0/4204720956 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:30:56.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.743+0000 7f30aa876640 1 -- 172.21.15.170:0/4204720956 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587062ae570 con 0x5587061b34a0 2024-09-12T17:30:56.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.744+0000 7f30aa876640 1 --2- 172.21.15.170:0/4204720956 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587061b34a0 0x5587062ae010 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f309c025c20 tx=0x7f309c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:30:56.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.744+0000 7f2f97606640 1 -- 172.21.15.170:0/4204720956 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f309c06c030 con 0x5587061b34a0 2024-09-12T17:30:56.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.744+0000 7f2f97606640 1 -- 172.21.15.170:0/4204720956 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f309c068660 con 0x5587061b34a0 2024-09-12T17:30:56.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.744+0000 7f2f97606640 1 -- 172.21.15.170:0/4204720956 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f309c068940 con 0x5587061b34a0 2024-09-12T17:30:56.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.744+0000 7f30aeb33800 1 -- 172.21.15.170:0/4204720956 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5587062ae800 con 0x5587061b34a0 2024-09-12T17:30:56.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.744+0000 7f30aeb33800 1 -- 172.21.15.170:0/4204720956 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587062af200 con 0x5587061b34a0 2024-09-12T17:30:56.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.745+0000 7f2f97606640 1 -- 172.21.15.170:0/4204720956 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f309c068ae0 con 0x5587061b34a0 2024-09-12T17:30:56.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.745+0000 7f2f97606640 1 --2- 172.21.15.170:0/4204720956 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2f9003c730 0x7f2f9003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:30:56.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.745+0000 7f2f97606640 1 -- 172.21.15.170:0/4204720956 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f309c097f70 con 0x5587061b34a0 2024-09-12T17:30:56.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.745+0000 7f30a3fff640 1 --2- 172.21.15.170:0/4204720956 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2f9003c730 0x7f2f9003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:30:56.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.745+0000 7f30aeb33800 1 --2- 172.21.15.170:0/4204720956 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5587061b3de0 0x5587062b5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:30:56.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.745+0000 7f30aeb33800 1 -- 172.21.15.170:0/4204720956 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5587062b5ba0 con 0x5587061b3de0 2024-09-12T17:30:56.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.745+0000 7f30ab077640 1 --2- 172.21.15.170:0/4204720956 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5587061b3de0 0x5587062b5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:30:56.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.746+0000 7f30a3fff640 1 --2- 172.21.15.170:0/4204720956 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2f9003c730 0x7f2f9003ebf0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3094001d70 tx=0x7f30940012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:30:56.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.746+0000 7f30ab077640 1 --2- 172.21.15.170:0/4204720956 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5587061b3de0 0x5587062b5660 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:30:56.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.746+0000 7f30ab077640 1 -- 172.21.15.170:0/4204720956 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f30a400a4d0 con 0x5587061b3de0 2024-09-12T17:30:56.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.746+0000 7f30aeb33800 1 -- 172.21.15.170:0/4204720956 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5587062b5f40 con 0x5587061b3de0 2024-09-12T17:30:56.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.746+0000 7f30ab077640 1 -- 172.21.15.170:0/4204720956 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f30a400a4d0 con 0x5587061b3de0 2024-09-12T17:30:56.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.746+0000 7f30aeb33800 1 --2- 172.21.15.170:0/4204720956 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5587062b7a40 0x5587062b9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:30:56.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.746+0000 7f30aeb33800 1 -- 172.21.15.170:0/4204720956 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:3 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5587062ba650 con 0x5587062b7a40 2024-09-12T17:30:56.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.746+0000 7f30aa876640 1 --2- 172.21.15.170:0/4204720956 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5587062b7a40 0x5587062b9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:30:56.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.747+0000 7f30aa876640 1 --2- 172.21.15.170:0/4204720956 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5587062b7a40 0x5587062b9ec0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:30:56.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.747+0000 7f30aa876640 1 -- 172.21.15.170:0/4204720956 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(3 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f309c051070 con 0x5587062b7a40 2024-09-12T17:30:56.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.747+0000 7f30aeb33800 1 -- 172.21.15.170:0/4204720956 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5587062b6790 con 0x5587061b3de0 2024-09-12T17:30:56.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.747+0000 7f30ab077640 1 -- 172.21.15.170:0/4204720956 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f30a400a4d0 con 0x5587061b3de0 2024-09-12T17:30:56.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.747+0000 7f30aeb33800 1 -- 172.21.15.170:0/4204720956 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5587062b6be0 con 0x5587062b7a40 2024-09-12T17:30:56.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.748+0000 7f30aa876640 1 -- 172.21.15.170:0/4204720956 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(5 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f309c051070 con 0x5587062b7a40 2024-09-12T17:30:56.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.748+0000 7f30aeb33800 1 Processor -- start 2024-09-12T17:30:56.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.748+0000 7f30aeb33800 1 -- start start 2024-09-12T17:30:56.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.748+0000 7f30aeb33800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587062c8f00 0x5587062c9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:30:56.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.748+0000 7f30aeb33800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5587060aba00 con 0x5587062c8f00 2024-09-12T17:30:56.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.748+0000 7f30ab077640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587062c8f00 0x5587062c9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:30:56.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.748+0000 7f30ab077640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587062c8f00 0x5587062c9320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:60006/0 (socket says 172.21.15.170:60006) 2024-09-12T17:30:56.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.748+0000 7f30ab077640 1 -- 172.21.15.170:0/3551391532 learned_addr learned my addr 172.21.15.170:0/3551391532 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:30:56.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.749+0000 7f30ab077640 1 -- 172.21.15.170:0/3551391532 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587062c9960 con 0x5587062c8f00 2024-09-12T17:30:56.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.749+0000 7f30ab077640 1 --2- 172.21.15.170:0/3551391532 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587062c8f00 0x5587062c9320 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x5587062af010 tx=0x7f30a40167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:30:56.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.749+0000 7f2f94e01640 1 -- 172.21.15.170:0/3551391532 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30a4013640 con 0x5587062c8f00 2024-09-12T17:30:56.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.749+0000 7f2f94e01640 1 -- 172.21.15.170:0/3551391532 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a40137e0 con 0x5587062c8f00 2024-09-12T17:30:56.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.749+0000 7f2f94e01640 1 -- 172.21.15.170:0/3551391532 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30a4013ae0 con 0x5587062c8f00 2024-09-12T17:30:56.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.749+0000 7f30aeb33800 1 -- 172.21.15.170:0/3551391532 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5587062ca190 con 0x5587062c8f00 2024-09-12T17:30:56.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.749+0000 7f30aeb33800 1 -- 172.21.15.170:0/3551391532 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587062ca730 con 0x5587062c8f00 2024-09-12T17:30:56.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.750+0000 7f2f94e01640 1 -- 172.21.15.170:0/3551391532 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f30a4011040 con 0x5587062c8f00 2024-09-12T17:30:56.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.750+0000 7f2f94e01640 1 --2- 172.21.15.170:0/3551391532 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2f8403c730 0x7f2f8403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:30:56.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.751+0000 7f2f94e01640 1 -- 172.21.15.170:0/3551391532 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f30a400e040 con 0x5587062c8f00 2024-09-12T17:30:56.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.751+0000 7f30aa876640 1 --2- 172.21.15.170:0/3551391532 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2f8403c730 0x7f2f8403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:30:56.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.751+0000 7f30aeb33800 1 Processor -- start 2024-09-12T17:30:56.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.751+0000 7f30aeb33800 1 -- start start 2024-09-12T17:30:56.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.751+0000 7f30aa876640 1 --2- 172.21.15.170:0/3551391532 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2f8403c730 0x7f2f8403ebf0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f309c096410 tx=0x7f309c05fd30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:30:56.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.751+0000 7f30aeb33800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587062d5a20 0x5587062d5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:30:56.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.751+0000 7f30aeb33800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5587062a7000 con 0x5587062d5a20 2024-09-12T17:30:56.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.751+0000 7f30ab077640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587062d5a20 0x5587062d5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:30:56.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.751+0000 7f30ab077640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587062d5a20 0x5587062d5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:60018/0 (socket says 172.21.15.170:60018) 2024-09-12T17:30:56.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.751+0000 7f30ab077640 1 -- 172.21.15.170:0/3244325296 learned_addr learned my addr 172.21.15.170:0/3244325296 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:30:56.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.752+0000 7f30ab077640 1 -- 172.21.15.170:0/3244325296 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587062d6410 con 0x5587062d5a20 2024-09-12T17:30:56.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.752+0000 7f30ab077640 1 --2- 172.21.15.170:0/3244325296 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587062d5a20 0x5587062d5e20 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f30a4053d60 tx=0x7f30a401fc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dceb188e298ccd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:30:56.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.752+0000 7f2f8e7fc640 1 -- 172.21.15.170:0/3244325296 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30a4021a40 con 0x5587062d5a20 2024-09-12T17:30:56.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.752+0000 7f2f8e7fc640 1 -- 172.21.15.170:0/3244325296 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a4021440 con 0x5587062d5a20 2024-09-12T17:30:56.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.752+0000 7f2f8e7fc640 1 -- 172.21.15.170:0/3244325296 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30a401f340 con 0x5587062d5a20 2024-09-12T17:30:56.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.752+0000 7f30aeb33800 1 -- 172.21.15.170:0/3244325296 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587062d5a20 msgr2=0x5587062d5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:56.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.752+0000 7f30aeb33800 1 --2- 172.21.15.170:0/3244325296 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587062d5a20 0x5587062d5e20 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f30a4053d60 tx=0x7f30a401fc40 comp rx=0 tx=0).stop 2024-09-12T17:30:56.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.752+0000 7f30aeb33800 1 -- 172.21.15.170:0/3244325296 shutdown_connections 2024-09-12T17:30:56.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.752+0000 7f30aeb33800 1 --2- 172.21.15.170:0/3244325296 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587062d5a20 0x5587062d5e20 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:30:56.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.752+0000 7f30aeb33800 1 -- 172.21.15.170:0/3244325296 >> 172.21.15.170:0/3244325296 conn(0x5587062d1e20 msgr2=0x5587062d0060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:30:56.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.752+0000 7f30aeb33800 1 -- 172.21.15.170:0/3244325296 shutdown_connections 2024-09-12T17:30:56.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.752+0000 7f30aeb33800 1 -- 172.21.15.170:0/3244325296 wait complete. 2024-09-12T17:30:56.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.753+0000 7f30aeb33800 1 Processor -- start 2024-09-12T17:30:56.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.753+0000 7f30aeb33800 1 -- start start 2024-09-12T17:30:56.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.753+0000 7f30aeb33800 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587062d5a20 0x5587062dcfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:30:56.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.753+0000 7f30aeb33800 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5587062d6a30 con 0x5587062d5a20 2024-09-12T17:30:56.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.753+0000 7f30ab077640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587062d5a20 0x5587062dcfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:30:56.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.753+0000 7f30ab077640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587062d5a20 0x5587062dcfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.170:60024/0 (socket says 172.21.15.170:60024) 2024-09-12T17:30:56.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.753+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 learned_addr learned my addr 172.21.15.170:0/1121657941 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-09-12T17:30:56.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.753+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587062dd540 con 0x5587062d5a20 2024-09-12T17:30:56.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.754+0000 7f30ab077640 1 --2- 172.21.15.170:0/1121657941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587062d5a20 0x5587062dcfe0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f30a4047040 tx=0x7f30a4053cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:30:56.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.754+0000 7f2f8cff9640 1 -- 172.21.15.170:0/1121657941 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30a4055720 con 0x5587062d5a20 2024-09-12T17:30:56.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.754+0000 7f2f8cff9640 1 -- 172.21.15.170:0/1121657941 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a4020800 con 0x5587062d5a20 2024-09-12T17:30:56.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.754+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5587062dd7d0 con 0x5587062d5a20 2024-09-12T17:30:56.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.754+0000 7f2f8cff9640 1 -- 172.21.15.170:0/1121657941 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30a4020ae0 con 0x5587062d5a20 2024-09-12T17:30:56.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.754+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587062de150 con 0x5587062d5a20 2024-09-12T17:30:56.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.755+0000 7f2f8cff9640 1 -- 172.21.15.170:0/1121657941 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f30a4020c80 con 0x5587062d5a20 2024-09-12T17:30:56.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.755+0000 7f2f8cff9640 1 --2- 172.21.15.170:0/1121657941 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2f7403c730 0x7f2f7403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:30:56.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.755+0000 7f2f8cff9640 1 -- 172.21.15.170:0/1121657941 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f30a404b040 con 0x5587062d5a20 2024-09-12T17:30:56.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.755+0000 7f30aa876640 1 --2- 172.21.15.170:0/1121657941 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2f7403c730 0x7f2f7403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:30:56.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.756+0000 7f30aa876640 1 --2- 172.21.15.170:0/1121657941 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2f7403c730 0x7f2f7403ebf0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f309c068fd0 tx=0x7f309c092000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:30:56.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.756+0000 7f30aeb33800 20 rados->read ofs=0 len=0 2024-09-12T17:30:56.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.756+0000 7f30aeb33800 1 --2- 172.21.15.170:0/1121657941 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5587062e8960 0x5587062eae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:30:56.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.756+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5587062eb570 con 0x5587062e8960 2024-09-12T17:30:56.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.756+0000 7f30a3fff640 1 --2- 172.21.15.170:0/1121657941 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5587062e8960 0x5587062eae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:30:56.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.756+0000 7f30a3fff640 1 --2- 172.21.15.170:0/1121657941 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5587062e8960 0x5587062eae20 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:30:56.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.756+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3094009050 con 0x5587062e8960 2024-09-12T17:30:56.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.756+0000 7f30aeb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:56.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.756+0000 7f30aeb33800 20 realm 2024-09-12T17:30:56.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.756+0000 7f30aeb33800 20 rados->read ofs=0 len=0 2024-09-12T17:30:56.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.756+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5587062e7cb0 con 0x5587062e8960 2024-09-12T17:30:56.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.757+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3094009050 con 0x5587062e8960 2024-09-12T17:30:56.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.757+0000 7f30aeb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:56.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.757+0000 7f30aeb33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:30:56.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.757+0000 7f30aeb33800 20 rados->read ofs=0 len=0 2024-09-12T17:30:56.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.757+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5587062ec060 con 0x5587062e8960 2024-09-12T17:30:56.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.757+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3094009050 con 0x5587062e8960 2024-09-12T17:30:56.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.757+0000 7f30aeb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:56.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.757+0000 7f30aeb33800 20 rados->read ofs=0 len=0 2024-09-12T17:30:56.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.757+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5587062ec930 con 0x5587062e8960 2024-09-12T17:30:56.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.757+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3094009050 con 0x5587062e8960 2024-09-12T17:30:56.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.757+0000 7f30aeb33800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:56.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.757+0000 7f30aeb33800 20 rados->read ofs=0 len=0 2024-09-12T17:30:56.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.757+0000 7f30aeb33800 1 --2- 172.21.15.170:0/1121657941 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5587062ed350 0x5587062ef740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:30:56.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.757+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:5 5.1f 5:fa2d31a5:::zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5587062efe80 con 0x5587062ed350 2024-09-12T17:30:56.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.757+0000 7f30ab077640 1 --2- 172.21.15.170:0/1121657941 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5587062ed350 0x5587062ef740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:30:56.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.758+0000 7f30ab077640 1 --2- 172.21.15.170:0/1121657941 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5587062ed350 0x5587062ef740 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:30:56.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.758+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== osd_op_reply(5 zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f30a4032070 con 0x5587062ed350 2024-09-12T17:30:56.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.758+0000 7f30aeb33800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:30:56.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.758+0000 7f30aeb33800 20 searching for the correct realm 2024-09-12T17:30:56.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.758+0000 7f30aeb33800 1 --2- 172.21.15.170:0/1121657941 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5587062f1e30 0x5587062f42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:30:56.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.758+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5587062f4970 con 0x5587062f1e30 2024-09-12T17:30:56.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.758+0000 7f30aa876640 1 --2- 172.21.15.170:0/1121657941 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5587062f1e30 0x5587062f42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:30:56.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.758+0000 7f30aa876640 1 --2- 172.21.15.170:0/1121657941 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5587062f1e30 0x5587062f42f0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:30:56.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.759+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.759+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5587062f4970 con 0x5587062ed350 2024-09-12T17:30:56.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.759+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30a4032070 con 0x5587062ed350 2024-09-12T17:30:56.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.759+0000 7f30ab077640 1 --2- 172.21.15.170:0/1121657941 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f30a4035070 0x7f30a4055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:30:56.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.759+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5587062f4970 con 0x7f30a4035070 2024-09-12T17:30:56.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.759+0000 7f30a3fff640 1 --2- 172.21.15.170:0/1121657941 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f30a4035070 0x7f30a4055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:30:56.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.760+0000 7f30a3fff640 1 --2- 172.21.15.170:0/1121657941 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f30a4035070 0x7f30a4055a70 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:30:56.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.760+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3094009050 con 0x7f30a4035070 2024-09-12T17:30:56.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.760+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5587062f4970 con 0x5587062e8960 2024-09-12T17:30:56.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.760+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3094009050 con 0x5587062e8960 2024-09-12T17:30:56.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.760+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5587062f4970 con 0x5587062e8960 2024-09-12T17:30:56.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.761+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.761+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5587062f4970 con 0x7f30a4035070 2024-09-12T17:30:56.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.761+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.761+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5587062f4970 con 0x7f30a4035070 2024-09-12T17:30:56.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.761+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.761+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5587062f4970 con 0x5587062ed350 2024-09-12T17:30:56.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.762+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30a4032070 con 0x5587062ed350 2024-09-12T17:30:56.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.762+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5587062f4970 con 0x5587062f1e30 2024-09-12T17:30:56.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.762+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.762+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5587062f4970 con 0x5587062e8960 2024-09-12T17:30:56.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.762+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.762+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5587062f4970 con 0x7f30a4035070 2024-09-12T17:30:56.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.762+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.762+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5587062f4970 con 0x5587062e8960 2024-09-12T17:30:56.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.763+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.763+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5587062f4970 con 0x5587062ed350 2024-09-12T17:30:56.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.763+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v22'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f30a4032070 con 0x5587062ed350 2024-09-12T17:30:56.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.763+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5587062f4970 con 0x5587062f1e30 2024-09-12T17:30:56.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.763+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.763+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5587062f4970 con 0x5587062f1e30 2024-09-12T17:30:56.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.763+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.763+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5587062f4970 con 0x5587062ed350 2024-09-12T17:30:56.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.764+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30a4032070 con 0x5587062ed350 2024-09-12T17:30:56.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.764+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5587062f4970 con 0x5587062f1e30 2024-09-12T17:30:56.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.764+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.764+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5587062f4970 con 0x5587062f1e30 2024-09-12T17:30:56.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.764+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.764+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5587062f4970 con 0x5587062e8960 2024-09-12T17:30:56.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.764+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.764+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5587062f4970 con 0x5587062e8960 2024-09-12T17:30:56.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.764+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v31'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.764+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5587062f4970 con 0x7f30a4035070 2024-09-12T17:30:56.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.765+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 5 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.765+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5587062f4970 con 0x5587062f1e30 2024-09-12T17:30:56.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.765+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.765+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5587062f4970 con 0x5587062ed350 2024-09-12T17:30:56.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.765+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 6 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30a4032070 con 0x5587062ed350 2024-09-12T17:30:56.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.765+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5587062f4970 con 0x5587062e8960 2024-09-12T17:30:56.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.766+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.766+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5587062f4970 con 0x7f30a4035070 2024-09-12T17:30:56.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.766+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 6 ==== osd_op_reply(30 [pgnls start_epoch 31 out=82b] v31'1 uv1 ondisk = 1) ==== 144+0+82 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.766+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5587062f4970 con 0x5587062f1e30 2024-09-12T17:30:56.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.766+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.766+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5587062f4970 con 0x7f30a4035070 2024-09-12T17:30:56.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.766+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 7 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.766+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5587062f4970 con 0x5587062ed350 2024-09-12T17:30:56.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.767+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 7 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.767+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5587062f4970 con 0x5587062f1e30 2024-09-12T17:30:56.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.767+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.767+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5587062f4970 con 0x7f30a4035070 2024-09-12T17:30:56.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.767+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 8 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.767+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5587062f4970 con 0x5587062e8960 2024-09-12T17:30:56.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.768+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.768+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5587062f4970 con 0x5587062ed350 2024-09-12T17:30:56.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.768+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 8 ==== osd_op_reply(37 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.768+0000 7f30aeb33800 20 RGWRados::pool_iterate: got zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 2024-09-12T17:30:56.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.768+0000 7f30aeb33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:30:56.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.768+0000 7f30aeb33800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:30:56.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.768+0000 7f30aeb33800 20 RGWRados::pool_iterate: got period_config.default 2024-09-12T17:30:56.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.768+0000 7f30aeb33800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:30:56.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.768+0000 7f30aeb33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:30:56.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.768+0000 7f30aeb33800 20 RGWRados::pool_iterate: got zone_info.7f05c86a-1902-4046-a99f-31d6f38ce8f7 2024-09-12T17:30:56.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.768+0000 7f30aeb33800 20 rados->read ofs=0 len=0 2024-09-12T17:30:56.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.768+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5587062f0840 con 0x5587062e8960 2024-09-12T17:30:56.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.768+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.768+0000 7f30aeb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:56.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.768+0000 7f30aeb33800 20 rados->read ofs=0 len=0 2024-09-12T17:30:56.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.768+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5587062f0480 con 0x5587062e8960 2024-09-12T17:30:56.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.768+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.768+0000 7f30aeb33800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:56.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.768+0000 7f30aeb33800 20 rados->read ofs=0 len=0 2024-09-12T17:30:56.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.768+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:40 5.6 5:647957c8:::zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5587062f0c80 con 0x5587062ed350 2024-09-12T17:30:56.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.769+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 9 ==== osd_op_reply(40 zonegroup_info.dc43fae2-274b-4ee4-ac82-d8ac27e45bf4 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.769+0000 7f30aeb33800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:30:56.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.769+0000 7f30aeb33800 20 zone default found 2024-09-12T17:30:56.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.769+0000 7f30aeb33800 4 Realm: () 2024-09-12T17:30:56.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.769+0000 7f30aeb33800 4 ZoneGroup: default (dc43fae2-274b-4ee4-ac82-d8ac27e45bf4) 2024-09-12T17:30:56.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.769+0000 7f30aeb33800 4 Zone: default (7f05c86a-1902-4046-a99f-31d6f38ce8f7) 2024-09-12T17:30:56.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.769+0000 7f30aeb33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:30:56.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.769+0000 7f30aeb33800 20 zonegroup default 2024-09-12T17:30:56.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.769+0000 7f30aeb33800 20 rados->read ofs=0 len=0 2024-09-12T17:30:56.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.769+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5587062f52a0 con 0x7f30a4035070 2024-09-12T17:30:56.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.769+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 9 ==== osd_op_reply(41 period_config.default [read 0~187 out=187b] v0'0 uv1 ondisk = 0) ==== 165+0+187 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.769+0000 7f30aeb33800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:30:56.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.769+0000 7f30aeb33800 20 rados->read ofs=0 len=0 2024-09-12T17:30:56.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.769+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5587062f74e0 con 0x5587062f1e30 2024-09-12T17:30:56.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.770+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.770+0000 7f30aeb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:56.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.770+0000 7f30aeb33800 20 rados->read ofs=0 len=0 2024-09-12T17:30:56.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.770+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5587062f7880 con 0x5587062f1e30 2024-09-12T17:30:56.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.770+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.770+0000 7f30aeb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:56.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.770+0000 7f30aeb33800 20 started sync module instance, tier type = 2024-09-12T17:30:56.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.770+0000 7f30aeb33800 20 started zone id=7f05c86a-1902-4046-a99f-31d6f38ce8f7 (name=default) with tier type = 2024-09-12T17:30:56.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.770+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5587062f6970 con 0x5587062ed350 2024-09-12T17:30:56.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.771+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 10 ==== osd_op_reply(44 notify.0 [create] v31'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.771+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94038412717408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5587062f8160 con 0x5587062ed350 2024-09-12T17:30:56.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.771+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5587062f89b0 con 0x5587062e8960 2024-09-12T17:30:56.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.772+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94038412717408] v31'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.772+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 15 ==== osd_op_reply(46 notify.1 [create] v31'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.772+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94038412721328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5587062f85e0 con 0x5587062e8960 2024-09-12T17:30:56.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.772+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5587062f90e0 con 0x5587062f1e30 2024-09-12T17:30:56.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.774+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94038412721328] v31'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.774+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 12 ==== osd_op_reply(48 notify.2 [create] v31'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.774+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94038412725200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5587062f90a0 con 0x5587062f1e30 2024-09-12T17:30:56.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.774+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5587062f9b60 con 0x5587062ed350 2024-09-12T17:30:56.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.775+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 12 ==== osd_op_reply(50 notify.3 [create] v31'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.775+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94038412727920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5587062f9b60 con 0x5587062ed350 2024-09-12T17:30:56.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.775+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5587062fab80 con 0x5587062e8960 2024-09-12T17:30:56.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.775+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94038412725200] v31'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.776+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94038412727920] v31'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.776+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 17 ==== osd_op_reply(52 notify.4 [create] v31'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.776+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94038412730240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5587062fab40 con 0x5587062e8960 2024-09-12T17:30:56.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.776+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5587062fb420 con 0x7f30a4035070 2024-09-12T17:30:56.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.777+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94038412730240] v31'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.777+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 10 ==== osd_op_reply(54 notify.5 [create] v31'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.777+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94038412731984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5587062faff0 con 0x7f30a4035070 2024-09-12T17:30:56.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.777+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5587062fba50 con 0x7f30a4035070 2024-09-12T17:30:56.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.779+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94038412731984] v31'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.779+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 12 ==== osd_op_reply(56 notify.6 [create] v31'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.779+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94038412735792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5587062fbc30 con 0x7f30a4035070 2024-09-12T17:30:56.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.779+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5587062fc480 con 0x7f30a4035070 2024-09-12T17:30:56.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.780+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94038412735792] v31'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.780+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 14 ==== osd_op_reply(58 notify.7 [create] v31'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.780+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94038412737584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5587062fc500 con 0x7f30a4035070 2024-09-12T17:30:56.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.780+0000 7f30aeb33800 20 add_watcher() i=0 2024-09-12T17:30:56.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.780+0000 7f30aeb33800 20 add_watcher() i=1 2024-09-12T17:30:56.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.780+0000 7f30aeb33800 20 add_watcher() i=2 2024-09-12T17:30:56.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.780+0000 7f30aeb33800 20 add_watcher() i=3 2024-09-12T17:30:56.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.780+0000 7f30aeb33800 20 add_watcher() i=4 2024-09-12T17:30:56.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.780+0000 7f30aeb33800 20 add_watcher() i=5 2024-09-12T17:30:56.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.780+0000 7f30aeb33800 20 add_watcher() i=6 2024-09-12T17:30:56.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.781+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94038412737584] v31'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.781+0000 7f30aeb33800 20 add_watcher() i=7 2024-09-12T17:30:56.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.781+0000 7f30aeb33800 2 all 8 watchers are set, enabling cache 2024-09-12T17:30:56.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.781+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5587062ff840 con 0x5587062e8960 2024-09-12T17:30:56.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.781+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.781+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94038412739008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5587062fca90 con 0x5587062e8960 2024-09-12T17:30:56.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.782+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94038412739008] v31'275 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.782+0000 7f2f617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:56.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.782+0000 7f30aeb33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:30:56.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.782+0000 7f30aeb33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:30:56.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.783+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5587063080c0 con 0x5587062e8960 2024-09-12T17:30:56.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.784+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.784+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5587063080c0 con 0x7f30a4035070 2024-09-12T17:30:56.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.785+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'33 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.785+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706308ae0 con 0x5587062f1e30 2024-09-12T17:30:56.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.786+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.786+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706308bc0 con 0x5587062e8960 2024-09-12T17:30:56.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.787+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'276 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.787+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706309130 con 0x5587062ed350 2024-09-12T17:30:56.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.788+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'83 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.788+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706309130 con 0x5587062f1e30 2024-09-12T17:30:56.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.789+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'56 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.789+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5587063096e0 con 0x5587062e8960 2024-09-12T17:30:56.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.790+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.790+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5587063096a0 con 0x7f30a4035070 2024-09-12T17:30:56.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.792+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'56 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.792+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5587063086d0 con 0x5587062ed350 2024-09-12T17:30:56.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.793+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'32 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.793+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5587063086d0 con 0x5587062f1e30 2024-09-12T17:30:56.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.794+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.794+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706309aa0 con 0x5587062ed350 2024-09-12T17:30:56.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.795+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'84 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.795+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706309a80 con 0x7f30a4035070 2024-09-12T17:30:56.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.796+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'41 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.797+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706309a80 con 0x5587062ed350 2024-09-12T17:30:56.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.798+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.798+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706309a20 con 0x7f30a4035070 2024-09-12T17:30:56.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.799+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'62 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.799+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706309a20 con 0x5587062e8960 2024-09-12T17:30:56.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.800+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'277 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.800+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706309a20 con 0x5587062f1e30 2024-09-12T17:30:56.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.801+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'77 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.801+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706309a20 con 0x5587062ed350 2024-09-12T17:30:56.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.802+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'85 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.802+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706309a20 con 0x5587062f1e30 2024-09-12T17:30:56.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.803+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.803+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706309a20 con 0x5587062e8960 2024-09-12T17:30:56.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.805+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'41 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.805+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706309a20 con 0x5587062e8960 2024-09-12T17:30:56.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.805+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'278 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.806+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706309a20 con 0x5587062f1e30 2024-09-12T17:30:56.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.807+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'78 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.807+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706309a20 con 0x5587062ed350 2024-09-12T17:30:56.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.808+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'42 uv32 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.808+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706309a20 con 0x5587062f1e30 2024-09-12T17:30:56.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.809+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.809+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706309b50 con 0x5587062f1e30 2024-09-12T17:30:56.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.809+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'38 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.809+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706309b50 con 0x5587062f1e30 2024-09-12T17:30:56.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.810+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'27 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.810+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706309b50 con 0x5587062f1e30 2024-09-12T17:30:56.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.811+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'57 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.811+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706309b50 con 0x7f30a4035070 2024-09-12T17:30:56.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.813+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.813+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706309b50 con 0x5587062f1e30 2024-09-12T17:30:56.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.814+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'34 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.814+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706309b50 con 0x7f30a4035070 2024-09-12T17:30:56.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.815+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'57 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.815+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706309b50 con 0x5587062f1e30 2024-09-12T17:30:56.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.816+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'79 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.816+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706309b50 con 0x7f30a4035070 2024-09-12T17:30:56.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.817+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'63 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.817+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706309bc0 con 0x5587062ed350 2024-09-12T17:30:56.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.818+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.818+0000 7f2edbfff640 20 reqs_thread_entry: start 2024-09-12T17:30:56.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.819+0000 7f30aeb33800 20 init_complete bucket index max shards: 11 2024-09-12T17:30:56.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.819+0000 7f30aeb33800 20 Filter name: none 2024-09-12T17:30:56.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.819+0000 7f2ed9ffb640 20 reqs_thread_entry: start 2024-09-12T17:30:56.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.819+0000 7f30aeb33800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:30:56.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.819+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:94 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706335c60 con 0x5587062e8960 2024-09-12T17:30:56.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.820+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 27 ==== osd_op_reply(94 gc.19 [call] v31'279 uv279 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.820+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:95 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706335c60 con 0x5587062e8960 2024-09-12T17:30:56.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.820+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 28 ==== osd_op_reply(95 gc.19 [call out=15b] v0'0 uv279 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.820+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.820+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:96 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706334c50 con 0x5587062e8960 2024-09-12T17:30:56.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.820+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 29 ==== osd_op_reply(96 gc.19 [call out=24b] v0'0 uv279 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.820+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:97 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706335c60 con 0x5587062e8960 2024-09-12T17:30:56.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.821+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 30 ==== osd_op_reply(97 gc.19 [call out=15b] v0'0 uv279 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.821+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.821+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:98 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706335c60 con 0x5587062e8960 2024-09-12T17:30:56.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.821+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 31 ==== osd_op_reply(98 gc.19 [call out=15b] v0'0 uv279 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.821+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.821+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:99 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706335c60 con 0x5587062e8960 2024-09-12T17:30:56.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.822+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 32 ==== osd_op_reply(99 gc.19 [call] v31'280 uv280 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.822+0000 7f30aeb33800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:30:56.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.822+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:100 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706335c60 con 0x5587062f1e30 2024-09-12T17:30:56.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.823+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 26 ==== osd_op_reply(100 gc.20 [call] v31'80 uv80 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.823+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:101 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706335c60 con 0x5587062f1e30 2024-09-12T17:30:56.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.823+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 27 ==== osd_op_reply(101 gc.20 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.823+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.823+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:102 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706334c50 con 0x5587062f1e30 2024-09-12T17:30:56.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.824+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 28 ==== osd_op_reply(102 gc.20 [call out=24b] v0'0 uv80 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.824+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:103 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706335c60 con 0x5587062f1e30 2024-09-12T17:30:56.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.824+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 29 ==== osd_op_reply(103 gc.20 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.824+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.824+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:104 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706335c60 con 0x5587062f1e30 2024-09-12T17:30:56.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.824+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 30 ==== osd_op_reply(104 gc.20 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.824+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.824+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:105 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706335c60 con 0x5587062f1e30 2024-09-12T17:30:56.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.825+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 31 ==== osd_op_reply(105 gc.20 [call] v31'81 uv81 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.825+0000 7f30aeb33800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:30:56.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.825+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:106 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706335c60 con 0x5587062ed350 2024-09-12T17:30:56.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.826+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 21 ==== osd_op_reply(106 gc.21 [call] v31'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.826+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:107 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706335c60 con 0x5587062ed350 2024-09-12T17:30:56.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.826+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 22 ==== osd_op_reply(107 gc.21 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.826+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.826+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:108 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706334c50 con 0x5587062ed350 2024-09-12T17:30:56.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.827+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 23 ==== osd_op_reply(108 gc.21 [call out=24b] v0'0 uv43 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.827+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:109 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706335c60 con 0x5587062ed350 2024-09-12T17:30:56.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.827+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 24 ==== osd_op_reply(109 gc.21 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.827+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.827+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:110 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706335c60 con 0x5587062ed350 2024-09-12T17:30:56.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.827+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 25 ==== osd_op_reply(110 gc.21 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.827+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.827+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:111 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706335c60 con 0x5587062ed350 2024-09-12T17:30:56.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.828+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 26 ==== osd_op_reply(111 gc.21 [call] v31'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.828+0000 7f30aeb33800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:30:56.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.828+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:112 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706335c60 con 0x5587062f1e30 2024-09-12T17:30:56.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.829+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 32 ==== osd_op_reply(112 gc.22 [call] v31'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.829+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:113 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706335c60 con 0x5587062f1e30 2024-09-12T17:30:56.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.829+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 33 ==== osd_op_reply(113 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.829+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.829+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:114 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706334c50 con 0x5587062f1e30 2024-09-12T17:30:56.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.829+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 34 ==== osd_op_reply(114 gc.22 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.829+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:115 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706335c60 con 0x5587062f1e30 2024-09-12T17:30:56.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.829+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 35 ==== osd_op_reply(115 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.830+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.830+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:116 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706335c60 con 0x5587062f1e30 2024-09-12T17:30:56.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.830+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 36 ==== osd_op_reply(116 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.830+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.830+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:117 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706335c60 con 0x5587062f1e30 2024-09-12T17:30:56.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.831+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 37 ==== osd_op_reply(117 gc.22 [call] v31'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.831+0000 7f30aeb33800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:30:56.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.831+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:118 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706335c60 con 0x5587062f1e30 2024-09-12T17:30:56.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.832+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 38 ==== osd_op_reply(118 gc.23 [call] v31'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.832+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:119 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706335c60 con 0x5587062f1e30 2024-09-12T17:30:56.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.832+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 39 ==== osd_op_reply(119 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.832+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.832+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:120 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706334c50 con 0x5587062f1e30 2024-09-12T17:30:56.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.832+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 40 ==== osd_op_reply(120 gc.23 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.832+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:121 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706335c60 con 0x5587062f1e30 2024-09-12T17:30:56.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.832+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 41 ==== osd_op_reply(121 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.832+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.832+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:122 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706335c60 con 0x5587062f1e30 2024-09-12T17:30:56.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.833+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 42 ==== osd_op_reply(122 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.833+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.833+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:123 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706335c60 con 0x5587062f1e30 2024-09-12T17:30:56.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.833+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 43 ==== osd_op_reply(123 gc.23 [call] v31'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.833+0000 7f30aeb33800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:30:56.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.833+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:124 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706335c60 con 0x5587062f1e30 2024-09-12T17:30:56.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.834+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 44 ==== osd_op_reply(124 gc.24 [call] v31'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.834+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:125 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706335c60 con 0x5587062f1e30 2024-09-12T17:30:56.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.835+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 45 ==== osd_op_reply(125 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.835+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.835+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:126 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706334c50 con 0x5587062f1e30 2024-09-12T17:30:56.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.835+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 46 ==== osd_op_reply(126 gc.24 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.835+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:127 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706335c60 con 0x5587062f1e30 2024-09-12T17:30:56.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.835+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 47 ==== osd_op_reply(127 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.835+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.835+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:128 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706335c60 con 0x5587062f1e30 2024-09-12T17:30:56.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.835+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 48 ==== osd_op_reply(128 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.836+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.836+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:129 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706335c60 con 0x5587062f1e30 2024-09-12T17:30:56.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.836+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 49 ==== osd_op_reply(129 gc.24 [call] v31'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.836+0000 7f30aeb33800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:30:56.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.836+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:130 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706335c60 con 0x5587062f1e30 2024-09-12T17:30:56.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.837+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 50 ==== osd_op_reply(130 gc.25 [call] v31'58 uv58 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.837+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:131 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706335c60 con 0x5587062f1e30 2024-09-12T17:30:56.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.838+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 51 ==== osd_op_reply(131 gc.25 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.838+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.838+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:132 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706334c50 con 0x5587062f1e30 2024-09-12T17:30:56.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.838+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 52 ==== osd_op_reply(132 gc.25 [call out=24b] v0'0 uv58 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.838+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:133 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706335c60 con 0x5587062f1e30 2024-09-12T17:30:56.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.838+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 53 ==== osd_op_reply(133 gc.25 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.838+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.838+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:134 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706335c60 con 0x5587062f1e30 2024-09-12T17:30:56.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.838+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 54 ==== osd_op_reply(134 gc.25 [call out=1715b] v0'0 uv58 ondisk = 0) ==== 149+0+1715 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.838+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:30:56.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.838+0000 7f30aeb33800 20 garbage collection: RGWGC::process iterating over entry tag='7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.2742479575634604898', time=2024-09-12T17:31:04.892637+0000, chain.objs.size()=7 2024-09-12T17:30:56.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.838+0000 7f30aeb33800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.11__shadow_.ZcvqM-ue5mFg6wCbAyM5n00ud0kTQcR_1 2024-09-12T17:30:56.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.838+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:135 3.4 3:2255228c:::7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.11__shadow_.ZcvqM-ue5mFg6wCbAyM5n00ud0kTQcR_1:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706336110 con 0x7f30a4035070 2024-09-12T17:30:56.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.838+0000 7f30aeb33800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.11__shadow_.ZcvqM-ue5mFg6wCbAyM5n00ud0kTQcR_2 2024-09-12T17:30:56.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.838+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:136 3.28 3:14771e05:::7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.11__shadow_.ZcvqM-ue5mFg6wCbAyM5n00ud0kTQcR_2:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706338b20 con 0x5587062f1e30 2024-09-12T17:30:56.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.838+0000 7f30aeb33800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.11__shadow_.ZcvqM-ue5mFg6wCbAyM5n00ud0kTQcR_3 2024-09-12T17:30:56.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.838+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:137 3.39 3:9c739703:::7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.11__shadow_.ZcvqM-ue5mFg6wCbAyM5n00ud0kTQcR_3:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55870633b4f0 con 0x5587062f1e30 2024-09-12T17:30:56.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.838+0000 7f30aeb33800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.11__shadow_.ZcvqM-ue5mFg6wCbAyM5n00ud0kTQcR_4 2024-09-12T17:30:56.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.838+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:138 3.2f 3:f6316f9c:::7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.11__shadow_.ZcvqM-ue5mFg6wCbAyM5n00ud0kTQcR_4:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55870633dee0 con 0x5587062f1e30 2024-09-12T17:30:56.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.838+0000 7f30aeb33800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.11__shadow_.ZcvqM-ue5mFg6wCbAyM5n00ud0kTQcR_5 2024-09-12T17:30:56.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.838+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:139 3.8 3:1349f86c:::7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.11__shadow_.ZcvqM-ue5mFg6wCbAyM5n00ud0kTQcR_5:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706340810 con 0x5587062f1e30 2024-09-12T17:30:56.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.838+0000 7f30aeb33800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.11__shadow_.ZcvqM-ue5mFg6wCbAyM5n00ud0kTQcR_6 2024-09-12T17:30:56.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.838+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:140 3.20 3:041c2c38:::7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.11__shadow_.ZcvqM-ue5mFg6wCbAyM5n00ud0kTQcR_6:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55870633dee0 con 0x5587062ed350 2024-09-12T17:30:56.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.838+0000 7f30aeb33800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.11__shadow_.ZcvqM-ue5mFg6wCbAyM5n00ud0kTQcR_7 2024-09-12T17:30:56.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.838+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:141 3.1e 3:7bad5dbb:::7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.11__shadow_.ZcvqM-ue5mFg6wCbAyM5n00ud0kTQcR_7:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706345550 con 0x7f30a4035070 2024-09-12T17:30:56.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.841+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 23 ==== osd_op_reply(141 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.11__shadow_.ZcvqM-ue5mFg6wCbAyM5n00ud0kTQcR_7 [call] v31'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.841+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 55 ==== osd_op_reply(137 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.11__shadow_.ZcvqM-ue5mFg6wCbAyM5n00ud0kTQcR_3 [call] v31'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.841+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 27 ==== osd_op_reply(140 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.11__shadow_.ZcvqM-ue5mFg6wCbAyM5n00ud0kTQcR_6 [call] v31'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.841+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 56 ==== osd_op_reply(138 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.11__shadow_.ZcvqM-ue5mFg6wCbAyM5n00ud0kTQcR_4 [call] v31'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.841+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 57 ==== osd_op_reply(136 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.11__shadow_.ZcvqM-ue5mFg6wCbAyM5n00ud0kTQcR_2 [call] v31'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.841+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 24 ==== osd_op_reply(135 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.11__shadow_.ZcvqM-ue5mFg6wCbAyM5n00ud0kTQcR_1 [call] v31'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.842+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 58 ==== osd_op_reply(139 7f05c86a-1902-4046-a99f-31d6f38ce8f7.4225.11__shadow_.ZcvqM-ue5mFg6wCbAyM5n00ud0kTQcR_5 [call] v31'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.842+0000 7f30aeb33800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:30:56.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.842+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:142 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55870633dee0 con 0x5587062f1e30 2024-09-12T17:30:56.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.843+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 59 ==== osd_op_reply(142 gc.25 [call] v31'59 uv59 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.843+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:143 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55870633dee0 con 0x5587062f1e30 2024-09-12T17:30:56.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.844+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 60 ==== osd_op_reply(143 gc.25 [call] v31'60 uv60 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.844+0000 7f30aeb33800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:30:56.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.844+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:144 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55870633dee0 con 0x7f30a4035070 2024-09-12T17:30:56.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.845+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 25 ==== osd_op_reply(144 gc.26 [call] v31'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.845+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:145 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55870633dee0 con 0x7f30a4035070 2024-09-12T17:30:56.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.845+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 26 ==== osd_op_reply(145 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.845+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.845+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:146 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55870633dee0 con 0x7f30a4035070 2024-09-12T17:30:56.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.845+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 27 ==== osd_op_reply(146 gc.26 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.845+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:147 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55870633dee0 con 0x7f30a4035070 2024-09-12T17:30:56.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.846+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 28 ==== osd_op_reply(147 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.846+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.846+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:148 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55870633dee0 con 0x7f30a4035070 2024-09-12T17:30:56.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.846+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 29 ==== osd_op_reply(148 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.846+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.846+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:149 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55870633dee0 con 0x7f30a4035070 2024-09-12T17:30:56.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.847+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 30 ==== osd_op_reply(149 gc.26 [call] v31'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.847+0000 7f30aeb33800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:30:56.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.847+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:150 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55870633dee0 con 0x5587062f1e30 2024-09-12T17:30:56.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.848+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 61 ==== osd_op_reply(150 gc.27 [call] v31'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.848+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:151 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55870633dee0 con 0x5587062f1e30 2024-09-12T17:30:56.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.848+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 62 ==== osd_op_reply(151 gc.27 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.848+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.848+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:152 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55870633dee0 con 0x5587062f1e30 2024-09-12T17:30:56.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.848+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 63 ==== osd_op_reply(152 gc.27 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.848+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:153 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55870633dee0 con 0x5587062f1e30 2024-09-12T17:30:56.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.849+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 64 ==== osd_op_reply(153 gc.27 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.849+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.849+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:154 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55870633dee0 con 0x5587062f1e30 2024-09-12T17:30:56.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.849+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 65 ==== osd_op_reply(154 gc.27 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.849+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.849+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:155 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55870633dee0 con 0x5587062f1e30 2024-09-12T17:30:56.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.850+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 66 ==== osd_op_reply(155 gc.27 [call] v31'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.850+0000 7f30aeb33800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:30:56.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.850+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:156 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55870633dee0 con 0x7f30a4035070 2024-09-12T17:30:56.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.851+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 31 ==== osd_op_reply(156 gc.28 [call] v31'58 uv58 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.851+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:157 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55870633dee0 con 0x7f30a4035070 2024-09-12T17:30:56.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.852+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 32 ==== osd_op_reply(157 gc.28 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.852+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.852+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:158 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55870633dee0 con 0x7f30a4035070 2024-09-12T17:30:56.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.852+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 33 ==== osd_op_reply(158 gc.28 [call out=24b] v0'0 uv58 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.852+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:159 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55870633dee0 con 0x7f30a4035070 2024-09-12T17:30:56.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.852+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 34 ==== osd_op_reply(159 gc.28 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.852+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.852+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:160 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55870633dee0 con 0x7f30a4035070 2024-09-12T17:30:56.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.853+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 35 ==== osd_op_reply(160 gc.28 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.853+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.853+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:161 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55870633dee0 con 0x7f30a4035070 2024-09-12T17:30:56.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.854+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 36 ==== osd_op_reply(161 gc.28 [call] v31'59 uv59 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.854+0000 7f30aeb33800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:30:56.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.854+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:162 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55870633dee0 con 0x5587062f1e30 2024-09-12T17:30:56.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.855+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 67 ==== osd_op_reply(162 gc.29 [call] v31'82 uv82 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.855+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:163 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55870633dee0 con 0x5587062f1e30 2024-09-12T17:30:56.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.855+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 68 ==== osd_op_reply(163 gc.29 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.855+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.855+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:164 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55870633dee0 con 0x5587062f1e30 2024-09-12T17:30:56.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.855+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 69 ==== osd_op_reply(164 gc.29 [call out=24b] v0'0 uv82 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.856+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:165 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55870633dee0 con 0x5587062f1e30 2024-09-12T17:30:56.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.856+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 70 ==== osd_op_reply(165 gc.29 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.856+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.856+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:166 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55870633dee0 con 0x5587062f1e30 2024-09-12T17:30:56.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.856+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 71 ==== osd_op_reply(166 gc.29 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.856+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.856+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:167 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55870633dee0 con 0x5587062f1e30 2024-09-12T17:30:56.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.857+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 72 ==== osd_op_reply(167 gc.29 [call] v31'83 uv83 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.857+0000 7f30aeb33800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:30:56.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.857+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:168 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55870633dee0 con 0x7f30a4035070 2024-09-12T17:30:56.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.858+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 37 ==== osd_op_reply(168 gc.30 [call] v31'64 uv64 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.858+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:169 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55870633dee0 con 0x7f30a4035070 2024-09-12T17:30:56.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.859+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 38 ==== osd_op_reply(169 gc.30 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.859+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.859+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:170 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55870633dee0 con 0x7f30a4035070 2024-09-12T17:30:56.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.859+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 39 ==== osd_op_reply(170 gc.30 [call out=24b] v0'0 uv64 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.859+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:171 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55870633dee0 con 0x7f30a4035070 2024-09-12T17:30:56.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.859+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 40 ==== osd_op_reply(171 gc.30 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.859+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.859+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:172 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55870633dee0 con 0x7f30a4035070 2024-09-12T17:30:56.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.859+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 41 ==== osd_op_reply(172 gc.30 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.860+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.860+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:173 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55870633dee0 con 0x7f30a4035070 2024-09-12T17:30:56.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.860+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 42 ==== osd_op_reply(173 gc.30 [call] v31'65 uv65 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.860+0000 7f30aeb33800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:30:56.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.860+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:174 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55870633dee0 con 0x5587062ed350 2024-09-12T17:30:56.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.862+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 28 ==== osd_op_reply(174 gc.31 [call] v31'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.862+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:175 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55870633b810 con 0x5587062ed350 2024-09-12T17:30:56.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.862+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 29 ==== osd_op_reply(175 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.862+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.862+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:176 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55870633b810 con 0x5587062ed350 2024-09-12T17:30:56.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.862+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 30 ==== osd_op_reply(176 gc.31 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.862+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:177 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55870633b810 con 0x5587062ed350 2024-09-12T17:30:56.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.863+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 31 ==== osd_op_reply(177 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.863+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.863+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:178 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062ed350 2024-09-12T17:30:56.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.863+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 32 ==== osd_op_reply(178 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.863+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.863+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:179 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062ed350 2024-09-12T17:30:56.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.864+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 33 ==== osd_op_reply(179 gc.31 [call] v31'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.864+0000 7f30aeb33800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:30:56.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.864+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:180 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062e8960 2024-09-12T17:30:56.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.866+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 33 ==== osd_op_reply(180 gc.0 [call] v31'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.866+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:181 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062e8960 2024-09-12T17:30:56.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.866+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 34 ==== osd_op_reply(181 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.866+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.866+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:182 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062e8960 2024-09-12T17:30:56.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.866+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 35 ==== osd_op_reply(182 gc.0 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.866+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:183 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062e8960 2024-09-12T17:30:56.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.866+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 36 ==== osd_op_reply(183 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.866+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.866+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:184 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062e8960 2024-09-12T17:30:56.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.866+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 37 ==== osd_op_reply(184 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.867+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.867+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:185 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062e8960 2024-09-12T17:30:56.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.868+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 38 ==== osd_op_reply(185 gc.0 [call] v31'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.868+0000 7f30aeb33800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:30:56.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.868+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:186 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x7f30a4035070 2024-09-12T17:30:56.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.869+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 43 ==== osd_op_reply(186 gc.1 [call] v31'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.869+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:187 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x7f30a4035070 2024-09-12T17:30:56.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.869+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 44 ==== osd_op_reply(187 gc.1 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.869+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.869+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:188 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x7f30a4035070 2024-09-12T17:30:56.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.869+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 45 ==== osd_op_reply(188 gc.1 [call out=24b] v0'0 uv34 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.869+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:189 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x7f30a4035070 2024-09-12T17:30:56.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.870+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 46 ==== osd_op_reply(189 gc.1 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.870+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.870+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:190 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x7f30a4035070 2024-09-12T17:30:56.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.870+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 47 ==== osd_op_reply(190 gc.1 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.870+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.870+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:191 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x7f30a4035070 2024-09-12T17:30:56.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.871+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 48 ==== osd_op_reply(191 gc.1 [call] v31'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.871+0000 7f30aeb33800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:30:56.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.871+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:192 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062f1e30 2024-09-12T17:30:56.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.872+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 73 ==== osd_op_reply(192 gc.2 [call] v31'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.872+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:193 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062f1e30 2024-09-12T17:30:56.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.872+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 74 ==== osd_op_reply(193 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.872+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.872+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:194 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062f1e30 2024-09-12T17:30:56.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.872+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 75 ==== osd_op_reply(194 gc.2 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.872+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:195 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062f1e30 2024-09-12T17:30:56.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.872+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 76 ==== osd_op_reply(195 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.872+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.872+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:196 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062f1e30 2024-09-12T17:30:56.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.873+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 77 ==== osd_op_reply(196 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.873+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.873+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:197 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062f1e30 2024-09-12T17:30:56.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.874+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 78 ==== osd_op_reply(197 gc.2 [call] v31'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.874+0000 7f30aeb33800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:30:56.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.874+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:198 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062e8960 2024-09-12T17:30:56.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.875+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 39 ==== osd_op_reply(198 gc.3 [call] v31'281 uv281 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.875+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:199 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062e8960 2024-09-12T17:30:56.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.875+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 40 ==== osd_op_reply(199 gc.3 [call out=15b] v0'0 uv281 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.875+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.875+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:200 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062e8960 2024-09-12T17:30:56.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.875+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 41 ==== osd_op_reply(200 gc.3 [call out=24b] v0'0 uv281 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.875+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:201 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062e8960 2024-09-12T17:30:56.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.875+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 42 ==== osd_op_reply(201 gc.3 [call out=15b] v0'0 uv281 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.875+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.875+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:202 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062e8960 2024-09-12T17:30:56.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.876+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 43 ==== osd_op_reply(202 gc.3 [call out=15b] v0'0 uv281 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.876+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.876+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:203 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062e8960 2024-09-12T17:30:56.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.877+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 44 ==== osd_op_reply(203 gc.3 [call] v31'282 uv282 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.877+0000 7f30aeb33800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:30:56.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.877+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:204 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062ed350 2024-09-12T17:30:56.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.878+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 34 ==== osd_op_reply(204 gc.4 [call] v31'86 uv86 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.878+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:205 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55870633b810 con 0x5587062ed350 2024-09-12T17:30:56.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.878+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 35 ==== osd_op_reply(205 gc.4 [call out=15b] v0'0 uv86 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.878+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.878+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:206 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55870633b810 con 0x5587062ed350 2024-09-12T17:30:56.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.878+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 36 ==== osd_op_reply(206 gc.4 [call out=24b] v0'0 uv86 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.878+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:207 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55870633b810 con 0x5587062ed350 2024-09-12T17:30:56.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.878+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 37 ==== osd_op_reply(207 gc.4 [call out=15b] v0'0 uv86 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.878+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.878+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:208 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062ed350 2024-09-12T17:30:56.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.879+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 38 ==== osd_op_reply(208 gc.4 [call out=15b] v0'0 uv86 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.879+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.879+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:209 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062ed350 2024-09-12T17:30:56.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.879+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 39 ==== osd_op_reply(209 gc.4 [call] v31'87 uv87 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.879+0000 7f30aeb33800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:30:56.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.879+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:210 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062f1e30 2024-09-12T17:30:56.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.880+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 79 ==== osd_op_reply(210 gc.5 [call] v31'61 uv61 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.880+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:211 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062f1e30 2024-09-12T17:30:56.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.881+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 80 ==== osd_op_reply(211 gc.5 [call out=15b] v0'0 uv61 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.881+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.881+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:212 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062f1e30 2024-09-12T17:30:56.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.881+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 81 ==== osd_op_reply(212 gc.5 [call out=24b] v0'0 uv61 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.881+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:213 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062f1e30 2024-09-12T17:30:56.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.881+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 82 ==== osd_op_reply(213 gc.5 [call out=15b] v0'0 uv61 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.881+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.881+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:214 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062f1e30 2024-09-12T17:30:56.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.881+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 83 ==== osd_op_reply(214 gc.5 [call out=15b] v0'0 uv61 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.881+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.881+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:215 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062f1e30 2024-09-12T17:30:56.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.882+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 84 ==== osd_op_reply(215 gc.5 [call] v31'62 uv62 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.882+0000 7f30aeb33800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:30:56.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.882+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:216 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062e8960 2024-09-12T17:30:56.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.883+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 45 ==== osd_op_reply(216 gc.6 [call] v31'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.883+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:217 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062e8960 2024-09-12T17:30:56.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.884+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 46 ==== osd_op_reply(217 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.884+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.884+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:218 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062e8960 2024-09-12T17:30:56.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.884+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 47 ==== osd_op_reply(218 gc.6 [call out=24b] v0'0 uv34 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.884+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:219 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062e8960 2024-09-12T17:30:56.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.884+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 48 ==== osd_op_reply(219 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.884+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.884+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:220 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062e8960 2024-09-12T17:30:56.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.884+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 49 ==== osd_op_reply(220 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.884+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.884+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:221 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062e8960 2024-09-12T17:30:56.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.885+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 50 ==== osd_op_reply(221 gc.6 [call] v31'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.885+0000 7f30aeb33800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:30:56.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.885+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:222 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x7f30a4035070 2024-09-12T17:30:56.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.887+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 49 ==== osd_op_reply(222 gc.7 [call] v31'60 uv60 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.887+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:223 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x7f30a4035070 2024-09-12T17:30:56.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.887+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 50 ==== osd_op_reply(223 gc.7 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.887+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.887+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:224 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x7f30a4035070 2024-09-12T17:30:56.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.887+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 51 ==== osd_op_reply(224 gc.7 [call out=24b] v0'0 uv60 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.888+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:225 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x7f30a4035070 2024-09-12T17:30:56.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.888+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 52 ==== osd_op_reply(225 gc.7 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.888+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.888+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:226 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x7f30a4035070 2024-09-12T17:30:56.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.888+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 53 ==== osd_op_reply(226 gc.7 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.888+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.888+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:227 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x7f30a4035070 2024-09-12T17:30:56.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.889+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 54 ==== osd_op_reply(227 gc.7 [call] v31'61 uv61 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.889+0000 7f30aeb33800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:30:56.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.889+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:228 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062ed350 2024-09-12T17:30:56.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.890+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 40 ==== osd_op_reply(228 gc.8 [call] v31'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.890+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:229 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55870633b810 con 0x5587062ed350 2024-09-12T17:30:56.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.891+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 41 ==== osd_op_reply(229 gc.8 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.891+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.891+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:230 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55870633b810 con 0x5587062ed350 2024-09-12T17:30:56.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.891+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 42 ==== osd_op_reply(230 gc.8 [call out=24b] v0'0 uv33 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.891+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:231 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55870633b810 con 0x5587062ed350 2024-09-12T17:30:56.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.891+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 43 ==== osd_op_reply(231 gc.8 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.891+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.891+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:232 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062ed350 2024-09-12T17:30:56.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.891+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 44 ==== osd_op_reply(232 gc.8 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.891+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.891+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:233 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062ed350 2024-09-12T17:30:56.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.892+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 45 ==== osd_op_reply(233 gc.8 [call] v31'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.892+0000 7f30aeb33800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:30:56.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.892+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:234 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062f1e30 2024-09-12T17:30:56.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.893+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 85 ==== osd_op_reply(234 gc.9 [call] v31'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.893+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:235 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062f1e30 2024-09-12T17:30:56.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.894+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 86 ==== osd_op_reply(235 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.894+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.894+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:236 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062f1e30 2024-09-12T17:30:56.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.894+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 87 ==== osd_op_reply(236 gc.9 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.894+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:237 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062f1e30 2024-09-12T17:30:56.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.894+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 88 ==== osd_op_reply(237 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.894+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.894+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:238 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062f1e30 2024-09-12T17:30:56.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.894+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 89 ==== osd_op_reply(238 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.894+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.894+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:239 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062f1e30 2024-09-12T17:30:56.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.895+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 90 ==== osd_op_reply(239 gc.9 [call] v31'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.895+0000 7f30aeb33800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:30:56.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.895+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:240 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062ed350 2024-09-12T17:30:56.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.896+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 46 ==== osd_op_reply(240 gc.10 [call] v31'88 uv88 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.896+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:241 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55870633b810 con 0x5587062ed350 2024-09-12T17:30:56.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.896+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 47 ==== osd_op_reply(241 gc.10 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.896+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.896+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:242 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55870633b810 con 0x5587062ed350 2024-09-12T17:30:56.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.897+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 48 ==== osd_op_reply(242 gc.10 [call out=24b] v0'0 uv88 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.897+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:243 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55870633b810 con 0x5587062ed350 2024-09-12T17:30:56.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.897+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 49 ==== osd_op_reply(243 gc.10 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.897+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.897+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:244 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062ed350 2024-09-12T17:30:56.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.897+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 50 ==== osd_op_reply(244 gc.10 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.897+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.897+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:245 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062ed350 2024-09-12T17:30:56.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.898+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 51 ==== osd_op_reply(245 gc.10 [call] v31'89 uv89 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.898+0000 7f30aeb33800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:30:56.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.898+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:246 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x7f30a4035070 2024-09-12T17:30:56.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.900+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 55 ==== osd_op_reply(246 gc.11 [call] v31'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.900+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:247 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x7f30a4035070 2024-09-12T17:30:56.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.900+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 56 ==== osd_op_reply(247 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.900+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.900+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:248 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x7f30a4035070 2024-09-12T17:30:56.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.900+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 57 ==== osd_op_reply(248 gc.11 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.900+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:249 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x7f30a4035070 2024-09-12T17:30:56.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.900+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 58 ==== osd_op_reply(249 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.900+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.900+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:250 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x7f30a4035070 2024-09-12T17:30:56.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.901+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 59 ==== osd_op_reply(250 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.901+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.901+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:251 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x7f30a4035070 2024-09-12T17:30:56.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.902+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 60 ==== osd_op_reply(251 gc.11 [call] v31'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.902+0000 7f30aeb33800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:30:56.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.902+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:252 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062ed350 2024-09-12T17:30:56.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.903+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 52 ==== osd_op_reply(252 gc.12 [call] v31'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.903+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:253 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55870633b810 con 0x5587062ed350 2024-09-12T17:30:56.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.903+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 53 ==== osd_op_reply(253 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.903+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.903+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:254 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55870633b810 con 0x5587062ed350 2024-09-12T17:30:56.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.903+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 54 ==== osd_op_reply(254 gc.12 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.903+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:255 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55870633b810 con 0x5587062ed350 2024-09-12T17:30:56.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.903+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 55 ==== osd_op_reply(255 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.903+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.903+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:256 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062ed350 2024-09-12T17:30:56.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.904+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 56 ==== osd_op_reply(256 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.904+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.904+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:257 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062ed350 2024-09-12T17:30:56.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.905+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 57 ==== osd_op_reply(257 gc.12 [call] v31'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.905+0000 7f30aeb33800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:30:56.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.905+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:258 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x7f30a4035070 2024-09-12T17:30:56.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.906+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 61 ==== osd_op_reply(258 gc.13 [call] v31'66 uv66 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.906+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:259 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x7f30a4035070 2024-09-12T17:30:56.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.906+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 62 ==== osd_op_reply(259 gc.13 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.906+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.906+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:260 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x7f30a4035070 2024-09-12T17:30:56.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.906+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 63 ==== osd_op_reply(260 gc.13 [call out=24b] v0'0 uv66 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.906+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:261 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x7f30a4035070 2024-09-12T17:30:56.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.907+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 64 ==== osd_op_reply(261 gc.13 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.907+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.907+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:262 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x7f30a4035070 2024-09-12T17:30:56.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.907+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 65 ==== osd_op_reply(262 gc.13 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.907+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.907+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:263 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x7f30a4035070 2024-09-12T17:30:56.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.908+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 66 ==== osd_op_reply(263 gc.13 [call] v31'67 uv67 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.908+0000 7f30aeb33800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:30:56.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.908+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:264 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062e8960 2024-09-12T17:30:56.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.909+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 51 ==== osd_op_reply(264 gc.14 [call] v31'283 uv283 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.909+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:265 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062e8960 2024-09-12T17:30:56.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.909+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 52 ==== osd_op_reply(265 gc.14 [call out=15b] v0'0 uv283 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.909+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.909+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:266 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062e8960 2024-09-12T17:30:56.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.910+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 53 ==== osd_op_reply(266 gc.14 [call out=24b] v0'0 uv283 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.910+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:267 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062e8960 2024-09-12T17:30:56.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.910+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 54 ==== osd_op_reply(267 gc.14 [call out=15b] v0'0 uv283 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.910+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.910+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:268 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062e8960 2024-09-12T17:30:56.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.910+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 55 ==== osd_op_reply(268 gc.14 [call out=15b] v0'0 uv283 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.910+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.910+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:269 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062e8960 2024-09-12T17:30:56.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.911+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 56 ==== osd_op_reply(269 gc.14 [call] v31'284 uv284 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.911+0000 7f30aeb33800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:30:56.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.911+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:270 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062f1e30 2024-09-12T17:30:56.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.912+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 91 ==== osd_op_reply(270 gc.15 [call] v31'84 uv84 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.912+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:271 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062f1e30 2024-09-12T17:30:56.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.912+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 92 ==== osd_op_reply(271 gc.15 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.912+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.912+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:272 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062f1e30 2024-09-12T17:30:56.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.913+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 93 ==== osd_op_reply(272 gc.15 [call out=24b] v0'0 uv84 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.913+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:273 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062f1e30 2024-09-12T17:30:56.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.913+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 94 ==== osd_op_reply(273 gc.15 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.913+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.913+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:274 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062f1e30 2024-09-12T17:30:56.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.913+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 95 ==== osd_op_reply(274 gc.15 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.913+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.913+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:275 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062f1e30 2024-09-12T17:30:56.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.914+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 96 ==== osd_op_reply(275 gc.15 [call] v31'85 uv85 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.914+0000 7f30aeb33800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:30:56.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.914+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:276 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062ed350 2024-09-12T17:30:56.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.915+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 58 ==== osd_op_reply(276 gc.16 [call] v31'90 uv90 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.915+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:277 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55870633b810 con 0x5587062ed350 2024-09-12T17:30:56.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.915+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 59 ==== osd_op_reply(277 gc.16 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.915+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.915+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:278 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55870633b810 con 0x5587062ed350 2024-09-12T17:30:56.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.916+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 60 ==== osd_op_reply(278 gc.16 [call out=24b] v0'0 uv90 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.916+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:279 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55870633b810 con 0x5587062ed350 2024-09-12T17:30:56.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.916+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 61 ==== osd_op_reply(279 gc.16 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.916+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.916+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:280 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062ed350 2024-09-12T17:30:56.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.916+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 62 ==== osd_op_reply(280 gc.16 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.916+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.916+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:281 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062ed350 2024-09-12T17:30:56.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.917+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 63 ==== osd_op_reply(281 gc.16 [call] v31'91 uv91 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.917+0000 7f30aeb33800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:30:56.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.917+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:282 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062f1e30 2024-09-12T17:30:56.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.918+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 97 ==== osd_op_reply(282 gc.17 [call] v31'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.918+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:283 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062f1e30 2024-09-12T17:30:56.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.918+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 98 ==== osd_op_reply(283 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.918+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.918+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:284 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062f1e30 2024-09-12T17:30:56.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.918+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 99 ==== osd_op_reply(284 gc.17 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.918+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:285 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062f1e30 2024-09-12T17:30:56.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.918+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 100 ==== osd_op_reply(285 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.918+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.918+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:286 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062f1e30 2024-09-12T17:30:56.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.919+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 101 ==== osd_op_reply(286 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.919+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.919+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:287 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062f1e30 2024-09-12T17:30:56.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.919+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 102 ==== osd_op_reply(287 gc.17 [call] v31'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.919+0000 7f30aeb33800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:30:56.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.919+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:288 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062e8960 2024-09-12T17:30:56.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.921+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 57 ==== osd_op_reply(288 gc.18 [call] v31'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.921+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:289 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062e8960 2024-09-12T17:30:56.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.921+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 58 ==== osd_op_reply(289 gc.18 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.921+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.921+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:290 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062e8960 2024-09-12T17:30:56.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.921+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 59 ==== osd_op_reply(290 gc.18 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.921+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:291 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062e8960 2024-09-12T17:30:56.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.921+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 60 ==== osd_op_reply(291 gc.18 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.921+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:30:56.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.921+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:292 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062e8960 2024-09-12T17:30:56.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.922+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 61 ==== osd_op_reply(292 gc.18 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.922+0000 7f30aeb33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:30:56.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.922+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:293 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706333c40 con 0x5587062e8960 2024-09-12T17:30:56.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.923+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 62 ==== osd_op_reply(293 gc.18 [call] v31'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.924+0000 7f2f617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:56.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.924+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94038412739008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706333ae0 con 0x5587062e8960 2024-09-12T17:30:56.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.925+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 63 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94038412739008] v31'285 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.925+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94038412717408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558706333ae0 con 0x5587062ed350 2024-09-12T17:30:56.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.926+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 64 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94038412717408] v31'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.926+0000 7f30aeb33800 20 remove_watcher() i=0 2024-09-12T17:30:56.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.926+0000 7f30aeb33800 2 removed watcher, disabling cache 2024-09-12T17:30:56.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.926+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94038412721328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5587062f6d60 con 0x5587062e8960 2024-09-12T17:30:56.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.927+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 64 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94038412721328] v31'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.927+0000 7f30aeb33800 20 remove_watcher() i=1 2024-09-12T17:30:56.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.927+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94038412725200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5587062f6d60 con 0x5587062f1e30 2024-09-12T17:30:56.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.928+0000 7f30aa876640 1 -- 172.21.15.170:0/1121657941 <== osd.3 v2:172.21.15.170:6816/2664906588 103 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94038412725200] v31'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f309c051070 con 0x5587062f1e30 2024-09-12T17:30:56.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.928+0000 7f30aeb33800 20 remove_watcher() i=2 2024-09-12T17:30:56.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.928+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94038412727920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5587062f8bd0 con 0x5587062ed350 2024-09-12T17:30:56.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.929+0000 7f30ab077640 1 -- 172.21.15.170:0/1121657941 <== osd.2 v2:172.21.15.170:6808/3855567754 65 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94038412727920] v31'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30a4066040 con 0x5587062ed350 2024-09-12T17:30:56.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.930+0000 7f30aeb33800 20 remove_watcher() i=3 2024-09-12T17:30:56.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.930+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94038412730240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5587062f6d60 con 0x5587062e8960 2024-09-12T17:30:56.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.931+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.1 v2:172.21.15.170:6800/1903654092 65 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94038412730240] v31'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3094029040 con 0x5587062e8960 2024-09-12T17:30:56.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.931+0000 7f30aeb33800 20 remove_watcher() i=4 2024-09-12T17:30:56.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.931+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94038412731984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5587062f9670 con 0x7f30a4035070 2024-09-12T17:30:56.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.932+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 67 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94038412731984] v31'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.932+0000 7f30aeb33800 20 remove_watcher() i=5 2024-09-12T17:30:56.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.932+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94038412735792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5587062f8bd0 con 0x7f30a4035070 2024-09-12T17:30:56.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.933+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 68 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94038412735792] v31'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.933+0000 7f30aeb33800 20 remove_watcher() i=6 2024-09-12T17:30:56.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.933+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94038412737584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5587062f9670 con 0x7f30a4035070 2024-09-12T17:30:56.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.934+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 <== osd.0 v2:172.21.15.47:6800/3978157098 69 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94038412737584] v31'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3094029040 con 0x7f30a4035070 2024-09-12T17:30:56.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.934+0000 7f30aeb33800 20 remove_watcher() i=7 2024-09-12T17:30:56.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.935+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f30a4035070 msgr2=0x7f30a4055a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:56.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.935+0000 7f30aeb33800 1 --2- 172.21.15.170:0/1121657941 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f30a4035070 0x7f30a4055a70 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:30:56.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.935+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5587062e8960 msgr2=0x5587062eae20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:56.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.935+0000 7f30aeb33800 1 --2- 172.21.15.170:0/1121657941 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5587062e8960 0x5587062eae20 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:30:56.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.935+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5587062ed350 msgr2=0x5587062ef740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:56.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.935+0000 7f30aeb33800 1 --2- 172.21.15.170:0/1121657941 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5587062ed350 0x5587062ef740 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:30:56.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.935+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5587062f1e30 msgr2=0x5587062f42f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:56.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.935+0000 7f30aeb33800 1 --2- 172.21.15.170:0/1121657941 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x5587062f1e30 0x5587062f42f0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:30:56.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.935+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2f7403c730 msgr2=0x7f2f7403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:56.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.935+0000 7f30aeb33800 1 --2- 172.21.15.170:0/1121657941 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2f7403c730 0x7f2f7403ebf0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f309c068fd0 tx=0x7f309c092000 comp rx=0 tx=0).stop 2024-09-12T17:30:56.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.935+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587062d5a20 msgr2=0x5587062dcfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:56.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.935+0000 7f30aeb33800 1 --2- 172.21.15.170:0/1121657941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587062d5a20 0x5587062dcfe0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f30a4047040 tx=0x7f30a4053cc0 comp rx=0 tx=0).stop 2024-09-12T17:30:56.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.935+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 reap_dead start 2024-09-12T17:30:56.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.935+0000 7f30a3fff640 1 -- 172.21.15.170:0/1121657941 reap_dead start 2024-09-12T17:30:56.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.935+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 shutdown_connections 2024-09-12T17:30:56.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.935+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 >> 172.21.15.170:0/1121657941 conn(0x5587062d1e20 msgr2=0x5587062d0030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:30:56.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.935+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 shutdown_connections 2024-09-12T17:30:56.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.935+0000 7f30aeb33800 1 -- 172.21.15.170:0/1121657941 wait complete. 2024-09-12T17:30:56.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.935+0000 7f30aeb33800 1 -- 172.21.15.170:0/3551391532 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2f8403c730 msgr2=0x7f2f8403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:56.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.935+0000 7f30aeb33800 1 --2- 172.21.15.170:0/3551391532 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2f8403c730 0x7f2f8403ebf0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f309c096410 tx=0x7f309c05fd30 comp rx=0 tx=0).stop 2024-09-12T17:30:56.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.935+0000 7f30aeb33800 1 -- 172.21.15.170:0/3551391532 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587062c8f00 msgr2=0x5587062c9320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:56.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.935+0000 7f30aeb33800 1 --2- 172.21.15.170:0/3551391532 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587062c8f00 0x5587062c9320 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x5587062af010 tx=0x7f30a40167b0 comp rx=0 tx=0).stop 2024-09-12T17:30:56.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.935+0000 7f30aeb33800 1 -- 172.21.15.170:0/3551391532 shutdown_connections 2024-09-12T17:30:56.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.935+0000 7f30aeb33800 1 --2- 172.21.15.170:0/3551391532 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2f8403c730 0x7f2f8403ebf0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:30:56.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.935+0000 7f30aeb33800 1 --2- 172.21.15.170:0/3551391532 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587062c8f00 0x5587062c9320 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:30:56.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.935+0000 7f30aeb33800 1 -- 172.21.15.170:0/3551391532 >> 172.21.15.170:0/3551391532 conn(0x5587062bd2b0 msgr2=0x5587062bd690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:30:56.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.935+0000 7f30aeb33800 1 -- 172.21.15.170:0/3551391532 shutdown_connections 2024-09-12T17:30:56.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.935+0000 7f30aeb33800 1 -- 172.21.15.170:0/3551391532 wait complete. 2024-09-12T17:30:56.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.936+0000 7f30aeb33800 1 -- 172.21.15.170:0/4204720956 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5587061b3de0 msgr2=0x5587062b5660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:56.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.936+0000 7f30aeb33800 1 --2- 172.21.15.170:0/4204720956 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5587061b3de0 0x5587062b5660 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:30:56.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.936+0000 7f30aeb33800 1 -- 172.21.15.170:0/4204720956 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5587062b7a40 msgr2=0x5587062b9ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:56.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.936+0000 7f30aeb33800 1 --2- 172.21.15.170:0/4204720956 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5587062b7a40 0x5587062b9ec0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:30:56.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.936+0000 7f30aeb33800 1 -- 172.21.15.170:0/4204720956 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2f9003c730 msgr2=0x7f2f9003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:56.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.936+0000 7f30aeb33800 1 --2- 172.21.15.170:0/4204720956 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2f9003c730 0x7f2f9003ebf0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3094001d70 tx=0x7f30940012d0 comp rx=0 tx=0).stop 2024-09-12T17:30:56.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.936+0000 7f30aeb33800 1 -- 172.21.15.170:0/4204720956 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587061b34a0 msgr2=0x5587062ae010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:56.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.936+0000 7f30aeb33800 1 --2- 172.21.15.170:0/4204720956 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587061b34a0 0x5587062ae010 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f309c025c20 tx=0x7f309c002fb0 comp rx=0 tx=0).stop 2024-09-12T17:30:56.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.936+0000 7f30aeb33800 1 -- 172.21.15.170:0/4204720956 shutdown_connections 2024-09-12T17:30:56.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.936+0000 7f30aeb33800 1 --2- 172.21.15.170:0/4204720956 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x5587062b7a40 0x5587062b9ec0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:30:56.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.936+0000 7f30aeb33800 1 --2- 172.21.15.170:0/4204720956 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f2f9003c730 0x7f2f9003ebf0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:30:56.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.936+0000 7f30aeb33800 1 --2- 172.21.15.170:0/4204720956 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x5587061b3de0 0x5587062b5660 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:30:56.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.936+0000 7f30aeb33800 1 --2- 172.21.15.170:0/4204720956 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5587061b34a0 0x5587062ae010 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:30:56.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.936+0000 7f30aeb33800 1 -- 172.21.15.170:0/4204720956 >> 172.21.15.170:0/4204720956 conn(0x5587061af1f0 msgr2=0x5587062a0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:30:56.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.936+0000 7f30aeb33800 1 -- 172.21.15.170:0/4204720956 shutdown_connections 2024-09-12T17:30:56.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T17:30:56.936+0000 7f30aeb33800 1 -- 172.21.15.170:0/4204720956 wait complete. 2024-09-12T17:30:56.946 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T17:30:56.956 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T17:30:56.956 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:30:57.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.061+0000 7fbc625bb640 1 Processor -- start 2024-09-12T17:30:57.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.061+0000 7fbc625bb640 1 -- start start 2024-09-12T17:30:57.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.062+0000 7fbc625bb640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbc5c130270 0x7fbc5c132660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:30:57.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.062+0000 7fbc625bb640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc5c06dc00 con 0x7fbc5c129d80 2024-09-12T17:30:57.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.062+0000 7fbc625bb640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fbc5c1299c0 con 0x7fbc5c130270 2024-09-12T17:30:57.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.062+0000 7fbc5b7fe640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbc5c130270 0x7fbc5c132660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:30:57.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.062+0000 7fbc5bfff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fbc5c129d80 0x7fbc5c12a160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:58568/0 (socket says 172.21.15.47:58568) 2024-09-12T17:30:57.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.062+0000 7fbc5bfff640 1 -- 172.21.15.47:0/191365222 learned_addr learned my addr 172.21.15.47:0/191365222 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-09-12T17:30:57.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.062+0000 7fbc5b7fe640 1 -- 172.21.15.47:0/191365222 >> v1:172.21.15.47:6789/0 conn(0x7fbc5c129d80 legacy=0x7fbc5c12a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:57.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.062+0000 7fbc5b7fe640 1 -- 172.21.15.47:0/191365222 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc5c12a870 con 0x7fbc5c130270 2024-09-12T17:30:57.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.063+0000 7fbc5b7fe640 1 --2- 172.21.15.47:0/191365222 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc5c130270 0x7fbc5c132660 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fbc50009720 tx=0x7fbc5002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=158cd5934c008ee5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:30:57.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.063+0000 7fbc5affd640 1 -- 172.21.15.47:0/191365222 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc50037070 con 0x7fbc5c130270 2024-09-12T17:30:57.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.063+0000 7fbc5affd640 1 -- 172.21.15.47:0/191365222 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc5002ad90 con 0x7fbc5c130270 2024-09-12T17:30:57.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.063+0000 7fbc5affd640 1 -- 172.21.15.47:0/191365222 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc50032590 con 0x7fbc5c130270 2024-09-12T17:30:57.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.064+0000 7fbc625bb640 1 -- 172.21.15.47:0/191365222 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc5c130270 msgr2=0x7fbc5c132660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:57.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.064+0000 7fbc625bb640 1 --2- 172.21.15.47:0/191365222 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc5c130270 0x7fbc5c132660 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fbc50009720 tx=0x7fbc5002a110 comp rx=0 tx=0).stop 2024-09-12T17:30:57.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.064+0000 7fbc625bb640 1 -- 172.21.15.47:0/191365222 shutdown_connections 2024-09-12T17:30:57.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.064+0000 7fbc625bb640 1 --2- 172.21.15.47:0/191365222 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc5c130270 0x7fbc5c132660 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:30:57.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.064+0000 7fbc625bb640 1 -- 172.21.15.47:0/191365222 >> 172.21.15.47:0/191365222 conn(0x7fbc5c070850 msgr2=0x7fbc5c072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:30:57.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.064+0000 7fbc625bb640 1 -- 172.21.15.47:0/191365222 shutdown_connections 2024-09-12T17:30:57.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.064+0000 7fbc625bb640 1 -- 172.21.15.47:0/191365222 wait complete. 2024-09-12T17:30:57.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.065+0000 7fbc625bb640 1 Processor -- start 2024-09-12T17:30:57.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.065+0000 7fbc625bb640 1 -- start start 2024-09-12T17:30:57.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.065+0000 7fbc625bb640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc5c129d80 0x7fbc5c112730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:30:57.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.065+0000 7fbc625bb640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5c073a10 con 0x7fbc5c129d80 2024-09-12T17:30:57.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.065+0000 7fbc5bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc5c129d80 0x7fbc5c112730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:30:57.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.065+0000 7fbc5bfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc5c129d80 0x7fbc5c112730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42856/0 (socket says 172.21.15.47:42856) 2024-09-12T17:30:57.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.065+0000 7fbc5bfff640 1 -- 172.21.15.47:0/914368824 learned_addr learned my addr 172.21.15.47:0/914368824 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:30:57.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.066+0000 7fbc5bfff640 1 -- 172.21.15.47:0/914368824 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc5c123de0 con 0x7fbc5c129d80 2024-09-12T17:30:57.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.066+0000 7fbc5bfff640 1 --2- 172.21.15.47:0/914368824 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc5c129d80 0x7fbc5c112730 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c00c480 tx=0x7fbc4c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:30:57.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.066+0000 7fbc58ff9640 1 -- 172.21.15.47:0/914368824 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc4c017070 con 0x7fbc5c129d80 2024-09-12T17:30:57.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.066+0000 7fbc58ff9640 1 -- 172.21.15.47:0/914368824 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc4c005c10 con 0x7fbc5c129d80 2024-09-12T17:30:57.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.066+0000 7fbc625bb640 1 -- 172.21.15.47:0/914368824 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc5c11a240 con 0x7fbc5c129d80 2024-09-12T17:30:57.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.066+0000 7fbc58ff9640 1 -- 172.21.15.47:0/914368824 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc4c007070 con 0x7fbc5c129d80 2024-09-12T17:30:57.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.066+0000 7fbc625bb640 1 -- 172.21.15.47:0/914368824 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc5c112c70 con 0x7fbc5c129d80 2024-09-12T17:30:57.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.067+0000 7fbc58ff9640 1 -- 172.21.15.47:0/914368824 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fbc4c01a070 con 0x7fbc5c129d80 2024-09-12T17:30:57.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.067+0000 7fbc625bb640 1 -- 172.21.15.47:0/914368824 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc5c11a010 con 0x7fbc5c129d80 2024-09-12T17:30:57.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.067+0000 7fbc58ff9640 1 --2- 172.21.15.47:0/914368824 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbc4803de90 0x7fbc48040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:30:57.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.067+0000 7fbc58ff9640 1 -- 172.21.15.47:0/914368824 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fbc4c051de0 con 0x7fbc5c129d80 2024-09-12T17:30:57.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.067+0000 7fbc5b7fe640 1 --2- 172.21.15.47:0/914368824 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbc4803de90 0x7fbc48040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:30:57.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.068+0000 7fbc5b7fe640 1 --2- 172.21.15.47:0/914368824 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbc4803de90 0x7fbc48040350 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbc50034000 tx=0x7fbc5002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:30:57.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.072+0000 7fbc58ff9640 1 -- 172.21.15.47:0/914368824 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7fbc4c01ac60 con 0x7fbc5c129d80 2024-09-12T17:30:57.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.255+0000 7fbc625bb640 1 -- 172.21.15.47:0/914368824 --> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbc5c114050 con 0x7fbc4803de90 2024-09-12T17:30:57.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.266+0000 7fbc58ff9640 1 -- 172.21.15.47:0/914368824 <== mgr.4102 v2:172.21.15.170:6824/4146902489 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665573 (secure 0 0 0) 0x7fbc5c114050 con 0x7fbc4803de90 2024-09-12T17:30:57.269 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:30:57.285 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-09-12T17:30:57.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.271+0000 7fbc625bb640 1 -- 172.21.15.47:0/914368824 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbc4803de90 msgr2=0x7fbc48040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:57.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.271+0000 7fbc625bb640 1 --2- 172.21.15.47:0/914368824 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbc4803de90 0x7fbc48040350 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbc50034000 tx=0x7fbc5002e000 comp rx=0 tx=0).stop 2024-09-12T17:30:57.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.271+0000 7fbc625bb640 1 -- 172.21.15.47:0/914368824 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc5c129d80 msgr2=0x7fbc5c112730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:57.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.271+0000 7fbc625bb640 1 --2- 172.21.15.47:0/914368824 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc5c129d80 0x7fbc5c112730 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c00c480 tx=0x7fbc4c00c940 comp rx=0 tx=0).stop 2024-09-12T17:30:57.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.271+0000 7fbc625bb640 1 -- 172.21.15.47:0/914368824 shutdown_connections 2024-09-12T17:30:57.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.271+0000 7fbc625bb640 1 --2- 172.21.15.47:0/914368824 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbc4803de90 0x7fbc48040350 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:30:57.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.271+0000 7fbc625bb640 1 --2- 172.21.15.47:0/914368824 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc5c129d80 0x7fbc5c112730 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:30:57.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.271+0000 7fbc625bb640 1 -- 172.21.15.47:0/914368824 >> 172.21.15.47:0/914368824 conn(0x7fbc5c070850 msgr2=0x7fbc5c1284b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:30:57.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.271+0000 7fbc625bb640 1 -- 172.21.15.47:0/914368824 shutdown_connections 2024-09-12T17:30:57.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.271+0000 7fbc625bb640 1 -- 172.21.15.47:0/914368824 wait complete. 2024-09-12T17:30:57.294 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":134,"stamp":"2024-09-12T17:30:55.792151+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412816,"num_objects":229,"num_object_clones":0,"num_object_copies":458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4911,"num_read_kb":4497,"num_write":2048,"num_write_kb":60586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":482,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4434,"ondisk_log_size":4434,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":182096,"kb_used_data":53200,"kb_used_omap":6,"kb_used_meta":128825,"kb_avail":377305264,"statfs":{"total":386547056640,"available":386360590336,"internally_reserved":0,"allocated":54476800,"data_stored":53331076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":131917590},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25811687,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":522,"num_read_kb":477,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003665"},"pg_stats":[{"pgid":"3.3f","version":"31'2","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.133871+0000","last_change":"2024-09-12T17:28:21.473408+0000","last_active":"2024-09-12T17:30:50.133871+0000","last_peered":"2024-09-12T17:30:50.133871+0000","last_clean":"2024-09-12T17:30:50.133871+0000","last_became_active":"2024-09-12T17:28:21.473004+0000","last_became_peered":"2024-09-12T17:28:21.473004+0000","last_unstale":"2024-09-12T17:30:50.133871+0000","last_undegraded":"2024-09-12T17:30:50.133871+0000","last_fullsized":"2024-09-12T17:30:50.133871+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:27:19.040598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.926869+0000","last_change":"2024-09-12T17:27:42.433458+0000","last_active":"2024-09-12T17:30:49.926869+0000","last_peered":"2024-09-12T17:30:49.926869+0000","last_clean":"2024-09-12T17:30:49.926869+0000","last_became_active":"2024-09-12T17:27:42.433207+0000","last_became_peered":"2024-09-12T17:27:42.433207+0000","last_unstale":"2024-09-12T17:30:49.926869+0000","last_undegraded":"2024-09-12T17:30:49.926869+0000","last_fullsized":"2024-09-12T17:30:49.926869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:10.865332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.473539+0000","last_change":"2024-09-12T17:27:40.419781+0000","last_active":"2024-09-12T17:28:21.473539+0000","last_peered":"2024-09-12T17:28:21.473539+0000","last_clean":"2024-09-12T17:28:21.473539+0000","last_became_active":"2024-09-12T17:27:40.418928+0000","last_became_peered":"2024-09-12T17:27:40.418928+0000","last_unstale":"2024-09-12T17:28:21.473539+0000","last_undegraded":"2024-09-12T17:28:21.473539+0000","last_fullsized":"2024-09-12T17:28:21.473539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:05.211778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"31'6","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.929876+0000","last_change":"2024-09-12T17:27:42.432970+0000","last_active":"2024-09-12T17:30:49.929876+0000","last_peered":"2024-09-12T17:30:49.929876+0000","last_clean":"2024-09-12T17:30:49.929876+0000","last_became_active":"2024-09-12T17:27:42.432677+0000","last_became_peered":"2024-09-12T17:27:42.432677+0000","last_unstale":"2024-09-12T17:30:49.929876+0000","last_undegraded":"2024-09-12T17:30:49.929876+0000","last_fullsized":"2024-09-12T17:30:49.929876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:02.399648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465766+0000","last_change":"2024-09-12T17:27:40.433743+0000","last_active":"2024-09-12T17:28:21.465766+0000","last_peered":"2024-09-12T17:28:21.465766+0000","last_clean":"2024-09-12T17:28:21.465766+0000","last_became_active":"2024-09-12T17:27:40.433470+0000","last_became_peered":"2024-09-12T17:27:40.433470+0000","last_unstale":"2024-09-12T17:28:21.465766+0000","last_undegraded":"2024-09-12T17:28:21.465766+0000","last_fullsized":"2024-09-12T17:28:21.465766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:30.372118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"31'8","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:05.194512+0000","last_change":"2024-09-12T17:27:42.433048+0000","last_active":"2024-09-12T17:29:05.194512+0000","last_peered":"2024-09-12T17:29:05.194512+0000","last_clean":"2024-09-12T17:29:05.194512+0000","last_became_active":"2024-09-12T17:27:42.432736+0000","last_became_peered":"2024-09-12T17:27:42.432736+0000","last_unstale":"2024-09-12T17:29:05.194512+0000","last_undegraded":"2024-09-12T17:29:05.194512+0000","last_fullsized":"2024-09-12T17:29:05.194512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:43.699110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"31'8","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.144210+0000","last_change":"2024-09-12T17:27:40.426931+0000","last_active":"2024-09-12T17:30:50.144210+0000","last_peered":"2024-09-12T17:30:50.144210+0000","last_clean":"2024-09-12T17:30:50.144210+0000","last_became_active":"2024-09-12T17:27:40.426649+0000","last_became_peered":"2024-09-12T17:27:40.426649+0000","last_unstale":"2024-09-12T17:30:50.144210+0000","last_undegraded":"2024-09-12T17:30:50.144210+0000","last_fullsized":"2024-09-12T17:30:50.144210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:02.612906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":18,"num_write":56,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"31'8","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.929278+0000","last_change":"2024-09-12T17:27:42.418772+0000","last_active":"2024-09-12T17:30:49.929278+0000","last_peered":"2024-09-12T17:30:49.929278+0000","last_clean":"2024-09-12T17:30:49.929278+0000","last_became_active":"2024-09-12T17:27:42.418517+0000","last_became_peered":"2024-09-12T17:27:42.418517+0000","last_unstale":"2024-09-12T17:30:49.929278+0000","last_undegraded":"2024-09-12T17:30:49.929278+0000","last_fullsized":"2024-09-12T17:30:49.929278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:38.683188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464584+0000","last_change":"2024-09-12T17:27:40.425244+0000","last_active":"2024-09-12T17:28:21.464584+0000","last_peered":"2024-09-12T17:28:21.464584+0000","last_clean":"2024-09-12T17:28:21.464584+0000","last_became_active":"2024-09-12T17:27:40.424978+0000","last_became_peered":"2024-09-12T17:27:40.424978+0000","last_unstale":"2024-09-12T17:28:21.464584+0000","last_undegraded":"2024-09-12T17:28:21.464584+0000","last_fullsized":"2024-09-12T17:28:21.464584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:04.819015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"31'16","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.148377+0000","last_change":"2024-09-12T17:27:42.424168+0000","last_active":"2024-09-12T17:30:50.148377+0000","last_peered":"2024-09-12T17:30:50.148377+0000","last_clean":"2024-09-12T17:30:50.148377+0000","last_became_active":"2024-09-12T17:27:42.423906+0000","last_became_peered":"2024-09-12T17:27:42.423906+0000","last_unstale":"2024-09-12T17:30:50.148377+0000","last_undegraded":"2024-09-12T17:30:50.148377+0000","last_fullsized":"2024-09-12T17:30:50.148377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:30.717650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.467259+0000","last_change":"2024-09-12T17:27:40.425571+0000","last_active":"2024-09-12T17:28:21.467259+0000","last_peered":"2024-09-12T17:28:21.467259+0000","last_clean":"2024-09-12T17:28:21.467259+0000","last_became_active":"2024-09-12T17:27:40.425308+0000","last_became_peered":"2024-09-12T17:27:40.425308+0000","last_unstale":"2024-09-12T17:28:21.467259+0000","last_undegraded":"2024-09-12T17:28:21.467259+0000","last_fullsized":"2024-09-12T17:28:21.467259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:31.336111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"29'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464656+0000","last_change":"2024-09-12T17:27:42.429057+0000","last_active":"2024-09-12T17:28:21.464656+0000","last_peered":"2024-09-12T17:28:21.464656+0000","last_clean":"2024-09-12T17:28:21.464656+0000","last_became_active":"2024-09-12T17:27:42.428137+0000","last_became_peered":"2024-09-12T17:27:42.428137+0000","last_unstale":"2024-09-12T17:28:21.464656+0000","last_undegraded":"2024-09-12T17:28:21.464656+0000","last_fullsized":"2024-09-12T17:28:21.464656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:30.467192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'3","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:10.769083+0000","last_change":"2024-09-12T17:27:40.427714+0000","last_active":"2024-09-12T17:30:10.769083+0000","last_peered":"2024-09-12T17:30:10.769083+0000","last_clean":"2024-09-12T17:30:10.769083+0000","last_became_active":"2024-09-12T17:27:40.426778+0000","last_became_peered":"2024-09-12T17:27:40.426778+0000","last_unstale":"2024-09-12T17:30:10.769083+0000","last_undegraded":"2024-09-12T17:30:10.769083+0000","last_fullsized":"2024-09-12T17:30:10.769083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:19.867310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"31'18","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:05.377369+0000","last_change":"2024-09-12T17:27:42.434343+0000","last_active":"2024-09-12T17:29:05.377369+0000","last_peered":"2024-09-12T17:29:05.377369+0000","last_clean":"2024-09-12T17:29:05.377369+0000","last_became_active":"2024-09-12T17:27:42.434042+0000","last_became_peered":"2024-09-12T17:27:42.434042+0000","last_unstale":"2024-09-12T17:29:05.377369+0000","last_undegraded":"2024-09-12T17:29:05.377369+0000","last_fullsized":"2024-09-12T17:29:05.377369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:52.600151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":56,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"31'4","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.822317+0000","last_change":"2024-09-12T17:27:40.419315+0000","last_active":"2024-09-12T17:28:21.822317+0000","last_peered":"2024-09-12T17:28:21.822317+0000","last_clean":"2024-09-12T17:28:21.822317+0000","last_became_active":"2024-09-12T17:27:40.418512+0000","last_became_peered":"2024-09-12T17:27:40.418512+0000","last_unstale":"2024-09-12T17:28:21.822317+0000","last_undegraded":"2024-09-12T17:28:21.822317+0000","last_fullsized":"2024-09-12T17:28:21.822317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:08.096897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"31'8","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:22.319704+0000","last_change":"2024-09-12T17:27:42.436453+0000","last_active":"2024-09-12T17:28:22.319704+0000","last_peered":"2024-09-12T17:28:22.319704+0000","last_clean":"2024-09-12T17:28:22.319704+0000","last_became_active":"2024-09-12T17:27:42.436159+0000","last_became_peered":"2024-09-12T17:27:42.436159+0000","last_unstale":"2024-09-12T17:28:22.319704+0000","last_undegraded":"2024-09-12T17:28:22.319704+0000","last_fullsized":"2024-09-12T17:28:22.319704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:16.940321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"31'4","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.226031+0000","last_change":"2024-09-12T17:27:42.433708+0000","last_active":"2024-09-12T17:30:50.226031+0000","last_peered":"2024-09-12T17:30:50.226031+0000","last_clean":"2024-09-12T17:30:50.226031+0000","last_became_active":"2024-09-12T17:27:42.433425+0000","last_became_peered":"2024-09-12T17:27:42.433425+0000","last_unstale":"2024-09-12T17:30:50.226031+0000","last_undegraded":"2024-09-12T17:30:50.226031+0000","last_fullsized":"2024-09-12T17:30:50.226031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:32.794303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470550+0000","last_change":"2024-09-12T17:27:40.417181+0000","last_active":"2024-09-12T17:28:21.470550+0000","last_peered":"2024-09-12T17:28:21.470550+0000","last_clean":"2024-09-12T17:28:21.470550+0000","last_became_active":"2024-09-12T17:27:40.415650+0000","last_became_peered":"2024-09-12T17:27:40.415650+0000","last_unstale":"2024-09-12T17:28:21.470550+0000","last_undegraded":"2024-09-12T17:28:21.470550+0000","last_fullsized":"2024-09-12T17:28:21.470550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:11.303262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468030+0000","last_change":"2024-09-12T17:27:42.427970+0000","last_active":"2024-09-12T17:28:21.468030+0000","last_peered":"2024-09-12T17:28:21.468030+0000","last_clean":"2024-09-12T17:28:21.468030+0000","last_became_active":"2024-09-12T17:27:42.427700+0000","last_became_peered":"2024-09-12T17:27:42.427700+0000","last_unstale":"2024-09-12T17:28:21.468030+0000","last_undegraded":"2024-09-12T17:28:21.468030+0000","last_fullsized":"2024-09-12T17:28:21.468030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:26.167048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:45.824378+0000","last_change":"2024-09-12T17:27:40.432319+0000","last_active":"2024-09-12T17:29:45.824378+0000","last_peered":"2024-09-12T17:29:45.824378+0000","last_clean":"2024-09-12T17:29:45.824378+0000","last_became_active":"2024-09-12T17:27:40.432033+0000","last_became_peered":"2024-09-12T17:27:40.432033+0000","last_unstale":"2024-09-12T17:29:45.824378+0000","last_undegraded":"2024-09-12T17:29:45.824378+0000","last_fullsized":"2024-09-12T17:29:45.824378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:33.541500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"31'3","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:04.760240+0000","last_change":"2024-09-12T17:27:42.428753+0000","last_active":"2024-09-12T17:30:04.760240+0000","last_peered":"2024-09-12T17:30:04.760240+0000","last_clean":"2024-09-12T17:30:04.760240+0000","last_became_active":"2024-09-12T17:27:42.428492+0000","last_became_peered":"2024-09-12T17:27:42.428492+0000","last_unstale":"2024-09-12T17:30:04.760240+0000","last_undegraded":"2024-09-12T17:30:04.760240+0000","last_fullsized":"2024-09-12T17:30:04.760240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:53.463766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"29'2","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.478975+0000","last_change":"2024-09-12T17:28:21.478314+0000","last_active":"2024-09-12T17:28:21.478975+0000","last_peered":"2024-09-12T17:28:21.478975+0000","last_clean":"2024-09-12T17:28:21.478975+0000","last_became_active":"2024-09-12T17:28:21.474758+0000","last_became_peered":"2024-09-12T17:28:21.474758+0000","last_unstale":"2024-09-12T17:28:21.478975+0000","last_undegraded":"2024-09-12T17:28:21.478975+0000","last_fullsized":"2024-09-12T17:28:21.478975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:57.685638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:22.319001+0000","last_change":"2024-09-12T17:27:42.425610+0000","last_active":"2024-09-12T17:28:22.319001+0000","last_peered":"2024-09-12T17:28:22.319001+0000","last_clean":"2024-09-12T17:28:22.319001+0000","last_became_active":"2024-09-12T17:27:42.424738+0000","last_became_peered":"2024-09-12T17:27:42.424738+0000","last_unstale":"2024-09-12T17:28:22.319001+0000","last_undegraded":"2024-09-12T17:28:22.319001+0000","last_fullsized":"2024-09-12T17:28:22.319001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:32.550633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469481+0000","last_change":"2024-09-12T17:27:40.415283+0000","last_active":"2024-09-12T17:28:21.469481+0000","last_peered":"2024-09-12T17:28:21.469481+0000","last_clean":"2024-09-12T17:28:21.469481+0000","last_became_active":"2024-09-12T17:27:40.414669+0000","last_became_peered":"2024-09-12T17:27:40.414669+0000","last_unstale":"2024-09-12T17:28:21.469481+0000","last_undegraded":"2024-09-12T17:28:21.469481+0000","last_fullsized":"2024-09-12T17:28:21.469481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:44.782205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"31'8","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.225695+0000","last_change":"2024-09-12T17:27:42.436197+0000","last_active":"2024-09-12T17:30:50.225695+0000","last_peered":"2024-09-12T17:30:50.225695+0000","last_clean":"2024-09-12T17:30:50.225695+0000","last_became_active":"2024-09-12T17:27:42.435928+0000","last_became_peered":"2024-09-12T17:27:42.435928+0000","last_unstale":"2024-09-12T17:30:50.225695+0000","last_undegraded":"2024-09-12T17:30:50.225695+0000","last_fullsized":"2024-09-12T17:30:50.225695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:08.170045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.889394+0000","last_change":"2024-09-12T17:27:40.420567+0000","last_active":"2024-09-12T17:30:49.889394+0000","last_peered":"2024-09-12T17:30:49.889394+0000","last_clean":"2024-09-12T17:30:49.889394+0000","last_became_active":"2024-09-12T17:27:40.419936+0000","last_became_peered":"2024-09-12T17:27:40.419936+0000","last_unstale":"2024-09-12T17:30:49.889394+0000","last_undegraded":"2024-09-12T17:30:49.889394+0000","last_fullsized":"2024-09-12T17:30:49.889394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:49.941918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"31'5","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:09.761218+0000","last_change":"2024-09-12T17:27:42.423827+0000","last_active":"2024-09-12T17:30:09.761218+0000","last_peered":"2024-09-12T17:30:09.761218+0000","last_clean":"2024-09-12T17:30:09.761218+0000","last_became_active":"2024-09-12T17:27:42.423569+0000","last_became_peered":"2024-09-12T17:27:42.423569+0000","last_unstale":"2024-09-12T17:30:09.761218+0000","last_undegraded":"2024-09-12T17:30:09.761218+0000","last_fullsized":"2024-09-12T17:30:09.761218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:15.384263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.821382+0000","last_change":"2024-09-12T17:27:40.428057+0000","last_active":"2024-09-12T17:28:21.821382+0000","last_peered":"2024-09-12T17:28:21.821382+0000","last_clean":"2024-09-12T17:28:21.821382+0000","last_became_active":"2024-09-12T17:27:40.426721+0000","last_became_peered":"2024-09-12T17:27:40.426721+0000","last_unstale":"2024-09-12T17:28:21.821382+0000","last_undegraded":"2024-09-12T17:28:21.821382+0000","last_fullsized":"2024-09-12T17:28:21.821382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:59.265443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"31'35","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.173308+0000","last_change":"2024-09-12T17:27:50.456507+0000","last_active":"2024-09-12T17:30:50.173308+0000","last_peered":"2024-09-12T17:30:50.173308+0000","last_clean":"2024-09-12T17:30:50.173308+0000","last_became_active":"2024-09-12T17:27:50.456184+0000","last_became_peered":"2024-09-12T17:27:50.456184+0000","last_unstale":"2024-09-12T17:30:50.173308+0000","last_undegraded":"2024-09-12T17:30:50.173308+0000","last_fullsized":"2024-09-12T17:30:50.173308+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:38.608944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"31'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.076531+0000","last_change":"2024-09-12T17:27:42.420958+0000","last_active":"2024-09-12T17:29:49.076531+0000","last_peered":"2024-09-12T17:29:49.076531+0000","last_clean":"2024-09-12T17:29:49.076531+0000","last_became_active":"2024-09-12T17:27:42.420666+0000","last_became_peered":"2024-09-12T17:27:42.420666+0000","last_unstale":"2024-09-12T17:29:49.076531+0000","last_undegraded":"2024-09-12T17:29:49.076531+0000","last_fullsized":"2024-09-12T17:29:49.076531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:15.830207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464196+0000","last_change":"2024-09-12T17:27:40.433530+0000","last_active":"2024-09-12T17:28:21.464196+0000","last_peered":"2024-09-12T17:28:21.464196+0000","last_clean":"2024-09-12T17:28:21.464196+0000","last_became_active":"2024-09-12T17:27:40.433044+0000","last_became_peered":"2024-09-12T17:27:40.433044+0000","last_unstale":"2024-09-12T17:28:21.464196+0000","last_undegraded":"2024-09-12T17:28:21.464196+0000","last_fullsized":"2024-09-12T17:28:21.464196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:34.927105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.473141+0000","last_change":"2024-09-12T17:28:21.472409+0000","last_active":"2024-09-12T17:28:21.473141+0000","last_peered":"2024-09-12T17:28:21.473141+0000","last_clean":"2024-09-12T17:28:21.473141+0000","last_became_active":"2024-09-12T17:28:21.472106+0000","last_became_peered":"2024-09-12T17:28:21.472106+0000","last_unstale":"2024-09-12T17:28:21.473141+0000","last_undegraded":"2024-09-12T17:28:21.473141+0000","last_fullsized":"2024-09-12T17:28:21.473141+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:56.281239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"31'30","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.596107+0000","last_change":"2024-09-12T17:27:46.442394+0000","last_active":"2024-09-12T17:29:47.596107+0000","last_peered":"2024-09-12T17:29:47.596107+0000","last_clean":"2024-09-12T17:29:47.596107+0000","last_became_active":"2024-09-12T17:27:46.441891+0000","last_became_peered":"2024-09-12T17:27:46.441891+0000","last_unstale":"2024-09-12T17:29:47.596107+0000","last_undegraded":"2024-09-12T17:29:47.596107+0000","last_fullsized":"2024-09-12T17:29:47.596107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:29.351398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470059+0000","last_change":"2024-09-12T17:27:48.448380+0000","last_active":"2024-09-12T17:28:21.470059+0000","last_peered":"2024-09-12T17:28:21.470059+0000","last_clean":"2024-09-12T17:28:21.470059+0000","last_became_active":"2024-09-12T17:27:48.448078+0000","last_became_peered":"2024-09-12T17:27:48.448078+0000","last_unstale":"2024-09-12T17:28:21.470059+0000","last_undegraded":"2024-09-12T17:28:21.470059+0000","last_fullsized":"2024-09-12T17:28:21.470059+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:32.578727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"31'7","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:05.200007+0000","last_change":"2024-09-12T17:27:50.457351+0000","last_active":"2024-09-12T17:29:05.200007+0000","last_peered":"2024-09-12T17:29:05.200007+0000","last_clean":"2024-09-12T17:29:05.200007+0000","last_became_active":"2024-09-12T17:27:50.457037+0000","last_became_peered":"2024-09-12T17:27:50.457037+0000","last_unstale":"2024-09-12T17:29:05.200007+0000","last_undegraded":"2024-09-12T17:29:05.200007+0000","last_fullsized":"2024-09-12T17:29:05.200007+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:28.456215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465641+0000","last_change":"2024-09-12T17:27:42.428129+0000","last_active":"2024-09-12T17:28:21.465641+0000","last_peered":"2024-09-12T17:28:21.465641+0000","last_clean":"2024-09-12T17:28:21.465641+0000","last_became_active":"2024-09-12T17:27:42.427872+0000","last_became_peered":"2024-09-12T17:27:42.427872+0000","last_unstale":"2024-09-12T17:28:21.465641+0000","last_undegraded":"2024-09-12T17:28:21.465641+0000","last_fullsized":"2024-09-12T17:28:21.465641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:27.694207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468076+0000","last_change":"2024-09-12T17:27:40.431296+0000","last_active":"2024-09-12T17:28:21.468076+0000","last_peered":"2024-09-12T17:28:21.468076+0000","last_clean":"2024-09-12T17:28:21.468076+0000","last_became_active":"2024-09-12T17:27:40.430969+0000","last_became_peered":"2024-09-12T17:27:40.430969+0000","last_unstale":"2024-09-12T17:28:21.468076+0000","last_undegraded":"2024-09-12T17:28:21.468076+0000","last_fullsized":"2024-09-12T17:28:21.468076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:08.250935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.472166+0000","last_change":"2024-09-12T17:27:44.427938+0000","last_active":"2024-09-12T17:28:21.472166+0000","last_peered":"2024-09-12T17:28:21.472166+0000","last_clean":"2024-09-12T17:28:21.472166+0000","last_became_active":"2024-09-12T17:27:44.427560+0000","last_became_peered":"2024-09-12T17:27:44.427560+0000","last_unstale":"2024-09-12T17:28:21.472166+0000","last_undegraded":"2024-09-12T17:28:21.472166+0000","last_fullsized":"2024-09-12T17:28:21.472166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:08.271249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"29'6","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470141+0000","last_change":"2024-09-12T17:27:46.438703+0000","last_active":"2024-09-12T17:28:21.470141+0000","last_peered":"2024-09-12T17:28:21.470141+0000","last_clean":"2024-09-12T17:28:21.470141+0000","last_became_active":"2024-09-12T17:27:46.436065+0000","last_became_peered":"2024-09-12T17:27:46.436065+0000","last_unstale":"2024-09-12T17:28:21.470141+0000","last_undegraded":"2024-09-12T17:28:21.470141+0000","last_fullsized":"2024-09-12T17:28:21.470141+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:52.392850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466101+0000","last_change":"2024-09-12T17:27:48.441701+0000","last_active":"2024-09-12T17:28:21.466101+0000","last_peered":"2024-09-12T17:28:21.466101+0000","last_clean":"2024-09-12T17:28:21.466101+0000","last_became_active":"2024-09-12T17:27:48.441192+0000","last_became_peered":"2024-09-12T17:27:48.441192+0000","last_unstale":"2024-09-12T17:28:21.466101+0000","last_undegraded":"2024-09-12T17:28:21.466101+0000","last_fullsized":"2024-09-12T17:28:21.466101+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:52.274187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"29'2","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470752+0000","last_change":"2024-09-12T17:27:50.451886+0000","last_active":"2024-09-12T17:28:21.470752+0000","last_peered":"2024-09-12T17:28:21.470752+0000","last_clean":"2024-09-12T17:28:21.470752+0000","last_became_active":"2024-09-12T17:27:50.451589+0000","last_became_peered":"2024-09-12T17:27:50.451589+0000","last_unstale":"2024-09-12T17:28:21.470752+0000","last_undegraded":"2024-09-12T17:28:21.470752+0000","last_fullsized":"2024-09-12T17:28:21.470752+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:53.513569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"31'8","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:22.319420+0000","last_change":"2024-09-12T17:27:42.426651+0000","last_active":"2024-09-12T17:28:22.319420+0000","last_peered":"2024-09-12T17:28:22.319420+0000","last_clean":"2024-09-12T17:28:22.319420+0000","last_became_active":"2024-09-12T17:27:42.426402+0000","last_became_peered":"2024-09-12T17:27:42.426402+0000","last_unstale":"2024-09-12T17:28:22.319420+0000","last_undegraded":"2024-09-12T17:28:22.319420+0000","last_fullsized":"2024-09-12T17:28:22.319420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:24.998663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.032605+0000","last_change":"2024-09-12T17:27:40.428134+0000","last_active":"2024-09-12T17:29:49.032605+0000","last_peered":"2024-09-12T17:29:49.032605+0000","last_clean":"2024-09-12T17:29:49.032605+0000","last_became_active":"2024-09-12T17:27:40.427860+0000","last_became_peered":"2024-09-12T17:27:40.427860+0000","last_unstale":"2024-09-12T17:29:49.032605+0000","last_undegraded":"2024-09-12T17:29:49.032605+0000","last_fullsized":"2024-09-12T17:29:49.032605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:15.255295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.474373+0000","last_change":"2024-09-12T17:27:44.431340+0000","last_active":"2024-09-12T17:28:21.474373+0000","last_peered":"2024-09-12T17:28:21.474373+0000","last_clean":"2024-09-12T17:28:21.474373+0000","last_became_active":"2024-09-12T17:27:44.430879+0000","last_became_peered":"2024-09-12T17:27:44.430879+0000","last_unstale":"2024-09-12T17:28:21.474373+0000","last_undegraded":"2024-09-12T17:28:21.474373+0000","last_fullsized":"2024-09-12T17:28:21.474373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:31.240889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"29'10","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.467842+0000","last_change":"2024-09-12T17:27:46.440472+0000","last_active":"2024-09-12T17:28:21.467842+0000","last_peered":"2024-09-12T17:28:21.467842+0000","last_clean":"2024-09-12T17:28:21.467842+0000","last_became_active":"2024-09-12T17:27:46.440203+0000","last_became_peered":"2024-09-12T17:27:46.440203+0000","last_unstale":"2024-09-12T17:28:21.467842+0000","last_undegraded":"2024-09-12T17:28:21.467842+0000","last_fullsized":"2024-09-12T17:28:21.467842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:58.292808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"31'282","reported_seq":405,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.511610+0000","last_change":"2024-09-12T17:27:48.451526+0000","last_active":"2024-09-12T17:30:49.511610+0000","last_peered":"2024-09-12T17:30:49.511610+0000","last_clean":"2024-09-12T17:30:49.511610+0000","last_became_active":"2024-09-12T17:27:48.450897+0000","last_became_peered":"2024-09-12T17:27:48.450897+0000","last_unstale":"2024-09-12T17:30:49.511610+0000","last_undegraded":"2024-09-12T17:30:49.511610+0000","last_fullsized":"2024-09-12T17:30:49.511610+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:24.867772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468002+0000","last_change":"2024-09-12T17:27:50.456983+0000","last_active":"2024-09-12T17:28:21.468002+0000","last_peered":"2024-09-12T17:28:21.468002+0000","last_clean":"2024-09-12T17:28:21.468002+0000","last_became_active":"2024-09-12T17:27:50.456376+0000","last_became_peered":"2024-09-12T17:27:50.456376+0000","last_unstale":"2024-09-12T17:28:21.468002+0000","last_undegraded":"2024-09-12T17:28:21.468002+0000","last_fullsized":"2024-09-12T17:28:21.468002+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:07.847747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"31'12","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.926558+0000","last_change":"2024-09-12T17:27:42.426373+0000","last_active":"2024-09-12T17:30:49.926558+0000","last_peered":"2024-09-12T17:30:49.926558+0000","last_clean":"2024-09-12T17:30:49.926558+0000","last_became_active":"2024-09-12T17:27:42.426060+0000","last_became_peered":"2024-09-12T17:27:42.426060+0000","last_unstale":"2024-09-12T17:30:49.926558+0000","last_undegraded":"2024-09-12T17:30:49.926558+0000","last_fullsized":"2024-09-12T17:30:49.926558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:54.699865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468564+0000","last_change":"2024-09-12T17:27:40.423578+0000","last_active":"2024-09-12T17:28:21.468564+0000","last_peered":"2024-09-12T17:28:21.468564+0000","last_clean":"2024-09-12T17:28:21.468564+0000","last_became_active":"2024-09-12T17:27:40.415702+0000","last_became_peered":"2024-09-12T17:27:40.415702+0000","last_unstale":"2024-09-12T17:28:21.468564+0000","last_undegraded":"2024-09-12T17:28:21.468564+0000","last_fullsized":"2024-09-12T17:28:21.468564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:05.858479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465273+0000","last_change":"2024-09-12T17:27:44.428855+0000","last_active":"2024-09-12T17:28:21.465273+0000","last_peered":"2024-09-12T17:28:21.465273+0000","last_clean":"2024-09-12T17:28:21.465273+0000","last_became_active":"2024-09-12T17:27:44.428526+0000","last_became_peered":"2024-09-12T17:27:44.428526+0000","last_unstale":"2024-09-12T17:28:21.465273+0000","last_undegraded":"2024-09-12T17:28:21.465273+0000","last_fullsized":"2024-09-12T17:28:21.465273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:22.407461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"31'30","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.590773+0000","last_change":"2024-09-12T17:27:46.441041+0000","last_active":"2024-09-12T17:29:47.590773+0000","last_peered":"2024-09-12T17:29:47.590773+0000","last_clean":"2024-09-12T17:29:47.590773+0000","last_became_active":"2024-09-12T17:27:46.440765+0000","last_became_peered":"2024-09-12T17:27:46.440765+0000","last_unstale":"2024-09-12T17:29:47.590773+0000","last_undegraded":"2024-09-12T17:29:47.590773+0000","last_fullsized":"2024-09-12T17:29:47.590773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:14.176389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"31'282","reported_seq":436,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.230811+0000","last_change":"2024-09-12T17:27:48.440009+0000","last_active":"2024-09-12T17:30:50.230811+0000","last_peered":"2024-09-12T17:30:50.230811+0000","last_clean":"2024-09-12T17:30:50.230811+0000","last_became_active":"2024-09-12T17:27:48.439642+0000","last_became_peered":"2024-09-12T17:27:48.439642+0000","last_unstale":"2024-09-12T17:30:50.230811+0000","last_undegraded":"2024-09-12T17:30:50.230811+0000","last_fullsized":"2024-09-12T17:30:50.230811+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:06.242670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"31'12","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.225652+0000","last_change":"2024-09-12T17:27:42.428634+0000","last_active":"2024-09-12T17:30:50.225652+0000","last_peered":"2024-09-12T17:30:50.225652+0000","last_clean":"2024-09-12T17:30:50.225652+0000","last_became_active":"2024-09-12T17:27:42.427990+0000","last_became_peered":"2024-09-12T17:27:42.427990+0000","last_unstale":"2024-09-12T17:30:50.225652+0000","last_undegraded":"2024-09-12T17:30:50.225652+0000","last_fullsized":"2024-09-12T17:30:50.225652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:27:19.215981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"29'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468356+0000","last_change":"2024-09-12T17:27:40.429060+0000","last_active":"2024-09-12T17:28:21.468356+0000","last_peered":"2024-09-12T17:28:21.468356+0000","last_clean":"2024-09-12T17:28:21.468356+0000","last_became_active":"2024-09-12T17:27:40.428462+0000","last_became_peered":"2024-09-12T17:27:40.428462+0000","last_unstale":"2024-09-12T17:28:21.468356+0000","last_undegraded":"2024-09-12T17:28:21.468356+0000","last_fullsized":"2024-09-12T17:28:21.468356+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:45.872253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468175+0000","last_change":"2024-09-12T17:27:44.433155+0000","last_active":"2024-09-12T17:28:21.468175+0000","last_peered":"2024-09-12T17:28:21.468175+0000","last_clean":"2024-09-12T17:28:21.468175+0000","last_became_active":"2024-09-12T17:27:44.431911+0000","last_became_peered":"2024-09-12T17:27:44.431911+0000","last_unstale":"2024-09-12T17:28:21.468175+0000","last_undegraded":"2024-09-12T17:28:21.468175+0000","last_fullsized":"2024-09-12T17:28:21.468175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:16.971114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"31'41","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.599915+0000","last_change":"2024-09-12T17:27:46.439466+0000","last_active":"2024-09-12T17:29:47.599915+0000","last_peered":"2024-09-12T17:29:47.599915+0000","last_clean":"2024-09-12T17:29:47.599915+0000","last_became_active":"2024-09-12T17:27:46.439188+0000","last_became_peered":"2024-09-12T17:27:46.439188+0000","last_unstale":"2024-09-12T17:29:47.599915+0000","last_undegraded":"2024-09-12T17:29:47.599915+0000","last_fullsized":"2024-09-12T17:29:47.599915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:25.881248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471714+0000","last_change":"2024-09-12T17:27:48.441917+0000","last_active":"2024-09-12T17:28:21.471714+0000","last_peered":"2024-09-12T17:28:21.471714+0000","last_clean":"2024-09-12T17:28:21.471714+0000","last_became_active":"2024-09-12T17:27:48.441618+0000","last_became_peered":"2024-09-12T17:27:48.441618+0000","last_unstale":"2024-09-12T17:28:21.471714+0000","last_undegraded":"2024-09-12T17:28:21.471714+0000","last_fullsized":"2024-09-12T17:28:21.471714+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:17.256348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"31'7","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.198792+0000","last_change":"2024-09-12T17:27:50.457616+0000","last_active":"2024-09-12T17:30:50.198792+0000","last_peered":"2024-09-12T17:30:50.198792+0000","last_clean":"2024-09-12T17:30:50.198792+0000","last_became_active":"2024-09-12T17:27:50.457350+0000","last_became_peered":"2024-09-12T17:27:50.457350+0000","last_unstale":"2024-09-12T17:30:50.198792+0000","last_undegraded":"2024-09-12T17:30:50.198792+0000","last_fullsized":"2024-09-12T17:30:50.198792+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:39.806321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"31'20","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.148556+0000","last_change":"2024-09-12T17:27:42.424787+0000","last_active":"2024-09-12T17:30:50.148556+0000","last_peered":"2024-09-12T17:30:50.148556+0000","last_clean":"2024-09-12T17:30:50.148556+0000","last_became_active":"2024-09-12T17:27:42.424268+0000","last_became_peered":"2024-09-12T17:27:42.424268+0000","last_unstale":"2024-09-12T17:30:50.148556+0000","last_undegraded":"2024-09-12T17:30:50.148556+0000","last_fullsized":"2024-09-12T17:30:50.148556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:10.726972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":75,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469727+0000","last_change":"2024-09-12T17:27:40.427959+0000","last_active":"2024-09-12T17:28:21.469727+0000","last_peered":"2024-09-12T17:28:21.469727+0000","last_clean":"2024-09-12T17:28:21.469727+0000","last_became_active":"2024-09-12T17:27:40.427677+0000","last_became_peered":"2024-09-12T17:27:40.427677+0000","last_unstale":"2024-09-12T17:28:21.469727+0000","last_undegraded":"2024-09-12T17:28:21.469727+0000","last_fullsized":"2024-09-12T17:28:21.469727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:13.997279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471294+0000","last_change":"2024-09-12T17:27:44.434751+0000","last_active":"2024-09-12T17:28:21.471294+0000","last_peered":"2024-09-12T17:28:21.471294+0000","last_clean":"2024-09-12T17:28:21.471294+0000","last_became_active":"2024-09-12T17:27:44.434433+0000","last_became_peered":"2024-09-12T17:27:44.434433+0000","last_unstale":"2024-09-12T17:28:21.471294+0000","last_undegraded":"2024-09-12T17:28:21.471294+0000","last_fullsized":"2024-09-12T17:28:21.471294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:00.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"31'30","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.580910+0000","last_change":"2024-09-12T17:27:46.442854+0000","last_active":"2024-09-12T17:29:47.580910+0000","last_peered":"2024-09-12T17:29:47.580910+0000","last_clean":"2024-09-12T17:29:47.580910+0000","last_became_active":"2024-09-12T17:27:46.442572+0000","last_became_peered":"2024-09-12T17:27:46.442572+0000","last_unstale":"2024-09-12T17:29:47.580910+0000","last_undegraded":"2024-09-12T17:29:47.580910+0000","last_fullsized":"2024-09-12T17:29:47.580910+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:49.755366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470885+0000","last_change":"2024-09-12T17:27:48.445793+0000","last_active":"2024-09-12T17:28:21.470885+0000","last_peered":"2024-09-12T17:28:21.470885+0000","last_clean":"2024-09-12T17:28:21.470885+0000","last_became_active":"2024-09-12T17:27:48.445502+0000","last_became_peered":"2024-09-12T17:27:48.445502+0000","last_unstale":"2024-09-12T17:28:21.470885+0000","last_undegraded":"2024-09-12T17:28:21.470885+0000","last_fullsized":"2024-09-12T17:28:21.470885+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:17.142197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"31'9","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.283385+0000","last_change":"2024-09-12T17:27:50.458007+0000","last_active":"2024-09-12T17:30:50.283385+0000","last_peered":"2024-09-12T17:30:50.283385+0000","last_clean":"2024-09-12T17:30:50.283385+0000","last_became_active":"2024-09-12T17:27:50.457691+0000","last_became_peered":"2024-09-12T17:27:50.457691+0000","last_unstale":"2024-09-12T17:30:50.283385+0000","last_undegraded":"2024-09-12T17:30:50.283385+0000","last_fullsized":"2024-09-12T17:30:50.283385+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:51.065237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":23,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"31'7","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.203773+0000","last_change":"2024-09-12T17:27:42.436839+0000","last_active":"2024-09-12T17:30:50.203773+0000","last_peered":"2024-09-12T17:30:50.203773+0000","last_clean":"2024-09-12T17:30:50.203773+0000","last_became_active":"2024-09-12T17:27:42.436517+0000","last_became_peered":"2024-09-12T17:27:42.436517+0000","last_unstale":"2024-09-12T17:30:50.203773+0000","last_undegraded":"2024-09-12T17:30:50.203773+0000","last_fullsized":"2024-09-12T17:30:50.203773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:56.329169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465301+0000","last_change":"2024-09-12T17:27:40.429917+0000","last_active":"2024-09-12T17:28:21.465301+0000","last_peered":"2024-09-12T17:28:21.465301+0000","last_clean":"2024-09-12T17:28:21.465301+0000","last_became_active":"2024-09-12T17:27:40.429663+0000","last_became_peered":"2024-09-12T17:27:40.429663+0000","last_unstale":"2024-09-12T17:28:21.465301+0000","last_undegraded":"2024-09-12T17:28:21.465301+0000","last_fullsized":"2024-09-12T17:28:21.465301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:01.771644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.473204+0000","last_change":"2024-09-12T17:27:44.431117+0000","last_active":"2024-09-12T17:28:21.473204+0000","last_peered":"2024-09-12T17:28:21.473204+0000","last_clean":"2024-09-12T17:28:21.473204+0000","last_became_active":"2024-09-12T17:27:44.430772+0000","last_became_peered":"2024-09-12T17:27:44.430772+0000","last_unstale":"2024-09-12T17:28:21.473204+0000","last_undegraded":"2024-09-12T17:28:21.473204+0000","last_fullsized":"2024-09-12T17:28:21.473204+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:11.871540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"31'37","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.601873+0000","last_change":"2024-09-12T17:27:46.444540+0000","last_active":"2024-09-12T17:29:47.601873+0000","last_peered":"2024-09-12T17:29:47.601873+0000","last_clean":"2024-09-12T17:29:47.601873+0000","last_became_active":"2024-09-12T17:27:46.444206+0000","last_became_peered":"2024-09-12T17:27:46.444206+0000","last_unstale":"2024-09-12T17:29:47.601873+0000","last_undegraded":"2024-09-12T17:29:47.601873+0000","last_fullsized":"2024-09-12T17:29:47.601873+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:06.613276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"31'282","reported_seq":398,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.354623+0000","last_change":"2024-09-12T17:27:48.448090+0000","last_active":"2024-09-12T17:30:50.354623+0000","last_peered":"2024-09-12T17:30:50.354623+0000","last_clean":"2024-09-12T17:30:50.354623+0000","last_became_active":"2024-09-12T17:27:48.447724+0000","last_became_peered":"2024-09-12T17:27:48.447724+0000","last_unstale":"2024-09-12T17:30:50.354623+0000","last_undegraded":"2024-09-12T17:30:50.354623+0000","last_fullsized":"2024-09-12T17:30:50.354623+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:37.632389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"31'4","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.183333+0000","last_change":"2024-09-12T17:27:50.451958+0000","last_active":"2024-09-12T17:30:50.183333+0000","last_peered":"2024-09-12T17:30:50.183333+0000","last_clean":"2024-09-12T17:30:50.183333+0000","last_became_active":"2024-09-12T17:27:50.451716+0000","last_became_peered":"2024-09-12T17:27:50.451716+0000","last_unstale":"2024-09-12T17:30:50.183333+0000","last_undegraded":"2024-09-12T17:30:50.183333+0000","last_fullsized":"2024-09-12T17:30:50.183333+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:28.075990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"31'4","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.018397+0000","last_change":"2024-09-12T17:27:42.429925+0000","last_active":"2024-09-12T17:30:50.018397+0000","last_peered":"2024-09-12T17:30:50.018397+0000","last_clean":"2024-09-12T17:30:50.018397+0000","last_became_active":"2024-09-12T17:27:42.429624+0000","last_became_peered":"2024-09-12T17:27:42.429624+0000","last_unstale":"2024-09-12T17:30:50.018397+0000","last_undegraded":"2024-09-12T17:30:50.018397+0000","last_fullsized":"2024-09-12T17:30:50.018397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:10.865332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464374+0000","last_change":"2024-09-12T17:27:40.424281+0000","last_active":"2024-09-12T17:28:21.464374+0000","last_peered":"2024-09-12T17:28:21.464374+0000","last_clean":"2024-09-12T17:28:21.464374+0000","last_became_active":"2024-09-12T17:27:40.423291+0000","last_became_peered":"2024-09-12T17:27:40.423291+0000","last_unstale":"2024-09-12T17:28:21.464374+0000","last_undegraded":"2024-09-12T17:28:21.464374+0000","last_fullsized":"2024-09-12T17:28:21.464374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:45.581275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471823+0000","last_change":"2024-09-12T17:27:44.430889+0000","last_active":"2024-09-12T17:28:21.471823+0000","last_peered":"2024-09-12T17:28:21.471823+0000","last_clean":"2024-09-12T17:28:21.471823+0000","last_became_active":"2024-09-12T17:27:44.430549+0000","last_became_peered":"2024-09-12T17:27:44.430549+0000","last_unstale":"2024-09-12T17:28:21.471823+0000","last_undegraded":"2024-09-12T17:28:21.471823+0000","last_fullsized":"2024-09-12T17:28:21.471823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:53.357220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"31'55","reported_seq":112,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:55.766229+0000","last_change":"2024-09-12T17:27:46.441393+0000","last_active":"2024-09-12T17:29:55.766229+0000","last_peered":"2024-09-12T17:29:55.766229+0000","last_clean":"2024-09-12T17:29:55.766229+0000","last_became_active":"2024-09-12T17:27:46.440805+0000","last_became_peered":"2024-09-12T17:27:46.440805+0000","last_unstale":"2024-09-12T17:29:55.766229+0000","last_undegraded":"2024-09-12T17:29:55.766229+0000","last_fullsized":"2024-09-12T17:29:55.766229+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:26.523623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5916,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":51,"num_read_kb":42,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471161+0000","last_change":"2024-09-12T17:27:48.443214+0000","last_active":"2024-09-12T17:28:21.471161+0000","last_peered":"2024-09-12T17:28:21.471161+0000","last_clean":"2024-09-12T17:28:21.471161+0000","last_became_active":"2024-09-12T17:27:48.442880+0000","last_became_peered":"2024-09-12T17:27:48.442880+0000","last_unstale":"2024-09-12T17:28:21.471161+0000","last_undegraded":"2024-09-12T17:28:21.471161+0000","last_fullsized":"2024-09-12T17:28:21.471161+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:45.787562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"31'20","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.331059+0000","last_change":"2024-09-12T17:27:50.454666+0000","last_active":"2024-09-12T17:30:50.331059+0000","last_peered":"2024-09-12T17:30:50.331059+0000","last_clean":"2024-09-12T17:30:50.331059+0000","last_became_active":"2024-09-12T17:27:50.454410+0000","last_became_peered":"2024-09-12T17:27:50.454410+0000","last_unstale":"2024-09-12T17:30:50.331059+0000","last_undegraded":"2024-09-12T17:30:50.331059+0000","last_fullsized":"2024-09-12T17:30:50.331059+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:12:29.329426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"31'10","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.225780+0000","last_change":"2024-09-12T17:27:42.436173+0000","last_active":"2024-09-12T17:30:50.225780+0000","last_peered":"2024-09-12T17:30:50.225780+0000","last_clean":"2024-09-12T17:30:50.225780+0000","last_became_active":"2024-09-12T17:27:42.435913+0000","last_became_peered":"2024-09-12T17:27:42.435913+0000","last_unstale":"2024-09-12T17:30:50.225780+0000","last_undegraded":"2024-09-12T17:30:50.225780+0000","last_fullsized":"2024-09-12T17:30:50.225780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:49.886133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.472093+0000","last_change":"2024-09-12T17:27:40.416125+0000","last_active":"2024-09-12T17:28:21.472093+0000","last_peered":"2024-09-12T17:28:21.472093+0000","last_clean":"2024-09-12T17:28:21.472093+0000","last_became_active":"2024-09-12T17:27:40.415703+0000","last_became_peered":"2024-09-12T17:27:40.415703+0000","last_unstale":"2024-09-12T17:28:21.472093+0000","last_undegraded":"2024-09-12T17:28:21.472093+0000","last_fullsized":"2024-09-12T17:28:21.472093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:40.086345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466635+0000","last_change":"2024-09-12T17:27:44.432984+0000","last_active":"2024-09-12T17:28:21.466635+0000","last_peered":"2024-09-12T17:28:21.466635+0000","last_clean":"2024-09-12T17:28:21.466635+0000","last_became_active":"2024-09-12T17:27:44.432588+0000","last_became_peered":"2024-09-12T17:27:44.432588+0000","last_unstale":"2024-09-12T17:28:21.466635+0000","last_undegraded":"2024-09-12T17:28:21.466635+0000","last_fullsized":"2024-09-12T17:28:21.466635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:09.951474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"31'32","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.584787+0000","last_change":"2024-09-12T17:27:46.432654+0000","last_active":"2024-09-12T17:29:47.584787+0000","last_peered":"2024-09-12T17:29:47.584787+0000","last_clean":"2024-09-12T17:29:47.584787+0000","last_became_active":"2024-09-12T17:27:46.432354+0000","last_became_peered":"2024-09-12T17:27:46.432354+0000","last_unstale":"2024-09-12T17:29:47.584787+0000","last_undegraded":"2024-09-12T17:29:47.584787+0000","last_fullsized":"2024-09-12T17:29:47.584787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:14.062258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466117+0000","last_change":"2024-09-12T17:27:48.451776+0000","last_active":"2024-09-12T17:28:21.466117+0000","last_peered":"2024-09-12T17:28:21.466117+0000","last_clean":"2024-09-12T17:28:21.466117+0000","last_became_active":"2024-09-12T17:27:48.451510+0000","last_became_peered":"2024-09-12T17:27:48.451510+0000","last_unstale":"2024-09-12T17:28:21.466117+0000","last_undegraded":"2024-09-12T17:28:21.466117+0000","last_fullsized":"2024-09-12T17:28:21.466117+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:01.787546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"31'7","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:50.765214+0000","last_change":"2024-09-12T17:27:50.455419+0000","last_active":"2024-09-12T17:29:50.765214+0000","last_peered":"2024-09-12T17:29:50.765214+0000","last_clean":"2024-09-12T17:29:50.765214+0000","last_became_active":"2024-09-12T17:27:50.454890+0000","last_became_peered":"2024-09-12T17:27:50.454890+0000","last_unstale":"2024-09-12T17:29:50.765214+0000","last_undegraded":"2024-09-12T17:29:50.765214+0000","last_fullsized":"2024-09-12T17:29:50.765214+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:50.422624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"31'8","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.196877+0000","last_change":"2024-09-12T17:27:42.440511+0000","last_active":"2024-09-12T17:30:50.196877+0000","last_peered":"2024-09-12T17:30:50.196877+0000","last_clean":"2024-09-12T17:30:50.196877+0000","last_became_active":"2024-09-12T17:27:42.440204+0000","last_became_peered":"2024-09-12T17:27:42.440204+0000","last_unstale":"2024-09-12T17:30:50.196877+0000","last_undegraded":"2024-09-12T17:30:50.196877+0000","last_fullsized":"2024-09-12T17:30:50.196877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:11.628797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464148+0000","last_change":"2024-09-12T17:27:40.428533+0000","last_active":"2024-09-12T17:28:21.464148+0000","last_peered":"2024-09-12T17:28:21.464148+0000","last_clean":"2024-09-12T17:28:21.464148+0000","last_became_active":"2024-09-12T17:27:40.428232+0000","last_became_peered":"2024-09-12T17:27:40.428232+0000","last_unstale":"2024-09-12T17:28:21.464148+0000","last_undegraded":"2024-09-12T17:28:21.464148+0000","last_fullsized":"2024-09-12T17:28:21.464148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:38.394799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.473721+0000","last_change":"2024-09-12T17:27:44.432569+0000","last_active":"2024-09-12T17:28:21.473721+0000","last_peered":"2024-09-12T17:28:21.473721+0000","last_clean":"2024-09-12T17:28:21.473721+0000","last_became_active":"2024-09-12T17:27:44.432211+0000","last_became_peered":"2024-09-12T17:27:44.432211+0000","last_unstale":"2024-09-12T17:28:21.473721+0000","last_undegraded":"2024-09-12T17:28:21.473721+0000","last_fullsized":"2024-09-12T17:28:21.473721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:13.176204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"31'36","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.610036+0000","last_change":"2024-09-12T17:27:46.433953+0000","last_active":"2024-09-12T17:29:47.610036+0000","last_peered":"2024-09-12T17:29:47.610036+0000","last_clean":"2024-09-12T17:29:47.610036+0000","last_became_active":"2024-09-12T17:27:46.433672+0000","last_became_peered":"2024-09-12T17:27:46.433672+0000","last_unstale":"2024-09-12T17:29:47.610036+0000","last_undegraded":"2024-09-12T17:29:47.610036+0000","last_fullsized":"2024-09-12T17:29:47.610036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:55.924502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"31'282","reported_seq":404,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.335012+0000","last_change":"2024-09-12T17:27:48.440623+0000","last_active":"2024-09-12T17:30:50.335012+0000","last_peered":"2024-09-12T17:30:50.335012+0000","last_clean":"2024-09-12T17:30:50.335012+0000","last_became_active":"2024-09-12T17:27:48.440335+0000","last_became_peered":"2024-09-12T17:27:48.440335+0000","last_unstale":"2024-09-12T17:30:50.335012+0000","last_undegraded":"2024-09-12T17:30:50.335012+0000","last_fullsized":"2024-09-12T17:30:50.335012+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:20.544074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"31'12","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:54.758294+0000","last_change":"2024-09-12T17:27:50.449089+0000","last_active":"2024-09-12T17:29:54.758294+0000","last_peered":"2024-09-12T17:29:54.758294+0000","last_clean":"2024-09-12T17:29:54.758294+0000","last_became_active":"2024-09-12T17:27:50.448680+0000","last_became_peered":"2024-09-12T17:27:50.448680+0000","last_unstale":"2024-09-12T17:29:54.758294+0000","last_undegraded":"2024-09-12T17:29:54.758294+0000","last_fullsized":"2024-09-12T17:29:54.758294+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:01.786654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.473949+0000","last_change":"2024-09-12T17:28:21.473062+0000","last_active":"2024-09-12T17:28:21.473949+0000","last_peered":"2024-09-12T17:28:21.473949+0000","last_clean":"2024-09-12T17:28:21.473949+0000","last_became_active":"2024-09-12T17:28:21.472744+0000","last_became_peered":"2024-09-12T17:28:21.472744+0000","last_unstale":"2024-09-12T17:28:21.473949+0000","last_undegraded":"2024-09-12T17:28:21.473949+0000","last_fullsized":"2024-09-12T17:28:21.473949+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:30.333530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.221504+0000","last_change":"2024-09-12T17:27:40.428769+0000","last_active":"2024-09-12T17:30:50.221504+0000","last_peered":"2024-09-12T17:30:50.221504+0000","last_clean":"2024-09-12T17:30:50.221504+0000","last_became_active":"2024-09-12T17:27:40.428512+0000","last_became_peered":"2024-09-12T17:27:40.428512+0000","last_unstale":"2024-09-12T17:30:50.221504+0000","last_undegraded":"2024-09-12T17:30:50.221504+0000","last_fullsized":"2024-09-12T17:30:50.221504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:45.757419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'3","reported_seq":414,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:48.725548+0000","last_change":"2024-09-12T17:27:44.430169+0000","last_active":"2024-09-12T17:29:48.725548+0000","last_peered":"2024-09-12T17:29:48.725548+0000","last_clean":"2024-09-12T17:29:48.725548+0000","last_became_active":"2024-09-12T17:27:44.429844+0000","last_became_peered":"2024-09-12T17:27:44.429844+0000","last_unstale":"2024-09-12T17:29:48.725548+0000","last_undegraded":"2024-09-12T17:29:48.725548+0000","last_fullsized":"2024-09-12T17:29:48.725548+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:19.512968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464478+0000","last_change":"2024-09-12T17:27:46.439449+0000","last_active":"2024-09-12T17:28:21.464478+0000","last_peered":"2024-09-12T17:28:21.464478+0000","last_clean":"2024-09-12T17:28:21.464478+0000","last_became_active":"2024-09-12T17:27:46.439153+0000","last_became_peered":"2024-09-12T17:27:46.439153+0000","last_unstale":"2024-09-12T17:28:21.464478+0000","last_undegraded":"2024-09-12T17:28:21.464478+0000","last_fullsized":"2024-09-12T17:28:21.464478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:53.118909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"31'282","reported_seq":460,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.285437+0000","last_change":"2024-09-12T17:27:48.441400+0000","last_active":"2024-09-12T17:30:50.285437+0000","last_peered":"2024-09-12T17:30:50.285437+0000","last_clean":"2024-09-12T17:30:50.285437+0000","last_became_active":"2024-09-12T17:27:48.441024+0000","last_became_peered":"2024-09-12T17:27:48.441024+0000","last_unstale":"2024-09-12T17:30:50.285437+0000","last_undegraded":"2024-09-12T17:30:50.285437+0000","last_fullsized":"2024-09-12T17:30:50.285437+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:09.672456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'4","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:48.859981+0000","last_change":"2024-09-12T17:27:50.452031+0000","last_active":"2024-09-12T17:29:48.859981+0000","last_peered":"2024-09-12T17:29:48.859981+0000","last_clean":"2024-09-12T17:29:48.859981+0000","last_became_active":"2024-09-12T17:27:50.451743+0000","last_became_peered":"2024-09-12T17:27:50.451743+0000","last_unstale":"2024-09-12T17:29:48.859981+0000","last_undegraded":"2024-09-12T17:29:48.859981+0000","last_fullsized":"2024-09-12T17:29:48.859981+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:24:17.073385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470933+0000","last_change":"2024-09-12T17:27:42.438842+0000","last_active":"2024-09-12T17:28:21.470933+0000","last_peered":"2024-09-12T17:28:21.470933+0000","last_clean":"2024-09-12T17:28:21.470933+0000","last_became_active":"2024-09-12T17:27:42.438566+0000","last_became_peered":"2024-09-12T17:27:42.438566+0000","last_unstale":"2024-09-12T17:28:21.470933+0000","last_undegraded":"2024-09-12T17:28:21.470933+0000","last_fullsized":"2024-09-12T17:28:21.470933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:08.054821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"31'1","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:50.765235+0000","last_change":"2024-09-12T17:27:40.430157+0000","last_active":"2024-09-12T17:29:50.765235+0000","last_peered":"2024-09-12T17:29:50.765235+0000","last_clean":"2024-09-12T17:29:50.765235+0000","last_became_active":"2024-09-12T17:27:40.429902+0000","last_became_peered":"2024-09-12T17:27:40.429902+0000","last_unstale":"2024-09-12T17:29:50.765235+0000","last_undegraded":"2024-09-12T17:29:50.765235+0000","last_fullsized":"2024-09-12T17:29:50.765235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:03.993235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465147+0000","last_change":"2024-09-12T17:27:44.431499+0000","last_active":"2024-09-12T17:28:21.465147+0000","last_peered":"2024-09-12T17:28:21.465147+0000","last_clean":"2024-09-12T17:28:21.465147+0000","last_became_active":"2024-09-12T17:27:44.431180+0000","last_became_peered":"2024-09-12T17:27:44.431180+0000","last_unstale":"2024-09-12T17:28:21.465147+0000","last_undegraded":"2024-09-12T17:28:21.465147+0000","last_fullsized":"2024-09-12T17:28:21.465147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:36.937417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"31'40","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.597133+0000","last_change":"2024-09-12T17:27:46.431873+0000","last_active":"2024-09-12T17:29:47.597133+0000","last_peered":"2024-09-12T17:29:47.597133+0000","last_clean":"2024-09-12T17:29:47.597133+0000","last_became_active":"2024-09-12T17:27:46.431599+0000","last_became_peered":"2024-09-12T17:27:46.431599+0000","last_unstale":"2024-09-12T17:29:47.597133+0000","last_undegraded":"2024-09-12T17:29:47.597133+0000","last_fullsized":"2024-09-12T17:29:47.597133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:08.059866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":52,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.467064+0000","last_change":"2024-09-12T17:27:48.447644+0000","last_active":"2024-09-12T17:28:21.467064+0000","last_peered":"2024-09-12T17:28:21.467064+0000","last_clean":"2024-09-12T17:28:21.467064+0000","last_became_active":"2024-09-12T17:27:48.447331+0000","last_became_peered":"2024-09-12T17:27:48.447331+0000","last_unstale":"2024-09-12T17:28:21.467064+0000","last_undegraded":"2024-09-12T17:28:21.467064+0000","last_fullsized":"2024-09-12T17:28:21.467064+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:15.622749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"31'6","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.260811+0000","last_change":"2024-09-12T17:27:50.448120+0000","last_active":"2024-09-12T17:30:50.260811+0000","last_peered":"2024-09-12T17:30:50.260811+0000","last_clean":"2024-09-12T17:30:50.260811+0000","last_became_active":"2024-09-12T17:27:50.447855+0000","last_became_peered":"2024-09-12T17:27:50.447855+0000","last_unstale":"2024-09-12T17:30:50.260811+0000","last_undegraded":"2024-09-12T17:30:50.260811+0000","last_fullsized":"2024-09-12T17:30:50.260811+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:45:37.063333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"31'14","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.225785+0000","last_change":"2024-09-12T17:27:42.438563+0000","last_active":"2024-09-12T17:30:50.225785+0000","last_peered":"2024-09-12T17:30:50.225785+0000","last_clean":"2024-09-12T17:30:50.225785+0000","last_became_active":"2024-09-12T17:27:42.438270+0000","last_became_peered":"2024-09-12T17:27:42.438270+0000","last_unstale":"2024-09-12T17:30:50.225785+0000","last_undegraded":"2024-09-12T17:30:50.225785+0000","last_fullsized":"2024-09-12T17:30:50.225785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:24.762523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'72","reported_seq":142,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468423+0000","last_change":"2024-09-12T17:27:25.975511+0000","last_active":"2024-09-12T17:28:21.468423+0000","last_peered":"2024-09-12T17:28:21.468423+0000","last_clean":"2024-09-12T17:28:21.468423+0000","last_became_active":"2024-09-12T17:27:25.974522+0000","last_became_peered":"2024-09-12T17:27:25.974522+0000","last_unstale":"2024-09-12T17:28:21.468423+0000","last_undegraded":"2024-09-12T17:28:21.468423+0000","last_fullsized":"2024-09-12T17:28:21.468423+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:24.738801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:24.738801+0000","last_clean_scrub_stamp":"2024-09-12T17:27:24.738801+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:42.005302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464653+0000","last_change":"2024-09-12T17:27:34.770151+0000","last_active":"2024-09-12T17:28:21.464653+0000","last_peered":"2024-09-12T17:28:21.464653+0000","last_clean":"2024-09-12T17:28:21.464653+0000","last_became_active":"2024-09-12T17:27:32.760744+0000","last_became_peered":"2024-09-12T17:27:32.760744+0000","last_unstale":"2024-09-12T17:28:21.464653+0000","last_undegraded":"2024-09-12T17:28:21.464653+0000","last_fullsized":"2024-09-12T17:28:21.464653+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:22:57.115660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014241220000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463397+0000","last_change":"2024-09-12T17:27:40.429657+0000","last_active":"2024-09-12T17:28:21.463397+0000","last_peered":"2024-09-12T17:28:21.463397+0000","last_clean":"2024-09-12T17:28:21.463397+0000","last_became_active":"2024-09-12T17:27:40.428453+0000","last_became_peered":"2024-09-12T17:27:40.428453+0000","last_unstale":"2024-09-12T17:28:21.463397+0000","last_undegraded":"2024-09-12T17:28:21.463397+0000","last_fullsized":"2024-09-12T17:28:21.463397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:25.951429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469125+0000","last_change":"2024-09-12T17:27:44.432804+0000","last_active":"2024-09-12T17:28:21.469125+0000","last_peered":"2024-09-12T17:28:21.469125+0000","last_clean":"2024-09-12T17:28:21.469125+0000","last_became_active":"2024-09-12T17:27:44.432336+0000","last_became_peered":"2024-09-12T17:27:44.432336+0000","last_unstale":"2024-09-12T17:28:21.469125+0000","last_undegraded":"2024-09-12T17:28:21.469125+0000","last_fullsized":"2024-09-12T17:28:21.469125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:57.403402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"31'76","reported_seq":146,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.607996+0000","last_change":"2024-09-12T17:27:46.438090+0000","last_active":"2024-09-12T17:29:47.607996+0000","last_peered":"2024-09-12T17:29:47.607996+0000","last_clean":"2024-09-12T17:29:47.607996+0000","last_became_active":"2024-09-12T17:27:46.437771+0000","last_became_peered":"2024-09-12T17:27:46.437771+0000","last_unstale":"2024-09-12T17:29:47.607996+0000","last_undegraded":"2024-09-12T17:29:47.607996+0000","last_fullsized":"2024-09-12T17:29:47.607996+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:14.400029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.474144+0000","last_change":"2024-09-12T17:27:48.446270+0000","last_active":"2024-09-12T17:28:21.474144+0000","last_peered":"2024-09-12T17:28:21.474144+0000","last_clean":"2024-09-12T17:28:21.474144+0000","last_became_active":"2024-09-12T17:27:48.445970+0000","last_became_peered":"2024-09-12T17:27:48.445970+0000","last_unstale":"2024-09-12T17:28:21.474144+0000","last_undegraded":"2024-09-12T17:28:21.474144+0000","last_fullsized":"2024-09-12T17:28:21.474144+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:31.488140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"31'81","reported_seq":163,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.235627+0000","last_change":"2024-09-12T17:27:50.448666+0000","last_active":"2024-09-12T17:30:50.235627+0000","last_peered":"2024-09-12T17:30:50.235627+0000","last_clean":"2024-09-12T17:30:50.235627+0000","last_became_active":"2024-09-12T17:27:50.448189+0000","last_became_peered":"2024-09-12T17:27:50.448189+0000","last_unstale":"2024-09-12T17:30:50.235627+0000","last_undegraded":"2024-09-12T17:30:50.235627+0000","last_fullsized":"2024-09-12T17:30:50.235627+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:38.207685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":221,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465570+0000","last_change":"2024-09-12T17:27:42.429760+0000","last_active":"2024-09-12T17:28:21.465570+0000","last_peered":"2024-09-12T17:28:21.465570+0000","last_clean":"2024-09-12T17:28:21.465570+0000","last_became_active":"2024-09-12T17:27:42.429497+0000","last_became_peered":"2024-09-12T17:27:42.429497+0000","last_unstale":"2024-09-12T17:28:21.465570+0000","last_undegraded":"2024-09-12T17:28:21.465570+0000","last_fullsized":"2024-09-12T17:28:21.465570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:09.539390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.462953+0000","last_change":"2024-09-12T17:27:34.769202+0000","last_active":"2024-09-12T17:28:21.462953+0000","last_peered":"2024-09-12T17:28:21.462953+0000","last_clean":"2024-09-12T17:28:21.462953+0000","last_became_active":"2024-09-12T17:27:32.761687+0000","last_became_peered":"2024-09-12T17:27:32.761687+0000","last_unstale":"2024-09-12T17:28:21.462953+0000","last_undegraded":"2024-09-12T17:28:21.462953+0000","last_fullsized":"2024-09-12T17:28:21.462953+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:00.950082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056694099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471668+0000","last_change":"2024-09-12T17:27:40.418643+0000","last_active":"2024-09-12T17:28:21.471668+0000","last_peered":"2024-09-12T17:28:21.471668+0000","last_clean":"2024-09-12T17:28:21.471668+0000","last_became_active":"2024-09-12T17:27:40.418249+0000","last_became_peered":"2024-09-12T17:27:40.418249+0000","last_unstale":"2024-09-12T17:28:21.471668+0000","last_undegraded":"2024-09-12T17:28:21.471668+0000","last_fullsized":"2024-09-12T17:28:21.471668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:03:41.714055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468312+0000","last_change":"2024-09-12T17:27:44.427026+0000","last_active":"2024-09-12T17:28:21.468312+0000","last_peered":"2024-09-12T17:28:21.468312+0000","last_clean":"2024-09-12T17:28:21.468312+0000","last_became_active":"2024-09-12T17:27:44.426698+0000","last_became_peered":"2024-09-12T17:27:44.426698+0000","last_unstale":"2024-09-12T17:28:21.468312+0000","last_undegraded":"2024-09-12T17:28:21.468312+0000","last_fullsized":"2024-09-12T17:28:21.468312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:09.582440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"31'274","reported_seq":478,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.511697+0000","last_change":"2024-09-12T17:27:46.438678+0000","last_active":"2024-09-12T17:30:49.511697+0000","last_peered":"2024-09-12T17:30:49.511697+0000","last_clean":"2024-09-12T17:30:49.511697+0000","last_became_active":"2024-09-12T17:27:46.438381+0000","last_became_peered":"2024-09-12T17:27:46.438381+0000","last_unstale":"2024-09-12T17:30:49.511697+0000","last_undegraded":"2024-09-12T17:30:49.511697+0000","last_fullsized":"2024-09-12T17:30:49.511697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:10.399053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464394+0000","last_change":"2024-09-12T17:27:48.451345+0000","last_active":"2024-09-12T17:28:21.464394+0000","last_peered":"2024-09-12T17:28:21.464394+0000","last_clean":"2024-09-12T17:28:21.464394+0000","last_became_active":"2024-09-12T17:27:48.450775+0000","last_became_peered":"2024-09-12T17:27:48.450775+0000","last_unstale":"2024-09-12T17:28:21.464394+0000","last_undegraded":"2024-09-12T17:28:21.464394+0000","last_fullsized":"2024-09-12T17:28:21.464394+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:37.382330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"31'5","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.944535+0000","last_change":"2024-09-12T17:27:50.458209+0000","last_active":"2024-09-12T17:30:49.944535+0000","last_peered":"2024-09-12T17:30:49.944535+0000","last_clean":"2024-09-12T17:30:49.944535+0000","last_became_active":"2024-09-12T17:27:50.457939+0000","last_became_peered":"2024-09-12T17:27:50.457939+0000","last_unstale":"2024-09-12T17:30:49.944535+0000","last_undegraded":"2024-09-12T17:30:49.944535+0000","last_fullsized":"2024-09-12T17:30:49.944535+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:23.231500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"31'4","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.076951+0000","last_change":"2024-09-12T17:27:42.425698+0000","last_active":"2024-09-12T17:29:49.076951+0000","last_peered":"2024-09-12T17:29:49.076951+0000","last_clean":"2024-09-12T17:29:49.076951+0000","last_became_active":"2024-09-12T17:27:42.424498+0000","last_became_peered":"2024-09-12T17:27:42.424498+0000","last_unstale":"2024-09-12T17:29:49.076951+0000","last_undegraded":"2024-09-12T17:29:49.076951+0000","last_fullsized":"2024-09-12T17:29:49.076951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:03.680453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466787+0000","last_change":"2024-09-12T17:27:35.052087+0000","last_active":"2024-09-12T17:28:21.466787+0000","last_peered":"2024-09-12T17:28:21.466787+0000","last_clean":"2024-09-12T17:28:21.466787+0000","last_became_active":"2024-09-12T17:27:32.761809+0000","last_became_peered":"2024-09-12T17:27:32.761809+0000","last_unstale":"2024-09-12T17:28:21.466787+0000","last_undegraded":"2024-09-12T17:28:21.466787+0000","last_fullsized":"2024-09-12T17:28:21.466787+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:18.084479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051333900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"31'3","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:05.185226+0000","last_change":"2024-09-12T17:27:40.418110+0000","last_active":"2024-09-12T17:29:05.185226+0000","last_peered":"2024-09-12T17:29:05.185226+0000","last_clean":"2024-09-12T17:29:05.185226+0000","last_became_active":"2024-09-12T17:27:40.417664+0000","last_became_peered":"2024-09-12T17:27:40.417664+0000","last_unstale":"2024-09-12T17:29:05.185226+0000","last_undegraded":"2024-09-12T17:29:05.185226+0000","last_fullsized":"2024-09-12T17:29:05.185226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:39.177042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"22'2","reported_seq":232,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:48.725808+0000","last_change":"2024-09-12T17:28:21.479837+0000","last_active":"2024-09-12T17:29:48.725808+0000","last_peered":"2024-09-12T17:29:48.725808+0000","last_clean":"2024-09-12T17:29:48.725808+0000","last_became_active":"2024-09-12T17:28:21.473073+0000","last_became_peered":"2024-09-12T17:28:21.473073+0000","last_unstale":"2024-09-12T17:29:48.725808+0000","last_undegraded":"2024-09-12T17:29:48.725808+0000","last_fullsized":"2024-09-12T17:29:48.725808+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:19.813164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":482,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"31'17","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.234475+0000","last_change":"2024-09-12T17:27:46.435712+0000","last_active":"2024-09-12T17:30:50.234475+0000","last_peered":"2024-09-12T17:30:50.234475+0000","last_clean":"2024-09-12T17:30:50.234475+0000","last_became_active":"2024-09-12T17:27:46.435381+0000","last_became_peered":"2024-09-12T17:27:46.435381+0000","last_unstale":"2024-09-12T17:30:50.234475+0000","last_undegraded":"2024-09-12T17:30:50.234475+0000","last_fullsized":"2024-09-12T17:30:50.234475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:41.723829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.472358+0000","last_change":"2024-09-12T17:27:48.451538+0000","last_active":"2024-09-12T17:28:21.472358+0000","last_peered":"2024-09-12T17:28:21.472358+0000","last_clean":"2024-09-12T17:28:21.472358+0000","last_became_active":"2024-09-12T17:27:48.451225+0000","last_became_peered":"2024-09-12T17:27:48.451225+0000","last_unstale":"2024-09-12T17:28:21.472358+0000","last_undegraded":"2024-09-12T17:28:21.472358+0000","last_fullsized":"2024-09-12T17:28:21.472358+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:18.269897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463520+0000","last_change":"2024-09-12T17:27:50.453764+0000","last_active":"2024-09-12T17:28:21.463520+0000","last_peered":"2024-09-12T17:28:21.463520+0000","last_clean":"2024-09-12T17:28:21.463520+0000","last_became_active":"2024-09-12T17:27:50.453458+0000","last_became_peered":"2024-09-12T17:27:50.453458+0000","last_unstale":"2024-09-12T17:28:21.463520+0000","last_undegraded":"2024-09-12T17:28:21.463520+0000","last_fullsized":"2024-09-12T17:28:21.463520+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:48.900827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"31'10","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.928991+0000","last_change":"2024-09-12T17:27:42.428370+0000","last_active":"2024-09-12T17:30:49.928991+0000","last_peered":"2024-09-12T17:30:49.928991+0000","last_clean":"2024-09-12T17:30:49.928991+0000","last_became_active":"2024-09-12T17:27:42.427591+0000","last_became_peered":"2024-09-12T17:27:42.427591+0000","last_unstale":"2024-09-12T17:30:49.928991+0000","last_undegraded":"2024-09-12T17:30:49.928991+0000","last_fullsized":"2024-09-12T17:30:49.928991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:32:15.190001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463771+0000","last_change":"2024-09-12T17:27:34.769764+0000","last_active":"2024-09-12T17:28:21.463771+0000","last_peered":"2024-09-12T17:28:21.463771+0000","last_clean":"2024-09-12T17:28:21.463771+0000","last_became_active":"2024-09-12T17:27:32.761967+0000","last_became_peered":"2024-09-12T17:27:32.761967+0000","last_unstale":"2024-09-12T17:28:21.463771+0000","last_undegraded":"2024-09-12T17:28:21.463771+0000","last_fullsized":"2024-09-12T17:28:21.463771+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:25.345465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001062323,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468759+0000","last_change":"2024-09-12T17:27:40.426229+0000","last_active":"2024-09-12T17:28:21.468759+0000","last_peered":"2024-09-12T17:28:21.468759+0000","last_clean":"2024-09-12T17:28:21.468759+0000","last_became_active":"2024-09-12T17:27:40.425973+0000","last_became_peered":"2024-09-12T17:27:40.425973+0000","last_unstale":"2024-09-12T17:28:21.468759+0000","last_undegraded":"2024-09-12T17:28:21.468759+0000","last_fullsized":"2024-09-12T17:28:21.468759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:08.388292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.473874+0000","last_change":"2024-09-12T17:27:44.432667+0000","last_active":"2024-09-12T17:28:21.473874+0000","last_peered":"2024-09-12T17:28:21.473874+0000","last_clean":"2024-09-12T17:28:21.473874+0000","last_became_active":"2024-09-12T17:27:44.432348+0000","last_became_peered":"2024-09-12T17:27:44.432348+0000","last_unstale":"2024-09-12T17:28:21.473874+0000","last_undegraded":"2024-09-12T17:28:21.473874+0000","last_fullsized":"2024-09-12T17:28:21.473874+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:56.521250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"31'14","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.091058+0000","last_change":"2024-09-12T17:27:46.442771+0000","last_active":"2024-09-12T17:30:49.091058+0000","last_peered":"2024-09-12T17:30:49.091058+0000","last_clean":"2024-09-12T17:30:49.091058+0000","last_became_active":"2024-09-12T17:27:46.442488+0000","last_became_peered":"2024-09-12T17:27:46.442488+0000","last_unstale":"2024-09-12T17:30:49.091058+0000","last_undegraded":"2024-09-12T17:30:49.091058+0000","last_fullsized":"2024-09-12T17:30:49.091058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:31.634237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466202+0000","last_change":"2024-09-12T17:27:48.451472+0000","last_active":"2024-09-12T17:28:21.466202+0000","last_peered":"2024-09-12T17:28:21.466202+0000","last_clean":"2024-09-12T17:28:21.466202+0000","last_became_active":"2024-09-12T17:27:48.451075+0000","last_became_peered":"2024-09-12T17:27:48.451075+0000","last_unstale":"2024-09-12T17:28:21.466202+0000","last_undegraded":"2024-09-12T17:28:21.466202+0000","last_fullsized":"2024-09-12T17:28:21.466202+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:41.217292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'10","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:48.840270+0000","last_change":"2024-09-12T17:27:50.456671+0000","last_active":"2024-09-12T17:29:48.840270+0000","last_peered":"2024-09-12T17:29:48.840270+0000","last_clean":"2024-09-12T17:29:48.840270+0000","last_became_active":"2024-09-12T17:27:50.455608+0000","last_became_peered":"2024-09-12T17:27:50.455608+0000","last_unstale":"2024-09-12T17:29:48.840270+0000","last_undegraded":"2024-09-12T17:29:48.840270+0000","last_fullsized":"2024-09-12T17:29:48.840270+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:23.681507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":17,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'14","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.148304+0000","last_change":"2024-09-12T17:28:21.472071+0000","last_active":"2024-09-12T17:30:50.148304+0000","last_peered":"2024-09-12T17:30:50.148304+0000","last_clean":"2024-09-12T17:30:50.148304+0000","last_became_active":"2024-09-12T17:28:21.471756+0000","last_became_peered":"2024-09-12T17:28:21.471756+0000","last_unstale":"2024-09-12T17:30:50.148304+0000","last_undegraded":"2024-09-12T17:30:50.148304+0000","last_fullsized":"2024-09-12T17:30:50.148304+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:02.305736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.141559+0000","last_change":"2024-09-12T17:27:40.424557+0000","last_active":"2024-09-12T17:30:50.141559+0000","last_peered":"2024-09-12T17:30:50.141559+0000","last_clean":"2024-09-12T17:30:50.141559+0000","last_became_active":"2024-09-12T17:27:40.424286+0000","last_became_peered":"2024-09-12T17:27:40.424286+0000","last_unstale":"2024-09-12T17:30:50.141559+0000","last_undegraded":"2024-09-12T17:30:50.141559+0000","last_fullsized":"2024-09-12T17:30:50.141559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:35.900609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.472269+0000","last_change":"2024-09-12T17:27:34.764756+0000","last_active":"2024-09-12T17:28:21.472269+0000","last_peered":"2024-09-12T17:28:21.472269+0000","last_clean":"2024-09-12T17:28:21.472269+0000","last_became_active":"2024-09-12T17:27:32.761595+0000","last_became_peered":"2024-09-12T17:27:32.761595+0000","last_unstale":"2024-09-12T17:28:21.472269+0000","last_undegraded":"2024-09-12T17:28:21.472269+0000","last_fullsized":"2024-09-12T17:28:21.472269+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:18.306129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000417551,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"31'1","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.757479+0000","last_change":"2024-09-12T17:27:44.432884+0000","last_active":"2024-09-12T17:29:49.757479+0000","last_peered":"2024-09-12T17:29:49.757479+0000","last_clean":"2024-09-12T17:29:49.757479+0000","last_became_active":"2024-09-12T17:27:44.432492+0000","last_became_peered":"2024-09-12T17:27:44.432492+0000","last_unstale":"2024-09-12T17:29:49.757479+0000","last_undegraded":"2024-09-12T17:29:49.757479+0000","last_fullsized":"2024-09-12T17:29:49.757479+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:10.580513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"31'61","reported_seq":121,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.757358+0000","last_change":"2024-09-12T17:27:46.439404+0000","last_active":"2024-09-12T17:29:49.757358+0000","last_peered":"2024-09-12T17:29:49.757358+0000","last_clean":"2024-09-12T17:29:49.757358+0000","last_became_active":"2024-09-12T17:27:46.439014+0000","last_became_peered":"2024-09-12T17:27:46.439014+0000","last_unstale":"2024-09-12T17:29:49.757358+0000","last_undegraded":"2024-09-12T17:29:49.757358+0000","last_fullsized":"2024-09-12T17:29:49.757358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:18.977626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.467285+0000","last_change":"2024-09-12T17:27:48.439106+0000","last_active":"2024-09-12T17:28:21.467285+0000","last_peered":"2024-09-12T17:28:21.467285+0000","last_clean":"2024-09-12T17:28:21.467285+0000","last_became_active":"2024-09-12T17:27:48.438779+0000","last_became_peered":"2024-09-12T17:27:48.438779+0000","last_unstale":"2024-09-12T17:28:21.467285+0000","last_undegraded":"2024-09-12T17:28:21.467285+0000","last_fullsized":"2024-09-12T17:28:21.467285+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:49.022922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"31'13","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.020053+0000","last_change":"2024-09-12T17:27:50.448485+0000","last_active":"2024-09-12T17:30:50.020053+0000","last_peered":"2024-09-12T17:30:50.020053+0000","last_clean":"2024-09-12T17:30:50.020053+0000","last_became_active":"2024-09-12T17:27:50.448060+0000","last_became_peered":"2024-09-12T17:27:50.448060+0000","last_unstale":"2024-09-12T17:30:50.020053+0000","last_undegraded":"2024-09-12T17:30:50.020053+0000","last_fullsized":"2024-09-12T17:30:50.020053+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:10.453854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":31,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"31'27","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.023811+0000","last_change":"2024-09-12T17:27:42.433227+0000","last_active":"2024-09-12T17:30:50.023811+0000","last_peered":"2024-09-12T17:30:50.023811+0000","last_clean":"2024-09-12T17:30:50.023811+0000","last_became_active":"2024-09-12T17:27:42.432800+0000","last_became_peered":"2024-09-12T17:27:42.432800+0000","last_unstale":"2024-09-12T17:30:50.023811+0000","last_undegraded":"2024-09-12T17:30:50.023811+0000","last_fullsized":"2024-09-12T17:30:50.023811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:05.801739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":99,"num_read_kb":83,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"31'3","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.757529+0000","last_change":"2024-09-12T17:27:40.419982+0000","last_active":"2024-09-12T17:29:49.757529+0000","last_peered":"2024-09-12T17:29:49.757529+0000","last_clean":"2024-09-12T17:29:49.757529+0000","last_became_active":"2024-09-12T17:27:40.418873+0000","last_became_peered":"2024-09-12T17:27:40.418873+0000","last_unstale":"2024-09-12T17:29:49.757529+0000","last_undegraded":"2024-09-12T17:29:49.757529+0000","last_fullsized":"2024-09-12T17:29:49.757529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:08.388292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465552+0000","last_change":"2024-09-12T17:27:34.770070+0000","last_active":"2024-09-12T17:28:21.465552+0000","last_peered":"2024-09-12T17:28:21.465552+0000","last_clean":"2024-09-12T17:28:21.465552+0000","last_became_active":"2024-09-12T17:27:32.761677+0000","last_became_peered":"2024-09-12T17:27:32.761677+0000","last_unstale":"2024-09-12T17:28:21.465552+0000","last_undegraded":"2024-09-12T17:28:21.465552+0000","last_fullsized":"2024-09-12T17:28:21.465552+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:22.236160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001356625,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463624+0000","last_change":"2024-09-12T17:27:44.426949+0000","last_active":"2024-09-12T17:28:21.463624+0000","last_peered":"2024-09-12T17:28:21.463624+0000","last_clean":"2024-09-12T17:28:21.463624+0000","last_became_active":"2024-09-12T17:27:44.426647+0000","last_became_peered":"2024-09-12T17:27:44.426647+0000","last_unstale":"2024-09-12T17:28:21.463624+0000","last_undegraded":"2024-09-12T17:28:21.463624+0000","last_fullsized":"2024-09-12T17:28:21.463624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:54.776333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"29'15","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468427+0000","last_change":"2024-09-12T17:27:46.439375+0000","last_active":"2024-09-12T17:28:21.468427+0000","last_peered":"2024-09-12T17:28:21.468427+0000","last_clean":"2024-09-12T17:28:21.468427+0000","last_became_active":"2024-09-12T17:27:46.439038+0000","last_became_peered":"2024-09-12T17:27:46.439038+0000","last_unstale":"2024-09-12T17:28:21.468427+0000","last_undegraded":"2024-09-12T17:28:21.468427+0000","last_fullsized":"2024-09-12T17:28:21.468427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:18.536701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"31'282","reported_seq":347,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.511651+0000","last_change":"2024-09-12T17:27:48.442198+0000","last_active":"2024-09-12T17:30:49.511651+0000","last_peered":"2024-09-12T17:30:49.511651+0000","last_clean":"2024-09-12T17:30:49.511651+0000","last_became_active":"2024-09-12T17:27:48.440948+0000","last_became_peered":"2024-09-12T17:27:48.440948+0000","last_unstale":"2024-09-12T17:30:49.511651+0000","last_undegraded":"2024-09-12T17:30:49.511651+0000","last_fullsized":"2024-09-12T17:30:49.511651+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:58.653865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465509+0000","last_change":"2024-09-12T17:27:50.455097+0000","last_active":"2024-09-12T17:28:21.465509+0000","last_peered":"2024-09-12T17:28:21.465509+0000","last_clean":"2024-09-12T17:28:21.465509+0000","last_became_active":"2024-09-12T17:27:50.454241+0000","last_became_peered":"2024-09-12T17:27:50.454241+0000","last_unstale":"2024-09-12T17:28:21.465509+0000","last_undegraded":"2024-09-12T17:28:21.465509+0000","last_fullsized":"2024-09-12T17:28:21.465509+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:01.881864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"31'16","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.203650+0000","last_change":"2024-09-12T17:27:42.424267+0000","last_active":"2024-09-12T17:30:50.203650+0000","last_peered":"2024-09-12T17:30:50.203650+0000","last_clean":"2024-09-12T17:30:50.203650+0000","last_became_active":"2024-09-12T17:27:42.423805+0000","last_became_peered":"2024-09-12T17:27:42.423805+0000","last_unstale":"2024-09-12T17:30:50.203650+0000","last_undegraded":"2024-09-12T17:30:50.203650+0000","last_fullsized":"2024-09-12T17:30:50.203650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:37.154226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466516+0000","last_change":"2024-09-12T17:27:40.424553+0000","last_active":"2024-09-12T17:28:21.466516+0000","last_peered":"2024-09-12T17:28:21.466516+0000","last_clean":"2024-09-12T17:28:21.466516+0000","last_became_active":"2024-09-12T17:27:40.423703+0000","last_became_peered":"2024-09-12T17:27:40.423703+0000","last_unstale":"2024-09-12T17:28:21.466516+0000","last_undegraded":"2024-09-12T17:28:21.466516+0000","last_fullsized":"2024-09-12T17:28:21.466516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:34.708745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.472967+0000","last_change":"2024-09-12T17:27:34.764838+0000","last_active":"2024-09-12T17:28:21.472967+0000","last_peered":"2024-09-12T17:28:21.472967+0000","last_clean":"2024-09-12T17:28:21.472967+0000","last_became_active":"2024-09-12T17:27:32.761590+0000","last_became_peered":"2024-09-12T17:27:32.761590+0000","last_unstale":"2024-09-12T17:28:21.472967+0000","last_undegraded":"2024-09-12T17:28:21.472967+0000","last_fullsized":"2024-09-12T17:28:21.472967+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:23.009450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036072200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463699+0000","last_change":"2024-09-12T17:27:44.427647+0000","last_active":"2024-09-12T17:28:21.463699+0000","last_peered":"2024-09-12T17:28:21.463699+0000","last_clean":"2024-09-12T17:28:21.463699+0000","last_became_active":"2024-09-12T17:27:44.427318+0000","last_became_peered":"2024-09-12T17:27:44.427318+0000","last_unstale":"2024-09-12T17:28:21.463699+0000","last_undegraded":"2024-09-12T17:28:21.463699+0000","last_fullsized":"2024-09-12T17:28:21.463699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:46.727329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'10","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464060+0000","last_change":"2024-09-12T17:27:46.444325+0000","last_active":"2024-09-12T17:28:21.464060+0000","last_peered":"2024-09-12T17:28:21.464060+0000","last_clean":"2024-09-12T17:28:21.464060+0000","last_became_active":"2024-09-12T17:27:46.443937+0000","last_became_peered":"2024-09-12T17:27:46.443937+0000","last_unstale":"2024-09-12T17:28:21.464060+0000","last_undegraded":"2024-09-12T17:28:21.464060+0000","last_fullsized":"2024-09-12T17:28:21.464060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:54:23.541095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"31'282","reported_seq":390,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.331661+0000","last_change":"2024-09-12T17:27:48.441935+0000","last_active":"2024-09-12T17:30:50.331661+0000","last_peered":"2024-09-12T17:30:50.331661+0000","last_clean":"2024-09-12T17:30:50.331661+0000","last_became_active":"2024-09-12T17:27:48.441694+0000","last_became_peered":"2024-09-12T17:27:48.441694+0000","last_unstale":"2024-09-12T17:30:50.331661+0000","last_undegraded":"2024-09-12T17:30:50.331661+0000","last_fullsized":"2024-09-12T17:30:50.331661+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:32.578727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"29'3","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468923+0000","last_change":"2024-09-12T17:27:50.453171+0000","last_active":"2024-09-12T17:28:21.468923+0000","last_peered":"2024-09-12T17:28:21.468923+0000","last_clean":"2024-09-12T17:28:21.468923+0000","last_became_active":"2024-09-12T17:27:50.452862+0000","last_became_peered":"2024-09-12T17:27:50.452862+0000","last_unstale":"2024-09-12T17:28:21.468923+0000","last_undegraded":"2024-09-12T17:28:21.468923+0000","last_fullsized":"2024-09-12T17:28:21.468923+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:55.038103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"29'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466639+0000","last_change":"2024-09-12T17:27:42.437147+0000","last_active":"2024-09-12T17:28:21.466639+0000","last_peered":"2024-09-12T17:28:21.466639+0000","last_clean":"2024-09-12T17:28:21.466639+0000","last_became_active":"2024-09-12T17:27:42.436667+0000","last_became_peered":"2024-09-12T17:27:42.436667+0000","last_unstale":"2024-09-12T17:28:21.466639+0000","last_undegraded":"2024-09-12T17:28:21.466639+0000","last_fullsized":"2024-09-12T17:28:21.466639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:46.763985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466656+0000","last_change":"2024-09-12T17:27:40.419748+0000","last_active":"2024-09-12T17:28:21.466656+0000","last_peered":"2024-09-12T17:28:21.466656+0000","last_clean":"2024-09-12T17:28:21.466656+0000","last_became_active":"2024-09-12T17:27:40.419472+0000","last_became_peered":"2024-09-12T17:27:40.419472+0000","last_unstale":"2024-09-12T17:28:21.466656+0000","last_undegraded":"2024-09-12T17:28:21.466656+0000","last_fullsized":"2024-09-12T17:28:21.466656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:16.839649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466286+0000","last_change":"2024-09-12T17:27:34.769850+0000","last_active":"2024-09-12T17:28:21.466286+0000","last_peered":"2024-09-12T17:28:21.466286+0000","last_clean":"2024-09-12T17:28:21.466286+0000","last_became_active":"2024-09-12T17:27:32.775344+0000","last_became_peered":"2024-09-12T17:27:32.775344+0000","last_unstale":"2024-09-12T17:28:21.466286+0000","last_undegraded":"2024-09-12T17:28:21.466286+0000","last_fullsized":"2024-09-12T17:28:21.466286+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:45.298951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011343939999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463970+0000","last_change":"2024-09-12T17:27:44.427846+0000","last_active":"2024-09-12T17:28:21.463970+0000","last_peered":"2024-09-12T17:28:21.463970+0000","last_clean":"2024-09-12T17:28:21.463970+0000","last_became_active":"2024-09-12T17:27:44.427519+0000","last_became_peered":"2024-09-12T17:27:44.427519+0000","last_unstale":"2024-09-12T17:28:21.463970+0000","last_undegraded":"2024-09-12T17:28:21.463970+0000","last_fullsized":"2024-09-12T17:28:21.463970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:56.857897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"31'82","reported_seq":155,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.594928+0000","last_change":"2024-09-12T17:27:46.442632+0000","last_active":"2024-09-12T17:29:47.594928+0000","last_peered":"2024-09-12T17:29:47.594928+0000","last_clean":"2024-09-12T17:29:47.594928+0000","last_became_active":"2024-09-12T17:27:46.442154+0000","last_became_peered":"2024-09-12T17:27:46.442154+0000","last_unstale":"2024-09-12T17:29:47.594928+0000","last_undegraded":"2024-09-12T17:29:47.594928+0000","last_fullsized":"2024-09-12T17:29:47.594928+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:20.802573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471089+0000","last_change":"2024-09-12T17:27:48.440496+0000","last_active":"2024-09-12T17:28:21.471089+0000","last_peered":"2024-09-12T17:28:21.471089+0000","last_clean":"2024-09-12T17:28:21.471089+0000","last_became_active":"2024-09-12T17:27:48.440177+0000","last_became_peered":"2024-09-12T17:27:48.440177+0000","last_unstale":"2024-09-12T17:28:21.471089+0000","last_undegraded":"2024-09-12T17:28:21.471089+0000","last_fullsized":"2024-09-12T17:28:21.471089+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:26.852348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466258+0000","last_change":"2024-09-12T17:27:50.454208+0000","last_active":"2024-09-12T17:28:21.466258+0000","last_peered":"2024-09-12T17:28:21.466258+0000","last_clean":"2024-09-12T17:28:21.466258+0000","last_became_active":"2024-09-12T17:27:50.453919+0000","last_became_peered":"2024-09-12T17:27:50.453919+0000","last_unstale":"2024-09-12T17:28:21.466258+0000","last_undegraded":"2024-09-12T17:28:21.466258+0000","last_fullsized":"2024-09-12T17:28:21.466258+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:28.859033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469099+0000","last_change":"2024-09-12T17:27:50.454609+0000","last_active":"2024-09-12T17:28:21.469099+0000","last_peered":"2024-09-12T17:28:21.469099+0000","last_clean":"2024-09-12T17:28:21.469099+0000","last_became_active":"2024-09-12T17:27:50.452190+0000","last_became_peered":"2024-09-12T17:27:50.452190+0000","last_unstale":"2024-09-12T17:28:21.469099+0000","last_undegraded":"2024-09-12T17:28:21.469099+0000","last_fullsized":"2024-09-12T17:28:21.469099+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:08.249355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:05.195137+0000","last_change":"2024-09-12T17:27:42.436477+0000","last_active":"2024-09-12T17:29:05.195137+0000","last_peered":"2024-09-12T17:29:05.195137+0000","last_clean":"2024-09-12T17:29:05.195137+0000","last_became_active":"2024-09-12T17:27:42.436187+0000","last_became_peered":"2024-09-12T17:27:42.436187+0000","last_unstale":"2024-09-12T17:29:05.195137+0000","last_undegraded":"2024-09-12T17:29:05.195137+0000","last_fullsized":"2024-09-12T17:29:05.195137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:06.625797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"29'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464418+0000","last_change":"2024-09-12T17:27:40.429080+0000","last_active":"2024-09-12T17:28:21.464418+0000","last_peered":"2024-09-12T17:28:21.464418+0000","last_clean":"2024-09-12T17:28:21.464418+0000","last_became_active":"2024-09-12T17:27:40.428529+0000","last_became_peered":"2024-09-12T17:27:40.428529+0000","last_unstale":"2024-09-12T17:28:21.464418+0000","last_undegraded":"2024-09-12T17:28:21.464418+0000","last_fullsized":"2024-09-12T17:28:21.464418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:43.412664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470025+0000","last_change":"2024-09-12T17:27:44.430001+0000","last_active":"2024-09-12T17:28:21.470025+0000","last_peered":"2024-09-12T17:28:21.470025+0000","last_clean":"2024-09-12T17:28:21.470025+0000","last_became_active":"2024-09-12T17:27:44.429701+0000","last_became_peered":"2024-09-12T17:27:44.429701+0000","last_unstale":"2024-09-12T17:28:21.470025+0000","last_undegraded":"2024-09-12T17:28:21.470025+0000","last_fullsized":"2024-09-12T17:28:21.470025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:31.928670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"31'32","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.600840+0000","last_change":"2024-09-12T17:27:46.443026+0000","last_active":"2024-09-12T17:29:47.600840+0000","last_peered":"2024-09-12T17:29:47.600840+0000","last_clean":"2024-09-12T17:29:47.600840+0000","last_became_active":"2024-09-12T17:27:46.442713+0000","last_became_peered":"2024-09-12T17:27:46.442713+0000","last_unstale":"2024-09-12T17:29:47.600840+0000","last_undegraded":"2024-09-12T17:29:47.600840+0000","last_fullsized":"2024-09-12T17:29:47.600840+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:29.878441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463885+0000","last_change":"2024-09-12T17:27:48.450563+0000","last_active":"2024-09-12T17:28:21.463885+0000","last_peered":"2024-09-12T17:28:21.463885+0000","last_clean":"2024-09-12T17:28:21.463885+0000","last_became_active":"2024-09-12T17:27:48.450050+0000","last_became_peered":"2024-09-12T17:27:48.450050+0000","last_unstale":"2024-09-12T17:28:21.463885+0000","last_undegraded":"2024-09-12T17:28:21.463885+0000","last_fullsized":"2024-09-12T17:28:21.463885+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:37.430305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"31'5","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.306851+0000","last_change":"2024-09-12T17:27:50.453680+0000","last_active":"2024-09-12T17:29:47.306851+0000","last_peered":"2024-09-12T17:29:47.306851+0000","last_clean":"2024-09-12T17:29:47.306851+0000","last_became_active":"2024-09-12T17:27:50.453382+0000","last_became_peered":"2024-09-12T17:27:50.453382+0000","last_unstale":"2024-09-12T17:29:47.306851+0000","last_undegraded":"2024-09-12T17:29:47.306851+0000","last_fullsized":"2024-09-12T17:29:47.306851+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:21.594797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"31'8","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.197223+0000","last_change":"2024-09-12T17:27:42.436403+0000","last_active":"2024-09-12T17:30:50.197223+0000","last_peered":"2024-09-12T17:30:50.197223+0000","last_clean":"2024-09-12T17:30:50.197223+0000","last_became_active":"2024-09-12T17:27:42.436150+0000","last_became_peered":"2024-09-12T17:27:42.436150+0000","last_unstale":"2024-09-12T17:30:50.197223+0000","last_undegraded":"2024-09-12T17:30:50.197223+0000","last_fullsized":"2024-09-12T17:30:50.197223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:34.481120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466884+0000","last_change":"2024-09-12T17:27:40.432404+0000","last_active":"2024-09-12T17:28:21.466884+0000","last_peered":"2024-09-12T17:28:21.466884+0000","last_clean":"2024-09-12T17:28:21.466884+0000","last_became_active":"2024-09-12T17:27:40.431962+0000","last_became_peered":"2024-09-12T17:27:40.431962+0000","last_unstale":"2024-09-12T17:28:21.466884+0000","last_undegraded":"2024-09-12T17:28:21.466884+0000","last_fullsized":"2024-09-12T17:28:21.466884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:16.839649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465368+0000","last_change":"2024-09-12T17:27:44.432604+0000","last_active":"2024-09-12T17:28:21.465368+0000","last_peered":"2024-09-12T17:28:21.465368+0000","last_clean":"2024-09-12T17:28:21.465368+0000","last_became_active":"2024-09-12T17:27:44.432334+0000","last_became_peered":"2024-09-12T17:27:44.432334+0000","last_unstale":"2024-09-12T17:28:21.465368+0000","last_undegraded":"2024-09-12T17:28:21.465368+0000","last_fullsized":"2024-09-12T17:28:21.465368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:32.282020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"31'6","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.113421+0000","last_change":"2024-09-12T17:27:46.435861+0000","last_active":"2024-09-12T17:30:49.113421+0000","last_peered":"2024-09-12T17:30:49.113421+0000","last_clean":"2024-09-12T17:30:49.113421+0000","last_became_active":"2024-09-12T17:27:46.435567+0000","last_became_peered":"2024-09-12T17:27:46.435567+0000","last_unstale":"2024-09-12T17:30:49.113421+0000","last_undegraded":"2024-09-12T17:30:49.113421+0000","last_fullsized":"2024-09-12T17:30:49.113421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:25.415585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466933+0000","last_change":"2024-09-12T17:27:48.448838+0000","last_active":"2024-09-12T17:28:21.466933+0000","last_peered":"2024-09-12T17:28:21.466933+0000","last_clean":"2024-09-12T17:28:21.466933+0000","last_became_active":"2024-09-12T17:27:48.448478+0000","last_became_peered":"2024-09-12T17:27:48.448478+0000","last_unstale":"2024-09-12T17:28:21.466933+0000","last_undegraded":"2024-09-12T17:28:21.466933+0000","last_fullsized":"2024-09-12T17:28:21.466933+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:31.633824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"31'8","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:22.316873+0000","last_change":"2024-09-12T17:27:50.449599+0000","last_active":"2024-09-12T17:28:22.316873+0000","last_peered":"2024-09-12T17:28:22.316873+0000","last_clean":"2024-09-12T17:28:22.316873+0000","last_became_active":"2024-09-12T17:27:50.449302+0000","last_became_peered":"2024-09-12T17:27:50.449302+0000","last_unstale":"2024-09-12T17:28:22.316873+0000","last_undegraded":"2024-09-12T17:28:22.316873+0000","last_fullsized":"2024-09-12T17:28:22.316873+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:02.835518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"31'4","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:05.195069+0000","last_change":"2024-09-12T17:27:42.424932+0000","last_active":"2024-09-12T17:29:05.195069+0000","last_peered":"2024-09-12T17:29:05.195069+0000","last_clean":"2024-09-12T17:29:05.195069+0000","last_became_active":"2024-09-12T17:27:42.423974+0000","last_became_peered":"2024-09-12T17:27:42.423974+0000","last_unstale":"2024-09-12T17:29:05.195069+0000","last_undegraded":"2024-09-12T17:29:05.195069+0000","last_fullsized":"2024-09-12T17:29:05.195069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:45.464780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:22.876120+0000","last_change":"2024-09-12T17:27:40.430392+0000","last_active":"2024-09-12T17:28:22.876120+0000","last_peered":"2024-09-12T17:28:22.876120+0000","last_clean":"2024-09-12T17:28:22.876120+0000","last_became_active":"2024-09-12T17:27:40.430154+0000","last_became_peered":"2024-09-12T17:27:40.430154+0000","last_unstale":"2024-09-12T17:28:22.876120+0000","last_undegraded":"2024-09-12T17:28:22.876120+0000","last_fullsized":"2024-09-12T17:28:22.876120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:51.844092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466293+0000","last_change":"2024-09-12T17:27:44.435267+0000","last_active":"2024-09-12T17:28:21.466293+0000","last_peered":"2024-09-12T17:28:21.466293+0000","last_clean":"2024-09-12T17:28:21.466293+0000","last_became_active":"2024-09-12T17:27:44.434979+0000","last_became_peered":"2024-09-12T17:27:44.434979+0000","last_unstale":"2024-09-12T17:28:21.466293+0000","last_undegraded":"2024-09-12T17:28:21.466293+0000","last_fullsized":"2024-09-12T17:28:21.466293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:20.110019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"31'40","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.160818+0000","last_change":"2024-09-12T17:27:46.433815+0000","last_active":"2024-09-12T17:30:49.160818+0000","last_peered":"2024-09-12T17:30:49.160818+0000","last_clean":"2024-09-12T17:30:49.160818+0000","last_became_active":"2024-09-12T17:27:46.433421+0000","last_became_peered":"2024-09-12T17:27:46.433421+0000","last_unstale":"2024-09-12T17:30:49.160818+0000","last_undegraded":"2024-09-12T17:30:49.160818+0000","last_fullsized":"2024-09-12T17:30:49.160818+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:46:25.118826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469750+0000","last_change":"2024-09-12T17:27:48.439853+0000","last_active":"2024-09-12T17:28:21.469750+0000","last_peered":"2024-09-12T17:28:21.469750+0000","last_clean":"2024-09-12T17:28:21.469750+0000","last_became_active":"2024-09-12T17:27:48.439547+0000","last_became_peered":"2024-09-12T17:27:48.439547+0000","last_unstale":"2024-09-12T17:28:21.469750+0000","last_undegraded":"2024-09-12T17:28:21.469750+0000","last_fullsized":"2024-09-12T17:28:21.469750+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:36.201000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464221+0000","last_change":"2024-09-12T17:27:50.459594+0000","last_active":"2024-09-12T17:28:21.464221+0000","last_peered":"2024-09-12T17:28:21.464221+0000","last_clean":"2024-09-12T17:28:21.464221+0000","last_became_active":"2024-09-12T17:27:50.459321+0000","last_became_peered":"2024-09-12T17:27:50.459321+0000","last_unstale":"2024-09-12T17:28:21.464221+0000","last_undegraded":"2024-09-12T17:28:21.464221+0000","last_fullsized":"2024-09-12T17:28:21.464221+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:42.428839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"31'14","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.226040+0000","last_change":"2024-09-12T17:27:42.428640+0000","last_active":"2024-09-12T17:30:50.226040+0000","last_peered":"2024-09-12T17:30:50.226040+0000","last_clean":"2024-09-12T17:30:50.226040+0000","last_became_active":"2024-09-12T17:27:42.428364+0000","last_became_peered":"2024-09-12T17:27:42.428364+0000","last_unstale":"2024-09-12T17:30:50.226040+0000","last_undegraded":"2024-09-12T17:30:50.226040+0000","last_fullsized":"2024-09-12T17:30:50.226040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:30.980696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.136306+0000","last_change":"2024-09-12T17:27:40.416377+0000","last_active":"2024-09-12T17:30:50.136306+0000","last_peered":"2024-09-12T17:30:50.136306+0000","last_clean":"2024-09-12T17:30:50.136306+0000","last_became_active":"2024-09-12T17:27:40.415212+0000","last_became_peered":"2024-09-12T17:27:40.415212+0000","last_unstale":"2024-09-12T17:30:50.136306+0000","last_undegraded":"2024-09-12T17:30:50.136306+0000","last_fullsized":"2024-09-12T17:30:50.136306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:08.388292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463776+0000","last_change":"2024-09-12T17:27:44.430145+0000","last_active":"2024-09-12T17:28:21.463776+0000","last_peered":"2024-09-12T17:28:21.463776+0000","last_clean":"2024-09-12T17:28:21.463776+0000","last_became_active":"2024-09-12T17:27:44.429844+0000","last_became_peered":"2024-09-12T17:27:44.429844+0000","last_unstale":"2024-09-12T17:28:21.463776+0000","last_undegraded":"2024-09-12T17:28:21.463776+0000","last_fullsized":"2024-09-12T17:28:21.463776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:59.753147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"31'31","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.586817+0000","last_change":"2024-09-12T17:27:46.432991+0000","last_active":"2024-09-12T17:29:47.586817+0000","last_peered":"2024-09-12T17:29:47.586817+0000","last_clean":"2024-09-12T17:29:47.586817+0000","last_became_active":"2024-09-12T17:27:46.432650+0000","last_became_peered":"2024-09-12T17:27:46.432650+0000","last_unstale":"2024-09-12T17:29:47.586817+0000","last_undegraded":"2024-09-12T17:29:47.586817+0000","last_fullsized":"2024-09-12T17:29:47.586817+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:21.877058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469478+0000","last_change":"2024-09-12T17:27:48.440110+0000","last_active":"2024-09-12T17:28:21.469478+0000","last_peered":"2024-09-12T17:28:21.469478+0000","last_clean":"2024-09-12T17:28:21.469478+0000","last_became_active":"2024-09-12T17:27:48.439134+0000","last_became_peered":"2024-09-12T17:27:48.439134+0000","last_unstale":"2024-09-12T17:28:21.469478+0000","last_undegraded":"2024-09-12T17:28:21.469478+0000","last_fullsized":"2024-09-12T17:28:21.469478+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:10.067239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:23.352256+0000","last_change":"2024-09-12T17:27:42.427657+0000","last_active":"2024-09-12T17:28:23.352256+0000","last_peered":"2024-09-12T17:28:23.352256+0000","last_clean":"2024-09-12T17:28:23.352256+0000","last_became_active":"2024-09-12T17:27:42.426108+0000","last_became_peered":"2024-09-12T17:27:42.426108+0000","last_unstale":"2024-09-12T17:28:23.352256+0000","last_undegraded":"2024-09-12T17:28:23.352256+0000","last_fullsized":"2024-09-12T17:28:23.352256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:46.077185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:22.871380+0000","last_change":"2024-09-12T17:27:40.430187+0000","last_active":"2024-09-12T17:28:22.871380+0000","last_peered":"2024-09-12T17:28:22.871380+0000","last_clean":"2024-09-12T17:28:22.871380+0000","last_became_active":"2024-09-12T17:27:40.429644+0000","last_became_peered":"2024-09-12T17:27:40.429644+0000","last_unstale":"2024-09-12T17:28:22.871380+0000","last_undegraded":"2024-09-12T17:28:22.871380+0000","last_fullsized":"2024-09-12T17:28:22.871380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:25.713951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:24.747265+0000","last_change":"2024-09-12T17:28:21.472039+0000","last_active":"2024-09-12T17:28:24.747265+0000","last_peered":"2024-09-12T17:28:24.747265+0000","last_clean":"2024-09-12T17:28:24.747265+0000","last_became_active":"2024-09-12T17:28:21.471678+0000","last_became_peered":"2024-09-12T17:28:21.471678+0000","last_unstale":"2024-09-12T17:28:24.747265+0000","last_undegraded":"2024-09-12T17:28:24.747265+0000","last_fullsized":"2024-09-12T17:28:24.747265+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:05.827719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"31'55","reported_seq":112,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.078333+0000","last_change":"2024-09-12T17:27:46.437943+0000","last_active":"2024-09-12T17:29:49.078333+0000","last_peered":"2024-09-12T17:29:49.078333+0000","last_clean":"2024-09-12T17:29:49.078333+0000","last_became_active":"2024-09-12T17:27:46.437623+0000","last_became_peered":"2024-09-12T17:27:46.437623+0000","last_unstale":"2024-09-12T17:29:49.078333+0000","last_undegraded":"2024-09-12T17:29:49.078333+0000","last_fullsized":"2024-09-12T17:29:49.078333+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:29.626451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.467936+0000","last_change":"2024-09-12T17:27:48.440791+0000","last_active":"2024-09-12T17:28:21.467936+0000","last_peered":"2024-09-12T17:28:21.467936+0000","last_clean":"2024-09-12T17:28:21.467936+0000","last_became_active":"2024-09-12T17:27:48.440354+0000","last_became_peered":"2024-09-12T17:27:48.440354+0000","last_unstale":"2024-09-12T17:28:21.467936+0000","last_undegraded":"2024-09-12T17:28:21.467936+0000","last_fullsized":"2024-09-12T17:28:21.467936+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:12.406427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"31'14","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.013731+0000","last_change":"2024-09-12T17:27:50.457985+0000","last_active":"2024-09-12T17:29:49.013731+0000","last_peered":"2024-09-12T17:29:49.013731+0000","last_clean":"2024-09-12T17:29:49.013731+0000","last_became_active":"2024-09-12T17:27:50.457744+0000","last_became_peered":"2024-09-12T17:27:50.457744+0000","last_unstale":"2024-09-12T17:29:49.013731+0000","last_undegraded":"2024-09-12T17:29:49.013731+0000","last_fullsized":"2024-09-12T17:29:49.013731+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:13.394393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"31'6","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:05.377000+0000","last_change":"2024-09-12T17:27:42.424802+0000","last_active":"2024-09-12T17:29:05.377000+0000","last_peered":"2024-09-12T17:29:05.377000+0000","last_clean":"2024-09-12T17:29:05.377000+0000","last_became_active":"2024-09-12T17:27:42.424447+0000","last_became_peered":"2024-09-12T17:27:42.424447+0000","last_unstale":"2024-09-12T17:29:05.377000+0000","last_undegraded":"2024-09-12T17:29:05.377000+0000","last_fullsized":"2024-09-12T17:29:05.377000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:50.988456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.467680+0000","last_change":"2024-09-12T17:27:40.415772+0000","last_active":"2024-09-12T17:28:21.467680+0000","last_peered":"2024-09-12T17:28:21.467680+0000","last_clean":"2024-09-12T17:28:21.467680+0000","last_became_active":"2024-09-12T17:27:40.414911+0000","last_became_peered":"2024-09-12T17:27:40.414911+0000","last_unstale":"2024-09-12T17:28:21.467680+0000","last_undegraded":"2024-09-12T17:28:21.467680+0000","last_fullsized":"2024-09-12T17:28:21.467680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:33.541500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"31'4","reported_seq":227,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:48.716416+0000","last_change":"2024-09-12T17:27:44.428072+0000","last_active":"2024-09-12T17:29:48.716416+0000","last_peered":"2024-09-12T17:29:48.716416+0000","last_clean":"2024-09-12T17:29:48.716416+0000","last_became_active":"2024-09-12T17:27:44.427778+0000","last_became_peered":"2024-09-12T17:27:44.427778+0000","last_unstale":"2024-09-12T17:29:48.716416+0000","last_undegraded":"2024-09-12T17:29:48.716416+0000","last_fullsized":"2024-09-12T17:29:48.716416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:40.229931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"31'36","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.587748+0000","last_change":"2024-09-12T17:27:46.440779+0000","last_active":"2024-09-12T17:29:47.587748+0000","last_peered":"2024-09-12T17:29:47.587748+0000","last_clean":"2024-09-12T17:29:47.587748+0000","last_became_active":"2024-09-12T17:27:46.440494+0000","last_became_peered":"2024-09-12T17:27:46.440494+0000","last_unstale":"2024-09-12T17:29:47.587748+0000","last_undegraded":"2024-09-12T17:29:47.587748+0000","last_fullsized":"2024-09-12T17:29:47.587748+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:43.434855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471249+0000","last_change":"2024-09-12T17:27:48.449171+0000","last_active":"2024-09-12T17:28:21.471249+0000","last_peered":"2024-09-12T17:28:21.471249+0000","last_clean":"2024-09-12T17:28:21.471249+0000","last_became_active":"2024-09-12T17:27:48.448871+0000","last_became_peered":"2024-09-12T17:27:48.448871+0000","last_unstale":"2024-09-12T17:28:21.471249+0000","last_undegraded":"2024-09-12T17:28:21.471249+0000","last_fullsized":"2024-09-12T17:28:21.471249+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:23.511991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463074+0000","last_change":"2024-09-12T17:27:50.452011+0000","last_active":"2024-09-12T17:28:21.463074+0000","last_peered":"2024-09-12T17:28:21.463074+0000","last_clean":"2024-09-12T17:28:21.463074+0000","last_became_active":"2024-09-12T17:27:50.451678+0000","last_became_peered":"2024-09-12T17:27:50.451678+0000","last_unstale":"2024-09-12T17:28:21.463074+0000","last_undegraded":"2024-09-12T17:28:21.463074+0000","last_fullsized":"2024-09-12T17:28:21.463074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:15.594880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.197331+0000","last_change":"2024-09-12T17:27:42.438932+0000","last_active":"2024-09-12T17:30:50.197331+0000","last_peered":"2024-09-12T17:30:50.197331+0000","last_clean":"2024-09-12T17:30:50.197331+0000","last_became_active":"2024-09-12T17:27:42.438583+0000","last_became_peered":"2024-09-12T17:27:42.438583+0000","last_unstale":"2024-09-12T17:30:50.197331+0000","last_undegraded":"2024-09-12T17:30:50.197331+0000","last_fullsized":"2024-09-12T17:30:50.197331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:41.527263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469834+0000","last_change":"2024-09-12T17:27:40.414311+0000","last_active":"2024-09-12T17:28:21.469834+0000","last_peered":"2024-09-12T17:28:21.469834+0000","last_clean":"2024-09-12T17:28:21.469834+0000","last_became_active":"2024-09-12T17:27:40.414034+0000","last_became_peered":"2024-09-12T17:27:40.414034+0000","last_unstale":"2024-09-12T17:28:21.469834+0000","last_undegraded":"2024-09-12T17:28:21.469834+0000","last_fullsized":"2024-09-12T17:28:21.469834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:02.612906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.467688+0000","last_change":"2024-09-12T17:27:44.427310+0000","last_active":"2024-09-12T17:28:21.467688+0000","last_peered":"2024-09-12T17:28:21.467688+0000","last_clean":"2024-09-12T17:28:21.467688+0000","last_became_active":"2024-09-12T17:27:44.426927+0000","last_became_peered":"2024-09-12T17:27:44.426927+0000","last_unstale":"2024-09-12T17:28:21.467688+0000","last_undegraded":"2024-09-12T17:28:21.467688+0000","last_fullsized":"2024-09-12T17:28:21.467688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:51.409386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"31'32","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.604974+0000","last_change":"2024-09-12T17:27:46.439119+0000","last_active":"2024-09-12T17:29:47.604974+0000","last_peered":"2024-09-12T17:29:47.604974+0000","last_clean":"2024-09-12T17:29:47.604974+0000","last_became_active":"2024-09-12T17:27:46.438778+0000","last_became_peered":"2024-09-12T17:27:46.438778+0000","last_unstale":"2024-09-12T17:29:47.604974+0000","last_undegraded":"2024-09-12T17:29:47.604974+0000","last_fullsized":"2024-09-12T17:29:47.604974+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:47.015548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.473244+0000","last_change":"2024-09-12T17:27:48.440227+0000","last_active":"2024-09-12T17:28:21.473244+0000","last_peered":"2024-09-12T17:28:21.473244+0000","last_clean":"2024-09-12T17:28:21.473244+0000","last_became_active":"2024-09-12T17:27:48.439888+0000","last_became_peered":"2024-09-12T17:27:48.439888+0000","last_unstale":"2024-09-12T17:28:21.473244+0000","last_undegraded":"2024-09-12T17:28:21.473244+0000","last_fullsized":"2024-09-12T17:28:21.473244+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:29.484764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"31'3","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.072631+0000","last_change":"2024-09-12T17:27:50.455406+0000","last_active":"2024-09-12T17:29:49.072631+0000","last_peered":"2024-09-12T17:29:49.072631+0000","last_clean":"2024-09-12T17:29:49.072631+0000","last_became_active":"2024-09-12T17:27:50.454058+0000","last_became_peered":"2024-09-12T17:27:50.454058+0000","last_unstale":"2024-09-12T17:29:49.072631+0000","last_undegraded":"2024-09-12T17:29:49.072631+0000","last_fullsized":"2024-09-12T17:29:49.072631+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:44.719122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"31'6","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.225767+0000","last_change":"2024-09-12T17:27:42.428738+0000","last_active":"2024-09-12T17:30:50.225767+0000","last_peered":"2024-09-12T17:30:50.225767+0000","last_clean":"2024-09-12T17:30:50.225767+0000","last_became_active":"2024-09-12T17:27:42.428236+0000","last_became_peered":"2024-09-12T17:27:42.428236+0000","last_unstale":"2024-09-12T17:30:50.225767+0000","last_undegraded":"2024-09-12T17:30:50.225767+0000","last_fullsized":"2024-09-12T17:30:50.225767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:41.383292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"31'6","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.138918+0000","last_change":"2024-09-12T17:27:40.429226+0000","last_active":"2024-09-12T17:30:50.138918+0000","last_peered":"2024-09-12T17:30:50.138918+0000","last_clean":"2024-09-12T17:30:50.138918+0000","last_became_active":"2024-09-12T17:27:40.428969+0000","last_became_peered":"2024-09-12T17:27:40.428969+0000","last_unstale":"2024-09-12T17:30:50.138918+0000","last_undegraded":"2024-09-12T17:30:50.138918+0000","last_fullsized":"2024-09-12T17:30:50.138918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:34.741245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":14,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470977+0000","last_change":"2024-09-12T17:27:44.432908+0000","last_active":"2024-09-12T17:28:21.470977+0000","last_peered":"2024-09-12T17:28:21.470977+0000","last_clean":"2024-09-12T17:28:21.470977+0000","last_became_active":"2024-09-12T17:27:44.432609+0000","last_became_peered":"2024-09-12T17:27:44.432609+0000","last_unstale":"2024-09-12T17:28:21.470977+0000","last_undegraded":"2024-09-12T17:28:21.470977+0000","last_fullsized":"2024-09-12T17:28:21.470977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:38.819057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"29'10","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465451+0000","last_change":"2024-09-12T17:27:46.445145+0000","last_active":"2024-09-12T17:28:21.465451+0000","last_peered":"2024-09-12T17:28:21.465451+0000","last_clean":"2024-09-12T17:28:21.465451+0000","last_became_active":"2024-09-12T17:27:46.444644+0000","last_became_peered":"2024-09-12T17:27:46.444644+0000","last_unstale":"2024-09-12T17:28:21.465451+0000","last_undegraded":"2024-09-12T17:28:21.465451+0000","last_fullsized":"2024-09-12T17:28:21.465451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:28.337567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"31'282","reported_seq":371,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.344750+0000","last_change":"2024-09-12T17:27:48.449435+0000","last_active":"2024-09-12T17:30:50.344750+0000","last_peered":"2024-09-12T17:30:50.344750+0000","last_clean":"2024-09-12T17:30:50.344750+0000","last_became_active":"2024-09-12T17:27:48.449138+0000","last_became_peered":"2024-09-12T17:27:48.449138+0000","last_unstale":"2024-09-12T17:30:50.344750+0000","last_undegraded":"2024-09-12T17:30:50.344750+0000","last_fullsized":"2024-09-12T17:30:50.344750+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:43.994480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.462765+0000","last_change":"2024-09-12T17:27:50.452165+0000","last_active":"2024-09-12T17:28:21.462765+0000","last_peered":"2024-09-12T17:28:21.462765+0000","last_clean":"2024-09-12T17:28:21.462765+0000","last_became_active":"2024-09-12T17:27:50.451899+0000","last_became_peered":"2024-09-12T17:27:50.451899+0000","last_unstale":"2024-09-12T17:28:21.462765+0000","last_undegraded":"2024-09-12T17:28:21.462765+0000","last_fullsized":"2024-09-12T17:28:21.462765+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:38.778216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"31'8","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.195915+0000","last_change":"2024-09-12T17:27:42.430391+0000","last_active":"2024-09-12T17:30:50.195915+0000","last_peered":"2024-09-12T17:30:50.195915+0000","last_clean":"2024-09-12T17:30:50.195915+0000","last_became_active":"2024-09-12T17:27:42.430110+0000","last_became_peered":"2024-09-12T17:27:42.430110+0000","last_unstale":"2024-09-12T17:30:50.195915+0000","last_undegraded":"2024-09-12T17:30:50.195915+0000","last_fullsized":"2024-09-12T17:30:50.195915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:09.624789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:48.918402+0000","last_change":"2024-09-12T17:27:40.415902+0000","last_active":"2024-09-12T17:29:48.918402+0000","last_peered":"2024-09-12T17:29:48.918402+0000","last_clean":"2024-09-12T17:29:48.918402+0000","last_became_active":"2024-09-12T17:27:40.415018+0000","last_became_peered":"2024-09-12T17:27:40.415018+0000","last_unstale":"2024-09-12T17:29:48.918402+0000","last_undegraded":"2024-09-12T17:29:48.918402+0000","last_fullsized":"2024-09-12T17:29:48.918402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:40.407846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470596+0000","last_change":"2024-09-12T17:27:44.433006+0000","last_active":"2024-09-12T17:28:21.470596+0000","last_peered":"2024-09-12T17:28:21.470596+0000","last_clean":"2024-09-12T17:28:21.470596+0000","last_became_active":"2024-09-12T17:27:44.432389+0000","last_became_peered":"2024-09-12T17:27:44.432389+0000","last_unstale":"2024-09-12T17:28:21.470596+0000","last_undegraded":"2024-09-12T17:28:21.470596+0000","last_fullsized":"2024-09-12T17:28:21.470596+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:18.314088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"31'36","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.578959+0000","last_change":"2024-09-12T17:27:46.437010+0000","last_active":"2024-09-12T17:29:47.578959+0000","last_peered":"2024-09-12T17:29:47.578959+0000","last_clean":"2024-09-12T17:29:47.578959+0000","last_became_active":"2024-09-12T17:27:46.435056+0000","last_became_peered":"2024-09-12T17:27:46.435056+0000","last_unstale":"2024-09-12T17:29:47.578959+0000","last_undegraded":"2024-09-12T17:29:47.578959+0000","last_fullsized":"2024-09-12T17:29:47.578959+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:41.987106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470481+0000","last_change":"2024-09-12T17:27:48.451418+0000","last_active":"2024-09-12T17:28:21.470481+0000","last_peered":"2024-09-12T17:28:21.470481+0000","last_clean":"2024-09-12T17:28:21.470481+0000","last_became_active":"2024-09-12T17:27:48.451143+0000","last_became_peered":"2024-09-12T17:27:48.451143+0000","last_unstale":"2024-09-12T17:28:21.470481+0000","last_undegraded":"2024-09-12T17:28:21.470481+0000","last_fullsized":"2024-09-12T17:28:21.470481+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:05.841062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469983+0000","last_change":"2024-09-12T17:27:50.459043+0000","last_active":"2024-09-12T17:28:21.469983+0000","last_peered":"2024-09-12T17:28:21.469983+0000","last_clean":"2024-09-12T17:28:21.469983+0000","last_became_active":"2024-09-12T17:27:50.458688+0000","last_became_peered":"2024-09-12T17:27:50.458688+0000","last_unstale":"2024-09-12T17:28:21.469983+0000","last_undegraded":"2024-09-12T17:28:21.469983+0000","last_fullsized":"2024-09-12T17:28:21.469983+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:52.579121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'17","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.936036+0000","last_change":"2024-09-12T17:27:42.429938+0000","last_active":"2024-09-12T17:30:49.936036+0000","last_peered":"2024-09-12T17:30:49.936036+0000","last_clean":"2024-09-12T17:30:49.936036+0000","last_became_active":"2024-09-12T17:27:42.429645+0000","last_became_peered":"2024-09-12T17:27:42.429645+0000","last_unstale":"2024-09-12T17:30:49.936036+0000","last_undegraded":"2024-09-12T17:30:49.936036+0000","last_fullsized":"2024-09-12T17:30:49.936036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:26.167048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":59,"num_read_kb":51,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465519+0000","last_change":"2024-09-12T17:27:40.433842+0000","last_active":"2024-09-12T17:28:21.465519+0000","last_peered":"2024-09-12T17:28:21.465519+0000","last_clean":"2024-09-12T17:28:21.465519+0000","last_became_active":"2024-09-12T17:27:40.433580+0000","last_became_peered":"2024-09-12T17:27:40.433580+0000","last_unstale":"2024-09-12T17:28:21.465519+0000","last_undegraded":"2024-09-12T17:28:21.465519+0000","last_fullsized":"2024-09-12T17:28:21.465519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:42.180970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469077+0000","last_change":"2024-09-12T17:27:44.433816+0000","last_active":"2024-09-12T17:28:21.469077+0000","last_peered":"2024-09-12T17:28:21.469077+0000","last_clean":"2024-09-12T17:28:21.469077+0000","last_became_active":"2024-09-12T17:27:44.433529+0000","last_became_peered":"2024-09-12T17:27:44.433529+0000","last_unstale":"2024-09-12T17:28:21.469077+0000","last_undegraded":"2024-09-12T17:28:21.469077+0000","last_fullsized":"2024-09-12T17:28:21.469077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:41.042095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"31'32","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:14.761606+0000","last_change":"2024-09-12T17:27:46.439345+0000","last_active":"2024-09-12T17:30:14.761606+0000","last_peered":"2024-09-12T17:30:14.761606+0000","last_clean":"2024-09-12T17:30:14.761606+0000","last_became_active":"2024-09-12T17:27:46.439037+0000","last_became_peered":"2024-09-12T17:27:46.439037+0000","last_unstale":"2024-09-12T17:30:14.761606+0000","last_undegraded":"2024-09-12T17:30:14.761606+0000","last_fullsized":"2024-09-12T17:30:14.761606+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:39.381080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463052+0000","last_change":"2024-09-12T17:27:48.449101+0000","last_active":"2024-09-12T17:28:21.463052+0000","last_peered":"2024-09-12T17:28:21.463052+0000","last_clean":"2024-09-12T17:28:21.463052+0000","last_became_active":"2024-09-12T17:27:48.448426+0000","last_became_peered":"2024-09-12T17:27:48.448426+0000","last_unstale":"2024-09-12T17:28:21.463052+0000","last_undegraded":"2024-09-12T17:28:21.463052+0000","last_fullsized":"2024-09-12T17:28:21.463052+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:18.516470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464580+0000","last_change":"2024-09-12T17:27:50.459948+0000","last_active":"2024-09-12T17:28:21.464580+0000","last_peered":"2024-09-12T17:28:21.464580+0000","last_clean":"2024-09-12T17:28:21.464580+0000","last_became_active":"2024-09-12T17:27:50.459662+0000","last_became_peered":"2024-09-12T17:27:50.459662+0000","last_unstale":"2024-09-12T17:28:21.464580+0000","last_undegraded":"2024-09-12T17:28:21.464580+0000","last_fullsized":"2024-09-12T17:28:21.464580+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:08.216661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'12","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.148532+0000","last_change":"2024-09-12T17:28:21.476547+0000","last_active":"2024-09-12T17:30:50.148532+0000","last_peered":"2024-09-12T17:30:50.148532+0000","last_clean":"2024-09-12T17:30:50.148532+0000","last_became_active":"2024-09-12T17:28:21.472532+0000","last_became_peered":"2024-09-12T17:28:21.472532+0000","last_unstale":"2024-09-12T17:30:50.148532+0000","last_undegraded":"2024-09-12T17:30:50.148532+0000","last_fullsized":"2024-09-12T17:30:50.148532+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:31.654192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"31'1","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:44.756709+0000","last_change":"2024-09-12T17:27:40.419012+0000","last_active":"2024-09-12T17:29:44.756709+0000","last_peered":"2024-09-12T17:29:44.756709+0000","last_clean":"2024-09-12T17:29:44.756709+0000","last_became_active":"2024-09-12T17:27:40.418464+0000","last_became_peered":"2024-09-12T17:27:40.418464+0000","last_unstale":"2024-09-12T17:29:44.756709+0000","last_undegraded":"2024-09-12T17:29:44.756709+0000","last_fullsized":"2024-09-12T17:29:44.756709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:41.313682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469583+0000","last_change":"2024-09-12T17:27:44.433348+0000","last_active":"2024-09-12T17:28:21.469583+0000","last_peered":"2024-09-12T17:28:21.469583+0000","last_clean":"2024-09-12T17:28:21.469583+0000","last_became_active":"2024-09-12T17:27:44.430221+0000","last_became_peered":"2024-09-12T17:27:44.430221+0000","last_unstale":"2024-09-12T17:28:21.469583+0000","last_undegraded":"2024-09-12T17:28:21.469583+0000","last_fullsized":"2024-09-12T17:28:21.469583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:13.176204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"31'26","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.602901+0000","last_change":"2024-09-12T17:27:46.441427+0000","last_active":"2024-09-12T17:29:47.602901+0000","last_peered":"2024-09-12T17:29:47.602901+0000","last_clean":"2024-09-12T17:29:47.602901+0000","last_became_active":"2024-09-12T17:27:46.441081+0000","last_became_peered":"2024-09-12T17:27:46.441081+0000","last_unstale":"2024-09-12T17:29:47.602901+0000","last_undegraded":"2024-09-12T17:29:47.602901+0000","last_fullsized":"2024-09-12T17:29:47.602901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:08.132341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463313+0000","last_change":"2024-09-12T17:27:48.447632+0000","last_active":"2024-09-12T17:28:21.463313+0000","last_peered":"2024-09-12T17:28:21.463313+0000","last_clean":"2024-09-12T17:28:21.463313+0000","last_became_active":"2024-09-12T17:27:48.447321+0000","last_became_peered":"2024-09-12T17:27:48.447321+0000","last_unstale":"2024-09-12T17:28:21.463313+0000","last_undegraded":"2024-09-12T17:28:21.463313+0000","last_fullsized":"2024-09-12T17:28:21.463313+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:43.865345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"31'10","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.181767+0000","last_change":"2024-09-12T17:27:50.460271+0000","last_active":"2024-09-12T17:30:49.181767+0000","last_peered":"2024-09-12T17:30:49.181767+0000","last_clean":"2024-09-12T17:30:49.181767+0000","last_became_active":"2024-09-12T17:27:50.459463+0000","last_became_peered":"2024-09-12T17:27:50.459463+0000","last_unstale":"2024-09-12T17:30:49.181767+0000","last_undegraded":"2024-09-12T17:30:49.181767+0000","last_fullsized":"2024-09-12T17:30:49.181767+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:18.316219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"31'17","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.232329+0000","last_change":"2024-09-12T17:27:42.430374+0000","last_active":"2024-09-12T17:30:50.232329+0000","last_peered":"2024-09-12T17:30:50.232329+0000","last_clean":"2024-09-12T17:30:50.232329+0000","last_became_active":"2024-09-12T17:27:42.430021+0000","last_became_peered":"2024-09-12T17:27:42.430021+0000","last_unstale":"2024-09-12T17:30:50.232329+0000","last_undegraded":"2024-09-12T17:30:50.232329+0000","last_fullsized":"2024-09-12T17:30:50.232329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:54.683103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":76,"num_read_kb":68,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470409+0000","last_change":"2024-09-12T17:27:40.416382+0000","last_active":"2024-09-12T17:28:21.470409+0000","last_peered":"2024-09-12T17:28:21.470409+0000","last_clean":"2024-09-12T17:28:21.470409+0000","last_became_active":"2024-09-12T17:27:40.415549+0000","last_became_peered":"2024-09-12T17:27:40.415549+0000","last_unstale":"2024-09-12T17:28:21.470409+0000","last_undegraded":"2024-09-12T17:28:21.470409+0000","last_fullsized":"2024-09-12T17:28:21.470409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:42:31.960679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"31'2","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:46.228947+0000","last_change":"2024-09-12T17:27:44.433362+0000","last_active":"2024-09-12T17:29:46.228947+0000","last_peered":"2024-09-12T17:29:46.228947+0000","last_clean":"2024-09-12T17:29:46.228947+0000","last_became_active":"2024-09-12T17:27:44.433037+0000","last_became_peered":"2024-09-12T17:27:44.433037+0000","last_unstale":"2024-09-12T17:29:46.228947+0000","last_undegraded":"2024-09-12T17:29:46.228947+0000","last_fullsized":"2024-09-12T17:29:46.228947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:52.650681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"31'33","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.096185+0000","last_change":"2024-09-12T17:27:46.443590+0000","last_active":"2024-09-12T17:30:49.096185+0000","last_peered":"2024-09-12T17:30:49.096185+0000","last_clean":"2024-09-12T17:30:49.096185+0000","last_became_active":"2024-09-12T17:27:46.443316+0000","last_became_peered":"2024-09-12T17:27:46.443316+0000","last_unstale":"2024-09-12T17:30:49.096185+0000","last_undegraded":"2024-09-12T17:30:49.096185+0000","last_fullsized":"2024-09-12T17:30:49.096185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:47.273927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471547+0000","last_change":"2024-09-12T17:27:48.448239+0000","last_active":"2024-09-12T17:28:21.471547+0000","last_peered":"2024-09-12T17:28:21.471547+0000","last_clean":"2024-09-12T17:28:21.471547+0000","last_became_active":"2024-09-12T17:27:48.447884+0000","last_became_peered":"2024-09-12T17:27:48.447884+0000","last_unstale":"2024-09-12T17:28:21.471547+0000","last_undegraded":"2024-09-12T17:28:21.471547+0000","last_fullsized":"2024-09-12T17:28:21.471547+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:37.799636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"31'2","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.614754+0000","last_change":"2024-09-12T17:27:50.459747+0000","last_active":"2024-09-12T17:29:47.614754+0000","last_peered":"2024-09-12T17:29:47.614754+0000","last_clean":"2024-09-12T17:29:47.614754+0000","last_became_active":"2024-09-12T17:27:50.459464+0000","last_became_peered":"2024-09-12T17:27:50.459464+0000","last_unstale":"2024-09-12T17:29:47.614754+0000","last_undegraded":"2024-09-12T17:29:47.614754+0000","last_fullsized":"2024-09-12T17:29:47.614754+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:47.424145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"31'6","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.018176+0000","last_change":"2024-09-12T17:28:21.475279+0000","last_active":"2024-09-12T17:30:50.018176+0000","last_peered":"2024-09-12T17:30:50.018176+0000","last_clean":"2024-09-12T17:30:50.018176+0000","last_became_active":"2024-09-12T17:28:21.471738+0000","last_became_peered":"2024-09-12T17:28:21.471738+0000","last_unstale":"2024-09-12T17:30:50.018176+0000","last_undegraded":"2024-09-12T17:30:50.018176+0000","last_fullsized":"2024-09-12T17:30:50.018176+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:24.585090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"31'1","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.757645+0000","last_change":"2024-09-12T17:27:40.425416+0000","last_active":"2024-09-12T17:29:49.757645+0000","last_peered":"2024-09-12T17:29:49.757645+0000","last_clean":"2024-09-12T17:29:49.757645+0000","last_became_active":"2024-09-12T17:27:40.425150+0000","last_became_peered":"2024-09-12T17:27:40.425150+0000","last_unstale":"2024-09-12T17:29:49.757645+0000","last_undegraded":"2024-09-12T17:29:49.757645+0000","last_fullsized":"2024-09-12T17:29:49.757645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:44.782205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"31'6","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.225756+0000","last_change":"2024-09-12T17:27:42.428098+0000","last_active":"2024-09-12T17:30:50.225756+0000","last_peered":"2024-09-12T17:30:50.225756+0000","last_clean":"2024-09-12T17:30:50.225756+0000","last_became_active":"2024-09-12T17:27:42.427745+0000","last_became_peered":"2024-09-12T17:27:42.427745+0000","last_unstale":"2024-09-12T17:30:50.225756+0000","last_undegraded":"2024-09-12T17:30:50.225756+0000","last_fullsized":"2024-09-12T17:30:50.225756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:27.653203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470803+0000","last_change":"2024-09-12T17:27:40.413378+0000","last_active":"2024-09-12T17:28:21.470803+0000","last_peered":"2024-09-12T17:28:21.470803+0000","last_clean":"2024-09-12T17:28:21.470803+0000","last_became_active":"2024-09-12T17:27:40.413068+0000","last_became_peered":"2024-09-12T17:27:40.413068+0000","last_unstale":"2024-09-12T17:28:21.470803+0000","last_undegraded":"2024-09-12T17:28:21.470803+0000","last_fullsized":"2024-09-12T17:28:21.470803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:35.900609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465685+0000","last_change":"2024-09-12T17:27:42.429127+0000","last_active":"2024-09-12T17:28:21.465685+0000","last_peered":"2024-09-12T17:28:21.465685+0000","last_clean":"2024-09-12T17:28:21.465685+0000","last_became_active":"2024-09-12T17:27:42.428871+0000","last_became_peered":"2024-09-12T17:27:42.428871+0000","last_unstale":"2024-09-12T17:28:21.465685+0000","last_undegraded":"2024-09-12T17:28:21.465685+0000","last_fullsized":"2024-09-12T17:28:21.465685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:46.400627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464105+0000","last_change":"2024-09-12T17:27:40.423623+0000","last_active":"2024-09-12T17:28:21.464105+0000","last_peered":"2024-09-12T17:28:21.464105+0000","last_clean":"2024-09-12T17:28:21.464105+0000","last_became_active":"2024-09-12T17:27:40.423210+0000","last_became_peered":"2024-09-12T17:27:40.423210+0000","last_unstale":"2024-09-12T17:28:21.464105+0000","last_undegraded":"2024-09-12T17:28:21.464105+0000","last_fullsized":"2024-09-12T17:28:21.464105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:10.561707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"31'10","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.148353+0000","last_change":"2024-09-12T17:27:42.428508+0000","last_active":"2024-09-12T17:30:50.148353+0000","last_peered":"2024-09-12T17:30:50.148353+0000","last_clean":"2024-09-12T17:30:50.148353+0000","last_became_active":"2024-09-12T17:27:42.428059+0000","last_became_peered":"2024-09-12T17:27:42.428059+0000","last_unstale":"2024-09-12T17:30:50.148353+0000","last_undegraded":"2024-09-12T17:30:50.148353+0000","last_fullsized":"2024-09-12T17:30:50.148353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:35.350838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.821850+0000","last_change":"2024-09-12T17:27:40.420118+0000","last_active":"2024-09-12T17:28:21.821850+0000","last_peered":"2024-09-12T17:28:21.821850+0000","last_clean":"2024-09-12T17:28:21.821850+0000","last_became_active":"2024-09-12T17:27:40.419018+0000","last_became_peered":"2024-09-12T17:27:40.419018+0000","last_unstale":"2024-09-12T17:28:21.821850+0000","last_undegraded":"2024-09-12T17:28:21.821850+0000","last_fullsized":"2024-09-12T17:28:21.821850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:45.609329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"31'4","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:23.352679+0000","last_change":"2024-09-12T17:27:42.425653+0000","last_active":"2024-09-12T17:28:23.352679+0000","last_peered":"2024-09-12T17:28:23.352679+0000","last_clean":"2024-09-12T17:28:23.352679+0000","last_became_active":"2024-09-12T17:27:42.424201+0000","last_became_peered":"2024-09-12T17:27:42.424201+0000","last_unstale":"2024-09-12T17:28:23.352679+0000","last_undegraded":"2024-09-12T17:28:23.352679+0000","last_fullsized":"2024-09-12T17:28:23.352679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:14.199032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.472579+0000","last_change":"2024-09-12T17:27:40.415678+0000","last_active":"2024-09-12T17:28:21.472579+0000","last_peered":"2024-09-12T17:28:21.472579+0000","last_clean":"2024-09-12T17:28:21.472579+0000","last_became_active":"2024-09-12T17:27:40.415318+0000","last_became_peered":"2024-09-12T17:27:40.415318+0000","last_unstale":"2024-09-12T17:28:21.472579+0000","last_undegraded":"2024-09-12T17:28:21.472579+0000","last_fullsized":"2024-09-12T17:28:21.472579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:42.195527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"31'6","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.225777+0000","last_change":"2024-09-12T17:27:42.434915+0000","last_active":"2024-09-12T17:30:50.225777+0000","last_peered":"2024-09-12T17:30:50.225777+0000","last_clean":"2024-09-12T17:30:50.225777+0000","last_became_active":"2024-09-12T17:27:42.434664+0000","last_became_peered":"2024-09-12T17:27:42.434664+0000","last_unstale":"2024-09-12T17:30:50.225777+0000","last_undegraded":"2024-09-12T17:30:50.225777+0000","last_fullsized":"2024-09-12T17:30:50.225777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:59.091747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:22.296581+0000","last_change":"2024-09-12T17:27:40.421011+0000","last_active":"2024-09-12T17:28:22.296581+0000","last_peered":"2024-09-12T17:28:22.296581+0000","last_clean":"2024-09-12T17:28:22.296581+0000","last_became_active":"2024-09-12T17:27:40.420491+0000","last_became_peered":"2024-09-12T17:27:40.420491+0000","last_unstale":"2024-09-12T17:28:22.296581+0000","last_undegraded":"2024-09-12T17:28:22.296581+0000","last_fullsized":"2024-09-12T17:28:22.296581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:35.277806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"31'10","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:05.194652+0000","last_change":"2024-09-12T17:27:42.425216+0000","last_active":"2024-09-12T17:29:05.194652+0000","last_peered":"2024-09-12T17:29:05.194652+0000","last_clean":"2024-09-12T17:29:05.194652+0000","last_became_active":"2024-09-12T17:27:42.424810+0000","last_became_peered":"2024-09-12T17:27:42.424810+0000","last_unstale":"2024-09-12T17:29:05.194652+0000","last_undegraded":"2024-09-12T17:29:05.194652+0000","last_fullsized":"2024-09-12T17:29:05.194652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:08.170045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":37,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469473+0000","last_change":"2024-09-12T17:27:40.431654+0000","last_active":"2024-09-12T17:28:21.469473+0000","last_peered":"2024-09-12T17:28:21.469473+0000","last_clean":"2024-09-12T17:28:21.469473+0000","last_became_active":"2024-09-12T17:27:40.431365+0000","last_became_peered":"2024-09-12T17:27:40.431365+0000","last_unstale":"2024-09-12T17:28:21.469473+0000","last_undegraded":"2024-09-12T17:28:21.469473+0000","last_fullsized":"2024-09-12T17:28:21.469473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:42:31.960679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"31'13","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.202797+0000","last_change":"2024-09-12T17:27:42.423482+0000","last_active":"2024-09-12T17:30:50.202797+0000","last_peered":"2024-09-12T17:30:50.202797+0000","last_clean":"2024-09-12T17:30:50.202797+0000","last_became_active":"2024-09-12T17:27:42.423099+0000","last_became_peered":"2024-09-12T17:27:42.423099+0000","last_unstale":"2024-09-12T17:30:50.202797+0000","last_undegraded":"2024-09-12T17:30:50.202797+0000","last_fullsized":"2024-09-12T17:30:50.202797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:16.940321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.822005+0000","last_change":"2024-09-12T17:27:40.415799+0000","last_active":"2024-09-12T17:28:21.822005+0000","last_peered":"2024-09-12T17:28:21.822005+0000","last_clean":"2024-09-12T17:28:21.822005+0000","last_became_active":"2024-09-12T17:27:40.415456+0000","last_became_peered":"2024-09-12T17:27:40.415456+0000","last_unstale":"2024-09-12T17:28:21.822005+0000","last_undegraded":"2024-09-12T17:28:21.822005+0000","last_fullsized":"2024-09-12T17:28:21.822005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:28.905045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"31'7","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.024232+0000","last_change":"2024-09-12T17:27:42.428053+0000","last_active":"2024-09-12T17:30:50.024232+0000","last_peered":"2024-09-12T17:30:50.024232+0000","last_clean":"2024-09-12T17:30:50.024232+0000","last_became_active":"2024-09-12T17:27:42.427778+0000","last_became_peered":"2024-09-12T17:27:42.427778+0000","last_unstale":"2024-09-12T17:30:50.024232+0000","last_undegraded":"2024-09-12T17:30:50.024232+0000","last_fullsized":"2024-09-12T17:30:50.024232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:29.654847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"31'1","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:50.765249+0000","last_change":"2024-09-12T17:27:40.418491+0000","last_active":"2024-09-12T17:29:50.765249+0000","last_peered":"2024-09-12T17:29:50.765249+0000","last_clean":"2024-09-12T17:29:50.765249+0000","last_became_active":"2024-09-12T17:27:40.418241+0000","last_became_peered":"2024-09-12T17:27:40.418241+0000","last_unstale":"2024-09-12T17:29:50.765249+0000","last_undegraded":"2024-09-12T17:29:50.765249+0000","last_fullsized":"2024-09-12T17:29:50.765249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:44.106061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:22.319225+0000","last_change":"2024-09-12T17:27:42.433339+0000","last_active":"2024-09-12T17:28:22.319225+0000","last_peered":"2024-09-12T17:28:22.319225+0000","last_clean":"2024-09-12T17:28:22.319225+0000","last_became_active":"2024-09-12T17:27:42.433084+0000","last_became_peered":"2024-09-12T17:27:42.433084+0000","last_unstale":"2024-09-12T17:28:22.319225+0000","last_undegraded":"2024-09-12T17:28:22.319225+0000","last_fullsized":"2024-09-12T17:28:22.319225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:14.732392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.822515+0000","last_change":"2024-09-12T17:27:40.418064+0000","last_active":"2024-09-12T17:28:21.822515+0000","last_peered":"2024-09-12T17:28:21.822515+0000","last_clean":"2024-09-12T17:28:21.822515+0000","last_became_active":"2024-09-12T17:27:40.417666+0000","last_became_peered":"2024-09-12T17:27:40.417666+0000","last_unstale":"2024-09-12T17:28:21.822515+0000","last_undegraded":"2024-09-12T17:28:21.822515+0000","last_fullsized":"2024-09-12T17:28:21.822515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:13.932643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"31'8","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.148411+0000","last_change":"2024-09-12T17:27:42.424818+0000","last_active":"2024-09-12T17:30:50.148411+0000","last_peered":"2024-09-12T17:30:50.148411+0000","last_clean":"2024-09-12T17:30:50.148411+0000","last_became_active":"2024-09-12T17:27:42.424017+0000","last_became_peered":"2024-09-12T17:27:42.424017+0000","last_unstale":"2024-09-12T17:30:50.148411+0000","last_undegraded":"2024-09-12T17:30:50.148411+0000","last_fullsized":"2024-09-12T17:30:50.148411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:22.656734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469834+0000","last_change":"2024-09-12T17:27:40.422351+0000","last_active":"2024-09-12T17:28:21.469834+0000","last_peered":"2024-09-12T17:28:21.469834+0000","last_clean":"2024-09-12T17:28:21.469834+0000","last_became_active":"2024-09-12T17:27:40.418964+0000","last_became_peered":"2024-09-12T17:27:40.418964+0000","last_unstale":"2024-09-12T17:28:21.469834+0000","last_undegraded":"2024-09-12T17:28:21.469834+0000","last_fullsized":"2024-09-12T17:28:21.469834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:51.844092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"31'6","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.076791+0000","last_change":"2024-09-12T17:27:42.424747+0000","last_active":"2024-09-12T17:29:49.076791+0000","last_peered":"2024-09-12T17:29:49.076791+0000","last_clean":"2024-09-12T17:29:49.076791+0000","last_became_active":"2024-09-12T17:27:42.422955+0000","last_became_peered":"2024-09-12T17:27:42.422955+0000","last_unstale":"2024-09-12T17:29:49.076791+0000","last_undegraded":"2024-09-12T17:29:49.076791+0000","last_fullsized":"2024-09-12T17:29:49.076791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:41.422424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.467383+0000","last_change":"2024-09-12T17:27:40.418452+0000","last_active":"2024-09-12T17:28:21.467383+0000","last_peered":"2024-09-12T17:28:21.467383+0000","last_clean":"2024-09-12T17:28:21.467383+0000","last_became_active":"2024-09-12T17:27:40.418183+0000","last_became_peered":"2024-09-12T17:27:40.418183+0000","last_unstale":"2024-09-12T17:28:21.467383+0000","last_undegraded":"2024-09-12T17:28:21.467383+0000","last_fullsized":"2024-09-12T17:28:21.467383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:35.210863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"31'5","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.233331+0000","last_change":"2024-09-12T17:27:42.434117+0000","last_active":"2024-09-12T17:30:50.233331+0000","last_peered":"2024-09-12T17:30:50.233331+0000","last_clean":"2024-09-12T17:30:50.233331+0000","last_became_active":"2024-09-12T17:27:42.433856+0000","last_became_peered":"2024-09-12T17:27:42.433856+0000","last_unstale":"2024-09-12T17:30:50.233331+0000","last_undegraded":"2024-09-12T17:30:50.233331+0000","last_fullsized":"2024-09-12T17:30:50.233331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:13.817201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464738+0000","last_change":"2024-09-12T17:27:40.429406+0000","last_active":"2024-09-12T17:28:21.464738+0000","last_peered":"2024-09-12T17:28:21.464738+0000","last_clean":"2024-09-12T17:28:21.464738+0000","last_became_active":"2024-09-12T17:27:40.428213+0000","last_became_peered":"2024-09-12T17:27:40.428213+0000","last_unstale":"2024-09-12T17:28:21.464738+0000","last_undegraded":"2024-09-12T17:28:21.464738+0000","last_fullsized":"2024-09-12T17:28:21.464738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:43.804492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"31'4","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:05.194819+0000","last_change":"2024-09-12T17:27:42.431854+0000","last_active":"2024-09-12T17:29:05.194819+0000","last_peered":"2024-09-12T17:29:05.194819+0000","last_clean":"2024-09-12T17:29:05.194819+0000","last_became_active":"2024-09-12T17:27:42.431562+0000","last_became_peered":"2024-09-12T17:27:42.431562+0000","last_unstale":"2024-09-12T17:29:05.194819+0000","last_undegraded":"2024-09-12T17:29:05.194819+0000","last_fullsized":"2024-09-12T17:29:05.194819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:46.641338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"31'4","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.909000+0000","last_change":"2024-09-12T17:27:40.426248+0000","last_active":"2024-09-12T17:30:49.909000+0000","last_peered":"2024-09-12T17:30:49.909000+0000","last_clean":"2024-09-12T17:30:49.909000+0000","last_became_active":"2024-09-12T17:27:40.425910+0000","last_became_peered":"2024-09-12T17:27:40.425910+0000","last_unstale":"2024-09-12T17:30:49.909000+0000","last_undegraded":"2024-09-12T17:30:49.909000+0000","last_fullsized":"2024-09-12T17:30:49.909000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:23.924826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"31'10","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.018646+0000","last_change":"2024-09-12T17:27:42.429554+0000","last_active":"2024-09-12T17:30:50.018646+0000","last_peered":"2024-09-12T17:30:50.018646+0000","last_clean":"2024-09-12T17:30:50.018646+0000","last_became_active":"2024-09-12T17:27:42.429270+0000","last_became_peered":"2024-09-12T17:27:42.429270+0000","last_unstale":"2024-09-12T17:30:50.018646+0000","last_undegraded":"2024-09-12T17:30:50.018646+0000","last_fullsized":"2024-09-12T17:30:50.018646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:32.810941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.054755+0000","last_change":"2024-09-12T17:27:40.432092+0000","last_active":"2024-09-12T17:29:49.054755+0000","last_peered":"2024-09-12T17:29:49.054755+0000","last_clean":"2024-09-12T17:29:49.054755+0000","last_became_active":"2024-09-12T17:27:40.431687+0000","last_became_peered":"2024-09-12T17:27:40.431687+0000","last_unstale":"2024-09-12T17:29:49.054755+0000","last_undegraded":"2024-09-12T17:29:49.054755+0000","last_fullsized":"2024-09-12T17:29:49.054755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:35.277806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"31'2","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.280728+0000","last_change":"2024-09-12T17:27:42.425651+0000","last_active":"2024-09-12T17:30:50.280728+0000","last_peered":"2024-09-12T17:30:50.280728+0000","last_clean":"2024-09-12T17:30:50.280728+0000","last_became_active":"2024-09-12T17:27:42.424910+0000","last_became_peered":"2024-09-12T17:27:42.424910+0000","last_unstale":"2024-09-12T17:30:50.280728+0000","last_undegraded":"2024-09-12T17:30:50.280728+0000","last_fullsized":"2024-09-12T17:30:50.280728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:52.600151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"31'1","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:00.767359+0000","last_change":"2024-09-12T17:27:40.434016+0000","last_active":"2024-09-12T17:30:00.767359+0000","last_peered":"2024-09-12T17:30:00.767359+0000","last_clean":"2024-09-12T17:30:00.767359+0000","last_became_active":"2024-09-12T17:27:40.433649+0000","last_became_peered":"2024-09-12T17:27:40.433649+0000","last_unstale":"2024-09-12T17:30:00.767359+0000","last_undegraded":"2024-09-12T17:30:00.767359+0000","last_fullsized":"2024-09-12T17:30:00.767359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:40.824207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:48.985835+0000","last_change":"2024-09-12T17:27:40.424269+0000","last_active":"2024-09-12T17:29:48.985835+0000","last_peered":"2024-09-12T17:29:48.985835+0000","last_clean":"2024-09-12T17:29:48.985835+0000","last_became_active":"2024-09-12T17:27:40.423343+0000","last_became_peered":"2024-09-12T17:27:40.423343+0000","last_unstale":"2024-09-12T17:29:48.985835+0000","last_undegraded":"2024-09-12T17:29:48.985835+0000","last_fullsized":"2024-09-12T17:29:48.985835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:04.434511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"31'8","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.196783+0000","last_change":"2024-09-12T17:27:42.426434+0000","last_active":"2024-09-12T17:30:50.196783+0000","last_peered":"2024-09-12T17:30:50.196783+0000","last_clean":"2024-09-12T17:30:50.196783+0000","last_became_active":"2024-09-12T17:27:42.426150+0000","last_became_peered":"2024-09-12T17:27:42.426150+0000","last_unstale":"2024-09-12T17:30:50.196783+0000","last_undegraded":"2024-09-12T17:30:50.196783+0000","last_fullsized":"2024-09-12T17:30:50.196783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:55.894831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471017+0000","last_change":"2024-09-12T17:27:40.420741+0000","last_active":"2024-09-12T17:28:21.471017+0000","last_peered":"2024-09-12T17:28:21.471017+0000","last_clean":"2024-09-12T17:28:21.471017+0000","last_became_active":"2024-09-12T17:27:40.420396+0000","last_became_peered":"2024-09-12T17:27:40.420396+0000","last_unstale":"2024-09-12T17:28:21.471017+0000","last_undegraded":"2024-09-12T17:28:21.471017+0000","last_fullsized":"2024-09-12T17:28:21.471017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:47.834956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"31'4","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.018441+0000","last_change":"2024-09-12T17:27:42.435623+0000","last_active":"2024-09-12T17:30:50.018441+0000","last_peered":"2024-09-12T17:30:50.018441+0000","last_clean":"2024-09-12T17:30:50.018441+0000","last_became_active":"2024-09-12T17:27:42.435324+0000","last_became_peered":"2024-09-12T17:27:42.435324+0000","last_unstale":"2024-09-12T17:30:50.018441+0000","last_undegraded":"2024-09-12T17:30:50.018441+0000","last_fullsized":"2024-09-12T17:30:50.018441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:04.329622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":482,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1662,"num_read_kb":1552,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":83,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51617792,"data_stored":51611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673006,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43848,"kb_used_data":16824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94327992,"statfs":{"total":96636764160,"available":96591863808,"internally_reserved":0,"allocated":17227776,"data_stored":16913193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705709,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40900,"kb_used_data":13876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94330940,"statfs":{"total":96636764160,"available":96594882560,"internally_reserved":0,"allocated":14209024,"data_stored":13946979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705709,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52844,"kb_used_data":9180,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94318996,"statfs":{"total":96636764160,"available":96582651904,"internally_reserved":0,"allocated":9400320,"data_stored":9113910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705710,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44504,"kb_used_data":13320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94327336,"statfs":{"total":96636764160,"available":96591192064,"internally_reserved":0,"allocated":13639680,"data_stored":13356994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13225984,"data_stored":13222784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13225984,"data_stored":13222784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:30:57.306 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:30:57.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.434+0000 7feb74b64640 1 Processor -- start 2024-09-12T17:30:57.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.434+0000 7feb74b64640 1 -- start start 2024-09-12T17:30:57.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.435+0000 7feb74b64640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7feb70129d80 0x7feb7012a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:30:57.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.435+0000 7feb74b64640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb7006dc00 con 0x7feb7012a6a0 2024-09-12T17:30:57.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.435+0000 7feb74b64640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7feb701299c0 con 0x7feb70129d80 2024-09-12T17:30:57.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.435+0000 7feb6e59c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7feb70129d80 0x7feb7012a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:30:57.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.435+0000 7feb6dd9b640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7feb7012a6a0 0x7feb70110d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:58584/0 (socket says 172.21.15.47:58584) 2024-09-12T17:30:57.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.435+0000 7feb6dd9b640 1 -- 172.21.15.47:0/3568463761 learned_addr learned my addr 172.21.15.47:0/3568463761 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-09-12T17:30:57.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.435+0000 7feb6e59c640 1 -- 172.21.15.47:0/3568463761 >> v1:172.21.15.47:6789/0 conn(0x7feb7012a6a0 legacy=0x7feb70110d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:57.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.435+0000 7feb6e59c640 1 -- 172.21.15.47:0/3568463761 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb70114d20 con 0x7feb70129d80 2024-09-12T17:30:57.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.436+0000 7feb6e59c640 1 --2- 172.21.15.47:0/3568463761 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb70129d80 0x7feb7012a160 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7feb60009d90 tx=0x7feb6002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f60854c961cf6d40 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:30:57.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.436+0000 7feb6d59a640 1 -- 172.21.15.47:0/3568463761 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb60007670 con 0x7feb70129d80 2024-09-12T17:30:57.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.436+0000 7feb6d59a640 1 -- 172.21.15.47:0/3568463761 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb60007810 con 0x7feb70129d80 2024-09-12T17:30:57.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.436+0000 7feb6d59a640 1 -- 172.21.15.47:0/3568463761 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb60007b10 con 0x7feb70129d80 2024-09-12T17:30:57.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.436+0000 7feb74b64640 1 -- 172.21.15.47:0/3568463761 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb70129d80 msgr2=0x7feb7012a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:57.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.436+0000 7feb74b64640 1 --2- 172.21.15.47:0/3568463761 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb70129d80 0x7feb7012a160 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7feb60009d90 tx=0x7feb6002a660 comp rx=0 tx=0).stop 2024-09-12T17:30:57.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.436+0000 7feb74b64640 1 -- 172.21.15.47:0/3568463761 shutdown_connections 2024-09-12T17:30:57.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.436+0000 7feb74b64640 1 --2- 172.21.15.47:0/3568463761 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb70129d80 0x7feb7012a160 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:30:57.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.436+0000 7feb74b64640 1 -- 172.21.15.47:0/3568463761 >> 172.21.15.47:0/3568463761 conn(0x7feb70070850 msgr2=0x7feb70072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:30:57.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.437+0000 7feb74b64640 1 -- 172.21.15.47:0/3568463761 shutdown_connections 2024-09-12T17:30:57.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.437+0000 7feb74b64640 1 -- 172.21.15.47:0/3568463761 wait complete. 2024-09-12T17:30:57.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.438+0000 7feb74b64640 1 Processor -- start 2024-09-12T17:30:57.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.438+0000 7feb74b64640 1 -- start start 2024-09-12T17:30:57.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.438+0000 7feb74b64640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb70129d80 0x7feb701bed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:30:57.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.438+0000 7feb74b64640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7feb70114940 con 0x7feb70129d80 2024-09-12T17:30:57.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.438+0000 7feb6e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb70129d80 0x7feb701bed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:30:57.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.438+0000 7feb6e59c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb70129d80 0x7feb701bed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42874/0 (socket says 172.21.15.47:42874) 2024-09-12T17:30:57.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.438+0000 7feb6e59c640 1 -- 172.21.15.47:0/1298989418 learned_addr learned my addr 172.21.15.47:0/1298989418 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:30:57.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.438+0000 7feb6e59c640 1 -- 172.21.15.47:0/1298989418 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb7011de40 con 0x7feb70129d80 2024-09-12T17:30:57.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.439+0000 7feb6e59c640 1 --2- 172.21.15.47:0/1298989418 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb70129d80 0x7feb701bed50 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7feb60009d90 tx=0x7feb60004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:30:57.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.439+0000 7feb5effd640 1 -- 172.21.15.47:0/1298989418 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb60040070 con 0x7feb70129d80 2024-09-12T17:30:57.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.439+0000 7feb5effd640 1 -- 172.21.15.47:0/1298989418 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb60031a90 con 0x7feb70129d80 2024-09-12T17:30:57.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.439+0000 7feb74b64640 1 -- 172.21.15.47:0/1298989418 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb701bf290 con 0x7feb70129d80 2024-09-12T17:30:57.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.439+0000 7feb5effd640 1 -- 172.21.15.47:0/1298989418 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb60031d70 con 0x7feb70129d80 2024-09-12T17:30:57.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.439+0000 7feb74b64640 1 -- 172.21.15.47:0/1298989418 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb701bf750 con 0x7feb70129d80 2024-09-12T17:30:57.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.440+0000 7feb5effd640 1 -- 172.21.15.47:0/1298989418 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7feb60039040 con 0x7feb70129d80 2024-09-12T17:30:57.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.440+0000 7feb74b64640 1 -- 172.21.15.47:0/1298989418 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb7011cad0 con 0x7feb70129d80 2024-09-12T17:30:57.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.440+0000 7feb5effd640 1 --2- 172.21.15.47:0/1298989418 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7feb5003de90 0x7feb50040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:30:57.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.440+0000 7feb5effd640 1 -- 172.21.15.47:0/1298989418 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7feb6002ae00 con 0x7feb70129d80 2024-09-12T17:30:57.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.440+0000 7feb6dd9b640 1 --2- 172.21.15.47:0/1298989418 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7feb5003de90 0x7feb50040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:30:57.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.440+0000 7feb6dd9b640 1 --2- 172.21.15.47:0/1298989418 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7feb5003de90 0x7feb50040350 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7feb64007fd0 tx=0x7feb64007aa0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:30:57.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.444+0000 7feb5effd640 1 -- 172.21.15.47:0/1298989418 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7feb600303a0 con 0x7feb70129d80 2024-09-12T17:30:57.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.628+0000 7feb74b64640 1 -- 172.21.15.47:0/1298989418 --> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7feb701276b0 con 0x7feb5003de90 2024-09-12T17:30:57.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.639+0000 7feb5effd640 1 -- 172.21.15.47:0/1298989418 <== mgr.4102 v2:172.21.15.170:6824/4146902489 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665573 (secure 0 0 0) 0x7feb640058b0 con 0x7feb5003de90 2024-09-12T17:30:57.648 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:30:57.653 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-09-12T17:30:57.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.644+0000 7feb74b64640 1 -- 172.21.15.47:0/1298989418 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7feb5003de90 msgr2=0x7feb50040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:57.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.644+0000 7feb74b64640 1 --2- 172.21.15.47:0/1298989418 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7feb5003de90 0x7feb50040350 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7feb64007fd0 tx=0x7feb64007aa0 comp rx=0 tx=0).stop 2024-09-12T17:30:57.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.644+0000 7feb74b64640 1 -- 172.21.15.47:0/1298989418 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb70129d80 msgr2=0x7feb701bed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:57.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.644+0000 7feb74b64640 1 --2- 172.21.15.47:0/1298989418 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb70129d80 0x7feb701bed50 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7feb60009d90 tx=0x7feb60004a40 comp rx=0 tx=0).stop 2024-09-12T17:30:57.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.644+0000 7feb74b64640 1 -- 172.21.15.47:0/1298989418 shutdown_connections 2024-09-12T17:30:57.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.644+0000 7feb74b64640 1 --2- 172.21.15.47:0/1298989418 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7feb5003de90 0x7feb50040350 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:30:57.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.644+0000 7feb74b64640 1 --2- 172.21.15.47:0/1298989418 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb70129d80 0x7feb701bed50 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:30:57.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.644+0000 7feb74b64640 1 -- 172.21.15.47:0/1298989418 >> 172.21.15.47:0/1298989418 conn(0x7feb70070850 msgr2=0x7feb70126310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:30:57.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.644+0000 7feb74b64640 1 -- 172.21.15.47:0/1298989418 shutdown_connections 2024-09-12T17:30:57.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.644+0000 7feb74b64640 1 -- 172.21.15.47:0/1298989418 wait complete. 2024-09-12T17:30:57.657 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":134,"stamp":"2024-09-12T17:30:55.792151+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412816,"num_objects":229,"num_object_clones":0,"num_object_copies":458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4911,"num_read_kb":4497,"num_write":2048,"num_write_kb":60586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":482,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4434,"ondisk_log_size":4434,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":182096,"kb_used_data":53200,"kb_used_omap":6,"kb_used_meta":128825,"kb_avail":377305264,"statfs":{"total":386547056640,"available":386360590336,"internally_reserved":0,"allocated":54476800,"data_stored":53331076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":131917590},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25811687,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":522,"num_read_kb":477,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003665"},"pg_stats":[{"pgid":"3.3f","version":"31'2","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.133871+0000","last_change":"2024-09-12T17:28:21.473408+0000","last_active":"2024-09-12T17:30:50.133871+0000","last_peered":"2024-09-12T17:30:50.133871+0000","last_clean":"2024-09-12T17:30:50.133871+0000","last_became_active":"2024-09-12T17:28:21.473004+0000","last_became_peered":"2024-09-12T17:28:21.473004+0000","last_unstale":"2024-09-12T17:30:50.133871+0000","last_undegraded":"2024-09-12T17:30:50.133871+0000","last_fullsized":"2024-09-12T17:30:50.133871+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:27:19.040598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.926869+0000","last_change":"2024-09-12T17:27:42.433458+0000","last_active":"2024-09-12T17:30:49.926869+0000","last_peered":"2024-09-12T17:30:49.926869+0000","last_clean":"2024-09-12T17:30:49.926869+0000","last_became_active":"2024-09-12T17:27:42.433207+0000","last_became_peered":"2024-09-12T17:27:42.433207+0000","last_unstale":"2024-09-12T17:30:49.926869+0000","last_undegraded":"2024-09-12T17:30:49.926869+0000","last_fullsized":"2024-09-12T17:30:49.926869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:10.865332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.473539+0000","last_change":"2024-09-12T17:27:40.419781+0000","last_active":"2024-09-12T17:28:21.473539+0000","last_peered":"2024-09-12T17:28:21.473539+0000","last_clean":"2024-09-12T17:28:21.473539+0000","last_became_active":"2024-09-12T17:27:40.418928+0000","last_became_peered":"2024-09-12T17:27:40.418928+0000","last_unstale":"2024-09-12T17:28:21.473539+0000","last_undegraded":"2024-09-12T17:28:21.473539+0000","last_fullsized":"2024-09-12T17:28:21.473539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:05.211778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"31'6","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.929876+0000","last_change":"2024-09-12T17:27:42.432970+0000","last_active":"2024-09-12T17:30:49.929876+0000","last_peered":"2024-09-12T17:30:49.929876+0000","last_clean":"2024-09-12T17:30:49.929876+0000","last_became_active":"2024-09-12T17:27:42.432677+0000","last_became_peered":"2024-09-12T17:27:42.432677+0000","last_unstale":"2024-09-12T17:30:49.929876+0000","last_undegraded":"2024-09-12T17:30:49.929876+0000","last_fullsized":"2024-09-12T17:30:49.929876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:02.399648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465766+0000","last_change":"2024-09-12T17:27:40.433743+0000","last_active":"2024-09-12T17:28:21.465766+0000","last_peered":"2024-09-12T17:28:21.465766+0000","last_clean":"2024-09-12T17:28:21.465766+0000","last_became_active":"2024-09-12T17:27:40.433470+0000","last_became_peered":"2024-09-12T17:27:40.433470+0000","last_unstale":"2024-09-12T17:28:21.465766+0000","last_undegraded":"2024-09-12T17:28:21.465766+0000","last_fullsized":"2024-09-12T17:28:21.465766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:30.372118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"31'8","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:05.194512+0000","last_change":"2024-09-12T17:27:42.433048+0000","last_active":"2024-09-12T17:29:05.194512+0000","last_peered":"2024-09-12T17:29:05.194512+0000","last_clean":"2024-09-12T17:29:05.194512+0000","last_became_active":"2024-09-12T17:27:42.432736+0000","last_became_peered":"2024-09-12T17:27:42.432736+0000","last_unstale":"2024-09-12T17:29:05.194512+0000","last_undegraded":"2024-09-12T17:29:05.194512+0000","last_fullsized":"2024-09-12T17:29:05.194512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:43.699110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"31'8","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.144210+0000","last_change":"2024-09-12T17:27:40.426931+0000","last_active":"2024-09-12T17:30:50.144210+0000","last_peered":"2024-09-12T17:30:50.144210+0000","last_clean":"2024-09-12T17:30:50.144210+0000","last_became_active":"2024-09-12T17:27:40.426649+0000","last_became_peered":"2024-09-12T17:27:40.426649+0000","last_unstale":"2024-09-12T17:30:50.144210+0000","last_undegraded":"2024-09-12T17:30:50.144210+0000","last_fullsized":"2024-09-12T17:30:50.144210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:02.612906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":18,"num_write":56,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"31'8","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.929278+0000","last_change":"2024-09-12T17:27:42.418772+0000","last_active":"2024-09-12T17:30:49.929278+0000","last_peered":"2024-09-12T17:30:49.929278+0000","last_clean":"2024-09-12T17:30:49.929278+0000","last_became_active":"2024-09-12T17:27:42.418517+0000","last_became_peered":"2024-09-12T17:27:42.418517+0000","last_unstale":"2024-09-12T17:30:49.929278+0000","last_undegraded":"2024-09-12T17:30:49.929278+0000","last_fullsized":"2024-09-12T17:30:49.929278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:38.683188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464584+0000","last_change":"2024-09-12T17:27:40.425244+0000","last_active":"2024-09-12T17:28:21.464584+0000","last_peered":"2024-09-12T17:28:21.464584+0000","last_clean":"2024-09-12T17:28:21.464584+0000","last_became_active":"2024-09-12T17:27:40.424978+0000","last_became_peered":"2024-09-12T17:27:40.424978+0000","last_unstale":"2024-09-12T17:28:21.464584+0000","last_undegraded":"2024-09-12T17:28:21.464584+0000","last_fullsized":"2024-09-12T17:28:21.464584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:04.819015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"31'16","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.148377+0000","last_change":"2024-09-12T17:27:42.424168+0000","last_active":"2024-09-12T17:30:50.148377+0000","last_peered":"2024-09-12T17:30:50.148377+0000","last_clean":"2024-09-12T17:30:50.148377+0000","last_became_active":"2024-09-12T17:27:42.423906+0000","last_became_peered":"2024-09-12T17:27:42.423906+0000","last_unstale":"2024-09-12T17:30:50.148377+0000","last_undegraded":"2024-09-12T17:30:50.148377+0000","last_fullsized":"2024-09-12T17:30:50.148377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:30.717650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.467259+0000","last_change":"2024-09-12T17:27:40.425571+0000","last_active":"2024-09-12T17:28:21.467259+0000","last_peered":"2024-09-12T17:28:21.467259+0000","last_clean":"2024-09-12T17:28:21.467259+0000","last_became_active":"2024-09-12T17:27:40.425308+0000","last_became_peered":"2024-09-12T17:27:40.425308+0000","last_unstale":"2024-09-12T17:28:21.467259+0000","last_undegraded":"2024-09-12T17:28:21.467259+0000","last_fullsized":"2024-09-12T17:28:21.467259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:31.336111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"29'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464656+0000","last_change":"2024-09-12T17:27:42.429057+0000","last_active":"2024-09-12T17:28:21.464656+0000","last_peered":"2024-09-12T17:28:21.464656+0000","last_clean":"2024-09-12T17:28:21.464656+0000","last_became_active":"2024-09-12T17:27:42.428137+0000","last_became_peered":"2024-09-12T17:27:42.428137+0000","last_unstale":"2024-09-12T17:28:21.464656+0000","last_undegraded":"2024-09-12T17:28:21.464656+0000","last_fullsized":"2024-09-12T17:28:21.464656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:30.467192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'3","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:10.769083+0000","last_change":"2024-09-12T17:27:40.427714+0000","last_active":"2024-09-12T17:30:10.769083+0000","last_peered":"2024-09-12T17:30:10.769083+0000","last_clean":"2024-09-12T17:30:10.769083+0000","last_became_active":"2024-09-12T17:27:40.426778+0000","last_became_peered":"2024-09-12T17:27:40.426778+0000","last_unstale":"2024-09-12T17:30:10.769083+0000","last_undegraded":"2024-09-12T17:30:10.769083+0000","last_fullsized":"2024-09-12T17:30:10.769083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:19.867310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"31'18","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:05.377369+0000","last_change":"2024-09-12T17:27:42.434343+0000","last_active":"2024-09-12T17:29:05.377369+0000","last_peered":"2024-09-12T17:29:05.377369+0000","last_clean":"2024-09-12T17:29:05.377369+0000","last_became_active":"2024-09-12T17:27:42.434042+0000","last_became_peered":"2024-09-12T17:27:42.434042+0000","last_unstale":"2024-09-12T17:29:05.377369+0000","last_undegraded":"2024-09-12T17:29:05.377369+0000","last_fullsized":"2024-09-12T17:29:05.377369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:52.600151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":56,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"31'4","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.822317+0000","last_change":"2024-09-12T17:27:40.419315+0000","last_active":"2024-09-12T17:28:21.822317+0000","last_peered":"2024-09-12T17:28:21.822317+0000","last_clean":"2024-09-12T17:28:21.822317+0000","last_became_active":"2024-09-12T17:27:40.418512+0000","last_became_peered":"2024-09-12T17:27:40.418512+0000","last_unstale":"2024-09-12T17:28:21.822317+0000","last_undegraded":"2024-09-12T17:28:21.822317+0000","last_fullsized":"2024-09-12T17:28:21.822317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:08.096897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"31'8","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:22.319704+0000","last_change":"2024-09-12T17:27:42.436453+0000","last_active":"2024-09-12T17:28:22.319704+0000","last_peered":"2024-09-12T17:28:22.319704+0000","last_clean":"2024-09-12T17:28:22.319704+0000","last_became_active":"2024-09-12T17:27:42.436159+0000","last_became_peered":"2024-09-12T17:27:42.436159+0000","last_unstale":"2024-09-12T17:28:22.319704+0000","last_undegraded":"2024-09-12T17:28:22.319704+0000","last_fullsized":"2024-09-12T17:28:22.319704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:16.940321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"31'4","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.226031+0000","last_change":"2024-09-12T17:27:42.433708+0000","last_active":"2024-09-12T17:30:50.226031+0000","last_peered":"2024-09-12T17:30:50.226031+0000","last_clean":"2024-09-12T17:30:50.226031+0000","last_became_active":"2024-09-12T17:27:42.433425+0000","last_became_peered":"2024-09-12T17:27:42.433425+0000","last_unstale":"2024-09-12T17:30:50.226031+0000","last_undegraded":"2024-09-12T17:30:50.226031+0000","last_fullsized":"2024-09-12T17:30:50.226031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:32.794303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470550+0000","last_change":"2024-09-12T17:27:40.417181+0000","last_active":"2024-09-12T17:28:21.470550+0000","last_peered":"2024-09-12T17:28:21.470550+0000","last_clean":"2024-09-12T17:28:21.470550+0000","last_became_active":"2024-09-12T17:27:40.415650+0000","last_became_peered":"2024-09-12T17:27:40.415650+0000","last_unstale":"2024-09-12T17:28:21.470550+0000","last_undegraded":"2024-09-12T17:28:21.470550+0000","last_fullsized":"2024-09-12T17:28:21.470550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:11.303262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468030+0000","last_change":"2024-09-12T17:27:42.427970+0000","last_active":"2024-09-12T17:28:21.468030+0000","last_peered":"2024-09-12T17:28:21.468030+0000","last_clean":"2024-09-12T17:28:21.468030+0000","last_became_active":"2024-09-12T17:27:42.427700+0000","last_became_peered":"2024-09-12T17:27:42.427700+0000","last_unstale":"2024-09-12T17:28:21.468030+0000","last_undegraded":"2024-09-12T17:28:21.468030+0000","last_fullsized":"2024-09-12T17:28:21.468030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:26.167048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:45.824378+0000","last_change":"2024-09-12T17:27:40.432319+0000","last_active":"2024-09-12T17:29:45.824378+0000","last_peered":"2024-09-12T17:29:45.824378+0000","last_clean":"2024-09-12T17:29:45.824378+0000","last_became_active":"2024-09-12T17:27:40.432033+0000","last_became_peered":"2024-09-12T17:27:40.432033+0000","last_unstale":"2024-09-12T17:29:45.824378+0000","last_undegraded":"2024-09-12T17:29:45.824378+0000","last_fullsized":"2024-09-12T17:29:45.824378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:33.541500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"31'3","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:04.760240+0000","last_change":"2024-09-12T17:27:42.428753+0000","last_active":"2024-09-12T17:30:04.760240+0000","last_peered":"2024-09-12T17:30:04.760240+0000","last_clean":"2024-09-12T17:30:04.760240+0000","last_became_active":"2024-09-12T17:27:42.428492+0000","last_became_peered":"2024-09-12T17:27:42.428492+0000","last_unstale":"2024-09-12T17:30:04.760240+0000","last_undegraded":"2024-09-12T17:30:04.760240+0000","last_fullsized":"2024-09-12T17:30:04.760240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:53.463766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"29'2","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.478975+0000","last_change":"2024-09-12T17:28:21.478314+0000","last_active":"2024-09-12T17:28:21.478975+0000","last_peered":"2024-09-12T17:28:21.478975+0000","last_clean":"2024-09-12T17:28:21.478975+0000","last_became_active":"2024-09-12T17:28:21.474758+0000","last_became_peered":"2024-09-12T17:28:21.474758+0000","last_unstale":"2024-09-12T17:28:21.478975+0000","last_undegraded":"2024-09-12T17:28:21.478975+0000","last_fullsized":"2024-09-12T17:28:21.478975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:57.685638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:22.319001+0000","last_change":"2024-09-12T17:27:42.425610+0000","last_active":"2024-09-12T17:28:22.319001+0000","last_peered":"2024-09-12T17:28:22.319001+0000","last_clean":"2024-09-12T17:28:22.319001+0000","last_became_active":"2024-09-12T17:27:42.424738+0000","last_became_peered":"2024-09-12T17:27:42.424738+0000","last_unstale":"2024-09-12T17:28:22.319001+0000","last_undegraded":"2024-09-12T17:28:22.319001+0000","last_fullsized":"2024-09-12T17:28:22.319001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:32.550633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469481+0000","last_change":"2024-09-12T17:27:40.415283+0000","last_active":"2024-09-12T17:28:21.469481+0000","last_peered":"2024-09-12T17:28:21.469481+0000","last_clean":"2024-09-12T17:28:21.469481+0000","last_became_active":"2024-09-12T17:27:40.414669+0000","last_became_peered":"2024-09-12T17:27:40.414669+0000","last_unstale":"2024-09-12T17:28:21.469481+0000","last_undegraded":"2024-09-12T17:28:21.469481+0000","last_fullsized":"2024-09-12T17:28:21.469481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:44.782205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"31'8","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.225695+0000","last_change":"2024-09-12T17:27:42.436197+0000","last_active":"2024-09-12T17:30:50.225695+0000","last_peered":"2024-09-12T17:30:50.225695+0000","last_clean":"2024-09-12T17:30:50.225695+0000","last_became_active":"2024-09-12T17:27:42.435928+0000","last_became_peered":"2024-09-12T17:27:42.435928+0000","last_unstale":"2024-09-12T17:30:50.225695+0000","last_undegraded":"2024-09-12T17:30:50.225695+0000","last_fullsized":"2024-09-12T17:30:50.225695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:08.170045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.889394+0000","last_change":"2024-09-12T17:27:40.420567+0000","last_active":"2024-09-12T17:30:49.889394+0000","last_peered":"2024-09-12T17:30:49.889394+0000","last_clean":"2024-09-12T17:30:49.889394+0000","last_became_active":"2024-09-12T17:27:40.419936+0000","last_became_peered":"2024-09-12T17:27:40.419936+0000","last_unstale":"2024-09-12T17:30:49.889394+0000","last_undegraded":"2024-09-12T17:30:49.889394+0000","last_fullsized":"2024-09-12T17:30:49.889394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:49.941918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"31'5","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:09.761218+0000","last_change":"2024-09-12T17:27:42.423827+0000","last_active":"2024-09-12T17:30:09.761218+0000","last_peered":"2024-09-12T17:30:09.761218+0000","last_clean":"2024-09-12T17:30:09.761218+0000","last_became_active":"2024-09-12T17:27:42.423569+0000","last_became_peered":"2024-09-12T17:27:42.423569+0000","last_unstale":"2024-09-12T17:30:09.761218+0000","last_undegraded":"2024-09-12T17:30:09.761218+0000","last_fullsized":"2024-09-12T17:30:09.761218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:15.384263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.821382+0000","last_change":"2024-09-12T17:27:40.428057+0000","last_active":"2024-09-12T17:28:21.821382+0000","last_peered":"2024-09-12T17:28:21.821382+0000","last_clean":"2024-09-12T17:28:21.821382+0000","last_became_active":"2024-09-12T17:27:40.426721+0000","last_became_peered":"2024-09-12T17:27:40.426721+0000","last_unstale":"2024-09-12T17:28:21.821382+0000","last_undegraded":"2024-09-12T17:28:21.821382+0000","last_fullsized":"2024-09-12T17:28:21.821382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:59.265443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"31'35","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.173308+0000","last_change":"2024-09-12T17:27:50.456507+0000","last_active":"2024-09-12T17:30:50.173308+0000","last_peered":"2024-09-12T17:30:50.173308+0000","last_clean":"2024-09-12T17:30:50.173308+0000","last_became_active":"2024-09-12T17:27:50.456184+0000","last_became_peered":"2024-09-12T17:27:50.456184+0000","last_unstale":"2024-09-12T17:30:50.173308+0000","last_undegraded":"2024-09-12T17:30:50.173308+0000","last_fullsized":"2024-09-12T17:30:50.173308+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:38.608944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"31'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.076531+0000","last_change":"2024-09-12T17:27:42.420958+0000","last_active":"2024-09-12T17:29:49.076531+0000","last_peered":"2024-09-12T17:29:49.076531+0000","last_clean":"2024-09-12T17:29:49.076531+0000","last_became_active":"2024-09-12T17:27:42.420666+0000","last_became_peered":"2024-09-12T17:27:42.420666+0000","last_unstale":"2024-09-12T17:29:49.076531+0000","last_undegraded":"2024-09-12T17:29:49.076531+0000","last_fullsized":"2024-09-12T17:29:49.076531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:15.830207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464196+0000","last_change":"2024-09-12T17:27:40.433530+0000","last_active":"2024-09-12T17:28:21.464196+0000","last_peered":"2024-09-12T17:28:21.464196+0000","last_clean":"2024-09-12T17:28:21.464196+0000","last_became_active":"2024-09-12T17:27:40.433044+0000","last_became_peered":"2024-09-12T17:27:40.433044+0000","last_unstale":"2024-09-12T17:28:21.464196+0000","last_undegraded":"2024-09-12T17:28:21.464196+0000","last_fullsized":"2024-09-12T17:28:21.464196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:34.927105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.473141+0000","last_change":"2024-09-12T17:28:21.472409+0000","last_active":"2024-09-12T17:28:21.473141+0000","last_peered":"2024-09-12T17:28:21.473141+0000","last_clean":"2024-09-12T17:28:21.473141+0000","last_became_active":"2024-09-12T17:28:21.472106+0000","last_became_peered":"2024-09-12T17:28:21.472106+0000","last_unstale":"2024-09-12T17:28:21.473141+0000","last_undegraded":"2024-09-12T17:28:21.473141+0000","last_fullsized":"2024-09-12T17:28:21.473141+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:56.281239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"31'30","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.596107+0000","last_change":"2024-09-12T17:27:46.442394+0000","last_active":"2024-09-12T17:29:47.596107+0000","last_peered":"2024-09-12T17:29:47.596107+0000","last_clean":"2024-09-12T17:29:47.596107+0000","last_became_active":"2024-09-12T17:27:46.441891+0000","last_became_peered":"2024-09-12T17:27:46.441891+0000","last_unstale":"2024-09-12T17:29:47.596107+0000","last_undegraded":"2024-09-12T17:29:47.596107+0000","last_fullsized":"2024-09-12T17:29:47.596107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:29.351398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470059+0000","last_change":"2024-09-12T17:27:48.448380+0000","last_active":"2024-09-12T17:28:21.470059+0000","last_peered":"2024-09-12T17:28:21.470059+0000","last_clean":"2024-09-12T17:28:21.470059+0000","last_became_active":"2024-09-12T17:27:48.448078+0000","last_became_peered":"2024-09-12T17:27:48.448078+0000","last_unstale":"2024-09-12T17:28:21.470059+0000","last_undegraded":"2024-09-12T17:28:21.470059+0000","last_fullsized":"2024-09-12T17:28:21.470059+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:32.578727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"31'7","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:05.200007+0000","last_change":"2024-09-12T17:27:50.457351+0000","last_active":"2024-09-12T17:29:05.200007+0000","last_peered":"2024-09-12T17:29:05.200007+0000","last_clean":"2024-09-12T17:29:05.200007+0000","last_became_active":"2024-09-12T17:27:50.457037+0000","last_became_peered":"2024-09-12T17:27:50.457037+0000","last_unstale":"2024-09-12T17:29:05.200007+0000","last_undegraded":"2024-09-12T17:29:05.200007+0000","last_fullsized":"2024-09-12T17:29:05.200007+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:28.456215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465641+0000","last_change":"2024-09-12T17:27:42.428129+0000","last_active":"2024-09-12T17:28:21.465641+0000","last_peered":"2024-09-12T17:28:21.465641+0000","last_clean":"2024-09-12T17:28:21.465641+0000","last_became_active":"2024-09-12T17:27:42.427872+0000","last_became_peered":"2024-09-12T17:27:42.427872+0000","last_unstale":"2024-09-12T17:28:21.465641+0000","last_undegraded":"2024-09-12T17:28:21.465641+0000","last_fullsized":"2024-09-12T17:28:21.465641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:27.694207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468076+0000","last_change":"2024-09-12T17:27:40.431296+0000","last_active":"2024-09-12T17:28:21.468076+0000","last_peered":"2024-09-12T17:28:21.468076+0000","last_clean":"2024-09-12T17:28:21.468076+0000","last_became_active":"2024-09-12T17:27:40.430969+0000","last_became_peered":"2024-09-12T17:27:40.430969+0000","last_unstale":"2024-09-12T17:28:21.468076+0000","last_undegraded":"2024-09-12T17:28:21.468076+0000","last_fullsized":"2024-09-12T17:28:21.468076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:08.250935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.472166+0000","last_change":"2024-09-12T17:27:44.427938+0000","last_active":"2024-09-12T17:28:21.472166+0000","last_peered":"2024-09-12T17:28:21.472166+0000","last_clean":"2024-09-12T17:28:21.472166+0000","last_became_active":"2024-09-12T17:27:44.427560+0000","last_became_peered":"2024-09-12T17:27:44.427560+0000","last_unstale":"2024-09-12T17:28:21.472166+0000","last_undegraded":"2024-09-12T17:28:21.472166+0000","last_fullsized":"2024-09-12T17:28:21.472166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:08.271249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"29'6","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470141+0000","last_change":"2024-09-12T17:27:46.438703+0000","last_active":"2024-09-12T17:28:21.470141+0000","last_peered":"2024-09-12T17:28:21.470141+0000","last_clean":"2024-09-12T17:28:21.470141+0000","last_became_active":"2024-09-12T17:27:46.436065+0000","last_became_peered":"2024-09-12T17:27:46.436065+0000","last_unstale":"2024-09-12T17:28:21.470141+0000","last_undegraded":"2024-09-12T17:28:21.470141+0000","last_fullsized":"2024-09-12T17:28:21.470141+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:52.392850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466101+0000","last_change":"2024-09-12T17:27:48.441701+0000","last_active":"2024-09-12T17:28:21.466101+0000","last_peered":"2024-09-12T17:28:21.466101+0000","last_clean":"2024-09-12T17:28:21.466101+0000","last_became_active":"2024-09-12T17:27:48.441192+0000","last_became_peered":"2024-09-12T17:27:48.441192+0000","last_unstale":"2024-09-12T17:28:21.466101+0000","last_undegraded":"2024-09-12T17:28:21.466101+0000","last_fullsized":"2024-09-12T17:28:21.466101+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:52.274187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"29'2","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470752+0000","last_change":"2024-09-12T17:27:50.451886+0000","last_active":"2024-09-12T17:28:21.470752+0000","last_peered":"2024-09-12T17:28:21.470752+0000","last_clean":"2024-09-12T17:28:21.470752+0000","last_became_active":"2024-09-12T17:27:50.451589+0000","last_became_peered":"2024-09-12T17:27:50.451589+0000","last_unstale":"2024-09-12T17:28:21.470752+0000","last_undegraded":"2024-09-12T17:28:21.470752+0000","last_fullsized":"2024-09-12T17:28:21.470752+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:53.513569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"31'8","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:22.319420+0000","last_change":"2024-09-12T17:27:42.426651+0000","last_active":"2024-09-12T17:28:22.319420+0000","last_peered":"2024-09-12T17:28:22.319420+0000","last_clean":"2024-09-12T17:28:22.319420+0000","last_became_active":"2024-09-12T17:27:42.426402+0000","last_became_peered":"2024-09-12T17:27:42.426402+0000","last_unstale":"2024-09-12T17:28:22.319420+0000","last_undegraded":"2024-09-12T17:28:22.319420+0000","last_fullsized":"2024-09-12T17:28:22.319420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:24.998663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.032605+0000","last_change":"2024-09-12T17:27:40.428134+0000","last_active":"2024-09-12T17:29:49.032605+0000","last_peered":"2024-09-12T17:29:49.032605+0000","last_clean":"2024-09-12T17:29:49.032605+0000","last_became_active":"2024-09-12T17:27:40.427860+0000","last_became_peered":"2024-09-12T17:27:40.427860+0000","last_unstale":"2024-09-12T17:29:49.032605+0000","last_undegraded":"2024-09-12T17:29:49.032605+0000","last_fullsized":"2024-09-12T17:29:49.032605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:15.255295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.474373+0000","last_change":"2024-09-12T17:27:44.431340+0000","last_active":"2024-09-12T17:28:21.474373+0000","last_peered":"2024-09-12T17:28:21.474373+0000","last_clean":"2024-09-12T17:28:21.474373+0000","last_became_active":"2024-09-12T17:27:44.430879+0000","last_became_peered":"2024-09-12T17:27:44.430879+0000","last_unstale":"2024-09-12T17:28:21.474373+0000","last_undegraded":"2024-09-12T17:28:21.474373+0000","last_fullsized":"2024-09-12T17:28:21.474373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:31.240889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"29'10","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.467842+0000","last_change":"2024-09-12T17:27:46.440472+0000","last_active":"2024-09-12T17:28:21.467842+0000","last_peered":"2024-09-12T17:28:21.467842+0000","last_clean":"2024-09-12T17:28:21.467842+0000","last_became_active":"2024-09-12T17:27:46.440203+0000","last_became_peered":"2024-09-12T17:27:46.440203+0000","last_unstale":"2024-09-12T17:28:21.467842+0000","last_undegraded":"2024-09-12T17:28:21.467842+0000","last_fullsized":"2024-09-12T17:28:21.467842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:58.292808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"31'282","reported_seq":405,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.511610+0000","last_change":"2024-09-12T17:27:48.451526+0000","last_active":"2024-09-12T17:30:49.511610+0000","last_peered":"2024-09-12T17:30:49.511610+0000","last_clean":"2024-09-12T17:30:49.511610+0000","last_became_active":"2024-09-12T17:27:48.450897+0000","last_became_peered":"2024-09-12T17:27:48.450897+0000","last_unstale":"2024-09-12T17:30:49.511610+0000","last_undegraded":"2024-09-12T17:30:49.511610+0000","last_fullsized":"2024-09-12T17:30:49.511610+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:24.867772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468002+0000","last_change":"2024-09-12T17:27:50.456983+0000","last_active":"2024-09-12T17:28:21.468002+0000","last_peered":"2024-09-12T17:28:21.468002+0000","last_clean":"2024-09-12T17:28:21.468002+0000","last_became_active":"2024-09-12T17:27:50.456376+0000","last_became_peered":"2024-09-12T17:27:50.456376+0000","last_unstale":"2024-09-12T17:28:21.468002+0000","last_undegraded":"2024-09-12T17:28:21.468002+0000","last_fullsized":"2024-09-12T17:28:21.468002+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:07.847747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"31'12","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.926558+0000","last_change":"2024-09-12T17:27:42.426373+0000","last_active":"2024-09-12T17:30:49.926558+0000","last_peered":"2024-09-12T17:30:49.926558+0000","last_clean":"2024-09-12T17:30:49.926558+0000","last_became_active":"2024-09-12T17:27:42.426060+0000","last_became_peered":"2024-09-12T17:27:42.426060+0000","last_unstale":"2024-09-12T17:30:49.926558+0000","last_undegraded":"2024-09-12T17:30:49.926558+0000","last_fullsized":"2024-09-12T17:30:49.926558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:54.699865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468564+0000","last_change":"2024-09-12T17:27:40.423578+0000","last_active":"2024-09-12T17:28:21.468564+0000","last_peered":"2024-09-12T17:28:21.468564+0000","last_clean":"2024-09-12T17:28:21.468564+0000","last_became_active":"2024-09-12T17:27:40.415702+0000","last_became_peered":"2024-09-12T17:27:40.415702+0000","last_unstale":"2024-09-12T17:28:21.468564+0000","last_undegraded":"2024-09-12T17:28:21.468564+0000","last_fullsized":"2024-09-12T17:28:21.468564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:05.858479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465273+0000","last_change":"2024-09-12T17:27:44.428855+0000","last_active":"2024-09-12T17:28:21.465273+0000","last_peered":"2024-09-12T17:28:21.465273+0000","last_clean":"2024-09-12T17:28:21.465273+0000","last_became_active":"2024-09-12T17:27:44.428526+0000","last_became_peered":"2024-09-12T17:27:44.428526+0000","last_unstale":"2024-09-12T17:28:21.465273+0000","last_undegraded":"2024-09-12T17:28:21.465273+0000","last_fullsized":"2024-09-12T17:28:21.465273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:22.407461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"31'30","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.590773+0000","last_change":"2024-09-12T17:27:46.441041+0000","last_active":"2024-09-12T17:29:47.590773+0000","last_peered":"2024-09-12T17:29:47.590773+0000","last_clean":"2024-09-12T17:29:47.590773+0000","last_became_active":"2024-09-12T17:27:46.440765+0000","last_became_peered":"2024-09-12T17:27:46.440765+0000","last_unstale":"2024-09-12T17:29:47.590773+0000","last_undegraded":"2024-09-12T17:29:47.590773+0000","last_fullsized":"2024-09-12T17:29:47.590773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:14.176389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"31'282","reported_seq":436,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.230811+0000","last_change":"2024-09-12T17:27:48.440009+0000","last_active":"2024-09-12T17:30:50.230811+0000","last_peered":"2024-09-12T17:30:50.230811+0000","last_clean":"2024-09-12T17:30:50.230811+0000","last_became_active":"2024-09-12T17:27:48.439642+0000","last_became_peered":"2024-09-12T17:27:48.439642+0000","last_unstale":"2024-09-12T17:30:50.230811+0000","last_undegraded":"2024-09-12T17:30:50.230811+0000","last_fullsized":"2024-09-12T17:30:50.230811+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:06.242670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"31'12","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.225652+0000","last_change":"2024-09-12T17:27:42.428634+0000","last_active":"2024-09-12T17:30:50.225652+0000","last_peered":"2024-09-12T17:30:50.225652+0000","last_clean":"2024-09-12T17:30:50.225652+0000","last_became_active":"2024-09-12T17:27:42.427990+0000","last_became_peered":"2024-09-12T17:27:42.427990+0000","last_unstale":"2024-09-12T17:30:50.225652+0000","last_undegraded":"2024-09-12T17:30:50.225652+0000","last_fullsized":"2024-09-12T17:30:50.225652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:27:19.215981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"29'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468356+0000","last_change":"2024-09-12T17:27:40.429060+0000","last_active":"2024-09-12T17:28:21.468356+0000","last_peered":"2024-09-12T17:28:21.468356+0000","last_clean":"2024-09-12T17:28:21.468356+0000","last_became_active":"2024-09-12T17:27:40.428462+0000","last_became_peered":"2024-09-12T17:27:40.428462+0000","last_unstale":"2024-09-12T17:28:21.468356+0000","last_undegraded":"2024-09-12T17:28:21.468356+0000","last_fullsized":"2024-09-12T17:28:21.468356+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:45.872253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468175+0000","last_change":"2024-09-12T17:27:44.433155+0000","last_active":"2024-09-12T17:28:21.468175+0000","last_peered":"2024-09-12T17:28:21.468175+0000","last_clean":"2024-09-12T17:28:21.468175+0000","last_became_active":"2024-09-12T17:27:44.431911+0000","last_became_peered":"2024-09-12T17:27:44.431911+0000","last_unstale":"2024-09-12T17:28:21.468175+0000","last_undegraded":"2024-09-12T17:28:21.468175+0000","last_fullsized":"2024-09-12T17:28:21.468175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:16.971114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"31'41","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.599915+0000","last_change":"2024-09-12T17:27:46.439466+0000","last_active":"2024-09-12T17:29:47.599915+0000","last_peered":"2024-09-12T17:29:47.599915+0000","last_clean":"2024-09-12T17:29:47.599915+0000","last_became_active":"2024-09-12T17:27:46.439188+0000","last_became_peered":"2024-09-12T17:27:46.439188+0000","last_unstale":"2024-09-12T17:29:47.599915+0000","last_undegraded":"2024-09-12T17:29:47.599915+0000","last_fullsized":"2024-09-12T17:29:47.599915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:25.881248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471714+0000","last_change":"2024-09-12T17:27:48.441917+0000","last_active":"2024-09-12T17:28:21.471714+0000","last_peered":"2024-09-12T17:28:21.471714+0000","last_clean":"2024-09-12T17:28:21.471714+0000","last_became_active":"2024-09-12T17:27:48.441618+0000","last_became_peered":"2024-09-12T17:27:48.441618+0000","last_unstale":"2024-09-12T17:28:21.471714+0000","last_undegraded":"2024-09-12T17:28:21.471714+0000","last_fullsized":"2024-09-12T17:28:21.471714+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:17.256348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"31'7","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.198792+0000","last_change":"2024-09-12T17:27:50.457616+0000","last_active":"2024-09-12T17:30:50.198792+0000","last_peered":"2024-09-12T17:30:50.198792+0000","last_clean":"2024-09-12T17:30:50.198792+0000","last_became_active":"2024-09-12T17:27:50.457350+0000","last_became_peered":"2024-09-12T17:27:50.457350+0000","last_unstale":"2024-09-12T17:30:50.198792+0000","last_undegraded":"2024-09-12T17:30:50.198792+0000","last_fullsized":"2024-09-12T17:30:50.198792+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:39.806321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"31'20","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.148556+0000","last_change":"2024-09-12T17:27:42.424787+0000","last_active":"2024-09-12T17:30:50.148556+0000","last_peered":"2024-09-12T17:30:50.148556+0000","last_clean":"2024-09-12T17:30:50.148556+0000","last_became_active":"2024-09-12T17:27:42.424268+0000","last_became_peered":"2024-09-12T17:27:42.424268+0000","last_unstale":"2024-09-12T17:30:50.148556+0000","last_undegraded":"2024-09-12T17:30:50.148556+0000","last_fullsized":"2024-09-12T17:30:50.148556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:10.726972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":75,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469727+0000","last_change":"2024-09-12T17:27:40.427959+0000","last_active":"2024-09-12T17:28:21.469727+0000","last_peered":"2024-09-12T17:28:21.469727+0000","last_clean":"2024-09-12T17:28:21.469727+0000","last_became_active":"2024-09-12T17:27:40.427677+0000","last_became_peered":"2024-09-12T17:27:40.427677+0000","last_unstale":"2024-09-12T17:28:21.469727+0000","last_undegraded":"2024-09-12T17:28:21.469727+0000","last_fullsized":"2024-09-12T17:28:21.469727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:13.997279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471294+0000","last_change":"2024-09-12T17:27:44.434751+0000","last_active":"2024-09-12T17:28:21.471294+0000","last_peered":"2024-09-12T17:28:21.471294+0000","last_clean":"2024-09-12T17:28:21.471294+0000","last_became_active":"2024-09-12T17:27:44.434433+0000","last_became_peered":"2024-09-12T17:27:44.434433+0000","last_unstale":"2024-09-12T17:28:21.471294+0000","last_undegraded":"2024-09-12T17:28:21.471294+0000","last_fullsized":"2024-09-12T17:28:21.471294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:00.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"31'30","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.580910+0000","last_change":"2024-09-12T17:27:46.442854+0000","last_active":"2024-09-12T17:29:47.580910+0000","last_peered":"2024-09-12T17:29:47.580910+0000","last_clean":"2024-09-12T17:29:47.580910+0000","last_became_active":"2024-09-12T17:27:46.442572+0000","last_became_peered":"2024-09-12T17:27:46.442572+0000","last_unstale":"2024-09-12T17:29:47.580910+0000","last_undegraded":"2024-09-12T17:29:47.580910+0000","last_fullsized":"2024-09-12T17:29:47.580910+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:49.755366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470885+0000","last_change":"2024-09-12T17:27:48.445793+0000","last_active":"2024-09-12T17:28:21.470885+0000","last_peered":"2024-09-12T17:28:21.470885+0000","last_clean":"2024-09-12T17:28:21.470885+0000","last_became_active":"2024-09-12T17:27:48.445502+0000","last_became_peered":"2024-09-12T17:27:48.445502+0000","last_unstale":"2024-09-12T17:28:21.470885+0000","last_undegraded":"2024-09-12T17:28:21.470885+0000","last_fullsized":"2024-09-12T17:28:21.470885+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:17.142197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"31'9","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.283385+0000","last_change":"2024-09-12T17:27:50.458007+0000","last_active":"2024-09-12T17:30:50.283385+0000","last_peered":"2024-09-12T17:30:50.283385+0000","last_clean":"2024-09-12T17:30:50.283385+0000","last_became_active":"2024-09-12T17:27:50.457691+0000","last_became_peered":"2024-09-12T17:27:50.457691+0000","last_unstale":"2024-09-12T17:30:50.283385+0000","last_undegraded":"2024-09-12T17:30:50.283385+0000","last_fullsized":"2024-09-12T17:30:50.283385+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:51.065237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":23,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"31'7","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.203773+0000","last_change":"2024-09-12T17:27:42.436839+0000","last_active":"2024-09-12T17:30:50.203773+0000","last_peered":"2024-09-12T17:30:50.203773+0000","last_clean":"2024-09-12T17:30:50.203773+0000","last_became_active":"2024-09-12T17:27:42.436517+0000","last_became_peered":"2024-09-12T17:27:42.436517+0000","last_unstale":"2024-09-12T17:30:50.203773+0000","last_undegraded":"2024-09-12T17:30:50.203773+0000","last_fullsized":"2024-09-12T17:30:50.203773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:56.329169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465301+0000","last_change":"2024-09-12T17:27:40.429917+0000","last_active":"2024-09-12T17:28:21.465301+0000","last_peered":"2024-09-12T17:28:21.465301+0000","last_clean":"2024-09-12T17:28:21.465301+0000","last_became_active":"2024-09-12T17:27:40.429663+0000","last_became_peered":"2024-09-12T17:27:40.429663+0000","last_unstale":"2024-09-12T17:28:21.465301+0000","last_undegraded":"2024-09-12T17:28:21.465301+0000","last_fullsized":"2024-09-12T17:28:21.465301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:01.771644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.473204+0000","last_change":"2024-09-12T17:27:44.431117+0000","last_active":"2024-09-12T17:28:21.473204+0000","last_peered":"2024-09-12T17:28:21.473204+0000","last_clean":"2024-09-12T17:28:21.473204+0000","last_became_active":"2024-09-12T17:27:44.430772+0000","last_became_peered":"2024-09-12T17:27:44.430772+0000","last_unstale":"2024-09-12T17:28:21.473204+0000","last_undegraded":"2024-09-12T17:28:21.473204+0000","last_fullsized":"2024-09-12T17:28:21.473204+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:11.871540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"31'37","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.601873+0000","last_change":"2024-09-12T17:27:46.444540+0000","last_active":"2024-09-12T17:29:47.601873+0000","last_peered":"2024-09-12T17:29:47.601873+0000","last_clean":"2024-09-12T17:29:47.601873+0000","last_became_active":"2024-09-12T17:27:46.444206+0000","last_became_peered":"2024-09-12T17:27:46.444206+0000","last_unstale":"2024-09-12T17:29:47.601873+0000","last_undegraded":"2024-09-12T17:29:47.601873+0000","last_fullsized":"2024-09-12T17:29:47.601873+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:06.613276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"31'282","reported_seq":398,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.354623+0000","last_change":"2024-09-12T17:27:48.448090+0000","last_active":"2024-09-12T17:30:50.354623+0000","last_peered":"2024-09-12T17:30:50.354623+0000","last_clean":"2024-09-12T17:30:50.354623+0000","last_became_active":"2024-09-12T17:27:48.447724+0000","last_became_peered":"2024-09-12T17:27:48.447724+0000","last_unstale":"2024-09-12T17:30:50.354623+0000","last_undegraded":"2024-09-12T17:30:50.354623+0000","last_fullsized":"2024-09-12T17:30:50.354623+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:37.632389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"31'4","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.183333+0000","last_change":"2024-09-12T17:27:50.451958+0000","last_active":"2024-09-12T17:30:50.183333+0000","last_peered":"2024-09-12T17:30:50.183333+0000","last_clean":"2024-09-12T17:30:50.183333+0000","last_became_active":"2024-09-12T17:27:50.451716+0000","last_became_peered":"2024-09-12T17:27:50.451716+0000","last_unstale":"2024-09-12T17:30:50.183333+0000","last_undegraded":"2024-09-12T17:30:50.183333+0000","last_fullsized":"2024-09-12T17:30:50.183333+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:28.075990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"31'4","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.018397+0000","last_change":"2024-09-12T17:27:42.429925+0000","last_active":"2024-09-12T17:30:50.018397+0000","last_peered":"2024-09-12T17:30:50.018397+0000","last_clean":"2024-09-12T17:30:50.018397+0000","last_became_active":"2024-09-12T17:27:42.429624+0000","last_became_peered":"2024-09-12T17:27:42.429624+0000","last_unstale":"2024-09-12T17:30:50.018397+0000","last_undegraded":"2024-09-12T17:30:50.018397+0000","last_fullsized":"2024-09-12T17:30:50.018397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:10.865332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464374+0000","last_change":"2024-09-12T17:27:40.424281+0000","last_active":"2024-09-12T17:28:21.464374+0000","last_peered":"2024-09-12T17:28:21.464374+0000","last_clean":"2024-09-12T17:28:21.464374+0000","last_became_active":"2024-09-12T17:27:40.423291+0000","last_became_peered":"2024-09-12T17:27:40.423291+0000","last_unstale":"2024-09-12T17:28:21.464374+0000","last_undegraded":"2024-09-12T17:28:21.464374+0000","last_fullsized":"2024-09-12T17:28:21.464374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:45.581275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471823+0000","last_change":"2024-09-12T17:27:44.430889+0000","last_active":"2024-09-12T17:28:21.471823+0000","last_peered":"2024-09-12T17:28:21.471823+0000","last_clean":"2024-09-12T17:28:21.471823+0000","last_became_active":"2024-09-12T17:27:44.430549+0000","last_became_peered":"2024-09-12T17:27:44.430549+0000","last_unstale":"2024-09-12T17:28:21.471823+0000","last_undegraded":"2024-09-12T17:28:21.471823+0000","last_fullsized":"2024-09-12T17:28:21.471823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:53.357220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"31'55","reported_seq":112,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:55.766229+0000","last_change":"2024-09-12T17:27:46.441393+0000","last_active":"2024-09-12T17:29:55.766229+0000","last_peered":"2024-09-12T17:29:55.766229+0000","last_clean":"2024-09-12T17:29:55.766229+0000","last_became_active":"2024-09-12T17:27:46.440805+0000","last_became_peered":"2024-09-12T17:27:46.440805+0000","last_unstale":"2024-09-12T17:29:55.766229+0000","last_undegraded":"2024-09-12T17:29:55.766229+0000","last_fullsized":"2024-09-12T17:29:55.766229+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:26.523623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5916,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":51,"num_read_kb":42,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471161+0000","last_change":"2024-09-12T17:27:48.443214+0000","last_active":"2024-09-12T17:28:21.471161+0000","last_peered":"2024-09-12T17:28:21.471161+0000","last_clean":"2024-09-12T17:28:21.471161+0000","last_became_active":"2024-09-12T17:27:48.442880+0000","last_became_peered":"2024-09-12T17:27:48.442880+0000","last_unstale":"2024-09-12T17:28:21.471161+0000","last_undegraded":"2024-09-12T17:28:21.471161+0000","last_fullsized":"2024-09-12T17:28:21.471161+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:45.787562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"31'20","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.331059+0000","last_change":"2024-09-12T17:27:50.454666+0000","last_active":"2024-09-12T17:30:50.331059+0000","last_peered":"2024-09-12T17:30:50.331059+0000","last_clean":"2024-09-12T17:30:50.331059+0000","last_became_active":"2024-09-12T17:27:50.454410+0000","last_became_peered":"2024-09-12T17:27:50.454410+0000","last_unstale":"2024-09-12T17:30:50.331059+0000","last_undegraded":"2024-09-12T17:30:50.331059+0000","last_fullsized":"2024-09-12T17:30:50.331059+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:12:29.329426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"31'10","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.225780+0000","last_change":"2024-09-12T17:27:42.436173+0000","last_active":"2024-09-12T17:30:50.225780+0000","last_peered":"2024-09-12T17:30:50.225780+0000","last_clean":"2024-09-12T17:30:50.225780+0000","last_became_active":"2024-09-12T17:27:42.435913+0000","last_became_peered":"2024-09-12T17:27:42.435913+0000","last_unstale":"2024-09-12T17:30:50.225780+0000","last_undegraded":"2024-09-12T17:30:50.225780+0000","last_fullsized":"2024-09-12T17:30:50.225780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:49.886133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.472093+0000","last_change":"2024-09-12T17:27:40.416125+0000","last_active":"2024-09-12T17:28:21.472093+0000","last_peered":"2024-09-12T17:28:21.472093+0000","last_clean":"2024-09-12T17:28:21.472093+0000","last_became_active":"2024-09-12T17:27:40.415703+0000","last_became_peered":"2024-09-12T17:27:40.415703+0000","last_unstale":"2024-09-12T17:28:21.472093+0000","last_undegraded":"2024-09-12T17:28:21.472093+0000","last_fullsized":"2024-09-12T17:28:21.472093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:40.086345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466635+0000","last_change":"2024-09-12T17:27:44.432984+0000","last_active":"2024-09-12T17:28:21.466635+0000","last_peered":"2024-09-12T17:28:21.466635+0000","last_clean":"2024-09-12T17:28:21.466635+0000","last_became_active":"2024-09-12T17:27:44.432588+0000","last_became_peered":"2024-09-12T17:27:44.432588+0000","last_unstale":"2024-09-12T17:28:21.466635+0000","last_undegraded":"2024-09-12T17:28:21.466635+0000","last_fullsized":"2024-09-12T17:28:21.466635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:09.951474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"31'32","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.584787+0000","last_change":"2024-09-12T17:27:46.432654+0000","last_active":"2024-09-12T17:29:47.584787+0000","last_peered":"2024-09-12T17:29:47.584787+0000","last_clean":"2024-09-12T17:29:47.584787+0000","last_became_active":"2024-09-12T17:27:46.432354+0000","last_became_peered":"2024-09-12T17:27:46.432354+0000","last_unstale":"2024-09-12T17:29:47.584787+0000","last_undegraded":"2024-09-12T17:29:47.584787+0000","last_fullsized":"2024-09-12T17:29:47.584787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:14.062258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466117+0000","last_change":"2024-09-12T17:27:48.451776+0000","last_active":"2024-09-12T17:28:21.466117+0000","last_peered":"2024-09-12T17:28:21.466117+0000","last_clean":"2024-09-12T17:28:21.466117+0000","last_became_active":"2024-09-12T17:27:48.451510+0000","last_became_peered":"2024-09-12T17:27:48.451510+0000","last_unstale":"2024-09-12T17:28:21.466117+0000","last_undegraded":"2024-09-12T17:28:21.466117+0000","last_fullsized":"2024-09-12T17:28:21.466117+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:01.787546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"31'7","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:50.765214+0000","last_change":"2024-09-12T17:27:50.455419+0000","last_active":"2024-09-12T17:29:50.765214+0000","last_peered":"2024-09-12T17:29:50.765214+0000","last_clean":"2024-09-12T17:29:50.765214+0000","last_became_active":"2024-09-12T17:27:50.454890+0000","last_became_peered":"2024-09-12T17:27:50.454890+0000","last_unstale":"2024-09-12T17:29:50.765214+0000","last_undegraded":"2024-09-12T17:29:50.765214+0000","last_fullsized":"2024-09-12T17:29:50.765214+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:50.422624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"31'8","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.196877+0000","last_change":"2024-09-12T17:27:42.440511+0000","last_active":"2024-09-12T17:30:50.196877+0000","last_peered":"2024-09-12T17:30:50.196877+0000","last_clean":"2024-09-12T17:30:50.196877+0000","last_became_active":"2024-09-12T17:27:42.440204+0000","last_became_peered":"2024-09-12T17:27:42.440204+0000","last_unstale":"2024-09-12T17:30:50.196877+0000","last_undegraded":"2024-09-12T17:30:50.196877+0000","last_fullsized":"2024-09-12T17:30:50.196877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:11.628797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464148+0000","last_change":"2024-09-12T17:27:40.428533+0000","last_active":"2024-09-12T17:28:21.464148+0000","last_peered":"2024-09-12T17:28:21.464148+0000","last_clean":"2024-09-12T17:28:21.464148+0000","last_became_active":"2024-09-12T17:27:40.428232+0000","last_became_peered":"2024-09-12T17:27:40.428232+0000","last_unstale":"2024-09-12T17:28:21.464148+0000","last_undegraded":"2024-09-12T17:28:21.464148+0000","last_fullsized":"2024-09-12T17:28:21.464148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:38.394799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.473721+0000","last_change":"2024-09-12T17:27:44.432569+0000","last_active":"2024-09-12T17:28:21.473721+0000","last_peered":"2024-09-12T17:28:21.473721+0000","last_clean":"2024-09-12T17:28:21.473721+0000","last_became_active":"2024-09-12T17:27:44.432211+0000","last_became_peered":"2024-09-12T17:27:44.432211+0000","last_unstale":"2024-09-12T17:28:21.473721+0000","last_undegraded":"2024-09-12T17:28:21.473721+0000","last_fullsized":"2024-09-12T17:28:21.473721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:13.176204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"31'36","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.610036+0000","last_change":"2024-09-12T17:27:46.433953+0000","last_active":"2024-09-12T17:29:47.610036+0000","last_peered":"2024-09-12T17:29:47.610036+0000","last_clean":"2024-09-12T17:29:47.610036+0000","last_became_active":"2024-09-12T17:27:46.433672+0000","last_became_peered":"2024-09-12T17:27:46.433672+0000","last_unstale":"2024-09-12T17:29:47.610036+0000","last_undegraded":"2024-09-12T17:29:47.610036+0000","last_fullsized":"2024-09-12T17:29:47.610036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:55.924502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"31'282","reported_seq":404,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.335012+0000","last_change":"2024-09-12T17:27:48.440623+0000","last_active":"2024-09-12T17:30:50.335012+0000","last_peered":"2024-09-12T17:30:50.335012+0000","last_clean":"2024-09-12T17:30:50.335012+0000","last_became_active":"2024-09-12T17:27:48.440335+0000","last_became_peered":"2024-09-12T17:27:48.440335+0000","last_unstale":"2024-09-12T17:30:50.335012+0000","last_undegraded":"2024-09-12T17:30:50.335012+0000","last_fullsized":"2024-09-12T17:30:50.335012+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:20.544074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"31'12","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:54.758294+0000","last_change":"2024-09-12T17:27:50.449089+0000","last_active":"2024-09-12T17:29:54.758294+0000","last_peered":"2024-09-12T17:29:54.758294+0000","last_clean":"2024-09-12T17:29:54.758294+0000","last_became_active":"2024-09-12T17:27:50.448680+0000","last_became_peered":"2024-09-12T17:27:50.448680+0000","last_unstale":"2024-09-12T17:29:54.758294+0000","last_undegraded":"2024-09-12T17:29:54.758294+0000","last_fullsized":"2024-09-12T17:29:54.758294+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:01.786654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.473949+0000","last_change":"2024-09-12T17:28:21.473062+0000","last_active":"2024-09-12T17:28:21.473949+0000","last_peered":"2024-09-12T17:28:21.473949+0000","last_clean":"2024-09-12T17:28:21.473949+0000","last_became_active":"2024-09-12T17:28:21.472744+0000","last_became_peered":"2024-09-12T17:28:21.472744+0000","last_unstale":"2024-09-12T17:28:21.473949+0000","last_undegraded":"2024-09-12T17:28:21.473949+0000","last_fullsized":"2024-09-12T17:28:21.473949+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:30.333530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.221504+0000","last_change":"2024-09-12T17:27:40.428769+0000","last_active":"2024-09-12T17:30:50.221504+0000","last_peered":"2024-09-12T17:30:50.221504+0000","last_clean":"2024-09-12T17:30:50.221504+0000","last_became_active":"2024-09-12T17:27:40.428512+0000","last_became_peered":"2024-09-12T17:27:40.428512+0000","last_unstale":"2024-09-12T17:30:50.221504+0000","last_undegraded":"2024-09-12T17:30:50.221504+0000","last_fullsized":"2024-09-12T17:30:50.221504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:45.757419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'3","reported_seq":414,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:48.725548+0000","last_change":"2024-09-12T17:27:44.430169+0000","last_active":"2024-09-12T17:29:48.725548+0000","last_peered":"2024-09-12T17:29:48.725548+0000","last_clean":"2024-09-12T17:29:48.725548+0000","last_became_active":"2024-09-12T17:27:44.429844+0000","last_became_peered":"2024-09-12T17:27:44.429844+0000","last_unstale":"2024-09-12T17:29:48.725548+0000","last_undegraded":"2024-09-12T17:29:48.725548+0000","last_fullsized":"2024-09-12T17:29:48.725548+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:19.512968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464478+0000","last_change":"2024-09-12T17:27:46.439449+0000","last_active":"2024-09-12T17:28:21.464478+0000","last_peered":"2024-09-12T17:28:21.464478+0000","last_clean":"2024-09-12T17:28:21.464478+0000","last_became_active":"2024-09-12T17:27:46.439153+0000","last_became_peered":"2024-09-12T17:27:46.439153+0000","last_unstale":"2024-09-12T17:28:21.464478+0000","last_undegraded":"2024-09-12T17:28:21.464478+0000","last_fullsized":"2024-09-12T17:28:21.464478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:53.118909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"31'282","reported_seq":460,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.285437+0000","last_change":"2024-09-12T17:27:48.441400+0000","last_active":"2024-09-12T17:30:50.285437+0000","last_peered":"2024-09-12T17:30:50.285437+0000","last_clean":"2024-09-12T17:30:50.285437+0000","last_became_active":"2024-09-12T17:27:48.441024+0000","last_became_peered":"2024-09-12T17:27:48.441024+0000","last_unstale":"2024-09-12T17:30:50.285437+0000","last_undegraded":"2024-09-12T17:30:50.285437+0000","last_fullsized":"2024-09-12T17:30:50.285437+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:09.672456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'4","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:48.859981+0000","last_change":"2024-09-12T17:27:50.452031+0000","last_active":"2024-09-12T17:29:48.859981+0000","last_peered":"2024-09-12T17:29:48.859981+0000","last_clean":"2024-09-12T17:29:48.859981+0000","last_became_active":"2024-09-12T17:27:50.451743+0000","last_became_peered":"2024-09-12T17:27:50.451743+0000","last_unstale":"2024-09-12T17:29:48.859981+0000","last_undegraded":"2024-09-12T17:29:48.859981+0000","last_fullsized":"2024-09-12T17:29:48.859981+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:24:17.073385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470933+0000","last_change":"2024-09-12T17:27:42.438842+0000","last_active":"2024-09-12T17:28:21.470933+0000","last_peered":"2024-09-12T17:28:21.470933+0000","last_clean":"2024-09-12T17:28:21.470933+0000","last_became_active":"2024-09-12T17:27:42.438566+0000","last_became_peered":"2024-09-12T17:27:42.438566+0000","last_unstale":"2024-09-12T17:28:21.470933+0000","last_undegraded":"2024-09-12T17:28:21.470933+0000","last_fullsized":"2024-09-12T17:28:21.470933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:08.054821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"31'1","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:50.765235+0000","last_change":"2024-09-12T17:27:40.430157+0000","last_active":"2024-09-12T17:29:50.765235+0000","last_peered":"2024-09-12T17:29:50.765235+0000","last_clean":"2024-09-12T17:29:50.765235+0000","last_became_active":"2024-09-12T17:27:40.429902+0000","last_became_peered":"2024-09-12T17:27:40.429902+0000","last_unstale":"2024-09-12T17:29:50.765235+0000","last_undegraded":"2024-09-12T17:29:50.765235+0000","last_fullsized":"2024-09-12T17:29:50.765235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:03.993235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465147+0000","last_change":"2024-09-12T17:27:44.431499+0000","last_active":"2024-09-12T17:28:21.465147+0000","last_peered":"2024-09-12T17:28:21.465147+0000","last_clean":"2024-09-12T17:28:21.465147+0000","last_became_active":"2024-09-12T17:27:44.431180+0000","last_became_peered":"2024-09-12T17:27:44.431180+0000","last_unstale":"2024-09-12T17:28:21.465147+0000","last_undegraded":"2024-09-12T17:28:21.465147+0000","last_fullsized":"2024-09-12T17:28:21.465147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:36.937417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"31'40","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.597133+0000","last_change":"2024-09-12T17:27:46.431873+0000","last_active":"2024-09-12T17:29:47.597133+0000","last_peered":"2024-09-12T17:29:47.597133+0000","last_clean":"2024-09-12T17:29:47.597133+0000","last_became_active":"2024-09-12T17:27:46.431599+0000","last_became_peered":"2024-09-12T17:27:46.431599+0000","last_unstale":"2024-09-12T17:29:47.597133+0000","last_undegraded":"2024-09-12T17:29:47.597133+0000","last_fullsized":"2024-09-12T17:29:47.597133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:08.059866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":52,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.467064+0000","last_change":"2024-09-12T17:27:48.447644+0000","last_active":"2024-09-12T17:28:21.467064+0000","last_peered":"2024-09-12T17:28:21.467064+0000","last_clean":"2024-09-12T17:28:21.467064+0000","last_became_active":"2024-09-12T17:27:48.447331+0000","last_became_peered":"2024-09-12T17:27:48.447331+0000","last_unstale":"2024-09-12T17:28:21.467064+0000","last_undegraded":"2024-09-12T17:28:21.467064+0000","last_fullsized":"2024-09-12T17:28:21.467064+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:15.622749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"31'6","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.260811+0000","last_change":"2024-09-12T17:27:50.448120+0000","last_active":"2024-09-12T17:30:50.260811+0000","last_peered":"2024-09-12T17:30:50.260811+0000","last_clean":"2024-09-12T17:30:50.260811+0000","last_became_active":"2024-09-12T17:27:50.447855+0000","last_became_peered":"2024-09-12T17:27:50.447855+0000","last_unstale":"2024-09-12T17:30:50.260811+0000","last_undegraded":"2024-09-12T17:30:50.260811+0000","last_fullsized":"2024-09-12T17:30:50.260811+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:45:37.063333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"31'14","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.225785+0000","last_change":"2024-09-12T17:27:42.438563+0000","last_active":"2024-09-12T17:30:50.225785+0000","last_peered":"2024-09-12T17:30:50.225785+0000","last_clean":"2024-09-12T17:30:50.225785+0000","last_became_active":"2024-09-12T17:27:42.438270+0000","last_became_peered":"2024-09-12T17:27:42.438270+0000","last_unstale":"2024-09-12T17:30:50.225785+0000","last_undegraded":"2024-09-12T17:30:50.225785+0000","last_fullsized":"2024-09-12T17:30:50.225785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:24.762523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'72","reported_seq":142,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468423+0000","last_change":"2024-09-12T17:27:25.975511+0000","last_active":"2024-09-12T17:28:21.468423+0000","last_peered":"2024-09-12T17:28:21.468423+0000","last_clean":"2024-09-12T17:28:21.468423+0000","last_became_active":"2024-09-12T17:27:25.974522+0000","last_became_peered":"2024-09-12T17:27:25.974522+0000","last_unstale":"2024-09-12T17:28:21.468423+0000","last_undegraded":"2024-09-12T17:28:21.468423+0000","last_fullsized":"2024-09-12T17:28:21.468423+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:24.738801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:24.738801+0000","last_clean_scrub_stamp":"2024-09-12T17:27:24.738801+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:42.005302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464653+0000","last_change":"2024-09-12T17:27:34.770151+0000","last_active":"2024-09-12T17:28:21.464653+0000","last_peered":"2024-09-12T17:28:21.464653+0000","last_clean":"2024-09-12T17:28:21.464653+0000","last_became_active":"2024-09-12T17:27:32.760744+0000","last_became_peered":"2024-09-12T17:27:32.760744+0000","last_unstale":"2024-09-12T17:28:21.464653+0000","last_undegraded":"2024-09-12T17:28:21.464653+0000","last_fullsized":"2024-09-12T17:28:21.464653+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:22:57.115660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014241220000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463397+0000","last_change":"2024-09-12T17:27:40.429657+0000","last_active":"2024-09-12T17:28:21.463397+0000","last_peered":"2024-09-12T17:28:21.463397+0000","last_clean":"2024-09-12T17:28:21.463397+0000","last_became_active":"2024-09-12T17:27:40.428453+0000","last_became_peered":"2024-09-12T17:27:40.428453+0000","last_unstale":"2024-09-12T17:28:21.463397+0000","last_undegraded":"2024-09-12T17:28:21.463397+0000","last_fullsized":"2024-09-12T17:28:21.463397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:25.951429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469125+0000","last_change":"2024-09-12T17:27:44.432804+0000","last_active":"2024-09-12T17:28:21.469125+0000","last_peered":"2024-09-12T17:28:21.469125+0000","last_clean":"2024-09-12T17:28:21.469125+0000","last_became_active":"2024-09-12T17:27:44.432336+0000","last_became_peered":"2024-09-12T17:27:44.432336+0000","last_unstale":"2024-09-12T17:28:21.469125+0000","last_undegraded":"2024-09-12T17:28:21.469125+0000","last_fullsized":"2024-09-12T17:28:21.469125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:57.403402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"31'76","reported_seq":146,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.607996+0000","last_change":"2024-09-12T17:27:46.438090+0000","last_active":"2024-09-12T17:29:47.607996+0000","last_peered":"2024-09-12T17:29:47.607996+0000","last_clean":"2024-09-12T17:29:47.607996+0000","last_became_active":"2024-09-12T17:27:46.437771+0000","last_became_peered":"2024-09-12T17:27:46.437771+0000","last_unstale":"2024-09-12T17:29:47.607996+0000","last_undegraded":"2024-09-12T17:29:47.607996+0000","last_fullsized":"2024-09-12T17:29:47.607996+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:14.400029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.474144+0000","last_change":"2024-09-12T17:27:48.446270+0000","last_active":"2024-09-12T17:28:21.474144+0000","last_peered":"2024-09-12T17:28:21.474144+0000","last_clean":"2024-09-12T17:28:21.474144+0000","last_became_active":"2024-09-12T17:27:48.445970+0000","last_became_peered":"2024-09-12T17:27:48.445970+0000","last_unstale":"2024-09-12T17:28:21.474144+0000","last_undegraded":"2024-09-12T17:28:21.474144+0000","last_fullsized":"2024-09-12T17:28:21.474144+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:31.488140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"31'81","reported_seq":163,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.235627+0000","last_change":"2024-09-12T17:27:50.448666+0000","last_active":"2024-09-12T17:30:50.235627+0000","last_peered":"2024-09-12T17:30:50.235627+0000","last_clean":"2024-09-12T17:30:50.235627+0000","last_became_active":"2024-09-12T17:27:50.448189+0000","last_became_peered":"2024-09-12T17:27:50.448189+0000","last_unstale":"2024-09-12T17:30:50.235627+0000","last_undegraded":"2024-09-12T17:30:50.235627+0000","last_fullsized":"2024-09-12T17:30:50.235627+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:38.207685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":221,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465570+0000","last_change":"2024-09-12T17:27:42.429760+0000","last_active":"2024-09-12T17:28:21.465570+0000","last_peered":"2024-09-12T17:28:21.465570+0000","last_clean":"2024-09-12T17:28:21.465570+0000","last_became_active":"2024-09-12T17:27:42.429497+0000","last_became_peered":"2024-09-12T17:27:42.429497+0000","last_unstale":"2024-09-12T17:28:21.465570+0000","last_undegraded":"2024-09-12T17:28:21.465570+0000","last_fullsized":"2024-09-12T17:28:21.465570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:09.539390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.462953+0000","last_change":"2024-09-12T17:27:34.769202+0000","last_active":"2024-09-12T17:28:21.462953+0000","last_peered":"2024-09-12T17:28:21.462953+0000","last_clean":"2024-09-12T17:28:21.462953+0000","last_became_active":"2024-09-12T17:27:32.761687+0000","last_became_peered":"2024-09-12T17:27:32.761687+0000","last_unstale":"2024-09-12T17:28:21.462953+0000","last_undegraded":"2024-09-12T17:28:21.462953+0000","last_fullsized":"2024-09-12T17:28:21.462953+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:00.950082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056694099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471668+0000","last_change":"2024-09-12T17:27:40.418643+0000","last_active":"2024-09-12T17:28:21.471668+0000","last_peered":"2024-09-12T17:28:21.471668+0000","last_clean":"2024-09-12T17:28:21.471668+0000","last_became_active":"2024-09-12T17:27:40.418249+0000","last_became_peered":"2024-09-12T17:27:40.418249+0000","last_unstale":"2024-09-12T17:28:21.471668+0000","last_undegraded":"2024-09-12T17:28:21.471668+0000","last_fullsized":"2024-09-12T17:28:21.471668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:03:41.714055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468312+0000","last_change":"2024-09-12T17:27:44.427026+0000","last_active":"2024-09-12T17:28:21.468312+0000","last_peered":"2024-09-12T17:28:21.468312+0000","last_clean":"2024-09-12T17:28:21.468312+0000","last_became_active":"2024-09-12T17:27:44.426698+0000","last_became_peered":"2024-09-12T17:27:44.426698+0000","last_unstale":"2024-09-12T17:28:21.468312+0000","last_undegraded":"2024-09-12T17:28:21.468312+0000","last_fullsized":"2024-09-12T17:28:21.468312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:09.582440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"31'274","reported_seq":478,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.511697+0000","last_change":"2024-09-12T17:27:46.438678+0000","last_active":"2024-09-12T17:30:49.511697+0000","last_peered":"2024-09-12T17:30:49.511697+0000","last_clean":"2024-09-12T17:30:49.511697+0000","last_became_active":"2024-09-12T17:27:46.438381+0000","last_became_peered":"2024-09-12T17:27:46.438381+0000","last_unstale":"2024-09-12T17:30:49.511697+0000","last_undegraded":"2024-09-12T17:30:49.511697+0000","last_fullsized":"2024-09-12T17:30:49.511697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:10.399053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464394+0000","last_change":"2024-09-12T17:27:48.451345+0000","last_active":"2024-09-12T17:28:21.464394+0000","last_peered":"2024-09-12T17:28:21.464394+0000","last_clean":"2024-09-12T17:28:21.464394+0000","last_became_active":"2024-09-12T17:27:48.450775+0000","last_became_peered":"2024-09-12T17:27:48.450775+0000","last_unstale":"2024-09-12T17:28:21.464394+0000","last_undegraded":"2024-09-12T17:28:21.464394+0000","last_fullsized":"2024-09-12T17:28:21.464394+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:37.382330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"31'5","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.944535+0000","last_change":"2024-09-12T17:27:50.458209+0000","last_active":"2024-09-12T17:30:49.944535+0000","last_peered":"2024-09-12T17:30:49.944535+0000","last_clean":"2024-09-12T17:30:49.944535+0000","last_became_active":"2024-09-12T17:27:50.457939+0000","last_became_peered":"2024-09-12T17:27:50.457939+0000","last_unstale":"2024-09-12T17:30:49.944535+0000","last_undegraded":"2024-09-12T17:30:49.944535+0000","last_fullsized":"2024-09-12T17:30:49.944535+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:23.231500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"31'4","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.076951+0000","last_change":"2024-09-12T17:27:42.425698+0000","last_active":"2024-09-12T17:29:49.076951+0000","last_peered":"2024-09-12T17:29:49.076951+0000","last_clean":"2024-09-12T17:29:49.076951+0000","last_became_active":"2024-09-12T17:27:42.424498+0000","last_became_peered":"2024-09-12T17:27:42.424498+0000","last_unstale":"2024-09-12T17:29:49.076951+0000","last_undegraded":"2024-09-12T17:29:49.076951+0000","last_fullsized":"2024-09-12T17:29:49.076951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:03.680453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466787+0000","last_change":"2024-09-12T17:27:35.052087+0000","last_active":"2024-09-12T17:28:21.466787+0000","last_peered":"2024-09-12T17:28:21.466787+0000","last_clean":"2024-09-12T17:28:21.466787+0000","last_became_active":"2024-09-12T17:27:32.761809+0000","last_became_peered":"2024-09-12T17:27:32.761809+0000","last_unstale":"2024-09-12T17:28:21.466787+0000","last_undegraded":"2024-09-12T17:28:21.466787+0000","last_fullsized":"2024-09-12T17:28:21.466787+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:18.084479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051333900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"31'3","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:05.185226+0000","last_change":"2024-09-12T17:27:40.418110+0000","last_active":"2024-09-12T17:29:05.185226+0000","last_peered":"2024-09-12T17:29:05.185226+0000","last_clean":"2024-09-12T17:29:05.185226+0000","last_became_active":"2024-09-12T17:27:40.417664+0000","last_became_peered":"2024-09-12T17:27:40.417664+0000","last_unstale":"2024-09-12T17:29:05.185226+0000","last_undegraded":"2024-09-12T17:29:05.185226+0000","last_fullsized":"2024-09-12T17:29:05.185226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:39.177042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"22'2","reported_seq":232,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:48.725808+0000","last_change":"2024-09-12T17:28:21.479837+0000","last_active":"2024-09-12T17:29:48.725808+0000","last_peered":"2024-09-12T17:29:48.725808+0000","last_clean":"2024-09-12T17:29:48.725808+0000","last_became_active":"2024-09-12T17:28:21.473073+0000","last_became_peered":"2024-09-12T17:28:21.473073+0000","last_unstale":"2024-09-12T17:29:48.725808+0000","last_undegraded":"2024-09-12T17:29:48.725808+0000","last_fullsized":"2024-09-12T17:29:48.725808+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:19.813164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":482,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"31'17","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.234475+0000","last_change":"2024-09-12T17:27:46.435712+0000","last_active":"2024-09-12T17:30:50.234475+0000","last_peered":"2024-09-12T17:30:50.234475+0000","last_clean":"2024-09-12T17:30:50.234475+0000","last_became_active":"2024-09-12T17:27:46.435381+0000","last_became_peered":"2024-09-12T17:27:46.435381+0000","last_unstale":"2024-09-12T17:30:50.234475+0000","last_undegraded":"2024-09-12T17:30:50.234475+0000","last_fullsized":"2024-09-12T17:30:50.234475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:41.723829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.472358+0000","last_change":"2024-09-12T17:27:48.451538+0000","last_active":"2024-09-12T17:28:21.472358+0000","last_peered":"2024-09-12T17:28:21.472358+0000","last_clean":"2024-09-12T17:28:21.472358+0000","last_became_active":"2024-09-12T17:27:48.451225+0000","last_became_peered":"2024-09-12T17:27:48.451225+0000","last_unstale":"2024-09-12T17:28:21.472358+0000","last_undegraded":"2024-09-12T17:28:21.472358+0000","last_fullsized":"2024-09-12T17:28:21.472358+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:18.269897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463520+0000","last_change":"2024-09-12T17:27:50.453764+0000","last_active":"2024-09-12T17:28:21.463520+0000","last_peered":"2024-09-12T17:28:21.463520+0000","last_clean":"2024-09-12T17:28:21.463520+0000","last_became_active":"2024-09-12T17:27:50.453458+0000","last_became_peered":"2024-09-12T17:27:50.453458+0000","last_unstale":"2024-09-12T17:28:21.463520+0000","last_undegraded":"2024-09-12T17:28:21.463520+0000","last_fullsized":"2024-09-12T17:28:21.463520+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:48.900827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"31'10","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.928991+0000","last_change":"2024-09-12T17:27:42.428370+0000","last_active":"2024-09-12T17:30:49.928991+0000","last_peered":"2024-09-12T17:30:49.928991+0000","last_clean":"2024-09-12T17:30:49.928991+0000","last_became_active":"2024-09-12T17:27:42.427591+0000","last_became_peered":"2024-09-12T17:27:42.427591+0000","last_unstale":"2024-09-12T17:30:49.928991+0000","last_undegraded":"2024-09-12T17:30:49.928991+0000","last_fullsized":"2024-09-12T17:30:49.928991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:32:15.190001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463771+0000","last_change":"2024-09-12T17:27:34.769764+0000","last_active":"2024-09-12T17:28:21.463771+0000","last_peered":"2024-09-12T17:28:21.463771+0000","last_clean":"2024-09-12T17:28:21.463771+0000","last_became_active":"2024-09-12T17:27:32.761967+0000","last_became_peered":"2024-09-12T17:27:32.761967+0000","last_unstale":"2024-09-12T17:28:21.463771+0000","last_undegraded":"2024-09-12T17:28:21.463771+0000","last_fullsized":"2024-09-12T17:28:21.463771+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:25.345465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001062323,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468759+0000","last_change":"2024-09-12T17:27:40.426229+0000","last_active":"2024-09-12T17:28:21.468759+0000","last_peered":"2024-09-12T17:28:21.468759+0000","last_clean":"2024-09-12T17:28:21.468759+0000","last_became_active":"2024-09-12T17:27:40.425973+0000","last_became_peered":"2024-09-12T17:27:40.425973+0000","last_unstale":"2024-09-12T17:28:21.468759+0000","last_undegraded":"2024-09-12T17:28:21.468759+0000","last_fullsized":"2024-09-12T17:28:21.468759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:08.388292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.473874+0000","last_change":"2024-09-12T17:27:44.432667+0000","last_active":"2024-09-12T17:28:21.473874+0000","last_peered":"2024-09-12T17:28:21.473874+0000","last_clean":"2024-09-12T17:28:21.473874+0000","last_became_active":"2024-09-12T17:27:44.432348+0000","last_became_peered":"2024-09-12T17:27:44.432348+0000","last_unstale":"2024-09-12T17:28:21.473874+0000","last_undegraded":"2024-09-12T17:28:21.473874+0000","last_fullsized":"2024-09-12T17:28:21.473874+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:56.521250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"31'14","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.091058+0000","last_change":"2024-09-12T17:27:46.442771+0000","last_active":"2024-09-12T17:30:49.091058+0000","last_peered":"2024-09-12T17:30:49.091058+0000","last_clean":"2024-09-12T17:30:49.091058+0000","last_became_active":"2024-09-12T17:27:46.442488+0000","last_became_peered":"2024-09-12T17:27:46.442488+0000","last_unstale":"2024-09-12T17:30:49.091058+0000","last_undegraded":"2024-09-12T17:30:49.091058+0000","last_fullsized":"2024-09-12T17:30:49.091058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:31.634237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466202+0000","last_change":"2024-09-12T17:27:48.451472+0000","last_active":"2024-09-12T17:28:21.466202+0000","last_peered":"2024-09-12T17:28:21.466202+0000","last_clean":"2024-09-12T17:28:21.466202+0000","last_became_active":"2024-09-12T17:27:48.451075+0000","last_became_peered":"2024-09-12T17:27:48.451075+0000","last_unstale":"2024-09-12T17:28:21.466202+0000","last_undegraded":"2024-09-12T17:28:21.466202+0000","last_fullsized":"2024-09-12T17:28:21.466202+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:41.217292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'10","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:48.840270+0000","last_change":"2024-09-12T17:27:50.456671+0000","last_active":"2024-09-12T17:29:48.840270+0000","last_peered":"2024-09-12T17:29:48.840270+0000","last_clean":"2024-09-12T17:29:48.840270+0000","last_became_active":"2024-09-12T17:27:50.455608+0000","last_became_peered":"2024-09-12T17:27:50.455608+0000","last_unstale":"2024-09-12T17:29:48.840270+0000","last_undegraded":"2024-09-12T17:29:48.840270+0000","last_fullsized":"2024-09-12T17:29:48.840270+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:23.681507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":17,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'14","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.148304+0000","last_change":"2024-09-12T17:28:21.472071+0000","last_active":"2024-09-12T17:30:50.148304+0000","last_peered":"2024-09-12T17:30:50.148304+0000","last_clean":"2024-09-12T17:30:50.148304+0000","last_became_active":"2024-09-12T17:28:21.471756+0000","last_became_peered":"2024-09-12T17:28:21.471756+0000","last_unstale":"2024-09-12T17:30:50.148304+0000","last_undegraded":"2024-09-12T17:30:50.148304+0000","last_fullsized":"2024-09-12T17:30:50.148304+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:02.305736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.141559+0000","last_change":"2024-09-12T17:27:40.424557+0000","last_active":"2024-09-12T17:30:50.141559+0000","last_peered":"2024-09-12T17:30:50.141559+0000","last_clean":"2024-09-12T17:30:50.141559+0000","last_became_active":"2024-09-12T17:27:40.424286+0000","last_became_peered":"2024-09-12T17:27:40.424286+0000","last_unstale":"2024-09-12T17:30:50.141559+0000","last_undegraded":"2024-09-12T17:30:50.141559+0000","last_fullsized":"2024-09-12T17:30:50.141559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:35.900609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.472269+0000","last_change":"2024-09-12T17:27:34.764756+0000","last_active":"2024-09-12T17:28:21.472269+0000","last_peered":"2024-09-12T17:28:21.472269+0000","last_clean":"2024-09-12T17:28:21.472269+0000","last_became_active":"2024-09-12T17:27:32.761595+0000","last_became_peered":"2024-09-12T17:27:32.761595+0000","last_unstale":"2024-09-12T17:28:21.472269+0000","last_undegraded":"2024-09-12T17:28:21.472269+0000","last_fullsized":"2024-09-12T17:28:21.472269+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:18.306129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000417551,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"31'1","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.757479+0000","last_change":"2024-09-12T17:27:44.432884+0000","last_active":"2024-09-12T17:29:49.757479+0000","last_peered":"2024-09-12T17:29:49.757479+0000","last_clean":"2024-09-12T17:29:49.757479+0000","last_became_active":"2024-09-12T17:27:44.432492+0000","last_became_peered":"2024-09-12T17:27:44.432492+0000","last_unstale":"2024-09-12T17:29:49.757479+0000","last_undegraded":"2024-09-12T17:29:49.757479+0000","last_fullsized":"2024-09-12T17:29:49.757479+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:10.580513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"31'61","reported_seq":121,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.757358+0000","last_change":"2024-09-12T17:27:46.439404+0000","last_active":"2024-09-12T17:29:49.757358+0000","last_peered":"2024-09-12T17:29:49.757358+0000","last_clean":"2024-09-12T17:29:49.757358+0000","last_became_active":"2024-09-12T17:27:46.439014+0000","last_became_peered":"2024-09-12T17:27:46.439014+0000","last_unstale":"2024-09-12T17:29:49.757358+0000","last_undegraded":"2024-09-12T17:29:49.757358+0000","last_fullsized":"2024-09-12T17:29:49.757358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:18.977626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.467285+0000","last_change":"2024-09-12T17:27:48.439106+0000","last_active":"2024-09-12T17:28:21.467285+0000","last_peered":"2024-09-12T17:28:21.467285+0000","last_clean":"2024-09-12T17:28:21.467285+0000","last_became_active":"2024-09-12T17:27:48.438779+0000","last_became_peered":"2024-09-12T17:27:48.438779+0000","last_unstale":"2024-09-12T17:28:21.467285+0000","last_undegraded":"2024-09-12T17:28:21.467285+0000","last_fullsized":"2024-09-12T17:28:21.467285+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:49.022922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"31'13","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.020053+0000","last_change":"2024-09-12T17:27:50.448485+0000","last_active":"2024-09-12T17:30:50.020053+0000","last_peered":"2024-09-12T17:30:50.020053+0000","last_clean":"2024-09-12T17:30:50.020053+0000","last_became_active":"2024-09-12T17:27:50.448060+0000","last_became_peered":"2024-09-12T17:27:50.448060+0000","last_unstale":"2024-09-12T17:30:50.020053+0000","last_undegraded":"2024-09-12T17:30:50.020053+0000","last_fullsized":"2024-09-12T17:30:50.020053+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:10.453854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":31,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"31'27","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.023811+0000","last_change":"2024-09-12T17:27:42.433227+0000","last_active":"2024-09-12T17:30:50.023811+0000","last_peered":"2024-09-12T17:30:50.023811+0000","last_clean":"2024-09-12T17:30:50.023811+0000","last_became_active":"2024-09-12T17:27:42.432800+0000","last_became_peered":"2024-09-12T17:27:42.432800+0000","last_unstale":"2024-09-12T17:30:50.023811+0000","last_undegraded":"2024-09-12T17:30:50.023811+0000","last_fullsized":"2024-09-12T17:30:50.023811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:05.801739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":99,"num_read_kb":83,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"31'3","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.757529+0000","last_change":"2024-09-12T17:27:40.419982+0000","last_active":"2024-09-12T17:29:49.757529+0000","last_peered":"2024-09-12T17:29:49.757529+0000","last_clean":"2024-09-12T17:29:49.757529+0000","last_became_active":"2024-09-12T17:27:40.418873+0000","last_became_peered":"2024-09-12T17:27:40.418873+0000","last_unstale":"2024-09-12T17:29:49.757529+0000","last_undegraded":"2024-09-12T17:29:49.757529+0000","last_fullsized":"2024-09-12T17:29:49.757529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:08.388292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465552+0000","last_change":"2024-09-12T17:27:34.770070+0000","last_active":"2024-09-12T17:28:21.465552+0000","last_peered":"2024-09-12T17:28:21.465552+0000","last_clean":"2024-09-12T17:28:21.465552+0000","last_became_active":"2024-09-12T17:27:32.761677+0000","last_became_peered":"2024-09-12T17:27:32.761677+0000","last_unstale":"2024-09-12T17:28:21.465552+0000","last_undegraded":"2024-09-12T17:28:21.465552+0000","last_fullsized":"2024-09-12T17:28:21.465552+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:22.236160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001356625,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463624+0000","last_change":"2024-09-12T17:27:44.426949+0000","last_active":"2024-09-12T17:28:21.463624+0000","last_peered":"2024-09-12T17:28:21.463624+0000","last_clean":"2024-09-12T17:28:21.463624+0000","last_became_active":"2024-09-12T17:27:44.426647+0000","last_became_peered":"2024-09-12T17:27:44.426647+0000","last_unstale":"2024-09-12T17:28:21.463624+0000","last_undegraded":"2024-09-12T17:28:21.463624+0000","last_fullsized":"2024-09-12T17:28:21.463624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:54.776333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"29'15","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468427+0000","last_change":"2024-09-12T17:27:46.439375+0000","last_active":"2024-09-12T17:28:21.468427+0000","last_peered":"2024-09-12T17:28:21.468427+0000","last_clean":"2024-09-12T17:28:21.468427+0000","last_became_active":"2024-09-12T17:27:46.439038+0000","last_became_peered":"2024-09-12T17:27:46.439038+0000","last_unstale":"2024-09-12T17:28:21.468427+0000","last_undegraded":"2024-09-12T17:28:21.468427+0000","last_fullsized":"2024-09-12T17:28:21.468427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:18.536701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"31'282","reported_seq":347,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.511651+0000","last_change":"2024-09-12T17:27:48.442198+0000","last_active":"2024-09-12T17:30:49.511651+0000","last_peered":"2024-09-12T17:30:49.511651+0000","last_clean":"2024-09-12T17:30:49.511651+0000","last_became_active":"2024-09-12T17:27:48.440948+0000","last_became_peered":"2024-09-12T17:27:48.440948+0000","last_unstale":"2024-09-12T17:30:49.511651+0000","last_undegraded":"2024-09-12T17:30:49.511651+0000","last_fullsized":"2024-09-12T17:30:49.511651+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:58.653865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465509+0000","last_change":"2024-09-12T17:27:50.455097+0000","last_active":"2024-09-12T17:28:21.465509+0000","last_peered":"2024-09-12T17:28:21.465509+0000","last_clean":"2024-09-12T17:28:21.465509+0000","last_became_active":"2024-09-12T17:27:50.454241+0000","last_became_peered":"2024-09-12T17:27:50.454241+0000","last_unstale":"2024-09-12T17:28:21.465509+0000","last_undegraded":"2024-09-12T17:28:21.465509+0000","last_fullsized":"2024-09-12T17:28:21.465509+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:01.881864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"31'16","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.203650+0000","last_change":"2024-09-12T17:27:42.424267+0000","last_active":"2024-09-12T17:30:50.203650+0000","last_peered":"2024-09-12T17:30:50.203650+0000","last_clean":"2024-09-12T17:30:50.203650+0000","last_became_active":"2024-09-12T17:27:42.423805+0000","last_became_peered":"2024-09-12T17:27:42.423805+0000","last_unstale":"2024-09-12T17:30:50.203650+0000","last_undegraded":"2024-09-12T17:30:50.203650+0000","last_fullsized":"2024-09-12T17:30:50.203650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:37.154226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466516+0000","last_change":"2024-09-12T17:27:40.424553+0000","last_active":"2024-09-12T17:28:21.466516+0000","last_peered":"2024-09-12T17:28:21.466516+0000","last_clean":"2024-09-12T17:28:21.466516+0000","last_became_active":"2024-09-12T17:27:40.423703+0000","last_became_peered":"2024-09-12T17:27:40.423703+0000","last_unstale":"2024-09-12T17:28:21.466516+0000","last_undegraded":"2024-09-12T17:28:21.466516+0000","last_fullsized":"2024-09-12T17:28:21.466516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:34.708745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.472967+0000","last_change":"2024-09-12T17:27:34.764838+0000","last_active":"2024-09-12T17:28:21.472967+0000","last_peered":"2024-09-12T17:28:21.472967+0000","last_clean":"2024-09-12T17:28:21.472967+0000","last_became_active":"2024-09-12T17:27:32.761590+0000","last_became_peered":"2024-09-12T17:27:32.761590+0000","last_unstale":"2024-09-12T17:28:21.472967+0000","last_undegraded":"2024-09-12T17:28:21.472967+0000","last_fullsized":"2024-09-12T17:28:21.472967+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:23.009450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036072200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463699+0000","last_change":"2024-09-12T17:27:44.427647+0000","last_active":"2024-09-12T17:28:21.463699+0000","last_peered":"2024-09-12T17:28:21.463699+0000","last_clean":"2024-09-12T17:28:21.463699+0000","last_became_active":"2024-09-12T17:27:44.427318+0000","last_became_peered":"2024-09-12T17:27:44.427318+0000","last_unstale":"2024-09-12T17:28:21.463699+0000","last_undegraded":"2024-09-12T17:28:21.463699+0000","last_fullsized":"2024-09-12T17:28:21.463699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:46.727329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'10","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464060+0000","last_change":"2024-09-12T17:27:46.444325+0000","last_active":"2024-09-12T17:28:21.464060+0000","last_peered":"2024-09-12T17:28:21.464060+0000","last_clean":"2024-09-12T17:28:21.464060+0000","last_became_active":"2024-09-12T17:27:46.443937+0000","last_became_peered":"2024-09-12T17:27:46.443937+0000","last_unstale":"2024-09-12T17:28:21.464060+0000","last_undegraded":"2024-09-12T17:28:21.464060+0000","last_fullsized":"2024-09-12T17:28:21.464060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:54:23.541095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"31'282","reported_seq":390,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.331661+0000","last_change":"2024-09-12T17:27:48.441935+0000","last_active":"2024-09-12T17:30:50.331661+0000","last_peered":"2024-09-12T17:30:50.331661+0000","last_clean":"2024-09-12T17:30:50.331661+0000","last_became_active":"2024-09-12T17:27:48.441694+0000","last_became_peered":"2024-09-12T17:27:48.441694+0000","last_unstale":"2024-09-12T17:30:50.331661+0000","last_undegraded":"2024-09-12T17:30:50.331661+0000","last_fullsized":"2024-09-12T17:30:50.331661+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:32.578727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"29'3","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468923+0000","last_change":"2024-09-12T17:27:50.453171+0000","last_active":"2024-09-12T17:28:21.468923+0000","last_peered":"2024-09-12T17:28:21.468923+0000","last_clean":"2024-09-12T17:28:21.468923+0000","last_became_active":"2024-09-12T17:27:50.452862+0000","last_became_peered":"2024-09-12T17:27:50.452862+0000","last_unstale":"2024-09-12T17:28:21.468923+0000","last_undegraded":"2024-09-12T17:28:21.468923+0000","last_fullsized":"2024-09-12T17:28:21.468923+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:55.038103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"29'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466639+0000","last_change":"2024-09-12T17:27:42.437147+0000","last_active":"2024-09-12T17:28:21.466639+0000","last_peered":"2024-09-12T17:28:21.466639+0000","last_clean":"2024-09-12T17:28:21.466639+0000","last_became_active":"2024-09-12T17:27:42.436667+0000","last_became_peered":"2024-09-12T17:27:42.436667+0000","last_unstale":"2024-09-12T17:28:21.466639+0000","last_undegraded":"2024-09-12T17:28:21.466639+0000","last_fullsized":"2024-09-12T17:28:21.466639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:46.763985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466656+0000","last_change":"2024-09-12T17:27:40.419748+0000","last_active":"2024-09-12T17:28:21.466656+0000","last_peered":"2024-09-12T17:28:21.466656+0000","last_clean":"2024-09-12T17:28:21.466656+0000","last_became_active":"2024-09-12T17:27:40.419472+0000","last_became_peered":"2024-09-12T17:27:40.419472+0000","last_unstale":"2024-09-12T17:28:21.466656+0000","last_undegraded":"2024-09-12T17:28:21.466656+0000","last_fullsized":"2024-09-12T17:28:21.466656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:16.839649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466286+0000","last_change":"2024-09-12T17:27:34.769850+0000","last_active":"2024-09-12T17:28:21.466286+0000","last_peered":"2024-09-12T17:28:21.466286+0000","last_clean":"2024-09-12T17:28:21.466286+0000","last_became_active":"2024-09-12T17:27:32.775344+0000","last_became_peered":"2024-09-12T17:27:32.775344+0000","last_unstale":"2024-09-12T17:28:21.466286+0000","last_undegraded":"2024-09-12T17:28:21.466286+0000","last_fullsized":"2024-09-12T17:28:21.466286+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:45.298951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011343939999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463970+0000","last_change":"2024-09-12T17:27:44.427846+0000","last_active":"2024-09-12T17:28:21.463970+0000","last_peered":"2024-09-12T17:28:21.463970+0000","last_clean":"2024-09-12T17:28:21.463970+0000","last_became_active":"2024-09-12T17:27:44.427519+0000","last_became_peered":"2024-09-12T17:27:44.427519+0000","last_unstale":"2024-09-12T17:28:21.463970+0000","last_undegraded":"2024-09-12T17:28:21.463970+0000","last_fullsized":"2024-09-12T17:28:21.463970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:56.857897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"31'82","reported_seq":155,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.594928+0000","last_change":"2024-09-12T17:27:46.442632+0000","last_active":"2024-09-12T17:29:47.594928+0000","last_peered":"2024-09-12T17:29:47.594928+0000","last_clean":"2024-09-12T17:29:47.594928+0000","last_became_active":"2024-09-12T17:27:46.442154+0000","last_became_peered":"2024-09-12T17:27:46.442154+0000","last_unstale":"2024-09-12T17:29:47.594928+0000","last_undegraded":"2024-09-12T17:29:47.594928+0000","last_fullsized":"2024-09-12T17:29:47.594928+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:20.802573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471089+0000","last_change":"2024-09-12T17:27:48.440496+0000","last_active":"2024-09-12T17:28:21.471089+0000","last_peered":"2024-09-12T17:28:21.471089+0000","last_clean":"2024-09-12T17:28:21.471089+0000","last_became_active":"2024-09-12T17:27:48.440177+0000","last_became_peered":"2024-09-12T17:27:48.440177+0000","last_unstale":"2024-09-12T17:28:21.471089+0000","last_undegraded":"2024-09-12T17:28:21.471089+0000","last_fullsized":"2024-09-12T17:28:21.471089+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:26.852348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466258+0000","last_change":"2024-09-12T17:27:50.454208+0000","last_active":"2024-09-12T17:28:21.466258+0000","last_peered":"2024-09-12T17:28:21.466258+0000","last_clean":"2024-09-12T17:28:21.466258+0000","last_became_active":"2024-09-12T17:27:50.453919+0000","last_became_peered":"2024-09-12T17:27:50.453919+0000","last_unstale":"2024-09-12T17:28:21.466258+0000","last_undegraded":"2024-09-12T17:28:21.466258+0000","last_fullsized":"2024-09-12T17:28:21.466258+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:28.859033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469099+0000","last_change":"2024-09-12T17:27:50.454609+0000","last_active":"2024-09-12T17:28:21.469099+0000","last_peered":"2024-09-12T17:28:21.469099+0000","last_clean":"2024-09-12T17:28:21.469099+0000","last_became_active":"2024-09-12T17:27:50.452190+0000","last_became_peered":"2024-09-12T17:27:50.452190+0000","last_unstale":"2024-09-12T17:28:21.469099+0000","last_undegraded":"2024-09-12T17:28:21.469099+0000","last_fullsized":"2024-09-12T17:28:21.469099+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:08.249355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:05.195137+0000","last_change":"2024-09-12T17:27:42.436477+0000","last_active":"2024-09-12T17:29:05.195137+0000","last_peered":"2024-09-12T17:29:05.195137+0000","last_clean":"2024-09-12T17:29:05.195137+0000","last_became_active":"2024-09-12T17:27:42.436187+0000","last_became_peered":"2024-09-12T17:27:42.436187+0000","last_unstale":"2024-09-12T17:29:05.195137+0000","last_undegraded":"2024-09-12T17:29:05.195137+0000","last_fullsized":"2024-09-12T17:29:05.195137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:06.625797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"29'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464418+0000","last_change":"2024-09-12T17:27:40.429080+0000","last_active":"2024-09-12T17:28:21.464418+0000","last_peered":"2024-09-12T17:28:21.464418+0000","last_clean":"2024-09-12T17:28:21.464418+0000","last_became_active":"2024-09-12T17:27:40.428529+0000","last_became_peered":"2024-09-12T17:27:40.428529+0000","last_unstale":"2024-09-12T17:28:21.464418+0000","last_undegraded":"2024-09-12T17:28:21.464418+0000","last_fullsized":"2024-09-12T17:28:21.464418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:43.412664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470025+0000","last_change":"2024-09-12T17:27:44.430001+0000","last_active":"2024-09-12T17:28:21.470025+0000","last_peered":"2024-09-12T17:28:21.470025+0000","last_clean":"2024-09-12T17:28:21.470025+0000","last_became_active":"2024-09-12T17:27:44.429701+0000","last_became_peered":"2024-09-12T17:27:44.429701+0000","last_unstale":"2024-09-12T17:28:21.470025+0000","last_undegraded":"2024-09-12T17:28:21.470025+0000","last_fullsized":"2024-09-12T17:28:21.470025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:31.928670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"31'32","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.600840+0000","last_change":"2024-09-12T17:27:46.443026+0000","last_active":"2024-09-12T17:29:47.600840+0000","last_peered":"2024-09-12T17:29:47.600840+0000","last_clean":"2024-09-12T17:29:47.600840+0000","last_became_active":"2024-09-12T17:27:46.442713+0000","last_became_peered":"2024-09-12T17:27:46.442713+0000","last_unstale":"2024-09-12T17:29:47.600840+0000","last_undegraded":"2024-09-12T17:29:47.600840+0000","last_fullsized":"2024-09-12T17:29:47.600840+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:29.878441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463885+0000","last_change":"2024-09-12T17:27:48.450563+0000","last_active":"2024-09-12T17:28:21.463885+0000","last_peered":"2024-09-12T17:28:21.463885+0000","last_clean":"2024-09-12T17:28:21.463885+0000","last_became_active":"2024-09-12T17:27:48.450050+0000","last_became_peered":"2024-09-12T17:27:48.450050+0000","last_unstale":"2024-09-12T17:28:21.463885+0000","last_undegraded":"2024-09-12T17:28:21.463885+0000","last_fullsized":"2024-09-12T17:28:21.463885+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:37.430305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"31'5","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.306851+0000","last_change":"2024-09-12T17:27:50.453680+0000","last_active":"2024-09-12T17:29:47.306851+0000","last_peered":"2024-09-12T17:29:47.306851+0000","last_clean":"2024-09-12T17:29:47.306851+0000","last_became_active":"2024-09-12T17:27:50.453382+0000","last_became_peered":"2024-09-12T17:27:50.453382+0000","last_unstale":"2024-09-12T17:29:47.306851+0000","last_undegraded":"2024-09-12T17:29:47.306851+0000","last_fullsized":"2024-09-12T17:29:47.306851+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:21.594797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"31'8","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.197223+0000","last_change":"2024-09-12T17:27:42.436403+0000","last_active":"2024-09-12T17:30:50.197223+0000","last_peered":"2024-09-12T17:30:50.197223+0000","last_clean":"2024-09-12T17:30:50.197223+0000","last_became_active":"2024-09-12T17:27:42.436150+0000","last_became_peered":"2024-09-12T17:27:42.436150+0000","last_unstale":"2024-09-12T17:30:50.197223+0000","last_undegraded":"2024-09-12T17:30:50.197223+0000","last_fullsized":"2024-09-12T17:30:50.197223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:34.481120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466884+0000","last_change":"2024-09-12T17:27:40.432404+0000","last_active":"2024-09-12T17:28:21.466884+0000","last_peered":"2024-09-12T17:28:21.466884+0000","last_clean":"2024-09-12T17:28:21.466884+0000","last_became_active":"2024-09-12T17:27:40.431962+0000","last_became_peered":"2024-09-12T17:27:40.431962+0000","last_unstale":"2024-09-12T17:28:21.466884+0000","last_undegraded":"2024-09-12T17:28:21.466884+0000","last_fullsized":"2024-09-12T17:28:21.466884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:16.839649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465368+0000","last_change":"2024-09-12T17:27:44.432604+0000","last_active":"2024-09-12T17:28:21.465368+0000","last_peered":"2024-09-12T17:28:21.465368+0000","last_clean":"2024-09-12T17:28:21.465368+0000","last_became_active":"2024-09-12T17:27:44.432334+0000","last_became_peered":"2024-09-12T17:27:44.432334+0000","last_unstale":"2024-09-12T17:28:21.465368+0000","last_undegraded":"2024-09-12T17:28:21.465368+0000","last_fullsized":"2024-09-12T17:28:21.465368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:32.282020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"31'6","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.113421+0000","last_change":"2024-09-12T17:27:46.435861+0000","last_active":"2024-09-12T17:30:49.113421+0000","last_peered":"2024-09-12T17:30:49.113421+0000","last_clean":"2024-09-12T17:30:49.113421+0000","last_became_active":"2024-09-12T17:27:46.435567+0000","last_became_peered":"2024-09-12T17:27:46.435567+0000","last_unstale":"2024-09-12T17:30:49.113421+0000","last_undegraded":"2024-09-12T17:30:49.113421+0000","last_fullsized":"2024-09-12T17:30:49.113421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:25.415585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466933+0000","last_change":"2024-09-12T17:27:48.448838+0000","last_active":"2024-09-12T17:28:21.466933+0000","last_peered":"2024-09-12T17:28:21.466933+0000","last_clean":"2024-09-12T17:28:21.466933+0000","last_became_active":"2024-09-12T17:27:48.448478+0000","last_became_peered":"2024-09-12T17:27:48.448478+0000","last_unstale":"2024-09-12T17:28:21.466933+0000","last_undegraded":"2024-09-12T17:28:21.466933+0000","last_fullsized":"2024-09-12T17:28:21.466933+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:31.633824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"31'8","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:22.316873+0000","last_change":"2024-09-12T17:27:50.449599+0000","last_active":"2024-09-12T17:28:22.316873+0000","last_peered":"2024-09-12T17:28:22.316873+0000","last_clean":"2024-09-12T17:28:22.316873+0000","last_became_active":"2024-09-12T17:27:50.449302+0000","last_became_peered":"2024-09-12T17:27:50.449302+0000","last_unstale":"2024-09-12T17:28:22.316873+0000","last_undegraded":"2024-09-12T17:28:22.316873+0000","last_fullsized":"2024-09-12T17:28:22.316873+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:02.835518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"31'4","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:05.195069+0000","last_change":"2024-09-12T17:27:42.424932+0000","last_active":"2024-09-12T17:29:05.195069+0000","last_peered":"2024-09-12T17:29:05.195069+0000","last_clean":"2024-09-12T17:29:05.195069+0000","last_became_active":"2024-09-12T17:27:42.423974+0000","last_became_peered":"2024-09-12T17:27:42.423974+0000","last_unstale":"2024-09-12T17:29:05.195069+0000","last_undegraded":"2024-09-12T17:29:05.195069+0000","last_fullsized":"2024-09-12T17:29:05.195069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:45.464780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:22.876120+0000","last_change":"2024-09-12T17:27:40.430392+0000","last_active":"2024-09-12T17:28:22.876120+0000","last_peered":"2024-09-12T17:28:22.876120+0000","last_clean":"2024-09-12T17:28:22.876120+0000","last_became_active":"2024-09-12T17:27:40.430154+0000","last_became_peered":"2024-09-12T17:27:40.430154+0000","last_unstale":"2024-09-12T17:28:22.876120+0000","last_undegraded":"2024-09-12T17:28:22.876120+0000","last_fullsized":"2024-09-12T17:28:22.876120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:51.844092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466293+0000","last_change":"2024-09-12T17:27:44.435267+0000","last_active":"2024-09-12T17:28:21.466293+0000","last_peered":"2024-09-12T17:28:21.466293+0000","last_clean":"2024-09-12T17:28:21.466293+0000","last_became_active":"2024-09-12T17:27:44.434979+0000","last_became_peered":"2024-09-12T17:27:44.434979+0000","last_unstale":"2024-09-12T17:28:21.466293+0000","last_undegraded":"2024-09-12T17:28:21.466293+0000","last_fullsized":"2024-09-12T17:28:21.466293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:20.110019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"31'40","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.160818+0000","last_change":"2024-09-12T17:27:46.433815+0000","last_active":"2024-09-12T17:30:49.160818+0000","last_peered":"2024-09-12T17:30:49.160818+0000","last_clean":"2024-09-12T17:30:49.160818+0000","last_became_active":"2024-09-12T17:27:46.433421+0000","last_became_peered":"2024-09-12T17:27:46.433421+0000","last_unstale":"2024-09-12T17:30:49.160818+0000","last_undegraded":"2024-09-12T17:30:49.160818+0000","last_fullsized":"2024-09-12T17:30:49.160818+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:46:25.118826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469750+0000","last_change":"2024-09-12T17:27:48.439853+0000","last_active":"2024-09-12T17:28:21.469750+0000","last_peered":"2024-09-12T17:28:21.469750+0000","last_clean":"2024-09-12T17:28:21.469750+0000","last_became_active":"2024-09-12T17:27:48.439547+0000","last_became_peered":"2024-09-12T17:27:48.439547+0000","last_unstale":"2024-09-12T17:28:21.469750+0000","last_undegraded":"2024-09-12T17:28:21.469750+0000","last_fullsized":"2024-09-12T17:28:21.469750+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:36.201000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464221+0000","last_change":"2024-09-12T17:27:50.459594+0000","last_active":"2024-09-12T17:28:21.464221+0000","last_peered":"2024-09-12T17:28:21.464221+0000","last_clean":"2024-09-12T17:28:21.464221+0000","last_became_active":"2024-09-12T17:27:50.459321+0000","last_became_peered":"2024-09-12T17:27:50.459321+0000","last_unstale":"2024-09-12T17:28:21.464221+0000","last_undegraded":"2024-09-12T17:28:21.464221+0000","last_fullsized":"2024-09-12T17:28:21.464221+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:42.428839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"31'14","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.226040+0000","last_change":"2024-09-12T17:27:42.428640+0000","last_active":"2024-09-12T17:30:50.226040+0000","last_peered":"2024-09-12T17:30:50.226040+0000","last_clean":"2024-09-12T17:30:50.226040+0000","last_became_active":"2024-09-12T17:27:42.428364+0000","last_became_peered":"2024-09-12T17:27:42.428364+0000","last_unstale":"2024-09-12T17:30:50.226040+0000","last_undegraded":"2024-09-12T17:30:50.226040+0000","last_fullsized":"2024-09-12T17:30:50.226040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:30.980696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.136306+0000","last_change":"2024-09-12T17:27:40.416377+0000","last_active":"2024-09-12T17:30:50.136306+0000","last_peered":"2024-09-12T17:30:50.136306+0000","last_clean":"2024-09-12T17:30:50.136306+0000","last_became_active":"2024-09-12T17:27:40.415212+0000","last_became_peered":"2024-09-12T17:27:40.415212+0000","last_unstale":"2024-09-12T17:30:50.136306+0000","last_undegraded":"2024-09-12T17:30:50.136306+0000","last_fullsized":"2024-09-12T17:30:50.136306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:08.388292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463776+0000","last_change":"2024-09-12T17:27:44.430145+0000","last_active":"2024-09-12T17:28:21.463776+0000","last_peered":"2024-09-12T17:28:21.463776+0000","last_clean":"2024-09-12T17:28:21.463776+0000","last_became_active":"2024-09-12T17:27:44.429844+0000","last_became_peered":"2024-09-12T17:27:44.429844+0000","last_unstale":"2024-09-12T17:28:21.463776+0000","last_undegraded":"2024-09-12T17:28:21.463776+0000","last_fullsized":"2024-09-12T17:28:21.463776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:59.753147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"31'31","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.586817+0000","last_change":"2024-09-12T17:27:46.432991+0000","last_active":"2024-09-12T17:29:47.586817+0000","last_peered":"2024-09-12T17:29:47.586817+0000","last_clean":"2024-09-12T17:29:47.586817+0000","last_became_active":"2024-09-12T17:27:46.432650+0000","last_became_peered":"2024-09-12T17:27:46.432650+0000","last_unstale":"2024-09-12T17:29:47.586817+0000","last_undegraded":"2024-09-12T17:29:47.586817+0000","last_fullsized":"2024-09-12T17:29:47.586817+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:21.877058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469478+0000","last_change":"2024-09-12T17:27:48.440110+0000","last_active":"2024-09-12T17:28:21.469478+0000","last_peered":"2024-09-12T17:28:21.469478+0000","last_clean":"2024-09-12T17:28:21.469478+0000","last_became_active":"2024-09-12T17:27:48.439134+0000","last_became_peered":"2024-09-12T17:27:48.439134+0000","last_unstale":"2024-09-12T17:28:21.469478+0000","last_undegraded":"2024-09-12T17:28:21.469478+0000","last_fullsized":"2024-09-12T17:28:21.469478+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:10.067239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:23.352256+0000","last_change":"2024-09-12T17:27:42.427657+0000","last_active":"2024-09-12T17:28:23.352256+0000","last_peered":"2024-09-12T17:28:23.352256+0000","last_clean":"2024-09-12T17:28:23.352256+0000","last_became_active":"2024-09-12T17:27:42.426108+0000","last_became_peered":"2024-09-12T17:27:42.426108+0000","last_unstale":"2024-09-12T17:28:23.352256+0000","last_undegraded":"2024-09-12T17:28:23.352256+0000","last_fullsized":"2024-09-12T17:28:23.352256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:46.077185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:22.871380+0000","last_change":"2024-09-12T17:27:40.430187+0000","last_active":"2024-09-12T17:28:22.871380+0000","last_peered":"2024-09-12T17:28:22.871380+0000","last_clean":"2024-09-12T17:28:22.871380+0000","last_became_active":"2024-09-12T17:27:40.429644+0000","last_became_peered":"2024-09-12T17:27:40.429644+0000","last_unstale":"2024-09-12T17:28:22.871380+0000","last_undegraded":"2024-09-12T17:28:22.871380+0000","last_fullsized":"2024-09-12T17:28:22.871380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:25.713951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:24.747265+0000","last_change":"2024-09-12T17:28:21.472039+0000","last_active":"2024-09-12T17:28:24.747265+0000","last_peered":"2024-09-12T17:28:24.747265+0000","last_clean":"2024-09-12T17:28:24.747265+0000","last_became_active":"2024-09-12T17:28:21.471678+0000","last_became_peered":"2024-09-12T17:28:21.471678+0000","last_unstale":"2024-09-12T17:28:24.747265+0000","last_undegraded":"2024-09-12T17:28:24.747265+0000","last_fullsized":"2024-09-12T17:28:24.747265+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:05.827719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"31'55","reported_seq":112,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.078333+0000","last_change":"2024-09-12T17:27:46.437943+0000","last_active":"2024-09-12T17:29:49.078333+0000","last_peered":"2024-09-12T17:29:49.078333+0000","last_clean":"2024-09-12T17:29:49.078333+0000","last_became_active":"2024-09-12T17:27:46.437623+0000","last_became_peered":"2024-09-12T17:27:46.437623+0000","last_unstale":"2024-09-12T17:29:49.078333+0000","last_undegraded":"2024-09-12T17:29:49.078333+0000","last_fullsized":"2024-09-12T17:29:49.078333+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:29.626451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.467936+0000","last_change":"2024-09-12T17:27:48.440791+0000","last_active":"2024-09-12T17:28:21.467936+0000","last_peered":"2024-09-12T17:28:21.467936+0000","last_clean":"2024-09-12T17:28:21.467936+0000","last_became_active":"2024-09-12T17:27:48.440354+0000","last_became_peered":"2024-09-12T17:27:48.440354+0000","last_unstale":"2024-09-12T17:28:21.467936+0000","last_undegraded":"2024-09-12T17:28:21.467936+0000","last_fullsized":"2024-09-12T17:28:21.467936+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:12.406427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"31'14","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.013731+0000","last_change":"2024-09-12T17:27:50.457985+0000","last_active":"2024-09-12T17:29:49.013731+0000","last_peered":"2024-09-12T17:29:49.013731+0000","last_clean":"2024-09-12T17:29:49.013731+0000","last_became_active":"2024-09-12T17:27:50.457744+0000","last_became_peered":"2024-09-12T17:27:50.457744+0000","last_unstale":"2024-09-12T17:29:49.013731+0000","last_undegraded":"2024-09-12T17:29:49.013731+0000","last_fullsized":"2024-09-12T17:29:49.013731+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:13.394393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"31'6","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:05.377000+0000","last_change":"2024-09-12T17:27:42.424802+0000","last_active":"2024-09-12T17:29:05.377000+0000","last_peered":"2024-09-12T17:29:05.377000+0000","last_clean":"2024-09-12T17:29:05.377000+0000","last_became_active":"2024-09-12T17:27:42.424447+0000","last_became_peered":"2024-09-12T17:27:42.424447+0000","last_unstale":"2024-09-12T17:29:05.377000+0000","last_undegraded":"2024-09-12T17:29:05.377000+0000","last_fullsized":"2024-09-12T17:29:05.377000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:50.988456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.467680+0000","last_change":"2024-09-12T17:27:40.415772+0000","last_active":"2024-09-12T17:28:21.467680+0000","last_peered":"2024-09-12T17:28:21.467680+0000","last_clean":"2024-09-12T17:28:21.467680+0000","last_became_active":"2024-09-12T17:27:40.414911+0000","last_became_peered":"2024-09-12T17:27:40.414911+0000","last_unstale":"2024-09-12T17:28:21.467680+0000","last_undegraded":"2024-09-12T17:28:21.467680+0000","last_fullsized":"2024-09-12T17:28:21.467680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:33.541500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"31'4","reported_seq":227,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:48.716416+0000","last_change":"2024-09-12T17:27:44.428072+0000","last_active":"2024-09-12T17:29:48.716416+0000","last_peered":"2024-09-12T17:29:48.716416+0000","last_clean":"2024-09-12T17:29:48.716416+0000","last_became_active":"2024-09-12T17:27:44.427778+0000","last_became_peered":"2024-09-12T17:27:44.427778+0000","last_unstale":"2024-09-12T17:29:48.716416+0000","last_undegraded":"2024-09-12T17:29:48.716416+0000","last_fullsized":"2024-09-12T17:29:48.716416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:40.229931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"31'36","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.587748+0000","last_change":"2024-09-12T17:27:46.440779+0000","last_active":"2024-09-12T17:29:47.587748+0000","last_peered":"2024-09-12T17:29:47.587748+0000","last_clean":"2024-09-12T17:29:47.587748+0000","last_became_active":"2024-09-12T17:27:46.440494+0000","last_became_peered":"2024-09-12T17:27:46.440494+0000","last_unstale":"2024-09-12T17:29:47.587748+0000","last_undegraded":"2024-09-12T17:29:47.587748+0000","last_fullsized":"2024-09-12T17:29:47.587748+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:43.434855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471249+0000","last_change":"2024-09-12T17:27:48.449171+0000","last_active":"2024-09-12T17:28:21.471249+0000","last_peered":"2024-09-12T17:28:21.471249+0000","last_clean":"2024-09-12T17:28:21.471249+0000","last_became_active":"2024-09-12T17:27:48.448871+0000","last_became_peered":"2024-09-12T17:27:48.448871+0000","last_unstale":"2024-09-12T17:28:21.471249+0000","last_undegraded":"2024-09-12T17:28:21.471249+0000","last_fullsized":"2024-09-12T17:28:21.471249+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:23.511991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463074+0000","last_change":"2024-09-12T17:27:50.452011+0000","last_active":"2024-09-12T17:28:21.463074+0000","last_peered":"2024-09-12T17:28:21.463074+0000","last_clean":"2024-09-12T17:28:21.463074+0000","last_became_active":"2024-09-12T17:27:50.451678+0000","last_became_peered":"2024-09-12T17:27:50.451678+0000","last_unstale":"2024-09-12T17:28:21.463074+0000","last_undegraded":"2024-09-12T17:28:21.463074+0000","last_fullsized":"2024-09-12T17:28:21.463074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:15.594880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.197331+0000","last_change":"2024-09-12T17:27:42.438932+0000","last_active":"2024-09-12T17:30:50.197331+0000","last_peered":"2024-09-12T17:30:50.197331+0000","last_clean":"2024-09-12T17:30:50.197331+0000","last_became_active":"2024-09-12T17:27:42.438583+0000","last_became_peered":"2024-09-12T17:27:42.438583+0000","last_unstale":"2024-09-12T17:30:50.197331+0000","last_undegraded":"2024-09-12T17:30:50.197331+0000","last_fullsized":"2024-09-12T17:30:50.197331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:41.527263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469834+0000","last_change":"2024-09-12T17:27:40.414311+0000","last_active":"2024-09-12T17:28:21.469834+0000","last_peered":"2024-09-12T17:28:21.469834+0000","last_clean":"2024-09-12T17:28:21.469834+0000","last_became_active":"2024-09-12T17:27:40.414034+0000","last_became_peered":"2024-09-12T17:27:40.414034+0000","last_unstale":"2024-09-12T17:28:21.469834+0000","last_undegraded":"2024-09-12T17:28:21.469834+0000","last_fullsized":"2024-09-12T17:28:21.469834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:02.612906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.467688+0000","last_change":"2024-09-12T17:27:44.427310+0000","last_active":"2024-09-12T17:28:21.467688+0000","last_peered":"2024-09-12T17:28:21.467688+0000","last_clean":"2024-09-12T17:28:21.467688+0000","last_became_active":"2024-09-12T17:27:44.426927+0000","last_became_peered":"2024-09-12T17:27:44.426927+0000","last_unstale":"2024-09-12T17:28:21.467688+0000","last_undegraded":"2024-09-12T17:28:21.467688+0000","last_fullsized":"2024-09-12T17:28:21.467688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:51.409386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"31'32","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.604974+0000","last_change":"2024-09-12T17:27:46.439119+0000","last_active":"2024-09-12T17:29:47.604974+0000","last_peered":"2024-09-12T17:29:47.604974+0000","last_clean":"2024-09-12T17:29:47.604974+0000","last_became_active":"2024-09-12T17:27:46.438778+0000","last_became_peered":"2024-09-12T17:27:46.438778+0000","last_unstale":"2024-09-12T17:29:47.604974+0000","last_undegraded":"2024-09-12T17:29:47.604974+0000","last_fullsized":"2024-09-12T17:29:47.604974+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:47.015548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.473244+0000","last_change":"2024-09-12T17:27:48.440227+0000","last_active":"2024-09-12T17:28:21.473244+0000","last_peered":"2024-09-12T17:28:21.473244+0000","last_clean":"2024-09-12T17:28:21.473244+0000","last_became_active":"2024-09-12T17:27:48.439888+0000","last_became_peered":"2024-09-12T17:27:48.439888+0000","last_unstale":"2024-09-12T17:28:21.473244+0000","last_undegraded":"2024-09-12T17:28:21.473244+0000","last_fullsized":"2024-09-12T17:28:21.473244+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:29.484764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"31'3","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.072631+0000","last_change":"2024-09-12T17:27:50.455406+0000","last_active":"2024-09-12T17:29:49.072631+0000","last_peered":"2024-09-12T17:29:49.072631+0000","last_clean":"2024-09-12T17:29:49.072631+0000","last_became_active":"2024-09-12T17:27:50.454058+0000","last_became_peered":"2024-09-12T17:27:50.454058+0000","last_unstale":"2024-09-12T17:29:49.072631+0000","last_undegraded":"2024-09-12T17:29:49.072631+0000","last_fullsized":"2024-09-12T17:29:49.072631+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:44.719122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"31'6","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.225767+0000","last_change":"2024-09-12T17:27:42.428738+0000","last_active":"2024-09-12T17:30:50.225767+0000","last_peered":"2024-09-12T17:30:50.225767+0000","last_clean":"2024-09-12T17:30:50.225767+0000","last_became_active":"2024-09-12T17:27:42.428236+0000","last_became_peered":"2024-09-12T17:27:42.428236+0000","last_unstale":"2024-09-12T17:30:50.225767+0000","last_undegraded":"2024-09-12T17:30:50.225767+0000","last_fullsized":"2024-09-12T17:30:50.225767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:41.383292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"31'6","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.138918+0000","last_change":"2024-09-12T17:27:40.429226+0000","last_active":"2024-09-12T17:30:50.138918+0000","last_peered":"2024-09-12T17:30:50.138918+0000","last_clean":"2024-09-12T17:30:50.138918+0000","last_became_active":"2024-09-12T17:27:40.428969+0000","last_became_peered":"2024-09-12T17:27:40.428969+0000","last_unstale":"2024-09-12T17:30:50.138918+0000","last_undegraded":"2024-09-12T17:30:50.138918+0000","last_fullsized":"2024-09-12T17:30:50.138918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:34.741245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":14,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470977+0000","last_change":"2024-09-12T17:27:44.432908+0000","last_active":"2024-09-12T17:28:21.470977+0000","last_peered":"2024-09-12T17:28:21.470977+0000","last_clean":"2024-09-12T17:28:21.470977+0000","last_became_active":"2024-09-12T17:27:44.432609+0000","last_became_peered":"2024-09-12T17:27:44.432609+0000","last_unstale":"2024-09-12T17:28:21.470977+0000","last_undegraded":"2024-09-12T17:28:21.470977+0000","last_fullsized":"2024-09-12T17:28:21.470977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:38.819057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"29'10","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465451+0000","last_change":"2024-09-12T17:27:46.445145+0000","last_active":"2024-09-12T17:28:21.465451+0000","last_peered":"2024-09-12T17:28:21.465451+0000","last_clean":"2024-09-12T17:28:21.465451+0000","last_became_active":"2024-09-12T17:27:46.444644+0000","last_became_peered":"2024-09-12T17:27:46.444644+0000","last_unstale":"2024-09-12T17:28:21.465451+0000","last_undegraded":"2024-09-12T17:28:21.465451+0000","last_fullsized":"2024-09-12T17:28:21.465451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:28.337567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"31'282","reported_seq":371,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.344750+0000","last_change":"2024-09-12T17:27:48.449435+0000","last_active":"2024-09-12T17:30:50.344750+0000","last_peered":"2024-09-12T17:30:50.344750+0000","last_clean":"2024-09-12T17:30:50.344750+0000","last_became_active":"2024-09-12T17:27:48.449138+0000","last_became_peered":"2024-09-12T17:27:48.449138+0000","last_unstale":"2024-09-12T17:30:50.344750+0000","last_undegraded":"2024-09-12T17:30:50.344750+0000","last_fullsized":"2024-09-12T17:30:50.344750+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:43.994480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.462765+0000","last_change":"2024-09-12T17:27:50.452165+0000","last_active":"2024-09-12T17:28:21.462765+0000","last_peered":"2024-09-12T17:28:21.462765+0000","last_clean":"2024-09-12T17:28:21.462765+0000","last_became_active":"2024-09-12T17:27:50.451899+0000","last_became_peered":"2024-09-12T17:27:50.451899+0000","last_unstale":"2024-09-12T17:28:21.462765+0000","last_undegraded":"2024-09-12T17:28:21.462765+0000","last_fullsized":"2024-09-12T17:28:21.462765+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:38.778216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"31'8","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.195915+0000","last_change":"2024-09-12T17:27:42.430391+0000","last_active":"2024-09-12T17:30:50.195915+0000","last_peered":"2024-09-12T17:30:50.195915+0000","last_clean":"2024-09-12T17:30:50.195915+0000","last_became_active":"2024-09-12T17:27:42.430110+0000","last_became_peered":"2024-09-12T17:27:42.430110+0000","last_unstale":"2024-09-12T17:30:50.195915+0000","last_undegraded":"2024-09-12T17:30:50.195915+0000","last_fullsized":"2024-09-12T17:30:50.195915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:09.624789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:48.918402+0000","last_change":"2024-09-12T17:27:40.415902+0000","last_active":"2024-09-12T17:29:48.918402+0000","last_peered":"2024-09-12T17:29:48.918402+0000","last_clean":"2024-09-12T17:29:48.918402+0000","last_became_active":"2024-09-12T17:27:40.415018+0000","last_became_peered":"2024-09-12T17:27:40.415018+0000","last_unstale":"2024-09-12T17:29:48.918402+0000","last_undegraded":"2024-09-12T17:29:48.918402+0000","last_fullsized":"2024-09-12T17:29:48.918402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:40.407846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470596+0000","last_change":"2024-09-12T17:27:44.433006+0000","last_active":"2024-09-12T17:28:21.470596+0000","last_peered":"2024-09-12T17:28:21.470596+0000","last_clean":"2024-09-12T17:28:21.470596+0000","last_became_active":"2024-09-12T17:27:44.432389+0000","last_became_peered":"2024-09-12T17:27:44.432389+0000","last_unstale":"2024-09-12T17:28:21.470596+0000","last_undegraded":"2024-09-12T17:28:21.470596+0000","last_fullsized":"2024-09-12T17:28:21.470596+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:18.314088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"31'36","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.578959+0000","last_change":"2024-09-12T17:27:46.437010+0000","last_active":"2024-09-12T17:29:47.578959+0000","last_peered":"2024-09-12T17:29:47.578959+0000","last_clean":"2024-09-12T17:29:47.578959+0000","last_became_active":"2024-09-12T17:27:46.435056+0000","last_became_peered":"2024-09-12T17:27:46.435056+0000","last_unstale":"2024-09-12T17:29:47.578959+0000","last_undegraded":"2024-09-12T17:29:47.578959+0000","last_fullsized":"2024-09-12T17:29:47.578959+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:41.987106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470481+0000","last_change":"2024-09-12T17:27:48.451418+0000","last_active":"2024-09-12T17:28:21.470481+0000","last_peered":"2024-09-12T17:28:21.470481+0000","last_clean":"2024-09-12T17:28:21.470481+0000","last_became_active":"2024-09-12T17:27:48.451143+0000","last_became_peered":"2024-09-12T17:27:48.451143+0000","last_unstale":"2024-09-12T17:28:21.470481+0000","last_undegraded":"2024-09-12T17:28:21.470481+0000","last_fullsized":"2024-09-12T17:28:21.470481+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:05.841062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469983+0000","last_change":"2024-09-12T17:27:50.459043+0000","last_active":"2024-09-12T17:28:21.469983+0000","last_peered":"2024-09-12T17:28:21.469983+0000","last_clean":"2024-09-12T17:28:21.469983+0000","last_became_active":"2024-09-12T17:27:50.458688+0000","last_became_peered":"2024-09-12T17:27:50.458688+0000","last_unstale":"2024-09-12T17:28:21.469983+0000","last_undegraded":"2024-09-12T17:28:21.469983+0000","last_fullsized":"2024-09-12T17:28:21.469983+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:52.579121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'17","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.936036+0000","last_change":"2024-09-12T17:27:42.429938+0000","last_active":"2024-09-12T17:30:49.936036+0000","last_peered":"2024-09-12T17:30:49.936036+0000","last_clean":"2024-09-12T17:30:49.936036+0000","last_became_active":"2024-09-12T17:27:42.429645+0000","last_became_peered":"2024-09-12T17:27:42.429645+0000","last_unstale":"2024-09-12T17:30:49.936036+0000","last_undegraded":"2024-09-12T17:30:49.936036+0000","last_fullsized":"2024-09-12T17:30:49.936036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:26.167048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":59,"num_read_kb":51,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465519+0000","last_change":"2024-09-12T17:27:40.433842+0000","last_active":"2024-09-12T17:28:21.465519+0000","last_peered":"2024-09-12T17:28:21.465519+0000","last_clean":"2024-09-12T17:28:21.465519+0000","last_became_active":"2024-09-12T17:27:40.433580+0000","last_became_peered":"2024-09-12T17:27:40.433580+0000","last_unstale":"2024-09-12T17:28:21.465519+0000","last_undegraded":"2024-09-12T17:28:21.465519+0000","last_fullsized":"2024-09-12T17:28:21.465519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:42.180970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469077+0000","last_change":"2024-09-12T17:27:44.433816+0000","last_active":"2024-09-12T17:28:21.469077+0000","last_peered":"2024-09-12T17:28:21.469077+0000","last_clean":"2024-09-12T17:28:21.469077+0000","last_became_active":"2024-09-12T17:27:44.433529+0000","last_became_peered":"2024-09-12T17:27:44.433529+0000","last_unstale":"2024-09-12T17:28:21.469077+0000","last_undegraded":"2024-09-12T17:28:21.469077+0000","last_fullsized":"2024-09-12T17:28:21.469077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:41.042095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"31'32","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:14.761606+0000","last_change":"2024-09-12T17:27:46.439345+0000","last_active":"2024-09-12T17:30:14.761606+0000","last_peered":"2024-09-12T17:30:14.761606+0000","last_clean":"2024-09-12T17:30:14.761606+0000","last_became_active":"2024-09-12T17:27:46.439037+0000","last_became_peered":"2024-09-12T17:27:46.439037+0000","last_unstale":"2024-09-12T17:30:14.761606+0000","last_undegraded":"2024-09-12T17:30:14.761606+0000","last_fullsized":"2024-09-12T17:30:14.761606+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:39.381080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463052+0000","last_change":"2024-09-12T17:27:48.449101+0000","last_active":"2024-09-12T17:28:21.463052+0000","last_peered":"2024-09-12T17:28:21.463052+0000","last_clean":"2024-09-12T17:28:21.463052+0000","last_became_active":"2024-09-12T17:27:48.448426+0000","last_became_peered":"2024-09-12T17:27:48.448426+0000","last_unstale":"2024-09-12T17:28:21.463052+0000","last_undegraded":"2024-09-12T17:28:21.463052+0000","last_fullsized":"2024-09-12T17:28:21.463052+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:18.516470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464580+0000","last_change":"2024-09-12T17:27:50.459948+0000","last_active":"2024-09-12T17:28:21.464580+0000","last_peered":"2024-09-12T17:28:21.464580+0000","last_clean":"2024-09-12T17:28:21.464580+0000","last_became_active":"2024-09-12T17:27:50.459662+0000","last_became_peered":"2024-09-12T17:27:50.459662+0000","last_unstale":"2024-09-12T17:28:21.464580+0000","last_undegraded":"2024-09-12T17:28:21.464580+0000","last_fullsized":"2024-09-12T17:28:21.464580+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:08.216661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'12","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.148532+0000","last_change":"2024-09-12T17:28:21.476547+0000","last_active":"2024-09-12T17:30:50.148532+0000","last_peered":"2024-09-12T17:30:50.148532+0000","last_clean":"2024-09-12T17:30:50.148532+0000","last_became_active":"2024-09-12T17:28:21.472532+0000","last_became_peered":"2024-09-12T17:28:21.472532+0000","last_unstale":"2024-09-12T17:30:50.148532+0000","last_undegraded":"2024-09-12T17:30:50.148532+0000","last_fullsized":"2024-09-12T17:30:50.148532+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:31.654192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"31'1","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:44.756709+0000","last_change":"2024-09-12T17:27:40.419012+0000","last_active":"2024-09-12T17:29:44.756709+0000","last_peered":"2024-09-12T17:29:44.756709+0000","last_clean":"2024-09-12T17:29:44.756709+0000","last_became_active":"2024-09-12T17:27:40.418464+0000","last_became_peered":"2024-09-12T17:27:40.418464+0000","last_unstale":"2024-09-12T17:29:44.756709+0000","last_undegraded":"2024-09-12T17:29:44.756709+0000","last_fullsized":"2024-09-12T17:29:44.756709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:41.313682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469583+0000","last_change":"2024-09-12T17:27:44.433348+0000","last_active":"2024-09-12T17:28:21.469583+0000","last_peered":"2024-09-12T17:28:21.469583+0000","last_clean":"2024-09-12T17:28:21.469583+0000","last_became_active":"2024-09-12T17:27:44.430221+0000","last_became_peered":"2024-09-12T17:27:44.430221+0000","last_unstale":"2024-09-12T17:28:21.469583+0000","last_undegraded":"2024-09-12T17:28:21.469583+0000","last_fullsized":"2024-09-12T17:28:21.469583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:13.176204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"31'26","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.602901+0000","last_change":"2024-09-12T17:27:46.441427+0000","last_active":"2024-09-12T17:29:47.602901+0000","last_peered":"2024-09-12T17:29:47.602901+0000","last_clean":"2024-09-12T17:29:47.602901+0000","last_became_active":"2024-09-12T17:27:46.441081+0000","last_became_peered":"2024-09-12T17:27:46.441081+0000","last_unstale":"2024-09-12T17:29:47.602901+0000","last_undegraded":"2024-09-12T17:29:47.602901+0000","last_fullsized":"2024-09-12T17:29:47.602901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:08.132341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463313+0000","last_change":"2024-09-12T17:27:48.447632+0000","last_active":"2024-09-12T17:28:21.463313+0000","last_peered":"2024-09-12T17:28:21.463313+0000","last_clean":"2024-09-12T17:28:21.463313+0000","last_became_active":"2024-09-12T17:27:48.447321+0000","last_became_peered":"2024-09-12T17:27:48.447321+0000","last_unstale":"2024-09-12T17:28:21.463313+0000","last_undegraded":"2024-09-12T17:28:21.463313+0000","last_fullsized":"2024-09-12T17:28:21.463313+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:43.865345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"31'10","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.181767+0000","last_change":"2024-09-12T17:27:50.460271+0000","last_active":"2024-09-12T17:30:49.181767+0000","last_peered":"2024-09-12T17:30:49.181767+0000","last_clean":"2024-09-12T17:30:49.181767+0000","last_became_active":"2024-09-12T17:27:50.459463+0000","last_became_peered":"2024-09-12T17:27:50.459463+0000","last_unstale":"2024-09-12T17:30:49.181767+0000","last_undegraded":"2024-09-12T17:30:49.181767+0000","last_fullsized":"2024-09-12T17:30:49.181767+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:18.316219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"31'17","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.232329+0000","last_change":"2024-09-12T17:27:42.430374+0000","last_active":"2024-09-12T17:30:50.232329+0000","last_peered":"2024-09-12T17:30:50.232329+0000","last_clean":"2024-09-12T17:30:50.232329+0000","last_became_active":"2024-09-12T17:27:42.430021+0000","last_became_peered":"2024-09-12T17:27:42.430021+0000","last_unstale":"2024-09-12T17:30:50.232329+0000","last_undegraded":"2024-09-12T17:30:50.232329+0000","last_fullsized":"2024-09-12T17:30:50.232329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:54.683103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":76,"num_read_kb":68,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470409+0000","last_change":"2024-09-12T17:27:40.416382+0000","last_active":"2024-09-12T17:28:21.470409+0000","last_peered":"2024-09-12T17:28:21.470409+0000","last_clean":"2024-09-12T17:28:21.470409+0000","last_became_active":"2024-09-12T17:27:40.415549+0000","last_became_peered":"2024-09-12T17:27:40.415549+0000","last_unstale":"2024-09-12T17:28:21.470409+0000","last_undegraded":"2024-09-12T17:28:21.470409+0000","last_fullsized":"2024-09-12T17:28:21.470409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:42:31.960679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"31'2","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:46.228947+0000","last_change":"2024-09-12T17:27:44.433362+0000","last_active":"2024-09-12T17:29:46.228947+0000","last_peered":"2024-09-12T17:29:46.228947+0000","last_clean":"2024-09-12T17:29:46.228947+0000","last_became_active":"2024-09-12T17:27:44.433037+0000","last_became_peered":"2024-09-12T17:27:44.433037+0000","last_unstale":"2024-09-12T17:29:46.228947+0000","last_undegraded":"2024-09-12T17:29:46.228947+0000","last_fullsized":"2024-09-12T17:29:46.228947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:52.650681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"31'33","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.096185+0000","last_change":"2024-09-12T17:27:46.443590+0000","last_active":"2024-09-12T17:30:49.096185+0000","last_peered":"2024-09-12T17:30:49.096185+0000","last_clean":"2024-09-12T17:30:49.096185+0000","last_became_active":"2024-09-12T17:27:46.443316+0000","last_became_peered":"2024-09-12T17:27:46.443316+0000","last_unstale":"2024-09-12T17:30:49.096185+0000","last_undegraded":"2024-09-12T17:30:49.096185+0000","last_fullsized":"2024-09-12T17:30:49.096185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:47.273927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471547+0000","last_change":"2024-09-12T17:27:48.448239+0000","last_active":"2024-09-12T17:28:21.471547+0000","last_peered":"2024-09-12T17:28:21.471547+0000","last_clean":"2024-09-12T17:28:21.471547+0000","last_became_active":"2024-09-12T17:27:48.447884+0000","last_became_peered":"2024-09-12T17:27:48.447884+0000","last_unstale":"2024-09-12T17:28:21.471547+0000","last_undegraded":"2024-09-12T17:28:21.471547+0000","last_fullsized":"2024-09-12T17:28:21.471547+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:37.799636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"31'2","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.614754+0000","last_change":"2024-09-12T17:27:50.459747+0000","last_active":"2024-09-12T17:29:47.614754+0000","last_peered":"2024-09-12T17:29:47.614754+0000","last_clean":"2024-09-12T17:29:47.614754+0000","last_became_active":"2024-09-12T17:27:50.459464+0000","last_became_peered":"2024-09-12T17:27:50.459464+0000","last_unstale":"2024-09-12T17:29:47.614754+0000","last_undegraded":"2024-09-12T17:29:47.614754+0000","last_fullsized":"2024-09-12T17:29:47.614754+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:47.424145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"31'6","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.018176+0000","last_change":"2024-09-12T17:28:21.475279+0000","last_active":"2024-09-12T17:30:50.018176+0000","last_peered":"2024-09-12T17:30:50.018176+0000","last_clean":"2024-09-12T17:30:50.018176+0000","last_became_active":"2024-09-12T17:28:21.471738+0000","last_became_peered":"2024-09-12T17:28:21.471738+0000","last_unstale":"2024-09-12T17:30:50.018176+0000","last_undegraded":"2024-09-12T17:30:50.018176+0000","last_fullsized":"2024-09-12T17:30:50.018176+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:24.585090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"31'1","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.757645+0000","last_change":"2024-09-12T17:27:40.425416+0000","last_active":"2024-09-12T17:29:49.757645+0000","last_peered":"2024-09-12T17:29:49.757645+0000","last_clean":"2024-09-12T17:29:49.757645+0000","last_became_active":"2024-09-12T17:27:40.425150+0000","last_became_peered":"2024-09-12T17:27:40.425150+0000","last_unstale":"2024-09-12T17:29:49.757645+0000","last_undegraded":"2024-09-12T17:29:49.757645+0000","last_fullsized":"2024-09-12T17:29:49.757645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:44.782205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"31'6","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.225756+0000","last_change":"2024-09-12T17:27:42.428098+0000","last_active":"2024-09-12T17:30:50.225756+0000","last_peered":"2024-09-12T17:30:50.225756+0000","last_clean":"2024-09-12T17:30:50.225756+0000","last_became_active":"2024-09-12T17:27:42.427745+0000","last_became_peered":"2024-09-12T17:27:42.427745+0000","last_unstale":"2024-09-12T17:30:50.225756+0000","last_undegraded":"2024-09-12T17:30:50.225756+0000","last_fullsized":"2024-09-12T17:30:50.225756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:27.653203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470803+0000","last_change":"2024-09-12T17:27:40.413378+0000","last_active":"2024-09-12T17:28:21.470803+0000","last_peered":"2024-09-12T17:28:21.470803+0000","last_clean":"2024-09-12T17:28:21.470803+0000","last_became_active":"2024-09-12T17:27:40.413068+0000","last_became_peered":"2024-09-12T17:27:40.413068+0000","last_unstale":"2024-09-12T17:28:21.470803+0000","last_undegraded":"2024-09-12T17:28:21.470803+0000","last_fullsized":"2024-09-12T17:28:21.470803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:35.900609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465685+0000","last_change":"2024-09-12T17:27:42.429127+0000","last_active":"2024-09-12T17:28:21.465685+0000","last_peered":"2024-09-12T17:28:21.465685+0000","last_clean":"2024-09-12T17:28:21.465685+0000","last_became_active":"2024-09-12T17:27:42.428871+0000","last_became_peered":"2024-09-12T17:27:42.428871+0000","last_unstale":"2024-09-12T17:28:21.465685+0000","last_undegraded":"2024-09-12T17:28:21.465685+0000","last_fullsized":"2024-09-12T17:28:21.465685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:46.400627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464105+0000","last_change":"2024-09-12T17:27:40.423623+0000","last_active":"2024-09-12T17:28:21.464105+0000","last_peered":"2024-09-12T17:28:21.464105+0000","last_clean":"2024-09-12T17:28:21.464105+0000","last_became_active":"2024-09-12T17:27:40.423210+0000","last_became_peered":"2024-09-12T17:27:40.423210+0000","last_unstale":"2024-09-12T17:28:21.464105+0000","last_undegraded":"2024-09-12T17:28:21.464105+0000","last_fullsized":"2024-09-12T17:28:21.464105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:10.561707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"31'10","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.148353+0000","last_change":"2024-09-12T17:27:42.428508+0000","last_active":"2024-09-12T17:30:50.148353+0000","last_peered":"2024-09-12T17:30:50.148353+0000","last_clean":"2024-09-12T17:30:50.148353+0000","last_became_active":"2024-09-12T17:27:42.428059+0000","last_became_peered":"2024-09-12T17:27:42.428059+0000","last_unstale":"2024-09-12T17:30:50.148353+0000","last_undegraded":"2024-09-12T17:30:50.148353+0000","last_fullsized":"2024-09-12T17:30:50.148353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:35.350838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.821850+0000","last_change":"2024-09-12T17:27:40.420118+0000","last_active":"2024-09-12T17:28:21.821850+0000","last_peered":"2024-09-12T17:28:21.821850+0000","last_clean":"2024-09-12T17:28:21.821850+0000","last_became_active":"2024-09-12T17:27:40.419018+0000","last_became_peered":"2024-09-12T17:27:40.419018+0000","last_unstale":"2024-09-12T17:28:21.821850+0000","last_undegraded":"2024-09-12T17:28:21.821850+0000","last_fullsized":"2024-09-12T17:28:21.821850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:45.609329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"31'4","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:23.352679+0000","last_change":"2024-09-12T17:27:42.425653+0000","last_active":"2024-09-12T17:28:23.352679+0000","last_peered":"2024-09-12T17:28:23.352679+0000","last_clean":"2024-09-12T17:28:23.352679+0000","last_became_active":"2024-09-12T17:27:42.424201+0000","last_became_peered":"2024-09-12T17:27:42.424201+0000","last_unstale":"2024-09-12T17:28:23.352679+0000","last_undegraded":"2024-09-12T17:28:23.352679+0000","last_fullsized":"2024-09-12T17:28:23.352679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:14.199032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.472579+0000","last_change":"2024-09-12T17:27:40.415678+0000","last_active":"2024-09-12T17:28:21.472579+0000","last_peered":"2024-09-12T17:28:21.472579+0000","last_clean":"2024-09-12T17:28:21.472579+0000","last_became_active":"2024-09-12T17:27:40.415318+0000","last_became_peered":"2024-09-12T17:27:40.415318+0000","last_unstale":"2024-09-12T17:28:21.472579+0000","last_undegraded":"2024-09-12T17:28:21.472579+0000","last_fullsized":"2024-09-12T17:28:21.472579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:42.195527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"31'6","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.225777+0000","last_change":"2024-09-12T17:27:42.434915+0000","last_active":"2024-09-12T17:30:50.225777+0000","last_peered":"2024-09-12T17:30:50.225777+0000","last_clean":"2024-09-12T17:30:50.225777+0000","last_became_active":"2024-09-12T17:27:42.434664+0000","last_became_peered":"2024-09-12T17:27:42.434664+0000","last_unstale":"2024-09-12T17:30:50.225777+0000","last_undegraded":"2024-09-12T17:30:50.225777+0000","last_fullsized":"2024-09-12T17:30:50.225777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:59.091747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:22.296581+0000","last_change":"2024-09-12T17:27:40.421011+0000","last_active":"2024-09-12T17:28:22.296581+0000","last_peered":"2024-09-12T17:28:22.296581+0000","last_clean":"2024-09-12T17:28:22.296581+0000","last_became_active":"2024-09-12T17:27:40.420491+0000","last_became_peered":"2024-09-12T17:27:40.420491+0000","last_unstale":"2024-09-12T17:28:22.296581+0000","last_undegraded":"2024-09-12T17:28:22.296581+0000","last_fullsized":"2024-09-12T17:28:22.296581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:35.277806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"31'10","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:05.194652+0000","last_change":"2024-09-12T17:27:42.425216+0000","last_active":"2024-09-12T17:29:05.194652+0000","last_peered":"2024-09-12T17:29:05.194652+0000","last_clean":"2024-09-12T17:29:05.194652+0000","last_became_active":"2024-09-12T17:27:42.424810+0000","last_became_peered":"2024-09-12T17:27:42.424810+0000","last_unstale":"2024-09-12T17:29:05.194652+0000","last_undegraded":"2024-09-12T17:29:05.194652+0000","last_fullsized":"2024-09-12T17:29:05.194652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:08.170045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":37,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469473+0000","last_change":"2024-09-12T17:27:40.431654+0000","last_active":"2024-09-12T17:28:21.469473+0000","last_peered":"2024-09-12T17:28:21.469473+0000","last_clean":"2024-09-12T17:28:21.469473+0000","last_became_active":"2024-09-12T17:27:40.431365+0000","last_became_peered":"2024-09-12T17:27:40.431365+0000","last_unstale":"2024-09-12T17:28:21.469473+0000","last_undegraded":"2024-09-12T17:28:21.469473+0000","last_fullsized":"2024-09-12T17:28:21.469473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:42:31.960679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"31'13","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.202797+0000","last_change":"2024-09-12T17:27:42.423482+0000","last_active":"2024-09-12T17:30:50.202797+0000","last_peered":"2024-09-12T17:30:50.202797+0000","last_clean":"2024-09-12T17:30:50.202797+0000","last_became_active":"2024-09-12T17:27:42.423099+0000","last_became_peered":"2024-09-12T17:27:42.423099+0000","last_unstale":"2024-09-12T17:30:50.202797+0000","last_undegraded":"2024-09-12T17:30:50.202797+0000","last_fullsized":"2024-09-12T17:30:50.202797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:16.940321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.822005+0000","last_change":"2024-09-12T17:27:40.415799+0000","last_active":"2024-09-12T17:28:21.822005+0000","last_peered":"2024-09-12T17:28:21.822005+0000","last_clean":"2024-09-12T17:28:21.822005+0000","last_became_active":"2024-09-12T17:27:40.415456+0000","last_became_peered":"2024-09-12T17:27:40.415456+0000","last_unstale":"2024-09-12T17:28:21.822005+0000","last_undegraded":"2024-09-12T17:28:21.822005+0000","last_fullsized":"2024-09-12T17:28:21.822005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:28.905045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"31'7","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.024232+0000","last_change":"2024-09-12T17:27:42.428053+0000","last_active":"2024-09-12T17:30:50.024232+0000","last_peered":"2024-09-12T17:30:50.024232+0000","last_clean":"2024-09-12T17:30:50.024232+0000","last_became_active":"2024-09-12T17:27:42.427778+0000","last_became_peered":"2024-09-12T17:27:42.427778+0000","last_unstale":"2024-09-12T17:30:50.024232+0000","last_undegraded":"2024-09-12T17:30:50.024232+0000","last_fullsized":"2024-09-12T17:30:50.024232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:29.654847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"31'1","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:50.765249+0000","last_change":"2024-09-12T17:27:40.418491+0000","last_active":"2024-09-12T17:29:50.765249+0000","last_peered":"2024-09-12T17:29:50.765249+0000","last_clean":"2024-09-12T17:29:50.765249+0000","last_became_active":"2024-09-12T17:27:40.418241+0000","last_became_peered":"2024-09-12T17:27:40.418241+0000","last_unstale":"2024-09-12T17:29:50.765249+0000","last_undegraded":"2024-09-12T17:29:50.765249+0000","last_fullsized":"2024-09-12T17:29:50.765249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:44.106061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:22.319225+0000","last_change":"2024-09-12T17:27:42.433339+0000","last_active":"2024-09-12T17:28:22.319225+0000","last_peered":"2024-09-12T17:28:22.319225+0000","last_clean":"2024-09-12T17:28:22.319225+0000","last_became_active":"2024-09-12T17:27:42.433084+0000","last_became_peered":"2024-09-12T17:27:42.433084+0000","last_unstale":"2024-09-12T17:28:22.319225+0000","last_undegraded":"2024-09-12T17:28:22.319225+0000","last_fullsized":"2024-09-12T17:28:22.319225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:14.732392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.822515+0000","last_change":"2024-09-12T17:27:40.418064+0000","last_active":"2024-09-12T17:28:21.822515+0000","last_peered":"2024-09-12T17:28:21.822515+0000","last_clean":"2024-09-12T17:28:21.822515+0000","last_became_active":"2024-09-12T17:27:40.417666+0000","last_became_peered":"2024-09-12T17:27:40.417666+0000","last_unstale":"2024-09-12T17:28:21.822515+0000","last_undegraded":"2024-09-12T17:28:21.822515+0000","last_fullsized":"2024-09-12T17:28:21.822515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:13.932643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"31'8","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.148411+0000","last_change":"2024-09-12T17:27:42.424818+0000","last_active":"2024-09-12T17:30:50.148411+0000","last_peered":"2024-09-12T17:30:50.148411+0000","last_clean":"2024-09-12T17:30:50.148411+0000","last_became_active":"2024-09-12T17:27:42.424017+0000","last_became_peered":"2024-09-12T17:27:42.424017+0000","last_unstale":"2024-09-12T17:30:50.148411+0000","last_undegraded":"2024-09-12T17:30:50.148411+0000","last_fullsized":"2024-09-12T17:30:50.148411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:22.656734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469834+0000","last_change":"2024-09-12T17:27:40.422351+0000","last_active":"2024-09-12T17:28:21.469834+0000","last_peered":"2024-09-12T17:28:21.469834+0000","last_clean":"2024-09-12T17:28:21.469834+0000","last_became_active":"2024-09-12T17:27:40.418964+0000","last_became_peered":"2024-09-12T17:27:40.418964+0000","last_unstale":"2024-09-12T17:28:21.469834+0000","last_undegraded":"2024-09-12T17:28:21.469834+0000","last_fullsized":"2024-09-12T17:28:21.469834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:51.844092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"31'6","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.076791+0000","last_change":"2024-09-12T17:27:42.424747+0000","last_active":"2024-09-12T17:29:49.076791+0000","last_peered":"2024-09-12T17:29:49.076791+0000","last_clean":"2024-09-12T17:29:49.076791+0000","last_became_active":"2024-09-12T17:27:42.422955+0000","last_became_peered":"2024-09-12T17:27:42.422955+0000","last_unstale":"2024-09-12T17:29:49.076791+0000","last_undegraded":"2024-09-12T17:29:49.076791+0000","last_fullsized":"2024-09-12T17:29:49.076791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:41.422424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.467383+0000","last_change":"2024-09-12T17:27:40.418452+0000","last_active":"2024-09-12T17:28:21.467383+0000","last_peered":"2024-09-12T17:28:21.467383+0000","last_clean":"2024-09-12T17:28:21.467383+0000","last_became_active":"2024-09-12T17:27:40.418183+0000","last_became_peered":"2024-09-12T17:27:40.418183+0000","last_unstale":"2024-09-12T17:28:21.467383+0000","last_undegraded":"2024-09-12T17:28:21.467383+0000","last_fullsized":"2024-09-12T17:28:21.467383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:35.210863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"31'5","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.233331+0000","last_change":"2024-09-12T17:27:42.434117+0000","last_active":"2024-09-12T17:30:50.233331+0000","last_peered":"2024-09-12T17:30:50.233331+0000","last_clean":"2024-09-12T17:30:50.233331+0000","last_became_active":"2024-09-12T17:27:42.433856+0000","last_became_peered":"2024-09-12T17:27:42.433856+0000","last_unstale":"2024-09-12T17:30:50.233331+0000","last_undegraded":"2024-09-12T17:30:50.233331+0000","last_fullsized":"2024-09-12T17:30:50.233331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:13.817201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464738+0000","last_change":"2024-09-12T17:27:40.429406+0000","last_active":"2024-09-12T17:28:21.464738+0000","last_peered":"2024-09-12T17:28:21.464738+0000","last_clean":"2024-09-12T17:28:21.464738+0000","last_became_active":"2024-09-12T17:27:40.428213+0000","last_became_peered":"2024-09-12T17:27:40.428213+0000","last_unstale":"2024-09-12T17:28:21.464738+0000","last_undegraded":"2024-09-12T17:28:21.464738+0000","last_fullsized":"2024-09-12T17:28:21.464738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:43.804492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"31'4","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:05.194819+0000","last_change":"2024-09-12T17:27:42.431854+0000","last_active":"2024-09-12T17:29:05.194819+0000","last_peered":"2024-09-12T17:29:05.194819+0000","last_clean":"2024-09-12T17:29:05.194819+0000","last_became_active":"2024-09-12T17:27:42.431562+0000","last_became_peered":"2024-09-12T17:27:42.431562+0000","last_unstale":"2024-09-12T17:29:05.194819+0000","last_undegraded":"2024-09-12T17:29:05.194819+0000","last_fullsized":"2024-09-12T17:29:05.194819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:46.641338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"31'4","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.909000+0000","last_change":"2024-09-12T17:27:40.426248+0000","last_active":"2024-09-12T17:30:49.909000+0000","last_peered":"2024-09-12T17:30:49.909000+0000","last_clean":"2024-09-12T17:30:49.909000+0000","last_became_active":"2024-09-12T17:27:40.425910+0000","last_became_peered":"2024-09-12T17:27:40.425910+0000","last_unstale":"2024-09-12T17:30:49.909000+0000","last_undegraded":"2024-09-12T17:30:49.909000+0000","last_fullsized":"2024-09-12T17:30:49.909000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:23.924826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"31'10","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.018646+0000","last_change":"2024-09-12T17:27:42.429554+0000","last_active":"2024-09-12T17:30:50.018646+0000","last_peered":"2024-09-12T17:30:50.018646+0000","last_clean":"2024-09-12T17:30:50.018646+0000","last_became_active":"2024-09-12T17:27:42.429270+0000","last_became_peered":"2024-09-12T17:27:42.429270+0000","last_unstale":"2024-09-12T17:30:50.018646+0000","last_undegraded":"2024-09-12T17:30:50.018646+0000","last_fullsized":"2024-09-12T17:30:50.018646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:32.810941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.054755+0000","last_change":"2024-09-12T17:27:40.432092+0000","last_active":"2024-09-12T17:29:49.054755+0000","last_peered":"2024-09-12T17:29:49.054755+0000","last_clean":"2024-09-12T17:29:49.054755+0000","last_became_active":"2024-09-12T17:27:40.431687+0000","last_became_peered":"2024-09-12T17:27:40.431687+0000","last_unstale":"2024-09-12T17:29:49.054755+0000","last_undegraded":"2024-09-12T17:29:49.054755+0000","last_fullsized":"2024-09-12T17:29:49.054755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:35.277806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"31'2","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.280728+0000","last_change":"2024-09-12T17:27:42.425651+0000","last_active":"2024-09-12T17:30:50.280728+0000","last_peered":"2024-09-12T17:30:50.280728+0000","last_clean":"2024-09-12T17:30:50.280728+0000","last_became_active":"2024-09-12T17:27:42.424910+0000","last_became_peered":"2024-09-12T17:27:42.424910+0000","last_unstale":"2024-09-12T17:30:50.280728+0000","last_undegraded":"2024-09-12T17:30:50.280728+0000","last_fullsized":"2024-09-12T17:30:50.280728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:52.600151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"31'1","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:00.767359+0000","last_change":"2024-09-12T17:27:40.434016+0000","last_active":"2024-09-12T17:30:00.767359+0000","last_peered":"2024-09-12T17:30:00.767359+0000","last_clean":"2024-09-12T17:30:00.767359+0000","last_became_active":"2024-09-12T17:27:40.433649+0000","last_became_peered":"2024-09-12T17:27:40.433649+0000","last_unstale":"2024-09-12T17:30:00.767359+0000","last_undegraded":"2024-09-12T17:30:00.767359+0000","last_fullsized":"2024-09-12T17:30:00.767359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:40.824207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:48.985835+0000","last_change":"2024-09-12T17:27:40.424269+0000","last_active":"2024-09-12T17:29:48.985835+0000","last_peered":"2024-09-12T17:29:48.985835+0000","last_clean":"2024-09-12T17:29:48.985835+0000","last_became_active":"2024-09-12T17:27:40.423343+0000","last_became_peered":"2024-09-12T17:27:40.423343+0000","last_unstale":"2024-09-12T17:29:48.985835+0000","last_undegraded":"2024-09-12T17:29:48.985835+0000","last_fullsized":"2024-09-12T17:29:48.985835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:04.434511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"31'8","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.196783+0000","last_change":"2024-09-12T17:27:42.426434+0000","last_active":"2024-09-12T17:30:50.196783+0000","last_peered":"2024-09-12T17:30:50.196783+0000","last_clean":"2024-09-12T17:30:50.196783+0000","last_became_active":"2024-09-12T17:27:42.426150+0000","last_became_peered":"2024-09-12T17:27:42.426150+0000","last_unstale":"2024-09-12T17:30:50.196783+0000","last_undegraded":"2024-09-12T17:30:50.196783+0000","last_fullsized":"2024-09-12T17:30:50.196783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:55.894831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471017+0000","last_change":"2024-09-12T17:27:40.420741+0000","last_active":"2024-09-12T17:28:21.471017+0000","last_peered":"2024-09-12T17:28:21.471017+0000","last_clean":"2024-09-12T17:28:21.471017+0000","last_became_active":"2024-09-12T17:27:40.420396+0000","last_became_peered":"2024-09-12T17:27:40.420396+0000","last_unstale":"2024-09-12T17:28:21.471017+0000","last_undegraded":"2024-09-12T17:28:21.471017+0000","last_fullsized":"2024-09-12T17:28:21.471017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:47.834956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"31'4","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.018441+0000","last_change":"2024-09-12T17:27:42.435623+0000","last_active":"2024-09-12T17:30:50.018441+0000","last_peered":"2024-09-12T17:30:50.018441+0000","last_clean":"2024-09-12T17:30:50.018441+0000","last_became_active":"2024-09-12T17:27:42.435324+0000","last_became_peered":"2024-09-12T17:27:42.435324+0000","last_unstale":"2024-09-12T17:30:50.018441+0000","last_undegraded":"2024-09-12T17:30:50.018441+0000","last_fullsized":"2024-09-12T17:30:50.018441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:04.329622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":482,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1662,"num_read_kb":1552,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":83,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51617792,"data_stored":51611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673006,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43848,"kb_used_data":16824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94327992,"statfs":{"total":96636764160,"available":96591863808,"internally_reserved":0,"allocated":17227776,"data_stored":16913193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705709,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40900,"kb_used_data":13876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94330940,"statfs":{"total":96636764160,"available":96594882560,"internally_reserved":0,"allocated":14209024,"data_stored":13946979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705709,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52844,"kb_used_data":9180,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94318996,"statfs":{"total":96636764160,"available":96582651904,"internally_reserved":0,"allocated":9400320,"data_stored":9113910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705710,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44504,"kb_used_data":13320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94327336,"statfs":{"total":96636764160,"available":96591192064,"internally_reserved":0,"allocated":13639680,"data_stored":13356994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13225984,"data_stored":13222784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13225984,"data_stored":13222784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:30:57.666 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T17:30:57.667 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:30:57.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.796+0000 7fd4892e6640 1 Processor -- start 2024-09-12T17:30:57.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.796+0000 7fd4892e6640 1 -- start start 2024-09-12T17:30:57.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.797+0000 7fd4892e6640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd48412f160 0x7fd48412f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:30:57.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.797+0000 7fd4892e6640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd484070f40 con 0x7fd48412fa80 2024-09-12T17:30:57.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.797+0000 7fd4892e6640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fd484070d70 con 0x7fd48412f160 2024-09-12T17:30:57.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.797+0000 7fd482ffd640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd48412f160 0x7fd48412f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:30:57.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.797+0000 7fd47bfff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fd48412fa80 0x7fd48412bc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:58594/0 (socket says 172.21.15.47:58594) 2024-09-12T17:30:57.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.797+0000 7fd47bfff640 1 -- 172.21.15.47:0/938078880 learned_addr learned my addr 172.21.15.47:0/938078880 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-09-12T17:30:57.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.797+0000 7fd482ffd640 1 -- 172.21.15.47:0/938078880 >> v1:172.21.15.47:6789/0 conn(0x7fd48412fa80 legacy=0x7fd48412bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:57.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.797+0000 7fd482ffd640 1 -- 172.21.15.47:0/938078880 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd484072160 con 0x7fd48412f160 2024-09-12T17:30:57.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.797+0000 7fd4827fc640 1 -- 172.21.15.47:0/938078880 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3066577837 0 0) 0x7fd484070f40 con 0x7fd48412fa80 2024-09-12T17:30:57.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.798+0000 7fd482ffd640 1 --2- 172.21.15.47:0/938078880 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd48412f160 0x7fd48412f540 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fd474009720 tx=0x7fd47402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=943b7132c41e3556 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:30:57.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.798+0000 7fd4827fc640 1 -- 172.21.15.47:0/938078880 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd474037070 con 0x7fd48412f160 2024-09-12T17:30:57.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.798+0000 7fd4827fc640 1 -- 172.21.15.47:0/938078880 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd47402ad90 con 0x7fd48412f160 2024-09-12T17:30:57.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.798+0000 7fd4827fc640 1 -- 172.21.15.47:0/938078880 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd474032590 con 0x7fd48412f160 2024-09-12T17:30:57.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.799+0000 7fd4892e6640 1 -- 172.21.15.47:0/938078880 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd48412f160 msgr2=0x7fd48412f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:57.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.799+0000 7fd4892e6640 1 --2- 172.21.15.47:0/938078880 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd48412f160 0x7fd48412f540 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fd474009720 tx=0x7fd47402a110 comp rx=0 tx=0).stop 2024-09-12T17:30:57.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.799+0000 7fd4892e6640 1 -- 172.21.15.47:0/938078880 shutdown_connections 2024-09-12T17:30:57.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.799+0000 7fd4892e6640 1 --2- 172.21.15.47:0/938078880 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd48412f160 0x7fd48412f540 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:30:57.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.799+0000 7fd4892e6640 1 -- 172.21.15.47:0/938078880 >> 172.21.15.47:0/938078880 conn(0x7fd4840a0ae0 msgr2=0x7fd48406dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:30:57.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.799+0000 7fd4892e6640 1 -- 172.21.15.47:0/938078880 shutdown_connections 2024-09-12T17:30:57.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.799+0000 7fd4892e6640 1 -- 172.21.15.47:0/938078880 wait complete. 2024-09-12T17:30:57.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.800+0000 7fd4892e6640 1 Processor -- start 2024-09-12T17:30:57.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.800+0000 7fd4892e6640 1 -- start start 2024-09-12T17:30:57.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.800+0000 7fd4892e6640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd48412f160 0x7fd484127eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:30:57.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.800+0000 7fd4892e6640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd48412c310 con 0x7fd48412f160 2024-09-12T17:30:57.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.800+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd48412f160 0x7fd484127eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:30:57.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.800+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd48412f160 0x7fd484127eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42894/0 (socket says 172.21.15.47:42894) 2024-09-12T17:30:57.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.800+0000 7fd482ffd640 1 -- 172.21.15.47:0/1312435902 learned_addr learned my addr 172.21.15.47:0/1312435902 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:30:57.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.800+0000 7fd482ffd640 1 -- 172.21.15.47:0/1312435902 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd48412a130 con 0x7fd48412f160 2024-09-12T17:30:57.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.801+0000 7fd482ffd640 1 --2- 172.21.15.47:0/1312435902 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd48412f160 0x7fd484127eb0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fd474009720 tx=0x7fd4740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:30:57.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.801+0000 7fd47b7fe640 1 -- 172.21.15.47:0/1312435902 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd474041070 con 0x7fd48412f160 2024-09-12T17:30:57.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.801+0000 7fd47b7fe640 1 -- 172.21.15.47:0/1312435902 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd47403c460 con 0x7fd48412f160 2024-09-12T17:30:57.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.801+0000 7fd4892e6640 1 -- 172.21.15.47:0/1312435902 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4841283f0 con 0x7fd48412f160 2024-09-12T17:30:57.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.801+0000 7fd47b7fe640 1 -- 172.21.15.47:0/1312435902 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd474037040 con 0x7fd48412f160 2024-09-12T17:30:57.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.801+0000 7fd4892e6640 1 -- 172.21.15.47:0/1312435902 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4841288b0 con 0x7fd48412f160 2024-09-12T17:30:57.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.802+0000 7fd47b7fe640 1 -- 172.21.15.47:0/1312435902 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fd474044070 con 0x7fd48412f160 2024-09-12T17:30:57.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.802+0000 7fd4892e6640 1 -- 172.21.15.47:0/1312435902 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd48412c860 con 0x7fd48412f160 2024-09-12T17:30:57.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.802+0000 7fd47b7fe640 1 --2- 172.21.15.47:0/1312435902 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd46403dec0 0x7fd464040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:30:57.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.802+0000 7fd47b7fe640 1 -- 172.21.15.47:0/1312435902 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fd474073440 con 0x7fd48412f160 2024-09-12T17:30:57.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.802+0000 7fd47bfff640 1 --2- 172.21.15.47:0/1312435902 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd46403dec0 0x7fd464040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:30:57.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.803+0000 7fd47bfff640 1 --2- 172.21.15.47:0/1312435902 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd46403dec0 0x7fd464040380 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd46c000c00 tx=0x7fd46c0078d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:30:57.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.807+0000 7fd47b7fe640 1 -- 172.21.15.47:0/1312435902 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7fd47403cc60 con 0x7fd48412f160 2024-09-12T17:30:57.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.988+0000 7fd4892e6640 1 -- 172.21.15.47:0/1312435902 --> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd4841298c0 con 0x7fd46403dec0 2024-09-12T17:30:58.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:57.998+0000 7fd47b7fe640 1 -- 172.21.15.47:0/1312435902 <== mgr.4102 v2:172.21.15.170:6824/4146902489 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665573 (secure 0 0 0) 0x7fd4841298c0 con 0x7fd46403dec0 2024-09-12T17:30:58.007 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:30:58.013 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-09-12T17:30:58.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.004+0000 7fd4892e6640 1 -- 172.21.15.47:0/1312435902 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd46403dec0 msgr2=0x7fd464040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:58.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.004+0000 7fd4892e6640 1 --2- 172.21.15.47:0/1312435902 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd46403dec0 0x7fd464040380 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd46c000c00 tx=0x7fd46c0078d0 comp rx=0 tx=0).stop 2024-09-12T17:30:58.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.004+0000 7fd4892e6640 1 -- 172.21.15.47:0/1312435902 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd48412f160 msgr2=0x7fd484127eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:58.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.004+0000 7fd4892e6640 1 --2- 172.21.15.47:0/1312435902 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd48412f160 0x7fd484127eb0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fd474009720 tx=0x7fd4740046c0 comp rx=0 tx=0).stop 2024-09-12T17:30:58.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.004+0000 7fd4892e6640 1 -- 172.21.15.47:0/1312435902 shutdown_connections 2024-09-12T17:30:58.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.004+0000 7fd4892e6640 1 --2- 172.21.15.47:0/1312435902 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd46403dec0 0x7fd464040380 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:30:58.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.004+0000 7fd4892e6640 1 --2- 172.21.15.47:0/1312435902 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd48412f160 0x7fd484127eb0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:30:58.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.004+0000 7fd4892e6640 1 -- 172.21.15.47:0/1312435902 >> 172.21.15.47:0/1312435902 conn(0x7fd4840a0ae0 msgr2=0x7fd48406f940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:30:58.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.004+0000 7fd4892e6640 1 -- 172.21.15.47:0/1312435902 shutdown_connections 2024-09-12T17:30:58.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.004+0000 7fd4892e6640 1 -- 172.21.15.47:0/1312435902 wait complete. 2024-09-12T17:30:58.016 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":135,"stamp":"2024-09-12T17:30:57.792962+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412816,"num_objects":229,"num_object_clones":0,"num_object_copies":458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4911,"num_read_kb":4497,"num_write":2048,"num_write_kb":60586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":482,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4434,"ondisk_log_size":4434,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":182096,"kb_used_data":53200,"kb_used_omap":6,"kb_used_meta":128825,"kb_avail":377305264,"statfs":{"total":386547056640,"available":386360590336,"internally_reserved":0,"allocated":54476800,"data_stored":53331076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":131917590},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25811687,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":522,"num_read_kb":477,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004011"},"pg_stats":[{"pgid":"3.3f","version":"31'2","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.133871+0000","last_change":"2024-09-12T17:28:21.473408+0000","last_active":"2024-09-12T17:30:50.133871+0000","last_peered":"2024-09-12T17:30:50.133871+0000","last_clean":"2024-09-12T17:30:50.133871+0000","last_became_active":"2024-09-12T17:28:21.473004+0000","last_became_peered":"2024-09-12T17:28:21.473004+0000","last_unstale":"2024-09-12T17:30:50.133871+0000","last_undegraded":"2024-09-12T17:30:50.133871+0000","last_fullsized":"2024-09-12T17:30:50.133871+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:27:19.040598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.926869+0000","last_change":"2024-09-12T17:27:42.433458+0000","last_active":"2024-09-12T17:30:49.926869+0000","last_peered":"2024-09-12T17:30:49.926869+0000","last_clean":"2024-09-12T17:30:49.926869+0000","last_became_active":"2024-09-12T17:27:42.433207+0000","last_became_peered":"2024-09-12T17:27:42.433207+0000","last_unstale":"2024-09-12T17:30:49.926869+0000","last_undegraded":"2024-09-12T17:30:49.926869+0000","last_fullsized":"2024-09-12T17:30:49.926869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:10.865332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.473539+0000","last_change":"2024-09-12T17:27:40.419781+0000","last_active":"2024-09-12T17:28:21.473539+0000","last_peered":"2024-09-12T17:28:21.473539+0000","last_clean":"2024-09-12T17:28:21.473539+0000","last_became_active":"2024-09-12T17:27:40.418928+0000","last_became_peered":"2024-09-12T17:27:40.418928+0000","last_unstale":"2024-09-12T17:28:21.473539+0000","last_undegraded":"2024-09-12T17:28:21.473539+0000","last_fullsized":"2024-09-12T17:28:21.473539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:05.211778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"31'6","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.929876+0000","last_change":"2024-09-12T17:27:42.432970+0000","last_active":"2024-09-12T17:30:49.929876+0000","last_peered":"2024-09-12T17:30:49.929876+0000","last_clean":"2024-09-12T17:30:49.929876+0000","last_became_active":"2024-09-12T17:27:42.432677+0000","last_became_peered":"2024-09-12T17:27:42.432677+0000","last_unstale":"2024-09-12T17:30:49.929876+0000","last_undegraded":"2024-09-12T17:30:49.929876+0000","last_fullsized":"2024-09-12T17:30:49.929876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:02.399648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465766+0000","last_change":"2024-09-12T17:27:40.433743+0000","last_active":"2024-09-12T17:28:21.465766+0000","last_peered":"2024-09-12T17:28:21.465766+0000","last_clean":"2024-09-12T17:28:21.465766+0000","last_became_active":"2024-09-12T17:27:40.433470+0000","last_became_peered":"2024-09-12T17:27:40.433470+0000","last_unstale":"2024-09-12T17:28:21.465766+0000","last_undegraded":"2024-09-12T17:28:21.465766+0000","last_fullsized":"2024-09-12T17:28:21.465766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:30.372118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"31'8","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:05.194512+0000","last_change":"2024-09-12T17:27:42.433048+0000","last_active":"2024-09-12T17:29:05.194512+0000","last_peered":"2024-09-12T17:29:05.194512+0000","last_clean":"2024-09-12T17:29:05.194512+0000","last_became_active":"2024-09-12T17:27:42.432736+0000","last_became_peered":"2024-09-12T17:27:42.432736+0000","last_unstale":"2024-09-12T17:29:05.194512+0000","last_undegraded":"2024-09-12T17:29:05.194512+0000","last_fullsized":"2024-09-12T17:29:05.194512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:43.699110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"31'8","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.144210+0000","last_change":"2024-09-12T17:27:40.426931+0000","last_active":"2024-09-12T17:30:50.144210+0000","last_peered":"2024-09-12T17:30:50.144210+0000","last_clean":"2024-09-12T17:30:50.144210+0000","last_became_active":"2024-09-12T17:27:40.426649+0000","last_became_peered":"2024-09-12T17:27:40.426649+0000","last_unstale":"2024-09-12T17:30:50.144210+0000","last_undegraded":"2024-09-12T17:30:50.144210+0000","last_fullsized":"2024-09-12T17:30:50.144210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:02.612906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":18,"num_write":56,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"31'8","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.929278+0000","last_change":"2024-09-12T17:27:42.418772+0000","last_active":"2024-09-12T17:30:49.929278+0000","last_peered":"2024-09-12T17:30:49.929278+0000","last_clean":"2024-09-12T17:30:49.929278+0000","last_became_active":"2024-09-12T17:27:42.418517+0000","last_became_peered":"2024-09-12T17:27:42.418517+0000","last_unstale":"2024-09-12T17:30:49.929278+0000","last_undegraded":"2024-09-12T17:30:49.929278+0000","last_fullsized":"2024-09-12T17:30:49.929278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:38.683188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464584+0000","last_change":"2024-09-12T17:27:40.425244+0000","last_active":"2024-09-12T17:28:21.464584+0000","last_peered":"2024-09-12T17:28:21.464584+0000","last_clean":"2024-09-12T17:28:21.464584+0000","last_became_active":"2024-09-12T17:27:40.424978+0000","last_became_peered":"2024-09-12T17:27:40.424978+0000","last_unstale":"2024-09-12T17:28:21.464584+0000","last_undegraded":"2024-09-12T17:28:21.464584+0000","last_fullsized":"2024-09-12T17:28:21.464584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:04.819015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"31'16","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.148377+0000","last_change":"2024-09-12T17:27:42.424168+0000","last_active":"2024-09-12T17:30:50.148377+0000","last_peered":"2024-09-12T17:30:50.148377+0000","last_clean":"2024-09-12T17:30:50.148377+0000","last_became_active":"2024-09-12T17:27:42.423906+0000","last_became_peered":"2024-09-12T17:27:42.423906+0000","last_unstale":"2024-09-12T17:30:50.148377+0000","last_undegraded":"2024-09-12T17:30:50.148377+0000","last_fullsized":"2024-09-12T17:30:50.148377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:30.717650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.467259+0000","last_change":"2024-09-12T17:27:40.425571+0000","last_active":"2024-09-12T17:28:21.467259+0000","last_peered":"2024-09-12T17:28:21.467259+0000","last_clean":"2024-09-12T17:28:21.467259+0000","last_became_active":"2024-09-12T17:27:40.425308+0000","last_became_peered":"2024-09-12T17:27:40.425308+0000","last_unstale":"2024-09-12T17:28:21.467259+0000","last_undegraded":"2024-09-12T17:28:21.467259+0000","last_fullsized":"2024-09-12T17:28:21.467259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:31.336111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"29'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464656+0000","last_change":"2024-09-12T17:27:42.429057+0000","last_active":"2024-09-12T17:28:21.464656+0000","last_peered":"2024-09-12T17:28:21.464656+0000","last_clean":"2024-09-12T17:28:21.464656+0000","last_became_active":"2024-09-12T17:27:42.428137+0000","last_became_peered":"2024-09-12T17:27:42.428137+0000","last_unstale":"2024-09-12T17:28:21.464656+0000","last_undegraded":"2024-09-12T17:28:21.464656+0000","last_fullsized":"2024-09-12T17:28:21.464656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:30.467192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'3","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:10.769083+0000","last_change":"2024-09-12T17:27:40.427714+0000","last_active":"2024-09-12T17:30:10.769083+0000","last_peered":"2024-09-12T17:30:10.769083+0000","last_clean":"2024-09-12T17:30:10.769083+0000","last_became_active":"2024-09-12T17:27:40.426778+0000","last_became_peered":"2024-09-12T17:27:40.426778+0000","last_unstale":"2024-09-12T17:30:10.769083+0000","last_undegraded":"2024-09-12T17:30:10.769083+0000","last_fullsized":"2024-09-12T17:30:10.769083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:19.867310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"31'18","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:05.377369+0000","last_change":"2024-09-12T17:27:42.434343+0000","last_active":"2024-09-12T17:29:05.377369+0000","last_peered":"2024-09-12T17:29:05.377369+0000","last_clean":"2024-09-12T17:29:05.377369+0000","last_became_active":"2024-09-12T17:27:42.434042+0000","last_became_peered":"2024-09-12T17:27:42.434042+0000","last_unstale":"2024-09-12T17:29:05.377369+0000","last_undegraded":"2024-09-12T17:29:05.377369+0000","last_fullsized":"2024-09-12T17:29:05.377369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:52.600151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":56,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"31'4","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.822317+0000","last_change":"2024-09-12T17:27:40.419315+0000","last_active":"2024-09-12T17:28:21.822317+0000","last_peered":"2024-09-12T17:28:21.822317+0000","last_clean":"2024-09-12T17:28:21.822317+0000","last_became_active":"2024-09-12T17:27:40.418512+0000","last_became_peered":"2024-09-12T17:27:40.418512+0000","last_unstale":"2024-09-12T17:28:21.822317+0000","last_undegraded":"2024-09-12T17:28:21.822317+0000","last_fullsized":"2024-09-12T17:28:21.822317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:08.096897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"31'8","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:22.319704+0000","last_change":"2024-09-12T17:27:42.436453+0000","last_active":"2024-09-12T17:28:22.319704+0000","last_peered":"2024-09-12T17:28:22.319704+0000","last_clean":"2024-09-12T17:28:22.319704+0000","last_became_active":"2024-09-12T17:27:42.436159+0000","last_became_peered":"2024-09-12T17:27:42.436159+0000","last_unstale":"2024-09-12T17:28:22.319704+0000","last_undegraded":"2024-09-12T17:28:22.319704+0000","last_fullsized":"2024-09-12T17:28:22.319704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:16.940321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"31'4","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.226031+0000","last_change":"2024-09-12T17:27:42.433708+0000","last_active":"2024-09-12T17:30:50.226031+0000","last_peered":"2024-09-12T17:30:50.226031+0000","last_clean":"2024-09-12T17:30:50.226031+0000","last_became_active":"2024-09-12T17:27:42.433425+0000","last_became_peered":"2024-09-12T17:27:42.433425+0000","last_unstale":"2024-09-12T17:30:50.226031+0000","last_undegraded":"2024-09-12T17:30:50.226031+0000","last_fullsized":"2024-09-12T17:30:50.226031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:32.794303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470550+0000","last_change":"2024-09-12T17:27:40.417181+0000","last_active":"2024-09-12T17:28:21.470550+0000","last_peered":"2024-09-12T17:28:21.470550+0000","last_clean":"2024-09-12T17:28:21.470550+0000","last_became_active":"2024-09-12T17:27:40.415650+0000","last_became_peered":"2024-09-12T17:27:40.415650+0000","last_unstale":"2024-09-12T17:28:21.470550+0000","last_undegraded":"2024-09-12T17:28:21.470550+0000","last_fullsized":"2024-09-12T17:28:21.470550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:11.303262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468030+0000","last_change":"2024-09-12T17:27:42.427970+0000","last_active":"2024-09-12T17:28:21.468030+0000","last_peered":"2024-09-12T17:28:21.468030+0000","last_clean":"2024-09-12T17:28:21.468030+0000","last_became_active":"2024-09-12T17:27:42.427700+0000","last_became_peered":"2024-09-12T17:27:42.427700+0000","last_unstale":"2024-09-12T17:28:21.468030+0000","last_undegraded":"2024-09-12T17:28:21.468030+0000","last_fullsized":"2024-09-12T17:28:21.468030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:26.167048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:45.824378+0000","last_change":"2024-09-12T17:27:40.432319+0000","last_active":"2024-09-12T17:29:45.824378+0000","last_peered":"2024-09-12T17:29:45.824378+0000","last_clean":"2024-09-12T17:29:45.824378+0000","last_became_active":"2024-09-12T17:27:40.432033+0000","last_became_peered":"2024-09-12T17:27:40.432033+0000","last_unstale":"2024-09-12T17:29:45.824378+0000","last_undegraded":"2024-09-12T17:29:45.824378+0000","last_fullsized":"2024-09-12T17:29:45.824378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:33.541500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"31'3","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:04.760240+0000","last_change":"2024-09-12T17:27:42.428753+0000","last_active":"2024-09-12T17:30:04.760240+0000","last_peered":"2024-09-12T17:30:04.760240+0000","last_clean":"2024-09-12T17:30:04.760240+0000","last_became_active":"2024-09-12T17:27:42.428492+0000","last_became_peered":"2024-09-12T17:27:42.428492+0000","last_unstale":"2024-09-12T17:30:04.760240+0000","last_undegraded":"2024-09-12T17:30:04.760240+0000","last_fullsized":"2024-09-12T17:30:04.760240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:53.463766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"29'2","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.478975+0000","last_change":"2024-09-12T17:28:21.478314+0000","last_active":"2024-09-12T17:28:21.478975+0000","last_peered":"2024-09-12T17:28:21.478975+0000","last_clean":"2024-09-12T17:28:21.478975+0000","last_became_active":"2024-09-12T17:28:21.474758+0000","last_became_peered":"2024-09-12T17:28:21.474758+0000","last_unstale":"2024-09-12T17:28:21.478975+0000","last_undegraded":"2024-09-12T17:28:21.478975+0000","last_fullsized":"2024-09-12T17:28:21.478975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:57.685638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:22.319001+0000","last_change":"2024-09-12T17:27:42.425610+0000","last_active":"2024-09-12T17:28:22.319001+0000","last_peered":"2024-09-12T17:28:22.319001+0000","last_clean":"2024-09-12T17:28:22.319001+0000","last_became_active":"2024-09-12T17:27:42.424738+0000","last_became_peered":"2024-09-12T17:27:42.424738+0000","last_unstale":"2024-09-12T17:28:22.319001+0000","last_undegraded":"2024-09-12T17:28:22.319001+0000","last_fullsized":"2024-09-12T17:28:22.319001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:32.550633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469481+0000","last_change":"2024-09-12T17:27:40.415283+0000","last_active":"2024-09-12T17:28:21.469481+0000","last_peered":"2024-09-12T17:28:21.469481+0000","last_clean":"2024-09-12T17:28:21.469481+0000","last_became_active":"2024-09-12T17:27:40.414669+0000","last_became_peered":"2024-09-12T17:27:40.414669+0000","last_unstale":"2024-09-12T17:28:21.469481+0000","last_undegraded":"2024-09-12T17:28:21.469481+0000","last_fullsized":"2024-09-12T17:28:21.469481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:44.782205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"31'8","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.225695+0000","last_change":"2024-09-12T17:27:42.436197+0000","last_active":"2024-09-12T17:30:50.225695+0000","last_peered":"2024-09-12T17:30:50.225695+0000","last_clean":"2024-09-12T17:30:50.225695+0000","last_became_active":"2024-09-12T17:27:42.435928+0000","last_became_peered":"2024-09-12T17:27:42.435928+0000","last_unstale":"2024-09-12T17:30:50.225695+0000","last_undegraded":"2024-09-12T17:30:50.225695+0000","last_fullsized":"2024-09-12T17:30:50.225695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:08.170045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.889394+0000","last_change":"2024-09-12T17:27:40.420567+0000","last_active":"2024-09-12T17:30:49.889394+0000","last_peered":"2024-09-12T17:30:49.889394+0000","last_clean":"2024-09-12T17:30:49.889394+0000","last_became_active":"2024-09-12T17:27:40.419936+0000","last_became_peered":"2024-09-12T17:27:40.419936+0000","last_unstale":"2024-09-12T17:30:49.889394+0000","last_undegraded":"2024-09-12T17:30:49.889394+0000","last_fullsized":"2024-09-12T17:30:49.889394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:49.941918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"31'5","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:09.761218+0000","last_change":"2024-09-12T17:27:42.423827+0000","last_active":"2024-09-12T17:30:09.761218+0000","last_peered":"2024-09-12T17:30:09.761218+0000","last_clean":"2024-09-12T17:30:09.761218+0000","last_became_active":"2024-09-12T17:27:42.423569+0000","last_became_peered":"2024-09-12T17:27:42.423569+0000","last_unstale":"2024-09-12T17:30:09.761218+0000","last_undegraded":"2024-09-12T17:30:09.761218+0000","last_fullsized":"2024-09-12T17:30:09.761218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:15.384263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.821382+0000","last_change":"2024-09-12T17:27:40.428057+0000","last_active":"2024-09-12T17:28:21.821382+0000","last_peered":"2024-09-12T17:28:21.821382+0000","last_clean":"2024-09-12T17:28:21.821382+0000","last_became_active":"2024-09-12T17:27:40.426721+0000","last_became_peered":"2024-09-12T17:27:40.426721+0000","last_unstale":"2024-09-12T17:28:21.821382+0000","last_undegraded":"2024-09-12T17:28:21.821382+0000","last_fullsized":"2024-09-12T17:28:21.821382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:59.265443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"31'35","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.173308+0000","last_change":"2024-09-12T17:27:50.456507+0000","last_active":"2024-09-12T17:30:50.173308+0000","last_peered":"2024-09-12T17:30:50.173308+0000","last_clean":"2024-09-12T17:30:50.173308+0000","last_became_active":"2024-09-12T17:27:50.456184+0000","last_became_peered":"2024-09-12T17:27:50.456184+0000","last_unstale":"2024-09-12T17:30:50.173308+0000","last_undegraded":"2024-09-12T17:30:50.173308+0000","last_fullsized":"2024-09-12T17:30:50.173308+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:38.608944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"31'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.076531+0000","last_change":"2024-09-12T17:27:42.420958+0000","last_active":"2024-09-12T17:29:49.076531+0000","last_peered":"2024-09-12T17:29:49.076531+0000","last_clean":"2024-09-12T17:29:49.076531+0000","last_became_active":"2024-09-12T17:27:42.420666+0000","last_became_peered":"2024-09-12T17:27:42.420666+0000","last_unstale":"2024-09-12T17:29:49.076531+0000","last_undegraded":"2024-09-12T17:29:49.076531+0000","last_fullsized":"2024-09-12T17:29:49.076531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:15.830207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464196+0000","last_change":"2024-09-12T17:27:40.433530+0000","last_active":"2024-09-12T17:28:21.464196+0000","last_peered":"2024-09-12T17:28:21.464196+0000","last_clean":"2024-09-12T17:28:21.464196+0000","last_became_active":"2024-09-12T17:27:40.433044+0000","last_became_peered":"2024-09-12T17:27:40.433044+0000","last_unstale":"2024-09-12T17:28:21.464196+0000","last_undegraded":"2024-09-12T17:28:21.464196+0000","last_fullsized":"2024-09-12T17:28:21.464196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:34.927105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.473141+0000","last_change":"2024-09-12T17:28:21.472409+0000","last_active":"2024-09-12T17:28:21.473141+0000","last_peered":"2024-09-12T17:28:21.473141+0000","last_clean":"2024-09-12T17:28:21.473141+0000","last_became_active":"2024-09-12T17:28:21.472106+0000","last_became_peered":"2024-09-12T17:28:21.472106+0000","last_unstale":"2024-09-12T17:28:21.473141+0000","last_undegraded":"2024-09-12T17:28:21.473141+0000","last_fullsized":"2024-09-12T17:28:21.473141+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:56.281239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"31'30","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.596107+0000","last_change":"2024-09-12T17:27:46.442394+0000","last_active":"2024-09-12T17:29:47.596107+0000","last_peered":"2024-09-12T17:29:47.596107+0000","last_clean":"2024-09-12T17:29:47.596107+0000","last_became_active":"2024-09-12T17:27:46.441891+0000","last_became_peered":"2024-09-12T17:27:46.441891+0000","last_unstale":"2024-09-12T17:29:47.596107+0000","last_undegraded":"2024-09-12T17:29:47.596107+0000","last_fullsized":"2024-09-12T17:29:47.596107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:29.351398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470059+0000","last_change":"2024-09-12T17:27:48.448380+0000","last_active":"2024-09-12T17:28:21.470059+0000","last_peered":"2024-09-12T17:28:21.470059+0000","last_clean":"2024-09-12T17:28:21.470059+0000","last_became_active":"2024-09-12T17:27:48.448078+0000","last_became_peered":"2024-09-12T17:27:48.448078+0000","last_unstale":"2024-09-12T17:28:21.470059+0000","last_undegraded":"2024-09-12T17:28:21.470059+0000","last_fullsized":"2024-09-12T17:28:21.470059+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:32.578727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"31'7","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:05.200007+0000","last_change":"2024-09-12T17:27:50.457351+0000","last_active":"2024-09-12T17:29:05.200007+0000","last_peered":"2024-09-12T17:29:05.200007+0000","last_clean":"2024-09-12T17:29:05.200007+0000","last_became_active":"2024-09-12T17:27:50.457037+0000","last_became_peered":"2024-09-12T17:27:50.457037+0000","last_unstale":"2024-09-12T17:29:05.200007+0000","last_undegraded":"2024-09-12T17:29:05.200007+0000","last_fullsized":"2024-09-12T17:29:05.200007+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:28.456215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465641+0000","last_change":"2024-09-12T17:27:42.428129+0000","last_active":"2024-09-12T17:28:21.465641+0000","last_peered":"2024-09-12T17:28:21.465641+0000","last_clean":"2024-09-12T17:28:21.465641+0000","last_became_active":"2024-09-12T17:27:42.427872+0000","last_became_peered":"2024-09-12T17:27:42.427872+0000","last_unstale":"2024-09-12T17:28:21.465641+0000","last_undegraded":"2024-09-12T17:28:21.465641+0000","last_fullsized":"2024-09-12T17:28:21.465641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:27.694207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468076+0000","last_change":"2024-09-12T17:27:40.431296+0000","last_active":"2024-09-12T17:28:21.468076+0000","last_peered":"2024-09-12T17:28:21.468076+0000","last_clean":"2024-09-12T17:28:21.468076+0000","last_became_active":"2024-09-12T17:27:40.430969+0000","last_became_peered":"2024-09-12T17:27:40.430969+0000","last_unstale":"2024-09-12T17:28:21.468076+0000","last_undegraded":"2024-09-12T17:28:21.468076+0000","last_fullsized":"2024-09-12T17:28:21.468076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:08.250935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.472166+0000","last_change":"2024-09-12T17:27:44.427938+0000","last_active":"2024-09-12T17:28:21.472166+0000","last_peered":"2024-09-12T17:28:21.472166+0000","last_clean":"2024-09-12T17:28:21.472166+0000","last_became_active":"2024-09-12T17:27:44.427560+0000","last_became_peered":"2024-09-12T17:27:44.427560+0000","last_unstale":"2024-09-12T17:28:21.472166+0000","last_undegraded":"2024-09-12T17:28:21.472166+0000","last_fullsized":"2024-09-12T17:28:21.472166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:08.271249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"29'6","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470141+0000","last_change":"2024-09-12T17:27:46.438703+0000","last_active":"2024-09-12T17:28:21.470141+0000","last_peered":"2024-09-12T17:28:21.470141+0000","last_clean":"2024-09-12T17:28:21.470141+0000","last_became_active":"2024-09-12T17:27:46.436065+0000","last_became_peered":"2024-09-12T17:27:46.436065+0000","last_unstale":"2024-09-12T17:28:21.470141+0000","last_undegraded":"2024-09-12T17:28:21.470141+0000","last_fullsized":"2024-09-12T17:28:21.470141+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:52.392850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466101+0000","last_change":"2024-09-12T17:27:48.441701+0000","last_active":"2024-09-12T17:28:21.466101+0000","last_peered":"2024-09-12T17:28:21.466101+0000","last_clean":"2024-09-12T17:28:21.466101+0000","last_became_active":"2024-09-12T17:27:48.441192+0000","last_became_peered":"2024-09-12T17:27:48.441192+0000","last_unstale":"2024-09-12T17:28:21.466101+0000","last_undegraded":"2024-09-12T17:28:21.466101+0000","last_fullsized":"2024-09-12T17:28:21.466101+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:52.274187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"29'2","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470752+0000","last_change":"2024-09-12T17:27:50.451886+0000","last_active":"2024-09-12T17:28:21.470752+0000","last_peered":"2024-09-12T17:28:21.470752+0000","last_clean":"2024-09-12T17:28:21.470752+0000","last_became_active":"2024-09-12T17:27:50.451589+0000","last_became_peered":"2024-09-12T17:27:50.451589+0000","last_unstale":"2024-09-12T17:28:21.470752+0000","last_undegraded":"2024-09-12T17:28:21.470752+0000","last_fullsized":"2024-09-12T17:28:21.470752+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:53.513569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"31'8","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:22.319420+0000","last_change":"2024-09-12T17:27:42.426651+0000","last_active":"2024-09-12T17:28:22.319420+0000","last_peered":"2024-09-12T17:28:22.319420+0000","last_clean":"2024-09-12T17:28:22.319420+0000","last_became_active":"2024-09-12T17:27:42.426402+0000","last_became_peered":"2024-09-12T17:27:42.426402+0000","last_unstale":"2024-09-12T17:28:22.319420+0000","last_undegraded":"2024-09-12T17:28:22.319420+0000","last_fullsized":"2024-09-12T17:28:22.319420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:24.998663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.032605+0000","last_change":"2024-09-12T17:27:40.428134+0000","last_active":"2024-09-12T17:29:49.032605+0000","last_peered":"2024-09-12T17:29:49.032605+0000","last_clean":"2024-09-12T17:29:49.032605+0000","last_became_active":"2024-09-12T17:27:40.427860+0000","last_became_peered":"2024-09-12T17:27:40.427860+0000","last_unstale":"2024-09-12T17:29:49.032605+0000","last_undegraded":"2024-09-12T17:29:49.032605+0000","last_fullsized":"2024-09-12T17:29:49.032605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:15.255295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.474373+0000","last_change":"2024-09-12T17:27:44.431340+0000","last_active":"2024-09-12T17:28:21.474373+0000","last_peered":"2024-09-12T17:28:21.474373+0000","last_clean":"2024-09-12T17:28:21.474373+0000","last_became_active":"2024-09-12T17:27:44.430879+0000","last_became_peered":"2024-09-12T17:27:44.430879+0000","last_unstale":"2024-09-12T17:28:21.474373+0000","last_undegraded":"2024-09-12T17:28:21.474373+0000","last_fullsized":"2024-09-12T17:28:21.474373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:31.240889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"29'10","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.467842+0000","last_change":"2024-09-12T17:27:46.440472+0000","last_active":"2024-09-12T17:28:21.467842+0000","last_peered":"2024-09-12T17:28:21.467842+0000","last_clean":"2024-09-12T17:28:21.467842+0000","last_became_active":"2024-09-12T17:27:46.440203+0000","last_became_peered":"2024-09-12T17:27:46.440203+0000","last_unstale":"2024-09-12T17:28:21.467842+0000","last_undegraded":"2024-09-12T17:28:21.467842+0000","last_fullsized":"2024-09-12T17:28:21.467842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:58.292808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"31'282","reported_seq":405,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.511610+0000","last_change":"2024-09-12T17:27:48.451526+0000","last_active":"2024-09-12T17:30:49.511610+0000","last_peered":"2024-09-12T17:30:49.511610+0000","last_clean":"2024-09-12T17:30:49.511610+0000","last_became_active":"2024-09-12T17:27:48.450897+0000","last_became_peered":"2024-09-12T17:27:48.450897+0000","last_unstale":"2024-09-12T17:30:49.511610+0000","last_undegraded":"2024-09-12T17:30:49.511610+0000","last_fullsized":"2024-09-12T17:30:49.511610+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:24.867772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468002+0000","last_change":"2024-09-12T17:27:50.456983+0000","last_active":"2024-09-12T17:28:21.468002+0000","last_peered":"2024-09-12T17:28:21.468002+0000","last_clean":"2024-09-12T17:28:21.468002+0000","last_became_active":"2024-09-12T17:27:50.456376+0000","last_became_peered":"2024-09-12T17:27:50.456376+0000","last_unstale":"2024-09-12T17:28:21.468002+0000","last_undegraded":"2024-09-12T17:28:21.468002+0000","last_fullsized":"2024-09-12T17:28:21.468002+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:07.847747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"31'12","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.926558+0000","last_change":"2024-09-12T17:27:42.426373+0000","last_active":"2024-09-12T17:30:49.926558+0000","last_peered":"2024-09-12T17:30:49.926558+0000","last_clean":"2024-09-12T17:30:49.926558+0000","last_became_active":"2024-09-12T17:27:42.426060+0000","last_became_peered":"2024-09-12T17:27:42.426060+0000","last_unstale":"2024-09-12T17:30:49.926558+0000","last_undegraded":"2024-09-12T17:30:49.926558+0000","last_fullsized":"2024-09-12T17:30:49.926558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:54.699865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468564+0000","last_change":"2024-09-12T17:27:40.423578+0000","last_active":"2024-09-12T17:28:21.468564+0000","last_peered":"2024-09-12T17:28:21.468564+0000","last_clean":"2024-09-12T17:28:21.468564+0000","last_became_active":"2024-09-12T17:27:40.415702+0000","last_became_peered":"2024-09-12T17:27:40.415702+0000","last_unstale":"2024-09-12T17:28:21.468564+0000","last_undegraded":"2024-09-12T17:28:21.468564+0000","last_fullsized":"2024-09-12T17:28:21.468564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:05.858479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465273+0000","last_change":"2024-09-12T17:27:44.428855+0000","last_active":"2024-09-12T17:28:21.465273+0000","last_peered":"2024-09-12T17:28:21.465273+0000","last_clean":"2024-09-12T17:28:21.465273+0000","last_became_active":"2024-09-12T17:27:44.428526+0000","last_became_peered":"2024-09-12T17:27:44.428526+0000","last_unstale":"2024-09-12T17:28:21.465273+0000","last_undegraded":"2024-09-12T17:28:21.465273+0000","last_fullsized":"2024-09-12T17:28:21.465273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:22.407461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"31'30","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.590773+0000","last_change":"2024-09-12T17:27:46.441041+0000","last_active":"2024-09-12T17:29:47.590773+0000","last_peered":"2024-09-12T17:29:47.590773+0000","last_clean":"2024-09-12T17:29:47.590773+0000","last_became_active":"2024-09-12T17:27:46.440765+0000","last_became_peered":"2024-09-12T17:27:46.440765+0000","last_unstale":"2024-09-12T17:29:47.590773+0000","last_undegraded":"2024-09-12T17:29:47.590773+0000","last_fullsized":"2024-09-12T17:29:47.590773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:14.176389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"31'282","reported_seq":436,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.230811+0000","last_change":"2024-09-12T17:27:48.440009+0000","last_active":"2024-09-12T17:30:50.230811+0000","last_peered":"2024-09-12T17:30:50.230811+0000","last_clean":"2024-09-12T17:30:50.230811+0000","last_became_active":"2024-09-12T17:27:48.439642+0000","last_became_peered":"2024-09-12T17:27:48.439642+0000","last_unstale":"2024-09-12T17:30:50.230811+0000","last_undegraded":"2024-09-12T17:30:50.230811+0000","last_fullsized":"2024-09-12T17:30:50.230811+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:06.242670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"31'12","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.225652+0000","last_change":"2024-09-12T17:27:42.428634+0000","last_active":"2024-09-12T17:30:50.225652+0000","last_peered":"2024-09-12T17:30:50.225652+0000","last_clean":"2024-09-12T17:30:50.225652+0000","last_became_active":"2024-09-12T17:27:42.427990+0000","last_became_peered":"2024-09-12T17:27:42.427990+0000","last_unstale":"2024-09-12T17:30:50.225652+0000","last_undegraded":"2024-09-12T17:30:50.225652+0000","last_fullsized":"2024-09-12T17:30:50.225652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:27:19.215981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"29'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468356+0000","last_change":"2024-09-12T17:27:40.429060+0000","last_active":"2024-09-12T17:28:21.468356+0000","last_peered":"2024-09-12T17:28:21.468356+0000","last_clean":"2024-09-12T17:28:21.468356+0000","last_became_active":"2024-09-12T17:27:40.428462+0000","last_became_peered":"2024-09-12T17:27:40.428462+0000","last_unstale":"2024-09-12T17:28:21.468356+0000","last_undegraded":"2024-09-12T17:28:21.468356+0000","last_fullsized":"2024-09-12T17:28:21.468356+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:45.872253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468175+0000","last_change":"2024-09-12T17:27:44.433155+0000","last_active":"2024-09-12T17:28:21.468175+0000","last_peered":"2024-09-12T17:28:21.468175+0000","last_clean":"2024-09-12T17:28:21.468175+0000","last_became_active":"2024-09-12T17:27:44.431911+0000","last_became_peered":"2024-09-12T17:27:44.431911+0000","last_unstale":"2024-09-12T17:28:21.468175+0000","last_undegraded":"2024-09-12T17:28:21.468175+0000","last_fullsized":"2024-09-12T17:28:21.468175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:16.971114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"31'41","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.599915+0000","last_change":"2024-09-12T17:27:46.439466+0000","last_active":"2024-09-12T17:29:47.599915+0000","last_peered":"2024-09-12T17:29:47.599915+0000","last_clean":"2024-09-12T17:29:47.599915+0000","last_became_active":"2024-09-12T17:27:46.439188+0000","last_became_peered":"2024-09-12T17:27:46.439188+0000","last_unstale":"2024-09-12T17:29:47.599915+0000","last_undegraded":"2024-09-12T17:29:47.599915+0000","last_fullsized":"2024-09-12T17:29:47.599915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:25.881248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471714+0000","last_change":"2024-09-12T17:27:48.441917+0000","last_active":"2024-09-12T17:28:21.471714+0000","last_peered":"2024-09-12T17:28:21.471714+0000","last_clean":"2024-09-12T17:28:21.471714+0000","last_became_active":"2024-09-12T17:27:48.441618+0000","last_became_peered":"2024-09-12T17:27:48.441618+0000","last_unstale":"2024-09-12T17:28:21.471714+0000","last_undegraded":"2024-09-12T17:28:21.471714+0000","last_fullsized":"2024-09-12T17:28:21.471714+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:17.256348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"31'7","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.198792+0000","last_change":"2024-09-12T17:27:50.457616+0000","last_active":"2024-09-12T17:30:50.198792+0000","last_peered":"2024-09-12T17:30:50.198792+0000","last_clean":"2024-09-12T17:30:50.198792+0000","last_became_active":"2024-09-12T17:27:50.457350+0000","last_became_peered":"2024-09-12T17:27:50.457350+0000","last_unstale":"2024-09-12T17:30:50.198792+0000","last_undegraded":"2024-09-12T17:30:50.198792+0000","last_fullsized":"2024-09-12T17:30:50.198792+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:39.806321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"31'20","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.148556+0000","last_change":"2024-09-12T17:27:42.424787+0000","last_active":"2024-09-12T17:30:50.148556+0000","last_peered":"2024-09-12T17:30:50.148556+0000","last_clean":"2024-09-12T17:30:50.148556+0000","last_became_active":"2024-09-12T17:27:42.424268+0000","last_became_peered":"2024-09-12T17:27:42.424268+0000","last_unstale":"2024-09-12T17:30:50.148556+0000","last_undegraded":"2024-09-12T17:30:50.148556+0000","last_fullsized":"2024-09-12T17:30:50.148556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:10.726972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":75,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469727+0000","last_change":"2024-09-12T17:27:40.427959+0000","last_active":"2024-09-12T17:28:21.469727+0000","last_peered":"2024-09-12T17:28:21.469727+0000","last_clean":"2024-09-12T17:28:21.469727+0000","last_became_active":"2024-09-12T17:27:40.427677+0000","last_became_peered":"2024-09-12T17:27:40.427677+0000","last_unstale":"2024-09-12T17:28:21.469727+0000","last_undegraded":"2024-09-12T17:28:21.469727+0000","last_fullsized":"2024-09-12T17:28:21.469727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:13.997279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471294+0000","last_change":"2024-09-12T17:27:44.434751+0000","last_active":"2024-09-12T17:28:21.471294+0000","last_peered":"2024-09-12T17:28:21.471294+0000","last_clean":"2024-09-12T17:28:21.471294+0000","last_became_active":"2024-09-12T17:27:44.434433+0000","last_became_peered":"2024-09-12T17:27:44.434433+0000","last_unstale":"2024-09-12T17:28:21.471294+0000","last_undegraded":"2024-09-12T17:28:21.471294+0000","last_fullsized":"2024-09-12T17:28:21.471294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:00.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"31'30","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.580910+0000","last_change":"2024-09-12T17:27:46.442854+0000","last_active":"2024-09-12T17:29:47.580910+0000","last_peered":"2024-09-12T17:29:47.580910+0000","last_clean":"2024-09-12T17:29:47.580910+0000","last_became_active":"2024-09-12T17:27:46.442572+0000","last_became_peered":"2024-09-12T17:27:46.442572+0000","last_unstale":"2024-09-12T17:29:47.580910+0000","last_undegraded":"2024-09-12T17:29:47.580910+0000","last_fullsized":"2024-09-12T17:29:47.580910+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:49.755366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470885+0000","last_change":"2024-09-12T17:27:48.445793+0000","last_active":"2024-09-12T17:28:21.470885+0000","last_peered":"2024-09-12T17:28:21.470885+0000","last_clean":"2024-09-12T17:28:21.470885+0000","last_became_active":"2024-09-12T17:27:48.445502+0000","last_became_peered":"2024-09-12T17:27:48.445502+0000","last_unstale":"2024-09-12T17:28:21.470885+0000","last_undegraded":"2024-09-12T17:28:21.470885+0000","last_fullsized":"2024-09-12T17:28:21.470885+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:17.142197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"31'9","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.283385+0000","last_change":"2024-09-12T17:27:50.458007+0000","last_active":"2024-09-12T17:30:50.283385+0000","last_peered":"2024-09-12T17:30:50.283385+0000","last_clean":"2024-09-12T17:30:50.283385+0000","last_became_active":"2024-09-12T17:27:50.457691+0000","last_became_peered":"2024-09-12T17:27:50.457691+0000","last_unstale":"2024-09-12T17:30:50.283385+0000","last_undegraded":"2024-09-12T17:30:50.283385+0000","last_fullsized":"2024-09-12T17:30:50.283385+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:51.065237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":23,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"31'7","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.203773+0000","last_change":"2024-09-12T17:27:42.436839+0000","last_active":"2024-09-12T17:30:50.203773+0000","last_peered":"2024-09-12T17:30:50.203773+0000","last_clean":"2024-09-12T17:30:50.203773+0000","last_became_active":"2024-09-12T17:27:42.436517+0000","last_became_peered":"2024-09-12T17:27:42.436517+0000","last_unstale":"2024-09-12T17:30:50.203773+0000","last_undegraded":"2024-09-12T17:30:50.203773+0000","last_fullsized":"2024-09-12T17:30:50.203773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:56.329169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465301+0000","last_change":"2024-09-12T17:27:40.429917+0000","last_active":"2024-09-12T17:28:21.465301+0000","last_peered":"2024-09-12T17:28:21.465301+0000","last_clean":"2024-09-12T17:28:21.465301+0000","last_became_active":"2024-09-12T17:27:40.429663+0000","last_became_peered":"2024-09-12T17:27:40.429663+0000","last_unstale":"2024-09-12T17:28:21.465301+0000","last_undegraded":"2024-09-12T17:28:21.465301+0000","last_fullsized":"2024-09-12T17:28:21.465301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:01.771644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.473204+0000","last_change":"2024-09-12T17:27:44.431117+0000","last_active":"2024-09-12T17:28:21.473204+0000","last_peered":"2024-09-12T17:28:21.473204+0000","last_clean":"2024-09-12T17:28:21.473204+0000","last_became_active":"2024-09-12T17:27:44.430772+0000","last_became_peered":"2024-09-12T17:27:44.430772+0000","last_unstale":"2024-09-12T17:28:21.473204+0000","last_undegraded":"2024-09-12T17:28:21.473204+0000","last_fullsized":"2024-09-12T17:28:21.473204+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:11.871540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"31'37","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.601873+0000","last_change":"2024-09-12T17:27:46.444540+0000","last_active":"2024-09-12T17:29:47.601873+0000","last_peered":"2024-09-12T17:29:47.601873+0000","last_clean":"2024-09-12T17:29:47.601873+0000","last_became_active":"2024-09-12T17:27:46.444206+0000","last_became_peered":"2024-09-12T17:27:46.444206+0000","last_unstale":"2024-09-12T17:29:47.601873+0000","last_undegraded":"2024-09-12T17:29:47.601873+0000","last_fullsized":"2024-09-12T17:29:47.601873+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:06.613276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"31'282","reported_seq":398,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.354623+0000","last_change":"2024-09-12T17:27:48.448090+0000","last_active":"2024-09-12T17:30:50.354623+0000","last_peered":"2024-09-12T17:30:50.354623+0000","last_clean":"2024-09-12T17:30:50.354623+0000","last_became_active":"2024-09-12T17:27:48.447724+0000","last_became_peered":"2024-09-12T17:27:48.447724+0000","last_unstale":"2024-09-12T17:30:50.354623+0000","last_undegraded":"2024-09-12T17:30:50.354623+0000","last_fullsized":"2024-09-12T17:30:50.354623+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:37.632389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"31'4","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.183333+0000","last_change":"2024-09-12T17:27:50.451958+0000","last_active":"2024-09-12T17:30:50.183333+0000","last_peered":"2024-09-12T17:30:50.183333+0000","last_clean":"2024-09-12T17:30:50.183333+0000","last_became_active":"2024-09-12T17:27:50.451716+0000","last_became_peered":"2024-09-12T17:27:50.451716+0000","last_unstale":"2024-09-12T17:30:50.183333+0000","last_undegraded":"2024-09-12T17:30:50.183333+0000","last_fullsized":"2024-09-12T17:30:50.183333+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:28.075990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"31'4","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.018397+0000","last_change":"2024-09-12T17:27:42.429925+0000","last_active":"2024-09-12T17:30:50.018397+0000","last_peered":"2024-09-12T17:30:50.018397+0000","last_clean":"2024-09-12T17:30:50.018397+0000","last_became_active":"2024-09-12T17:27:42.429624+0000","last_became_peered":"2024-09-12T17:27:42.429624+0000","last_unstale":"2024-09-12T17:30:50.018397+0000","last_undegraded":"2024-09-12T17:30:50.018397+0000","last_fullsized":"2024-09-12T17:30:50.018397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:10.865332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464374+0000","last_change":"2024-09-12T17:27:40.424281+0000","last_active":"2024-09-12T17:28:21.464374+0000","last_peered":"2024-09-12T17:28:21.464374+0000","last_clean":"2024-09-12T17:28:21.464374+0000","last_became_active":"2024-09-12T17:27:40.423291+0000","last_became_peered":"2024-09-12T17:27:40.423291+0000","last_unstale":"2024-09-12T17:28:21.464374+0000","last_undegraded":"2024-09-12T17:28:21.464374+0000","last_fullsized":"2024-09-12T17:28:21.464374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:45.581275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471823+0000","last_change":"2024-09-12T17:27:44.430889+0000","last_active":"2024-09-12T17:28:21.471823+0000","last_peered":"2024-09-12T17:28:21.471823+0000","last_clean":"2024-09-12T17:28:21.471823+0000","last_became_active":"2024-09-12T17:27:44.430549+0000","last_became_peered":"2024-09-12T17:27:44.430549+0000","last_unstale":"2024-09-12T17:28:21.471823+0000","last_undegraded":"2024-09-12T17:28:21.471823+0000","last_fullsized":"2024-09-12T17:28:21.471823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:53.357220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"31'55","reported_seq":112,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:55.766229+0000","last_change":"2024-09-12T17:27:46.441393+0000","last_active":"2024-09-12T17:29:55.766229+0000","last_peered":"2024-09-12T17:29:55.766229+0000","last_clean":"2024-09-12T17:29:55.766229+0000","last_became_active":"2024-09-12T17:27:46.440805+0000","last_became_peered":"2024-09-12T17:27:46.440805+0000","last_unstale":"2024-09-12T17:29:55.766229+0000","last_undegraded":"2024-09-12T17:29:55.766229+0000","last_fullsized":"2024-09-12T17:29:55.766229+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:26.523623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5916,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":51,"num_read_kb":42,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471161+0000","last_change":"2024-09-12T17:27:48.443214+0000","last_active":"2024-09-12T17:28:21.471161+0000","last_peered":"2024-09-12T17:28:21.471161+0000","last_clean":"2024-09-12T17:28:21.471161+0000","last_became_active":"2024-09-12T17:27:48.442880+0000","last_became_peered":"2024-09-12T17:27:48.442880+0000","last_unstale":"2024-09-12T17:28:21.471161+0000","last_undegraded":"2024-09-12T17:28:21.471161+0000","last_fullsized":"2024-09-12T17:28:21.471161+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:45.787562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"31'20","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.331059+0000","last_change":"2024-09-12T17:27:50.454666+0000","last_active":"2024-09-12T17:30:50.331059+0000","last_peered":"2024-09-12T17:30:50.331059+0000","last_clean":"2024-09-12T17:30:50.331059+0000","last_became_active":"2024-09-12T17:27:50.454410+0000","last_became_peered":"2024-09-12T17:27:50.454410+0000","last_unstale":"2024-09-12T17:30:50.331059+0000","last_undegraded":"2024-09-12T17:30:50.331059+0000","last_fullsized":"2024-09-12T17:30:50.331059+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:12:29.329426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"31'10","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.225780+0000","last_change":"2024-09-12T17:27:42.436173+0000","last_active":"2024-09-12T17:30:50.225780+0000","last_peered":"2024-09-12T17:30:50.225780+0000","last_clean":"2024-09-12T17:30:50.225780+0000","last_became_active":"2024-09-12T17:27:42.435913+0000","last_became_peered":"2024-09-12T17:27:42.435913+0000","last_unstale":"2024-09-12T17:30:50.225780+0000","last_undegraded":"2024-09-12T17:30:50.225780+0000","last_fullsized":"2024-09-12T17:30:50.225780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:49.886133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.472093+0000","last_change":"2024-09-12T17:27:40.416125+0000","last_active":"2024-09-12T17:28:21.472093+0000","last_peered":"2024-09-12T17:28:21.472093+0000","last_clean":"2024-09-12T17:28:21.472093+0000","last_became_active":"2024-09-12T17:27:40.415703+0000","last_became_peered":"2024-09-12T17:27:40.415703+0000","last_unstale":"2024-09-12T17:28:21.472093+0000","last_undegraded":"2024-09-12T17:28:21.472093+0000","last_fullsized":"2024-09-12T17:28:21.472093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:40.086345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466635+0000","last_change":"2024-09-12T17:27:44.432984+0000","last_active":"2024-09-12T17:28:21.466635+0000","last_peered":"2024-09-12T17:28:21.466635+0000","last_clean":"2024-09-12T17:28:21.466635+0000","last_became_active":"2024-09-12T17:27:44.432588+0000","last_became_peered":"2024-09-12T17:27:44.432588+0000","last_unstale":"2024-09-12T17:28:21.466635+0000","last_undegraded":"2024-09-12T17:28:21.466635+0000","last_fullsized":"2024-09-12T17:28:21.466635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:09.951474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"31'32","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.584787+0000","last_change":"2024-09-12T17:27:46.432654+0000","last_active":"2024-09-12T17:29:47.584787+0000","last_peered":"2024-09-12T17:29:47.584787+0000","last_clean":"2024-09-12T17:29:47.584787+0000","last_became_active":"2024-09-12T17:27:46.432354+0000","last_became_peered":"2024-09-12T17:27:46.432354+0000","last_unstale":"2024-09-12T17:29:47.584787+0000","last_undegraded":"2024-09-12T17:29:47.584787+0000","last_fullsized":"2024-09-12T17:29:47.584787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:14.062258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466117+0000","last_change":"2024-09-12T17:27:48.451776+0000","last_active":"2024-09-12T17:28:21.466117+0000","last_peered":"2024-09-12T17:28:21.466117+0000","last_clean":"2024-09-12T17:28:21.466117+0000","last_became_active":"2024-09-12T17:27:48.451510+0000","last_became_peered":"2024-09-12T17:27:48.451510+0000","last_unstale":"2024-09-12T17:28:21.466117+0000","last_undegraded":"2024-09-12T17:28:21.466117+0000","last_fullsized":"2024-09-12T17:28:21.466117+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:01.787546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"31'7","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:50.765214+0000","last_change":"2024-09-12T17:27:50.455419+0000","last_active":"2024-09-12T17:29:50.765214+0000","last_peered":"2024-09-12T17:29:50.765214+0000","last_clean":"2024-09-12T17:29:50.765214+0000","last_became_active":"2024-09-12T17:27:50.454890+0000","last_became_peered":"2024-09-12T17:27:50.454890+0000","last_unstale":"2024-09-12T17:29:50.765214+0000","last_undegraded":"2024-09-12T17:29:50.765214+0000","last_fullsized":"2024-09-12T17:29:50.765214+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:50.422624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"31'8","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.196877+0000","last_change":"2024-09-12T17:27:42.440511+0000","last_active":"2024-09-12T17:30:50.196877+0000","last_peered":"2024-09-12T17:30:50.196877+0000","last_clean":"2024-09-12T17:30:50.196877+0000","last_became_active":"2024-09-12T17:27:42.440204+0000","last_became_peered":"2024-09-12T17:27:42.440204+0000","last_unstale":"2024-09-12T17:30:50.196877+0000","last_undegraded":"2024-09-12T17:30:50.196877+0000","last_fullsized":"2024-09-12T17:30:50.196877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:11.628797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464148+0000","last_change":"2024-09-12T17:27:40.428533+0000","last_active":"2024-09-12T17:28:21.464148+0000","last_peered":"2024-09-12T17:28:21.464148+0000","last_clean":"2024-09-12T17:28:21.464148+0000","last_became_active":"2024-09-12T17:27:40.428232+0000","last_became_peered":"2024-09-12T17:27:40.428232+0000","last_unstale":"2024-09-12T17:28:21.464148+0000","last_undegraded":"2024-09-12T17:28:21.464148+0000","last_fullsized":"2024-09-12T17:28:21.464148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:38.394799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.473721+0000","last_change":"2024-09-12T17:27:44.432569+0000","last_active":"2024-09-12T17:28:21.473721+0000","last_peered":"2024-09-12T17:28:21.473721+0000","last_clean":"2024-09-12T17:28:21.473721+0000","last_became_active":"2024-09-12T17:27:44.432211+0000","last_became_peered":"2024-09-12T17:27:44.432211+0000","last_unstale":"2024-09-12T17:28:21.473721+0000","last_undegraded":"2024-09-12T17:28:21.473721+0000","last_fullsized":"2024-09-12T17:28:21.473721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:13.176204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"31'36","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.610036+0000","last_change":"2024-09-12T17:27:46.433953+0000","last_active":"2024-09-12T17:29:47.610036+0000","last_peered":"2024-09-12T17:29:47.610036+0000","last_clean":"2024-09-12T17:29:47.610036+0000","last_became_active":"2024-09-12T17:27:46.433672+0000","last_became_peered":"2024-09-12T17:27:46.433672+0000","last_unstale":"2024-09-12T17:29:47.610036+0000","last_undegraded":"2024-09-12T17:29:47.610036+0000","last_fullsized":"2024-09-12T17:29:47.610036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:55.924502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"31'282","reported_seq":404,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.335012+0000","last_change":"2024-09-12T17:27:48.440623+0000","last_active":"2024-09-12T17:30:50.335012+0000","last_peered":"2024-09-12T17:30:50.335012+0000","last_clean":"2024-09-12T17:30:50.335012+0000","last_became_active":"2024-09-12T17:27:48.440335+0000","last_became_peered":"2024-09-12T17:27:48.440335+0000","last_unstale":"2024-09-12T17:30:50.335012+0000","last_undegraded":"2024-09-12T17:30:50.335012+0000","last_fullsized":"2024-09-12T17:30:50.335012+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:20.544074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"31'12","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:54.758294+0000","last_change":"2024-09-12T17:27:50.449089+0000","last_active":"2024-09-12T17:29:54.758294+0000","last_peered":"2024-09-12T17:29:54.758294+0000","last_clean":"2024-09-12T17:29:54.758294+0000","last_became_active":"2024-09-12T17:27:50.448680+0000","last_became_peered":"2024-09-12T17:27:50.448680+0000","last_unstale":"2024-09-12T17:29:54.758294+0000","last_undegraded":"2024-09-12T17:29:54.758294+0000","last_fullsized":"2024-09-12T17:29:54.758294+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:01.786654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.473949+0000","last_change":"2024-09-12T17:28:21.473062+0000","last_active":"2024-09-12T17:28:21.473949+0000","last_peered":"2024-09-12T17:28:21.473949+0000","last_clean":"2024-09-12T17:28:21.473949+0000","last_became_active":"2024-09-12T17:28:21.472744+0000","last_became_peered":"2024-09-12T17:28:21.472744+0000","last_unstale":"2024-09-12T17:28:21.473949+0000","last_undegraded":"2024-09-12T17:28:21.473949+0000","last_fullsized":"2024-09-12T17:28:21.473949+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:30.333530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.221504+0000","last_change":"2024-09-12T17:27:40.428769+0000","last_active":"2024-09-12T17:30:50.221504+0000","last_peered":"2024-09-12T17:30:50.221504+0000","last_clean":"2024-09-12T17:30:50.221504+0000","last_became_active":"2024-09-12T17:27:40.428512+0000","last_became_peered":"2024-09-12T17:27:40.428512+0000","last_unstale":"2024-09-12T17:30:50.221504+0000","last_undegraded":"2024-09-12T17:30:50.221504+0000","last_fullsized":"2024-09-12T17:30:50.221504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:45.757419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'3","reported_seq":414,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:48.725548+0000","last_change":"2024-09-12T17:27:44.430169+0000","last_active":"2024-09-12T17:29:48.725548+0000","last_peered":"2024-09-12T17:29:48.725548+0000","last_clean":"2024-09-12T17:29:48.725548+0000","last_became_active":"2024-09-12T17:27:44.429844+0000","last_became_peered":"2024-09-12T17:27:44.429844+0000","last_unstale":"2024-09-12T17:29:48.725548+0000","last_undegraded":"2024-09-12T17:29:48.725548+0000","last_fullsized":"2024-09-12T17:29:48.725548+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:19.512968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464478+0000","last_change":"2024-09-12T17:27:46.439449+0000","last_active":"2024-09-12T17:28:21.464478+0000","last_peered":"2024-09-12T17:28:21.464478+0000","last_clean":"2024-09-12T17:28:21.464478+0000","last_became_active":"2024-09-12T17:27:46.439153+0000","last_became_peered":"2024-09-12T17:27:46.439153+0000","last_unstale":"2024-09-12T17:28:21.464478+0000","last_undegraded":"2024-09-12T17:28:21.464478+0000","last_fullsized":"2024-09-12T17:28:21.464478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:53.118909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"31'282","reported_seq":460,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.285437+0000","last_change":"2024-09-12T17:27:48.441400+0000","last_active":"2024-09-12T17:30:50.285437+0000","last_peered":"2024-09-12T17:30:50.285437+0000","last_clean":"2024-09-12T17:30:50.285437+0000","last_became_active":"2024-09-12T17:27:48.441024+0000","last_became_peered":"2024-09-12T17:27:48.441024+0000","last_unstale":"2024-09-12T17:30:50.285437+0000","last_undegraded":"2024-09-12T17:30:50.285437+0000","last_fullsized":"2024-09-12T17:30:50.285437+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:09.672456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'4","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:48.859981+0000","last_change":"2024-09-12T17:27:50.452031+0000","last_active":"2024-09-12T17:29:48.859981+0000","last_peered":"2024-09-12T17:29:48.859981+0000","last_clean":"2024-09-12T17:29:48.859981+0000","last_became_active":"2024-09-12T17:27:50.451743+0000","last_became_peered":"2024-09-12T17:27:50.451743+0000","last_unstale":"2024-09-12T17:29:48.859981+0000","last_undegraded":"2024-09-12T17:29:48.859981+0000","last_fullsized":"2024-09-12T17:29:48.859981+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:24:17.073385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470933+0000","last_change":"2024-09-12T17:27:42.438842+0000","last_active":"2024-09-12T17:28:21.470933+0000","last_peered":"2024-09-12T17:28:21.470933+0000","last_clean":"2024-09-12T17:28:21.470933+0000","last_became_active":"2024-09-12T17:27:42.438566+0000","last_became_peered":"2024-09-12T17:27:42.438566+0000","last_unstale":"2024-09-12T17:28:21.470933+0000","last_undegraded":"2024-09-12T17:28:21.470933+0000","last_fullsized":"2024-09-12T17:28:21.470933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:08.054821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"31'1","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:50.765235+0000","last_change":"2024-09-12T17:27:40.430157+0000","last_active":"2024-09-12T17:29:50.765235+0000","last_peered":"2024-09-12T17:29:50.765235+0000","last_clean":"2024-09-12T17:29:50.765235+0000","last_became_active":"2024-09-12T17:27:40.429902+0000","last_became_peered":"2024-09-12T17:27:40.429902+0000","last_unstale":"2024-09-12T17:29:50.765235+0000","last_undegraded":"2024-09-12T17:29:50.765235+0000","last_fullsized":"2024-09-12T17:29:50.765235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:03.993235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465147+0000","last_change":"2024-09-12T17:27:44.431499+0000","last_active":"2024-09-12T17:28:21.465147+0000","last_peered":"2024-09-12T17:28:21.465147+0000","last_clean":"2024-09-12T17:28:21.465147+0000","last_became_active":"2024-09-12T17:27:44.431180+0000","last_became_peered":"2024-09-12T17:27:44.431180+0000","last_unstale":"2024-09-12T17:28:21.465147+0000","last_undegraded":"2024-09-12T17:28:21.465147+0000","last_fullsized":"2024-09-12T17:28:21.465147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:36.937417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"31'40","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.597133+0000","last_change":"2024-09-12T17:27:46.431873+0000","last_active":"2024-09-12T17:29:47.597133+0000","last_peered":"2024-09-12T17:29:47.597133+0000","last_clean":"2024-09-12T17:29:47.597133+0000","last_became_active":"2024-09-12T17:27:46.431599+0000","last_became_peered":"2024-09-12T17:27:46.431599+0000","last_unstale":"2024-09-12T17:29:47.597133+0000","last_undegraded":"2024-09-12T17:29:47.597133+0000","last_fullsized":"2024-09-12T17:29:47.597133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:08.059866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":52,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.467064+0000","last_change":"2024-09-12T17:27:48.447644+0000","last_active":"2024-09-12T17:28:21.467064+0000","last_peered":"2024-09-12T17:28:21.467064+0000","last_clean":"2024-09-12T17:28:21.467064+0000","last_became_active":"2024-09-12T17:27:48.447331+0000","last_became_peered":"2024-09-12T17:27:48.447331+0000","last_unstale":"2024-09-12T17:28:21.467064+0000","last_undegraded":"2024-09-12T17:28:21.467064+0000","last_fullsized":"2024-09-12T17:28:21.467064+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:15.622749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"31'6","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.260811+0000","last_change":"2024-09-12T17:27:50.448120+0000","last_active":"2024-09-12T17:30:50.260811+0000","last_peered":"2024-09-12T17:30:50.260811+0000","last_clean":"2024-09-12T17:30:50.260811+0000","last_became_active":"2024-09-12T17:27:50.447855+0000","last_became_peered":"2024-09-12T17:27:50.447855+0000","last_unstale":"2024-09-12T17:30:50.260811+0000","last_undegraded":"2024-09-12T17:30:50.260811+0000","last_fullsized":"2024-09-12T17:30:50.260811+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:45:37.063333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"31'14","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.225785+0000","last_change":"2024-09-12T17:27:42.438563+0000","last_active":"2024-09-12T17:30:50.225785+0000","last_peered":"2024-09-12T17:30:50.225785+0000","last_clean":"2024-09-12T17:30:50.225785+0000","last_became_active":"2024-09-12T17:27:42.438270+0000","last_became_peered":"2024-09-12T17:27:42.438270+0000","last_unstale":"2024-09-12T17:30:50.225785+0000","last_undegraded":"2024-09-12T17:30:50.225785+0000","last_fullsized":"2024-09-12T17:30:50.225785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:24.762523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'72","reported_seq":142,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468423+0000","last_change":"2024-09-12T17:27:25.975511+0000","last_active":"2024-09-12T17:28:21.468423+0000","last_peered":"2024-09-12T17:28:21.468423+0000","last_clean":"2024-09-12T17:28:21.468423+0000","last_became_active":"2024-09-12T17:27:25.974522+0000","last_became_peered":"2024-09-12T17:27:25.974522+0000","last_unstale":"2024-09-12T17:28:21.468423+0000","last_undegraded":"2024-09-12T17:28:21.468423+0000","last_fullsized":"2024-09-12T17:28:21.468423+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:24.738801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:24.738801+0000","last_clean_scrub_stamp":"2024-09-12T17:27:24.738801+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:42.005302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464653+0000","last_change":"2024-09-12T17:27:34.770151+0000","last_active":"2024-09-12T17:28:21.464653+0000","last_peered":"2024-09-12T17:28:21.464653+0000","last_clean":"2024-09-12T17:28:21.464653+0000","last_became_active":"2024-09-12T17:27:32.760744+0000","last_became_peered":"2024-09-12T17:27:32.760744+0000","last_unstale":"2024-09-12T17:28:21.464653+0000","last_undegraded":"2024-09-12T17:28:21.464653+0000","last_fullsized":"2024-09-12T17:28:21.464653+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:22:57.115660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014241220000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463397+0000","last_change":"2024-09-12T17:27:40.429657+0000","last_active":"2024-09-12T17:28:21.463397+0000","last_peered":"2024-09-12T17:28:21.463397+0000","last_clean":"2024-09-12T17:28:21.463397+0000","last_became_active":"2024-09-12T17:27:40.428453+0000","last_became_peered":"2024-09-12T17:27:40.428453+0000","last_unstale":"2024-09-12T17:28:21.463397+0000","last_undegraded":"2024-09-12T17:28:21.463397+0000","last_fullsized":"2024-09-12T17:28:21.463397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:25.951429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469125+0000","last_change":"2024-09-12T17:27:44.432804+0000","last_active":"2024-09-12T17:28:21.469125+0000","last_peered":"2024-09-12T17:28:21.469125+0000","last_clean":"2024-09-12T17:28:21.469125+0000","last_became_active":"2024-09-12T17:27:44.432336+0000","last_became_peered":"2024-09-12T17:27:44.432336+0000","last_unstale":"2024-09-12T17:28:21.469125+0000","last_undegraded":"2024-09-12T17:28:21.469125+0000","last_fullsized":"2024-09-12T17:28:21.469125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:57.403402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"31'76","reported_seq":146,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.607996+0000","last_change":"2024-09-12T17:27:46.438090+0000","last_active":"2024-09-12T17:29:47.607996+0000","last_peered":"2024-09-12T17:29:47.607996+0000","last_clean":"2024-09-12T17:29:47.607996+0000","last_became_active":"2024-09-12T17:27:46.437771+0000","last_became_peered":"2024-09-12T17:27:46.437771+0000","last_unstale":"2024-09-12T17:29:47.607996+0000","last_undegraded":"2024-09-12T17:29:47.607996+0000","last_fullsized":"2024-09-12T17:29:47.607996+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:14.400029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.474144+0000","last_change":"2024-09-12T17:27:48.446270+0000","last_active":"2024-09-12T17:28:21.474144+0000","last_peered":"2024-09-12T17:28:21.474144+0000","last_clean":"2024-09-12T17:28:21.474144+0000","last_became_active":"2024-09-12T17:27:48.445970+0000","last_became_peered":"2024-09-12T17:27:48.445970+0000","last_unstale":"2024-09-12T17:28:21.474144+0000","last_undegraded":"2024-09-12T17:28:21.474144+0000","last_fullsized":"2024-09-12T17:28:21.474144+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:31.488140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"31'81","reported_seq":163,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.235627+0000","last_change":"2024-09-12T17:27:50.448666+0000","last_active":"2024-09-12T17:30:50.235627+0000","last_peered":"2024-09-12T17:30:50.235627+0000","last_clean":"2024-09-12T17:30:50.235627+0000","last_became_active":"2024-09-12T17:27:50.448189+0000","last_became_peered":"2024-09-12T17:27:50.448189+0000","last_unstale":"2024-09-12T17:30:50.235627+0000","last_undegraded":"2024-09-12T17:30:50.235627+0000","last_fullsized":"2024-09-12T17:30:50.235627+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:38.207685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":221,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465570+0000","last_change":"2024-09-12T17:27:42.429760+0000","last_active":"2024-09-12T17:28:21.465570+0000","last_peered":"2024-09-12T17:28:21.465570+0000","last_clean":"2024-09-12T17:28:21.465570+0000","last_became_active":"2024-09-12T17:27:42.429497+0000","last_became_peered":"2024-09-12T17:27:42.429497+0000","last_unstale":"2024-09-12T17:28:21.465570+0000","last_undegraded":"2024-09-12T17:28:21.465570+0000","last_fullsized":"2024-09-12T17:28:21.465570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:09.539390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.462953+0000","last_change":"2024-09-12T17:27:34.769202+0000","last_active":"2024-09-12T17:28:21.462953+0000","last_peered":"2024-09-12T17:28:21.462953+0000","last_clean":"2024-09-12T17:28:21.462953+0000","last_became_active":"2024-09-12T17:27:32.761687+0000","last_became_peered":"2024-09-12T17:27:32.761687+0000","last_unstale":"2024-09-12T17:28:21.462953+0000","last_undegraded":"2024-09-12T17:28:21.462953+0000","last_fullsized":"2024-09-12T17:28:21.462953+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:00.950082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056694099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471668+0000","last_change":"2024-09-12T17:27:40.418643+0000","last_active":"2024-09-12T17:28:21.471668+0000","last_peered":"2024-09-12T17:28:21.471668+0000","last_clean":"2024-09-12T17:28:21.471668+0000","last_became_active":"2024-09-12T17:27:40.418249+0000","last_became_peered":"2024-09-12T17:27:40.418249+0000","last_unstale":"2024-09-12T17:28:21.471668+0000","last_undegraded":"2024-09-12T17:28:21.471668+0000","last_fullsized":"2024-09-12T17:28:21.471668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:03:41.714055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468312+0000","last_change":"2024-09-12T17:27:44.427026+0000","last_active":"2024-09-12T17:28:21.468312+0000","last_peered":"2024-09-12T17:28:21.468312+0000","last_clean":"2024-09-12T17:28:21.468312+0000","last_became_active":"2024-09-12T17:27:44.426698+0000","last_became_peered":"2024-09-12T17:27:44.426698+0000","last_unstale":"2024-09-12T17:28:21.468312+0000","last_undegraded":"2024-09-12T17:28:21.468312+0000","last_fullsized":"2024-09-12T17:28:21.468312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:09.582440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"31'274","reported_seq":478,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.511697+0000","last_change":"2024-09-12T17:27:46.438678+0000","last_active":"2024-09-12T17:30:49.511697+0000","last_peered":"2024-09-12T17:30:49.511697+0000","last_clean":"2024-09-12T17:30:49.511697+0000","last_became_active":"2024-09-12T17:27:46.438381+0000","last_became_peered":"2024-09-12T17:27:46.438381+0000","last_unstale":"2024-09-12T17:30:49.511697+0000","last_undegraded":"2024-09-12T17:30:49.511697+0000","last_fullsized":"2024-09-12T17:30:49.511697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:10.399053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464394+0000","last_change":"2024-09-12T17:27:48.451345+0000","last_active":"2024-09-12T17:28:21.464394+0000","last_peered":"2024-09-12T17:28:21.464394+0000","last_clean":"2024-09-12T17:28:21.464394+0000","last_became_active":"2024-09-12T17:27:48.450775+0000","last_became_peered":"2024-09-12T17:27:48.450775+0000","last_unstale":"2024-09-12T17:28:21.464394+0000","last_undegraded":"2024-09-12T17:28:21.464394+0000","last_fullsized":"2024-09-12T17:28:21.464394+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:37.382330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"31'5","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.944535+0000","last_change":"2024-09-12T17:27:50.458209+0000","last_active":"2024-09-12T17:30:49.944535+0000","last_peered":"2024-09-12T17:30:49.944535+0000","last_clean":"2024-09-12T17:30:49.944535+0000","last_became_active":"2024-09-12T17:27:50.457939+0000","last_became_peered":"2024-09-12T17:27:50.457939+0000","last_unstale":"2024-09-12T17:30:49.944535+0000","last_undegraded":"2024-09-12T17:30:49.944535+0000","last_fullsized":"2024-09-12T17:30:49.944535+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:23.231500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"31'4","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.076951+0000","last_change":"2024-09-12T17:27:42.425698+0000","last_active":"2024-09-12T17:29:49.076951+0000","last_peered":"2024-09-12T17:29:49.076951+0000","last_clean":"2024-09-12T17:29:49.076951+0000","last_became_active":"2024-09-12T17:27:42.424498+0000","last_became_peered":"2024-09-12T17:27:42.424498+0000","last_unstale":"2024-09-12T17:29:49.076951+0000","last_undegraded":"2024-09-12T17:29:49.076951+0000","last_fullsized":"2024-09-12T17:29:49.076951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:03.680453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466787+0000","last_change":"2024-09-12T17:27:35.052087+0000","last_active":"2024-09-12T17:28:21.466787+0000","last_peered":"2024-09-12T17:28:21.466787+0000","last_clean":"2024-09-12T17:28:21.466787+0000","last_became_active":"2024-09-12T17:27:32.761809+0000","last_became_peered":"2024-09-12T17:27:32.761809+0000","last_unstale":"2024-09-12T17:28:21.466787+0000","last_undegraded":"2024-09-12T17:28:21.466787+0000","last_fullsized":"2024-09-12T17:28:21.466787+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:18.084479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051333900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"31'3","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:05.185226+0000","last_change":"2024-09-12T17:27:40.418110+0000","last_active":"2024-09-12T17:29:05.185226+0000","last_peered":"2024-09-12T17:29:05.185226+0000","last_clean":"2024-09-12T17:29:05.185226+0000","last_became_active":"2024-09-12T17:27:40.417664+0000","last_became_peered":"2024-09-12T17:27:40.417664+0000","last_unstale":"2024-09-12T17:29:05.185226+0000","last_undegraded":"2024-09-12T17:29:05.185226+0000","last_fullsized":"2024-09-12T17:29:05.185226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:39.177042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"22'2","reported_seq":232,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:48.725808+0000","last_change":"2024-09-12T17:28:21.479837+0000","last_active":"2024-09-12T17:29:48.725808+0000","last_peered":"2024-09-12T17:29:48.725808+0000","last_clean":"2024-09-12T17:29:48.725808+0000","last_became_active":"2024-09-12T17:28:21.473073+0000","last_became_peered":"2024-09-12T17:28:21.473073+0000","last_unstale":"2024-09-12T17:29:48.725808+0000","last_undegraded":"2024-09-12T17:29:48.725808+0000","last_fullsized":"2024-09-12T17:29:48.725808+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:19.813164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":482,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"31'17","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.234475+0000","last_change":"2024-09-12T17:27:46.435712+0000","last_active":"2024-09-12T17:30:50.234475+0000","last_peered":"2024-09-12T17:30:50.234475+0000","last_clean":"2024-09-12T17:30:50.234475+0000","last_became_active":"2024-09-12T17:27:46.435381+0000","last_became_peered":"2024-09-12T17:27:46.435381+0000","last_unstale":"2024-09-12T17:30:50.234475+0000","last_undegraded":"2024-09-12T17:30:50.234475+0000","last_fullsized":"2024-09-12T17:30:50.234475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:41.723829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.472358+0000","last_change":"2024-09-12T17:27:48.451538+0000","last_active":"2024-09-12T17:28:21.472358+0000","last_peered":"2024-09-12T17:28:21.472358+0000","last_clean":"2024-09-12T17:28:21.472358+0000","last_became_active":"2024-09-12T17:27:48.451225+0000","last_became_peered":"2024-09-12T17:27:48.451225+0000","last_unstale":"2024-09-12T17:28:21.472358+0000","last_undegraded":"2024-09-12T17:28:21.472358+0000","last_fullsized":"2024-09-12T17:28:21.472358+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:18.269897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463520+0000","last_change":"2024-09-12T17:27:50.453764+0000","last_active":"2024-09-12T17:28:21.463520+0000","last_peered":"2024-09-12T17:28:21.463520+0000","last_clean":"2024-09-12T17:28:21.463520+0000","last_became_active":"2024-09-12T17:27:50.453458+0000","last_became_peered":"2024-09-12T17:27:50.453458+0000","last_unstale":"2024-09-12T17:28:21.463520+0000","last_undegraded":"2024-09-12T17:28:21.463520+0000","last_fullsized":"2024-09-12T17:28:21.463520+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:48.900827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"31'10","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.928991+0000","last_change":"2024-09-12T17:27:42.428370+0000","last_active":"2024-09-12T17:30:49.928991+0000","last_peered":"2024-09-12T17:30:49.928991+0000","last_clean":"2024-09-12T17:30:49.928991+0000","last_became_active":"2024-09-12T17:27:42.427591+0000","last_became_peered":"2024-09-12T17:27:42.427591+0000","last_unstale":"2024-09-12T17:30:49.928991+0000","last_undegraded":"2024-09-12T17:30:49.928991+0000","last_fullsized":"2024-09-12T17:30:49.928991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:32:15.190001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463771+0000","last_change":"2024-09-12T17:27:34.769764+0000","last_active":"2024-09-12T17:28:21.463771+0000","last_peered":"2024-09-12T17:28:21.463771+0000","last_clean":"2024-09-12T17:28:21.463771+0000","last_became_active":"2024-09-12T17:27:32.761967+0000","last_became_peered":"2024-09-12T17:27:32.761967+0000","last_unstale":"2024-09-12T17:28:21.463771+0000","last_undegraded":"2024-09-12T17:28:21.463771+0000","last_fullsized":"2024-09-12T17:28:21.463771+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:25.345465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001062323,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468759+0000","last_change":"2024-09-12T17:27:40.426229+0000","last_active":"2024-09-12T17:28:21.468759+0000","last_peered":"2024-09-12T17:28:21.468759+0000","last_clean":"2024-09-12T17:28:21.468759+0000","last_became_active":"2024-09-12T17:27:40.425973+0000","last_became_peered":"2024-09-12T17:27:40.425973+0000","last_unstale":"2024-09-12T17:28:21.468759+0000","last_undegraded":"2024-09-12T17:28:21.468759+0000","last_fullsized":"2024-09-12T17:28:21.468759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:08.388292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.473874+0000","last_change":"2024-09-12T17:27:44.432667+0000","last_active":"2024-09-12T17:28:21.473874+0000","last_peered":"2024-09-12T17:28:21.473874+0000","last_clean":"2024-09-12T17:28:21.473874+0000","last_became_active":"2024-09-12T17:27:44.432348+0000","last_became_peered":"2024-09-12T17:27:44.432348+0000","last_unstale":"2024-09-12T17:28:21.473874+0000","last_undegraded":"2024-09-12T17:28:21.473874+0000","last_fullsized":"2024-09-12T17:28:21.473874+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:56.521250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"31'14","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.091058+0000","last_change":"2024-09-12T17:27:46.442771+0000","last_active":"2024-09-12T17:30:49.091058+0000","last_peered":"2024-09-12T17:30:49.091058+0000","last_clean":"2024-09-12T17:30:49.091058+0000","last_became_active":"2024-09-12T17:27:46.442488+0000","last_became_peered":"2024-09-12T17:27:46.442488+0000","last_unstale":"2024-09-12T17:30:49.091058+0000","last_undegraded":"2024-09-12T17:30:49.091058+0000","last_fullsized":"2024-09-12T17:30:49.091058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:31.634237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466202+0000","last_change":"2024-09-12T17:27:48.451472+0000","last_active":"2024-09-12T17:28:21.466202+0000","last_peered":"2024-09-12T17:28:21.466202+0000","last_clean":"2024-09-12T17:28:21.466202+0000","last_became_active":"2024-09-12T17:27:48.451075+0000","last_became_peered":"2024-09-12T17:27:48.451075+0000","last_unstale":"2024-09-12T17:28:21.466202+0000","last_undegraded":"2024-09-12T17:28:21.466202+0000","last_fullsized":"2024-09-12T17:28:21.466202+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:41.217292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'10","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:48.840270+0000","last_change":"2024-09-12T17:27:50.456671+0000","last_active":"2024-09-12T17:29:48.840270+0000","last_peered":"2024-09-12T17:29:48.840270+0000","last_clean":"2024-09-12T17:29:48.840270+0000","last_became_active":"2024-09-12T17:27:50.455608+0000","last_became_peered":"2024-09-12T17:27:50.455608+0000","last_unstale":"2024-09-12T17:29:48.840270+0000","last_undegraded":"2024-09-12T17:29:48.840270+0000","last_fullsized":"2024-09-12T17:29:48.840270+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:23.681507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":17,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'14","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.148304+0000","last_change":"2024-09-12T17:28:21.472071+0000","last_active":"2024-09-12T17:30:50.148304+0000","last_peered":"2024-09-12T17:30:50.148304+0000","last_clean":"2024-09-12T17:30:50.148304+0000","last_became_active":"2024-09-12T17:28:21.471756+0000","last_became_peered":"2024-09-12T17:28:21.471756+0000","last_unstale":"2024-09-12T17:30:50.148304+0000","last_undegraded":"2024-09-12T17:30:50.148304+0000","last_fullsized":"2024-09-12T17:30:50.148304+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:02.305736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.141559+0000","last_change":"2024-09-12T17:27:40.424557+0000","last_active":"2024-09-12T17:30:50.141559+0000","last_peered":"2024-09-12T17:30:50.141559+0000","last_clean":"2024-09-12T17:30:50.141559+0000","last_became_active":"2024-09-12T17:27:40.424286+0000","last_became_peered":"2024-09-12T17:27:40.424286+0000","last_unstale":"2024-09-12T17:30:50.141559+0000","last_undegraded":"2024-09-12T17:30:50.141559+0000","last_fullsized":"2024-09-12T17:30:50.141559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:35.900609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.472269+0000","last_change":"2024-09-12T17:27:34.764756+0000","last_active":"2024-09-12T17:28:21.472269+0000","last_peered":"2024-09-12T17:28:21.472269+0000","last_clean":"2024-09-12T17:28:21.472269+0000","last_became_active":"2024-09-12T17:27:32.761595+0000","last_became_peered":"2024-09-12T17:27:32.761595+0000","last_unstale":"2024-09-12T17:28:21.472269+0000","last_undegraded":"2024-09-12T17:28:21.472269+0000","last_fullsized":"2024-09-12T17:28:21.472269+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:18.306129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000417551,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"31'1","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.757479+0000","last_change":"2024-09-12T17:27:44.432884+0000","last_active":"2024-09-12T17:29:49.757479+0000","last_peered":"2024-09-12T17:29:49.757479+0000","last_clean":"2024-09-12T17:29:49.757479+0000","last_became_active":"2024-09-12T17:27:44.432492+0000","last_became_peered":"2024-09-12T17:27:44.432492+0000","last_unstale":"2024-09-12T17:29:49.757479+0000","last_undegraded":"2024-09-12T17:29:49.757479+0000","last_fullsized":"2024-09-12T17:29:49.757479+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:10.580513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"31'61","reported_seq":121,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.757358+0000","last_change":"2024-09-12T17:27:46.439404+0000","last_active":"2024-09-12T17:29:49.757358+0000","last_peered":"2024-09-12T17:29:49.757358+0000","last_clean":"2024-09-12T17:29:49.757358+0000","last_became_active":"2024-09-12T17:27:46.439014+0000","last_became_peered":"2024-09-12T17:27:46.439014+0000","last_unstale":"2024-09-12T17:29:49.757358+0000","last_undegraded":"2024-09-12T17:29:49.757358+0000","last_fullsized":"2024-09-12T17:29:49.757358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:18.977626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.467285+0000","last_change":"2024-09-12T17:27:48.439106+0000","last_active":"2024-09-12T17:28:21.467285+0000","last_peered":"2024-09-12T17:28:21.467285+0000","last_clean":"2024-09-12T17:28:21.467285+0000","last_became_active":"2024-09-12T17:27:48.438779+0000","last_became_peered":"2024-09-12T17:27:48.438779+0000","last_unstale":"2024-09-12T17:28:21.467285+0000","last_undegraded":"2024-09-12T17:28:21.467285+0000","last_fullsized":"2024-09-12T17:28:21.467285+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:49.022922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"31'13","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.020053+0000","last_change":"2024-09-12T17:27:50.448485+0000","last_active":"2024-09-12T17:30:50.020053+0000","last_peered":"2024-09-12T17:30:50.020053+0000","last_clean":"2024-09-12T17:30:50.020053+0000","last_became_active":"2024-09-12T17:27:50.448060+0000","last_became_peered":"2024-09-12T17:27:50.448060+0000","last_unstale":"2024-09-12T17:30:50.020053+0000","last_undegraded":"2024-09-12T17:30:50.020053+0000","last_fullsized":"2024-09-12T17:30:50.020053+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:10.453854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":31,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"31'27","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.023811+0000","last_change":"2024-09-12T17:27:42.433227+0000","last_active":"2024-09-12T17:30:50.023811+0000","last_peered":"2024-09-12T17:30:50.023811+0000","last_clean":"2024-09-12T17:30:50.023811+0000","last_became_active":"2024-09-12T17:27:42.432800+0000","last_became_peered":"2024-09-12T17:27:42.432800+0000","last_unstale":"2024-09-12T17:30:50.023811+0000","last_undegraded":"2024-09-12T17:30:50.023811+0000","last_fullsized":"2024-09-12T17:30:50.023811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:05.801739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":99,"num_read_kb":83,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"31'3","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.757529+0000","last_change":"2024-09-12T17:27:40.419982+0000","last_active":"2024-09-12T17:29:49.757529+0000","last_peered":"2024-09-12T17:29:49.757529+0000","last_clean":"2024-09-12T17:29:49.757529+0000","last_became_active":"2024-09-12T17:27:40.418873+0000","last_became_peered":"2024-09-12T17:27:40.418873+0000","last_unstale":"2024-09-12T17:29:49.757529+0000","last_undegraded":"2024-09-12T17:29:49.757529+0000","last_fullsized":"2024-09-12T17:29:49.757529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:08.388292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465552+0000","last_change":"2024-09-12T17:27:34.770070+0000","last_active":"2024-09-12T17:28:21.465552+0000","last_peered":"2024-09-12T17:28:21.465552+0000","last_clean":"2024-09-12T17:28:21.465552+0000","last_became_active":"2024-09-12T17:27:32.761677+0000","last_became_peered":"2024-09-12T17:27:32.761677+0000","last_unstale":"2024-09-12T17:28:21.465552+0000","last_undegraded":"2024-09-12T17:28:21.465552+0000","last_fullsized":"2024-09-12T17:28:21.465552+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:22.236160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001356625,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463624+0000","last_change":"2024-09-12T17:27:44.426949+0000","last_active":"2024-09-12T17:28:21.463624+0000","last_peered":"2024-09-12T17:28:21.463624+0000","last_clean":"2024-09-12T17:28:21.463624+0000","last_became_active":"2024-09-12T17:27:44.426647+0000","last_became_peered":"2024-09-12T17:27:44.426647+0000","last_unstale":"2024-09-12T17:28:21.463624+0000","last_undegraded":"2024-09-12T17:28:21.463624+0000","last_fullsized":"2024-09-12T17:28:21.463624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:54.776333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"29'15","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468427+0000","last_change":"2024-09-12T17:27:46.439375+0000","last_active":"2024-09-12T17:28:21.468427+0000","last_peered":"2024-09-12T17:28:21.468427+0000","last_clean":"2024-09-12T17:28:21.468427+0000","last_became_active":"2024-09-12T17:27:46.439038+0000","last_became_peered":"2024-09-12T17:27:46.439038+0000","last_unstale":"2024-09-12T17:28:21.468427+0000","last_undegraded":"2024-09-12T17:28:21.468427+0000","last_fullsized":"2024-09-12T17:28:21.468427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:18.536701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"31'282","reported_seq":347,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.511651+0000","last_change":"2024-09-12T17:27:48.442198+0000","last_active":"2024-09-12T17:30:49.511651+0000","last_peered":"2024-09-12T17:30:49.511651+0000","last_clean":"2024-09-12T17:30:49.511651+0000","last_became_active":"2024-09-12T17:27:48.440948+0000","last_became_peered":"2024-09-12T17:27:48.440948+0000","last_unstale":"2024-09-12T17:30:49.511651+0000","last_undegraded":"2024-09-12T17:30:49.511651+0000","last_fullsized":"2024-09-12T17:30:49.511651+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:58.653865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465509+0000","last_change":"2024-09-12T17:27:50.455097+0000","last_active":"2024-09-12T17:28:21.465509+0000","last_peered":"2024-09-12T17:28:21.465509+0000","last_clean":"2024-09-12T17:28:21.465509+0000","last_became_active":"2024-09-12T17:27:50.454241+0000","last_became_peered":"2024-09-12T17:27:50.454241+0000","last_unstale":"2024-09-12T17:28:21.465509+0000","last_undegraded":"2024-09-12T17:28:21.465509+0000","last_fullsized":"2024-09-12T17:28:21.465509+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:01.881864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"31'16","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.203650+0000","last_change":"2024-09-12T17:27:42.424267+0000","last_active":"2024-09-12T17:30:50.203650+0000","last_peered":"2024-09-12T17:30:50.203650+0000","last_clean":"2024-09-12T17:30:50.203650+0000","last_became_active":"2024-09-12T17:27:42.423805+0000","last_became_peered":"2024-09-12T17:27:42.423805+0000","last_unstale":"2024-09-12T17:30:50.203650+0000","last_undegraded":"2024-09-12T17:30:50.203650+0000","last_fullsized":"2024-09-12T17:30:50.203650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:37.154226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466516+0000","last_change":"2024-09-12T17:27:40.424553+0000","last_active":"2024-09-12T17:28:21.466516+0000","last_peered":"2024-09-12T17:28:21.466516+0000","last_clean":"2024-09-12T17:28:21.466516+0000","last_became_active":"2024-09-12T17:27:40.423703+0000","last_became_peered":"2024-09-12T17:27:40.423703+0000","last_unstale":"2024-09-12T17:28:21.466516+0000","last_undegraded":"2024-09-12T17:28:21.466516+0000","last_fullsized":"2024-09-12T17:28:21.466516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:34.708745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.472967+0000","last_change":"2024-09-12T17:27:34.764838+0000","last_active":"2024-09-12T17:28:21.472967+0000","last_peered":"2024-09-12T17:28:21.472967+0000","last_clean":"2024-09-12T17:28:21.472967+0000","last_became_active":"2024-09-12T17:27:32.761590+0000","last_became_peered":"2024-09-12T17:27:32.761590+0000","last_unstale":"2024-09-12T17:28:21.472967+0000","last_undegraded":"2024-09-12T17:28:21.472967+0000","last_fullsized":"2024-09-12T17:28:21.472967+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:23.009450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036072200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463699+0000","last_change":"2024-09-12T17:27:44.427647+0000","last_active":"2024-09-12T17:28:21.463699+0000","last_peered":"2024-09-12T17:28:21.463699+0000","last_clean":"2024-09-12T17:28:21.463699+0000","last_became_active":"2024-09-12T17:27:44.427318+0000","last_became_peered":"2024-09-12T17:27:44.427318+0000","last_unstale":"2024-09-12T17:28:21.463699+0000","last_undegraded":"2024-09-12T17:28:21.463699+0000","last_fullsized":"2024-09-12T17:28:21.463699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:46.727329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'10","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464060+0000","last_change":"2024-09-12T17:27:46.444325+0000","last_active":"2024-09-12T17:28:21.464060+0000","last_peered":"2024-09-12T17:28:21.464060+0000","last_clean":"2024-09-12T17:28:21.464060+0000","last_became_active":"2024-09-12T17:27:46.443937+0000","last_became_peered":"2024-09-12T17:27:46.443937+0000","last_unstale":"2024-09-12T17:28:21.464060+0000","last_undegraded":"2024-09-12T17:28:21.464060+0000","last_fullsized":"2024-09-12T17:28:21.464060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:54:23.541095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"31'282","reported_seq":390,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.331661+0000","last_change":"2024-09-12T17:27:48.441935+0000","last_active":"2024-09-12T17:30:50.331661+0000","last_peered":"2024-09-12T17:30:50.331661+0000","last_clean":"2024-09-12T17:30:50.331661+0000","last_became_active":"2024-09-12T17:27:48.441694+0000","last_became_peered":"2024-09-12T17:27:48.441694+0000","last_unstale":"2024-09-12T17:30:50.331661+0000","last_undegraded":"2024-09-12T17:30:50.331661+0000","last_fullsized":"2024-09-12T17:30:50.331661+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:32.578727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"29'3","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468923+0000","last_change":"2024-09-12T17:27:50.453171+0000","last_active":"2024-09-12T17:28:21.468923+0000","last_peered":"2024-09-12T17:28:21.468923+0000","last_clean":"2024-09-12T17:28:21.468923+0000","last_became_active":"2024-09-12T17:27:50.452862+0000","last_became_peered":"2024-09-12T17:27:50.452862+0000","last_unstale":"2024-09-12T17:28:21.468923+0000","last_undegraded":"2024-09-12T17:28:21.468923+0000","last_fullsized":"2024-09-12T17:28:21.468923+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:55.038103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"29'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466639+0000","last_change":"2024-09-12T17:27:42.437147+0000","last_active":"2024-09-12T17:28:21.466639+0000","last_peered":"2024-09-12T17:28:21.466639+0000","last_clean":"2024-09-12T17:28:21.466639+0000","last_became_active":"2024-09-12T17:27:42.436667+0000","last_became_peered":"2024-09-12T17:27:42.436667+0000","last_unstale":"2024-09-12T17:28:21.466639+0000","last_undegraded":"2024-09-12T17:28:21.466639+0000","last_fullsized":"2024-09-12T17:28:21.466639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:46.763985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466656+0000","last_change":"2024-09-12T17:27:40.419748+0000","last_active":"2024-09-12T17:28:21.466656+0000","last_peered":"2024-09-12T17:28:21.466656+0000","last_clean":"2024-09-12T17:28:21.466656+0000","last_became_active":"2024-09-12T17:27:40.419472+0000","last_became_peered":"2024-09-12T17:27:40.419472+0000","last_unstale":"2024-09-12T17:28:21.466656+0000","last_undegraded":"2024-09-12T17:28:21.466656+0000","last_fullsized":"2024-09-12T17:28:21.466656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:16.839649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466286+0000","last_change":"2024-09-12T17:27:34.769850+0000","last_active":"2024-09-12T17:28:21.466286+0000","last_peered":"2024-09-12T17:28:21.466286+0000","last_clean":"2024-09-12T17:28:21.466286+0000","last_became_active":"2024-09-12T17:27:32.775344+0000","last_became_peered":"2024-09-12T17:27:32.775344+0000","last_unstale":"2024-09-12T17:28:21.466286+0000","last_undegraded":"2024-09-12T17:28:21.466286+0000","last_fullsized":"2024-09-12T17:28:21.466286+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:45.298951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011343939999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463970+0000","last_change":"2024-09-12T17:27:44.427846+0000","last_active":"2024-09-12T17:28:21.463970+0000","last_peered":"2024-09-12T17:28:21.463970+0000","last_clean":"2024-09-12T17:28:21.463970+0000","last_became_active":"2024-09-12T17:27:44.427519+0000","last_became_peered":"2024-09-12T17:27:44.427519+0000","last_unstale":"2024-09-12T17:28:21.463970+0000","last_undegraded":"2024-09-12T17:28:21.463970+0000","last_fullsized":"2024-09-12T17:28:21.463970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:56.857897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"31'82","reported_seq":155,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.594928+0000","last_change":"2024-09-12T17:27:46.442632+0000","last_active":"2024-09-12T17:29:47.594928+0000","last_peered":"2024-09-12T17:29:47.594928+0000","last_clean":"2024-09-12T17:29:47.594928+0000","last_became_active":"2024-09-12T17:27:46.442154+0000","last_became_peered":"2024-09-12T17:27:46.442154+0000","last_unstale":"2024-09-12T17:29:47.594928+0000","last_undegraded":"2024-09-12T17:29:47.594928+0000","last_fullsized":"2024-09-12T17:29:47.594928+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:20.802573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471089+0000","last_change":"2024-09-12T17:27:48.440496+0000","last_active":"2024-09-12T17:28:21.471089+0000","last_peered":"2024-09-12T17:28:21.471089+0000","last_clean":"2024-09-12T17:28:21.471089+0000","last_became_active":"2024-09-12T17:27:48.440177+0000","last_became_peered":"2024-09-12T17:27:48.440177+0000","last_unstale":"2024-09-12T17:28:21.471089+0000","last_undegraded":"2024-09-12T17:28:21.471089+0000","last_fullsized":"2024-09-12T17:28:21.471089+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:26.852348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466258+0000","last_change":"2024-09-12T17:27:50.454208+0000","last_active":"2024-09-12T17:28:21.466258+0000","last_peered":"2024-09-12T17:28:21.466258+0000","last_clean":"2024-09-12T17:28:21.466258+0000","last_became_active":"2024-09-12T17:27:50.453919+0000","last_became_peered":"2024-09-12T17:27:50.453919+0000","last_unstale":"2024-09-12T17:28:21.466258+0000","last_undegraded":"2024-09-12T17:28:21.466258+0000","last_fullsized":"2024-09-12T17:28:21.466258+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:28.859033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469099+0000","last_change":"2024-09-12T17:27:50.454609+0000","last_active":"2024-09-12T17:28:21.469099+0000","last_peered":"2024-09-12T17:28:21.469099+0000","last_clean":"2024-09-12T17:28:21.469099+0000","last_became_active":"2024-09-12T17:27:50.452190+0000","last_became_peered":"2024-09-12T17:27:50.452190+0000","last_unstale":"2024-09-12T17:28:21.469099+0000","last_undegraded":"2024-09-12T17:28:21.469099+0000","last_fullsized":"2024-09-12T17:28:21.469099+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:08.249355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:05.195137+0000","last_change":"2024-09-12T17:27:42.436477+0000","last_active":"2024-09-12T17:29:05.195137+0000","last_peered":"2024-09-12T17:29:05.195137+0000","last_clean":"2024-09-12T17:29:05.195137+0000","last_became_active":"2024-09-12T17:27:42.436187+0000","last_became_peered":"2024-09-12T17:27:42.436187+0000","last_unstale":"2024-09-12T17:29:05.195137+0000","last_undegraded":"2024-09-12T17:29:05.195137+0000","last_fullsized":"2024-09-12T17:29:05.195137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:06.625797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"29'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464418+0000","last_change":"2024-09-12T17:27:40.429080+0000","last_active":"2024-09-12T17:28:21.464418+0000","last_peered":"2024-09-12T17:28:21.464418+0000","last_clean":"2024-09-12T17:28:21.464418+0000","last_became_active":"2024-09-12T17:27:40.428529+0000","last_became_peered":"2024-09-12T17:27:40.428529+0000","last_unstale":"2024-09-12T17:28:21.464418+0000","last_undegraded":"2024-09-12T17:28:21.464418+0000","last_fullsized":"2024-09-12T17:28:21.464418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:43.412664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470025+0000","last_change":"2024-09-12T17:27:44.430001+0000","last_active":"2024-09-12T17:28:21.470025+0000","last_peered":"2024-09-12T17:28:21.470025+0000","last_clean":"2024-09-12T17:28:21.470025+0000","last_became_active":"2024-09-12T17:27:44.429701+0000","last_became_peered":"2024-09-12T17:27:44.429701+0000","last_unstale":"2024-09-12T17:28:21.470025+0000","last_undegraded":"2024-09-12T17:28:21.470025+0000","last_fullsized":"2024-09-12T17:28:21.470025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:31.928670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"31'32","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.600840+0000","last_change":"2024-09-12T17:27:46.443026+0000","last_active":"2024-09-12T17:29:47.600840+0000","last_peered":"2024-09-12T17:29:47.600840+0000","last_clean":"2024-09-12T17:29:47.600840+0000","last_became_active":"2024-09-12T17:27:46.442713+0000","last_became_peered":"2024-09-12T17:27:46.442713+0000","last_unstale":"2024-09-12T17:29:47.600840+0000","last_undegraded":"2024-09-12T17:29:47.600840+0000","last_fullsized":"2024-09-12T17:29:47.600840+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:29.878441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463885+0000","last_change":"2024-09-12T17:27:48.450563+0000","last_active":"2024-09-12T17:28:21.463885+0000","last_peered":"2024-09-12T17:28:21.463885+0000","last_clean":"2024-09-12T17:28:21.463885+0000","last_became_active":"2024-09-12T17:27:48.450050+0000","last_became_peered":"2024-09-12T17:27:48.450050+0000","last_unstale":"2024-09-12T17:28:21.463885+0000","last_undegraded":"2024-09-12T17:28:21.463885+0000","last_fullsized":"2024-09-12T17:28:21.463885+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:37.430305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"31'5","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.306851+0000","last_change":"2024-09-12T17:27:50.453680+0000","last_active":"2024-09-12T17:29:47.306851+0000","last_peered":"2024-09-12T17:29:47.306851+0000","last_clean":"2024-09-12T17:29:47.306851+0000","last_became_active":"2024-09-12T17:27:50.453382+0000","last_became_peered":"2024-09-12T17:27:50.453382+0000","last_unstale":"2024-09-12T17:29:47.306851+0000","last_undegraded":"2024-09-12T17:29:47.306851+0000","last_fullsized":"2024-09-12T17:29:47.306851+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:21.594797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"31'8","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.197223+0000","last_change":"2024-09-12T17:27:42.436403+0000","last_active":"2024-09-12T17:30:50.197223+0000","last_peered":"2024-09-12T17:30:50.197223+0000","last_clean":"2024-09-12T17:30:50.197223+0000","last_became_active":"2024-09-12T17:27:42.436150+0000","last_became_peered":"2024-09-12T17:27:42.436150+0000","last_unstale":"2024-09-12T17:30:50.197223+0000","last_undegraded":"2024-09-12T17:30:50.197223+0000","last_fullsized":"2024-09-12T17:30:50.197223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:34.481120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466884+0000","last_change":"2024-09-12T17:27:40.432404+0000","last_active":"2024-09-12T17:28:21.466884+0000","last_peered":"2024-09-12T17:28:21.466884+0000","last_clean":"2024-09-12T17:28:21.466884+0000","last_became_active":"2024-09-12T17:27:40.431962+0000","last_became_peered":"2024-09-12T17:27:40.431962+0000","last_unstale":"2024-09-12T17:28:21.466884+0000","last_undegraded":"2024-09-12T17:28:21.466884+0000","last_fullsized":"2024-09-12T17:28:21.466884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:16.839649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465368+0000","last_change":"2024-09-12T17:27:44.432604+0000","last_active":"2024-09-12T17:28:21.465368+0000","last_peered":"2024-09-12T17:28:21.465368+0000","last_clean":"2024-09-12T17:28:21.465368+0000","last_became_active":"2024-09-12T17:27:44.432334+0000","last_became_peered":"2024-09-12T17:27:44.432334+0000","last_unstale":"2024-09-12T17:28:21.465368+0000","last_undegraded":"2024-09-12T17:28:21.465368+0000","last_fullsized":"2024-09-12T17:28:21.465368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:32.282020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"31'6","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.113421+0000","last_change":"2024-09-12T17:27:46.435861+0000","last_active":"2024-09-12T17:30:49.113421+0000","last_peered":"2024-09-12T17:30:49.113421+0000","last_clean":"2024-09-12T17:30:49.113421+0000","last_became_active":"2024-09-12T17:27:46.435567+0000","last_became_peered":"2024-09-12T17:27:46.435567+0000","last_unstale":"2024-09-12T17:30:49.113421+0000","last_undegraded":"2024-09-12T17:30:49.113421+0000","last_fullsized":"2024-09-12T17:30:49.113421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:25.415585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466933+0000","last_change":"2024-09-12T17:27:48.448838+0000","last_active":"2024-09-12T17:28:21.466933+0000","last_peered":"2024-09-12T17:28:21.466933+0000","last_clean":"2024-09-12T17:28:21.466933+0000","last_became_active":"2024-09-12T17:27:48.448478+0000","last_became_peered":"2024-09-12T17:27:48.448478+0000","last_unstale":"2024-09-12T17:28:21.466933+0000","last_undegraded":"2024-09-12T17:28:21.466933+0000","last_fullsized":"2024-09-12T17:28:21.466933+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:31.633824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"31'8","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:22.316873+0000","last_change":"2024-09-12T17:27:50.449599+0000","last_active":"2024-09-12T17:28:22.316873+0000","last_peered":"2024-09-12T17:28:22.316873+0000","last_clean":"2024-09-12T17:28:22.316873+0000","last_became_active":"2024-09-12T17:27:50.449302+0000","last_became_peered":"2024-09-12T17:27:50.449302+0000","last_unstale":"2024-09-12T17:28:22.316873+0000","last_undegraded":"2024-09-12T17:28:22.316873+0000","last_fullsized":"2024-09-12T17:28:22.316873+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:02.835518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"31'4","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:05.195069+0000","last_change":"2024-09-12T17:27:42.424932+0000","last_active":"2024-09-12T17:29:05.195069+0000","last_peered":"2024-09-12T17:29:05.195069+0000","last_clean":"2024-09-12T17:29:05.195069+0000","last_became_active":"2024-09-12T17:27:42.423974+0000","last_became_peered":"2024-09-12T17:27:42.423974+0000","last_unstale":"2024-09-12T17:29:05.195069+0000","last_undegraded":"2024-09-12T17:29:05.195069+0000","last_fullsized":"2024-09-12T17:29:05.195069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:45.464780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:22.876120+0000","last_change":"2024-09-12T17:27:40.430392+0000","last_active":"2024-09-12T17:28:22.876120+0000","last_peered":"2024-09-12T17:28:22.876120+0000","last_clean":"2024-09-12T17:28:22.876120+0000","last_became_active":"2024-09-12T17:27:40.430154+0000","last_became_peered":"2024-09-12T17:27:40.430154+0000","last_unstale":"2024-09-12T17:28:22.876120+0000","last_undegraded":"2024-09-12T17:28:22.876120+0000","last_fullsized":"2024-09-12T17:28:22.876120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:51.844092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466293+0000","last_change":"2024-09-12T17:27:44.435267+0000","last_active":"2024-09-12T17:28:21.466293+0000","last_peered":"2024-09-12T17:28:21.466293+0000","last_clean":"2024-09-12T17:28:21.466293+0000","last_became_active":"2024-09-12T17:27:44.434979+0000","last_became_peered":"2024-09-12T17:27:44.434979+0000","last_unstale":"2024-09-12T17:28:21.466293+0000","last_undegraded":"2024-09-12T17:28:21.466293+0000","last_fullsized":"2024-09-12T17:28:21.466293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:20.110019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"31'40","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.160818+0000","last_change":"2024-09-12T17:27:46.433815+0000","last_active":"2024-09-12T17:30:49.160818+0000","last_peered":"2024-09-12T17:30:49.160818+0000","last_clean":"2024-09-12T17:30:49.160818+0000","last_became_active":"2024-09-12T17:27:46.433421+0000","last_became_peered":"2024-09-12T17:27:46.433421+0000","last_unstale":"2024-09-12T17:30:49.160818+0000","last_undegraded":"2024-09-12T17:30:49.160818+0000","last_fullsized":"2024-09-12T17:30:49.160818+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:46:25.118826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469750+0000","last_change":"2024-09-12T17:27:48.439853+0000","last_active":"2024-09-12T17:28:21.469750+0000","last_peered":"2024-09-12T17:28:21.469750+0000","last_clean":"2024-09-12T17:28:21.469750+0000","last_became_active":"2024-09-12T17:27:48.439547+0000","last_became_peered":"2024-09-12T17:27:48.439547+0000","last_unstale":"2024-09-12T17:28:21.469750+0000","last_undegraded":"2024-09-12T17:28:21.469750+0000","last_fullsized":"2024-09-12T17:28:21.469750+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:36.201000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464221+0000","last_change":"2024-09-12T17:27:50.459594+0000","last_active":"2024-09-12T17:28:21.464221+0000","last_peered":"2024-09-12T17:28:21.464221+0000","last_clean":"2024-09-12T17:28:21.464221+0000","last_became_active":"2024-09-12T17:27:50.459321+0000","last_became_peered":"2024-09-12T17:27:50.459321+0000","last_unstale":"2024-09-12T17:28:21.464221+0000","last_undegraded":"2024-09-12T17:28:21.464221+0000","last_fullsized":"2024-09-12T17:28:21.464221+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:42.428839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"31'14","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.226040+0000","last_change":"2024-09-12T17:27:42.428640+0000","last_active":"2024-09-12T17:30:50.226040+0000","last_peered":"2024-09-12T17:30:50.226040+0000","last_clean":"2024-09-12T17:30:50.226040+0000","last_became_active":"2024-09-12T17:27:42.428364+0000","last_became_peered":"2024-09-12T17:27:42.428364+0000","last_unstale":"2024-09-12T17:30:50.226040+0000","last_undegraded":"2024-09-12T17:30:50.226040+0000","last_fullsized":"2024-09-12T17:30:50.226040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:30.980696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.136306+0000","last_change":"2024-09-12T17:27:40.416377+0000","last_active":"2024-09-12T17:30:50.136306+0000","last_peered":"2024-09-12T17:30:50.136306+0000","last_clean":"2024-09-12T17:30:50.136306+0000","last_became_active":"2024-09-12T17:27:40.415212+0000","last_became_peered":"2024-09-12T17:27:40.415212+0000","last_unstale":"2024-09-12T17:30:50.136306+0000","last_undegraded":"2024-09-12T17:30:50.136306+0000","last_fullsized":"2024-09-12T17:30:50.136306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:08.388292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463776+0000","last_change":"2024-09-12T17:27:44.430145+0000","last_active":"2024-09-12T17:28:21.463776+0000","last_peered":"2024-09-12T17:28:21.463776+0000","last_clean":"2024-09-12T17:28:21.463776+0000","last_became_active":"2024-09-12T17:27:44.429844+0000","last_became_peered":"2024-09-12T17:27:44.429844+0000","last_unstale":"2024-09-12T17:28:21.463776+0000","last_undegraded":"2024-09-12T17:28:21.463776+0000","last_fullsized":"2024-09-12T17:28:21.463776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:59.753147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"31'31","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.586817+0000","last_change":"2024-09-12T17:27:46.432991+0000","last_active":"2024-09-12T17:29:47.586817+0000","last_peered":"2024-09-12T17:29:47.586817+0000","last_clean":"2024-09-12T17:29:47.586817+0000","last_became_active":"2024-09-12T17:27:46.432650+0000","last_became_peered":"2024-09-12T17:27:46.432650+0000","last_unstale":"2024-09-12T17:29:47.586817+0000","last_undegraded":"2024-09-12T17:29:47.586817+0000","last_fullsized":"2024-09-12T17:29:47.586817+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:21.877058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469478+0000","last_change":"2024-09-12T17:27:48.440110+0000","last_active":"2024-09-12T17:28:21.469478+0000","last_peered":"2024-09-12T17:28:21.469478+0000","last_clean":"2024-09-12T17:28:21.469478+0000","last_became_active":"2024-09-12T17:27:48.439134+0000","last_became_peered":"2024-09-12T17:27:48.439134+0000","last_unstale":"2024-09-12T17:28:21.469478+0000","last_undegraded":"2024-09-12T17:28:21.469478+0000","last_fullsized":"2024-09-12T17:28:21.469478+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:10.067239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:23.352256+0000","last_change":"2024-09-12T17:27:42.427657+0000","last_active":"2024-09-12T17:28:23.352256+0000","last_peered":"2024-09-12T17:28:23.352256+0000","last_clean":"2024-09-12T17:28:23.352256+0000","last_became_active":"2024-09-12T17:27:42.426108+0000","last_became_peered":"2024-09-12T17:27:42.426108+0000","last_unstale":"2024-09-12T17:28:23.352256+0000","last_undegraded":"2024-09-12T17:28:23.352256+0000","last_fullsized":"2024-09-12T17:28:23.352256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:46.077185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:22.871380+0000","last_change":"2024-09-12T17:27:40.430187+0000","last_active":"2024-09-12T17:28:22.871380+0000","last_peered":"2024-09-12T17:28:22.871380+0000","last_clean":"2024-09-12T17:28:22.871380+0000","last_became_active":"2024-09-12T17:27:40.429644+0000","last_became_peered":"2024-09-12T17:27:40.429644+0000","last_unstale":"2024-09-12T17:28:22.871380+0000","last_undegraded":"2024-09-12T17:28:22.871380+0000","last_fullsized":"2024-09-12T17:28:22.871380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:25.713951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:24.747265+0000","last_change":"2024-09-12T17:28:21.472039+0000","last_active":"2024-09-12T17:28:24.747265+0000","last_peered":"2024-09-12T17:28:24.747265+0000","last_clean":"2024-09-12T17:28:24.747265+0000","last_became_active":"2024-09-12T17:28:21.471678+0000","last_became_peered":"2024-09-12T17:28:21.471678+0000","last_unstale":"2024-09-12T17:28:24.747265+0000","last_undegraded":"2024-09-12T17:28:24.747265+0000","last_fullsized":"2024-09-12T17:28:24.747265+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:05.827719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"31'55","reported_seq":112,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.078333+0000","last_change":"2024-09-12T17:27:46.437943+0000","last_active":"2024-09-12T17:29:49.078333+0000","last_peered":"2024-09-12T17:29:49.078333+0000","last_clean":"2024-09-12T17:29:49.078333+0000","last_became_active":"2024-09-12T17:27:46.437623+0000","last_became_peered":"2024-09-12T17:27:46.437623+0000","last_unstale":"2024-09-12T17:29:49.078333+0000","last_undegraded":"2024-09-12T17:29:49.078333+0000","last_fullsized":"2024-09-12T17:29:49.078333+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:29.626451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.467936+0000","last_change":"2024-09-12T17:27:48.440791+0000","last_active":"2024-09-12T17:28:21.467936+0000","last_peered":"2024-09-12T17:28:21.467936+0000","last_clean":"2024-09-12T17:28:21.467936+0000","last_became_active":"2024-09-12T17:27:48.440354+0000","last_became_peered":"2024-09-12T17:27:48.440354+0000","last_unstale":"2024-09-12T17:28:21.467936+0000","last_undegraded":"2024-09-12T17:28:21.467936+0000","last_fullsized":"2024-09-12T17:28:21.467936+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:12.406427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"31'14","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.013731+0000","last_change":"2024-09-12T17:27:50.457985+0000","last_active":"2024-09-12T17:29:49.013731+0000","last_peered":"2024-09-12T17:29:49.013731+0000","last_clean":"2024-09-12T17:29:49.013731+0000","last_became_active":"2024-09-12T17:27:50.457744+0000","last_became_peered":"2024-09-12T17:27:50.457744+0000","last_unstale":"2024-09-12T17:29:49.013731+0000","last_undegraded":"2024-09-12T17:29:49.013731+0000","last_fullsized":"2024-09-12T17:29:49.013731+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:13.394393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"31'6","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:05.377000+0000","last_change":"2024-09-12T17:27:42.424802+0000","last_active":"2024-09-12T17:29:05.377000+0000","last_peered":"2024-09-12T17:29:05.377000+0000","last_clean":"2024-09-12T17:29:05.377000+0000","last_became_active":"2024-09-12T17:27:42.424447+0000","last_became_peered":"2024-09-12T17:27:42.424447+0000","last_unstale":"2024-09-12T17:29:05.377000+0000","last_undegraded":"2024-09-12T17:29:05.377000+0000","last_fullsized":"2024-09-12T17:29:05.377000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:50.988456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.467680+0000","last_change":"2024-09-12T17:27:40.415772+0000","last_active":"2024-09-12T17:28:21.467680+0000","last_peered":"2024-09-12T17:28:21.467680+0000","last_clean":"2024-09-12T17:28:21.467680+0000","last_became_active":"2024-09-12T17:27:40.414911+0000","last_became_peered":"2024-09-12T17:27:40.414911+0000","last_unstale":"2024-09-12T17:28:21.467680+0000","last_undegraded":"2024-09-12T17:28:21.467680+0000","last_fullsized":"2024-09-12T17:28:21.467680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:33.541500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"31'4","reported_seq":227,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:48.716416+0000","last_change":"2024-09-12T17:27:44.428072+0000","last_active":"2024-09-12T17:29:48.716416+0000","last_peered":"2024-09-12T17:29:48.716416+0000","last_clean":"2024-09-12T17:29:48.716416+0000","last_became_active":"2024-09-12T17:27:44.427778+0000","last_became_peered":"2024-09-12T17:27:44.427778+0000","last_unstale":"2024-09-12T17:29:48.716416+0000","last_undegraded":"2024-09-12T17:29:48.716416+0000","last_fullsized":"2024-09-12T17:29:48.716416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:40.229931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"31'36","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.587748+0000","last_change":"2024-09-12T17:27:46.440779+0000","last_active":"2024-09-12T17:29:47.587748+0000","last_peered":"2024-09-12T17:29:47.587748+0000","last_clean":"2024-09-12T17:29:47.587748+0000","last_became_active":"2024-09-12T17:27:46.440494+0000","last_became_peered":"2024-09-12T17:27:46.440494+0000","last_unstale":"2024-09-12T17:29:47.587748+0000","last_undegraded":"2024-09-12T17:29:47.587748+0000","last_fullsized":"2024-09-12T17:29:47.587748+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:43.434855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471249+0000","last_change":"2024-09-12T17:27:48.449171+0000","last_active":"2024-09-12T17:28:21.471249+0000","last_peered":"2024-09-12T17:28:21.471249+0000","last_clean":"2024-09-12T17:28:21.471249+0000","last_became_active":"2024-09-12T17:27:48.448871+0000","last_became_peered":"2024-09-12T17:27:48.448871+0000","last_unstale":"2024-09-12T17:28:21.471249+0000","last_undegraded":"2024-09-12T17:28:21.471249+0000","last_fullsized":"2024-09-12T17:28:21.471249+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:23.511991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463074+0000","last_change":"2024-09-12T17:27:50.452011+0000","last_active":"2024-09-12T17:28:21.463074+0000","last_peered":"2024-09-12T17:28:21.463074+0000","last_clean":"2024-09-12T17:28:21.463074+0000","last_became_active":"2024-09-12T17:27:50.451678+0000","last_became_peered":"2024-09-12T17:27:50.451678+0000","last_unstale":"2024-09-12T17:28:21.463074+0000","last_undegraded":"2024-09-12T17:28:21.463074+0000","last_fullsized":"2024-09-12T17:28:21.463074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:15.594880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.197331+0000","last_change":"2024-09-12T17:27:42.438932+0000","last_active":"2024-09-12T17:30:50.197331+0000","last_peered":"2024-09-12T17:30:50.197331+0000","last_clean":"2024-09-12T17:30:50.197331+0000","last_became_active":"2024-09-12T17:27:42.438583+0000","last_became_peered":"2024-09-12T17:27:42.438583+0000","last_unstale":"2024-09-12T17:30:50.197331+0000","last_undegraded":"2024-09-12T17:30:50.197331+0000","last_fullsized":"2024-09-12T17:30:50.197331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:41.527263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469834+0000","last_change":"2024-09-12T17:27:40.414311+0000","last_active":"2024-09-12T17:28:21.469834+0000","last_peered":"2024-09-12T17:28:21.469834+0000","last_clean":"2024-09-12T17:28:21.469834+0000","last_became_active":"2024-09-12T17:27:40.414034+0000","last_became_peered":"2024-09-12T17:27:40.414034+0000","last_unstale":"2024-09-12T17:28:21.469834+0000","last_undegraded":"2024-09-12T17:28:21.469834+0000","last_fullsized":"2024-09-12T17:28:21.469834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:02.612906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.467688+0000","last_change":"2024-09-12T17:27:44.427310+0000","last_active":"2024-09-12T17:28:21.467688+0000","last_peered":"2024-09-12T17:28:21.467688+0000","last_clean":"2024-09-12T17:28:21.467688+0000","last_became_active":"2024-09-12T17:27:44.426927+0000","last_became_peered":"2024-09-12T17:27:44.426927+0000","last_unstale":"2024-09-12T17:28:21.467688+0000","last_undegraded":"2024-09-12T17:28:21.467688+0000","last_fullsized":"2024-09-12T17:28:21.467688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:51.409386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"31'32","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.604974+0000","last_change":"2024-09-12T17:27:46.439119+0000","last_active":"2024-09-12T17:29:47.604974+0000","last_peered":"2024-09-12T17:29:47.604974+0000","last_clean":"2024-09-12T17:29:47.604974+0000","last_became_active":"2024-09-12T17:27:46.438778+0000","last_became_peered":"2024-09-12T17:27:46.438778+0000","last_unstale":"2024-09-12T17:29:47.604974+0000","last_undegraded":"2024-09-12T17:29:47.604974+0000","last_fullsized":"2024-09-12T17:29:47.604974+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:47.015548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.473244+0000","last_change":"2024-09-12T17:27:48.440227+0000","last_active":"2024-09-12T17:28:21.473244+0000","last_peered":"2024-09-12T17:28:21.473244+0000","last_clean":"2024-09-12T17:28:21.473244+0000","last_became_active":"2024-09-12T17:27:48.439888+0000","last_became_peered":"2024-09-12T17:27:48.439888+0000","last_unstale":"2024-09-12T17:28:21.473244+0000","last_undegraded":"2024-09-12T17:28:21.473244+0000","last_fullsized":"2024-09-12T17:28:21.473244+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:29.484764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"31'3","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.072631+0000","last_change":"2024-09-12T17:27:50.455406+0000","last_active":"2024-09-12T17:29:49.072631+0000","last_peered":"2024-09-12T17:29:49.072631+0000","last_clean":"2024-09-12T17:29:49.072631+0000","last_became_active":"2024-09-12T17:27:50.454058+0000","last_became_peered":"2024-09-12T17:27:50.454058+0000","last_unstale":"2024-09-12T17:29:49.072631+0000","last_undegraded":"2024-09-12T17:29:49.072631+0000","last_fullsized":"2024-09-12T17:29:49.072631+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:44.719122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"31'6","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.225767+0000","last_change":"2024-09-12T17:27:42.428738+0000","last_active":"2024-09-12T17:30:50.225767+0000","last_peered":"2024-09-12T17:30:50.225767+0000","last_clean":"2024-09-12T17:30:50.225767+0000","last_became_active":"2024-09-12T17:27:42.428236+0000","last_became_peered":"2024-09-12T17:27:42.428236+0000","last_unstale":"2024-09-12T17:30:50.225767+0000","last_undegraded":"2024-09-12T17:30:50.225767+0000","last_fullsized":"2024-09-12T17:30:50.225767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:41.383292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"31'6","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.138918+0000","last_change":"2024-09-12T17:27:40.429226+0000","last_active":"2024-09-12T17:30:50.138918+0000","last_peered":"2024-09-12T17:30:50.138918+0000","last_clean":"2024-09-12T17:30:50.138918+0000","last_became_active":"2024-09-12T17:27:40.428969+0000","last_became_peered":"2024-09-12T17:27:40.428969+0000","last_unstale":"2024-09-12T17:30:50.138918+0000","last_undegraded":"2024-09-12T17:30:50.138918+0000","last_fullsized":"2024-09-12T17:30:50.138918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:34.741245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":14,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470977+0000","last_change":"2024-09-12T17:27:44.432908+0000","last_active":"2024-09-12T17:28:21.470977+0000","last_peered":"2024-09-12T17:28:21.470977+0000","last_clean":"2024-09-12T17:28:21.470977+0000","last_became_active":"2024-09-12T17:27:44.432609+0000","last_became_peered":"2024-09-12T17:27:44.432609+0000","last_unstale":"2024-09-12T17:28:21.470977+0000","last_undegraded":"2024-09-12T17:28:21.470977+0000","last_fullsized":"2024-09-12T17:28:21.470977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:38.819057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"29'10","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465451+0000","last_change":"2024-09-12T17:27:46.445145+0000","last_active":"2024-09-12T17:28:21.465451+0000","last_peered":"2024-09-12T17:28:21.465451+0000","last_clean":"2024-09-12T17:28:21.465451+0000","last_became_active":"2024-09-12T17:27:46.444644+0000","last_became_peered":"2024-09-12T17:27:46.444644+0000","last_unstale":"2024-09-12T17:28:21.465451+0000","last_undegraded":"2024-09-12T17:28:21.465451+0000","last_fullsized":"2024-09-12T17:28:21.465451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:28.337567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"31'282","reported_seq":371,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.344750+0000","last_change":"2024-09-12T17:27:48.449435+0000","last_active":"2024-09-12T17:30:50.344750+0000","last_peered":"2024-09-12T17:30:50.344750+0000","last_clean":"2024-09-12T17:30:50.344750+0000","last_became_active":"2024-09-12T17:27:48.449138+0000","last_became_peered":"2024-09-12T17:27:48.449138+0000","last_unstale":"2024-09-12T17:30:50.344750+0000","last_undegraded":"2024-09-12T17:30:50.344750+0000","last_fullsized":"2024-09-12T17:30:50.344750+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:43.994480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.462765+0000","last_change":"2024-09-12T17:27:50.452165+0000","last_active":"2024-09-12T17:28:21.462765+0000","last_peered":"2024-09-12T17:28:21.462765+0000","last_clean":"2024-09-12T17:28:21.462765+0000","last_became_active":"2024-09-12T17:27:50.451899+0000","last_became_peered":"2024-09-12T17:27:50.451899+0000","last_unstale":"2024-09-12T17:28:21.462765+0000","last_undegraded":"2024-09-12T17:28:21.462765+0000","last_fullsized":"2024-09-12T17:28:21.462765+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:38.778216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"31'8","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.195915+0000","last_change":"2024-09-12T17:27:42.430391+0000","last_active":"2024-09-12T17:30:50.195915+0000","last_peered":"2024-09-12T17:30:50.195915+0000","last_clean":"2024-09-12T17:30:50.195915+0000","last_became_active":"2024-09-12T17:27:42.430110+0000","last_became_peered":"2024-09-12T17:27:42.430110+0000","last_unstale":"2024-09-12T17:30:50.195915+0000","last_undegraded":"2024-09-12T17:30:50.195915+0000","last_fullsized":"2024-09-12T17:30:50.195915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:09.624789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:48.918402+0000","last_change":"2024-09-12T17:27:40.415902+0000","last_active":"2024-09-12T17:29:48.918402+0000","last_peered":"2024-09-12T17:29:48.918402+0000","last_clean":"2024-09-12T17:29:48.918402+0000","last_became_active":"2024-09-12T17:27:40.415018+0000","last_became_peered":"2024-09-12T17:27:40.415018+0000","last_unstale":"2024-09-12T17:29:48.918402+0000","last_undegraded":"2024-09-12T17:29:48.918402+0000","last_fullsized":"2024-09-12T17:29:48.918402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:40.407846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470596+0000","last_change":"2024-09-12T17:27:44.433006+0000","last_active":"2024-09-12T17:28:21.470596+0000","last_peered":"2024-09-12T17:28:21.470596+0000","last_clean":"2024-09-12T17:28:21.470596+0000","last_became_active":"2024-09-12T17:27:44.432389+0000","last_became_peered":"2024-09-12T17:27:44.432389+0000","last_unstale":"2024-09-12T17:28:21.470596+0000","last_undegraded":"2024-09-12T17:28:21.470596+0000","last_fullsized":"2024-09-12T17:28:21.470596+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:18.314088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"31'36","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.578959+0000","last_change":"2024-09-12T17:27:46.437010+0000","last_active":"2024-09-12T17:29:47.578959+0000","last_peered":"2024-09-12T17:29:47.578959+0000","last_clean":"2024-09-12T17:29:47.578959+0000","last_became_active":"2024-09-12T17:27:46.435056+0000","last_became_peered":"2024-09-12T17:27:46.435056+0000","last_unstale":"2024-09-12T17:29:47.578959+0000","last_undegraded":"2024-09-12T17:29:47.578959+0000","last_fullsized":"2024-09-12T17:29:47.578959+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:41.987106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470481+0000","last_change":"2024-09-12T17:27:48.451418+0000","last_active":"2024-09-12T17:28:21.470481+0000","last_peered":"2024-09-12T17:28:21.470481+0000","last_clean":"2024-09-12T17:28:21.470481+0000","last_became_active":"2024-09-12T17:27:48.451143+0000","last_became_peered":"2024-09-12T17:27:48.451143+0000","last_unstale":"2024-09-12T17:28:21.470481+0000","last_undegraded":"2024-09-12T17:28:21.470481+0000","last_fullsized":"2024-09-12T17:28:21.470481+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:05.841062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469983+0000","last_change":"2024-09-12T17:27:50.459043+0000","last_active":"2024-09-12T17:28:21.469983+0000","last_peered":"2024-09-12T17:28:21.469983+0000","last_clean":"2024-09-12T17:28:21.469983+0000","last_became_active":"2024-09-12T17:27:50.458688+0000","last_became_peered":"2024-09-12T17:27:50.458688+0000","last_unstale":"2024-09-12T17:28:21.469983+0000","last_undegraded":"2024-09-12T17:28:21.469983+0000","last_fullsized":"2024-09-12T17:28:21.469983+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:52.579121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'17","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.936036+0000","last_change":"2024-09-12T17:27:42.429938+0000","last_active":"2024-09-12T17:30:49.936036+0000","last_peered":"2024-09-12T17:30:49.936036+0000","last_clean":"2024-09-12T17:30:49.936036+0000","last_became_active":"2024-09-12T17:27:42.429645+0000","last_became_peered":"2024-09-12T17:27:42.429645+0000","last_unstale":"2024-09-12T17:30:49.936036+0000","last_undegraded":"2024-09-12T17:30:49.936036+0000","last_fullsized":"2024-09-12T17:30:49.936036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:26.167048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":59,"num_read_kb":51,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465519+0000","last_change":"2024-09-12T17:27:40.433842+0000","last_active":"2024-09-12T17:28:21.465519+0000","last_peered":"2024-09-12T17:28:21.465519+0000","last_clean":"2024-09-12T17:28:21.465519+0000","last_became_active":"2024-09-12T17:27:40.433580+0000","last_became_peered":"2024-09-12T17:27:40.433580+0000","last_unstale":"2024-09-12T17:28:21.465519+0000","last_undegraded":"2024-09-12T17:28:21.465519+0000","last_fullsized":"2024-09-12T17:28:21.465519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:42.180970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469077+0000","last_change":"2024-09-12T17:27:44.433816+0000","last_active":"2024-09-12T17:28:21.469077+0000","last_peered":"2024-09-12T17:28:21.469077+0000","last_clean":"2024-09-12T17:28:21.469077+0000","last_became_active":"2024-09-12T17:27:44.433529+0000","last_became_peered":"2024-09-12T17:27:44.433529+0000","last_unstale":"2024-09-12T17:28:21.469077+0000","last_undegraded":"2024-09-12T17:28:21.469077+0000","last_fullsized":"2024-09-12T17:28:21.469077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:41.042095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"31'32","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:14.761606+0000","last_change":"2024-09-12T17:27:46.439345+0000","last_active":"2024-09-12T17:30:14.761606+0000","last_peered":"2024-09-12T17:30:14.761606+0000","last_clean":"2024-09-12T17:30:14.761606+0000","last_became_active":"2024-09-12T17:27:46.439037+0000","last_became_peered":"2024-09-12T17:27:46.439037+0000","last_unstale":"2024-09-12T17:30:14.761606+0000","last_undegraded":"2024-09-12T17:30:14.761606+0000","last_fullsized":"2024-09-12T17:30:14.761606+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:39.381080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463052+0000","last_change":"2024-09-12T17:27:48.449101+0000","last_active":"2024-09-12T17:28:21.463052+0000","last_peered":"2024-09-12T17:28:21.463052+0000","last_clean":"2024-09-12T17:28:21.463052+0000","last_became_active":"2024-09-12T17:27:48.448426+0000","last_became_peered":"2024-09-12T17:27:48.448426+0000","last_unstale":"2024-09-12T17:28:21.463052+0000","last_undegraded":"2024-09-12T17:28:21.463052+0000","last_fullsized":"2024-09-12T17:28:21.463052+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:18.516470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464580+0000","last_change":"2024-09-12T17:27:50.459948+0000","last_active":"2024-09-12T17:28:21.464580+0000","last_peered":"2024-09-12T17:28:21.464580+0000","last_clean":"2024-09-12T17:28:21.464580+0000","last_became_active":"2024-09-12T17:27:50.459662+0000","last_became_peered":"2024-09-12T17:27:50.459662+0000","last_unstale":"2024-09-12T17:28:21.464580+0000","last_undegraded":"2024-09-12T17:28:21.464580+0000","last_fullsized":"2024-09-12T17:28:21.464580+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:08.216661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'12","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.148532+0000","last_change":"2024-09-12T17:28:21.476547+0000","last_active":"2024-09-12T17:30:50.148532+0000","last_peered":"2024-09-12T17:30:50.148532+0000","last_clean":"2024-09-12T17:30:50.148532+0000","last_became_active":"2024-09-12T17:28:21.472532+0000","last_became_peered":"2024-09-12T17:28:21.472532+0000","last_unstale":"2024-09-12T17:30:50.148532+0000","last_undegraded":"2024-09-12T17:30:50.148532+0000","last_fullsized":"2024-09-12T17:30:50.148532+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:31.654192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"31'1","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:44.756709+0000","last_change":"2024-09-12T17:27:40.419012+0000","last_active":"2024-09-12T17:29:44.756709+0000","last_peered":"2024-09-12T17:29:44.756709+0000","last_clean":"2024-09-12T17:29:44.756709+0000","last_became_active":"2024-09-12T17:27:40.418464+0000","last_became_peered":"2024-09-12T17:27:40.418464+0000","last_unstale":"2024-09-12T17:29:44.756709+0000","last_undegraded":"2024-09-12T17:29:44.756709+0000","last_fullsized":"2024-09-12T17:29:44.756709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:41.313682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469583+0000","last_change":"2024-09-12T17:27:44.433348+0000","last_active":"2024-09-12T17:28:21.469583+0000","last_peered":"2024-09-12T17:28:21.469583+0000","last_clean":"2024-09-12T17:28:21.469583+0000","last_became_active":"2024-09-12T17:27:44.430221+0000","last_became_peered":"2024-09-12T17:27:44.430221+0000","last_unstale":"2024-09-12T17:28:21.469583+0000","last_undegraded":"2024-09-12T17:28:21.469583+0000","last_fullsized":"2024-09-12T17:28:21.469583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:13.176204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"31'26","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.602901+0000","last_change":"2024-09-12T17:27:46.441427+0000","last_active":"2024-09-12T17:29:47.602901+0000","last_peered":"2024-09-12T17:29:47.602901+0000","last_clean":"2024-09-12T17:29:47.602901+0000","last_became_active":"2024-09-12T17:27:46.441081+0000","last_became_peered":"2024-09-12T17:27:46.441081+0000","last_unstale":"2024-09-12T17:29:47.602901+0000","last_undegraded":"2024-09-12T17:29:47.602901+0000","last_fullsized":"2024-09-12T17:29:47.602901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:08.132341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463313+0000","last_change":"2024-09-12T17:27:48.447632+0000","last_active":"2024-09-12T17:28:21.463313+0000","last_peered":"2024-09-12T17:28:21.463313+0000","last_clean":"2024-09-12T17:28:21.463313+0000","last_became_active":"2024-09-12T17:27:48.447321+0000","last_became_peered":"2024-09-12T17:27:48.447321+0000","last_unstale":"2024-09-12T17:28:21.463313+0000","last_undegraded":"2024-09-12T17:28:21.463313+0000","last_fullsized":"2024-09-12T17:28:21.463313+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:43.865345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"31'10","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.181767+0000","last_change":"2024-09-12T17:27:50.460271+0000","last_active":"2024-09-12T17:30:49.181767+0000","last_peered":"2024-09-12T17:30:49.181767+0000","last_clean":"2024-09-12T17:30:49.181767+0000","last_became_active":"2024-09-12T17:27:50.459463+0000","last_became_peered":"2024-09-12T17:27:50.459463+0000","last_unstale":"2024-09-12T17:30:49.181767+0000","last_undegraded":"2024-09-12T17:30:49.181767+0000","last_fullsized":"2024-09-12T17:30:49.181767+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:18.316219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"31'17","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.232329+0000","last_change":"2024-09-12T17:27:42.430374+0000","last_active":"2024-09-12T17:30:50.232329+0000","last_peered":"2024-09-12T17:30:50.232329+0000","last_clean":"2024-09-12T17:30:50.232329+0000","last_became_active":"2024-09-12T17:27:42.430021+0000","last_became_peered":"2024-09-12T17:27:42.430021+0000","last_unstale":"2024-09-12T17:30:50.232329+0000","last_undegraded":"2024-09-12T17:30:50.232329+0000","last_fullsized":"2024-09-12T17:30:50.232329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:54.683103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":76,"num_read_kb":68,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470409+0000","last_change":"2024-09-12T17:27:40.416382+0000","last_active":"2024-09-12T17:28:21.470409+0000","last_peered":"2024-09-12T17:28:21.470409+0000","last_clean":"2024-09-12T17:28:21.470409+0000","last_became_active":"2024-09-12T17:27:40.415549+0000","last_became_peered":"2024-09-12T17:27:40.415549+0000","last_unstale":"2024-09-12T17:28:21.470409+0000","last_undegraded":"2024-09-12T17:28:21.470409+0000","last_fullsized":"2024-09-12T17:28:21.470409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:42:31.960679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"31'2","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:46.228947+0000","last_change":"2024-09-12T17:27:44.433362+0000","last_active":"2024-09-12T17:29:46.228947+0000","last_peered":"2024-09-12T17:29:46.228947+0000","last_clean":"2024-09-12T17:29:46.228947+0000","last_became_active":"2024-09-12T17:27:44.433037+0000","last_became_peered":"2024-09-12T17:27:44.433037+0000","last_unstale":"2024-09-12T17:29:46.228947+0000","last_undegraded":"2024-09-12T17:29:46.228947+0000","last_fullsized":"2024-09-12T17:29:46.228947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:52.650681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"31'33","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.096185+0000","last_change":"2024-09-12T17:27:46.443590+0000","last_active":"2024-09-12T17:30:49.096185+0000","last_peered":"2024-09-12T17:30:49.096185+0000","last_clean":"2024-09-12T17:30:49.096185+0000","last_became_active":"2024-09-12T17:27:46.443316+0000","last_became_peered":"2024-09-12T17:27:46.443316+0000","last_unstale":"2024-09-12T17:30:49.096185+0000","last_undegraded":"2024-09-12T17:30:49.096185+0000","last_fullsized":"2024-09-12T17:30:49.096185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:47.273927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471547+0000","last_change":"2024-09-12T17:27:48.448239+0000","last_active":"2024-09-12T17:28:21.471547+0000","last_peered":"2024-09-12T17:28:21.471547+0000","last_clean":"2024-09-12T17:28:21.471547+0000","last_became_active":"2024-09-12T17:27:48.447884+0000","last_became_peered":"2024-09-12T17:27:48.447884+0000","last_unstale":"2024-09-12T17:28:21.471547+0000","last_undegraded":"2024-09-12T17:28:21.471547+0000","last_fullsized":"2024-09-12T17:28:21.471547+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:37.799636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"31'2","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.614754+0000","last_change":"2024-09-12T17:27:50.459747+0000","last_active":"2024-09-12T17:29:47.614754+0000","last_peered":"2024-09-12T17:29:47.614754+0000","last_clean":"2024-09-12T17:29:47.614754+0000","last_became_active":"2024-09-12T17:27:50.459464+0000","last_became_peered":"2024-09-12T17:27:50.459464+0000","last_unstale":"2024-09-12T17:29:47.614754+0000","last_undegraded":"2024-09-12T17:29:47.614754+0000","last_fullsized":"2024-09-12T17:29:47.614754+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:47.424145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"31'6","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.018176+0000","last_change":"2024-09-12T17:28:21.475279+0000","last_active":"2024-09-12T17:30:50.018176+0000","last_peered":"2024-09-12T17:30:50.018176+0000","last_clean":"2024-09-12T17:30:50.018176+0000","last_became_active":"2024-09-12T17:28:21.471738+0000","last_became_peered":"2024-09-12T17:28:21.471738+0000","last_unstale":"2024-09-12T17:30:50.018176+0000","last_undegraded":"2024-09-12T17:30:50.018176+0000","last_fullsized":"2024-09-12T17:30:50.018176+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:24.585090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"31'1","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.757645+0000","last_change":"2024-09-12T17:27:40.425416+0000","last_active":"2024-09-12T17:29:49.757645+0000","last_peered":"2024-09-12T17:29:49.757645+0000","last_clean":"2024-09-12T17:29:49.757645+0000","last_became_active":"2024-09-12T17:27:40.425150+0000","last_became_peered":"2024-09-12T17:27:40.425150+0000","last_unstale":"2024-09-12T17:29:49.757645+0000","last_undegraded":"2024-09-12T17:29:49.757645+0000","last_fullsized":"2024-09-12T17:29:49.757645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:44.782205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"31'6","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.225756+0000","last_change":"2024-09-12T17:27:42.428098+0000","last_active":"2024-09-12T17:30:50.225756+0000","last_peered":"2024-09-12T17:30:50.225756+0000","last_clean":"2024-09-12T17:30:50.225756+0000","last_became_active":"2024-09-12T17:27:42.427745+0000","last_became_peered":"2024-09-12T17:27:42.427745+0000","last_unstale":"2024-09-12T17:30:50.225756+0000","last_undegraded":"2024-09-12T17:30:50.225756+0000","last_fullsized":"2024-09-12T17:30:50.225756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:27.653203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470803+0000","last_change":"2024-09-12T17:27:40.413378+0000","last_active":"2024-09-12T17:28:21.470803+0000","last_peered":"2024-09-12T17:28:21.470803+0000","last_clean":"2024-09-12T17:28:21.470803+0000","last_became_active":"2024-09-12T17:27:40.413068+0000","last_became_peered":"2024-09-12T17:27:40.413068+0000","last_unstale":"2024-09-12T17:28:21.470803+0000","last_undegraded":"2024-09-12T17:28:21.470803+0000","last_fullsized":"2024-09-12T17:28:21.470803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:35.900609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465685+0000","last_change":"2024-09-12T17:27:42.429127+0000","last_active":"2024-09-12T17:28:21.465685+0000","last_peered":"2024-09-12T17:28:21.465685+0000","last_clean":"2024-09-12T17:28:21.465685+0000","last_became_active":"2024-09-12T17:27:42.428871+0000","last_became_peered":"2024-09-12T17:27:42.428871+0000","last_unstale":"2024-09-12T17:28:21.465685+0000","last_undegraded":"2024-09-12T17:28:21.465685+0000","last_fullsized":"2024-09-12T17:28:21.465685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:46.400627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464105+0000","last_change":"2024-09-12T17:27:40.423623+0000","last_active":"2024-09-12T17:28:21.464105+0000","last_peered":"2024-09-12T17:28:21.464105+0000","last_clean":"2024-09-12T17:28:21.464105+0000","last_became_active":"2024-09-12T17:27:40.423210+0000","last_became_peered":"2024-09-12T17:27:40.423210+0000","last_unstale":"2024-09-12T17:28:21.464105+0000","last_undegraded":"2024-09-12T17:28:21.464105+0000","last_fullsized":"2024-09-12T17:28:21.464105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:10.561707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"31'10","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.148353+0000","last_change":"2024-09-12T17:27:42.428508+0000","last_active":"2024-09-12T17:30:50.148353+0000","last_peered":"2024-09-12T17:30:50.148353+0000","last_clean":"2024-09-12T17:30:50.148353+0000","last_became_active":"2024-09-12T17:27:42.428059+0000","last_became_peered":"2024-09-12T17:27:42.428059+0000","last_unstale":"2024-09-12T17:30:50.148353+0000","last_undegraded":"2024-09-12T17:30:50.148353+0000","last_fullsized":"2024-09-12T17:30:50.148353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:35.350838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.821850+0000","last_change":"2024-09-12T17:27:40.420118+0000","last_active":"2024-09-12T17:28:21.821850+0000","last_peered":"2024-09-12T17:28:21.821850+0000","last_clean":"2024-09-12T17:28:21.821850+0000","last_became_active":"2024-09-12T17:27:40.419018+0000","last_became_peered":"2024-09-12T17:27:40.419018+0000","last_unstale":"2024-09-12T17:28:21.821850+0000","last_undegraded":"2024-09-12T17:28:21.821850+0000","last_fullsized":"2024-09-12T17:28:21.821850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:45.609329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"31'4","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:23.352679+0000","last_change":"2024-09-12T17:27:42.425653+0000","last_active":"2024-09-12T17:28:23.352679+0000","last_peered":"2024-09-12T17:28:23.352679+0000","last_clean":"2024-09-12T17:28:23.352679+0000","last_became_active":"2024-09-12T17:27:42.424201+0000","last_became_peered":"2024-09-12T17:27:42.424201+0000","last_unstale":"2024-09-12T17:28:23.352679+0000","last_undegraded":"2024-09-12T17:28:23.352679+0000","last_fullsized":"2024-09-12T17:28:23.352679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:14.199032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.472579+0000","last_change":"2024-09-12T17:27:40.415678+0000","last_active":"2024-09-12T17:28:21.472579+0000","last_peered":"2024-09-12T17:28:21.472579+0000","last_clean":"2024-09-12T17:28:21.472579+0000","last_became_active":"2024-09-12T17:27:40.415318+0000","last_became_peered":"2024-09-12T17:27:40.415318+0000","last_unstale":"2024-09-12T17:28:21.472579+0000","last_undegraded":"2024-09-12T17:28:21.472579+0000","last_fullsized":"2024-09-12T17:28:21.472579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:42.195527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"31'6","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.225777+0000","last_change":"2024-09-12T17:27:42.434915+0000","last_active":"2024-09-12T17:30:50.225777+0000","last_peered":"2024-09-12T17:30:50.225777+0000","last_clean":"2024-09-12T17:30:50.225777+0000","last_became_active":"2024-09-12T17:27:42.434664+0000","last_became_peered":"2024-09-12T17:27:42.434664+0000","last_unstale":"2024-09-12T17:30:50.225777+0000","last_undegraded":"2024-09-12T17:30:50.225777+0000","last_fullsized":"2024-09-12T17:30:50.225777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:59.091747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:22.296581+0000","last_change":"2024-09-12T17:27:40.421011+0000","last_active":"2024-09-12T17:28:22.296581+0000","last_peered":"2024-09-12T17:28:22.296581+0000","last_clean":"2024-09-12T17:28:22.296581+0000","last_became_active":"2024-09-12T17:27:40.420491+0000","last_became_peered":"2024-09-12T17:27:40.420491+0000","last_unstale":"2024-09-12T17:28:22.296581+0000","last_undegraded":"2024-09-12T17:28:22.296581+0000","last_fullsized":"2024-09-12T17:28:22.296581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:35.277806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"31'10","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:05.194652+0000","last_change":"2024-09-12T17:27:42.425216+0000","last_active":"2024-09-12T17:29:05.194652+0000","last_peered":"2024-09-12T17:29:05.194652+0000","last_clean":"2024-09-12T17:29:05.194652+0000","last_became_active":"2024-09-12T17:27:42.424810+0000","last_became_peered":"2024-09-12T17:27:42.424810+0000","last_unstale":"2024-09-12T17:29:05.194652+0000","last_undegraded":"2024-09-12T17:29:05.194652+0000","last_fullsized":"2024-09-12T17:29:05.194652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:08.170045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":37,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469473+0000","last_change":"2024-09-12T17:27:40.431654+0000","last_active":"2024-09-12T17:28:21.469473+0000","last_peered":"2024-09-12T17:28:21.469473+0000","last_clean":"2024-09-12T17:28:21.469473+0000","last_became_active":"2024-09-12T17:27:40.431365+0000","last_became_peered":"2024-09-12T17:27:40.431365+0000","last_unstale":"2024-09-12T17:28:21.469473+0000","last_undegraded":"2024-09-12T17:28:21.469473+0000","last_fullsized":"2024-09-12T17:28:21.469473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:42:31.960679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"31'13","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.202797+0000","last_change":"2024-09-12T17:27:42.423482+0000","last_active":"2024-09-12T17:30:50.202797+0000","last_peered":"2024-09-12T17:30:50.202797+0000","last_clean":"2024-09-12T17:30:50.202797+0000","last_became_active":"2024-09-12T17:27:42.423099+0000","last_became_peered":"2024-09-12T17:27:42.423099+0000","last_unstale":"2024-09-12T17:30:50.202797+0000","last_undegraded":"2024-09-12T17:30:50.202797+0000","last_fullsized":"2024-09-12T17:30:50.202797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:16.940321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.822005+0000","last_change":"2024-09-12T17:27:40.415799+0000","last_active":"2024-09-12T17:28:21.822005+0000","last_peered":"2024-09-12T17:28:21.822005+0000","last_clean":"2024-09-12T17:28:21.822005+0000","last_became_active":"2024-09-12T17:27:40.415456+0000","last_became_peered":"2024-09-12T17:27:40.415456+0000","last_unstale":"2024-09-12T17:28:21.822005+0000","last_undegraded":"2024-09-12T17:28:21.822005+0000","last_fullsized":"2024-09-12T17:28:21.822005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:28.905045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"31'7","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.024232+0000","last_change":"2024-09-12T17:27:42.428053+0000","last_active":"2024-09-12T17:30:50.024232+0000","last_peered":"2024-09-12T17:30:50.024232+0000","last_clean":"2024-09-12T17:30:50.024232+0000","last_became_active":"2024-09-12T17:27:42.427778+0000","last_became_peered":"2024-09-12T17:27:42.427778+0000","last_unstale":"2024-09-12T17:30:50.024232+0000","last_undegraded":"2024-09-12T17:30:50.024232+0000","last_fullsized":"2024-09-12T17:30:50.024232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:29.654847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"31'1","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:50.765249+0000","last_change":"2024-09-12T17:27:40.418491+0000","last_active":"2024-09-12T17:29:50.765249+0000","last_peered":"2024-09-12T17:29:50.765249+0000","last_clean":"2024-09-12T17:29:50.765249+0000","last_became_active":"2024-09-12T17:27:40.418241+0000","last_became_peered":"2024-09-12T17:27:40.418241+0000","last_unstale":"2024-09-12T17:29:50.765249+0000","last_undegraded":"2024-09-12T17:29:50.765249+0000","last_fullsized":"2024-09-12T17:29:50.765249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:44.106061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:22.319225+0000","last_change":"2024-09-12T17:27:42.433339+0000","last_active":"2024-09-12T17:28:22.319225+0000","last_peered":"2024-09-12T17:28:22.319225+0000","last_clean":"2024-09-12T17:28:22.319225+0000","last_became_active":"2024-09-12T17:27:42.433084+0000","last_became_peered":"2024-09-12T17:27:42.433084+0000","last_unstale":"2024-09-12T17:28:22.319225+0000","last_undegraded":"2024-09-12T17:28:22.319225+0000","last_fullsized":"2024-09-12T17:28:22.319225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:14.732392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.822515+0000","last_change":"2024-09-12T17:27:40.418064+0000","last_active":"2024-09-12T17:28:21.822515+0000","last_peered":"2024-09-12T17:28:21.822515+0000","last_clean":"2024-09-12T17:28:21.822515+0000","last_became_active":"2024-09-12T17:27:40.417666+0000","last_became_peered":"2024-09-12T17:27:40.417666+0000","last_unstale":"2024-09-12T17:28:21.822515+0000","last_undegraded":"2024-09-12T17:28:21.822515+0000","last_fullsized":"2024-09-12T17:28:21.822515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:13.932643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"31'8","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.148411+0000","last_change":"2024-09-12T17:27:42.424818+0000","last_active":"2024-09-12T17:30:50.148411+0000","last_peered":"2024-09-12T17:30:50.148411+0000","last_clean":"2024-09-12T17:30:50.148411+0000","last_became_active":"2024-09-12T17:27:42.424017+0000","last_became_peered":"2024-09-12T17:27:42.424017+0000","last_unstale":"2024-09-12T17:30:50.148411+0000","last_undegraded":"2024-09-12T17:30:50.148411+0000","last_fullsized":"2024-09-12T17:30:50.148411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:22.656734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469834+0000","last_change":"2024-09-12T17:27:40.422351+0000","last_active":"2024-09-12T17:28:21.469834+0000","last_peered":"2024-09-12T17:28:21.469834+0000","last_clean":"2024-09-12T17:28:21.469834+0000","last_became_active":"2024-09-12T17:27:40.418964+0000","last_became_peered":"2024-09-12T17:27:40.418964+0000","last_unstale":"2024-09-12T17:28:21.469834+0000","last_undegraded":"2024-09-12T17:28:21.469834+0000","last_fullsized":"2024-09-12T17:28:21.469834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:51.844092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"31'6","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.076791+0000","last_change":"2024-09-12T17:27:42.424747+0000","last_active":"2024-09-12T17:29:49.076791+0000","last_peered":"2024-09-12T17:29:49.076791+0000","last_clean":"2024-09-12T17:29:49.076791+0000","last_became_active":"2024-09-12T17:27:42.422955+0000","last_became_peered":"2024-09-12T17:27:42.422955+0000","last_unstale":"2024-09-12T17:29:49.076791+0000","last_undegraded":"2024-09-12T17:29:49.076791+0000","last_fullsized":"2024-09-12T17:29:49.076791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:41.422424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.467383+0000","last_change":"2024-09-12T17:27:40.418452+0000","last_active":"2024-09-12T17:28:21.467383+0000","last_peered":"2024-09-12T17:28:21.467383+0000","last_clean":"2024-09-12T17:28:21.467383+0000","last_became_active":"2024-09-12T17:27:40.418183+0000","last_became_peered":"2024-09-12T17:27:40.418183+0000","last_unstale":"2024-09-12T17:28:21.467383+0000","last_undegraded":"2024-09-12T17:28:21.467383+0000","last_fullsized":"2024-09-12T17:28:21.467383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:35.210863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"31'5","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.233331+0000","last_change":"2024-09-12T17:27:42.434117+0000","last_active":"2024-09-12T17:30:50.233331+0000","last_peered":"2024-09-12T17:30:50.233331+0000","last_clean":"2024-09-12T17:30:50.233331+0000","last_became_active":"2024-09-12T17:27:42.433856+0000","last_became_peered":"2024-09-12T17:27:42.433856+0000","last_unstale":"2024-09-12T17:30:50.233331+0000","last_undegraded":"2024-09-12T17:30:50.233331+0000","last_fullsized":"2024-09-12T17:30:50.233331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:13.817201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464738+0000","last_change":"2024-09-12T17:27:40.429406+0000","last_active":"2024-09-12T17:28:21.464738+0000","last_peered":"2024-09-12T17:28:21.464738+0000","last_clean":"2024-09-12T17:28:21.464738+0000","last_became_active":"2024-09-12T17:27:40.428213+0000","last_became_peered":"2024-09-12T17:27:40.428213+0000","last_unstale":"2024-09-12T17:28:21.464738+0000","last_undegraded":"2024-09-12T17:28:21.464738+0000","last_fullsized":"2024-09-12T17:28:21.464738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:43.804492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"31'4","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:05.194819+0000","last_change":"2024-09-12T17:27:42.431854+0000","last_active":"2024-09-12T17:29:05.194819+0000","last_peered":"2024-09-12T17:29:05.194819+0000","last_clean":"2024-09-12T17:29:05.194819+0000","last_became_active":"2024-09-12T17:27:42.431562+0000","last_became_peered":"2024-09-12T17:27:42.431562+0000","last_unstale":"2024-09-12T17:29:05.194819+0000","last_undegraded":"2024-09-12T17:29:05.194819+0000","last_fullsized":"2024-09-12T17:29:05.194819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:46.641338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"31'4","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.909000+0000","last_change":"2024-09-12T17:27:40.426248+0000","last_active":"2024-09-12T17:30:49.909000+0000","last_peered":"2024-09-12T17:30:49.909000+0000","last_clean":"2024-09-12T17:30:49.909000+0000","last_became_active":"2024-09-12T17:27:40.425910+0000","last_became_peered":"2024-09-12T17:27:40.425910+0000","last_unstale":"2024-09-12T17:30:49.909000+0000","last_undegraded":"2024-09-12T17:30:49.909000+0000","last_fullsized":"2024-09-12T17:30:49.909000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:23.924826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"31'10","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.018646+0000","last_change":"2024-09-12T17:27:42.429554+0000","last_active":"2024-09-12T17:30:50.018646+0000","last_peered":"2024-09-12T17:30:50.018646+0000","last_clean":"2024-09-12T17:30:50.018646+0000","last_became_active":"2024-09-12T17:27:42.429270+0000","last_became_peered":"2024-09-12T17:27:42.429270+0000","last_unstale":"2024-09-12T17:30:50.018646+0000","last_undegraded":"2024-09-12T17:30:50.018646+0000","last_fullsized":"2024-09-12T17:30:50.018646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:32.810941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.054755+0000","last_change":"2024-09-12T17:27:40.432092+0000","last_active":"2024-09-12T17:29:49.054755+0000","last_peered":"2024-09-12T17:29:49.054755+0000","last_clean":"2024-09-12T17:29:49.054755+0000","last_became_active":"2024-09-12T17:27:40.431687+0000","last_became_peered":"2024-09-12T17:27:40.431687+0000","last_unstale":"2024-09-12T17:29:49.054755+0000","last_undegraded":"2024-09-12T17:29:49.054755+0000","last_fullsized":"2024-09-12T17:29:49.054755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:35.277806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"31'2","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.280728+0000","last_change":"2024-09-12T17:27:42.425651+0000","last_active":"2024-09-12T17:30:50.280728+0000","last_peered":"2024-09-12T17:30:50.280728+0000","last_clean":"2024-09-12T17:30:50.280728+0000","last_became_active":"2024-09-12T17:27:42.424910+0000","last_became_peered":"2024-09-12T17:27:42.424910+0000","last_unstale":"2024-09-12T17:30:50.280728+0000","last_undegraded":"2024-09-12T17:30:50.280728+0000","last_fullsized":"2024-09-12T17:30:50.280728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:52.600151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"31'1","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:00.767359+0000","last_change":"2024-09-12T17:27:40.434016+0000","last_active":"2024-09-12T17:30:00.767359+0000","last_peered":"2024-09-12T17:30:00.767359+0000","last_clean":"2024-09-12T17:30:00.767359+0000","last_became_active":"2024-09-12T17:27:40.433649+0000","last_became_peered":"2024-09-12T17:27:40.433649+0000","last_unstale":"2024-09-12T17:30:00.767359+0000","last_undegraded":"2024-09-12T17:30:00.767359+0000","last_fullsized":"2024-09-12T17:30:00.767359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:40.824207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:48.985835+0000","last_change":"2024-09-12T17:27:40.424269+0000","last_active":"2024-09-12T17:29:48.985835+0000","last_peered":"2024-09-12T17:29:48.985835+0000","last_clean":"2024-09-12T17:29:48.985835+0000","last_became_active":"2024-09-12T17:27:40.423343+0000","last_became_peered":"2024-09-12T17:27:40.423343+0000","last_unstale":"2024-09-12T17:29:48.985835+0000","last_undegraded":"2024-09-12T17:29:48.985835+0000","last_fullsized":"2024-09-12T17:29:48.985835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:04.434511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"31'8","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.196783+0000","last_change":"2024-09-12T17:27:42.426434+0000","last_active":"2024-09-12T17:30:50.196783+0000","last_peered":"2024-09-12T17:30:50.196783+0000","last_clean":"2024-09-12T17:30:50.196783+0000","last_became_active":"2024-09-12T17:27:42.426150+0000","last_became_peered":"2024-09-12T17:27:42.426150+0000","last_unstale":"2024-09-12T17:30:50.196783+0000","last_undegraded":"2024-09-12T17:30:50.196783+0000","last_fullsized":"2024-09-12T17:30:50.196783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:55.894831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471017+0000","last_change":"2024-09-12T17:27:40.420741+0000","last_active":"2024-09-12T17:28:21.471017+0000","last_peered":"2024-09-12T17:28:21.471017+0000","last_clean":"2024-09-12T17:28:21.471017+0000","last_became_active":"2024-09-12T17:27:40.420396+0000","last_became_peered":"2024-09-12T17:27:40.420396+0000","last_unstale":"2024-09-12T17:28:21.471017+0000","last_undegraded":"2024-09-12T17:28:21.471017+0000","last_fullsized":"2024-09-12T17:28:21.471017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:47.834956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"31'4","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.018441+0000","last_change":"2024-09-12T17:27:42.435623+0000","last_active":"2024-09-12T17:30:50.018441+0000","last_peered":"2024-09-12T17:30:50.018441+0000","last_clean":"2024-09-12T17:30:50.018441+0000","last_became_active":"2024-09-12T17:27:42.435324+0000","last_became_peered":"2024-09-12T17:27:42.435324+0000","last_unstale":"2024-09-12T17:30:50.018441+0000","last_undegraded":"2024-09-12T17:30:50.018441+0000","last_fullsized":"2024-09-12T17:30:50.018441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:04.329622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":482,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1662,"num_read_kb":1552,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":83,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51617792,"data_stored":51611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673006,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43848,"kb_used_data":16824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94327992,"statfs":{"total":96636764160,"available":96591863808,"internally_reserved":0,"allocated":17227776,"data_stored":16913193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705709,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40900,"kb_used_data":13876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94330940,"statfs":{"total":96636764160,"available":96594882560,"internally_reserved":0,"allocated":14209024,"data_stored":13946979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705709,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52844,"kb_used_data":9180,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94318996,"statfs":{"total":96636764160,"available":96582651904,"internally_reserved":0,"allocated":9400320,"data_stored":9113910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705710,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44504,"kb_used_data":13320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94327336,"statfs":{"total":96636764160,"available":96591192064,"internally_reserved":0,"allocated":13639680,"data_stored":13356994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13225984,"data_stored":13222784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13225984,"data_stored":13222784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:30:58.025 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T17:30:58.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.155+0000 7ff23bbf8640 1 Processor -- start 2024-09-12T17:30:58.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.156+0000 7ff23bbf8640 1 -- start start 2024-09-12T17:30:58.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.156+0000 7ff23bbf8640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff234130270 0x7ff234132660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:30:58.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.156+0000 7ff23bbf8640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff23406dc00 con 0x7ff234129d80 2024-09-12T17:30:58.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.156+0000 7ff23bbf8640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7ff2341299c0 con 0x7ff234130270 2024-09-12T17:30:58.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.156+0000 7ff239193640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff234130270 0x7ff234132660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:30:58.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.156+0000 7ff239994640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7ff234129d80 0x7ff23412a160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:58596/0 (socket says 172.21.15.47:58596) 2024-09-12T17:30:58.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.156+0000 7ff239994640 1 -- 172.21.15.47:0/2731247083 learned_addr learned my addr 172.21.15.47:0/2731247083 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-09-12T17:30:58.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.156+0000 7ff239193640 1 --2- 172.21.15.47:0/2731247083 >> v2:172.21.15.47:3300/0 conn(0x7ff234130270 0x7ff234132660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42902/0 (socket says 172.21.15.47:42902) 2024-09-12T17:30:58.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.156+0000 7ff239193640 1 -- 172.21.15.47:0/2731247083 >> v1:172.21.15.47:6789/0 conn(0x7ff234129d80 legacy=0x7ff23412a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:58.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.156+0000 7ff238992640 1 -- 172.21.15.47:0/2731247083 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3895891192 0 0) 0x7ff23406dc00 con 0x7ff234129d80 2024-09-12T17:30:58.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.156+0000 7ff239193640 1 -- 172.21.15.47:0/2731247083 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff23412a870 con 0x7ff234130270 2024-09-12T17:30:58.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.157+0000 7ff239193640 1 --2- 172.21.15.47:0/2731247083 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff234130270 0x7ff234132660 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7ff224009720 tx=0x7ff22402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b56567535338c92 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:30:58.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.157+0000 7ff238992640 1 -- 172.21.15.47:0/2731247083 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff224037070 con 0x7ff234130270 2024-09-12T17:30:58.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.157+0000 7ff238992640 1 -- 172.21.15.47:0/2731247083 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff22402ad90 con 0x7ff234130270 2024-09-12T17:30:58.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.157+0000 7ff238992640 1 -- 172.21.15.47:0/2731247083 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff224032590 con 0x7ff234130270 2024-09-12T17:30:58.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.158+0000 7ff23bbf8640 1 -- 172.21.15.47:0/2731247083 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff234130270 msgr2=0x7ff234132660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:58.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.158+0000 7ff23bbf8640 1 --2- 172.21.15.47:0/2731247083 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff234130270 0x7ff234132660 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7ff224009720 tx=0x7ff22402a110 comp rx=0 tx=0).stop 2024-09-12T17:30:58.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.158+0000 7ff23bbf8640 1 -- 172.21.15.47:0/2731247083 shutdown_connections 2024-09-12T17:30:58.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.158+0000 7ff23bbf8640 1 --2- 172.21.15.47:0/2731247083 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff234130270 0x7ff234132660 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:30:58.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.158+0000 7ff23bbf8640 1 -- 172.21.15.47:0/2731247083 >> 172.21.15.47:0/2731247083 conn(0x7ff234070850 msgr2=0x7ff234072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:30:58.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.158+0000 7ff23bbf8640 1 -- 172.21.15.47:0/2731247083 shutdown_connections 2024-09-12T17:30:58.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.158+0000 7ff23bbf8640 1 -- 172.21.15.47:0/2731247083 wait complete. 2024-09-12T17:30:58.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.159+0000 7ff23bbf8640 1 Processor -- start 2024-09-12T17:30:58.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.159+0000 7ff23bbf8640 1 -- start start 2024-09-12T17:30:58.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.159+0000 7ff23bbf8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff234129d80 0x7ff234115030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:30:58.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.159+0000 7ff23bbf8640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff234073a10 con 0x7ff234129d80 2024-09-12T17:30:58.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.159+0000 7ff239994640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff234129d80 0x7ff234115030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:30:58.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.159+0000 7ff239994640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff234129d80 0x7ff234115030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42904/0 (socket says 172.21.15.47:42904) 2024-09-12T17:30:58.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.159+0000 7ff239994640 1 -- 172.21.15.47:0/2361409702 learned_addr learned my addr 172.21.15.47:0/2361409702 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:30:58.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.160+0000 7ff239994640 1 -- 172.21.15.47:0/2361409702 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff234117300 con 0x7ff234129d80 2024-09-12T17:30:58.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.160+0000 7ff239994640 1 --2- 172.21.15.47:0/2361409702 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff234129d80 0x7ff234115030 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7ff23000c7c0 tx=0x7ff23000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:30:58.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.160+0000 7ff22a7fc640 1 -- 172.21.15.47:0/2361409702 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff230018070 con 0x7ff234129d80 2024-09-12T17:30:58.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.160+0000 7ff22a7fc640 1 -- 172.21.15.47:0/2361409702 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff230004d70 con 0x7ff234129d80 2024-09-12T17:30:58.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.160+0000 7ff23bbf8640 1 -- 172.21.15.47:0/2361409702 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff234116e00 con 0x7ff234129d80 2024-09-12T17:30:58.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.160+0000 7ff22a7fc640 1 -- 172.21.15.47:0/2361409702 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff23000a710 con 0x7ff234129d80 2024-09-12T17:30:58.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.160+0000 7ff23bbf8640 1 -- 172.21.15.47:0/2361409702 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff234126930 con 0x7ff234129d80 2024-09-12T17:30:58.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.161+0000 7ff22a7fc640 1 -- 172.21.15.47:0/2361409702 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ff23001b070 con 0x7ff234129d80 2024-09-12T17:30:58.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.161+0000 7ff23bbf8640 1 -- 172.21.15.47:0/2361409702 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff23412a160 con 0x7ff234129d80 2024-09-12T17:30:58.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.161+0000 7ff22a7fc640 1 --2- 172.21.15.47:0/2361409702 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff21803dec0 0x7ff218040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:30:58.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.161+0000 7ff22a7fc640 1 -- 172.21.15.47:0/2361409702 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7ff230052290 con 0x7ff234129d80 2024-09-12T17:30:58.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.161+0000 7ff239193640 1 --2- 172.21.15.47:0/2361409702 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff21803dec0 0x7ff218040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:30:58.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.162+0000 7ff239193640 1 --2- 172.21.15.47:0/2361409702 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff21803dec0 0x7ff218040380 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff224034000 tx=0x7ff22402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:30:58.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.166+0000 7ff22a7fc640 1 -- 172.21.15.47:0/2361409702 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7ff230011db0 con 0x7ff234129d80 2024-09-12T17:30:58.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.350+0000 7ff23bbf8640 1 -- 172.21.15.47:0/2361409702 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff234068da0 con 0x7ff234129d80 2024-09-12T17:30:58.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.351+0000 7ff22a7fc640 1 -- 172.21.15.47:0/2361409702 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+21359 (secure 0 0 0) 0x7ff230010e00 con 0x7ff234129d80 2024-09-12T17:30:58.354 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:30:58.354 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":31,"fsid":"e43073ba-e4e6-405e-a192-e8c972c1bee5","created":"2024-09-12T17:27:15.406724+0000","modified":"2024-09-12T17:28:21.460097+0000","last_up_change":"2024-09-12T17:27:24.738801+0000","last_in_change":"2024-09-12T17:27:16.470942+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:27:23.745577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T17:27:30.967806+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-12T17:27:39.356283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.440000057220459,"score_stable":1.440000057220459,"optimal_score":1,"raw_score_acting":1.440000057220459,"raw_score_stable":1.440000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-12T17:27:40.723205+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.190000057220459,"score_stable":1.190000057220459,"optimal_score":1,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-12T17:27:42.719105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-12T17:27:44.497339+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-12T17:27:46.449501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-12T17:27:48.505657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d97fac4f-551d-416d-8b2b-e59c453a8d20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":3978157098},{"type":"v1","addr":"172.21.15.47:6801","nonce":3978157098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":3978157098},{"type":"v1","addr":"172.21.15.47:6803","nonce":3978157098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":3978157098},{"type":"v1","addr":"172.21.15.47:6807","nonce":3978157098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":3978157098},{"type":"v1","addr":"172.21.15.47:6805","nonce":3978157098}]},"public_addr":"172.21.15.47:6801/3978157098","cluster_addr":"172.21.15.47:6803/3978157098","heartbeat_back_addr":"172.21.15.47:6807/3978157098","heartbeat_front_addr":"172.21.15.47:6805/3978157098","state":["exists","up"]},{"osd":1,"uuid":"c128aa03-fca1-4254-92ef-e52ded72aae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1903654092},{"type":"v1","addr":"172.21.15.170:6801","nonce":1903654092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1903654092},{"type":"v1","addr":"172.21.15.170:6803","nonce":1903654092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1903654092},{"type":"v1","addr":"172.21.15.170:6807","nonce":1903654092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1903654092},{"type":"v1","addr":"172.21.15.170:6805","nonce":1903654092}]},"public_addr":"172.21.15.170:6801/1903654092","cluster_addr":"172.21.15.170:6803/1903654092","heartbeat_back_addr":"172.21.15.170:6807/1903654092","heartbeat_front_addr":"172.21.15.170:6805/1903654092","state":["exists","up"]},{"osd":2,"uuid":"06af30af-11dd-4c7c-9009-9d1c015bc547","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3855567754},{"type":"v1","addr":"172.21.15.170:6809","nonce":3855567754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":3855567754},{"type":"v1","addr":"172.21.15.170:6811","nonce":3855567754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":3855567754},{"type":"v1","addr":"172.21.15.170:6815","nonce":3855567754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":3855567754},{"type":"v1","addr":"172.21.15.170:6813","nonce":3855567754}]},"public_addr":"172.21.15.170:6809/3855567754","cluster_addr":"172.21.15.170:6811/3855567754","heartbeat_back_addr":"172.21.15.170:6815/3855567754","heartbeat_front_addr":"172.21.15.170:6813/3855567754","state":["exists","up"]},{"osd":3,"uuid":"a6700a39-ad47-4fcc-a6b1-a0953f82883e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2664906588},{"type":"v1","addr":"172.21.15.170:6817","nonce":2664906588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2664906588},{"type":"v1","addr":"172.21.15.170:6819","nonce":2664906588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2664906588},{"type":"v1","addr":"172.21.15.170:6823","nonce":2664906588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2664906588},{"type":"v1","addr":"172.21.15.170:6821","nonce":2664906588}]},"public_addr":"172.21.15.170:6817/2664906588","cluster_addr":"172.21.15.170:6819/2664906588","heartbeat_back_addr":"172.21.15.170:6823/2664906588","heartbeat_front_addr":"172.21.15.170:6821/2664906588","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:27:21.948935+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:27:22.508052+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:27:22.007283+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:27:22.726262+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.35","mappings":[{"from":3,"to":0}]},{"pgid":"3.3f","mappings":[{"from":3,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":3,"to":0}]},{"pgid":"4.19","mappings":[{"from":3,"to":2}]},{"pgid":"4.27","mappings":[{"from":1,"to":2}]},{"pgid":"5.6","mappings":[{"from":0,"to":1}]},{"pgid":"5.15","mappings":[{"from":0,"to":2}]},{"pgid":"5.1e","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:30:58.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.354+0000 7ff23bbf8640 1 -- 172.21.15.47:0/2361409702 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff21803dec0 msgr2=0x7ff218040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:58.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.354+0000 7ff23bbf8640 1 --2- 172.21.15.47:0/2361409702 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff21803dec0 0x7ff218040380 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff224034000 tx=0x7ff22402e000 comp rx=0 tx=0).stop 2024-09-12T17:30:58.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.354+0000 7ff23bbf8640 1 -- 172.21.15.47:0/2361409702 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff234129d80 msgr2=0x7ff234115030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:58.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.354+0000 7ff23bbf8640 1 --2- 172.21.15.47:0/2361409702 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff234129d80 0x7ff234115030 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7ff23000c7c0 tx=0x7ff23000cc80 comp rx=0 tx=0).stop 2024-09-12T17:30:58.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.354+0000 7ff23bbf8640 1 -- 172.21.15.47:0/2361409702 shutdown_connections 2024-09-12T17:30:58.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.354+0000 7ff23bbf8640 1 --2- 172.21.15.47:0/2361409702 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7ff21803dec0 0x7ff218040380 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:30:58.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.354+0000 7ff23bbf8640 1 --2- 172.21.15.47:0/2361409702 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff234129d80 0x7ff234115030 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:30:58.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.354+0000 7ff23bbf8640 1 -- 172.21.15.47:0/2361409702 >> 172.21.15.47:0/2361409702 conn(0x7ff234070850 msgr2=0x7ff2341b5360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:30:58.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.354+0000 7ff23bbf8640 1 -- 172.21.15.47:0/2361409702 shutdown_connections 2024-09-12T17:30:58.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:58.354+0000 7ff23bbf8640 1 -- 172.21.15.47:0/2361409702 wait complete. 2024-09-12T17:30:59.371 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T17:30:59.371 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T17:30:59.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.488+0000 7f754452b640 1 Processor -- start 2024-09-12T17:30:59.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.488+0000 7f754452b640 1 -- start start 2024-09-12T17:30:59.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.489+0000 7f754452b640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f753c130290 0x7f753c132680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:30:59.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.489+0000 7f754452b640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f753c0733d0 con 0x7f753c1235f0 2024-09-12T17:30:59.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.489+0000 7f754452b640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f753c114d60 con 0x7f753c130290 2024-09-12T17:30:59.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.489+0000 7f7541ac6640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f753c130290 0x7f753c132680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:30:59.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.489+0000 7f75422c7640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f753c1235f0 0x7f753c1239d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:58610/0 (socket says 172.21.15.47:58610) 2024-09-12T17:30:59.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.489+0000 7f75422c7640 1 -- 172.21.15.47:0/411152556 learned_addr learned my addr 172.21.15.47:0/411152556 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-09-12T17:30:59.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.490+0000 7f7541ac6640 1 -- 172.21.15.47:0/411152556 >> v1:172.21.15.47:6789/0 conn(0x7f753c1235f0 legacy=0x7f753c1239d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:59.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.490+0000 7f7541ac6640 1 -- 172.21.15.47:0/411152556 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f753c1240e0 con 0x7f753c130290 2024-09-12T17:30:59.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.490+0000 7f75412c5640 1 -- 172.21.15.47:0/411152556 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3437203629 0 0) 0x7f753c0733d0 con 0x7f753c1235f0 2024-09-12T17:30:59.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.490+0000 7f7541ac6640 1 --2- 172.21.15.47:0/411152556 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f753c130290 0x7f753c132680 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f752c009720 tx=0x7f752c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ef18d8f0d43bb60 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:30:59.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.490+0000 7f75412c5640 1 -- 172.21.15.47:0/411152556 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f752c037070 con 0x7f753c130290 2024-09-12T17:30:59.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.490+0000 7f75412c5640 1 -- 172.21.15.47:0/411152556 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f752c02ad90 con 0x7f753c130290 2024-09-12T17:30:59.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.491+0000 7f75412c5640 1 -- 172.21.15.47:0/411152556 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f752c032590 con 0x7f753c130290 2024-09-12T17:30:59.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.491+0000 7f754452b640 1 -- 172.21.15.47:0/411152556 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f753c130290 msgr2=0x7f753c132680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:59.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.491+0000 7f754452b640 1 --2- 172.21.15.47:0/411152556 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f753c130290 0x7f753c132680 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f752c009720 tx=0x7f752c02a110 comp rx=0 tx=0).stop 2024-09-12T17:30:59.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.491+0000 7f754452b640 1 -- 172.21.15.47:0/411152556 shutdown_connections 2024-09-12T17:30:59.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.491+0000 7f754452b640 1 --2- 172.21.15.47:0/411152556 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f753c130290 0x7f753c132680 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:30:59.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.491+0000 7f754452b640 1 -- 172.21.15.47:0/411152556 >> 172.21.15.47:0/411152556 conn(0x7f753c070210 msgr2=0x7f753c072630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:30:59.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.491+0000 7f754452b640 1 -- 172.21.15.47:0/411152556 shutdown_connections 2024-09-12T17:30:59.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.491+0000 7f754452b640 1 -- 172.21.15.47:0/411152556 wait complete. 2024-09-12T17:30:59.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.492+0000 7f754452b640 1 Processor -- start 2024-09-12T17:30:59.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.492+0000 7f754452b640 1 -- start start 2024-09-12T17:30:59.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.492+0000 7f754452b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f753c1235f0 0x7f753c120670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:30:59.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.492+0000 7f754452b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f753c114380 con 0x7f753c1235f0 2024-09-12T17:30:59.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.493+0000 7f75422c7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f753c1235f0 0x7f753c120670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:30:59.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.493+0000 7f75422c7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f753c1235f0 0x7f753c120670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42926/0 (socket says 172.21.15.47:42926) 2024-09-12T17:30:59.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.493+0000 7f75422c7640 1 -- 172.21.15.47:0/3848475650 learned_addr learned my addr 172.21.15.47:0/3848475650 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:30:59.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.493+0000 7f75422c7640 1 -- 172.21.15.47:0/3848475650 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f753c12a7e0 con 0x7f753c1235f0 2024-09-12T17:30:59.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.493+0000 7f75422c7640 1 --2- 172.21.15.47:0/3848475650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f753c1235f0 0x7f753c120670 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f753800c3d0 tx=0x7f753800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:30:59.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.493+0000 7f7532ffd640 1 -- 172.21.15.47:0/3848475650 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75380074d0 con 0x7f753c1235f0 2024-09-12T17:30:59.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.493+0000 7f7532ffd640 1 -- 172.21.15.47:0/3848475650 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75380047e0 con 0x7f753c1235f0 2024-09-12T17:30:59.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.493+0000 7f754452b640 1 -- 172.21.15.47:0/3848475650 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f753c112f70 con 0x7f753c1235f0 2024-09-12T17:30:59.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.493+0000 7f7532ffd640 1 -- 172.21.15.47:0/3848475650 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7538007670 con 0x7f753c1235f0 2024-09-12T17:30:59.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.493+0000 7f754452b640 1 -- 172.21.15.47:0/3848475650 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f753c112800 con 0x7f753c1235f0 2024-09-12T17:30:59.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.494+0000 7f754452b640 1 -- 172.21.15.47:0/3848475650 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f753c1239d0 con 0x7f753c1235f0 2024-09-12T17:30:59.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.494+0000 7f7532ffd640 1 -- 172.21.15.47:0/3848475650 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f7538011070 con 0x7f753c1235f0 2024-09-12T17:30:59.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.495+0000 7f7532ffd640 1 --2- 172.21.15.47:0/3848475650 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f752003dec0 0x7f7520040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:30:59.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.495+0000 7f7532ffd640 1 -- 172.21.15.47:0/3848475650 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f7538052790 con 0x7f753c1235f0 2024-09-12T17:30:59.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.495+0000 7f7532ffd640 1 --2- 172.21.15.47:0/3848475650 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f7520049cc0 0x7f752004c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:30:59.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.495+0000 7f7532ffd640 1 -- 172.21.15.47:0/3848475650 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7538018e50 con 0x7f7520049cc0 2024-09-12T17:30:59.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.495+0000 7f7532ffd640 1 -- 172.21.15.47:0/3848475650 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f7538059050 con 0x7f753c1235f0 2024-09-12T17:30:59.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.495+0000 7f7542ac8640 1 --2- 172.21.15.47:0/3848475650 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f7520049cc0 0x7f752004c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:30:59.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.495+0000 7f7541ac6640 1 --2- 172.21.15.47:0/3848475650 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f752003dec0 0x7f7520040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:30:59.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.495+0000 7f7542ac8640 1 --2- 172.21.15.47:0/3848475650 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f7520049cc0 0x7f752004c160 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:30:59.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.496+0000 7f7541ac6640 1 --2- 172.21.15.47:0/3848475650 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f752003dec0 0x7f7520040380 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f752c009720 tx=0x7f752c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:30:59.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.496+0000 7f7532ffd640 1 -- 172.21.15.47:0/3848475650 <== osd.0 v2:172.21.15.47:6800/3978157098 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7538018e50 con 0x7f7520049cc0 2024-09-12T17:30:59.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.509+0000 7f754452b640 1 -- 172.21.15.47:0/3848475650 --> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f753c130460 con 0x7f7520049cc0 2024-09-12T17:30:59.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.509+0000 7f7532ffd640 1 -- 172.21.15.47:0/3848475650 <== osd.0 v2:172.21.15.47:6800/3978157098 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f753c130460 con 0x7f7520049cc0 2024-09-12T17:30:59.510 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:30:59.510 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T17:30:59.511 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:30:59.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.509+0000 7f754452b640 1 -- 172.21.15.47:0/3848475650 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f7520049cc0 msgr2=0x7f752004c160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:59.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.509+0000 7f754452b640 1 --2- 172.21.15.47:0/3848475650 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f7520049cc0 0x7f752004c160 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:30:59.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.509+0000 7f754452b640 1 -- 172.21.15.47:0/3848475650 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f752003dec0 msgr2=0x7f7520040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:59.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.509+0000 7f754452b640 1 --2- 172.21.15.47:0/3848475650 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f752003dec0 0x7f7520040380 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f752c009720 tx=0x7f752c02e000 comp rx=0 tx=0).stop 2024-09-12T17:30:59.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.509+0000 7f754452b640 1 -- 172.21.15.47:0/3848475650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f753c1235f0 msgr2=0x7f753c120670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:59.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.509+0000 7f754452b640 1 --2- 172.21.15.47:0/3848475650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f753c1235f0 0x7f753c120670 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f753800c3d0 tx=0x7f753800c890 comp rx=0 tx=0).stop 2024-09-12T17:30:59.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.509+0000 7f754452b640 1 -- 172.21.15.47:0/3848475650 shutdown_connections 2024-09-12T17:30:59.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.509+0000 7f754452b640 1 --2- 172.21.15.47:0/3848475650 >> [v2:172.21.15.47:6800/3978157098,v1:172.21.15.47:6801/3978157098] conn(0x7f7520049cc0 0x7f752004c160 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:30:59.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.509+0000 7f754452b640 1 --2- 172.21.15.47:0/3848475650 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f752003dec0 0x7f7520040380 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:30:59.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.509+0000 7f754452b640 1 --2- 172.21.15.47:0/3848475650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f753c1235f0 0x7f753c120670 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:30:59.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.509+0000 7f754452b640 1 -- 172.21.15.47:0/3848475650 >> 172.21.15.47:0/3848475650 conn(0x7f753c070210 msgr2=0x7f753c121d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:30:59.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.509+0000 7f754452b640 1 -- 172.21.15.47:0/3848475650 shutdown_connections 2024-09-12T17:30:59.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.509+0000 7f754452b640 1 -- 172.21.15.47:0/3848475650 wait complete. 2024-09-12T17:30:59.521 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T17:30:59.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.622+0000 7fe9f27ec640 1 Processor -- start 2024-09-12T17:30:59.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.622+0000 7fe9f27ec640 1 -- start start 2024-09-12T17:30:59.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.623+0000 7fe9f27ec640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe9ec06fe70 0x7fe9ec070250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:30:59.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.623+0000 7fe9f27ec640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9ec071680 con 0x7fe9ec070790 2024-09-12T17:30:59.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.623+0000 7fe9f27ec640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fe9ec0a30e0 con 0x7fe9ec06fe70 2024-09-12T17:30:59.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.623+0000 7fe9ebfff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe9ec06fe70 0x7fe9ec070250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:30:59.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.623+0000 7fe9eb7fe640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fe9ec070790 0x7fe9ec12ab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:58612/0 (socket says 172.21.15.47:58612) 2024-09-12T17:30:59.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.623+0000 7fe9eb7fe640 1 -- 172.21.15.47:0/3686509110 learned_addr learned my addr 172.21.15.47:0/3686509110 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-09-12T17:30:59.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.623+0000 7fe9ebfff640 1 -- 172.21.15.47:0/3686509110 >> v1:172.21.15.47:6789/0 conn(0x7fe9ec070790 legacy=0x7fe9ec12ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:59.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.623+0000 7fe9ebfff640 1 -- 172.21.15.47:0/3686509110 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9ec071dd0 con 0x7fe9ec06fe70 2024-09-12T17:30:59.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.624+0000 7fe9ebfff640 1 --2- 172.21.15.47:0/3686509110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9ec06fe70 0x7fe9ec070250 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc009720 tx=0x7fe9dc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d49e3caeeece822b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:30:59.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.624+0000 7fe9eaffd640 1 -- 172.21.15.47:0/3686509110 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9dc037070 con 0x7fe9ec06fe70 2024-09-12T17:30:59.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.624+0000 7fe9eaffd640 1 -- 172.21.15.47:0/3686509110 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9dc02ad90 con 0x7fe9ec06fe70 2024-09-12T17:30:59.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.624+0000 7fe9eaffd640 1 -- 172.21.15.47:0/3686509110 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9dc032590 con 0x7fe9ec06fe70 2024-09-12T17:30:59.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.625+0000 7fe9f27ec640 1 -- 172.21.15.47:0/3686509110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9ec06fe70 msgr2=0x7fe9ec070250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:59.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.625+0000 7fe9f27ec640 1 --2- 172.21.15.47:0/3686509110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9ec06fe70 0x7fe9ec070250 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc009720 tx=0x7fe9dc02a110 comp rx=0 tx=0).stop 2024-09-12T17:30:59.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.625+0000 7fe9f27ec640 1 -- 172.21.15.47:0/3686509110 shutdown_connections 2024-09-12T17:30:59.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.625+0000 7fe9f27ec640 1 --2- 172.21.15.47:0/3686509110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9ec06fe70 0x7fe9ec070250 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:30:59.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.625+0000 7fe9f27ec640 1 -- 172.21.15.47:0/3686509110 >> 172.21.15.47:0/3686509110 conn(0x7fe9ec0a0a50 msgr2=0x7fe9ec06e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:30:59.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.625+0000 7fe9f27ec640 1 -- 172.21.15.47:0/3686509110 shutdown_connections 2024-09-12T17:30:59.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.625+0000 7fe9f27ec640 1 -- 172.21.15.47:0/3686509110 wait complete. 2024-09-12T17:30:59.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.626+0000 7fe9f27ec640 1 Processor -- start 2024-09-12T17:30:59.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.626+0000 7fe9f27ec640 1 -- start start 2024-09-12T17:30:59.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.626+0000 7fe9f27ec640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9ec06fe70 0x7fe9ec11f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:30:59.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.626+0000 7fe9f27ec640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ec075cc0 con 0x7fe9ec06fe70 2024-09-12T17:30:59.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.626+0000 7fe9ebfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9ec06fe70 0x7fe9ec11f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:30:59.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.626+0000 7fe9ebfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9ec06fe70 0x7fe9ec11f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42948/0 (socket says 172.21.15.47:42948) 2024-09-12T17:30:59.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.626+0000 7fe9ebfff640 1 -- 172.21.15.47:0/3802663828 learned_addr learned my addr 172.21.15.47:0/3802663828 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:30:59.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.627+0000 7fe9ebfff640 1 -- 172.21.15.47:0/3802663828 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9ec121300 con 0x7fe9ec06fe70 2024-09-12T17:30:59.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.627+0000 7fe9ebfff640 1 --2- 172.21.15.47:0/3802663828 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9ec06fe70 0x7fe9ec11f210 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc009840 tx=0x7fe9dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:30:59.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.627+0000 7fe9e8ff9640 1 -- 172.21.15.47:0/3802663828 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9dc041070 con 0x7fe9ec06fe70 2024-09-12T17:30:59.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.627+0000 7fe9e8ff9640 1 -- 172.21.15.47:0/3802663828 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9dc03c460 con 0x7fe9ec06fe70 2024-09-12T17:30:59.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.627+0000 7fe9e8ff9640 1 -- 172.21.15.47:0/3802663828 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9dc037040 con 0x7fe9ec06fe70 2024-09-12T17:30:59.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.627+0000 7fe9f27ec640 1 -- 172.21.15.47:0/3802663828 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9ec122560 con 0x7fe9ec06fe70 2024-09-12T17:30:59.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.627+0000 7fe9f27ec640 1 -- 172.21.15.47:0/3802663828 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9ec122890 con 0x7fe9ec06fe70 2024-09-12T17:30:59.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.628+0000 7fe9e8ff9640 1 -- 172.21.15.47:0/3802663828 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe9dc044070 con 0x7fe9ec06fe70 2024-09-12T17:30:59.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.628+0000 7fe9f27ec640 1 -- 172.21.15.47:0/3802663828 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9ec070250 con 0x7fe9ec06fe70 2024-09-12T17:30:59.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.628+0000 7fe9e8ff9640 1 --2- 172.21.15.47:0/3802663828 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe9d803de70 0x7fe9d8040330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:30:59.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.628+0000 7fe9e8ff9640 1 -- 172.21.15.47:0/3802663828 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fe9dc073500 con 0x7fe9ec06fe70 2024-09-12T17:30:59.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.629+0000 7fe9eb7fe640 1 --2- 172.21.15.47:0/3802663828 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe9d803de70 0x7fe9d8040330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:30:59.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.630+0000 7fe9eb7fe640 1 --2- 172.21.15.47:0/3802663828 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe9d803de70 0x7fe9d8040330 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0007fd0 tx=0x7fe9e0007aa0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:30:59.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.633+0000 7fe9e8ff9640 1 -- 172.21.15.47:0/3802663828 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7fe9dc04ed60 con 0x7fe9ec06fe70 2024-09-12T17:30:59.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.818+0000 7fe9f27ec640 1 -- 172.21.15.47:0/3802663828 --> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fe9ec073970 con 0x7fe9d803de70 2024-09-12T17:30:59.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.819+0000 7fe9e8ff9640 1 -- 172.21.15.47:0/3802663828 <== mgr.4102 v2:172.21.15.170:6824/4146902489 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe9e00058b0 con 0x7fe9d803de70 2024-09-12T17:30:59.820 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T17:30:59.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.821+0000 7fe9f27ec640 1 -- 172.21.15.47:0/3802663828 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe9d803de70 msgr2=0x7fe9d8040330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:59.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.821+0000 7fe9f27ec640 1 --2- 172.21.15.47:0/3802663828 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe9d803de70 0x7fe9d8040330 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0007fd0 tx=0x7fe9e0007aa0 comp rx=0 tx=0).stop 2024-09-12T17:30:59.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.821+0000 7fe9f27ec640 1 -- 172.21.15.47:0/3802663828 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9ec06fe70 msgr2=0x7fe9ec11f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:59.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.821+0000 7fe9f27ec640 1 --2- 172.21.15.47:0/3802663828 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9ec06fe70 0x7fe9ec11f210 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc009840 tx=0x7fe9dc0046c0 comp rx=0 tx=0).stop 2024-09-12T17:30:59.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.821+0000 7fe9f27ec640 1 -- 172.21.15.47:0/3802663828 shutdown_connections 2024-09-12T17:30:59.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.821+0000 7fe9f27ec640 1 --2- 172.21.15.47:0/3802663828 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe9d803de70 0x7fe9d8040330 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:30:59.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.821+0000 7fe9f27ec640 1 --2- 172.21.15.47:0/3802663828 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9ec06fe70 0x7fe9ec11f210 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:30:59.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.821+0000 7fe9f27ec640 1 -- 172.21.15.47:0/3802663828 >> 172.21.15.47:0/3802663828 conn(0x7fe9ec0a0a50 msgr2=0x7fe9ec12c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:30:59.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.822+0000 7fe9f27ec640 1 -- 172.21.15.47:0/3802663828 shutdown_connections 2024-09-12T17:30:59.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.822+0000 7fe9f27ec640 1 -- 172.21.15.47:0/3802663828 wait complete. 2024-09-12T17:30:59.833 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T17:30:59.834 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T17:30:59.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.937+0000 7f0a0ff32640 1 Processor -- start 2024-09-12T17:30:59.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.937+0000 7f0a0ff32640 1 -- start start 2024-09-12T17:30:59.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.938+0000 7f0a0ff32640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f0a081325e0 0x7f0a081349d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:30:59.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.938+0000 7f0a0ff32640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a08116d50 con 0x7f0a0812bed0 2024-09-12T17:30:59.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.938+0000 7f0a0ff32640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f0a081170f0 con 0x7f0a081325e0 2024-09-12T17:30:59.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.938+0000 7f0a0dcce640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f0a0812bed0 0x7f0a0812c2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:58628/0 (socket says 172.21.15.47:58628) 2024-09-12T17:30:59.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.938+0000 7f0a0dcce640 1 -- 172.21.15.47:0/1343893129 learned_addr learned my addr 172.21.15.47:0/1343893129 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-09-12T17:30:59.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.938+0000 7f0a0d4cd640 1 --2- 172.21.15.47:0/1343893129 >> v2:172.21.15.47:3300/0 conn(0x7f0a081325e0 0x7f0a081349d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:30:59.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.938+0000 7f0a0cccc640 1 -- 172.21.15.47:0/1343893129 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3327547260 0 0) 0x7f0a08116d50 con 0x7f0a0812bed0 2024-09-12T17:30:59.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.938+0000 7f0a0cccc640 1 -- 172.21.15.47:0/1343893129 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09f4003520 con 0x7f0a0812bed0 2024-09-12T17:30:59.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.938+0000 7f0a0d4cd640 1 -- 172.21.15.47:0/1343893129 >> v1:172.21.15.47:6789/0 conn(0x7f0a0812bed0 legacy=0x7f0a0812c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:59.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.938+0000 7f0a0d4cd640 1 -- 172.21.15.47:0/1343893129 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a08115df0 con 0x7f0a081325e0 2024-09-12T17:30:59.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.939+0000 7f0a0d4cd640 1 --2- 172.21.15.47:0/1343893129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a081325e0 0x7f0a081349d0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f09f8009720 tx=0x7f09f802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2c3d75e43d515e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:30:59.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.939+0000 7f0a0cccc640 1 -- 172.21.15.47:0/1343893129 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09f8037070 con 0x7f0a081325e0 2024-09-12T17:30:59.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.939+0000 7f0a0cccc640 1 -- 172.21.15.47:0/1343893129 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09f802ad90 con 0x7f0a081325e0 2024-09-12T17:30:59.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.939+0000 7f0a0cccc640 1 -- 172.21.15.47:0/1343893129 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09f8032590 con 0x7f0a081325e0 2024-09-12T17:30:59.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.940+0000 7f0a0ff32640 1 -- 172.21.15.47:0/1343893129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a081325e0 msgr2=0x7f0a081349d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:59.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.940+0000 7f0a0ff32640 1 --2- 172.21.15.47:0/1343893129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a081325e0 0x7f0a081349d0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f09f8009720 tx=0x7f09f802a110 comp rx=0 tx=0).stop 2024-09-12T17:30:59.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.940+0000 7f0a0ff32640 1 -- 172.21.15.47:0/1343893129 shutdown_connections 2024-09-12T17:30:59.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.940+0000 7f0a0ff32640 1 --2- 172.21.15.47:0/1343893129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a081325e0 0x7f0a081349d0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:30:59.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.940+0000 7f0a0ff32640 1 -- 172.21.15.47:0/1343893129 >> 172.21.15.47:0/1343893129 conn(0x7f0a0806fb60 msgr2=0x7f0a08071f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:30:59.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.940+0000 7f0a0ff32640 1 -- 172.21.15.47:0/1343893129 shutdown_connections 2024-09-12T17:30:59.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.940+0000 7f0a0ff32640 1 -- 172.21.15.47:0/1343893129 wait complete. 2024-09-12T17:30:59.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.941+0000 7f0a0ff32640 1 Processor -- start 2024-09-12T17:30:59.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.941+0000 7f0a0ff32640 1 -- start start 2024-09-12T17:30:59.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.941+0000 7f0a0ff32640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a0812bed0 0x7f0a08124db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:30:59.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.941+0000 7f0a0ff32640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0a081166c0 con 0x7f0a0812bed0 2024-09-12T17:30:59.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.941+0000 7f0a0dcce640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a0812bed0 0x7f0a08124db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:30:59.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.941+0000 7f0a0dcce640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a0812bed0 0x7f0a08124db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42972/0 (socket says 172.21.15.47:42972) 2024-09-12T17:30:59.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.941+0000 7f0a0dcce640 1 -- 172.21.15.47:0/2100520397 learned_addr learned my addr 172.21.15.47:0/2100520397 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:30:59.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.941+0000 7f0a0dcce640 1 -- 172.21.15.47:0/2100520397 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a08072780 con 0x7f0a0812bed0 2024-09-12T17:30:59.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.942+0000 7f0a0dcce640 1 --2- 172.21.15.47:0/2100520397 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a0812bed0 0x7f0a08124db0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f0a0400c390 tx=0x7f0a0400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:30:59.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.942+0000 7f09fe7fc640 1 -- 172.21.15.47:0/2100520397 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a04017070 con 0x7f0a0812bed0 2024-09-12T17:30:59.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.942+0000 7f09fe7fc640 1 -- 172.21.15.47:0/2100520397 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a04005cd0 con 0x7f0a0812bed0 2024-09-12T17:30:59.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.942+0000 7f0a0ff32640 1 -- 172.21.15.47:0/2100520397 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a08117ba0 con 0x7f0a0812bed0 2024-09-12T17:30:59.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.942+0000 7f09fe7fc640 1 -- 172.21.15.47:0/2100520397 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a04007200 con 0x7f0a0812bed0 2024-09-12T17:30:59.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.942+0000 7f0a0ff32640 1 -- 172.21.15.47:0/2100520397 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a081254d0 con 0x7f0a0812bed0 2024-09-12T17:30:59.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.943+0000 7f09fe7fc640 1 -- 172.21.15.47:0/2100520397 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f0a0401a070 con 0x7f0a0812bed0 2024-09-12T17:30:59.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.943+0000 7f0a0ff32640 1 -- 172.21.15.47:0/2100520397 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0a0812c2b0 con 0x7f0a0812bed0 2024-09-12T17:30:59.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.943+0000 7f09fe7fc640 1 --2- 172.21.15.47:0/2100520397 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f09ec03de90 0x7f09ec040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:30:59.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.943+0000 7f09fe7fc640 1 -- 172.21.15.47:0/2100520397 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f0a04051e20 con 0x7f0a0812bed0 2024-09-12T17:30:59.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.943+0000 7f09fe7fc640 1 --2- 172.21.15.47:0/2100520397 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x7f09ec049c90 0x7f09ec04c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:30:59.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.943+0000 7f09fe7fc640 1 -- 172.21.15.47:0/2100520397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f09ec04c800 con 0x7f09ec049c90 2024-09-12T17:30:59.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.943+0000 7f09fe7fc640 1 -- 172.21.15.47:0/2100520397 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f0a040544d0 con 0x7f0a0812bed0 2024-09-12T17:30:59.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.943+0000 7f0a0d4cd640 1 --2- 172.21.15.47:0/2100520397 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f09ec03de90 0x7f09ec040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:30:59.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.943+0000 7f0a0e4cf640 1 --2- 172.21.15.47:0/2100520397 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x7f09ec049c90 0x7f09ec04c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:30:59.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.944+0000 7f0a0d4cd640 1 --2- 172.21.15.47:0/2100520397 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f09ec03de90 0x7f09ec040350 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f09f8034000 tx=0x7f09f802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:30:59.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.944+0000 7f0a0e4cf640 1 --2- 172.21.15.47:0/2100520397 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x7f09ec049c90 0x7f09ec04c130 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:30:59.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.945+0000 7f09fe7fc640 1 -- 172.21.15.47:0/2100520397 <== osd.1 v2:172.21.15.170:6800/1903654092 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f09ec04c800 con 0x7f09ec049c90 2024-09-12T17:30:59.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.957+0000 7f0a0ff32640 1 -- 172.21.15.47:0/2100520397 --> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0a081299c0 con 0x7f09ec049c90 2024-09-12T17:30:59.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.958+0000 7f09fe7fc640 1 -- 172.21.15.47:0/2100520397 <== osd.1 v2:172.21.15.170:6800/1903654092 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0a081299c0 con 0x7f09ec049c90 2024-09-12T17:30:59.959 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:30:59.959 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T17:30:59.960 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:30:59.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.958+0000 7f0a0ff32640 1 -- 172.21.15.47:0/2100520397 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x7f09ec049c90 msgr2=0x7f09ec04c130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:59.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.958+0000 7f0a0ff32640 1 --2- 172.21.15.47:0/2100520397 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x7f09ec049c90 0x7f09ec04c130 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:30:59.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.958+0000 7f0a0ff32640 1 -- 172.21.15.47:0/2100520397 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f09ec03de90 msgr2=0x7f09ec040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:59.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.958+0000 7f0a0ff32640 1 --2- 172.21.15.47:0/2100520397 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f09ec03de90 0x7f09ec040350 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f09f8034000 tx=0x7f09f802e000 comp rx=0 tx=0).stop 2024-09-12T17:30:59.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.958+0000 7f0a0ff32640 1 -- 172.21.15.47:0/2100520397 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a0812bed0 msgr2=0x7f0a08124db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:30:59.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.958+0000 7f0a0ff32640 1 --2- 172.21.15.47:0/2100520397 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a0812bed0 0x7f0a08124db0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f0a0400c390 tx=0x7f0a0400c850 comp rx=0 tx=0).stop 2024-09-12T17:30:59.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.958+0000 7f0a0ff32640 1 -- 172.21.15.47:0/2100520397 shutdown_connections 2024-09-12T17:30:59.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.958+0000 7f0a0ff32640 1 --2- 172.21.15.47:0/2100520397 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f09ec03de90 0x7f09ec040350 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:30:59.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.958+0000 7f0a0ff32640 1 --2- 172.21.15.47:0/2100520397 >> [v2:172.21.15.170:6800/1903654092,v1:172.21.15.170:6801/1903654092] conn(0x7f09ec049c90 0x7f09ec04c130 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:30:59.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.958+0000 7f0a0ff32640 1 --2- 172.21.15.47:0/2100520397 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a0812bed0 0x7f0a08124db0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:30:59.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.958+0000 7f0a0ff32640 1 -- 172.21.15.47:0/2100520397 >> 172.21.15.47:0/2100520397 conn(0x7f0a0806fb60 msgr2=0x7f0a08126630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:30:59.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.958+0000 7f0a0ff32640 1 -- 172.21.15.47:0/2100520397 shutdown_connections 2024-09-12T17:30:59.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:30:59.958+0000 7f0a0ff32640 1 -- 172.21.15.47:0/2100520397 wait complete. 2024-09-12T17:30:59.970 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T17:31:00.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.070+0000 7f591fd2b640 1 Processor -- start 2024-09-12T17:31:00.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.070+0000 7f591fd2b640 1 -- start start 2024-09-12T17:31:00.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.071+0000 7f591fd2b640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5918070960 0x7f5918134780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:31:00.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.071+0000 7f591fd2b640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5918071680 con 0x7f591806fe70 2024-09-12T17:31:00.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.071+0000 7f591fd2b640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f59180a30e0 con 0x7f5918070960 2024-09-12T17:31:00.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.071+0000 7f591d2c6640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5918070960 0x7f5918134780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:31:00.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.071+0000 7f591dac7640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f591806fe70 0x7f5918070250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:58642/0 (socket says 172.21.15.47:58642) 2024-09-12T17:31:00.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.071+0000 7f591dac7640 1 -- 172.21.15.47:0/2660026517 learned_addr learned my addr 172.21.15.47:0/2660026517 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-09-12T17:31:00.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.071+0000 7f591d2c6640 1 -- 172.21.15.47:0/2660026517 >> v1:172.21.15.47:6789/0 conn(0x7f591806fe70 legacy=0x7f5918070250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:31:00.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.071+0000 7f591d2c6640 1 -- 172.21.15.47:0/2660026517 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5918071dd0 con 0x7f5918070960 2024-09-12T17:31:00.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.072+0000 7f591d2c6640 1 --2- 172.21.15.47:0/2660026517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5918070960 0x7f5918134780 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f5908009720 tx=0x7f590802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2bf74ed242fd80c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:31:00.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.072+0000 7f591cac5640 1 -- 172.21.15.47:0/2660026517 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5908037070 con 0x7f5918070960 2024-09-12T17:31:00.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.072+0000 7f591cac5640 1 -- 172.21.15.47:0/2660026517 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f590802ad90 con 0x7f5918070960 2024-09-12T17:31:00.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.072+0000 7f591cac5640 1 -- 172.21.15.47:0/2660026517 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5908032590 con 0x7f5918070960 2024-09-12T17:31:00.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.073+0000 7f591fd2b640 1 -- 172.21.15.47:0/2660026517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5918070960 msgr2=0x7f5918134780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:31:00.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.073+0000 7f591fd2b640 1 --2- 172.21.15.47:0/2660026517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5918070960 0x7f5918134780 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f5908009720 tx=0x7f590802a110 comp rx=0 tx=0).stop 2024-09-12T17:31:00.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.073+0000 7f591fd2b640 1 -- 172.21.15.47:0/2660026517 shutdown_connections 2024-09-12T17:31:00.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.073+0000 7f591fd2b640 1 --2- 172.21.15.47:0/2660026517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5918070960 0x7f5918134780 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:31:00.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.073+0000 7f591fd2b640 1 -- 172.21.15.47:0/2660026517 >> 172.21.15.47:0/2660026517 conn(0x7f59180a0a50 msgr2=0x7f591806e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:31:00.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.073+0000 7f591fd2b640 1 -- 172.21.15.47:0/2660026517 shutdown_connections 2024-09-12T17:31:00.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.073+0000 7f591fd2b640 1 -- 172.21.15.47:0/2660026517 wait complete. 2024-09-12T17:31:00.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.074+0000 7f591fd2b640 1 Processor -- start 2024-09-12T17:31:00.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.074+0000 7f591fd2b640 1 -- start start 2024-09-12T17:31:00.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.074+0000 7f591fd2b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f591806fe70 0x7f591811ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:31:00.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.074+0000 7f591fd2b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5918075cc0 con 0x7f591806fe70 2024-09-12T17:31:00.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.074+0000 7f591dac7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f591806fe70 0x7f591811ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:31:00.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.074+0000 7f591dac7640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f591806fe70 0x7f591811ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42988/0 (socket says 172.21.15.47:42988) 2024-09-12T17:31:00.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.074+0000 7f591dac7640 1 -- 172.21.15.47:0/1818150968 learned_addr learned my addr 172.21.15.47:0/1818150968 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:31:00.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.074+0000 7f591dac7640 1 -- 172.21.15.47:0/1818150968 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f591811c380 con 0x7f591806fe70 2024-09-12T17:31:00.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.074+0000 7f591dac7640 1 --2- 172.21.15.47:0/1818150968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f591806fe70 0x7f591811ac50 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f591400c480 tx=0x7f591400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:31:00.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.075+0000 7f590e7fc640 1 -- 172.21.15.47:0/1818150968 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5914017070 con 0x7f591806fe70 2024-09-12T17:31:00.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.075+0000 7f590e7fc640 1 -- 172.21.15.47:0/1818150968 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5914005c10 con 0x7f591806fe70 2024-09-12T17:31:00.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.075+0000 7f591fd2b640 1 -- 172.21.15.47:0/1818150968 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f591811d060 con 0x7f591806fe70 2024-09-12T17:31:00.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.075+0000 7f590e7fc640 1 -- 172.21.15.47:0/1818150968 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5914007070 con 0x7f591806fe70 2024-09-12T17:31:00.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.075+0000 7f591fd2b640 1 -- 172.21.15.47:0/1818150968 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f591811dc20 con 0x7f591806fe70 2024-09-12T17:31:00.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.076+0000 7f590e7fc640 1 -- 172.21.15.47:0/1818150968 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f591401a070 con 0x7f591806fe70 2024-09-12T17:31:00.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.076+0000 7f591fd2b640 1 -- 172.21.15.47:0/1818150968 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5918134c40 con 0x7f591806fe70 2024-09-12T17:31:00.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.076+0000 7f590e7fc640 1 --2- 172.21.15.47:0/1818150968 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f58fc03dec0 0x7f58fc040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:31:00.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.076+0000 7f590e7fc640 1 -- 172.21.15.47:0/1818150968 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f5914051e20 con 0x7f591806fe70 2024-09-12T17:31:00.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.076+0000 7f591d2c6640 1 --2- 172.21.15.47:0/1818150968 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f58fc03dec0 0x7f58fc040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:31:00.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.077+0000 7f591d2c6640 1 --2- 172.21.15.47:0/1818150968 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f58fc03dec0 0x7f58fc040380 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5908034000 tx=0x7f590802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:31:00.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.080+0000 7f590e7fc640 1 -- 172.21.15.47:0/1818150968 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f591401b3b0 con 0x7f591806fe70 2024-09-12T17:31:00.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.265+0000 7f591fd2b640 1 -- 172.21.15.47:0/1818150968 --> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f591811deb0 con 0x7f58fc03dec0 2024-09-12T17:31:00.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.266+0000 7f590e7fc640 1 -- 172.21.15.47:0/1818150968 <== mgr.4102 v2:172.21.15.170:6824/4146902489 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f591811deb0 con 0x7f58fc03dec0 2024-09-12T17:31:00.267 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T17:31:00.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.268+0000 7f591fd2b640 1 -- 172.21.15.47:0/1818150968 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f58fc03dec0 msgr2=0x7f58fc040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:31:00.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.268+0000 7f591fd2b640 1 --2- 172.21.15.47:0/1818150968 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f58fc03dec0 0x7f58fc040380 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5908034000 tx=0x7f590802e000 comp rx=0 tx=0).stop 2024-09-12T17:31:00.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.269+0000 7f591fd2b640 1 -- 172.21.15.47:0/1818150968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f591806fe70 msgr2=0x7f591811ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:31:00.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.269+0000 7f591fd2b640 1 --2- 172.21.15.47:0/1818150968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f591806fe70 0x7f591811ac50 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f591400c480 tx=0x7f591400c940 comp rx=0 tx=0).stop 2024-09-12T17:31:00.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.269+0000 7f591fd2b640 1 -- 172.21.15.47:0/1818150968 shutdown_connections 2024-09-12T17:31:00.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.269+0000 7f591fd2b640 1 --2- 172.21.15.47:0/1818150968 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f58fc03dec0 0x7f58fc040380 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:31:00.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.269+0000 7f591fd2b640 1 --2- 172.21.15.47:0/1818150968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f591806fe70 0x7f591811ac50 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:31:00.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.269+0000 7f591fd2b640 1 -- 172.21.15.47:0/1818150968 >> 172.21.15.47:0/1818150968 conn(0x7f59180a0a50 msgr2=0x7f591812bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:31:00.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.269+0000 7f591fd2b640 1 -- 172.21.15.47:0/1818150968 shutdown_connections 2024-09-12T17:31:00.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.269+0000 7f591fd2b640 1 -- 172.21.15.47:0/1818150968 wait complete. 2024-09-12T17:31:00.280 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T17:31:00.281 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T17:31:00.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.385+0000 7f753cbe2640 1 Processor -- start 2024-09-12T17:31:00.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.385+0000 7f753cbe2640 1 -- start start 2024-09-12T17:31:00.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.385+0000 7f753cbe2640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f75381141c0 0x7f7538132330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:31:00.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.385+0000 7f753cbe2640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f753812de60 con 0x7f753812d370 2024-09-12T17:31:00.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.385+0000 7f753cbe2640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f753812cfb0 con 0x7f75381141c0 2024-09-12T17:31:00.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.386+0000 7f7535d9b640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f75381141c0 0x7f7538132330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:31:00.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.386+0000 7f753659c640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f753812d370 0x7f753812d750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:58646/0 (socket says 172.21.15.47:58646) 2024-09-12T17:31:00.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.386+0000 7f753659c640 1 -- 172.21.15.47:0/1246018361 learned_addr learned my addr 172.21.15.47:0/1246018361 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-09-12T17:31:00.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.386+0000 7f7535d9b640 1 -- 172.21.15.47:0/1246018361 >> v1:172.21.15.47:6789/0 conn(0x7f753812d370 legacy=0x7f753812d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:31:00.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.386+0000 7f7535d9b640 1 -- 172.21.15.47:0/1246018361 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75380733d0 con 0x7f75381141c0 2024-09-12T17:31:00.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.387+0000 7f7535d9b640 1 --2- 172.21.15.47:0/1246018361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75381141c0 0x7f7538132330 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f752c009720 tx=0x7f752c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53b5bb3fb15b3cf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:31:00.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.387+0000 7f753559a640 1 -- 172.21.15.47:0/1246018361 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f752c037070 con 0x7f75381141c0 2024-09-12T17:31:00.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.387+0000 7f753559a640 1 -- 172.21.15.47:0/1246018361 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f752c02ad90 con 0x7f75381141c0 2024-09-12T17:31:00.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.387+0000 7f753559a640 1 -- 172.21.15.47:0/1246018361 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f752c032590 con 0x7f75381141c0 2024-09-12T17:31:00.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.387+0000 7f753cbe2640 1 -- 172.21.15.47:0/1246018361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75381141c0 msgr2=0x7f7538132330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:31:00.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.387+0000 7f753cbe2640 1 --2- 172.21.15.47:0/1246018361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75381141c0 0x7f7538132330 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f752c009720 tx=0x7f752c02a110 comp rx=0 tx=0).stop 2024-09-12T17:31:00.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.387+0000 7f753cbe2640 1 -- 172.21.15.47:0/1246018361 shutdown_connections 2024-09-12T17:31:00.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.387+0000 7f753cbe2640 1 --2- 172.21.15.47:0/1246018361 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75381141c0 0x7f7538132330 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:31:00.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.387+0000 7f753cbe2640 1 -- 172.21.15.47:0/1246018361 >> 172.21.15.47:0/1246018361 conn(0x7f7538070210 msgr2=0x7f7538072630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:31:00.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.387+0000 7f753cbe2640 1 -- 172.21.15.47:0/1246018361 shutdown_connections 2024-09-12T17:31:00.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.387+0000 7f753cbe2640 1 -- 172.21.15.47:0/1246018361 wait complete. 2024-09-12T17:31:00.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.388+0000 7f753cbe2640 1 Processor -- start 2024-09-12T17:31:00.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.388+0000 7f753cbe2640 1 -- start start 2024-09-12T17:31:00.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.389+0000 7f753cbe2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75381141c0 0x7f75381c1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:31:00.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.389+0000 7f753cbe2640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7538132870 con 0x7f75381141c0 2024-09-12T17:31:00.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.389+0000 7f753659c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75381141c0 0x7f75381c1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:31:00.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.389+0000 7f753659c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75381141c0 0x7f75381c1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43010/0 (socket says 172.21.15.47:43010) 2024-09-12T17:31:00.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.389+0000 7f753659c640 1 -- 172.21.15.47:0/2794870592 learned_addr learned my addr 172.21.15.47:0/2794870592 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:31:00.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.389+0000 7f753659c640 1 -- 172.21.15.47:0/2794870592 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7538131a50 con 0x7f75381141c0 2024-09-12T17:31:00.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.389+0000 7f753659c640 1 --2- 172.21.15.47:0/2794870592 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75381141c0 0x7f75381c1c00 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f752800c480 tx=0x7f752800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:31:00.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.389+0000 7f7526ffd640 1 -- 172.21.15.47:0/2794870592 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7528017070 con 0x7f75381141c0 2024-09-12T17:31:00.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.389+0000 7f7526ffd640 1 -- 172.21.15.47:0/2794870592 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7528005c10 con 0x7f75381141c0 2024-09-12T17:31:00.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.389+0000 7f753cbe2640 1 -- 172.21.15.47:0/2794870592 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7538116260 con 0x7f75381141c0 2024-09-12T17:31:00.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.389+0000 7f7526ffd640 1 -- 172.21.15.47:0/2794870592 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7528007070 con 0x7f75381141c0 2024-09-12T17:31:00.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.389+0000 7f753cbe2640 1 -- 172.21.15.47:0/2794870592 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75381157a0 con 0x7f75381141c0 2024-09-12T17:31:00.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.390+0000 7f753cbe2640 1 -- 172.21.15.47:0/2794870592 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7538115a20 con 0x7f75381141c0 2024-09-12T17:31:00.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.390+0000 7f7526ffd640 1 -- 172.21.15.47:0/2794870592 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f752801a070 con 0x7f75381141c0 2024-09-12T17:31:00.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.391+0000 7f7526ffd640 1 --2- 172.21.15.47:0/2794870592 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f751803dec0 0x7f7518040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:31:00.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.391+0000 7f7526ffd640 1 -- 172.21.15.47:0/2794870592 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f7528051e30 con 0x7f75381141c0 2024-09-12T17:31:00.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.391+0000 7f7526ffd640 1 --2- 172.21.15.47:0/2794870592 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x7f7518049cc0 0x7f751804c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:31:00.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.391+0000 7f7526ffd640 1 -- 172.21.15.47:0/2794870592 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7528014ec0 con 0x7f7518049cc0 2024-09-12T17:31:00.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.391+0000 7f7526ffd640 1 -- 172.21.15.47:0/2794870592 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f75280544e0 con 0x7f75381141c0 2024-09-12T17:31:00.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.391+0000 7f7535d9b640 1 --2- 172.21.15.47:0/2794870592 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f751803dec0 0x7f7518040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:31:00.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.391+0000 7f7536d9d640 1 --2- 172.21.15.47:0/2794870592 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x7f7518049cc0 0x7f751804c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:31:00.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.391+0000 7f7535d9b640 1 --2- 172.21.15.47:0/2794870592 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f751803dec0 0x7f7518040380 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f752c009720 tx=0x7f752c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:31:00.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.391+0000 7f7536d9d640 1 --2- 172.21.15.47:0/2794870592 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x7f7518049cc0 0x7f751804c160 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:31:00.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.392+0000 7f7526ffd640 1 -- 172.21.15.47:0/2794870592 <== osd.2 v2:172.21.15.170:6808/3855567754 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7528014ec0 con 0x7f7518049cc0 2024-09-12T17:31:00.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.405+0000 7f753cbe2640 1 -- 172.21.15.47:0/2794870592 --> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f753812d5c0 con 0x7f7518049cc0 2024-09-12T17:31:00.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.405+0000 7f7526ffd640 1 -- 172.21.15.47:0/2794870592 <== osd.2 v2:172.21.15.170:6808/3855567754 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f753812d5c0 con 0x7f7518049cc0 2024-09-12T17:31:00.407 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:31:00.407 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T17:31:00.407 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:31:00.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.406+0000 7f753cbe2640 1 -- 172.21.15.47:0/2794870592 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x7f7518049cc0 msgr2=0x7f751804c160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:31:00.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.406+0000 7f753cbe2640 1 --2- 172.21.15.47:0/2794870592 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x7f7518049cc0 0x7f751804c160 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:31:00.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.406+0000 7f753cbe2640 1 -- 172.21.15.47:0/2794870592 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f751803dec0 msgr2=0x7f7518040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:31:00.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.406+0000 7f753cbe2640 1 --2- 172.21.15.47:0/2794870592 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f751803dec0 0x7f7518040380 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f752c009720 tx=0x7f752c02e000 comp rx=0 tx=0).stop 2024-09-12T17:31:00.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.406+0000 7f753cbe2640 1 -- 172.21.15.47:0/2794870592 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75381141c0 msgr2=0x7f75381c1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:31:00.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.406+0000 7f753cbe2640 1 --2- 172.21.15.47:0/2794870592 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75381141c0 0x7f75381c1c00 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f752800c480 tx=0x7f752800c940 comp rx=0 tx=0).stop 2024-09-12T17:31:00.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.406+0000 7f753cbe2640 1 -- 172.21.15.47:0/2794870592 shutdown_connections 2024-09-12T17:31:00.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.406+0000 7f753cbe2640 1 --2- 172.21.15.47:0/2794870592 >> [v2:172.21.15.170:6808/3855567754,v1:172.21.15.170:6809/3855567754] conn(0x7f7518049cc0 0x7f751804c160 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:31:00.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.406+0000 7f753cbe2640 1 --2- 172.21.15.47:0/2794870592 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f751803dec0 0x7f7518040380 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:31:00.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.406+0000 7f753cbe2640 1 --2- 172.21.15.47:0/2794870592 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75381141c0 0x7f75381c1c00 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:31:00.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.406+0000 7f753cbe2640 1 -- 172.21.15.47:0/2794870592 >> 172.21.15.47:0/2794870592 conn(0x7f7538070210 msgr2=0x7f7538126380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:31:00.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.406+0000 7f753cbe2640 1 -- 172.21.15.47:0/2794870592 shutdown_connections 2024-09-12T17:31:00.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.406+0000 7f753cbe2640 1 -- 172.21.15.47:0/2794870592 wait complete. 2024-09-12T17:31:00.418 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T17:31:00.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.521+0000 7f317e1f8640 1 Processor -- start 2024-09-12T17:31:00.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.521+0000 7f317e1f8640 1 -- start start 2024-09-12T17:31:00.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.521+0000 7f317e1f8640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f317809ecd0 0x7f31781314d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:31:00.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.521+0000 7f317e1f8640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3178073050 con 0x7f3178071d10 2024-09-12T17:31:00.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.521+0000 7f317e1f8640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f3178073600 con 0x7f317809ecd0 2024-09-12T17:31:00.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.521+0000 7f3176ffd640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f317809ecd0 0x7f31781314d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:31:00.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.521+0000 7f31777fe640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f3178071d10 0x7f31780720f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:58650/0 (socket says 172.21.15.47:58650) 2024-09-12T17:31:00.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.521+0000 7f31777fe640 1 -- 172.21.15.47:0/2263535803 learned_addr learned my addr 172.21.15.47:0/2263535803 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-09-12T17:31:00.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.521+0000 7f3176ffd640 1 -- 172.21.15.47:0/2263535803 >> v1:172.21.15.47:6789/0 conn(0x7f3178071d10 legacy=0x7f31780720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:31:00.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.521+0000 7f3176ffd640 1 -- 172.21.15.47:0/2263535803 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31780732f0 con 0x7f317809ecd0 2024-09-12T17:31:00.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.522+0000 7f3176ffd640 1 --2- 172.21.15.47:0/2263535803 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f317809ecd0 0x7f31781314d0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f316c009720 tx=0x7f316c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e5c096e9f6f4a5a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:31:00.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.522+0000 7f31767fc640 1 -- 172.21.15.47:0/2263535803 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f316c037070 con 0x7f317809ecd0 2024-09-12T17:31:00.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.522+0000 7f31767fc640 1 -- 172.21.15.47:0/2263535803 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f316c02ad90 con 0x7f317809ecd0 2024-09-12T17:31:00.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.522+0000 7f31767fc640 1 -- 172.21.15.47:0/2263535803 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f316c032590 con 0x7f317809ecd0 2024-09-12T17:31:00.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.523+0000 7f317e1f8640 1 -- 172.21.15.47:0/2263535803 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f317809ecd0 msgr2=0x7f31781314d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:31:00.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.523+0000 7f317e1f8640 1 --2- 172.21.15.47:0/2263535803 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f317809ecd0 0x7f31781314d0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f316c009720 tx=0x7f316c02a110 comp rx=0 tx=0).stop 2024-09-12T17:31:00.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.523+0000 7f317e1f8640 1 -- 172.21.15.47:0/2263535803 shutdown_connections 2024-09-12T17:31:00.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.523+0000 7f317e1f8640 1 --2- 172.21.15.47:0/2263535803 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f317809ecd0 0x7f31781314d0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:31:00.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.523+0000 7f317e1f8640 1 -- 172.21.15.47:0/2263535803 >> 172.21.15.47:0/2263535803 conn(0x7f317809c640 msgr2=0x7f317806ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:31:00.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.523+0000 7f317e1f8640 1 -- 172.21.15.47:0/2263535803 shutdown_connections 2024-09-12T17:31:00.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.523+0000 7f317e1f8640 1 -- 172.21.15.47:0/2263535803 wait complete. 2024-09-12T17:31:00.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.524+0000 7f317e1f8640 1 Processor -- start 2024-09-12T17:31:00.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.524+0000 7f317e1f8640 1 -- start start 2024-09-12T17:31:00.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.524+0000 7f317e1f8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3178071d10 0x7f31781c0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:31:00.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.524+0000 7f317e1f8640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3178072980 con 0x7f3178071d10 2024-09-12T17:31:00.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.524+0000 7f31777fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3178071d10 0x7f31781c0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:31:00.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.524+0000 7f31777fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3178071d10 0x7f31781c0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43028/0 (socket says 172.21.15.47:43028) 2024-09-12T17:31:00.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.525+0000 7f31777fe640 1 -- 172.21.15.47:0/1035756328 learned_addr learned my addr 172.21.15.47:0/1035756328 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:31:00.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.525+0000 7f31777fe640 1 -- 172.21.15.47:0/1035756328 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3178070e70 con 0x7f3178071d10 2024-09-12T17:31:00.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.525+0000 7f31777fe640 1 --2- 172.21.15.47:0/1035756328 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3178071d10 0x7f31781c0980 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f316800c480 tx=0x7f316800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:31:00.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.525+0000 7f315ffff640 1 -- 172.21.15.47:0/1035756328 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3168017070 con 0x7f3178071d10 2024-09-12T17:31:00.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.525+0000 7f315ffff640 1 -- 172.21.15.47:0/1035756328 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3168005c10 con 0x7f3178071d10 2024-09-12T17:31:00.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.525+0000 7f315ffff640 1 -- 172.21.15.47:0/1035756328 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3168007070 con 0x7f3178071d10 2024-09-12T17:31:00.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.525+0000 7f317e1f8640 1 -- 172.21.15.47:0/1035756328 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3178116840 con 0x7f3178071d10 2024-09-12T17:31:00.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.525+0000 7f317e1f8640 1 -- 172.21.15.47:0/1035756328 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f317811bd20 con 0x7f3178071d10 2024-09-12T17:31:00.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.526+0000 7f315ffff640 1 -- 172.21.15.47:0/1035756328 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f316801a070 con 0x7f3178071d10 2024-09-12T17:31:00.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.526+0000 7f317e1f8640 1 -- 172.21.15.47:0/1035756328 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3178116c60 con 0x7f3178071d10 2024-09-12T17:31:00.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.526+0000 7f315ffff640 1 --2- 172.21.15.47:0/1035756328 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f316403de90 0x7f3164040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:31:00.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.526+0000 7f315ffff640 1 -- 172.21.15.47:0/1035756328 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f3168051e30 con 0x7f3178071d10 2024-09-12T17:31:00.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.527+0000 7f3176ffd640 1 --2- 172.21.15.47:0/1035756328 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f316403de90 0x7f3164040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:31:00.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.527+0000 7f3176ffd640 1 --2- 172.21.15.47:0/1035756328 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f316403de90 0x7f3164040350 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f316c034000 tx=0x7f316c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:31:00.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.531+0000 7f315ffff640 1 -- 172.21.15.47:0/1035756328 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f3178073050 con 0x7f3178071d10 2024-09-12T17:31:00.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.714+0000 7f317e1f8640 1 -- 172.21.15.47:0/1035756328 --> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f31780720f0 con 0x7f316403de90 2024-09-12T17:31:00.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.715+0000 7f315ffff640 1 -- 172.21.15.47:0/1035756328 <== mgr.4102 v2:172.21.15.170:6824/4146902489 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f31780720f0 con 0x7f316403de90 2024-09-12T17:31:00.717 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T17:31:00.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.718+0000 7f317e1f8640 1 -- 172.21.15.47:0/1035756328 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f316403de90 msgr2=0x7f3164040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:31:00.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.718+0000 7f317e1f8640 1 --2- 172.21.15.47:0/1035756328 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f316403de90 0x7f3164040350 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f316c034000 tx=0x7f316c02e000 comp rx=0 tx=0).stop 2024-09-12T17:31:00.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.718+0000 7f317e1f8640 1 -- 172.21.15.47:0/1035756328 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3178071d10 msgr2=0x7f31781c0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:31:00.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.718+0000 7f317e1f8640 1 --2- 172.21.15.47:0/1035756328 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3178071d10 0x7f31781c0980 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f316800c480 tx=0x7f316800c940 comp rx=0 tx=0).stop 2024-09-12T17:31:00.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.718+0000 7f317e1f8640 1 -- 172.21.15.47:0/1035756328 shutdown_connections 2024-09-12T17:31:00.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.718+0000 7f317e1f8640 1 --2- 172.21.15.47:0/1035756328 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f316403de90 0x7f3164040350 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:31:00.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.718+0000 7f317e1f8640 1 --2- 172.21.15.47:0/1035756328 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3178071d10 0x7f31781c0980 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:31:00.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.718+0000 7f317e1f8640 1 -- 172.21.15.47:0/1035756328 >> 172.21.15.47:0/1035756328 conn(0x7f317809c640 msgr2=0x7f3178128930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:31:00.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.718+0000 7f317e1f8640 1 -- 172.21.15.47:0/1035756328 shutdown_connections 2024-09-12T17:31:00.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.718+0000 7f317e1f8640 1 -- 172.21.15.47:0/1035756328 wait complete. 2024-09-12T17:31:00.730 INFO:tasks.ceph:Scrubbing osd.3 2024-09-12T17:31:00.731 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-12T17:31:00.825 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-09-12T17:31:00.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.836+0000 7fd3a3194640 1 Processor -- start 2024-09-12T17:31:00.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.836+0000 7fd3a3194640 1 -- start start 2024-09-12T17:31:00.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.837+0000 7fd3a3194640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd39c1325e0 0x7fd39c1349d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:31:00.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.837+0000 7fd3a3194640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd39c116d50 con 0x7fd39c12bed0 2024-09-12T17:31:00.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.837+0000 7fd3a3194640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fd39c1170f0 con 0x7fd39c1325e0 2024-09-12T17:31:00.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.837+0000 7fd39bfff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd39c1325e0 0x7fd39c1349d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:31:00.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.837+0000 7fd3a0f30640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fd39c12bed0 0x7fd39c12c2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:58662/0 (socket says 172.21.15.47:58662) 2024-09-12T17:31:00.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.837+0000 7fd3a0f30640 1 -- 172.21.15.47:0/1942940279 learned_addr learned my addr 172.21.15.47:0/1942940279 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-09-12T17:31:00.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.837+0000 7fd39bfff640 1 -- 172.21.15.47:0/1942940279 >> v1:172.21.15.47:6789/0 conn(0x7fd39c12bed0 legacy=0x7fd39c12c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:31:00.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.837+0000 7fd39b7fe640 1 -- 172.21.15.47:0/1942940279 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1434547155 0 0) 0x7fd39c116d50 con 0x7fd39c12bed0 2024-09-12T17:31:00.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.837+0000 7fd39bfff640 1 -- 172.21.15.47:0/1942940279 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd39c115df0 con 0x7fd39c1325e0 2024-09-12T17:31:00.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.838+0000 7fd39bfff640 1 --2- 172.21.15.47:0/1942940279 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd39c1325e0 0x7fd39c1349d0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fd390009720 tx=0x7fd39002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b5b5099a2c9240 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:31:00.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.838+0000 7fd39b7fe640 1 -- 172.21.15.47:0/1942940279 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd390037070 con 0x7fd39c1325e0 2024-09-12T17:31:00.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.838+0000 7fd39b7fe640 1 -- 172.21.15.47:0/1942940279 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd39002ad90 con 0x7fd39c1325e0 2024-09-12T17:31:00.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.838+0000 7fd39b7fe640 1 -- 172.21.15.47:0/1942940279 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd390032590 con 0x7fd39c1325e0 2024-09-12T17:31:00.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.839+0000 7fd3a3194640 1 -- 172.21.15.47:0/1942940279 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd39c1325e0 msgr2=0x7fd39c1349d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:31:00.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.839+0000 7fd3a3194640 1 --2- 172.21.15.47:0/1942940279 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd39c1325e0 0x7fd39c1349d0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fd390009720 tx=0x7fd39002a110 comp rx=0 tx=0).stop 2024-09-12T17:31:00.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.839+0000 7fd3a3194640 1 -- 172.21.15.47:0/1942940279 shutdown_connections 2024-09-12T17:31:00.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.839+0000 7fd3a3194640 1 --2- 172.21.15.47:0/1942940279 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd39c1325e0 0x7fd39c1349d0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:31:00.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.839+0000 7fd3a3194640 1 -- 172.21.15.47:0/1942940279 >> 172.21.15.47:0/1942940279 conn(0x7fd39c06fb60 msgr2=0x7fd39c071f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:31:00.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.839+0000 7fd3a3194640 1 -- 172.21.15.47:0/1942940279 shutdown_connections 2024-09-12T17:31:00.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.839+0000 7fd3a3194640 1 -- 172.21.15.47:0/1942940279 wait complete. 2024-09-12T17:31:00.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.840+0000 7fd3a3194640 1 Processor -- start 2024-09-12T17:31:00.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.840+0000 7fd3a3194640 1 -- start start 2024-09-12T17:31:00.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.840+0000 7fd3a3194640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd39c12bed0 0x7fd39c1252b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:31:00.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.840+0000 7fd3a3194640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd39c1166c0 con 0x7fd39c12bed0 2024-09-12T17:31:00.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.840+0000 7fd3a0f30640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd39c12bed0 0x7fd39c1252b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:31:00.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.840+0000 7fd3a0f30640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd39c12bed0 0x7fd39c1252b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43048/0 (socket says 172.21.15.47:43048) 2024-09-12T17:31:00.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.840+0000 7fd3a0f30640 1 -- 172.21.15.47:0/2545676345 learned_addr learned my addr 172.21.15.47:0/2545676345 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:31:00.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.841+0000 7fd3a0f30640 1 -- 172.21.15.47:0/2545676345 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd39c117b70 con 0x7fd39c12bed0 2024-09-12T17:31:00.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.841+0000 7fd3a0f30640 1 --2- 172.21.15.47:0/2545676345 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd39c12bed0 0x7fd39c1252b0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fd38c00c320 tx=0x7fd38c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:31:00.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.841+0000 7fd3997fa640 1 -- 172.21.15.47:0/2545676345 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd38c007410 con 0x7fd39c12bed0 2024-09-12T17:31:00.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.841+0000 7fd3997fa640 1 -- 172.21.15.47:0/2545676345 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd38c0075d0 con 0x7fd39c12bed0 2024-09-12T17:31:00.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.841+0000 7fd3a3194640 1 -- 172.21.15.47:0/2545676345 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd39c117e00 con 0x7fd39c12bed0 2024-09-12T17:31:00.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.841+0000 7fd3997fa640 1 -- 172.21.15.47:0/2545676345 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd38c004950 con 0x7fd39c12bed0 2024-09-12T17:31:00.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.841+0000 7fd3a3194640 1 -- 172.21.15.47:0/2545676345 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd39c1259d0 con 0x7fd39c12bed0 2024-09-12T17:31:00.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.842+0000 7fd3a3194640 1 -- 172.21.15.47:0/2545676345 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd39c117660 con 0x7fd39c12bed0 2024-09-12T17:31:00.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.842+0000 7fd3997fa640 1 -- 172.21.15.47:0/2545676345 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fd38c011070 con 0x7fd39c12bed0 2024-09-12T17:31:00.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.842+0000 7fd3997fa640 1 --2- 172.21.15.47:0/2545676345 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd38803de90 0x7fd388040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:31:00.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.842+0000 7fd3997fa640 1 -- 172.21.15.47:0/2545676345 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fd38c0526a0 con 0x7fd39c12bed0 2024-09-12T17:31:00.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.842+0000 7fd3997fa640 1 --2- 172.21.15.47:0/2545676345 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x7fd388049cf0 0x7fd38804c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:31:00.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.842+0000 7fd3997fa640 1 -- 172.21.15.47:0/2545676345 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd38c00fe50 con 0x7fd388049cf0 2024-09-12T17:31:00.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.842+0000 7fd3997fa640 1 -- 172.21.15.47:0/2545676345 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fd38c059050 con 0x7fd39c12bed0 2024-09-12T17:31:00.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.842+0000 7fd39bfff640 1 --2- 172.21.15.47:0/2545676345 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd38803de90 0x7fd388040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:31:00.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.843+0000 7fd3a1731640 1 --2- 172.21.15.47:0/2545676345 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x7fd388049cf0 0x7fd38804c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:31:00.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.843+0000 7fd39bfff640 1 --2- 172.21.15.47:0/2545676345 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd38803de90 0x7fd388040350 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd390034000 tx=0x7fd39002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:31:00.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.843+0000 7fd3a1731640 1 --2- 172.21.15.47:0/2545676345 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x7fd388049cf0 0x7fd38804c190 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:31:00.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.844+0000 7fd3997fa640 1 -- 172.21.15.47:0/2545676345 <== osd.3 v2:172.21.15.170:6816/2664906588 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd38c00fe50 con 0x7fd388049cf0 2024-09-12T17:31:00.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.856+0000 7fd3a3194640 1 -- 172.21.15.47:0/2545676345 --> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd39c12c2b0 con 0x7fd388049cf0 2024-09-12T17:31:00.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.857+0000 7fd3997fa640 1 -- 172.21.15.47:0/2545676345 <== osd.3 v2:172.21.15.170:6816/2664906588 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd39c12c2b0 con 0x7fd388049cf0 2024-09-12T17:31:00.875 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:31:00.875 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T17:31:00.876 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:31:00.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.857+0000 7fd3a3194640 1 -- 172.21.15.47:0/2545676345 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x7fd388049cf0 msgr2=0x7fd38804c190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:31:00.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.857+0000 7fd3a3194640 1 --2- 172.21.15.47:0/2545676345 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x7fd388049cf0 0x7fd38804c190 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:31:00.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.857+0000 7fd3a3194640 1 -- 172.21.15.47:0/2545676345 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd38803de90 msgr2=0x7fd388040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:31:00.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.857+0000 7fd3a3194640 1 --2- 172.21.15.47:0/2545676345 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd38803de90 0x7fd388040350 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd390034000 tx=0x7fd39002e000 comp rx=0 tx=0).stop 2024-09-12T17:31:00.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.857+0000 7fd3a3194640 1 -- 172.21.15.47:0/2545676345 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd39c12bed0 msgr2=0x7fd39c1252b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:31:00.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.857+0000 7fd3a3194640 1 --2- 172.21.15.47:0/2545676345 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd39c12bed0 0x7fd39c1252b0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fd38c00c320 tx=0x7fd38c00c7e0 comp rx=0 tx=0).stop 2024-09-12T17:31:00.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.858+0000 7fd3a3194640 1 -- 172.21.15.47:0/2545676345 shutdown_connections 2024-09-12T17:31:00.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.858+0000 7fd3a3194640 1 --2- 172.21.15.47:0/2545676345 >> [v2:172.21.15.170:6816/2664906588,v1:172.21.15.170:6817/2664906588] conn(0x7fd388049cf0 0x7fd38804c190 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:31:00.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.858+0000 7fd3a3194640 1 --2- 172.21.15.47:0/2545676345 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fd38803de90 0x7fd388040350 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:31:00.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.858+0000 7fd3a3194640 1 --2- 172.21.15.47:0/2545676345 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd39c12bed0 0x7fd39c1252b0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:31:00.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.858+0000 7fd3a3194640 1 -- 172.21.15.47:0/2545676345 >> 172.21.15.47:0/2545676345 conn(0x7fd39c06fb60 msgr2=0x7fd39c126630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:31:00.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.858+0000 7fd3a3194640 1 -- 172.21.15.47:0/2545676345 shutdown_connections 2024-09-12T17:31:00.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.858+0000 7fd3a3194640 1 -- 172.21.15.47:0/2545676345 wait complete. 2024-09-12T17:31:00.879 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-12T17:31:00.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.981+0000 7f225da3c640 1 Processor -- start 2024-09-12T17:31:00.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.981+0000 7f225da3c640 1 -- start start 2024-09-12T17:31:00.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.982+0000 7f225da3c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2258071ec0 0x7f2258130c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:31:00.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.982+0000 7f225da3c640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f225806de00 con 0x7f2258070c00 2024-09-12T17:31:00.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.982+0000 7f225da3c640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f2258069380 con 0x7f2258071ec0 2024-09-12T17:31:00.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.982+0000 7f22567fc640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2258071ec0 0x7f2258130c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:31:00.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.982+0000 7f2256ffd640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f2258070c00 0x7f2258070fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:58664/0 (socket says 172.21.15.47:58664) 2024-09-12T17:31:00.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.982+0000 7f2256ffd640 1 -- 172.21.15.47:0/316947559 learned_addr learned my addr 172.21.15.47:0/316947559 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-09-12T17:31:00.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.982+0000 7f22567fc640 1 -- 172.21.15.47:0/316947559 >> v1:172.21.15.47:6789/0 conn(0x7f2258070c00 legacy=0x7f2258070fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:31:00.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.982+0000 7f22567fc640 1 -- 172.21.15.47:0/316947559 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f225809ecd0 con 0x7f2258071ec0 2024-09-12T17:31:00.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.983+0000 7f22567fc640 1 --2- 172.21.15.47:0/316947559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2258071ec0 0x7f2258130c80 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f224c009720 tx=0x7f224c02b220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b70a1a761478d10d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:31:00.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.983+0000 7f2255ffb640 1 -- 172.21.15.47:0/316947559 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f224c038070 con 0x7f2258071ec0 2024-09-12T17:31:00.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.983+0000 7f2255ffb640 1 -- 172.21.15.47:0/316947559 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f224c033440 con 0x7f2258071ec0 2024-09-12T17:31:00.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.983+0000 7f2255ffb640 1 -- 172.21.15.47:0/316947559 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f224c033740 con 0x7f2258071ec0 2024-09-12T17:31:00.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.984+0000 7f225da3c640 1 -- 172.21.15.47:0/316947559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2258071ec0 msgr2=0x7f2258130c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:31:00.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.984+0000 7f225da3c640 1 --2- 172.21.15.47:0/316947559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2258071ec0 0x7f2258130c80 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f224c009720 tx=0x7f224c02b220 comp rx=0 tx=0).stop 2024-09-12T17:31:00.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.984+0000 7f225da3c640 1 -- 172.21.15.47:0/316947559 shutdown_connections 2024-09-12T17:31:00.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.984+0000 7f225da3c640 1 --2- 172.21.15.47:0/316947559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2258071ec0 0x7f2258130c80 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:31:00.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.984+0000 7f225da3c640 1 -- 172.21.15.47:0/316947559 >> 172.21.15.47:0/316947559 conn(0x7f225809c640 msgr2=0x7f225806ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:31:00.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.984+0000 7f225da3c640 1 -- 172.21.15.47:0/316947559 shutdown_connections 2024-09-12T17:31:00.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.984+0000 7f225da3c640 1 -- 172.21.15.47:0/316947559 wait complete. 2024-09-12T17:31:00.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.985+0000 7f225da3c640 1 Processor -- start 2024-09-12T17:31:00.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.985+0000 7f225da3c640 1 -- start start 2024-09-12T17:31:00.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.985+0000 7f225da3c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2258070c00 0x7f22581c0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:31:00.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.985+0000 7f225da3c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2258071900 con 0x7f2258070c00 2024-09-12T17:31:00.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.985+0000 7f2256ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2258070c00 0x7f22581c0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:31:00.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.985+0000 7f2256ffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2258070c00 0x7f22581c0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43060/0 (socket says 172.21.15.47:43060) 2024-09-12T17:31:00.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.985+0000 7f2256ffd640 1 -- 172.21.15.47:0/1367252168 learned_addr learned my addr 172.21.15.47:0/1367252168 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:31:00.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.986+0000 7f2256ffd640 1 -- 172.21.15.47:0/1367252168 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2258116020 con 0x7f2258070c00 2024-09-12T17:31:00.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.986+0000 7f2256ffd640 1 --2- 172.21.15.47:0/1367252168 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2258070c00 0x7f22581c0cd0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f224800c480 tx=0x7f224800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:31:00.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.986+0000 7f223ffff640 1 -- 172.21.15.47:0/1367252168 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2248017070 con 0x7f2258070c00 2024-09-12T17:31:00.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.986+0000 7f223ffff640 1 -- 172.21.15.47:0/1367252168 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2248005c10 con 0x7f2258070c00 2024-09-12T17:31:00.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.986+0000 7f225da3c640 1 -- 172.21.15.47:0/1367252168 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2258125ab0 con 0x7f2258070c00 2024-09-12T17:31:00.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.986+0000 7f223ffff640 1 -- 172.21.15.47:0/1367252168 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2248007070 con 0x7f2258070c00 2024-09-12T17:31:00.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.986+0000 7f225da3c640 1 -- 172.21.15.47:0/1367252168 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22581c1210 con 0x7f2258070c00 2024-09-12T17:31:00.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.987+0000 7f223ffff640 1 -- 172.21.15.47:0/1367252168 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f224801a070 con 0x7f2258070c00 2024-09-12T17:31:00.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.987+0000 7f223ffff640 1 --2- 172.21.15.47:0/1367252168 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f224403dec0 0x7f2244040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:31:00.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.987+0000 7f225da3c640 1 -- 172.21.15.47:0/1367252168 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2258126af0 con 0x7f2258070c00 2024-09-12T17:31:00.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.987+0000 7f223ffff640 1 -- 172.21.15.47:0/1367252168 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f2248051e30 con 0x7f2258070c00 2024-09-12T17:31:00.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.987+0000 7f22567fc640 1 --2- 172.21.15.47:0/1367252168 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f224403dec0 0x7f2244040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:31:00.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.988+0000 7f22567fc640 1 --2- 172.21.15.47:0/1367252168 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f224403dec0 0x7f2244040380 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f224c035000 tx=0x7f224c02f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:31:00.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:00.992+0000 7f223ffff640 1 -- 172.21.15.47:0/1367252168 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f2248055030 con 0x7f2258070c00 2024-09-12T17:31:01.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.174+0000 7f225da3c640 1 -- 172.21.15.47:0/1367252168 --> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f2258073380 con 0x7f224403dec0 2024-09-12T17:31:01.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.175+0000 7f223ffff640 1 -- 172.21.15.47:0/1367252168 <== mgr.4102 v2:172.21.15.170:6824/4146902489 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2258073380 con 0x7f224403dec0 2024-09-12T17:31:01.176 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 3 to deep-scrub 2024-09-12T17:31:01.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.177+0000 7f225da3c640 1 -- 172.21.15.47:0/1367252168 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f224403dec0 msgr2=0x7f2244040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:31:01.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.177+0000 7f225da3c640 1 --2- 172.21.15.47:0/1367252168 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f224403dec0 0x7f2244040380 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f224c035000 tx=0x7f224c02f000 comp rx=0 tx=0).stop 2024-09-12T17:31:01.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.177+0000 7f225da3c640 1 -- 172.21.15.47:0/1367252168 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2258070c00 msgr2=0x7f22581c0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:31:01.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.177+0000 7f225da3c640 1 --2- 172.21.15.47:0/1367252168 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2258070c00 0x7f22581c0cd0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f224800c480 tx=0x7f224800c940 comp rx=0 tx=0).stop 2024-09-12T17:31:01.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.177+0000 7f225da3c640 1 -- 172.21.15.47:0/1367252168 shutdown_connections 2024-09-12T17:31:01.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.177+0000 7f225da3c640 1 --2- 172.21.15.47:0/1367252168 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f224403dec0 0x7f2244040380 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:31:01.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.177+0000 7f225da3c640 1 --2- 172.21.15.47:0/1367252168 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2258070c00 0x7f22581c0cd0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:31:01.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.177+0000 7f225da3c640 1 -- 172.21.15.47:0/1367252168 >> 172.21.15.47:0/1367252168 conn(0x7f225809c640 msgr2=0x7f225811a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:31:01.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.177+0000 7f225da3c640 1 -- 172.21.15.47:0/1367252168 shutdown_connections 2024-09-12T17:31:01.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.177+0000 7f225da3c640 1 -- 172.21.15.47:0/1367252168 wait complete. 2024-09-12T17:31:01.189 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:31:01.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.289+0000 7f4eb132b640 1 Processor -- start 2024-09-12T17:31:01.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.289+0000 7f4eb132b640 1 -- start start 2024-09-12T17:31:01.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.290+0000 7f4eb132b640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4eac113220 0x7f4eac131380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:31:01.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.290+0000 7f4eb132b640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4eac06dc00 con 0x7f4eac112730 2024-09-12T17:31:01.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.290+0000 7f4eb132b640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f4eac113630 con 0x7f4eac113220 2024-09-12T17:31:01.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.290+0000 7f4eaa7fc640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4eac113220 0x7f4eac131380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:31:01.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.290+0000 7f4eaaffd640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f4eac112730 0x7f4eac112b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:58670/0 (socket says 172.21.15.47:58670) 2024-09-12T17:31:01.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.290+0000 7f4eaaffd640 1 -- 172.21.15.47:0/2983913247 learned_addr learned my addr 172.21.15.47:0/2983913247 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-09-12T17:31:01.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.290+0000 7f4eaa7fc640 1 -- 172.21.15.47:0/2983913247 >> v1:172.21.15.47:6789/0 conn(0x7f4eac112730 legacy=0x7f4eac112b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:31:01.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.290+0000 7f4eaa7fc640 1 -- 172.21.15.47:0/2983913247 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eac113c00 con 0x7f4eac113220 2024-09-12T17:31:01.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.291+0000 7f4eaa7fc640 1 --2- 172.21.15.47:0/2983913247 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4eac113220 0x7f4eac131380 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0009720 tx=0x7f4ea002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=712aa7e40a3ff03b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:31:01.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.291+0000 7f4ea9ffb640 1 -- 172.21.15.47:0/2983913247 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ea0037070 con 0x7f4eac113220 2024-09-12T17:31:01.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.291+0000 7f4ea9ffb640 1 -- 172.21.15.47:0/2983913247 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ea002ad90 con 0x7f4eac113220 2024-09-12T17:31:01.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.291+0000 7f4ea9ffb640 1 -- 172.21.15.47:0/2983913247 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ea0032590 con 0x7f4eac113220 2024-09-12T17:31:01.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.292+0000 7f4eb132b640 1 -- 172.21.15.47:0/2983913247 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4eac113220 msgr2=0x7f4eac131380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:31:01.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.292+0000 7f4eb132b640 1 --2- 172.21.15.47:0/2983913247 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4eac113220 0x7f4eac131380 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0009720 tx=0x7f4ea002a110 comp rx=0 tx=0).stop 2024-09-12T17:31:01.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.292+0000 7f4eb132b640 1 -- 172.21.15.47:0/2983913247 shutdown_connections 2024-09-12T17:31:01.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.292+0000 7f4eb132b640 1 --2- 172.21.15.47:0/2983913247 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4eac113220 0x7f4eac131380 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:31:01.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.292+0000 7f4eb132b640 1 -- 172.21.15.47:0/2983913247 >> 172.21.15.47:0/2983913247 conn(0x7f4eac070850 msgr2=0x7f4eac072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:31:01.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.292+0000 7f4eb132b640 1 -- 172.21.15.47:0/2983913247 shutdown_connections 2024-09-12T17:31:01.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.292+0000 7f4eb132b640 1 -- 172.21.15.47:0/2983913247 wait complete. 2024-09-12T17:31:01.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.293+0000 7f4eb132b640 1 Processor -- start 2024-09-12T17:31:01.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.293+0000 7f4eb132b640 1 -- start start 2024-09-12T17:31:01.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.293+0000 7f4eb132b640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4eac112730 0x7f4eac1215c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:31:01.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.293+0000 7f4eb132b640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4eac131a40 con 0x7f4eac112730 2024-09-12T17:31:01.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.293+0000 7f4eaaffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4eac112730 0x7f4eac1215c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:31:01.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.293+0000 7f4eaaffd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4eac112730 0x7f4eac1215c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43078/0 (socket says 172.21.15.47:43078) 2024-09-12T17:31:01.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.293+0000 7f4eaaffd640 1 -- 172.21.15.47:0/4059285519 learned_addr learned my addr 172.21.15.47:0/4059285519 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:31:01.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.294+0000 7f4eaaffd640 1 -- 172.21.15.47:0/4059285519 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eac12a0b0 con 0x7f4eac112730 2024-09-12T17:31:01.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.294+0000 7f4eaaffd640 1 --2- 172.21.15.47:0/4059285519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4eac112730 0x7f4eac1215c0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c00c380 tx=0x7f4e9c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:31:01.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.294+0000 7f4e937fe640 1 -- 172.21.15.47:0/4059285519 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e9c017070 con 0x7f4eac112730 2024-09-12T17:31:01.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.294+0000 7f4e937fe640 1 -- 172.21.15.47:0/4059285519 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e9c005c10 con 0x7f4eac112730 2024-09-12T17:31:01.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.294+0000 7f4eb132b640 1 -- 172.21.15.47:0/4059285519 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4eac12a720 con 0x7f4eac112730 2024-09-12T17:31:01.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.294+0000 7f4e937fe640 1 -- 172.21.15.47:0/4059285519 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e9c0070d0 con 0x7f4eac112730 2024-09-12T17:31:01.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.294+0000 7f4eb132b640 1 -- 172.21.15.47:0/4059285519 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4eac121ce0 con 0x7f4eac112730 2024-09-12T17:31:01.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.295+0000 7f4eb132b640 1 -- 172.21.15.47:0/4059285519 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4eac112b10 con 0x7f4eac112730 2024-09-12T17:31:01.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.295+0000 7f4e937fe640 1 -- 172.21.15.47:0/4059285519 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f4e9c01a070 con 0x7f4eac112730 2024-09-12T17:31:01.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.295+0000 7f4e937fe640 1 --2- 172.21.15.47:0/4059285519 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f4e9803de90 0x7f4e98040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:31:01.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.295+0000 7f4e937fe640 1 -- 172.21.15.47:0/4059285519 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f4e9c051e40 con 0x7f4eac112730 2024-09-12T17:31:01.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.295+0000 7f4eaa7fc640 1 --2- 172.21.15.47:0/4059285519 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f4e9803de90 0x7f4e98040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:31:01.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.296+0000 7f4eaa7fc640 1 --2- 172.21.15.47:0/4059285519 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f4e9803de90 0x7f4e98040350 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0034000 tx=0x7f4ea002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:31:01.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.300+0000 7f4e937fe640 1 -- 172.21.15.47:0/4059285519 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f4e9c012400 con 0x7f4eac112730 2024-09-12T17:31:01.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.480+0000 7f4eb132b640 1 -- 172.21.15.47:0/4059285519 --> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4eac126540 con 0x7f4e9803de90 2024-09-12T17:31:01.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.491+0000 7f4e937fe640 1 -- 172.21.15.47:0/4059285519 <== mgr.4102 v2:172.21.15.170:6824/4146902489 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665500 (secure 0 0 0) 0x7f4eac126540 con 0x7f4e9803de90 2024-09-12T17:31:01.504 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:31:01.509 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-09-12T17:31:01.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.496+0000 7f4eb132b640 1 -- 172.21.15.47:0/4059285519 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f4e9803de90 msgr2=0x7f4e98040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:31:01.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.496+0000 7f4eb132b640 1 --2- 172.21.15.47:0/4059285519 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f4e9803de90 0x7f4e98040350 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0034000 tx=0x7f4ea002e000 comp rx=0 tx=0).stop 2024-09-12T17:31:01.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.496+0000 7f4eb132b640 1 -- 172.21.15.47:0/4059285519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4eac112730 msgr2=0x7f4eac1215c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:31:01.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.496+0000 7f4eb132b640 1 --2- 172.21.15.47:0/4059285519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4eac112730 0x7f4eac1215c0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c00c380 tx=0x7f4e9c00c840 comp rx=0 tx=0).stop 2024-09-12T17:31:01.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.496+0000 7f4eb132b640 1 -- 172.21.15.47:0/4059285519 shutdown_connections 2024-09-12T17:31:01.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.496+0000 7f4eb132b640 1 --2- 172.21.15.47:0/4059285519 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f4e9803de90 0x7f4e98040350 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:31:01.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.496+0000 7f4eb132b640 1 --2- 172.21.15.47:0/4059285519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4eac112730 0x7f4eac1215c0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:31:01.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.496+0000 7f4eb132b640 1 -- 172.21.15.47:0/4059285519 >> 172.21.15.47:0/4059285519 conn(0x7f4eac070850 msgr2=0x7f4eac0722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:31:01.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.496+0000 7f4eb132b640 1 -- 172.21.15.47:0/4059285519 shutdown_connections 2024-09-12T17:31:01.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:01.496+0000 7f4eb132b640 1 -- 172.21.15.47:0/4059285519 wait complete. 2024-09-12T17:31:01.513 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":136,"stamp":"2024-09-12T17:30:59.793341+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":17384336,"num_objects":226,"num_object_clones":0,"num_object_copies":452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":226,"num_whiteouts":0,"num_read":5048,"num_read_kb":4634,"num_write":2091,"num_write_kb":60586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":482,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4520,"ondisk_log_size":4520,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148072,"kb_used_data":19172,"kb_used_omap":6,"kb_used_meta":128825,"kb_avail":377339288,"statfs":{"total":386547056640,"available":386395430912,"internally_reserved":0,"allocated":19632128,"data_stored":18495190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":131917590},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16783207,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":659,"num_read_kb":614,"num_write":427,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003590"},"pg_stats":[{"pgid":"3.3f","version":"31'2","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.133871+0000","last_change":"2024-09-12T17:28:21.473408+0000","last_active":"2024-09-12T17:30:50.133871+0000","last_peered":"2024-09-12T17:30:50.133871+0000","last_clean":"2024-09-12T17:30:50.133871+0000","last_became_active":"2024-09-12T17:28:21.473004+0000","last_became_peered":"2024-09-12T17:28:21.473004+0000","last_unstale":"2024-09-12T17:30:50.133871+0000","last_undegraded":"2024-09-12T17:30:50.133871+0000","last_fullsized":"2024-09-12T17:30:50.133871+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:27:19.040598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.926869+0000","last_change":"2024-09-12T17:27:42.433458+0000","last_active":"2024-09-12T17:30:49.926869+0000","last_peered":"2024-09-12T17:30:49.926869+0000","last_clean":"2024-09-12T17:30:49.926869+0000","last_became_active":"2024-09-12T17:27:42.433207+0000","last_became_peered":"2024-09-12T17:27:42.433207+0000","last_unstale":"2024-09-12T17:30:49.926869+0000","last_undegraded":"2024-09-12T17:30:49.926869+0000","last_fullsized":"2024-09-12T17:30:49.926869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:10.865332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.473539+0000","last_change":"2024-09-12T17:27:40.419781+0000","last_active":"2024-09-12T17:28:21.473539+0000","last_peered":"2024-09-12T17:28:21.473539+0000","last_clean":"2024-09-12T17:28:21.473539+0000","last_became_active":"2024-09-12T17:27:40.418928+0000","last_became_peered":"2024-09-12T17:27:40.418928+0000","last_unstale":"2024-09-12T17:28:21.473539+0000","last_undegraded":"2024-09-12T17:28:21.473539+0000","last_fullsized":"2024-09-12T17:28:21.473539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:05.211778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"31'6","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.929876+0000","last_change":"2024-09-12T17:27:42.432970+0000","last_active":"2024-09-12T17:30:49.929876+0000","last_peered":"2024-09-12T17:30:49.929876+0000","last_clean":"2024-09-12T17:30:49.929876+0000","last_became_active":"2024-09-12T17:27:42.432677+0000","last_became_peered":"2024-09-12T17:27:42.432677+0000","last_unstale":"2024-09-12T17:30:49.929876+0000","last_undegraded":"2024-09-12T17:30:49.929876+0000","last_fullsized":"2024-09-12T17:30:49.929876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:02.399648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465766+0000","last_change":"2024-09-12T17:27:40.433743+0000","last_active":"2024-09-12T17:28:21.465766+0000","last_peered":"2024-09-12T17:28:21.465766+0000","last_clean":"2024-09-12T17:28:21.465766+0000","last_became_active":"2024-09-12T17:27:40.433470+0000","last_became_peered":"2024-09-12T17:27:40.433470+0000","last_unstale":"2024-09-12T17:28:21.465766+0000","last_undegraded":"2024-09-12T17:28:21.465766+0000","last_fullsized":"2024-09-12T17:28:21.465766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:30.372118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"31'8","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:05.194512+0000","last_change":"2024-09-12T17:27:42.433048+0000","last_active":"2024-09-12T17:29:05.194512+0000","last_peered":"2024-09-12T17:29:05.194512+0000","last_clean":"2024-09-12T17:29:05.194512+0000","last_became_active":"2024-09-12T17:27:42.432736+0000","last_became_peered":"2024-09-12T17:27:42.432736+0000","last_unstale":"2024-09-12T17:29:05.194512+0000","last_undegraded":"2024-09-12T17:29:05.194512+0000","last_fullsized":"2024-09-12T17:29:05.194512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:43.699110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"31'8","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.144210+0000","last_change":"2024-09-12T17:27:40.426931+0000","last_active":"2024-09-12T17:30:50.144210+0000","last_peered":"2024-09-12T17:30:50.144210+0000","last_clean":"2024-09-12T17:30:50.144210+0000","last_became_active":"2024-09-12T17:27:40.426649+0000","last_became_peered":"2024-09-12T17:27:40.426649+0000","last_unstale":"2024-09-12T17:30:50.144210+0000","last_undegraded":"2024-09-12T17:30:50.144210+0000","last_fullsized":"2024-09-12T17:30:50.144210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:02.612906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":18,"num_write":56,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"31'8","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.929278+0000","last_change":"2024-09-12T17:27:42.418772+0000","last_active":"2024-09-12T17:30:49.929278+0000","last_peered":"2024-09-12T17:30:49.929278+0000","last_clean":"2024-09-12T17:30:49.929278+0000","last_became_active":"2024-09-12T17:27:42.418517+0000","last_became_peered":"2024-09-12T17:27:42.418517+0000","last_unstale":"2024-09-12T17:30:49.929278+0000","last_undegraded":"2024-09-12T17:30:49.929278+0000","last_fullsized":"2024-09-12T17:30:49.929278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:38.683188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464584+0000","last_change":"2024-09-12T17:27:40.425244+0000","last_active":"2024-09-12T17:28:21.464584+0000","last_peered":"2024-09-12T17:28:21.464584+0000","last_clean":"2024-09-12T17:28:21.464584+0000","last_became_active":"2024-09-12T17:27:40.424978+0000","last_became_peered":"2024-09-12T17:27:40.424978+0000","last_unstale":"2024-09-12T17:28:21.464584+0000","last_undegraded":"2024-09-12T17:28:21.464584+0000","last_fullsized":"2024-09-12T17:28:21.464584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:04.819015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"31'16","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.148377+0000","last_change":"2024-09-12T17:27:42.424168+0000","last_active":"2024-09-12T17:30:50.148377+0000","last_peered":"2024-09-12T17:30:50.148377+0000","last_clean":"2024-09-12T17:30:50.148377+0000","last_became_active":"2024-09-12T17:27:42.423906+0000","last_became_peered":"2024-09-12T17:27:42.423906+0000","last_unstale":"2024-09-12T17:30:50.148377+0000","last_undegraded":"2024-09-12T17:30:50.148377+0000","last_fullsized":"2024-09-12T17:30:50.148377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:30.717650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.467259+0000","last_change":"2024-09-12T17:27:40.425571+0000","last_active":"2024-09-12T17:28:21.467259+0000","last_peered":"2024-09-12T17:28:21.467259+0000","last_clean":"2024-09-12T17:28:21.467259+0000","last_became_active":"2024-09-12T17:27:40.425308+0000","last_became_peered":"2024-09-12T17:27:40.425308+0000","last_unstale":"2024-09-12T17:28:21.467259+0000","last_undegraded":"2024-09-12T17:28:21.467259+0000","last_fullsized":"2024-09-12T17:28:21.467259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:31.336111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"29'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464656+0000","last_change":"2024-09-12T17:27:42.429057+0000","last_active":"2024-09-12T17:28:21.464656+0000","last_peered":"2024-09-12T17:28:21.464656+0000","last_clean":"2024-09-12T17:28:21.464656+0000","last_became_active":"2024-09-12T17:27:42.428137+0000","last_became_peered":"2024-09-12T17:27:42.428137+0000","last_unstale":"2024-09-12T17:28:21.464656+0000","last_undegraded":"2024-09-12T17:28:21.464656+0000","last_fullsized":"2024-09-12T17:28:21.464656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:30.467192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'3","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:10.769083+0000","last_change":"2024-09-12T17:27:40.427714+0000","last_active":"2024-09-12T17:30:10.769083+0000","last_peered":"2024-09-12T17:30:10.769083+0000","last_clean":"2024-09-12T17:30:10.769083+0000","last_became_active":"2024-09-12T17:27:40.426778+0000","last_became_peered":"2024-09-12T17:27:40.426778+0000","last_unstale":"2024-09-12T17:30:10.769083+0000","last_undegraded":"2024-09-12T17:30:10.769083+0000","last_fullsized":"2024-09-12T17:30:10.769083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:19.867310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"31'18","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:05.377369+0000","last_change":"2024-09-12T17:27:42.434343+0000","last_active":"2024-09-12T17:29:05.377369+0000","last_peered":"2024-09-12T17:29:05.377369+0000","last_clean":"2024-09-12T17:29:05.377369+0000","last_became_active":"2024-09-12T17:27:42.434042+0000","last_became_peered":"2024-09-12T17:27:42.434042+0000","last_unstale":"2024-09-12T17:29:05.377369+0000","last_undegraded":"2024-09-12T17:29:05.377369+0000","last_fullsized":"2024-09-12T17:29:05.377369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:52.600151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":56,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"31'4","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.822317+0000","last_change":"2024-09-12T17:27:40.419315+0000","last_active":"2024-09-12T17:28:21.822317+0000","last_peered":"2024-09-12T17:28:21.822317+0000","last_clean":"2024-09-12T17:28:21.822317+0000","last_became_active":"2024-09-12T17:27:40.418512+0000","last_became_peered":"2024-09-12T17:27:40.418512+0000","last_unstale":"2024-09-12T17:28:21.822317+0000","last_undegraded":"2024-09-12T17:28:21.822317+0000","last_fullsized":"2024-09-12T17:28:21.822317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:08.096897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"31'8","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:22.319704+0000","last_change":"2024-09-12T17:27:42.436453+0000","last_active":"2024-09-12T17:28:22.319704+0000","last_peered":"2024-09-12T17:28:22.319704+0000","last_clean":"2024-09-12T17:28:22.319704+0000","last_became_active":"2024-09-12T17:27:42.436159+0000","last_became_peered":"2024-09-12T17:27:42.436159+0000","last_unstale":"2024-09-12T17:28:22.319704+0000","last_undegraded":"2024-09-12T17:28:22.319704+0000","last_fullsized":"2024-09-12T17:28:22.319704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:16.940321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"31'4","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.226031+0000","last_change":"2024-09-12T17:27:42.433708+0000","last_active":"2024-09-12T17:30:50.226031+0000","last_peered":"2024-09-12T17:30:50.226031+0000","last_clean":"2024-09-12T17:30:50.226031+0000","last_became_active":"2024-09-12T17:27:42.433425+0000","last_became_peered":"2024-09-12T17:27:42.433425+0000","last_unstale":"2024-09-12T17:30:50.226031+0000","last_undegraded":"2024-09-12T17:30:50.226031+0000","last_fullsized":"2024-09-12T17:30:50.226031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:32.794303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470550+0000","last_change":"2024-09-12T17:27:40.417181+0000","last_active":"2024-09-12T17:28:21.470550+0000","last_peered":"2024-09-12T17:28:21.470550+0000","last_clean":"2024-09-12T17:28:21.470550+0000","last_became_active":"2024-09-12T17:27:40.415650+0000","last_became_peered":"2024-09-12T17:27:40.415650+0000","last_unstale":"2024-09-12T17:28:21.470550+0000","last_undegraded":"2024-09-12T17:28:21.470550+0000","last_fullsized":"2024-09-12T17:28:21.470550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:11.303262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468030+0000","last_change":"2024-09-12T17:27:42.427970+0000","last_active":"2024-09-12T17:28:21.468030+0000","last_peered":"2024-09-12T17:28:21.468030+0000","last_clean":"2024-09-12T17:28:21.468030+0000","last_became_active":"2024-09-12T17:27:42.427700+0000","last_became_peered":"2024-09-12T17:27:42.427700+0000","last_unstale":"2024-09-12T17:28:21.468030+0000","last_undegraded":"2024-09-12T17:28:21.468030+0000","last_fullsized":"2024-09-12T17:28:21.468030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:26.167048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:45.824378+0000","last_change":"2024-09-12T17:27:40.432319+0000","last_active":"2024-09-12T17:29:45.824378+0000","last_peered":"2024-09-12T17:29:45.824378+0000","last_clean":"2024-09-12T17:29:45.824378+0000","last_became_active":"2024-09-12T17:27:40.432033+0000","last_became_peered":"2024-09-12T17:27:40.432033+0000","last_unstale":"2024-09-12T17:29:45.824378+0000","last_undegraded":"2024-09-12T17:29:45.824378+0000","last_fullsized":"2024-09-12T17:29:45.824378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:33.541500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"31'3","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:04.760240+0000","last_change":"2024-09-12T17:27:42.428753+0000","last_active":"2024-09-12T17:30:04.760240+0000","last_peered":"2024-09-12T17:30:04.760240+0000","last_clean":"2024-09-12T17:30:04.760240+0000","last_became_active":"2024-09-12T17:27:42.428492+0000","last_became_peered":"2024-09-12T17:27:42.428492+0000","last_unstale":"2024-09-12T17:30:04.760240+0000","last_undegraded":"2024-09-12T17:30:04.760240+0000","last_fullsized":"2024-09-12T17:30:04.760240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:53.463766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"29'2","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.478975+0000","last_change":"2024-09-12T17:28:21.478314+0000","last_active":"2024-09-12T17:28:21.478975+0000","last_peered":"2024-09-12T17:28:21.478975+0000","last_clean":"2024-09-12T17:28:21.478975+0000","last_became_active":"2024-09-12T17:28:21.474758+0000","last_became_peered":"2024-09-12T17:28:21.474758+0000","last_unstale":"2024-09-12T17:28:21.478975+0000","last_undegraded":"2024-09-12T17:28:21.478975+0000","last_fullsized":"2024-09-12T17:28:21.478975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:57.685638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:22.319001+0000","last_change":"2024-09-12T17:27:42.425610+0000","last_active":"2024-09-12T17:28:22.319001+0000","last_peered":"2024-09-12T17:28:22.319001+0000","last_clean":"2024-09-12T17:28:22.319001+0000","last_became_active":"2024-09-12T17:27:42.424738+0000","last_became_peered":"2024-09-12T17:27:42.424738+0000","last_unstale":"2024-09-12T17:28:22.319001+0000","last_undegraded":"2024-09-12T17:28:22.319001+0000","last_fullsized":"2024-09-12T17:28:22.319001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:32.550633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469481+0000","last_change":"2024-09-12T17:27:40.415283+0000","last_active":"2024-09-12T17:28:21.469481+0000","last_peered":"2024-09-12T17:28:21.469481+0000","last_clean":"2024-09-12T17:28:21.469481+0000","last_became_active":"2024-09-12T17:27:40.414669+0000","last_became_peered":"2024-09-12T17:27:40.414669+0000","last_unstale":"2024-09-12T17:28:21.469481+0000","last_undegraded":"2024-09-12T17:28:21.469481+0000","last_fullsized":"2024-09-12T17:28:21.469481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:44.782205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"31'8","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.225695+0000","last_change":"2024-09-12T17:27:42.436197+0000","last_active":"2024-09-12T17:30:50.225695+0000","last_peered":"2024-09-12T17:30:50.225695+0000","last_clean":"2024-09-12T17:30:50.225695+0000","last_became_active":"2024-09-12T17:27:42.435928+0000","last_became_peered":"2024-09-12T17:27:42.435928+0000","last_unstale":"2024-09-12T17:30:50.225695+0000","last_undegraded":"2024-09-12T17:30:50.225695+0000","last_fullsized":"2024-09-12T17:30:50.225695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:08.170045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.889394+0000","last_change":"2024-09-12T17:27:40.420567+0000","last_active":"2024-09-12T17:30:49.889394+0000","last_peered":"2024-09-12T17:30:49.889394+0000","last_clean":"2024-09-12T17:30:49.889394+0000","last_became_active":"2024-09-12T17:27:40.419936+0000","last_became_peered":"2024-09-12T17:27:40.419936+0000","last_unstale":"2024-09-12T17:30:49.889394+0000","last_undegraded":"2024-09-12T17:30:49.889394+0000","last_fullsized":"2024-09-12T17:30:49.889394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:49.941918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"31'5","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:09.761218+0000","last_change":"2024-09-12T17:27:42.423827+0000","last_active":"2024-09-12T17:30:09.761218+0000","last_peered":"2024-09-12T17:30:09.761218+0000","last_clean":"2024-09-12T17:30:09.761218+0000","last_became_active":"2024-09-12T17:27:42.423569+0000","last_became_peered":"2024-09-12T17:27:42.423569+0000","last_unstale":"2024-09-12T17:30:09.761218+0000","last_undegraded":"2024-09-12T17:30:09.761218+0000","last_fullsized":"2024-09-12T17:30:09.761218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:15.384263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.821382+0000","last_change":"2024-09-12T17:27:40.428057+0000","last_active":"2024-09-12T17:28:21.821382+0000","last_peered":"2024-09-12T17:28:21.821382+0000","last_clean":"2024-09-12T17:28:21.821382+0000","last_became_active":"2024-09-12T17:27:40.426721+0000","last_became_peered":"2024-09-12T17:27:40.426721+0000","last_unstale":"2024-09-12T17:28:21.821382+0000","last_undegraded":"2024-09-12T17:28:21.821382+0000","last_fullsized":"2024-09-12T17:28:21.821382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:59.265443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"31'35","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.173308+0000","last_change":"2024-09-12T17:27:50.456507+0000","last_active":"2024-09-12T17:30:50.173308+0000","last_peered":"2024-09-12T17:30:50.173308+0000","last_clean":"2024-09-12T17:30:50.173308+0000","last_became_active":"2024-09-12T17:27:50.456184+0000","last_became_peered":"2024-09-12T17:27:50.456184+0000","last_unstale":"2024-09-12T17:30:50.173308+0000","last_undegraded":"2024-09-12T17:30:50.173308+0000","last_fullsized":"2024-09-12T17:30:50.173308+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:38.608944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"31'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.076531+0000","last_change":"2024-09-12T17:27:42.420958+0000","last_active":"2024-09-12T17:29:49.076531+0000","last_peered":"2024-09-12T17:29:49.076531+0000","last_clean":"2024-09-12T17:29:49.076531+0000","last_became_active":"2024-09-12T17:27:42.420666+0000","last_became_peered":"2024-09-12T17:27:42.420666+0000","last_unstale":"2024-09-12T17:29:49.076531+0000","last_undegraded":"2024-09-12T17:29:49.076531+0000","last_fullsized":"2024-09-12T17:29:49.076531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:15.830207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464196+0000","last_change":"2024-09-12T17:27:40.433530+0000","last_active":"2024-09-12T17:28:21.464196+0000","last_peered":"2024-09-12T17:28:21.464196+0000","last_clean":"2024-09-12T17:28:21.464196+0000","last_became_active":"2024-09-12T17:27:40.433044+0000","last_became_peered":"2024-09-12T17:27:40.433044+0000","last_unstale":"2024-09-12T17:28:21.464196+0000","last_undegraded":"2024-09-12T17:28:21.464196+0000","last_fullsized":"2024-09-12T17:28:21.464196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:34.927105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.473141+0000","last_change":"2024-09-12T17:28:21.472409+0000","last_active":"2024-09-12T17:28:21.473141+0000","last_peered":"2024-09-12T17:28:21.473141+0000","last_clean":"2024-09-12T17:28:21.473141+0000","last_became_active":"2024-09-12T17:28:21.472106+0000","last_became_peered":"2024-09-12T17:28:21.472106+0000","last_unstale":"2024-09-12T17:28:21.473141+0000","last_undegraded":"2024-09-12T17:28:21.473141+0000","last_fullsized":"2024-09-12T17:28:21.473141+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:56.281239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"31'30","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.596107+0000","last_change":"2024-09-12T17:27:46.442394+0000","last_active":"2024-09-12T17:29:47.596107+0000","last_peered":"2024-09-12T17:29:47.596107+0000","last_clean":"2024-09-12T17:29:47.596107+0000","last_became_active":"2024-09-12T17:27:46.441891+0000","last_became_peered":"2024-09-12T17:27:46.441891+0000","last_unstale":"2024-09-12T17:29:47.596107+0000","last_undegraded":"2024-09-12T17:29:47.596107+0000","last_fullsized":"2024-09-12T17:29:47.596107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:29.351398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470059+0000","last_change":"2024-09-12T17:27:48.448380+0000","last_active":"2024-09-12T17:28:21.470059+0000","last_peered":"2024-09-12T17:28:21.470059+0000","last_clean":"2024-09-12T17:28:21.470059+0000","last_became_active":"2024-09-12T17:27:48.448078+0000","last_became_peered":"2024-09-12T17:27:48.448078+0000","last_unstale":"2024-09-12T17:28:21.470059+0000","last_undegraded":"2024-09-12T17:28:21.470059+0000","last_fullsized":"2024-09-12T17:28:21.470059+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:32.578727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"31'7","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:05.200007+0000","last_change":"2024-09-12T17:27:50.457351+0000","last_active":"2024-09-12T17:29:05.200007+0000","last_peered":"2024-09-12T17:29:05.200007+0000","last_clean":"2024-09-12T17:29:05.200007+0000","last_became_active":"2024-09-12T17:27:50.457037+0000","last_became_peered":"2024-09-12T17:27:50.457037+0000","last_unstale":"2024-09-12T17:29:05.200007+0000","last_undegraded":"2024-09-12T17:29:05.200007+0000","last_fullsized":"2024-09-12T17:29:05.200007+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:28.456215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465641+0000","last_change":"2024-09-12T17:27:42.428129+0000","last_active":"2024-09-12T17:28:21.465641+0000","last_peered":"2024-09-12T17:28:21.465641+0000","last_clean":"2024-09-12T17:28:21.465641+0000","last_became_active":"2024-09-12T17:27:42.427872+0000","last_became_peered":"2024-09-12T17:27:42.427872+0000","last_unstale":"2024-09-12T17:28:21.465641+0000","last_undegraded":"2024-09-12T17:28:21.465641+0000","last_fullsized":"2024-09-12T17:28:21.465641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:27.694207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468076+0000","last_change":"2024-09-12T17:27:40.431296+0000","last_active":"2024-09-12T17:28:21.468076+0000","last_peered":"2024-09-12T17:28:21.468076+0000","last_clean":"2024-09-12T17:28:21.468076+0000","last_became_active":"2024-09-12T17:27:40.430969+0000","last_became_peered":"2024-09-12T17:27:40.430969+0000","last_unstale":"2024-09-12T17:28:21.468076+0000","last_undegraded":"2024-09-12T17:28:21.468076+0000","last_fullsized":"2024-09-12T17:28:21.468076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:08.250935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.472166+0000","last_change":"2024-09-12T17:27:44.427938+0000","last_active":"2024-09-12T17:28:21.472166+0000","last_peered":"2024-09-12T17:28:21.472166+0000","last_clean":"2024-09-12T17:28:21.472166+0000","last_became_active":"2024-09-12T17:27:44.427560+0000","last_became_peered":"2024-09-12T17:27:44.427560+0000","last_unstale":"2024-09-12T17:28:21.472166+0000","last_undegraded":"2024-09-12T17:28:21.472166+0000","last_fullsized":"2024-09-12T17:28:21.472166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:08.271249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"29'6","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470141+0000","last_change":"2024-09-12T17:27:46.438703+0000","last_active":"2024-09-12T17:28:21.470141+0000","last_peered":"2024-09-12T17:28:21.470141+0000","last_clean":"2024-09-12T17:28:21.470141+0000","last_became_active":"2024-09-12T17:27:46.436065+0000","last_became_peered":"2024-09-12T17:27:46.436065+0000","last_unstale":"2024-09-12T17:28:21.470141+0000","last_undegraded":"2024-09-12T17:28:21.470141+0000","last_fullsized":"2024-09-12T17:28:21.470141+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:52.392850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466101+0000","last_change":"2024-09-12T17:27:48.441701+0000","last_active":"2024-09-12T17:28:21.466101+0000","last_peered":"2024-09-12T17:28:21.466101+0000","last_clean":"2024-09-12T17:28:21.466101+0000","last_became_active":"2024-09-12T17:27:48.441192+0000","last_became_peered":"2024-09-12T17:27:48.441192+0000","last_unstale":"2024-09-12T17:28:21.466101+0000","last_undegraded":"2024-09-12T17:28:21.466101+0000","last_fullsized":"2024-09-12T17:28:21.466101+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:52.274187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"29'2","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470752+0000","last_change":"2024-09-12T17:27:50.451886+0000","last_active":"2024-09-12T17:28:21.470752+0000","last_peered":"2024-09-12T17:28:21.470752+0000","last_clean":"2024-09-12T17:28:21.470752+0000","last_became_active":"2024-09-12T17:27:50.451589+0000","last_became_peered":"2024-09-12T17:27:50.451589+0000","last_unstale":"2024-09-12T17:28:21.470752+0000","last_undegraded":"2024-09-12T17:28:21.470752+0000","last_fullsized":"2024-09-12T17:28:21.470752+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:53.513569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"31'8","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:22.319420+0000","last_change":"2024-09-12T17:27:42.426651+0000","last_active":"2024-09-12T17:28:22.319420+0000","last_peered":"2024-09-12T17:28:22.319420+0000","last_clean":"2024-09-12T17:28:22.319420+0000","last_became_active":"2024-09-12T17:27:42.426402+0000","last_became_peered":"2024-09-12T17:27:42.426402+0000","last_unstale":"2024-09-12T17:28:22.319420+0000","last_undegraded":"2024-09-12T17:28:22.319420+0000","last_fullsized":"2024-09-12T17:28:22.319420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:24.998663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.032605+0000","last_change":"2024-09-12T17:27:40.428134+0000","last_active":"2024-09-12T17:29:49.032605+0000","last_peered":"2024-09-12T17:29:49.032605+0000","last_clean":"2024-09-12T17:29:49.032605+0000","last_became_active":"2024-09-12T17:27:40.427860+0000","last_became_peered":"2024-09-12T17:27:40.427860+0000","last_unstale":"2024-09-12T17:29:49.032605+0000","last_undegraded":"2024-09-12T17:29:49.032605+0000","last_fullsized":"2024-09-12T17:29:49.032605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:15.255295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.474373+0000","last_change":"2024-09-12T17:27:44.431340+0000","last_active":"2024-09-12T17:28:21.474373+0000","last_peered":"2024-09-12T17:28:21.474373+0000","last_clean":"2024-09-12T17:28:21.474373+0000","last_became_active":"2024-09-12T17:27:44.430879+0000","last_became_peered":"2024-09-12T17:27:44.430879+0000","last_unstale":"2024-09-12T17:28:21.474373+0000","last_undegraded":"2024-09-12T17:28:21.474373+0000","last_fullsized":"2024-09-12T17:28:21.474373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:31.240889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"29'10","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.467842+0000","last_change":"2024-09-12T17:27:46.440472+0000","last_active":"2024-09-12T17:28:21.467842+0000","last_peered":"2024-09-12T17:28:21.467842+0000","last_clean":"2024-09-12T17:28:21.467842+0000","last_became_active":"2024-09-12T17:27:46.440203+0000","last_became_peered":"2024-09-12T17:27:46.440203+0000","last_unstale":"2024-09-12T17:28:21.467842+0000","last_undegraded":"2024-09-12T17:28:21.467842+0000","last_fullsized":"2024-09-12T17:28:21.467842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:58.292808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"31'282","reported_seq":405,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.511610+0000","last_change":"2024-09-12T17:27:48.451526+0000","last_active":"2024-09-12T17:30:49.511610+0000","last_peered":"2024-09-12T17:30:49.511610+0000","last_clean":"2024-09-12T17:30:49.511610+0000","last_became_active":"2024-09-12T17:27:48.450897+0000","last_became_peered":"2024-09-12T17:27:48.450897+0000","last_unstale":"2024-09-12T17:30:49.511610+0000","last_undegraded":"2024-09-12T17:30:49.511610+0000","last_fullsized":"2024-09-12T17:30:49.511610+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:24.867772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468002+0000","last_change":"2024-09-12T17:27:50.456983+0000","last_active":"2024-09-12T17:28:21.468002+0000","last_peered":"2024-09-12T17:28:21.468002+0000","last_clean":"2024-09-12T17:28:21.468002+0000","last_became_active":"2024-09-12T17:27:50.456376+0000","last_became_peered":"2024-09-12T17:27:50.456376+0000","last_unstale":"2024-09-12T17:28:21.468002+0000","last_undegraded":"2024-09-12T17:28:21.468002+0000","last_fullsized":"2024-09-12T17:28:21.468002+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:07.847747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"31'12","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.926558+0000","last_change":"2024-09-12T17:27:42.426373+0000","last_active":"2024-09-12T17:30:49.926558+0000","last_peered":"2024-09-12T17:30:49.926558+0000","last_clean":"2024-09-12T17:30:49.926558+0000","last_became_active":"2024-09-12T17:27:42.426060+0000","last_became_peered":"2024-09-12T17:27:42.426060+0000","last_unstale":"2024-09-12T17:30:49.926558+0000","last_undegraded":"2024-09-12T17:30:49.926558+0000","last_fullsized":"2024-09-12T17:30:49.926558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:54.699865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468564+0000","last_change":"2024-09-12T17:27:40.423578+0000","last_active":"2024-09-12T17:28:21.468564+0000","last_peered":"2024-09-12T17:28:21.468564+0000","last_clean":"2024-09-12T17:28:21.468564+0000","last_became_active":"2024-09-12T17:27:40.415702+0000","last_became_peered":"2024-09-12T17:27:40.415702+0000","last_unstale":"2024-09-12T17:28:21.468564+0000","last_undegraded":"2024-09-12T17:28:21.468564+0000","last_fullsized":"2024-09-12T17:28:21.468564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:05.858479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465273+0000","last_change":"2024-09-12T17:27:44.428855+0000","last_active":"2024-09-12T17:28:21.465273+0000","last_peered":"2024-09-12T17:28:21.465273+0000","last_clean":"2024-09-12T17:28:21.465273+0000","last_became_active":"2024-09-12T17:27:44.428526+0000","last_became_peered":"2024-09-12T17:27:44.428526+0000","last_unstale":"2024-09-12T17:28:21.465273+0000","last_undegraded":"2024-09-12T17:28:21.465273+0000","last_fullsized":"2024-09-12T17:28:21.465273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:22.407461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"31'33","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.905030+0000","last_change":"2024-09-12T17:27:46.441041+0000","last_active":"2024-09-12T17:30:56.905030+0000","last_peered":"2024-09-12T17:30:56.905030+0000","last_clean":"2024-09-12T17:30:56.905030+0000","last_became_active":"2024-09-12T17:27:46.440765+0000","last_became_peered":"2024-09-12T17:27:46.440765+0000","last_unstale":"2024-09-12T17:30:56.905030+0000","last_undegraded":"2024-09-12T17:30:56.905030+0000","last_fullsized":"2024-09-12T17:30:56.905030+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:14.176389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"31'285","reported_seq":439,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.780942+0000","last_change":"2024-09-12T17:27:48.440009+0000","last_active":"2024-09-12T17:30:56.780942+0000","last_peered":"2024-09-12T17:30:56.780942+0000","last_clean":"2024-09-12T17:30:56.780942+0000","last_became_active":"2024-09-12T17:27:48.439642+0000","last_became_peered":"2024-09-12T17:27:48.439642+0000","last_unstale":"2024-09-12T17:30:56.780942+0000","last_undegraded":"2024-09-12T17:30:56.780942+0000","last_fullsized":"2024-09-12T17:30:56.780942+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:06.242670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"31'12","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.225652+0000","last_change":"2024-09-12T17:27:42.428634+0000","last_active":"2024-09-12T17:30:50.225652+0000","last_peered":"2024-09-12T17:30:50.225652+0000","last_clean":"2024-09-12T17:30:50.225652+0000","last_became_active":"2024-09-12T17:27:42.427990+0000","last_became_peered":"2024-09-12T17:27:42.427990+0000","last_unstale":"2024-09-12T17:30:50.225652+0000","last_undegraded":"2024-09-12T17:30:50.225652+0000","last_fullsized":"2024-09-12T17:30:50.225652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:27:19.215981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"29'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468356+0000","last_change":"2024-09-12T17:27:40.429060+0000","last_active":"2024-09-12T17:28:21.468356+0000","last_peered":"2024-09-12T17:28:21.468356+0000","last_clean":"2024-09-12T17:28:21.468356+0000","last_became_active":"2024-09-12T17:27:40.428462+0000","last_became_peered":"2024-09-12T17:27:40.428462+0000","last_unstale":"2024-09-12T17:28:21.468356+0000","last_undegraded":"2024-09-12T17:28:21.468356+0000","last_fullsized":"2024-09-12T17:28:21.468356+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:45.872253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468175+0000","last_change":"2024-09-12T17:27:44.433155+0000","last_active":"2024-09-12T17:28:21.468175+0000","last_peered":"2024-09-12T17:28:21.468175+0000","last_clean":"2024-09-12T17:28:21.468175+0000","last_became_active":"2024-09-12T17:27:44.431911+0000","last_became_peered":"2024-09-12T17:27:44.431911+0000","last_unstale":"2024-09-12T17:28:21.468175+0000","last_undegraded":"2024-09-12T17:28:21.468175+0000","last_fullsized":"2024-09-12T17:28:21.468175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:16.971114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"31'44","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.828471+0000","last_change":"2024-09-12T17:27:46.439466+0000","last_active":"2024-09-12T17:30:56.828471+0000","last_peered":"2024-09-12T17:30:56.828471+0000","last_clean":"2024-09-12T17:30:56.828471+0000","last_became_active":"2024-09-12T17:27:46.439188+0000","last_became_peered":"2024-09-12T17:27:46.439188+0000","last_unstale":"2024-09-12T17:30:56.828471+0000","last_undegraded":"2024-09-12T17:30:56.828471+0000","last_fullsized":"2024-09-12T17:30:56.828471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:25.881248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471714+0000","last_change":"2024-09-12T17:27:48.441917+0000","last_active":"2024-09-12T17:28:21.471714+0000","last_peered":"2024-09-12T17:28:21.471714+0000","last_clean":"2024-09-12T17:28:21.471714+0000","last_became_active":"2024-09-12T17:27:48.441618+0000","last_became_peered":"2024-09-12T17:27:48.441618+0000","last_unstale":"2024-09-12T17:28:21.471714+0000","last_undegraded":"2024-09-12T17:28:21.471714+0000","last_fullsized":"2024-09-12T17:28:21.471714+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:17.256348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"31'7","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.198792+0000","last_change":"2024-09-12T17:27:50.457616+0000","last_active":"2024-09-12T17:30:50.198792+0000","last_peered":"2024-09-12T17:30:50.198792+0000","last_clean":"2024-09-12T17:30:50.198792+0000","last_became_active":"2024-09-12T17:27:50.457350+0000","last_became_peered":"2024-09-12T17:27:50.457350+0000","last_unstale":"2024-09-12T17:30:50.198792+0000","last_undegraded":"2024-09-12T17:30:50.198792+0000","last_fullsized":"2024-09-12T17:30:50.198792+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:39.806321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"31'20","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.148556+0000","last_change":"2024-09-12T17:27:42.424787+0000","last_active":"2024-09-12T17:30:50.148556+0000","last_peered":"2024-09-12T17:30:50.148556+0000","last_clean":"2024-09-12T17:30:50.148556+0000","last_became_active":"2024-09-12T17:27:42.424268+0000","last_became_peered":"2024-09-12T17:27:42.424268+0000","last_unstale":"2024-09-12T17:30:50.148556+0000","last_undegraded":"2024-09-12T17:30:50.148556+0000","last_fullsized":"2024-09-12T17:30:50.148556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:10.726972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":75,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469727+0000","last_change":"2024-09-12T17:27:40.427959+0000","last_active":"2024-09-12T17:28:21.469727+0000","last_peered":"2024-09-12T17:28:21.469727+0000","last_clean":"2024-09-12T17:28:21.469727+0000","last_became_active":"2024-09-12T17:27:40.427677+0000","last_became_peered":"2024-09-12T17:27:40.427677+0000","last_unstale":"2024-09-12T17:28:21.469727+0000","last_undegraded":"2024-09-12T17:28:21.469727+0000","last_fullsized":"2024-09-12T17:28:21.469727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:13.997279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471294+0000","last_change":"2024-09-12T17:27:44.434751+0000","last_active":"2024-09-12T17:28:21.471294+0000","last_peered":"2024-09-12T17:28:21.471294+0000","last_clean":"2024-09-12T17:28:21.471294+0000","last_became_active":"2024-09-12T17:27:44.434433+0000","last_became_peered":"2024-09-12T17:27:44.434433+0000","last_unstale":"2024-09-12T17:28:21.471294+0000","last_undegraded":"2024-09-12T17:28:21.471294+0000","last_fullsized":"2024-09-12T17:28:21.471294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:00.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"31'30","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.580910+0000","last_change":"2024-09-12T17:27:46.442854+0000","last_active":"2024-09-12T17:29:47.580910+0000","last_peered":"2024-09-12T17:29:47.580910+0000","last_clean":"2024-09-12T17:29:47.580910+0000","last_became_active":"2024-09-12T17:27:46.442572+0000","last_became_peered":"2024-09-12T17:27:46.442572+0000","last_unstale":"2024-09-12T17:29:47.580910+0000","last_undegraded":"2024-09-12T17:29:47.580910+0000","last_fullsized":"2024-09-12T17:29:47.580910+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:49.755366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470885+0000","last_change":"2024-09-12T17:27:48.445793+0000","last_active":"2024-09-12T17:28:21.470885+0000","last_peered":"2024-09-12T17:28:21.470885+0000","last_clean":"2024-09-12T17:28:21.470885+0000","last_became_active":"2024-09-12T17:27:48.445502+0000","last_became_peered":"2024-09-12T17:27:48.445502+0000","last_unstale":"2024-09-12T17:28:21.470885+0000","last_undegraded":"2024-09-12T17:28:21.470885+0000","last_fullsized":"2024-09-12T17:28:21.470885+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:17.142197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"31'9","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.283385+0000","last_change":"2024-09-12T17:27:50.458007+0000","last_active":"2024-09-12T17:30:50.283385+0000","last_peered":"2024-09-12T17:30:50.283385+0000","last_clean":"2024-09-12T17:30:50.283385+0000","last_became_active":"2024-09-12T17:27:50.457691+0000","last_became_peered":"2024-09-12T17:27:50.457691+0000","last_unstale":"2024-09-12T17:30:50.283385+0000","last_undegraded":"2024-09-12T17:30:50.283385+0000","last_fullsized":"2024-09-12T17:30:50.283385+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:51.065237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":23,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"31'7","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.203773+0000","last_change":"2024-09-12T17:27:42.436839+0000","last_active":"2024-09-12T17:30:50.203773+0000","last_peered":"2024-09-12T17:30:50.203773+0000","last_clean":"2024-09-12T17:30:50.203773+0000","last_became_active":"2024-09-12T17:27:42.436517+0000","last_became_peered":"2024-09-12T17:27:42.436517+0000","last_unstale":"2024-09-12T17:30:50.203773+0000","last_undegraded":"2024-09-12T17:30:50.203773+0000","last_fullsized":"2024-09-12T17:30:50.203773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:56.329169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465301+0000","last_change":"2024-09-12T17:27:40.429917+0000","last_active":"2024-09-12T17:28:21.465301+0000","last_peered":"2024-09-12T17:28:21.465301+0000","last_clean":"2024-09-12T17:28:21.465301+0000","last_became_active":"2024-09-12T17:27:40.429663+0000","last_became_peered":"2024-09-12T17:27:40.429663+0000","last_unstale":"2024-09-12T17:28:21.465301+0000","last_undegraded":"2024-09-12T17:28:21.465301+0000","last_fullsized":"2024-09-12T17:28:21.465301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:01.771644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.473204+0000","last_change":"2024-09-12T17:27:44.431117+0000","last_active":"2024-09-12T17:28:21.473204+0000","last_peered":"2024-09-12T17:28:21.473204+0000","last_clean":"2024-09-12T17:28:21.473204+0000","last_became_active":"2024-09-12T17:27:44.430772+0000","last_became_peered":"2024-09-12T17:27:44.430772+0000","last_unstale":"2024-09-12T17:28:21.473204+0000","last_undegraded":"2024-09-12T17:28:21.473204+0000","last_fullsized":"2024-09-12T17:28:21.473204+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:11.871540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"31'37","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.601873+0000","last_change":"2024-09-12T17:27:46.444540+0000","last_active":"2024-09-12T17:29:47.601873+0000","last_peered":"2024-09-12T17:29:47.601873+0000","last_clean":"2024-09-12T17:29:47.601873+0000","last_became_active":"2024-09-12T17:27:46.444206+0000","last_became_peered":"2024-09-12T17:27:46.444206+0000","last_unstale":"2024-09-12T17:29:47.601873+0000","last_undegraded":"2024-09-12T17:29:47.601873+0000","last_fullsized":"2024-09-12T17:29:47.601873+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:06.613276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"31'285","reported_seq":401,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.782240+0000","last_change":"2024-09-12T17:27:48.448090+0000","last_active":"2024-09-12T17:30:56.782240+0000","last_peered":"2024-09-12T17:30:56.782240+0000","last_clean":"2024-09-12T17:30:56.782240+0000","last_became_active":"2024-09-12T17:27:48.447724+0000","last_became_peered":"2024-09-12T17:27:48.447724+0000","last_unstale":"2024-09-12T17:30:56.782240+0000","last_undegraded":"2024-09-12T17:30:56.782240+0000","last_fullsized":"2024-09-12T17:30:56.782240+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:37.632389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"31'4","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.183333+0000","last_change":"2024-09-12T17:27:50.451958+0000","last_active":"2024-09-12T17:30:50.183333+0000","last_peered":"2024-09-12T17:30:50.183333+0000","last_clean":"2024-09-12T17:30:50.183333+0000","last_became_active":"2024-09-12T17:27:50.451716+0000","last_became_peered":"2024-09-12T17:27:50.451716+0000","last_unstale":"2024-09-12T17:30:50.183333+0000","last_undegraded":"2024-09-12T17:30:50.183333+0000","last_fullsized":"2024-09-12T17:30:50.183333+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:28.075990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"31'4","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.018397+0000","last_change":"2024-09-12T17:27:42.429925+0000","last_active":"2024-09-12T17:30:50.018397+0000","last_peered":"2024-09-12T17:30:50.018397+0000","last_clean":"2024-09-12T17:30:50.018397+0000","last_became_active":"2024-09-12T17:27:42.429624+0000","last_became_peered":"2024-09-12T17:27:42.429624+0000","last_unstale":"2024-09-12T17:30:50.018397+0000","last_undegraded":"2024-09-12T17:30:50.018397+0000","last_fullsized":"2024-09-12T17:30:50.018397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:10.865332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464374+0000","last_change":"2024-09-12T17:27:40.424281+0000","last_active":"2024-09-12T17:28:21.464374+0000","last_peered":"2024-09-12T17:28:21.464374+0000","last_clean":"2024-09-12T17:28:21.464374+0000","last_became_active":"2024-09-12T17:27:40.423291+0000","last_became_peered":"2024-09-12T17:27:40.423291+0000","last_unstale":"2024-09-12T17:28:21.464374+0000","last_undegraded":"2024-09-12T17:28:21.464374+0000","last_fullsized":"2024-09-12T17:28:21.464374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:45.581275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471823+0000","last_change":"2024-09-12T17:27:44.430889+0000","last_active":"2024-09-12T17:28:21.471823+0000","last_peered":"2024-09-12T17:28:21.471823+0000","last_clean":"2024-09-12T17:28:21.471823+0000","last_became_active":"2024-09-12T17:27:44.430549+0000","last_became_peered":"2024-09-12T17:27:44.430549+0000","last_unstale":"2024-09-12T17:28:21.471823+0000","last_undegraded":"2024-09-12T17:28:21.471823+0000","last_fullsized":"2024-09-12T17:28:21.471823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:53.357220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"31'55","reported_seq":112,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:55.766229+0000","last_change":"2024-09-12T17:27:46.441393+0000","last_active":"2024-09-12T17:29:55.766229+0000","last_peered":"2024-09-12T17:29:55.766229+0000","last_clean":"2024-09-12T17:29:55.766229+0000","last_became_active":"2024-09-12T17:27:46.440805+0000","last_became_peered":"2024-09-12T17:27:46.440805+0000","last_unstale":"2024-09-12T17:29:55.766229+0000","last_undegraded":"2024-09-12T17:29:55.766229+0000","last_fullsized":"2024-09-12T17:29:55.766229+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:26.523623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5916,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":51,"num_read_kb":42,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471161+0000","last_change":"2024-09-12T17:27:48.443214+0000","last_active":"2024-09-12T17:28:21.471161+0000","last_peered":"2024-09-12T17:28:21.471161+0000","last_clean":"2024-09-12T17:28:21.471161+0000","last_became_active":"2024-09-12T17:27:48.442880+0000","last_became_peered":"2024-09-12T17:27:48.442880+0000","last_unstale":"2024-09-12T17:28:21.471161+0000","last_undegraded":"2024-09-12T17:28:21.471161+0000","last_fullsized":"2024-09-12T17:28:21.471161+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:45.787562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"31'20","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.331059+0000","last_change":"2024-09-12T17:27:50.454666+0000","last_active":"2024-09-12T17:30:50.331059+0000","last_peered":"2024-09-12T17:30:50.331059+0000","last_clean":"2024-09-12T17:30:50.331059+0000","last_became_active":"2024-09-12T17:27:50.454410+0000","last_became_peered":"2024-09-12T17:27:50.454410+0000","last_unstale":"2024-09-12T17:30:50.331059+0000","last_undegraded":"2024-09-12T17:30:50.331059+0000","last_fullsized":"2024-09-12T17:30:50.331059+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:12:29.329426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"31'10","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.225780+0000","last_change":"2024-09-12T17:27:42.436173+0000","last_active":"2024-09-12T17:30:50.225780+0000","last_peered":"2024-09-12T17:30:50.225780+0000","last_clean":"2024-09-12T17:30:50.225780+0000","last_became_active":"2024-09-12T17:27:42.435913+0000","last_became_peered":"2024-09-12T17:27:42.435913+0000","last_unstale":"2024-09-12T17:30:50.225780+0000","last_undegraded":"2024-09-12T17:30:50.225780+0000","last_fullsized":"2024-09-12T17:30:50.225780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:49.886133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.472093+0000","last_change":"2024-09-12T17:27:40.416125+0000","last_active":"2024-09-12T17:28:21.472093+0000","last_peered":"2024-09-12T17:28:21.472093+0000","last_clean":"2024-09-12T17:28:21.472093+0000","last_became_active":"2024-09-12T17:27:40.415703+0000","last_became_peered":"2024-09-12T17:27:40.415703+0000","last_unstale":"2024-09-12T17:28:21.472093+0000","last_undegraded":"2024-09-12T17:28:21.472093+0000","last_fullsized":"2024-09-12T17:28:21.472093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:40.086345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466635+0000","last_change":"2024-09-12T17:27:44.432984+0000","last_active":"2024-09-12T17:28:21.466635+0000","last_peered":"2024-09-12T17:28:21.466635+0000","last_clean":"2024-09-12T17:28:21.466635+0000","last_became_active":"2024-09-12T17:27:44.432588+0000","last_became_peered":"2024-09-12T17:27:44.432588+0000","last_unstale":"2024-09-12T17:28:21.466635+0000","last_undegraded":"2024-09-12T17:28:21.466635+0000","last_fullsized":"2024-09-12T17:28:21.466635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:09.951474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"31'35","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.885603+0000","last_change":"2024-09-12T17:27:46.432654+0000","last_active":"2024-09-12T17:30:56.885603+0000","last_peered":"2024-09-12T17:30:56.885603+0000","last_clean":"2024-09-12T17:30:56.885603+0000","last_became_active":"2024-09-12T17:27:46.432354+0000","last_became_peered":"2024-09-12T17:27:46.432354+0000","last_unstale":"2024-09-12T17:30:56.885603+0000","last_undegraded":"2024-09-12T17:30:56.885603+0000","last_fullsized":"2024-09-12T17:30:56.885603+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:14.062258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466117+0000","last_change":"2024-09-12T17:27:48.451776+0000","last_active":"2024-09-12T17:28:21.466117+0000","last_peered":"2024-09-12T17:28:21.466117+0000","last_clean":"2024-09-12T17:28:21.466117+0000","last_became_active":"2024-09-12T17:27:48.451510+0000","last_became_peered":"2024-09-12T17:27:48.451510+0000","last_unstale":"2024-09-12T17:28:21.466117+0000","last_undegraded":"2024-09-12T17:28:21.466117+0000","last_fullsized":"2024-09-12T17:28:21.466117+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:01.787546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"31'7","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:50.765214+0000","last_change":"2024-09-12T17:27:50.455419+0000","last_active":"2024-09-12T17:29:50.765214+0000","last_peered":"2024-09-12T17:29:50.765214+0000","last_clean":"2024-09-12T17:29:50.765214+0000","last_became_active":"2024-09-12T17:27:50.454890+0000","last_became_peered":"2024-09-12T17:27:50.454890+0000","last_unstale":"2024-09-12T17:29:50.765214+0000","last_undegraded":"2024-09-12T17:29:50.765214+0000","last_fullsized":"2024-09-12T17:29:50.765214+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:50.422624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"31'8","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.196877+0000","last_change":"2024-09-12T17:27:42.440511+0000","last_active":"2024-09-12T17:30:50.196877+0000","last_peered":"2024-09-12T17:30:50.196877+0000","last_clean":"2024-09-12T17:30:50.196877+0000","last_became_active":"2024-09-12T17:27:42.440204+0000","last_became_peered":"2024-09-12T17:27:42.440204+0000","last_unstale":"2024-09-12T17:30:50.196877+0000","last_undegraded":"2024-09-12T17:30:50.196877+0000","last_fullsized":"2024-09-12T17:30:50.196877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:11.628797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464148+0000","last_change":"2024-09-12T17:27:40.428533+0000","last_active":"2024-09-12T17:28:21.464148+0000","last_peered":"2024-09-12T17:28:21.464148+0000","last_clean":"2024-09-12T17:28:21.464148+0000","last_became_active":"2024-09-12T17:27:40.428232+0000","last_became_peered":"2024-09-12T17:27:40.428232+0000","last_unstale":"2024-09-12T17:28:21.464148+0000","last_undegraded":"2024-09-12T17:28:21.464148+0000","last_fullsized":"2024-09-12T17:28:21.464148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:38.394799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.473721+0000","last_change":"2024-09-12T17:27:44.432569+0000","last_active":"2024-09-12T17:28:21.473721+0000","last_peered":"2024-09-12T17:28:21.473721+0000","last_clean":"2024-09-12T17:28:21.473721+0000","last_became_active":"2024-09-12T17:27:44.432211+0000","last_became_peered":"2024-09-12T17:27:44.432211+0000","last_unstale":"2024-09-12T17:28:21.473721+0000","last_undegraded":"2024-09-12T17:28:21.473721+0000","last_fullsized":"2024-09-12T17:28:21.473721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:13.176204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"31'39","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.864276+0000","last_change":"2024-09-12T17:27:46.433953+0000","last_active":"2024-09-12T17:30:56.864276+0000","last_peered":"2024-09-12T17:30:56.864276+0000","last_clean":"2024-09-12T17:30:56.864276+0000","last_became_active":"2024-09-12T17:27:46.433672+0000","last_became_peered":"2024-09-12T17:27:46.433672+0000","last_unstale":"2024-09-12T17:30:56.864276+0000","last_undegraded":"2024-09-12T17:30:56.864276+0000","last_fullsized":"2024-09-12T17:30:56.864276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:55.924502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"31'285","reported_seq":407,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.777401+0000","last_change":"2024-09-12T17:27:48.440623+0000","last_active":"2024-09-12T17:30:56.777401+0000","last_peered":"2024-09-12T17:30:56.777401+0000","last_clean":"2024-09-12T17:30:56.777401+0000","last_became_active":"2024-09-12T17:27:48.440335+0000","last_became_peered":"2024-09-12T17:27:48.440335+0000","last_unstale":"2024-09-12T17:30:56.777401+0000","last_undegraded":"2024-09-12T17:30:56.777401+0000","last_fullsized":"2024-09-12T17:30:56.777401+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:20.544074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"31'12","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:54.758294+0000","last_change":"2024-09-12T17:27:50.449089+0000","last_active":"2024-09-12T17:29:54.758294+0000","last_peered":"2024-09-12T17:29:54.758294+0000","last_clean":"2024-09-12T17:29:54.758294+0000","last_became_active":"2024-09-12T17:27:50.448680+0000","last_became_peered":"2024-09-12T17:27:50.448680+0000","last_unstale":"2024-09-12T17:29:54.758294+0000","last_undegraded":"2024-09-12T17:29:54.758294+0000","last_fullsized":"2024-09-12T17:29:54.758294+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:01.786654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.473949+0000","last_change":"2024-09-12T17:28:21.473062+0000","last_active":"2024-09-12T17:28:21.473949+0000","last_peered":"2024-09-12T17:28:21.473949+0000","last_clean":"2024-09-12T17:28:21.473949+0000","last_became_active":"2024-09-12T17:28:21.472744+0000","last_became_peered":"2024-09-12T17:28:21.472744+0000","last_unstale":"2024-09-12T17:28:21.473949+0000","last_undegraded":"2024-09-12T17:28:21.473949+0000","last_fullsized":"2024-09-12T17:28:21.473949+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:30.333530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.221504+0000","last_change":"2024-09-12T17:27:40.428769+0000","last_active":"2024-09-12T17:30:50.221504+0000","last_peered":"2024-09-12T17:30:50.221504+0000","last_clean":"2024-09-12T17:30:50.221504+0000","last_became_active":"2024-09-12T17:27:40.428512+0000","last_became_peered":"2024-09-12T17:27:40.428512+0000","last_unstale":"2024-09-12T17:30:50.221504+0000","last_undegraded":"2024-09-12T17:30:50.221504+0000","last_fullsized":"2024-09-12T17:30:50.221504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:45.757419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'3","reported_seq":418,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.758569+0000","last_change":"2024-09-12T17:27:44.430169+0000","last_active":"2024-09-12T17:30:56.758569+0000","last_peered":"2024-09-12T17:30:56.758569+0000","last_clean":"2024-09-12T17:30:56.758569+0000","last_became_active":"2024-09-12T17:27:44.429844+0000","last_became_peered":"2024-09-12T17:27:44.429844+0000","last_unstale":"2024-09-12T17:30:56.758569+0000","last_undegraded":"2024-09-12T17:30:56.758569+0000","last_fullsized":"2024-09-12T17:30:56.758569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:19.512968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464478+0000","last_change":"2024-09-12T17:27:46.439449+0000","last_active":"2024-09-12T17:28:21.464478+0000","last_peered":"2024-09-12T17:28:21.464478+0000","last_clean":"2024-09-12T17:28:21.464478+0000","last_became_active":"2024-09-12T17:27:46.439153+0000","last_became_peered":"2024-09-12T17:27:46.439153+0000","last_unstale":"2024-09-12T17:28:21.464478+0000","last_undegraded":"2024-09-12T17:28:21.464478+0000","last_fullsized":"2024-09-12T17:28:21.464478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:53.118909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"31'285","reported_seq":463,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.778548+0000","last_change":"2024-09-12T17:27:48.441400+0000","last_active":"2024-09-12T17:30:56.778548+0000","last_peered":"2024-09-12T17:30:56.778548+0000","last_clean":"2024-09-12T17:30:56.778548+0000","last_became_active":"2024-09-12T17:27:48.441024+0000","last_became_peered":"2024-09-12T17:27:48.441024+0000","last_unstale":"2024-09-12T17:30:56.778548+0000","last_undegraded":"2024-09-12T17:30:56.778548+0000","last_fullsized":"2024-09-12T17:30:56.778548+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:09.672456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'4","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:48.859981+0000","last_change":"2024-09-12T17:27:50.452031+0000","last_active":"2024-09-12T17:29:48.859981+0000","last_peered":"2024-09-12T17:29:48.859981+0000","last_clean":"2024-09-12T17:29:48.859981+0000","last_became_active":"2024-09-12T17:27:50.451743+0000","last_became_peered":"2024-09-12T17:27:50.451743+0000","last_unstale":"2024-09-12T17:29:48.859981+0000","last_undegraded":"2024-09-12T17:29:48.859981+0000","last_fullsized":"2024-09-12T17:29:48.859981+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:24:17.073385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470933+0000","last_change":"2024-09-12T17:27:42.438842+0000","last_active":"2024-09-12T17:28:21.470933+0000","last_peered":"2024-09-12T17:28:21.470933+0000","last_clean":"2024-09-12T17:28:21.470933+0000","last_became_active":"2024-09-12T17:27:42.438566+0000","last_became_peered":"2024-09-12T17:27:42.438566+0000","last_unstale":"2024-09-12T17:28:21.470933+0000","last_undegraded":"2024-09-12T17:28:21.470933+0000","last_fullsized":"2024-09-12T17:28:21.470933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:08.054821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"31'1","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:50.765235+0000","last_change":"2024-09-12T17:27:40.430157+0000","last_active":"2024-09-12T17:29:50.765235+0000","last_peered":"2024-09-12T17:29:50.765235+0000","last_clean":"2024-09-12T17:29:50.765235+0000","last_became_active":"2024-09-12T17:27:40.429902+0000","last_became_peered":"2024-09-12T17:27:40.429902+0000","last_unstale":"2024-09-12T17:29:50.765235+0000","last_undegraded":"2024-09-12T17:29:50.765235+0000","last_fullsized":"2024-09-12T17:29:50.765235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:03.993235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465147+0000","last_change":"2024-09-12T17:27:44.431499+0000","last_active":"2024-09-12T17:28:21.465147+0000","last_peered":"2024-09-12T17:28:21.465147+0000","last_clean":"2024-09-12T17:28:21.465147+0000","last_became_active":"2024-09-12T17:27:44.431180+0000","last_became_peered":"2024-09-12T17:27:44.431180+0000","last_unstale":"2024-09-12T17:28:21.465147+0000","last_undegraded":"2024-09-12T17:28:21.465147+0000","last_fullsized":"2024-09-12T17:28:21.465147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:36.937417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"31'43","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.923010+0000","last_change":"2024-09-12T17:27:46.431873+0000","last_active":"2024-09-12T17:30:56.923010+0000","last_peered":"2024-09-12T17:30:56.923010+0000","last_clean":"2024-09-12T17:30:56.923010+0000","last_became_active":"2024-09-12T17:27:46.431599+0000","last_became_peered":"2024-09-12T17:27:46.431599+0000","last_unstale":"2024-09-12T17:30:56.923010+0000","last_undegraded":"2024-09-12T17:30:56.923010+0000","last_fullsized":"2024-09-12T17:30:56.923010+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:08.059866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":53,"num_read_kb":61,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.467064+0000","last_change":"2024-09-12T17:27:48.447644+0000","last_active":"2024-09-12T17:28:21.467064+0000","last_peered":"2024-09-12T17:28:21.467064+0000","last_clean":"2024-09-12T17:28:21.467064+0000","last_became_active":"2024-09-12T17:27:48.447331+0000","last_became_peered":"2024-09-12T17:27:48.447331+0000","last_unstale":"2024-09-12T17:28:21.467064+0000","last_undegraded":"2024-09-12T17:28:21.467064+0000","last_fullsized":"2024-09-12T17:28:21.467064+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:15.622749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"31'6","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.260811+0000","last_change":"2024-09-12T17:27:50.448120+0000","last_active":"2024-09-12T17:30:50.260811+0000","last_peered":"2024-09-12T17:30:50.260811+0000","last_clean":"2024-09-12T17:30:50.260811+0000","last_became_active":"2024-09-12T17:27:50.447855+0000","last_became_peered":"2024-09-12T17:27:50.447855+0000","last_unstale":"2024-09-12T17:30:50.260811+0000","last_undegraded":"2024-09-12T17:30:50.260811+0000","last_fullsized":"2024-09-12T17:30:50.260811+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:45:37.063333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"31'14","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.225785+0000","last_change":"2024-09-12T17:27:42.438563+0000","last_active":"2024-09-12T17:30:50.225785+0000","last_peered":"2024-09-12T17:30:50.225785+0000","last_clean":"2024-09-12T17:30:50.225785+0000","last_became_active":"2024-09-12T17:27:42.438270+0000","last_became_peered":"2024-09-12T17:27:42.438270+0000","last_unstale":"2024-09-12T17:30:50.225785+0000","last_undegraded":"2024-09-12T17:30:50.225785+0000","last_fullsized":"2024-09-12T17:30:50.225785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:24.762523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'72","reported_seq":142,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468423+0000","last_change":"2024-09-12T17:27:25.975511+0000","last_active":"2024-09-12T17:28:21.468423+0000","last_peered":"2024-09-12T17:28:21.468423+0000","last_clean":"2024-09-12T17:28:21.468423+0000","last_became_active":"2024-09-12T17:27:25.974522+0000","last_became_peered":"2024-09-12T17:27:25.974522+0000","last_unstale":"2024-09-12T17:28:21.468423+0000","last_undegraded":"2024-09-12T17:28:21.468423+0000","last_fullsized":"2024-09-12T17:28:21.468423+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:24.738801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:24.738801+0000","last_clean_scrub_stamp":"2024-09-12T17:27:24.738801+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:42.005302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464653+0000","last_change":"2024-09-12T17:27:34.770151+0000","last_active":"2024-09-12T17:28:21.464653+0000","last_peered":"2024-09-12T17:28:21.464653+0000","last_clean":"2024-09-12T17:28:21.464653+0000","last_became_active":"2024-09-12T17:27:32.760744+0000","last_became_peered":"2024-09-12T17:27:32.760744+0000","last_unstale":"2024-09-12T17:28:21.464653+0000","last_undegraded":"2024-09-12T17:28:21.464653+0000","last_fullsized":"2024-09-12T17:28:21.464653+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:22:57.115660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014241220000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463397+0000","last_change":"2024-09-12T17:27:40.429657+0000","last_active":"2024-09-12T17:28:21.463397+0000","last_peered":"2024-09-12T17:28:21.463397+0000","last_clean":"2024-09-12T17:28:21.463397+0000","last_became_active":"2024-09-12T17:27:40.428453+0000","last_became_peered":"2024-09-12T17:27:40.428453+0000","last_unstale":"2024-09-12T17:28:21.463397+0000","last_undegraded":"2024-09-12T17:28:21.463397+0000","last_fullsized":"2024-09-12T17:28:21.463397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:25.951429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469125+0000","last_change":"2024-09-12T17:27:44.432804+0000","last_active":"2024-09-12T17:28:21.469125+0000","last_peered":"2024-09-12T17:28:21.469125+0000","last_clean":"2024-09-12T17:28:21.469125+0000","last_became_active":"2024-09-12T17:27:44.432336+0000","last_became_peered":"2024-09-12T17:27:44.432336+0000","last_unstale":"2024-09-12T17:28:21.469125+0000","last_undegraded":"2024-09-12T17:28:21.469125+0000","last_fullsized":"2024-09-12T17:28:21.469125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:57.403402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"31'76","reported_seq":146,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.607996+0000","last_change":"2024-09-12T17:27:46.438090+0000","last_active":"2024-09-12T17:29:47.607996+0000","last_peered":"2024-09-12T17:29:47.607996+0000","last_clean":"2024-09-12T17:29:47.607996+0000","last_became_active":"2024-09-12T17:27:46.437771+0000","last_became_peered":"2024-09-12T17:27:46.437771+0000","last_unstale":"2024-09-12T17:29:47.607996+0000","last_undegraded":"2024-09-12T17:29:47.607996+0000","last_fullsized":"2024-09-12T17:29:47.607996+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:14.400029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.474144+0000","last_change":"2024-09-12T17:27:48.446270+0000","last_active":"2024-09-12T17:28:21.474144+0000","last_peered":"2024-09-12T17:28:21.474144+0000","last_clean":"2024-09-12T17:28:21.474144+0000","last_became_active":"2024-09-12T17:27:48.445970+0000","last_became_peered":"2024-09-12T17:27:48.445970+0000","last_unstale":"2024-09-12T17:28:21.474144+0000","last_undegraded":"2024-09-12T17:28:21.474144+0000","last_fullsized":"2024-09-12T17:28:21.474144+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:31.488140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"31'81","reported_seq":163,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.235627+0000","last_change":"2024-09-12T17:27:50.448666+0000","last_active":"2024-09-12T17:30:50.235627+0000","last_peered":"2024-09-12T17:30:50.235627+0000","last_clean":"2024-09-12T17:30:50.235627+0000","last_became_active":"2024-09-12T17:27:50.448189+0000","last_became_peered":"2024-09-12T17:27:50.448189+0000","last_unstale":"2024-09-12T17:30:50.235627+0000","last_undegraded":"2024-09-12T17:30:50.235627+0000","last_fullsized":"2024-09-12T17:30:50.235627+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:38.207685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":221,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465570+0000","last_change":"2024-09-12T17:27:42.429760+0000","last_active":"2024-09-12T17:28:21.465570+0000","last_peered":"2024-09-12T17:28:21.465570+0000","last_clean":"2024-09-12T17:28:21.465570+0000","last_became_active":"2024-09-12T17:27:42.429497+0000","last_became_peered":"2024-09-12T17:27:42.429497+0000","last_unstale":"2024-09-12T17:28:21.465570+0000","last_undegraded":"2024-09-12T17:28:21.465570+0000","last_fullsized":"2024-09-12T17:28:21.465570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:09.539390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.462953+0000","last_change":"2024-09-12T17:27:34.769202+0000","last_active":"2024-09-12T17:28:21.462953+0000","last_peered":"2024-09-12T17:28:21.462953+0000","last_clean":"2024-09-12T17:28:21.462953+0000","last_became_active":"2024-09-12T17:27:32.761687+0000","last_became_peered":"2024-09-12T17:27:32.761687+0000","last_unstale":"2024-09-12T17:28:21.462953+0000","last_undegraded":"2024-09-12T17:28:21.462953+0000","last_fullsized":"2024-09-12T17:28:21.462953+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:00.950082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056694099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471668+0000","last_change":"2024-09-12T17:27:40.418643+0000","last_active":"2024-09-12T17:28:21.471668+0000","last_peered":"2024-09-12T17:28:21.471668+0000","last_clean":"2024-09-12T17:28:21.471668+0000","last_became_active":"2024-09-12T17:27:40.418249+0000","last_became_peered":"2024-09-12T17:27:40.418249+0000","last_unstale":"2024-09-12T17:28:21.471668+0000","last_undegraded":"2024-09-12T17:28:21.471668+0000","last_fullsized":"2024-09-12T17:28:21.471668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:03:41.714055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468312+0000","last_change":"2024-09-12T17:27:44.427026+0000","last_active":"2024-09-12T17:28:21.468312+0000","last_peered":"2024-09-12T17:28:21.468312+0000","last_clean":"2024-09-12T17:28:21.468312+0000","last_became_active":"2024-09-12T17:27:44.426698+0000","last_became_peered":"2024-09-12T17:27:44.426698+0000","last_unstale":"2024-09-12T17:28:21.468312+0000","last_undegraded":"2024-09-12T17:28:21.468312+0000","last_fullsized":"2024-09-12T17:28:21.468312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:09.582440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"31'285","reported_seq":502,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.912291+0000","last_change":"2024-09-12T17:27:46.438678+0000","last_active":"2024-09-12T17:30:56.912291+0000","last_peered":"2024-09-12T17:30:56.912291+0000","last_clean":"2024-09-12T17:30:56.912291+0000","last_became_active":"2024-09-12T17:27:46.438381+0000","last_became_peered":"2024-09-12T17:27:46.438381+0000","last_unstale":"2024-09-12T17:30:56.912291+0000","last_undegraded":"2024-09-12T17:30:56.912291+0000","last_fullsized":"2024-09-12T17:30:56.912291+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:10.399053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464394+0000","last_change":"2024-09-12T17:27:48.451345+0000","last_active":"2024-09-12T17:28:21.464394+0000","last_peered":"2024-09-12T17:28:21.464394+0000","last_clean":"2024-09-12T17:28:21.464394+0000","last_became_active":"2024-09-12T17:27:48.450775+0000","last_became_peered":"2024-09-12T17:27:48.450775+0000","last_unstale":"2024-09-12T17:28:21.464394+0000","last_undegraded":"2024-09-12T17:28:21.464394+0000","last_fullsized":"2024-09-12T17:28:21.464394+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:37.382330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"31'5","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.944535+0000","last_change":"2024-09-12T17:27:50.458209+0000","last_active":"2024-09-12T17:30:49.944535+0000","last_peered":"2024-09-12T17:30:49.944535+0000","last_clean":"2024-09-12T17:30:49.944535+0000","last_became_active":"2024-09-12T17:27:50.457939+0000","last_became_peered":"2024-09-12T17:27:50.457939+0000","last_unstale":"2024-09-12T17:30:49.944535+0000","last_undegraded":"2024-09-12T17:30:49.944535+0000","last_fullsized":"2024-09-12T17:30:49.944535+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:23.231500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"31'4","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.076951+0000","last_change":"2024-09-12T17:27:42.425698+0000","last_active":"2024-09-12T17:29:49.076951+0000","last_peered":"2024-09-12T17:29:49.076951+0000","last_clean":"2024-09-12T17:29:49.076951+0000","last_became_active":"2024-09-12T17:27:42.424498+0000","last_became_peered":"2024-09-12T17:27:42.424498+0000","last_unstale":"2024-09-12T17:29:49.076951+0000","last_undegraded":"2024-09-12T17:29:49.076951+0000","last_fullsized":"2024-09-12T17:29:49.076951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:03.680453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466787+0000","last_change":"2024-09-12T17:27:35.052087+0000","last_active":"2024-09-12T17:28:21.466787+0000","last_peered":"2024-09-12T17:28:21.466787+0000","last_clean":"2024-09-12T17:28:21.466787+0000","last_became_active":"2024-09-12T17:27:32.761809+0000","last_became_peered":"2024-09-12T17:27:32.761809+0000","last_unstale":"2024-09-12T17:28:21.466787+0000","last_undegraded":"2024-09-12T17:28:21.466787+0000","last_fullsized":"2024-09-12T17:28:21.466787+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:18.084479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051333900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"31'3","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:05.185226+0000","last_change":"2024-09-12T17:27:40.418110+0000","last_active":"2024-09-12T17:29:05.185226+0000","last_peered":"2024-09-12T17:29:05.185226+0000","last_clean":"2024-09-12T17:29:05.185226+0000","last_became_active":"2024-09-12T17:27:40.417664+0000","last_became_peered":"2024-09-12T17:27:40.417664+0000","last_unstale":"2024-09-12T17:29:05.185226+0000","last_undegraded":"2024-09-12T17:29:05.185226+0000","last_fullsized":"2024-09-12T17:29:05.185226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:39.177042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"22'2","reported_seq":234,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.748852+0000","last_change":"2024-09-12T17:28:21.479837+0000","last_active":"2024-09-12T17:30:56.748852+0000","last_peered":"2024-09-12T17:30:56.748852+0000","last_clean":"2024-09-12T17:30:56.748852+0000","last_became_active":"2024-09-12T17:28:21.473073+0000","last_became_peered":"2024-09-12T17:28:21.473073+0000","last_unstale":"2024-09-12T17:30:56.748852+0000","last_undegraded":"2024-09-12T17:30:56.748852+0000","last_fullsized":"2024-09-12T17:30:56.748852+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:19.813164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":482,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"31'17","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.234475+0000","last_change":"2024-09-12T17:27:46.435712+0000","last_active":"2024-09-12T17:30:50.234475+0000","last_peered":"2024-09-12T17:30:50.234475+0000","last_clean":"2024-09-12T17:30:50.234475+0000","last_became_active":"2024-09-12T17:27:46.435381+0000","last_became_peered":"2024-09-12T17:27:46.435381+0000","last_unstale":"2024-09-12T17:30:50.234475+0000","last_undegraded":"2024-09-12T17:30:50.234475+0000","last_fullsized":"2024-09-12T17:30:50.234475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:41.723829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.472358+0000","last_change":"2024-09-12T17:27:48.451538+0000","last_active":"2024-09-12T17:28:21.472358+0000","last_peered":"2024-09-12T17:28:21.472358+0000","last_clean":"2024-09-12T17:28:21.472358+0000","last_became_active":"2024-09-12T17:27:48.451225+0000","last_became_peered":"2024-09-12T17:27:48.451225+0000","last_unstale":"2024-09-12T17:28:21.472358+0000","last_undegraded":"2024-09-12T17:28:21.472358+0000","last_fullsized":"2024-09-12T17:28:21.472358+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:18.269897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463520+0000","last_change":"2024-09-12T17:27:50.453764+0000","last_active":"2024-09-12T17:28:21.463520+0000","last_peered":"2024-09-12T17:28:21.463520+0000","last_clean":"2024-09-12T17:28:21.463520+0000","last_became_active":"2024-09-12T17:27:50.453458+0000","last_became_peered":"2024-09-12T17:27:50.453458+0000","last_unstale":"2024-09-12T17:28:21.463520+0000","last_undegraded":"2024-09-12T17:28:21.463520+0000","last_fullsized":"2024-09-12T17:28:21.463520+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:48.900827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"31'10","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.928991+0000","last_change":"2024-09-12T17:27:42.428370+0000","last_active":"2024-09-12T17:30:49.928991+0000","last_peered":"2024-09-12T17:30:49.928991+0000","last_clean":"2024-09-12T17:30:49.928991+0000","last_became_active":"2024-09-12T17:27:42.427591+0000","last_became_peered":"2024-09-12T17:27:42.427591+0000","last_unstale":"2024-09-12T17:30:49.928991+0000","last_undegraded":"2024-09-12T17:30:49.928991+0000","last_fullsized":"2024-09-12T17:30:49.928991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:32:15.190001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463771+0000","last_change":"2024-09-12T17:27:34.769764+0000","last_active":"2024-09-12T17:28:21.463771+0000","last_peered":"2024-09-12T17:28:21.463771+0000","last_clean":"2024-09-12T17:28:21.463771+0000","last_became_active":"2024-09-12T17:27:32.761967+0000","last_became_peered":"2024-09-12T17:27:32.761967+0000","last_unstale":"2024-09-12T17:28:21.463771+0000","last_undegraded":"2024-09-12T17:28:21.463771+0000","last_fullsized":"2024-09-12T17:28:21.463771+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:25.345465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001062323,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468759+0000","last_change":"2024-09-12T17:27:40.426229+0000","last_active":"2024-09-12T17:28:21.468759+0000","last_peered":"2024-09-12T17:28:21.468759+0000","last_clean":"2024-09-12T17:28:21.468759+0000","last_became_active":"2024-09-12T17:27:40.425973+0000","last_became_peered":"2024-09-12T17:27:40.425973+0000","last_unstale":"2024-09-12T17:28:21.468759+0000","last_undegraded":"2024-09-12T17:28:21.468759+0000","last_fullsized":"2024-09-12T17:28:21.468759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:08.388292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.473874+0000","last_change":"2024-09-12T17:27:44.432667+0000","last_active":"2024-09-12T17:28:21.473874+0000","last_peered":"2024-09-12T17:28:21.473874+0000","last_clean":"2024-09-12T17:28:21.473874+0000","last_became_active":"2024-09-12T17:27:44.432348+0000","last_became_peered":"2024-09-12T17:27:44.432348+0000","last_unstale":"2024-09-12T17:28:21.473874+0000","last_undegraded":"2024-09-12T17:28:21.473874+0000","last_fullsized":"2024-09-12T17:28:21.473874+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:56.521250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"31'14","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.091058+0000","last_change":"2024-09-12T17:27:46.442771+0000","last_active":"2024-09-12T17:30:49.091058+0000","last_peered":"2024-09-12T17:30:49.091058+0000","last_clean":"2024-09-12T17:30:49.091058+0000","last_became_active":"2024-09-12T17:27:46.442488+0000","last_became_peered":"2024-09-12T17:27:46.442488+0000","last_unstale":"2024-09-12T17:30:49.091058+0000","last_undegraded":"2024-09-12T17:30:49.091058+0000","last_fullsized":"2024-09-12T17:30:49.091058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:31.634237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466202+0000","last_change":"2024-09-12T17:27:48.451472+0000","last_active":"2024-09-12T17:28:21.466202+0000","last_peered":"2024-09-12T17:28:21.466202+0000","last_clean":"2024-09-12T17:28:21.466202+0000","last_became_active":"2024-09-12T17:27:48.451075+0000","last_became_peered":"2024-09-12T17:27:48.451075+0000","last_unstale":"2024-09-12T17:28:21.466202+0000","last_undegraded":"2024-09-12T17:28:21.466202+0000","last_fullsized":"2024-09-12T17:28:21.466202+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:41.217292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'10","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:48.840270+0000","last_change":"2024-09-12T17:27:50.456671+0000","last_active":"2024-09-12T17:29:48.840270+0000","last_peered":"2024-09-12T17:29:48.840270+0000","last_clean":"2024-09-12T17:29:48.840270+0000","last_became_active":"2024-09-12T17:27:50.455608+0000","last_became_peered":"2024-09-12T17:27:50.455608+0000","last_unstale":"2024-09-12T17:29:48.840270+0000","last_undegraded":"2024-09-12T17:29:48.840270+0000","last_fullsized":"2024-09-12T17:29:48.840270+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:23.681507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":17,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'14","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.148304+0000","last_change":"2024-09-12T17:28:21.472071+0000","last_active":"2024-09-12T17:30:50.148304+0000","last_peered":"2024-09-12T17:30:50.148304+0000","last_clean":"2024-09-12T17:30:50.148304+0000","last_became_active":"2024-09-12T17:28:21.471756+0000","last_became_peered":"2024-09-12T17:28:21.471756+0000","last_unstale":"2024-09-12T17:30:50.148304+0000","last_undegraded":"2024-09-12T17:30:50.148304+0000","last_fullsized":"2024-09-12T17:30:50.148304+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:02.305736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.141559+0000","last_change":"2024-09-12T17:27:40.424557+0000","last_active":"2024-09-12T17:30:50.141559+0000","last_peered":"2024-09-12T17:30:50.141559+0000","last_clean":"2024-09-12T17:30:50.141559+0000","last_became_active":"2024-09-12T17:27:40.424286+0000","last_became_peered":"2024-09-12T17:27:40.424286+0000","last_unstale":"2024-09-12T17:30:50.141559+0000","last_undegraded":"2024-09-12T17:30:50.141559+0000","last_fullsized":"2024-09-12T17:30:50.141559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:35.900609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.472269+0000","last_change":"2024-09-12T17:27:34.764756+0000","last_active":"2024-09-12T17:28:21.472269+0000","last_peered":"2024-09-12T17:28:21.472269+0000","last_clean":"2024-09-12T17:28:21.472269+0000","last_became_active":"2024-09-12T17:27:32.761595+0000","last_became_peered":"2024-09-12T17:27:32.761595+0000","last_unstale":"2024-09-12T17:28:21.472269+0000","last_undegraded":"2024-09-12T17:28:21.472269+0000","last_fullsized":"2024-09-12T17:28:21.472269+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:18.306129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000417551,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"31'1","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.353832+0000","last_change":"2024-09-12T17:27:44.432884+0000","last_active":"2024-09-12T17:30:50.353832+0000","last_peered":"2024-09-12T17:30:50.353832+0000","last_clean":"2024-09-12T17:30:50.353832+0000","last_became_active":"2024-09-12T17:27:44.432492+0000","last_became_peered":"2024-09-12T17:27:44.432492+0000","last_unstale":"2024-09-12T17:30:50.353832+0000","last_undegraded":"2024-09-12T17:30:50.353832+0000","last_fullsized":"2024-09-12T17:30:50.353832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:10.580513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"31'67","reported_seq":135,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.908193+0000","last_change":"2024-09-12T17:27:46.439404+0000","last_active":"2024-09-12T17:30:56.908193+0000","last_peered":"2024-09-12T17:30:56.908193+0000","last_clean":"2024-09-12T17:30:56.908193+0000","last_became_active":"2024-09-12T17:27:46.439014+0000","last_became_peered":"2024-09-12T17:27:46.439014+0000","last_unstale":"2024-09-12T17:30:56.908193+0000","last_undegraded":"2024-09-12T17:30:56.908193+0000","last_fullsized":"2024-09-12T17:30:56.908193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:18.977626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.467285+0000","last_change":"2024-09-12T17:27:48.439106+0000","last_active":"2024-09-12T17:28:21.467285+0000","last_peered":"2024-09-12T17:28:21.467285+0000","last_clean":"2024-09-12T17:28:21.467285+0000","last_became_active":"2024-09-12T17:27:48.438779+0000","last_became_peered":"2024-09-12T17:27:48.438779+0000","last_unstale":"2024-09-12T17:28:21.467285+0000","last_undegraded":"2024-09-12T17:28:21.467285+0000","last_fullsized":"2024-09-12T17:28:21.467285+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:49.022922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"31'13","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.020053+0000","last_change":"2024-09-12T17:27:50.448485+0000","last_active":"2024-09-12T17:30:50.020053+0000","last_peered":"2024-09-12T17:30:50.020053+0000","last_clean":"2024-09-12T17:30:50.020053+0000","last_became_active":"2024-09-12T17:27:50.448060+0000","last_became_peered":"2024-09-12T17:27:50.448060+0000","last_unstale":"2024-09-12T17:30:50.020053+0000","last_undegraded":"2024-09-12T17:30:50.020053+0000","last_fullsized":"2024-09-12T17:30:50.020053+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:10.453854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":31,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"31'27","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.023811+0000","last_change":"2024-09-12T17:27:42.433227+0000","last_active":"2024-09-12T17:30:50.023811+0000","last_peered":"2024-09-12T17:30:50.023811+0000","last_clean":"2024-09-12T17:30:50.023811+0000","last_became_active":"2024-09-12T17:27:42.432800+0000","last_became_peered":"2024-09-12T17:27:42.432800+0000","last_unstale":"2024-09-12T17:30:50.023811+0000","last_undegraded":"2024-09-12T17:30:50.023811+0000","last_fullsized":"2024-09-12T17:30:50.023811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:05.801739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":99,"num_read_kb":83,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"31'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.790738+0000","last_change":"2024-09-12T17:27:40.419982+0000","last_active":"2024-09-12T17:30:49.790738+0000","last_peered":"2024-09-12T17:30:49.790738+0000","last_clean":"2024-09-12T17:30:49.790738+0000","last_became_active":"2024-09-12T17:27:40.418873+0000","last_became_peered":"2024-09-12T17:27:40.418873+0000","last_unstale":"2024-09-12T17:30:49.790738+0000","last_undegraded":"2024-09-12T17:30:49.790738+0000","last_fullsized":"2024-09-12T17:30:49.790738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:08.388292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465552+0000","last_change":"2024-09-12T17:27:34.770070+0000","last_active":"2024-09-12T17:28:21.465552+0000","last_peered":"2024-09-12T17:28:21.465552+0000","last_clean":"2024-09-12T17:28:21.465552+0000","last_became_active":"2024-09-12T17:27:32.761677+0000","last_became_peered":"2024-09-12T17:27:32.761677+0000","last_unstale":"2024-09-12T17:28:21.465552+0000","last_undegraded":"2024-09-12T17:28:21.465552+0000","last_fullsized":"2024-09-12T17:28:21.465552+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:22.236160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001356625,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463624+0000","last_change":"2024-09-12T17:27:44.426949+0000","last_active":"2024-09-12T17:28:21.463624+0000","last_peered":"2024-09-12T17:28:21.463624+0000","last_clean":"2024-09-12T17:28:21.463624+0000","last_became_active":"2024-09-12T17:27:44.426647+0000","last_became_peered":"2024-09-12T17:27:44.426647+0000","last_unstale":"2024-09-12T17:28:21.463624+0000","last_undegraded":"2024-09-12T17:28:21.463624+0000","last_fullsized":"2024-09-12T17:28:21.463624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:54.776333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"29'15","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468427+0000","last_change":"2024-09-12T17:27:46.439375+0000","last_active":"2024-09-12T17:28:21.468427+0000","last_peered":"2024-09-12T17:28:21.468427+0000","last_clean":"2024-09-12T17:28:21.468427+0000","last_became_active":"2024-09-12T17:27:46.439038+0000","last_became_peered":"2024-09-12T17:27:46.439038+0000","last_unstale":"2024-09-12T17:28:21.468427+0000","last_undegraded":"2024-09-12T17:28:21.468427+0000","last_fullsized":"2024-09-12T17:28:21.468427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:18.536701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"31'285","reported_seq":350,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.774859+0000","last_change":"2024-09-12T17:27:48.442198+0000","last_active":"2024-09-12T17:30:56.774859+0000","last_peered":"2024-09-12T17:30:56.774859+0000","last_clean":"2024-09-12T17:30:56.774859+0000","last_became_active":"2024-09-12T17:27:48.440948+0000","last_became_peered":"2024-09-12T17:27:48.440948+0000","last_unstale":"2024-09-12T17:30:56.774859+0000","last_undegraded":"2024-09-12T17:30:56.774859+0000","last_fullsized":"2024-09-12T17:30:56.774859+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:58.653865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465509+0000","last_change":"2024-09-12T17:27:50.455097+0000","last_active":"2024-09-12T17:28:21.465509+0000","last_peered":"2024-09-12T17:28:21.465509+0000","last_clean":"2024-09-12T17:28:21.465509+0000","last_became_active":"2024-09-12T17:27:50.454241+0000","last_became_peered":"2024-09-12T17:27:50.454241+0000","last_unstale":"2024-09-12T17:28:21.465509+0000","last_undegraded":"2024-09-12T17:28:21.465509+0000","last_fullsized":"2024-09-12T17:28:21.465509+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:01.881864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"31'16","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.203650+0000","last_change":"2024-09-12T17:27:42.424267+0000","last_active":"2024-09-12T17:30:50.203650+0000","last_peered":"2024-09-12T17:30:50.203650+0000","last_clean":"2024-09-12T17:30:50.203650+0000","last_became_active":"2024-09-12T17:27:42.423805+0000","last_became_peered":"2024-09-12T17:27:42.423805+0000","last_unstale":"2024-09-12T17:30:50.203650+0000","last_undegraded":"2024-09-12T17:30:50.203650+0000","last_fullsized":"2024-09-12T17:30:50.203650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:37.154226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466516+0000","last_change":"2024-09-12T17:27:40.424553+0000","last_active":"2024-09-12T17:28:21.466516+0000","last_peered":"2024-09-12T17:28:21.466516+0000","last_clean":"2024-09-12T17:28:21.466516+0000","last_became_active":"2024-09-12T17:27:40.423703+0000","last_became_peered":"2024-09-12T17:27:40.423703+0000","last_unstale":"2024-09-12T17:28:21.466516+0000","last_undegraded":"2024-09-12T17:28:21.466516+0000","last_fullsized":"2024-09-12T17:28:21.466516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:34.708745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.472967+0000","last_change":"2024-09-12T17:27:34.764838+0000","last_active":"2024-09-12T17:28:21.472967+0000","last_peered":"2024-09-12T17:28:21.472967+0000","last_clean":"2024-09-12T17:28:21.472967+0000","last_became_active":"2024-09-12T17:27:32.761590+0000","last_became_peered":"2024-09-12T17:27:32.761590+0000","last_unstale":"2024-09-12T17:28:21.472967+0000","last_undegraded":"2024-09-12T17:28:21.472967+0000","last_fullsized":"2024-09-12T17:28:21.472967+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:23.009450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036072200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463699+0000","last_change":"2024-09-12T17:27:44.427647+0000","last_active":"2024-09-12T17:28:21.463699+0000","last_peered":"2024-09-12T17:28:21.463699+0000","last_clean":"2024-09-12T17:28:21.463699+0000","last_became_active":"2024-09-12T17:27:44.427318+0000","last_became_peered":"2024-09-12T17:27:44.427318+0000","last_unstale":"2024-09-12T17:28:21.463699+0000","last_undegraded":"2024-09-12T17:28:21.463699+0000","last_fullsized":"2024-09-12T17:28:21.463699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:46.727329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'10","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464060+0000","last_change":"2024-09-12T17:27:46.444325+0000","last_active":"2024-09-12T17:28:21.464060+0000","last_peered":"2024-09-12T17:28:21.464060+0000","last_clean":"2024-09-12T17:28:21.464060+0000","last_became_active":"2024-09-12T17:27:46.443937+0000","last_became_peered":"2024-09-12T17:27:46.443937+0000","last_unstale":"2024-09-12T17:28:21.464060+0000","last_undegraded":"2024-09-12T17:28:21.464060+0000","last_fullsized":"2024-09-12T17:28:21.464060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:54:23.541095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"31'285","reported_seq":393,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.779911+0000","last_change":"2024-09-12T17:27:48.441935+0000","last_active":"2024-09-12T17:30:56.779911+0000","last_peered":"2024-09-12T17:30:56.779911+0000","last_clean":"2024-09-12T17:30:56.779911+0000","last_became_active":"2024-09-12T17:27:48.441694+0000","last_became_peered":"2024-09-12T17:27:48.441694+0000","last_unstale":"2024-09-12T17:30:56.779911+0000","last_undegraded":"2024-09-12T17:30:56.779911+0000","last_fullsized":"2024-09-12T17:30:56.779911+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:32.578727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"29'3","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468923+0000","last_change":"2024-09-12T17:27:50.453171+0000","last_active":"2024-09-12T17:28:21.468923+0000","last_peered":"2024-09-12T17:28:21.468923+0000","last_clean":"2024-09-12T17:28:21.468923+0000","last_became_active":"2024-09-12T17:27:50.452862+0000","last_became_peered":"2024-09-12T17:27:50.452862+0000","last_unstale":"2024-09-12T17:28:21.468923+0000","last_undegraded":"2024-09-12T17:28:21.468923+0000","last_fullsized":"2024-09-12T17:28:21.468923+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:55.038103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"29'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466639+0000","last_change":"2024-09-12T17:27:42.437147+0000","last_active":"2024-09-12T17:28:21.466639+0000","last_peered":"2024-09-12T17:28:21.466639+0000","last_clean":"2024-09-12T17:28:21.466639+0000","last_became_active":"2024-09-12T17:27:42.436667+0000","last_became_peered":"2024-09-12T17:27:42.436667+0000","last_unstale":"2024-09-12T17:28:21.466639+0000","last_undegraded":"2024-09-12T17:28:21.466639+0000","last_fullsized":"2024-09-12T17:28:21.466639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:46.763985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466656+0000","last_change":"2024-09-12T17:27:40.419748+0000","last_active":"2024-09-12T17:28:21.466656+0000","last_peered":"2024-09-12T17:28:21.466656+0000","last_clean":"2024-09-12T17:28:21.466656+0000","last_became_active":"2024-09-12T17:27:40.419472+0000","last_became_peered":"2024-09-12T17:27:40.419472+0000","last_unstale":"2024-09-12T17:28:21.466656+0000","last_undegraded":"2024-09-12T17:28:21.466656+0000","last_fullsized":"2024-09-12T17:28:21.466656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:16.839649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466286+0000","last_change":"2024-09-12T17:27:34.769850+0000","last_active":"2024-09-12T17:28:21.466286+0000","last_peered":"2024-09-12T17:28:21.466286+0000","last_clean":"2024-09-12T17:28:21.466286+0000","last_became_active":"2024-09-12T17:27:32.775344+0000","last_became_peered":"2024-09-12T17:27:32.775344+0000","last_unstale":"2024-09-12T17:28:21.466286+0000","last_undegraded":"2024-09-12T17:28:21.466286+0000","last_fullsized":"2024-09-12T17:28:21.466286+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:31.752203+0000","last_clean_scrub_stamp":"2024-09-12T17:27:31.752203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:45.298951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011343939999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463970+0000","last_change":"2024-09-12T17:27:44.427846+0000","last_active":"2024-09-12T17:28:21.463970+0000","last_peered":"2024-09-12T17:28:21.463970+0000","last_clean":"2024-09-12T17:28:21.463970+0000","last_became_active":"2024-09-12T17:27:44.427519+0000","last_became_peered":"2024-09-12T17:27:44.427519+0000","last_unstale":"2024-09-12T17:28:21.463970+0000","last_undegraded":"2024-09-12T17:28:21.463970+0000","last_fullsized":"2024-09-12T17:28:21.463970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:56.857897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"31'91","reported_seq":176,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.917412+0000","last_change":"2024-09-12T17:27:46.442632+0000","last_active":"2024-09-12T17:30:56.917412+0000","last_peered":"2024-09-12T17:30:56.917412+0000","last_clean":"2024-09-12T17:30:56.917412+0000","last_became_active":"2024-09-12T17:27:46.442154+0000","last_became_peered":"2024-09-12T17:27:46.442154+0000","last_unstale":"2024-09-12T17:30:56.917412+0000","last_undegraded":"2024-09-12T17:30:56.917412+0000","last_fullsized":"2024-09-12T17:30:56.917412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:20.802573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471089+0000","last_change":"2024-09-12T17:27:48.440496+0000","last_active":"2024-09-12T17:28:21.471089+0000","last_peered":"2024-09-12T17:28:21.471089+0000","last_clean":"2024-09-12T17:28:21.471089+0000","last_became_active":"2024-09-12T17:27:48.440177+0000","last_became_peered":"2024-09-12T17:27:48.440177+0000","last_unstale":"2024-09-12T17:28:21.471089+0000","last_undegraded":"2024-09-12T17:28:21.471089+0000","last_fullsized":"2024-09-12T17:28:21.471089+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:26.852348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466258+0000","last_change":"2024-09-12T17:27:50.454208+0000","last_active":"2024-09-12T17:28:21.466258+0000","last_peered":"2024-09-12T17:28:21.466258+0000","last_clean":"2024-09-12T17:28:21.466258+0000","last_became_active":"2024-09-12T17:27:50.453919+0000","last_became_peered":"2024-09-12T17:27:50.453919+0000","last_unstale":"2024-09-12T17:28:21.466258+0000","last_undegraded":"2024-09-12T17:28:21.466258+0000","last_fullsized":"2024-09-12T17:28:21.466258+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:28.859033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469099+0000","last_change":"2024-09-12T17:27:50.454609+0000","last_active":"2024-09-12T17:28:21.469099+0000","last_peered":"2024-09-12T17:28:21.469099+0000","last_clean":"2024-09-12T17:28:21.469099+0000","last_became_active":"2024-09-12T17:27:50.452190+0000","last_became_peered":"2024-09-12T17:27:50.452190+0000","last_unstale":"2024-09-12T17:28:21.469099+0000","last_undegraded":"2024-09-12T17:28:21.469099+0000","last_fullsized":"2024-09-12T17:28:21.469099+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:08.249355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:05.195137+0000","last_change":"2024-09-12T17:27:42.436477+0000","last_active":"2024-09-12T17:29:05.195137+0000","last_peered":"2024-09-12T17:29:05.195137+0000","last_clean":"2024-09-12T17:29:05.195137+0000","last_became_active":"2024-09-12T17:27:42.436187+0000","last_became_peered":"2024-09-12T17:27:42.436187+0000","last_unstale":"2024-09-12T17:29:05.195137+0000","last_undegraded":"2024-09-12T17:29:05.195137+0000","last_fullsized":"2024-09-12T17:29:05.195137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:06.625797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"29'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464418+0000","last_change":"2024-09-12T17:27:40.429080+0000","last_active":"2024-09-12T17:28:21.464418+0000","last_peered":"2024-09-12T17:28:21.464418+0000","last_clean":"2024-09-12T17:28:21.464418+0000","last_became_active":"2024-09-12T17:27:40.428529+0000","last_became_peered":"2024-09-12T17:27:40.428529+0000","last_unstale":"2024-09-12T17:28:21.464418+0000","last_undegraded":"2024-09-12T17:28:21.464418+0000","last_fullsized":"2024-09-12T17:28:21.464418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:43.412664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470025+0000","last_change":"2024-09-12T17:27:44.430001+0000","last_active":"2024-09-12T17:28:21.470025+0000","last_peered":"2024-09-12T17:28:21.470025+0000","last_clean":"2024-09-12T17:28:21.470025+0000","last_became_active":"2024-09-12T17:27:44.429701+0000","last_became_peered":"2024-09-12T17:27:44.429701+0000","last_unstale":"2024-09-12T17:28:21.470025+0000","last_undegraded":"2024-09-12T17:28:21.470025+0000","last_fullsized":"2024-09-12T17:28:21.470025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:31.928670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"31'32","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.600840+0000","last_change":"2024-09-12T17:27:46.443026+0000","last_active":"2024-09-12T17:29:47.600840+0000","last_peered":"2024-09-12T17:29:47.600840+0000","last_clean":"2024-09-12T17:29:47.600840+0000","last_became_active":"2024-09-12T17:27:46.442713+0000","last_became_peered":"2024-09-12T17:27:46.442713+0000","last_unstale":"2024-09-12T17:29:47.600840+0000","last_undegraded":"2024-09-12T17:29:47.600840+0000","last_fullsized":"2024-09-12T17:29:47.600840+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:29.878441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463885+0000","last_change":"2024-09-12T17:27:48.450563+0000","last_active":"2024-09-12T17:28:21.463885+0000","last_peered":"2024-09-12T17:28:21.463885+0000","last_clean":"2024-09-12T17:28:21.463885+0000","last_became_active":"2024-09-12T17:27:48.450050+0000","last_became_peered":"2024-09-12T17:27:48.450050+0000","last_unstale":"2024-09-12T17:28:21.463885+0000","last_undegraded":"2024-09-12T17:28:21.463885+0000","last_fullsized":"2024-09-12T17:28:21.463885+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:37.430305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"31'5","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.306851+0000","last_change":"2024-09-12T17:27:50.453680+0000","last_active":"2024-09-12T17:29:47.306851+0000","last_peered":"2024-09-12T17:29:47.306851+0000","last_clean":"2024-09-12T17:29:47.306851+0000","last_became_active":"2024-09-12T17:27:50.453382+0000","last_became_peered":"2024-09-12T17:27:50.453382+0000","last_unstale":"2024-09-12T17:29:47.306851+0000","last_undegraded":"2024-09-12T17:29:47.306851+0000","last_fullsized":"2024-09-12T17:29:47.306851+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:21.594797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"31'8","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.197223+0000","last_change":"2024-09-12T17:27:42.436403+0000","last_active":"2024-09-12T17:30:50.197223+0000","last_peered":"2024-09-12T17:30:50.197223+0000","last_clean":"2024-09-12T17:30:50.197223+0000","last_became_active":"2024-09-12T17:27:42.436150+0000","last_became_peered":"2024-09-12T17:27:42.436150+0000","last_unstale":"2024-09-12T17:30:50.197223+0000","last_undegraded":"2024-09-12T17:30:50.197223+0000","last_fullsized":"2024-09-12T17:30:50.197223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:34.481120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466884+0000","last_change":"2024-09-12T17:27:40.432404+0000","last_active":"2024-09-12T17:28:21.466884+0000","last_peered":"2024-09-12T17:28:21.466884+0000","last_clean":"2024-09-12T17:28:21.466884+0000","last_became_active":"2024-09-12T17:27:40.431962+0000","last_became_peered":"2024-09-12T17:27:40.431962+0000","last_unstale":"2024-09-12T17:28:21.466884+0000","last_undegraded":"2024-09-12T17:28:21.466884+0000","last_fullsized":"2024-09-12T17:28:21.466884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:16.839649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465368+0000","last_change":"2024-09-12T17:27:44.432604+0000","last_active":"2024-09-12T17:28:21.465368+0000","last_peered":"2024-09-12T17:28:21.465368+0000","last_clean":"2024-09-12T17:28:21.465368+0000","last_became_active":"2024-09-12T17:27:44.432334+0000","last_became_peered":"2024-09-12T17:27:44.432334+0000","last_unstale":"2024-09-12T17:28:21.465368+0000","last_undegraded":"2024-09-12T17:28:21.465368+0000","last_fullsized":"2024-09-12T17:28:21.465368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:32.282020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"31'6","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.113421+0000","last_change":"2024-09-12T17:27:46.435861+0000","last_active":"2024-09-12T17:30:49.113421+0000","last_peered":"2024-09-12T17:30:49.113421+0000","last_clean":"2024-09-12T17:30:49.113421+0000","last_became_active":"2024-09-12T17:27:46.435567+0000","last_became_peered":"2024-09-12T17:27:46.435567+0000","last_unstale":"2024-09-12T17:30:49.113421+0000","last_undegraded":"2024-09-12T17:30:49.113421+0000","last_fullsized":"2024-09-12T17:30:49.113421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:25.415585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466933+0000","last_change":"2024-09-12T17:27:48.448838+0000","last_active":"2024-09-12T17:28:21.466933+0000","last_peered":"2024-09-12T17:28:21.466933+0000","last_clean":"2024-09-12T17:28:21.466933+0000","last_became_active":"2024-09-12T17:27:48.448478+0000","last_became_peered":"2024-09-12T17:27:48.448478+0000","last_unstale":"2024-09-12T17:28:21.466933+0000","last_undegraded":"2024-09-12T17:28:21.466933+0000","last_fullsized":"2024-09-12T17:28:21.466933+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:31.633824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"31'8","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:22.316873+0000","last_change":"2024-09-12T17:27:50.449599+0000","last_active":"2024-09-12T17:28:22.316873+0000","last_peered":"2024-09-12T17:28:22.316873+0000","last_clean":"2024-09-12T17:28:22.316873+0000","last_became_active":"2024-09-12T17:27:50.449302+0000","last_became_peered":"2024-09-12T17:27:50.449302+0000","last_unstale":"2024-09-12T17:28:22.316873+0000","last_undegraded":"2024-09-12T17:28:22.316873+0000","last_fullsized":"2024-09-12T17:28:22.316873+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:02.835518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"31'4","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:05.195069+0000","last_change":"2024-09-12T17:27:42.424932+0000","last_active":"2024-09-12T17:29:05.195069+0000","last_peered":"2024-09-12T17:29:05.195069+0000","last_clean":"2024-09-12T17:29:05.195069+0000","last_became_active":"2024-09-12T17:27:42.423974+0000","last_became_peered":"2024-09-12T17:27:42.423974+0000","last_unstale":"2024-09-12T17:29:05.195069+0000","last_undegraded":"2024-09-12T17:29:05.195069+0000","last_fullsized":"2024-09-12T17:29:05.195069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:45.464780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:22.876120+0000","last_change":"2024-09-12T17:27:40.430392+0000","last_active":"2024-09-12T17:28:22.876120+0000","last_peered":"2024-09-12T17:28:22.876120+0000","last_clean":"2024-09-12T17:28:22.876120+0000","last_became_active":"2024-09-12T17:27:40.430154+0000","last_became_peered":"2024-09-12T17:27:40.430154+0000","last_unstale":"2024-09-12T17:28:22.876120+0000","last_undegraded":"2024-09-12T17:28:22.876120+0000","last_fullsized":"2024-09-12T17:28:22.876120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:51.844092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466293+0000","last_change":"2024-09-12T17:27:44.435267+0000","last_active":"2024-09-12T17:28:21.466293+0000","last_peered":"2024-09-12T17:28:21.466293+0000","last_clean":"2024-09-12T17:28:21.466293+0000","last_became_active":"2024-09-12T17:27:44.434979+0000","last_became_peered":"2024-09-12T17:27:44.434979+0000","last_unstale":"2024-09-12T17:28:21.466293+0000","last_undegraded":"2024-09-12T17:28:21.466293+0000","last_fullsized":"2024-09-12T17:28:21.466293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:20.110019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"31'43","reported_seq":107,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.902031+0000","last_change":"2024-09-12T17:27:46.433815+0000","last_active":"2024-09-12T17:30:56.902031+0000","last_peered":"2024-09-12T17:30:56.902031+0000","last_clean":"2024-09-12T17:30:56.902031+0000","last_became_active":"2024-09-12T17:27:46.433421+0000","last_became_peered":"2024-09-12T17:27:46.433421+0000","last_unstale":"2024-09-12T17:30:56.902031+0000","last_undegraded":"2024-09-12T17:30:56.902031+0000","last_fullsized":"2024-09-12T17:30:56.902031+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:46:25.118826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469750+0000","last_change":"2024-09-12T17:27:48.439853+0000","last_active":"2024-09-12T17:28:21.469750+0000","last_peered":"2024-09-12T17:28:21.469750+0000","last_clean":"2024-09-12T17:28:21.469750+0000","last_became_active":"2024-09-12T17:27:48.439547+0000","last_became_peered":"2024-09-12T17:27:48.439547+0000","last_unstale":"2024-09-12T17:28:21.469750+0000","last_undegraded":"2024-09-12T17:28:21.469750+0000","last_fullsized":"2024-09-12T17:28:21.469750+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:36.201000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464221+0000","last_change":"2024-09-12T17:27:50.459594+0000","last_active":"2024-09-12T17:28:21.464221+0000","last_peered":"2024-09-12T17:28:21.464221+0000","last_clean":"2024-09-12T17:28:21.464221+0000","last_became_active":"2024-09-12T17:27:50.459321+0000","last_became_peered":"2024-09-12T17:27:50.459321+0000","last_unstale":"2024-09-12T17:28:21.464221+0000","last_undegraded":"2024-09-12T17:28:21.464221+0000","last_fullsized":"2024-09-12T17:28:21.464221+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:42.428839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"31'14","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.226040+0000","last_change":"2024-09-12T17:27:42.428640+0000","last_active":"2024-09-12T17:30:50.226040+0000","last_peered":"2024-09-12T17:30:50.226040+0000","last_clean":"2024-09-12T17:30:50.226040+0000","last_became_active":"2024-09-12T17:27:42.428364+0000","last_became_peered":"2024-09-12T17:27:42.428364+0000","last_unstale":"2024-09-12T17:30:50.226040+0000","last_undegraded":"2024-09-12T17:30:50.226040+0000","last_fullsized":"2024-09-12T17:30:50.226040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:30.980696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.136306+0000","last_change":"2024-09-12T17:27:40.416377+0000","last_active":"2024-09-12T17:30:50.136306+0000","last_peered":"2024-09-12T17:30:50.136306+0000","last_clean":"2024-09-12T17:30:50.136306+0000","last_became_active":"2024-09-12T17:27:40.415212+0000","last_became_peered":"2024-09-12T17:27:40.415212+0000","last_unstale":"2024-09-12T17:30:50.136306+0000","last_undegraded":"2024-09-12T17:30:50.136306+0000","last_fullsized":"2024-09-12T17:30:50.136306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:08.388292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463776+0000","last_change":"2024-09-12T17:27:44.430145+0000","last_active":"2024-09-12T17:28:21.463776+0000","last_peered":"2024-09-12T17:28:21.463776+0000","last_clean":"2024-09-12T17:28:21.463776+0000","last_became_active":"2024-09-12T17:27:44.429844+0000","last_became_peered":"2024-09-12T17:27:44.429844+0000","last_unstale":"2024-09-12T17:28:21.463776+0000","last_undegraded":"2024-09-12T17:28:21.463776+0000","last_fullsized":"2024-09-12T17:28:21.463776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:59.753147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"31'34","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.892689+0000","last_change":"2024-09-12T17:27:46.432991+0000","last_active":"2024-09-12T17:30:56.892689+0000","last_peered":"2024-09-12T17:30:56.892689+0000","last_clean":"2024-09-12T17:30:56.892689+0000","last_became_active":"2024-09-12T17:27:46.432650+0000","last_became_peered":"2024-09-12T17:27:46.432650+0000","last_unstale":"2024-09-12T17:30:56.892689+0000","last_undegraded":"2024-09-12T17:30:56.892689+0000","last_fullsized":"2024-09-12T17:30:56.892689+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:21.877058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469478+0000","last_change":"2024-09-12T17:27:48.440110+0000","last_active":"2024-09-12T17:28:21.469478+0000","last_peered":"2024-09-12T17:28:21.469478+0000","last_clean":"2024-09-12T17:28:21.469478+0000","last_became_active":"2024-09-12T17:27:48.439134+0000","last_became_peered":"2024-09-12T17:27:48.439134+0000","last_unstale":"2024-09-12T17:28:21.469478+0000","last_undegraded":"2024-09-12T17:28:21.469478+0000","last_fullsized":"2024-09-12T17:28:21.469478+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:10.067239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:23.352256+0000","last_change":"2024-09-12T17:27:42.427657+0000","last_active":"2024-09-12T17:28:23.352256+0000","last_peered":"2024-09-12T17:28:23.352256+0000","last_clean":"2024-09-12T17:28:23.352256+0000","last_became_active":"2024-09-12T17:27:42.426108+0000","last_became_peered":"2024-09-12T17:27:42.426108+0000","last_unstale":"2024-09-12T17:28:23.352256+0000","last_undegraded":"2024-09-12T17:28:23.352256+0000","last_fullsized":"2024-09-12T17:28:23.352256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:46.077185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:22.871380+0000","last_change":"2024-09-12T17:27:40.430187+0000","last_active":"2024-09-12T17:28:22.871380+0000","last_peered":"2024-09-12T17:28:22.871380+0000","last_clean":"2024-09-12T17:28:22.871380+0000","last_became_active":"2024-09-12T17:27:40.429644+0000","last_became_peered":"2024-09-12T17:27:40.429644+0000","last_unstale":"2024-09-12T17:28:22.871380+0000","last_undegraded":"2024-09-12T17:28:22.871380+0000","last_fullsized":"2024-09-12T17:28:22.871380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:25.713951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:24.747265+0000","last_change":"2024-09-12T17:28:21.472039+0000","last_active":"2024-09-12T17:28:24.747265+0000","last_peered":"2024-09-12T17:28:24.747265+0000","last_clean":"2024-09-12T17:28:24.747265+0000","last_became_active":"2024-09-12T17:28:21.471678+0000","last_became_peered":"2024-09-12T17:28:21.471678+0000","last_unstale":"2024-09-12T17:28:24.747265+0000","last_undegraded":"2024-09-12T17:28:24.747265+0000","last_fullsized":"2024-09-12T17:28:24.747265+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:05.827719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"31'61","reported_seq":126,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.889697+0000","last_change":"2024-09-12T17:27:46.437943+0000","last_active":"2024-09-12T17:30:56.889697+0000","last_peered":"2024-09-12T17:30:56.889697+0000","last_clean":"2024-09-12T17:30:56.889697+0000","last_became_active":"2024-09-12T17:27:46.437623+0000","last_became_peered":"2024-09-12T17:27:46.437623+0000","last_unstale":"2024-09-12T17:30:56.889697+0000","last_undegraded":"2024-09-12T17:30:56.889697+0000","last_fullsized":"2024-09-12T17:30:56.889697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:29.626451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.467936+0000","last_change":"2024-09-12T17:27:48.440791+0000","last_active":"2024-09-12T17:28:21.467936+0000","last_peered":"2024-09-12T17:28:21.467936+0000","last_clean":"2024-09-12T17:28:21.467936+0000","last_became_active":"2024-09-12T17:27:48.440354+0000","last_became_peered":"2024-09-12T17:27:48.440354+0000","last_unstale":"2024-09-12T17:28:21.467936+0000","last_undegraded":"2024-09-12T17:28:21.467936+0000","last_fullsized":"2024-09-12T17:28:21.467936+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:12.406427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"31'14","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.013731+0000","last_change":"2024-09-12T17:27:50.457985+0000","last_active":"2024-09-12T17:29:49.013731+0000","last_peered":"2024-09-12T17:29:49.013731+0000","last_clean":"2024-09-12T17:29:49.013731+0000","last_became_active":"2024-09-12T17:27:50.457744+0000","last_became_peered":"2024-09-12T17:27:50.457744+0000","last_unstale":"2024-09-12T17:29:49.013731+0000","last_undegraded":"2024-09-12T17:29:49.013731+0000","last_fullsized":"2024-09-12T17:29:49.013731+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:13.394393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"31'6","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:05.377000+0000","last_change":"2024-09-12T17:27:42.424802+0000","last_active":"2024-09-12T17:29:05.377000+0000","last_peered":"2024-09-12T17:29:05.377000+0000","last_clean":"2024-09-12T17:29:05.377000+0000","last_became_active":"2024-09-12T17:27:42.424447+0000","last_became_peered":"2024-09-12T17:27:42.424447+0000","last_unstale":"2024-09-12T17:29:05.377000+0000","last_undegraded":"2024-09-12T17:29:05.377000+0000","last_fullsized":"2024-09-12T17:29:05.377000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:50.988456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.467680+0000","last_change":"2024-09-12T17:27:40.415772+0000","last_active":"2024-09-12T17:28:21.467680+0000","last_peered":"2024-09-12T17:28:21.467680+0000","last_clean":"2024-09-12T17:28:21.467680+0000","last_became_active":"2024-09-12T17:27:40.414911+0000","last_became_peered":"2024-09-12T17:27:40.414911+0000","last_unstale":"2024-09-12T17:28:21.467680+0000","last_undegraded":"2024-09-12T17:28:21.467680+0000","last_fullsized":"2024-09-12T17:28:21.467680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:33.541500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"31'4","reported_seq":229,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.748270+0000","last_change":"2024-09-12T17:27:44.428072+0000","last_active":"2024-09-12T17:30:56.748270+0000","last_peered":"2024-09-12T17:30:56.748270+0000","last_clean":"2024-09-12T17:30:56.748270+0000","last_became_active":"2024-09-12T17:27:44.427778+0000","last_became_peered":"2024-09-12T17:27:44.427778+0000","last_unstale":"2024-09-12T17:30:56.748270+0000","last_undegraded":"2024-09-12T17:30:56.748270+0000","last_fullsized":"2024-09-12T17:30:56.748270+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:40.229931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"31'36","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.587748+0000","last_change":"2024-09-12T17:27:46.440779+0000","last_active":"2024-09-12T17:29:47.587748+0000","last_peered":"2024-09-12T17:29:47.587748+0000","last_clean":"2024-09-12T17:29:47.587748+0000","last_became_active":"2024-09-12T17:27:46.440494+0000","last_became_peered":"2024-09-12T17:27:46.440494+0000","last_unstale":"2024-09-12T17:29:47.587748+0000","last_undegraded":"2024-09-12T17:29:47.587748+0000","last_fullsized":"2024-09-12T17:29:47.587748+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:43.434855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471249+0000","last_change":"2024-09-12T17:27:48.449171+0000","last_active":"2024-09-12T17:28:21.471249+0000","last_peered":"2024-09-12T17:28:21.471249+0000","last_clean":"2024-09-12T17:28:21.471249+0000","last_became_active":"2024-09-12T17:27:48.448871+0000","last_became_peered":"2024-09-12T17:27:48.448871+0000","last_unstale":"2024-09-12T17:28:21.471249+0000","last_undegraded":"2024-09-12T17:28:21.471249+0000","last_fullsized":"2024-09-12T17:28:21.471249+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:23.511991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463074+0000","last_change":"2024-09-12T17:27:50.452011+0000","last_active":"2024-09-12T17:28:21.463074+0000","last_peered":"2024-09-12T17:28:21.463074+0000","last_clean":"2024-09-12T17:28:21.463074+0000","last_became_active":"2024-09-12T17:27:50.451678+0000","last_became_peered":"2024-09-12T17:27:50.451678+0000","last_unstale":"2024-09-12T17:28:21.463074+0000","last_undegraded":"2024-09-12T17:28:21.463074+0000","last_fullsized":"2024-09-12T17:28:21.463074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:15.594880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.197331+0000","last_change":"2024-09-12T17:27:42.438932+0000","last_active":"2024-09-12T17:30:50.197331+0000","last_peered":"2024-09-12T17:30:50.197331+0000","last_clean":"2024-09-12T17:30:50.197331+0000","last_became_active":"2024-09-12T17:27:42.438583+0000","last_became_peered":"2024-09-12T17:27:42.438583+0000","last_unstale":"2024-09-12T17:30:50.197331+0000","last_undegraded":"2024-09-12T17:30:50.197331+0000","last_fullsized":"2024-09-12T17:30:50.197331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:41.527263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469834+0000","last_change":"2024-09-12T17:27:40.414311+0000","last_active":"2024-09-12T17:28:21.469834+0000","last_peered":"2024-09-12T17:28:21.469834+0000","last_clean":"2024-09-12T17:28:21.469834+0000","last_became_active":"2024-09-12T17:27:40.414034+0000","last_became_peered":"2024-09-12T17:27:40.414034+0000","last_unstale":"2024-09-12T17:28:21.469834+0000","last_undegraded":"2024-09-12T17:28:21.469834+0000","last_fullsized":"2024-09-12T17:28:21.469834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:02.612906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.467688+0000","last_change":"2024-09-12T17:27:44.427310+0000","last_active":"2024-09-12T17:28:21.467688+0000","last_peered":"2024-09-12T17:28:21.467688+0000","last_clean":"2024-09-12T17:28:21.467688+0000","last_became_active":"2024-09-12T17:27:44.426927+0000","last_became_peered":"2024-09-12T17:27:44.426927+0000","last_unstale":"2024-09-12T17:28:21.467688+0000","last_undegraded":"2024-09-12T17:28:21.467688+0000","last_fullsized":"2024-09-12T17:28:21.467688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:51.409386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"31'35","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.847330+0000","last_change":"2024-09-12T17:27:46.439119+0000","last_active":"2024-09-12T17:30:56.847330+0000","last_peered":"2024-09-12T17:30:56.847330+0000","last_clean":"2024-09-12T17:30:56.847330+0000","last_became_active":"2024-09-12T17:27:46.438778+0000","last_became_peered":"2024-09-12T17:27:46.438778+0000","last_unstale":"2024-09-12T17:30:56.847330+0000","last_undegraded":"2024-09-12T17:30:56.847330+0000","last_fullsized":"2024-09-12T17:30:56.847330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:47.015548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.473244+0000","last_change":"2024-09-12T17:27:48.440227+0000","last_active":"2024-09-12T17:28:21.473244+0000","last_peered":"2024-09-12T17:28:21.473244+0000","last_clean":"2024-09-12T17:28:21.473244+0000","last_became_active":"2024-09-12T17:27:48.439888+0000","last_became_peered":"2024-09-12T17:27:48.439888+0000","last_unstale":"2024-09-12T17:28:21.473244+0000","last_undegraded":"2024-09-12T17:28:21.473244+0000","last_fullsized":"2024-09-12T17:28:21.473244+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:29.484764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"31'3","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.072631+0000","last_change":"2024-09-12T17:27:50.455406+0000","last_active":"2024-09-12T17:29:49.072631+0000","last_peered":"2024-09-12T17:29:49.072631+0000","last_clean":"2024-09-12T17:29:49.072631+0000","last_became_active":"2024-09-12T17:27:50.454058+0000","last_became_peered":"2024-09-12T17:27:50.454058+0000","last_unstale":"2024-09-12T17:29:49.072631+0000","last_undegraded":"2024-09-12T17:29:49.072631+0000","last_fullsized":"2024-09-12T17:29:49.072631+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:44.719122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"31'6","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.225767+0000","last_change":"2024-09-12T17:27:42.428738+0000","last_active":"2024-09-12T17:30:50.225767+0000","last_peered":"2024-09-12T17:30:50.225767+0000","last_clean":"2024-09-12T17:30:50.225767+0000","last_became_active":"2024-09-12T17:27:42.428236+0000","last_became_peered":"2024-09-12T17:27:42.428236+0000","last_unstale":"2024-09-12T17:30:50.225767+0000","last_undegraded":"2024-09-12T17:30:50.225767+0000","last_fullsized":"2024-09-12T17:30:50.225767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:41.383292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"31'6","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.138918+0000","last_change":"2024-09-12T17:27:40.429226+0000","last_active":"2024-09-12T17:30:50.138918+0000","last_peered":"2024-09-12T17:30:50.138918+0000","last_clean":"2024-09-12T17:30:50.138918+0000","last_became_active":"2024-09-12T17:27:40.428969+0000","last_became_peered":"2024-09-12T17:27:40.428969+0000","last_unstale":"2024-09-12T17:30:50.138918+0000","last_undegraded":"2024-09-12T17:30:50.138918+0000","last_fullsized":"2024-09-12T17:30:50.138918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:34.741245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":14,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470977+0000","last_change":"2024-09-12T17:27:44.432908+0000","last_active":"2024-09-12T17:28:21.470977+0000","last_peered":"2024-09-12T17:28:21.470977+0000","last_clean":"2024-09-12T17:28:21.470977+0000","last_became_active":"2024-09-12T17:27:44.432609+0000","last_became_peered":"2024-09-12T17:27:44.432609+0000","last_unstale":"2024-09-12T17:28:21.470977+0000","last_undegraded":"2024-09-12T17:28:21.470977+0000","last_fullsized":"2024-09-12T17:28:21.470977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:38.819057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"29'10","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465451+0000","last_change":"2024-09-12T17:27:46.445145+0000","last_active":"2024-09-12T17:28:21.465451+0000","last_peered":"2024-09-12T17:28:21.465451+0000","last_clean":"2024-09-12T17:28:21.465451+0000","last_became_active":"2024-09-12T17:27:46.444644+0000","last_became_peered":"2024-09-12T17:27:46.444644+0000","last_unstale":"2024-09-12T17:28:21.465451+0000","last_undegraded":"2024-09-12T17:28:21.465451+0000","last_fullsized":"2024-09-12T17:28:21.465451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:28.337567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"31'285","reported_seq":374,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.773238+0000","last_change":"2024-09-12T17:27:48.449435+0000","last_active":"2024-09-12T17:30:56.773238+0000","last_peered":"2024-09-12T17:30:56.773238+0000","last_clean":"2024-09-12T17:30:56.773238+0000","last_became_active":"2024-09-12T17:27:48.449138+0000","last_became_peered":"2024-09-12T17:27:48.449138+0000","last_unstale":"2024-09-12T17:30:56.773238+0000","last_undegraded":"2024-09-12T17:30:56.773238+0000","last_fullsized":"2024-09-12T17:30:56.773238+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:43.994480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.462765+0000","last_change":"2024-09-12T17:27:50.452165+0000","last_active":"2024-09-12T17:28:21.462765+0000","last_peered":"2024-09-12T17:28:21.462765+0000","last_clean":"2024-09-12T17:28:21.462765+0000","last_became_active":"2024-09-12T17:27:50.451899+0000","last_became_peered":"2024-09-12T17:27:50.451899+0000","last_unstale":"2024-09-12T17:28:21.462765+0000","last_undegraded":"2024-09-12T17:28:21.462765+0000","last_fullsized":"2024-09-12T17:28:21.462765+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:38.778216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"31'8","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.195915+0000","last_change":"2024-09-12T17:27:42.430391+0000","last_active":"2024-09-12T17:30:50.195915+0000","last_peered":"2024-09-12T17:30:50.195915+0000","last_clean":"2024-09-12T17:30:50.195915+0000","last_became_active":"2024-09-12T17:27:42.430110+0000","last_became_peered":"2024-09-12T17:27:42.430110+0000","last_unstale":"2024-09-12T17:30:50.195915+0000","last_undegraded":"2024-09-12T17:30:50.195915+0000","last_fullsized":"2024-09-12T17:30:50.195915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:09.624789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:48.918402+0000","last_change":"2024-09-12T17:27:40.415902+0000","last_active":"2024-09-12T17:29:48.918402+0000","last_peered":"2024-09-12T17:29:48.918402+0000","last_clean":"2024-09-12T17:29:48.918402+0000","last_became_active":"2024-09-12T17:27:40.415018+0000","last_became_peered":"2024-09-12T17:27:40.415018+0000","last_unstale":"2024-09-12T17:29:48.918402+0000","last_undegraded":"2024-09-12T17:29:48.918402+0000","last_fullsized":"2024-09-12T17:29:48.918402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:40.407846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470596+0000","last_change":"2024-09-12T17:27:44.433006+0000","last_active":"2024-09-12T17:28:21.470596+0000","last_peered":"2024-09-12T17:28:21.470596+0000","last_clean":"2024-09-12T17:28:21.470596+0000","last_became_active":"2024-09-12T17:27:44.432389+0000","last_became_peered":"2024-09-12T17:27:44.432389+0000","last_unstale":"2024-09-12T17:28:21.470596+0000","last_undegraded":"2024-09-12T17:28:21.470596+0000","last_fullsized":"2024-09-12T17:28:21.470596+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:18.314088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"31'39","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.867839+0000","last_change":"2024-09-12T17:27:46.437010+0000","last_active":"2024-09-12T17:30:56.867839+0000","last_peered":"2024-09-12T17:30:56.867839+0000","last_clean":"2024-09-12T17:30:56.867839+0000","last_became_active":"2024-09-12T17:27:46.435056+0000","last_became_peered":"2024-09-12T17:27:46.435056+0000","last_unstale":"2024-09-12T17:30:56.867839+0000","last_undegraded":"2024-09-12T17:30:56.867839+0000","last_fullsized":"2024-09-12T17:30:56.867839+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:41.987106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470481+0000","last_change":"2024-09-12T17:27:48.451418+0000","last_active":"2024-09-12T17:28:21.470481+0000","last_peered":"2024-09-12T17:28:21.470481+0000","last_clean":"2024-09-12T17:28:21.470481+0000","last_became_active":"2024-09-12T17:27:48.451143+0000","last_became_peered":"2024-09-12T17:27:48.451143+0000","last_unstale":"2024-09-12T17:28:21.470481+0000","last_undegraded":"2024-09-12T17:28:21.470481+0000","last_fullsized":"2024-09-12T17:28:21.470481+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:05.841062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469983+0000","last_change":"2024-09-12T17:27:50.459043+0000","last_active":"2024-09-12T17:28:21.469983+0000","last_peered":"2024-09-12T17:28:21.469983+0000","last_clean":"2024-09-12T17:28:21.469983+0000","last_became_active":"2024-09-12T17:27:50.458688+0000","last_became_peered":"2024-09-12T17:27:50.458688+0000","last_unstale":"2024-09-12T17:28:21.469983+0000","last_undegraded":"2024-09-12T17:28:21.469983+0000","last_fullsized":"2024-09-12T17:28:21.469983+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:52.579121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'17","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.936036+0000","last_change":"2024-09-12T17:27:42.429938+0000","last_active":"2024-09-12T17:30:49.936036+0000","last_peered":"2024-09-12T17:30:49.936036+0000","last_clean":"2024-09-12T17:30:49.936036+0000","last_became_active":"2024-09-12T17:27:42.429645+0000","last_became_peered":"2024-09-12T17:27:42.429645+0000","last_unstale":"2024-09-12T17:30:49.936036+0000","last_undegraded":"2024-09-12T17:30:49.936036+0000","last_fullsized":"2024-09-12T17:30:49.936036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:26.167048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":59,"num_read_kb":51,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465519+0000","last_change":"2024-09-12T17:27:40.433842+0000","last_active":"2024-09-12T17:28:21.465519+0000","last_peered":"2024-09-12T17:28:21.465519+0000","last_clean":"2024-09-12T17:28:21.465519+0000","last_became_active":"2024-09-12T17:27:40.433580+0000","last_became_peered":"2024-09-12T17:27:40.433580+0000","last_unstale":"2024-09-12T17:28:21.465519+0000","last_undegraded":"2024-09-12T17:28:21.465519+0000","last_fullsized":"2024-09-12T17:28:21.465519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:42.180970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469077+0000","last_change":"2024-09-12T17:27:44.433816+0000","last_active":"2024-09-12T17:28:21.469077+0000","last_peered":"2024-09-12T17:28:21.469077+0000","last_clean":"2024-09-12T17:28:21.469077+0000","last_became_active":"2024-09-12T17:27:44.433529+0000","last_became_peered":"2024-09-12T17:27:44.433529+0000","last_unstale":"2024-09-12T17:28:21.469077+0000","last_undegraded":"2024-09-12T17:28:21.469077+0000","last_fullsized":"2024-09-12T17:28:21.469077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:41.042095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"31'35","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.871259+0000","last_change":"2024-09-12T17:27:46.439345+0000","last_active":"2024-09-12T17:30:56.871259+0000","last_peered":"2024-09-12T17:30:56.871259+0000","last_clean":"2024-09-12T17:30:56.871259+0000","last_became_active":"2024-09-12T17:27:46.439037+0000","last_became_peered":"2024-09-12T17:27:46.439037+0000","last_unstale":"2024-09-12T17:30:56.871259+0000","last_undegraded":"2024-09-12T17:30:56.871259+0000","last_fullsized":"2024-09-12T17:30:56.871259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:39.381080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463052+0000","last_change":"2024-09-12T17:27:48.449101+0000","last_active":"2024-09-12T17:28:21.463052+0000","last_peered":"2024-09-12T17:28:21.463052+0000","last_clean":"2024-09-12T17:28:21.463052+0000","last_became_active":"2024-09-12T17:27:48.448426+0000","last_became_peered":"2024-09-12T17:27:48.448426+0000","last_unstale":"2024-09-12T17:28:21.463052+0000","last_undegraded":"2024-09-12T17:28:21.463052+0000","last_fullsized":"2024-09-12T17:28:21.463052+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:18.516470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464580+0000","last_change":"2024-09-12T17:27:50.459948+0000","last_active":"2024-09-12T17:28:21.464580+0000","last_peered":"2024-09-12T17:28:21.464580+0000","last_clean":"2024-09-12T17:28:21.464580+0000","last_became_active":"2024-09-12T17:27:50.459662+0000","last_became_peered":"2024-09-12T17:27:50.459662+0000","last_unstale":"2024-09-12T17:28:21.464580+0000","last_undegraded":"2024-09-12T17:28:21.464580+0000","last_fullsized":"2024-09-12T17:28:21.464580+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:08.216661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'12","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.148532+0000","last_change":"2024-09-12T17:28:21.476547+0000","last_active":"2024-09-12T17:30:50.148532+0000","last_peered":"2024-09-12T17:30:50.148532+0000","last_clean":"2024-09-12T17:30:50.148532+0000","last_became_active":"2024-09-12T17:28:21.472532+0000","last_became_peered":"2024-09-12T17:28:21.472532+0000","last_unstale":"2024-09-12T17:30:50.148532+0000","last_undegraded":"2024-09-12T17:30:50.148532+0000","last_fullsized":"2024-09-12T17:30:50.148532+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:31.654192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.865073+0000","last_change":"2024-09-12T17:27:40.419012+0000","last_active":"2024-09-12T17:30:49.865073+0000","last_peered":"2024-09-12T17:30:49.865073+0000","last_clean":"2024-09-12T17:30:49.865073+0000","last_became_active":"2024-09-12T17:27:40.418464+0000","last_became_peered":"2024-09-12T17:27:40.418464+0000","last_unstale":"2024-09-12T17:30:49.865073+0000","last_undegraded":"2024-09-12T17:30:49.865073+0000","last_fullsized":"2024-09-12T17:30:49.865073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:41.313682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469583+0000","last_change":"2024-09-12T17:27:44.433348+0000","last_active":"2024-09-12T17:28:21.469583+0000","last_peered":"2024-09-12T17:28:21.469583+0000","last_clean":"2024-09-12T17:28:21.469583+0000","last_became_active":"2024-09-12T17:27:44.430221+0000","last_became_peered":"2024-09-12T17:27:44.430221+0000","last_unstale":"2024-09-12T17:28:21.469583+0000","last_undegraded":"2024-09-12T17:28:21.469583+0000","last_fullsized":"2024-09-12T17:28:21.469583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:13.176204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"31'26","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.602901+0000","last_change":"2024-09-12T17:27:46.441427+0000","last_active":"2024-09-12T17:29:47.602901+0000","last_peered":"2024-09-12T17:29:47.602901+0000","last_clean":"2024-09-12T17:29:47.602901+0000","last_became_active":"2024-09-12T17:27:46.441081+0000","last_became_peered":"2024-09-12T17:27:46.441081+0000","last_unstale":"2024-09-12T17:29:47.602901+0000","last_undegraded":"2024-09-12T17:29:47.602901+0000","last_fullsized":"2024-09-12T17:29:47.602901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:08.132341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463313+0000","last_change":"2024-09-12T17:27:48.447632+0000","last_active":"2024-09-12T17:28:21.463313+0000","last_peered":"2024-09-12T17:28:21.463313+0000","last_clean":"2024-09-12T17:28:21.463313+0000","last_became_active":"2024-09-12T17:27:48.447321+0000","last_became_peered":"2024-09-12T17:27:48.447321+0000","last_unstale":"2024-09-12T17:28:21.463313+0000","last_undegraded":"2024-09-12T17:28:21.463313+0000","last_fullsized":"2024-09-12T17:28:21.463313+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:43.865345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"31'10","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.181767+0000","last_change":"2024-09-12T17:27:50.460271+0000","last_active":"2024-09-12T17:30:49.181767+0000","last_peered":"2024-09-12T17:30:49.181767+0000","last_clean":"2024-09-12T17:30:49.181767+0000","last_became_active":"2024-09-12T17:27:50.459463+0000","last_became_peered":"2024-09-12T17:27:50.459463+0000","last_unstale":"2024-09-12T17:30:49.181767+0000","last_undegraded":"2024-09-12T17:30:49.181767+0000","last_fullsized":"2024-09-12T17:30:49.181767+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:18.316219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"31'17","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.232329+0000","last_change":"2024-09-12T17:27:42.430374+0000","last_active":"2024-09-12T17:30:50.232329+0000","last_peered":"2024-09-12T17:30:50.232329+0000","last_clean":"2024-09-12T17:30:50.232329+0000","last_became_active":"2024-09-12T17:27:42.430021+0000","last_became_peered":"2024-09-12T17:27:42.430021+0000","last_unstale":"2024-09-12T17:30:50.232329+0000","last_undegraded":"2024-09-12T17:30:50.232329+0000","last_fullsized":"2024-09-12T17:30:50.232329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:54.683103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":76,"num_read_kb":68,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470409+0000","last_change":"2024-09-12T17:27:40.416382+0000","last_active":"2024-09-12T17:28:21.470409+0000","last_peered":"2024-09-12T17:28:21.470409+0000","last_clean":"2024-09-12T17:28:21.470409+0000","last_became_active":"2024-09-12T17:27:40.415549+0000","last_became_peered":"2024-09-12T17:27:40.415549+0000","last_unstale":"2024-09-12T17:28:21.470409+0000","last_undegraded":"2024-09-12T17:28:21.470409+0000","last_fullsized":"2024-09-12T17:28:21.470409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:42:31.960679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"31'2","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:46.228947+0000","last_change":"2024-09-12T17:27:44.433362+0000","last_active":"2024-09-12T17:29:46.228947+0000","last_peered":"2024-09-12T17:29:46.228947+0000","last_clean":"2024-09-12T17:29:46.228947+0000","last_became_active":"2024-09-12T17:27:44.433037+0000","last_became_peered":"2024-09-12T17:27:44.433037+0000","last_unstale":"2024-09-12T17:29:46.228947+0000","last_undegraded":"2024-09-12T17:29:46.228947+0000","last_fullsized":"2024-09-12T17:29:46.228947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:52.650681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"31'33","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.096185+0000","last_change":"2024-09-12T17:27:46.443590+0000","last_active":"2024-09-12T17:30:49.096185+0000","last_peered":"2024-09-12T17:30:49.096185+0000","last_clean":"2024-09-12T17:30:49.096185+0000","last_became_active":"2024-09-12T17:27:46.443316+0000","last_became_peered":"2024-09-12T17:27:46.443316+0000","last_unstale":"2024-09-12T17:30:49.096185+0000","last_undegraded":"2024-09-12T17:30:49.096185+0000","last_fullsized":"2024-09-12T17:30:49.096185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:47.273927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471547+0000","last_change":"2024-09-12T17:27:48.448239+0000","last_active":"2024-09-12T17:28:21.471547+0000","last_peered":"2024-09-12T17:28:21.471547+0000","last_clean":"2024-09-12T17:28:21.471547+0000","last_became_active":"2024-09-12T17:27:48.447884+0000","last_became_peered":"2024-09-12T17:27:48.447884+0000","last_unstale":"2024-09-12T17:28:21.471547+0000","last_undegraded":"2024-09-12T17:28:21.471547+0000","last_fullsized":"2024-09-12T17:28:21.471547+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:37.799636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"31'2","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.614754+0000","last_change":"2024-09-12T17:27:50.459747+0000","last_active":"2024-09-12T17:29:47.614754+0000","last_peered":"2024-09-12T17:29:47.614754+0000","last_clean":"2024-09-12T17:29:47.614754+0000","last_became_active":"2024-09-12T17:27:50.459464+0000","last_became_peered":"2024-09-12T17:27:50.459464+0000","last_unstale":"2024-09-12T17:29:47.614754+0000","last_undegraded":"2024-09-12T17:29:47.614754+0000","last_fullsized":"2024-09-12T17:29:47.614754+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:47.424145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"31'6","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.018176+0000","last_change":"2024-09-12T17:28:21.475279+0000","last_active":"2024-09-12T17:30:50.018176+0000","last_peered":"2024-09-12T17:30:50.018176+0000","last_clean":"2024-09-12T17:30:50.018176+0000","last_became_active":"2024-09-12T17:28:21.471738+0000","last_became_peered":"2024-09-12T17:28:21.471738+0000","last_unstale":"2024-09-12T17:30:50.018176+0000","last_undegraded":"2024-09-12T17:30:50.018176+0000","last_fullsized":"2024-09-12T17:30:50.018176+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:24.585090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.870117+0000","last_change":"2024-09-12T17:27:40.425416+0000","last_active":"2024-09-12T17:30:49.870117+0000","last_peered":"2024-09-12T17:30:49.870117+0000","last_clean":"2024-09-12T17:30:49.870117+0000","last_became_active":"2024-09-12T17:27:40.425150+0000","last_became_peered":"2024-09-12T17:27:40.425150+0000","last_unstale":"2024-09-12T17:30:49.870117+0000","last_undegraded":"2024-09-12T17:30:49.870117+0000","last_fullsized":"2024-09-12T17:30:49.870117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:44.782205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"31'6","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.225756+0000","last_change":"2024-09-12T17:27:42.428098+0000","last_active":"2024-09-12T17:30:50.225756+0000","last_peered":"2024-09-12T17:30:50.225756+0000","last_clean":"2024-09-12T17:30:50.225756+0000","last_became_active":"2024-09-12T17:27:42.427745+0000","last_became_peered":"2024-09-12T17:27:42.427745+0000","last_unstale":"2024-09-12T17:30:50.225756+0000","last_undegraded":"2024-09-12T17:30:50.225756+0000","last_fullsized":"2024-09-12T17:30:50.225756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:27.653203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470803+0000","last_change":"2024-09-12T17:27:40.413378+0000","last_active":"2024-09-12T17:28:21.470803+0000","last_peered":"2024-09-12T17:28:21.470803+0000","last_clean":"2024-09-12T17:28:21.470803+0000","last_became_active":"2024-09-12T17:27:40.413068+0000","last_became_peered":"2024-09-12T17:27:40.413068+0000","last_unstale":"2024-09-12T17:28:21.470803+0000","last_undegraded":"2024-09-12T17:28:21.470803+0000","last_fullsized":"2024-09-12T17:28:21.470803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:35.900609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465685+0000","last_change":"2024-09-12T17:27:42.429127+0000","last_active":"2024-09-12T17:28:21.465685+0000","last_peered":"2024-09-12T17:28:21.465685+0000","last_clean":"2024-09-12T17:28:21.465685+0000","last_became_active":"2024-09-12T17:27:42.428871+0000","last_became_peered":"2024-09-12T17:27:42.428871+0000","last_unstale":"2024-09-12T17:28:21.465685+0000","last_undegraded":"2024-09-12T17:28:21.465685+0000","last_fullsized":"2024-09-12T17:28:21.465685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:46.400627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464105+0000","last_change":"2024-09-12T17:27:40.423623+0000","last_active":"2024-09-12T17:28:21.464105+0000","last_peered":"2024-09-12T17:28:21.464105+0000","last_clean":"2024-09-12T17:28:21.464105+0000","last_became_active":"2024-09-12T17:27:40.423210+0000","last_became_peered":"2024-09-12T17:27:40.423210+0000","last_unstale":"2024-09-12T17:28:21.464105+0000","last_undegraded":"2024-09-12T17:28:21.464105+0000","last_fullsized":"2024-09-12T17:28:21.464105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:10.561707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"31'10","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.148353+0000","last_change":"2024-09-12T17:27:42.428508+0000","last_active":"2024-09-12T17:30:50.148353+0000","last_peered":"2024-09-12T17:30:50.148353+0000","last_clean":"2024-09-12T17:30:50.148353+0000","last_became_active":"2024-09-12T17:27:42.428059+0000","last_became_peered":"2024-09-12T17:27:42.428059+0000","last_unstale":"2024-09-12T17:30:50.148353+0000","last_undegraded":"2024-09-12T17:30:50.148353+0000","last_fullsized":"2024-09-12T17:30:50.148353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:35.350838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.821850+0000","last_change":"2024-09-12T17:27:40.420118+0000","last_active":"2024-09-12T17:28:21.821850+0000","last_peered":"2024-09-12T17:28:21.821850+0000","last_clean":"2024-09-12T17:28:21.821850+0000","last_became_active":"2024-09-12T17:27:40.419018+0000","last_became_peered":"2024-09-12T17:27:40.419018+0000","last_unstale":"2024-09-12T17:28:21.821850+0000","last_undegraded":"2024-09-12T17:28:21.821850+0000","last_fullsized":"2024-09-12T17:28:21.821850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:45.609329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"31'4","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:23.352679+0000","last_change":"2024-09-12T17:27:42.425653+0000","last_active":"2024-09-12T17:28:23.352679+0000","last_peered":"2024-09-12T17:28:23.352679+0000","last_clean":"2024-09-12T17:28:23.352679+0000","last_became_active":"2024-09-12T17:27:42.424201+0000","last_became_peered":"2024-09-12T17:27:42.424201+0000","last_unstale":"2024-09-12T17:28:23.352679+0000","last_undegraded":"2024-09-12T17:28:23.352679+0000","last_fullsized":"2024-09-12T17:28:23.352679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:14.199032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.472579+0000","last_change":"2024-09-12T17:27:40.415678+0000","last_active":"2024-09-12T17:28:21.472579+0000","last_peered":"2024-09-12T17:28:21.472579+0000","last_clean":"2024-09-12T17:28:21.472579+0000","last_became_active":"2024-09-12T17:27:40.415318+0000","last_became_peered":"2024-09-12T17:27:40.415318+0000","last_unstale":"2024-09-12T17:28:21.472579+0000","last_undegraded":"2024-09-12T17:28:21.472579+0000","last_fullsized":"2024-09-12T17:28:21.472579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:42.195527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"31'6","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.225777+0000","last_change":"2024-09-12T17:27:42.434915+0000","last_active":"2024-09-12T17:30:50.225777+0000","last_peered":"2024-09-12T17:30:50.225777+0000","last_clean":"2024-09-12T17:30:50.225777+0000","last_became_active":"2024-09-12T17:27:42.434664+0000","last_became_peered":"2024-09-12T17:27:42.434664+0000","last_unstale":"2024-09-12T17:30:50.225777+0000","last_undegraded":"2024-09-12T17:30:50.225777+0000","last_fullsized":"2024-09-12T17:30:50.225777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:59.091747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:22.296581+0000","last_change":"2024-09-12T17:27:40.421011+0000","last_active":"2024-09-12T17:28:22.296581+0000","last_peered":"2024-09-12T17:28:22.296581+0000","last_clean":"2024-09-12T17:28:22.296581+0000","last_became_active":"2024-09-12T17:27:40.420491+0000","last_became_peered":"2024-09-12T17:27:40.420491+0000","last_unstale":"2024-09-12T17:28:22.296581+0000","last_undegraded":"2024-09-12T17:28:22.296581+0000","last_fullsized":"2024-09-12T17:28:22.296581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:35.277806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"31'10","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:05.194652+0000","last_change":"2024-09-12T17:27:42.425216+0000","last_active":"2024-09-12T17:29:05.194652+0000","last_peered":"2024-09-12T17:29:05.194652+0000","last_clean":"2024-09-12T17:29:05.194652+0000","last_became_active":"2024-09-12T17:27:42.424810+0000","last_became_peered":"2024-09-12T17:27:42.424810+0000","last_unstale":"2024-09-12T17:29:05.194652+0000","last_undegraded":"2024-09-12T17:29:05.194652+0000","last_fullsized":"2024-09-12T17:29:05.194652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:08.170045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":37,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469473+0000","last_change":"2024-09-12T17:27:40.431654+0000","last_active":"2024-09-12T17:28:21.469473+0000","last_peered":"2024-09-12T17:28:21.469473+0000","last_clean":"2024-09-12T17:28:21.469473+0000","last_became_active":"2024-09-12T17:27:40.431365+0000","last_became_peered":"2024-09-12T17:27:40.431365+0000","last_unstale":"2024-09-12T17:28:21.469473+0000","last_undegraded":"2024-09-12T17:28:21.469473+0000","last_fullsized":"2024-09-12T17:28:21.469473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:42:31.960679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"31'13","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.202797+0000","last_change":"2024-09-12T17:27:42.423482+0000","last_active":"2024-09-12T17:30:50.202797+0000","last_peered":"2024-09-12T17:30:50.202797+0000","last_clean":"2024-09-12T17:30:50.202797+0000","last_became_active":"2024-09-12T17:27:42.423099+0000","last_became_peered":"2024-09-12T17:27:42.423099+0000","last_unstale":"2024-09-12T17:30:50.202797+0000","last_undegraded":"2024-09-12T17:30:50.202797+0000","last_fullsized":"2024-09-12T17:30:50.202797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:16.940321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.822005+0000","last_change":"2024-09-12T17:27:40.415799+0000","last_active":"2024-09-12T17:28:21.822005+0000","last_peered":"2024-09-12T17:28:21.822005+0000","last_clean":"2024-09-12T17:28:21.822005+0000","last_became_active":"2024-09-12T17:27:40.415456+0000","last_became_peered":"2024-09-12T17:27:40.415456+0000","last_unstale":"2024-09-12T17:28:21.822005+0000","last_undegraded":"2024-09-12T17:28:21.822005+0000","last_fullsized":"2024-09-12T17:28:21.822005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:28.905045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"31'7","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.024232+0000","last_change":"2024-09-12T17:27:42.428053+0000","last_active":"2024-09-12T17:30:50.024232+0000","last_peered":"2024-09-12T17:30:50.024232+0000","last_clean":"2024-09-12T17:30:50.024232+0000","last_became_active":"2024-09-12T17:27:42.427778+0000","last_became_peered":"2024-09-12T17:27:42.427778+0000","last_unstale":"2024-09-12T17:30:50.024232+0000","last_undegraded":"2024-09-12T17:30:50.024232+0000","last_fullsized":"2024-09-12T17:30:50.024232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:29.654847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"31'1","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:50.765249+0000","last_change":"2024-09-12T17:27:40.418491+0000","last_active":"2024-09-12T17:29:50.765249+0000","last_peered":"2024-09-12T17:29:50.765249+0000","last_clean":"2024-09-12T17:29:50.765249+0000","last_became_active":"2024-09-12T17:27:40.418241+0000","last_became_peered":"2024-09-12T17:27:40.418241+0000","last_unstale":"2024-09-12T17:29:50.765249+0000","last_undegraded":"2024-09-12T17:29:50.765249+0000","last_fullsized":"2024-09-12T17:29:50.765249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:44.106061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:22.319225+0000","last_change":"2024-09-12T17:27:42.433339+0000","last_active":"2024-09-12T17:28:22.319225+0000","last_peered":"2024-09-12T17:28:22.319225+0000","last_clean":"2024-09-12T17:28:22.319225+0000","last_became_active":"2024-09-12T17:27:42.433084+0000","last_became_peered":"2024-09-12T17:27:42.433084+0000","last_unstale":"2024-09-12T17:28:22.319225+0000","last_undegraded":"2024-09-12T17:28:22.319225+0000","last_fullsized":"2024-09-12T17:28:22.319225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:14.732392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.822515+0000","last_change":"2024-09-12T17:27:40.418064+0000","last_active":"2024-09-12T17:28:21.822515+0000","last_peered":"2024-09-12T17:28:21.822515+0000","last_clean":"2024-09-12T17:28:21.822515+0000","last_became_active":"2024-09-12T17:27:40.417666+0000","last_became_peered":"2024-09-12T17:27:40.417666+0000","last_unstale":"2024-09-12T17:28:21.822515+0000","last_undegraded":"2024-09-12T17:28:21.822515+0000","last_fullsized":"2024-09-12T17:28:21.822515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:13.932643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"31'8","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.148411+0000","last_change":"2024-09-12T17:27:42.424818+0000","last_active":"2024-09-12T17:30:50.148411+0000","last_peered":"2024-09-12T17:30:50.148411+0000","last_clean":"2024-09-12T17:30:50.148411+0000","last_became_active":"2024-09-12T17:27:42.424017+0000","last_became_peered":"2024-09-12T17:27:42.424017+0000","last_unstale":"2024-09-12T17:30:50.148411+0000","last_undegraded":"2024-09-12T17:30:50.148411+0000","last_fullsized":"2024-09-12T17:30:50.148411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:22.656734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469834+0000","last_change":"2024-09-12T17:27:40.422351+0000","last_active":"2024-09-12T17:28:21.469834+0000","last_peered":"2024-09-12T17:28:21.469834+0000","last_clean":"2024-09-12T17:28:21.469834+0000","last_became_active":"2024-09-12T17:27:40.418964+0000","last_became_peered":"2024-09-12T17:27:40.418964+0000","last_unstale":"2024-09-12T17:28:21.469834+0000","last_undegraded":"2024-09-12T17:28:21.469834+0000","last_fullsized":"2024-09-12T17:28:21.469834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:51.844092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"31'6","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.076791+0000","last_change":"2024-09-12T17:27:42.424747+0000","last_active":"2024-09-12T17:29:49.076791+0000","last_peered":"2024-09-12T17:29:49.076791+0000","last_clean":"2024-09-12T17:29:49.076791+0000","last_became_active":"2024-09-12T17:27:42.422955+0000","last_became_peered":"2024-09-12T17:27:42.422955+0000","last_unstale":"2024-09-12T17:29:49.076791+0000","last_undegraded":"2024-09-12T17:29:49.076791+0000","last_fullsized":"2024-09-12T17:29:49.076791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:41.422424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.467383+0000","last_change":"2024-09-12T17:27:40.418452+0000","last_active":"2024-09-12T17:28:21.467383+0000","last_peered":"2024-09-12T17:28:21.467383+0000","last_clean":"2024-09-12T17:28:21.467383+0000","last_became_active":"2024-09-12T17:27:40.418183+0000","last_became_peered":"2024-09-12T17:27:40.418183+0000","last_unstale":"2024-09-12T17:28:21.467383+0000","last_undegraded":"2024-09-12T17:28:21.467383+0000","last_fullsized":"2024-09-12T17:28:21.467383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:35.210863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"31'5","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.233331+0000","last_change":"2024-09-12T17:27:42.434117+0000","last_active":"2024-09-12T17:30:50.233331+0000","last_peered":"2024-09-12T17:30:50.233331+0000","last_clean":"2024-09-12T17:30:50.233331+0000","last_became_active":"2024-09-12T17:27:42.433856+0000","last_became_peered":"2024-09-12T17:27:42.433856+0000","last_unstale":"2024-09-12T17:30:50.233331+0000","last_undegraded":"2024-09-12T17:30:50.233331+0000","last_fullsized":"2024-09-12T17:30:50.233331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:13.817201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464738+0000","last_change":"2024-09-12T17:27:40.429406+0000","last_active":"2024-09-12T17:28:21.464738+0000","last_peered":"2024-09-12T17:28:21.464738+0000","last_clean":"2024-09-12T17:28:21.464738+0000","last_became_active":"2024-09-12T17:27:40.428213+0000","last_became_peered":"2024-09-12T17:27:40.428213+0000","last_unstale":"2024-09-12T17:28:21.464738+0000","last_undegraded":"2024-09-12T17:28:21.464738+0000","last_fullsized":"2024-09-12T17:28:21.464738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:43.804492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"31'4","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:05.194819+0000","last_change":"2024-09-12T17:27:42.431854+0000","last_active":"2024-09-12T17:29:05.194819+0000","last_peered":"2024-09-12T17:29:05.194819+0000","last_clean":"2024-09-12T17:29:05.194819+0000","last_became_active":"2024-09-12T17:27:42.431562+0000","last_became_peered":"2024-09-12T17:27:42.431562+0000","last_unstale":"2024-09-12T17:29:05.194819+0000","last_undegraded":"2024-09-12T17:29:05.194819+0000","last_fullsized":"2024-09-12T17:29:05.194819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:46.641338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"31'4","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.909000+0000","last_change":"2024-09-12T17:27:40.426248+0000","last_active":"2024-09-12T17:30:49.909000+0000","last_peered":"2024-09-12T17:30:49.909000+0000","last_clean":"2024-09-12T17:30:49.909000+0000","last_became_active":"2024-09-12T17:27:40.425910+0000","last_became_peered":"2024-09-12T17:27:40.425910+0000","last_unstale":"2024-09-12T17:30:49.909000+0000","last_undegraded":"2024-09-12T17:30:49.909000+0000","last_fullsized":"2024-09-12T17:30:49.909000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:23.924826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"31'10","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.018646+0000","last_change":"2024-09-12T17:27:42.429554+0000","last_active":"2024-09-12T17:30:50.018646+0000","last_peered":"2024-09-12T17:30:50.018646+0000","last_clean":"2024-09-12T17:30:50.018646+0000","last_became_active":"2024-09-12T17:27:42.429270+0000","last_became_peered":"2024-09-12T17:27:42.429270+0000","last_unstale":"2024-09-12T17:30:50.018646+0000","last_undegraded":"2024-09-12T17:30:50.018646+0000","last_fullsized":"2024-09-12T17:30:50.018646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:32.810941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.054755+0000","last_change":"2024-09-12T17:27:40.432092+0000","last_active":"2024-09-12T17:29:49.054755+0000","last_peered":"2024-09-12T17:29:49.054755+0000","last_clean":"2024-09-12T17:29:49.054755+0000","last_became_active":"2024-09-12T17:27:40.431687+0000","last_became_peered":"2024-09-12T17:27:40.431687+0000","last_unstale":"2024-09-12T17:29:49.054755+0000","last_undegraded":"2024-09-12T17:29:49.054755+0000","last_fullsized":"2024-09-12T17:29:49.054755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:35.277806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"31'2","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.280728+0000","last_change":"2024-09-12T17:27:42.425651+0000","last_active":"2024-09-12T17:30:50.280728+0000","last_peered":"2024-09-12T17:30:50.280728+0000","last_clean":"2024-09-12T17:30:50.280728+0000","last_became_active":"2024-09-12T17:27:42.424910+0000","last_became_peered":"2024-09-12T17:27:42.424910+0000","last_unstale":"2024-09-12T17:30:50.280728+0000","last_undegraded":"2024-09-12T17:30:50.280728+0000","last_fullsized":"2024-09-12T17:30:50.280728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:52.600151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"31'1","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:00.767359+0000","last_change":"2024-09-12T17:27:40.434016+0000","last_active":"2024-09-12T17:30:00.767359+0000","last_peered":"2024-09-12T17:30:00.767359+0000","last_clean":"2024-09-12T17:30:00.767359+0000","last_became_active":"2024-09-12T17:27:40.433649+0000","last_became_peered":"2024-09-12T17:27:40.433649+0000","last_unstale":"2024-09-12T17:30:00.767359+0000","last_undegraded":"2024-09-12T17:30:00.767359+0000","last_fullsized":"2024-09-12T17:30:00.767359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:40.824207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:48.985835+0000","last_change":"2024-09-12T17:27:40.424269+0000","last_active":"2024-09-12T17:29:48.985835+0000","last_peered":"2024-09-12T17:29:48.985835+0000","last_clean":"2024-09-12T17:29:48.985835+0000","last_became_active":"2024-09-12T17:27:40.423343+0000","last_became_peered":"2024-09-12T17:27:40.423343+0000","last_unstale":"2024-09-12T17:29:48.985835+0000","last_undegraded":"2024-09-12T17:29:48.985835+0000","last_fullsized":"2024-09-12T17:29:48.985835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:04.434511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"31'8","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.196783+0000","last_change":"2024-09-12T17:27:42.426434+0000","last_active":"2024-09-12T17:30:50.196783+0000","last_peered":"2024-09-12T17:30:50.196783+0000","last_clean":"2024-09-12T17:30:50.196783+0000","last_became_active":"2024-09-12T17:27:42.426150+0000","last_became_peered":"2024-09-12T17:27:42.426150+0000","last_unstale":"2024-09-12T17:30:50.196783+0000","last_undegraded":"2024-09-12T17:30:50.196783+0000","last_fullsized":"2024-09-12T17:30:50.196783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:55.894831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471017+0000","last_change":"2024-09-12T17:27:40.420741+0000","last_active":"2024-09-12T17:28:21.471017+0000","last_peered":"2024-09-12T17:28:21.471017+0000","last_clean":"2024-09-12T17:28:21.471017+0000","last_became_active":"2024-09-12T17:27:40.420396+0000","last_became_peered":"2024-09-12T17:27:40.420396+0000","last_unstale":"2024-09-12T17:28:21.471017+0000","last_undegraded":"2024-09-12T17:28:21.471017+0000","last_fullsized":"2024-09-12T17:28:21.471017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:47.834956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"31'4","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.018441+0000","last_change":"2024-09-12T17:27:42.435623+0000","last_active":"2024-09-12T17:30:50.018441+0000","last_peered":"2024-09-12T17:30:50.018441+0000","last_clean":"2024-09-12T17:30:50.018441+0000","last_became_active":"2024-09-12T17:27:42.435324+0000","last_became_peered":"2024-09-12T17:27:42.435324+0000","last_unstale":"2024-09-12T17:30:50.018441+0000","last_undegraded":"2024-09-12T17:30:50.018441+0000","last_fullsized":"2024-09-12T17:30:50.018441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:04.329622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2277,"ondisk_log_size":2277,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1525,"num_read_kb":1314,"num_write":571,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":9114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1337,"ondisk_log_size":1337,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":482,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1662,"num_read_kb":1552,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":133,"num_read_kb":83,"num_write":312,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673006,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43848,"kb_used_data":16824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94327992,"statfs":{"total":96636764160,"available":96591863808,"internally_reserved":0,"allocated":17227776,"data_stored":16913193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705710,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":983040,"data_stored":724195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705710,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44652,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327188,"statfs":{"total":96636764160,"available":96591040512,"internally_reserved":0,"allocated":1007616,"data_stored":723592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705711,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31588,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340252,"statfs":{"total":96636764160,"available":96604418048,"internally_reserved":0,"allocated":413696,"data_stored":134210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:31:01.585 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.585 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.585 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.585 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.585 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.585 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.586 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.586 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.586 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.586 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.586 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.586 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.586 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.586 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.586 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.587 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.587 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.587 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.587 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.587 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.587 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.587 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.587 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.587 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.588 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.588 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.588 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.588 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.588 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.588 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.588 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.588 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.589 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.589 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.589 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.589 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.589 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.589 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.589 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.589 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.589 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.590 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.590 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.590 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.590 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.590 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.590 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.590 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.590 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.591 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.591 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.591 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.591 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.591 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.591 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.591 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.591 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.591 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.592 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.592 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.592 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.592 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.592 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.592 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.592 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.592 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.593 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.593 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.593 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.593 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.593 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.593 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.593 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.593 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.593 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.594 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.594 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.594 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.594 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.594 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.594 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.594 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.594 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.595 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.595 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.595 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.595 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.595 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.595 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.595 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.595 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.595 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.596 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.596 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.596 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.596 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.596 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.596 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.596 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.596 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.597 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.597 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T17:27:24.738801+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.597 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T17:27:31.752203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.597 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.597 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.597 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.597 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.597 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.597 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.598 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T17:27:31.752203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.598 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.598 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.598 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.598 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.598 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.598 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.598 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-12T17:27:31.752203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.598 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.599 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.599 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.599 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.599 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.599 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.599 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T17:27:31.752203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.599 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.599 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.600 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.600 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.600 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.600 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.600 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.600 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-12T17:27:31.752203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.600 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.601 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.601 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.601 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.601 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.601 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.601 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T17:27:31.752203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.601 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.601 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.601 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.602 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.602 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.602 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.602 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-12T17:27:31.752203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.602 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.602 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.602 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.602 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.603 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.603 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.603 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T17:27:31.752203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.603 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.603 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.603 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.603 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.603 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.604 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.604 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.604 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.604 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.604 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.604 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.605 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.605 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.605 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.605 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.605 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.605 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.605 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.605 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.605 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.606 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.606 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.606 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.606 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.606 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.606 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.606 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.606 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.607 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.607 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.607 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.607 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.607 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.607 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.607 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.607 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.607 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.608 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.608 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.608 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.608 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.608 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.608 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.608 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.608 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.609 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.609 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.609 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.609 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.609 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.609 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.609 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.609 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.609 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.610 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.610 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.610 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.610 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.610 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.610 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.610 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.610 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.611 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.611 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.611 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.611 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.611 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.611 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.611 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.611 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.611 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.612 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.612 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.612 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.612 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.612 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.612 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.612 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.612 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.612 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.613 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.613 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.613 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.613 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.613 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.613 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.613 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.613 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.614 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.614 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.614 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.614 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.614 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.614 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.614 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.614 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.614 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.615 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.615 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.615 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.615 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.615 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.615 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.615 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.615 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.615 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.616 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.616 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.616 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.616 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.616 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.616 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:01.616 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T17:31:21.618 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:31:21.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.732+0000 7f9fd24a2640 1 Processor -- start 2024-09-12T17:31:21.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.732+0000 7f9fd24a2640 1 -- start start 2024-09-12T17:31:21.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.732+0000 7f9fd24a2640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9fcc129d80 0x7f9fcc12a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:31:21.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.732+0000 7f9fd24a2640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fcc06dc00 con 0x7f9fcc12a6a0 2024-09-12T17:31:21.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.732+0000 7f9fd24a2640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f9fcc1299c0 con 0x7f9fcc129d80 2024-09-12T17:31:21.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.733+0000 7f9fcbfff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9fcc129d80 0x7f9fcc12a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:31:21.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.733+0000 7f9fcb7fe640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f9fcc12a6a0 0x7f9fcc110d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:37620/0 (socket says 172.21.15.47:37620) 2024-09-12T17:31:21.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.733+0000 7f9fcb7fe640 1 -- 172.21.15.47:0/3080023216 learned_addr learned my addr 172.21.15.47:0/3080023216 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-09-12T17:31:21.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.733+0000 7f9fcbfff640 1 -- 172.21.15.47:0/3080023216 >> v1:172.21.15.47:6789/0 conn(0x7f9fcc12a6a0 legacy=0x7f9fcc110d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:31:21.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.733+0000 7f9fcbfff640 1 -- 172.21.15.47:0/3080023216 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fcc114d20 con 0x7f9fcc129d80 2024-09-12T17:31:21.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.733+0000 7f9fcaffd640 1 -- 172.21.15.47:0/3080023216 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1307926984 0 0) 0x7f9fcc06dc00 con 0x7f9fcc12a6a0 2024-09-12T17:31:21.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.734+0000 7f9fcbfff640 1 --2- 172.21.15.47:0/3080023216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9fcc129d80 0x7f9fcc12a160 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc009720 tx=0x7f9fbc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd36ee874df318f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:31:21.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.734+0000 7f9fcaffd640 1 -- 172.21.15.47:0/3080023216 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fbc037070 con 0x7f9fcc129d80 2024-09-12T17:31:21.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.734+0000 7f9fcaffd640 1 -- 172.21.15.47:0/3080023216 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fbc02ad90 con 0x7f9fcc129d80 2024-09-12T17:31:21.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.734+0000 7f9fcaffd640 1 -- 172.21.15.47:0/3080023216 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fbc032590 con 0x7f9fcc129d80 2024-09-12T17:31:21.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.734+0000 7f9fd24a2640 1 -- 172.21.15.47:0/3080023216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9fcc129d80 msgr2=0x7f9fcc12a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:31:21.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.734+0000 7f9fd24a2640 1 --2- 172.21.15.47:0/3080023216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9fcc129d80 0x7f9fcc12a160 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc009720 tx=0x7f9fbc02a110 comp rx=0 tx=0).stop 2024-09-12T17:31:21.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.734+0000 7f9fd24a2640 1 -- 172.21.15.47:0/3080023216 shutdown_connections 2024-09-12T17:31:21.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.734+0000 7f9fd24a2640 1 --2- 172.21.15.47:0/3080023216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9fcc129d80 0x7f9fcc12a160 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:31:21.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.734+0000 7f9fd24a2640 1 -- 172.21.15.47:0/3080023216 >> 172.21.15.47:0/3080023216 conn(0x7f9fcc070850 msgr2=0x7f9fcc072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:31:21.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.734+0000 7f9fd24a2640 1 -- 172.21.15.47:0/3080023216 shutdown_connections 2024-09-12T17:31:21.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.734+0000 7f9fd24a2640 1 -- 172.21.15.47:0/3080023216 wait complete. 2024-09-12T17:31:21.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.735+0000 7f9fd24a2640 1 Processor -- start 2024-09-12T17:31:21.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.736+0000 7f9fd24a2640 1 -- start start 2024-09-12T17:31:21.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.736+0000 7f9fd24a2640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9fcc129d80 0x7f9fcc1c3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:31:21.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.736+0000 7f9fd24a2640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9fcc114940 con 0x7f9fcc129d80 2024-09-12T17:31:21.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.736+0000 7f9fcbfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9fcc129d80 0x7f9fcc1c3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:31:21.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.736+0000 7f9fcbfff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9fcc129d80 0x7f9fcc1c3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:41554/0 (socket says 172.21.15.47:41554) 2024-09-12T17:31:21.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.736+0000 7f9fcbfff640 1 -- 172.21.15.47:0/391279848 learned_addr learned my addr 172.21.15.47:0/391279848 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:31:21.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.736+0000 7f9fcbfff640 1 -- 172.21.15.47:0/391279848 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fcc114270 con 0x7f9fcc129d80 2024-09-12T17:31:21.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.737+0000 7f9fcbfff640 1 --2- 172.21.15.47:0/391279848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9fcc129d80 0x7f9fcc1c3da0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc035040 tx=0x7f9fbc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:31:21.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.737+0000 7f9fc8ff9640 1 -- 172.21.15.47:0/391279848 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fbc037040 con 0x7f9fcc129d80 2024-09-12T17:31:21.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.737+0000 7f9fc8ff9640 1 -- 172.21.15.47:0/391279848 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fbc004160 con 0x7f9fcc129d80 2024-09-12T17:31:21.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.737+0000 7f9fd24a2640 1 -- 172.21.15.47:0/391279848 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fcc120610 con 0x7f9fcc129d80 2024-09-12T17:31:21.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.737+0000 7f9fc8ff9640 1 -- 172.21.15.47:0/391279848 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fbc004440 con 0x7f9fcc129d80 2024-09-12T17:31:21.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.737+0000 7f9fd24a2640 1 -- 172.21.15.47:0/391279848 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fcc1c44c0 con 0x7f9fcc129d80 2024-09-12T17:31:21.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.738+0000 7f9fc8ff9640 1 -- 172.21.15.47:0/391279848 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f9fbc003610 con 0x7f9fcc129d80 2024-09-12T17:31:21.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.738+0000 7f9fd24a2640 1 -- 172.21.15.47:0/391279848 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fcc1119e0 con 0x7f9fcc129d80 2024-09-12T17:31:21.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.738+0000 7f9fc8ff9640 1 --2- 172.21.15.47:0/391279848 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f9fb803de90 0x7f9fb8040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:31:21.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.738+0000 7f9fc8ff9640 1 -- 172.21.15.47:0/391279848 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f9fbc073ba0 con 0x7f9fcc129d80 2024-09-12T17:31:21.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.739+0000 7f9fcb7fe640 1 --2- 172.21.15.47:0/391279848 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f9fb803de90 0x7f9fb8040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:31:21.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.740+0000 7f9fcb7fe640 1 --2- 172.21.15.47:0/391279848 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f9fb803de90 0x7f9fb8040350 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0000c00 tx=0x7f9fc00078d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:31:21.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.743+0000 7f9fc8ff9640 1 -- 172.21.15.47:0/391279848 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f9fbc03c3d0 con 0x7f9fcc129d80 2024-09-12T17:31:21.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.926+0000 7f9fd24a2640 1 -- 172.21.15.47:0/391279848 --> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9fcc1276b0 con 0x7f9fb803de90 2024-09-12T17:31:21.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.937+0000 7f9fc8ff9640 1 -- 172.21.15.47:0/391279848 <== mgr.4102 v2:172.21.15.170:6824/4146902489 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665512 (secure 0 0 0) 0x7f9fcc1276b0 con 0x7f9fb803de90 2024-09-12T17:31:21.945 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:31:21.954 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-09-12T17:31:21.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.942+0000 7f9fd24a2640 1 -- 172.21.15.47:0/391279848 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f9fb803de90 msgr2=0x7f9fb8040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:31:21.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.942+0000 7f9fd24a2640 1 --2- 172.21.15.47:0/391279848 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f9fb803de90 0x7f9fb8040350 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0000c00 tx=0x7f9fc00078d0 comp rx=0 tx=0).stop 2024-09-12T17:31:21.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.942+0000 7f9fd24a2640 1 -- 172.21.15.47:0/391279848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9fcc129d80 msgr2=0x7f9fcc1c3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:31:21.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.942+0000 7f9fd24a2640 1 --2- 172.21.15.47:0/391279848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9fcc129d80 0x7f9fcc1c3da0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc035040 tx=0x7f9fbc0046c0 comp rx=0 tx=0).stop 2024-09-12T17:31:21.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.942+0000 7f9fd24a2640 1 -- 172.21.15.47:0/391279848 shutdown_connections 2024-09-12T17:31:21.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.942+0000 7f9fd24a2640 1 --2- 172.21.15.47:0/391279848 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f9fb803de90 0x7f9fb8040350 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:31:21.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.942+0000 7f9fd24a2640 1 --2- 172.21.15.47:0/391279848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9fcc129d80 0x7f9fcc1c3da0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:31:21.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.942+0000 7f9fd24a2640 1 -- 172.21.15.47:0/391279848 >> 172.21.15.47:0/391279848 conn(0x7f9fcc070850 msgr2=0x7f9fcc126310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:31:21.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.942+0000 7f9fd24a2640 1 -- 172.21.15.47:0/391279848 shutdown_connections 2024-09-12T17:31:21.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:21.942+0000 7f9fd24a2640 1 -- 172.21.15.47:0/391279848 wait complete. 2024-09-12T17:31:21.958 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2024-09-12T17:31:21.801224+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5127,"num_read_kb":4717,"num_write":2121,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":482,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4568,"ondisk_log_size":4568,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":115040,"kb_used_data":2784,"kb_used_omap":6,"kb_used_meta":112185,"kb_avail":377372320,"statfs":{"total":386547056640,"available":386429255680,"internally_reserved":0,"allocated":2850816,"data_stored":1716264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":114878230},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004519"},"pg_stats":[{"pgid":"3.3f","version":"31'2","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:15.167597+0000","last_change":"2024-09-12T17:31:15.167597+0000","last_active":"2024-09-12T17:31:15.167597+0000","last_peered":"2024-09-12T17:31:15.167597+0000","last_clean":"2024-09-12T17:31:15.167597+0000","last_became_active":"2024-09-12T17:28:21.473004+0000","last_became_peered":"2024-09-12T17:28:21.473004+0000","last_unstale":"2024-09-12T17:31:15.167597+0000","last_undegraded":"2024-09-12T17:31:15.167597+0000","last_fullsized":"2024-09-12T17:31:15.167597+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:15.167516+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:15.167516+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.167516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:41.949425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.926869+0000","last_change":"2024-09-12T17:27:42.433458+0000","last_active":"2024-09-12T17:30:49.926869+0000","last_peered":"2024-09-12T17:30:49.926869+0000","last_clean":"2024-09-12T17:30:49.926869+0000","last_became_active":"2024-09-12T17:27:42.433207+0000","last_became_peered":"2024-09-12T17:27:42.433207+0000","last_unstale":"2024-09-12T17:30:49.926869+0000","last_undegraded":"2024-09-12T17:30:49.926869+0000","last_fullsized":"2024-09-12T17:30:49.926869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:10.865332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:13.892956+0000","last_change":"2024-09-12T17:31:13.892956+0000","last_active":"2024-09-12T17:31:13.892956+0000","last_peered":"2024-09-12T17:31:13.892956+0000","last_clean":"2024-09-12T17:31:13.892956+0000","last_became_active":"2024-09-12T17:27:40.418928+0000","last_became_peered":"2024-09-12T17:27:40.418928+0000","last_unstale":"2024-09-12T17:31:13.892956+0000","last_undegraded":"2024-09-12T17:31:13.892956+0000","last_fullsized":"2024-09-12T17:31:13.892956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:13.892860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:13.892860+0000","last_clean_scrub_stamp":"2024-09-12T17:31:13.892860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:59.577514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"31'6","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.929876+0000","last_change":"2024-09-12T17:27:42.432970+0000","last_active":"2024-09-12T17:30:49.929876+0000","last_peered":"2024-09-12T17:30:49.929876+0000","last_clean":"2024-09-12T17:30:49.929876+0000","last_became_active":"2024-09-12T17:27:42.432677+0000","last_became_peered":"2024-09-12T17:27:42.432677+0000","last_unstale":"2024-09-12T17:30:49.929876+0000","last_undegraded":"2024-09-12T17:30:49.929876+0000","last_fullsized":"2024-09-12T17:30:49.929876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:02.399648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465766+0000","last_change":"2024-09-12T17:27:40.433743+0000","last_active":"2024-09-12T17:28:21.465766+0000","last_peered":"2024-09-12T17:28:21.465766+0000","last_clean":"2024-09-12T17:28:21.465766+0000","last_became_active":"2024-09-12T17:27:40.433470+0000","last_became_peered":"2024-09-12T17:27:40.433470+0000","last_unstale":"2024-09-12T17:28:21.465766+0000","last_undegraded":"2024-09-12T17:28:21.465766+0000","last_fullsized":"2024-09-12T17:28:21.465766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:30.372118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"31'8","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:05.194512+0000","last_change":"2024-09-12T17:27:42.433048+0000","last_active":"2024-09-12T17:29:05.194512+0000","last_peered":"2024-09-12T17:29:05.194512+0000","last_clean":"2024-09-12T17:29:05.194512+0000","last_became_active":"2024-09-12T17:27:42.432736+0000","last_became_peered":"2024-09-12T17:27:42.432736+0000","last_unstale":"2024-09-12T17:29:05.194512+0000","last_undegraded":"2024-09-12T17:29:05.194512+0000","last_fullsized":"2024-09-12T17:29:05.194512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:43.699110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"31'8","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:14.164859+0000","last_change":"2024-09-12T17:31:14.164859+0000","last_active":"2024-09-12T17:31:14.164859+0000","last_peered":"2024-09-12T17:31:14.164859+0000","last_clean":"2024-09-12T17:31:14.164859+0000","last_became_active":"2024-09-12T17:27:40.426649+0000","last_became_peered":"2024-09-12T17:27:40.426649+0000","last_unstale":"2024-09-12T17:31:14.164859+0000","last_undegraded":"2024-09-12T17:31:14.164859+0000","last_fullsized":"2024-09-12T17:31:14.164859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:14.164764+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:14.164764+0000","last_clean_scrub_stamp":"2024-09-12T17:31:14.164764+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:53.065552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":18,"num_write":56,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"31'8","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.929278+0000","last_change":"2024-09-12T17:27:42.418772+0000","last_active":"2024-09-12T17:30:49.929278+0000","last_peered":"2024-09-12T17:30:49.929278+0000","last_clean":"2024-09-12T17:30:49.929278+0000","last_became_active":"2024-09-12T17:27:42.418517+0000","last_became_peered":"2024-09-12T17:27:42.418517+0000","last_unstale":"2024-09-12T17:30:49.929278+0000","last_undegraded":"2024-09-12T17:30:49.929278+0000","last_fullsized":"2024-09-12T17:30:49.929278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:38.683188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464584+0000","last_change":"2024-09-12T17:27:40.425244+0000","last_active":"2024-09-12T17:28:21.464584+0000","last_peered":"2024-09-12T17:28:21.464584+0000","last_clean":"2024-09-12T17:28:21.464584+0000","last_became_active":"2024-09-12T17:27:40.424978+0000","last_became_peered":"2024-09-12T17:27:40.424978+0000","last_unstale":"2024-09-12T17:28:21.464584+0000","last_undegraded":"2024-09-12T17:28:21.464584+0000","last_fullsized":"2024-09-12T17:28:21.464584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:04.819015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"31'16","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.148377+0000","last_change":"2024-09-12T17:27:42.424168+0000","last_active":"2024-09-12T17:30:50.148377+0000","last_peered":"2024-09-12T17:30:50.148377+0000","last_clean":"2024-09-12T17:30:50.148377+0000","last_became_active":"2024-09-12T17:27:42.423906+0000","last_became_peered":"2024-09-12T17:27:42.423906+0000","last_unstale":"2024-09-12T17:30:50.148377+0000","last_undegraded":"2024-09-12T17:30:50.148377+0000","last_fullsized":"2024-09-12T17:30:50.148377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:30.717650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:12.104894+0000","last_change":"2024-09-12T17:31:12.104894+0000","last_active":"2024-09-12T17:31:12.104894+0000","last_peered":"2024-09-12T17:31:12.104894+0000","last_clean":"2024-09-12T17:31:12.104894+0000","last_became_active":"2024-09-12T17:27:40.425308+0000","last_became_peered":"2024-09-12T17:27:40.425308+0000","last_unstale":"2024-09-12T17:31:12.104894+0000","last_undegraded":"2024-09-12T17:31:12.104894+0000","last_fullsized":"2024-09-12T17:31:12.104894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:12.104802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:12.104802+0000","last_clean_scrub_stamp":"2024-09-12T17:31:12.104802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:46.519276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"29'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464656+0000","last_change":"2024-09-12T17:27:42.429057+0000","last_active":"2024-09-12T17:28:21.464656+0000","last_peered":"2024-09-12T17:28:21.464656+0000","last_clean":"2024-09-12T17:28:21.464656+0000","last_became_active":"2024-09-12T17:27:42.428137+0000","last_became_peered":"2024-09-12T17:27:42.428137+0000","last_unstale":"2024-09-12T17:28:21.464656+0000","last_undegraded":"2024-09-12T17:28:21.464656+0000","last_fullsized":"2024-09-12T17:28:21.464656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:30.467192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.820912+0000","last_change":"2024-09-12T17:27:40.427714+0000","last_active":"2024-09-12T17:30:49.820912+0000","last_peered":"2024-09-12T17:30:49.820912+0000","last_clean":"2024-09-12T17:30:49.820912+0000","last_became_active":"2024-09-12T17:27:40.426778+0000","last_became_peered":"2024-09-12T17:27:40.426778+0000","last_unstale":"2024-09-12T17:30:49.820912+0000","last_undegraded":"2024-09-12T17:30:49.820912+0000","last_fullsized":"2024-09-12T17:30:49.820912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:19.867310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"31'18","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:05.377369+0000","last_change":"2024-09-12T17:27:42.434343+0000","last_active":"2024-09-12T17:29:05.377369+0000","last_peered":"2024-09-12T17:29:05.377369+0000","last_clean":"2024-09-12T17:29:05.377369+0000","last_became_active":"2024-09-12T17:27:42.434042+0000","last_became_peered":"2024-09-12T17:27:42.434042+0000","last_unstale":"2024-09-12T17:29:05.377369+0000","last_undegraded":"2024-09-12T17:29:05.377369+0000","last_fullsized":"2024-09-12T17:29:05.377369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:52.600151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":56,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:12.847582+0000","last_change":"2024-09-12T17:31:12.847582+0000","last_active":"2024-09-12T17:31:12.847582+0000","last_peered":"2024-09-12T17:31:12.847582+0000","last_clean":"2024-09-12T17:31:12.847582+0000","last_became_active":"2024-09-12T17:27:40.418512+0000","last_became_peered":"2024-09-12T17:27:40.418512+0000","last_unstale":"2024-09-12T17:31:12.847582+0000","last_undegraded":"2024-09-12T17:31:12.847582+0000","last_fullsized":"2024-09-12T17:31:12.847582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:12.847495+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:12.847495+0000","last_clean_scrub_stamp":"2024-09-12T17:31:12.847495+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:57.086545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"31'8","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:22.319704+0000","last_change":"2024-09-12T17:27:42.436453+0000","last_active":"2024-09-12T17:28:22.319704+0000","last_peered":"2024-09-12T17:28:22.319704+0000","last_clean":"2024-09-12T17:28:22.319704+0000","last_became_active":"2024-09-12T17:27:42.436159+0000","last_became_peered":"2024-09-12T17:27:42.436159+0000","last_unstale":"2024-09-12T17:28:22.319704+0000","last_undegraded":"2024-09-12T17:28:22.319704+0000","last_fullsized":"2024-09-12T17:28:22.319704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:16.940321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"31'4","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.226031+0000","last_change":"2024-09-12T17:27:42.433708+0000","last_active":"2024-09-12T17:30:50.226031+0000","last_peered":"2024-09-12T17:30:50.226031+0000","last_clean":"2024-09-12T17:30:50.226031+0000","last_became_active":"2024-09-12T17:27:42.433425+0000","last_became_peered":"2024-09-12T17:27:42.433425+0000","last_unstale":"2024-09-12T17:30:50.226031+0000","last_undegraded":"2024-09-12T17:30:50.226031+0000","last_fullsized":"2024-09-12T17:30:50.226031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:32.794303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:13.316703+0000","last_change":"2024-09-12T17:31:13.316703+0000","last_active":"2024-09-12T17:31:13.316703+0000","last_peered":"2024-09-12T17:31:13.316703+0000","last_clean":"2024-09-12T17:31:13.316703+0000","last_became_active":"2024-09-12T17:27:40.415650+0000","last_became_peered":"2024-09-12T17:27:40.415650+0000","last_unstale":"2024-09-12T17:31:13.316703+0000","last_undegraded":"2024-09-12T17:31:13.316703+0000","last_fullsized":"2024-09-12T17:31:13.316703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:13.316616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:13.316616+0000","last_clean_scrub_stamp":"2024-09-12T17:31:13.316616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:05.300957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468030+0000","last_change":"2024-09-12T17:27:42.427970+0000","last_active":"2024-09-12T17:28:21.468030+0000","last_peered":"2024-09-12T17:28:21.468030+0000","last_clean":"2024-09-12T17:28:21.468030+0000","last_became_active":"2024-09-12T17:27:42.427700+0000","last_became_peered":"2024-09-12T17:27:42.427700+0000","last_unstale":"2024-09-12T17:28:21.468030+0000","last_undegraded":"2024-09-12T17:28:21.468030+0000","last_fullsized":"2024-09-12T17:28:21.468030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:26.167048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:13.154171+0000","last_change":"2024-09-12T17:31:13.154171+0000","last_active":"2024-09-12T17:31:13.154171+0000","last_peered":"2024-09-12T17:31:13.154171+0000","last_clean":"2024-09-12T17:31:13.154171+0000","last_became_active":"2024-09-12T17:27:40.432033+0000","last_became_peered":"2024-09-12T17:27:40.432033+0000","last_unstale":"2024-09-12T17:31:13.154171+0000","last_undegraded":"2024-09-12T17:31:13.154171+0000","last_fullsized":"2024-09-12T17:31:13.154171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:13.154091+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:13.154091+0000","last_clean_scrub_stamp":"2024-09-12T17:31:13.154091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:49:12.833133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"31'3","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:04.760240+0000","last_change":"2024-09-12T17:27:42.428753+0000","last_active":"2024-09-12T17:30:04.760240+0000","last_peered":"2024-09-12T17:30:04.760240+0000","last_clean":"2024-09-12T17:30:04.760240+0000","last_became_active":"2024-09-12T17:27:42.428492+0000","last_became_peered":"2024-09-12T17:27:42.428492+0000","last_unstale":"2024-09-12T17:30:04.760240+0000","last_undegraded":"2024-09-12T17:30:04.760240+0000","last_fullsized":"2024-09-12T17:30:04.760240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:53.463766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"29'2","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:14.354822+0000","last_change":"2024-09-12T17:31:14.354822+0000","last_active":"2024-09-12T17:31:14.354822+0000","last_peered":"2024-09-12T17:31:14.354822+0000","last_clean":"2024-09-12T17:31:14.354822+0000","last_became_active":"2024-09-12T17:28:21.474758+0000","last_became_peered":"2024-09-12T17:28:21.474758+0000","last_unstale":"2024-09-12T17:31:14.354822+0000","last_undegraded":"2024-09-12T17:31:14.354822+0000","last_fullsized":"2024-09-12T17:31:14.354822+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-12T17:31:14.354735+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-12T17:31:14.354735+0000","last_clean_scrub_stamp":"2024-09-12T17:31:14.354735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:06.230735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:22.319001+0000","last_change":"2024-09-12T17:27:42.425610+0000","last_active":"2024-09-12T17:28:22.319001+0000","last_peered":"2024-09-12T17:28:22.319001+0000","last_clean":"2024-09-12T17:28:22.319001+0000","last_became_active":"2024-09-12T17:27:42.424738+0000","last_became_peered":"2024-09-12T17:27:42.424738+0000","last_unstale":"2024-09-12T17:28:22.319001+0000","last_undegraded":"2024-09-12T17:28:22.319001+0000","last_fullsized":"2024-09-12T17:28:22.319001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:32.550633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:10.251786+0000","last_change":"2024-09-12T17:31:10.251786+0000","last_active":"2024-09-12T17:31:10.251786+0000","last_peered":"2024-09-12T17:31:10.251786+0000","last_clean":"2024-09-12T17:31:10.251786+0000","last_became_active":"2024-09-12T17:27:40.414669+0000","last_became_peered":"2024-09-12T17:27:40.414669+0000","last_unstale":"2024-09-12T17:31:10.251786+0000","last_undegraded":"2024-09-12T17:31:10.251786+0000","last_fullsized":"2024-09-12T17:31:10.251786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:10.251701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:10.251701+0000","last_clean_scrub_stamp":"2024-09-12T17:31:10.251701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:31.254231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"31'8","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.225695+0000","last_change":"2024-09-12T17:27:42.436197+0000","last_active":"2024-09-12T17:30:50.225695+0000","last_peered":"2024-09-12T17:30:50.225695+0000","last_clean":"2024-09-12T17:30:50.225695+0000","last_became_active":"2024-09-12T17:27:42.435928+0000","last_became_peered":"2024-09-12T17:27:42.435928+0000","last_unstale":"2024-09-12T17:30:50.225695+0000","last_undegraded":"2024-09-12T17:30:50.225695+0000","last_fullsized":"2024-09-12T17:30:50.225695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:08.170045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:11.894841+0000","last_change":"2024-09-12T17:31:11.894841+0000","last_active":"2024-09-12T17:31:11.894841+0000","last_peered":"2024-09-12T17:31:11.894841+0000","last_clean":"2024-09-12T17:31:11.894841+0000","last_became_active":"2024-09-12T17:27:40.419936+0000","last_became_peered":"2024-09-12T17:27:40.419936+0000","last_unstale":"2024-09-12T17:31:11.894841+0000","last_undegraded":"2024-09-12T17:31:11.894841+0000","last_fullsized":"2024-09-12T17:31:11.894841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:11.894749+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:11.894749+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.894749+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:17.780383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"31'5","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:09.761218+0000","last_change":"2024-09-12T17:27:42.423827+0000","last_active":"2024-09-12T17:30:09.761218+0000","last_peered":"2024-09-12T17:30:09.761218+0000","last_clean":"2024-09-12T17:30:09.761218+0000","last_became_active":"2024-09-12T17:27:42.423569+0000","last_became_peered":"2024-09-12T17:27:42.423569+0000","last_unstale":"2024-09-12T17:30:09.761218+0000","last_undegraded":"2024-09-12T17:30:09.761218+0000","last_fullsized":"2024-09-12T17:30:09.761218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:15.384263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.821382+0000","last_change":"2024-09-12T17:27:40.428057+0000","last_active":"2024-09-12T17:28:21.821382+0000","last_peered":"2024-09-12T17:28:21.821382+0000","last_clean":"2024-09-12T17:28:21.821382+0000","last_became_active":"2024-09-12T17:27:40.426721+0000","last_became_peered":"2024-09-12T17:27:40.426721+0000","last_unstale":"2024-09-12T17:28:21.821382+0000","last_undegraded":"2024-09-12T17:28:21.821382+0000","last_fullsized":"2024-09-12T17:28:21.821382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:59.265443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"31'35","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.173308+0000","last_change":"2024-09-12T17:27:50.456507+0000","last_active":"2024-09-12T17:30:50.173308+0000","last_peered":"2024-09-12T17:30:50.173308+0000","last_clean":"2024-09-12T17:30:50.173308+0000","last_became_active":"2024-09-12T17:27:50.456184+0000","last_became_peered":"2024-09-12T17:27:50.456184+0000","last_unstale":"2024-09-12T17:30:50.173308+0000","last_undegraded":"2024-09-12T17:30:50.173308+0000","last_fullsized":"2024-09-12T17:30:50.173308+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:38.608944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"31'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.076531+0000","last_change":"2024-09-12T17:27:42.420958+0000","last_active":"2024-09-12T17:29:49.076531+0000","last_peered":"2024-09-12T17:29:49.076531+0000","last_clean":"2024-09-12T17:29:49.076531+0000","last_became_active":"2024-09-12T17:27:42.420666+0000","last_became_peered":"2024-09-12T17:27:42.420666+0000","last_unstale":"2024-09-12T17:29:49.076531+0000","last_undegraded":"2024-09-12T17:29:49.076531+0000","last_fullsized":"2024-09-12T17:29:49.076531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:15.830207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:15.386849+0000","last_change":"2024-09-12T17:31:15.386849+0000","last_active":"2024-09-12T17:31:15.386849+0000","last_peered":"2024-09-12T17:31:15.386849+0000","last_clean":"2024-09-12T17:31:15.386849+0000","last_became_active":"2024-09-12T17:27:40.433044+0000","last_became_peered":"2024-09-12T17:27:40.433044+0000","last_unstale":"2024-09-12T17:31:15.386849+0000","last_undegraded":"2024-09-12T17:31:15.386849+0000","last_fullsized":"2024-09-12T17:31:15.386849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.386742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.386742+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.386742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:15.078612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.473141+0000","last_change":"2024-09-12T17:28:21.472409+0000","last_active":"2024-09-12T17:28:21.473141+0000","last_peered":"2024-09-12T17:28:21.473141+0000","last_clean":"2024-09-12T17:28:21.473141+0000","last_became_active":"2024-09-12T17:28:21.472106+0000","last_became_peered":"2024-09-12T17:28:21.472106+0000","last_unstale":"2024-09-12T17:28:21.473141+0000","last_undegraded":"2024-09-12T17:28:21.473141+0000","last_fullsized":"2024-09-12T17:28:21.473141+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:56.281239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"31'33","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.920036+0000","last_change":"2024-09-12T17:27:46.442394+0000","last_active":"2024-09-12T17:30:56.920036+0000","last_peered":"2024-09-12T17:30:56.920036+0000","last_clean":"2024-09-12T17:30:56.920036+0000","last_became_active":"2024-09-12T17:27:46.441891+0000","last_became_peered":"2024-09-12T17:27:46.441891+0000","last_unstale":"2024-09-12T17:30:56.920036+0000","last_undegraded":"2024-09-12T17:30:56.920036+0000","last_fullsized":"2024-09-12T17:30:56.920036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:29.351398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470059+0000","last_change":"2024-09-12T17:27:48.448380+0000","last_active":"2024-09-12T17:28:21.470059+0000","last_peered":"2024-09-12T17:28:21.470059+0000","last_clean":"2024-09-12T17:28:21.470059+0000","last_became_active":"2024-09-12T17:27:48.448078+0000","last_became_peered":"2024-09-12T17:27:48.448078+0000","last_unstale":"2024-09-12T17:28:21.470059+0000","last_undegraded":"2024-09-12T17:28:21.470059+0000","last_fullsized":"2024-09-12T17:28:21.470059+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:32.578727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"31'7","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:05.200007+0000","last_change":"2024-09-12T17:27:50.457351+0000","last_active":"2024-09-12T17:29:05.200007+0000","last_peered":"2024-09-12T17:29:05.200007+0000","last_clean":"2024-09-12T17:29:05.200007+0000","last_became_active":"2024-09-12T17:27:50.457037+0000","last_became_peered":"2024-09-12T17:27:50.457037+0000","last_unstale":"2024-09-12T17:29:05.200007+0000","last_undegraded":"2024-09-12T17:29:05.200007+0000","last_fullsized":"2024-09-12T17:29:05.200007+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:28.456215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465641+0000","last_change":"2024-09-12T17:27:42.428129+0000","last_active":"2024-09-12T17:28:21.465641+0000","last_peered":"2024-09-12T17:28:21.465641+0000","last_clean":"2024-09-12T17:28:21.465641+0000","last_became_active":"2024-09-12T17:27:42.427872+0000","last_became_peered":"2024-09-12T17:27:42.427872+0000","last_unstale":"2024-09-12T17:28:21.465641+0000","last_undegraded":"2024-09-12T17:28:21.465641+0000","last_fullsized":"2024-09-12T17:28:21.465641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:27.694207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:06.079744+0000","last_change":"2024-09-12T17:31:06.079744+0000","last_active":"2024-09-12T17:31:06.079744+0000","last_peered":"2024-09-12T17:31:06.079744+0000","last_clean":"2024-09-12T17:31:06.079744+0000","last_became_active":"2024-09-12T17:27:40.430969+0000","last_became_peered":"2024-09-12T17:27:40.430969+0000","last_unstale":"2024-09-12T17:31:06.079744+0000","last_undegraded":"2024-09-12T17:31:06.079744+0000","last_fullsized":"2024-09-12T17:31:06.079744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:06.079660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:06.079660+0000","last_clean_scrub_stamp":"2024-09-12T17:31:06.079660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:37.732174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.472166+0000","last_change":"2024-09-12T17:27:44.427938+0000","last_active":"2024-09-12T17:28:21.472166+0000","last_peered":"2024-09-12T17:28:21.472166+0000","last_clean":"2024-09-12T17:28:21.472166+0000","last_became_active":"2024-09-12T17:27:44.427560+0000","last_became_peered":"2024-09-12T17:27:44.427560+0000","last_unstale":"2024-09-12T17:28:21.472166+0000","last_undegraded":"2024-09-12T17:28:21.472166+0000","last_fullsized":"2024-09-12T17:28:21.472166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:08.271249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"29'6","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470141+0000","last_change":"2024-09-12T17:27:46.438703+0000","last_active":"2024-09-12T17:28:21.470141+0000","last_peered":"2024-09-12T17:28:21.470141+0000","last_clean":"2024-09-12T17:28:21.470141+0000","last_became_active":"2024-09-12T17:27:46.436065+0000","last_became_peered":"2024-09-12T17:27:46.436065+0000","last_unstale":"2024-09-12T17:28:21.470141+0000","last_undegraded":"2024-09-12T17:28:21.470141+0000","last_fullsized":"2024-09-12T17:28:21.470141+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:52.392850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466101+0000","last_change":"2024-09-12T17:27:48.441701+0000","last_active":"2024-09-12T17:28:21.466101+0000","last_peered":"2024-09-12T17:28:21.466101+0000","last_clean":"2024-09-12T17:28:21.466101+0000","last_became_active":"2024-09-12T17:27:48.441192+0000","last_became_peered":"2024-09-12T17:27:48.441192+0000","last_unstale":"2024-09-12T17:28:21.466101+0000","last_undegraded":"2024-09-12T17:28:21.466101+0000","last_fullsized":"2024-09-12T17:28:21.466101+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:52.274187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"29'2","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470752+0000","last_change":"2024-09-12T17:27:50.451886+0000","last_active":"2024-09-12T17:28:21.470752+0000","last_peered":"2024-09-12T17:28:21.470752+0000","last_clean":"2024-09-12T17:28:21.470752+0000","last_became_active":"2024-09-12T17:27:50.451589+0000","last_became_peered":"2024-09-12T17:27:50.451589+0000","last_unstale":"2024-09-12T17:28:21.470752+0000","last_undegraded":"2024-09-12T17:28:21.470752+0000","last_fullsized":"2024-09-12T17:28:21.470752+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:53.513569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"31'8","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:22.319420+0000","last_change":"2024-09-12T17:27:42.426651+0000","last_active":"2024-09-12T17:28:22.319420+0000","last_peered":"2024-09-12T17:28:22.319420+0000","last_clean":"2024-09-12T17:28:22.319420+0000","last_became_active":"2024-09-12T17:27:42.426402+0000","last_became_peered":"2024-09-12T17:27:42.426402+0000","last_unstale":"2024-09-12T17:28:22.319420+0000","last_undegraded":"2024-09-12T17:28:22.319420+0000","last_fullsized":"2024-09-12T17:28:22.319420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:24.998663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:11.412979+0000","last_change":"2024-09-12T17:31:11.412979+0000","last_active":"2024-09-12T17:31:11.412979+0000","last_peered":"2024-09-12T17:31:11.412979+0000","last_clean":"2024-09-12T17:31:11.412979+0000","last_became_active":"2024-09-12T17:27:40.427860+0000","last_became_peered":"2024-09-12T17:27:40.427860+0000","last_unstale":"2024-09-12T17:31:11.412979+0000","last_undegraded":"2024-09-12T17:31:11.412979+0000","last_fullsized":"2024-09-12T17:31:11.412979+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:11.412886+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:11.412886+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.412886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:55.973064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.474373+0000","last_change":"2024-09-12T17:27:44.431340+0000","last_active":"2024-09-12T17:28:21.474373+0000","last_peered":"2024-09-12T17:28:21.474373+0000","last_clean":"2024-09-12T17:28:21.474373+0000","last_became_active":"2024-09-12T17:27:44.430879+0000","last_became_peered":"2024-09-12T17:27:44.430879+0000","last_unstale":"2024-09-12T17:28:21.474373+0000","last_undegraded":"2024-09-12T17:28:21.474373+0000","last_fullsized":"2024-09-12T17:28:21.474373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:31.240889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"29'10","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.467842+0000","last_change":"2024-09-12T17:27:46.440472+0000","last_active":"2024-09-12T17:28:21.467842+0000","last_peered":"2024-09-12T17:28:21.467842+0000","last_clean":"2024-09-12T17:28:21.467842+0000","last_became_active":"2024-09-12T17:27:46.440203+0000","last_became_peered":"2024-09-12T17:27:46.440203+0000","last_unstale":"2024-09-12T17:28:21.467842+0000","last_undegraded":"2024-09-12T17:28:21.467842+0000","last_fullsized":"2024-09-12T17:28:21.467842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:58.292808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"31'285","reported_seq":408,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.776362+0000","last_change":"2024-09-12T17:27:48.451526+0000","last_active":"2024-09-12T17:30:56.776362+0000","last_peered":"2024-09-12T17:30:56.776362+0000","last_clean":"2024-09-12T17:30:56.776362+0000","last_became_active":"2024-09-12T17:27:48.450897+0000","last_became_peered":"2024-09-12T17:27:48.450897+0000","last_unstale":"2024-09-12T17:30:56.776362+0000","last_undegraded":"2024-09-12T17:30:56.776362+0000","last_fullsized":"2024-09-12T17:30:56.776362+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:24.867772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468002+0000","last_change":"2024-09-12T17:27:50.456983+0000","last_active":"2024-09-12T17:28:21.468002+0000","last_peered":"2024-09-12T17:28:21.468002+0000","last_clean":"2024-09-12T17:28:21.468002+0000","last_became_active":"2024-09-12T17:27:50.456376+0000","last_became_peered":"2024-09-12T17:27:50.456376+0000","last_unstale":"2024-09-12T17:28:21.468002+0000","last_undegraded":"2024-09-12T17:28:21.468002+0000","last_fullsized":"2024-09-12T17:28:21.468002+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:07.847747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"31'12","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:18.820795+0000","last_change":"2024-09-12T17:31:18.820795+0000","last_active":"2024-09-12T17:31:18.820795+0000","last_peered":"2024-09-12T17:31:18.820795+0000","last_clean":"2024-09-12T17:31:18.820795+0000","last_became_active":"2024-09-12T17:27:42.426060+0000","last_became_peered":"2024-09-12T17:27:42.426060+0000","last_unstale":"2024-09-12T17:31:18.820795+0000","last_undegraded":"2024-09-12T17:31:18.820795+0000","last_fullsized":"2024-09-12T17:31:18.820795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-09-12T17:31:18.820697+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-09-12T17:31:18.820697+0000","last_clean_scrub_stamp":"2024-09-12T17:31:18.820697+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:36.452576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:02.411977+0000","last_change":"2024-09-12T17:31:02.411977+0000","last_active":"2024-09-12T17:31:02.411977+0000","last_peered":"2024-09-12T17:31:02.411977+0000","last_clean":"2024-09-12T17:31:02.411977+0000","last_became_active":"2024-09-12T17:27:40.415702+0000","last_became_peered":"2024-09-12T17:27:40.415702+0000","last_unstale":"2024-09-12T17:31:02.411977+0000","last_undegraded":"2024-09-12T17:31:02.411977+0000","last_fullsized":"2024-09-12T17:31:02.411977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:02.411854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:02.411854+0000","last_clean_scrub_stamp":"2024-09-12T17:31:02.411854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:49:02.090895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465273+0000","last_change":"2024-09-12T17:27:44.428855+0000","last_active":"2024-09-12T17:28:21.465273+0000","last_peered":"2024-09-12T17:28:21.465273+0000","last_clean":"2024-09-12T17:28:21.465273+0000","last_became_active":"2024-09-12T17:27:44.428526+0000","last_became_peered":"2024-09-12T17:27:44.428526+0000","last_unstale":"2024-09-12T17:28:21.465273+0000","last_undegraded":"2024-09-12T17:28:21.465273+0000","last_fullsized":"2024-09-12T17:28:21.465273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:22.407461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"31'33","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.905030+0000","last_change":"2024-09-12T17:27:46.441041+0000","last_active":"2024-09-12T17:30:56.905030+0000","last_peered":"2024-09-12T17:30:56.905030+0000","last_clean":"2024-09-12T17:30:56.905030+0000","last_became_active":"2024-09-12T17:27:46.440765+0000","last_became_peered":"2024-09-12T17:27:46.440765+0000","last_unstale":"2024-09-12T17:30:56.905030+0000","last_undegraded":"2024-09-12T17:30:56.905030+0000","last_fullsized":"2024-09-12T17:30:56.905030+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:14.176389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"31'285","reported_seq":439,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.780942+0000","last_change":"2024-09-12T17:27:48.440009+0000","last_active":"2024-09-12T17:30:56.780942+0000","last_peered":"2024-09-12T17:30:56.780942+0000","last_clean":"2024-09-12T17:30:56.780942+0000","last_became_active":"2024-09-12T17:27:48.439642+0000","last_became_peered":"2024-09-12T17:27:48.439642+0000","last_unstale":"2024-09-12T17:30:56.780942+0000","last_undegraded":"2024-09-12T17:30:56.780942+0000","last_fullsized":"2024-09-12T17:30:56.780942+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:06.242670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"31'12","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.225652+0000","last_change":"2024-09-12T17:27:42.428634+0000","last_active":"2024-09-12T17:30:50.225652+0000","last_peered":"2024-09-12T17:30:50.225652+0000","last_clean":"2024-09-12T17:30:50.225652+0000","last_became_active":"2024-09-12T17:27:42.427990+0000","last_became_peered":"2024-09-12T17:27:42.427990+0000","last_unstale":"2024-09-12T17:30:50.225652+0000","last_undegraded":"2024-09-12T17:30:50.225652+0000","last_fullsized":"2024-09-12T17:30:50.225652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:27:19.215981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"29'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:05.090851+0000","last_change":"2024-09-12T17:31:05.090851+0000","last_active":"2024-09-12T17:31:05.090851+0000","last_peered":"2024-09-12T17:31:05.090851+0000","last_clean":"2024-09-12T17:31:05.090851+0000","last_became_active":"2024-09-12T17:27:40.428462+0000","last_became_peered":"2024-09-12T17:27:40.428462+0000","last_unstale":"2024-09-12T17:31:05.090851+0000","last_undegraded":"2024-09-12T17:31:05.090851+0000","last_fullsized":"2024-09-12T17:31:05.090851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-12T17:31:05.090744+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-12T17:31:05.090744+0000","last_clean_scrub_stamp":"2024-09-12T17:31:05.090744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:12.385812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468175+0000","last_change":"2024-09-12T17:27:44.433155+0000","last_active":"2024-09-12T17:28:21.468175+0000","last_peered":"2024-09-12T17:28:21.468175+0000","last_clean":"2024-09-12T17:28:21.468175+0000","last_became_active":"2024-09-12T17:27:44.431911+0000","last_became_peered":"2024-09-12T17:27:44.431911+0000","last_unstale":"2024-09-12T17:28:21.468175+0000","last_undegraded":"2024-09-12T17:28:21.468175+0000","last_fullsized":"2024-09-12T17:28:21.468175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:16.971114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"31'44","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.828471+0000","last_change":"2024-09-12T17:27:46.439466+0000","last_active":"2024-09-12T17:30:56.828471+0000","last_peered":"2024-09-12T17:30:56.828471+0000","last_clean":"2024-09-12T17:30:56.828471+0000","last_became_active":"2024-09-12T17:27:46.439188+0000","last_became_peered":"2024-09-12T17:27:46.439188+0000","last_unstale":"2024-09-12T17:30:56.828471+0000","last_undegraded":"2024-09-12T17:30:56.828471+0000","last_fullsized":"2024-09-12T17:30:56.828471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:25.881248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471714+0000","last_change":"2024-09-12T17:27:48.441917+0000","last_active":"2024-09-12T17:28:21.471714+0000","last_peered":"2024-09-12T17:28:21.471714+0000","last_clean":"2024-09-12T17:28:21.471714+0000","last_became_active":"2024-09-12T17:27:48.441618+0000","last_became_peered":"2024-09-12T17:27:48.441618+0000","last_unstale":"2024-09-12T17:28:21.471714+0000","last_undegraded":"2024-09-12T17:28:21.471714+0000","last_fullsized":"2024-09-12T17:28:21.471714+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:17.256348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"31'7","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.198792+0000","last_change":"2024-09-12T17:27:50.457616+0000","last_active":"2024-09-12T17:30:50.198792+0000","last_peered":"2024-09-12T17:30:50.198792+0000","last_clean":"2024-09-12T17:30:50.198792+0000","last_became_active":"2024-09-12T17:27:50.457350+0000","last_became_peered":"2024-09-12T17:27:50.457350+0000","last_unstale":"2024-09-12T17:30:50.198792+0000","last_undegraded":"2024-09-12T17:30:50.198792+0000","last_fullsized":"2024-09-12T17:30:50.198792+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:39.806321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"31'20","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:15.343990+0000","last_change":"2024-09-12T17:31:15.343990+0000","last_active":"2024-09-12T17:31:15.343990+0000","last_peered":"2024-09-12T17:31:15.343990+0000","last_clean":"2024-09-12T17:31:15.343990+0000","last_became_active":"2024-09-12T17:27:42.424268+0000","last_became_peered":"2024-09-12T17:27:42.424268+0000","last_unstale":"2024-09-12T17:31:15.343990+0000","last_undegraded":"2024-09-12T17:31:15.343990+0000","last_fullsized":"2024-09-12T17:31:15.343990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'20","last_scrub_stamp":"2024-09-12T17:31:15.343895+0000","last_deep_scrub":"31'20","last_deep_scrub_stamp":"2024-09-12T17:31:15.343895+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.343895+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:21.229528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":75,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:02.018708+0000","last_change":"2024-09-12T17:31:02.018708+0000","last_active":"2024-09-12T17:31:02.018708+0000","last_peered":"2024-09-12T17:31:02.018708+0000","last_clean":"2024-09-12T17:31:02.018708+0000","last_became_active":"2024-09-12T17:27:40.427677+0000","last_became_peered":"2024-09-12T17:27:40.427677+0000","last_unstale":"2024-09-12T17:31:02.018708+0000","last_undegraded":"2024-09-12T17:31:02.018708+0000","last_fullsized":"2024-09-12T17:31:02.018708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:02.018612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:02.018612+0000","last_clean_scrub_stamp":"2024-09-12T17:31:02.018612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:03.467671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471294+0000","last_change":"2024-09-12T17:27:44.434751+0000","last_active":"2024-09-12T17:28:21.471294+0000","last_peered":"2024-09-12T17:28:21.471294+0000","last_clean":"2024-09-12T17:28:21.471294+0000","last_became_active":"2024-09-12T17:27:44.434433+0000","last_became_peered":"2024-09-12T17:27:44.434433+0000","last_unstale":"2024-09-12T17:28:21.471294+0000","last_undegraded":"2024-09-12T17:28:21.471294+0000","last_fullsized":"2024-09-12T17:28:21.471294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:00.980917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"31'33","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.874071+0000","last_change":"2024-09-12T17:27:46.442854+0000","last_active":"2024-09-12T17:30:56.874071+0000","last_peered":"2024-09-12T17:30:56.874071+0000","last_clean":"2024-09-12T17:30:56.874071+0000","last_became_active":"2024-09-12T17:27:46.442572+0000","last_became_peered":"2024-09-12T17:27:46.442572+0000","last_unstale":"2024-09-12T17:30:56.874071+0000","last_undegraded":"2024-09-12T17:30:56.874071+0000","last_fullsized":"2024-09-12T17:30:56.874071+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:49.755366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470885+0000","last_change":"2024-09-12T17:27:48.445793+0000","last_active":"2024-09-12T17:28:21.470885+0000","last_peered":"2024-09-12T17:28:21.470885+0000","last_clean":"2024-09-12T17:28:21.470885+0000","last_became_active":"2024-09-12T17:27:48.445502+0000","last_became_peered":"2024-09-12T17:27:48.445502+0000","last_unstale":"2024-09-12T17:28:21.470885+0000","last_undegraded":"2024-09-12T17:28:21.470885+0000","last_fullsized":"2024-09-12T17:28:21.470885+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:17.142197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"31'9","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.283385+0000","last_change":"2024-09-12T17:27:50.458007+0000","last_active":"2024-09-12T17:30:50.283385+0000","last_peered":"2024-09-12T17:30:50.283385+0000","last_clean":"2024-09-12T17:30:50.283385+0000","last_became_active":"2024-09-12T17:27:50.457691+0000","last_became_peered":"2024-09-12T17:27:50.457691+0000","last_unstale":"2024-09-12T17:30:50.283385+0000","last_undegraded":"2024-09-12T17:30:50.283385+0000","last_fullsized":"2024-09-12T17:30:50.283385+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:51.065237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":23,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"31'7","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:19.207381+0000","last_change":"2024-09-12T17:31:19.207381+0000","last_active":"2024-09-12T17:31:19.207381+0000","last_peered":"2024-09-12T17:31:19.207381+0000","last_clean":"2024-09-12T17:31:19.207381+0000","last_became_active":"2024-09-12T17:27:42.436517+0000","last_became_peered":"2024-09-12T17:27:42.436517+0000","last_unstale":"2024-09-12T17:31:19.207381+0000","last_undegraded":"2024-09-12T17:31:19.207381+0000","last_fullsized":"2024-09-12T17:31:19.207381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'7","last_scrub_stamp":"2024-09-12T17:31:19.207291+0000","last_deep_scrub":"31'7","last_deep_scrub_stamp":"2024-09-12T17:31:19.207291+0000","last_clean_scrub_stamp":"2024-09-12T17:31:19.207291+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:26.304916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:10.389482+0000","last_change":"2024-09-12T17:31:10.389482+0000","last_active":"2024-09-12T17:31:10.389482+0000","last_peered":"2024-09-12T17:31:10.389482+0000","last_clean":"2024-09-12T17:31:10.389482+0000","last_became_active":"2024-09-12T17:27:40.429663+0000","last_became_peered":"2024-09-12T17:27:40.429663+0000","last_unstale":"2024-09-12T17:31:10.389482+0000","last_undegraded":"2024-09-12T17:31:10.389482+0000","last_fullsized":"2024-09-12T17:31:10.389482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:10.389388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:10.389388+0000","last_clean_scrub_stamp":"2024-09-12T17:31:10.389388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:20.668432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.473204+0000","last_change":"2024-09-12T17:27:44.431117+0000","last_active":"2024-09-12T17:28:21.473204+0000","last_peered":"2024-09-12T17:28:21.473204+0000","last_clean":"2024-09-12T17:28:21.473204+0000","last_became_active":"2024-09-12T17:27:44.430772+0000","last_became_peered":"2024-09-12T17:27:44.430772+0000","last_unstale":"2024-09-12T17:28:21.473204+0000","last_undegraded":"2024-09-12T17:28:21.473204+0000","last_fullsized":"2024-09-12T17:28:21.473204+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:11.871540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"31'40","reported_seq":90,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.833856+0000","last_change":"2024-09-12T17:27:46.444540+0000","last_active":"2024-09-12T17:30:56.833856+0000","last_peered":"2024-09-12T17:30:56.833856+0000","last_clean":"2024-09-12T17:30:56.833856+0000","last_became_active":"2024-09-12T17:27:46.444206+0000","last_became_peered":"2024-09-12T17:27:46.444206+0000","last_unstale":"2024-09-12T17:30:56.833856+0000","last_undegraded":"2024-09-12T17:30:56.833856+0000","last_fullsized":"2024-09-12T17:30:56.833856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:06.613276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"31'285","reported_seq":401,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.782240+0000","last_change":"2024-09-12T17:27:48.448090+0000","last_active":"2024-09-12T17:30:56.782240+0000","last_peered":"2024-09-12T17:30:56.782240+0000","last_clean":"2024-09-12T17:30:56.782240+0000","last_became_active":"2024-09-12T17:27:48.447724+0000","last_became_peered":"2024-09-12T17:27:48.447724+0000","last_unstale":"2024-09-12T17:30:56.782240+0000","last_undegraded":"2024-09-12T17:30:56.782240+0000","last_fullsized":"2024-09-12T17:30:56.782240+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:37.632389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"31'4","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.183333+0000","last_change":"2024-09-12T17:27:50.451958+0000","last_active":"2024-09-12T17:30:50.183333+0000","last_peered":"2024-09-12T17:30:50.183333+0000","last_clean":"2024-09-12T17:30:50.183333+0000","last_became_active":"2024-09-12T17:27:50.451716+0000","last_became_peered":"2024-09-12T17:27:50.451716+0000","last_unstale":"2024-09-12T17:30:50.183333+0000","last_undegraded":"2024-09-12T17:30:50.183333+0000","last_fullsized":"2024-09-12T17:30:50.183333+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:28.075990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"31'4","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:18.197113+0000","last_change":"2024-09-12T17:31:18.197113+0000","last_active":"2024-09-12T17:31:18.197113+0000","last_peered":"2024-09-12T17:31:18.197113+0000","last_clean":"2024-09-12T17:31:18.197113+0000","last_became_active":"2024-09-12T17:27:42.429624+0000","last_became_peered":"2024-09-12T17:27:42.429624+0000","last_unstale":"2024-09-12T17:31:18.197113+0000","last_undegraded":"2024-09-12T17:31:18.197113+0000","last_fullsized":"2024-09-12T17:31:18.197113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:18.197003+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:18.197003+0000","last_clean_scrub_stamp":"2024-09-12T17:31:18.197003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:31:53.642094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:12.393232+0000","last_change":"2024-09-12T17:31:12.393232+0000","last_active":"2024-09-12T17:31:12.393232+0000","last_peered":"2024-09-12T17:31:12.393232+0000","last_clean":"2024-09-12T17:31:12.393232+0000","last_became_active":"2024-09-12T17:27:40.423291+0000","last_became_peered":"2024-09-12T17:27:40.423291+0000","last_unstale":"2024-09-12T17:31:12.393232+0000","last_undegraded":"2024-09-12T17:31:12.393232+0000","last_fullsized":"2024-09-12T17:31:12.393232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:12.393115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:12.393115+0000","last_clean_scrub_stamp":"2024-09-12T17:31:12.393115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:06.951305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471823+0000","last_change":"2024-09-12T17:27:44.430889+0000","last_active":"2024-09-12T17:28:21.471823+0000","last_peered":"2024-09-12T17:28:21.471823+0000","last_clean":"2024-09-12T17:28:21.471823+0000","last_became_active":"2024-09-12T17:27:44.430549+0000","last_became_peered":"2024-09-12T17:27:44.430549+0000","last_unstale":"2024-09-12T17:28:21.471823+0000","last_undegraded":"2024-09-12T17:28:21.471823+0000","last_fullsized":"2024-09-12T17:28:21.471823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:53.357220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"31'62","reported_seq":127,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.882552+0000","last_change":"2024-09-12T17:27:46.441393+0000","last_active":"2024-09-12T17:30:56.882552+0000","last_peered":"2024-09-12T17:30:56.882552+0000","last_clean":"2024-09-12T17:30:56.882552+0000","last_became_active":"2024-09-12T17:27:46.440805+0000","last_became_peered":"2024-09-12T17:27:46.440805+0000","last_unstale":"2024-09-12T17:30:56.882552+0000","last_undegraded":"2024-09-12T17:30:56.882552+0000","last_fullsized":"2024-09-12T17:30:56.882552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:26.523623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":65,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471161+0000","last_change":"2024-09-12T17:27:48.443214+0000","last_active":"2024-09-12T17:28:21.471161+0000","last_peered":"2024-09-12T17:28:21.471161+0000","last_clean":"2024-09-12T17:28:21.471161+0000","last_became_active":"2024-09-12T17:27:48.442880+0000","last_became_peered":"2024-09-12T17:27:48.442880+0000","last_unstale":"2024-09-12T17:28:21.471161+0000","last_undegraded":"2024-09-12T17:28:21.471161+0000","last_fullsized":"2024-09-12T17:28:21.471161+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:45.787562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"31'20","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.331059+0000","last_change":"2024-09-12T17:27:50.454666+0000","last_active":"2024-09-12T17:30:50.331059+0000","last_peered":"2024-09-12T17:30:50.331059+0000","last_clean":"2024-09-12T17:30:50.331059+0000","last_became_active":"2024-09-12T17:27:50.454410+0000","last_became_peered":"2024-09-12T17:27:50.454410+0000","last_unstale":"2024-09-12T17:30:50.331059+0000","last_undegraded":"2024-09-12T17:30:50.331059+0000","last_fullsized":"2024-09-12T17:30:50.331059+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:12:29.329426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"31'10","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:16.297952+0000","last_change":"2024-09-12T17:31:16.297952+0000","last_active":"2024-09-12T17:31:16.297952+0000","last_peered":"2024-09-12T17:31:16.297952+0000","last_clean":"2024-09-12T17:31:16.297952+0000","last_became_active":"2024-09-12T17:27:42.435913+0000","last_became_peered":"2024-09-12T17:27:42.435913+0000","last_unstale":"2024-09-12T17:31:16.297952+0000","last_undegraded":"2024-09-12T17:31:16.297952+0000","last_fullsized":"2024-09-12T17:31:16.297952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-12T17:31:16.297850+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-12T17:31:16.297850+0000","last_clean_scrub_stamp":"2024-09-12T17:31:16.297850+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:00.536900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:09.860489+0000","last_change":"2024-09-12T17:31:09.860489+0000","last_active":"2024-09-12T17:31:09.860489+0000","last_peered":"2024-09-12T17:31:09.860489+0000","last_clean":"2024-09-12T17:31:09.860489+0000","last_became_active":"2024-09-12T17:27:40.415703+0000","last_became_peered":"2024-09-12T17:27:40.415703+0000","last_unstale":"2024-09-12T17:31:09.860489+0000","last_undegraded":"2024-09-12T17:31:09.860489+0000","last_fullsized":"2024-09-12T17:31:09.860489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:09.860396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:09.860396+0000","last_clean_scrub_stamp":"2024-09-12T17:31:09.860396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:27.321941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466635+0000","last_change":"2024-09-12T17:27:44.432984+0000","last_active":"2024-09-12T17:28:21.466635+0000","last_peered":"2024-09-12T17:28:21.466635+0000","last_clean":"2024-09-12T17:28:21.466635+0000","last_became_active":"2024-09-12T17:27:44.432588+0000","last_became_peered":"2024-09-12T17:27:44.432588+0000","last_unstale":"2024-09-12T17:28:21.466635+0000","last_undegraded":"2024-09-12T17:28:21.466635+0000","last_fullsized":"2024-09-12T17:28:21.466635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:09.951474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"31'35","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.885603+0000","last_change":"2024-09-12T17:27:46.432654+0000","last_active":"2024-09-12T17:30:56.885603+0000","last_peered":"2024-09-12T17:30:56.885603+0000","last_clean":"2024-09-12T17:30:56.885603+0000","last_became_active":"2024-09-12T17:27:46.432354+0000","last_became_peered":"2024-09-12T17:27:46.432354+0000","last_unstale":"2024-09-12T17:30:56.885603+0000","last_undegraded":"2024-09-12T17:30:56.885603+0000","last_fullsized":"2024-09-12T17:30:56.885603+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:14.062258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466117+0000","last_change":"2024-09-12T17:27:48.451776+0000","last_active":"2024-09-12T17:28:21.466117+0000","last_peered":"2024-09-12T17:28:21.466117+0000","last_clean":"2024-09-12T17:28:21.466117+0000","last_became_active":"2024-09-12T17:27:48.451510+0000","last_became_peered":"2024-09-12T17:27:48.451510+0000","last_unstale":"2024-09-12T17:28:21.466117+0000","last_undegraded":"2024-09-12T17:28:21.466117+0000","last_fullsized":"2024-09-12T17:28:21.466117+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:01.787546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"31'7","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:50.765214+0000","last_change":"2024-09-12T17:27:50.455419+0000","last_active":"2024-09-12T17:29:50.765214+0000","last_peered":"2024-09-12T17:29:50.765214+0000","last_clean":"2024-09-12T17:29:50.765214+0000","last_became_active":"2024-09-12T17:27:50.454890+0000","last_became_peered":"2024-09-12T17:27:50.454890+0000","last_unstale":"2024-09-12T17:29:50.765214+0000","last_undegraded":"2024-09-12T17:29:50.765214+0000","last_fullsized":"2024-09-12T17:29:50.765214+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:50.422624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"31'8","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.196877+0000","last_change":"2024-09-12T17:27:42.440511+0000","last_active":"2024-09-12T17:30:50.196877+0000","last_peered":"2024-09-12T17:30:50.196877+0000","last_clean":"2024-09-12T17:30:50.196877+0000","last_became_active":"2024-09-12T17:27:42.440204+0000","last_became_peered":"2024-09-12T17:27:42.440204+0000","last_unstale":"2024-09-12T17:30:50.196877+0000","last_undegraded":"2024-09-12T17:30:50.196877+0000","last_fullsized":"2024-09-12T17:30:50.196877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:11.628797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:09.348825+0000","last_change":"2024-09-12T17:31:09.348825+0000","last_active":"2024-09-12T17:31:09.348825+0000","last_peered":"2024-09-12T17:31:09.348825+0000","last_clean":"2024-09-12T17:31:09.348825+0000","last_became_active":"2024-09-12T17:27:40.428232+0000","last_became_peered":"2024-09-12T17:27:40.428232+0000","last_unstale":"2024-09-12T17:31:09.348825+0000","last_undegraded":"2024-09-12T17:31:09.348825+0000","last_fullsized":"2024-09-12T17:31:09.348825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:09.348730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:09.348730+0000","last_clean_scrub_stamp":"2024-09-12T17:31:09.348730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:20.262551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.473721+0000","last_change":"2024-09-12T17:27:44.432569+0000","last_active":"2024-09-12T17:28:21.473721+0000","last_peered":"2024-09-12T17:28:21.473721+0000","last_clean":"2024-09-12T17:28:21.473721+0000","last_became_active":"2024-09-12T17:27:44.432211+0000","last_became_peered":"2024-09-12T17:27:44.432211+0000","last_unstale":"2024-09-12T17:28:21.473721+0000","last_undegraded":"2024-09-12T17:28:21.473721+0000","last_fullsized":"2024-09-12T17:28:21.473721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:13.176204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"31'39","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.864276+0000","last_change":"2024-09-12T17:27:46.433953+0000","last_active":"2024-09-12T17:30:56.864276+0000","last_peered":"2024-09-12T17:30:56.864276+0000","last_clean":"2024-09-12T17:30:56.864276+0000","last_became_active":"2024-09-12T17:27:46.433672+0000","last_became_peered":"2024-09-12T17:27:46.433672+0000","last_unstale":"2024-09-12T17:30:56.864276+0000","last_undegraded":"2024-09-12T17:30:56.864276+0000","last_fullsized":"2024-09-12T17:30:56.864276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:55.924502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"31'285","reported_seq":407,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.777401+0000","last_change":"2024-09-12T17:27:48.440623+0000","last_active":"2024-09-12T17:30:56.777401+0000","last_peered":"2024-09-12T17:30:56.777401+0000","last_clean":"2024-09-12T17:30:56.777401+0000","last_became_active":"2024-09-12T17:27:48.440335+0000","last_became_peered":"2024-09-12T17:27:48.440335+0000","last_unstale":"2024-09-12T17:30:56.777401+0000","last_undegraded":"2024-09-12T17:30:56.777401+0000","last_fullsized":"2024-09-12T17:30:56.777401+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:20.544074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"31'12","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:54.758294+0000","last_change":"2024-09-12T17:27:50.449089+0000","last_active":"2024-09-12T17:29:54.758294+0000","last_peered":"2024-09-12T17:29:54.758294+0000","last_clean":"2024-09-12T17:29:54.758294+0000","last_became_active":"2024-09-12T17:27:50.448680+0000","last_became_peered":"2024-09-12T17:27:50.448680+0000","last_unstale":"2024-09-12T17:29:54.758294+0000","last_undegraded":"2024-09-12T17:29:54.758294+0000","last_fullsized":"2024-09-12T17:29:54.758294+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:01.786654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.473949+0000","last_change":"2024-09-12T17:28:21.473062+0000","last_active":"2024-09-12T17:28:21.473949+0000","last_peered":"2024-09-12T17:28:21.473949+0000","last_clean":"2024-09-12T17:28:21.473949+0000","last_became_active":"2024-09-12T17:28:21.472744+0000","last_became_peered":"2024-09-12T17:28:21.472744+0000","last_unstale":"2024-09-12T17:28:21.473949+0000","last_undegraded":"2024-09-12T17:28:21.473949+0000","last_fullsized":"2024-09-12T17:28:21.473949+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:30.333530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:08.306087+0000","last_change":"2024-09-12T17:31:08.306087+0000","last_active":"2024-09-12T17:31:08.306087+0000","last_peered":"2024-09-12T17:31:08.306087+0000","last_clean":"2024-09-12T17:31:08.306087+0000","last_became_active":"2024-09-12T17:27:40.428512+0000","last_became_peered":"2024-09-12T17:27:40.428512+0000","last_unstale":"2024-09-12T17:31:08.306087+0000","last_undegraded":"2024-09-12T17:31:08.306087+0000","last_fullsized":"2024-09-12T17:31:08.306087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:08.306000+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:08.306000+0000","last_clean_scrub_stamp":"2024-09-12T17:31:08.306000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:33.492014+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'3","reported_seq":418,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.758569+0000","last_change":"2024-09-12T17:27:44.430169+0000","last_active":"2024-09-12T17:30:56.758569+0000","last_peered":"2024-09-12T17:30:56.758569+0000","last_clean":"2024-09-12T17:30:56.758569+0000","last_became_active":"2024-09-12T17:27:44.429844+0000","last_became_peered":"2024-09-12T17:27:44.429844+0000","last_unstale":"2024-09-12T17:30:56.758569+0000","last_undegraded":"2024-09-12T17:30:56.758569+0000","last_fullsized":"2024-09-12T17:30:56.758569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:19.512968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464478+0000","last_change":"2024-09-12T17:27:46.439449+0000","last_active":"2024-09-12T17:28:21.464478+0000","last_peered":"2024-09-12T17:28:21.464478+0000","last_clean":"2024-09-12T17:28:21.464478+0000","last_became_active":"2024-09-12T17:27:46.439153+0000","last_became_peered":"2024-09-12T17:27:46.439153+0000","last_unstale":"2024-09-12T17:28:21.464478+0000","last_undegraded":"2024-09-12T17:28:21.464478+0000","last_fullsized":"2024-09-12T17:28:21.464478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:53.118909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"31'285","reported_seq":463,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.778548+0000","last_change":"2024-09-12T17:27:48.441400+0000","last_active":"2024-09-12T17:30:56.778548+0000","last_peered":"2024-09-12T17:30:56.778548+0000","last_clean":"2024-09-12T17:30:56.778548+0000","last_became_active":"2024-09-12T17:27:48.441024+0000","last_became_peered":"2024-09-12T17:27:48.441024+0000","last_unstale":"2024-09-12T17:30:56.778548+0000","last_undegraded":"2024-09-12T17:30:56.778548+0000","last_fullsized":"2024-09-12T17:30:56.778548+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:09.672456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'4","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:48.859981+0000","last_change":"2024-09-12T17:27:50.452031+0000","last_active":"2024-09-12T17:29:48.859981+0000","last_peered":"2024-09-12T17:29:48.859981+0000","last_clean":"2024-09-12T17:29:48.859981+0000","last_became_active":"2024-09-12T17:27:50.451743+0000","last_became_peered":"2024-09-12T17:27:50.451743+0000","last_unstale":"2024-09-12T17:29:48.859981+0000","last_undegraded":"2024-09-12T17:29:48.859981+0000","last_fullsized":"2024-09-12T17:29:48.859981+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:24:17.073385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:17.306328+0000","last_change":"2024-09-12T17:31:17.306328+0000","last_active":"2024-09-12T17:31:17.306328+0000","last_peered":"2024-09-12T17:31:17.306328+0000","last_clean":"2024-09-12T17:31:17.306328+0000","last_became_active":"2024-09-12T17:27:42.438566+0000","last_became_peered":"2024-09-12T17:27:42.438566+0000","last_unstale":"2024-09-12T17:31:17.306328+0000","last_undegraded":"2024-09-12T17:31:17.306328+0000","last_fullsized":"2024-09-12T17:31:17.306328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:17.306243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:17.306243+0000","last_clean_scrub_stamp":"2024-09-12T17:31:17.306243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:02.990898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:14.414138+0000","last_change":"2024-09-12T17:31:14.414138+0000","last_active":"2024-09-12T17:31:14.414138+0000","last_peered":"2024-09-12T17:31:14.414138+0000","last_clean":"2024-09-12T17:31:14.414138+0000","last_became_active":"2024-09-12T17:27:40.429902+0000","last_became_peered":"2024-09-12T17:27:40.429902+0000","last_unstale":"2024-09-12T17:31:14.414138+0000","last_undegraded":"2024-09-12T17:31:14.414138+0000","last_fullsized":"2024-09-12T17:31:14.414138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:14.414041+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:14.414041+0000","last_clean_scrub_stamp":"2024-09-12T17:31:14.414041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:51.245716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465147+0000","last_change":"2024-09-12T17:27:44.431499+0000","last_active":"2024-09-12T17:28:21.465147+0000","last_peered":"2024-09-12T17:28:21.465147+0000","last_clean":"2024-09-12T17:28:21.465147+0000","last_became_active":"2024-09-12T17:27:44.431180+0000","last_became_peered":"2024-09-12T17:27:44.431180+0000","last_unstale":"2024-09-12T17:28:21.465147+0000","last_undegraded":"2024-09-12T17:28:21.465147+0000","last_fullsized":"2024-09-12T17:28:21.465147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:36.937417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"31'43","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.923010+0000","last_change":"2024-09-12T17:27:46.431873+0000","last_active":"2024-09-12T17:30:56.923010+0000","last_peered":"2024-09-12T17:30:56.923010+0000","last_clean":"2024-09-12T17:30:56.923010+0000","last_became_active":"2024-09-12T17:27:46.431599+0000","last_became_peered":"2024-09-12T17:27:46.431599+0000","last_unstale":"2024-09-12T17:30:56.923010+0000","last_undegraded":"2024-09-12T17:30:56.923010+0000","last_fullsized":"2024-09-12T17:30:56.923010+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:08.059866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":53,"num_read_kb":61,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.467064+0000","last_change":"2024-09-12T17:27:48.447644+0000","last_active":"2024-09-12T17:28:21.467064+0000","last_peered":"2024-09-12T17:28:21.467064+0000","last_clean":"2024-09-12T17:28:21.467064+0000","last_became_active":"2024-09-12T17:27:48.447331+0000","last_became_peered":"2024-09-12T17:27:48.447331+0000","last_unstale":"2024-09-12T17:28:21.467064+0000","last_undegraded":"2024-09-12T17:28:21.467064+0000","last_fullsized":"2024-09-12T17:28:21.467064+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:15.622749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"31'6","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.260811+0000","last_change":"2024-09-12T17:27:50.448120+0000","last_active":"2024-09-12T17:30:50.260811+0000","last_peered":"2024-09-12T17:30:50.260811+0000","last_clean":"2024-09-12T17:30:50.260811+0000","last_became_active":"2024-09-12T17:27:50.447855+0000","last_became_peered":"2024-09-12T17:27:50.447855+0000","last_unstale":"2024-09-12T17:30:50.260811+0000","last_undegraded":"2024-09-12T17:30:50.260811+0000","last_fullsized":"2024-09-12T17:30:50.260811+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:45:37.063333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"31'14","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.225785+0000","last_change":"2024-09-12T17:27:42.438563+0000","last_active":"2024-09-12T17:30:50.225785+0000","last_peered":"2024-09-12T17:30:50.225785+0000","last_clean":"2024-09-12T17:30:50.225785+0000","last_became_active":"2024-09-12T17:27:42.438270+0000","last_became_peered":"2024-09-12T17:27:42.438270+0000","last_unstale":"2024-09-12T17:30:50.225785+0000","last_undegraded":"2024-09-12T17:30:50.225785+0000","last_fullsized":"2024-09-12T17:30:50.225785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:24.762523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"31'74","reported_seq":152,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:01.448262+0000","last_change":"2024-09-12T17:31:01.448262+0000","last_active":"2024-09-12T17:31:01.448262+0000","last_peered":"2024-09-12T17:31:01.448262+0000","last_clean":"2024-09-12T17:31:01.448262+0000","last_became_active":"2024-09-12T17:27:25.974522+0000","last_became_peered":"2024-09-12T17:27:25.974522+0000","last_unstale":"2024-09-12T17:31:01.448262+0000","last_undegraded":"2024-09-12T17:31:01.448262+0000","last_fullsized":"2024-09-12T17:31:01.448262+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'74","last_scrub_stamp":"2024-09-12T17:31:01.448174+0000","last_deep_scrub":"31'74","last_deep_scrub_stamp":"2024-09-12T17:31:01.448174+0000","last_clean_scrub_stamp":"2024-09-12T17:31:01.448174+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:35.862648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"31'2","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:04.209698+0000","last_change":"2024-09-12T17:31:04.209698+0000","last_active":"2024-09-12T17:31:04.209698+0000","last_peered":"2024-09-12T17:31:04.209698+0000","last_clean":"2024-09-12T17:31:04.209698+0000","last_became_active":"2024-09-12T17:27:32.760744+0000","last_became_peered":"2024-09-12T17:27:32.760744+0000","last_unstale":"2024-09-12T17:31:04.209698+0000","last_undegraded":"2024-09-12T17:31:04.209698+0000","last_fullsized":"2024-09-12T17:31:04.209698+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:04.209605+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:04.209605+0000","last_clean_scrub_stamp":"2024-09-12T17:31:04.209605+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:18.344014+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0014241220000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:05.209735+0000","last_change":"2024-09-12T17:31:05.209735+0000","last_active":"2024-09-12T17:31:05.209735+0000","last_peered":"2024-09-12T17:31:05.209735+0000","last_clean":"2024-09-12T17:31:05.209735+0000","last_became_active":"2024-09-12T17:27:40.428453+0000","last_became_peered":"2024-09-12T17:27:40.428453+0000","last_unstale":"2024-09-12T17:31:05.209735+0000","last_undegraded":"2024-09-12T17:31:05.209735+0000","last_fullsized":"2024-09-12T17:31:05.209735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:05.209644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:05.209644+0000","last_clean_scrub_stamp":"2024-09-12T17:31:05.209644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:39.739604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469125+0000","last_change":"2024-09-12T17:27:44.432804+0000","last_active":"2024-09-12T17:28:21.469125+0000","last_peered":"2024-09-12T17:28:21.469125+0000","last_clean":"2024-09-12T17:28:21.469125+0000","last_became_active":"2024-09-12T17:27:44.432336+0000","last_became_peered":"2024-09-12T17:27:44.432336+0000","last_unstale":"2024-09-12T17:28:21.469125+0000","last_undegraded":"2024-09-12T17:28:21.469125+0000","last_fullsized":"2024-09-12T17:28:21.469125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:57.403402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"31'85","reported_seq":167,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.914512+0000","last_change":"2024-09-12T17:27:46.438090+0000","last_active":"2024-09-12T17:30:56.914512+0000","last_peered":"2024-09-12T17:30:56.914512+0000","last_clean":"2024-09-12T17:30:56.914512+0000","last_became_active":"2024-09-12T17:27:46.437771+0000","last_became_peered":"2024-09-12T17:27:46.437771+0000","last_unstale":"2024-09-12T17:30:56.914512+0000","last_undegraded":"2024-09-12T17:30:56.914512+0000","last_fullsized":"2024-09-12T17:30:56.914512+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:14.400029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.474144+0000","last_change":"2024-09-12T17:27:48.446270+0000","last_active":"2024-09-12T17:28:21.474144+0000","last_peered":"2024-09-12T17:28:21.474144+0000","last_clean":"2024-09-12T17:28:21.474144+0000","last_became_active":"2024-09-12T17:27:48.445970+0000","last_became_peered":"2024-09-12T17:27:48.445970+0000","last_unstale":"2024-09-12T17:28:21.474144+0000","last_undegraded":"2024-09-12T17:28:21.474144+0000","last_fullsized":"2024-09-12T17:28:21.474144+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:31.488140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"31'81","reported_seq":163,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.235627+0000","last_change":"2024-09-12T17:27:50.448666+0000","last_active":"2024-09-12T17:30:50.235627+0000","last_peered":"2024-09-12T17:30:50.235627+0000","last_clean":"2024-09-12T17:30:50.235627+0000","last_became_active":"2024-09-12T17:27:50.448189+0000","last_became_peered":"2024-09-12T17:27:50.448189+0000","last_unstale":"2024-09-12T17:30:50.235627+0000","last_undegraded":"2024-09-12T17:30:50.235627+0000","last_fullsized":"2024-09-12T17:30:50.235627+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:38.207685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":221,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465570+0000","last_change":"2024-09-12T17:27:42.429760+0000","last_active":"2024-09-12T17:28:21.465570+0000","last_peered":"2024-09-12T17:28:21.465570+0000","last_clean":"2024-09-12T17:28:21.465570+0000","last_became_active":"2024-09-12T17:27:42.429497+0000","last_became_peered":"2024-09-12T17:27:42.429497+0000","last_unstale":"2024-09-12T17:28:21.465570+0000","last_undegraded":"2024-09-12T17:28:21.465570+0000","last_fullsized":"2024-09-12T17:28:21.465570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:09.539390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:01.220220+0000","last_change":"2024-09-12T17:31:01.220220+0000","last_active":"2024-09-12T17:31:01.220220+0000","last_peered":"2024-09-12T17:31:01.220220+0000","last_clean":"2024-09-12T17:31:01.220220+0000","last_became_active":"2024-09-12T17:27:32.761687+0000","last_became_peered":"2024-09-12T17:27:32.761687+0000","last_unstale":"2024-09-12T17:31:01.220220+0000","last_undegraded":"2024-09-12T17:31:01.220220+0000","last_fullsized":"2024-09-12T17:31:01.220220+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:01.220136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:01.220136+0000","last_clean_scrub_stamp":"2024-09-12T17:31:01.220136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:40.149633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056694099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:01.844114+0000","last_change":"2024-09-12T17:31:01.844114+0000","last_active":"2024-09-12T17:31:01.844114+0000","last_peered":"2024-09-12T17:31:01.844114+0000","last_clean":"2024-09-12T17:31:01.844114+0000","last_became_active":"2024-09-12T17:27:40.418249+0000","last_became_peered":"2024-09-12T17:27:40.418249+0000","last_unstale":"2024-09-12T17:31:01.844114+0000","last_undegraded":"2024-09-12T17:31:01.844114+0000","last_fullsized":"2024-09-12T17:31:01.844114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:01.844025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:01.844025+0000","last_clean_scrub_stamp":"2024-09-12T17:31:01.844025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:24.701961+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468312+0000","last_change":"2024-09-12T17:27:44.427026+0000","last_active":"2024-09-12T17:28:21.468312+0000","last_peered":"2024-09-12T17:28:21.468312+0000","last_clean":"2024-09-12T17:28:21.468312+0000","last_became_active":"2024-09-12T17:27:44.426698+0000","last_became_peered":"2024-09-12T17:27:44.426698+0000","last_unstale":"2024-09-12T17:28:21.468312+0000","last_undegraded":"2024-09-12T17:28:21.468312+0000","last_fullsized":"2024-09-12T17:28:21.468312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:09.582440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"31'285","reported_seq":502,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.912291+0000","last_change":"2024-09-12T17:27:46.438678+0000","last_active":"2024-09-12T17:30:56.912291+0000","last_peered":"2024-09-12T17:30:56.912291+0000","last_clean":"2024-09-12T17:30:56.912291+0000","last_became_active":"2024-09-12T17:27:46.438381+0000","last_became_peered":"2024-09-12T17:27:46.438381+0000","last_unstale":"2024-09-12T17:30:56.912291+0000","last_undegraded":"2024-09-12T17:30:56.912291+0000","last_fullsized":"2024-09-12T17:30:56.912291+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:10.399053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464394+0000","last_change":"2024-09-12T17:27:48.451345+0000","last_active":"2024-09-12T17:28:21.464394+0000","last_peered":"2024-09-12T17:28:21.464394+0000","last_clean":"2024-09-12T17:28:21.464394+0000","last_became_active":"2024-09-12T17:27:48.450775+0000","last_became_peered":"2024-09-12T17:27:48.450775+0000","last_unstale":"2024-09-12T17:28:21.464394+0000","last_undegraded":"2024-09-12T17:28:21.464394+0000","last_fullsized":"2024-09-12T17:28:21.464394+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:37.382330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"31'5","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.944535+0000","last_change":"2024-09-12T17:27:50.458209+0000","last_active":"2024-09-12T17:30:49.944535+0000","last_peered":"2024-09-12T17:30:49.944535+0000","last_clean":"2024-09-12T17:30:49.944535+0000","last_became_active":"2024-09-12T17:27:50.457939+0000","last_became_peered":"2024-09-12T17:27:50.457939+0000","last_unstale":"2024-09-12T17:30:49.944535+0000","last_undegraded":"2024-09-12T17:30:49.944535+0000","last_fullsized":"2024-09-12T17:30:49.944535+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:23.231500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:16.847975+0000","last_change":"2024-09-12T17:31:16.847975+0000","last_active":"2024-09-12T17:31:16.847975+0000","last_peered":"2024-09-12T17:31:16.847975+0000","last_clean":"2024-09-12T17:31:16.847975+0000","last_became_active":"2024-09-12T17:27:42.424498+0000","last_became_peered":"2024-09-12T17:27:42.424498+0000","last_unstale":"2024-09-12T17:31:16.847975+0000","last_undegraded":"2024-09-12T17:31:16.847975+0000","last_fullsized":"2024-09-12T17:31:16.847975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:16.847857+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:16.847857+0000","last_clean_scrub_stamp":"2024-09-12T17:31:16.847857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:43.335725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:03.037376+0000","last_change":"2024-09-12T17:31:03.037376+0000","last_active":"2024-09-12T17:31:03.037376+0000","last_peered":"2024-09-12T17:31:03.037376+0000","last_clean":"2024-09-12T17:31:03.037376+0000","last_became_active":"2024-09-12T17:27:32.761809+0000","last_became_peered":"2024-09-12T17:27:32.761809+0000","last_unstale":"2024-09-12T17:31:03.037376+0000","last_undegraded":"2024-09-12T17:31:03.037376+0000","last_fullsized":"2024-09-12T17:31:03.037376+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:03.037295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:03.037295+0000","last_clean_scrub_stamp":"2024-09-12T17:31:03.037295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:57:59.113302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051333900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"31'3","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:03.795932+0000","last_change":"2024-09-12T17:31:03.795932+0000","last_active":"2024-09-12T17:31:03.795932+0000","last_peered":"2024-09-12T17:31:03.795932+0000","last_clean":"2024-09-12T17:31:03.795932+0000","last_became_active":"2024-09-12T17:27:40.417664+0000","last_became_peered":"2024-09-12T17:27:40.417664+0000","last_unstale":"2024-09-12T17:31:03.795932+0000","last_undegraded":"2024-09-12T17:31:03.795932+0000","last_fullsized":"2024-09-12T17:31:03.795932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-09-12T17:31:03.795825+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-09-12T17:31:03.795825+0000","last_clean_scrub_stamp":"2024-09-12T17:31:03.795825+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:31:39.240916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"22'2","reported_seq":234,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.748852+0000","last_change":"2024-09-12T17:28:21.479837+0000","last_active":"2024-09-12T17:30:56.748852+0000","last_peered":"2024-09-12T17:30:56.748852+0000","last_clean":"2024-09-12T17:30:56.748852+0000","last_became_active":"2024-09-12T17:28:21.473073+0000","last_became_peered":"2024-09-12T17:28:21.473073+0000","last_unstale":"2024-09-12T17:30:56.748852+0000","last_undegraded":"2024-09-12T17:30:56.748852+0000","last_fullsized":"2024-09-12T17:30:56.748852+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:19.813164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":482,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"31'17","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.234475+0000","last_change":"2024-09-12T17:27:46.435712+0000","last_active":"2024-09-12T17:30:50.234475+0000","last_peered":"2024-09-12T17:30:50.234475+0000","last_clean":"2024-09-12T17:30:50.234475+0000","last_became_active":"2024-09-12T17:27:46.435381+0000","last_became_peered":"2024-09-12T17:27:46.435381+0000","last_unstale":"2024-09-12T17:30:50.234475+0000","last_undegraded":"2024-09-12T17:30:50.234475+0000","last_fullsized":"2024-09-12T17:30:50.234475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:41.723829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.472358+0000","last_change":"2024-09-12T17:27:48.451538+0000","last_active":"2024-09-12T17:28:21.472358+0000","last_peered":"2024-09-12T17:28:21.472358+0000","last_clean":"2024-09-12T17:28:21.472358+0000","last_became_active":"2024-09-12T17:27:48.451225+0000","last_became_peered":"2024-09-12T17:27:48.451225+0000","last_unstale":"2024-09-12T17:28:21.472358+0000","last_undegraded":"2024-09-12T17:28:21.472358+0000","last_fullsized":"2024-09-12T17:28:21.472358+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:18.269897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463520+0000","last_change":"2024-09-12T17:27:50.453764+0000","last_active":"2024-09-12T17:28:21.463520+0000","last_peered":"2024-09-12T17:28:21.463520+0000","last_clean":"2024-09-12T17:28:21.463520+0000","last_became_active":"2024-09-12T17:27:50.453458+0000","last_became_peered":"2024-09-12T17:27:50.453458+0000","last_unstale":"2024-09-12T17:28:21.463520+0000","last_undegraded":"2024-09-12T17:28:21.463520+0000","last_fullsized":"2024-09-12T17:28:21.463520+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:48.900827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"31'10","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:15.887674+0000","last_change":"2024-09-12T17:31:15.887674+0000","last_active":"2024-09-12T17:31:15.887674+0000","last_peered":"2024-09-12T17:31:15.887674+0000","last_clean":"2024-09-12T17:31:15.887674+0000","last_became_active":"2024-09-12T17:27:42.427591+0000","last_became_peered":"2024-09-12T17:27:42.427591+0000","last_unstale":"2024-09-12T17:31:15.887674+0000","last_undegraded":"2024-09-12T17:31:15.887674+0000","last_fullsized":"2024-09-12T17:31:15.887674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-12T17:31:15.887587+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-12T17:31:15.887587+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.887587+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:34.580284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"31'3","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:02.205137+0000","last_change":"2024-09-12T17:31:02.205137+0000","last_active":"2024-09-12T17:31:02.205137+0000","last_peered":"2024-09-12T17:31:02.205137+0000","last_clean":"2024-09-12T17:31:02.205137+0000","last_became_active":"2024-09-12T17:27:32.761967+0000","last_became_peered":"2024-09-12T17:27:32.761967+0000","last_unstale":"2024-09-12T17:31:02.205137+0000","last_undegraded":"2024-09-12T17:31:02.205137+0000","last_fullsized":"2024-09-12T17:31:02.205137+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-09-12T17:31:02.205052+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-09-12T17:31:02.205052+0000","last_clean_scrub_stamp":"2024-09-12T17:31:02.205052+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:42.393847+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001062323,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:04.082738+0000","last_change":"2024-09-12T17:31:04.082738+0000","last_active":"2024-09-12T17:31:04.082738+0000","last_peered":"2024-09-12T17:31:04.082738+0000","last_clean":"2024-09-12T17:31:04.082738+0000","last_became_active":"2024-09-12T17:27:40.425973+0000","last_became_peered":"2024-09-12T17:27:40.425973+0000","last_unstale":"2024-09-12T17:31:04.082738+0000","last_undegraded":"2024-09-12T17:31:04.082738+0000","last_fullsized":"2024-09-12T17:31:04.082738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:04.082603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:04.082603+0000","last_clean_scrub_stamp":"2024-09-12T17:31:04.082603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:21.270783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.473874+0000","last_change":"2024-09-12T17:27:44.432667+0000","last_active":"2024-09-12T17:28:21.473874+0000","last_peered":"2024-09-12T17:28:21.473874+0000","last_clean":"2024-09-12T17:28:21.473874+0000","last_became_active":"2024-09-12T17:27:44.432348+0000","last_became_peered":"2024-09-12T17:27:44.432348+0000","last_unstale":"2024-09-12T17:28:21.473874+0000","last_undegraded":"2024-09-12T17:28:21.473874+0000","last_fullsized":"2024-09-12T17:28:21.473874+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:56.521250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"31'14","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.091058+0000","last_change":"2024-09-12T17:27:46.442771+0000","last_active":"2024-09-12T17:30:49.091058+0000","last_peered":"2024-09-12T17:30:49.091058+0000","last_clean":"2024-09-12T17:30:49.091058+0000","last_became_active":"2024-09-12T17:27:46.442488+0000","last_became_peered":"2024-09-12T17:27:46.442488+0000","last_unstale":"2024-09-12T17:30:49.091058+0000","last_undegraded":"2024-09-12T17:30:49.091058+0000","last_fullsized":"2024-09-12T17:30:49.091058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:31.634237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466202+0000","last_change":"2024-09-12T17:27:48.451472+0000","last_active":"2024-09-12T17:28:21.466202+0000","last_peered":"2024-09-12T17:28:21.466202+0000","last_clean":"2024-09-12T17:28:21.466202+0000","last_became_active":"2024-09-12T17:27:48.451075+0000","last_became_peered":"2024-09-12T17:27:48.451075+0000","last_unstale":"2024-09-12T17:28:21.466202+0000","last_undegraded":"2024-09-12T17:28:21.466202+0000","last_fullsized":"2024-09-12T17:28:21.466202+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:41.217292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'10","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:48.840270+0000","last_change":"2024-09-12T17:27:50.456671+0000","last_active":"2024-09-12T17:29:48.840270+0000","last_peered":"2024-09-12T17:29:48.840270+0000","last_clean":"2024-09-12T17:29:48.840270+0000","last_became_active":"2024-09-12T17:27:50.455608+0000","last_became_peered":"2024-09-12T17:27:50.455608+0000","last_unstale":"2024-09-12T17:29:48.840270+0000","last_undegraded":"2024-09-12T17:29:48.840270+0000","last_fullsized":"2024-09-12T17:29:48.840270+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:23.681507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":17,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'14","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:16.142405+0000","last_change":"2024-09-12T17:31:16.142405+0000","last_active":"2024-09-12T17:31:16.142405+0000","last_peered":"2024-09-12T17:31:16.142405+0000","last_clean":"2024-09-12T17:31:16.142405+0000","last_became_active":"2024-09-12T17:28:21.471756+0000","last_became_peered":"2024-09-12T17:28:21.471756+0000","last_unstale":"2024-09-12T17:31:16.142405+0000","last_undegraded":"2024-09-12T17:31:16.142405+0000","last_fullsized":"2024-09-12T17:31:16.142405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-12T17:31:16.142322+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-12T17:31:16.142322+0000","last_clean_scrub_stamp":"2024-09-12T17:31:16.142322+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:39.000259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:01.009730+0000","last_change":"2024-09-12T17:31:01.009730+0000","last_active":"2024-09-12T17:31:01.009730+0000","last_peered":"2024-09-12T17:31:01.009730+0000","last_clean":"2024-09-12T17:31:01.009730+0000","last_became_active":"2024-09-12T17:27:40.424286+0000","last_became_peered":"2024-09-12T17:27:40.424286+0000","last_unstale":"2024-09-12T17:31:01.009730+0000","last_undegraded":"2024-09-12T17:31:01.009730+0000","last_fullsized":"2024-09-12T17:31:01.009730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:01.009648+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:01.009648+0000","last_clean_scrub_stamp":"2024-09-12T17:31:01.009648+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:15.810543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:59.835771+0000","last_change":"2024-09-12T17:30:59.835771+0000","last_active":"2024-09-12T17:30:59.835771+0000","last_peered":"2024-09-12T17:30:59.835771+0000","last_clean":"2024-09-12T17:30:59.835771+0000","last_became_active":"2024-09-12T17:27:32.761595+0000","last_became_peered":"2024-09-12T17:27:32.761595+0000","last_unstale":"2024-09-12T17:30:59.835771+0000","last_undegraded":"2024-09-12T17:30:59.835771+0000","last_fullsized":"2024-09-12T17:30:59.835771+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:59.835655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:59.835655+0000","last_clean_scrub_stamp":"2024-09-12T17:30:59.835655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:14.315612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000417551,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"31'1","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.353832+0000","last_change":"2024-09-12T17:27:44.432884+0000","last_active":"2024-09-12T17:30:50.353832+0000","last_peered":"2024-09-12T17:30:50.353832+0000","last_clean":"2024-09-12T17:30:50.353832+0000","last_became_active":"2024-09-12T17:27:44.432492+0000","last_became_peered":"2024-09-12T17:27:44.432492+0000","last_unstale":"2024-09-12T17:30:50.353832+0000","last_undegraded":"2024-09-12T17:30:50.353832+0000","last_fullsized":"2024-09-12T17:30:50.353832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:10.580513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"31'67","reported_seq":135,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.908193+0000","last_change":"2024-09-12T17:27:46.439404+0000","last_active":"2024-09-12T17:30:56.908193+0000","last_peered":"2024-09-12T17:30:56.908193+0000","last_clean":"2024-09-12T17:30:56.908193+0000","last_became_active":"2024-09-12T17:27:46.439014+0000","last_became_peered":"2024-09-12T17:27:46.439014+0000","last_unstale":"2024-09-12T17:30:56.908193+0000","last_undegraded":"2024-09-12T17:30:56.908193+0000","last_fullsized":"2024-09-12T17:30:56.908193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:18.977626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.467285+0000","last_change":"2024-09-12T17:27:48.439106+0000","last_active":"2024-09-12T17:28:21.467285+0000","last_peered":"2024-09-12T17:28:21.467285+0000","last_clean":"2024-09-12T17:28:21.467285+0000","last_became_active":"2024-09-12T17:27:48.438779+0000","last_became_peered":"2024-09-12T17:27:48.438779+0000","last_unstale":"2024-09-12T17:28:21.467285+0000","last_undegraded":"2024-09-12T17:28:21.467285+0000","last_fullsized":"2024-09-12T17:28:21.467285+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:49.022922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"31'13","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.020053+0000","last_change":"2024-09-12T17:27:50.448485+0000","last_active":"2024-09-12T17:30:50.020053+0000","last_peered":"2024-09-12T17:30:50.020053+0000","last_clean":"2024-09-12T17:30:50.020053+0000","last_became_active":"2024-09-12T17:27:50.448060+0000","last_became_peered":"2024-09-12T17:27:50.448060+0000","last_unstale":"2024-09-12T17:30:50.020053+0000","last_undegraded":"2024-09-12T17:30:50.020053+0000","last_fullsized":"2024-09-12T17:30:50.020053+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:10.453854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":31,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"31'27","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:12.291292+0000","last_change":"2024-09-12T17:31:12.291292+0000","last_active":"2024-09-12T17:31:12.291292+0000","last_peered":"2024-09-12T17:31:12.291292+0000","last_clean":"2024-09-12T17:31:12.291292+0000","last_became_active":"2024-09-12T17:27:42.432800+0000","last_became_peered":"2024-09-12T17:27:42.432800+0000","last_unstale":"2024-09-12T17:31:12.291292+0000","last_undegraded":"2024-09-12T17:31:12.291292+0000","last_fullsized":"2024-09-12T17:31:12.291292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'27","last_scrub_stamp":"2024-09-12T17:31:12.291188+0000","last_deep_scrub":"31'27","last_deep_scrub_stamp":"2024-09-12T17:31:12.291188+0000","last_clean_scrub_stamp":"2024-09-12T17:31:12.291188+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:58.552254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":99,"num_read_kb":83,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"31'4","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:05.776042+0000","last_change":"2024-09-12T17:31:05.776042+0000","last_active":"2024-09-12T17:31:05.776042+0000","last_peered":"2024-09-12T17:31:05.776042+0000","last_clean":"2024-09-12T17:31:05.776042+0000","last_became_active":"2024-09-12T17:27:40.418873+0000","last_became_peered":"2024-09-12T17:27:40.418873+0000","last_unstale":"2024-09-12T17:31:05.776042+0000","last_undegraded":"2024-09-12T17:31:05.776042+0000","last_fullsized":"2024-09-12T17:31:05.776042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:05.775954+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:05.775954+0000","last_clean_scrub_stamp":"2024-09-12T17:31:05.775954+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:05.095403+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:03.225739+0000","last_change":"2024-09-12T17:31:03.225739+0000","last_active":"2024-09-12T17:31:03.225739+0000","last_peered":"2024-09-12T17:31:03.225739+0000","last_clean":"2024-09-12T17:31:03.225739+0000","last_became_active":"2024-09-12T17:27:32.761677+0000","last_became_peered":"2024-09-12T17:27:32.761677+0000","last_unstale":"2024-09-12T17:31:03.225739+0000","last_undegraded":"2024-09-12T17:31:03.225739+0000","last_fullsized":"2024-09-12T17:31:03.225739+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:03.225639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:03.225639+0000","last_clean_scrub_stamp":"2024-09-12T17:31:03.225639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:53.792882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001356625,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463624+0000","last_change":"2024-09-12T17:27:44.426949+0000","last_active":"2024-09-12T17:28:21.463624+0000","last_peered":"2024-09-12T17:28:21.463624+0000","last_clean":"2024-09-12T17:28:21.463624+0000","last_became_active":"2024-09-12T17:27:44.426647+0000","last_became_peered":"2024-09-12T17:27:44.426647+0000","last_unstale":"2024-09-12T17:28:21.463624+0000","last_undegraded":"2024-09-12T17:28:21.463624+0000","last_fullsized":"2024-09-12T17:28:21.463624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:54.776333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"29'15","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468427+0000","last_change":"2024-09-12T17:27:46.439375+0000","last_active":"2024-09-12T17:28:21.468427+0000","last_peered":"2024-09-12T17:28:21.468427+0000","last_clean":"2024-09-12T17:28:21.468427+0000","last_became_active":"2024-09-12T17:27:46.439038+0000","last_became_peered":"2024-09-12T17:27:46.439038+0000","last_unstale":"2024-09-12T17:28:21.468427+0000","last_undegraded":"2024-09-12T17:28:21.468427+0000","last_fullsized":"2024-09-12T17:28:21.468427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:18.536701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"31'285","reported_seq":350,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.774859+0000","last_change":"2024-09-12T17:27:48.442198+0000","last_active":"2024-09-12T17:30:56.774859+0000","last_peered":"2024-09-12T17:30:56.774859+0000","last_clean":"2024-09-12T17:30:56.774859+0000","last_became_active":"2024-09-12T17:27:48.440948+0000","last_became_peered":"2024-09-12T17:27:48.440948+0000","last_unstale":"2024-09-12T17:30:56.774859+0000","last_undegraded":"2024-09-12T17:30:56.774859+0000","last_fullsized":"2024-09-12T17:30:56.774859+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:58.653865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465509+0000","last_change":"2024-09-12T17:27:50.455097+0000","last_active":"2024-09-12T17:28:21.465509+0000","last_peered":"2024-09-12T17:28:21.465509+0000","last_clean":"2024-09-12T17:28:21.465509+0000","last_became_active":"2024-09-12T17:27:50.454241+0000","last_became_peered":"2024-09-12T17:27:50.454241+0000","last_unstale":"2024-09-12T17:28:21.465509+0000","last_undegraded":"2024-09-12T17:28:21.465509+0000","last_fullsized":"2024-09-12T17:28:21.465509+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:01.881864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"31'16","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.203650+0000","last_change":"2024-09-12T17:27:42.424267+0000","last_active":"2024-09-12T17:30:50.203650+0000","last_peered":"2024-09-12T17:30:50.203650+0000","last_clean":"2024-09-12T17:30:50.203650+0000","last_became_active":"2024-09-12T17:27:42.423805+0000","last_became_peered":"2024-09-12T17:27:42.423805+0000","last_unstale":"2024-09-12T17:30:50.203650+0000","last_undegraded":"2024-09-12T17:30:50.203650+0000","last_fullsized":"2024-09-12T17:30:50.203650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:37.154226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:07.273111+0000","last_change":"2024-09-12T17:31:07.273111+0000","last_active":"2024-09-12T17:31:07.273111+0000","last_peered":"2024-09-12T17:31:07.273111+0000","last_clean":"2024-09-12T17:31:07.273111+0000","last_became_active":"2024-09-12T17:27:40.423703+0000","last_became_peered":"2024-09-12T17:27:40.423703+0000","last_unstale":"2024-09-12T17:31:07.273111+0000","last_undegraded":"2024-09-12T17:31:07.273111+0000","last_fullsized":"2024-09-12T17:31:07.273111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:07.273027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:07.273027+0000","last_clean_scrub_stamp":"2024-09-12T17:31:07.273027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:59.920670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:00.826782+0000","last_change":"2024-09-12T17:31:00.826782+0000","last_active":"2024-09-12T17:31:00.826782+0000","last_peered":"2024-09-12T17:31:00.826782+0000","last_clean":"2024-09-12T17:31:00.826782+0000","last_became_active":"2024-09-12T17:27:32.761590+0000","last_became_peered":"2024-09-12T17:27:32.761590+0000","last_unstale":"2024-09-12T17:31:00.826782+0000","last_undegraded":"2024-09-12T17:31:00.826782+0000","last_fullsized":"2024-09-12T17:31:00.826782+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:00.826700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:00.826700+0000","last_clean_scrub_stamp":"2024-09-12T17:31:00.826700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:41.176527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036072200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463699+0000","last_change":"2024-09-12T17:27:44.427647+0000","last_active":"2024-09-12T17:28:21.463699+0000","last_peered":"2024-09-12T17:28:21.463699+0000","last_clean":"2024-09-12T17:28:21.463699+0000","last_became_active":"2024-09-12T17:27:44.427318+0000","last_became_peered":"2024-09-12T17:27:44.427318+0000","last_unstale":"2024-09-12T17:28:21.463699+0000","last_undegraded":"2024-09-12T17:28:21.463699+0000","last_fullsized":"2024-09-12T17:28:21.463699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:46.727329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'10","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464060+0000","last_change":"2024-09-12T17:27:46.444325+0000","last_active":"2024-09-12T17:28:21.464060+0000","last_peered":"2024-09-12T17:28:21.464060+0000","last_clean":"2024-09-12T17:28:21.464060+0000","last_became_active":"2024-09-12T17:27:46.443937+0000","last_became_peered":"2024-09-12T17:27:46.443937+0000","last_unstale":"2024-09-12T17:28:21.464060+0000","last_undegraded":"2024-09-12T17:28:21.464060+0000","last_fullsized":"2024-09-12T17:28:21.464060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:54:23.541095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"31'285","reported_seq":393,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.779911+0000","last_change":"2024-09-12T17:27:48.441935+0000","last_active":"2024-09-12T17:30:56.779911+0000","last_peered":"2024-09-12T17:30:56.779911+0000","last_clean":"2024-09-12T17:30:56.779911+0000","last_became_active":"2024-09-12T17:27:48.441694+0000","last_became_peered":"2024-09-12T17:27:48.441694+0000","last_unstale":"2024-09-12T17:30:56.779911+0000","last_undegraded":"2024-09-12T17:30:56.779911+0000","last_fullsized":"2024-09-12T17:30:56.779911+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:32.578727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"29'3","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468923+0000","last_change":"2024-09-12T17:27:50.453171+0000","last_active":"2024-09-12T17:28:21.468923+0000","last_peered":"2024-09-12T17:28:21.468923+0000","last_clean":"2024-09-12T17:28:21.468923+0000","last_became_active":"2024-09-12T17:27:50.452862+0000","last_became_peered":"2024-09-12T17:27:50.452862+0000","last_unstale":"2024-09-12T17:28:21.468923+0000","last_undegraded":"2024-09-12T17:28:21.468923+0000","last_fullsized":"2024-09-12T17:28:21.468923+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:55.038103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"29'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:17.188673+0000","last_change":"2024-09-12T17:31:17.188673+0000","last_active":"2024-09-12T17:31:17.188673+0000","last_peered":"2024-09-12T17:31:17.188673+0000","last_clean":"2024-09-12T17:31:17.188673+0000","last_became_active":"2024-09-12T17:27:42.436667+0000","last_became_peered":"2024-09-12T17:27:42.436667+0000","last_unstale":"2024-09-12T17:31:17.188673+0000","last_undegraded":"2024-09-12T17:31:17.188673+0000","last_fullsized":"2024-09-12T17:31:17.188673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-12T17:31:17.188564+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-12T17:31:17.188564+0000","last_clean_scrub_stamp":"2024-09-12T17:31:17.188564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:45.338606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:00.488993+0000","last_change":"2024-09-12T17:31:00.488993+0000","last_active":"2024-09-12T17:31:00.488993+0000","last_peered":"2024-09-12T17:31:00.488993+0000","last_clean":"2024-09-12T17:31:00.488993+0000","last_became_active":"2024-09-12T17:27:40.419472+0000","last_became_peered":"2024-09-12T17:27:40.419472+0000","last_unstale":"2024-09-12T17:31:00.488993+0000","last_undegraded":"2024-09-12T17:31:00.488993+0000","last_fullsized":"2024-09-12T17:31:00.488993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:00.488897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:00.488897+0000","last_clean_scrub_stamp":"2024-09-12T17:31:00.488897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:42.257433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:06.255467+0000","last_change":"2024-09-12T17:31:06.255467+0000","last_active":"2024-09-12T17:31:06.255467+0000","last_peered":"2024-09-12T17:31:06.255467+0000","last_clean":"2024-09-12T17:31:06.255467+0000","last_became_active":"2024-09-12T17:27:32.775344+0000","last_became_peered":"2024-09-12T17:27:32.775344+0000","last_unstale":"2024-09-12T17:31:06.255467+0000","last_undegraded":"2024-09-12T17:31:06.255467+0000","last_fullsized":"2024-09-12T17:31:06.255467+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:06.255380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:06.255380+0000","last_clean_scrub_stamp":"2024-09-12T17:31:06.255380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:58.712793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011343939999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463970+0000","last_change":"2024-09-12T17:27:44.427846+0000","last_active":"2024-09-12T17:28:21.463970+0000","last_peered":"2024-09-12T17:28:21.463970+0000","last_clean":"2024-09-12T17:28:21.463970+0000","last_became_active":"2024-09-12T17:27:44.427519+0000","last_became_peered":"2024-09-12T17:27:44.427519+0000","last_unstale":"2024-09-12T17:28:21.463970+0000","last_undegraded":"2024-09-12T17:28:21.463970+0000","last_fullsized":"2024-09-12T17:28:21.463970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:56.857897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"31'91","reported_seq":176,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.917412+0000","last_change":"2024-09-12T17:27:46.442632+0000","last_active":"2024-09-12T17:30:56.917412+0000","last_peered":"2024-09-12T17:30:56.917412+0000","last_clean":"2024-09-12T17:30:56.917412+0000","last_became_active":"2024-09-12T17:27:46.442154+0000","last_became_peered":"2024-09-12T17:27:46.442154+0000","last_unstale":"2024-09-12T17:30:56.917412+0000","last_undegraded":"2024-09-12T17:30:56.917412+0000","last_fullsized":"2024-09-12T17:30:56.917412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:20.802573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471089+0000","last_change":"2024-09-12T17:27:48.440496+0000","last_active":"2024-09-12T17:28:21.471089+0000","last_peered":"2024-09-12T17:28:21.471089+0000","last_clean":"2024-09-12T17:28:21.471089+0000","last_became_active":"2024-09-12T17:27:48.440177+0000","last_became_peered":"2024-09-12T17:27:48.440177+0000","last_unstale":"2024-09-12T17:28:21.471089+0000","last_undegraded":"2024-09-12T17:28:21.471089+0000","last_fullsized":"2024-09-12T17:28:21.471089+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:26.852348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466258+0000","last_change":"2024-09-12T17:27:50.454208+0000","last_active":"2024-09-12T17:28:21.466258+0000","last_peered":"2024-09-12T17:28:21.466258+0000","last_clean":"2024-09-12T17:28:21.466258+0000","last_became_active":"2024-09-12T17:27:50.453919+0000","last_became_peered":"2024-09-12T17:27:50.453919+0000","last_unstale":"2024-09-12T17:28:21.466258+0000","last_undegraded":"2024-09-12T17:28:21.466258+0000","last_fullsized":"2024-09-12T17:28:21.466258+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:28.859033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469099+0000","last_change":"2024-09-12T17:27:50.454609+0000","last_active":"2024-09-12T17:28:21.469099+0000","last_peered":"2024-09-12T17:28:21.469099+0000","last_clean":"2024-09-12T17:28:21.469099+0000","last_became_active":"2024-09-12T17:27:50.452190+0000","last_became_peered":"2024-09-12T17:27:50.452190+0000","last_unstale":"2024-09-12T17:28:21.469099+0000","last_undegraded":"2024-09-12T17:28:21.469099+0000","last_fullsized":"2024-09-12T17:28:21.469099+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:08.249355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:05.195137+0000","last_change":"2024-09-12T17:27:42.436477+0000","last_active":"2024-09-12T17:29:05.195137+0000","last_peered":"2024-09-12T17:29:05.195137+0000","last_clean":"2024-09-12T17:29:05.195137+0000","last_became_active":"2024-09-12T17:27:42.436187+0000","last_became_peered":"2024-09-12T17:27:42.436187+0000","last_unstale":"2024-09-12T17:29:05.195137+0000","last_undegraded":"2024-09-12T17:29:05.195137+0000","last_fullsized":"2024-09-12T17:29:05.195137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:06.625797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"29'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:16.370798+0000","last_change":"2024-09-12T17:31:16.370798+0000","last_active":"2024-09-12T17:31:16.370798+0000","last_peered":"2024-09-12T17:31:16.370798+0000","last_clean":"2024-09-12T17:31:16.370798+0000","last_became_active":"2024-09-12T17:27:40.428529+0000","last_became_peered":"2024-09-12T17:27:40.428529+0000","last_unstale":"2024-09-12T17:31:16.370798+0000","last_undegraded":"2024-09-12T17:31:16.370798+0000","last_fullsized":"2024-09-12T17:31:16.370798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-12T17:31:16.370693+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-12T17:31:16.370693+0000","last_clean_scrub_stamp":"2024-09-12T17:31:16.370693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:11.675892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470025+0000","last_change":"2024-09-12T17:27:44.430001+0000","last_active":"2024-09-12T17:28:21.470025+0000","last_peered":"2024-09-12T17:28:21.470025+0000","last_clean":"2024-09-12T17:28:21.470025+0000","last_became_active":"2024-09-12T17:27:44.429701+0000","last_became_peered":"2024-09-12T17:27:44.429701+0000","last_unstale":"2024-09-12T17:28:21.470025+0000","last_undegraded":"2024-09-12T17:28:21.470025+0000","last_fullsized":"2024-09-12T17:28:21.470025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:31.928670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"31'35","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.831082+0000","last_change":"2024-09-12T17:27:46.443026+0000","last_active":"2024-09-12T17:30:56.831082+0000","last_peered":"2024-09-12T17:30:56.831082+0000","last_clean":"2024-09-12T17:30:56.831082+0000","last_became_active":"2024-09-12T17:27:46.442713+0000","last_became_peered":"2024-09-12T17:27:46.442713+0000","last_unstale":"2024-09-12T17:30:56.831082+0000","last_undegraded":"2024-09-12T17:30:56.831082+0000","last_fullsized":"2024-09-12T17:30:56.831082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:29.878441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463885+0000","last_change":"2024-09-12T17:27:48.450563+0000","last_active":"2024-09-12T17:28:21.463885+0000","last_peered":"2024-09-12T17:28:21.463885+0000","last_clean":"2024-09-12T17:28:21.463885+0000","last_became_active":"2024-09-12T17:27:48.450050+0000","last_became_peered":"2024-09-12T17:27:48.450050+0000","last_unstale":"2024-09-12T17:28:21.463885+0000","last_undegraded":"2024-09-12T17:28:21.463885+0000","last_fullsized":"2024-09-12T17:28:21.463885+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:37.430305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"31'5","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.306851+0000","last_change":"2024-09-12T17:27:50.453680+0000","last_active":"2024-09-12T17:29:47.306851+0000","last_peered":"2024-09-12T17:29:47.306851+0000","last_clean":"2024-09-12T17:29:47.306851+0000","last_became_active":"2024-09-12T17:27:50.453382+0000","last_became_peered":"2024-09-12T17:27:50.453382+0000","last_unstale":"2024-09-12T17:29:47.306851+0000","last_undegraded":"2024-09-12T17:29:47.306851+0000","last_fullsized":"2024-09-12T17:29:47.306851+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:21.594797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"31'8","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:19.332207+0000","last_change":"2024-09-12T17:31:19.332207+0000","last_active":"2024-09-12T17:31:19.332207+0000","last_peered":"2024-09-12T17:31:19.332207+0000","last_clean":"2024-09-12T17:31:19.332207+0000","last_became_active":"2024-09-12T17:27:42.436150+0000","last_became_peered":"2024-09-12T17:27:42.436150+0000","last_unstale":"2024-09-12T17:31:19.332207+0000","last_undegraded":"2024-09-12T17:31:19.332207+0000","last_fullsized":"2024-09-12T17:31:19.332207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:19.332119+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:19.332119+0000","last_clean_scrub_stamp":"2024-09-12T17:31:19.332119+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:45.819987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:07.073417+0000","last_change":"2024-09-12T17:31:07.073417+0000","last_active":"2024-09-12T17:31:07.073417+0000","last_peered":"2024-09-12T17:31:07.073417+0000","last_clean":"2024-09-12T17:31:07.073417+0000","last_became_active":"2024-09-12T17:27:40.431962+0000","last_became_peered":"2024-09-12T17:27:40.431962+0000","last_unstale":"2024-09-12T17:31:07.073417+0000","last_undegraded":"2024-09-12T17:31:07.073417+0000","last_fullsized":"2024-09-12T17:31:07.073417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:07.073320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:07.073320+0000","last_clean_scrub_stamp":"2024-09-12T17:31:07.073320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:17.908445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465368+0000","last_change":"2024-09-12T17:27:44.432604+0000","last_active":"2024-09-12T17:28:21.465368+0000","last_peered":"2024-09-12T17:28:21.465368+0000","last_clean":"2024-09-12T17:28:21.465368+0000","last_became_active":"2024-09-12T17:27:44.432334+0000","last_became_peered":"2024-09-12T17:27:44.432334+0000","last_unstale":"2024-09-12T17:28:21.465368+0000","last_undegraded":"2024-09-12T17:28:21.465368+0000","last_fullsized":"2024-09-12T17:28:21.465368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:32.282020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"31'6","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.113421+0000","last_change":"2024-09-12T17:27:46.435861+0000","last_active":"2024-09-12T17:30:49.113421+0000","last_peered":"2024-09-12T17:30:49.113421+0000","last_clean":"2024-09-12T17:30:49.113421+0000","last_became_active":"2024-09-12T17:27:46.435567+0000","last_became_peered":"2024-09-12T17:27:46.435567+0000","last_unstale":"2024-09-12T17:30:49.113421+0000","last_undegraded":"2024-09-12T17:30:49.113421+0000","last_fullsized":"2024-09-12T17:30:49.113421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:25.415585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466933+0000","last_change":"2024-09-12T17:27:48.448838+0000","last_active":"2024-09-12T17:28:21.466933+0000","last_peered":"2024-09-12T17:28:21.466933+0000","last_clean":"2024-09-12T17:28:21.466933+0000","last_became_active":"2024-09-12T17:27:48.448478+0000","last_became_peered":"2024-09-12T17:27:48.448478+0000","last_unstale":"2024-09-12T17:28:21.466933+0000","last_undegraded":"2024-09-12T17:28:21.466933+0000","last_fullsized":"2024-09-12T17:28:21.466933+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:31.633824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"31'8","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:22.316873+0000","last_change":"2024-09-12T17:27:50.449599+0000","last_active":"2024-09-12T17:28:22.316873+0000","last_peered":"2024-09-12T17:28:22.316873+0000","last_clean":"2024-09-12T17:28:22.316873+0000","last_became_active":"2024-09-12T17:27:50.449302+0000","last_became_peered":"2024-09-12T17:27:50.449302+0000","last_unstale":"2024-09-12T17:28:22.316873+0000","last_undegraded":"2024-09-12T17:28:22.316873+0000","last_fullsized":"2024-09-12T17:28:22.316873+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:02.835518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"31'4","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:17.849853+0000","last_change":"2024-09-12T17:31:17.849853+0000","last_active":"2024-09-12T17:31:17.849853+0000","last_peered":"2024-09-12T17:31:17.849853+0000","last_clean":"2024-09-12T17:31:17.849853+0000","last_became_active":"2024-09-12T17:27:42.423974+0000","last_became_peered":"2024-09-12T17:27:42.423974+0000","last_unstale":"2024-09-12T17:31:17.849853+0000","last_undegraded":"2024-09-12T17:31:17.849853+0000","last_fullsized":"2024-09-12T17:31:17.849853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:17.849764+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:17.849764+0000","last_clean_scrub_stamp":"2024-09-12T17:31:17.849764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:32.821977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:08.073247+0000","last_change":"2024-09-12T17:31:08.073247+0000","last_active":"2024-09-12T17:31:08.073247+0000","last_peered":"2024-09-12T17:31:08.073247+0000","last_clean":"2024-09-12T17:31:08.073247+0000","last_became_active":"2024-09-12T17:27:40.430154+0000","last_became_peered":"2024-09-12T17:27:40.430154+0000","last_unstale":"2024-09-12T17:31:08.073247+0000","last_undegraded":"2024-09-12T17:31:08.073247+0000","last_fullsized":"2024-09-12T17:31:08.073247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:08.073165+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:08.073165+0000","last_clean_scrub_stamp":"2024-09-12T17:31:08.073165+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:18.392407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466293+0000","last_change":"2024-09-12T17:27:44.435267+0000","last_active":"2024-09-12T17:28:21.466293+0000","last_peered":"2024-09-12T17:28:21.466293+0000","last_clean":"2024-09-12T17:28:21.466293+0000","last_became_active":"2024-09-12T17:27:44.434979+0000","last_became_peered":"2024-09-12T17:27:44.434979+0000","last_unstale":"2024-09-12T17:28:21.466293+0000","last_undegraded":"2024-09-12T17:28:21.466293+0000","last_fullsized":"2024-09-12T17:28:21.466293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:20.110019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"31'43","reported_seq":107,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.902031+0000","last_change":"2024-09-12T17:27:46.433815+0000","last_active":"2024-09-12T17:30:56.902031+0000","last_peered":"2024-09-12T17:30:56.902031+0000","last_clean":"2024-09-12T17:30:56.902031+0000","last_became_active":"2024-09-12T17:27:46.433421+0000","last_became_peered":"2024-09-12T17:27:46.433421+0000","last_unstale":"2024-09-12T17:30:56.902031+0000","last_undegraded":"2024-09-12T17:30:56.902031+0000","last_fullsized":"2024-09-12T17:30:56.902031+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:46:25.118826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469750+0000","last_change":"2024-09-12T17:27:48.439853+0000","last_active":"2024-09-12T17:28:21.469750+0000","last_peered":"2024-09-12T17:28:21.469750+0000","last_clean":"2024-09-12T17:28:21.469750+0000","last_became_active":"2024-09-12T17:27:48.439547+0000","last_became_peered":"2024-09-12T17:27:48.439547+0000","last_unstale":"2024-09-12T17:28:21.469750+0000","last_undegraded":"2024-09-12T17:28:21.469750+0000","last_fullsized":"2024-09-12T17:28:21.469750+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:36.201000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464221+0000","last_change":"2024-09-12T17:27:50.459594+0000","last_active":"2024-09-12T17:28:21.464221+0000","last_peered":"2024-09-12T17:28:21.464221+0000","last_clean":"2024-09-12T17:28:21.464221+0000","last_became_active":"2024-09-12T17:27:50.459321+0000","last_became_peered":"2024-09-12T17:27:50.459321+0000","last_unstale":"2024-09-12T17:28:21.464221+0000","last_undegraded":"2024-09-12T17:28:21.464221+0000","last_fullsized":"2024-09-12T17:28:21.464221+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:42.428839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"31'14","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.226040+0000","last_change":"2024-09-12T17:27:42.428640+0000","last_active":"2024-09-12T17:30:50.226040+0000","last_peered":"2024-09-12T17:30:50.226040+0000","last_clean":"2024-09-12T17:30:50.226040+0000","last_became_active":"2024-09-12T17:27:42.428364+0000","last_became_peered":"2024-09-12T17:27:42.428364+0000","last_unstale":"2024-09-12T17:30:50.226040+0000","last_undegraded":"2024-09-12T17:30:50.226040+0000","last_fullsized":"2024-09-12T17:30:50.226040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:30.980696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:03.411106+0000","last_change":"2024-09-12T17:31:03.411106+0000","last_active":"2024-09-12T17:31:03.411106+0000","last_peered":"2024-09-12T17:31:03.411106+0000","last_clean":"2024-09-12T17:31:03.411106+0000","last_became_active":"2024-09-12T17:27:40.415212+0000","last_became_peered":"2024-09-12T17:27:40.415212+0000","last_unstale":"2024-09-12T17:31:03.411106+0000","last_undegraded":"2024-09-12T17:31:03.411106+0000","last_fullsized":"2024-09-12T17:31:03.411106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:03.411027+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:03.411027+0000","last_clean_scrub_stamp":"2024-09-12T17:31:03.411027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:42.311815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463776+0000","last_change":"2024-09-12T17:27:44.430145+0000","last_active":"2024-09-12T17:28:21.463776+0000","last_peered":"2024-09-12T17:28:21.463776+0000","last_clean":"2024-09-12T17:28:21.463776+0000","last_became_active":"2024-09-12T17:27:44.429844+0000","last_became_peered":"2024-09-12T17:27:44.429844+0000","last_unstale":"2024-09-12T17:28:21.463776+0000","last_undegraded":"2024-09-12T17:28:21.463776+0000","last_fullsized":"2024-09-12T17:28:21.463776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:59.753147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"31'34","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.892689+0000","last_change":"2024-09-12T17:27:46.432991+0000","last_active":"2024-09-12T17:30:56.892689+0000","last_peered":"2024-09-12T17:30:56.892689+0000","last_clean":"2024-09-12T17:30:56.892689+0000","last_became_active":"2024-09-12T17:27:46.432650+0000","last_became_peered":"2024-09-12T17:27:46.432650+0000","last_unstale":"2024-09-12T17:30:56.892689+0000","last_undegraded":"2024-09-12T17:30:56.892689+0000","last_fullsized":"2024-09-12T17:30:56.892689+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:21.877058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469478+0000","last_change":"2024-09-12T17:27:48.440110+0000","last_active":"2024-09-12T17:28:21.469478+0000","last_peered":"2024-09-12T17:28:21.469478+0000","last_clean":"2024-09-12T17:28:21.469478+0000","last_became_active":"2024-09-12T17:27:48.439134+0000","last_became_peered":"2024-09-12T17:27:48.439134+0000","last_unstale":"2024-09-12T17:28:21.469478+0000","last_undegraded":"2024-09-12T17:28:21.469478+0000","last_fullsized":"2024-09-12T17:28:21.469478+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:10.067239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:23.352256+0000","last_change":"2024-09-12T17:27:42.427657+0000","last_active":"2024-09-12T17:28:23.352256+0000","last_peered":"2024-09-12T17:28:23.352256+0000","last_clean":"2024-09-12T17:28:23.352256+0000","last_became_active":"2024-09-12T17:27:42.426108+0000","last_became_peered":"2024-09-12T17:27:42.426108+0000","last_unstale":"2024-09-12T17:28:23.352256+0000","last_undegraded":"2024-09-12T17:28:23.352256+0000","last_fullsized":"2024-09-12T17:28:23.352256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:46.077185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:13.378936+0000","last_change":"2024-09-12T17:31:13.378936+0000","last_active":"2024-09-12T17:31:13.378936+0000","last_peered":"2024-09-12T17:31:13.378936+0000","last_clean":"2024-09-12T17:31:13.378936+0000","last_became_active":"2024-09-12T17:27:40.429644+0000","last_became_peered":"2024-09-12T17:27:40.429644+0000","last_unstale":"2024-09-12T17:31:13.378936+0000","last_undegraded":"2024-09-12T17:31:13.378936+0000","last_fullsized":"2024-09-12T17:31:13.378936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:13.378812+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:13.378812+0000","last_clean_scrub_stamp":"2024-09-12T17:31:13.378812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:25.356806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:24.747265+0000","last_change":"2024-09-12T17:28:21.472039+0000","last_active":"2024-09-12T17:28:24.747265+0000","last_peered":"2024-09-12T17:28:24.747265+0000","last_clean":"2024-09-12T17:28:24.747265+0000","last_became_active":"2024-09-12T17:28:21.471678+0000","last_became_peered":"2024-09-12T17:28:21.471678+0000","last_unstale":"2024-09-12T17:28:24.747265+0000","last_undegraded":"2024-09-12T17:28:24.747265+0000","last_fullsized":"2024-09-12T17:28:24.747265+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:05.827719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"31'61","reported_seq":126,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.889697+0000","last_change":"2024-09-12T17:27:46.437943+0000","last_active":"2024-09-12T17:30:56.889697+0000","last_peered":"2024-09-12T17:30:56.889697+0000","last_clean":"2024-09-12T17:30:56.889697+0000","last_became_active":"2024-09-12T17:27:46.437623+0000","last_became_peered":"2024-09-12T17:27:46.437623+0000","last_unstale":"2024-09-12T17:30:56.889697+0000","last_undegraded":"2024-09-12T17:30:56.889697+0000","last_fullsized":"2024-09-12T17:30:56.889697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:29.626451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.467936+0000","last_change":"2024-09-12T17:27:48.440791+0000","last_active":"2024-09-12T17:28:21.467936+0000","last_peered":"2024-09-12T17:28:21.467936+0000","last_clean":"2024-09-12T17:28:21.467936+0000","last_became_active":"2024-09-12T17:27:48.440354+0000","last_became_peered":"2024-09-12T17:27:48.440354+0000","last_unstale":"2024-09-12T17:28:21.467936+0000","last_undegraded":"2024-09-12T17:28:21.467936+0000","last_fullsized":"2024-09-12T17:28:21.467936+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:12.406427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"31'14","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.013731+0000","last_change":"2024-09-12T17:27:50.457985+0000","last_active":"2024-09-12T17:29:49.013731+0000","last_peered":"2024-09-12T17:29:49.013731+0000","last_clean":"2024-09-12T17:29:49.013731+0000","last_became_active":"2024-09-12T17:27:50.457744+0000","last_became_peered":"2024-09-12T17:27:50.457744+0000","last_unstale":"2024-09-12T17:29:49.013731+0000","last_undegraded":"2024-09-12T17:29:49.013731+0000","last_fullsized":"2024-09-12T17:29:49.013731+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:13.394393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"31'6","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:05.377000+0000","last_change":"2024-09-12T17:27:42.424802+0000","last_active":"2024-09-12T17:29:05.377000+0000","last_peered":"2024-09-12T17:29:05.377000+0000","last_clean":"2024-09-12T17:29:05.377000+0000","last_became_active":"2024-09-12T17:27:42.424447+0000","last_became_peered":"2024-09-12T17:27:42.424447+0000","last_unstale":"2024-09-12T17:29:05.377000+0000","last_undegraded":"2024-09-12T17:29:05.377000+0000","last_fullsized":"2024-09-12T17:29:05.377000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:50.988456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:04.363963+0000","last_change":"2024-09-12T17:31:04.363963+0000","last_active":"2024-09-12T17:31:04.363963+0000","last_peered":"2024-09-12T17:31:04.363963+0000","last_clean":"2024-09-12T17:31:04.363963+0000","last_became_active":"2024-09-12T17:27:40.414911+0000","last_became_peered":"2024-09-12T17:27:40.414911+0000","last_unstale":"2024-09-12T17:31:04.363963+0000","last_undegraded":"2024-09-12T17:31:04.363963+0000","last_fullsized":"2024-09-12T17:31:04.363963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:04.363875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:04.363875+0000","last_clean_scrub_stamp":"2024-09-12T17:31:04.363875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:31.145785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"31'4","reported_seq":229,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.748270+0000","last_change":"2024-09-12T17:27:44.428072+0000","last_active":"2024-09-12T17:30:56.748270+0000","last_peered":"2024-09-12T17:30:56.748270+0000","last_clean":"2024-09-12T17:30:56.748270+0000","last_became_active":"2024-09-12T17:27:44.427778+0000","last_became_peered":"2024-09-12T17:27:44.427778+0000","last_unstale":"2024-09-12T17:30:56.748270+0000","last_undegraded":"2024-09-12T17:30:56.748270+0000","last_fullsized":"2024-09-12T17:30:56.748270+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:40.229931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"31'39","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.895653+0000","last_change":"2024-09-12T17:27:46.440779+0000","last_active":"2024-09-12T17:30:56.895653+0000","last_peered":"2024-09-12T17:30:56.895653+0000","last_clean":"2024-09-12T17:30:56.895653+0000","last_became_active":"2024-09-12T17:27:46.440494+0000","last_became_peered":"2024-09-12T17:27:46.440494+0000","last_unstale":"2024-09-12T17:30:56.895653+0000","last_undegraded":"2024-09-12T17:30:56.895653+0000","last_fullsized":"2024-09-12T17:30:56.895653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:43.434855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471249+0000","last_change":"2024-09-12T17:27:48.449171+0000","last_active":"2024-09-12T17:28:21.471249+0000","last_peered":"2024-09-12T17:28:21.471249+0000","last_clean":"2024-09-12T17:28:21.471249+0000","last_became_active":"2024-09-12T17:27:48.448871+0000","last_became_peered":"2024-09-12T17:27:48.448871+0000","last_unstale":"2024-09-12T17:28:21.471249+0000","last_undegraded":"2024-09-12T17:28:21.471249+0000","last_fullsized":"2024-09-12T17:28:21.471249+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:23.511991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463074+0000","last_change":"2024-09-12T17:27:50.452011+0000","last_active":"2024-09-12T17:28:21.463074+0000","last_peered":"2024-09-12T17:28:21.463074+0000","last_clean":"2024-09-12T17:28:21.463074+0000","last_became_active":"2024-09-12T17:27:50.451678+0000","last_became_peered":"2024-09-12T17:27:50.451678+0000","last_unstale":"2024-09-12T17:28:21.463074+0000","last_undegraded":"2024-09-12T17:28:21.463074+0000","last_fullsized":"2024-09-12T17:28:21.463074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:15.594880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.197331+0000","last_change":"2024-09-12T17:27:42.438932+0000","last_active":"2024-09-12T17:30:50.197331+0000","last_peered":"2024-09-12T17:30:50.197331+0000","last_clean":"2024-09-12T17:30:50.197331+0000","last_became_active":"2024-09-12T17:27:42.438583+0000","last_became_peered":"2024-09-12T17:27:42.438583+0000","last_unstale":"2024-09-12T17:30:50.197331+0000","last_undegraded":"2024-09-12T17:30:50.197331+0000","last_fullsized":"2024-09-12T17:30:50.197331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:41.527263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:05.381633+0000","last_change":"2024-09-12T17:31:05.381633+0000","last_active":"2024-09-12T17:31:05.381633+0000","last_peered":"2024-09-12T17:31:05.381633+0000","last_clean":"2024-09-12T17:31:05.381633+0000","last_became_active":"2024-09-12T17:27:40.414034+0000","last_became_peered":"2024-09-12T17:27:40.414034+0000","last_unstale":"2024-09-12T17:31:05.381633+0000","last_undegraded":"2024-09-12T17:31:05.381633+0000","last_fullsized":"2024-09-12T17:31:05.381633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:05.381510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:05.381510+0000","last_clean_scrub_stamp":"2024-09-12T17:31:05.381510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:28.239447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.467688+0000","last_change":"2024-09-12T17:27:44.427310+0000","last_active":"2024-09-12T17:28:21.467688+0000","last_peered":"2024-09-12T17:28:21.467688+0000","last_clean":"2024-09-12T17:28:21.467688+0000","last_became_active":"2024-09-12T17:27:44.426927+0000","last_became_peered":"2024-09-12T17:27:44.426927+0000","last_unstale":"2024-09-12T17:28:21.467688+0000","last_undegraded":"2024-09-12T17:28:21.467688+0000","last_fullsized":"2024-09-12T17:28:21.467688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:51.409386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"31'35","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.847330+0000","last_change":"2024-09-12T17:27:46.439119+0000","last_active":"2024-09-12T17:30:56.847330+0000","last_peered":"2024-09-12T17:30:56.847330+0000","last_clean":"2024-09-12T17:30:56.847330+0000","last_became_active":"2024-09-12T17:27:46.438778+0000","last_became_peered":"2024-09-12T17:27:46.438778+0000","last_unstale":"2024-09-12T17:30:56.847330+0000","last_undegraded":"2024-09-12T17:30:56.847330+0000","last_fullsized":"2024-09-12T17:30:56.847330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:47.015548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.473244+0000","last_change":"2024-09-12T17:27:48.440227+0000","last_active":"2024-09-12T17:28:21.473244+0000","last_peered":"2024-09-12T17:28:21.473244+0000","last_clean":"2024-09-12T17:28:21.473244+0000","last_became_active":"2024-09-12T17:27:48.439888+0000","last_became_peered":"2024-09-12T17:27:48.439888+0000","last_unstale":"2024-09-12T17:28:21.473244+0000","last_undegraded":"2024-09-12T17:28:21.473244+0000","last_fullsized":"2024-09-12T17:28:21.473244+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:29.484764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"31'3","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.072631+0000","last_change":"2024-09-12T17:27:50.455406+0000","last_active":"2024-09-12T17:29:49.072631+0000","last_peered":"2024-09-12T17:29:49.072631+0000","last_clean":"2024-09-12T17:29:49.072631+0000","last_became_active":"2024-09-12T17:27:50.454058+0000","last_became_peered":"2024-09-12T17:27:50.454058+0000","last_unstale":"2024-09-12T17:29:49.072631+0000","last_undegraded":"2024-09-12T17:29:49.072631+0000","last_fullsized":"2024-09-12T17:29:49.072631+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:44.719122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"31'6","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.225767+0000","last_change":"2024-09-12T17:27:42.428738+0000","last_active":"2024-09-12T17:30:50.225767+0000","last_peered":"2024-09-12T17:30:50.225767+0000","last_clean":"2024-09-12T17:30:50.225767+0000","last_became_active":"2024-09-12T17:27:42.428236+0000","last_became_peered":"2024-09-12T17:27:42.428236+0000","last_unstale":"2024-09-12T17:30:50.225767+0000","last_undegraded":"2024-09-12T17:30:50.225767+0000","last_fullsized":"2024-09-12T17:30:50.225767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:41.383292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"31'6","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:17.402187+0000","last_change":"2024-09-12T17:31:17.402187+0000","last_active":"2024-09-12T17:31:17.402187+0000","last_peered":"2024-09-12T17:31:17.402187+0000","last_clean":"2024-09-12T17:31:17.402187+0000","last_became_active":"2024-09-12T17:27:40.428969+0000","last_became_peered":"2024-09-12T17:27:40.428969+0000","last_unstale":"2024-09-12T17:31:17.402187+0000","last_undegraded":"2024-09-12T17:31:17.402187+0000","last_fullsized":"2024-09-12T17:31:17.402187+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-12T17:31:17.402103+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-12T17:31:17.402103+0000","last_clean_scrub_stamp":"2024-09-12T17:31:17.402103+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:02:26.841712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":14,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470977+0000","last_change":"2024-09-12T17:27:44.432908+0000","last_active":"2024-09-12T17:28:21.470977+0000","last_peered":"2024-09-12T17:28:21.470977+0000","last_clean":"2024-09-12T17:28:21.470977+0000","last_became_active":"2024-09-12T17:27:44.432609+0000","last_became_peered":"2024-09-12T17:27:44.432609+0000","last_unstale":"2024-09-12T17:28:21.470977+0000","last_undegraded":"2024-09-12T17:28:21.470977+0000","last_fullsized":"2024-09-12T17:28:21.470977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:38.819057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"29'10","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465451+0000","last_change":"2024-09-12T17:27:46.445145+0000","last_active":"2024-09-12T17:28:21.465451+0000","last_peered":"2024-09-12T17:28:21.465451+0000","last_clean":"2024-09-12T17:28:21.465451+0000","last_became_active":"2024-09-12T17:27:46.444644+0000","last_became_peered":"2024-09-12T17:27:46.444644+0000","last_unstale":"2024-09-12T17:28:21.465451+0000","last_undegraded":"2024-09-12T17:28:21.465451+0000","last_fullsized":"2024-09-12T17:28:21.465451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:28.337567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"31'285","reported_seq":374,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.773238+0000","last_change":"2024-09-12T17:27:48.449435+0000","last_active":"2024-09-12T17:30:56.773238+0000","last_peered":"2024-09-12T17:30:56.773238+0000","last_clean":"2024-09-12T17:30:56.773238+0000","last_became_active":"2024-09-12T17:27:48.449138+0000","last_became_peered":"2024-09-12T17:27:48.449138+0000","last_unstale":"2024-09-12T17:30:56.773238+0000","last_undegraded":"2024-09-12T17:30:56.773238+0000","last_fullsized":"2024-09-12T17:30:56.773238+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:43.994480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.462765+0000","last_change":"2024-09-12T17:27:50.452165+0000","last_active":"2024-09-12T17:28:21.462765+0000","last_peered":"2024-09-12T17:28:21.462765+0000","last_clean":"2024-09-12T17:28:21.462765+0000","last_became_active":"2024-09-12T17:27:50.451899+0000","last_became_peered":"2024-09-12T17:27:50.451899+0000","last_unstale":"2024-09-12T17:28:21.462765+0000","last_undegraded":"2024-09-12T17:28:21.462765+0000","last_fullsized":"2024-09-12T17:28:21.462765+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:38.778216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"31'8","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.195915+0000","last_change":"2024-09-12T17:27:42.430391+0000","last_active":"2024-09-12T17:30:50.195915+0000","last_peered":"2024-09-12T17:30:50.195915+0000","last_clean":"2024-09-12T17:30:50.195915+0000","last_became_active":"2024-09-12T17:27:42.430110+0000","last_became_peered":"2024-09-12T17:27:42.430110+0000","last_unstale":"2024-09-12T17:30:50.195915+0000","last_undegraded":"2024-09-12T17:30:50.195915+0000","last_fullsized":"2024-09-12T17:30:50.195915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:09.624789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:06.345680+0000","last_change":"2024-09-12T17:31:06.345680+0000","last_active":"2024-09-12T17:31:06.345680+0000","last_peered":"2024-09-12T17:31:06.345680+0000","last_clean":"2024-09-12T17:31:06.345680+0000","last_became_active":"2024-09-12T17:27:40.415018+0000","last_became_peered":"2024-09-12T17:27:40.415018+0000","last_unstale":"2024-09-12T17:31:06.345680+0000","last_undegraded":"2024-09-12T17:31:06.345680+0000","last_fullsized":"2024-09-12T17:31:06.345680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:06.345593+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:06.345593+0000","last_clean_scrub_stamp":"2024-09-12T17:31:06.345593+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:34.495634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470596+0000","last_change":"2024-09-12T17:27:44.433006+0000","last_active":"2024-09-12T17:28:21.470596+0000","last_peered":"2024-09-12T17:28:21.470596+0000","last_clean":"2024-09-12T17:28:21.470596+0000","last_became_active":"2024-09-12T17:27:44.432389+0000","last_became_peered":"2024-09-12T17:27:44.432389+0000","last_unstale":"2024-09-12T17:28:21.470596+0000","last_undegraded":"2024-09-12T17:28:21.470596+0000","last_fullsized":"2024-09-12T17:28:21.470596+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:18.314088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"31'39","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.867839+0000","last_change":"2024-09-12T17:27:46.437010+0000","last_active":"2024-09-12T17:30:56.867839+0000","last_peered":"2024-09-12T17:30:56.867839+0000","last_clean":"2024-09-12T17:30:56.867839+0000","last_became_active":"2024-09-12T17:27:46.435056+0000","last_became_peered":"2024-09-12T17:27:46.435056+0000","last_unstale":"2024-09-12T17:30:56.867839+0000","last_undegraded":"2024-09-12T17:30:56.867839+0000","last_fullsized":"2024-09-12T17:30:56.867839+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:41.987106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470481+0000","last_change":"2024-09-12T17:27:48.451418+0000","last_active":"2024-09-12T17:28:21.470481+0000","last_peered":"2024-09-12T17:28:21.470481+0000","last_clean":"2024-09-12T17:28:21.470481+0000","last_became_active":"2024-09-12T17:27:48.451143+0000","last_became_peered":"2024-09-12T17:27:48.451143+0000","last_unstale":"2024-09-12T17:28:21.470481+0000","last_undegraded":"2024-09-12T17:28:21.470481+0000","last_fullsized":"2024-09-12T17:28:21.470481+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:05.841062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469983+0000","last_change":"2024-09-12T17:27:50.459043+0000","last_active":"2024-09-12T17:28:21.469983+0000","last_peered":"2024-09-12T17:28:21.469983+0000","last_clean":"2024-09-12T17:28:21.469983+0000","last_became_active":"2024-09-12T17:27:50.458688+0000","last_became_peered":"2024-09-12T17:27:50.458688+0000","last_unstale":"2024-09-12T17:28:21.469983+0000","last_undegraded":"2024-09-12T17:28:21.469983+0000","last_fullsized":"2024-09-12T17:28:21.469983+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:52.579121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'17","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.936036+0000","last_change":"2024-09-12T17:27:42.429938+0000","last_active":"2024-09-12T17:30:49.936036+0000","last_peered":"2024-09-12T17:30:49.936036+0000","last_clean":"2024-09-12T17:30:49.936036+0000","last_became_active":"2024-09-12T17:27:42.429645+0000","last_became_peered":"2024-09-12T17:27:42.429645+0000","last_unstale":"2024-09-12T17:30:49.936036+0000","last_undegraded":"2024-09-12T17:30:49.936036+0000","last_fullsized":"2024-09-12T17:30:49.936036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:26.167048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":59,"num_read_kb":51,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:18.401497+0000","last_change":"2024-09-12T17:31:18.401497+0000","last_active":"2024-09-12T17:31:18.401497+0000","last_peered":"2024-09-12T17:31:18.401497+0000","last_clean":"2024-09-12T17:31:18.401497+0000","last_became_active":"2024-09-12T17:27:40.433580+0000","last_became_peered":"2024-09-12T17:27:40.433580+0000","last_unstale":"2024-09-12T17:31:18.401497+0000","last_undegraded":"2024-09-12T17:31:18.401497+0000","last_fullsized":"2024-09-12T17:31:18.401497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:18.401408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:18.401408+0000","last_clean_scrub_stamp":"2024-09-12T17:31:18.401408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:11.623914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469077+0000","last_change":"2024-09-12T17:27:44.433816+0000","last_active":"2024-09-12T17:28:21.469077+0000","last_peered":"2024-09-12T17:28:21.469077+0000","last_clean":"2024-09-12T17:28:21.469077+0000","last_became_active":"2024-09-12T17:27:44.433529+0000","last_became_peered":"2024-09-12T17:27:44.433529+0000","last_unstale":"2024-09-12T17:28:21.469077+0000","last_undegraded":"2024-09-12T17:28:21.469077+0000","last_fullsized":"2024-09-12T17:28:21.469077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:41.042095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"31'35","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.871259+0000","last_change":"2024-09-12T17:27:46.439345+0000","last_active":"2024-09-12T17:30:56.871259+0000","last_peered":"2024-09-12T17:30:56.871259+0000","last_clean":"2024-09-12T17:30:56.871259+0000","last_became_active":"2024-09-12T17:27:46.439037+0000","last_became_peered":"2024-09-12T17:27:46.439037+0000","last_unstale":"2024-09-12T17:30:56.871259+0000","last_undegraded":"2024-09-12T17:30:56.871259+0000","last_fullsized":"2024-09-12T17:30:56.871259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:39.381080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463052+0000","last_change":"2024-09-12T17:27:48.449101+0000","last_active":"2024-09-12T17:28:21.463052+0000","last_peered":"2024-09-12T17:28:21.463052+0000","last_clean":"2024-09-12T17:28:21.463052+0000","last_became_active":"2024-09-12T17:27:48.448426+0000","last_became_peered":"2024-09-12T17:27:48.448426+0000","last_unstale":"2024-09-12T17:28:21.463052+0000","last_undegraded":"2024-09-12T17:28:21.463052+0000","last_fullsized":"2024-09-12T17:28:21.463052+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:18.516470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464580+0000","last_change":"2024-09-12T17:27:50.459948+0000","last_active":"2024-09-12T17:28:21.464580+0000","last_peered":"2024-09-12T17:28:21.464580+0000","last_clean":"2024-09-12T17:28:21.464580+0000","last_became_active":"2024-09-12T17:27:50.459662+0000","last_became_peered":"2024-09-12T17:27:50.459662+0000","last_unstale":"2024-09-12T17:28:21.464580+0000","last_undegraded":"2024-09-12T17:28:21.464580+0000","last_fullsized":"2024-09-12T17:28:21.464580+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:08.216661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'12","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.148532+0000","last_change":"2024-09-12T17:28:21.476547+0000","last_active":"2024-09-12T17:30:50.148532+0000","last_peered":"2024-09-12T17:30:50.148532+0000","last_clean":"2024-09-12T17:30:50.148532+0000","last_became_active":"2024-09-12T17:28:21.472532+0000","last_became_peered":"2024-09-12T17:28:21.472532+0000","last_unstale":"2024-09-12T17:30:50.148532+0000","last_undegraded":"2024-09-12T17:30:50.148532+0000","last_fullsized":"2024-09-12T17:30:50.148532+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:31.654192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:04.774672+0000","last_change":"2024-09-12T17:31:04.774672+0000","last_active":"2024-09-12T17:31:04.774672+0000","last_peered":"2024-09-12T17:31:04.774672+0000","last_clean":"2024-09-12T17:31:04.774672+0000","last_became_active":"2024-09-12T17:27:40.418464+0000","last_became_peered":"2024-09-12T17:27:40.418464+0000","last_unstale":"2024-09-12T17:31:04.774672+0000","last_undegraded":"2024-09-12T17:31:04.774672+0000","last_fullsized":"2024-09-12T17:31:04.774672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:04.774580+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:04.774580+0000","last_clean_scrub_stamp":"2024-09-12T17:31:04.774580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:11.872204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469583+0000","last_change":"2024-09-12T17:27:44.433348+0000","last_active":"2024-09-12T17:28:21.469583+0000","last_peered":"2024-09-12T17:28:21.469583+0000","last_clean":"2024-09-12T17:28:21.469583+0000","last_became_active":"2024-09-12T17:27:44.430221+0000","last_became_peered":"2024-09-12T17:27:44.430221+0000","last_unstale":"2024-09-12T17:28:21.469583+0000","last_undegraded":"2024-09-12T17:28:21.469583+0000","last_fullsized":"2024-09-12T17:28:21.469583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:13.176204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"31'29","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.836827+0000","last_change":"2024-09-12T17:27:46.441427+0000","last_active":"2024-09-12T17:30:56.836827+0000","last_peered":"2024-09-12T17:30:56.836827+0000","last_clean":"2024-09-12T17:30:56.836827+0000","last_became_active":"2024-09-12T17:27:46.441081+0000","last_became_peered":"2024-09-12T17:27:46.441081+0000","last_unstale":"2024-09-12T17:30:56.836827+0000","last_undegraded":"2024-09-12T17:30:56.836827+0000","last_fullsized":"2024-09-12T17:30:56.836827+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:08.132341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463313+0000","last_change":"2024-09-12T17:27:48.447632+0000","last_active":"2024-09-12T17:28:21.463313+0000","last_peered":"2024-09-12T17:28:21.463313+0000","last_clean":"2024-09-12T17:28:21.463313+0000","last_became_active":"2024-09-12T17:27:48.447321+0000","last_became_peered":"2024-09-12T17:27:48.447321+0000","last_unstale":"2024-09-12T17:28:21.463313+0000","last_undegraded":"2024-09-12T17:28:21.463313+0000","last_fullsized":"2024-09-12T17:28:21.463313+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:43.865345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"31'10","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.181767+0000","last_change":"2024-09-12T17:27:50.460271+0000","last_active":"2024-09-12T17:30:49.181767+0000","last_peered":"2024-09-12T17:30:49.181767+0000","last_clean":"2024-09-12T17:30:49.181767+0000","last_became_active":"2024-09-12T17:27:50.459463+0000","last_became_peered":"2024-09-12T17:27:50.459463+0000","last_unstale":"2024-09-12T17:30:49.181767+0000","last_undegraded":"2024-09-12T17:30:49.181767+0000","last_fullsized":"2024-09-12T17:30:49.181767+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:18.316219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"31'17","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.232329+0000","last_change":"2024-09-12T17:27:42.430374+0000","last_active":"2024-09-12T17:30:50.232329+0000","last_peered":"2024-09-12T17:30:50.232329+0000","last_clean":"2024-09-12T17:30:50.232329+0000","last_became_active":"2024-09-12T17:27:42.430021+0000","last_became_peered":"2024-09-12T17:27:42.430021+0000","last_unstale":"2024-09-12T17:30:50.232329+0000","last_undegraded":"2024-09-12T17:30:50.232329+0000","last_fullsized":"2024-09-12T17:30:50.232329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:54.683103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":76,"num_read_kb":68,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:07.302162+0000","last_change":"2024-09-12T17:31:07.302162+0000","last_active":"2024-09-12T17:31:07.302162+0000","last_peered":"2024-09-12T17:31:07.302162+0000","last_clean":"2024-09-12T17:31:07.302162+0000","last_became_active":"2024-09-12T17:27:40.415549+0000","last_became_peered":"2024-09-12T17:27:40.415549+0000","last_unstale":"2024-09-12T17:31:07.302162+0000","last_undegraded":"2024-09-12T17:31:07.302162+0000","last_fullsized":"2024-09-12T17:31:07.302162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:07.302079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:07.302079+0000","last_clean_scrub_stamp":"2024-09-12T17:31:07.302079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:31:42.747169+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"31'2","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:46.228947+0000","last_change":"2024-09-12T17:27:44.433362+0000","last_active":"2024-09-12T17:29:46.228947+0000","last_peered":"2024-09-12T17:29:46.228947+0000","last_clean":"2024-09-12T17:29:46.228947+0000","last_became_active":"2024-09-12T17:27:44.433037+0000","last_became_peered":"2024-09-12T17:27:44.433037+0000","last_unstale":"2024-09-12T17:29:46.228947+0000","last_undegraded":"2024-09-12T17:29:46.228947+0000","last_fullsized":"2024-09-12T17:29:46.228947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:52.650681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"31'36","reported_seq":85,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.850133+0000","last_change":"2024-09-12T17:27:46.443590+0000","last_active":"2024-09-12T17:30:56.850133+0000","last_peered":"2024-09-12T17:30:56.850133+0000","last_clean":"2024-09-12T17:30:56.850133+0000","last_became_active":"2024-09-12T17:27:46.443316+0000","last_became_peered":"2024-09-12T17:27:46.443316+0000","last_unstale":"2024-09-12T17:30:56.850133+0000","last_undegraded":"2024-09-12T17:30:56.850133+0000","last_fullsized":"2024-09-12T17:30:56.850133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:47.273927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471547+0000","last_change":"2024-09-12T17:27:48.448239+0000","last_active":"2024-09-12T17:28:21.471547+0000","last_peered":"2024-09-12T17:28:21.471547+0000","last_clean":"2024-09-12T17:28:21.471547+0000","last_became_active":"2024-09-12T17:27:48.447884+0000","last_became_peered":"2024-09-12T17:27:48.447884+0000","last_unstale":"2024-09-12T17:28:21.471547+0000","last_undegraded":"2024-09-12T17:28:21.471547+0000","last_fullsized":"2024-09-12T17:28:21.471547+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:37.799636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"31'2","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.614754+0000","last_change":"2024-09-12T17:27:50.459747+0000","last_active":"2024-09-12T17:29:47.614754+0000","last_peered":"2024-09-12T17:29:47.614754+0000","last_clean":"2024-09-12T17:29:47.614754+0000","last_became_active":"2024-09-12T17:27:50.459464+0000","last_became_peered":"2024-09-12T17:27:50.459464+0000","last_unstale":"2024-09-12T17:29:47.614754+0000","last_undegraded":"2024-09-12T17:29:47.614754+0000","last_fullsized":"2024-09-12T17:29:47.614754+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:47.424145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"31'6","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.018176+0000","last_change":"2024-09-12T17:28:21.475279+0000","last_active":"2024-09-12T17:30:50.018176+0000","last_peered":"2024-09-12T17:30:50.018176+0000","last_clean":"2024-09-12T17:30:50.018176+0000","last_became_active":"2024-09-12T17:28:21.471738+0000","last_became_peered":"2024-09-12T17:28:21.471738+0000","last_unstale":"2024-09-12T17:30:50.018176+0000","last_undegraded":"2024-09-12T17:30:50.018176+0000","last_fullsized":"2024-09-12T17:30:50.018176+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:24.585090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:09.101122+0000","last_change":"2024-09-12T17:31:09.101122+0000","last_active":"2024-09-12T17:31:09.101122+0000","last_peered":"2024-09-12T17:31:09.101122+0000","last_clean":"2024-09-12T17:31:09.101122+0000","last_became_active":"2024-09-12T17:27:40.425150+0000","last_became_peered":"2024-09-12T17:27:40.425150+0000","last_unstale":"2024-09-12T17:31:09.101122+0000","last_undegraded":"2024-09-12T17:31:09.101122+0000","last_fullsized":"2024-09-12T17:31:09.101122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:09.101041+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:09.101041+0000","last_clean_scrub_stamp":"2024-09-12T17:31:09.101041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:11.434252+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"31'6","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.225756+0000","last_change":"2024-09-12T17:27:42.428098+0000","last_active":"2024-09-12T17:30:50.225756+0000","last_peered":"2024-09-12T17:30:50.225756+0000","last_clean":"2024-09-12T17:30:50.225756+0000","last_became_active":"2024-09-12T17:27:42.427745+0000","last_became_peered":"2024-09-12T17:27:42.427745+0000","last_unstale":"2024-09-12T17:30:50.225756+0000","last_undegraded":"2024-09-12T17:30:50.225756+0000","last_fullsized":"2024-09-12T17:30:50.225756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:27.653203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:02.824281+0000","last_change":"2024-09-12T17:31:02.824281+0000","last_active":"2024-09-12T17:31:02.824281+0000","last_peered":"2024-09-12T17:31:02.824281+0000","last_clean":"2024-09-12T17:31:02.824281+0000","last_became_active":"2024-09-12T17:27:40.413068+0000","last_became_peered":"2024-09-12T17:27:40.413068+0000","last_unstale":"2024-09-12T17:31:02.824281+0000","last_undegraded":"2024-09-12T17:31:02.824281+0000","last_fullsized":"2024-09-12T17:31:02.824281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:02.824193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:02.824193+0000","last_clean_scrub_stamp":"2024-09-12T17:31:02.824193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:30.974235+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465685+0000","last_change":"2024-09-12T17:27:42.429127+0000","last_active":"2024-09-12T17:28:21.465685+0000","last_peered":"2024-09-12T17:28:21.465685+0000","last_clean":"2024-09-12T17:28:21.465685+0000","last_became_active":"2024-09-12T17:27:42.428871+0000","last_became_peered":"2024-09-12T17:27:42.428871+0000","last_unstale":"2024-09-12T17:28:21.465685+0000","last_undegraded":"2024-09-12T17:28:21.465685+0000","last_fullsized":"2024-09-12T17:28:21.465685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:46.400627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:19.436252+0000","last_change":"2024-09-12T17:31:19.436252+0000","last_active":"2024-09-12T17:31:19.436252+0000","last_peered":"2024-09-12T17:31:19.436252+0000","last_clean":"2024-09-12T17:31:19.436252+0000","last_became_active":"2024-09-12T17:27:40.423210+0000","last_became_peered":"2024-09-12T17:27:40.423210+0000","last_unstale":"2024-09-12T17:31:19.436252+0000","last_undegraded":"2024-09-12T17:31:19.436252+0000","last_fullsized":"2024-09-12T17:31:19.436252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:19.436168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:19.436168+0000","last_clean_scrub_stamp":"2024-09-12T17:31:19.436168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:08.266186+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"31'10","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.148353+0000","last_change":"2024-09-12T17:27:42.428508+0000","last_active":"2024-09-12T17:30:50.148353+0000","last_peered":"2024-09-12T17:30:50.148353+0000","last_clean":"2024-09-12T17:30:50.148353+0000","last_became_active":"2024-09-12T17:27:42.428059+0000","last_became_peered":"2024-09-12T17:27:42.428059+0000","last_unstale":"2024-09-12T17:30:50.148353+0000","last_undegraded":"2024-09-12T17:30:50.148353+0000","last_fullsized":"2024-09-12T17:30:50.148353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:35.350838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:08.822428+0000","last_change":"2024-09-12T17:31:08.822428+0000","last_active":"2024-09-12T17:31:08.822428+0000","last_peered":"2024-09-12T17:31:08.822428+0000","last_clean":"2024-09-12T17:31:08.822428+0000","last_became_active":"2024-09-12T17:27:40.419018+0000","last_became_peered":"2024-09-12T17:27:40.419018+0000","last_unstale":"2024-09-12T17:31:08.822428+0000","last_undegraded":"2024-09-12T17:31:08.822428+0000","last_fullsized":"2024-09-12T17:31:08.822428+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:08.822340+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:08.822340+0000","last_clean_scrub_stamp":"2024-09-12T17:31:08.822340+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:55.083405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"31'4","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:23.352679+0000","last_change":"2024-09-12T17:27:42.425653+0000","last_active":"2024-09-12T17:28:23.352679+0000","last_peered":"2024-09-12T17:28:23.352679+0000","last_clean":"2024-09-12T17:28:23.352679+0000","last_became_active":"2024-09-12T17:27:42.424201+0000","last_became_peered":"2024-09-12T17:27:42.424201+0000","last_unstale":"2024-09-12T17:28:23.352679+0000","last_undegraded":"2024-09-12T17:28:23.352679+0000","last_fullsized":"2024-09-12T17:28:23.352679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:14.199032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:14.865433+0000","last_change":"2024-09-12T17:31:14.865433+0000","last_active":"2024-09-12T17:31:14.865433+0000","last_peered":"2024-09-12T17:31:14.865433+0000","last_clean":"2024-09-12T17:31:14.865433+0000","last_became_active":"2024-09-12T17:27:40.415318+0000","last_became_peered":"2024-09-12T17:27:40.415318+0000","last_unstale":"2024-09-12T17:31:14.865433+0000","last_undegraded":"2024-09-12T17:31:14.865433+0000","last_fullsized":"2024-09-12T17:31:14.865433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:14.865333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:14.865333+0000","last_clean_scrub_stamp":"2024-09-12T17:31:14.865333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:46.192766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"31'6","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.225777+0000","last_change":"2024-09-12T17:27:42.434915+0000","last_active":"2024-09-12T17:30:50.225777+0000","last_peered":"2024-09-12T17:30:50.225777+0000","last_clean":"2024-09-12T17:30:50.225777+0000","last_became_active":"2024-09-12T17:27:42.434664+0000","last_became_peered":"2024-09-12T17:27:42.434664+0000","last_unstale":"2024-09-12T17:30:50.225777+0000","last_undegraded":"2024-09-12T17:30:50.225777+0000","last_fullsized":"2024-09-12T17:30:50.225777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:59.091747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:09.264861+0000","last_change":"2024-09-12T17:31:09.264861+0000","last_active":"2024-09-12T17:31:09.264861+0000","last_peered":"2024-09-12T17:31:09.264861+0000","last_clean":"2024-09-12T17:31:09.264861+0000","last_became_active":"2024-09-12T17:27:40.420491+0000","last_became_peered":"2024-09-12T17:27:40.420491+0000","last_unstale":"2024-09-12T17:31:09.264861+0000","last_undegraded":"2024-09-12T17:31:09.264861+0000","last_fullsized":"2024-09-12T17:31:09.264861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:09.264760+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:09.264760+0000","last_clean_scrub_stamp":"2024-09-12T17:31:09.264760+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:08.584209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"31'10","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:05.194652+0000","last_change":"2024-09-12T17:27:42.425216+0000","last_active":"2024-09-12T17:29:05.194652+0000","last_peered":"2024-09-12T17:29:05.194652+0000","last_clean":"2024-09-12T17:29:05.194652+0000","last_became_active":"2024-09-12T17:27:42.424810+0000","last_became_peered":"2024-09-12T17:27:42.424810+0000","last_unstale":"2024-09-12T17:29:05.194652+0000","last_undegraded":"2024-09-12T17:29:05.194652+0000","last_fullsized":"2024-09-12T17:29:05.194652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:08.170045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":37,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:10.132403+0000","last_change":"2024-09-12T17:31:10.132403+0000","last_active":"2024-09-12T17:31:10.132403+0000","last_peered":"2024-09-12T17:31:10.132403+0000","last_clean":"2024-09-12T17:31:10.132403+0000","last_became_active":"2024-09-12T17:27:40.431365+0000","last_became_peered":"2024-09-12T17:27:40.431365+0000","last_unstale":"2024-09-12T17:31:10.132403+0000","last_undegraded":"2024-09-12T17:31:10.132403+0000","last_fullsized":"2024-09-12T17:31:10.132403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:10.132310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:10.132310+0000","last_clean_scrub_stamp":"2024-09-12T17:31:10.132310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:29.172061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"31'13","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:18.349579+0000","last_change":"2024-09-12T17:31:18.349579+0000","last_active":"2024-09-12T17:31:18.349579+0000","last_peered":"2024-09-12T17:31:18.349579+0000","last_clean":"2024-09-12T17:31:18.349579+0000","last_became_active":"2024-09-12T17:27:42.423099+0000","last_became_peered":"2024-09-12T17:27:42.423099+0000","last_unstale":"2024-09-12T17:31:18.349579+0000","last_undegraded":"2024-09-12T17:31:18.349579+0000","last_fullsized":"2024-09-12T17:31:18.349579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'13","last_scrub_stamp":"2024-09-12T17:31:18.349454+0000","last_deep_scrub":"31'13","last_deep_scrub_stamp":"2024-09-12T17:31:18.349454+0000","last_clean_scrub_stamp":"2024-09-12T17:31:18.349454+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:26.892025+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:06.750029+0000","last_change":"2024-09-12T17:31:06.750029+0000","last_active":"2024-09-12T17:31:06.750029+0000","last_peered":"2024-09-12T17:31:06.750029+0000","last_clean":"2024-09-12T17:31:06.750029+0000","last_became_active":"2024-09-12T17:27:40.415456+0000","last_became_peered":"2024-09-12T17:27:40.415456+0000","last_unstale":"2024-09-12T17:31:06.750029+0000","last_undegraded":"2024-09-12T17:31:06.750029+0000","last_fullsized":"2024-09-12T17:31:06.750029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:06.749935+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:06.749935+0000","last_clean_scrub_stamp":"2024-09-12T17:31:06.749935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:24:59.406146+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"31'7","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.024232+0000","last_change":"2024-09-12T17:27:42.428053+0000","last_active":"2024-09-12T17:30:50.024232+0000","last_peered":"2024-09-12T17:30:50.024232+0000","last_clean":"2024-09-12T17:30:50.024232+0000","last_became_active":"2024-09-12T17:27:42.427778+0000","last_became_peered":"2024-09-12T17:27:42.427778+0000","last_unstale":"2024-09-12T17:30:50.024232+0000","last_undegraded":"2024-09-12T17:30:50.024232+0000","last_fullsized":"2024-09-12T17:30:50.024232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:29.654847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.815094+0000","last_change":"2024-09-12T17:27:40.418491+0000","last_active":"2024-09-12T17:30:49.815094+0000","last_peered":"2024-09-12T17:30:49.815094+0000","last_clean":"2024-09-12T17:30:49.815094+0000","last_became_active":"2024-09-12T17:27:40.418241+0000","last_became_peered":"2024-09-12T17:27:40.418241+0000","last_unstale":"2024-09-12T17:30:49.815094+0000","last_undegraded":"2024-09-12T17:30:49.815094+0000","last_fullsized":"2024-09-12T17:30:49.815094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:44.106061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:22.319225+0000","last_change":"2024-09-12T17:27:42.433339+0000","last_active":"2024-09-12T17:28:22.319225+0000","last_peered":"2024-09-12T17:28:22.319225+0000","last_clean":"2024-09-12T17:28:22.319225+0000","last_became_active":"2024-09-12T17:27:42.433084+0000","last_became_peered":"2024-09-12T17:27:42.433084+0000","last_unstale":"2024-09-12T17:28:22.319225+0000","last_undegraded":"2024-09-12T17:28:22.319225+0000","last_fullsized":"2024-09-12T17:28:22.319225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:14.732392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:07.773832+0000","last_change":"2024-09-12T17:31:07.773832+0000","last_active":"2024-09-12T17:31:07.773832+0000","last_peered":"2024-09-12T17:31:07.773832+0000","last_clean":"2024-09-12T17:31:07.773832+0000","last_became_active":"2024-09-12T17:27:40.417666+0000","last_became_peered":"2024-09-12T17:27:40.417666+0000","last_unstale":"2024-09-12T17:31:07.773832+0000","last_undegraded":"2024-09-12T17:31:07.773832+0000","last_fullsized":"2024-09-12T17:31:07.773832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:07.773746+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:07.773746+0000","last_clean_scrub_stamp":"2024-09-12T17:31:07.773746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:55.901197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"31'8","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.148411+0000","last_change":"2024-09-12T17:27:42.424818+0000","last_active":"2024-09-12T17:30:50.148411+0000","last_peered":"2024-09-12T17:30:50.148411+0000","last_clean":"2024-09-12T17:30:50.148411+0000","last_became_active":"2024-09-12T17:27:42.424017+0000","last_became_peered":"2024-09-12T17:27:42.424017+0000","last_unstale":"2024-09-12T17:30:50.148411+0000","last_undegraded":"2024-09-12T17:30:50.148411+0000","last_fullsized":"2024-09-12T17:30:50.148411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:22.656734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:08.294816+0000","last_change":"2024-09-12T17:31:08.294816+0000","last_active":"2024-09-12T17:31:08.294816+0000","last_peered":"2024-09-12T17:31:08.294816+0000","last_clean":"2024-09-12T17:31:08.294816+0000","last_became_active":"2024-09-12T17:27:40.418964+0000","last_became_peered":"2024-09-12T17:27:40.418964+0000","last_unstale":"2024-09-12T17:31:08.294816+0000","last_undegraded":"2024-09-12T17:31:08.294816+0000","last_fullsized":"2024-09-12T17:31:08.294816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:08.294725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:08.294725+0000","last_clean_scrub_stamp":"2024-09-12T17:31:08.294725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:15.392350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"31'6","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.076791+0000","last_change":"2024-09-12T17:27:42.424747+0000","last_active":"2024-09-12T17:29:49.076791+0000","last_peered":"2024-09-12T17:29:49.076791+0000","last_clean":"2024-09-12T17:29:49.076791+0000","last_became_active":"2024-09-12T17:27:42.422955+0000","last_became_peered":"2024-09-12T17:27:42.422955+0000","last_unstale":"2024-09-12T17:29:49.076791+0000","last_undegraded":"2024-09-12T17:29:49.076791+0000","last_fullsized":"2024-09-12T17:29:49.076791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:41.422424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:11.276659+0000","last_change":"2024-09-12T17:31:11.276659+0000","last_active":"2024-09-12T17:31:11.276659+0000","last_peered":"2024-09-12T17:31:11.276659+0000","last_clean":"2024-09-12T17:31:11.276659+0000","last_became_active":"2024-09-12T17:27:40.418183+0000","last_became_peered":"2024-09-12T17:27:40.418183+0000","last_unstale":"2024-09-12T17:31:11.276659+0000","last_undegraded":"2024-09-12T17:31:11.276659+0000","last_fullsized":"2024-09-12T17:31:11.276659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.276556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.276556+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.276556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:59.404006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"31'5","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.233331+0000","last_change":"2024-09-12T17:27:42.434117+0000","last_active":"2024-09-12T17:30:50.233331+0000","last_peered":"2024-09-12T17:30:50.233331+0000","last_clean":"2024-09-12T17:30:50.233331+0000","last_became_active":"2024-09-12T17:27:42.433856+0000","last_became_peered":"2024-09-12T17:27:42.433856+0000","last_unstale":"2024-09-12T17:30:50.233331+0000","last_undegraded":"2024-09-12T17:30:50.233331+0000","last_fullsized":"2024-09-12T17:30:50.233331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:13.817201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:20.447899+0000","last_change":"2024-09-12T17:31:20.447899+0000","last_active":"2024-09-12T17:31:20.447899+0000","last_peered":"2024-09-12T17:31:20.447899+0000","last_clean":"2024-09-12T17:31:20.447899+0000","last_became_active":"2024-09-12T17:27:40.428213+0000","last_became_peered":"2024-09-12T17:27:40.428213+0000","last_unstale":"2024-09-12T17:31:20.447899+0000","last_undegraded":"2024-09-12T17:31:20.447899+0000","last_fullsized":"2024-09-12T17:31:20.447899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:20.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:20.447796+0000","last_clean_scrub_stamp":"2024-09-12T17:31:20.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:46.194594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"31'4","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:05.194819+0000","last_change":"2024-09-12T17:27:42.431854+0000","last_active":"2024-09-12T17:29:05.194819+0000","last_peered":"2024-09-12T17:29:05.194819+0000","last_clean":"2024-09-12T17:29:05.194819+0000","last_became_active":"2024-09-12T17:27:42.431562+0000","last_became_peered":"2024-09-12T17:27:42.431562+0000","last_unstale":"2024-09-12T17:29:05.194819+0000","last_undegraded":"2024-09-12T17:29:05.194819+0000","last_fullsized":"2024-09-12T17:29:05.194819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:46.641338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"31'4","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.909000+0000","last_change":"2024-09-12T17:27:40.426248+0000","last_active":"2024-09-12T17:30:49.909000+0000","last_peered":"2024-09-12T17:30:49.909000+0000","last_clean":"2024-09-12T17:30:49.909000+0000","last_became_active":"2024-09-12T17:27:40.425910+0000","last_became_peered":"2024-09-12T17:27:40.425910+0000","last_unstale":"2024-09-12T17:30:49.909000+0000","last_undegraded":"2024-09-12T17:30:49.909000+0000","last_fullsized":"2024-09-12T17:30:49.909000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:23.924826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"31'10","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.018646+0000","last_change":"2024-09-12T17:27:42.429554+0000","last_active":"2024-09-12T17:30:50.018646+0000","last_peered":"2024-09-12T17:30:50.018646+0000","last_clean":"2024-09-12T17:30:50.018646+0000","last_became_active":"2024-09-12T17:27:42.429270+0000","last_became_peered":"2024-09-12T17:27:42.429270+0000","last_unstale":"2024-09-12T17:30:50.018646+0000","last_undegraded":"2024-09-12T17:30:50.018646+0000","last_fullsized":"2024-09-12T17:30:50.018646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:32.810941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:11.107395+0000","last_change":"2024-09-12T17:31:11.107395+0000","last_active":"2024-09-12T17:31:11.107395+0000","last_peered":"2024-09-12T17:31:11.107395+0000","last_clean":"2024-09-12T17:31:11.107395+0000","last_became_active":"2024-09-12T17:27:40.431687+0000","last_became_peered":"2024-09-12T17:27:40.431687+0000","last_unstale":"2024-09-12T17:31:11.107395+0000","last_undegraded":"2024-09-12T17:31:11.107395+0000","last_fullsized":"2024-09-12T17:31:11.107395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:11.107302+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:11.107302+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.107302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:52.875838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"31'2","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.280728+0000","last_change":"2024-09-12T17:27:42.425651+0000","last_active":"2024-09-12T17:30:50.280728+0000","last_peered":"2024-09-12T17:30:50.280728+0000","last_clean":"2024-09-12T17:30:50.280728+0000","last_became_active":"2024-09-12T17:27:42.424910+0000","last_became_peered":"2024-09-12T17:27:42.424910+0000","last_unstale":"2024-09-12T17:30:50.280728+0000","last_undegraded":"2024-09-12T17:30:50.280728+0000","last_fullsized":"2024-09-12T17:30:50.280728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:52.600151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.835548+0000","last_change":"2024-09-12T17:27:40.434016+0000","last_active":"2024-09-12T17:30:49.835548+0000","last_peered":"2024-09-12T17:30:49.835548+0000","last_clean":"2024-09-12T17:30:49.835548+0000","last_became_active":"2024-09-12T17:27:40.433649+0000","last_became_peered":"2024-09-12T17:27:40.433649+0000","last_unstale":"2024-09-12T17:30:49.835548+0000","last_undegraded":"2024-09-12T17:30:49.835548+0000","last_fullsized":"2024-09-12T17:30:49.835548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:40.824207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:48.985835+0000","last_change":"2024-09-12T17:27:40.424269+0000","last_active":"2024-09-12T17:29:48.985835+0000","last_peered":"2024-09-12T17:29:48.985835+0000","last_clean":"2024-09-12T17:29:48.985835+0000","last_became_active":"2024-09-12T17:27:40.423343+0000","last_became_peered":"2024-09-12T17:27:40.423343+0000","last_unstale":"2024-09-12T17:29:48.985835+0000","last_undegraded":"2024-09-12T17:29:48.985835+0000","last_fullsized":"2024-09-12T17:29:48.985835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:39.769434+0000","last_clean_scrub_stamp":"2024-09-12T17:27:39.769434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:04.434511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"31'8","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.196783+0000","last_change":"2024-09-12T17:27:42.426434+0000","last_active":"2024-09-12T17:30:50.196783+0000","last_peered":"2024-09-12T17:30:50.196783+0000","last_clean":"2024-09-12T17:30:50.196783+0000","last_became_active":"2024-09-12T17:27:42.426150+0000","last_became_peered":"2024-09-12T17:27:42.426150+0000","last_unstale":"2024-09-12T17:30:50.196783+0000","last_undegraded":"2024-09-12T17:30:50.196783+0000","last_fullsized":"2024-09-12T17:30:50.196783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:55.894831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:10.897255+0000","last_change":"2024-09-12T17:31:10.897255+0000","last_active":"2024-09-12T17:31:10.897255+0000","last_peered":"2024-09-12T17:31:10.897255+0000","last_clean":"2024-09-12T17:31:10.897255+0000","last_became_active":"2024-09-12T17:27:40.420396+0000","last_became_peered":"2024-09-12T17:27:40.420396+0000","last_unstale":"2024-09-12T17:31:10.897255+0000","last_undegraded":"2024-09-12T17:31:10.897255+0000","last_fullsized":"2024-09-12T17:31:10.897255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:10.897168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:10.897168+0000","last_clean_scrub_stamp":"2024-09-12T17:31:10.897168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:17.103760+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"31'4","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.018441+0000","last_change":"2024-09-12T17:27:42.435623+0000","last_active":"2024-09-12T17:30:50.018441+0000","last_peered":"2024-09-12T17:30:50.018441+0000","last_clean":"2024-09-12T17:30:50.018441+0000","last_became_active":"2024-09-12T17:27:42.435324+0000","last_became_peered":"2024-09-12T17:27:42.435324+0000","last_unstale":"2024-09-12T17:30:50.018441+0000","last_undegraded":"2024-09-12T17:30:50.018441+0000","last_fullsized":"2024-09-12T17:30:50.018441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:04.329622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1374,"ondisk_log_size":1374,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":482,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1662,"num_read_kb":1552,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673011,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":446464,"data_stored":134267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705714,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":983040,"data_stored":724195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705714,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1007616,"data_stored":723592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705715,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31588,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340252,"statfs":{"total":96636764160,"available":96604418048,"internally_reserved":0,"allocated":413696,"data_stored":134210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:31:21.970 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.970 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.970 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.970 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.970 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.970 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.971 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.971 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.971 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.971 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.971 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.971 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.971 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.971 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.972 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.972 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.972 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.972 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.972 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.972 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.972 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.972 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.973 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.973 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.973 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.973 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.973 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.973 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.973 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.973 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.973 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.974 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.974 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.974 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.974 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.974 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.974 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.974 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.974 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.975 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.975 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.975 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.975 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.975 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.975 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.975 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.975 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.975 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.976 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.976 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.976 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.976 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.976 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.976 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.976 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.976 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.977 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.977 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.977 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.977 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.977 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.977 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.977 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.977 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.978 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.978 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.978 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.978 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.978 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.978 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.978 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.978 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.978 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.979 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.979 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.979 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.979 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.979 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.979 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.979 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.979 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.980 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.980 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.980 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.980 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.980 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.980 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.980 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.980 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.981 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.981 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.981 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.981 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.981 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.981 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.981 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.981 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.982 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.982 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.982 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.982 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.982 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.982 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.982 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.983 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.983 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.983 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.983 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.983 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.983 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.983 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.983 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.983 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.984 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.984 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.984 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.984 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.984 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.984 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.984 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.984 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.985 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.985 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.985 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.985 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.985 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.985 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.985 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.985 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.985 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.986 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.986 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.986 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.986 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.986 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.986 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.986 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.986 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.987 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.987 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.987 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.987 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.987 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.987 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.987 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.987 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.988 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.988 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.988 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.988 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.988 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.988 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.989 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.989 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.989 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.989 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.989 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.989 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.989 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.989 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.989 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.990 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.990 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.990 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.990 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.990 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.990 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.990 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.990 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.990 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.991 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.991 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.991 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.991 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.991 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.991 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.991 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.991 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.992 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.992 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.992 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.992 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.992 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.992 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-12T17:27:39.769434+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.992 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.992 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:21.993 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T17:31:41.994 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:31:42.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.106+0000 7f401a575640 1 Processor -- start 2024-09-12T17:31:42.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.106+0000 7f401a575640 1 -- start start 2024-09-12T17:31:42.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.106+0000 7f401a575640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4014129d80 0x7f401412a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:31:42.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.106+0000 7f401a575640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f401406dc00 con 0x7f401412a6a0 2024-09-12T17:31:42.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.106+0000 7f401a575640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f40141299c0 con 0x7f4014129d80 2024-09-12T17:31:42.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.107+0000 7f4013fff640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4014129d80 0x7f401412a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:31:42.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.107+0000 7f40137fe640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f401412a6a0 0x7f4014110d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:51804/0 (socket says 172.21.15.47:51804) 2024-09-12T17:31:42.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.107+0000 7f40137fe640 1 -- 172.21.15.47:0/1267134903 learned_addr learned my addr 172.21.15.47:0/1267134903 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-09-12T17:31:42.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.107+0000 7f4013fff640 1 -- 172.21.15.47:0/1267134903 >> v1:172.21.15.47:6789/0 conn(0x7f401412a6a0 legacy=0x7f4014110d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:31:42.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.107+0000 7f4012ffd640 1 -- 172.21.15.47:0/1267134903 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 225236942 0 0) 0x7f401406dc00 con 0x7f401412a6a0 2024-09-12T17:31:42.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.107+0000 7f4013fff640 1 -- 172.21.15.47:0/1267134903 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4014114d20 con 0x7f4014129d80 2024-09-12T17:31:42.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.108+0000 7f4013fff640 1 --2- 172.21.15.47:0/1267134903 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4014129d80 0x7f401412a160 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f4004009720 tx=0x7f400402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae4b0f5a4a907fa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:31:42.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.108+0000 7f4012ffd640 1 -- 172.21.15.47:0/1267134903 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4004037070 con 0x7f4014129d80 2024-09-12T17:31:42.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.108+0000 7f4012ffd640 1 -- 172.21.15.47:0/1267134903 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f400402ad90 con 0x7f4014129d80 2024-09-12T17:31:42.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.108+0000 7f4012ffd640 1 -- 172.21.15.47:0/1267134903 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4004032590 con 0x7f4014129d80 2024-09-12T17:31:42.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.108+0000 7f401a575640 1 -- 172.21.15.47:0/1267134903 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4014129d80 msgr2=0x7f401412a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:31:42.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.108+0000 7f401a575640 1 --2- 172.21.15.47:0/1267134903 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4014129d80 0x7f401412a160 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f4004009720 tx=0x7f400402a110 comp rx=0 tx=0).stop 2024-09-12T17:31:42.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.108+0000 7f401a575640 1 -- 172.21.15.47:0/1267134903 shutdown_connections 2024-09-12T17:31:42.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.108+0000 7f401a575640 1 --2- 172.21.15.47:0/1267134903 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4014129d80 0x7f401412a160 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:31:42.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.108+0000 7f401a575640 1 -- 172.21.15.47:0/1267134903 >> 172.21.15.47:0/1267134903 conn(0x7f4014070850 msgr2=0x7f4014072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:31:42.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.108+0000 7f401a575640 1 -- 172.21.15.47:0/1267134903 shutdown_connections 2024-09-12T17:31:42.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.108+0000 7f401a575640 1 -- 172.21.15.47:0/1267134903 wait complete. 2024-09-12T17:31:42.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.109+0000 7f401a575640 1 Processor -- start 2024-09-12T17:31:42.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.110+0000 7f401a575640 1 -- start start 2024-09-12T17:31:42.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.110+0000 7f401a575640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4014129d80 0x7f40141c3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:31:42.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.110+0000 7f401a575640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4014114940 con 0x7f4014129d80 2024-09-12T17:31:42.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.110+0000 7f4013fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4014129d80 0x7f40141c3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:31:42.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.110+0000 7f4013fff640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4014129d80 0x7f40141c3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48408/0 (socket says 172.21.15.47:48408) 2024-09-12T17:31:42.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.110+0000 7f4013fff640 1 -- 172.21.15.47:0/1943347890 learned_addr learned my addr 172.21.15.47:0/1943347890 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:31:42.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.110+0000 7f4013fff640 1 -- 172.21.15.47:0/1943347890 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4014114270 con 0x7f4014129d80 2024-09-12T17:31:42.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.111+0000 7f4013fff640 1 --2- 172.21.15.47:0/1943347890 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4014129d80 0x7f40141c3da0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f4004035040 tx=0x7f40040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:31:42.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.111+0000 7f4010ff9640 1 -- 172.21.15.47:0/1943347890 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4004037040 con 0x7f4014129d80 2024-09-12T17:31:42.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.111+0000 7f4010ff9640 1 -- 172.21.15.47:0/1943347890 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4004004160 con 0x7f4014129d80 2024-09-12T17:31:42.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.111+0000 7f401a575640 1 -- 172.21.15.47:0/1943347890 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4014120610 con 0x7f4014129d80 2024-09-12T17:31:42.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.111+0000 7f4010ff9640 1 -- 172.21.15.47:0/1943347890 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4004004440 con 0x7f4014129d80 2024-09-12T17:31:42.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.111+0000 7f401a575640 1 -- 172.21.15.47:0/1943347890 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40141c44c0 con 0x7f4014129d80 2024-09-12T17:31:42.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.112+0000 7f401a575640 1 -- 172.21.15.47:0/1943347890 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40141119e0 con 0x7f4014129d80 2024-09-12T17:31:42.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.112+0000 7f4010ff9640 1 -- 172.21.15.47:0/1943347890 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f4004003610 con 0x7f4014129d80 2024-09-12T17:31:42.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.112+0000 7f4010ff9640 1 --2- 172.21.15.47:0/1943347890 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f400003de90 0x7f4000040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:31:42.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.112+0000 7f4010ff9640 1 -- 172.21.15.47:0/1943347890 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f4004073ba0 con 0x7f4014129d80 2024-09-12T17:31:42.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.113+0000 7f40137fe640 1 --2- 172.21.15.47:0/1943347890 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f400003de90 0x7f4000040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:31:42.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.113+0000 7f40137fe640 1 --2- 172.21.15.47:0/1943347890 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f400003de90 0x7f4000040350 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4008000c00 tx=0x7f40080078d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:31:42.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.117+0000 7f4010ff9640 1 -- 172.21.15.47:0/1943347890 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f400403c3d0 con 0x7f4014129d80 2024-09-12T17:31:42.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.297+0000 7f401a575640 1 -- 172.21.15.47:0/1943347890 --> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f40141276b0 con 0x7f400003de90 2024-09-12T17:31:42.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.308+0000 7f4010ff9640 1 -- 172.21.15.47:0/1943347890 <== mgr.4102 v2:172.21.15.170:6824/4146902489 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665673 (secure 0 0 0) 0x7f40141276b0 con 0x7f400003de90 2024-09-12T17:31:42.318 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:31:42.323 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-09-12T17:31:42.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.313+0000 7f401a575640 1 -- 172.21.15.47:0/1943347890 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f400003de90 msgr2=0x7f4000040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:31:42.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.313+0000 7f401a575640 1 --2- 172.21.15.47:0/1943347890 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f400003de90 0x7f4000040350 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4008000c00 tx=0x7f40080078d0 comp rx=0 tx=0).stop 2024-09-12T17:31:42.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.313+0000 7f401a575640 1 -- 172.21.15.47:0/1943347890 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4014129d80 msgr2=0x7f40141c3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:31:42.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.313+0000 7f401a575640 1 --2- 172.21.15.47:0/1943347890 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4014129d80 0x7f40141c3da0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f4004035040 tx=0x7f40040046c0 comp rx=0 tx=0).stop 2024-09-12T17:31:42.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.313+0000 7f401a575640 1 -- 172.21.15.47:0/1943347890 shutdown_connections 2024-09-12T17:31:42.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.313+0000 7f401a575640 1 --2- 172.21.15.47:0/1943347890 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f400003de90 0x7f4000040350 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:31:42.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.313+0000 7f401a575640 1 --2- 172.21.15.47:0/1943347890 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4014129d80 0x7f40141c3da0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:31:42.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.313+0000 7f401a575640 1 -- 172.21.15.47:0/1943347890 >> 172.21.15.47:0/1943347890 conn(0x7f4014070850 msgr2=0x7f4014126310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:31:42.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.313+0000 7f401a575640 1 -- 172.21.15.47:0/1943347890 shutdown_connections 2024-09-12T17:31:42.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:31:42.313+0000 7f401a575640 1 -- 172.21.15.47:0/1943347890 wait complete. 2024-09-12T17:31:42.327 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":157,"stamp":"2024-09-12T17:31:41.807663+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5127,"num_read_kb":4717,"num_write":2121,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":482,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1042,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4628,"ondisk_log_size":4628,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":115040,"kb_used_data":2784,"kb_used_omap":6,"kb_used_meta":112185,"kb_avail":377372320,"statfs":{"total":386547056640,"available":386429255680,"internally_reserved":0,"allocated":2850816,"data_stored":1716264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":114878230},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1042,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004036"},"pg_stats":[{"pgid":"3.3f","version":"31'2","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:15.167597+0000","last_change":"2024-09-12T17:31:15.167597+0000","last_active":"2024-09-12T17:31:15.167597+0000","last_peered":"2024-09-12T17:31:15.167597+0000","last_clean":"2024-09-12T17:31:15.167597+0000","last_became_active":"2024-09-12T17:28:21.473004+0000","last_became_peered":"2024-09-12T17:28:21.473004+0000","last_unstale":"2024-09-12T17:31:15.167597+0000","last_undegraded":"2024-09-12T17:31:15.167597+0000","last_fullsized":"2024-09-12T17:31:15.167597+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:15.167516+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:15.167516+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.167516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:41.949425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"31'2","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:30.347524+0000","last_change":"2024-09-12T17:31:30.347524+0000","last_active":"2024-09-12T17:31:30.347524+0000","last_peered":"2024-09-12T17:31:30.347524+0000","last_clean":"2024-09-12T17:31:30.347524+0000","last_became_active":"2024-09-12T17:27:42.433207+0000","last_became_peered":"2024-09-12T17:27:42.433207+0000","last_unstale":"2024-09-12T17:31:30.347524+0000","last_undegraded":"2024-09-12T17:31:30.347524+0000","last_fullsized":"2024-09-12T17:31:30.347524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:30.347428+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:30.347428+0000","last_clean_scrub_stamp":"2024-09-12T17:31:30.347428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:21.492749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:13.892956+0000","last_change":"2024-09-12T17:31:13.892956+0000","last_active":"2024-09-12T17:31:13.892956+0000","last_peered":"2024-09-12T17:31:13.892956+0000","last_clean":"2024-09-12T17:31:13.892956+0000","last_became_active":"2024-09-12T17:27:40.418928+0000","last_became_peered":"2024-09-12T17:27:40.418928+0000","last_unstale":"2024-09-12T17:31:13.892956+0000","last_undegraded":"2024-09-12T17:31:13.892956+0000","last_fullsized":"2024-09-12T17:31:13.892956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:13.892860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:13.892860+0000","last_clean_scrub_stamp":"2024-09-12T17:31:13.892860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:59.577514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"31'6","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.929876+0000","last_change":"2024-09-12T17:27:42.432970+0000","last_active":"2024-09-12T17:30:49.929876+0000","last_peered":"2024-09-12T17:30:49.929876+0000","last_clean":"2024-09-12T17:30:49.929876+0000","last_became_active":"2024-09-12T17:27:42.432677+0000","last_became_peered":"2024-09-12T17:27:42.432677+0000","last_unstale":"2024-09-12T17:30:49.929876+0000","last_undegraded":"2024-09-12T17:30:49.929876+0000","last_fullsized":"2024-09-12T17:30:49.929876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:02.399648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:30.548169+0000","last_change":"2024-09-12T17:31:30.548169+0000","last_active":"2024-09-12T17:31:30.548169+0000","last_peered":"2024-09-12T17:31:30.548169+0000","last_clean":"2024-09-12T17:31:30.548169+0000","last_became_active":"2024-09-12T17:27:40.433470+0000","last_became_peered":"2024-09-12T17:27:40.433470+0000","last_unstale":"2024-09-12T17:31:30.548169+0000","last_undegraded":"2024-09-12T17:31:30.548169+0000","last_fullsized":"2024-09-12T17:31:30.548169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:30.548084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:30.548084+0000","last_clean_scrub_stamp":"2024-09-12T17:31:30.548084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:09.304175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"31'8","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:05.194512+0000","last_change":"2024-09-12T17:27:42.433048+0000","last_active":"2024-09-12T17:29:05.194512+0000","last_peered":"2024-09-12T17:29:05.194512+0000","last_clean":"2024-09-12T17:29:05.194512+0000","last_became_active":"2024-09-12T17:27:42.432736+0000","last_became_peered":"2024-09-12T17:27:42.432736+0000","last_unstale":"2024-09-12T17:29:05.194512+0000","last_undegraded":"2024-09-12T17:29:05.194512+0000","last_fullsized":"2024-09-12T17:29:05.194512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:43.699110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"31'8","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:14.164859+0000","last_change":"2024-09-12T17:31:14.164859+0000","last_active":"2024-09-12T17:31:14.164859+0000","last_peered":"2024-09-12T17:31:14.164859+0000","last_clean":"2024-09-12T17:31:14.164859+0000","last_became_active":"2024-09-12T17:27:40.426649+0000","last_became_peered":"2024-09-12T17:27:40.426649+0000","last_unstale":"2024-09-12T17:31:14.164859+0000","last_undegraded":"2024-09-12T17:31:14.164859+0000","last_fullsized":"2024-09-12T17:31:14.164859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:14.164764+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:14.164764+0000","last_clean_scrub_stamp":"2024-09-12T17:31:14.164764+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:53.065552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":18,"num_write":56,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"31'8","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.929278+0000","last_change":"2024-09-12T17:27:42.418772+0000","last_active":"2024-09-12T17:30:49.929278+0000","last_peered":"2024-09-12T17:30:49.929278+0000","last_clean":"2024-09-12T17:30:49.929278+0000","last_became_active":"2024-09-12T17:27:42.418517+0000","last_became_peered":"2024-09-12T17:27:42.418517+0000","last_unstale":"2024-09-12T17:30:49.929278+0000","last_undegraded":"2024-09-12T17:30:49.929278+0000","last_fullsized":"2024-09-12T17:30:49.929278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:38.683188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:24.485763+0000","last_change":"2024-09-12T17:31:24.485763+0000","last_active":"2024-09-12T17:31:24.485763+0000","last_peered":"2024-09-12T17:31:24.485763+0000","last_clean":"2024-09-12T17:31:24.485763+0000","last_became_active":"2024-09-12T17:27:40.424978+0000","last_became_peered":"2024-09-12T17:27:40.424978+0000","last_unstale":"2024-09-12T17:31:24.485763+0000","last_undegraded":"2024-09-12T17:31:24.485763+0000","last_fullsized":"2024-09-12T17:31:24.485763+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:24.485659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:24.485659+0000","last_clean_scrub_stamp":"2024-09-12T17:31:24.485659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:57.212649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"31'16","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:31.349593+0000","last_change":"2024-09-12T17:31:31.349593+0000","last_active":"2024-09-12T17:31:31.349593+0000","last_peered":"2024-09-12T17:31:31.349593+0000","last_clean":"2024-09-12T17:31:31.349593+0000","last_became_active":"2024-09-12T17:27:42.423906+0000","last_became_peered":"2024-09-12T17:27:42.423906+0000","last_unstale":"2024-09-12T17:31:31.349593+0000","last_undegraded":"2024-09-12T17:31:31.349593+0000","last_fullsized":"2024-09-12T17:31:31.349593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'16","last_scrub_stamp":"2024-09-12T17:31:31.349474+0000","last_deep_scrub":"31'16","last_deep_scrub_stamp":"2024-09-12T17:31:31.349474+0000","last_clean_scrub_stamp":"2024-09-12T17:31:31.349474+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:12.460742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:12.104894+0000","last_change":"2024-09-12T17:31:12.104894+0000","last_active":"2024-09-12T17:31:12.104894+0000","last_peered":"2024-09-12T17:31:12.104894+0000","last_clean":"2024-09-12T17:31:12.104894+0000","last_became_active":"2024-09-12T17:27:40.425308+0000","last_became_peered":"2024-09-12T17:27:40.425308+0000","last_unstale":"2024-09-12T17:31:12.104894+0000","last_undegraded":"2024-09-12T17:31:12.104894+0000","last_fullsized":"2024-09-12T17:31:12.104894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:12.104802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:12.104802+0000","last_clean_scrub_stamp":"2024-09-12T17:31:12.104802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:46.519276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"29'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464656+0000","last_change":"2024-09-12T17:27:42.429057+0000","last_active":"2024-09-12T17:28:21.464656+0000","last_peered":"2024-09-12T17:28:21.464656+0000","last_clean":"2024-09-12T17:28:21.464656+0000","last_became_active":"2024-09-12T17:27:42.428137+0000","last_became_peered":"2024-09-12T17:27:42.428137+0000","last_unstale":"2024-09-12T17:28:21.464656+0000","last_undegraded":"2024-09-12T17:28:21.464656+0000","last_fullsized":"2024-09-12T17:28:21.464656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:30.467192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'4","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:25.524102+0000","last_change":"2024-09-12T17:31:25.524102+0000","last_active":"2024-09-12T17:31:25.524102+0000","last_peered":"2024-09-12T17:31:25.524102+0000","last_clean":"2024-09-12T17:31:25.524102+0000","last_became_active":"2024-09-12T17:27:40.426778+0000","last_became_peered":"2024-09-12T17:27:40.426778+0000","last_unstale":"2024-09-12T17:31:25.524102+0000","last_undegraded":"2024-09-12T17:31:25.524102+0000","last_fullsized":"2024-09-12T17:31:25.524102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:25.524021+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:25.524021+0000","last_clean_scrub_stamp":"2024-09-12T17:31:25.524021+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:28.696346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"31'18","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:28.212438+0000","last_change":"2024-09-12T17:31:28.212438+0000","last_active":"2024-09-12T17:31:28.212438+0000","last_peered":"2024-09-12T17:31:28.212438+0000","last_clean":"2024-09-12T17:31:28.212438+0000","last_became_active":"2024-09-12T17:27:42.434042+0000","last_became_peered":"2024-09-12T17:27:42.434042+0000","last_unstale":"2024-09-12T17:31:28.212438+0000","last_undegraded":"2024-09-12T17:31:28.212438+0000","last_fullsized":"2024-09-12T17:31:28.212438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'18","last_scrub_stamp":"2024-09-12T17:31:28.212358+0000","last_deep_scrub":"31'18","last_deep_scrub_stamp":"2024-09-12T17:31:28.212358+0000","last_clean_scrub_stamp":"2024-09-12T17:31:28.212358+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:13.897013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":56,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:12.847582+0000","last_change":"2024-09-12T17:31:12.847582+0000","last_active":"2024-09-12T17:31:12.847582+0000","last_peered":"2024-09-12T17:31:12.847582+0000","last_clean":"2024-09-12T17:31:12.847582+0000","last_became_active":"2024-09-12T17:27:40.418512+0000","last_became_peered":"2024-09-12T17:27:40.418512+0000","last_unstale":"2024-09-12T17:31:12.847582+0000","last_undegraded":"2024-09-12T17:31:12.847582+0000","last_fullsized":"2024-09-12T17:31:12.847582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:12.847495+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:12.847495+0000","last_clean_scrub_stamp":"2024-09-12T17:31:12.847495+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:57.086545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"31'8","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:30.206222+0000","last_change":"2024-09-12T17:31:30.206222+0000","last_active":"2024-09-12T17:31:30.206222+0000","last_peered":"2024-09-12T17:31:30.206222+0000","last_clean":"2024-09-12T17:31:30.206222+0000","last_became_active":"2024-09-12T17:27:42.436159+0000","last_became_peered":"2024-09-12T17:27:42.436159+0000","last_unstale":"2024-09-12T17:31:30.206222+0000","last_undegraded":"2024-09-12T17:31:30.206222+0000","last_fullsized":"2024-09-12T17:31:30.206222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:30.206128+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:30.206128+0000","last_clean_scrub_stamp":"2024-09-12T17:31:30.206128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:56.693996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"31'4","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.226031+0000","last_change":"2024-09-12T17:27:42.433708+0000","last_active":"2024-09-12T17:30:50.226031+0000","last_peered":"2024-09-12T17:30:50.226031+0000","last_clean":"2024-09-12T17:30:50.226031+0000","last_became_active":"2024-09-12T17:27:42.433425+0000","last_became_peered":"2024-09-12T17:27:42.433425+0000","last_unstale":"2024-09-12T17:30:50.226031+0000","last_undegraded":"2024-09-12T17:30:50.226031+0000","last_fullsized":"2024-09-12T17:30:50.226031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:32.794303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:13.316703+0000","last_change":"2024-09-12T17:31:13.316703+0000","last_active":"2024-09-12T17:31:13.316703+0000","last_peered":"2024-09-12T17:31:13.316703+0000","last_clean":"2024-09-12T17:31:13.316703+0000","last_became_active":"2024-09-12T17:27:40.415650+0000","last_became_peered":"2024-09-12T17:27:40.415650+0000","last_unstale":"2024-09-12T17:31:13.316703+0000","last_undegraded":"2024-09-12T17:31:13.316703+0000","last_fullsized":"2024-09-12T17:31:13.316703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:13.316616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:13.316616+0000","last_clean_scrub_stamp":"2024-09-12T17:31:13.316616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:05.300957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:26.339465+0000","last_change":"2024-09-12T17:31:26.339465+0000","last_active":"2024-09-12T17:31:26.339465+0000","last_peered":"2024-09-12T17:31:26.339465+0000","last_clean":"2024-09-12T17:31:26.339465+0000","last_became_active":"2024-09-12T17:27:42.427700+0000","last_became_peered":"2024-09-12T17:27:42.427700+0000","last_unstale":"2024-09-12T17:31:26.339465+0000","last_undegraded":"2024-09-12T17:31:26.339465+0000","last_fullsized":"2024-09-12T17:31:26.339465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:26.339370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:26.339370+0000","last_clean_scrub_stamp":"2024-09-12T17:31:26.339370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:03.318523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:13.154171+0000","last_change":"2024-09-12T17:31:13.154171+0000","last_active":"2024-09-12T17:31:13.154171+0000","last_peered":"2024-09-12T17:31:13.154171+0000","last_clean":"2024-09-12T17:31:13.154171+0000","last_became_active":"2024-09-12T17:27:40.432033+0000","last_became_peered":"2024-09-12T17:27:40.432033+0000","last_unstale":"2024-09-12T17:31:13.154171+0000","last_undegraded":"2024-09-12T17:31:13.154171+0000","last_fullsized":"2024-09-12T17:31:13.154171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:13.154091+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:13.154091+0000","last_clean_scrub_stamp":"2024-09-12T17:31:13.154091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:49:12.833133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:27.303000+0000","last_change":"2024-09-12T17:31:27.303000+0000","last_active":"2024-09-12T17:31:27.303000+0000","last_peered":"2024-09-12T17:31:27.303000+0000","last_clean":"2024-09-12T17:31:27.303000+0000","last_became_active":"2024-09-12T17:27:42.428492+0000","last_became_peered":"2024-09-12T17:27:42.428492+0000","last_unstale":"2024-09-12T17:31:27.303000+0000","last_undegraded":"2024-09-12T17:31:27.303000+0000","last_fullsized":"2024-09-12T17:31:27.303000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:27.302915+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:27.302915+0000","last_clean_scrub_stamp":"2024-09-12T17:31:27.302915+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:55.284211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"29'2","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:14.354822+0000","last_change":"2024-09-12T17:31:14.354822+0000","last_active":"2024-09-12T17:31:14.354822+0000","last_peered":"2024-09-12T17:31:14.354822+0000","last_clean":"2024-09-12T17:31:14.354822+0000","last_became_active":"2024-09-12T17:28:21.474758+0000","last_became_peered":"2024-09-12T17:28:21.474758+0000","last_unstale":"2024-09-12T17:31:14.354822+0000","last_undegraded":"2024-09-12T17:31:14.354822+0000","last_fullsized":"2024-09-12T17:31:14.354822+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-12T17:31:14.354735+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-12T17:31:14.354735+0000","last_clean_scrub_stamp":"2024-09-12T17:31:14.354735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:06.230735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"31'2","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:26.883823+0000","last_change":"2024-09-12T17:31:26.883823+0000","last_active":"2024-09-12T17:31:26.883823+0000","last_peered":"2024-09-12T17:31:26.883823+0000","last_clean":"2024-09-12T17:31:26.883823+0000","last_became_active":"2024-09-12T17:27:42.424738+0000","last_became_peered":"2024-09-12T17:27:42.424738+0000","last_unstale":"2024-09-12T17:31:26.883823+0000","last_undegraded":"2024-09-12T17:31:26.883823+0000","last_fullsized":"2024-09-12T17:31:26.883823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:26.883725+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:26.883725+0000","last_clean_scrub_stamp":"2024-09-12T17:31:26.883725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:55.999346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:10.251786+0000","last_change":"2024-09-12T17:31:10.251786+0000","last_active":"2024-09-12T17:31:10.251786+0000","last_peered":"2024-09-12T17:31:10.251786+0000","last_clean":"2024-09-12T17:31:10.251786+0000","last_became_active":"2024-09-12T17:27:40.414669+0000","last_became_peered":"2024-09-12T17:27:40.414669+0000","last_unstale":"2024-09-12T17:31:10.251786+0000","last_undegraded":"2024-09-12T17:31:10.251786+0000","last_fullsized":"2024-09-12T17:31:10.251786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:10.251701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:10.251701+0000","last_clean_scrub_stamp":"2024-09-12T17:31:10.251701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:31.254231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"31'8","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:27.238292+0000","last_change":"2024-09-12T17:31:27.238292+0000","last_active":"2024-09-12T17:31:27.238292+0000","last_peered":"2024-09-12T17:31:27.238292+0000","last_clean":"2024-09-12T17:31:27.238292+0000","last_became_active":"2024-09-12T17:27:42.435928+0000","last_became_peered":"2024-09-12T17:27:42.435928+0000","last_unstale":"2024-09-12T17:31:27.238292+0000","last_undegraded":"2024-09-12T17:31:27.238292+0000","last_fullsized":"2024-09-12T17:31:27.238292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:27.238196+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:27.238196+0000","last_clean_scrub_stamp":"2024-09-12T17:31:27.238196+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:11.477246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:11.894841+0000","last_change":"2024-09-12T17:31:11.894841+0000","last_active":"2024-09-12T17:31:11.894841+0000","last_peered":"2024-09-12T17:31:11.894841+0000","last_clean":"2024-09-12T17:31:11.894841+0000","last_became_active":"2024-09-12T17:27:40.419936+0000","last_became_peered":"2024-09-12T17:27:40.419936+0000","last_unstale":"2024-09-12T17:31:11.894841+0000","last_undegraded":"2024-09-12T17:31:11.894841+0000","last_fullsized":"2024-09-12T17:31:11.894841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:11.894749+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:11.894749+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.894749+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:17.780383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"31'6","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:28.322665+0000","last_change":"2024-09-12T17:31:28.322665+0000","last_active":"2024-09-12T17:31:28.322665+0000","last_peered":"2024-09-12T17:31:28.322665+0000","last_clean":"2024-09-12T17:31:28.322665+0000","last_became_active":"2024-09-12T17:27:42.423569+0000","last_became_peered":"2024-09-12T17:27:42.423569+0000","last_unstale":"2024-09-12T17:31:28.322665+0000","last_undegraded":"2024-09-12T17:31:28.322665+0000","last_fullsized":"2024-09-12T17:31:28.322665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-12T17:31:28.322583+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-12T17:31:28.322583+0000","last_clean_scrub_stamp":"2024-09-12T17:31:28.322583+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:37.072614+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:22.482090+0000","last_change":"2024-09-12T17:31:22.482090+0000","last_active":"2024-09-12T17:31:22.482090+0000","last_peered":"2024-09-12T17:31:22.482090+0000","last_clean":"2024-09-12T17:31:22.482090+0000","last_became_active":"2024-09-12T17:27:40.426721+0000","last_became_peered":"2024-09-12T17:27:40.426721+0000","last_unstale":"2024-09-12T17:31:22.482090+0000","last_undegraded":"2024-09-12T17:31:22.482090+0000","last_fullsized":"2024-09-12T17:31:22.482090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:22.481974+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:22.481974+0000","last_clean_scrub_stamp":"2024-09-12T17:31:22.481974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:55.953993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"31'35","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.173308+0000","last_change":"2024-09-12T17:27:50.456507+0000","last_active":"2024-09-12T17:30:50.173308+0000","last_peered":"2024-09-12T17:30:50.173308+0000","last_clean":"2024-09-12T17:30:50.173308+0000","last_became_active":"2024-09-12T17:27:50.456184+0000","last_became_peered":"2024-09-12T17:27:50.456184+0000","last_unstale":"2024-09-12T17:30:50.173308+0000","last_undegraded":"2024-09-12T17:30:50.173308+0000","last_fullsized":"2024-09-12T17:30:50.173308+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:38.608944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:36.387973+0000","last_change":"2024-09-12T17:31:36.387973+0000","last_active":"2024-09-12T17:31:36.387973+0000","last_peered":"2024-09-12T17:31:36.387973+0000","last_clean":"2024-09-12T17:31:36.387973+0000","last_became_active":"2024-09-12T17:27:42.420666+0000","last_became_peered":"2024-09-12T17:27:42.420666+0000","last_unstale":"2024-09-12T17:31:36.387973+0000","last_undegraded":"2024-09-12T17:31:36.387973+0000","last_fullsized":"2024-09-12T17:31:36.387973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:36.387861+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:36.387861+0000","last_clean_scrub_stamp":"2024-09-12T17:31:36.387861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:45.116536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:15.386849+0000","last_change":"2024-09-12T17:31:15.386849+0000","last_active":"2024-09-12T17:31:15.386849+0000","last_peered":"2024-09-12T17:31:15.386849+0000","last_clean":"2024-09-12T17:31:15.386849+0000","last_became_active":"2024-09-12T17:27:40.433044+0000","last_became_peered":"2024-09-12T17:27:40.433044+0000","last_unstale":"2024-09-12T17:31:15.386849+0000","last_undegraded":"2024-09-12T17:31:15.386849+0000","last_fullsized":"2024-09-12T17:31:15.386849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.386742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.386742+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.386742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:15.078612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.473141+0000","last_change":"2024-09-12T17:28:21.472409+0000","last_active":"2024-09-12T17:28:21.473141+0000","last_peered":"2024-09-12T17:28:21.473141+0000","last_clean":"2024-09-12T17:28:21.473141+0000","last_became_active":"2024-09-12T17:28:21.472106+0000","last_became_peered":"2024-09-12T17:28:21.472106+0000","last_unstale":"2024-09-12T17:28:21.473141+0000","last_undegraded":"2024-09-12T17:28:21.473141+0000","last_fullsized":"2024-09-12T17:28:21.473141+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:56.281239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"31'33","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.920036+0000","last_change":"2024-09-12T17:27:46.442394+0000","last_active":"2024-09-12T17:30:56.920036+0000","last_peered":"2024-09-12T17:30:56.920036+0000","last_clean":"2024-09-12T17:30:56.920036+0000","last_became_active":"2024-09-12T17:27:46.441891+0000","last_became_peered":"2024-09-12T17:27:46.441891+0000","last_unstale":"2024-09-12T17:30:56.920036+0000","last_undegraded":"2024-09-12T17:30:56.920036+0000","last_fullsized":"2024-09-12T17:30:56.920036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:29.351398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470059+0000","last_change":"2024-09-12T17:27:48.448380+0000","last_active":"2024-09-12T17:28:21.470059+0000","last_peered":"2024-09-12T17:28:21.470059+0000","last_clean":"2024-09-12T17:28:21.470059+0000","last_became_active":"2024-09-12T17:27:48.448078+0000","last_became_peered":"2024-09-12T17:27:48.448078+0000","last_unstale":"2024-09-12T17:28:21.470059+0000","last_undegraded":"2024-09-12T17:28:21.470059+0000","last_fullsized":"2024-09-12T17:28:21.470059+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:32.578727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"31'7","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:05.200007+0000","last_change":"2024-09-12T17:27:50.457351+0000","last_active":"2024-09-12T17:29:05.200007+0000","last_peered":"2024-09-12T17:29:05.200007+0000","last_clean":"2024-09-12T17:29:05.200007+0000","last_became_active":"2024-09-12T17:27:50.457037+0000","last_became_peered":"2024-09-12T17:27:50.457037+0000","last_unstale":"2024-09-12T17:29:05.200007+0000","last_undegraded":"2024-09-12T17:29:05.200007+0000","last_fullsized":"2024-09-12T17:29:05.200007+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:28.456215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:35.433441+0000","last_change":"2024-09-12T17:31:35.433441+0000","last_active":"2024-09-12T17:31:35.433441+0000","last_peered":"2024-09-12T17:31:35.433441+0000","last_clean":"2024-09-12T17:31:35.433441+0000","last_became_active":"2024-09-12T17:27:42.427872+0000","last_became_peered":"2024-09-12T17:27:42.427872+0000","last_unstale":"2024-09-12T17:31:35.433441+0000","last_undegraded":"2024-09-12T17:31:35.433441+0000","last_fullsized":"2024-09-12T17:31:35.433441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:35.433325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:35.433325+0000","last_clean_scrub_stamp":"2024-09-12T17:31:35.433325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:14.341661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:06.079744+0000","last_change":"2024-09-12T17:31:06.079744+0000","last_active":"2024-09-12T17:31:06.079744+0000","last_peered":"2024-09-12T17:31:06.079744+0000","last_clean":"2024-09-12T17:31:06.079744+0000","last_became_active":"2024-09-12T17:27:40.430969+0000","last_became_peered":"2024-09-12T17:27:40.430969+0000","last_unstale":"2024-09-12T17:31:06.079744+0000","last_undegraded":"2024-09-12T17:31:06.079744+0000","last_fullsized":"2024-09-12T17:31:06.079744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:06.079660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:06.079660+0000","last_clean_scrub_stamp":"2024-09-12T17:31:06.079660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:37.732174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:34.891676+0000","last_change":"2024-09-12T17:31:34.891676+0000","last_active":"2024-09-12T17:31:34.891676+0000","last_peered":"2024-09-12T17:31:34.891676+0000","last_clean":"2024-09-12T17:31:34.891676+0000","last_became_active":"2024-09-12T17:27:44.427560+0000","last_became_peered":"2024-09-12T17:27:44.427560+0000","last_unstale":"2024-09-12T17:31:34.891676+0000","last_undegraded":"2024-09-12T17:31:34.891676+0000","last_fullsized":"2024-09-12T17:31:34.891676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:34.891583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:34.891583+0000","last_clean_scrub_stamp":"2024-09-12T17:31:34.891583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:39.698964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"29'6","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470141+0000","last_change":"2024-09-12T17:27:46.438703+0000","last_active":"2024-09-12T17:28:21.470141+0000","last_peered":"2024-09-12T17:28:21.470141+0000","last_clean":"2024-09-12T17:28:21.470141+0000","last_became_active":"2024-09-12T17:27:46.436065+0000","last_became_peered":"2024-09-12T17:27:46.436065+0000","last_unstale":"2024-09-12T17:28:21.470141+0000","last_undegraded":"2024-09-12T17:28:21.470141+0000","last_fullsized":"2024-09-12T17:28:21.470141+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:52.392850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466101+0000","last_change":"2024-09-12T17:27:48.441701+0000","last_active":"2024-09-12T17:28:21.466101+0000","last_peered":"2024-09-12T17:28:21.466101+0000","last_clean":"2024-09-12T17:28:21.466101+0000","last_became_active":"2024-09-12T17:27:48.441192+0000","last_became_peered":"2024-09-12T17:27:48.441192+0000","last_unstale":"2024-09-12T17:28:21.466101+0000","last_undegraded":"2024-09-12T17:28:21.466101+0000","last_fullsized":"2024-09-12T17:28:21.466101+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:52.274187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"29'2","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470752+0000","last_change":"2024-09-12T17:27:50.451886+0000","last_active":"2024-09-12T17:28:21.470752+0000","last_peered":"2024-09-12T17:28:21.470752+0000","last_clean":"2024-09-12T17:28:21.470752+0000","last_became_active":"2024-09-12T17:27:50.451589+0000","last_became_peered":"2024-09-12T17:27:50.451589+0000","last_unstale":"2024-09-12T17:28:21.470752+0000","last_undegraded":"2024-09-12T17:28:21.470752+0000","last_fullsized":"2024-09-12T17:28:21.470752+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:53.513569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"31'8","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:39.517731+0000","last_change":"2024-09-12T17:31:39.517731+0000","last_active":"2024-09-12T17:31:39.517731+0000","last_peered":"2024-09-12T17:31:39.517731+0000","last_clean":"2024-09-12T17:31:39.517731+0000","last_became_active":"2024-09-12T17:27:42.426402+0000","last_became_peered":"2024-09-12T17:27:42.426402+0000","last_unstale":"2024-09-12T17:31:39.517731+0000","last_undegraded":"2024-09-12T17:31:39.517731+0000","last_fullsized":"2024-09-12T17:31:39.517731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:39.517638+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:39.517638+0000","last_clean_scrub_stamp":"2024-09-12T17:31:39.517638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:39.295946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:11.412979+0000","last_change":"2024-09-12T17:31:11.412979+0000","last_active":"2024-09-12T17:31:11.412979+0000","last_peered":"2024-09-12T17:31:11.412979+0000","last_clean":"2024-09-12T17:31:11.412979+0000","last_became_active":"2024-09-12T17:27:40.427860+0000","last_became_peered":"2024-09-12T17:27:40.427860+0000","last_unstale":"2024-09-12T17:31:11.412979+0000","last_undegraded":"2024-09-12T17:31:11.412979+0000","last_fullsized":"2024-09-12T17:31:11.412979+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:11.412886+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:11.412886+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.412886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:55.973064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:33.930387+0000","last_change":"2024-09-12T17:31:33.930387+0000","last_active":"2024-09-12T17:31:33.930387+0000","last_peered":"2024-09-12T17:31:33.930387+0000","last_clean":"2024-09-12T17:31:33.930387+0000","last_became_active":"2024-09-12T17:27:44.430879+0000","last_became_peered":"2024-09-12T17:27:44.430879+0000","last_unstale":"2024-09-12T17:31:33.930387+0000","last_undegraded":"2024-09-12T17:31:33.930387+0000","last_fullsized":"2024-09-12T17:31:33.930387+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:33.930301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:33.930301+0000","last_clean_scrub_stamp":"2024-09-12T17:31:33.930301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:21.439880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"29'10","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.467842+0000","last_change":"2024-09-12T17:27:46.440472+0000","last_active":"2024-09-12T17:28:21.467842+0000","last_peered":"2024-09-12T17:28:21.467842+0000","last_clean":"2024-09-12T17:28:21.467842+0000","last_became_active":"2024-09-12T17:27:46.440203+0000","last_became_peered":"2024-09-12T17:27:46.440203+0000","last_unstale":"2024-09-12T17:28:21.467842+0000","last_undegraded":"2024-09-12T17:28:21.467842+0000","last_fullsized":"2024-09-12T17:28:21.467842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:58.292808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"31'285","reported_seq":408,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.776362+0000","last_change":"2024-09-12T17:27:48.451526+0000","last_active":"2024-09-12T17:30:56.776362+0000","last_peered":"2024-09-12T17:30:56.776362+0000","last_clean":"2024-09-12T17:30:56.776362+0000","last_became_active":"2024-09-12T17:27:48.450897+0000","last_became_peered":"2024-09-12T17:27:48.450897+0000","last_unstale":"2024-09-12T17:30:56.776362+0000","last_undegraded":"2024-09-12T17:30:56.776362+0000","last_fullsized":"2024-09-12T17:30:56.776362+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:24.867772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468002+0000","last_change":"2024-09-12T17:27:50.456983+0000","last_active":"2024-09-12T17:28:21.468002+0000","last_peered":"2024-09-12T17:28:21.468002+0000","last_clean":"2024-09-12T17:28:21.468002+0000","last_became_active":"2024-09-12T17:27:50.456376+0000","last_became_peered":"2024-09-12T17:27:50.456376+0000","last_unstale":"2024-09-12T17:28:21.468002+0000","last_undegraded":"2024-09-12T17:28:21.468002+0000","last_fullsized":"2024-09-12T17:28:21.468002+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:07.847747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"31'12","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:18.820795+0000","last_change":"2024-09-12T17:31:18.820795+0000","last_active":"2024-09-12T17:31:18.820795+0000","last_peered":"2024-09-12T17:31:18.820795+0000","last_clean":"2024-09-12T17:31:18.820795+0000","last_became_active":"2024-09-12T17:27:42.426060+0000","last_became_peered":"2024-09-12T17:27:42.426060+0000","last_unstale":"2024-09-12T17:31:18.820795+0000","last_undegraded":"2024-09-12T17:31:18.820795+0000","last_fullsized":"2024-09-12T17:31:18.820795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-09-12T17:31:18.820697+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-09-12T17:31:18.820697+0000","last_clean_scrub_stamp":"2024-09-12T17:31:18.820697+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:36.452576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:02.411977+0000","last_change":"2024-09-12T17:31:02.411977+0000","last_active":"2024-09-12T17:31:02.411977+0000","last_peered":"2024-09-12T17:31:02.411977+0000","last_clean":"2024-09-12T17:31:02.411977+0000","last_became_active":"2024-09-12T17:27:40.415702+0000","last_became_peered":"2024-09-12T17:27:40.415702+0000","last_unstale":"2024-09-12T17:31:02.411977+0000","last_undegraded":"2024-09-12T17:31:02.411977+0000","last_fullsized":"2024-09-12T17:31:02.411977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:02.411854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:02.411854+0000","last_clean_scrub_stamp":"2024-09-12T17:31:02.411854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:49:02.090895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465273+0000","last_change":"2024-09-12T17:27:44.428855+0000","last_active":"2024-09-12T17:28:21.465273+0000","last_peered":"2024-09-12T17:28:21.465273+0000","last_clean":"2024-09-12T17:28:21.465273+0000","last_became_active":"2024-09-12T17:27:44.428526+0000","last_became_peered":"2024-09-12T17:27:44.428526+0000","last_unstale":"2024-09-12T17:28:21.465273+0000","last_undegraded":"2024-09-12T17:28:21.465273+0000","last_fullsized":"2024-09-12T17:28:21.465273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:22.407461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"31'33","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.905030+0000","last_change":"2024-09-12T17:27:46.441041+0000","last_active":"2024-09-12T17:30:56.905030+0000","last_peered":"2024-09-12T17:30:56.905030+0000","last_clean":"2024-09-12T17:30:56.905030+0000","last_became_active":"2024-09-12T17:27:46.440765+0000","last_became_peered":"2024-09-12T17:27:46.440765+0000","last_unstale":"2024-09-12T17:30:56.905030+0000","last_undegraded":"2024-09-12T17:30:56.905030+0000","last_fullsized":"2024-09-12T17:30:56.905030+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:14.176389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"31'285","reported_seq":439,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.780942+0000","last_change":"2024-09-12T17:27:48.440009+0000","last_active":"2024-09-12T17:30:56.780942+0000","last_peered":"2024-09-12T17:30:56.780942+0000","last_clean":"2024-09-12T17:30:56.780942+0000","last_became_active":"2024-09-12T17:27:48.439642+0000","last_became_peered":"2024-09-12T17:27:48.439642+0000","last_unstale":"2024-09-12T17:30:56.780942+0000","last_undegraded":"2024-09-12T17:30:56.780942+0000","last_fullsized":"2024-09-12T17:30:56.780942+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:06.242670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"31'12","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:32.536913+0000","last_change":"2024-09-12T17:31:32.536913+0000","last_active":"2024-09-12T17:31:32.536913+0000","last_peered":"2024-09-12T17:31:32.536913+0000","last_clean":"2024-09-12T17:31:32.536913+0000","last_became_active":"2024-09-12T17:27:42.427990+0000","last_became_peered":"2024-09-12T17:27:42.427990+0000","last_unstale":"2024-09-12T17:31:32.536913+0000","last_undegraded":"2024-09-12T17:31:32.536913+0000","last_fullsized":"2024-09-12T17:31:32.536913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-09-12T17:31:32.536801+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-09-12T17:31:32.536801+0000","last_clean_scrub_stamp":"2024-09-12T17:31:32.536801+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:58.780921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"29'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:05.090851+0000","last_change":"2024-09-12T17:31:05.090851+0000","last_active":"2024-09-12T17:31:05.090851+0000","last_peered":"2024-09-12T17:31:05.090851+0000","last_clean":"2024-09-12T17:31:05.090851+0000","last_became_active":"2024-09-12T17:27:40.428462+0000","last_became_peered":"2024-09-12T17:27:40.428462+0000","last_unstale":"2024-09-12T17:31:05.090851+0000","last_undegraded":"2024-09-12T17:31:05.090851+0000","last_fullsized":"2024-09-12T17:31:05.090851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-12T17:31:05.090744+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-12T17:31:05.090744+0000","last_clean_scrub_stamp":"2024-09-12T17:31:05.090744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:12.385812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:32.302755+0000","last_change":"2024-09-12T17:31:32.302755+0000","last_active":"2024-09-12T17:31:32.302755+0000","last_peered":"2024-09-12T17:31:32.302755+0000","last_clean":"2024-09-12T17:31:32.302755+0000","last_became_active":"2024-09-12T17:27:44.431911+0000","last_became_peered":"2024-09-12T17:27:44.431911+0000","last_unstale":"2024-09-12T17:31:32.302755+0000","last_undegraded":"2024-09-12T17:31:32.302755+0000","last_fullsized":"2024-09-12T17:31:32.302755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:32.302660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:32.302660+0000","last_clean_scrub_stamp":"2024-09-12T17:31:32.302660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:32.223168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"31'53","reported_seq":113,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:39.122513+0000","last_change":"2024-09-12T17:31:39.122513+0000","last_active":"2024-09-12T17:31:39.122513+0000","last_peered":"2024-09-12T17:31:39.122513+0000","last_clean":"2024-09-12T17:31:39.122513+0000","last_became_active":"2024-09-12T17:27:46.439188+0000","last_became_peered":"2024-09-12T17:27:46.439188+0000","last_unstale":"2024-09-12T17:31:39.122513+0000","last_undegraded":"2024-09-12T17:31:39.122513+0000","last_fullsized":"2024-09-12T17:31:39.122513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'53","last_scrub_stamp":"2024-09-12T17:31:39.122418+0000","last_deep_scrub":"31'53","last_deep_scrub_stamp":"2024-09-12T17:31:39.122418+0000","last_clean_scrub_stamp":"2024-09-12T17:31:39.122418+0000","objects_scrubbed":9,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:47.872448+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471714+0000","last_change":"2024-09-12T17:27:48.441917+0000","last_active":"2024-09-12T17:28:21.471714+0000","last_peered":"2024-09-12T17:28:21.471714+0000","last_clean":"2024-09-12T17:28:21.471714+0000","last_became_active":"2024-09-12T17:27:48.441618+0000","last_became_peered":"2024-09-12T17:27:48.441618+0000","last_unstale":"2024-09-12T17:28:21.471714+0000","last_undegraded":"2024-09-12T17:28:21.471714+0000","last_fullsized":"2024-09-12T17:28:21.471714+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:17.256348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"31'7","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.198792+0000","last_change":"2024-09-12T17:27:50.457616+0000","last_active":"2024-09-12T17:30:50.198792+0000","last_peered":"2024-09-12T17:30:50.198792+0000","last_clean":"2024-09-12T17:30:50.198792+0000","last_became_active":"2024-09-12T17:27:50.457350+0000","last_became_peered":"2024-09-12T17:27:50.457350+0000","last_unstale":"2024-09-12T17:30:50.198792+0000","last_undegraded":"2024-09-12T17:30:50.198792+0000","last_fullsized":"2024-09-12T17:30:50.198792+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:39.806321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"31'20","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:15.343990+0000","last_change":"2024-09-12T17:31:15.343990+0000","last_active":"2024-09-12T17:31:15.343990+0000","last_peered":"2024-09-12T17:31:15.343990+0000","last_clean":"2024-09-12T17:31:15.343990+0000","last_became_active":"2024-09-12T17:27:42.424268+0000","last_became_peered":"2024-09-12T17:27:42.424268+0000","last_unstale":"2024-09-12T17:31:15.343990+0000","last_undegraded":"2024-09-12T17:31:15.343990+0000","last_fullsized":"2024-09-12T17:31:15.343990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'20","last_scrub_stamp":"2024-09-12T17:31:15.343895+0000","last_deep_scrub":"31'20","last_deep_scrub_stamp":"2024-09-12T17:31:15.343895+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.343895+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:21.229528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":75,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:02.018708+0000","last_change":"2024-09-12T17:31:02.018708+0000","last_active":"2024-09-12T17:31:02.018708+0000","last_peered":"2024-09-12T17:31:02.018708+0000","last_clean":"2024-09-12T17:31:02.018708+0000","last_became_active":"2024-09-12T17:27:40.427677+0000","last_became_peered":"2024-09-12T17:27:40.427677+0000","last_unstale":"2024-09-12T17:31:02.018708+0000","last_undegraded":"2024-09-12T17:31:02.018708+0000","last_fullsized":"2024-09-12T17:31:02.018708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:02.018612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:02.018612+0000","last_clean_scrub_stamp":"2024-09-12T17:31:02.018612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:03.467671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:29.829824+0000","last_change":"2024-09-12T17:31:29.829824+0000","last_active":"2024-09-12T17:31:29.829824+0000","last_peered":"2024-09-12T17:31:29.829824+0000","last_clean":"2024-09-12T17:31:29.829824+0000","last_became_active":"2024-09-12T17:27:44.434433+0000","last_became_peered":"2024-09-12T17:27:44.434433+0000","last_unstale":"2024-09-12T17:31:29.829824+0000","last_undegraded":"2024-09-12T17:31:29.829824+0000","last_fullsized":"2024-09-12T17:31:29.829824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:29.829730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:29.829730+0000","last_clean_scrub_stamp":"2024-09-12T17:31:29.829730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:14.124471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"31'33","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.874071+0000","last_change":"2024-09-12T17:27:46.442854+0000","last_active":"2024-09-12T17:30:56.874071+0000","last_peered":"2024-09-12T17:30:56.874071+0000","last_clean":"2024-09-12T17:30:56.874071+0000","last_became_active":"2024-09-12T17:27:46.442572+0000","last_became_peered":"2024-09-12T17:27:46.442572+0000","last_unstale":"2024-09-12T17:30:56.874071+0000","last_undegraded":"2024-09-12T17:30:56.874071+0000","last_fullsized":"2024-09-12T17:30:56.874071+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:49.755366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470885+0000","last_change":"2024-09-12T17:27:48.445793+0000","last_active":"2024-09-12T17:28:21.470885+0000","last_peered":"2024-09-12T17:28:21.470885+0000","last_clean":"2024-09-12T17:28:21.470885+0000","last_became_active":"2024-09-12T17:27:48.445502+0000","last_became_peered":"2024-09-12T17:27:48.445502+0000","last_unstale":"2024-09-12T17:28:21.470885+0000","last_undegraded":"2024-09-12T17:28:21.470885+0000","last_fullsized":"2024-09-12T17:28:21.470885+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:17.142197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"31'9","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.283385+0000","last_change":"2024-09-12T17:27:50.458007+0000","last_active":"2024-09-12T17:30:50.283385+0000","last_peered":"2024-09-12T17:30:50.283385+0000","last_clean":"2024-09-12T17:30:50.283385+0000","last_became_active":"2024-09-12T17:27:50.457691+0000","last_became_peered":"2024-09-12T17:27:50.457691+0000","last_unstale":"2024-09-12T17:30:50.283385+0000","last_undegraded":"2024-09-12T17:30:50.283385+0000","last_fullsized":"2024-09-12T17:30:50.283385+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:51.065237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":23,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"31'7","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:19.207381+0000","last_change":"2024-09-12T17:31:19.207381+0000","last_active":"2024-09-12T17:31:19.207381+0000","last_peered":"2024-09-12T17:31:19.207381+0000","last_clean":"2024-09-12T17:31:19.207381+0000","last_became_active":"2024-09-12T17:27:42.436517+0000","last_became_peered":"2024-09-12T17:27:42.436517+0000","last_unstale":"2024-09-12T17:31:19.207381+0000","last_undegraded":"2024-09-12T17:31:19.207381+0000","last_fullsized":"2024-09-12T17:31:19.207381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'7","last_scrub_stamp":"2024-09-12T17:31:19.207291+0000","last_deep_scrub":"31'7","last_deep_scrub_stamp":"2024-09-12T17:31:19.207291+0000","last_clean_scrub_stamp":"2024-09-12T17:31:19.207291+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:26.304916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:10.389482+0000","last_change":"2024-09-12T17:31:10.389482+0000","last_active":"2024-09-12T17:31:10.389482+0000","last_peered":"2024-09-12T17:31:10.389482+0000","last_clean":"2024-09-12T17:31:10.389482+0000","last_became_active":"2024-09-12T17:27:40.429663+0000","last_became_peered":"2024-09-12T17:27:40.429663+0000","last_unstale":"2024-09-12T17:31:10.389482+0000","last_undegraded":"2024-09-12T17:31:10.389482+0000","last_fullsized":"2024-09-12T17:31:10.389482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:10.389388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:10.389388+0000","last_clean_scrub_stamp":"2024-09-12T17:31:10.389388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:20.668432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:36.870675+0000","last_change":"2024-09-12T17:31:36.870675+0000","last_active":"2024-09-12T17:31:36.870675+0000","last_peered":"2024-09-12T17:31:36.870675+0000","last_clean":"2024-09-12T17:31:36.870675+0000","last_became_active":"2024-09-12T17:27:44.430772+0000","last_became_peered":"2024-09-12T17:27:44.430772+0000","last_unstale":"2024-09-12T17:31:36.870675+0000","last_undegraded":"2024-09-12T17:31:36.870675+0000","last_fullsized":"2024-09-12T17:31:36.870675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:36.870579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:36.870579+0000","last_clean_scrub_stamp":"2024-09-12T17:31:36.870579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:47.799822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"31'40","reported_seq":90,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.833856+0000","last_change":"2024-09-12T17:27:46.444540+0000","last_active":"2024-09-12T17:30:56.833856+0000","last_peered":"2024-09-12T17:30:56.833856+0000","last_clean":"2024-09-12T17:30:56.833856+0000","last_became_active":"2024-09-12T17:27:46.444206+0000","last_became_peered":"2024-09-12T17:27:46.444206+0000","last_unstale":"2024-09-12T17:30:56.833856+0000","last_undegraded":"2024-09-12T17:30:56.833856+0000","last_fullsized":"2024-09-12T17:30:56.833856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:06.613276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"31'285","reported_seq":401,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.782240+0000","last_change":"2024-09-12T17:27:48.448090+0000","last_active":"2024-09-12T17:30:56.782240+0000","last_peered":"2024-09-12T17:30:56.782240+0000","last_clean":"2024-09-12T17:30:56.782240+0000","last_became_active":"2024-09-12T17:27:48.447724+0000","last_became_peered":"2024-09-12T17:27:48.447724+0000","last_unstale":"2024-09-12T17:30:56.782240+0000","last_undegraded":"2024-09-12T17:30:56.782240+0000","last_fullsized":"2024-09-12T17:30:56.782240+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:37.632389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"31'4","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.183333+0000","last_change":"2024-09-12T17:27:50.451958+0000","last_active":"2024-09-12T17:30:50.183333+0000","last_peered":"2024-09-12T17:30:50.183333+0000","last_clean":"2024-09-12T17:30:50.183333+0000","last_became_active":"2024-09-12T17:27:50.451716+0000","last_became_peered":"2024-09-12T17:27:50.451716+0000","last_unstale":"2024-09-12T17:30:50.183333+0000","last_undegraded":"2024-09-12T17:30:50.183333+0000","last_fullsized":"2024-09-12T17:30:50.183333+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:28.075990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"31'4","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:18.197113+0000","last_change":"2024-09-12T17:31:18.197113+0000","last_active":"2024-09-12T17:31:18.197113+0000","last_peered":"2024-09-12T17:31:18.197113+0000","last_clean":"2024-09-12T17:31:18.197113+0000","last_became_active":"2024-09-12T17:27:42.429624+0000","last_became_peered":"2024-09-12T17:27:42.429624+0000","last_unstale":"2024-09-12T17:31:18.197113+0000","last_undegraded":"2024-09-12T17:31:18.197113+0000","last_fullsized":"2024-09-12T17:31:18.197113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:18.197003+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:18.197003+0000","last_clean_scrub_stamp":"2024-09-12T17:31:18.197003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:31:53.642094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:12.393232+0000","last_change":"2024-09-12T17:31:12.393232+0000","last_active":"2024-09-12T17:31:12.393232+0000","last_peered":"2024-09-12T17:31:12.393232+0000","last_clean":"2024-09-12T17:31:12.393232+0000","last_became_active":"2024-09-12T17:27:40.423291+0000","last_became_peered":"2024-09-12T17:27:40.423291+0000","last_unstale":"2024-09-12T17:31:12.393232+0000","last_undegraded":"2024-09-12T17:31:12.393232+0000","last_fullsized":"2024-09-12T17:31:12.393232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:12.393115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:12.393115+0000","last_clean_scrub_stamp":"2024-09-12T17:31:12.393115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:06.951305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:28.877883+0000","last_change":"2024-09-12T17:31:28.877883+0000","last_active":"2024-09-12T17:31:28.877883+0000","last_peered":"2024-09-12T17:31:28.877883+0000","last_clean":"2024-09-12T17:31:28.877883+0000","last_became_active":"2024-09-12T17:27:44.430549+0000","last_became_peered":"2024-09-12T17:27:44.430549+0000","last_unstale":"2024-09-12T17:31:28.877883+0000","last_undegraded":"2024-09-12T17:31:28.877883+0000","last_fullsized":"2024-09-12T17:31:28.877883+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:28.877789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:28.877789+0000","last_clean_scrub_stamp":"2024-09-12T17:31:28.877789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:38.715807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"31'62","reported_seq":127,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.882552+0000","last_change":"2024-09-12T17:27:46.441393+0000","last_active":"2024-09-12T17:30:56.882552+0000","last_peered":"2024-09-12T17:30:56.882552+0000","last_clean":"2024-09-12T17:30:56.882552+0000","last_became_active":"2024-09-12T17:27:46.440805+0000","last_became_peered":"2024-09-12T17:27:46.440805+0000","last_unstale":"2024-09-12T17:30:56.882552+0000","last_undegraded":"2024-09-12T17:30:56.882552+0000","last_fullsized":"2024-09-12T17:30:56.882552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:26.523623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":65,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471161+0000","last_change":"2024-09-12T17:27:48.443214+0000","last_active":"2024-09-12T17:28:21.471161+0000","last_peered":"2024-09-12T17:28:21.471161+0000","last_clean":"2024-09-12T17:28:21.471161+0000","last_became_active":"2024-09-12T17:27:48.442880+0000","last_became_peered":"2024-09-12T17:27:48.442880+0000","last_unstale":"2024-09-12T17:28:21.471161+0000","last_undegraded":"2024-09-12T17:28:21.471161+0000","last_fullsized":"2024-09-12T17:28:21.471161+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:45.787562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"31'20","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.331059+0000","last_change":"2024-09-12T17:27:50.454666+0000","last_active":"2024-09-12T17:30:50.331059+0000","last_peered":"2024-09-12T17:30:50.331059+0000","last_clean":"2024-09-12T17:30:50.331059+0000","last_became_active":"2024-09-12T17:27:50.454410+0000","last_became_peered":"2024-09-12T17:27:50.454410+0000","last_unstale":"2024-09-12T17:30:50.331059+0000","last_undegraded":"2024-09-12T17:30:50.331059+0000","last_fullsized":"2024-09-12T17:30:50.331059+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:12:29.329426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"31'10","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:16.297952+0000","last_change":"2024-09-12T17:31:16.297952+0000","last_active":"2024-09-12T17:31:16.297952+0000","last_peered":"2024-09-12T17:31:16.297952+0000","last_clean":"2024-09-12T17:31:16.297952+0000","last_became_active":"2024-09-12T17:27:42.435913+0000","last_became_peered":"2024-09-12T17:27:42.435913+0000","last_unstale":"2024-09-12T17:31:16.297952+0000","last_undegraded":"2024-09-12T17:31:16.297952+0000","last_fullsized":"2024-09-12T17:31:16.297952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-12T17:31:16.297850+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-12T17:31:16.297850+0000","last_clean_scrub_stamp":"2024-09-12T17:31:16.297850+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:00.536900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:09.860489+0000","last_change":"2024-09-12T17:31:09.860489+0000","last_active":"2024-09-12T17:31:09.860489+0000","last_peered":"2024-09-12T17:31:09.860489+0000","last_clean":"2024-09-12T17:31:09.860489+0000","last_became_active":"2024-09-12T17:27:40.415703+0000","last_became_peered":"2024-09-12T17:27:40.415703+0000","last_unstale":"2024-09-12T17:31:09.860489+0000","last_undegraded":"2024-09-12T17:31:09.860489+0000","last_fullsized":"2024-09-12T17:31:09.860489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:09.860396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:09.860396+0000","last_clean_scrub_stamp":"2024-09-12T17:31:09.860396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:27.321941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:31.156349+0000","last_change":"2024-09-12T17:31:31.156349+0000","last_active":"2024-09-12T17:31:31.156349+0000","last_peered":"2024-09-12T17:31:31.156349+0000","last_clean":"2024-09-12T17:31:31.156349+0000","last_became_active":"2024-09-12T17:27:44.432588+0000","last_became_peered":"2024-09-12T17:27:44.432588+0000","last_unstale":"2024-09-12T17:31:31.156349+0000","last_undegraded":"2024-09-12T17:31:31.156349+0000","last_fullsized":"2024-09-12T17:31:31.156349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:31.156264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:31.156264+0000","last_clean_scrub_stamp":"2024-09-12T17:31:31.156264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:46.128476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"31'35","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.885603+0000","last_change":"2024-09-12T17:27:46.432654+0000","last_active":"2024-09-12T17:30:56.885603+0000","last_peered":"2024-09-12T17:30:56.885603+0000","last_clean":"2024-09-12T17:30:56.885603+0000","last_became_active":"2024-09-12T17:27:46.432354+0000","last_became_peered":"2024-09-12T17:27:46.432354+0000","last_unstale":"2024-09-12T17:30:56.885603+0000","last_undegraded":"2024-09-12T17:30:56.885603+0000","last_fullsized":"2024-09-12T17:30:56.885603+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:14.062258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466117+0000","last_change":"2024-09-12T17:27:48.451776+0000","last_active":"2024-09-12T17:28:21.466117+0000","last_peered":"2024-09-12T17:28:21.466117+0000","last_clean":"2024-09-12T17:28:21.466117+0000","last_became_active":"2024-09-12T17:27:48.451510+0000","last_became_peered":"2024-09-12T17:27:48.451510+0000","last_unstale":"2024-09-12T17:28:21.466117+0000","last_undegraded":"2024-09-12T17:28:21.466117+0000","last_fullsized":"2024-09-12T17:28:21.466117+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:01.787546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"31'7","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:50.765214+0000","last_change":"2024-09-12T17:27:50.455419+0000","last_active":"2024-09-12T17:29:50.765214+0000","last_peered":"2024-09-12T17:29:50.765214+0000","last_clean":"2024-09-12T17:29:50.765214+0000","last_became_active":"2024-09-12T17:27:50.454890+0000","last_became_peered":"2024-09-12T17:27:50.454890+0000","last_unstale":"2024-09-12T17:29:50.765214+0000","last_undegraded":"2024-09-12T17:29:50.765214+0000","last_fullsized":"2024-09-12T17:29:50.765214+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:50.422624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"31'8","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:33.513178+0000","last_change":"2024-09-12T17:31:33.513178+0000","last_active":"2024-09-12T17:31:33.513178+0000","last_peered":"2024-09-12T17:31:33.513178+0000","last_clean":"2024-09-12T17:31:33.513178+0000","last_became_active":"2024-09-12T17:27:42.440204+0000","last_became_peered":"2024-09-12T17:27:42.440204+0000","last_unstale":"2024-09-12T17:31:33.513178+0000","last_undegraded":"2024-09-12T17:31:33.513178+0000","last_fullsized":"2024-09-12T17:31:33.513178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:33.513094+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:33.513094+0000","last_clean_scrub_stamp":"2024-09-12T17:31:33.513094+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:57.471769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:09.348825+0000","last_change":"2024-09-12T17:31:09.348825+0000","last_active":"2024-09-12T17:31:09.348825+0000","last_peered":"2024-09-12T17:31:09.348825+0000","last_clean":"2024-09-12T17:31:09.348825+0000","last_became_active":"2024-09-12T17:27:40.428232+0000","last_became_peered":"2024-09-12T17:27:40.428232+0000","last_unstale":"2024-09-12T17:31:09.348825+0000","last_undegraded":"2024-09-12T17:31:09.348825+0000","last_fullsized":"2024-09-12T17:31:09.348825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:09.348730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:09.348730+0000","last_clean_scrub_stamp":"2024-09-12T17:31:09.348730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:20.262551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:31.879020+0000","last_change":"2024-09-12T17:31:31.879020+0000","last_active":"2024-09-12T17:31:31.879020+0000","last_peered":"2024-09-12T17:31:31.879020+0000","last_clean":"2024-09-12T17:31:31.879020+0000","last_became_active":"2024-09-12T17:27:44.432211+0000","last_became_peered":"2024-09-12T17:27:44.432211+0000","last_unstale":"2024-09-12T17:31:31.879020+0000","last_undegraded":"2024-09-12T17:31:31.879020+0000","last_fullsized":"2024-09-12T17:31:31.879020+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:31.878931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:31.878931+0000","last_clean_scrub_stamp":"2024-09-12T17:31:31.878931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:53:23.177009+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"31'39","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.864276+0000","last_change":"2024-09-12T17:27:46.433953+0000","last_active":"2024-09-12T17:30:56.864276+0000","last_peered":"2024-09-12T17:30:56.864276+0000","last_clean":"2024-09-12T17:30:56.864276+0000","last_became_active":"2024-09-12T17:27:46.433672+0000","last_became_peered":"2024-09-12T17:27:46.433672+0000","last_unstale":"2024-09-12T17:30:56.864276+0000","last_undegraded":"2024-09-12T17:30:56.864276+0000","last_fullsized":"2024-09-12T17:30:56.864276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:55.924502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"31'285","reported_seq":407,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.777401+0000","last_change":"2024-09-12T17:27:48.440623+0000","last_active":"2024-09-12T17:30:56.777401+0000","last_peered":"2024-09-12T17:30:56.777401+0000","last_clean":"2024-09-12T17:30:56.777401+0000","last_became_active":"2024-09-12T17:27:48.440335+0000","last_became_peered":"2024-09-12T17:27:48.440335+0000","last_unstale":"2024-09-12T17:30:56.777401+0000","last_undegraded":"2024-09-12T17:30:56.777401+0000","last_fullsized":"2024-09-12T17:30:56.777401+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:20.544074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"31'12","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:54.758294+0000","last_change":"2024-09-12T17:27:50.449089+0000","last_active":"2024-09-12T17:29:54.758294+0000","last_peered":"2024-09-12T17:29:54.758294+0000","last_clean":"2024-09-12T17:29:54.758294+0000","last_became_active":"2024-09-12T17:27:50.448680+0000","last_became_peered":"2024-09-12T17:27:50.448680+0000","last_unstale":"2024-09-12T17:29:54.758294+0000","last_undegraded":"2024-09-12T17:29:54.758294+0000","last_fullsized":"2024-09-12T17:29:54.758294+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:01.786654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:20.187884+0000","last_change":"2024-09-12T17:31:20.187884+0000","last_active":"2024-09-12T17:31:20.187884+0000","last_peered":"2024-09-12T17:31:20.187884+0000","last_clean":"2024-09-12T17:31:20.187884+0000","last_became_active":"2024-09-12T17:28:21.472744+0000","last_became_peered":"2024-09-12T17:28:21.472744+0000","last_unstale":"2024-09-12T17:31:20.187884+0000","last_undegraded":"2024-09-12T17:31:20.187884+0000","last_fullsized":"2024-09-12T17:31:20.187884+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:20.187750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:20.187750+0000","last_clean_scrub_stamp":"2024-09-12T17:31:20.187750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:19.507199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:08.306087+0000","last_change":"2024-09-12T17:31:08.306087+0000","last_active":"2024-09-12T17:31:08.306087+0000","last_peered":"2024-09-12T17:31:08.306087+0000","last_clean":"2024-09-12T17:31:08.306087+0000","last_became_active":"2024-09-12T17:27:40.428512+0000","last_became_peered":"2024-09-12T17:27:40.428512+0000","last_unstale":"2024-09-12T17:31:08.306087+0000","last_undegraded":"2024-09-12T17:31:08.306087+0000","last_fullsized":"2024-09-12T17:31:08.306087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:08.306000+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:08.306000+0000","last_clean_scrub_stamp":"2024-09-12T17:31:08.306000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:33.492014+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'5","reported_seq":428,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:34.315174+0000","last_change":"2024-09-12T17:31:34.315174+0000","last_active":"2024-09-12T17:31:34.315174+0000","last_peered":"2024-09-12T17:31:34.315174+0000","last_clean":"2024-09-12T17:31:34.315174+0000","last_became_active":"2024-09-12T17:27:44.429844+0000","last_became_peered":"2024-09-12T17:27:44.429844+0000","last_unstale":"2024-09-12T17:31:34.315174+0000","last_undegraded":"2024-09-12T17:31:34.315174+0000","last_fullsized":"2024-09-12T17:31:34.315174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-09-12T17:31:34.315074+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-09-12T17:31:34.315074+0000","last_clean_scrub_stamp":"2024-09-12T17:31:34.315074+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:53:25.613152+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464478+0000","last_change":"2024-09-12T17:27:46.439449+0000","last_active":"2024-09-12T17:28:21.464478+0000","last_peered":"2024-09-12T17:28:21.464478+0000","last_clean":"2024-09-12T17:28:21.464478+0000","last_became_active":"2024-09-12T17:27:46.439153+0000","last_became_peered":"2024-09-12T17:27:46.439153+0000","last_unstale":"2024-09-12T17:28:21.464478+0000","last_undegraded":"2024-09-12T17:28:21.464478+0000","last_fullsized":"2024-09-12T17:28:21.464478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:53.118909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"31'285","reported_seq":463,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.778548+0000","last_change":"2024-09-12T17:27:48.441400+0000","last_active":"2024-09-12T17:30:56.778548+0000","last_peered":"2024-09-12T17:30:56.778548+0000","last_clean":"2024-09-12T17:30:56.778548+0000","last_became_active":"2024-09-12T17:27:48.441024+0000","last_became_peered":"2024-09-12T17:27:48.441024+0000","last_unstale":"2024-09-12T17:30:56.778548+0000","last_undegraded":"2024-09-12T17:30:56.778548+0000","last_fullsized":"2024-09-12T17:30:56.778548+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:09.672456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'4","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:48.859981+0000","last_change":"2024-09-12T17:27:50.452031+0000","last_active":"2024-09-12T17:29:48.859981+0000","last_peered":"2024-09-12T17:29:48.859981+0000","last_clean":"2024-09-12T17:29:48.859981+0000","last_became_active":"2024-09-12T17:27:50.451743+0000","last_became_peered":"2024-09-12T17:27:50.451743+0000","last_unstale":"2024-09-12T17:29:48.859981+0000","last_undegraded":"2024-09-12T17:29:48.859981+0000","last_fullsized":"2024-09-12T17:29:48.859981+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:24:17.073385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:17.306328+0000","last_change":"2024-09-12T17:31:17.306328+0000","last_active":"2024-09-12T17:31:17.306328+0000","last_peered":"2024-09-12T17:31:17.306328+0000","last_clean":"2024-09-12T17:31:17.306328+0000","last_became_active":"2024-09-12T17:27:42.438566+0000","last_became_peered":"2024-09-12T17:27:42.438566+0000","last_unstale":"2024-09-12T17:31:17.306328+0000","last_undegraded":"2024-09-12T17:31:17.306328+0000","last_fullsized":"2024-09-12T17:31:17.306328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:17.306243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:17.306243+0000","last_clean_scrub_stamp":"2024-09-12T17:31:17.306243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:02.990898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:14.414138+0000","last_change":"2024-09-12T17:31:14.414138+0000","last_active":"2024-09-12T17:31:14.414138+0000","last_peered":"2024-09-12T17:31:14.414138+0000","last_clean":"2024-09-12T17:31:14.414138+0000","last_became_active":"2024-09-12T17:27:40.429902+0000","last_became_peered":"2024-09-12T17:27:40.429902+0000","last_unstale":"2024-09-12T17:31:14.414138+0000","last_undegraded":"2024-09-12T17:31:14.414138+0000","last_fullsized":"2024-09-12T17:31:14.414138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:14.414041+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:14.414041+0000","last_clean_scrub_stamp":"2024-09-12T17:31:14.414041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:51.245716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465147+0000","last_change":"2024-09-12T17:27:44.431499+0000","last_active":"2024-09-12T17:28:21.465147+0000","last_peered":"2024-09-12T17:28:21.465147+0000","last_clean":"2024-09-12T17:28:21.465147+0000","last_became_active":"2024-09-12T17:27:44.431180+0000","last_became_peered":"2024-09-12T17:27:44.431180+0000","last_unstale":"2024-09-12T17:28:21.465147+0000","last_undegraded":"2024-09-12T17:28:21.465147+0000","last_fullsized":"2024-09-12T17:28:21.465147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:36.937417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"31'43","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.923010+0000","last_change":"2024-09-12T17:27:46.431873+0000","last_active":"2024-09-12T17:30:56.923010+0000","last_peered":"2024-09-12T17:30:56.923010+0000","last_clean":"2024-09-12T17:30:56.923010+0000","last_became_active":"2024-09-12T17:27:46.431599+0000","last_became_peered":"2024-09-12T17:27:46.431599+0000","last_unstale":"2024-09-12T17:30:56.923010+0000","last_undegraded":"2024-09-12T17:30:56.923010+0000","last_fullsized":"2024-09-12T17:30:56.923010+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:08.059866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":53,"num_read_kb":61,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.467064+0000","last_change":"2024-09-12T17:27:48.447644+0000","last_active":"2024-09-12T17:28:21.467064+0000","last_peered":"2024-09-12T17:28:21.467064+0000","last_clean":"2024-09-12T17:28:21.467064+0000","last_became_active":"2024-09-12T17:27:48.447331+0000","last_became_peered":"2024-09-12T17:27:48.447331+0000","last_unstale":"2024-09-12T17:28:21.467064+0000","last_undegraded":"2024-09-12T17:28:21.467064+0000","last_fullsized":"2024-09-12T17:28:21.467064+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:15.622749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"31'6","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.260811+0000","last_change":"2024-09-12T17:27:50.448120+0000","last_active":"2024-09-12T17:30:50.260811+0000","last_peered":"2024-09-12T17:30:50.260811+0000","last_clean":"2024-09-12T17:30:50.260811+0000","last_became_active":"2024-09-12T17:27:50.447855+0000","last_became_peered":"2024-09-12T17:27:50.447855+0000","last_unstale":"2024-09-12T17:30:50.260811+0000","last_undegraded":"2024-09-12T17:30:50.260811+0000","last_fullsized":"2024-09-12T17:30:50.260811+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:45:37.063333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"31'14","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:31.547869+0000","last_change":"2024-09-12T17:31:31.547869+0000","last_active":"2024-09-12T17:31:31.547869+0000","last_peered":"2024-09-12T17:31:31.547869+0000","last_clean":"2024-09-12T17:31:31.547869+0000","last_became_active":"2024-09-12T17:27:42.438270+0000","last_became_peered":"2024-09-12T17:27:42.438270+0000","last_unstale":"2024-09-12T17:31:31.547869+0000","last_undegraded":"2024-09-12T17:31:31.547869+0000","last_fullsized":"2024-09-12T17:31:31.547869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-12T17:31:31.547749+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-12T17:31:31.547749+0000","last_clean_scrub_stamp":"2024-09-12T17:31:31.547749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:59.304661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"31'74","reported_seq":153,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:01.448317+0000","last_change":"2024-09-12T17:31:01.448262+0000","last_active":"2024-09-12T17:31:01.448317+0000","last_peered":"2024-09-12T17:31:01.448317+0000","last_clean":"2024-09-12T17:31:01.448317+0000","last_became_active":"2024-09-12T17:27:25.974522+0000","last_became_peered":"2024-09-12T17:27:25.974522+0000","last_unstale":"2024-09-12T17:31:01.448317+0000","last_undegraded":"2024-09-12T17:31:01.448317+0000","last_fullsized":"2024-09-12T17:31:01.448317+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'74","last_scrub_stamp":"2024-09-12T17:31:01.448174+0000","last_deep_scrub":"31'74","last_deep_scrub_stamp":"2024-09-12T17:31:01.448174+0000","last_clean_scrub_stamp":"2024-09-12T17:31:01.448174+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:35.862648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"31'2","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:04.209698+0000","last_change":"2024-09-12T17:31:04.209698+0000","last_active":"2024-09-12T17:31:04.209698+0000","last_peered":"2024-09-12T17:31:04.209698+0000","last_clean":"2024-09-12T17:31:04.209698+0000","last_became_active":"2024-09-12T17:27:32.760744+0000","last_became_peered":"2024-09-12T17:27:32.760744+0000","last_unstale":"2024-09-12T17:31:04.209698+0000","last_undegraded":"2024-09-12T17:31:04.209698+0000","last_fullsized":"2024-09-12T17:31:04.209698+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:04.209605+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:04.209605+0000","last_clean_scrub_stamp":"2024-09-12T17:31:04.209605+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:18.344014+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0014241220000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:05.209735+0000","last_change":"2024-09-12T17:31:05.209735+0000","last_active":"2024-09-12T17:31:05.209735+0000","last_peered":"2024-09-12T17:31:05.209735+0000","last_clean":"2024-09-12T17:31:05.209735+0000","last_became_active":"2024-09-12T17:27:40.428453+0000","last_became_peered":"2024-09-12T17:27:40.428453+0000","last_unstale":"2024-09-12T17:31:05.209735+0000","last_undegraded":"2024-09-12T17:31:05.209735+0000","last_fullsized":"2024-09-12T17:31:05.209735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:05.209644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:05.209644+0000","last_clean_scrub_stamp":"2024-09-12T17:31:05.209644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:39.739604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:33.324301+0000","last_change":"2024-09-12T17:31:33.324301+0000","last_active":"2024-09-12T17:31:33.324301+0000","last_peered":"2024-09-12T17:31:33.324301+0000","last_clean":"2024-09-12T17:31:33.324301+0000","last_became_active":"2024-09-12T17:27:44.432336+0000","last_became_peered":"2024-09-12T17:27:44.432336+0000","last_unstale":"2024-09-12T17:31:33.324301+0000","last_undegraded":"2024-09-12T17:31:33.324301+0000","last_fullsized":"2024-09-12T17:31:33.324301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:33.324201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:33.324201+0000","last_clean_scrub_stamp":"2024-09-12T17:31:33.324201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:09.650088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"31'85","reported_seq":167,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.914512+0000","last_change":"2024-09-12T17:27:46.438090+0000","last_active":"2024-09-12T17:30:56.914512+0000","last_peered":"2024-09-12T17:30:56.914512+0000","last_clean":"2024-09-12T17:30:56.914512+0000","last_became_active":"2024-09-12T17:27:46.437771+0000","last_became_peered":"2024-09-12T17:27:46.437771+0000","last_unstale":"2024-09-12T17:30:56.914512+0000","last_undegraded":"2024-09-12T17:30:56.914512+0000","last_fullsized":"2024-09-12T17:30:56.914512+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:14.400029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.474144+0000","last_change":"2024-09-12T17:27:48.446270+0000","last_active":"2024-09-12T17:28:21.474144+0000","last_peered":"2024-09-12T17:28:21.474144+0000","last_clean":"2024-09-12T17:28:21.474144+0000","last_became_active":"2024-09-12T17:27:48.445970+0000","last_became_peered":"2024-09-12T17:27:48.445970+0000","last_unstale":"2024-09-12T17:28:21.474144+0000","last_undegraded":"2024-09-12T17:28:21.474144+0000","last_fullsized":"2024-09-12T17:28:21.474144+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:31.488140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"31'81","reported_seq":163,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.235627+0000","last_change":"2024-09-12T17:27:50.448666+0000","last_active":"2024-09-12T17:30:50.235627+0000","last_peered":"2024-09-12T17:30:50.235627+0000","last_clean":"2024-09-12T17:30:50.235627+0000","last_became_active":"2024-09-12T17:27:50.448189+0000","last_became_peered":"2024-09-12T17:27:50.448189+0000","last_unstale":"2024-09-12T17:30:50.235627+0000","last_undegraded":"2024-09-12T17:30:50.235627+0000","last_fullsized":"2024-09-12T17:30:50.235627+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:38.207685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":221,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:29.534969+0000","last_change":"2024-09-12T17:31:29.534969+0000","last_active":"2024-09-12T17:31:29.534969+0000","last_peered":"2024-09-12T17:31:29.534969+0000","last_clean":"2024-09-12T17:31:29.534969+0000","last_became_active":"2024-09-12T17:27:42.429497+0000","last_became_peered":"2024-09-12T17:27:42.429497+0000","last_unstale":"2024-09-12T17:31:29.534969+0000","last_undegraded":"2024-09-12T17:31:29.534969+0000","last_fullsized":"2024-09-12T17:31:29.534969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-12T17:31:29.534867+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-12T17:31:29.534867+0000","last_clean_scrub_stamp":"2024-09-12T17:31:29.534867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:43.863976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:01.220300+0000","last_change":"2024-09-12T17:31:01.220220+0000","last_active":"2024-09-12T17:31:01.220300+0000","last_peered":"2024-09-12T17:31:01.220300+0000","last_clean":"2024-09-12T17:31:01.220300+0000","last_became_active":"2024-09-12T17:27:32.761687+0000","last_became_peered":"2024-09-12T17:27:32.761687+0000","last_unstale":"2024-09-12T17:31:01.220300+0000","last_undegraded":"2024-09-12T17:31:01.220300+0000","last_fullsized":"2024-09-12T17:31:01.220300+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:01.220136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:01.220136+0000","last_clean_scrub_stamp":"2024-09-12T17:31:01.220136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:40.149633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056694099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:01.844114+0000","last_change":"2024-09-12T17:31:01.844114+0000","last_active":"2024-09-12T17:31:01.844114+0000","last_peered":"2024-09-12T17:31:01.844114+0000","last_clean":"2024-09-12T17:31:01.844114+0000","last_became_active":"2024-09-12T17:27:40.418249+0000","last_became_peered":"2024-09-12T17:27:40.418249+0000","last_unstale":"2024-09-12T17:31:01.844114+0000","last_undegraded":"2024-09-12T17:31:01.844114+0000","last_fullsized":"2024-09-12T17:31:01.844114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:01.844025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:01.844025+0000","last_clean_scrub_stamp":"2024-09-12T17:31:01.844025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:24.701961+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468312+0000","last_change":"2024-09-12T17:27:44.427026+0000","last_active":"2024-09-12T17:28:21.468312+0000","last_peered":"2024-09-12T17:28:21.468312+0000","last_clean":"2024-09-12T17:28:21.468312+0000","last_became_active":"2024-09-12T17:27:44.426698+0000","last_became_peered":"2024-09-12T17:27:44.426698+0000","last_unstale":"2024-09-12T17:28:21.468312+0000","last_undegraded":"2024-09-12T17:28:21.468312+0000","last_fullsized":"2024-09-12T17:28:21.468312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:09.582440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"31'285","reported_seq":502,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.912291+0000","last_change":"2024-09-12T17:27:46.438678+0000","last_active":"2024-09-12T17:30:56.912291+0000","last_peered":"2024-09-12T17:30:56.912291+0000","last_clean":"2024-09-12T17:30:56.912291+0000","last_became_active":"2024-09-12T17:27:46.438381+0000","last_became_peered":"2024-09-12T17:27:46.438381+0000","last_unstale":"2024-09-12T17:30:56.912291+0000","last_undegraded":"2024-09-12T17:30:56.912291+0000","last_fullsized":"2024-09-12T17:30:56.912291+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:10.399053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464394+0000","last_change":"2024-09-12T17:27:48.451345+0000","last_active":"2024-09-12T17:28:21.464394+0000","last_peered":"2024-09-12T17:28:21.464394+0000","last_clean":"2024-09-12T17:28:21.464394+0000","last_became_active":"2024-09-12T17:27:48.450775+0000","last_became_peered":"2024-09-12T17:27:48.450775+0000","last_unstale":"2024-09-12T17:28:21.464394+0000","last_undegraded":"2024-09-12T17:28:21.464394+0000","last_fullsized":"2024-09-12T17:28:21.464394+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:37.382330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"31'5","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.944535+0000","last_change":"2024-09-12T17:27:50.458209+0000","last_active":"2024-09-12T17:30:49.944535+0000","last_peered":"2024-09-12T17:30:49.944535+0000","last_clean":"2024-09-12T17:30:49.944535+0000","last_became_active":"2024-09-12T17:27:50.457939+0000","last_became_peered":"2024-09-12T17:27:50.457939+0000","last_unstale":"2024-09-12T17:30:49.944535+0000","last_undegraded":"2024-09-12T17:30:49.944535+0000","last_fullsized":"2024-09-12T17:30:49.944535+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:23.231500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:16.847975+0000","last_change":"2024-09-12T17:31:16.847975+0000","last_active":"2024-09-12T17:31:16.847975+0000","last_peered":"2024-09-12T17:31:16.847975+0000","last_clean":"2024-09-12T17:31:16.847975+0000","last_became_active":"2024-09-12T17:27:42.424498+0000","last_became_peered":"2024-09-12T17:27:42.424498+0000","last_unstale":"2024-09-12T17:31:16.847975+0000","last_undegraded":"2024-09-12T17:31:16.847975+0000","last_fullsized":"2024-09-12T17:31:16.847975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:16.847857+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:16.847857+0000","last_clean_scrub_stamp":"2024-09-12T17:31:16.847857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:43.335725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:03.037376+0000","last_change":"2024-09-12T17:31:03.037376+0000","last_active":"2024-09-12T17:31:03.037376+0000","last_peered":"2024-09-12T17:31:03.037376+0000","last_clean":"2024-09-12T17:31:03.037376+0000","last_became_active":"2024-09-12T17:27:32.761809+0000","last_became_peered":"2024-09-12T17:27:32.761809+0000","last_unstale":"2024-09-12T17:31:03.037376+0000","last_undegraded":"2024-09-12T17:31:03.037376+0000","last_fullsized":"2024-09-12T17:31:03.037376+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:03.037295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:03.037295+0000","last_clean_scrub_stamp":"2024-09-12T17:31:03.037295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:57:59.113302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051333900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"31'3","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:03.795932+0000","last_change":"2024-09-12T17:31:03.795932+0000","last_active":"2024-09-12T17:31:03.795932+0000","last_peered":"2024-09-12T17:31:03.795932+0000","last_clean":"2024-09-12T17:31:03.795932+0000","last_became_active":"2024-09-12T17:27:40.417664+0000","last_became_peered":"2024-09-12T17:27:40.417664+0000","last_unstale":"2024-09-12T17:31:03.795932+0000","last_undegraded":"2024-09-12T17:31:03.795932+0000","last_fullsized":"2024-09-12T17:31:03.795932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-09-12T17:31:03.795825+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-09-12T17:31:03.795825+0000","last_clean_scrub_stamp":"2024-09-12T17:31:03.795825+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:31:39.240916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"31'4","reported_seq":244,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:29.251861+0000","last_change":"2024-09-12T17:31:29.251861+0000","last_active":"2024-09-12T17:31:29.251861+0000","last_peered":"2024-09-12T17:31:29.251861+0000","last_clean":"2024-09-12T17:31:29.251861+0000","last_became_active":"2024-09-12T17:28:21.473073+0000","last_became_peered":"2024-09-12T17:28:21.473073+0000","last_unstale":"2024-09-12T17:31:29.251861+0000","last_undegraded":"2024-09-12T17:31:29.251861+0000","last_fullsized":"2024-09-12T17:31:29.251861+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:29.251773+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:29.251773+0000","last_clean_scrub_stamp":"2024-09-12T17:31:29.251773+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:37.794343+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":482,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"31'25","reported_seq":102,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:38.112059+0000","last_change":"2024-09-12T17:31:38.112059+0000","last_active":"2024-09-12T17:31:38.112059+0000","last_peered":"2024-09-12T17:31:38.112059+0000","last_clean":"2024-09-12T17:31:38.112059+0000","last_became_active":"2024-09-12T17:27:46.435381+0000","last_became_peered":"2024-09-12T17:27:46.435381+0000","last_unstale":"2024-09-12T17:31:38.112059+0000","last_undegraded":"2024-09-12T17:31:38.112059+0000","last_fullsized":"2024-09-12T17:31:38.112059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'25","last_scrub_stamp":"2024-09-12T17:31:38.111974+0000","last_deep_scrub":"31'25","last_deep_scrub_stamp":"2024-09-12T17:31:38.111974+0000","last_clean_scrub_stamp":"2024-09-12T17:31:38.111974+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:06.093270+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.472358+0000","last_change":"2024-09-12T17:27:48.451538+0000","last_active":"2024-09-12T17:28:21.472358+0000","last_peered":"2024-09-12T17:28:21.472358+0000","last_clean":"2024-09-12T17:28:21.472358+0000","last_became_active":"2024-09-12T17:27:48.451225+0000","last_became_peered":"2024-09-12T17:27:48.451225+0000","last_unstale":"2024-09-12T17:28:21.472358+0000","last_undegraded":"2024-09-12T17:28:21.472358+0000","last_fullsized":"2024-09-12T17:28:21.472358+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:18.269897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463520+0000","last_change":"2024-09-12T17:27:50.453764+0000","last_active":"2024-09-12T17:28:21.463520+0000","last_peered":"2024-09-12T17:28:21.463520+0000","last_clean":"2024-09-12T17:28:21.463520+0000","last_became_active":"2024-09-12T17:27:50.453458+0000","last_became_peered":"2024-09-12T17:27:50.453458+0000","last_unstale":"2024-09-12T17:28:21.463520+0000","last_undegraded":"2024-09-12T17:28:21.463520+0000","last_fullsized":"2024-09-12T17:28:21.463520+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:48.900827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"31'10","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:15.887674+0000","last_change":"2024-09-12T17:31:15.887674+0000","last_active":"2024-09-12T17:31:15.887674+0000","last_peered":"2024-09-12T17:31:15.887674+0000","last_clean":"2024-09-12T17:31:15.887674+0000","last_became_active":"2024-09-12T17:27:42.427591+0000","last_became_peered":"2024-09-12T17:27:42.427591+0000","last_unstale":"2024-09-12T17:31:15.887674+0000","last_undegraded":"2024-09-12T17:31:15.887674+0000","last_fullsized":"2024-09-12T17:31:15.887674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-12T17:31:15.887587+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-12T17:31:15.887587+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.887587+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:34.580284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"31'3","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:02.205137+0000","last_change":"2024-09-12T17:31:02.205137+0000","last_active":"2024-09-12T17:31:02.205137+0000","last_peered":"2024-09-12T17:31:02.205137+0000","last_clean":"2024-09-12T17:31:02.205137+0000","last_became_active":"2024-09-12T17:27:32.761967+0000","last_became_peered":"2024-09-12T17:27:32.761967+0000","last_unstale":"2024-09-12T17:31:02.205137+0000","last_undegraded":"2024-09-12T17:31:02.205137+0000","last_fullsized":"2024-09-12T17:31:02.205137+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-09-12T17:31:02.205052+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-09-12T17:31:02.205052+0000","last_clean_scrub_stamp":"2024-09-12T17:31:02.205052+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:42.393847+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001062323,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:04.082738+0000","last_change":"2024-09-12T17:31:04.082738+0000","last_active":"2024-09-12T17:31:04.082738+0000","last_peered":"2024-09-12T17:31:04.082738+0000","last_clean":"2024-09-12T17:31:04.082738+0000","last_became_active":"2024-09-12T17:27:40.425973+0000","last_became_peered":"2024-09-12T17:27:40.425973+0000","last_unstale":"2024-09-12T17:31:04.082738+0000","last_undegraded":"2024-09-12T17:31:04.082738+0000","last_fullsized":"2024-09-12T17:31:04.082738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:04.082603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:04.082603+0000","last_clean_scrub_stamp":"2024-09-12T17:31:04.082603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:21.270783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:32.915286+0000","last_change":"2024-09-12T17:31:32.915286+0000","last_active":"2024-09-12T17:31:32.915286+0000","last_peered":"2024-09-12T17:31:32.915286+0000","last_clean":"2024-09-12T17:31:32.915286+0000","last_became_active":"2024-09-12T17:27:44.432348+0000","last_became_peered":"2024-09-12T17:27:44.432348+0000","last_unstale":"2024-09-12T17:31:32.915286+0000","last_undegraded":"2024-09-12T17:31:32.915286+0000","last_fullsized":"2024-09-12T17:31:32.915286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:32.915180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:32.915180+0000","last_clean_scrub_stamp":"2024-09-12T17:31:32.915180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:38.504920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"31'14","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.091058+0000","last_change":"2024-09-12T17:27:46.442771+0000","last_active":"2024-09-12T17:30:49.091058+0000","last_peered":"2024-09-12T17:30:49.091058+0000","last_clean":"2024-09-12T17:30:49.091058+0000","last_became_active":"2024-09-12T17:27:46.442488+0000","last_became_peered":"2024-09-12T17:27:46.442488+0000","last_unstale":"2024-09-12T17:30:49.091058+0000","last_undegraded":"2024-09-12T17:30:49.091058+0000","last_fullsized":"2024-09-12T17:30:49.091058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:31.634237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466202+0000","last_change":"2024-09-12T17:27:48.451472+0000","last_active":"2024-09-12T17:28:21.466202+0000","last_peered":"2024-09-12T17:28:21.466202+0000","last_clean":"2024-09-12T17:28:21.466202+0000","last_became_active":"2024-09-12T17:27:48.451075+0000","last_became_peered":"2024-09-12T17:27:48.451075+0000","last_unstale":"2024-09-12T17:28:21.466202+0000","last_undegraded":"2024-09-12T17:28:21.466202+0000","last_fullsized":"2024-09-12T17:28:21.466202+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:41.217292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'10","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:48.840270+0000","last_change":"2024-09-12T17:27:50.456671+0000","last_active":"2024-09-12T17:29:48.840270+0000","last_peered":"2024-09-12T17:29:48.840270+0000","last_clean":"2024-09-12T17:29:48.840270+0000","last_became_active":"2024-09-12T17:27:50.455608+0000","last_became_peered":"2024-09-12T17:27:50.455608+0000","last_unstale":"2024-09-12T17:29:48.840270+0000","last_undegraded":"2024-09-12T17:29:48.840270+0000","last_fullsized":"2024-09-12T17:29:48.840270+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:23.681507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":17,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'14","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:16.142405+0000","last_change":"2024-09-12T17:31:16.142405+0000","last_active":"2024-09-12T17:31:16.142405+0000","last_peered":"2024-09-12T17:31:16.142405+0000","last_clean":"2024-09-12T17:31:16.142405+0000","last_became_active":"2024-09-12T17:28:21.471756+0000","last_became_peered":"2024-09-12T17:28:21.471756+0000","last_unstale":"2024-09-12T17:31:16.142405+0000","last_undegraded":"2024-09-12T17:31:16.142405+0000","last_fullsized":"2024-09-12T17:31:16.142405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-12T17:31:16.142322+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-12T17:31:16.142322+0000","last_clean_scrub_stamp":"2024-09-12T17:31:16.142322+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:39.000259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:01.009730+0000","last_change":"2024-09-12T17:31:01.009730+0000","last_active":"2024-09-12T17:31:01.009730+0000","last_peered":"2024-09-12T17:31:01.009730+0000","last_clean":"2024-09-12T17:31:01.009730+0000","last_became_active":"2024-09-12T17:27:40.424286+0000","last_became_peered":"2024-09-12T17:27:40.424286+0000","last_unstale":"2024-09-12T17:31:01.009730+0000","last_undegraded":"2024-09-12T17:31:01.009730+0000","last_fullsized":"2024-09-12T17:31:01.009730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:01.009648+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:01.009648+0000","last_clean_scrub_stamp":"2024-09-12T17:31:01.009648+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:15.810543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:59.835771+0000","last_change":"2024-09-12T17:30:59.835771+0000","last_active":"2024-09-12T17:30:59.835771+0000","last_peered":"2024-09-12T17:30:59.835771+0000","last_clean":"2024-09-12T17:30:59.835771+0000","last_became_active":"2024-09-12T17:27:32.761595+0000","last_became_peered":"2024-09-12T17:27:32.761595+0000","last_unstale":"2024-09-12T17:30:59.835771+0000","last_undegraded":"2024-09-12T17:30:59.835771+0000","last_fullsized":"2024-09-12T17:30:59.835771+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:59.835655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:59.835655+0000","last_clean_scrub_stamp":"2024-09-12T17:30:59.835655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:14.315612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000417551,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:30.833822+0000","last_change":"2024-09-12T17:31:30.833822+0000","last_active":"2024-09-12T17:31:30.833822+0000","last_peered":"2024-09-12T17:31:30.833822+0000","last_clean":"2024-09-12T17:31:30.833822+0000","last_became_active":"2024-09-12T17:27:44.432492+0000","last_became_peered":"2024-09-12T17:27:44.432492+0000","last_unstale":"2024-09-12T17:31:30.833822+0000","last_undegraded":"2024-09-12T17:31:30.833822+0000","last_fullsized":"2024-09-12T17:31:30.833822+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:30.833721+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:30.833721+0000","last_clean_scrub_stamp":"2024-09-12T17:31:30.833721+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:05.676775+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"31'76","reported_seq":152,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:35.922981+0000","last_change":"2024-09-12T17:31:35.922981+0000","last_active":"2024-09-12T17:31:35.922981+0000","last_peered":"2024-09-12T17:31:35.922981+0000","last_clean":"2024-09-12T17:31:35.922981+0000","last_became_active":"2024-09-12T17:27:46.439014+0000","last_became_peered":"2024-09-12T17:27:46.439014+0000","last_unstale":"2024-09-12T17:31:35.922981+0000","last_undegraded":"2024-09-12T17:31:35.922981+0000","last_fullsized":"2024-09-12T17:31:35.922981+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'76","last_scrub_stamp":"2024-09-12T17:31:35.922854+0000","last_deep_scrub":"31'76","last_deep_scrub_stamp":"2024-09-12T17:31:35.922854+0000","last_clean_scrub_stamp":"2024-09-12T17:31:35.922854+0000","objects_scrubbed":9,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:07.104177+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.467285+0000","last_change":"2024-09-12T17:27:48.439106+0000","last_active":"2024-09-12T17:28:21.467285+0000","last_peered":"2024-09-12T17:28:21.467285+0000","last_clean":"2024-09-12T17:28:21.467285+0000","last_became_active":"2024-09-12T17:27:48.438779+0000","last_became_peered":"2024-09-12T17:27:48.438779+0000","last_unstale":"2024-09-12T17:28:21.467285+0000","last_undegraded":"2024-09-12T17:28:21.467285+0000","last_fullsized":"2024-09-12T17:28:21.467285+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:49.022922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"31'13","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.020053+0000","last_change":"2024-09-12T17:27:50.448485+0000","last_active":"2024-09-12T17:30:50.020053+0000","last_peered":"2024-09-12T17:30:50.020053+0000","last_clean":"2024-09-12T17:30:50.020053+0000","last_became_active":"2024-09-12T17:27:50.448060+0000","last_became_peered":"2024-09-12T17:27:50.448060+0000","last_unstale":"2024-09-12T17:30:50.020053+0000","last_undegraded":"2024-09-12T17:30:50.020053+0000","last_fullsized":"2024-09-12T17:30:50.020053+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:10.453854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":31,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"31'27","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:12.291292+0000","last_change":"2024-09-12T17:31:12.291292+0000","last_active":"2024-09-12T17:31:12.291292+0000","last_peered":"2024-09-12T17:31:12.291292+0000","last_clean":"2024-09-12T17:31:12.291292+0000","last_became_active":"2024-09-12T17:27:42.432800+0000","last_became_peered":"2024-09-12T17:27:42.432800+0000","last_unstale":"2024-09-12T17:31:12.291292+0000","last_undegraded":"2024-09-12T17:31:12.291292+0000","last_fullsized":"2024-09-12T17:31:12.291292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'27","last_scrub_stamp":"2024-09-12T17:31:12.291188+0000","last_deep_scrub":"31'27","last_deep_scrub_stamp":"2024-09-12T17:31:12.291188+0000","last_clean_scrub_stamp":"2024-09-12T17:31:12.291188+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:58.552254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":99,"num_read_kb":83,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"31'4","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:05.776042+0000","last_change":"2024-09-12T17:31:05.776042+0000","last_active":"2024-09-12T17:31:05.776042+0000","last_peered":"2024-09-12T17:31:05.776042+0000","last_clean":"2024-09-12T17:31:05.776042+0000","last_became_active":"2024-09-12T17:27:40.418873+0000","last_became_peered":"2024-09-12T17:27:40.418873+0000","last_unstale":"2024-09-12T17:31:05.776042+0000","last_undegraded":"2024-09-12T17:31:05.776042+0000","last_fullsized":"2024-09-12T17:31:05.776042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:05.775954+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:05.775954+0000","last_clean_scrub_stamp":"2024-09-12T17:31:05.775954+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:05.095403+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:03.225739+0000","last_change":"2024-09-12T17:31:03.225739+0000","last_active":"2024-09-12T17:31:03.225739+0000","last_peered":"2024-09-12T17:31:03.225739+0000","last_clean":"2024-09-12T17:31:03.225739+0000","last_became_active":"2024-09-12T17:27:32.761677+0000","last_became_peered":"2024-09-12T17:27:32.761677+0000","last_unstale":"2024-09-12T17:31:03.225739+0000","last_undegraded":"2024-09-12T17:31:03.225739+0000","last_fullsized":"2024-09-12T17:31:03.225739+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:03.225639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:03.225639+0000","last_clean_scrub_stamp":"2024-09-12T17:31:03.225639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:53.792882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001356625,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463624+0000","last_change":"2024-09-12T17:27:44.426949+0000","last_active":"2024-09-12T17:28:21.463624+0000","last_peered":"2024-09-12T17:28:21.463624+0000","last_clean":"2024-09-12T17:28:21.463624+0000","last_became_active":"2024-09-12T17:27:44.426647+0000","last_became_peered":"2024-09-12T17:27:44.426647+0000","last_unstale":"2024-09-12T17:28:21.463624+0000","last_undegraded":"2024-09-12T17:28:21.463624+0000","last_fullsized":"2024-09-12T17:28:21.463624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:54.776333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"29'15","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468427+0000","last_change":"2024-09-12T17:27:46.439375+0000","last_active":"2024-09-12T17:28:21.468427+0000","last_peered":"2024-09-12T17:28:21.468427+0000","last_clean":"2024-09-12T17:28:21.468427+0000","last_became_active":"2024-09-12T17:27:46.439038+0000","last_became_peered":"2024-09-12T17:27:46.439038+0000","last_unstale":"2024-09-12T17:28:21.468427+0000","last_undegraded":"2024-09-12T17:28:21.468427+0000","last_fullsized":"2024-09-12T17:28:21.468427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:18.536701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"31'285","reported_seq":350,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.774859+0000","last_change":"2024-09-12T17:27:48.442198+0000","last_active":"2024-09-12T17:30:56.774859+0000","last_peered":"2024-09-12T17:30:56.774859+0000","last_clean":"2024-09-12T17:30:56.774859+0000","last_became_active":"2024-09-12T17:27:48.440948+0000","last_became_peered":"2024-09-12T17:27:48.440948+0000","last_unstale":"2024-09-12T17:30:56.774859+0000","last_undegraded":"2024-09-12T17:30:56.774859+0000","last_fullsized":"2024-09-12T17:30:56.774859+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:58.653865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465509+0000","last_change":"2024-09-12T17:27:50.455097+0000","last_active":"2024-09-12T17:28:21.465509+0000","last_peered":"2024-09-12T17:28:21.465509+0000","last_clean":"2024-09-12T17:28:21.465509+0000","last_became_active":"2024-09-12T17:27:50.454241+0000","last_became_peered":"2024-09-12T17:27:50.454241+0000","last_unstale":"2024-09-12T17:28:21.465509+0000","last_undegraded":"2024-09-12T17:28:21.465509+0000","last_fullsized":"2024-09-12T17:28:21.465509+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:01.881864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"31'16","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:28.486564+0000","last_change":"2024-09-12T17:31:28.486564+0000","last_active":"2024-09-12T17:31:28.486564+0000","last_peered":"2024-09-12T17:31:28.486564+0000","last_clean":"2024-09-12T17:31:28.486564+0000","last_became_active":"2024-09-12T17:27:42.423805+0000","last_became_peered":"2024-09-12T17:27:42.423805+0000","last_unstale":"2024-09-12T17:31:28.486564+0000","last_undegraded":"2024-09-12T17:31:28.486564+0000","last_fullsized":"2024-09-12T17:31:28.486564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'16","last_scrub_stamp":"2024-09-12T17:31:28.486474+0000","last_deep_scrub":"31'16","last_deep_scrub_stamp":"2024-09-12T17:31:28.486474+0000","last_clean_scrub_stamp":"2024-09-12T17:31:28.486474+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:53.131800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:07.273111+0000","last_change":"2024-09-12T17:31:07.273111+0000","last_active":"2024-09-12T17:31:07.273111+0000","last_peered":"2024-09-12T17:31:07.273111+0000","last_clean":"2024-09-12T17:31:07.273111+0000","last_became_active":"2024-09-12T17:27:40.423703+0000","last_became_peered":"2024-09-12T17:27:40.423703+0000","last_unstale":"2024-09-12T17:31:07.273111+0000","last_undegraded":"2024-09-12T17:31:07.273111+0000","last_fullsized":"2024-09-12T17:31:07.273111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:07.273027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:07.273027+0000","last_clean_scrub_stamp":"2024-09-12T17:31:07.273027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:59.920670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:00.826782+0000","last_change":"2024-09-12T17:31:00.826782+0000","last_active":"2024-09-12T17:31:00.826782+0000","last_peered":"2024-09-12T17:31:00.826782+0000","last_clean":"2024-09-12T17:31:00.826782+0000","last_became_active":"2024-09-12T17:27:32.761590+0000","last_became_peered":"2024-09-12T17:27:32.761590+0000","last_unstale":"2024-09-12T17:31:00.826782+0000","last_undegraded":"2024-09-12T17:31:00.826782+0000","last_fullsized":"2024-09-12T17:31:00.826782+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:00.826700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:00.826700+0000","last_clean_scrub_stamp":"2024-09-12T17:31:00.826700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:41.176527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036072200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463699+0000","last_change":"2024-09-12T17:27:44.427647+0000","last_active":"2024-09-12T17:28:21.463699+0000","last_peered":"2024-09-12T17:28:21.463699+0000","last_clean":"2024-09-12T17:28:21.463699+0000","last_became_active":"2024-09-12T17:27:44.427318+0000","last_became_peered":"2024-09-12T17:27:44.427318+0000","last_unstale":"2024-09-12T17:28:21.463699+0000","last_undegraded":"2024-09-12T17:28:21.463699+0000","last_fullsized":"2024-09-12T17:28:21.463699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:46.727329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'10","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464060+0000","last_change":"2024-09-12T17:27:46.444325+0000","last_active":"2024-09-12T17:28:21.464060+0000","last_peered":"2024-09-12T17:28:21.464060+0000","last_clean":"2024-09-12T17:28:21.464060+0000","last_became_active":"2024-09-12T17:27:46.443937+0000","last_became_peered":"2024-09-12T17:27:46.443937+0000","last_unstale":"2024-09-12T17:28:21.464060+0000","last_undegraded":"2024-09-12T17:28:21.464060+0000","last_fullsized":"2024-09-12T17:28:21.464060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:54:23.541095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"31'285","reported_seq":393,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.779911+0000","last_change":"2024-09-12T17:27:48.441935+0000","last_active":"2024-09-12T17:30:56.779911+0000","last_peered":"2024-09-12T17:30:56.779911+0000","last_clean":"2024-09-12T17:30:56.779911+0000","last_became_active":"2024-09-12T17:27:48.441694+0000","last_became_peered":"2024-09-12T17:27:48.441694+0000","last_unstale":"2024-09-12T17:30:56.779911+0000","last_undegraded":"2024-09-12T17:30:56.779911+0000","last_fullsized":"2024-09-12T17:30:56.779911+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:32.578727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"29'3","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.468923+0000","last_change":"2024-09-12T17:27:50.453171+0000","last_active":"2024-09-12T17:28:21.468923+0000","last_peered":"2024-09-12T17:28:21.468923+0000","last_clean":"2024-09-12T17:28:21.468923+0000","last_became_active":"2024-09-12T17:27:50.452862+0000","last_became_peered":"2024-09-12T17:27:50.452862+0000","last_unstale":"2024-09-12T17:28:21.468923+0000","last_undegraded":"2024-09-12T17:28:21.468923+0000","last_fullsized":"2024-09-12T17:28:21.468923+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:55.038103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"29'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:17.188673+0000","last_change":"2024-09-12T17:31:17.188673+0000","last_active":"2024-09-12T17:31:17.188673+0000","last_peered":"2024-09-12T17:31:17.188673+0000","last_clean":"2024-09-12T17:31:17.188673+0000","last_became_active":"2024-09-12T17:27:42.436667+0000","last_became_peered":"2024-09-12T17:27:42.436667+0000","last_unstale":"2024-09-12T17:31:17.188673+0000","last_undegraded":"2024-09-12T17:31:17.188673+0000","last_fullsized":"2024-09-12T17:31:17.188673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-12T17:31:17.188564+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-12T17:31:17.188564+0000","last_clean_scrub_stamp":"2024-09-12T17:31:17.188564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:45.338606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:00.488993+0000","last_change":"2024-09-12T17:31:00.488993+0000","last_active":"2024-09-12T17:31:00.488993+0000","last_peered":"2024-09-12T17:31:00.488993+0000","last_clean":"2024-09-12T17:31:00.488993+0000","last_became_active":"2024-09-12T17:27:40.419472+0000","last_became_peered":"2024-09-12T17:27:40.419472+0000","last_unstale":"2024-09-12T17:31:00.488993+0000","last_undegraded":"2024-09-12T17:31:00.488993+0000","last_fullsized":"2024-09-12T17:31:00.488993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:00.488897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:00.488897+0000","last_clean_scrub_stamp":"2024-09-12T17:31:00.488897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:42.257433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:06.255467+0000","last_change":"2024-09-12T17:31:06.255467+0000","last_active":"2024-09-12T17:31:06.255467+0000","last_peered":"2024-09-12T17:31:06.255467+0000","last_clean":"2024-09-12T17:31:06.255467+0000","last_became_active":"2024-09-12T17:27:32.775344+0000","last_became_peered":"2024-09-12T17:27:32.775344+0000","last_unstale":"2024-09-12T17:31:06.255467+0000","last_undegraded":"2024-09-12T17:31:06.255467+0000","last_fullsized":"2024-09-12T17:31:06.255467+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:06.255380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:06.255380+0000","last_clean_scrub_stamp":"2024-09-12T17:31:06.255380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:58.712793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011343939999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463970+0000","last_change":"2024-09-12T17:27:44.427846+0000","last_active":"2024-09-12T17:28:21.463970+0000","last_peered":"2024-09-12T17:28:21.463970+0000","last_clean":"2024-09-12T17:28:21.463970+0000","last_became_active":"2024-09-12T17:27:44.427519+0000","last_became_peered":"2024-09-12T17:27:44.427519+0000","last_unstale":"2024-09-12T17:28:21.463970+0000","last_undegraded":"2024-09-12T17:28:21.463970+0000","last_fullsized":"2024-09-12T17:28:21.463970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:56.857897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"31'99","reported_seq":192,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:36.131379+0000","last_change":"2024-09-12T17:31:36.131379+0000","last_active":"2024-09-12T17:31:36.131379+0000","last_peered":"2024-09-12T17:31:36.131379+0000","last_clean":"2024-09-12T17:31:36.131379+0000","last_became_active":"2024-09-12T17:27:46.442154+0000","last_became_peered":"2024-09-12T17:27:46.442154+0000","last_unstale":"2024-09-12T17:31:36.131379+0000","last_undegraded":"2024-09-12T17:31:36.131379+0000","last_fullsized":"2024-09-12T17:31:36.131379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'99","last_scrub_stamp":"2024-09-12T17:31:36.131282+0000","last_deep_scrub":"31'99","last_deep_scrub_stamp":"2024-09-12T17:31:36.131282+0000","last_clean_scrub_stamp":"2024-09-12T17:31:36.131282+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:32.789106+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471089+0000","last_change":"2024-09-12T17:27:48.440496+0000","last_active":"2024-09-12T17:28:21.471089+0000","last_peered":"2024-09-12T17:28:21.471089+0000","last_clean":"2024-09-12T17:28:21.471089+0000","last_became_active":"2024-09-12T17:27:48.440177+0000","last_became_peered":"2024-09-12T17:27:48.440177+0000","last_unstale":"2024-09-12T17:28:21.471089+0000","last_undegraded":"2024-09-12T17:28:21.471089+0000","last_fullsized":"2024-09-12T17:28:21.471089+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:26.852348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466258+0000","last_change":"2024-09-12T17:27:50.454208+0000","last_active":"2024-09-12T17:28:21.466258+0000","last_peered":"2024-09-12T17:28:21.466258+0000","last_clean":"2024-09-12T17:28:21.466258+0000","last_became_active":"2024-09-12T17:27:50.453919+0000","last_became_peered":"2024-09-12T17:27:50.453919+0000","last_unstale":"2024-09-12T17:28:21.466258+0000","last_undegraded":"2024-09-12T17:28:21.466258+0000","last_fullsized":"2024-09-12T17:28:21.466258+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:28.859033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469099+0000","last_change":"2024-09-12T17:27:50.454609+0000","last_active":"2024-09-12T17:28:21.469099+0000","last_peered":"2024-09-12T17:28:21.469099+0000","last_clean":"2024-09-12T17:28:21.469099+0000","last_became_active":"2024-09-12T17:27:50.452190+0000","last_became_peered":"2024-09-12T17:27:50.452190+0000","last_unstale":"2024-09-12T17:28:21.469099+0000","last_undegraded":"2024-09-12T17:28:21.469099+0000","last_fullsized":"2024-09-12T17:28:21.469099+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:08.249355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:21.214317+0000","last_change":"2024-09-12T17:31:21.214317+0000","last_active":"2024-09-12T17:31:21.214317+0000","last_peered":"2024-09-12T17:31:21.214317+0000","last_clean":"2024-09-12T17:31:21.214317+0000","last_became_active":"2024-09-12T17:27:42.436187+0000","last_became_peered":"2024-09-12T17:27:42.436187+0000","last_unstale":"2024-09-12T17:31:21.214317+0000","last_undegraded":"2024-09-12T17:31:21.214317+0000","last_fullsized":"2024-09-12T17:31:21.214317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:21.214230+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:21.214230+0000","last_clean_scrub_stamp":"2024-09-12T17:31:21.214230+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:42.216760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"29'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:16.370798+0000","last_change":"2024-09-12T17:31:16.370798+0000","last_active":"2024-09-12T17:31:16.370798+0000","last_peered":"2024-09-12T17:31:16.370798+0000","last_clean":"2024-09-12T17:31:16.370798+0000","last_became_active":"2024-09-12T17:27:40.428529+0000","last_became_peered":"2024-09-12T17:27:40.428529+0000","last_unstale":"2024-09-12T17:31:16.370798+0000","last_undegraded":"2024-09-12T17:31:16.370798+0000","last_fullsized":"2024-09-12T17:31:16.370798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-12T17:31:16.370693+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-12T17:31:16.370693+0000","last_clean_scrub_stamp":"2024-09-12T17:31:16.370693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:11.675892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:35.281115+0000","last_change":"2024-09-12T17:31:35.281115+0000","last_active":"2024-09-12T17:31:35.281115+0000","last_peered":"2024-09-12T17:31:35.281115+0000","last_clean":"2024-09-12T17:31:35.281115+0000","last_became_active":"2024-09-12T17:27:44.429701+0000","last_became_peered":"2024-09-12T17:27:44.429701+0000","last_unstale":"2024-09-12T17:31:35.281115+0000","last_undegraded":"2024-09-12T17:31:35.281115+0000","last_fullsized":"2024-09-12T17:31:35.281115+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:35.281006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:35.281006+0000","last_clean_scrub_stamp":"2024-09-12T17:31:35.281006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:44.156197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"31'35","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.831082+0000","last_change":"2024-09-12T17:27:46.443026+0000","last_active":"2024-09-12T17:30:56.831082+0000","last_peered":"2024-09-12T17:30:56.831082+0000","last_clean":"2024-09-12T17:30:56.831082+0000","last_became_active":"2024-09-12T17:27:46.442713+0000","last_became_peered":"2024-09-12T17:27:46.442713+0000","last_unstale":"2024-09-12T17:30:56.831082+0000","last_undegraded":"2024-09-12T17:30:56.831082+0000","last_fullsized":"2024-09-12T17:30:56.831082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:29.878441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463885+0000","last_change":"2024-09-12T17:27:48.450563+0000","last_active":"2024-09-12T17:28:21.463885+0000","last_peered":"2024-09-12T17:28:21.463885+0000","last_clean":"2024-09-12T17:28:21.463885+0000","last_became_active":"2024-09-12T17:27:48.450050+0000","last_became_peered":"2024-09-12T17:27:48.450050+0000","last_unstale":"2024-09-12T17:28:21.463885+0000","last_undegraded":"2024-09-12T17:28:21.463885+0000","last_fullsized":"2024-09-12T17:28:21.463885+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:37.430305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"31'5","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.306851+0000","last_change":"2024-09-12T17:27:50.453680+0000","last_active":"2024-09-12T17:29:47.306851+0000","last_peered":"2024-09-12T17:29:47.306851+0000","last_clean":"2024-09-12T17:29:47.306851+0000","last_became_active":"2024-09-12T17:27:50.453382+0000","last_became_peered":"2024-09-12T17:27:50.453382+0000","last_unstale":"2024-09-12T17:29:47.306851+0000","last_undegraded":"2024-09-12T17:29:47.306851+0000","last_fullsized":"2024-09-12T17:29:47.306851+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:21.594797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"31'8","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:19.332207+0000","last_change":"2024-09-12T17:31:19.332207+0000","last_active":"2024-09-12T17:31:19.332207+0000","last_peered":"2024-09-12T17:31:19.332207+0000","last_clean":"2024-09-12T17:31:19.332207+0000","last_became_active":"2024-09-12T17:27:42.436150+0000","last_became_peered":"2024-09-12T17:27:42.436150+0000","last_unstale":"2024-09-12T17:31:19.332207+0000","last_undegraded":"2024-09-12T17:31:19.332207+0000","last_fullsized":"2024-09-12T17:31:19.332207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:19.332119+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:19.332119+0000","last_clean_scrub_stamp":"2024-09-12T17:31:19.332119+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:45.819987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:07.073417+0000","last_change":"2024-09-12T17:31:07.073417+0000","last_active":"2024-09-12T17:31:07.073417+0000","last_peered":"2024-09-12T17:31:07.073417+0000","last_clean":"2024-09-12T17:31:07.073417+0000","last_became_active":"2024-09-12T17:27:40.431962+0000","last_became_peered":"2024-09-12T17:27:40.431962+0000","last_unstale":"2024-09-12T17:31:07.073417+0000","last_undegraded":"2024-09-12T17:31:07.073417+0000","last_fullsized":"2024-09-12T17:31:07.073417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:07.073320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:07.073320+0000","last_clean_scrub_stamp":"2024-09-12T17:31:07.073320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:17.908445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465368+0000","last_change":"2024-09-12T17:27:44.432604+0000","last_active":"2024-09-12T17:28:21.465368+0000","last_peered":"2024-09-12T17:28:21.465368+0000","last_clean":"2024-09-12T17:28:21.465368+0000","last_became_active":"2024-09-12T17:27:44.432334+0000","last_became_peered":"2024-09-12T17:27:44.432334+0000","last_unstale":"2024-09-12T17:28:21.465368+0000","last_undegraded":"2024-09-12T17:28:21.465368+0000","last_fullsized":"2024-09-12T17:28:21.465368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:32.282020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"31'6","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.113421+0000","last_change":"2024-09-12T17:27:46.435861+0000","last_active":"2024-09-12T17:30:49.113421+0000","last_peered":"2024-09-12T17:30:49.113421+0000","last_clean":"2024-09-12T17:30:49.113421+0000","last_became_active":"2024-09-12T17:27:46.435567+0000","last_became_peered":"2024-09-12T17:27:46.435567+0000","last_unstale":"2024-09-12T17:30:49.113421+0000","last_undegraded":"2024-09-12T17:30:49.113421+0000","last_fullsized":"2024-09-12T17:30:49.113421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:25.415585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466933+0000","last_change":"2024-09-12T17:27:48.448838+0000","last_active":"2024-09-12T17:28:21.466933+0000","last_peered":"2024-09-12T17:28:21.466933+0000","last_clean":"2024-09-12T17:28:21.466933+0000","last_became_active":"2024-09-12T17:27:48.448478+0000","last_became_peered":"2024-09-12T17:27:48.448478+0000","last_unstale":"2024-09-12T17:28:21.466933+0000","last_undegraded":"2024-09-12T17:28:21.466933+0000","last_fullsized":"2024-09-12T17:28:21.466933+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:31.633824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"31'8","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:22.316873+0000","last_change":"2024-09-12T17:27:50.449599+0000","last_active":"2024-09-12T17:28:22.316873+0000","last_peered":"2024-09-12T17:28:22.316873+0000","last_clean":"2024-09-12T17:28:22.316873+0000","last_became_active":"2024-09-12T17:27:50.449302+0000","last_became_peered":"2024-09-12T17:27:50.449302+0000","last_unstale":"2024-09-12T17:28:22.316873+0000","last_undegraded":"2024-09-12T17:28:22.316873+0000","last_fullsized":"2024-09-12T17:28:22.316873+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:02.835518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"31'4","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:17.849853+0000","last_change":"2024-09-12T17:31:17.849853+0000","last_active":"2024-09-12T17:31:17.849853+0000","last_peered":"2024-09-12T17:31:17.849853+0000","last_clean":"2024-09-12T17:31:17.849853+0000","last_became_active":"2024-09-12T17:27:42.423974+0000","last_became_peered":"2024-09-12T17:27:42.423974+0000","last_unstale":"2024-09-12T17:31:17.849853+0000","last_undegraded":"2024-09-12T17:31:17.849853+0000","last_fullsized":"2024-09-12T17:31:17.849853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:17.849764+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:17.849764+0000","last_clean_scrub_stamp":"2024-09-12T17:31:17.849764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:32.821977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:08.073247+0000","last_change":"2024-09-12T17:31:08.073247+0000","last_active":"2024-09-12T17:31:08.073247+0000","last_peered":"2024-09-12T17:31:08.073247+0000","last_clean":"2024-09-12T17:31:08.073247+0000","last_became_active":"2024-09-12T17:27:40.430154+0000","last_became_peered":"2024-09-12T17:27:40.430154+0000","last_unstale":"2024-09-12T17:31:08.073247+0000","last_undegraded":"2024-09-12T17:31:08.073247+0000","last_fullsized":"2024-09-12T17:31:08.073247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:08.073165+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:08.073165+0000","last_clean_scrub_stamp":"2024-09-12T17:31:08.073165+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:18.392407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:32.133092+0000","last_change":"2024-09-12T17:31:32.133092+0000","last_active":"2024-09-12T17:31:32.133092+0000","last_peered":"2024-09-12T17:31:32.133092+0000","last_clean":"2024-09-12T17:31:32.133092+0000","last_became_active":"2024-09-12T17:27:44.434979+0000","last_became_peered":"2024-09-12T17:27:44.434979+0000","last_unstale":"2024-09-12T17:31:32.133092+0000","last_undegraded":"2024-09-12T17:31:32.133092+0000","last_fullsized":"2024-09-12T17:31:32.133092+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:32.133012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:32.133012+0000","last_clean_scrub_stamp":"2024-09-12T17:31:32.133012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:49.764890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"31'49","reported_seq":121,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:37.924314+0000","last_change":"2024-09-12T17:31:37.924314+0000","last_active":"2024-09-12T17:31:37.924314+0000","last_peered":"2024-09-12T17:31:37.924314+0000","last_clean":"2024-09-12T17:31:37.924314+0000","last_became_active":"2024-09-12T17:27:46.433421+0000","last_became_peered":"2024-09-12T17:27:46.433421+0000","last_unstale":"2024-09-12T17:31:37.924314+0000","last_undegraded":"2024-09-12T17:31:37.924314+0000","last_fullsized":"2024-09-12T17:31:37.924314+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'49","last_scrub_stamp":"2024-09-12T17:31:37.924209+0000","last_deep_scrub":"31'49","last_deep_scrub_stamp":"2024-09-12T17:31:37.924209+0000","last_clean_scrub_stamp":"2024-09-12T17:31:37.924209+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:04.705594+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469750+0000","last_change":"2024-09-12T17:27:48.439853+0000","last_active":"2024-09-12T17:28:21.469750+0000","last_peered":"2024-09-12T17:28:21.469750+0000","last_clean":"2024-09-12T17:28:21.469750+0000","last_became_active":"2024-09-12T17:27:48.439547+0000","last_became_peered":"2024-09-12T17:27:48.439547+0000","last_unstale":"2024-09-12T17:28:21.469750+0000","last_undegraded":"2024-09-12T17:28:21.469750+0000","last_fullsized":"2024-09-12T17:28:21.469750+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:36.201000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464221+0000","last_change":"2024-09-12T17:27:50.459594+0000","last_active":"2024-09-12T17:28:21.464221+0000","last_peered":"2024-09-12T17:28:21.464221+0000","last_clean":"2024-09-12T17:28:21.464221+0000","last_became_active":"2024-09-12T17:27:50.459321+0000","last_became_peered":"2024-09-12T17:27:50.459321+0000","last_unstale":"2024-09-12T17:28:21.464221+0000","last_undegraded":"2024-09-12T17:28:21.464221+0000","last_fullsized":"2024-09-12T17:28:21.464221+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:42.428839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"31'14","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:34.471584+0000","last_change":"2024-09-12T17:31:34.471584+0000","last_active":"2024-09-12T17:31:34.471584+0000","last_peered":"2024-09-12T17:31:34.471584+0000","last_clean":"2024-09-12T17:31:34.471584+0000","last_became_active":"2024-09-12T17:27:42.428364+0000","last_became_peered":"2024-09-12T17:27:42.428364+0000","last_unstale":"2024-09-12T17:31:34.471584+0000","last_undegraded":"2024-09-12T17:31:34.471584+0000","last_fullsized":"2024-09-12T17:31:34.471584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-12T17:31:34.471505+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-12T17:31:34.471505+0000","last_clean_scrub_stamp":"2024-09-12T17:31:34.471505+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:39.907822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:03.411106+0000","last_change":"2024-09-12T17:31:03.411106+0000","last_active":"2024-09-12T17:31:03.411106+0000","last_peered":"2024-09-12T17:31:03.411106+0000","last_clean":"2024-09-12T17:31:03.411106+0000","last_became_active":"2024-09-12T17:27:40.415212+0000","last_became_peered":"2024-09-12T17:27:40.415212+0000","last_unstale":"2024-09-12T17:31:03.411106+0000","last_undegraded":"2024-09-12T17:31:03.411106+0000","last_fullsized":"2024-09-12T17:31:03.411106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:03.411027+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:03.411027+0000","last_clean_scrub_stamp":"2024-09-12T17:31:03.411027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:42.311815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463776+0000","last_change":"2024-09-12T17:27:44.430145+0000","last_active":"2024-09-12T17:28:21.463776+0000","last_peered":"2024-09-12T17:28:21.463776+0000","last_clean":"2024-09-12T17:28:21.463776+0000","last_became_active":"2024-09-12T17:27:44.429844+0000","last_became_peered":"2024-09-12T17:27:44.429844+0000","last_unstale":"2024-09-12T17:28:21.463776+0000","last_undegraded":"2024-09-12T17:28:21.463776+0000","last_fullsized":"2024-09-12T17:28:21.463776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:43.410381+0000","last_clean_scrub_stamp":"2024-09-12T17:27:43.410381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:59.753147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"31'34","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.892689+0000","last_change":"2024-09-12T17:27:46.432991+0000","last_active":"2024-09-12T17:30:56.892689+0000","last_peered":"2024-09-12T17:30:56.892689+0000","last_clean":"2024-09-12T17:30:56.892689+0000","last_became_active":"2024-09-12T17:27:46.432650+0000","last_became_peered":"2024-09-12T17:27:46.432650+0000","last_unstale":"2024-09-12T17:30:56.892689+0000","last_undegraded":"2024-09-12T17:30:56.892689+0000","last_fullsized":"2024-09-12T17:30:56.892689+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:21.877058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469478+0000","last_change":"2024-09-12T17:27:48.440110+0000","last_active":"2024-09-12T17:28:21.469478+0000","last_peered":"2024-09-12T17:28:21.469478+0000","last_clean":"2024-09-12T17:28:21.469478+0000","last_became_active":"2024-09-12T17:27:48.439134+0000","last_became_peered":"2024-09-12T17:27:48.439134+0000","last_unstale":"2024-09-12T17:28:21.469478+0000","last_undegraded":"2024-09-12T17:28:21.469478+0000","last_fullsized":"2024-09-12T17:28:21.469478+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:10.067239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:38.470826+0000","last_change":"2024-09-12T17:31:38.470826+0000","last_active":"2024-09-12T17:31:38.470826+0000","last_peered":"2024-09-12T17:31:38.470826+0000","last_clean":"2024-09-12T17:31:38.470826+0000","last_became_active":"2024-09-12T17:27:42.426108+0000","last_became_peered":"2024-09-12T17:27:42.426108+0000","last_unstale":"2024-09-12T17:31:38.470826+0000","last_undegraded":"2024-09-12T17:31:38.470826+0000","last_fullsized":"2024-09-12T17:31:38.470826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:38.470744+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:38.470744+0000","last_clean_scrub_stamp":"2024-09-12T17:31:38.470744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:20.220207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:13.378936+0000","last_change":"2024-09-12T17:31:13.378936+0000","last_active":"2024-09-12T17:31:13.378936+0000","last_peered":"2024-09-12T17:31:13.378936+0000","last_clean":"2024-09-12T17:31:13.378936+0000","last_became_active":"2024-09-12T17:27:40.429644+0000","last_became_peered":"2024-09-12T17:27:40.429644+0000","last_unstale":"2024-09-12T17:31:13.378936+0000","last_undegraded":"2024-09-12T17:31:13.378936+0000","last_fullsized":"2024-09-12T17:31:13.378936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:13.378812+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:13.378812+0000","last_clean_scrub_stamp":"2024-09-12T17:31:13.378812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:25.356806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:35.136034+0000","last_change":"2024-09-12T17:31:35.136034+0000","last_active":"2024-09-12T17:31:35.136034+0000","last_peered":"2024-09-12T17:31:35.136034+0000","last_clean":"2024-09-12T17:31:35.136034+0000","last_became_active":"2024-09-12T17:28:21.471678+0000","last_became_peered":"2024-09-12T17:28:21.471678+0000","last_unstale":"2024-09-12T17:31:35.136034+0000","last_undegraded":"2024-09-12T17:31:35.136034+0000","last_fullsized":"2024-09-12T17:31:35.136034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:35.135955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:35.135955+0000","last_clean_scrub_stamp":"2024-09-12T17:31:35.135955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:53.779707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"31'66","reported_seq":139,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:38.968939+0000","last_change":"2024-09-12T17:31:38.968939+0000","last_active":"2024-09-12T17:31:38.968939+0000","last_peered":"2024-09-12T17:31:38.968939+0000","last_clean":"2024-09-12T17:31:38.968939+0000","last_became_active":"2024-09-12T17:27:46.437623+0000","last_became_peered":"2024-09-12T17:27:46.437623+0000","last_unstale":"2024-09-12T17:31:38.968939+0000","last_undegraded":"2024-09-12T17:31:38.968939+0000","last_fullsized":"2024-09-12T17:31:38.968939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'66","last_scrub_stamp":"2024-09-12T17:31:38.968815+0000","last_deep_scrub":"31'66","last_deep_scrub_stamp":"2024-09-12T17:31:38.968815+0000","last_clean_scrub_stamp":"2024-09-12T17:31:38.968815+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:48.067615+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.467936+0000","last_change":"2024-09-12T17:27:48.440791+0000","last_active":"2024-09-12T17:28:21.467936+0000","last_peered":"2024-09-12T17:28:21.467936+0000","last_clean":"2024-09-12T17:28:21.467936+0000","last_became_active":"2024-09-12T17:27:48.440354+0000","last_became_peered":"2024-09-12T17:27:48.440354+0000","last_unstale":"2024-09-12T17:28:21.467936+0000","last_undegraded":"2024-09-12T17:28:21.467936+0000","last_fullsized":"2024-09-12T17:28:21.467936+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:12.406427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"31'14","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.013731+0000","last_change":"2024-09-12T17:27:50.457985+0000","last_active":"2024-09-12T17:29:49.013731+0000","last_peered":"2024-09-12T17:29:49.013731+0000","last_clean":"2024-09-12T17:29:49.013731+0000","last_became_active":"2024-09-12T17:27:50.457744+0000","last_became_peered":"2024-09-12T17:27:50.457744+0000","last_unstale":"2024-09-12T17:29:49.013731+0000","last_undegraded":"2024-09-12T17:29:49.013731+0000","last_fullsized":"2024-09-12T17:29:49.013731+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:13.394393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"31'6","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:21.836070+0000","last_change":"2024-09-12T17:31:21.836070+0000","last_active":"2024-09-12T17:31:21.836070+0000","last_peered":"2024-09-12T17:31:21.836070+0000","last_clean":"2024-09-12T17:31:21.836070+0000","last_became_active":"2024-09-12T17:27:42.424447+0000","last_became_peered":"2024-09-12T17:27:42.424447+0000","last_unstale":"2024-09-12T17:31:21.836070+0000","last_undegraded":"2024-09-12T17:31:21.836070+0000","last_fullsized":"2024-09-12T17:31:21.836070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-12T17:31:21.835987+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-12T17:31:21.835987+0000","last_clean_scrub_stamp":"2024-09-12T17:31:21.835987+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:40.479739+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:04.363963+0000","last_change":"2024-09-12T17:31:04.363963+0000","last_active":"2024-09-12T17:31:04.363963+0000","last_peered":"2024-09-12T17:31:04.363963+0000","last_clean":"2024-09-12T17:31:04.363963+0000","last_became_active":"2024-09-12T17:27:40.414911+0000","last_became_peered":"2024-09-12T17:27:40.414911+0000","last_unstale":"2024-09-12T17:31:04.363963+0000","last_undegraded":"2024-09-12T17:31:04.363963+0000","last_fullsized":"2024-09-12T17:31:04.363963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:04.363875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:04.363875+0000","last_clean_scrub_stamp":"2024-09-12T17:31:04.363875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:31.145785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"31'5","reported_seq":238,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:37.091674+0000","last_change":"2024-09-12T17:31:37.091674+0000","last_active":"2024-09-12T17:31:37.091674+0000","last_peered":"2024-09-12T17:31:37.091674+0000","last_clean":"2024-09-12T17:31:37.091674+0000","last_became_active":"2024-09-12T17:27:44.427778+0000","last_became_peered":"2024-09-12T17:27:44.427778+0000","last_unstale":"2024-09-12T17:31:37.091674+0000","last_undegraded":"2024-09-12T17:31:37.091674+0000","last_fullsized":"2024-09-12T17:31:37.091674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-09-12T17:31:37.091588+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-09-12T17:31:37.091588+0000","last_clean_scrub_stamp":"2024-09-12T17:31:37.091588+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:14.070741+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"31'39","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.895653+0000","last_change":"2024-09-12T17:27:46.440779+0000","last_active":"2024-09-12T17:30:56.895653+0000","last_peered":"2024-09-12T17:30:56.895653+0000","last_clean":"2024-09-12T17:30:56.895653+0000","last_became_active":"2024-09-12T17:27:46.440494+0000","last_became_peered":"2024-09-12T17:27:46.440494+0000","last_unstale":"2024-09-12T17:30:56.895653+0000","last_undegraded":"2024-09-12T17:30:56.895653+0000","last_fullsized":"2024-09-12T17:30:56.895653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:43.434855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471249+0000","last_change":"2024-09-12T17:27:48.449171+0000","last_active":"2024-09-12T17:28:21.471249+0000","last_peered":"2024-09-12T17:28:21.471249+0000","last_clean":"2024-09-12T17:28:21.471249+0000","last_became_active":"2024-09-12T17:27:48.448871+0000","last_became_peered":"2024-09-12T17:27:48.448871+0000","last_unstale":"2024-09-12T17:28:21.471249+0000","last_undegraded":"2024-09-12T17:28:21.471249+0000","last_fullsized":"2024-09-12T17:28:21.471249+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:23.511991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463074+0000","last_change":"2024-09-12T17:27:50.452011+0000","last_active":"2024-09-12T17:28:21.463074+0000","last_peered":"2024-09-12T17:28:21.463074+0000","last_clean":"2024-09-12T17:28:21.463074+0000","last_became_active":"2024-09-12T17:27:50.451678+0000","last_became_peered":"2024-09-12T17:27:50.451678+0000","last_unstale":"2024-09-12T17:28:21.463074+0000","last_undegraded":"2024-09-12T17:28:21.463074+0000","last_fullsized":"2024-09-12T17:28:21.463074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:15.594880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:37.437437+0000","last_change":"2024-09-12T17:31:37.437437+0000","last_active":"2024-09-12T17:31:37.437437+0000","last_peered":"2024-09-12T17:31:37.437437+0000","last_clean":"2024-09-12T17:31:37.437437+0000","last_became_active":"2024-09-12T17:27:42.438583+0000","last_became_peered":"2024-09-12T17:27:42.438583+0000","last_unstale":"2024-09-12T17:31:37.437437+0000","last_undegraded":"2024-09-12T17:31:37.437437+0000","last_fullsized":"2024-09-12T17:31:37.437437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:37.437341+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:37.437341+0000","last_clean_scrub_stamp":"2024-09-12T17:31:37.437341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:18.893026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:05.381633+0000","last_change":"2024-09-12T17:31:05.381633+0000","last_active":"2024-09-12T17:31:05.381633+0000","last_peered":"2024-09-12T17:31:05.381633+0000","last_clean":"2024-09-12T17:31:05.381633+0000","last_became_active":"2024-09-12T17:27:40.414034+0000","last_became_peered":"2024-09-12T17:27:40.414034+0000","last_unstale":"2024-09-12T17:31:05.381633+0000","last_undegraded":"2024-09-12T17:31:05.381633+0000","last_fullsized":"2024-09-12T17:31:05.381633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:05.381510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:05.381510+0000","last_clean_scrub_stamp":"2024-09-12T17:31:05.381510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:28.239447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:34.127651+0000","last_change":"2024-09-12T17:31:34.127651+0000","last_active":"2024-09-12T17:31:34.127651+0000","last_peered":"2024-09-12T17:31:34.127651+0000","last_clean":"2024-09-12T17:31:34.127651+0000","last_became_active":"2024-09-12T17:27:44.426927+0000","last_became_peered":"2024-09-12T17:27:44.426927+0000","last_unstale":"2024-09-12T17:31:34.127651+0000","last_undegraded":"2024-09-12T17:31:34.127651+0000","last_fullsized":"2024-09-12T17:31:34.127651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:34.127561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:34.127561+0000","last_clean_scrub_stamp":"2024-09-12T17:31:34.127561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:41.075392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"31'35","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.847330+0000","last_change":"2024-09-12T17:27:46.439119+0000","last_active":"2024-09-12T17:30:56.847330+0000","last_peered":"2024-09-12T17:30:56.847330+0000","last_clean":"2024-09-12T17:30:56.847330+0000","last_became_active":"2024-09-12T17:27:46.438778+0000","last_became_peered":"2024-09-12T17:27:46.438778+0000","last_unstale":"2024-09-12T17:30:56.847330+0000","last_undegraded":"2024-09-12T17:30:56.847330+0000","last_fullsized":"2024-09-12T17:30:56.847330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:47.015548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.473244+0000","last_change":"2024-09-12T17:27:48.440227+0000","last_active":"2024-09-12T17:28:21.473244+0000","last_peered":"2024-09-12T17:28:21.473244+0000","last_clean":"2024-09-12T17:28:21.473244+0000","last_became_active":"2024-09-12T17:27:48.439888+0000","last_became_peered":"2024-09-12T17:27:48.439888+0000","last_unstale":"2024-09-12T17:28:21.473244+0000","last_undegraded":"2024-09-12T17:28:21.473244+0000","last_fullsized":"2024-09-12T17:28:21.473244+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:29.484764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"31'3","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.072631+0000","last_change":"2024-09-12T17:27:50.455406+0000","last_active":"2024-09-12T17:29:49.072631+0000","last_peered":"2024-09-12T17:29:49.072631+0000","last_clean":"2024-09-12T17:29:49.072631+0000","last_became_active":"2024-09-12T17:27:50.454058+0000","last_became_peered":"2024-09-12T17:27:50.454058+0000","last_unstale":"2024-09-12T17:29:49.072631+0000","last_undegraded":"2024-09-12T17:29:49.072631+0000","last_fullsized":"2024-09-12T17:29:49.072631+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:44.719122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"31'6","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:19.793825+0000","last_change":"2024-09-12T17:31:19.793825+0000","last_active":"2024-09-12T17:31:19.793825+0000","last_peered":"2024-09-12T17:31:19.793825+0000","last_clean":"2024-09-12T17:31:19.793825+0000","last_became_active":"2024-09-12T17:27:42.428236+0000","last_became_peered":"2024-09-12T17:27:42.428236+0000","last_unstale":"2024-09-12T17:31:19.793825+0000","last_undegraded":"2024-09-12T17:31:19.793825+0000","last_fullsized":"2024-09-12T17:31:19.793825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-12T17:31:19.793741+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-12T17:31:19.793741+0000","last_clean_scrub_stamp":"2024-09-12T17:31:19.793741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:09.004133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"31'6","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:17.402187+0000","last_change":"2024-09-12T17:31:17.402187+0000","last_active":"2024-09-12T17:31:17.402187+0000","last_peered":"2024-09-12T17:31:17.402187+0000","last_clean":"2024-09-12T17:31:17.402187+0000","last_became_active":"2024-09-12T17:27:40.428969+0000","last_became_peered":"2024-09-12T17:27:40.428969+0000","last_unstale":"2024-09-12T17:31:17.402187+0000","last_undegraded":"2024-09-12T17:31:17.402187+0000","last_fullsized":"2024-09-12T17:31:17.402187+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-12T17:31:17.402103+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-12T17:31:17.402103+0000","last_clean_scrub_stamp":"2024-09-12T17:31:17.402103+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:02:26.841712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":14,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:38.208867+0000","last_change":"2024-09-12T17:31:38.208867+0000","last_active":"2024-09-12T17:31:38.208867+0000","last_peered":"2024-09-12T17:31:38.208867+0000","last_clean":"2024-09-12T17:31:38.208867+0000","last_became_active":"2024-09-12T17:27:44.432609+0000","last_became_peered":"2024-09-12T17:27:44.432609+0000","last_unstale":"2024-09-12T17:31:38.208867+0000","last_undegraded":"2024-09-12T17:31:38.208867+0000","last_fullsized":"2024-09-12T17:31:38.208867+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:38.208779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:38.208779+0000","last_clean_scrub_stamp":"2024-09-12T17:31:38.208779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:52.480217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"29'10","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465451+0000","last_change":"2024-09-12T17:27:46.445145+0000","last_active":"2024-09-12T17:28:21.465451+0000","last_peered":"2024-09-12T17:28:21.465451+0000","last_clean":"2024-09-12T17:28:21.465451+0000","last_became_active":"2024-09-12T17:27:46.444644+0000","last_became_peered":"2024-09-12T17:27:46.444644+0000","last_unstale":"2024-09-12T17:28:21.465451+0000","last_undegraded":"2024-09-12T17:28:21.465451+0000","last_fullsized":"2024-09-12T17:28:21.465451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:28.337567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"31'285","reported_seq":374,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.773238+0000","last_change":"2024-09-12T17:27:48.449435+0000","last_active":"2024-09-12T17:30:56.773238+0000","last_peered":"2024-09-12T17:30:56.773238+0000","last_clean":"2024-09-12T17:30:56.773238+0000","last_became_active":"2024-09-12T17:27:48.449138+0000","last_became_peered":"2024-09-12T17:27:48.449138+0000","last_unstale":"2024-09-12T17:30:56.773238+0000","last_undegraded":"2024-09-12T17:30:56.773238+0000","last_fullsized":"2024-09-12T17:30:56.773238+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:43.994480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.462765+0000","last_change":"2024-09-12T17:27:50.452165+0000","last_active":"2024-09-12T17:28:21.462765+0000","last_peered":"2024-09-12T17:28:21.462765+0000","last_clean":"2024-09-12T17:28:21.462765+0000","last_became_active":"2024-09-12T17:27:50.451899+0000","last_became_peered":"2024-09-12T17:27:50.451899+0000","last_unstale":"2024-09-12T17:28:21.462765+0000","last_undegraded":"2024-09-12T17:28:21.462765+0000","last_fullsized":"2024-09-12T17:28:21.462765+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:38.778216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"31'8","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:25.227409+0000","last_change":"2024-09-12T17:31:25.227409+0000","last_active":"2024-09-12T17:31:25.227409+0000","last_peered":"2024-09-12T17:31:25.227409+0000","last_clean":"2024-09-12T17:31:25.227409+0000","last_became_active":"2024-09-12T17:27:42.430110+0000","last_became_peered":"2024-09-12T17:27:42.430110+0000","last_unstale":"2024-09-12T17:31:25.227409+0000","last_undegraded":"2024-09-12T17:31:25.227409+0000","last_fullsized":"2024-09-12T17:31:25.227409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:25.227313+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:25.227313+0000","last_clean_scrub_stamp":"2024-09-12T17:31:25.227313+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:17.103312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:06.345680+0000","last_change":"2024-09-12T17:31:06.345680+0000","last_active":"2024-09-12T17:31:06.345680+0000","last_peered":"2024-09-12T17:31:06.345680+0000","last_clean":"2024-09-12T17:31:06.345680+0000","last_became_active":"2024-09-12T17:27:40.415018+0000","last_became_peered":"2024-09-12T17:27:40.415018+0000","last_unstale":"2024-09-12T17:31:06.345680+0000","last_undegraded":"2024-09-12T17:31:06.345680+0000","last_fullsized":"2024-09-12T17:31:06.345680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:06.345593+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:06.345593+0000","last_clean_scrub_stamp":"2024-09-12T17:31:06.345593+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:34.495634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:37.210915+0000","last_change":"2024-09-12T17:31:37.210915+0000","last_active":"2024-09-12T17:31:37.210915+0000","last_peered":"2024-09-12T17:31:37.210915+0000","last_clean":"2024-09-12T17:31:37.210915+0000","last_became_active":"2024-09-12T17:27:44.432389+0000","last_became_peered":"2024-09-12T17:27:44.432389+0000","last_unstale":"2024-09-12T17:31:37.210915+0000","last_undegraded":"2024-09-12T17:31:37.210915+0000","last_fullsized":"2024-09-12T17:31:37.210915+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:37.210810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:37.210810+0000","last_clean_scrub_stamp":"2024-09-12T17:31:37.210810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:49.748361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"31'39","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.867839+0000","last_change":"2024-09-12T17:27:46.437010+0000","last_active":"2024-09-12T17:30:56.867839+0000","last_peered":"2024-09-12T17:30:56.867839+0000","last_clean":"2024-09-12T17:30:56.867839+0000","last_became_active":"2024-09-12T17:27:46.435056+0000","last_became_peered":"2024-09-12T17:27:46.435056+0000","last_unstale":"2024-09-12T17:30:56.867839+0000","last_undegraded":"2024-09-12T17:30:56.867839+0000","last_fullsized":"2024-09-12T17:30:56.867839+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:41.987106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470481+0000","last_change":"2024-09-12T17:27:48.451418+0000","last_active":"2024-09-12T17:28:21.470481+0000","last_peered":"2024-09-12T17:28:21.470481+0000","last_clean":"2024-09-12T17:28:21.470481+0000","last_became_active":"2024-09-12T17:27:48.451143+0000","last_became_peered":"2024-09-12T17:27:48.451143+0000","last_unstale":"2024-09-12T17:28:21.470481+0000","last_undegraded":"2024-09-12T17:28:21.470481+0000","last_fullsized":"2024-09-12T17:28:21.470481+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:05.841062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.469983+0000","last_change":"2024-09-12T17:27:50.459043+0000","last_active":"2024-09-12T17:28:21.469983+0000","last_peered":"2024-09-12T17:28:21.469983+0000","last_clean":"2024-09-12T17:28:21.469983+0000","last_became_active":"2024-09-12T17:27:50.458688+0000","last_became_peered":"2024-09-12T17:27:50.458688+0000","last_unstale":"2024-09-12T17:28:21.469983+0000","last_undegraded":"2024-09-12T17:28:21.469983+0000","last_fullsized":"2024-09-12T17:28:21.469983+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:52.579121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'18","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:24.239641+0000","last_change":"2024-09-12T17:31:24.239641+0000","last_active":"2024-09-12T17:31:24.239641+0000","last_peered":"2024-09-12T17:31:24.239641+0000","last_clean":"2024-09-12T17:31:24.239641+0000","last_became_active":"2024-09-12T17:27:42.429645+0000","last_became_peered":"2024-09-12T17:27:42.429645+0000","last_unstale":"2024-09-12T17:31:24.239641+0000","last_undegraded":"2024-09-12T17:31:24.239641+0000","last_fullsized":"2024-09-12T17:31:24.239641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'18","last_scrub_stamp":"2024-09-12T17:31:24.239557+0000","last_deep_scrub":"31'18","last_deep_scrub_stamp":"2024-09-12T17:31:24.239557+0000","last_clean_scrub_stamp":"2024-09-12T17:31:24.239557+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:16.223898+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":59,"num_read_kb":51,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:18.401497+0000","last_change":"2024-09-12T17:31:18.401497+0000","last_active":"2024-09-12T17:31:18.401497+0000","last_peered":"2024-09-12T17:31:18.401497+0000","last_clean":"2024-09-12T17:31:18.401497+0000","last_became_active":"2024-09-12T17:27:40.433580+0000","last_became_peered":"2024-09-12T17:27:40.433580+0000","last_unstale":"2024-09-12T17:31:18.401497+0000","last_undegraded":"2024-09-12T17:31:18.401497+0000","last_fullsized":"2024-09-12T17:31:18.401497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:18.401408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:18.401408+0000","last_clean_scrub_stamp":"2024-09-12T17:31:18.401408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:11.623914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:33.094219+0000","last_change":"2024-09-12T17:31:33.094219+0000","last_active":"2024-09-12T17:31:33.094219+0000","last_peered":"2024-09-12T17:31:33.094219+0000","last_clean":"2024-09-12T17:31:33.094219+0000","last_became_active":"2024-09-12T17:27:44.433529+0000","last_became_peered":"2024-09-12T17:27:44.433529+0000","last_unstale":"2024-09-12T17:31:33.094219+0000","last_undegraded":"2024-09-12T17:31:33.094219+0000","last_fullsized":"2024-09-12T17:31:33.094219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:33.094131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:33.094131+0000","last_clean_scrub_stamp":"2024-09-12T17:31:33.094131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:22.304523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"31'35","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.871259+0000","last_change":"2024-09-12T17:27:46.439345+0000","last_active":"2024-09-12T17:30:56.871259+0000","last_peered":"2024-09-12T17:30:56.871259+0000","last_clean":"2024-09-12T17:30:56.871259+0000","last_became_active":"2024-09-12T17:27:46.439037+0000","last_became_peered":"2024-09-12T17:27:46.439037+0000","last_unstale":"2024-09-12T17:30:56.871259+0000","last_undegraded":"2024-09-12T17:30:56.871259+0000","last_fullsized":"2024-09-12T17:30:56.871259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:39.381080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463052+0000","last_change":"2024-09-12T17:27:48.449101+0000","last_active":"2024-09-12T17:28:21.463052+0000","last_peered":"2024-09-12T17:28:21.463052+0000","last_clean":"2024-09-12T17:28:21.463052+0000","last_became_active":"2024-09-12T17:27:48.448426+0000","last_became_peered":"2024-09-12T17:27:48.448426+0000","last_unstale":"2024-09-12T17:28:21.463052+0000","last_undegraded":"2024-09-12T17:28:21.463052+0000","last_fullsized":"2024-09-12T17:28:21.463052+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:18.516470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464580+0000","last_change":"2024-09-12T17:27:50.459948+0000","last_active":"2024-09-12T17:28:21.464580+0000","last_peered":"2024-09-12T17:28:21.464580+0000","last_clean":"2024-09-12T17:28:21.464580+0000","last_became_active":"2024-09-12T17:27:50.459662+0000","last_became_peered":"2024-09-12T17:27:50.459662+0000","last_unstale":"2024-09-12T17:28:21.464580+0000","last_undegraded":"2024-09-12T17:28:21.464580+0000","last_fullsized":"2024-09-12T17:28:21.464580+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:08.216661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'12","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:23.237052+0000","last_change":"2024-09-12T17:31:23.237052+0000","last_active":"2024-09-12T17:31:23.237052+0000","last_peered":"2024-09-12T17:31:23.237052+0000","last_clean":"2024-09-12T17:31:23.237052+0000","last_became_active":"2024-09-12T17:28:21.472532+0000","last_became_peered":"2024-09-12T17:28:21.472532+0000","last_unstale":"2024-09-12T17:31:23.237052+0000","last_undegraded":"2024-09-12T17:31:23.237052+0000","last_fullsized":"2024-09-12T17:31:23.237052+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-09-12T17:31:23.236949+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-09-12T17:31:23.236949+0000","last_clean_scrub_stamp":"2024-09-12T17:31:23.236949+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:09.498014+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:04.774672+0000","last_change":"2024-09-12T17:31:04.774672+0000","last_active":"2024-09-12T17:31:04.774672+0000","last_peered":"2024-09-12T17:31:04.774672+0000","last_clean":"2024-09-12T17:31:04.774672+0000","last_became_active":"2024-09-12T17:27:40.418464+0000","last_became_peered":"2024-09-12T17:27:40.418464+0000","last_unstale":"2024-09-12T17:31:04.774672+0000","last_undegraded":"2024-09-12T17:31:04.774672+0000","last_fullsized":"2024-09-12T17:31:04.774672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:04.774580+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:04.774580+0000","last_clean_scrub_stamp":"2024-09-12T17:31:04.774580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:11.872204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:36.236243+0000","last_change":"2024-09-12T17:31:36.236243+0000","last_active":"2024-09-12T17:31:36.236243+0000","last_peered":"2024-09-12T17:31:36.236243+0000","last_clean":"2024-09-12T17:31:36.236243+0000","last_became_active":"2024-09-12T17:27:44.430221+0000","last_became_peered":"2024-09-12T17:27:44.430221+0000","last_unstale":"2024-09-12T17:31:36.236243+0000","last_undegraded":"2024-09-12T17:31:36.236243+0000","last_fullsized":"2024-09-12T17:31:36.236243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:36.236156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:36.236156+0000","last_clean_scrub_stamp":"2024-09-12T17:31:36.236156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:42.309771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"31'29","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.836827+0000","last_change":"2024-09-12T17:27:46.441427+0000","last_active":"2024-09-12T17:30:56.836827+0000","last_peered":"2024-09-12T17:30:56.836827+0000","last_clean":"2024-09-12T17:30:56.836827+0000","last_became_active":"2024-09-12T17:27:46.441081+0000","last_became_peered":"2024-09-12T17:27:46.441081+0000","last_unstale":"2024-09-12T17:30:56.836827+0000","last_undegraded":"2024-09-12T17:30:56.836827+0000","last_fullsized":"2024-09-12T17:30:56.836827+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:08.132341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463313+0000","last_change":"2024-09-12T17:27:48.447632+0000","last_active":"2024-09-12T17:28:21.463313+0000","last_peered":"2024-09-12T17:28:21.463313+0000","last_clean":"2024-09-12T17:28:21.463313+0000","last_became_active":"2024-09-12T17:27:48.447321+0000","last_became_peered":"2024-09-12T17:27:48.447321+0000","last_unstale":"2024-09-12T17:28:21.463313+0000","last_undegraded":"2024-09-12T17:28:21.463313+0000","last_fullsized":"2024-09-12T17:28:21.463313+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:43.865345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"31'10","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.181767+0000","last_change":"2024-09-12T17:27:50.460271+0000","last_active":"2024-09-12T17:30:49.181767+0000","last_peered":"2024-09-12T17:30:49.181767+0000","last_clean":"2024-09-12T17:30:49.181767+0000","last_became_active":"2024-09-12T17:27:50.459463+0000","last_became_peered":"2024-09-12T17:27:50.459463+0000","last_unstale":"2024-09-12T17:30:49.181767+0000","last_undegraded":"2024-09-12T17:30:49.181767+0000","last_fullsized":"2024-09-12T17:30:49.181767+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:18.316219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"31'18","reported_seq":90,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:22.222693+0000","last_change":"2024-09-12T17:31:22.222693+0000","last_active":"2024-09-12T17:31:22.222693+0000","last_peered":"2024-09-12T17:31:22.222693+0000","last_clean":"2024-09-12T17:31:22.222693+0000","last_became_active":"2024-09-12T17:27:42.430021+0000","last_became_peered":"2024-09-12T17:27:42.430021+0000","last_unstale":"2024-09-12T17:31:22.222693+0000","last_undegraded":"2024-09-12T17:31:22.222693+0000","last_fullsized":"2024-09-12T17:31:22.222693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'18","last_scrub_stamp":"2024-09-12T17:31:22.222608+0000","last_deep_scrub":"31'18","last_deep_scrub_stamp":"2024-09-12T17:31:22.222608+0000","last_clean_scrub_stamp":"2024-09-12T17:31:22.222608+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:10.350058+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":76,"num_read_kb":68,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:07.302162+0000","last_change":"2024-09-12T17:31:07.302162+0000","last_active":"2024-09-12T17:31:07.302162+0000","last_peered":"2024-09-12T17:31:07.302162+0000","last_clean":"2024-09-12T17:31:07.302162+0000","last_became_active":"2024-09-12T17:27:40.415549+0000","last_became_peered":"2024-09-12T17:27:40.415549+0000","last_unstale":"2024-09-12T17:31:07.302162+0000","last_undegraded":"2024-09-12T17:31:07.302162+0000","last_fullsized":"2024-09-12T17:31:07.302162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:07.302079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:07.302079+0000","last_clean_scrub_stamp":"2024-09-12T17:31:07.302079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:31:42.747169+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"31'3","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:39.213346+0000","last_change":"2024-09-12T17:31:39.213346+0000","last_active":"2024-09-12T17:31:39.213346+0000","last_peered":"2024-09-12T17:31:39.213346+0000","last_clean":"2024-09-12T17:31:39.213346+0000","last_became_active":"2024-09-12T17:27:44.433037+0000","last_became_peered":"2024-09-12T17:27:44.433037+0000","last_unstale":"2024-09-12T17:31:39.213346+0000","last_undegraded":"2024-09-12T17:31:39.213346+0000","last_fullsized":"2024-09-12T17:31:39.213346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-09-12T17:31:39.213265+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-09-12T17:31:39.213265+0000","last_clean_scrub_stamp":"2024-09-12T17:31:39.213265+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:46.499885+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"31'36","reported_seq":85,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.850133+0000","last_change":"2024-09-12T17:27:46.443590+0000","last_active":"2024-09-12T17:30:56.850133+0000","last_peered":"2024-09-12T17:30:56.850133+0000","last_clean":"2024-09-12T17:30:56.850133+0000","last_became_active":"2024-09-12T17:27:46.443316+0000","last_became_peered":"2024-09-12T17:27:46.443316+0000","last_unstale":"2024-09-12T17:30:56.850133+0000","last_undegraded":"2024-09-12T17:30:56.850133+0000","last_fullsized":"2024-09-12T17:30:56.850133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:47.273927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.471547+0000","last_change":"2024-09-12T17:27:48.448239+0000","last_active":"2024-09-12T17:28:21.471547+0000","last_peered":"2024-09-12T17:28:21.471547+0000","last_clean":"2024-09-12T17:28:21.471547+0000","last_became_active":"2024-09-12T17:27:48.447884+0000","last_became_peered":"2024-09-12T17:27:48.447884+0000","last_unstale":"2024-09-12T17:28:21.471547+0000","last_undegraded":"2024-09-12T17:28:21.471547+0000","last_fullsized":"2024-09-12T17:28:21.471547+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:37.799636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"31'2","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.614754+0000","last_change":"2024-09-12T17:27:50.459747+0000","last_active":"2024-09-12T17:29:47.614754+0000","last_peered":"2024-09-12T17:29:47.614754+0000","last_clean":"2024-09-12T17:29:47.614754+0000","last_became_active":"2024-09-12T17:27:50.459464+0000","last_became_peered":"2024-09-12T17:27:50.459464+0000","last_unstale":"2024-09-12T17:29:47.614754+0000","last_undegraded":"2024-09-12T17:29:47.614754+0000","last_fullsized":"2024-09-12T17:29:47.614754+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:47.424145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"31'6","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:26.275546+0000","last_change":"2024-09-12T17:31:26.275546+0000","last_active":"2024-09-12T17:31:26.275546+0000","last_peered":"2024-09-12T17:31:26.275546+0000","last_clean":"2024-09-12T17:31:26.275546+0000","last_became_active":"2024-09-12T17:28:21.471738+0000","last_became_peered":"2024-09-12T17:28:21.471738+0000","last_unstale":"2024-09-12T17:31:26.275546+0000","last_undegraded":"2024-09-12T17:31:26.275546+0000","last_fullsized":"2024-09-12T17:31:26.275546+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-12T17:31:26.275465+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-12T17:31:26.275465+0000","last_clean_scrub_stamp":"2024-09-12T17:31:26.275465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:32.161098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:09.101122+0000","last_change":"2024-09-12T17:31:09.101122+0000","last_active":"2024-09-12T17:31:09.101122+0000","last_peered":"2024-09-12T17:31:09.101122+0000","last_clean":"2024-09-12T17:31:09.101122+0000","last_became_active":"2024-09-12T17:27:40.425150+0000","last_became_peered":"2024-09-12T17:27:40.425150+0000","last_unstale":"2024-09-12T17:31:09.101122+0000","last_undegraded":"2024-09-12T17:31:09.101122+0000","last_fullsized":"2024-09-12T17:31:09.101122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:09.101041+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:09.101041+0000","last_clean_scrub_stamp":"2024-09-12T17:31:09.101041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:11.434252+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"31'6","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:24.873531+0000","last_change":"2024-09-12T17:31:24.873531+0000","last_active":"2024-09-12T17:31:24.873531+0000","last_peered":"2024-09-12T17:31:24.873531+0000","last_clean":"2024-09-12T17:31:24.873531+0000","last_became_active":"2024-09-12T17:27:42.427745+0000","last_became_peered":"2024-09-12T17:27:42.427745+0000","last_unstale":"2024-09-12T17:31:24.873531+0000","last_undegraded":"2024-09-12T17:31:24.873531+0000","last_fullsized":"2024-09-12T17:31:24.873531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-12T17:31:24.873443+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-12T17:31:24.873443+0000","last_clean_scrub_stamp":"2024-09-12T17:31:24.873443+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:52.854740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:02.824281+0000","last_change":"2024-09-12T17:31:02.824281+0000","last_active":"2024-09-12T17:31:02.824281+0000","last_peered":"2024-09-12T17:31:02.824281+0000","last_clean":"2024-09-12T17:31:02.824281+0000","last_became_active":"2024-09-12T17:27:40.413068+0000","last_became_peered":"2024-09-12T17:27:40.413068+0000","last_unstale":"2024-09-12T17:31:02.824281+0000","last_undegraded":"2024-09-12T17:31:02.824281+0000","last_fullsized":"2024-09-12T17:31:02.824281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:02.824193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:02.824193+0000","last_clean_scrub_stamp":"2024-09-12T17:31:02.824193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:30.974235+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:40.553818+0000","last_change":"2024-09-12T17:31:40.553818+0000","last_active":"2024-09-12T17:31:40.553818+0000","last_peered":"2024-09-12T17:31:40.553818+0000","last_clean":"2024-09-12T17:31:40.553818+0000","last_became_active":"2024-09-12T17:27:42.428871+0000","last_became_peered":"2024-09-12T17:27:42.428871+0000","last_unstale":"2024-09-12T17:31:40.553818+0000","last_undegraded":"2024-09-12T17:31:40.553818+0000","last_fullsized":"2024-09-12T17:31:40.553818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:40.553702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:40.553702+0000","last_clean_scrub_stamp":"2024-09-12T17:31:40.553702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:04.977336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:19.436252+0000","last_change":"2024-09-12T17:31:19.436252+0000","last_active":"2024-09-12T17:31:19.436252+0000","last_peered":"2024-09-12T17:31:19.436252+0000","last_clean":"2024-09-12T17:31:19.436252+0000","last_became_active":"2024-09-12T17:27:40.423210+0000","last_became_peered":"2024-09-12T17:27:40.423210+0000","last_unstale":"2024-09-12T17:31:19.436252+0000","last_undegraded":"2024-09-12T17:31:19.436252+0000","last_fullsized":"2024-09-12T17:31:19.436252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:19.436168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:19.436168+0000","last_clean_scrub_stamp":"2024-09-12T17:31:19.436168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:08.266186+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"31'10","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:23.856443+0000","last_change":"2024-09-12T17:31:23.856443+0000","last_active":"2024-09-12T17:31:23.856443+0000","last_peered":"2024-09-12T17:31:23.856443+0000","last_clean":"2024-09-12T17:31:23.856443+0000","last_became_active":"2024-09-12T17:27:42.428059+0000","last_became_peered":"2024-09-12T17:27:42.428059+0000","last_unstale":"2024-09-12T17:31:23.856443+0000","last_undegraded":"2024-09-12T17:31:23.856443+0000","last_fullsized":"2024-09-12T17:31:23.856443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-12T17:31:23.856356+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-12T17:31:23.856356+0000","last_clean_scrub_stamp":"2024-09-12T17:31:23.856356+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:00.835509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:08.822428+0000","last_change":"2024-09-12T17:31:08.822428+0000","last_active":"2024-09-12T17:31:08.822428+0000","last_peered":"2024-09-12T17:31:08.822428+0000","last_clean":"2024-09-12T17:31:08.822428+0000","last_became_active":"2024-09-12T17:27:40.419018+0000","last_became_peered":"2024-09-12T17:27:40.419018+0000","last_unstale":"2024-09-12T17:31:08.822428+0000","last_undegraded":"2024-09-12T17:31:08.822428+0000","last_fullsized":"2024-09-12T17:31:08.822428+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:08.822340+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:08.822340+0000","last_clean_scrub_stamp":"2024-09-12T17:31:08.822340+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:55.083405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"31'4","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:22.847810+0000","last_change":"2024-09-12T17:31:22.847810+0000","last_active":"2024-09-12T17:31:22.847810+0000","last_peered":"2024-09-12T17:31:22.847810+0000","last_clean":"2024-09-12T17:31:22.847810+0000","last_became_active":"2024-09-12T17:27:42.424201+0000","last_became_peered":"2024-09-12T17:27:42.424201+0000","last_unstale":"2024-09-12T17:31:22.847810+0000","last_undegraded":"2024-09-12T17:31:22.847810+0000","last_fullsized":"2024-09-12T17:31:22.847810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:22.847723+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:22.847723+0000","last_clean_scrub_stamp":"2024-09-12T17:31:22.847723+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:19.505548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:14.865433+0000","last_change":"2024-09-12T17:31:14.865433+0000","last_active":"2024-09-12T17:31:14.865433+0000","last_peered":"2024-09-12T17:31:14.865433+0000","last_clean":"2024-09-12T17:31:14.865433+0000","last_became_active":"2024-09-12T17:27:40.415318+0000","last_became_peered":"2024-09-12T17:27:40.415318+0000","last_unstale":"2024-09-12T17:31:14.865433+0000","last_undegraded":"2024-09-12T17:31:14.865433+0000","last_fullsized":"2024-09-12T17:31:14.865433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:14.865333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:14.865333+0000","last_clean_scrub_stamp":"2024-09-12T17:31:14.865333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:46.192766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"31'6","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:20.343357+0000","last_change":"2024-09-12T17:31:20.343357+0000","last_active":"2024-09-12T17:31:20.343357+0000","last_peered":"2024-09-12T17:31:20.343357+0000","last_clean":"2024-09-12T17:31:20.343357+0000","last_became_active":"2024-09-12T17:27:42.434664+0000","last_became_peered":"2024-09-12T17:27:42.434664+0000","last_unstale":"2024-09-12T17:31:20.343357+0000","last_undegraded":"2024-09-12T17:31:20.343357+0000","last_fullsized":"2024-09-12T17:31:20.343357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-12T17:31:20.343275+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-12T17:31:20.343275+0000","last_clean_scrub_stamp":"2024-09-12T17:31:20.343275+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:35.315488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:09.264861+0000","last_change":"2024-09-12T17:31:09.264861+0000","last_active":"2024-09-12T17:31:09.264861+0000","last_peered":"2024-09-12T17:31:09.264861+0000","last_clean":"2024-09-12T17:31:09.264861+0000","last_became_active":"2024-09-12T17:27:40.420491+0000","last_became_peered":"2024-09-12T17:27:40.420491+0000","last_unstale":"2024-09-12T17:31:09.264861+0000","last_undegraded":"2024-09-12T17:31:09.264861+0000","last_fullsized":"2024-09-12T17:31:09.264861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:09.264760+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:09.264760+0000","last_clean_scrub_stamp":"2024-09-12T17:31:09.264760+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:08.584209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"31'10","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:20.791706+0000","last_change":"2024-09-12T17:31:20.791706+0000","last_active":"2024-09-12T17:31:20.791706+0000","last_peered":"2024-09-12T17:31:20.791706+0000","last_clean":"2024-09-12T17:31:20.791706+0000","last_became_active":"2024-09-12T17:27:42.424810+0000","last_became_peered":"2024-09-12T17:27:42.424810+0000","last_unstale":"2024-09-12T17:31:20.791706+0000","last_undegraded":"2024-09-12T17:31:20.791706+0000","last_fullsized":"2024-09-12T17:31:20.791706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-12T17:31:20.791597+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-12T17:31:20.791597+0000","last_clean_scrub_stamp":"2024-09-12T17:31:20.791597+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:27.739428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":37,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:10.132403+0000","last_change":"2024-09-12T17:31:10.132403+0000","last_active":"2024-09-12T17:31:10.132403+0000","last_peered":"2024-09-12T17:31:10.132403+0000","last_clean":"2024-09-12T17:31:10.132403+0000","last_became_active":"2024-09-12T17:27:40.431365+0000","last_became_peered":"2024-09-12T17:27:40.431365+0000","last_unstale":"2024-09-12T17:31:10.132403+0000","last_undegraded":"2024-09-12T17:31:10.132403+0000","last_fullsized":"2024-09-12T17:31:10.132403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:10.132310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:10.132310+0000","last_clean_scrub_stamp":"2024-09-12T17:31:10.132310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:29.172061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"31'13","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:18.349579+0000","last_change":"2024-09-12T17:31:18.349579+0000","last_active":"2024-09-12T17:31:18.349579+0000","last_peered":"2024-09-12T17:31:18.349579+0000","last_clean":"2024-09-12T17:31:18.349579+0000","last_became_active":"2024-09-12T17:27:42.423099+0000","last_became_peered":"2024-09-12T17:27:42.423099+0000","last_unstale":"2024-09-12T17:31:18.349579+0000","last_undegraded":"2024-09-12T17:31:18.349579+0000","last_fullsized":"2024-09-12T17:31:18.349579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'13","last_scrub_stamp":"2024-09-12T17:31:18.349454+0000","last_deep_scrub":"31'13","last_deep_scrub_stamp":"2024-09-12T17:31:18.349454+0000","last_clean_scrub_stamp":"2024-09-12T17:31:18.349454+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:26.892025+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:06.750029+0000","last_change":"2024-09-12T17:31:06.750029+0000","last_active":"2024-09-12T17:31:06.750029+0000","last_peered":"2024-09-12T17:31:06.750029+0000","last_clean":"2024-09-12T17:31:06.750029+0000","last_became_active":"2024-09-12T17:27:40.415456+0000","last_became_peered":"2024-09-12T17:27:40.415456+0000","last_unstale":"2024-09-12T17:31:06.750029+0000","last_undegraded":"2024-09-12T17:31:06.750029+0000","last_fullsized":"2024-09-12T17:31:06.750029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:06.749935+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:06.749935+0000","last_clean_scrub_stamp":"2024-09-12T17:31:06.749935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:24:59.406146+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"31'8","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:24.348206+0000","last_change":"2024-09-12T17:31:24.348206+0000","last_active":"2024-09-12T17:31:24.348206+0000","last_peered":"2024-09-12T17:31:24.348206+0000","last_clean":"2024-09-12T17:31:24.348206+0000","last_became_active":"2024-09-12T17:27:42.427778+0000","last_became_peered":"2024-09-12T17:27:42.427778+0000","last_unstale":"2024-09-12T17:31:24.348206+0000","last_undegraded":"2024-09-12T17:31:24.348206+0000","last_fullsized":"2024-09-12T17:31:24.348206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:24.348117+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:24.348117+0000","last_clean_scrub_stamp":"2024-09-12T17:31:24.348117+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:42.991869+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:23.444668+0000","last_change":"2024-09-12T17:31:23.444668+0000","last_active":"2024-09-12T17:31:23.444668+0000","last_peered":"2024-09-12T17:31:23.444668+0000","last_clean":"2024-09-12T17:31:23.444668+0000","last_became_active":"2024-09-12T17:27:40.418241+0000","last_became_peered":"2024-09-12T17:27:40.418241+0000","last_unstale":"2024-09-12T17:31:23.444668+0000","last_undegraded":"2024-09-12T17:31:23.444668+0000","last_fullsized":"2024-09-12T17:31:23.444668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:23.444583+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:23.444583+0000","last_clean_scrub_stamp":"2024-09-12T17:31:23.444583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:46:46.884073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:22.319225+0000","last_change":"2024-09-12T17:27:42.433339+0000","last_active":"2024-09-12T17:28:22.319225+0000","last_peered":"2024-09-12T17:28:22.319225+0000","last_clean":"2024-09-12T17:28:22.319225+0000","last_became_active":"2024-09-12T17:27:42.433084+0000","last_became_peered":"2024-09-12T17:27:42.433084+0000","last_unstale":"2024-09-12T17:28:22.319225+0000","last_undegraded":"2024-09-12T17:28:22.319225+0000","last_fullsized":"2024-09-12T17:28:22.319225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:14.732392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:07.773832+0000","last_change":"2024-09-12T17:31:07.773832+0000","last_active":"2024-09-12T17:31:07.773832+0000","last_peered":"2024-09-12T17:31:07.773832+0000","last_clean":"2024-09-12T17:31:07.773832+0000","last_became_active":"2024-09-12T17:27:40.417666+0000","last_became_peered":"2024-09-12T17:27:40.417666+0000","last_unstale":"2024-09-12T17:31:07.773832+0000","last_undegraded":"2024-09-12T17:31:07.773832+0000","last_fullsized":"2024-09-12T17:31:07.773832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:07.773746+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:07.773746+0000","last_clean_scrub_stamp":"2024-09-12T17:31:07.773746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:55.901197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"31'8","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:25.906704+0000","last_change":"2024-09-12T17:31:25.906704+0000","last_active":"2024-09-12T17:31:25.906704+0000","last_peered":"2024-09-12T17:31:25.906704+0000","last_clean":"2024-09-12T17:31:25.906704+0000","last_became_active":"2024-09-12T17:27:42.424017+0000","last_became_peered":"2024-09-12T17:27:42.424017+0000","last_unstale":"2024-09-12T17:31:25.906704+0000","last_undegraded":"2024-09-12T17:31:25.906704+0000","last_fullsized":"2024-09-12T17:31:25.906704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:25.906608+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:25.906608+0000","last_clean_scrub_stamp":"2024-09-12T17:31:25.906608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:34.656639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:08.294816+0000","last_change":"2024-09-12T17:31:08.294816+0000","last_active":"2024-09-12T17:31:08.294816+0000","last_peered":"2024-09-12T17:31:08.294816+0000","last_clean":"2024-09-12T17:31:08.294816+0000","last_became_active":"2024-09-12T17:27:40.418964+0000","last_became_peered":"2024-09-12T17:27:40.418964+0000","last_unstale":"2024-09-12T17:31:08.294816+0000","last_undegraded":"2024-09-12T17:31:08.294816+0000","last_fullsized":"2024-09-12T17:31:08.294816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:08.294725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:08.294725+0000","last_clean_scrub_stamp":"2024-09-12T17:31:08.294725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:15.392350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"31'6","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:23.297312+0000","last_change":"2024-09-12T17:31:23.297312+0000","last_active":"2024-09-12T17:31:23.297312+0000","last_peered":"2024-09-12T17:31:23.297312+0000","last_clean":"2024-09-12T17:31:23.297312+0000","last_became_active":"2024-09-12T17:27:42.422955+0000","last_became_peered":"2024-09-12T17:27:42.422955+0000","last_unstale":"2024-09-12T17:31:23.297312+0000","last_undegraded":"2024-09-12T17:31:23.297312+0000","last_fullsized":"2024-09-12T17:31:23.297312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-12T17:31:23.297230+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-12T17:31:23.297230+0000","last_clean_scrub_stamp":"2024-09-12T17:31:23.297230+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:30.245061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:11.276659+0000","last_change":"2024-09-12T17:31:11.276659+0000","last_active":"2024-09-12T17:31:11.276659+0000","last_peered":"2024-09-12T17:31:11.276659+0000","last_clean":"2024-09-12T17:31:11.276659+0000","last_became_active":"2024-09-12T17:27:40.418183+0000","last_became_peered":"2024-09-12T17:27:40.418183+0000","last_unstale":"2024-09-12T17:31:11.276659+0000","last_undegraded":"2024-09-12T17:31:11.276659+0000","last_fullsized":"2024-09-12T17:31:11.276659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.276556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.276556+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.276556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:59.404006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"31'6","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:22.333174+0000","last_change":"2024-09-12T17:31:22.333174+0000","last_active":"2024-09-12T17:31:22.333174+0000","last_peered":"2024-09-12T17:31:22.333174+0000","last_clean":"2024-09-12T17:31:22.333174+0000","last_became_active":"2024-09-12T17:27:42.433856+0000","last_became_peered":"2024-09-12T17:27:42.433856+0000","last_unstale":"2024-09-12T17:31:22.333174+0000","last_undegraded":"2024-09-12T17:31:22.333174+0000","last_fullsized":"2024-09-12T17:31:22.333174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-12T17:31:22.333089+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-12T17:31:22.333089+0000","last_clean_scrub_stamp":"2024-09-12T17:31:22.333089+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:11.543481+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:20.447899+0000","last_change":"2024-09-12T17:31:20.447899+0000","last_active":"2024-09-12T17:31:20.447899+0000","last_peered":"2024-09-12T17:31:20.447899+0000","last_clean":"2024-09-12T17:31:20.447899+0000","last_became_active":"2024-09-12T17:27:40.428213+0000","last_became_peered":"2024-09-12T17:27:40.428213+0000","last_unstale":"2024-09-12T17:31:20.447899+0000","last_undegraded":"2024-09-12T17:31:20.447899+0000","last_fullsized":"2024-09-12T17:31:20.447899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:20.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:20.447796+0000","last_clean_scrub_stamp":"2024-09-12T17:31:20.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:46.194594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"31'4","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:25.320720+0000","last_change":"2024-09-12T17:31:25.320720+0000","last_active":"2024-09-12T17:31:25.320720+0000","last_peered":"2024-09-12T17:31:25.320720+0000","last_clean":"2024-09-12T17:31:25.320720+0000","last_became_active":"2024-09-12T17:27:42.431562+0000","last_became_peered":"2024-09-12T17:27:42.431562+0000","last_unstale":"2024-09-12T17:31:25.320720+0000","last_undegraded":"2024-09-12T17:31:25.320720+0000","last_fullsized":"2024-09-12T17:31:25.320720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:25.320637+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:25.320637+0000","last_clean_scrub_stamp":"2024-09-12T17:31:25.320637+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:21.978461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"31'4","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:21.435534+0000","last_change":"2024-09-12T17:31:21.435534+0000","last_active":"2024-09-12T17:31:21.435534+0000","last_peered":"2024-09-12T17:31:21.435534+0000","last_clean":"2024-09-12T17:31:21.435534+0000","last_became_active":"2024-09-12T17:27:40.425910+0000","last_became_peered":"2024-09-12T17:27:40.425910+0000","last_unstale":"2024-09-12T17:31:21.435534+0000","last_undegraded":"2024-09-12T17:31:21.435534+0000","last_fullsized":"2024-09-12T17:31:21.435534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:21.435416+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:21.435416+0000","last_clean_scrub_stamp":"2024-09-12T17:31:21.435416+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:50.263995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"31'10","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.018646+0000","last_change":"2024-09-12T17:27:42.429554+0000","last_active":"2024-09-12T17:30:50.018646+0000","last_peered":"2024-09-12T17:30:50.018646+0000","last_clean":"2024-09-12T17:30:50.018646+0000","last_became_active":"2024-09-12T17:27:42.429270+0000","last_became_peered":"2024-09-12T17:27:42.429270+0000","last_unstale":"2024-09-12T17:30:50.018646+0000","last_undegraded":"2024-09-12T17:30:50.018646+0000","last_fullsized":"2024-09-12T17:30:50.018646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:41.405642+0000","last_clean_scrub_stamp":"2024-09-12T17:27:41.405642+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:32.810941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:11.107395+0000","last_change":"2024-09-12T17:31:11.107395+0000","last_active":"2024-09-12T17:31:11.107395+0000","last_peered":"2024-09-12T17:31:11.107395+0000","last_clean":"2024-09-12T17:31:11.107395+0000","last_became_active":"2024-09-12T17:27:40.431687+0000","last_became_peered":"2024-09-12T17:27:40.431687+0000","last_unstale":"2024-09-12T17:31:11.107395+0000","last_undegraded":"2024-09-12T17:31:11.107395+0000","last_fullsized":"2024-09-12T17:31:11.107395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:11.107302+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:11.107302+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.107302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:52.875838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"31'4","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:21.328105+0000","last_change":"2024-09-12T17:31:21.328105+0000","last_active":"2024-09-12T17:31:21.328105+0000","last_peered":"2024-09-12T17:31:21.328105+0000","last_clean":"2024-09-12T17:31:21.328105+0000","last_became_active":"2024-09-12T17:27:42.424910+0000","last_became_peered":"2024-09-12T17:27:42.424910+0000","last_unstale":"2024-09-12T17:31:21.328105+0000","last_undegraded":"2024-09-12T17:31:21.328105+0000","last_fullsized":"2024-09-12T17:31:21.328105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:21.328005+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:21.328005+0000","last_clean_scrub_stamp":"2024-09-12T17:31:21.328005+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:38.959884+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:26.570705+0000","last_change":"2024-09-12T17:31:26.570705+0000","last_active":"2024-09-12T17:31:26.570705+0000","last_peered":"2024-09-12T17:31:26.570705+0000","last_clean":"2024-09-12T17:31:26.570705+0000","last_became_active":"2024-09-12T17:27:40.433649+0000","last_became_peered":"2024-09-12T17:27:40.433649+0000","last_unstale":"2024-09-12T17:31:26.570705+0000","last_undegraded":"2024-09-12T17:31:26.570705+0000","last_fullsized":"2024-09-12T17:31:26.570705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:26.570609+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:26.570609+0000","last_clean_scrub_stamp":"2024-09-12T17:31:26.570609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:50.953136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:27.530165+0000","last_change":"2024-09-12T17:31:27.530165+0000","last_active":"2024-09-12T17:31:27.530165+0000","last_peered":"2024-09-12T17:31:27.530165+0000","last_clean":"2024-09-12T17:31:27.530165+0000","last_became_active":"2024-09-12T17:27:40.423343+0000","last_became_peered":"2024-09-12T17:27:40.423343+0000","last_unstale":"2024-09-12T17:31:27.530165+0000","last_undegraded":"2024-09-12T17:31:27.530165+0000","last_fullsized":"2024-09-12T17:31:27.530165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:27.530082+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:27.530082+0000","last_clean_scrub_stamp":"2024-09-12T17:31:27.530082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:50.850315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"31'8","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:27.881064+0000","last_change":"2024-09-12T17:31:27.881064+0000","last_active":"2024-09-12T17:31:27.881064+0000","last_peered":"2024-09-12T17:31:27.881064+0000","last_clean":"2024-09-12T17:31:27.881064+0000","last_became_active":"2024-09-12T17:27:42.426150+0000","last_became_peered":"2024-09-12T17:27:42.426150+0000","last_unstale":"2024-09-12T17:31:27.881064+0000","last_undegraded":"2024-09-12T17:31:27.881064+0000","last_fullsized":"2024-09-12T17:31:27.881064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:27.880963+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:27.880963+0000","last_clean_scrub_stamp":"2024-09-12T17:31:27.880963+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:19.026284+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:10.897255+0000","last_change":"2024-09-12T17:31:10.897255+0000","last_active":"2024-09-12T17:31:10.897255+0000","last_peered":"2024-09-12T17:31:10.897255+0000","last_clean":"2024-09-12T17:31:10.897255+0000","last_became_active":"2024-09-12T17:27:40.420396+0000","last_became_peered":"2024-09-12T17:27:40.420396+0000","last_unstale":"2024-09-12T17:31:10.897255+0000","last_undegraded":"2024-09-12T17:31:10.897255+0000","last_fullsized":"2024-09-12T17:31:10.897255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:10.897168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:10.897168+0000","last_clean_scrub_stamp":"2024-09-12T17:31:10.897168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:17.103760+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:29.307191+0000","last_change":"2024-09-12T17:31:29.307191+0000","last_active":"2024-09-12T17:31:29.307191+0000","last_peered":"2024-09-12T17:31:29.307191+0000","last_clean":"2024-09-12T17:31:29.307191+0000","last_became_active":"2024-09-12T17:27:42.435324+0000","last_became_peered":"2024-09-12T17:27:42.435324+0000","last_unstale":"2024-09-12T17:31:29.307191+0000","last_undegraded":"2024-09-12T17:31:29.307191+0000","last_fullsized":"2024-09-12T17:31:29.307191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:29.307110+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:29.307110+0000","last_clean_scrub_stamp":"2024-09-12T17:31:29.307110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:55.863554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1042,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1419,"ondisk_log_size":1419,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":482,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1662,"num_read_kb":1552,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":481,"ondisk_log_size":481,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673015,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":446464,"data_stored":134267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705718,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":983040,"data_stored":724195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705718,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1007616,"data_stored":723592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705719,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31588,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340252,"statfs":{"total":96636764160,"available":96604418048,"internally_reserved":0,"allocated":413696,"data_stored":134210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:31:42.337 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.337 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.337 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.337 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.338 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.338 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.338 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.338 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.338 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.338 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.338 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.339 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.339 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.339 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.339 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.339 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.339 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.339 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.340 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.340 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.340 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.340 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.340 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.340 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.340 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.341 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.341 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.341 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.341 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.341 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.341 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.341 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.341 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.342 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.342 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.342 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.342 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.342 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.342 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.342 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.342 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.343 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.343 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.343 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.343 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.343 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.343 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.343 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.343 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.344 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.344 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.344 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.344 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.344 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.344 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.344 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.345 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.345 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.345 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.345 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.345 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.345 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.345 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.345 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.346 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.346 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.346 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.346 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.346 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.346 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.346 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.346 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.347 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.347 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.347 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.347 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.347 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.347 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.347 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T17:27:43.410381+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.348 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.348 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.348 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.348 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.348 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.348 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.348 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.349 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.349 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.349 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.349 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.349 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.349 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.349 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.349 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.350 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.350 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.350 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.350 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.350 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.350 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.350 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.351 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.351 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.351 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.351 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.351 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T17:27:41.405642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:31:42.351 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T17:32:02.353 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:32:02.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.468+0000 7fc001fda640 1 Processor -- start 2024-09-12T17:32:02.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.468+0000 7fc001fda640 1 -- start start 2024-09-12T17:32:02.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.468+0000 7fc001fda640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbffc130270 0x7fbffc132660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:32:02.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.468+0000 7fc001fda640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbffc06dc00 con 0x7fbffc129d80 2024-09-12T17:32:02.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.468+0000 7fc001fda640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fbffc1299c0 con 0x7fbffc130270 2024-09-12T17:32:02.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.468+0000 7fbffb7fe640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fbffc129d80 0x7fbffc12a160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:33728/0 (socket says 172.21.15.47:33728) 2024-09-12T17:32:02.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.469+0000 7fbffb7fe640 1 -- 172.21.15.47:0/1610602542 learned_addr learned my addr 172.21.15.47:0/1610602542 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-09-12T17:32:02.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.469+0000 7fbffaffd640 1 --2- 172.21.15.47:0/1610602542 >> v2:172.21.15.47:3300/0 conn(0x7fbffc130270 0x7fbffc132660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:32:02.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.469+0000 7fbffaffd640 1 -- 172.21.15.47:0/1610602542 >> v1:172.21.15.47:6789/0 conn(0x7fbffc129d80 legacy=0x7fbffc12a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:32:02.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.469+0000 7fbffaffd640 1 -- 172.21.15.47:0/1610602542 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbffc12a870 con 0x7fbffc130270 2024-09-12T17:32:02.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.470+0000 7fbffaffd640 1 --2- 172.21.15.47:0/1610602542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbffc130270 0x7fbffc132660 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fbff0009720 tx=0x7fbff002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83117ec6d6f08add server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:32:02.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.470+0000 7fbffa7fc640 1 -- 172.21.15.47:0/1610602542 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbff0037070 con 0x7fbffc130270 2024-09-12T17:32:02.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.470+0000 7fbffa7fc640 1 -- 172.21.15.47:0/1610602542 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbff002ad90 con 0x7fbffc130270 2024-09-12T17:32:02.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.470+0000 7fbffa7fc640 1 -- 172.21.15.47:0/1610602542 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbff0032590 con 0x7fbffc130270 2024-09-12T17:32:02.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.470+0000 7fc001fda640 1 -- 172.21.15.47:0/1610602542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbffc130270 msgr2=0x7fbffc132660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:32:02.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.470+0000 7fc001fda640 1 --2- 172.21.15.47:0/1610602542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbffc130270 0x7fbffc132660 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fbff0009720 tx=0x7fbff002a110 comp rx=0 tx=0).stop 2024-09-12T17:32:02.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.470+0000 7fc001fda640 1 -- 172.21.15.47:0/1610602542 shutdown_connections 2024-09-12T17:32:02.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.470+0000 7fc001fda640 1 --2- 172.21.15.47:0/1610602542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbffc130270 0x7fbffc132660 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:32:02.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.470+0000 7fc001fda640 1 -- 172.21.15.47:0/1610602542 >> 172.21.15.47:0/1610602542 conn(0x7fbffc070850 msgr2=0x7fbffc072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:32:02.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.470+0000 7fc001fda640 1 -- 172.21.15.47:0/1610602542 shutdown_connections 2024-09-12T17:32:02.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.470+0000 7fc001fda640 1 -- 172.21.15.47:0/1610602542 wait complete. 2024-09-12T17:32:02.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.471+0000 7fc001fda640 1 Processor -- start 2024-09-12T17:32:02.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.471+0000 7fc001fda640 1 -- start start 2024-09-12T17:32:02.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.472+0000 7fc001fda640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbffc129d80 0x7fbffc115770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:32:02.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.472+0000 7fc001fda640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbffc073a10 con 0x7fbffc129d80 2024-09-12T17:32:02.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.472+0000 7fbffb7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbffc129d80 0x7fbffc115770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:32:02.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.472+0000 7fbffb7fe640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbffc129d80 0x7fbffc115770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54510/0 (socket says 172.21.15.47:54510) 2024-09-12T17:32:02.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.472+0000 7fbffb7fe640 1 -- 172.21.15.47:0/2357024419 learned_addr learned my addr 172.21.15.47:0/2357024419 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:32:02.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.472+0000 7fbffb7fe640 1 -- 172.21.15.47:0/2357024419 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbffc118a50 con 0x7fbffc129d80 2024-09-12T17:32:02.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.472+0000 7fbffb7fe640 1 --2- 172.21.15.47:0/2357024419 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbffc129d80 0x7fbffc115770 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fbfec00c480 tx=0x7fbfec00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:32:02.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.473+0000 7fbfe3fff640 1 -- 172.21.15.47:0/2357024419 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfec017070 con 0x7fbffc129d80 2024-09-12T17:32:02.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.473+0000 7fbfe3fff640 1 -- 172.21.15.47:0/2357024419 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfec005c10 con 0x7fbffc129d80 2024-09-12T17:32:02.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.473+0000 7fc001fda640 1 -- 172.21.15.47:0/2357024419 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbffc1276b0 con 0x7fbffc129d80 2024-09-12T17:32:02.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.473+0000 7fbfe3fff640 1 -- 172.21.15.47:0/2357024419 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfec007070 con 0x7fbffc129d80 2024-09-12T17:32:02.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.473+0000 7fc001fda640 1 -- 172.21.15.47:0/2357024419 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbffc115e90 con 0x7fbffc129d80 2024-09-12T17:32:02.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.474+0000 7fbfe3fff640 1 -- 172.21.15.47:0/2357024419 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fbfec01a070 con 0x7fbffc129d80 2024-09-12T17:32:02.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.474+0000 7fc001fda640 1 -- 172.21.15.47:0/2357024419 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbffc12a160 con 0x7fbffc129d80 2024-09-12T17:32:02.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.474+0000 7fbfe3fff640 1 --2- 172.21.15.47:0/2357024419 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbfe803de90 0x7fbfe8040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:32:02.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.474+0000 7fbfe3fff640 1 -- 172.21.15.47:0/2357024419 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fbfec051e00 con 0x7fbffc129d80 2024-09-12T17:32:02.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.475+0000 7fbffaffd640 1 --2- 172.21.15.47:0/2357024419 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbfe803de90 0x7fbfe8040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:32:02.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.475+0000 7fbffaffd640 1 --2- 172.21.15.47:0/2357024419 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbfe803de90 0x7fbfe8040350 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fbff0034000 tx=0x7fbff002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:32:02.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.479+0000 7fbfe3fff640 1 -- 172.21.15.47:0/2357024419 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7fbfec01ac60 con 0x7fbffc129d80 2024-09-12T17:32:02.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.660+0000 7fc001fda640 1 -- 172.21.15.47:0/2357024419 --> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbffc117650 con 0x7fbfe803de90 2024-09-12T17:32:02.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.670+0000 7fbfe3fff640 1 -- 172.21.15.47:0/2357024419 <== mgr.4102 v2:172.21.15.170:6824/4146902489 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665712 (secure 0 0 0) 0x7fbffc117650 con 0x7fbfe803de90 2024-09-12T17:32:02.681 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:32:02.687 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-09-12T17:32:02.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.675+0000 7fc001fda640 1 -- 172.21.15.47:0/2357024419 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbfe803de90 msgr2=0x7fbfe8040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:32:02.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.675+0000 7fc001fda640 1 --2- 172.21.15.47:0/2357024419 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbfe803de90 0x7fbfe8040350 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fbff0034000 tx=0x7fbff002e000 comp rx=0 tx=0).stop 2024-09-12T17:32:02.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.675+0000 7fc001fda640 1 -- 172.21.15.47:0/2357024419 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbffc129d80 msgr2=0x7fbffc115770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:32:02.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.675+0000 7fc001fda640 1 --2- 172.21.15.47:0/2357024419 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbffc129d80 0x7fbffc115770 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fbfec00c480 tx=0x7fbfec00c940 comp rx=0 tx=0).stop 2024-09-12T17:32:02.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.675+0000 7fc001fda640 1 -- 172.21.15.47:0/2357024419 shutdown_connections 2024-09-12T17:32:02.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.675+0000 7fc001fda640 1 --2- 172.21.15.47:0/2357024419 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fbfe803de90 0x7fbfe8040350 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:32:02.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.675+0000 7fc001fda640 1 --2- 172.21.15.47:0/2357024419 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbffc129d80 0x7fbffc115770 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:32:02.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.675+0000 7fc001fda640 1 -- 172.21.15.47:0/2357024419 >> 172.21.15.47:0/2357024419 conn(0x7fbffc070850 msgr2=0x7fbffc1284b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:32:02.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.675+0000 7fc001fda640 1 -- 172.21.15.47:0/2357024419 shutdown_connections 2024-09-12T17:32:02.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:02.675+0000 7fc001fda640 1 -- 172.21.15.47:0/2357024419 wait complete. 2024-09-12T17:32:02.691 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":167,"stamp":"2024-09-12T17:32:01.814491+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5127,"num_read_kb":4717,"num_write":2121,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":482,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2079,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4737,"ondisk_log_size":4737,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":115040,"kb_used_data":2784,"kb_used_omap":6,"kb_used_meta":112185,"kb_avail":377372320,"statfs":{"total":386547056640,"available":386429255680,"internally_reserved":0,"allocated":2850816,"data_stored":1716264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":114878230},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":743,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004076"},"pg_stats":[{"pgid":"3.3f","version":"31'2","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:15.167665+0000","last_change":"2024-09-12T17:31:15.167597+0000","last_active":"2024-09-12T17:31:15.167665+0000","last_peered":"2024-09-12T17:31:15.167665+0000","last_clean":"2024-09-12T17:31:15.167665+0000","last_became_active":"2024-09-12T17:28:21.473004+0000","last_became_peered":"2024-09-12T17:28:21.473004+0000","last_unstale":"2024-09-12T17:31:15.167665+0000","last_undegraded":"2024-09-12T17:31:15.167665+0000","last_fullsized":"2024-09-12T17:31:15.167665+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:15.167516+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:15.167516+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.167516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:41.949425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"31'2","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:30.347524+0000","last_change":"2024-09-12T17:31:30.347524+0000","last_active":"2024-09-12T17:31:30.347524+0000","last_peered":"2024-09-12T17:31:30.347524+0000","last_clean":"2024-09-12T17:31:30.347524+0000","last_became_active":"2024-09-12T17:27:42.433207+0000","last_became_peered":"2024-09-12T17:27:42.433207+0000","last_unstale":"2024-09-12T17:31:30.347524+0000","last_undegraded":"2024-09-12T17:31:30.347524+0000","last_fullsized":"2024-09-12T17:31:30.347524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:30.347428+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:30.347428+0000","last_clean_scrub_stamp":"2024-09-12T17:31:30.347428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:21.492749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:13.893011+0000","last_change":"2024-09-12T17:31:13.892956+0000","last_active":"2024-09-12T17:31:13.893011+0000","last_peered":"2024-09-12T17:31:13.893011+0000","last_clean":"2024-09-12T17:31:13.893011+0000","last_became_active":"2024-09-12T17:27:40.418928+0000","last_became_peered":"2024-09-12T17:27:40.418928+0000","last_unstale":"2024-09-12T17:31:13.893011+0000","last_undegraded":"2024-09-12T17:31:13.893011+0000","last_fullsized":"2024-09-12T17:31:13.893011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:13.892860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:13.892860+0000","last_clean_scrub_stamp":"2024-09-12T17:31:13.892860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:59.577514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"31'6","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:42.521828+0000","last_change":"2024-09-12T17:31:42.521828+0000","last_active":"2024-09-12T17:31:42.521828+0000","last_peered":"2024-09-12T17:31:42.521828+0000","last_clean":"2024-09-12T17:31:42.521828+0000","last_became_active":"2024-09-12T17:27:42.432677+0000","last_became_peered":"2024-09-12T17:27:42.432677+0000","last_unstale":"2024-09-12T17:31:42.521828+0000","last_undegraded":"2024-09-12T17:31:42.521828+0000","last_fullsized":"2024-09-12T17:31:42.521828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-12T17:31:42.521720+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-12T17:31:42.521720+0000","last_clean_scrub_stamp":"2024-09-12T17:31:42.521720+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:00.076710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:30.548231+0000","last_change":"2024-09-12T17:31:30.548169+0000","last_active":"2024-09-12T17:31:30.548231+0000","last_peered":"2024-09-12T17:31:30.548231+0000","last_clean":"2024-09-12T17:31:30.548231+0000","last_became_active":"2024-09-12T17:27:40.433470+0000","last_became_peered":"2024-09-12T17:27:40.433470+0000","last_unstale":"2024-09-12T17:31:30.548231+0000","last_undegraded":"2024-09-12T17:31:30.548231+0000","last_fullsized":"2024-09-12T17:31:30.548231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:30.548084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:30.548084+0000","last_clean_scrub_stamp":"2024-09-12T17:31:30.548084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:09.304175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"31'8","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:44.472937+0000","last_change":"2024-09-12T17:31:44.472937+0000","last_active":"2024-09-12T17:31:44.472937+0000","last_peered":"2024-09-12T17:31:44.472937+0000","last_clean":"2024-09-12T17:31:44.472937+0000","last_became_active":"2024-09-12T17:27:42.432736+0000","last_became_peered":"2024-09-12T17:27:42.432736+0000","last_unstale":"2024-09-12T17:31:44.472937+0000","last_undegraded":"2024-09-12T17:31:44.472937+0000","last_fullsized":"2024-09-12T17:31:44.472937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:44.472839+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:44.472839+0000","last_clean_scrub_stamp":"2024-09-12T17:31:44.472839+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:00.405274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"31'8","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:14.164926+0000","last_change":"2024-09-12T17:31:14.164859+0000","last_active":"2024-09-12T17:31:14.164926+0000","last_peered":"2024-09-12T17:31:14.164926+0000","last_clean":"2024-09-12T17:31:14.164926+0000","last_became_active":"2024-09-12T17:27:40.426649+0000","last_became_peered":"2024-09-12T17:27:40.426649+0000","last_unstale":"2024-09-12T17:31:14.164926+0000","last_undegraded":"2024-09-12T17:31:14.164926+0000","last_fullsized":"2024-09-12T17:31:14.164926+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:14.164764+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:14.164764+0000","last_clean_scrub_stamp":"2024-09-12T17:31:14.164764+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:53.065552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":18,"num_write":56,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"31'8","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:45.517276+0000","last_change":"2024-09-12T17:31:45.517276+0000","last_active":"2024-09-12T17:31:45.517276+0000","last_peered":"2024-09-12T17:31:45.517276+0000","last_clean":"2024-09-12T17:31:45.517276+0000","last_became_active":"2024-09-12T17:27:42.418517+0000","last_became_peered":"2024-09-12T17:27:42.418517+0000","last_unstale":"2024-09-12T17:31:45.517276+0000","last_undegraded":"2024-09-12T17:31:45.517276+0000","last_fullsized":"2024-09-12T17:31:45.517276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:45.517161+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:45.517161+0000","last_clean_scrub_stamp":"2024-09-12T17:31:45.517161+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:53.551953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:24.485763+0000","last_change":"2024-09-12T17:31:24.485763+0000","last_active":"2024-09-12T17:31:24.485763+0000","last_peered":"2024-09-12T17:31:24.485763+0000","last_clean":"2024-09-12T17:31:24.485763+0000","last_became_active":"2024-09-12T17:27:40.424978+0000","last_became_peered":"2024-09-12T17:27:40.424978+0000","last_unstale":"2024-09-12T17:31:24.485763+0000","last_undegraded":"2024-09-12T17:31:24.485763+0000","last_fullsized":"2024-09-12T17:31:24.485763+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:24.485659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:24.485659+0000","last_clean_scrub_stamp":"2024-09-12T17:31:24.485659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:57.212649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"31'16","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:31.349661+0000","last_change":"2024-09-12T17:31:31.349593+0000","last_active":"2024-09-12T17:31:31.349661+0000","last_peered":"2024-09-12T17:31:31.349661+0000","last_clean":"2024-09-12T17:31:31.349661+0000","last_became_active":"2024-09-12T17:27:42.423906+0000","last_became_peered":"2024-09-12T17:27:42.423906+0000","last_unstale":"2024-09-12T17:31:31.349661+0000","last_undegraded":"2024-09-12T17:31:31.349661+0000","last_fullsized":"2024-09-12T17:31:31.349661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'16","last_scrub_stamp":"2024-09-12T17:31:31.349474+0000","last_deep_scrub":"31'16","last_deep_scrub_stamp":"2024-09-12T17:31:31.349474+0000","last_clean_scrub_stamp":"2024-09-12T17:31:31.349474+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:12.460742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:12.104894+0000","last_change":"2024-09-12T17:31:12.104894+0000","last_active":"2024-09-12T17:31:12.104894+0000","last_peered":"2024-09-12T17:31:12.104894+0000","last_clean":"2024-09-12T17:31:12.104894+0000","last_became_active":"2024-09-12T17:27:40.425308+0000","last_became_peered":"2024-09-12T17:27:40.425308+0000","last_unstale":"2024-09-12T17:31:12.104894+0000","last_undegraded":"2024-09-12T17:31:12.104894+0000","last_fullsized":"2024-09-12T17:31:12.104894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:12.104802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:12.104802+0000","last_clean_scrub_stamp":"2024-09-12T17:31:12.104802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:46.519276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"29'2","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:50.469293+0000","last_change":"2024-09-12T17:31:50.469234+0000","last_active":"2024-09-12T17:31:50.469293+0000","last_peered":"2024-09-12T17:31:50.469293+0000","last_clean":"2024-09-12T17:31:50.469293+0000","last_became_active":"2024-09-12T17:27:42.428137+0000","last_became_peered":"2024-09-12T17:27:42.428137+0000","last_unstale":"2024-09-12T17:31:50.469293+0000","last_undegraded":"2024-09-12T17:31:50.469293+0000","last_fullsized":"2024-09-12T17:31:50.469293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-12T17:31:50.469138+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-12T17:31:50.469138+0000","last_clean_scrub_stamp":"2024-09-12T17:31:50.469138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:27.400201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'4","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:25.524102+0000","last_change":"2024-09-12T17:31:25.524102+0000","last_active":"2024-09-12T17:31:25.524102+0000","last_peered":"2024-09-12T17:31:25.524102+0000","last_clean":"2024-09-12T17:31:25.524102+0000","last_became_active":"2024-09-12T17:27:40.426778+0000","last_became_peered":"2024-09-12T17:27:40.426778+0000","last_unstale":"2024-09-12T17:31:25.524102+0000","last_undegraded":"2024-09-12T17:31:25.524102+0000","last_fullsized":"2024-09-12T17:31:25.524102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:25.524021+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:25.524021+0000","last_clean_scrub_stamp":"2024-09-12T17:31:25.524021+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:28.696346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"31'18","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:28.212504+0000","last_change":"2024-09-12T17:31:28.212438+0000","last_active":"2024-09-12T17:31:28.212504+0000","last_peered":"2024-09-12T17:31:28.212504+0000","last_clean":"2024-09-12T17:31:28.212504+0000","last_became_active":"2024-09-12T17:27:42.434042+0000","last_became_peered":"2024-09-12T17:27:42.434042+0000","last_unstale":"2024-09-12T17:31:28.212504+0000","last_undegraded":"2024-09-12T17:31:28.212504+0000","last_fullsized":"2024-09-12T17:31:28.212504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'18","last_scrub_stamp":"2024-09-12T17:31:28.212358+0000","last_deep_scrub":"31'18","last_deep_scrub_stamp":"2024-09-12T17:31:28.212358+0000","last_clean_scrub_stamp":"2024-09-12T17:31:28.212358+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:13.897013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":56,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:12.847582+0000","last_change":"2024-09-12T17:31:12.847582+0000","last_active":"2024-09-12T17:31:12.847582+0000","last_peered":"2024-09-12T17:31:12.847582+0000","last_clean":"2024-09-12T17:31:12.847582+0000","last_became_active":"2024-09-12T17:27:40.418512+0000","last_became_peered":"2024-09-12T17:27:40.418512+0000","last_unstale":"2024-09-12T17:31:12.847582+0000","last_undegraded":"2024-09-12T17:31:12.847582+0000","last_fullsized":"2024-09-12T17:31:12.847582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:12.847495+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:12.847495+0000","last_clean_scrub_stamp":"2024-09-12T17:31:12.847495+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:57.086545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"31'8","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:30.206280+0000","last_change":"2024-09-12T17:31:30.206222+0000","last_active":"2024-09-12T17:31:30.206280+0000","last_peered":"2024-09-12T17:31:30.206280+0000","last_clean":"2024-09-12T17:31:30.206280+0000","last_became_active":"2024-09-12T17:27:42.436159+0000","last_became_peered":"2024-09-12T17:27:42.436159+0000","last_unstale":"2024-09-12T17:31:30.206280+0000","last_undegraded":"2024-09-12T17:31:30.206280+0000","last_fullsized":"2024-09-12T17:31:30.206280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:30.206128+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:30.206128+0000","last_clean_scrub_stamp":"2024-09-12T17:31:30.206128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:56.693996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"31'4","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:43.498350+0000","last_change":"2024-09-12T17:31:43.498350+0000","last_active":"2024-09-12T17:31:43.498350+0000","last_peered":"2024-09-12T17:31:43.498350+0000","last_clean":"2024-09-12T17:31:43.498350+0000","last_became_active":"2024-09-12T17:27:42.433425+0000","last_became_peered":"2024-09-12T17:27:42.433425+0000","last_unstale":"2024-09-12T17:31:43.498350+0000","last_undegraded":"2024-09-12T17:31:43.498350+0000","last_fullsized":"2024-09-12T17:31:43.498350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:43.498234+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:43.498234+0000","last_clean_scrub_stamp":"2024-09-12T17:31:43.498234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:55.272591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:13.316703+0000","last_change":"2024-09-12T17:31:13.316703+0000","last_active":"2024-09-12T17:31:13.316703+0000","last_peered":"2024-09-12T17:31:13.316703+0000","last_clean":"2024-09-12T17:31:13.316703+0000","last_became_active":"2024-09-12T17:27:40.415650+0000","last_became_peered":"2024-09-12T17:27:40.415650+0000","last_unstale":"2024-09-12T17:31:13.316703+0000","last_undegraded":"2024-09-12T17:31:13.316703+0000","last_fullsized":"2024-09-12T17:31:13.316703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:13.316616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:13.316616+0000","last_clean_scrub_stamp":"2024-09-12T17:31:13.316616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:05.300957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:26.339465+0000","last_change":"2024-09-12T17:31:26.339465+0000","last_active":"2024-09-12T17:31:26.339465+0000","last_peered":"2024-09-12T17:31:26.339465+0000","last_clean":"2024-09-12T17:31:26.339465+0000","last_became_active":"2024-09-12T17:27:42.427700+0000","last_became_peered":"2024-09-12T17:27:42.427700+0000","last_unstale":"2024-09-12T17:31:26.339465+0000","last_undegraded":"2024-09-12T17:31:26.339465+0000","last_fullsized":"2024-09-12T17:31:26.339465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:26.339370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:26.339370+0000","last_clean_scrub_stamp":"2024-09-12T17:31:26.339370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:03.318523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:13.154171+0000","last_change":"2024-09-12T17:31:13.154171+0000","last_active":"2024-09-12T17:31:13.154171+0000","last_peered":"2024-09-12T17:31:13.154171+0000","last_clean":"2024-09-12T17:31:13.154171+0000","last_became_active":"2024-09-12T17:27:40.432033+0000","last_became_peered":"2024-09-12T17:27:40.432033+0000","last_unstale":"2024-09-12T17:31:13.154171+0000","last_undegraded":"2024-09-12T17:31:13.154171+0000","last_fullsized":"2024-09-12T17:31:13.154171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:13.154091+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:13.154091+0000","last_clean_scrub_stamp":"2024-09-12T17:31:13.154091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:49:12.833133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:27.303000+0000","last_change":"2024-09-12T17:31:27.303000+0000","last_active":"2024-09-12T17:31:27.303000+0000","last_peered":"2024-09-12T17:31:27.303000+0000","last_clean":"2024-09-12T17:31:27.303000+0000","last_became_active":"2024-09-12T17:27:42.428492+0000","last_became_peered":"2024-09-12T17:27:42.428492+0000","last_unstale":"2024-09-12T17:31:27.303000+0000","last_undegraded":"2024-09-12T17:31:27.303000+0000","last_fullsized":"2024-09-12T17:31:27.303000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:27.302915+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:27.302915+0000","last_clean_scrub_stamp":"2024-09-12T17:31:27.302915+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:55.284211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"29'2","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:14.354822+0000","last_change":"2024-09-12T17:31:14.354822+0000","last_active":"2024-09-12T17:31:14.354822+0000","last_peered":"2024-09-12T17:31:14.354822+0000","last_clean":"2024-09-12T17:31:14.354822+0000","last_became_active":"2024-09-12T17:28:21.474758+0000","last_became_peered":"2024-09-12T17:28:21.474758+0000","last_unstale":"2024-09-12T17:31:14.354822+0000","last_undegraded":"2024-09-12T17:31:14.354822+0000","last_fullsized":"2024-09-12T17:31:14.354822+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-12T17:31:14.354735+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-12T17:31:14.354735+0000","last_clean_scrub_stamp":"2024-09-12T17:31:14.354735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:06.230735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"31'2","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:26.883823+0000","last_change":"2024-09-12T17:31:26.883823+0000","last_active":"2024-09-12T17:31:26.883823+0000","last_peered":"2024-09-12T17:31:26.883823+0000","last_clean":"2024-09-12T17:31:26.883823+0000","last_became_active":"2024-09-12T17:27:42.424738+0000","last_became_peered":"2024-09-12T17:27:42.424738+0000","last_unstale":"2024-09-12T17:31:26.883823+0000","last_undegraded":"2024-09-12T17:31:26.883823+0000","last_fullsized":"2024-09-12T17:31:26.883823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:26.883725+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:26.883725+0000","last_clean_scrub_stamp":"2024-09-12T17:31:26.883725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:55.999346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:10.251786+0000","last_change":"2024-09-12T17:31:10.251786+0000","last_active":"2024-09-12T17:31:10.251786+0000","last_peered":"2024-09-12T17:31:10.251786+0000","last_clean":"2024-09-12T17:31:10.251786+0000","last_became_active":"2024-09-12T17:27:40.414669+0000","last_became_peered":"2024-09-12T17:27:40.414669+0000","last_unstale":"2024-09-12T17:31:10.251786+0000","last_undegraded":"2024-09-12T17:31:10.251786+0000","last_fullsized":"2024-09-12T17:31:10.251786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:10.251701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:10.251701+0000","last_clean_scrub_stamp":"2024-09-12T17:31:10.251701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:31.254231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"31'8","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:27.238292+0000","last_change":"2024-09-12T17:31:27.238292+0000","last_active":"2024-09-12T17:31:27.238292+0000","last_peered":"2024-09-12T17:31:27.238292+0000","last_clean":"2024-09-12T17:31:27.238292+0000","last_became_active":"2024-09-12T17:27:42.435928+0000","last_became_peered":"2024-09-12T17:27:42.435928+0000","last_unstale":"2024-09-12T17:31:27.238292+0000","last_undegraded":"2024-09-12T17:31:27.238292+0000","last_fullsized":"2024-09-12T17:31:27.238292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:27.238196+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:27.238196+0000","last_clean_scrub_stamp":"2024-09-12T17:31:27.238196+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:11.477246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:11.894841+0000","last_change":"2024-09-12T17:31:11.894841+0000","last_active":"2024-09-12T17:31:11.894841+0000","last_peered":"2024-09-12T17:31:11.894841+0000","last_clean":"2024-09-12T17:31:11.894841+0000","last_became_active":"2024-09-12T17:27:40.419936+0000","last_became_peered":"2024-09-12T17:27:40.419936+0000","last_unstale":"2024-09-12T17:31:11.894841+0000","last_undegraded":"2024-09-12T17:31:11.894841+0000","last_fullsized":"2024-09-12T17:31:11.894841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:11.894749+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:11.894749+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.894749+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:17.780383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"31'6","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:28.322665+0000","last_change":"2024-09-12T17:31:28.322665+0000","last_active":"2024-09-12T17:31:28.322665+0000","last_peered":"2024-09-12T17:31:28.322665+0000","last_clean":"2024-09-12T17:31:28.322665+0000","last_became_active":"2024-09-12T17:27:42.423569+0000","last_became_peered":"2024-09-12T17:27:42.423569+0000","last_unstale":"2024-09-12T17:31:28.322665+0000","last_undegraded":"2024-09-12T17:31:28.322665+0000","last_fullsized":"2024-09-12T17:31:28.322665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-12T17:31:28.322583+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-12T17:31:28.322583+0000","last_clean_scrub_stamp":"2024-09-12T17:31:28.322583+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:37.072614+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:22.482090+0000","last_change":"2024-09-12T17:31:22.482090+0000","last_active":"2024-09-12T17:31:22.482090+0000","last_peered":"2024-09-12T17:31:22.482090+0000","last_clean":"2024-09-12T17:31:22.482090+0000","last_became_active":"2024-09-12T17:27:40.426721+0000","last_became_peered":"2024-09-12T17:27:40.426721+0000","last_unstale":"2024-09-12T17:31:22.482090+0000","last_undegraded":"2024-09-12T17:31:22.482090+0000","last_fullsized":"2024-09-12T17:31:22.482090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:22.481974+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:22.481974+0000","last_clean_scrub_stamp":"2024-09-12T17:31:22.481974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:55.953993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"31'36","reported_seq":109,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:58.185554+0000","last_change":"2024-09-12T17:31:58.185554+0000","last_active":"2024-09-12T17:31:58.185554+0000","last_peered":"2024-09-12T17:31:58.185554+0000","last_clean":"2024-09-12T17:31:58.185554+0000","last_became_active":"2024-09-12T17:27:50.456184+0000","last_became_peered":"2024-09-12T17:27:50.456184+0000","last_unstale":"2024-09-12T17:31:58.185554+0000","last_undegraded":"2024-09-12T17:31:58.185554+0000","last_fullsized":"2024-09-12T17:31:58.185554+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2024-09-12T17:31:58.185466+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2024-09-12T17:31:58.185466+0000","last_clean_scrub_stamp":"2024-09-12T17:31:58.185466+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:51.239821+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:36.387973+0000","last_change":"2024-09-12T17:31:36.387973+0000","last_active":"2024-09-12T17:31:36.387973+0000","last_peered":"2024-09-12T17:31:36.387973+0000","last_clean":"2024-09-12T17:31:36.387973+0000","last_became_active":"2024-09-12T17:27:42.420666+0000","last_became_peered":"2024-09-12T17:27:42.420666+0000","last_unstale":"2024-09-12T17:31:36.387973+0000","last_undegraded":"2024-09-12T17:31:36.387973+0000","last_fullsized":"2024-09-12T17:31:36.387973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:36.387861+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:36.387861+0000","last_clean_scrub_stamp":"2024-09-12T17:31:36.387861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:45.116536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:15.386849+0000","last_change":"2024-09-12T17:31:15.386849+0000","last_active":"2024-09-12T17:31:15.386849+0000","last_peered":"2024-09-12T17:31:15.386849+0000","last_clean":"2024-09-12T17:31:15.386849+0000","last_became_active":"2024-09-12T17:27:40.433044+0000","last_became_peered":"2024-09-12T17:27:40.433044+0000","last_unstale":"2024-09-12T17:31:15.386849+0000","last_undegraded":"2024-09-12T17:31:15.386849+0000","last_fullsized":"2024-09-12T17:31:15.386849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.386742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.386742+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.386742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:15.078612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:54.490500+0000","last_change":"2024-09-12T17:31:54.490500+0000","last_active":"2024-09-12T17:31:54.490500+0000","last_peered":"2024-09-12T17:31:54.490500+0000","last_clean":"2024-09-12T17:31:54.490500+0000","last_became_active":"2024-09-12T17:28:21.472106+0000","last_became_peered":"2024-09-12T17:28:21.472106+0000","last_unstale":"2024-09-12T17:31:54.490500+0000","last_undegraded":"2024-09-12T17:31:54.490500+0000","last_fullsized":"2024-09-12T17:31:54.490500+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:54.490405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:54.490405+0000","last_clean_scrub_stamp":"2024-09-12T17:31:54.490405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:19.790112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"31'33","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.920036+0000","last_change":"2024-09-12T17:27:46.442394+0000","last_active":"2024-09-12T17:30:56.920036+0000","last_peered":"2024-09-12T17:30:56.920036+0000","last_clean":"2024-09-12T17:30:56.920036+0000","last_became_active":"2024-09-12T17:27:46.441891+0000","last_became_peered":"2024-09-12T17:27:46.441891+0000","last_unstale":"2024-09-12T17:30:56.920036+0000","last_undegraded":"2024-09-12T17:30:56.920036+0000","last_fullsized":"2024-09-12T17:30:56.920036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:29.351398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:49.250043+0000","last_change":"2024-09-12T17:31:49.250043+0000","last_active":"2024-09-12T17:31:49.250043+0000","last_peered":"2024-09-12T17:31:49.250043+0000","last_clean":"2024-09-12T17:31:49.250043+0000","last_became_active":"2024-09-12T17:27:48.448078+0000","last_became_peered":"2024-09-12T17:27:48.448078+0000","last_unstale":"2024-09-12T17:31:49.250043+0000","last_undegraded":"2024-09-12T17:31:49.250043+0000","last_fullsized":"2024-09-12T17:31:49.250043+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:49.249951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:49.249951+0000","last_clean_scrub_stamp":"2024-09-12T17:31:49.249951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:59.102237+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"31'7","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:59.228042+0000","last_change":"2024-09-12T17:31:59.228042+0000","last_active":"2024-09-12T17:31:59.228042+0000","last_peered":"2024-09-12T17:31:59.228042+0000","last_clean":"2024-09-12T17:31:59.228042+0000","last_became_active":"2024-09-12T17:27:50.457037+0000","last_became_peered":"2024-09-12T17:27:50.457037+0000","last_unstale":"2024-09-12T17:31:59.228042+0000","last_undegraded":"2024-09-12T17:31:59.228042+0000","last_fullsized":"2024-09-12T17:31:59.228042+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'7","last_scrub_stamp":"2024-09-12T17:31:59.227925+0000","last_deep_scrub":"31'7","last_deep_scrub_stamp":"2024-09-12T17:31:59.227925+0000","last_clean_scrub_stamp":"2024-09-12T17:31:59.227925+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:58.614798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:35.433441+0000","last_change":"2024-09-12T17:31:35.433441+0000","last_active":"2024-09-12T17:31:35.433441+0000","last_peered":"2024-09-12T17:31:35.433441+0000","last_clean":"2024-09-12T17:31:35.433441+0000","last_became_active":"2024-09-12T17:27:42.427872+0000","last_became_peered":"2024-09-12T17:27:42.427872+0000","last_unstale":"2024-09-12T17:31:35.433441+0000","last_undegraded":"2024-09-12T17:31:35.433441+0000","last_fullsized":"2024-09-12T17:31:35.433441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:35.433325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:35.433325+0000","last_clean_scrub_stamp":"2024-09-12T17:31:35.433325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:14.341661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:06.079744+0000","last_change":"2024-09-12T17:31:06.079744+0000","last_active":"2024-09-12T17:31:06.079744+0000","last_peered":"2024-09-12T17:31:06.079744+0000","last_clean":"2024-09-12T17:31:06.079744+0000","last_became_active":"2024-09-12T17:27:40.430969+0000","last_became_peered":"2024-09-12T17:27:40.430969+0000","last_unstale":"2024-09-12T17:31:06.079744+0000","last_undegraded":"2024-09-12T17:31:06.079744+0000","last_fullsized":"2024-09-12T17:31:06.079744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:06.079660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:06.079660+0000","last_clean_scrub_stamp":"2024-09-12T17:31:06.079660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:37.732174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:34.891676+0000","last_change":"2024-09-12T17:31:34.891676+0000","last_active":"2024-09-12T17:31:34.891676+0000","last_peered":"2024-09-12T17:31:34.891676+0000","last_clean":"2024-09-12T17:31:34.891676+0000","last_became_active":"2024-09-12T17:27:44.427560+0000","last_became_peered":"2024-09-12T17:27:44.427560+0000","last_unstale":"2024-09-12T17:31:34.891676+0000","last_undegraded":"2024-09-12T17:31:34.891676+0000","last_fullsized":"2024-09-12T17:31:34.891676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:34.891583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:34.891583+0000","last_clean_scrub_stamp":"2024-09-12T17:31:34.891583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:39.698964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"31'9","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:44.202804+0000","last_change":"2024-09-12T17:31:44.202804+0000","last_active":"2024-09-12T17:31:44.202804+0000","last_peered":"2024-09-12T17:31:44.202804+0000","last_clean":"2024-09-12T17:31:44.202804+0000","last_became_active":"2024-09-12T17:27:46.436065+0000","last_became_peered":"2024-09-12T17:27:46.436065+0000","last_unstale":"2024-09-12T17:31:44.202804+0000","last_undegraded":"2024-09-12T17:31:44.202804+0000","last_fullsized":"2024-09-12T17:31:44.202804+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'9","last_scrub_stamp":"2024-09-12T17:31:44.202702+0000","last_deep_scrub":"31'9","last_deep_scrub_stamp":"2024-09-12T17:31:44.202702+0000","last_clean_scrub_stamp":"2024-09-12T17:31:44.202702+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:36.305048+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:50.273274+0000","last_change":"2024-09-12T17:31:50.273274+0000","last_active":"2024-09-12T17:31:50.273274+0000","last_peered":"2024-09-12T17:31:50.273274+0000","last_clean":"2024-09-12T17:31:50.273274+0000","last_became_active":"2024-09-12T17:27:48.441192+0000","last_became_peered":"2024-09-12T17:27:48.441192+0000","last_unstale":"2024-09-12T17:31:50.273274+0000","last_undegraded":"2024-09-12T17:31:50.273274+0000","last_fullsized":"2024-09-12T17:31:50.273274+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:50.273191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:50.273191+0000","last_clean_scrub_stamp":"2024-09-12T17:31:50.273191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:58.027939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"29'2","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.470752+0000","last_change":"2024-09-12T17:27:50.451886+0000","last_active":"2024-09-12T17:28:21.470752+0000","last_peered":"2024-09-12T17:28:21.470752+0000","last_clean":"2024-09-12T17:28:21.470752+0000","last_became_active":"2024-09-12T17:27:50.451589+0000","last_became_peered":"2024-09-12T17:27:50.451589+0000","last_unstale":"2024-09-12T17:28:21.470752+0000","last_undegraded":"2024-09-12T17:28:21.470752+0000","last_fullsized":"2024-09-12T17:28:21.470752+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:53.513569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"31'8","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:39.517731+0000","last_change":"2024-09-12T17:31:39.517731+0000","last_active":"2024-09-12T17:31:39.517731+0000","last_peered":"2024-09-12T17:31:39.517731+0000","last_clean":"2024-09-12T17:31:39.517731+0000","last_became_active":"2024-09-12T17:27:42.426402+0000","last_became_peered":"2024-09-12T17:27:42.426402+0000","last_unstale":"2024-09-12T17:31:39.517731+0000","last_undegraded":"2024-09-12T17:31:39.517731+0000","last_fullsized":"2024-09-12T17:31:39.517731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:39.517638+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:39.517638+0000","last_clean_scrub_stamp":"2024-09-12T17:31:39.517638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:39.295946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:11.412979+0000","last_change":"2024-09-12T17:31:11.412979+0000","last_active":"2024-09-12T17:31:11.412979+0000","last_peered":"2024-09-12T17:31:11.412979+0000","last_clean":"2024-09-12T17:31:11.412979+0000","last_became_active":"2024-09-12T17:27:40.427860+0000","last_became_peered":"2024-09-12T17:27:40.427860+0000","last_unstale":"2024-09-12T17:31:11.412979+0000","last_undegraded":"2024-09-12T17:31:11.412979+0000","last_fullsized":"2024-09-12T17:31:11.412979+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:11.412886+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:11.412886+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.412886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:55.973064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:33.930387+0000","last_change":"2024-09-12T17:31:33.930387+0000","last_active":"2024-09-12T17:31:33.930387+0000","last_peered":"2024-09-12T17:31:33.930387+0000","last_clean":"2024-09-12T17:31:33.930387+0000","last_became_active":"2024-09-12T17:27:44.430879+0000","last_became_peered":"2024-09-12T17:27:44.430879+0000","last_unstale":"2024-09-12T17:31:33.930387+0000","last_undegraded":"2024-09-12T17:31:33.930387+0000","last_fullsized":"2024-09-12T17:31:33.930387+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:33.930301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:33.930301+0000","last_clean_scrub_stamp":"2024-09-12T17:31:33.930301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:21.439880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"31'15","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:42.207431+0000","last_change":"2024-09-12T17:31:42.207431+0000","last_active":"2024-09-12T17:31:42.207431+0000","last_peered":"2024-09-12T17:31:42.207431+0000","last_clean":"2024-09-12T17:31:42.207431+0000","last_became_active":"2024-09-12T17:27:46.440203+0000","last_became_peered":"2024-09-12T17:27:46.440203+0000","last_unstale":"2024-09-12T17:31:42.207431+0000","last_undegraded":"2024-09-12T17:31:42.207431+0000","last_fullsized":"2024-09-12T17:31:42.207431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'15","last_scrub_stamp":"2024-09-12T17:31:42.207339+0000","last_deep_scrub":"31'15","last_deep_scrub_stamp":"2024-09-12T17:31:42.207339+0000","last_clean_scrub_stamp":"2024-09-12T17:31:42.207339+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:23.318607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"31'285","reported_seq":408,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.776362+0000","last_change":"2024-09-12T17:27:48.451526+0000","last_active":"2024-09-12T17:30:56.776362+0000","last_peered":"2024-09-12T17:30:56.776362+0000","last_clean":"2024-09-12T17:30:56.776362+0000","last_became_active":"2024-09-12T17:27:48.450897+0000","last_became_peered":"2024-09-12T17:27:48.450897+0000","last_unstale":"2024-09-12T17:30:56.776362+0000","last_undegraded":"2024-09-12T17:30:56.776362+0000","last_fullsized":"2024-09-12T17:30:56.776362+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:24.867772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:55.276749+0000","last_change":"2024-09-12T17:31:55.276749+0000","last_active":"2024-09-12T17:31:55.276749+0000","last_peered":"2024-09-12T17:31:55.276749+0000","last_clean":"2024-09-12T17:31:55.276749+0000","last_became_active":"2024-09-12T17:27:50.456376+0000","last_became_peered":"2024-09-12T17:27:50.456376+0000","last_unstale":"2024-09-12T17:31:55.276749+0000","last_undegraded":"2024-09-12T17:31:55.276749+0000","last_fullsized":"2024-09-12T17:31:55.276749+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:55.276668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:55.276668+0000","last_clean_scrub_stamp":"2024-09-12T17:31:55.276668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:22.077233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"31'12","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:18.820795+0000","last_change":"2024-09-12T17:31:18.820795+0000","last_active":"2024-09-12T17:31:18.820795+0000","last_peered":"2024-09-12T17:31:18.820795+0000","last_clean":"2024-09-12T17:31:18.820795+0000","last_became_active":"2024-09-12T17:27:42.426060+0000","last_became_peered":"2024-09-12T17:27:42.426060+0000","last_unstale":"2024-09-12T17:31:18.820795+0000","last_undegraded":"2024-09-12T17:31:18.820795+0000","last_fullsized":"2024-09-12T17:31:18.820795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-09-12T17:31:18.820697+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-09-12T17:31:18.820697+0000","last_clean_scrub_stamp":"2024-09-12T17:31:18.820697+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:36.452576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:02.411977+0000","last_change":"2024-09-12T17:31:02.411977+0000","last_active":"2024-09-12T17:31:02.411977+0000","last_peered":"2024-09-12T17:31:02.411977+0000","last_clean":"2024-09-12T17:31:02.411977+0000","last_became_active":"2024-09-12T17:27:40.415702+0000","last_became_peered":"2024-09-12T17:27:40.415702+0000","last_unstale":"2024-09-12T17:31:02.411977+0000","last_undegraded":"2024-09-12T17:31:02.411977+0000","last_fullsized":"2024-09-12T17:31:02.411977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:02.411854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:02.411854+0000","last_clean_scrub_stamp":"2024-09-12T17:31:02.411854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:49:02.090895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:56.514565+0000","last_change":"2024-09-12T17:31:56.514565+0000","last_active":"2024-09-12T17:31:56.514565+0000","last_peered":"2024-09-12T17:31:56.514565+0000","last_clean":"2024-09-12T17:31:56.514565+0000","last_became_active":"2024-09-12T17:27:44.428526+0000","last_became_peered":"2024-09-12T17:27:44.428526+0000","last_unstale":"2024-09-12T17:31:56.514565+0000","last_undegraded":"2024-09-12T17:31:56.514565+0000","last_fullsized":"2024-09-12T17:31:56.514565+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:56.514483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:56.514483+0000","last_clean_scrub_stamp":"2024-09-12T17:31:56.514483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:10.869206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"31'37","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:43.169088+0000","last_change":"2024-09-12T17:31:43.169088+0000","last_active":"2024-09-12T17:31:43.169088+0000","last_peered":"2024-09-12T17:31:43.169088+0000","last_clean":"2024-09-12T17:31:43.169088+0000","last_became_active":"2024-09-12T17:27:46.440765+0000","last_became_peered":"2024-09-12T17:27:46.440765+0000","last_unstale":"2024-09-12T17:31:43.169088+0000","last_undegraded":"2024-09-12T17:31:43.169088+0000","last_fullsized":"2024-09-12T17:31:43.169088+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2024-09-12T17:31:43.168991+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2024-09-12T17:31:43.168991+0000","last_clean_scrub_stamp":"2024-09-12T17:31:43.168991+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:43.089499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"31'286","reported_seq":448,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:49.037938+0000","last_change":"2024-09-12T17:31:49.037938+0000","last_active":"2024-09-12T17:31:49.037938+0000","last_peered":"2024-09-12T17:31:49.037938+0000","last_clean":"2024-09-12T17:31:49.037938+0000","last_became_active":"2024-09-12T17:27:48.439642+0000","last_became_peered":"2024-09-12T17:27:48.439642+0000","last_unstale":"2024-09-12T17:31:49.037938+0000","last_undegraded":"2024-09-12T17:31:49.037938+0000","last_fullsized":"2024-09-12T17:31:49.037938+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'286","last_scrub_stamp":"2024-09-12T17:31:49.037839+0000","last_deep_scrub":"31'286","last_deep_scrub_stamp":"2024-09-12T17:31:49.037839+0000","last_clean_scrub_stamp":"2024-09-12T17:31:49.037839+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:34:11.064004+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"31'12","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:32.536913+0000","last_change":"2024-09-12T17:31:32.536913+0000","last_active":"2024-09-12T17:31:32.536913+0000","last_peered":"2024-09-12T17:31:32.536913+0000","last_clean":"2024-09-12T17:31:32.536913+0000","last_became_active":"2024-09-12T17:27:42.427990+0000","last_became_peered":"2024-09-12T17:27:42.427990+0000","last_unstale":"2024-09-12T17:31:32.536913+0000","last_undegraded":"2024-09-12T17:31:32.536913+0000","last_fullsized":"2024-09-12T17:31:32.536913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-09-12T17:31:32.536801+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-09-12T17:31:32.536801+0000","last_clean_scrub_stamp":"2024-09-12T17:31:32.536801+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:58.780921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"29'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:05.090851+0000","last_change":"2024-09-12T17:31:05.090851+0000","last_active":"2024-09-12T17:31:05.090851+0000","last_peered":"2024-09-12T17:31:05.090851+0000","last_clean":"2024-09-12T17:31:05.090851+0000","last_became_active":"2024-09-12T17:27:40.428462+0000","last_became_peered":"2024-09-12T17:27:40.428462+0000","last_unstale":"2024-09-12T17:31:05.090851+0000","last_undegraded":"2024-09-12T17:31:05.090851+0000","last_fullsized":"2024-09-12T17:31:05.090851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-12T17:31:05.090744+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-12T17:31:05.090744+0000","last_clean_scrub_stamp":"2024-09-12T17:31:05.090744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:12.385812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:32.302755+0000","last_change":"2024-09-12T17:31:32.302755+0000","last_active":"2024-09-12T17:31:32.302755+0000","last_peered":"2024-09-12T17:31:32.302755+0000","last_clean":"2024-09-12T17:31:32.302755+0000","last_became_active":"2024-09-12T17:27:44.431911+0000","last_became_peered":"2024-09-12T17:27:44.431911+0000","last_unstale":"2024-09-12T17:31:32.302755+0000","last_undegraded":"2024-09-12T17:31:32.302755+0000","last_fullsized":"2024-09-12T17:31:32.302755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:32.302660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:32.302660+0000","last_clean_scrub_stamp":"2024-09-12T17:31:32.302660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:32.223168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"31'53","reported_seq":113,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:39.122513+0000","last_change":"2024-09-12T17:31:39.122513+0000","last_active":"2024-09-12T17:31:39.122513+0000","last_peered":"2024-09-12T17:31:39.122513+0000","last_clean":"2024-09-12T17:31:39.122513+0000","last_became_active":"2024-09-12T17:27:46.439188+0000","last_became_peered":"2024-09-12T17:27:46.439188+0000","last_unstale":"2024-09-12T17:31:39.122513+0000","last_undegraded":"2024-09-12T17:31:39.122513+0000","last_fullsized":"2024-09-12T17:31:39.122513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'53","last_scrub_stamp":"2024-09-12T17:31:39.122418+0000","last_deep_scrub":"31'53","last_deep_scrub_stamp":"2024-09-12T17:31:39.122418+0000","last_clean_scrub_stamp":"2024-09-12T17:31:39.122418+0000","objects_scrubbed":9,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:47.872448+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:58.152535+0000","last_change":"2024-09-12T17:31:58.152535+0000","last_active":"2024-09-12T17:31:58.152535+0000","last_peered":"2024-09-12T17:31:58.152535+0000","last_clean":"2024-09-12T17:31:58.152535+0000","last_became_active":"2024-09-12T17:27:48.441618+0000","last_became_peered":"2024-09-12T17:27:48.441618+0000","last_unstale":"2024-09-12T17:31:58.152535+0000","last_undegraded":"2024-09-12T17:31:58.152535+0000","last_fullsized":"2024-09-12T17:31:58.152535+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:58.152443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:58.152443+0000","last_clean_scrub_stamp":"2024-09-12T17:31:58.152443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:10.503764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"31'7","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:53.281735+0000","last_change":"2024-09-12T17:31:53.281651+0000","last_active":"2024-09-12T17:31:53.281735+0000","last_peered":"2024-09-12T17:31:53.281735+0000","last_clean":"2024-09-12T17:31:53.281735+0000","last_became_active":"2024-09-12T17:27:50.457350+0000","last_became_peered":"2024-09-12T17:27:50.457350+0000","last_unstale":"2024-09-12T17:31:53.281735+0000","last_undegraded":"2024-09-12T17:31:53.281735+0000","last_fullsized":"2024-09-12T17:31:53.281735+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'7","last_scrub_stamp":"2024-09-12T17:31:53.281555+0000","last_deep_scrub":"31'7","last_deep_scrub_stamp":"2024-09-12T17:31:53.281555+0000","last_clean_scrub_stamp":"2024-09-12T17:31:53.281555+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:15.825245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"31'20","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:15.343990+0000","last_change":"2024-09-12T17:31:15.343990+0000","last_active":"2024-09-12T17:31:15.343990+0000","last_peered":"2024-09-12T17:31:15.343990+0000","last_clean":"2024-09-12T17:31:15.343990+0000","last_became_active":"2024-09-12T17:27:42.424268+0000","last_became_peered":"2024-09-12T17:27:42.424268+0000","last_unstale":"2024-09-12T17:31:15.343990+0000","last_undegraded":"2024-09-12T17:31:15.343990+0000","last_fullsized":"2024-09-12T17:31:15.343990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'20","last_scrub_stamp":"2024-09-12T17:31:15.343895+0000","last_deep_scrub":"31'20","last_deep_scrub_stamp":"2024-09-12T17:31:15.343895+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.343895+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:21.229528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":75,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:02.018708+0000","last_change":"2024-09-12T17:31:02.018708+0000","last_active":"2024-09-12T17:31:02.018708+0000","last_peered":"2024-09-12T17:31:02.018708+0000","last_clean":"2024-09-12T17:31:02.018708+0000","last_became_active":"2024-09-12T17:27:40.427677+0000","last_became_peered":"2024-09-12T17:27:40.427677+0000","last_unstale":"2024-09-12T17:31:02.018708+0000","last_undegraded":"2024-09-12T17:31:02.018708+0000","last_fullsized":"2024-09-12T17:31:02.018708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:02.018612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:02.018612+0000","last_clean_scrub_stamp":"2024-09-12T17:31:02.018612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:03.467671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:29.829824+0000","last_change":"2024-09-12T17:31:29.829824+0000","last_active":"2024-09-12T17:31:29.829824+0000","last_peered":"2024-09-12T17:31:29.829824+0000","last_clean":"2024-09-12T17:31:29.829824+0000","last_became_active":"2024-09-12T17:27:44.434433+0000","last_became_peered":"2024-09-12T17:27:44.434433+0000","last_unstale":"2024-09-12T17:31:29.829824+0000","last_undegraded":"2024-09-12T17:31:29.829824+0000","last_fullsized":"2024-09-12T17:31:29.829824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:29.829730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:29.829730+0000","last_clean_scrub_stamp":"2024-09-12T17:31:29.829730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:14.124471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"31'33","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.874071+0000","last_change":"2024-09-12T17:27:46.442854+0000","last_active":"2024-09-12T17:30:56.874071+0000","last_peered":"2024-09-12T17:30:56.874071+0000","last_clean":"2024-09-12T17:30:56.874071+0000","last_became_active":"2024-09-12T17:27:46.442572+0000","last_became_peered":"2024-09-12T17:27:46.442572+0000","last_unstale":"2024-09-12T17:30:56.874071+0000","last_undegraded":"2024-09-12T17:30:56.874071+0000","last_fullsized":"2024-09-12T17:30:56.874071+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:49.755366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:48.064289+0000","last_change":"2024-09-12T17:31:48.064289+0000","last_active":"2024-09-12T17:31:48.064289+0000","last_peered":"2024-09-12T17:31:48.064289+0000","last_clean":"2024-09-12T17:31:48.064289+0000","last_became_active":"2024-09-12T17:27:48.445502+0000","last_became_peered":"2024-09-12T17:27:48.445502+0000","last_unstale":"2024-09-12T17:31:48.064289+0000","last_undegraded":"2024-09-12T17:31:48.064289+0000","last_fullsized":"2024-09-12T17:31:48.064289+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:48.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:48.064186+0000","last_clean_scrub_stamp":"2024-09-12T17:31:48.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:55.818934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"31'11","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:53.304691+0000","last_change":"2024-09-12T17:31:53.304576+0000","last_active":"2024-09-12T17:31:53.304691+0000","last_peered":"2024-09-12T17:31:53.304691+0000","last_clean":"2024-09-12T17:31:53.304691+0000","last_became_active":"2024-09-12T17:27:50.457691+0000","last_became_peered":"2024-09-12T17:27:50.457691+0000","last_unstale":"2024-09-12T17:31:53.304691+0000","last_undegraded":"2024-09-12T17:31:53.304691+0000","last_fullsized":"2024-09-12T17:31:53.304691+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'11","last_scrub_stamp":"2024-09-12T17:31:53.304462+0000","last_deep_scrub":"31'11","last_deep_scrub_stamp":"2024-09-12T17:31:53.304462+0000","last_clean_scrub_stamp":"2024-09-12T17:31:53.304462+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:54.162201+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":23,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"31'7","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:19.207381+0000","last_change":"2024-09-12T17:31:19.207381+0000","last_active":"2024-09-12T17:31:19.207381+0000","last_peered":"2024-09-12T17:31:19.207381+0000","last_clean":"2024-09-12T17:31:19.207381+0000","last_became_active":"2024-09-12T17:27:42.436517+0000","last_became_peered":"2024-09-12T17:27:42.436517+0000","last_unstale":"2024-09-12T17:31:19.207381+0000","last_undegraded":"2024-09-12T17:31:19.207381+0000","last_fullsized":"2024-09-12T17:31:19.207381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'7","last_scrub_stamp":"2024-09-12T17:31:19.207291+0000","last_deep_scrub":"31'7","last_deep_scrub_stamp":"2024-09-12T17:31:19.207291+0000","last_clean_scrub_stamp":"2024-09-12T17:31:19.207291+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:26.304916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:10.389482+0000","last_change":"2024-09-12T17:31:10.389482+0000","last_active":"2024-09-12T17:31:10.389482+0000","last_peered":"2024-09-12T17:31:10.389482+0000","last_clean":"2024-09-12T17:31:10.389482+0000","last_became_active":"2024-09-12T17:27:40.429663+0000","last_became_peered":"2024-09-12T17:27:40.429663+0000","last_unstale":"2024-09-12T17:31:10.389482+0000","last_undegraded":"2024-09-12T17:31:10.389482+0000","last_fullsized":"2024-09-12T17:31:10.389482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:10.389388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:10.389388+0000","last_clean_scrub_stamp":"2024-09-12T17:31:10.389388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:20.668432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:36.870675+0000","last_change":"2024-09-12T17:31:36.870675+0000","last_active":"2024-09-12T17:31:36.870675+0000","last_peered":"2024-09-12T17:31:36.870675+0000","last_clean":"2024-09-12T17:31:36.870675+0000","last_became_active":"2024-09-12T17:27:44.430772+0000","last_became_peered":"2024-09-12T17:27:44.430772+0000","last_unstale":"2024-09-12T17:31:36.870675+0000","last_undegraded":"2024-09-12T17:31:36.870675+0000","last_fullsized":"2024-09-12T17:31:36.870675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:36.870579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:36.870579+0000","last_clean_scrub_stamp":"2024-09-12T17:31:36.870579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:47.799822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"31'40","reported_seq":90,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.833856+0000","last_change":"2024-09-12T17:27:46.444540+0000","last_active":"2024-09-12T17:30:56.833856+0000","last_peered":"2024-09-12T17:30:56.833856+0000","last_clean":"2024-09-12T17:30:56.833856+0000","last_became_active":"2024-09-12T17:27:46.444206+0000","last_became_peered":"2024-09-12T17:27:46.444206+0000","last_unstale":"2024-09-12T17:30:56.833856+0000","last_undegraded":"2024-09-12T17:30:56.833856+0000","last_fullsized":"2024-09-12T17:30:56.833856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:06.613276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"31'286","reported_seq":410,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:45.012737+0000","last_change":"2024-09-12T17:31:45.012737+0000","last_active":"2024-09-12T17:31:45.012737+0000","last_peered":"2024-09-12T17:31:45.012737+0000","last_clean":"2024-09-12T17:31:45.012737+0000","last_became_active":"2024-09-12T17:27:48.447724+0000","last_became_peered":"2024-09-12T17:27:48.447724+0000","last_unstale":"2024-09-12T17:31:45.012737+0000","last_undegraded":"2024-09-12T17:31:45.012737+0000","last_fullsized":"2024-09-12T17:31:45.012737+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'286","last_scrub_stamp":"2024-09-12T17:31:45.012653+0000","last_deep_scrub":"31'286","last_deep_scrub_stamp":"2024-09-12T17:31:45.012653+0000","last_clean_scrub_stamp":"2024-09-12T17:31:45.012653+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:11.878520+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"31'4","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:55.160166+0000","last_change":"2024-09-12T17:31:55.160166+0000","last_active":"2024-09-12T17:31:55.160166+0000","last_peered":"2024-09-12T17:31:55.160166+0000","last_clean":"2024-09-12T17:31:55.160166+0000","last_became_active":"2024-09-12T17:27:50.451716+0000","last_became_peered":"2024-09-12T17:27:50.451716+0000","last_unstale":"2024-09-12T17:31:55.160166+0000","last_undegraded":"2024-09-12T17:31:55.160166+0000","last_fullsized":"2024-09-12T17:31:55.160166+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:55.160079+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:55.160079+0000","last_clean_scrub_stamp":"2024-09-12T17:31:55.160079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:53:48.158349+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"31'4","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:18.197113+0000","last_change":"2024-09-12T17:31:18.197113+0000","last_active":"2024-09-12T17:31:18.197113+0000","last_peered":"2024-09-12T17:31:18.197113+0000","last_clean":"2024-09-12T17:31:18.197113+0000","last_became_active":"2024-09-12T17:27:42.429624+0000","last_became_peered":"2024-09-12T17:27:42.429624+0000","last_unstale":"2024-09-12T17:31:18.197113+0000","last_undegraded":"2024-09-12T17:31:18.197113+0000","last_fullsized":"2024-09-12T17:31:18.197113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:18.197003+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:18.197003+0000","last_clean_scrub_stamp":"2024-09-12T17:31:18.197003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:31:53.642094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:12.393232+0000","last_change":"2024-09-12T17:31:12.393232+0000","last_active":"2024-09-12T17:31:12.393232+0000","last_peered":"2024-09-12T17:31:12.393232+0000","last_clean":"2024-09-12T17:31:12.393232+0000","last_became_active":"2024-09-12T17:27:40.423291+0000","last_became_peered":"2024-09-12T17:27:40.423291+0000","last_unstale":"2024-09-12T17:31:12.393232+0000","last_undegraded":"2024-09-12T17:31:12.393232+0000","last_fullsized":"2024-09-12T17:31:12.393232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:12.393115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:12.393115+0000","last_clean_scrub_stamp":"2024-09-12T17:31:12.393115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:06.951305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:28.877883+0000","last_change":"2024-09-12T17:31:28.877883+0000","last_active":"2024-09-12T17:31:28.877883+0000","last_peered":"2024-09-12T17:31:28.877883+0000","last_clean":"2024-09-12T17:31:28.877883+0000","last_became_active":"2024-09-12T17:27:44.430549+0000","last_became_peered":"2024-09-12T17:27:44.430549+0000","last_unstale":"2024-09-12T17:31:28.877883+0000","last_undegraded":"2024-09-12T17:31:28.877883+0000","last_fullsized":"2024-09-12T17:31:28.877883+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:28.877789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:28.877789+0000","last_clean_scrub_stamp":"2024-09-12T17:31:28.877789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:38.715807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"31'67","reported_seq":140,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:00.538682+0000","last_change":"2024-09-12T17:32:00.538682+0000","last_active":"2024-09-12T17:32:00.538682+0000","last_peered":"2024-09-12T17:32:00.538682+0000","last_clean":"2024-09-12T17:32:00.538682+0000","last_became_active":"2024-09-12T17:27:46.440805+0000","last_became_peered":"2024-09-12T17:27:46.440805+0000","last_unstale":"2024-09-12T17:32:00.538682+0000","last_undegraded":"2024-09-12T17:32:00.538682+0000","last_fullsized":"2024-09-12T17:32:00.538682+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'67","last_scrub_stamp":"2024-09-12T17:32:00.538575+0000","last_deep_scrub":"31'67","last_deep_scrub_stamp":"2024-09-12T17:32:00.538575+0000","last_clean_scrub_stamp":"2024-09-12T17:32:00.538575+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:05.569873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":65,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:52.146732+0000","last_change":"2024-09-12T17:31:52.146732+0000","last_active":"2024-09-12T17:31:52.146732+0000","last_peered":"2024-09-12T17:31:52.146732+0000","last_clean":"2024-09-12T17:31:52.146732+0000","last_became_active":"2024-09-12T17:27:48.442880+0000","last_became_peered":"2024-09-12T17:27:48.442880+0000","last_unstale":"2024-09-12T17:31:52.146732+0000","last_undegraded":"2024-09-12T17:31:52.146732+0000","last_fullsized":"2024-09-12T17:31:52.146732+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:52.146643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:52.146643+0000","last_clean_scrub_stamp":"2024-09-12T17:31:52.146643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:38.895711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"31'23","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:56.120828+0000","last_change":"2024-09-12T17:31:56.120828+0000","last_active":"2024-09-12T17:31:56.120828+0000","last_peered":"2024-09-12T17:31:56.120828+0000","last_clean":"2024-09-12T17:31:56.120828+0000","last_became_active":"2024-09-12T17:27:50.454410+0000","last_became_peered":"2024-09-12T17:27:50.454410+0000","last_unstale":"2024-09-12T17:31:56.120828+0000","last_undegraded":"2024-09-12T17:31:56.120828+0000","last_fullsized":"2024-09-12T17:31:56.120828+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'23","last_scrub_stamp":"2024-09-12T17:31:56.120744+0000","last_deep_scrub":"31'23","last_deep_scrub_stamp":"2024-09-12T17:31:56.120744+0000","last_clean_scrub_stamp":"2024-09-12T17:31:56.120744+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:49.175099+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"31'10","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:16.297952+0000","last_change":"2024-09-12T17:31:16.297952+0000","last_active":"2024-09-12T17:31:16.297952+0000","last_peered":"2024-09-12T17:31:16.297952+0000","last_clean":"2024-09-12T17:31:16.297952+0000","last_became_active":"2024-09-12T17:27:42.435913+0000","last_became_peered":"2024-09-12T17:27:42.435913+0000","last_unstale":"2024-09-12T17:31:16.297952+0000","last_undegraded":"2024-09-12T17:31:16.297952+0000","last_fullsized":"2024-09-12T17:31:16.297952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-12T17:31:16.297850+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-12T17:31:16.297850+0000","last_clean_scrub_stamp":"2024-09-12T17:31:16.297850+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:00.536900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:09.860489+0000","last_change":"2024-09-12T17:31:09.860489+0000","last_active":"2024-09-12T17:31:09.860489+0000","last_peered":"2024-09-12T17:31:09.860489+0000","last_clean":"2024-09-12T17:31:09.860489+0000","last_became_active":"2024-09-12T17:27:40.415703+0000","last_became_peered":"2024-09-12T17:27:40.415703+0000","last_unstale":"2024-09-12T17:31:09.860489+0000","last_undegraded":"2024-09-12T17:31:09.860489+0000","last_fullsized":"2024-09-12T17:31:09.860489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:09.860396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:09.860396+0000","last_clean_scrub_stamp":"2024-09-12T17:31:09.860396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:27.321941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:31.156349+0000","last_change":"2024-09-12T17:31:31.156349+0000","last_active":"2024-09-12T17:31:31.156349+0000","last_peered":"2024-09-12T17:31:31.156349+0000","last_clean":"2024-09-12T17:31:31.156349+0000","last_became_active":"2024-09-12T17:27:44.432588+0000","last_became_peered":"2024-09-12T17:27:44.432588+0000","last_unstale":"2024-09-12T17:31:31.156349+0000","last_undegraded":"2024-09-12T17:31:31.156349+0000","last_fullsized":"2024-09-12T17:31:31.156349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:31.156264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:31.156264+0000","last_clean_scrub_stamp":"2024-09-12T17:31:31.156264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:46.128476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"31'40","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:43.253053+0000","last_change":"2024-09-12T17:31:43.253053+0000","last_active":"2024-09-12T17:31:43.253053+0000","last_peered":"2024-09-12T17:31:43.253053+0000","last_clean":"2024-09-12T17:31:43.253053+0000","last_became_active":"2024-09-12T17:27:46.432354+0000","last_became_peered":"2024-09-12T17:27:46.432354+0000","last_unstale":"2024-09-12T17:31:43.253053+0000","last_undegraded":"2024-09-12T17:31:43.253053+0000","last_fullsized":"2024-09-12T17:31:43.253053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'40","last_scrub_stamp":"2024-09-12T17:31:43.252950+0000","last_deep_scrub":"31'40","last_deep_scrub_stamp":"2024-09-12T17:31:43.252950+0000","last_clean_scrub_stamp":"2024-09-12T17:31:43.252950+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:37.973626+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466117+0000","last_change":"2024-09-12T17:27:48.451776+0000","last_active":"2024-09-12T17:28:21.466117+0000","last_peered":"2024-09-12T17:28:21.466117+0000","last_clean":"2024-09-12T17:28:21.466117+0000","last_became_active":"2024-09-12T17:27:48.451510+0000","last_became_peered":"2024-09-12T17:27:48.451510+0000","last_unstale":"2024-09-12T17:28:21.466117+0000","last_undegraded":"2024-09-12T17:28:21.466117+0000","last_fullsized":"2024-09-12T17:28:21.466117+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:01.787546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"31'7","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:50.284929+0000","last_change":"2024-09-12T17:27:50.455419+0000","last_active":"2024-09-12T17:30:50.284929+0000","last_peered":"2024-09-12T17:30:50.284929+0000","last_clean":"2024-09-12T17:30:50.284929+0000","last_became_active":"2024-09-12T17:27:50.454890+0000","last_became_peered":"2024-09-12T17:27:50.454890+0000","last_unstale":"2024-09-12T17:30:50.284929+0000","last_undegraded":"2024-09-12T17:30:50.284929+0000","last_fullsized":"2024-09-12T17:30:50.284929+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"31'8","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:33.513178+0000","last_change":"2024-09-12T17:31:33.513178+0000","last_active":"2024-09-12T17:31:33.513178+0000","last_peered":"2024-09-12T17:31:33.513178+0000","last_clean":"2024-09-12T17:31:33.513178+0000","last_became_active":"2024-09-12T17:27:42.440204+0000","last_became_peered":"2024-09-12T17:27:42.440204+0000","last_unstale":"2024-09-12T17:31:33.513178+0000","last_undegraded":"2024-09-12T17:31:33.513178+0000","last_fullsized":"2024-09-12T17:31:33.513178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:33.513094+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:33.513094+0000","last_clean_scrub_stamp":"2024-09-12T17:31:33.513094+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:57.471769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:09.348952+0000","last_change":"2024-09-12T17:31:09.348825+0000","last_active":"2024-09-12T17:31:09.348952+0000","last_peered":"2024-09-12T17:31:09.348952+0000","last_clean":"2024-09-12T17:31:09.348952+0000","last_became_active":"2024-09-12T17:27:40.428232+0000","last_became_peered":"2024-09-12T17:27:40.428232+0000","last_unstale":"2024-09-12T17:31:09.348952+0000","last_undegraded":"2024-09-12T17:31:09.348952+0000","last_fullsized":"2024-09-12T17:31:09.348952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:09.348730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:09.348730+0000","last_clean_scrub_stamp":"2024-09-12T17:31:09.348730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:20.262551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:31.879020+0000","last_change":"2024-09-12T17:31:31.879020+0000","last_active":"2024-09-12T17:31:31.879020+0000","last_peered":"2024-09-12T17:31:31.879020+0000","last_clean":"2024-09-12T17:31:31.879020+0000","last_became_active":"2024-09-12T17:27:44.432211+0000","last_became_peered":"2024-09-12T17:27:44.432211+0000","last_unstale":"2024-09-12T17:31:31.879020+0000","last_undegraded":"2024-09-12T17:31:31.879020+0000","last_fullsized":"2024-09-12T17:31:31.879020+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:31.878931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:31.878931+0000","last_clean_scrub_stamp":"2024-09-12T17:31:31.878931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:53:23.177009+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"31'46","reported_seq":104,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:40.157807+0000","last_change":"2024-09-12T17:31:40.157807+0000","last_active":"2024-09-12T17:31:40.157807+0000","last_peered":"2024-09-12T17:31:40.157807+0000","last_clean":"2024-09-12T17:31:40.157807+0000","last_became_active":"2024-09-12T17:27:46.433672+0000","last_became_peered":"2024-09-12T17:27:46.433672+0000","last_unstale":"2024-09-12T17:31:40.157807+0000","last_undegraded":"2024-09-12T17:31:40.157807+0000","last_fullsized":"2024-09-12T17:31:40.157807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2024-09-12T17:31:40.157697+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2024-09-12T17:31:40.157697+0000","last_clean_scrub_stamp":"2024-09-12T17:31:40.157697+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:06.714141+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"31'286","reported_seq":416,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:46.212968+0000","last_change":"2024-09-12T17:31:46.212968+0000","last_active":"2024-09-12T17:31:46.212968+0000","last_peered":"2024-09-12T17:31:46.212968+0000","last_clean":"2024-09-12T17:31:46.212968+0000","last_became_active":"2024-09-12T17:27:48.440335+0000","last_became_peered":"2024-09-12T17:27:48.440335+0000","last_unstale":"2024-09-12T17:31:46.212968+0000","last_undegraded":"2024-09-12T17:31:46.212968+0000","last_fullsized":"2024-09-12T17:31:46.212968+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'286","last_scrub_stamp":"2024-09-12T17:31:46.212875+0000","last_deep_scrub":"31'286","last_deep_scrub_stamp":"2024-09-12T17:31:46.212875+0000","last_clean_scrub_stamp":"2024-09-12T17:31:46.212875+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:55.088066+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"31'13","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:53.165093+0000","last_change":"2024-09-12T17:31:53.165033+0000","last_active":"2024-09-12T17:31:53.165093+0000","last_peered":"2024-09-12T17:31:53.165093+0000","last_clean":"2024-09-12T17:31:53.165093+0000","last_became_active":"2024-09-12T17:27:50.448680+0000","last_became_peered":"2024-09-12T17:27:50.448680+0000","last_unstale":"2024-09-12T17:31:53.165093+0000","last_undegraded":"2024-09-12T17:31:53.165093+0000","last_fullsized":"2024-09-12T17:31:53.165093+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'13","last_scrub_stamp":"2024-09-12T17:31:53.164949+0000","last_deep_scrub":"31'13","last_deep_scrub_stamp":"2024-09-12T17:31:53.164949+0000","last_clean_scrub_stamp":"2024-09-12T17:31:53.164949+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:13.457431+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:20.187884+0000","last_change":"2024-09-12T17:31:20.187884+0000","last_active":"2024-09-12T17:31:20.187884+0000","last_peered":"2024-09-12T17:31:20.187884+0000","last_clean":"2024-09-12T17:31:20.187884+0000","last_became_active":"2024-09-12T17:28:21.472744+0000","last_became_peered":"2024-09-12T17:28:21.472744+0000","last_unstale":"2024-09-12T17:31:20.187884+0000","last_undegraded":"2024-09-12T17:31:20.187884+0000","last_fullsized":"2024-09-12T17:31:20.187884+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:20.187750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:20.187750+0000","last_clean_scrub_stamp":"2024-09-12T17:31:20.187750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:19.507199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:08.306145+0000","last_change":"2024-09-12T17:31:08.306087+0000","last_active":"2024-09-12T17:31:08.306145+0000","last_peered":"2024-09-12T17:31:08.306145+0000","last_clean":"2024-09-12T17:31:08.306145+0000","last_became_active":"2024-09-12T17:27:40.428512+0000","last_became_peered":"2024-09-12T17:27:40.428512+0000","last_unstale":"2024-09-12T17:31:08.306145+0000","last_undegraded":"2024-09-12T17:31:08.306145+0000","last_fullsized":"2024-09-12T17:31:08.306145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:08.306000+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:08.306000+0000","last_clean_scrub_stamp":"2024-09-12T17:31:08.306000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:33.492014+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'5","reported_seq":428,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:34.315174+0000","last_change":"2024-09-12T17:31:34.315174+0000","last_active":"2024-09-12T17:31:34.315174+0000","last_peered":"2024-09-12T17:31:34.315174+0000","last_clean":"2024-09-12T17:31:34.315174+0000","last_became_active":"2024-09-12T17:27:44.429844+0000","last_became_peered":"2024-09-12T17:27:44.429844+0000","last_unstale":"2024-09-12T17:31:34.315174+0000","last_undegraded":"2024-09-12T17:31:34.315174+0000","last_fullsized":"2024-09-12T17:31:34.315174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-09-12T17:31:34.315074+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-09-12T17:31:34.315074+0000","last_clean_scrub_stamp":"2024-09-12T17:31:34.315074+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:53:25.613152+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464478+0000","last_change":"2024-09-12T17:27:46.439449+0000","last_active":"2024-09-12T17:28:21.464478+0000","last_peered":"2024-09-12T17:28:21.464478+0000","last_clean":"2024-09-12T17:28:21.464478+0000","last_became_active":"2024-09-12T17:27:46.439153+0000","last_became_peered":"2024-09-12T17:27:46.439153+0000","last_unstale":"2024-09-12T17:28:21.464478+0000","last_undegraded":"2024-09-12T17:28:21.464478+0000","last_fullsized":"2024-09-12T17:28:21.464478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:53.118909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"31'286","reported_seq":472,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:46.205541+0000","last_change":"2024-09-12T17:31:46.205541+0000","last_active":"2024-09-12T17:31:46.205541+0000","last_peered":"2024-09-12T17:31:46.205541+0000","last_clean":"2024-09-12T17:31:46.205541+0000","last_became_active":"2024-09-12T17:27:48.441024+0000","last_became_peered":"2024-09-12T17:27:48.441024+0000","last_unstale":"2024-09-12T17:31:46.205541+0000","last_undegraded":"2024-09-12T17:31:46.205541+0000","last_fullsized":"2024-09-12T17:31:46.205541+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'286","last_scrub_stamp":"2024-09-12T17:31:46.205451+0000","last_deep_scrub":"31'286","last_deep_scrub_stamp":"2024-09-12T17:31:46.205451+0000","last_clean_scrub_stamp":"2024-09-12T17:31:46.205451+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:06.332116+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'4","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:51.282731+0000","last_change":"2024-09-12T17:31:51.282630+0000","last_active":"2024-09-12T17:31:51.282731+0000","last_peered":"2024-09-12T17:31:51.282731+0000","last_clean":"2024-09-12T17:31:51.282731+0000","last_became_active":"2024-09-12T17:27:50.451743+0000","last_became_peered":"2024-09-12T17:27:50.451743+0000","last_unstale":"2024-09-12T17:31:51.282731+0000","last_undegraded":"2024-09-12T17:31:51.282731+0000","last_fullsized":"2024-09-12T17:31:51.282731+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:51.282505+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:51.282505+0000","last_clean_scrub_stamp":"2024-09-12T17:31:51.282505+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:18.063890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:17.306328+0000","last_change":"2024-09-12T17:31:17.306328+0000","last_active":"2024-09-12T17:31:17.306328+0000","last_peered":"2024-09-12T17:31:17.306328+0000","last_clean":"2024-09-12T17:31:17.306328+0000","last_became_active":"2024-09-12T17:27:42.438566+0000","last_became_peered":"2024-09-12T17:27:42.438566+0000","last_unstale":"2024-09-12T17:31:17.306328+0000","last_undegraded":"2024-09-12T17:31:17.306328+0000","last_fullsized":"2024-09-12T17:31:17.306328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:17.306243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:17.306243+0000","last_clean_scrub_stamp":"2024-09-12T17:31:17.306243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:02.990898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:14.414186+0000","last_change":"2024-09-12T17:31:14.414138+0000","last_active":"2024-09-12T17:31:14.414186+0000","last_peered":"2024-09-12T17:31:14.414186+0000","last_clean":"2024-09-12T17:31:14.414186+0000","last_became_active":"2024-09-12T17:27:40.429902+0000","last_became_peered":"2024-09-12T17:27:40.429902+0000","last_unstale":"2024-09-12T17:31:14.414186+0000","last_undegraded":"2024-09-12T17:31:14.414186+0000","last_fullsized":"2024-09-12T17:31:14.414186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:14.414041+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:14.414041+0000","last_clean_scrub_stamp":"2024-09-12T17:31:14.414041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:51.245716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:55.518291+0000","last_change":"2024-09-12T17:31:55.518291+0000","last_active":"2024-09-12T17:31:55.518291+0000","last_peered":"2024-09-12T17:31:55.518291+0000","last_clean":"2024-09-12T17:31:55.518291+0000","last_became_active":"2024-09-12T17:27:44.431180+0000","last_became_peered":"2024-09-12T17:27:44.431180+0000","last_unstale":"2024-09-12T17:31:55.518291+0000","last_undegraded":"2024-09-12T17:31:55.518291+0000","last_fullsized":"2024-09-12T17:31:55.518291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:55.518204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:55.518204+0000","last_clean_scrub_stamp":"2024-09-12T17:31:55.518204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:09.192139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"31'51","reported_seq":110,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:42.218263+0000","last_change":"2024-09-12T17:31:42.218263+0000","last_active":"2024-09-12T17:31:42.218263+0000","last_peered":"2024-09-12T17:31:42.218263+0000","last_clean":"2024-09-12T17:31:42.218263+0000","last_became_active":"2024-09-12T17:27:46.431599+0000","last_became_peered":"2024-09-12T17:27:46.431599+0000","last_unstale":"2024-09-12T17:31:42.218263+0000","last_undegraded":"2024-09-12T17:31:42.218263+0000","last_fullsized":"2024-09-12T17:31:42.218263+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'51","last_scrub_stamp":"2024-09-12T17:31:42.218165+0000","last_deep_scrub":"31'51","last_deep_scrub_stamp":"2024-09-12T17:31:42.218165+0000","last_clean_scrub_stamp":"2024-09-12T17:31:42.218165+0000","objects_scrubbed":8,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:04.370123+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":53,"num_read_kb":61,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:45.223521+0000","last_change":"2024-09-12T17:31:45.223521+0000","last_active":"2024-09-12T17:31:45.223521+0000","last_peered":"2024-09-12T17:31:45.223521+0000","last_clean":"2024-09-12T17:31:45.223521+0000","last_became_active":"2024-09-12T17:27:48.447331+0000","last_became_peered":"2024-09-12T17:27:48.447331+0000","last_unstale":"2024-09-12T17:31:45.223521+0000","last_undegraded":"2024-09-12T17:31:45.223521+0000","last_fullsized":"2024-09-12T17:31:45.223521+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:45.223419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:45.223419+0000","last_clean_scrub_stamp":"2024-09-12T17:31:45.223419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:53:36.521497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"31'7","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:52.272997+0000","last_change":"2024-09-12T17:31:52.272909+0000","last_active":"2024-09-12T17:31:52.272997+0000","last_peered":"2024-09-12T17:31:52.272997+0000","last_clean":"2024-09-12T17:31:52.272997+0000","last_became_active":"2024-09-12T17:27:50.447855+0000","last_became_peered":"2024-09-12T17:27:50.447855+0000","last_unstale":"2024-09-12T17:31:52.272997+0000","last_undegraded":"2024-09-12T17:31:52.272997+0000","last_fullsized":"2024-09-12T17:31:52.272997+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'7","last_scrub_stamp":"2024-09-12T17:31:52.272789+0000","last_deep_scrub":"31'7","last_deep_scrub_stamp":"2024-09-12T17:31:52.272789+0000","last_clean_scrub_stamp":"2024-09-12T17:31:52.272789+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:36.685106+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"31'14","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:31.547974+0000","last_change":"2024-09-12T17:31:31.547869+0000","last_active":"2024-09-12T17:31:31.547974+0000","last_peered":"2024-09-12T17:31:31.547974+0000","last_clean":"2024-09-12T17:31:31.547974+0000","last_became_active":"2024-09-12T17:27:42.438270+0000","last_became_peered":"2024-09-12T17:27:42.438270+0000","last_unstale":"2024-09-12T17:31:31.547974+0000","last_undegraded":"2024-09-12T17:31:31.547974+0000","last_fullsized":"2024-09-12T17:31:31.547974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-12T17:31:31.547749+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-12T17:31:31.547749+0000","last_clean_scrub_stamp":"2024-09-12T17:31:31.547749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:59.304661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"31'74","reported_seq":153,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:01.448317+0000","last_change":"2024-09-12T17:31:01.448262+0000","last_active":"2024-09-12T17:31:01.448317+0000","last_peered":"2024-09-12T17:31:01.448317+0000","last_clean":"2024-09-12T17:31:01.448317+0000","last_became_active":"2024-09-12T17:27:25.974522+0000","last_became_peered":"2024-09-12T17:27:25.974522+0000","last_unstale":"2024-09-12T17:31:01.448317+0000","last_undegraded":"2024-09-12T17:31:01.448317+0000","last_fullsized":"2024-09-12T17:31:01.448317+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'74","last_scrub_stamp":"2024-09-12T17:31:01.448174+0000","last_deep_scrub":"31'74","last_deep_scrub_stamp":"2024-09-12T17:31:01.448174+0000","last_clean_scrub_stamp":"2024-09-12T17:31:01.448174+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:35.862648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"31'2","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:04.209795+0000","last_change":"2024-09-12T17:31:04.209698+0000","last_active":"2024-09-12T17:31:04.209795+0000","last_peered":"2024-09-12T17:31:04.209795+0000","last_clean":"2024-09-12T17:31:04.209795+0000","last_became_active":"2024-09-12T17:27:32.760744+0000","last_became_peered":"2024-09-12T17:27:32.760744+0000","last_unstale":"2024-09-12T17:31:04.209795+0000","last_undegraded":"2024-09-12T17:31:04.209795+0000","last_fullsized":"2024-09-12T17:31:04.209795+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:04.209605+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:04.209605+0000","last_clean_scrub_stamp":"2024-09-12T17:31:04.209605+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:18.344014+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0014241220000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:05.209841+0000","last_change":"2024-09-12T17:31:05.209735+0000","last_active":"2024-09-12T17:31:05.209841+0000","last_peered":"2024-09-12T17:31:05.209841+0000","last_clean":"2024-09-12T17:31:05.209841+0000","last_became_active":"2024-09-12T17:27:40.428453+0000","last_became_peered":"2024-09-12T17:27:40.428453+0000","last_unstale":"2024-09-12T17:31:05.209841+0000","last_undegraded":"2024-09-12T17:31:05.209841+0000","last_fullsized":"2024-09-12T17:31:05.209841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:05.209644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:05.209644+0000","last_clean_scrub_stamp":"2024-09-12T17:31:05.209644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:39.739604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:33.324359+0000","last_change":"2024-09-12T17:31:33.324301+0000","last_active":"2024-09-12T17:31:33.324359+0000","last_peered":"2024-09-12T17:31:33.324359+0000","last_clean":"2024-09-12T17:31:33.324359+0000","last_became_active":"2024-09-12T17:27:44.432336+0000","last_became_peered":"2024-09-12T17:27:44.432336+0000","last_unstale":"2024-09-12T17:31:33.324359+0000","last_undegraded":"2024-09-12T17:31:33.324359+0000","last_fullsized":"2024-09-12T17:31:33.324359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:33.324201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:33.324201+0000","last_clean_scrub_stamp":"2024-09-12T17:31:33.324201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:09.650088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"31'90","reported_seq":180,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:59.559357+0000","last_change":"2024-09-12T17:31:59.559357+0000","last_active":"2024-09-12T17:31:59.559357+0000","last_peered":"2024-09-12T17:31:59.559357+0000","last_clean":"2024-09-12T17:31:59.559357+0000","last_became_active":"2024-09-12T17:27:46.437771+0000","last_became_peered":"2024-09-12T17:27:46.437771+0000","last_unstale":"2024-09-12T17:31:59.559357+0000","last_undegraded":"2024-09-12T17:31:59.559357+0000","last_fullsized":"2024-09-12T17:31:59.559357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'90","last_scrub_stamp":"2024-09-12T17:31:59.559246+0000","last_deep_scrub":"31'90","last_deep_scrub_stamp":"2024-09-12T17:31:59.559246+0000","last_clean_scrub_stamp":"2024-09-12T17:31:59.559246+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:46.610831+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:44.033196+0000","last_change":"2024-09-12T17:31:44.033196+0000","last_active":"2024-09-12T17:31:44.033196+0000","last_peered":"2024-09-12T17:31:44.033196+0000","last_clean":"2024-09-12T17:31:44.033196+0000","last_became_active":"2024-09-12T17:27:48.445970+0000","last_became_peered":"2024-09-12T17:27:48.445970+0000","last_unstale":"2024-09-12T17:31:44.033196+0000","last_undegraded":"2024-09-12T17:31:44.033196+0000","last_fullsized":"2024-09-12T17:31:44.033196+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:44.033093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:44.033093+0000","last_clean_scrub_stamp":"2024-09-12T17:31:44.033093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:04.159758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"31'81","reported_seq":171,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:52.233929+0000","last_change":"2024-09-12T17:31:52.233929+0000","last_active":"2024-09-12T17:31:52.233929+0000","last_peered":"2024-09-12T17:31:52.233929+0000","last_clean":"2024-09-12T17:31:52.233929+0000","last_became_active":"2024-09-12T17:27:50.448189+0000","last_became_peered":"2024-09-12T17:27:50.448189+0000","last_unstale":"2024-09-12T17:31:52.233929+0000","last_undegraded":"2024-09-12T17:31:52.233929+0000","last_fullsized":"2024-09-12T17:31:52.233929+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'81","last_scrub_stamp":"2024-09-12T17:31:52.233825+0000","last_deep_scrub":"31'81","last_deep_scrub_stamp":"2024-09-12T17:31:52.233825+0000","last_clean_scrub_stamp":"2024-09-12T17:31:52.233825+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:27.501741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":221,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:29.534969+0000","last_change":"2024-09-12T17:31:29.534969+0000","last_active":"2024-09-12T17:31:29.534969+0000","last_peered":"2024-09-12T17:31:29.534969+0000","last_clean":"2024-09-12T17:31:29.534969+0000","last_became_active":"2024-09-12T17:27:42.429497+0000","last_became_peered":"2024-09-12T17:27:42.429497+0000","last_unstale":"2024-09-12T17:31:29.534969+0000","last_undegraded":"2024-09-12T17:31:29.534969+0000","last_fullsized":"2024-09-12T17:31:29.534969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-12T17:31:29.534867+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-12T17:31:29.534867+0000","last_clean_scrub_stamp":"2024-09-12T17:31:29.534867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:43.863976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:01.220300+0000","last_change":"2024-09-12T17:31:01.220220+0000","last_active":"2024-09-12T17:31:01.220300+0000","last_peered":"2024-09-12T17:31:01.220300+0000","last_clean":"2024-09-12T17:31:01.220300+0000","last_became_active":"2024-09-12T17:27:32.761687+0000","last_became_peered":"2024-09-12T17:27:32.761687+0000","last_unstale":"2024-09-12T17:31:01.220300+0000","last_undegraded":"2024-09-12T17:31:01.220300+0000","last_fullsized":"2024-09-12T17:31:01.220300+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:01.220136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:01.220136+0000","last_clean_scrub_stamp":"2024-09-12T17:31:01.220136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:40.149633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056694099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:01.844201+0000","last_change":"2024-09-12T17:31:01.844114+0000","last_active":"2024-09-12T17:31:01.844201+0000","last_peered":"2024-09-12T17:31:01.844201+0000","last_clean":"2024-09-12T17:31:01.844201+0000","last_became_active":"2024-09-12T17:27:40.418249+0000","last_became_peered":"2024-09-12T17:27:40.418249+0000","last_unstale":"2024-09-12T17:31:01.844201+0000","last_undegraded":"2024-09-12T17:31:01.844201+0000","last_fullsized":"2024-09-12T17:31:01.844201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:01.844025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:01.844025+0000","last_clean_scrub_stamp":"2024-09-12T17:31:01.844025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:24.701961+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:51.473329+0000","last_change":"2024-09-12T17:31:51.473329+0000","last_active":"2024-09-12T17:31:51.473329+0000","last_peered":"2024-09-12T17:31:51.473329+0000","last_clean":"2024-09-12T17:31:51.473329+0000","last_became_active":"2024-09-12T17:27:44.426698+0000","last_became_peered":"2024-09-12T17:27:44.426698+0000","last_unstale":"2024-09-12T17:31:51.473329+0000","last_undegraded":"2024-09-12T17:31:51.473329+0000","last_fullsized":"2024-09-12T17:31:51.473329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:51.473243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:51.473243+0000","last_clean_scrub_stamp":"2024-09-12T17:31:51.473243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:02.192513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"31'295","reported_seq":521,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:41.218206+0000","last_change":"2024-09-12T17:31:41.218144+0000","last_active":"2024-09-12T17:31:41.218206+0000","last_peered":"2024-09-12T17:31:41.218206+0000","last_clean":"2024-09-12T17:31:41.218206+0000","last_became_active":"2024-09-12T17:27:46.438381+0000","last_became_peered":"2024-09-12T17:27:46.438381+0000","last_unstale":"2024-09-12T17:31:41.218206+0000","last_undegraded":"2024-09-12T17:31:41.218206+0000","last_fullsized":"2024-09-12T17:31:41.218206+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'295","last_scrub_stamp":"2024-09-12T17:31:41.218033+0000","last_deep_scrub":"31'295","last_deep_scrub_stamp":"2024-09-12T17:31:41.218033+0000","last_clean_scrub_stamp":"2024-09-12T17:31:41.218033+0000","objects_scrubbed":10,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:50.316833+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:55.766324+0000","last_change":"2024-09-12T17:27:48.451345+0000","last_active":"2024-09-12T17:29:55.766324+0000","last_peered":"2024-09-12T17:29:55.766324+0000","last_clean":"2024-09-12T17:29:55.766324+0000","last_became_active":"2024-09-12T17:27:48.450775+0000","last_became_peered":"2024-09-12T17:27:48.450775+0000","last_unstale":"2024-09-12T17:29:55.766324+0000","last_undegraded":"2024-09-12T17:29:55.766324+0000","last_fullsized":"2024-09-12T17:29:55.766324+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"31'5","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:55.307903+0000","last_change":"2024-09-12T17:31:55.307903+0000","last_active":"2024-09-12T17:31:55.307903+0000","last_peered":"2024-09-12T17:31:55.307903+0000","last_clean":"2024-09-12T17:31:55.307903+0000","last_became_active":"2024-09-12T17:27:50.457939+0000","last_became_peered":"2024-09-12T17:27:50.457939+0000","last_unstale":"2024-09-12T17:31:55.307903+0000","last_undegraded":"2024-09-12T17:31:55.307903+0000","last_fullsized":"2024-09-12T17:31:55.307903+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-09-12T17:31:55.307796+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-09-12T17:31:55.307796+0000","last_clean_scrub_stamp":"2024-09-12T17:31:55.307796+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:15.600277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:16.847975+0000","last_change":"2024-09-12T17:31:16.847975+0000","last_active":"2024-09-12T17:31:16.847975+0000","last_peered":"2024-09-12T17:31:16.847975+0000","last_clean":"2024-09-12T17:31:16.847975+0000","last_became_active":"2024-09-12T17:27:42.424498+0000","last_became_peered":"2024-09-12T17:27:42.424498+0000","last_unstale":"2024-09-12T17:31:16.847975+0000","last_undegraded":"2024-09-12T17:31:16.847975+0000","last_fullsized":"2024-09-12T17:31:16.847975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:16.847857+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:16.847857+0000","last_clean_scrub_stamp":"2024-09-12T17:31:16.847857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:43.335725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:03.037428+0000","last_change":"2024-09-12T17:31:03.037376+0000","last_active":"2024-09-12T17:31:03.037428+0000","last_peered":"2024-09-12T17:31:03.037428+0000","last_clean":"2024-09-12T17:31:03.037428+0000","last_became_active":"2024-09-12T17:27:32.761809+0000","last_became_peered":"2024-09-12T17:27:32.761809+0000","last_unstale":"2024-09-12T17:31:03.037428+0000","last_undegraded":"2024-09-12T17:31:03.037428+0000","last_fullsized":"2024-09-12T17:31:03.037428+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:03.037295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:03.037295+0000","last_clean_scrub_stamp":"2024-09-12T17:31:03.037295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:57:59.113302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051333900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"31'3","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:03.795988+0000","last_change":"2024-09-12T17:31:03.795932+0000","last_active":"2024-09-12T17:31:03.795988+0000","last_peered":"2024-09-12T17:31:03.795988+0000","last_clean":"2024-09-12T17:31:03.795988+0000","last_became_active":"2024-09-12T17:27:40.417664+0000","last_became_peered":"2024-09-12T17:27:40.417664+0000","last_unstale":"2024-09-12T17:31:03.795988+0000","last_undegraded":"2024-09-12T17:31:03.795988+0000","last_fullsized":"2024-09-12T17:31:03.795988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-09-12T17:31:03.795825+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-09-12T17:31:03.795825+0000","last_clean_scrub_stamp":"2024-09-12T17:31:03.795825+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:31:39.240916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"31'4","reported_seq":244,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:29.251861+0000","last_change":"2024-09-12T17:31:29.251861+0000","last_active":"2024-09-12T17:31:29.251861+0000","last_peered":"2024-09-12T17:31:29.251861+0000","last_clean":"2024-09-12T17:31:29.251861+0000","last_became_active":"2024-09-12T17:28:21.473073+0000","last_became_peered":"2024-09-12T17:28:21.473073+0000","last_unstale":"2024-09-12T17:31:29.251861+0000","last_undegraded":"2024-09-12T17:31:29.251861+0000","last_fullsized":"2024-09-12T17:31:29.251861+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:29.251773+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:29.251773+0000","last_clean_scrub_stamp":"2024-09-12T17:31:29.251773+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:37.794343+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":482,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"31'25","reported_seq":103,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:38.112116+0000","last_change":"2024-09-12T17:31:38.112059+0000","last_active":"2024-09-12T17:31:38.112116+0000","last_peered":"2024-09-12T17:31:38.112116+0000","last_clean":"2024-09-12T17:31:38.112116+0000","last_became_active":"2024-09-12T17:27:46.435381+0000","last_became_peered":"2024-09-12T17:27:46.435381+0000","last_unstale":"2024-09-12T17:31:38.112116+0000","last_undegraded":"2024-09-12T17:31:38.112116+0000","last_fullsized":"2024-09-12T17:31:38.112116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'25","last_scrub_stamp":"2024-09-12T17:31:38.111974+0000","last_deep_scrub":"31'25","last_deep_scrub_stamp":"2024-09-12T17:31:38.111974+0000","last_clean_scrub_stamp":"2024-09-12T17:31:38.111974+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:06.093270+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:45.990516+0000","last_change":"2024-09-12T17:31:45.990449+0000","last_active":"2024-09-12T17:31:45.990516+0000","last_peered":"2024-09-12T17:31:45.990516+0000","last_clean":"2024-09-12T17:31:45.990516+0000","last_became_active":"2024-09-12T17:27:48.451225+0000","last_became_peered":"2024-09-12T17:27:48.451225+0000","last_unstale":"2024-09-12T17:31:45.990516+0000","last_undegraded":"2024-09-12T17:31:45.990516+0000","last_fullsized":"2024-09-12T17:31:45.990516+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:45.990362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:45.990362+0000","last_clean_scrub_stamp":"2024-09-12T17:31:45.990362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:29.719452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463520+0000","last_change":"2024-09-12T17:27:50.453764+0000","last_active":"2024-09-12T17:28:21.463520+0000","last_peered":"2024-09-12T17:28:21.463520+0000","last_clean":"2024-09-12T17:28:21.463520+0000","last_became_active":"2024-09-12T17:27:50.453458+0000","last_became_peered":"2024-09-12T17:27:50.453458+0000","last_unstale":"2024-09-12T17:28:21.463520+0000","last_undegraded":"2024-09-12T17:28:21.463520+0000","last_fullsized":"2024-09-12T17:28:21.463520+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:48.900827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"31'10","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:15.887747+0000","last_change":"2024-09-12T17:31:15.887674+0000","last_active":"2024-09-12T17:31:15.887747+0000","last_peered":"2024-09-12T17:31:15.887747+0000","last_clean":"2024-09-12T17:31:15.887747+0000","last_became_active":"2024-09-12T17:27:42.427591+0000","last_became_peered":"2024-09-12T17:27:42.427591+0000","last_unstale":"2024-09-12T17:31:15.887747+0000","last_undegraded":"2024-09-12T17:31:15.887747+0000","last_fullsized":"2024-09-12T17:31:15.887747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-12T17:31:15.887587+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-12T17:31:15.887587+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.887587+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:34.580284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"31'3","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:02.205206+0000","last_change":"2024-09-12T17:31:02.205137+0000","last_active":"2024-09-12T17:31:02.205206+0000","last_peered":"2024-09-12T17:31:02.205206+0000","last_clean":"2024-09-12T17:31:02.205206+0000","last_became_active":"2024-09-12T17:27:32.761967+0000","last_became_peered":"2024-09-12T17:27:32.761967+0000","last_unstale":"2024-09-12T17:31:02.205206+0000","last_undegraded":"2024-09-12T17:31:02.205206+0000","last_fullsized":"2024-09-12T17:31:02.205206+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-09-12T17:31:02.205052+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-09-12T17:31:02.205052+0000","last_clean_scrub_stamp":"2024-09-12T17:31:02.205052+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:42.393847+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001062323,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:04.082831+0000","last_change":"2024-09-12T17:31:04.082738+0000","last_active":"2024-09-12T17:31:04.082831+0000","last_peered":"2024-09-12T17:31:04.082831+0000","last_clean":"2024-09-12T17:31:04.082831+0000","last_became_active":"2024-09-12T17:27:40.425973+0000","last_became_peered":"2024-09-12T17:27:40.425973+0000","last_unstale":"2024-09-12T17:31:04.082831+0000","last_undegraded":"2024-09-12T17:31:04.082831+0000","last_fullsized":"2024-09-12T17:31:04.082831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:04.082603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:04.082603+0000","last_clean_scrub_stamp":"2024-09-12T17:31:04.082603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:21.270783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:32.915382+0000","last_change":"2024-09-12T17:31:32.915286+0000","last_active":"2024-09-12T17:31:32.915382+0000","last_peered":"2024-09-12T17:31:32.915382+0000","last_clean":"2024-09-12T17:31:32.915382+0000","last_became_active":"2024-09-12T17:27:44.432348+0000","last_became_peered":"2024-09-12T17:27:44.432348+0000","last_unstale":"2024-09-12T17:31:32.915382+0000","last_undegraded":"2024-09-12T17:31:32.915382+0000","last_fullsized":"2024-09-12T17:31:32.915382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:32.915180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:32.915180+0000","last_clean_scrub_stamp":"2024-09-12T17:31:32.915180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:38.504920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"31'21","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:58.531308+0000","last_change":"2024-09-12T17:31:58.531308+0000","last_active":"2024-09-12T17:31:58.531308+0000","last_peered":"2024-09-12T17:31:58.531308+0000","last_clean":"2024-09-12T17:31:58.531308+0000","last_became_active":"2024-09-12T17:27:46.442488+0000","last_became_peered":"2024-09-12T17:27:46.442488+0000","last_unstale":"2024-09-12T17:31:58.531308+0000","last_undegraded":"2024-09-12T17:31:58.531308+0000","last_fullsized":"2024-09-12T17:31:58.531308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'21","last_scrub_stamp":"2024-09-12T17:31:58.531214+0000","last_deep_scrub":"31'21","last_deep_scrub_stamp":"2024-09-12T17:31:58.531214+0000","last_clean_scrub_stamp":"2024-09-12T17:31:58.531214+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:34.732602+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.466202+0000","last_change":"2024-09-12T17:27:48.451472+0000","last_active":"2024-09-12T17:28:21.466202+0000","last_peered":"2024-09-12T17:28:21.466202+0000","last_clean":"2024-09-12T17:28:21.466202+0000","last_became_active":"2024-09-12T17:27:48.451075+0000","last_became_peered":"2024-09-12T17:27:48.451075+0000","last_unstale":"2024-09-12T17:28:21.466202+0000","last_undegraded":"2024-09-12T17:28:21.466202+0000","last_fullsized":"2024-09-12T17:28:21.466202+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:41.217292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'10","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:54.304418+0000","last_change":"2024-09-12T17:31:54.304418+0000","last_active":"2024-09-12T17:31:54.304418+0000","last_peered":"2024-09-12T17:31:54.304418+0000","last_clean":"2024-09-12T17:31:54.304418+0000","last_became_active":"2024-09-12T17:27:50.455608+0000","last_became_peered":"2024-09-12T17:27:50.455608+0000","last_unstale":"2024-09-12T17:31:54.304418+0000","last_undegraded":"2024-09-12T17:31:54.304418+0000","last_fullsized":"2024-09-12T17:31:54.304418+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-12T17:31:54.304339+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-12T17:31:54.304339+0000","last_clean_scrub_stamp":"2024-09-12T17:31:54.304339+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:41.053408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":17,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'14","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:16.142405+0000","last_change":"2024-09-12T17:31:16.142405+0000","last_active":"2024-09-12T17:31:16.142405+0000","last_peered":"2024-09-12T17:31:16.142405+0000","last_clean":"2024-09-12T17:31:16.142405+0000","last_became_active":"2024-09-12T17:28:21.471756+0000","last_became_peered":"2024-09-12T17:28:21.471756+0000","last_unstale":"2024-09-12T17:31:16.142405+0000","last_undegraded":"2024-09-12T17:31:16.142405+0000","last_fullsized":"2024-09-12T17:31:16.142405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-12T17:31:16.142322+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-12T17:31:16.142322+0000","last_clean_scrub_stamp":"2024-09-12T17:31:16.142322+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:39.000259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:01.009789+0000","last_change":"2024-09-12T17:31:01.009730+0000","last_active":"2024-09-12T17:31:01.009789+0000","last_peered":"2024-09-12T17:31:01.009789+0000","last_clean":"2024-09-12T17:31:01.009789+0000","last_became_active":"2024-09-12T17:27:40.424286+0000","last_became_peered":"2024-09-12T17:27:40.424286+0000","last_unstale":"2024-09-12T17:31:01.009789+0000","last_undegraded":"2024-09-12T17:31:01.009789+0000","last_fullsized":"2024-09-12T17:31:01.009789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:01.009648+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:01.009648+0000","last_clean_scrub_stamp":"2024-09-12T17:31:01.009648+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:15.810543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:59.835909+0000","last_change":"2024-09-12T17:30:59.835771+0000","last_active":"2024-09-12T17:30:59.835909+0000","last_peered":"2024-09-12T17:30:59.835909+0000","last_clean":"2024-09-12T17:30:59.835909+0000","last_became_active":"2024-09-12T17:27:32.761595+0000","last_became_peered":"2024-09-12T17:27:32.761595+0000","last_unstale":"2024-09-12T17:30:59.835909+0000","last_undegraded":"2024-09-12T17:30:59.835909+0000","last_fullsized":"2024-09-12T17:30:59.835909+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:59.835655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:59.835655+0000","last_clean_scrub_stamp":"2024-09-12T17:30:59.835655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:14.315612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000417551,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"31'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:30.833956+0000","last_change":"2024-09-12T17:31:30.833822+0000","last_active":"2024-09-12T17:31:30.833956+0000","last_peered":"2024-09-12T17:31:30.833956+0000","last_clean":"2024-09-12T17:31:30.833956+0000","last_became_active":"2024-09-12T17:27:44.432492+0000","last_became_peered":"2024-09-12T17:27:44.432492+0000","last_unstale":"2024-09-12T17:31:30.833956+0000","last_undegraded":"2024-09-12T17:31:30.833956+0000","last_fullsized":"2024-09-12T17:31:30.833956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:30.833721+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:30.833721+0000","last_clean_scrub_stamp":"2024-09-12T17:31:30.833721+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:05.676775+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"31'76","reported_seq":153,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:35.923118+0000","last_change":"2024-09-12T17:31:35.922981+0000","last_active":"2024-09-12T17:31:35.923118+0000","last_peered":"2024-09-12T17:31:35.923118+0000","last_clean":"2024-09-12T17:31:35.923118+0000","last_became_active":"2024-09-12T17:27:46.439014+0000","last_became_peered":"2024-09-12T17:27:46.439014+0000","last_unstale":"2024-09-12T17:31:35.923118+0000","last_undegraded":"2024-09-12T17:31:35.923118+0000","last_fullsized":"2024-09-12T17:31:35.923118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'76","last_scrub_stamp":"2024-09-12T17:31:35.922854+0000","last_deep_scrub":"31'76","last_deep_scrub_stamp":"2024-09-12T17:31:35.922854+0000","last_clean_scrub_stamp":"2024-09-12T17:31:35.922854+0000","objects_scrubbed":9,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:07.104177+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:44.204301+0000","last_change":"2024-09-12T17:31:44.204241+0000","last_active":"2024-09-12T17:31:44.204301+0000","last_peered":"2024-09-12T17:31:44.204301+0000","last_clean":"2024-09-12T17:31:44.204301+0000","last_became_active":"2024-09-12T17:27:48.438779+0000","last_became_peered":"2024-09-12T17:27:48.438779+0000","last_unstale":"2024-09-12T17:31:44.204301+0000","last_undegraded":"2024-09-12T17:31:44.204301+0000","last_fullsized":"2024-09-12T17:31:44.204301+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:44.204158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:44.204158+0000","last_clean_scrub_stamp":"2024-09-12T17:31:44.204158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:20.530044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"31'13","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:59.119082+0000","last_change":"2024-09-12T17:31:59.119082+0000","last_active":"2024-09-12T17:31:59.119082+0000","last_peered":"2024-09-12T17:31:59.119082+0000","last_clean":"2024-09-12T17:31:59.119082+0000","last_became_active":"2024-09-12T17:27:50.448060+0000","last_became_peered":"2024-09-12T17:27:50.448060+0000","last_unstale":"2024-09-12T17:31:59.119082+0000","last_undegraded":"2024-09-12T17:31:59.119082+0000","last_fullsized":"2024-09-12T17:31:59.119082+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'13","last_scrub_stamp":"2024-09-12T17:31:59.118958+0000","last_deep_scrub":"31'13","last_deep_scrub_stamp":"2024-09-12T17:31:59.118958+0000","last_clean_scrub_stamp":"2024-09-12T17:31:59.118958+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:59.445773+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":31,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"31'27","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:12.291409+0000","last_change":"2024-09-12T17:31:12.291292+0000","last_active":"2024-09-12T17:31:12.291409+0000","last_peered":"2024-09-12T17:31:12.291409+0000","last_clean":"2024-09-12T17:31:12.291409+0000","last_became_active":"2024-09-12T17:27:42.432800+0000","last_became_peered":"2024-09-12T17:27:42.432800+0000","last_unstale":"2024-09-12T17:31:12.291409+0000","last_undegraded":"2024-09-12T17:31:12.291409+0000","last_fullsized":"2024-09-12T17:31:12.291409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'27","last_scrub_stamp":"2024-09-12T17:31:12.291188+0000","last_deep_scrub":"31'27","last_deep_scrub_stamp":"2024-09-12T17:31:12.291188+0000","last_clean_scrub_stamp":"2024-09-12T17:31:12.291188+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:58.552254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":99,"num_read_kb":83,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:05.776096+0000","last_change":"2024-09-12T17:31:05.776042+0000","last_active":"2024-09-12T17:31:05.776096+0000","last_peered":"2024-09-12T17:31:05.776096+0000","last_clean":"2024-09-12T17:31:05.776096+0000","last_became_active":"2024-09-12T17:27:40.418873+0000","last_became_peered":"2024-09-12T17:27:40.418873+0000","last_unstale":"2024-09-12T17:31:05.776096+0000","last_undegraded":"2024-09-12T17:31:05.776096+0000","last_fullsized":"2024-09-12T17:31:05.776096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:05.775954+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:05.775954+0000","last_clean_scrub_stamp":"2024-09-12T17:31:05.775954+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:05.095403+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:03.225809+0000","last_change":"2024-09-12T17:31:03.225739+0000","last_active":"2024-09-12T17:31:03.225809+0000","last_peered":"2024-09-12T17:31:03.225809+0000","last_clean":"2024-09-12T17:31:03.225809+0000","last_became_active":"2024-09-12T17:27:32.761677+0000","last_became_peered":"2024-09-12T17:27:32.761677+0000","last_unstale":"2024-09-12T17:31:03.225809+0000","last_undegraded":"2024-09-12T17:31:03.225809+0000","last_fullsized":"2024-09-12T17:31:03.225809+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:03.225639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:03.225639+0000","last_clean_scrub_stamp":"2024-09-12T17:31:03.225639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:53.792882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001356625,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:49.474298+0000","last_change":"2024-09-12T17:31:49.474248+0000","last_active":"2024-09-12T17:31:49.474298+0000","last_peered":"2024-09-12T17:31:49.474298+0000","last_clean":"2024-09-12T17:31:49.474298+0000","last_became_active":"2024-09-12T17:27:44.426647+0000","last_became_peered":"2024-09-12T17:27:44.426647+0000","last_unstale":"2024-09-12T17:31:49.474298+0000","last_undegraded":"2024-09-12T17:31:49.474298+0000","last_fullsized":"2024-09-12T17:31:49.474298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:49.474140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:49.474140+0000","last_clean_scrub_stamp":"2024-09-12T17:31:49.474140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:25.749871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"31'22","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:40.171838+0000","last_change":"2024-09-12T17:31:40.171783+0000","last_active":"2024-09-12T17:31:40.171838+0000","last_peered":"2024-09-12T17:31:40.171838+0000","last_clean":"2024-09-12T17:31:40.171838+0000","last_became_active":"2024-09-12T17:27:46.439038+0000","last_became_peered":"2024-09-12T17:27:46.439038+0000","last_unstale":"2024-09-12T17:31:40.171838+0000","last_undegraded":"2024-09-12T17:31:40.171838+0000","last_fullsized":"2024-09-12T17:31:40.171838+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'22","last_scrub_stamp":"2024-09-12T17:31:40.171698+0000","last_deep_scrub":"31'22","last_deep_scrub_stamp":"2024-09-12T17:31:40.171698+0000","last_clean_scrub_stamp":"2024-09-12T17:31:40.171698+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:53.965338+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"31'286","reported_seq":360,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:47.186948+0000","last_change":"2024-09-12T17:31:47.186874+0000","last_active":"2024-09-12T17:31:47.186948+0000","last_peered":"2024-09-12T17:31:47.186948+0000","last_clean":"2024-09-12T17:31:47.186948+0000","last_became_active":"2024-09-12T17:27:48.440948+0000","last_became_peered":"2024-09-12T17:27:48.440948+0000","last_unstale":"2024-09-12T17:31:47.186948+0000","last_undegraded":"2024-09-12T17:31:47.186948+0000","last_fullsized":"2024-09-12T17:31:47.186948+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'286","last_scrub_stamp":"2024-09-12T17:31:47.186792+0000","last_deep_scrub":"31'286","last_deep_scrub_stamp":"2024-09-12T17:31:47.186792+0000","last_clean_scrub_stamp":"2024-09-12T17:31:47.186792+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:58.556769+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.465509+0000","last_change":"2024-09-12T17:27:50.455097+0000","last_active":"2024-09-12T17:28:21.465509+0000","last_peered":"2024-09-12T17:28:21.465509+0000","last_clean":"2024-09-12T17:28:21.465509+0000","last_became_active":"2024-09-12T17:27:50.454241+0000","last_became_peered":"2024-09-12T17:27:50.454241+0000","last_unstale":"2024-09-12T17:28:21.465509+0000","last_undegraded":"2024-09-12T17:28:21.465509+0000","last_fullsized":"2024-09-12T17:28:21.465509+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:01.881864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"31'16","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:28.486671+0000","last_change":"2024-09-12T17:31:28.486564+0000","last_active":"2024-09-12T17:31:28.486671+0000","last_peered":"2024-09-12T17:31:28.486671+0000","last_clean":"2024-09-12T17:31:28.486671+0000","last_became_active":"2024-09-12T17:27:42.423805+0000","last_became_peered":"2024-09-12T17:27:42.423805+0000","last_unstale":"2024-09-12T17:31:28.486671+0000","last_undegraded":"2024-09-12T17:31:28.486671+0000","last_fullsized":"2024-09-12T17:31:28.486671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'16","last_scrub_stamp":"2024-09-12T17:31:28.486474+0000","last_deep_scrub":"31'16","last_deep_scrub_stamp":"2024-09-12T17:31:28.486474+0000","last_clean_scrub_stamp":"2024-09-12T17:31:28.486474+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:53.131800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:07.273178+0000","last_change":"2024-09-12T17:31:07.273111+0000","last_active":"2024-09-12T17:31:07.273178+0000","last_peered":"2024-09-12T17:31:07.273178+0000","last_clean":"2024-09-12T17:31:07.273178+0000","last_became_active":"2024-09-12T17:27:40.423703+0000","last_became_peered":"2024-09-12T17:27:40.423703+0000","last_unstale":"2024-09-12T17:31:07.273178+0000","last_undegraded":"2024-09-12T17:31:07.273178+0000","last_fullsized":"2024-09-12T17:31:07.273178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:07.273027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:07.273027+0000","last_clean_scrub_stamp":"2024-09-12T17:31:07.273027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:59.920670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:00.826839+0000","last_change":"2024-09-12T17:31:00.826782+0000","last_active":"2024-09-12T17:31:00.826839+0000","last_peered":"2024-09-12T17:31:00.826839+0000","last_clean":"2024-09-12T17:31:00.826839+0000","last_became_active":"2024-09-12T17:27:32.761590+0000","last_became_peered":"2024-09-12T17:27:32.761590+0000","last_unstale":"2024-09-12T17:31:00.826839+0000","last_undegraded":"2024-09-12T17:31:00.826839+0000","last_fullsized":"2024-09-12T17:31:00.826839+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:00.826700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:00.826700+0000","last_clean_scrub_stamp":"2024-09-12T17:31:00.826700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:41.176527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036072200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:48.494341+0000","last_change":"2024-09-12T17:31:48.494284+0000","last_active":"2024-09-12T17:31:48.494341+0000","last_peered":"2024-09-12T17:31:48.494341+0000","last_clean":"2024-09-12T17:31:48.494341+0000","last_became_active":"2024-09-12T17:27:44.427318+0000","last_became_peered":"2024-09-12T17:27:44.427318+0000","last_unstale":"2024-09-12T17:31:48.494341+0000","last_undegraded":"2024-09-12T17:31:48.494341+0000","last_fullsized":"2024-09-12T17:31:48.494341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:48.494175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:48.494175+0000","last_clean_scrub_stamp":"2024-09-12T17:31:48.494175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:20.611185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"31'15","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:57.492276+0000","last_change":"2024-09-12T17:31:57.492276+0000","last_active":"2024-09-12T17:31:57.492276+0000","last_peered":"2024-09-12T17:31:57.492276+0000","last_clean":"2024-09-12T17:31:57.492276+0000","last_became_active":"2024-09-12T17:27:46.443937+0000","last_became_peered":"2024-09-12T17:27:46.443937+0000","last_unstale":"2024-09-12T17:31:57.492276+0000","last_undegraded":"2024-09-12T17:31:57.492276+0000","last_fullsized":"2024-09-12T17:31:57.492276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'15","last_scrub_stamp":"2024-09-12T17:31:57.492132+0000","last_deep_scrub":"31'15","last_deep_scrub_stamp":"2024-09-12T17:31:57.492132+0000","last_clean_scrub_stamp":"2024-09-12T17:31:57.492132+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:27.779269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"31'286","reported_seq":403,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:47.039683+0000","last_change":"2024-09-12T17:31:47.039607+0000","last_active":"2024-09-12T17:31:47.039683+0000","last_peered":"2024-09-12T17:31:47.039683+0000","last_clean":"2024-09-12T17:31:47.039683+0000","last_became_active":"2024-09-12T17:27:48.441694+0000","last_became_peered":"2024-09-12T17:27:48.441694+0000","last_unstale":"2024-09-12T17:31:47.039683+0000","last_undegraded":"2024-09-12T17:31:47.039683+0000","last_fullsized":"2024-09-12T17:31:47.039683+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'286","last_scrub_stamp":"2024-09-12T17:31:47.039521+0000","last_deep_scrub":"31'286","last_deep_scrub_stamp":"2024-09-12T17:31:47.039521+0000","last_clean_scrub_stamp":"2024-09-12T17:31:47.039521+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:56.891807+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"29'3","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:57.215310+0000","last_change":"2024-09-12T17:31:57.215310+0000","last_active":"2024-09-12T17:31:57.215310+0000","last_peered":"2024-09-12T17:31:57.215310+0000","last_clean":"2024-09-12T17:31:57.215310+0000","last_became_active":"2024-09-12T17:27:50.452862+0000","last_became_peered":"2024-09-12T17:27:50.452862+0000","last_unstale":"2024-09-12T17:31:57.215310+0000","last_undegraded":"2024-09-12T17:31:57.215310+0000","last_fullsized":"2024-09-12T17:31:57.215310+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-09-12T17:31:57.215214+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-09-12T17:31:57.215214+0000","last_clean_scrub_stamp":"2024-09-12T17:31:57.215214+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:58.167244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"29'2","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:17.188786+0000","last_change":"2024-09-12T17:31:17.188673+0000","last_active":"2024-09-12T17:31:17.188786+0000","last_peered":"2024-09-12T17:31:17.188786+0000","last_clean":"2024-09-12T17:31:17.188786+0000","last_became_active":"2024-09-12T17:27:42.436667+0000","last_became_peered":"2024-09-12T17:27:42.436667+0000","last_unstale":"2024-09-12T17:31:17.188786+0000","last_undegraded":"2024-09-12T17:31:17.188786+0000","last_fullsized":"2024-09-12T17:31:17.188786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-12T17:31:17.188564+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-12T17:31:17.188564+0000","last_clean_scrub_stamp":"2024-09-12T17:31:17.188564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:45.338606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:00.488993+0000","last_change":"2024-09-12T17:31:00.488993+0000","last_active":"2024-09-12T17:31:00.488993+0000","last_peered":"2024-09-12T17:31:00.488993+0000","last_clean":"2024-09-12T17:31:00.488993+0000","last_became_active":"2024-09-12T17:27:40.419472+0000","last_became_peered":"2024-09-12T17:27:40.419472+0000","last_unstale":"2024-09-12T17:31:00.488993+0000","last_undegraded":"2024-09-12T17:31:00.488993+0000","last_fullsized":"2024-09-12T17:31:00.488993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:00.488897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:00.488897+0000","last_clean_scrub_stamp":"2024-09-12T17:31:00.488897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:42.257433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:06.255527+0000","last_change":"2024-09-12T17:31:06.255467+0000","last_active":"2024-09-12T17:31:06.255527+0000","last_peered":"2024-09-12T17:31:06.255527+0000","last_clean":"2024-09-12T17:31:06.255527+0000","last_became_active":"2024-09-12T17:27:32.775344+0000","last_became_peered":"2024-09-12T17:27:32.775344+0000","last_unstale":"2024-09-12T17:31:06.255527+0000","last_undegraded":"2024-09-12T17:31:06.255527+0000","last_fullsized":"2024-09-12T17:31:06.255527+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:06.255380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:06.255380+0000","last_clean_scrub_stamp":"2024-09-12T17:31:06.255380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:58.712793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011343939999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:47.526576+0000","last_change":"2024-09-12T17:31:47.526576+0000","last_active":"2024-09-12T17:31:47.526576+0000","last_peered":"2024-09-12T17:31:47.526576+0000","last_clean":"2024-09-12T17:31:47.526576+0000","last_became_active":"2024-09-12T17:27:44.427519+0000","last_became_peered":"2024-09-12T17:27:44.427519+0000","last_unstale":"2024-09-12T17:31:47.526576+0000","last_undegraded":"2024-09-12T17:31:47.526576+0000","last_fullsized":"2024-09-12T17:31:47.526576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:47.526460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:47.526460+0000","last_clean_scrub_stamp":"2024-09-12T17:31:47.526460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:05.506192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"31'99","reported_seq":193,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:36.131450+0000","last_change":"2024-09-12T17:31:36.131379+0000","last_active":"2024-09-12T17:31:36.131450+0000","last_peered":"2024-09-12T17:31:36.131450+0000","last_clean":"2024-09-12T17:31:36.131450+0000","last_became_active":"2024-09-12T17:27:46.442154+0000","last_became_peered":"2024-09-12T17:27:46.442154+0000","last_unstale":"2024-09-12T17:31:36.131450+0000","last_undegraded":"2024-09-12T17:31:36.131450+0000","last_fullsized":"2024-09-12T17:31:36.131450+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'99","last_scrub_stamp":"2024-09-12T17:31:36.131282+0000","last_deep_scrub":"31'99","last_deep_scrub_stamp":"2024-09-12T17:31:36.131282+0000","last_clean_scrub_stamp":"2024-09-12T17:31:36.131282+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:32.789106+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:43.051537+0000","last_change":"2024-09-12T17:31:43.051486+0000","last_active":"2024-09-12T17:31:43.051537+0000","last_peered":"2024-09-12T17:31:43.051537+0000","last_clean":"2024-09-12T17:31:43.051537+0000","last_became_active":"2024-09-12T17:27:48.440177+0000","last_became_peered":"2024-09-12T17:27:48.440177+0000","last_unstale":"2024-09-12T17:31:43.051537+0000","last_undegraded":"2024-09-12T17:31:43.051537+0000","last_fullsized":"2024-09-12T17:31:43.051537+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:43.051387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:43.051387+0000","last_clean_scrub_stamp":"2024-09-12T17:31:43.051387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:19.689950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:54.306646+0000","last_change":"2024-09-12T17:31:54.306646+0000","last_active":"2024-09-12T17:31:54.306646+0000","last_peered":"2024-09-12T17:31:54.306646+0000","last_clean":"2024-09-12T17:31:54.306646+0000","last_became_active":"2024-09-12T17:27:50.453919+0000","last_became_peered":"2024-09-12T17:27:50.453919+0000","last_unstale":"2024-09-12T17:31:54.306646+0000","last_undegraded":"2024-09-12T17:31:54.306646+0000","last_fullsized":"2024-09-12T17:31:54.306646+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:54.306539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:54.306539+0000","last_clean_scrub_stamp":"2024-09-12T17:31:54.306539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:45.965830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:56.291919+0000","last_change":"2024-09-12T17:31:56.291840+0000","last_active":"2024-09-12T17:31:56.291919+0000","last_peered":"2024-09-12T17:31:56.291919+0000","last_clean":"2024-09-12T17:31:56.291919+0000","last_became_active":"2024-09-12T17:27:50.452190+0000","last_became_peered":"2024-09-12T17:27:50.452190+0000","last_unstale":"2024-09-12T17:31:56.291919+0000","last_undegraded":"2024-09-12T17:31:56.291919+0000","last_fullsized":"2024-09-12T17:31:56.291919+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:56.291760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:56.291760+0000","last_clean_scrub_stamp":"2024-09-12T17:31:56.291760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:32.123683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:21.214317+0000","last_change":"2024-09-12T17:31:21.214317+0000","last_active":"2024-09-12T17:31:21.214317+0000","last_peered":"2024-09-12T17:31:21.214317+0000","last_clean":"2024-09-12T17:31:21.214317+0000","last_became_active":"2024-09-12T17:27:42.436187+0000","last_became_peered":"2024-09-12T17:27:42.436187+0000","last_unstale":"2024-09-12T17:31:21.214317+0000","last_undegraded":"2024-09-12T17:31:21.214317+0000","last_fullsized":"2024-09-12T17:31:21.214317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:21.214230+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:21.214230+0000","last_clean_scrub_stamp":"2024-09-12T17:31:21.214230+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:42.216760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"29'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:16.370798+0000","last_change":"2024-09-12T17:31:16.370798+0000","last_active":"2024-09-12T17:31:16.370798+0000","last_peered":"2024-09-12T17:31:16.370798+0000","last_clean":"2024-09-12T17:31:16.370798+0000","last_became_active":"2024-09-12T17:27:40.428529+0000","last_became_peered":"2024-09-12T17:27:40.428529+0000","last_unstale":"2024-09-12T17:31:16.370798+0000","last_undegraded":"2024-09-12T17:31:16.370798+0000","last_fullsized":"2024-09-12T17:31:16.370798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-12T17:31:16.370693+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-12T17:31:16.370693+0000","last_clean_scrub_stamp":"2024-09-12T17:31:16.370693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:11.675892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:35.281115+0000","last_change":"2024-09-12T17:31:35.281115+0000","last_active":"2024-09-12T17:31:35.281115+0000","last_peered":"2024-09-12T17:31:35.281115+0000","last_clean":"2024-09-12T17:31:35.281115+0000","last_became_active":"2024-09-12T17:27:44.429701+0000","last_became_peered":"2024-09-12T17:27:44.429701+0000","last_unstale":"2024-09-12T17:31:35.281115+0000","last_undegraded":"2024-09-12T17:31:35.281115+0000","last_fullsized":"2024-09-12T17:31:35.281115+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:35.281006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:35.281006+0000","last_clean_scrub_stamp":"2024-09-12T17:31:35.281006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:44.156197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"31'35","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.831082+0000","last_change":"2024-09-12T17:27:46.443026+0000","last_active":"2024-09-12T17:30:56.831082+0000","last_peered":"2024-09-12T17:30:56.831082+0000","last_clean":"2024-09-12T17:30:56.831082+0000","last_became_active":"2024-09-12T17:27:46.442713+0000","last_became_peered":"2024-09-12T17:27:46.442713+0000","last_unstale":"2024-09-12T17:30:56.831082+0000","last_undegraded":"2024-09-12T17:30:56.831082+0000","last_fullsized":"2024-09-12T17:30:56.831082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:29.878441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463885+0000","last_change":"2024-09-12T17:27:48.450563+0000","last_active":"2024-09-12T17:28:21.463885+0000","last_peered":"2024-09-12T17:28:21.463885+0000","last_clean":"2024-09-12T17:28:21.463885+0000","last_became_active":"2024-09-12T17:27:48.450050+0000","last_became_peered":"2024-09-12T17:27:48.450050+0000","last_unstale":"2024-09-12T17:28:21.463885+0000","last_undegraded":"2024-09-12T17:28:21.463885+0000","last_fullsized":"2024-09-12T17:28:21.463885+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:37.430305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"31'5","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.757591+0000","last_change":"2024-09-12T17:27:50.453680+0000","last_active":"2024-09-12T17:29:49.757591+0000","last_peered":"2024-09-12T17:29:49.757591+0000","last_clean":"2024-09-12T17:29:49.757591+0000","last_became_active":"2024-09-12T17:27:50.453382+0000","last_became_peered":"2024-09-12T17:27:50.453382+0000","last_unstale":"2024-09-12T17:29:49.757591+0000","last_undegraded":"2024-09-12T17:29:49.757591+0000","last_fullsized":"2024-09-12T17:29:49.757591+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"31'8","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:19.332207+0000","last_change":"2024-09-12T17:31:19.332207+0000","last_active":"2024-09-12T17:31:19.332207+0000","last_peered":"2024-09-12T17:31:19.332207+0000","last_clean":"2024-09-12T17:31:19.332207+0000","last_became_active":"2024-09-12T17:27:42.436150+0000","last_became_peered":"2024-09-12T17:27:42.436150+0000","last_unstale":"2024-09-12T17:31:19.332207+0000","last_undegraded":"2024-09-12T17:31:19.332207+0000","last_fullsized":"2024-09-12T17:31:19.332207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:19.332119+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:19.332119+0000","last_clean_scrub_stamp":"2024-09-12T17:31:19.332119+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:45.819987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:07.073417+0000","last_change":"2024-09-12T17:31:07.073417+0000","last_active":"2024-09-12T17:31:07.073417+0000","last_peered":"2024-09-12T17:31:07.073417+0000","last_clean":"2024-09-12T17:31:07.073417+0000","last_became_active":"2024-09-12T17:27:40.431962+0000","last_became_peered":"2024-09-12T17:27:40.431962+0000","last_unstale":"2024-09-12T17:31:07.073417+0000","last_undegraded":"2024-09-12T17:31:07.073417+0000","last_fullsized":"2024-09-12T17:31:07.073417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:07.073320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:07.073320+0000","last_clean_scrub_stamp":"2024-09-12T17:31:07.073320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:17.908445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:53.455763+0000","last_change":"2024-09-12T17:31:53.455763+0000","last_active":"2024-09-12T17:31:53.455763+0000","last_peered":"2024-09-12T17:31:53.455763+0000","last_clean":"2024-09-12T17:31:53.455763+0000","last_became_active":"2024-09-12T17:27:44.432334+0000","last_became_peered":"2024-09-12T17:27:44.432334+0000","last_unstale":"2024-09-12T17:31:53.455763+0000","last_undegraded":"2024-09-12T17:31:53.455763+0000","last_fullsized":"2024-09-12T17:31:53.455763+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:53.455655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:53.455655+0000","last_clean_scrub_stamp":"2024-09-12T17:31:53.455655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:19.517675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"31'9","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:40.960920+0000","last_change":"2024-09-12T17:31:40.960920+0000","last_active":"2024-09-12T17:31:40.960920+0000","last_peered":"2024-09-12T17:31:40.960920+0000","last_clean":"2024-09-12T17:31:40.960920+0000","last_became_active":"2024-09-12T17:27:46.435567+0000","last_became_peered":"2024-09-12T17:27:46.435567+0000","last_unstale":"2024-09-12T17:31:40.960920+0000","last_undegraded":"2024-09-12T17:31:40.960920+0000","last_fullsized":"2024-09-12T17:31:40.960920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'9","last_scrub_stamp":"2024-09-12T17:31:40.960798+0000","last_deep_scrub":"31'9","last_deep_scrub_stamp":"2024-09-12T17:31:40.960798+0000","last_clean_scrub_stamp":"2024-09-12T17:31:40.960798+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:35.681474+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:47.260045+0000","last_change":"2024-09-12T17:31:47.260045+0000","last_active":"2024-09-12T17:31:47.260045+0000","last_peered":"2024-09-12T17:31:47.260045+0000","last_clean":"2024-09-12T17:31:47.260045+0000","last_became_active":"2024-09-12T17:27:48.448478+0000","last_became_peered":"2024-09-12T17:27:48.448478+0000","last_unstale":"2024-09-12T17:31:47.260045+0000","last_undegraded":"2024-09-12T17:31:47.260045+0000","last_fullsized":"2024-09-12T17:31:47.260045+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:47.259949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:47.259949+0000","last_clean_scrub_stamp":"2024-09-12T17:31:47.259949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:53.333564+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"31'8","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:22.316873+0000","last_change":"2024-09-12T17:27:50.449599+0000","last_active":"2024-09-12T17:28:22.316873+0000","last_peered":"2024-09-12T17:28:22.316873+0000","last_clean":"2024-09-12T17:28:22.316873+0000","last_became_active":"2024-09-12T17:27:50.449302+0000","last_became_peered":"2024-09-12T17:27:50.449302+0000","last_unstale":"2024-09-12T17:28:22.316873+0000","last_undegraded":"2024-09-12T17:28:22.316873+0000","last_fullsized":"2024-09-12T17:28:22.316873+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:02.835518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"31'4","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:17.849853+0000","last_change":"2024-09-12T17:31:17.849853+0000","last_active":"2024-09-12T17:31:17.849853+0000","last_peered":"2024-09-12T17:31:17.849853+0000","last_clean":"2024-09-12T17:31:17.849853+0000","last_became_active":"2024-09-12T17:27:42.423974+0000","last_became_peered":"2024-09-12T17:27:42.423974+0000","last_unstale":"2024-09-12T17:31:17.849853+0000","last_undegraded":"2024-09-12T17:31:17.849853+0000","last_fullsized":"2024-09-12T17:31:17.849853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:17.849764+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:17.849764+0000","last_clean_scrub_stamp":"2024-09-12T17:31:17.849764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:32.821977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:08.073247+0000","last_change":"2024-09-12T17:31:08.073247+0000","last_active":"2024-09-12T17:31:08.073247+0000","last_peered":"2024-09-12T17:31:08.073247+0000","last_clean":"2024-09-12T17:31:08.073247+0000","last_became_active":"2024-09-12T17:27:40.430154+0000","last_became_peered":"2024-09-12T17:27:40.430154+0000","last_unstale":"2024-09-12T17:31:08.073247+0000","last_undegraded":"2024-09-12T17:31:08.073247+0000","last_fullsized":"2024-09-12T17:31:08.073247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:08.073165+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:08.073165+0000","last_clean_scrub_stamp":"2024-09-12T17:31:08.073165+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:18.392407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:32.133092+0000","last_change":"2024-09-12T17:31:32.133092+0000","last_active":"2024-09-12T17:31:32.133092+0000","last_peered":"2024-09-12T17:31:32.133092+0000","last_clean":"2024-09-12T17:31:32.133092+0000","last_became_active":"2024-09-12T17:27:44.434979+0000","last_became_peered":"2024-09-12T17:27:44.434979+0000","last_unstale":"2024-09-12T17:31:32.133092+0000","last_undegraded":"2024-09-12T17:31:32.133092+0000","last_fullsized":"2024-09-12T17:31:32.133092+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:32.133012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:32.133012+0000","last_clean_scrub_stamp":"2024-09-12T17:31:32.133012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:49.764890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"31'49","reported_seq":121,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:37.924314+0000","last_change":"2024-09-12T17:31:37.924314+0000","last_active":"2024-09-12T17:31:37.924314+0000","last_peered":"2024-09-12T17:31:37.924314+0000","last_clean":"2024-09-12T17:31:37.924314+0000","last_became_active":"2024-09-12T17:27:46.433421+0000","last_became_peered":"2024-09-12T17:27:46.433421+0000","last_unstale":"2024-09-12T17:31:37.924314+0000","last_undegraded":"2024-09-12T17:31:37.924314+0000","last_fullsized":"2024-09-12T17:31:37.924314+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'49","last_scrub_stamp":"2024-09-12T17:31:37.924209+0000","last_deep_scrub":"31'49","last_deep_scrub_stamp":"2024-09-12T17:31:37.924209+0000","last_clean_scrub_stamp":"2024-09-12T17:31:37.924209+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:04.705594+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:48.208432+0000","last_change":"2024-09-12T17:31:48.208432+0000","last_active":"2024-09-12T17:31:48.208432+0000","last_peered":"2024-09-12T17:31:48.208432+0000","last_clean":"2024-09-12T17:31:48.208432+0000","last_became_active":"2024-09-12T17:27:48.439547+0000","last_became_peered":"2024-09-12T17:27:48.439547+0000","last_unstale":"2024-09-12T17:31:48.208432+0000","last_undegraded":"2024-09-12T17:31:48.208432+0000","last_fullsized":"2024-09-12T17:31:48.208432+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:48.208342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:48.208342+0000","last_clean_scrub_stamp":"2024-09-12T17:31:48.208342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:31.937432+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464221+0000","last_change":"2024-09-12T17:27:50.459594+0000","last_active":"2024-09-12T17:28:21.464221+0000","last_peered":"2024-09-12T17:28:21.464221+0000","last_clean":"2024-09-12T17:28:21.464221+0000","last_became_active":"2024-09-12T17:27:50.459321+0000","last_became_peered":"2024-09-12T17:27:50.459321+0000","last_unstale":"2024-09-12T17:28:21.464221+0000","last_undegraded":"2024-09-12T17:28:21.464221+0000","last_fullsized":"2024-09-12T17:28:21.464221+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:42.428839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"31'14","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:34.471584+0000","last_change":"2024-09-12T17:31:34.471584+0000","last_active":"2024-09-12T17:31:34.471584+0000","last_peered":"2024-09-12T17:31:34.471584+0000","last_clean":"2024-09-12T17:31:34.471584+0000","last_became_active":"2024-09-12T17:27:42.428364+0000","last_became_peered":"2024-09-12T17:27:42.428364+0000","last_unstale":"2024-09-12T17:31:34.471584+0000","last_undegraded":"2024-09-12T17:31:34.471584+0000","last_fullsized":"2024-09-12T17:31:34.471584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-12T17:31:34.471505+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-12T17:31:34.471505+0000","last_clean_scrub_stamp":"2024-09-12T17:31:34.471505+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:39.907822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:03.411106+0000","last_change":"2024-09-12T17:31:03.411106+0000","last_active":"2024-09-12T17:31:03.411106+0000","last_peered":"2024-09-12T17:31:03.411106+0000","last_clean":"2024-09-12T17:31:03.411106+0000","last_became_active":"2024-09-12T17:27:40.415212+0000","last_became_peered":"2024-09-12T17:27:40.415212+0000","last_unstale":"2024-09-12T17:31:03.411106+0000","last_undegraded":"2024-09-12T17:31:03.411106+0000","last_fullsized":"2024-09-12T17:31:03.411106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:03.411027+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:03.411027+0000","last_clean_scrub_stamp":"2024-09-12T17:31:03.411027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:42.311815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:52.479581+0000","last_change":"2024-09-12T17:31:52.479581+0000","last_active":"2024-09-12T17:31:52.479581+0000","last_peered":"2024-09-12T17:31:52.479581+0000","last_clean":"2024-09-12T17:31:52.479581+0000","last_became_active":"2024-09-12T17:27:44.429844+0000","last_became_peered":"2024-09-12T17:27:44.429844+0000","last_unstale":"2024-09-12T17:31:52.479581+0000","last_undegraded":"2024-09-12T17:31:52.479581+0000","last_fullsized":"2024-09-12T17:31:52.479581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:52.479482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:52.479482+0000","last_clean_scrub_stamp":"2024-09-12T17:31:52.479482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:16.636626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"31'38","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:41.161165+0000","last_change":"2024-09-12T17:31:41.161165+0000","last_active":"2024-09-12T17:31:41.161165+0000","last_peered":"2024-09-12T17:31:41.161165+0000","last_clean":"2024-09-12T17:31:41.161165+0000","last_became_active":"2024-09-12T17:27:46.432650+0000","last_became_peered":"2024-09-12T17:27:46.432650+0000","last_unstale":"2024-09-12T17:31:41.161165+0000","last_undegraded":"2024-09-12T17:31:41.161165+0000","last_fullsized":"2024-09-12T17:31:41.161165+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'38","last_scrub_stamp":"2024-09-12T17:31:41.161056+0000","last_deep_scrub":"31'38","last_deep_scrub_stamp":"2024-09-12T17:31:41.161056+0000","last_clean_scrub_stamp":"2024-09-12T17:31:41.161056+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:32.306377+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:48.210555+0000","last_change":"2024-09-12T17:31:48.210555+0000","last_active":"2024-09-12T17:31:48.210555+0000","last_peered":"2024-09-12T17:31:48.210555+0000","last_clean":"2024-09-12T17:31:48.210555+0000","last_became_active":"2024-09-12T17:27:48.439134+0000","last_became_peered":"2024-09-12T17:27:48.439134+0000","last_unstale":"2024-09-12T17:31:48.210555+0000","last_undegraded":"2024-09-12T17:31:48.210555+0000","last_fullsized":"2024-09-12T17:31:48.210555+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:48.210467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:48.210467+0000","last_clean_scrub_stamp":"2024-09-12T17:31:48.210467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:00.748017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:38.470924+0000","last_change":"2024-09-12T17:31:38.470826+0000","last_active":"2024-09-12T17:31:38.470924+0000","last_peered":"2024-09-12T17:31:38.470924+0000","last_clean":"2024-09-12T17:31:38.470924+0000","last_became_active":"2024-09-12T17:27:42.426108+0000","last_became_peered":"2024-09-12T17:27:42.426108+0000","last_unstale":"2024-09-12T17:31:38.470924+0000","last_undegraded":"2024-09-12T17:31:38.470924+0000","last_fullsized":"2024-09-12T17:31:38.470924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:38.470744+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:38.470744+0000","last_clean_scrub_stamp":"2024-09-12T17:31:38.470744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:20.220207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:13.378936+0000","last_change":"2024-09-12T17:31:13.378936+0000","last_active":"2024-09-12T17:31:13.378936+0000","last_peered":"2024-09-12T17:31:13.378936+0000","last_clean":"2024-09-12T17:31:13.378936+0000","last_became_active":"2024-09-12T17:27:40.429644+0000","last_became_peered":"2024-09-12T17:27:40.429644+0000","last_unstale":"2024-09-12T17:31:13.378936+0000","last_undegraded":"2024-09-12T17:31:13.378936+0000","last_fullsized":"2024-09-12T17:31:13.378936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:13.378812+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:13.378812+0000","last_clean_scrub_stamp":"2024-09-12T17:31:13.378812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:25.356806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:35.136034+0000","last_change":"2024-09-12T17:31:35.136034+0000","last_active":"2024-09-12T17:31:35.136034+0000","last_peered":"2024-09-12T17:31:35.136034+0000","last_clean":"2024-09-12T17:31:35.136034+0000","last_became_active":"2024-09-12T17:28:21.471678+0000","last_became_peered":"2024-09-12T17:28:21.471678+0000","last_unstale":"2024-09-12T17:31:35.136034+0000","last_undegraded":"2024-09-12T17:31:35.136034+0000","last_fullsized":"2024-09-12T17:31:35.136034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:35.135955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:35.135955+0000","last_clean_scrub_stamp":"2024-09-12T17:31:35.135955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:53.779707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"31'66","reported_seq":139,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:38.968939+0000","last_change":"2024-09-12T17:31:38.968939+0000","last_active":"2024-09-12T17:31:38.968939+0000","last_peered":"2024-09-12T17:31:38.968939+0000","last_clean":"2024-09-12T17:31:38.968939+0000","last_became_active":"2024-09-12T17:27:46.437623+0000","last_became_peered":"2024-09-12T17:27:46.437623+0000","last_unstale":"2024-09-12T17:31:38.968939+0000","last_undegraded":"2024-09-12T17:31:38.968939+0000","last_fullsized":"2024-09-12T17:31:38.968939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'66","last_scrub_stamp":"2024-09-12T17:31:38.968815+0000","last_deep_scrub":"31'66","last_deep_scrub_stamp":"2024-09-12T17:31:38.968815+0000","last_clean_scrub_stamp":"2024-09-12T17:31:38.968815+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:48.067615+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:49.239074+0000","last_change":"2024-09-12T17:31:49.239074+0000","last_active":"2024-09-12T17:31:49.239074+0000","last_peered":"2024-09-12T17:31:49.239074+0000","last_clean":"2024-09-12T17:31:49.239074+0000","last_became_active":"2024-09-12T17:27:48.440354+0000","last_became_peered":"2024-09-12T17:27:48.440354+0000","last_unstale":"2024-09-12T17:31:49.239074+0000","last_undegraded":"2024-09-12T17:31:49.239074+0000","last_fullsized":"2024-09-12T17:31:49.239074+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:49.238996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:49.238996+0000","last_clean_scrub_stamp":"2024-09-12T17:31:49.238996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:20.420319+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"31'14","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:57.126688+0000","last_change":"2024-09-12T17:31:57.126688+0000","last_active":"2024-09-12T17:31:57.126688+0000","last_peered":"2024-09-12T17:31:57.126688+0000","last_clean":"2024-09-12T17:31:57.126688+0000","last_became_active":"2024-09-12T17:27:50.457744+0000","last_became_peered":"2024-09-12T17:27:50.457744+0000","last_unstale":"2024-09-12T17:31:57.126688+0000","last_undegraded":"2024-09-12T17:31:57.126688+0000","last_fullsized":"2024-09-12T17:31:57.126688+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-12T17:31:57.126597+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-12T17:31:57.126597+0000","last_clean_scrub_stamp":"2024-09-12T17:31:57.126597+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:42.203786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"31'6","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:21.836167+0000","last_change":"2024-09-12T17:31:21.836070+0000","last_active":"2024-09-12T17:31:21.836167+0000","last_peered":"2024-09-12T17:31:21.836167+0000","last_clean":"2024-09-12T17:31:21.836167+0000","last_became_active":"2024-09-12T17:27:42.424447+0000","last_became_peered":"2024-09-12T17:27:42.424447+0000","last_unstale":"2024-09-12T17:31:21.836167+0000","last_undegraded":"2024-09-12T17:31:21.836167+0000","last_fullsized":"2024-09-12T17:31:21.836167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-12T17:31:21.835987+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-12T17:31:21.835987+0000","last_clean_scrub_stamp":"2024-09-12T17:31:21.835987+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:40.479739+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:04.363963+0000","last_change":"2024-09-12T17:31:04.363963+0000","last_active":"2024-09-12T17:31:04.363963+0000","last_peered":"2024-09-12T17:31:04.363963+0000","last_clean":"2024-09-12T17:31:04.363963+0000","last_became_active":"2024-09-12T17:27:40.414911+0000","last_became_peered":"2024-09-12T17:27:40.414911+0000","last_unstale":"2024-09-12T17:31:04.363963+0000","last_undegraded":"2024-09-12T17:31:04.363963+0000","last_fullsized":"2024-09-12T17:31:04.363963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:04.363875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:04.363875+0000","last_clean_scrub_stamp":"2024-09-12T17:31:04.363875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:31.145785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"31'5","reported_seq":239,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:37.091750+0000","last_change":"2024-09-12T17:31:37.091674+0000","last_active":"2024-09-12T17:31:37.091750+0000","last_peered":"2024-09-12T17:31:37.091750+0000","last_clean":"2024-09-12T17:31:37.091750+0000","last_became_active":"2024-09-12T17:27:44.427778+0000","last_became_peered":"2024-09-12T17:27:44.427778+0000","last_unstale":"2024-09-12T17:31:37.091750+0000","last_undegraded":"2024-09-12T17:31:37.091750+0000","last_fullsized":"2024-09-12T17:31:37.091750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-09-12T17:31:37.091588+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-09-12T17:31:37.091588+0000","last_clean_scrub_stamp":"2024-09-12T17:31:37.091588+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:14.070741+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"31'39","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.895653+0000","last_change":"2024-09-12T17:27:46.440779+0000","last_active":"2024-09-12T17:30:56.895653+0000","last_peered":"2024-09-12T17:30:56.895653+0000","last_clean":"2024-09-12T17:30:56.895653+0000","last_became_active":"2024-09-12T17:27:46.440494+0000","last_became_peered":"2024-09-12T17:27:46.440494+0000","last_unstale":"2024-09-12T17:30:56.895653+0000","last_undegraded":"2024-09-12T17:30:56.895653+0000","last_fullsized":"2024-09-12T17:30:56.895653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:43.434855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:51.230116+0000","last_change":"2024-09-12T17:31:51.230116+0000","last_active":"2024-09-12T17:31:51.230116+0000","last_peered":"2024-09-12T17:31:51.230116+0000","last_clean":"2024-09-12T17:31:51.230116+0000","last_became_active":"2024-09-12T17:27:48.448871+0000","last_became_peered":"2024-09-12T17:27:48.448871+0000","last_unstale":"2024-09-12T17:31:51.230116+0000","last_undegraded":"2024-09-12T17:31:51.230116+0000","last_fullsized":"2024-09-12T17:31:51.230116+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:51.230024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:51.230024+0000","last_clean_scrub_stamp":"2024-09-12T17:31:51.230024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:45.840129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463074+0000","last_change":"2024-09-12T17:27:50.452011+0000","last_active":"2024-09-12T17:28:21.463074+0000","last_peered":"2024-09-12T17:28:21.463074+0000","last_clean":"2024-09-12T17:28:21.463074+0000","last_became_active":"2024-09-12T17:27:50.451678+0000","last_became_peered":"2024-09-12T17:27:50.451678+0000","last_unstale":"2024-09-12T17:28:21.463074+0000","last_undegraded":"2024-09-12T17:28:21.463074+0000","last_fullsized":"2024-09-12T17:28:21.463074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:15.594880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:37.437437+0000","last_change":"2024-09-12T17:31:37.437437+0000","last_active":"2024-09-12T17:31:37.437437+0000","last_peered":"2024-09-12T17:31:37.437437+0000","last_clean":"2024-09-12T17:31:37.437437+0000","last_became_active":"2024-09-12T17:27:42.438583+0000","last_became_peered":"2024-09-12T17:27:42.438583+0000","last_unstale":"2024-09-12T17:31:37.437437+0000","last_undegraded":"2024-09-12T17:31:37.437437+0000","last_fullsized":"2024-09-12T17:31:37.437437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:37.437341+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:37.437341+0000","last_clean_scrub_stamp":"2024-09-12T17:31:37.437341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:18.893026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:05.381633+0000","last_change":"2024-09-12T17:31:05.381633+0000","last_active":"2024-09-12T17:31:05.381633+0000","last_peered":"2024-09-12T17:31:05.381633+0000","last_clean":"2024-09-12T17:31:05.381633+0000","last_became_active":"2024-09-12T17:27:40.414034+0000","last_became_peered":"2024-09-12T17:27:40.414034+0000","last_unstale":"2024-09-12T17:31:05.381633+0000","last_undegraded":"2024-09-12T17:31:05.381633+0000","last_fullsized":"2024-09-12T17:31:05.381633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:05.381510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:05.381510+0000","last_clean_scrub_stamp":"2024-09-12T17:31:05.381510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:28.239447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:34.127651+0000","last_change":"2024-09-12T17:31:34.127651+0000","last_active":"2024-09-12T17:31:34.127651+0000","last_peered":"2024-09-12T17:31:34.127651+0000","last_clean":"2024-09-12T17:31:34.127651+0000","last_became_active":"2024-09-12T17:27:44.426927+0000","last_became_peered":"2024-09-12T17:27:44.426927+0000","last_unstale":"2024-09-12T17:31:34.127651+0000","last_undegraded":"2024-09-12T17:31:34.127651+0000","last_fullsized":"2024-09-12T17:31:34.127651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:34.127561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:34.127561+0000","last_clean_scrub_stamp":"2024-09-12T17:31:34.127561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:41.075392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"31'40","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:39.963017+0000","last_change":"2024-09-12T17:31:39.962935+0000","last_active":"2024-09-12T17:31:39.963017+0000","last_peered":"2024-09-12T17:31:39.963017+0000","last_clean":"2024-09-12T17:31:39.963017+0000","last_became_active":"2024-09-12T17:27:46.438778+0000","last_became_peered":"2024-09-12T17:27:46.438778+0000","last_unstale":"2024-09-12T17:31:39.963017+0000","last_undegraded":"2024-09-12T17:31:39.963017+0000","last_fullsized":"2024-09-12T17:31:39.963017+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'40","last_scrub_stamp":"2024-09-12T17:31:39.962824+0000","last_deep_scrub":"31'40","last_deep_scrub_stamp":"2024-09-12T17:31:39.962824+0000","last_clean_scrub_stamp":"2024-09-12T17:31:39.962824+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:02.114783+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:51.100050+0000","last_change":"2024-09-12T17:31:51.100050+0000","last_active":"2024-09-12T17:31:51.100050+0000","last_peered":"2024-09-12T17:31:51.100050+0000","last_clean":"2024-09-12T17:31:51.100050+0000","last_became_active":"2024-09-12T17:27:48.439888+0000","last_became_peered":"2024-09-12T17:27:48.439888+0000","last_unstale":"2024-09-12T17:31:51.100050+0000","last_undegraded":"2024-09-12T17:31:51.100050+0000","last_fullsized":"2024-09-12T17:31:51.100050+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:51.099939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:51.099939+0000","last_clean_scrub_stamp":"2024-09-12T17:31:51.099939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:51.957679+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"31'3","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.072631+0000","last_change":"2024-09-12T17:27:50.455406+0000","last_active":"2024-09-12T17:29:49.072631+0000","last_peered":"2024-09-12T17:29:49.072631+0000","last_clean":"2024-09-12T17:29:49.072631+0000","last_became_active":"2024-09-12T17:27:50.454058+0000","last_became_peered":"2024-09-12T17:27:50.454058+0000","last_unstale":"2024-09-12T17:29:49.072631+0000","last_undegraded":"2024-09-12T17:29:49.072631+0000","last_fullsized":"2024-09-12T17:29:49.072631+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:44.719122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"31'6","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:19.793825+0000","last_change":"2024-09-12T17:31:19.793825+0000","last_active":"2024-09-12T17:31:19.793825+0000","last_peered":"2024-09-12T17:31:19.793825+0000","last_clean":"2024-09-12T17:31:19.793825+0000","last_became_active":"2024-09-12T17:27:42.428236+0000","last_became_peered":"2024-09-12T17:27:42.428236+0000","last_unstale":"2024-09-12T17:31:19.793825+0000","last_undegraded":"2024-09-12T17:31:19.793825+0000","last_fullsized":"2024-09-12T17:31:19.793825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-12T17:31:19.793741+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-12T17:31:19.793741+0000","last_clean_scrub_stamp":"2024-09-12T17:31:19.793741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:09.004133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"31'6","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:17.402187+0000","last_change":"2024-09-12T17:31:17.402187+0000","last_active":"2024-09-12T17:31:17.402187+0000","last_peered":"2024-09-12T17:31:17.402187+0000","last_clean":"2024-09-12T17:31:17.402187+0000","last_became_active":"2024-09-12T17:27:40.428969+0000","last_became_peered":"2024-09-12T17:27:40.428969+0000","last_unstale":"2024-09-12T17:31:17.402187+0000","last_undegraded":"2024-09-12T17:31:17.402187+0000","last_fullsized":"2024-09-12T17:31:17.402187+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-12T17:31:17.402103+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-12T17:31:17.402103+0000","last_clean_scrub_stamp":"2024-09-12T17:31:17.402103+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:02:26.841712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":14,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:38.208867+0000","last_change":"2024-09-12T17:31:38.208867+0000","last_active":"2024-09-12T17:31:38.208867+0000","last_peered":"2024-09-12T17:31:38.208867+0000","last_clean":"2024-09-12T17:31:38.208867+0000","last_became_active":"2024-09-12T17:27:44.432609+0000","last_became_peered":"2024-09-12T17:27:44.432609+0000","last_unstale":"2024-09-12T17:31:38.208867+0000","last_undegraded":"2024-09-12T17:31:38.208867+0000","last_fullsized":"2024-09-12T17:31:38.208867+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:38.208779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:38.208779+0000","last_clean_scrub_stamp":"2024-09-12T17:31:38.208779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:52.480217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"29'10","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:45.764615+0000","last_change":"2024-09-12T17:27:46.445145+0000","last_active":"2024-09-12T17:29:45.764615+0000","last_peered":"2024-09-12T17:29:45.764615+0000","last_clean":"2024-09-12T17:29:45.764615+0000","last_became_active":"2024-09-12T17:27:46.444644+0000","last_became_peered":"2024-09-12T17:27:46.444644+0000","last_unstale":"2024-09-12T17:29:45.764615+0000","last_undegraded":"2024-09-12T17:29:45.764615+0000","last_fullsized":"2024-09-12T17:29:45.764615+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"31'286","reported_seq":384,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:50.249180+0000","last_change":"2024-09-12T17:31:50.249117+0000","last_active":"2024-09-12T17:31:50.249180+0000","last_peered":"2024-09-12T17:31:50.249180+0000","last_clean":"2024-09-12T17:31:50.249180+0000","last_became_active":"2024-09-12T17:27:48.449138+0000","last_became_peered":"2024-09-12T17:27:48.449138+0000","last_unstale":"2024-09-12T17:31:50.249180+0000","last_undegraded":"2024-09-12T17:31:50.249180+0000","last_fullsized":"2024-09-12T17:31:50.249180+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'286","last_scrub_stamp":"2024-09-12T17:31:50.249038+0000","last_deep_scrub":"31'286","last_deep_scrub_stamp":"2024-09-12T17:31:50.249038+0000","last_clean_scrub_stamp":"2024-09-12T17:31:50.249038+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:01.178281+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.462765+0000","last_change":"2024-09-12T17:27:50.452165+0000","last_active":"2024-09-12T17:28:21.462765+0000","last_peered":"2024-09-12T17:28:21.462765+0000","last_clean":"2024-09-12T17:28:21.462765+0000","last_became_active":"2024-09-12T17:27:50.451899+0000","last_became_peered":"2024-09-12T17:27:50.451899+0000","last_unstale":"2024-09-12T17:28:21.462765+0000","last_undegraded":"2024-09-12T17:28:21.462765+0000","last_fullsized":"2024-09-12T17:28:21.462765+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:38.778216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"31'8","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:25.227409+0000","last_change":"2024-09-12T17:31:25.227409+0000","last_active":"2024-09-12T17:31:25.227409+0000","last_peered":"2024-09-12T17:31:25.227409+0000","last_clean":"2024-09-12T17:31:25.227409+0000","last_became_active":"2024-09-12T17:27:42.430110+0000","last_became_peered":"2024-09-12T17:27:42.430110+0000","last_unstale":"2024-09-12T17:31:25.227409+0000","last_undegraded":"2024-09-12T17:31:25.227409+0000","last_fullsized":"2024-09-12T17:31:25.227409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:25.227313+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:25.227313+0000","last_clean_scrub_stamp":"2024-09-12T17:31:25.227313+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:17.103312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:06.345680+0000","last_change":"2024-09-12T17:31:06.345680+0000","last_active":"2024-09-12T17:31:06.345680+0000","last_peered":"2024-09-12T17:31:06.345680+0000","last_clean":"2024-09-12T17:31:06.345680+0000","last_became_active":"2024-09-12T17:27:40.415018+0000","last_became_peered":"2024-09-12T17:27:40.415018+0000","last_unstale":"2024-09-12T17:31:06.345680+0000","last_undegraded":"2024-09-12T17:31:06.345680+0000","last_fullsized":"2024-09-12T17:31:06.345680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:06.345593+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:06.345593+0000","last_clean_scrub_stamp":"2024-09-12T17:31:06.345593+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:34.495634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:37.210915+0000","last_change":"2024-09-12T17:31:37.210915+0000","last_active":"2024-09-12T17:31:37.210915+0000","last_peered":"2024-09-12T17:31:37.210915+0000","last_clean":"2024-09-12T17:31:37.210915+0000","last_became_active":"2024-09-12T17:27:44.432389+0000","last_became_peered":"2024-09-12T17:27:44.432389+0000","last_unstale":"2024-09-12T17:31:37.210915+0000","last_undegraded":"2024-09-12T17:31:37.210915+0000","last_fullsized":"2024-09-12T17:31:37.210915+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:37.210810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:37.210810+0000","last_clean_scrub_stamp":"2024-09-12T17:31:37.210810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:49.748361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"31'46","reported_seq":104,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:45.208276+0000","last_change":"2024-09-12T17:31:45.208276+0000","last_active":"2024-09-12T17:31:45.208276+0000","last_peered":"2024-09-12T17:31:45.208276+0000","last_clean":"2024-09-12T17:31:45.208276+0000","last_became_active":"2024-09-12T17:27:46.435056+0000","last_became_peered":"2024-09-12T17:27:46.435056+0000","last_unstale":"2024-09-12T17:31:45.208276+0000","last_undegraded":"2024-09-12T17:31:45.208276+0000","last_fullsized":"2024-09-12T17:31:45.208276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2024-09-12T17:31:45.208179+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2024-09-12T17:31:45.208179+0000","last_clean_scrub_stamp":"2024-09-12T17:31:45.208179+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:21.846742+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:54.119551+0000","last_change":"2024-09-12T17:31:54.119551+0000","last_active":"2024-09-12T17:31:54.119551+0000","last_peered":"2024-09-12T17:31:54.119551+0000","last_clean":"2024-09-12T17:31:54.119551+0000","last_became_active":"2024-09-12T17:27:48.451143+0000","last_became_peered":"2024-09-12T17:27:48.451143+0000","last_unstale":"2024-09-12T17:31:54.119551+0000","last_undegraded":"2024-09-12T17:31:54.119551+0000","last_fullsized":"2024-09-12T17:31:54.119551+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:54.119464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:54.119464+0000","last_clean_scrub_stamp":"2024-09-12T17:31:54.119464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:50.067210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:56.264451+0000","last_change":"2024-09-12T17:31:56.264451+0000","last_active":"2024-09-12T17:31:56.264451+0000","last_peered":"2024-09-12T17:31:56.264451+0000","last_clean":"2024-09-12T17:31:56.264451+0000","last_became_active":"2024-09-12T17:27:50.458688+0000","last_became_peered":"2024-09-12T17:27:50.458688+0000","last_unstale":"2024-09-12T17:31:56.264451+0000","last_undegraded":"2024-09-12T17:31:56.264451+0000","last_fullsized":"2024-09-12T17:31:56.264451+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:56.264368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:56.264368+0000","last_clean_scrub_stamp":"2024-09-12T17:31:56.264368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:54.541983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'18","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:24.239641+0000","last_change":"2024-09-12T17:31:24.239641+0000","last_active":"2024-09-12T17:31:24.239641+0000","last_peered":"2024-09-12T17:31:24.239641+0000","last_clean":"2024-09-12T17:31:24.239641+0000","last_became_active":"2024-09-12T17:27:42.429645+0000","last_became_peered":"2024-09-12T17:27:42.429645+0000","last_unstale":"2024-09-12T17:31:24.239641+0000","last_undegraded":"2024-09-12T17:31:24.239641+0000","last_fullsized":"2024-09-12T17:31:24.239641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'18","last_scrub_stamp":"2024-09-12T17:31:24.239557+0000","last_deep_scrub":"31'18","last_deep_scrub_stamp":"2024-09-12T17:31:24.239557+0000","last_clean_scrub_stamp":"2024-09-12T17:31:24.239557+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:16.223898+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":59,"num_read_kb":51,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:18.401497+0000","last_change":"2024-09-12T17:31:18.401497+0000","last_active":"2024-09-12T17:31:18.401497+0000","last_peered":"2024-09-12T17:31:18.401497+0000","last_clean":"2024-09-12T17:31:18.401497+0000","last_became_active":"2024-09-12T17:27:40.433580+0000","last_became_peered":"2024-09-12T17:27:40.433580+0000","last_unstale":"2024-09-12T17:31:18.401497+0000","last_undegraded":"2024-09-12T17:31:18.401497+0000","last_fullsized":"2024-09-12T17:31:18.401497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:18.401408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:18.401408+0000","last_clean_scrub_stamp":"2024-09-12T17:31:18.401408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:11.623914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:33.094219+0000","last_change":"2024-09-12T17:31:33.094219+0000","last_active":"2024-09-12T17:31:33.094219+0000","last_peered":"2024-09-12T17:31:33.094219+0000","last_clean":"2024-09-12T17:31:33.094219+0000","last_became_active":"2024-09-12T17:27:44.433529+0000","last_became_peered":"2024-09-12T17:27:44.433529+0000","last_unstale":"2024-09-12T17:31:33.094219+0000","last_undegraded":"2024-09-12T17:31:33.094219+0000","last_fullsized":"2024-09-12T17:31:33.094219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:33.094131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:33.094131+0000","last_clean_scrub_stamp":"2024-09-12T17:31:33.094131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:22.304523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"31'39","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:42.006958+0000","last_change":"2024-09-12T17:31:42.006958+0000","last_active":"2024-09-12T17:31:42.006958+0000","last_peered":"2024-09-12T17:31:42.006958+0000","last_clean":"2024-09-12T17:31:42.006958+0000","last_became_active":"2024-09-12T17:27:46.439037+0000","last_became_peered":"2024-09-12T17:27:46.439037+0000","last_unstale":"2024-09-12T17:31:42.006958+0000","last_undegraded":"2024-09-12T17:31:42.006958+0000","last_fullsized":"2024-09-12T17:31:42.006958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2024-09-12T17:31:42.006807+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2024-09-12T17:31:42.006807+0000","last_clean_scrub_stamp":"2024-09-12T17:31:42.006807+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:34.109153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463052+0000","last_change":"2024-09-12T17:27:48.449101+0000","last_active":"2024-09-12T17:28:21.463052+0000","last_peered":"2024-09-12T17:28:21.463052+0000","last_clean":"2024-09-12T17:28:21.463052+0000","last_became_active":"2024-09-12T17:27:48.448426+0000","last_became_peered":"2024-09-12T17:27:48.448426+0000","last_unstale":"2024-09-12T17:28:21.463052+0000","last_undegraded":"2024-09-12T17:28:21.463052+0000","last_fullsized":"2024-09-12T17:28:21.463052+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:18.516470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464580+0000","last_change":"2024-09-12T17:27:50.459948+0000","last_active":"2024-09-12T17:28:21.464580+0000","last_peered":"2024-09-12T17:28:21.464580+0000","last_clean":"2024-09-12T17:28:21.464580+0000","last_became_active":"2024-09-12T17:27:50.459662+0000","last_became_peered":"2024-09-12T17:27:50.459662+0000","last_unstale":"2024-09-12T17:28:21.464580+0000","last_undegraded":"2024-09-12T17:28:21.464580+0000","last_fullsized":"2024-09-12T17:28:21.464580+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:08.216661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'12","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:23.237052+0000","last_change":"2024-09-12T17:31:23.237052+0000","last_active":"2024-09-12T17:31:23.237052+0000","last_peered":"2024-09-12T17:31:23.237052+0000","last_clean":"2024-09-12T17:31:23.237052+0000","last_became_active":"2024-09-12T17:28:21.472532+0000","last_became_peered":"2024-09-12T17:28:21.472532+0000","last_unstale":"2024-09-12T17:31:23.237052+0000","last_undegraded":"2024-09-12T17:31:23.237052+0000","last_fullsized":"2024-09-12T17:31:23.237052+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-09-12T17:31:23.236949+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-09-12T17:31:23.236949+0000","last_clean_scrub_stamp":"2024-09-12T17:31:23.236949+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:09.498014+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:04.774737+0000","last_change":"2024-09-12T17:31:04.774672+0000","last_active":"2024-09-12T17:31:04.774737+0000","last_peered":"2024-09-12T17:31:04.774737+0000","last_clean":"2024-09-12T17:31:04.774737+0000","last_became_active":"2024-09-12T17:27:40.418464+0000","last_became_peered":"2024-09-12T17:27:40.418464+0000","last_unstale":"2024-09-12T17:31:04.774737+0000","last_undegraded":"2024-09-12T17:31:04.774737+0000","last_fullsized":"2024-09-12T17:31:04.774737+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:04.774580+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:04.774580+0000","last_clean_scrub_stamp":"2024-09-12T17:31:04.774580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:11.872204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:36.236243+0000","last_change":"2024-09-12T17:31:36.236243+0000","last_active":"2024-09-12T17:31:36.236243+0000","last_peered":"2024-09-12T17:31:36.236243+0000","last_clean":"2024-09-12T17:31:36.236243+0000","last_became_active":"2024-09-12T17:27:44.430221+0000","last_became_peered":"2024-09-12T17:27:44.430221+0000","last_unstale":"2024-09-12T17:31:36.236243+0000","last_undegraded":"2024-09-12T17:31:36.236243+0000","last_fullsized":"2024-09-12T17:31:36.236243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:36.236156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:36.236156+0000","last_clean_scrub_stamp":"2024-09-12T17:31:36.236156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:42.309771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"31'29","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.836827+0000","last_change":"2024-09-12T17:27:46.441427+0000","last_active":"2024-09-12T17:30:56.836827+0000","last_peered":"2024-09-12T17:30:56.836827+0000","last_clean":"2024-09-12T17:30:56.836827+0000","last_became_active":"2024-09-12T17:27:46.441081+0000","last_became_peered":"2024-09-12T17:27:46.441081+0000","last_unstale":"2024-09-12T17:30:56.836827+0000","last_undegraded":"2024-09-12T17:30:56.836827+0000","last_fullsized":"2024-09-12T17:30:56.836827+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:08.132341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463313+0000","last_change":"2024-09-12T17:27:48.447632+0000","last_active":"2024-09-12T17:28:21.463313+0000","last_peered":"2024-09-12T17:28:21.463313+0000","last_clean":"2024-09-12T17:28:21.463313+0000","last_became_active":"2024-09-12T17:27:48.447321+0000","last_became_peered":"2024-09-12T17:27:48.447321+0000","last_unstale":"2024-09-12T17:28:21.463313+0000","last_undegraded":"2024-09-12T17:28:21.463313+0000","last_fullsized":"2024-09-12T17:28:21.463313+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:47.424266+0000","last_clean_scrub_stamp":"2024-09-12T17:27:47.424266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:43.865345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"31'10","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.181767+0000","last_change":"2024-09-12T17:27:50.460271+0000","last_active":"2024-09-12T17:30:49.181767+0000","last_peered":"2024-09-12T17:30:49.181767+0000","last_clean":"2024-09-12T17:30:49.181767+0000","last_became_active":"2024-09-12T17:27:50.459463+0000","last_became_peered":"2024-09-12T17:27:50.459463+0000","last_unstale":"2024-09-12T17:30:49.181767+0000","last_undegraded":"2024-09-12T17:30:49.181767+0000","last_fullsized":"2024-09-12T17:30:49.181767+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:18.316219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"31'18","reported_seq":90,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:22.222693+0000","last_change":"2024-09-12T17:31:22.222693+0000","last_active":"2024-09-12T17:31:22.222693+0000","last_peered":"2024-09-12T17:31:22.222693+0000","last_clean":"2024-09-12T17:31:22.222693+0000","last_became_active":"2024-09-12T17:27:42.430021+0000","last_became_peered":"2024-09-12T17:27:42.430021+0000","last_unstale":"2024-09-12T17:31:22.222693+0000","last_undegraded":"2024-09-12T17:31:22.222693+0000","last_fullsized":"2024-09-12T17:31:22.222693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'18","last_scrub_stamp":"2024-09-12T17:31:22.222608+0000","last_deep_scrub":"31'18","last_deep_scrub_stamp":"2024-09-12T17:31:22.222608+0000","last_clean_scrub_stamp":"2024-09-12T17:31:22.222608+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:10.350058+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":76,"num_read_kb":68,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:07.302226+0000","last_change":"2024-09-12T17:31:07.302162+0000","last_active":"2024-09-12T17:31:07.302226+0000","last_peered":"2024-09-12T17:31:07.302226+0000","last_clean":"2024-09-12T17:31:07.302226+0000","last_became_active":"2024-09-12T17:27:40.415549+0000","last_became_peered":"2024-09-12T17:27:40.415549+0000","last_unstale":"2024-09-12T17:31:07.302226+0000","last_undegraded":"2024-09-12T17:31:07.302226+0000","last_fullsized":"2024-09-12T17:31:07.302226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:07.302079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:07.302079+0000","last_clean_scrub_stamp":"2024-09-12T17:31:07.302079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:31:42.747169+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"31'3","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:39.213346+0000","last_change":"2024-09-12T17:31:39.213346+0000","last_active":"2024-09-12T17:31:39.213346+0000","last_peered":"2024-09-12T17:31:39.213346+0000","last_clean":"2024-09-12T17:31:39.213346+0000","last_became_active":"2024-09-12T17:27:44.433037+0000","last_became_peered":"2024-09-12T17:27:44.433037+0000","last_unstale":"2024-09-12T17:31:39.213346+0000","last_undegraded":"2024-09-12T17:31:39.213346+0000","last_fullsized":"2024-09-12T17:31:39.213346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-09-12T17:31:39.213265+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-09-12T17:31:39.213265+0000","last_clean_scrub_stamp":"2024-09-12T17:31:39.213265+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:46.499885+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"31'36","reported_seq":85,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:56.850133+0000","last_change":"2024-09-12T17:27:46.443590+0000","last_active":"2024-09-12T17:30:56.850133+0000","last_peered":"2024-09-12T17:30:56.850133+0000","last_clean":"2024-09-12T17:30:56.850133+0000","last_became_active":"2024-09-12T17:27:46.443316+0000","last_became_peered":"2024-09-12T17:27:46.443316+0000","last_unstale":"2024-09-12T17:30:56.850133+0000","last_undegraded":"2024-09-12T17:30:56.850133+0000","last_fullsized":"2024-09-12T17:30:56.850133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:45.416892+0000","last_clean_scrub_stamp":"2024-09-12T17:27:45.416892+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:47.273927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:50.051568+0000","last_change":"2024-09-12T17:31:50.051568+0000","last_active":"2024-09-12T17:31:50.051568+0000","last_peered":"2024-09-12T17:31:50.051568+0000","last_clean":"2024-09-12T17:31:50.051568+0000","last_became_active":"2024-09-12T17:27:48.447884+0000","last_became_peered":"2024-09-12T17:27:48.447884+0000","last_unstale":"2024-09-12T17:31:50.051568+0000","last_undegraded":"2024-09-12T17:31:50.051568+0000","last_fullsized":"2024-09-12T17:31:50.051568+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:50.051481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:50.051481+0000","last_clean_scrub_stamp":"2024-09-12T17:31:50.051481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:34.463798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"31'2","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.614754+0000","last_change":"2024-09-12T17:27:50.459747+0000","last_active":"2024-09-12T17:29:47.614754+0000","last_peered":"2024-09-12T17:29:47.614754+0000","last_clean":"2024-09-12T17:29:47.614754+0000","last_became_active":"2024-09-12T17:27:50.459464+0000","last_became_peered":"2024-09-12T17:27:50.459464+0000","last_unstale":"2024-09-12T17:29:47.614754+0000","last_undegraded":"2024-09-12T17:29:47.614754+0000","last_fullsized":"2024-09-12T17:29:47.614754+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:47.424145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"31'6","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:26.275546+0000","last_change":"2024-09-12T17:31:26.275546+0000","last_active":"2024-09-12T17:31:26.275546+0000","last_peered":"2024-09-12T17:31:26.275546+0000","last_clean":"2024-09-12T17:31:26.275546+0000","last_became_active":"2024-09-12T17:28:21.471738+0000","last_became_peered":"2024-09-12T17:28:21.471738+0000","last_unstale":"2024-09-12T17:31:26.275546+0000","last_undegraded":"2024-09-12T17:31:26.275546+0000","last_fullsized":"2024-09-12T17:31:26.275546+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-12T17:31:26.275465+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-12T17:31:26.275465+0000","last_clean_scrub_stamp":"2024-09-12T17:31:26.275465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:32.161098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:09.101188+0000","last_change":"2024-09-12T17:31:09.101122+0000","last_active":"2024-09-12T17:31:09.101188+0000","last_peered":"2024-09-12T17:31:09.101188+0000","last_clean":"2024-09-12T17:31:09.101188+0000","last_became_active":"2024-09-12T17:27:40.425150+0000","last_became_peered":"2024-09-12T17:27:40.425150+0000","last_unstale":"2024-09-12T17:31:09.101188+0000","last_undegraded":"2024-09-12T17:31:09.101188+0000","last_fullsized":"2024-09-12T17:31:09.101188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:09.101041+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:09.101041+0000","last_clean_scrub_stamp":"2024-09-12T17:31:09.101041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:11.434252+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"31'6","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:24.873531+0000","last_change":"2024-09-12T17:31:24.873531+0000","last_active":"2024-09-12T17:31:24.873531+0000","last_peered":"2024-09-12T17:31:24.873531+0000","last_clean":"2024-09-12T17:31:24.873531+0000","last_became_active":"2024-09-12T17:27:42.427745+0000","last_became_peered":"2024-09-12T17:27:42.427745+0000","last_unstale":"2024-09-12T17:31:24.873531+0000","last_undegraded":"2024-09-12T17:31:24.873531+0000","last_fullsized":"2024-09-12T17:31:24.873531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-12T17:31:24.873443+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-12T17:31:24.873443+0000","last_clean_scrub_stamp":"2024-09-12T17:31:24.873443+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:52.854740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:02.824340+0000","last_change":"2024-09-12T17:31:02.824281+0000","last_active":"2024-09-12T17:31:02.824340+0000","last_peered":"2024-09-12T17:31:02.824340+0000","last_clean":"2024-09-12T17:31:02.824340+0000","last_became_active":"2024-09-12T17:27:40.413068+0000","last_became_peered":"2024-09-12T17:27:40.413068+0000","last_unstale":"2024-09-12T17:31:02.824340+0000","last_undegraded":"2024-09-12T17:31:02.824340+0000","last_fullsized":"2024-09-12T17:31:02.824340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:02.824193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:02.824193+0000","last_clean_scrub_stamp":"2024-09-12T17:31:02.824193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:30.974235+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:40.553818+0000","last_change":"2024-09-12T17:31:40.553818+0000","last_active":"2024-09-12T17:31:40.553818+0000","last_peered":"2024-09-12T17:31:40.553818+0000","last_clean":"2024-09-12T17:31:40.553818+0000","last_became_active":"2024-09-12T17:27:42.428871+0000","last_became_peered":"2024-09-12T17:27:42.428871+0000","last_unstale":"2024-09-12T17:31:40.553818+0000","last_undegraded":"2024-09-12T17:31:40.553818+0000","last_fullsized":"2024-09-12T17:31:40.553818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:40.553702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:40.553702+0000","last_clean_scrub_stamp":"2024-09-12T17:31:40.553702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:04.977336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:19.436342+0000","last_change":"2024-09-12T17:31:19.436252+0000","last_active":"2024-09-12T17:31:19.436342+0000","last_peered":"2024-09-12T17:31:19.436342+0000","last_clean":"2024-09-12T17:31:19.436342+0000","last_became_active":"2024-09-12T17:27:40.423210+0000","last_became_peered":"2024-09-12T17:27:40.423210+0000","last_unstale":"2024-09-12T17:31:19.436342+0000","last_undegraded":"2024-09-12T17:31:19.436342+0000","last_fullsized":"2024-09-12T17:31:19.436342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:19.436168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:19.436168+0000","last_clean_scrub_stamp":"2024-09-12T17:31:19.436168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:08.266186+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"31'10","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:23.856443+0000","last_change":"2024-09-12T17:31:23.856443+0000","last_active":"2024-09-12T17:31:23.856443+0000","last_peered":"2024-09-12T17:31:23.856443+0000","last_clean":"2024-09-12T17:31:23.856443+0000","last_became_active":"2024-09-12T17:27:42.428059+0000","last_became_peered":"2024-09-12T17:27:42.428059+0000","last_unstale":"2024-09-12T17:31:23.856443+0000","last_undegraded":"2024-09-12T17:31:23.856443+0000","last_fullsized":"2024-09-12T17:31:23.856443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-12T17:31:23.856356+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-12T17:31:23.856356+0000","last_clean_scrub_stamp":"2024-09-12T17:31:23.856356+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:00.835509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:08.822490+0000","last_change":"2024-09-12T17:31:08.822428+0000","last_active":"2024-09-12T17:31:08.822490+0000","last_peered":"2024-09-12T17:31:08.822490+0000","last_clean":"2024-09-12T17:31:08.822490+0000","last_became_active":"2024-09-12T17:27:40.419018+0000","last_became_peered":"2024-09-12T17:27:40.419018+0000","last_unstale":"2024-09-12T17:31:08.822490+0000","last_undegraded":"2024-09-12T17:31:08.822490+0000","last_fullsized":"2024-09-12T17:31:08.822490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:08.822340+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:08.822340+0000","last_clean_scrub_stamp":"2024-09-12T17:31:08.822340+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:55.083405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"31'4","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:22.847898+0000","last_change":"2024-09-12T17:31:22.847810+0000","last_active":"2024-09-12T17:31:22.847898+0000","last_peered":"2024-09-12T17:31:22.847898+0000","last_clean":"2024-09-12T17:31:22.847898+0000","last_became_active":"2024-09-12T17:27:42.424201+0000","last_became_peered":"2024-09-12T17:27:42.424201+0000","last_unstale":"2024-09-12T17:31:22.847898+0000","last_undegraded":"2024-09-12T17:31:22.847898+0000","last_fullsized":"2024-09-12T17:31:22.847898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:22.847723+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:22.847723+0000","last_clean_scrub_stamp":"2024-09-12T17:31:22.847723+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:19.505548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:14.865433+0000","last_change":"2024-09-12T17:31:14.865433+0000","last_active":"2024-09-12T17:31:14.865433+0000","last_peered":"2024-09-12T17:31:14.865433+0000","last_clean":"2024-09-12T17:31:14.865433+0000","last_became_active":"2024-09-12T17:27:40.415318+0000","last_became_peered":"2024-09-12T17:27:40.415318+0000","last_unstale":"2024-09-12T17:31:14.865433+0000","last_undegraded":"2024-09-12T17:31:14.865433+0000","last_fullsized":"2024-09-12T17:31:14.865433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:14.865333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:14.865333+0000","last_clean_scrub_stamp":"2024-09-12T17:31:14.865333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:46.192766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"31'6","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:20.343411+0000","last_change":"2024-09-12T17:31:20.343357+0000","last_active":"2024-09-12T17:31:20.343411+0000","last_peered":"2024-09-12T17:31:20.343411+0000","last_clean":"2024-09-12T17:31:20.343411+0000","last_became_active":"2024-09-12T17:27:42.434664+0000","last_became_peered":"2024-09-12T17:27:42.434664+0000","last_unstale":"2024-09-12T17:31:20.343411+0000","last_undegraded":"2024-09-12T17:31:20.343411+0000","last_fullsized":"2024-09-12T17:31:20.343411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-12T17:31:20.343275+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-12T17:31:20.343275+0000","last_clean_scrub_stamp":"2024-09-12T17:31:20.343275+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:35.315488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:09.264861+0000","last_change":"2024-09-12T17:31:09.264861+0000","last_active":"2024-09-12T17:31:09.264861+0000","last_peered":"2024-09-12T17:31:09.264861+0000","last_clean":"2024-09-12T17:31:09.264861+0000","last_became_active":"2024-09-12T17:27:40.420491+0000","last_became_peered":"2024-09-12T17:27:40.420491+0000","last_unstale":"2024-09-12T17:31:09.264861+0000","last_undegraded":"2024-09-12T17:31:09.264861+0000","last_fullsized":"2024-09-12T17:31:09.264861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:09.264760+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:09.264760+0000","last_clean_scrub_stamp":"2024-09-12T17:31:09.264760+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:08.584209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"31'10","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:20.791830+0000","last_change":"2024-09-12T17:31:20.791706+0000","last_active":"2024-09-12T17:31:20.791830+0000","last_peered":"2024-09-12T17:31:20.791830+0000","last_clean":"2024-09-12T17:31:20.791830+0000","last_became_active":"2024-09-12T17:27:42.424810+0000","last_became_peered":"2024-09-12T17:27:42.424810+0000","last_unstale":"2024-09-12T17:31:20.791830+0000","last_undegraded":"2024-09-12T17:31:20.791830+0000","last_fullsized":"2024-09-12T17:31:20.791830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-12T17:31:20.791597+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-12T17:31:20.791597+0000","last_clean_scrub_stamp":"2024-09-12T17:31:20.791597+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:27.739428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":37,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:10.132403+0000","last_change":"2024-09-12T17:31:10.132403+0000","last_active":"2024-09-12T17:31:10.132403+0000","last_peered":"2024-09-12T17:31:10.132403+0000","last_clean":"2024-09-12T17:31:10.132403+0000","last_became_active":"2024-09-12T17:27:40.431365+0000","last_became_peered":"2024-09-12T17:27:40.431365+0000","last_unstale":"2024-09-12T17:31:10.132403+0000","last_undegraded":"2024-09-12T17:31:10.132403+0000","last_fullsized":"2024-09-12T17:31:10.132403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:10.132310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:10.132310+0000","last_clean_scrub_stamp":"2024-09-12T17:31:10.132310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:29.172061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"31'13","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:18.349683+0000","last_change":"2024-09-12T17:31:18.349579+0000","last_active":"2024-09-12T17:31:18.349683+0000","last_peered":"2024-09-12T17:31:18.349683+0000","last_clean":"2024-09-12T17:31:18.349683+0000","last_became_active":"2024-09-12T17:27:42.423099+0000","last_became_peered":"2024-09-12T17:27:42.423099+0000","last_unstale":"2024-09-12T17:31:18.349683+0000","last_undegraded":"2024-09-12T17:31:18.349683+0000","last_fullsized":"2024-09-12T17:31:18.349683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'13","last_scrub_stamp":"2024-09-12T17:31:18.349454+0000","last_deep_scrub":"31'13","last_deep_scrub_stamp":"2024-09-12T17:31:18.349454+0000","last_clean_scrub_stamp":"2024-09-12T17:31:18.349454+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:26.892025+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:06.750029+0000","last_change":"2024-09-12T17:31:06.750029+0000","last_active":"2024-09-12T17:31:06.750029+0000","last_peered":"2024-09-12T17:31:06.750029+0000","last_clean":"2024-09-12T17:31:06.750029+0000","last_became_active":"2024-09-12T17:27:40.415456+0000","last_became_peered":"2024-09-12T17:27:40.415456+0000","last_unstale":"2024-09-12T17:31:06.750029+0000","last_undegraded":"2024-09-12T17:31:06.750029+0000","last_fullsized":"2024-09-12T17:31:06.750029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:06.749935+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:06.749935+0000","last_clean_scrub_stamp":"2024-09-12T17:31:06.749935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:24:59.406146+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"31'8","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:24.348206+0000","last_change":"2024-09-12T17:31:24.348206+0000","last_active":"2024-09-12T17:31:24.348206+0000","last_peered":"2024-09-12T17:31:24.348206+0000","last_clean":"2024-09-12T17:31:24.348206+0000","last_became_active":"2024-09-12T17:27:42.427778+0000","last_became_peered":"2024-09-12T17:27:42.427778+0000","last_unstale":"2024-09-12T17:31:24.348206+0000","last_undegraded":"2024-09-12T17:31:24.348206+0000","last_fullsized":"2024-09-12T17:31:24.348206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:24.348117+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:24.348117+0000","last_clean_scrub_stamp":"2024-09-12T17:31:24.348117+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:42.991869+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:23.444728+0000","last_change":"2024-09-12T17:31:23.444668+0000","last_active":"2024-09-12T17:31:23.444728+0000","last_peered":"2024-09-12T17:31:23.444728+0000","last_clean":"2024-09-12T17:31:23.444728+0000","last_became_active":"2024-09-12T17:27:40.418241+0000","last_became_peered":"2024-09-12T17:27:40.418241+0000","last_unstale":"2024-09-12T17:31:23.444728+0000","last_undegraded":"2024-09-12T17:31:23.444728+0000","last_fullsized":"2024-09-12T17:31:23.444728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:23.444583+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:23.444583+0000","last_clean_scrub_stamp":"2024-09-12T17:31:23.444583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:46:46.884073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"31'2","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:41.511321+0000","last_change":"2024-09-12T17:31:41.511321+0000","last_active":"2024-09-12T17:31:41.511321+0000","last_peered":"2024-09-12T17:31:41.511321+0000","last_clean":"2024-09-12T17:31:41.511321+0000","last_became_active":"2024-09-12T17:27:42.433084+0000","last_became_peered":"2024-09-12T17:27:42.433084+0000","last_unstale":"2024-09-12T17:31:41.511321+0000","last_undegraded":"2024-09-12T17:31:41.511321+0000","last_fullsized":"2024-09-12T17:31:41.511321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:41.511229+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:41.511229+0000","last_clean_scrub_stamp":"2024-09-12T17:31:41.511229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:43.558896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:07.773832+0000","last_change":"2024-09-12T17:31:07.773832+0000","last_active":"2024-09-12T17:31:07.773832+0000","last_peered":"2024-09-12T17:31:07.773832+0000","last_clean":"2024-09-12T17:31:07.773832+0000","last_became_active":"2024-09-12T17:27:40.417666+0000","last_became_peered":"2024-09-12T17:27:40.417666+0000","last_unstale":"2024-09-12T17:31:07.773832+0000","last_undegraded":"2024-09-12T17:31:07.773832+0000","last_fullsized":"2024-09-12T17:31:07.773832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:07.773746+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:07.773746+0000","last_clean_scrub_stamp":"2024-09-12T17:31:07.773746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:55.901197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"31'8","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:25.906704+0000","last_change":"2024-09-12T17:31:25.906704+0000","last_active":"2024-09-12T17:31:25.906704+0000","last_peered":"2024-09-12T17:31:25.906704+0000","last_clean":"2024-09-12T17:31:25.906704+0000","last_became_active":"2024-09-12T17:27:42.424017+0000","last_became_peered":"2024-09-12T17:27:42.424017+0000","last_unstale":"2024-09-12T17:31:25.906704+0000","last_undegraded":"2024-09-12T17:31:25.906704+0000","last_fullsized":"2024-09-12T17:31:25.906704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:25.906608+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:25.906608+0000","last_clean_scrub_stamp":"2024-09-12T17:31:25.906608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:34.656639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:08.294816+0000","last_change":"2024-09-12T17:31:08.294816+0000","last_active":"2024-09-12T17:31:08.294816+0000","last_peered":"2024-09-12T17:31:08.294816+0000","last_clean":"2024-09-12T17:31:08.294816+0000","last_became_active":"2024-09-12T17:27:40.418964+0000","last_became_peered":"2024-09-12T17:27:40.418964+0000","last_unstale":"2024-09-12T17:31:08.294816+0000","last_undegraded":"2024-09-12T17:31:08.294816+0000","last_fullsized":"2024-09-12T17:31:08.294816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:08.294725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:08.294725+0000","last_clean_scrub_stamp":"2024-09-12T17:31:08.294725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:15.392350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"31'6","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:23.297312+0000","last_change":"2024-09-12T17:31:23.297312+0000","last_active":"2024-09-12T17:31:23.297312+0000","last_peered":"2024-09-12T17:31:23.297312+0000","last_clean":"2024-09-12T17:31:23.297312+0000","last_became_active":"2024-09-12T17:27:42.422955+0000","last_became_peered":"2024-09-12T17:27:42.422955+0000","last_unstale":"2024-09-12T17:31:23.297312+0000","last_undegraded":"2024-09-12T17:31:23.297312+0000","last_fullsized":"2024-09-12T17:31:23.297312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-12T17:31:23.297230+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-12T17:31:23.297230+0000","last_clean_scrub_stamp":"2024-09-12T17:31:23.297230+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:30.245061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:11.276659+0000","last_change":"2024-09-12T17:31:11.276659+0000","last_active":"2024-09-12T17:31:11.276659+0000","last_peered":"2024-09-12T17:31:11.276659+0000","last_clean":"2024-09-12T17:31:11.276659+0000","last_became_active":"2024-09-12T17:27:40.418183+0000","last_became_peered":"2024-09-12T17:27:40.418183+0000","last_unstale":"2024-09-12T17:31:11.276659+0000","last_undegraded":"2024-09-12T17:31:11.276659+0000","last_fullsized":"2024-09-12T17:31:11.276659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.276556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.276556+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.276556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:59.404006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"31'6","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:22.333174+0000","last_change":"2024-09-12T17:31:22.333174+0000","last_active":"2024-09-12T17:31:22.333174+0000","last_peered":"2024-09-12T17:31:22.333174+0000","last_clean":"2024-09-12T17:31:22.333174+0000","last_became_active":"2024-09-12T17:27:42.433856+0000","last_became_peered":"2024-09-12T17:27:42.433856+0000","last_unstale":"2024-09-12T17:31:22.333174+0000","last_undegraded":"2024-09-12T17:31:22.333174+0000","last_fullsized":"2024-09-12T17:31:22.333174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-12T17:31:22.333089+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-12T17:31:22.333089+0000","last_clean_scrub_stamp":"2024-09-12T17:31:22.333089+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:11.543481+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:20.447899+0000","last_change":"2024-09-12T17:31:20.447899+0000","last_active":"2024-09-12T17:31:20.447899+0000","last_peered":"2024-09-12T17:31:20.447899+0000","last_clean":"2024-09-12T17:31:20.447899+0000","last_became_active":"2024-09-12T17:27:40.428213+0000","last_became_peered":"2024-09-12T17:27:40.428213+0000","last_unstale":"2024-09-12T17:31:20.447899+0000","last_undegraded":"2024-09-12T17:31:20.447899+0000","last_fullsized":"2024-09-12T17:31:20.447899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:20.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:20.447796+0000","last_clean_scrub_stamp":"2024-09-12T17:31:20.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:46.194594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"31'4","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:25.320720+0000","last_change":"2024-09-12T17:31:25.320720+0000","last_active":"2024-09-12T17:31:25.320720+0000","last_peered":"2024-09-12T17:31:25.320720+0000","last_clean":"2024-09-12T17:31:25.320720+0000","last_became_active":"2024-09-12T17:27:42.431562+0000","last_became_peered":"2024-09-12T17:27:42.431562+0000","last_unstale":"2024-09-12T17:31:25.320720+0000","last_undegraded":"2024-09-12T17:31:25.320720+0000","last_fullsized":"2024-09-12T17:31:25.320720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:25.320637+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:25.320637+0000","last_clean_scrub_stamp":"2024-09-12T17:31:25.320637+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:21.978461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"31'4","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:21.435534+0000","last_change":"2024-09-12T17:31:21.435534+0000","last_active":"2024-09-12T17:31:21.435534+0000","last_peered":"2024-09-12T17:31:21.435534+0000","last_clean":"2024-09-12T17:31:21.435534+0000","last_became_active":"2024-09-12T17:27:40.425910+0000","last_became_peered":"2024-09-12T17:27:40.425910+0000","last_unstale":"2024-09-12T17:31:21.435534+0000","last_undegraded":"2024-09-12T17:31:21.435534+0000","last_fullsized":"2024-09-12T17:31:21.435534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:21.435416+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:21.435416+0000","last_clean_scrub_stamp":"2024-09-12T17:31:21.435416+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:50.263995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"31'10","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:46.497582+0000","last_change":"2024-09-12T17:31:46.497582+0000","last_active":"2024-09-12T17:31:46.497582+0000","last_peered":"2024-09-12T17:31:46.497582+0000","last_clean":"2024-09-12T17:31:46.497582+0000","last_became_active":"2024-09-12T17:27:42.429270+0000","last_became_peered":"2024-09-12T17:27:42.429270+0000","last_unstale":"2024-09-12T17:31:46.497582+0000","last_undegraded":"2024-09-12T17:31:46.497582+0000","last_fullsized":"2024-09-12T17:31:46.497582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-12T17:31:46.497497+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-12T17:31:46.497497+0000","last_clean_scrub_stamp":"2024-09-12T17:31:46.497497+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:43.001937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:11.107395+0000","last_change":"2024-09-12T17:31:11.107395+0000","last_active":"2024-09-12T17:31:11.107395+0000","last_peered":"2024-09-12T17:31:11.107395+0000","last_clean":"2024-09-12T17:31:11.107395+0000","last_became_active":"2024-09-12T17:27:40.431687+0000","last_became_peered":"2024-09-12T17:27:40.431687+0000","last_unstale":"2024-09-12T17:31:11.107395+0000","last_undegraded":"2024-09-12T17:31:11.107395+0000","last_fullsized":"2024-09-12T17:31:11.107395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:11.107302+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:11.107302+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.107302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:52.875838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"31'4","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:21.328105+0000","last_change":"2024-09-12T17:31:21.328105+0000","last_active":"2024-09-12T17:31:21.328105+0000","last_peered":"2024-09-12T17:31:21.328105+0000","last_clean":"2024-09-12T17:31:21.328105+0000","last_became_active":"2024-09-12T17:27:42.424910+0000","last_became_peered":"2024-09-12T17:27:42.424910+0000","last_unstale":"2024-09-12T17:31:21.328105+0000","last_undegraded":"2024-09-12T17:31:21.328105+0000","last_fullsized":"2024-09-12T17:31:21.328105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:21.328005+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:21.328005+0000","last_clean_scrub_stamp":"2024-09-12T17:31:21.328005+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:38.959884+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:26.570705+0000","last_change":"2024-09-12T17:31:26.570705+0000","last_active":"2024-09-12T17:31:26.570705+0000","last_peered":"2024-09-12T17:31:26.570705+0000","last_clean":"2024-09-12T17:31:26.570705+0000","last_became_active":"2024-09-12T17:27:40.433649+0000","last_became_peered":"2024-09-12T17:27:40.433649+0000","last_unstale":"2024-09-12T17:31:26.570705+0000","last_undegraded":"2024-09-12T17:31:26.570705+0000","last_fullsized":"2024-09-12T17:31:26.570705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:26.570609+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:26.570609+0000","last_clean_scrub_stamp":"2024-09-12T17:31:26.570609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:50.953136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:27.530165+0000","last_change":"2024-09-12T17:31:27.530165+0000","last_active":"2024-09-12T17:31:27.530165+0000","last_peered":"2024-09-12T17:31:27.530165+0000","last_clean":"2024-09-12T17:31:27.530165+0000","last_became_active":"2024-09-12T17:27:40.423343+0000","last_became_peered":"2024-09-12T17:27:40.423343+0000","last_unstale":"2024-09-12T17:31:27.530165+0000","last_undegraded":"2024-09-12T17:31:27.530165+0000","last_fullsized":"2024-09-12T17:31:27.530165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:27.530082+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:27.530082+0000","last_clean_scrub_stamp":"2024-09-12T17:31:27.530082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:50.850315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"31'8","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:27.881064+0000","last_change":"2024-09-12T17:31:27.881064+0000","last_active":"2024-09-12T17:31:27.881064+0000","last_peered":"2024-09-12T17:31:27.881064+0000","last_clean":"2024-09-12T17:31:27.881064+0000","last_became_active":"2024-09-12T17:27:42.426150+0000","last_became_peered":"2024-09-12T17:27:42.426150+0000","last_unstale":"2024-09-12T17:31:27.881064+0000","last_undegraded":"2024-09-12T17:31:27.881064+0000","last_fullsized":"2024-09-12T17:31:27.881064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:27.880963+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:27.880963+0000","last_clean_scrub_stamp":"2024-09-12T17:31:27.880963+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:19.026284+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:10.897255+0000","last_change":"2024-09-12T17:31:10.897255+0000","last_active":"2024-09-12T17:31:10.897255+0000","last_peered":"2024-09-12T17:31:10.897255+0000","last_clean":"2024-09-12T17:31:10.897255+0000","last_became_active":"2024-09-12T17:27:40.420396+0000","last_became_peered":"2024-09-12T17:27:40.420396+0000","last_unstale":"2024-09-12T17:31:10.897255+0000","last_undegraded":"2024-09-12T17:31:10.897255+0000","last_fullsized":"2024-09-12T17:31:10.897255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:10.897168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:10.897168+0000","last_clean_scrub_stamp":"2024-09-12T17:31:10.897168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:17.103760+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:29.307191+0000","last_change":"2024-09-12T17:31:29.307191+0000","last_active":"2024-09-12T17:31:29.307191+0000","last_peered":"2024-09-12T17:31:29.307191+0000","last_clean":"2024-09-12T17:31:29.307191+0000","last_became_active":"2024-09-12T17:27:42.435324+0000","last_became_peered":"2024-09-12T17:27:42.435324+0000","last_unstale":"2024-09-12T17:31:29.307191+0000","last_undegraded":"2024-09-12T17:31:29.307191+0000","last_fullsized":"2024-09-12T17:31:29.307191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:29.307110+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:29.307110+0000","last_clean_scrub_stamp":"2024-09-12T17:31:29.307110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:55.863554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2287,"ondisk_log_size":2287,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1730,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1513,"ondisk_log_size":1513,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":482,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1662,"num_read_kb":1552,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":481,"ondisk_log_size":481,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673019,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":446464,"data_stored":134267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705722,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":983040,"data_stored":724195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705722,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1007616,"data_stored":723592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705723,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31588,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340252,"statfs":{"total":96636764160,"available":96604418048,"internally_reserved":0,"allocated":413696,"data_stored":134210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:32:02.704 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:32:02.704 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:32:02.704 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:32:02.705 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:32:02.705 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:32:02.705 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:32:02.705 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:32:02.706 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:32:02.706 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:32:02.706 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:32:02.706 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:32:02.707 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:32:02.707 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:32:02.707 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:32:02.708 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:32:02.708 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:32:02.708 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:32:02.708 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:32:02.708 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:32:02.709 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:32:02.709 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:32:02.709 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:32:02.709 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:32:02.710 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:32:02.710 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:32:02.710 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T17:27:47.424266+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:32:02.710 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:32:02.710 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T17:27:45.416892+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:32:02.710 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:32:02.711 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T17:32:22.713 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:32:22.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:22.828+0000 7fe113031640 1 Processor -- start 2024-09-12T17:32:22.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:22.828+0000 7fe113031640 1 -- start start 2024-09-12T17:32:22.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:22.828+0000 7fe113031640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe10c129d80 0x7fe10c12a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:32:22.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:22.828+0000 7fe113031640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe10c06dc00 con 0x7fe10c12a6a0 2024-09-12T17:32:22.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:22.828+0000 7fe113031640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fe10c1299c0 con 0x7fe10c129d80 2024-09-12T17:32:22.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:22.829+0000 7fe110dcd640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe10c129d80 0x7fe10c12a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:32:22.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:22.829+0000 7fe103fff640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fe10c12a6a0 0x7fe10c110d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:39678/0 (socket says 172.21.15.47:39678) 2024-09-12T17:32:22.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:22.829+0000 7fe103fff640 1 -- 172.21.15.47:0/3562161233 learned_addr learned my addr 172.21.15.47:0/3562161233 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-09-12T17:32:22.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:22.829+0000 7fe110dcd640 1 -- 172.21.15.47:0/3562161233 >> v1:172.21.15.47:6789/0 conn(0x7fe10c12a6a0 legacy=0x7fe10c110d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:32:22.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:22.829+0000 7fe110dcd640 1 -- 172.21.15.47:0/3562161233 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe10c114d20 con 0x7fe10c129d80 2024-09-12T17:32:22.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:22.829+0000 7fe1037fe640 1 -- 172.21.15.47:0/3562161233 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 44502720 0 0) 0x7fe10c06dc00 con 0x7fe10c12a6a0 2024-09-12T17:32:22.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:22.830+0000 7fe110dcd640 1 --2- 172.21.15.47:0/3562161233 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe10c129d80 0x7fe10c12a160 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fe108009720 tx=0x7fe10802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e78f7cbddc52c6ef server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:32:22.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:22.830+0000 7fe1037fe640 1 -- 172.21.15.47:0/3562161233 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe108037070 con 0x7fe10c129d80 2024-09-12T17:32:22.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:22.830+0000 7fe1037fe640 1 -- 172.21.15.47:0/3562161233 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe10802ad90 con 0x7fe10c129d80 2024-09-12T17:32:22.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:22.830+0000 7fe1037fe640 1 -- 172.21.15.47:0/3562161233 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe108032590 con 0x7fe10c129d80 2024-09-12T17:32:22.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:22.830+0000 7fe113031640 1 -- 172.21.15.47:0/3562161233 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe10c129d80 msgr2=0x7fe10c12a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:32:22.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:22.830+0000 7fe113031640 1 --2- 172.21.15.47:0/3562161233 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe10c129d80 0x7fe10c12a160 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fe108009720 tx=0x7fe10802a110 comp rx=0 tx=0).stop 2024-09-12T17:32:22.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:22.830+0000 7fe113031640 1 -- 172.21.15.47:0/3562161233 shutdown_connections 2024-09-12T17:32:22.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:22.830+0000 7fe113031640 1 --2- 172.21.15.47:0/3562161233 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe10c129d80 0x7fe10c12a160 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:32:22.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:22.830+0000 7fe113031640 1 -- 172.21.15.47:0/3562161233 >> 172.21.15.47:0/3562161233 conn(0x7fe10c070850 msgr2=0x7fe10c072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:32:22.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:22.830+0000 7fe113031640 1 -- 172.21.15.47:0/3562161233 shutdown_connections 2024-09-12T17:32:22.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:22.830+0000 7fe113031640 1 -- 172.21.15.47:0/3562161233 wait complete. 2024-09-12T17:32:22.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:22.831+0000 7fe113031640 1 Processor -- start 2024-09-12T17:32:22.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:22.831+0000 7fe113031640 1 -- start start 2024-09-12T17:32:22.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:22.832+0000 7fe113031640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe10c129d80 0x7fe10c1c1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:32:22.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:22.832+0000 7fe113031640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe10c114940 con 0x7fe10c129d80 2024-09-12T17:32:22.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:22.832+0000 7fe110dcd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe10c129d80 0x7fe10c1c1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:32:22.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:22.832+0000 7fe110dcd640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe10c129d80 0x7fe10c1c1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59000/0 (socket says 172.21.15.47:59000) 2024-09-12T17:32:22.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:22.832+0000 7fe110dcd640 1 -- 172.21.15.47:0/1798607739 learned_addr learned my addr 172.21.15.47:0/1798607739 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:32:22.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:22.832+0000 7fe110dcd640 1 -- 172.21.15.47:0/1798607739 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe10c11dfa0 con 0x7fe10c129d80 2024-09-12T17:32:22.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:22.832+0000 7fe110dcd640 1 --2- 172.21.15.47:0/1798607739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe10c129d80 0x7fe10c1c1d80 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fe108035040 tx=0x7fe1080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:32:22.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:22.833+0000 7fe1017fa640 1 -- 172.21.15.47:0/1798607739 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe108037040 con 0x7fe10c129d80 2024-09-12T17:32:22.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:22.833+0000 7fe1017fa640 1 -- 172.21.15.47:0/1798607739 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe108004160 con 0x7fe10c129d80 2024-09-12T17:32:22.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:22.833+0000 7fe113031640 1 -- 172.21.15.47:0/1798607739 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe10c11d3e0 con 0x7fe10c129d80 2024-09-12T17:32:22.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:22.833+0000 7fe1017fa640 1 -- 172.21.15.47:0/1798607739 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe108004440 con 0x7fe10c129d80 2024-09-12T17:32:22.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:22.833+0000 7fe113031640 1 -- 172.21.15.47:0/1798607739 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe10c1c22c0 con 0x7fe10c129d80 2024-09-12T17:32:22.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:22.834+0000 7fe113031640 1 -- 172.21.15.47:0/1798607739 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe10c1119e0 con 0x7fe10c129d80 2024-09-12T17:32:22.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:22.834+0000 7fe1017fa640 1 -- 172.21.15.47:0/1798607739 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe108003610 con 0x7fe10c129d80 2024-09-12T17:32:22.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:22.834+0000 7fe1017fa640 1 --2- 172.21.15.47:0/1798607739 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe0f803de90 0x7fe0f8040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:32:22.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:22.834+0000 7fe1017fa640 1 -- 172.21.15.47:0/1798607739 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7fe108073ba0 con 0x7fe10c129d80 2024-09-12T17:32:22.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:22.834+0000 7fe103fff640 1 --2- 172.21.15.47:0/1798607739 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe0f803de90 0x7fe0f8040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:32:22.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:22.835+0000 7fe103fff640 1 --2- 172.21.15.47:0/1798607739 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe0f803de90 0x7fe0f8040350 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc000c00 tx=0x7fe0fc0078d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:32:22.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:22.838+0000 7fe1017fa640 1 -- 172.21.15.47:0/1798607739 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7fe10803c3d0 con 0x7fe10c129d80 2024-09-12T17:32:23.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:23.021+0000 7fe113031640 1 -- 172.21.15.47:0/1798607739 --> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe10c11d5b0 con 0x7fe0f803de90 2024-09-12T17:32:23.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:23.032+0000 7fe1017fa640 1 -- 172.21.15.47:0/1798607739 <== mgr.4102 v2:172.21.15.170:6824/4146902489 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665914 (secure 0 0 0) 0x7fe0fc0070d0 con 0x7fe0f803de90 2024-09-12T17:32:23.041 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:32:23.046 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-09-12T17:32:23.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:23.037+0000 7fe113031640 1 -- 172.21.15.47:0/1798607739 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe0f803de90 msgr2=0x7fe0f8040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:32:23.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:23.037+0000 7fe113031640 1 --2- 172.21.15.47:0/1798607739 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe0f803de90 0x7fe0f8040350 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc000c00 tx=0x7fe0fc0078d0 comp rx=0 tx=0).stop 2024-09-12T17:32:23.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:23.037+0000 7fe113031640 1 -- 172.21.15.47:0/1798607739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe10c129d80 msgr2=0x7fe10c1c1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:32:23.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:23.037+0000 7fe113031640 1 --2- 172.21.15.47:0/1798607739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe10c129d80 0x7fe10c1c1d80 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fe108035040 tx=0x7fe1080046c0 comp rx=0 tx=0).stop 2024-09-12T17:32:23.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:23.037+0000 7fe113031640 1 -- 172.21.15.47:0/1798607739 shutdown_connections 2024-09-12T17:32:23.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:23.037+0000 7fe113031640 1 --2- 172.21.15.47:0/1798607739 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7fe0f803de90 0x7fe0f8040350 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:32:23.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:23.037+0000 7fe113031640 1 --2- 172.21.15.47:0/1798607739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe10c129d80 0x7fe10c1c1d80 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:32:23.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:23.037+0000 7fe113031640 1 -- 172.21.15.47:0/1798607739 >> 172.21.15.47:0/1798607739 conn(0x7fe10c070850 msgr2=0x7fe10c126310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:32:23.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:23.037+0000 7fe113031640 1 -- 172.21.15.47:0/1798607739 shutdown_connections 2024-09-12T17:32:23.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:23.037+0000 7fe113031640 1 -- 172.21.15.47:0/1798607739 wait complete. 2024-09-12T17:32:23.050 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":177,"stamp":"2024-09-12T17:32:21.821164+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5127,"num_read_kb":4717,"num_write":2121,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":482,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3349,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4783,"ondisk_log_size":4783,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":115040,"kb_used_data":2784,"kb_used_omap":6,"kb_used_meta":112185,"kb_avail":377372320,"statfs":{"total":386547056640,"available":386429255680,"internally_reserved":0,"allocated":2850816,"data_stored":1716264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":114878230},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004076"},"pg_stats":[{"pgid":"3.3f","version":"31'2","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:15.167665+0000","last_change":"2024-09-12T17:31:15.167597+0000","last_active":"2024-09-12T17:31:15.167665+0000","last_peered":"2024-09-12T17:31:15.167665+0000","last_clean":"2024-09-12T17:31:15.167665+0000","last_became_active":"2024-09-12T17:28:21.473004+0000","last_became_peered":"2024-09-12T17:28:21.473004+0000","last_unstale":"2024-09-12T17:31:15.167665+0000","last_undegraded":"2024-09-12T17:31:15.167665+0000","last_fullsized":"2024-09-12T17:31:15.167665+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:15.167516+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:15.167516+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.167516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:41.949425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"31'2","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:30.347524+0000","last_change":"2024-09-12T17:31:30.347524+0000","last_active":"2024-09-12T17:31:30.347524+0000","last_peered":"2024-09-12T17:31:30.347524+0000","last_clean":"2024-09-12T17:31:30.347524+0000","last_became_active":"2024-09-12T17:27:42.433207+0000","last_became_peered":"2024-09-12T17:27:42.433207+0000","last_unstale":"2024-09-12T17:31:30.347524+0000","last_undegraded":"2024-09-12T17:31:30.347524+0000","last_fullsized":"2024-09-12T17:31:30.347524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:30.347428+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:30.347428+0000","last_clean_scrub_stamp":"2024-09-12T17:31:30.347428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:21.492749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:13.893011+0000","last_change":"2024-09-12T17:31:13.892956+0000","last_active":"2024-09-12T17:31:13.893011+0000","last_peered":"2024-09-12T17:31:13.893011+0000","last_clean":"2024-09-12T17:31:13.893011+0000","last_became_active":"2024-09-12T17:27:40.418928+0000","last_became_peered":"2024-09-12T17:27:40.418928+0000","last_unstale":"2024-09-12T17:31:13.893011+0000","last_undegraded":"2024-09-12T17:31:13.893011+0000","last_fullsized":"2024-09-12T17:31:13.893011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:13.892860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:13.892860+0000","last_clean_scrub_stamp":"2024-09-12T17:31:13.892860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:59.577514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"31'6","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:42.521828+0000","last_change":"2024-09-12T17:31:42.521828+0000","last_active":"2024-09-12T17:31:42.521828+0000","last_peered":"2024-09-12T17:31:42.521828+0000","last_clean":"2024-09-12T17:31:42.521828+0000","last_became_active":"2024-09-12T17:27:42.432677+0000","last_became_peered":"2024-09-12T17:27:42.432677+0000","last_unstale":"2024-09-12T17:31:42.521828+0000","last_undegraded":"2024-09-12T17:31:42.521828+0000","last_fullsized":"2024-09-12T17:31:42.521828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-12T17:31:42.521720+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-12T17:31:42.521720+0000","last_clean_scrub_stamp":"2024-09-12T17:31:42.521720+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:00.076710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:30.548231+0000","last_change":"2024-09-12T17:31:30.548169+0000","last_active":"2024-09-12T17:31:30.548231+0000","last_peered":"2024-09-12T17:31:30.548231+0000","last_clean":"2024-09-12T17:31:30.548231+0000","last_became_active":"2024-09-12T17:27:40.433470+0000","last_became_peered":"2024-09-12T17:27:40.433470+0000","last_unstale":"2024-09-12T17:31:30.548231+0000","last_undegraded":"2024-09-12T17:31:30.548231+0000","last_fullsized":"2024-09-12T17:31:30.548231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:30.548084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:30.548084+0000","last_clean_scrub_stamp":"2024-09-12T17:31:30.548084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:09.304175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"31'8","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:44.472937+0000","last_change":"2024-09-12T17:31:44.472937+0000","last_active":"2024-09-12T17:31:44.472937+0000","last_peered":"2024-09-12T17:31:44.472937+0000","last_clean":"2024-09-12T17:31:44.472937+0000","last_became_active":"2024-09-12T17:27:42.432736+0000","last_became_peered":"2024-09-12T17:27:42.432736+0000","last_unstale":"2024-09-12T17:31:44.472937+0000","last_undegraded":"2024-09-12T17:31:44.472937+0000","last_fullsized":"2024-09-12T17:31:44.472937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:44.472839+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:44.472839+0000","last_clean_scrub_stamp":"2024-09-12T17:31:44.472839+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:00.405274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"31'8","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:14.164926+0000","last_change":"2024-09-12T17:31:14.164859+0000","last_active":"2024-09-12T17:31:14.164926+0000","last_peered":"2024-09-12T17:31:14.164926+0000","last_clean":"2024-09-12T17:31:14.164926+0000","last_became_active":"2024-09-12T17:27:40.426649+0000","last_became_peered":"2024-09-12T17:27:40.426649+0000","last_unstale":"2024-09-12T17:31:14.164926+0000","last_undegraded":"2024-09-12T17:31:14.164926+0000","last_fullsized":"2024-09-12T17:31:14.164926+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:14.164764+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:14.164764+0000","last_clean_scrub_stamp":"2024-09-12T17:31:14.164764+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:53.065552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":18,"num_write":56,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"31'8","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:45.517276+0000","last_change":"2024-09-12T17:31:45.517276+0000","last_active":"2024-09-12T17:31:45.517276+0000","last_peered":"2024-09-12T17:31:45.517276+0000","last_clean":"2024-09-12T17:31:45.517276+0000","last_became_active":"2024-09-12T17:27:42.418517+0000","last_became_peered":"2024-09-12T17:27:42.418517+0000","last_unstale":"2024-09-12T17:31:45.517276+0000","last_undegraded":"2024-09-12T17:31:45.517276+0000","last_fullsized":"2024-09-12T17:31:45.517276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:45.517161+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:45.517161+0000","last_clean_scrub_stamp":"2024-09-12T17:31:45.517161+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:53.551953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:24.485763+0000","last_change":"2024-09-12T17:31:24.485763+0000","last_active":"2024-09-12T17:31:24.485763+0000","last_peered":"2024-09-12T17:31:24.485763+0000","last_clean":"2024-09-12T17:31:24.485763+0000","last_became_active":"2024-09-12T17:27:40.424978+0000","last_became_peered":"2024-09-12T17:27:40.424978+0000","last_unstale":"2024-09-12T17:31:24.485763+0000","last_undegraded":"2024-09-12T17:31:24.485763+0000","last_fullsized":"2024-09-12T17:31:24.485763+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:24.485659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:24.485659+0000","last_clean_scrub_stamp":"2024-09-12T17:31:24.485659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:57.212649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"31'16","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:31.349661+0000","last_change":"2024-09-12T17:31:31.349593+0000","last_active":"2024-09-12T17:31:31.349661+0000","last_peered":"2024-09-12T17:31:31.349661+0000","last_clean":"2024-09-12T17:31:31.349661+0000","last_became_active":"2024-09-12T17:27:42.423906+0000","last_became_peered":"2024-09-12T17:27:42.423906+0000","last_unstale":"2024-09-12T17:31:31.349661+0000","last_undegraded":"2024-09-12T17:31:31.349661+0000","last_fullsized":"2024-09-12T17:31:31.349661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'16","last_scrub_stamp":"2024-09-12T17:31:31.349474+0000","last_deep_scrub":"31'16","last_deep_scrub_stamp":"2024-09-12T17:31:31.349474+0000","last_clean_scrub_stamp":"2024-09-12T17:31:31.349474+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:12.460742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:12.104894+0000","last_change":"2024-09-12T17:31:12.104894+0000","last_active":"2024-09-12T17:31:12.104894+0000","last_peered":"2024-09-12T17:31:12.104894+0000","last_clean":"2024-09-12T17:31:12.104894+0000","last_became_active":"2024-09-12T17:27:40.425308+0000","last_became_peered":"2024-09-12T17:27:40.425308+0000","last_unstale":"2024-09-12T17:31:12.104894+0000","last_undegraded":"2024-09-12T17:31:12.104894+0000","last_fullsized":"2024-09-12T17:31:12.104894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:12.104802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:12.104802+0000","last_clean_scrub_stamp":"2024-09-12T17:31:12.104802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:46.519276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"29'2","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:50.469293+0000","last_change":"2024-09-12T17:31:50.469234+0000","last_active":"2024-09-12T17:31:50.469293+0000","last_peered":"2024-09-12T17:31:50.469293+0000","last_clean":"2024-09-12T17:31:50.469293+0000","last_became_active":"2024-09-12T17:27:42.428137+0000","last_became_peered":"2024-09-12T17:27:42.428137+0000","last_unstale":"2024-09-12T17:31:50.469293+0000","last_undegraded":"2024-09-12T17:31:50.469293+0000","last_fullsized":"2024-09-12T17:31:50.469293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-12T17:31:50.469138+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-12T17:31:50.469138+0000","last_clean_scrub_stamp":"2024-09-12T17:31:50.469138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:27.400201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'4","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:25.524102+0000","last_change":"2024-09-12T17:31:25.524102+0000","last_active":"2024-09-12T17:31:25.524102+0000","last_peered":"2024-09-12T17:31:25.524102+0000","last_clean":"2024-09-12T17:31:25.524102+0000","last_became_active":"2024-09-12T17:27:40.426778+0000","last_became_peered":"2024-09-12T17:27:40.426778+0000","last_unstale":"2024-09-12T17:31:25.524102+0000","last_undegraded":"2024-09-12T17:31:25.524102+0000","last_fullsized":"2024-09-12T17:31:25.524102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:25.524021+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:25.524021+0000","last_clean_scrub_stamp":"2024-09-12T17:31:25.524021+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:28.696346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"31'18","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:28.212504+0000","last_change":"2024-09-12T17:31:28.212438+0000","last_active":"2024-09-12T17:31:28.212504+0000","last_peered":"2024-09-12T17:31:28.212504+0000","last_clean":"2024-09-12T17:31:28.212504+0000","last_became_active":"2024-09-12T17:27:42.434042+0000","last_became_peered":"2024-09-12T17:27:42.434042+0000","last_unstale":"2024-09-12T17:31:28.212504+0000","last_undegraded":"2024-09-12T17:31:28.212504+0000","last_fullsized":"2024-09-12T17:31:28.212504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'18","last_scrub_stamp":"2024-09-12T17:31:28.212358+0000","last_deep_scrub":"31'18","last_deep_scrub_stamp":"2024-09-12T17:31:28.212358+0000","last_clean_scrub_stamp":"2024-09-12T17:31:28.212358+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:13.897013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":56,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:12.847582+0000","last_change":"2024-09-12T17:31:12.847582+0000","last_active":"2024-09-12T17:31:12.847582+0000","last_peered":"2024-09-12T17:31:12.847582+0000","last_clean":"2024-09-12T17:31:12.847582+0000","last_became_active":"2024-09-12T17:27:40.418512+0000","last_became_peered":"2024-09-12T17:27:40.418512+0000","last_unstale":"2024-09-12T17:31:12.847582+0000","last_undegraded":"2024-09-12T17:31:12.847582+0000","last_fullsized":"2024-09-12T17:31:12.847582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:12.847495+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:12.847495+0000","last_clean_scrub_stamp":"2024-09-12T17:31:12.847495+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:57.086545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"31'8","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:30.206280+0000","last_change":"2024-09-12T17:31:30.206222+0000","last_active":"2024-09-12T17:31:30.206280+0000","last_peered":"2024-09-12T17:31:30.206280+0000","last_clean":"2024-09-12T17:31:30.206280+0000","last_became_active":"2024-09-12T17:27:42.436159+0000","last_became_peered":"2024-09-12T17:27:42.436159+0000","last_unstale":"2024-09-12T17:31:30.206280+0000","last_undegraded":"2024-09-12T17:31:30.206280+0000","last_fullsized":"2024-09-12T17:31:30.206280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:30.206128+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:30.206128+0000","last_clean_scrub_stamp":"2024-09-12T17:31:30.206128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:56.693996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"31'4","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:43.498350+0000","last_change":"2024-09-12T17:31:43.498350+0000","last_active":"2024-09-12T17:31:43.498350+0000","last_peered":"2024-09-12T17:31:43.498350+0000","last_clean":"2024-09-12T17:31:43.498350+0000","last_became_active":"2024-09-12T17:27:42.433425+0000","last_became_peered":"2024-09-12T17:27:42.433425+0000","last_unstale":"2024-09-12T17:31:43.498350+0000","last_undegraded":"2024-09-12T17:31:43.498350+0000","last_fullsized":"2024-09-12T17:31:43.498350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:43.498234+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:43.498234+0000","last_clean_scrub_stamp":"2024-09-12T17:31:43.498234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:55.272591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:13.316703+0000","last_change":"2024-09-12T17:31:13.316703+0000","last_active":"2024-09-12T17:31:13.316703+0000","last_peered":"2024-09-12T17:31:13.316703+0000","last_clean":"2024-09-12T17:31:13.316703+0000","last_became_active":"2024-09-12T17:27:40.415650+0000","last_became_peered":"2024-09-12T17:27:40.415650+0000","last_unstale":"2024-09-12T17:31:13.316703+0000","last_undegraded":"2024-09-12T17:31:13.316703+0000","last_fullsized":"2024-09-12T17:31:13.316703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:13.316616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:13.316616+0000","last_clean_scrub_stamp":"2024-09-12T17:31:13.316616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:05.300957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:26.339465+0000","last_change":"2024-09-12T17:31:26.339465+0000","last_active":"2024-09-12T17:31:26.339465+0000","last_peered":"2024-09-12T17:31:26.339465+0000","last_clean":"2024-09-12T17:31:26.339465+0000","last_became_active":"2024-09-12T17:27:42.427700+0000","last_became_peered":"2024-09-12T17:27:42.427700+0000","last_unstale":"2024-09-12T17:31:26.339465+0000","last_undegraded":"2024-09-12T17:31:26.339465+0000","last_fullsized":"2024-09-12T17:31:26.339465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:26.339370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:26.339370+0000","last_clean_scrub_stamp":"2024-09-12T17:31:26.339370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:03.318523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:13.154171+0000","last_change":"2024-09-12T17:31:13.154171+0000","last_active":"2024-09-12T17:31:13.154171+0000","last_peered":"2024-09-12T17:31:13.154171+0000","last_clean":"2024-09-12T17:31:13.154171+0000","last_became_active":"2024-09-12T17:27:40.432033+0000","last_became_peered":"2024-09-12T17:27:40.432033+0000","last_unstale":"2024-09-12T17:31:13.154171+0000","last_undegraded":"2024-09-12T17:31:13.154171+0000","last_fullsized":"2024-09-12T17:31:13.154171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:13.154091+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:13.154091+0000","last_clean_scrub_stamp":"2024-09-12T17:31:13.154091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:49:12.833133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:27.303000+0000","last_change":"2024-09-12T17:31:27.303000+0000","last_active":"2024-09-12T17:31:27.303000+0000","last_peered":"2024-09-12T17:31:27.303000+0000","last_clean":"2024-09-12T17:31:27.303000+0000","last_became_active":"2024-09-12T17:27:42.428492+0000","last_became_peered":"2024-09-12T17:27:42.428492+0000","last_unstale":"2024-09-12T17:31:27.303000+0000","last_undegraded":"2024-09-12T17:31:27.303000+0000","last_fullsized":"2024-09-12T17:31:27.303000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:27.302915+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:27.302915+0000","last_clean_scrub_stamp":"2024-09-12T17:31:27.302915+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:55.284211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"29'2","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:14.354822+0000","last_change":"2024-09-12T17:31:14.354822+0000","last_active":"2024-09-12T17:31:14.354822+0000","last_peered":"2024-09-12T17:31:14.354822+0000","last_clean":"2024-09-12T17:31:14.354822+0000","last_became_active":"2024-09-12T17:28:21.474758+0000","last_became_peered":"2024-09-12T17:28:21.474758+0000","last_unstale":"2024-09-12T17:31:14.354822+0000","last_undegraded":"2024-09-12T17:31:14.354822+0000","last_fullsized":"2024-09-12T17:31:14.354822+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-12T17:31:14.354735+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-12T17:31:14.354735+0000","last_clean_scrub_stamp":"2024-09-12T17:31:14.354735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:06.230735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"31'2","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:26.883823+0000","last_change":"2024-09-12T17:31:26.883823+0000","last_active":"2024-09-12T17:31:26.883823+0000","last_peered":"2024-09-12T17:31:26.883823+0000","last_clean":"2024-09-12T17:31:26.883823+0000","last_became_active":"2024-09-12T17:27:42.424738+0000","last_became_peered":"2024-09-12T17:27:42.424738+0000","last_unstale":"2024-09-12T17:31:26.883823+0000","last_undegraded":"2024-09-12T17:31:26.883823+0000","last_fullsized":"2024-09-12T17:31:26.883823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:26.883725+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:26.883725+0000","last_clean_scrub_stamp":"2024-09-12T17:31:26.883725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:55.999346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:10.251786+0000","last_change":"2024-09-12T17:31:10.251786+0000","last_active":"2024-09-12T17:31:10.251786+0000","last_peered":"2024-09-12T17:31:10.251786+0000","last_clean":"2024-09-12T17:31:10.251786+0000","last_became_active":"2024-09-12T17:27:40.414669+0000","last_became_peered":"2024-09-12T17:27:40.414669+0000","last_unstale":"2024-09-12T17:31:10.251786+0000","last_undegraded":"2024-09-12T17:31:10.251786+0000","last_fullsized":"2024-09-12T17:31:10.251786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:10.251701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:10.251701+0000","last_clean_scrub_stamp":"2024-09-12T17:31:10.251701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:31.254231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"31'8","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:27.238292+0000","last_change":"2024-09-12T17:31:27.238292+0000","last_active":"2024-09-12T17:31:27.238292+0000","last_peered":"2024-09-12T17:31:27.238292+0000","last_clean":"2024-09-12T17:31:27.238292+0000","last_became_active":"2024-09-12T17:27:42.435928+0000","last_became_peered":"2024-09-12T17:27:42.435928+0000","last_unstale":"2024-09-12T17:31:27.238292+0000","last_undegraded":"2024-09-12T17:31:27.238292+0000","last_fullsized":"2024-09-12T17:31:27.238292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:27.238196+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:27.238196+0000","last_clean_scrub_stamp":"2024-09-12T17:31:27.238196+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:11.477246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:11.894841+0000","last_change":"2024-09-12T17:31:11.894841+0000","last_active":"2024-09-12T17:31:11.894841+0000","last_peered":"2024-09-12T17:31:11.894841+0000","last_clean":"2024-09-12T17:31:11.894841+0000","last_became_active":"2024-09-12T17:27:40.419936+0000","last_became_peered":"2024-09-12T17:27:40.419936+0000","last_unstale":"2024-09-12T17:31:11.894841+0000","last_undegraded":"2024-09-12T17:31:11.894841+0000","last_fullsized":"2024-09-12T17:31:11.894841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:11.894749+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:11.894749+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.894749+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:17.780383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"31'6","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:28.322665+0000","last_change":"2024-09-12T17:31:28.322665+0000","last_active":"2024-09-12T17:31:28.322665+0000","last_peered":"2024-09-12T17:31:28.322665+0000","last_clean":"2024-09-12T17:31:28.322665+0000","last_became_active":"2024-09-12T17:27:42.423569+0000","last_became_peered":"2024-09-12T17:27:42.423569+0000","last_unstale":"2024-09-12T17:31:28.322665+0000","last_undegraded":"2024-09-12T17:31:28.322665+0000","last_fullsized":"2024-09-12T17:31:28.322665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-12T17:31:28.322583+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-12T17:31:28.322583+0000","last_clean_scrub_stamp":"2024-09-12T17:31:28.322583+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:37.072614+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:22.482194+0000","last_change":"2024-09-12T17:31:22.482090+0000","last_active":"2024-09-12T17:31:22.482194+0000","last_peered":"2024-09-12T17:31:22.482194+0000","last_clean":"2024-09-12T17:31:22.482194+0000","last_became_active":"2024-09-12T17:27:40.426721+0000","last_became_peered":"2024-09-12T17:27:40.426721+0000","last_unstale":"2024-09-12T17:31:22.482194+0000","last_undegraded":"2024-09-12T17:31:22.482194+0000","last_fullsized":"2024-09-12T17:31:22.482194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:22.481974+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:22.481974+0000","last_clean_scrub_stamp":"2024-09-12T17:31:22.481974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:55.953993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"31'36","reported_seq":109,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:58.185554+0000","last_change":"2024-09-12T17:31:58.185554+0000","last_active":"2024-09-12T17:31:58.185554+0000","last_peered":"2024-09-12T17:31:58.185554+0000","last_clean":"2024-09-12T17:31:58.185554+0000","last_became_active":"2024-09-12T17:27:50.456184+0000","last_became_peered":"2024-09-12T17:27:50.456184+0000","last_unstale":"2024-09-12T17:31:58.185554+0000","last_undegraded":"2024-09-12T17:31:58.185554+0000","last_fullsized":"2024-09-12T17:31:58.185554+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2024-09-12T17:31:58.185466+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2024-09-12T17:31:58.185466+0000","last_clean_scrub_stamp":"2024-09-12T17:31:58.185466+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:51.239821+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:36.387973+0000","last_change":"2024-09-12T17:31:36.387973+0000","last_active":"2024-09-12T17:31:36.387973+0000","last_peered":"2024-09-12T17:31:36.387973+0000","last_clean":"2024-09-12T17:31:36.387973+0000","last_became_active":"2024-09-12T17:27:42.420666+0000","last_became_peered":"2024-09-12T17:27:42.420666+0000","last_unstale":"2024-09-12T17:31:36.387973+0000","last_undegraded":"2024-09-12T17:31:36.387973+0000","last_fullsized":"2024-09-12T17:31:36.387973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:36.387861+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:36.387861+0000","last_clean_scrub_stamp":"2024-09-12T17:31:36.387861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:45.116536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:15.386957+0000","last_change":"2024-09-12T17:31:15.386849+0000","last_active":"2024-09-12T17:31:15.386957+0000","last_peered":"2024-09-12T17:31:15.386957+0000","last_clean":"2024-09-12T17:31:15.386957+0000","last_became_active":"2024-09-12T17:27:40.433044+0000","last_became_peered":"2024-09-12T17:27:40.433044+0000","last_unstale":"2024-09-12T17:31:15.386957+0000","last_undegraded":"2024-09-12T17:31:15.386957+0000","last_fullsized":"2024-09-12T17:31:15.386957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.386742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.386742+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.386742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:15.078612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:54.490500+0000","last_change":"2024-09-12T17:31:54.490500+0000","last_active":"2024-09-12T17:31:54.490500+0000","last_peered":"2024-09-12T17:31:54.490500+0000","last_clean":"2024-09-12T17:31:54.490500+0000","last_became_active":"2024-09-12T17:28:21.472106+0000","last_became_peered":"2024-09-12T17:28:21.472106+0000","last_unstale":"2024-09-12T17:31:54.490500+0000","last_undegraded":"2024-09-12T17:31:54.490500+0000","last_fullsized":"2024-09-12T17:31:54.490500+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:54.490405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:54.490405+0000","last_clean_scrub_stamp":"2024-09-12T17:31:54.490405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:19.790112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"31'37","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:04.438568+0000","last_change":"2024-09-12T17:32:04.438568+0000","last_active":"2024-09-12T17:32:04.438568+0000","last_peered":"2024-09-12T17:32:04.438568+0000","last_clean":"2024-09-12T17:32:04.438568+0000","last_became_active":"2024-09-12T17:27:46.441891+0000","last_became_peered":"2024-09-12T17:27:46.441891+0000","last_unstale":"2024-09-12T17:32:04.438568+0000","last_undegraded":"2024-09-12T17:32:04.438568+0000","last_fullsized":"2024-09-12T17:32:04.438568+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2024-09-12T17:32:04.438465+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2024-09-12T17:32:04.438465+0000","last_clean_scrub_stamp":"2024-09-12T17:32:04.438465+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:34.497334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:49.250043+0000","last_change":"2024-09-12T17:31:49.250043+0000","last_active":"2024-09-12T17:31:49.250043+0000","last_peered":"2024-09-12T17:31:49.250043+0000","last_clean":"2024-09-12T17:31:49.250043+0000","last_became_active":"2024-09-12T17:27:48.448078+0000","last_became_peered":"2024-09-12T17:27:48.448078+0000","last_unstale":"2024-09-12T17:31:49.250043+0000","last_undegraded":"2024-09-12T17:31:49.250043+0000","last_fullsized":"2024-09-12T17:31:49.250043+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:49.249951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:49.249951+0000","last_clean_scrub_stamp":"2024-09-12T17:31:49.249951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:59.102237+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"31'7","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:59.228042+0000","last_change":"2024-09-12T17:31:59.228042+0000","last_active":"2024-09-12T17:31:59.228042+0000","last_peered":"2024-09-12T17:31:59.228042+0000","last_clean":"2024-09-12T17:31:59.228042+0000","last_became_active":"2024-09-12T17:27:50.457037+0000","last_became_peered":"2024-09-12T17:27:50.457037+0000","last_unstale":"2024-09-12T17:31:59.228042+0000","last_undegraded":"2024-09-12T17:31:59.228042+0000","last_fullsized":"2024-09-12T17:31:59.228042+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'7","last_scrub_stamp":"2024-09-12T17:31:59.227925+0000","last_deep_scrub":"31'7","last_deep_scrub_stamp":"2024-09-12T17:31:59.227925+0000","last_clean_scrub_stamp":"2024-09-12T17:31:59.227925+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:58.614798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:35.433441+0000","last_change":"2024-09-12T17:31:35.433441+0000","last_active":"2024-09-12T17:31:35.433441+0000","last_peered":"2024-09-12T17:31:35.433441+0000","last_clean":"2024-09-12T17:31:35.433441+0000","last_became_active":"2024-09-12T17:27:42.427872+0000","last_became_peered":"2024-09-12T17:27:42.427872+0000","last_unstale":"2024-09-12T17:31:35.433441+0000","last_undegraded":"2024-09-12T17:31:35.433441+0000","last_fullsized":"2024-09-12T17:31:35.433441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:35.433325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:35.433325+0000","last_clean_scrub_stamp":"2024-09-12T17:31:35.433325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:14.341661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:06.079744+0000","last_change":"2024-09-12T17:31:06.079744+0000","last_active":"2024-09-12T17:31:06.079744+0000","last_peered":"2024-09-12T17:31:06.079744+0000","last_clean":"2024-09-12T17:31:06.079744+0000","last_became_active":"2024-09-12T17:27:40.430969+0000","last_became_peered":"2024-09-12T17:27:40.430969+0000","last_unstale":"2024-09-12T17:31:06.079744+0000","last_undegraded":"2024-09-12T17:31:06.079744+0000","last_fullsized":"2024-09-12T17:31:06.079744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:06.079660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:06.079660+0000","last_clean_scrub_stamp":"2024-09-12T17:31:06.079660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:37.732174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:34.891676+0000","last_change":"2024-09-12T17:31:34.891676+0000","last_active":"2024-09-12T17:31:34.891676+0000","last_peered":"2024-09-12T17:31:34.891676+0000","last_clean":"2024-09-12T17:31:34.891676+0000","last_became_active":"2024-09-12T17:27:44.427560+0000","last_became_peered":"2024-09-12T17:27:44.427560+0000","last_unstale":"2024-09-12T17:31:34.891676+0000","last_undegraded":"2024-09-12T17:31:34.891676+0000","last_fullsized":"2024-09-12T17:31:34.891676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:34.891583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:34.891583+0000","last_clean_scrub_stamp":"2024-09-12T17:31:34.891583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:39.698964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"31'9","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:44.202804+0000","last_change":"2024-09-12T17:31:44.202804+0000","last_active":"2024-09-12T17:31:44.202804+0000","last_peered":"2024-09-12T17:31:44.202804+0000","last_clean":"2024-09-12T17:31:44.202804+0000","last_became_active":"2024-09-12T17:27:46.436065+0000","last_became_peered":"2024-09-12T17:27:46.436065+0000","last_unstale":"2024-09-12T17:31:44.202804+0000","last_undegraded":"2024-09-12T17:31:44.202804+0000","last_fullsized":"2024-09-12T17:31:44.202804+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'9","last_scrub_stamp":"2024-09-12T17:31:44.202702+0000","last_deep_scrub":"31'9","last_deep_scrub_stamp":"2024-09-12T17:31:44.202702+0000","last_clean_scrub_stamp":"2024-09-12T17:31:44.202702+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:36.305048+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:50.273274+0000","last_change":"2024-09-12T17:31:50.273274+0000","last_active":"2024-09-12T17:31:50.273274+0000","last_peered":"2024-09-12T17:31:50.273274+0000","last_clean":"2024-09-12T17:31:50.273274+0000","last_became_active":"2024-09-12T17:27:48.441192+0000","last_became_peered":"2024-09-12T17:27:48.441192+0000","last_unstale":"2024-09-12T17:31:50.273274+0000","last_undegraded":"2024-09-12T17:31:50.273274+0000","last_fullsized":"2024-09-12T17:31:50.273274+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:50.273191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:50.273191+0000","last_clean_scrub_stamp":"2024-09-12T17:31:50.273191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:58.027939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"29'2","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:00.165631+0000","last_change":"2024-09-12T17:32:00.165631+0000","last_active":"2024-09-12T17:32:00.165631+0000","last_peered":"2024-09-12T17:32:00.165631+0000","last_clean":"2024-09-12T17:32:00.165631+0000","last_became_active":"2024-09-12T17:27:50.451589+0000","last_became_peered":"2024-09-12T17:27:50.451589+0000","last_unstale":"2024-09-12T17:32:00.165631+0000","last_undegraded":"2024-09-12T17:32:00.165631+0000","last_fullsized":"2024-09-12T17:32:00.165631+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-12T17:32:00.165538+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-12T17:32:00.165538+0000","last_clean_scrub_stamp":"2024-09-12T17:32:00.165538+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:55.837683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"31'8","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:39.517731+0000","last_change":"2024-09-12T17:31:39.517731+0000","last_active":"2024-09-12T17:31:39.517731+0000","last_peered":"2024-09-12T17:31:39.517731+0000","last_clean":"2024-09-12T17:31:39.517731+0000","last_became_active":"2024-09-12T17:27:42.426402+0000","last_became_peered":"2024-09-12T17:27:42.426402+0000","last_unstale":"2024-09-12T17:31:39.517731+0000","last_undegraded":"2024-09-12T17:31:39.517731+0000","last_fullsized":"2024-09-12T17:31:39.517731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:39.517638+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:39.517638+0000","last_clean_scrub_stamp":"2024-09-12T17:31:39.517638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:39.295946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:11.413094+0000","last_change":"2024-09-12T17:31:11.412979+0000","last_active":"2024-09-12T17:31:11.413094+0000","last_peered":"2024-09-12T17:31:11.413094+0000","last_clean":"2024-09-12T17:31:11.413094+0000","last_became_active":"2024-09-12T17:27:40.427860+0000","last_became_peered":"2024-09-12T17:27:40.427860+0000","last_unstale":"2024-09-12T17:31:11.413094+0000","last_undegraded":"2024-09-12T17:31:11.413094+0000","last_fullsized":"2024-09-12T17:31:11.413094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:11.412886+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:11.412886+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.412886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:55.973064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:33.930387+0000","last_change":"2024-09-12T17:31:33.930387+0000","last_active":"2024-09-12T17:31:33.930387+0000","last_peered":"2024-09-12T17:31:33.930387+0000","last_clean":"2024-09-12T17:31:33.930387+0000","last_became_active":"2024-09-12T17:27:44.430879+0000","last_became_peered":"2024-09-12T17:27:44.430879+0000","last_unstale":"2024-09-12T17:31:33.930387+0000","last_undegraded":"2024-09-12T17:31:33.930387+0000","last_fullsized":"2024-09-12T17:31:33.930387+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:33.930301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:33.930301+0000","last_clean_scrub_stamp":"2024-09-12T17:31:33.930301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:21.439880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"31'15","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:42.207431+0000","last_change":"2024-09-12T17:31:42.207431+0000","last_active":"2024-09-12T17:31:42.207431+0000","last_peered":"2024-09-12T17:31:42.207431+0000","last_clean":"2024-09-12T17:31:42.207431+0000","last_became_active":"2024-09-12T17:27:46.440203+0000","last_became_peered":"2024-09-12T17:27:46.440203+0000","last_unstale":"2024-09-12T17:31:42.207431+0000","last_undegraded":"2024-09-12T17:31:42.207431+0000","last_fullsized":"2024-09-12T17:31:42.207431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'15","last_scrub_stamp":"2024-09-12T17:31:42.207339+0000","last_deep_scrub":"31'15","last_deep_scrub_stamp":"2024-09-12T17:31:42.207339+0000","last_clean_scrub_stamp":"2024-09-12T17:31:42.207339+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:23.318607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"31'286","reported_seq":417,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:12.439098+0000","last_change":"2024-09-12T17:32:12.439098+0000","last_active":"2024-09-12T17:32:12.439098+0000","last_peered":"2024-09-12T17:32:12.439098+0000","last_clean":"2024-09-12T17:32:12.439098+0000","last_became_active":"2024-09-12T17:27:48.450897+0000","last_became_peered":"2024-09-12T17:27:48.450897+0000","last_unstale":"2024-09-12T17:32:12.439098+0000","last_undegraded":"2024-09-12T17:32:12.439098+0000","last_fullsized":"2024-09-12T17:32:12.439098+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'286","last_scrub_stamp":"2024-09-12T17:32:12.439009+0000","last_deep_scrub":"31'286","last_deep_scrub_stamp":"2024-09-12T17:32:12.439009+0000","last_clean_scrub_stamp":"2024-09-12T17:32:12.439009+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:07.919777+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:55.276749+0000","last_change":"2024-09-12T17:31:55.276749+0000","last_active":"2024-09-12T17:31:55.276749+0000","last_peered":"2024-09-12T17:31:55.276749+0000","last_clean":"2024-09-12T17:31:55.276749+0000","last_became_active":"2024-09-12T17:27:50.456376+0000","last_became_peered":"2024-09-12T17:27:50.456376+0000","last_unstale":"2024-09-12T17:31:55.276749+0000","last_undegraded":"2024-09-12T17:31:55.276749+0000","last_fullsized":"2024-09-12T17:31:55.276749+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:55.276668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:55.276668+0000","last_clean_scrub_stamp":"2024-09-12T17:31:55.276668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:22.077233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"31'12","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:18.820795+0000","last_change":"2024-09-12T17:31:18.820795+0000","last_active":"2024-09-12T17:31:18.820795+0000","last_peered":"2024-09-12T17:31:18.820795+0000","last_clean":"2024-09-12T17:31:18.820795+0000","last_became_active":"2024-09-12T17:27:42.426060+0000","last_became_peered":"2024-09-12T17:27:42.426060+0000","last_unstale":"2024-09-12T17:31:18.820795+0000","last_undegraded":"2024-09-12T17:31:18.820795+0000","last_fullsized":"2024-09-12T17:31:18.820795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-09-12T17:31:18.820697+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-09-12T17:31:18.820697+0000","last_clean_scrub_stamp":"2024-09-12T17:31:18.820697+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:36.452576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:02.411977+0000","last_change":"2024-09-12T17:31:02.411977+0000","last_active":"2024-09-12T17:31:02.411977+0000","last_peered":"2024-09-12T17:31:02.411977+0000","last_clean":"2024-09-12T17:31:02.411977+0000","last_became_active":"2024-09-12T17:27:40.415702+0000","last_became_peered":"2024-09-12T17:27:40.415702+0000","last_unstale":"2024-09-12T17:31:02.411977+0000","last_undegraded":"2024-09-12T17:31:02.411977+0000","last_fullsized":"2024-09-12T17:31:02.411977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:02.411854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:02.411854+0000","last_clean_scrub_stamp":"2024-09-12T17:31:02.411854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:49:02.090895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:56.514565+0000","last_change":"2024-09-12T17:31:56.514565+0000","last_active":"2024-09-12T17:31:56.514565+0000","last_peered":"2024-09-12T17:31:56.514565+0000","last_clean":"2024-09-12T17:31:56.514565+0000","last_became_active":"2024-09-12T17:27:44.428526+0000","last_became_peered":"2024-09-12T17:27:44.428526+0000","last_unstale":"2024-09-12T17:31:56.514565+0000","last_undegraded":"2024-09-12T17:31:56.514565+0000","last_fullsized":"2024-09-12T17:31:56.514565+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:56.514483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:56.514483+0000","last_clean_scrub_stamp":"2024-09-12T17:31:56.514483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:10.869206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"31'37","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:43.169088+0000","last_change":"2024-09-12T17:31:43.169088+0000","last_active":"2024-09-12T17:31:43.169088+0000","last_peered":"2024-09-12T17:31:43.169088+0000","last_clean":"2024-09-12T17:31:43.169088+0000","last_became_active":"2024-09-12T17:27:46.440765+0000","last_became_peered":"2024-09-12T17:27:46.440765+0000","last_unstale":"2024-09-12T17:31:43.169088+0000","last_undegraded":"2024-09-12T17:31:43.169088+0000","last_fullsized":"2024-09-12T17:31:43.169088+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2024-09-12T17:31:43.168991+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2024-09-12T17:31:43.168991+0000","last_clean_scrub_stamp":"2024-09-12T17:31:43.168991+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:43.089499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"31'286","reported_seq":448,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:49.037938+0000","last_change":"2024-09-12T17:31:49.037938+0000","last_active":"2024-09-12T17:31:49.037938+0000","last_peered":"2024-09-12T17:31:49.037938+0000","last_clean":"2024-09-12T17:31:49.037938+0000","last_became_active":"2024-09-12T17:27:48.439642+0000","last_became_peered":"2024-09-12T17:27:48.439642+0000","last_unstale":"2024-09-12T17:31:49.037938+0000","last_undegraded":"2024-09-12T17:31:49.037938+0000","last_fullsized":"2024-09-12T17:31:49.037938+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'286","last_scrub_stamp":"2024-09-12T17:31:49.037839+0000","last_deep_scrub":"31'286","last_deep_scrub_stamp":"2024-09-12T17:31:49.037839+0000","last_clean_scrub_stamp":"2024-09-12T17:31:49.037839+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:34:11.064004+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"31'12","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:32.537003+0000","last_change":"2024-09-12T17:31:32.536913+0000","last_active":"2024-09-12T17:31:32.537003+0000","last_peered":"2024-09-12T17:31:32.537003+0000","last_clean":"2024-09-12T17:31:32.537003+0000","last_became_active":"2024-09-12T17:27:42.427990+0000","last_became_peered":"2024-09-12T17:27:42.427990+0000","last_unstale":"2024-09-12T17:31:32.537003+0000","last_undegraded":"2024-09-12T17:31:32.537003+0000","last_fullsized":"2024-09-12T17:31:32.537003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-09-12T17:31:32.536801+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-09-12T17:31:32.536801+0000","last_clean_scrub_stamp":"2024-09-12T17:31:32.536801+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:58.780921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"29'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:05.090948+0000","last_change":"2024-09-12T17:31:05.090851+0000","last_active":"2024-09-12T17:31:05.090948+0000","last_peered":"2024-09-12T17:31:05.090948+0000","last_clean":"2024-09-12T17:31:05.090948+0000","last_became_active":"2024-09-12T17:27:40.428462+0000","last_became_peered":"2024-09-12T17:27:40.428462+0000","last_unstale":"2024-09-12T17:31:05.090948+0000","last_undegraded":"2024-09-12T17:31:05.090948+0000","last_fullsized":"2024-09-12T17:31:05.090948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-12T17:31:05.090744+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-12T17:31:05.090744+0000","last_clean_scrub_stamp":"2024-09-12T17:31:05.090744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:12.385812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:32.302841+0000","last_change":"2024-09-12T17:31:32.302755+0000","last_active":"2024-09-12T17:31:32.302841+0000","last_peered":"2024-09-12T17:31:32.302841+0000","last_clean":"2024-09-12T17:31:32.302841+0000","last_became_active":"2024-09-12T17:27:44.431911+0000","last_became_peered":"2024-09-12T17:27:44.431911+0000","last_unstale":"2024-09-12T17:31:32.302841+0000","last_undegraded":"2024-09-12T17:31:32.302841+0000","last_fullsized":"2024-09-12T17:31:32.302841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:32.302660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:32.302660+0000","last_clean_scrub_stamp":"2024-09-12T17:31:32.302660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:32.223168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"31'53","reported_seq":114,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:39.122583+0000","last_change":"2024-09-12T17:31:39.122513+0000","last_active":"2024-09-12T17:31:39.122583+0000","last_peered":"2024-09-12T17:31:39.122583+0000","last_clean":"2024-09-12T17:31:39.122583+0000","last_became_active":"2024-09-12T17:27:46.439188+0000","last_became_peered":"2024-09-12T17:27:46.439188+0000","last_unstale":"2024-09-12T17:31:39.122583+0000","last_undegraded":"2024-09-12T17:31:39.122583+0000","last_fullsized":"2024-09-12T17:31:39.122583+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'53","last_scrub_stamp":"2024-09-12T17:31:39.122418+0000","last_deep_scrub":"31'53","last_deep_scrub_stamp":"2024-09-12T17:31:39.122418+0000","last_clean_scrub_stamp":"2024-09-12T17:31:39.122418+0000","objects_scrubbed":9,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:47.872448+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:58.152595+0000","last_change":"2024-09-12T17:31:58.152535+0000","last_active":"2024-09-12T17:31:58.152595+0000","last_peered":"2024-09-12T17:31:58.152595+0000","last_clean":"2024-09-12T17:31:58.152595+0000","last_became_active":"2024-09-12T17:27:48.441618+0000","last_became_peered":"2024-09-12T17:27:48.441618+0000","last_unstale":"2024-09-12T17:31:58.152595+0000","last_undegraded":"2024-09-12T17:31:58.152595+0000","last_fullsized":"2024-09-12T17:31:58.152595+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:58.152443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:58.152443+0000","last_clean_scrub_stamp":"2024-09-12T17:31:58.152443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:10.503764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"31'7","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:53.281735+0000","last_change":"2024-09-12T17:31:53.281651+0000","last_active":"2024-09-12T17:31:53.281735+0000","last_peered":"2024-09-12T17:31:53.281735+0000","last_clean":"2024-09-12T17:31:53.281735+0000","last_became_active":"2024-09-12T17:27:50.457350+0000","last_became_peered":"2024-09-12T17:27:50.457350+0000","last_unstale":"2024-09-12T17:31:53.281735+0000","last_undegraded":"2024-09-12T17:31:53.281735+0000","last_fullsized":"2024-09-12T17:31:53.281735+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'7","last_scrub_stamp":"2024-09-12T17:31:53.281555+0000","last_deep_scrub":"31'7","last_deep_scrub_stamp":"2024-09-12T17:31:53.281555+0000","last_clean_scrub_stamp":"2024-09-12T17:31:53.281555+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:15.825245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"31'20","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:15.344065+0000","last_change":"2024-09-12T17:31:15.343990+0000","last_active":"2024-09-12T17:31:15.344065+0000","last_peered":"2024-09-12T17:31:15.344065+0000","last_clean":"2024-09-12T17:31:15.344065+0000","last_became_active":"2024-09-12T17:27:42.424268+0000","last_became_peered":"2024-09-12T17:27:42.424268+0000","last_unstale":"2024-09-12T17:31:15.344065+0000","last_undegraded":"2024-09-12T17:31:15.344065+0000","last_fullsized":"2024-09-12T17:31:15.344065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'20","last_scrub_stamp":"2024-09-12T17:31:15.343895+0000","last_deep_scrub":"31'20","last_deep_scrub_stamp":"2024-09-12T17:31:15.343895+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.343895+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:21.229528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":75,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:02.018765+0000","last_change":"2024-09-12T17:31:02.018708+0000","last_active":"2024-09-12T17:31:02.018765+0000","last_peered":"2024-09-12T17:31:02.018765+0000","last_clean":"2024-09-12T17:31:02.018765+0000","last_became_active":"2024-09-12T17:27:40.427677+0000","last_became_peered":"2024-09-12T17:27:40.427677+0000","last_unstale":"2024-09-12T17:31:02.018765+0000","last_undegraded":"2024-09-12T17:31:02.018765+0000","last_fullsized":"2024-09-12T17:31:02.018765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:02.018612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:02.018612+0000","last_clean_scrub_stamp":"2024-09-12T17:31:02.018612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:03.467671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:29.829930+0000","last_change":"2024-09-12T17:31:29.829824+0000","last_active":"2024-09-12T17:31:29.829930+0000","last_peered":"2024-09-12T17:31:29.829930+0000","last_clean":"2024-09-12T17:31:29.829930+0000","last_became_active":"2024-09-12T17:27:44.434433+0000","last_became_peered":"2024-09-12T17:27:44.434433+0000","last_unstale":"2024-09-12T17:31:29.829930+0000","last_undegraded":"2024-09-12T17:31:29.829930+0000","last_fullsized":"2024-09-12T17:31:29.829930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:29.829730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:29.829730+0000","last_clean_scrub_stamp":"2024-09-12T17:31:29.829730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:14.124471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"31'37","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:05.445701+0000","last_change":"2024-09-12T17:32:05.445644+0000","last_active":"2024-09-12T17:32:05.445701+0000","last_peered":"2024-09-12T17:32:05.445701+0000","last_clean":"2024-09-12T17:32:05.445701+0000","last_became_active":"2024-09-12T17:27:46.442572+0000","last_became_peered":"2024-09-12T17:27:46.442572+0000","last_unstale":"2024-09-12T17:32:05.445701+0000","last_undegraded":"2024-09-12T17:32:05.445701+0000","last_fullsized":"2024-09-12T17:32:05.445701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2024-09-12T17:32:05.445541+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2024-09-12T17:32:05.445541+0000","last_clean_scrub_stamp":"2024-09-12T17:32:05.445541+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:01.051919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:48.064362+0000","last_change":"2024-09-12T17:31:48.064289+0000","last_active":"2024-09-12T17:31:48.064362+0000","last_peered":"2024-09-12T17:31:48.064362+0000","last_clean":"2024-09-12T17:31:48.064362+0000","last_became_active":"2024-09-12T17:27:48.445502+0000","last_became_peered":"2024-09-12T17:27:48.445502+0000","last_unstale":"2024-09-12T17:31:48.064362+0000","last_undegraded":"2024-09-12T17:31:48.064362+0000","last_fullsized":"2024-09-12T17:31:48.064362+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:48.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:48.064186+0000","last_clean_scrub_stamp":"2024-09-12T17:31:48.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:55.818934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"31'11","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:53.304691+0000","last_change":"2024-09-12T17:31:53.304576+0000","last_active":"2024-09-12T17:31:53.304691+0000","last_peered":"2024-09-12T17:31:53.304691+0000","last_clean":"2024-09-12T17:31:53.304691+0000","last_became_active":"2024-09-12T17:27:50.457691+0000","last_became_peered":"2024-09-12T17:27:50.457691+0000","last_unstale":"2024-09-12T17:31:53.304691+0000","last_undegraded":"2024-09-12T17:31:53.304691+0000","last_fullsized":"2024-09-12T17:31:53.304691+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'11","last_scrub_stamp":"2024-09-12T17:31:53.304462+0000","last_deep_scrub":"31'11","last_deep_scrub_stamp":"2024-09-12T17:31:53.304462+0000","last_clean_scrub_stamp":"2024-09-12T17:31:53.304462+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:54.162201+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":23,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"31'7","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:19.207503+0000","last_change":"2024-09-12T17:31:19.207381+0000","last_active":"2024-09-12T17:31:19.207503+0000","last_peered":"2024-09-12T17:31:19.207503+0000","last_clean":"2024-09-12T17:31:19.207503+0000","last_became_active":"2024-09-12T17:27:42.436517+0000","last_became_peered":"2024-09-12T17:27:42.436517+0000","last_unstale":"2024-09-12T17:31:19.207503+0000","last_undegraded":"2024-09-12T17:31:19.207503+0000","last_fullsized":"2024-09-12T17:31:19.207503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'7","last_scrub_stamp":"2024-09-12T17:31:19.207291+0000","last_deep_scrub":"31'7","last_deep_scrub_stamp":"2024-09-12T17:31:19.207291+0000","last_clean_scrub_stamp":"2024-09-12T17:31:19.207291+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:26.304916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:10.389582+0000","last_change":"2024-09-12T17:31:10.389482+0000","last_active":"2024-09-12T17:31:10.389582+0000","last_peered":"2024-09-12T17:31:10.389582+0000","last_clean":"2024-09-12T17:31:10.389582+0000","last_became_active":"2024-09-12T17:27:40.429663+0000","last_became_peered":"2024-09-12T17:27:40.429663+0000","last_unstale":"2024-09-12T17:31:10.389582+0000","last_undegraded":"2024-09-12T17:31:10.389582+0000","last_fullsized":"2024-09-12T17:31:10.389582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:10.389388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:10.389388+0000","last_clean_scrub_stamp":"2024-09-12T17:31:10.389388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:20.668432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:36.870732+0000","last_change":"2024-09-12T17:31:36.870675+0000","last_active":"2024-09-12T17:31:36.870732+0000","last_peered":"2024-09-12T17:31:36.870732+0000","last_clean":"2024-09-12T17:31:36.870732+0000","last_became_active":"2024-09-12T17:27:44.430772+0000","last_became_peered":"2024-09-12T17:27:44.430772+0000","last_unstale":"2024-09-12T17:31:36.870732+0000","last_undegraded":"2024-09-12T17:31:36.870732+0000","last_fullsized":"2024-09-12T17:31:36.870732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:36.870579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:36.870579+0000","last_clean_scrub_stamp":"2024-09-12T17:31:36.870579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:47.799822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"31'47","reported_seq":106,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:01.568840+0000","last_change":"2024-09-12T17:32:01.568771+0000","last_active":"2024-09-12T17:32:01.568840+0000","last_peered":"2024-09-12T17:32:01.568840+0000","last_clean":"2024-09-12T17:32:01.568840+0000","last_became_active":"2024-09-12T17:27:46.444206+0000","last_became_peered":"2024-09-12T17:27:46.444206+0000","last_unstale":"2024-09-12T17:32:01.568840+0000","last_undegraded":"2024-09-12T17:32:01.568840+0000","last_fullsized":"2024-09-12T17:32:01.568840+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'47","last_scrub_stamp":"2024-09-12T17:32:01.568683+0000","last_deep_scrub":"31'47","last_deep_scrub_stamp":"2024-09-12T17:32:01.568683+0000","last_clean_scrub_stamp":"2024-09-12T17:32:01.568683+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:38.716991+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"31'286","reported_seq":411,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:45.012810+0000","last_change":"2024-09-12T17:31:45.012737+0000","last_active":"2024-09-12T17:31:45.012810+0000","last_peered":"2024-09-12T17:31:45.012810+0000","last_clean":"2024-09-12T17:31:45.012810+0000","last_became_active":"2024-09-12T17:27:48.447724+0000","last_became_peered":"2024-09-12T17:27:48.447724+0000","last_unstale":"2024-09-12T17:31:45.012810+0000","last_undegraded":"2024-09-12T17:31:45.012810+0000","last_fullsized":"2024-09-12T17:31:45.012810+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'286","last_scrub_stamp":"2024-09-12T17:31:45.012653+0000","last_deep_scrub":"31'286","last_deep_scrub_stamp":"2024-09-12T17:31:45.012653+0000","last_clean_scrub_stamp":"2024-09-12T17:31:45.012653+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:11.878520+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"31'4","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:55.160230+0000","last_change":"2024-09-12T17:31:55.160166+0000","last_active":"2024-09-12T17:31:55.160230+0000","last_peered":"2024-09-12T17:31:55.160230+0000","last_clean":"2024-09-12T17:31:55.160230+0000","last_became_active":"2024-09-12T17:27:50.451716+0000","last_became_peered":"2024-09-12T17:27:50.451716+0000","last_unstale":"2024-09-12T17:31:55.160230+0000","last_undegraded":"2024-09-12T17:31:55.160230+0000","last_fullsized":"2024-09-12T17:31:55.160230+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:55.160079+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:55.160079+0000","last_clean_scrub_stamp":"2024-09-12T17:31:55.160079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:53:48.158349+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"31'4","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:18.197232+0000","last_change":"2024-09-12T17:31:18.197113+0000","last_active":"2024-09-12T17:31:18.197232+0000","last_peered":"2024-09-12T17:31:18.197232+0000","last_clean":"2024-09-12T17:31:18.197232+0000","last_became_active":"2024-09-12T17:27:42.429624+0000","last_became_peered":"2024-09-12T17:27:42.429624+0000","last_unstale":"2024-09-12T17:31:18.197232+0000","last_undegraded":"2024-09-12T17:31:18.197232+0000","last_fullsized":"2024-09-12T17:31:18.197232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:18.197003+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:18.197003+0000","last_clean_scrub_stamp":"2024-09-12T17:31:18.197003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:31:53.642094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:12.393323+0000","last_change":"2024-09-12T17:31:12.393232+0000","last_active":"2024-09-12T17:31:12.393323+0000","last_peered":"2024-09-12T17:31:12.393323+0000","last_clean":"2024-09-12T17:31:12.393323+0000","last_became_active":"2024-09-12T17:27:40.423291+0000","last_became_peered":"2024-09-12T17:27:40.423291+0000","last_unstale":"2024-09-12T17:31:12.393323+0000","last_undegraded":"2024-09-12T17:31:12.393323+0000","last_fullsized":"2024-09-12T17:31:12.393323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:12.393115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:12.393115+0000","last_clean_scrub_stamp":"2024-09-12T17:31:12.393115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:06.951305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:28.877953+0000","last_change":"2024-09-12T17:31:28.877883+0000","last_active":"2024-09-12T17:31:28.877953+0000","last_peered":"2024-09-12T17:31:28.877953+0000","last_clean":"2024-09-12T17:31:28.877953+0000","last_became_active":"2024-09-12T17:27:44.430549+0000","last_became_peered":"2024-09-12T17:27:44.430549+0000","last_unstale":"2024-09-12T17:31:28.877953+0000","last_undegraded":"2024-09-12T17:31:28.877953+0000","last_fullsized":"2024-09-12T17:31:28.877953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:28.877789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:28.877789+0000","last_clean_scrub_stamp":"2024-09-12T17:31:28.877789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:38.715807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"31'67","reported_seq":141,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:00.538782+0000","last_change":"2024-09-12T17:32:00.538682+0000","last_active":"2024-09-12T17:32:00.538782+0000","last_peered":"2024-09-12T17:32:00.538782+0000","last_clean":"2024-09-12T17:32:00.538782+0000","last_became_active":"2024-09-12T17:27:46.440805+0000","last_became_peered":"2024-09-12T17:27:46.440805+0000","last_unstale":"2024-09-12T17:32:00.538782+0000","last_undegraded":"2024-09-12T17:32:00.538782+0000","last_fullsized":"2024-09-12T17:32:00.538782+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'67","last_scrub_stamp":"2024-09-12T17:32:00.538575+0000","last_deep_scrub":"31'67","last_deep_scrub_stamp":"2024-09-12T17:32:00.538575+0000","last_clean_scrub_stamp":"2024-09-12T17:32:00.538575+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:05.569873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":65,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:52.146807+0000","last_change":"2024-09-12T17:31:52.146732+0000","last_active":"2024-09-12T17:31:52.146807+0000","last_peered":"2024-09-12T17:31:52.146807+0000","last_clean":"2024-09-12T17:31:52.146807+0000","last_became_active":"2024-09-12T17:27:48.442880+0000","last_became_peered":"2024-09-12T17:27:48.442880+0000","last_unstale":"2024-09-12T17:31:52.146807+0000","last_undegraded":"2024-09-12T17:31:52.146807+0000","last_fullsized":"2024-09-12T17:31:52.146807+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:52.146643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:52.146643+0000","last_clean_scrub_stamp":"2024-09-12T17:31:52.146643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:38.895711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"31'23","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:56.120907+0000","last_change":"2024-09-12T17:31:56.120828+0000","last_active":"2024-09-12T17:31:56.120907+0000","last_peered":"2024-09-12T17:31:56.120907+0000","last_clean":"2024-09-12T17:31:56.120907+0000","last_became_active":"2024-09-12T17:27:50.454410+0000","last_became_peered":"2024-09-12T17:27:50.454410+0000","last_unstale":"2024-09-12T17:31:56.120907+0000","last_undegraded":"2024-09-12T17:31:56.120907+0000","last_fullsized":"2024-09-12T17:31:56.120907+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'23","last_scrub_stamp":"2024-09-12T17:31:56.120744+0000","last_deep_scrub":"31'23","last_deep_scrub_stamp":"2024-09-12T17:31:56.120744+0000","last_clean_scrub_stamp":"2024-09-12T17:31:56.120744+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:49.175099+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"31'10","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:16.298048+0000","last_change":"2024-09-12T17:31:16.297952+0000","last_active":"2024-09-12T17:31:16.298048+0000","last_peered":"2024-09-12T17:31:16.298048+0000","last_clean":"2024-09-12T17:31:16.298048+0000","last_became_active":"2024-09-12T17:27:42.435913+0000","last_became_peered":"2024-09-12T17:27:42.435913+0000","last_unstale":"2024-09-12T17:31:16.298048+0000","last_undegraded":"2024-09-12T17:31:16.298048+0000","last_fullsized":"2024-09-12T17:31:16.298048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-12T17:31:16.297850+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-12T17:31:16.297850+0000","last_clean_scrub_stamp":"2024-09-12T17:31:16.297850+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:00.536900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:09.860566+0000","last_change":"2024-09-12T17:31:09.860489+0000","last_active":"2024-09-12T17:31:09.860566+0000","last_peered":"2024-09-12T17:31:09.860566+0000","last_clean":"2024-09-12T17:31:09.860566+0000","last_became_active":"2024-09-12T17:27:40.415703+0000","last_became_peered":"2024-09-12T17:27:40.415703+0000","last_unstale":"2024-09-12T17:31:09.860566+0000","last_undegraded":"2024-09-12T17:31:09.860566+0000","last_fullsized":"2024-09-12T17:31:09.860566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:09.860396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:09.860396+0000","last_clean_scrub_stamp":"2024-09-12T17:31:09.860396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:27.321941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:31.156403+0000","last_change":"2024-09-12T17:31:31.156349+0000","last_active":"2024-09-12T17:31:31.156403+0000","last_peered":"2024-09-12T17:31:31.156403+0000","last_clean":"2024-09-12T17:31:31.156403+0000","last_became_active":"2024-09-12T17:27:44.432588+0000","last_became_peered":"2024-09-12T17:27:44.432588+0000","last_unstale":"2024-09-12T17:31:31.156403+0000","last_undegraded":"2024-09-12T17:31:31.156403+0000","last_fullsized":"2024-09-12T17:31:31.156403+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:31.156264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:31.156264+0000","last_clean_scrub_stamp":"2024-09-12T17:31:31.156264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:46.128476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"31'40","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:43.253116+0000","last_change":"2024-09-12T17:31:43.253053+0000","last_active":"2024-09-12T17:31:43.253116+0000","last_peered":"2024-09-12T17:31:43.253116+0000","last_clean":"2024-09-12T17:31:43.253116+0000","last_became_active":"2024-09-12T17:27:46.432354+0000","last_became_peered":"2024-09-12T17:27:46.432354+0000","last_unstale":"2024-09-12T17:31:43.253116+0000","last_undegraded":"2024-09-12T17:31:43.253116+0000","last_fullsized":"2024-09-12T17:31:43.253116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'40","last_scrub_stamp":"2024-09-12T17:31:43.252950+0000","last_deep_scrub":"31'40","last_deep_scrub_stamp":"2024-09-12T17:31:43.252950+0000","last_clean_scrub_stamp":"2024-09-12T17:31:43.252950+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:37.973626+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:15.384782+0000","last_change":"2024-09-12T17:32:15.384721+0000","last_active":"2024-09-12T17:32:15.384782+0000","last_peered":"2024-09-12T17:32:15.384782+0000","last_clean":"2024-09-12T17:32:15.384782+0000","last_became_active":"2024-09-12T17:27:48.451510+0000","last_became_peered":"2024-09-12T17:27:48.451510+0000","last_unstale":"2024-09-12T17:32:15.384782+0000","last_undegraded":"2024-09-12T17:32:15.384782+0000","last_fullsized":"2024-09-12T17:32:15.384782+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:32:15.384619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:32:15.384619+0000","last_clean_scrub_stamp":"2024-09-12T17:32:15.384619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:42.682447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"31'8","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:17.364521+0000","last_change":"2024-09-12T17:32:17.364521+0000","last_active":"2024-09-12T17:32:17.364521+0000","last_peered":"2024-09-12T17:32:17.364521+0000","last_clean":"2024-09-12T17:32:17.364521+0000","last_became_active":"2024-09-12T17:27:50.454890+0000","last_became_peered":"2024-09-12T17:27:50.454890+0000","last_unstale":"2024-09-12T17:32:17.364521+0000","last_undegraded":"2024-09-12T17:32:17.364521+0000","last_fullsized":"2024-09-12T17:32:17.364521+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:32:17.364431+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:32:17.364431+0000","last_clean_scrub_stamp":"2024-09-12T17:32:17.364431+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:02.947715+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"31'8","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:33.513235+0000","last_change":"2024-09-12T17:31:33.513178+0000","last_active":"2024-09-12T17:31:33.513235+0000","last_peered":"2024-09-12T17:31:33.513235+0000","last_clean":"2024-09-12T17:31:33.513235+0000","last_became_active":"2024-09-12T17:27:42.440204+0000","last_became_peered":"2024-09-12T17:27:42.440204+0000","last_unstale":"2024-09-12T17:31:33.513235+0000","last_undegraded":"2024-09-12T17:31:33.513235+0000","last_fullsized":"2024-09-12T17:31:33.513235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:33.513094+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:33.513094+0000","last_clean_scrub_stamp":"2024-09-12T17:31:33.513094+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:57.471769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:09.348952+0000","last_change":"2024-09-12T17:31:09.348825+0000","last_active":"2024-09-12T17:31:09.348952+0000","last_peered":"2024-09-12T17:31:09.348952+0000","last_clean":"2024-09-12T17:31:09.348952+0000","last_became_active":"2024-09-12T17:27:40.428232+0000","last_became_peered":"2024-09-12T17:27:40.428232+0000","last_unstale":"2024-09-12T17:31:09.348952+0000","last_undegraded":"2024-09-12T17:31:09.348952+0000","last_fullsized":"2024-09-12T17:31:09.348952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:09.348730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:09.348730+0000","last_clean_scrub_stamp":"2024-09-12T17:31:09.348730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:20.262551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:31.879077+0000","last_change":"2024-09-12T17:31:31.879020+0000","last_active":"2024-09-12T17:31:31.879077+0000","last_peered":"2024-09-12T17:31:31.879077+0000","last_clean":"2024-09-12T17:31:31.879077+0000","last_became_active":"2024-09-12T17:27:44.432211+0000","last_became_peered":"2024-09-12T17:27:44.432211+0000","last_unstale":"2024-09-12T17:31:31.879077+0000","last_undegraded":"2024-09-12T17:31:31.879077+0000","last_fullsized":"2024-09-12T17:31:31.879077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:31.878931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:31.878931+0000","last_clean_scrub_stamp":"2024-09-12T17:31:31.878931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:53:23.177009+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"31'46","reported_seq":105,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:40.157870+0000","last_change":"2024-09-12T17:31:40.157807+0000","last_active":"2024-09-12T17:31:40.157870+0000","last_peered":"2024-09-12T17:31:40.157870+0000","last_clean":"2024-09-12T17:31:40.157870+0000","last_became_active":"2024-09-12T17:27:46.433672+0000","last_became_peered":"2024-09-12T17:27:46.433672+0000","last_unstale":"2024-09-12T17:31:40.157870+0000","last_undegraded":"2024-09-12T17:31:40.157870+0000","last_fullsized":"2024-09-12T17:31:40.157870+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2024-09-12T17:31:40.157697+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2024-09-12T17:31:40.157697+0000","last_clean_scrub_stamp":"2024-09-12T17:31:40.157697+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:06.714141+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"31'286","reported_seq":417,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:46.213021+0000","last_change":"2024-09-12T17:31:46.212968+0000","last_active":"2024-09-12T17:31:46.213021+0000","last_peered":"2024-09-12T17:31:46.213021+0000","last_clean":"2024-09-12T17:31:46.213021+0000","last_became_active":"2024-09-12T17:27:48.440335+0000","last_became_peered":"2024-09-12T17:27:48.440335+0000","last_unstale":"2024-09-12T17:31:46.213021+0000","last_undegraded":"2024-09-12T17:31:46.213021+0000","last_fullsized":"2024-09-12T17:31:46.213021+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'286","last_scrub_stamp":"2024-09-12T17:31:46.212875+0000","last_deep_scrub":"31'286","last_deep_scrub_stamp":"2024-09-12T17:31:46.212875+0000","last_clean_scrub_stamp":"2024-09-12T17:31:46.212875+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:55.088066+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"31'13","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:53.165093+0000","last_change":"2024-09-12T17:31:53.165033+0000","last_active":"2024-09-12T17:31:53.165093+0000","last_peered":"2024-09-12T17:31:53.165093+0000","last_clean":"2024-09-12T17:31:53.165093+0000","last_became_active":"2024-09-12T17:27:50.448680+0000","last_became_peered":"2024-09-12T17:27:50.448680+0000","last_unstale":"2024-09-12T17:31:53.165093+0000","last_undegraded":"2024-09-12T17:31:53.165093+0000","last_fullsized":"2024-09-12T17:31:53.165093+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'13","last_scrub_stamp":"2024-09-12T17:31:53.164949+0000","last_deep_scrub":"31'13","last_deep_scrub_stamp":"2024-09-12T17:31:53.164949+0000","last_clean_scrub_stamp":"2024-09-12T17:31:53.164949+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:13.457431+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:20.187967+0000","last_change":"2024-09-12T17:31:20.187884+0000","last_active":"2024-09-12T17:31:20.187967+0000","last_peered":"2024-09-12T17:31:20.187967+0000","last_clean":"2024-09-12T17:31:20.187967+0000","last_became_active":"2024-09-12T17:28:21.472744+0000","last_became_peered":"2024-09-12T17:28:21.472744+0000","last_unstale":"2024-09-12T17:31:20.187967+0000","last_undegraded":"2024-09-12T17:31:20.187967+0000","last_fullsized":"2024-09-12T17:31:20.187967+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:20.187750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:20.187750+0000","last_clean_scrub_stamp":"2024-09-12T17:31:20.187750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:19.507199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:08.306145+0000","last_change":"2024-09-12T17:31:08.306087+0000","last_active":"2024-09-12T17:31:08.306145+0000","last_peered":"2024-09-12T17:31:08.306145+0000","last_clean":"2024-09-12T17:31:08.306145+0000","last_became_active":"2024-09-12T17:27:40.428512+0000","last_became_peered":"2024-09-12T17:27:40.428512+0000","last_unstale":"2024-09-12T17:31:08.306145+0000","last_undegraded":"2024-09-12T17:31:08.306145+0000","last_fullsized":"2024-09-12T17:31:08.306145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:08.306000+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:08.306000+0000","last_clean_scrub_stamp":"2024-09-12T17:31:08.306000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:33.492014+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'5","reported_seq":429,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:34.315232+0000","last_change":"2024-09-12T17:31:34.315174+0000","last_active":"2024-09-12T17:31:34.315232+0000","last_peered":"2024-09-12T17:31:34.315232+0000","last_clean":"2024-09-12T17:31:34.315232+0000","last_became_active":"2024-09-12T17:27:44.429844+0000","last_became_peered":"2024-09-12T17:27:44.429844+0000","last_unstale":"2024-09-12T17:31:34.315232+0000","last_undegraded":"2024-09-12T17:31:34.315232+0000","last_fullsized":"2024-09-12T17:31:34.315232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-09-12T17:31:34.315074+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-09-12T17:31:34.315074+0000","last_clean_scrub_stamp":"2024-09-12T17:31:34.315074+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:53:25.613152+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"31'15","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:02.519816+0000","last_change":"2024-09-12T17:32:02.519757+0000","last_active":"2024-09-12T17:32:02.519816+0000","last_peered":"2024-09-12T17:32:02.519816+0000","last_clean":"2024-09-12T17:32:02.519816+0000","last_became_active":"2024-09-12T17:27:46.439153+0000","last_became_peered":"2024-09-12T17:27:46.439153+0000","last_unstale":"2024-09-12T17:32:02.519816+0000","last_undegraded":"2024-09-12T17:32:02.519816+0000","last_fullsized":"2024-09-12T17:32:02.519816+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'15","last_scrub_stamp":"2024-09-12T17:32:02.519664+0000","last_deep_scrub":"31'15","last_deep_scrub_stamp":"2024-09-12T17:32:02.519664+0000","last_clean_scrub_stamp":"2024-09-12T17:32:02.519664+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:48.844630+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"31'286","reported_seq":473,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:46.205624+0000","last_change":"2024-09-12T17:31:46.205541+0000","last_active":"2024-09-12T17:31:46.205624+0000","last_peered":"2024-09-12T17:31:46.205624+0000","last_clean":"2024-09-12T17:31:46.205624+0000","last_became_active":"2024-09-12T17:27:48.441024+0000","last_became_peered":"2024-09-12T17:27:48.441024+0000","last_unstale":"2024-09-12T17:31:46.205624+0000","last_undegraded":"2024-09-12T17:31:46.205624+0000","last_fullsized":"2024-09-12T17:31:46.205624+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'286","last_scrub_stamp":"2024-09-12T17:31:46.205451+0000","last_deep_scrub":"31'286","last_deep_scrub_stamp":"2024-09-12T17:31:46.205451+0000","last_clean_scrub_stamp":"2024-09-12T17:31:46.205451+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:06.332116+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'4","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:51.282731+0000","last_change":"2024-09-12T17:31:51.282630+0000","last_active":"2024-09-12T17:31:51.282731+0000","last_peered":"2024-09-12T17:31:51.282731+0000","last_clean":"2024-09-12T17:31:51.282731+0000","last_became_active":"2024-09-12T17:27:50.451743+0000","last_became_peered":"2024-09-12T17:27:50.451743+0000","last_unstale":"2024-09-12T17:31:51.282731+0000","last_undegraded":"2024-09-12T17:31:51.282731+0000","last_fullsized":"2024-09-12T17:31:51.282731+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:51.282505+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:51.282505+0000","last_clean_scrub_stamp":"2024-09-12T17:31:51.282505+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:18.063890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:17.306393+0000","last_change":"2024-09-12T17:31:17.306328+0000","last_active":"2024-09-12T17:31:17.306393+0000","last_peered":"2024-09-12T17:31:17.306393+0000","last_clean":"2024-09-12T17:31:17.306393+0000","last_became_active":"2024-09-12T17:27:42.438566+0000","last_became_peered":"2024-09-12T17:27:42.438566+0000","last_unstale":"2024-09-12T17:31:17.306393+0000","last_undegraded":"2024-09-12T17:31:17.306393+0000","last_fullsized":"2024-09-12T17:31:17.306393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:17.306243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:17.306243+0000","last_clean_scrub_stamp":"2024-09-12T17:31:17.306243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:02.990898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:14.414186+0000","last_change":"2024-09-12T17:31:14.414138+0000","last_active":"2024-09-12T17:31:14.414186+0000","last_peered":"2024-09-12T17:31:14.414186+0000","last_clean":"2024-09-12T17:31:14.414186+0000","last_became_active":"2024-09-12T17:27:40.429902+0000","last_became_peered":"2024-09-12T17:27:40.429902+0000","last_unstale":"2024-09-12T17:31:14.414186+0000","last_undegraded":"2024-09-12T17:31:14.414186+0000","last_fullsized":"2024-09-12T17:31:14.414186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:14.414041+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:14.414041+0000","last_clean_scrub_stamp":"2024-09-12T17:31:14.414041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:51.245716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:55.518346+0000","last_change":"2024-09-12T17:31:55.518291+0000","last_active":"2024-09-12T17:31:55.518346+0000","last_peered":"2024-09-12T17:31:55.518346+0000","last_clean":"2024-09-12T17:31:55.518346+0000","last_became_active":"2024-09-12T17:27:44.431180+0000","last_became_peered":"2024-09-12T17:27:44.431180+0000","last_unstale":"2024-09-12T17:31:55.518346+0000","last_undegraded":"2024-09-12T17:31:55.518346+0000","last_fullsized":"2024-09-12T17:31:55.518346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:55.518204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:55.518204+0000","last_clean_scrub_stamp":"2024-09-12T17:31:55.518204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:09.192139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"31'51","reported_seq":111,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:42.218317+0000","last_change":"2024-09-12T17:31:42.218263+0000","last_active":"2024-09-12T17:31:42.218317+0000","last_peered":"2024-09-12T17:31:42.218317+0000","last_clean":"2024-09-12T17:31:42.218317+0000","last_became_active":"2024-09-12T17:27:46.431599+0000","last_became_peered":"2024-09-12T17:27:46.431599+0000","last_unstale":"2024-09-12T17:31:42.218317+0000","last_undegraded":"2024-09-12T17:31:42.218317+0000","last_fullsized":"2024-09-12T17:31:42.218317+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'51","last_scrub_stamp":"2024-09-12T17:31:42.218165+0000","last_deep_scrub":"31'51","last_deep_scrub_stamp":"2024-09-12T17:31:42.218165+0000","last_clean_scrub_stamp":"2024-09-12T17:31:42.218165+0000","objects_scrubbed":8,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:04.370123+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":53,"num_read_kb":61,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:45.223586+0000","last_change":"2024-09-12T17:31:45.223521+0000","last_active":"2024-09-12T17:31:45.223586+0000","last_peered":"2024-09-12T17:31:45.223586+0000","last_clean":"2024-09-12T17:31:45.223586+0000","last_became_active":"2024-09-12T17:27:48.447331+0000","last_became_peered":"2024-09-12T17:27:48.447331+0000","last_unstale":"2024-09-12T17:31:45.223586+0000","last_undegraded":"2024-09-12T17:31:45.223586+0000","last_fullsized":"2024-09-12T17:31:45.223586+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:45.223419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:45.223419+0000","last_clean_scrub_stamp":"2024-09-12T17:31:45.223419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:53:36.521497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"31'7","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:52.272997+0000","last_change":"2024-09-12T17:31:52.272909+0000","last_active":"2024-09-12T17:31:52.272997+0000","last_peered":"2024-09-12T17:31:52.272997+0000","last_clean":"2024-09-12T17:31:52.272997+0000","last_became_active":"2024-09-12T17:27:50.447855+0000","last_became_peered":"2024-09-12T17:27:50.447855+0000","last_unstale":"2024-09-12T17:31:52.272997+0000","last_undegraded":"2024-09-12T17:31:52.272997+0000","last_fullsized":"2024-09-12T17:31:52.272997+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'7","last_scrub_stamp":"2024-09-12T17:31:52.272789+0000","last_deep_scrub":"31'7","last_deep_scrub_stamp":"2024-09-12T17:31:52.272789+0000","last_clean_scrub_stamp":"2024-09-12T17:31:52.272789+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:36.685106+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"31'14","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:31.547974+0000","last_change":"2024-09-12T17:31:31.547869+0000","last_active":"2024-09-12T17:31:31.547974+0000","last_peered":"2024-09-12T17:31:31.547974+0000","last_clean":"2024-09-12T17:31:31.547974+0000","last_became_active":"2024-09-12T17:27:42.438270+0000","last_became_peered":"2024-09-12T17:27:42.438270+0000","last_unstale":"2024-09-12T17:31:31.547974+0000","last_undegraded":"2024-09-12T17:31:31.547974+0000","last_fullsized":"2024-09-12T17:31:31.547974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-12T17:31:31.547749+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-12T17:31:31.547749+0000","last_clean_scrub_stamp":"2024-09-12T17:31:31.547749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:59.304661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"31'74","reported_seq":153,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:01.448317+0000","last_change":"2024-09-12T17:31:01.448262+0000","last_active":"2024-09-12T17:31:01.448317+0000","last_peered":"2024-09-12T17:31:01.448317+0000","last_clean":"2024-09-12T17:31:01.448317+0000","last_became_active":"2024-09-12T17:27:25.974522+0000","last_became_peered":"2024-09-12T17:27:25.974522+0000","last_unstale":"2024-09-12T17:31:01.448317+0000","last_undegraded":"2024-09-12T17:31:01.448317+0000","last_fullsized":"2024-09-12T17:31:01.448317+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'74","last_scrub_stamp":"2024-09-12T17:31:01.448174+0000","last_deep_scrub":"31'74","last_deep_scrub_stamp":"2024-09-12T17:31:01.448174+0000","last_clean_scrub_stamp":"2024-09-12T17:31:01.448174+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:35.862648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"31'2","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:04.209795+0000","last_change":"2024-09-12T17:31:04.209698+0000","last_active":"2024-09-12T17:31:04.209795+0000","last_peered":"2024-09-12T17:31:04.209795+0000","last_clean":"2024-09-12T17:31:04.209795+0000","last_became_active":"2024-09-12T17:27:32.760744+0000","last_became_peered":"2024-09-12T17:27:32.760744+0000","last_unstale":"2024-09-12T17:31:04.209795+0000","last_undegraded":"2024-09-12T17:31:04.209795+0000","last_fullsized":"2024-09-12T17:31:04.209795+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:04.209605+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:04.209605+0000","last_clean_scrub_stamp":"2024-09-12T17:31:04.209605+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:18.344014+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0014241220000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:05.209841+0000","last_change":"2024-09-12T17:31:05.209735+0000","last_active":"2024-09-12T17:31:05.209841+0000","last_peered":"2024-09-12T17:31:05.209841+0000","last_clean":"2024-09-12T17:31:05.209841+0000","last_became_active":"2024-09-12T17:27:40.428453+0000","last_became_peered":"2024-09-12T17:27:40.428453+0000","last_unstale":"2024-09-12T17:31:05.209841+0000","last_undegraded":"2024-09-12T17:31:05.209841+0000","last_fullsized":"2024-09-12T17:31:05.209841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:05.209644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:05.209644+0000","last_clean_scrub_stamp":"2024-09-12T17:31:05.209644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:39.739604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:33.324359+0000","last_change":"2024-09-12T17:31:33.324301+0000","last_active":"2024-09-12T17:31:33.324359+0000","last_peered":"2024-09-12T17:31:33.324359+0000","last_clean":"2024-09-12T17:31:33.324359+0000","last_became_active":"2024-09-12T17:27:44.432336+0000","last_became_peered":"2024-09-12T17:27:44.432336+0000","last_unstale":"2024-09-12T17:31:33.324359+0000","last_undegraded":"2024-09-12T17:31:33.324359+0000","last_fullsized":"2024-09-12T17:31:33.324359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:33.324201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:33.324201+0000","last_clean_scrub_stamp":"2024-09-12T17:31:33.324201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:09.650088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"31'90","reported_seq":181,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:59.559414+0000","last_change":"2024-09-12T17:31:59.559357+0000","last_active":"2024-09-12T17:31:59.559414+0000","last_peered":"2024-09-12T17:31:59.559414+0000","last_clean":"2024-09-12T17:31:59.559414+0000","last_became_active":"2024-09-12T17:27:46.437771+0000","last_became_peered":"2024-09-12T17:27:46.437771+0000","last_unstale":"2024-09-12T17:31:59.559414+0000","last_undegraded":"2024-09-12T17:31:59.559414+0000","last_fullsized":"2024-09-12T17:31:59.559414+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'90","last_scrub_stamp":"2024-09-12T17:31:59.559246+0000","last_deep_scrub":"31'90","last_deep_scrub_stamp":"2024-09-12T17:31:59.559246+0000","last_clean_scrub_stamp":"2024-09-12T17:31:59.559246+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:46.610831+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:44.033322+0000","last_change":"2024-09-12T17:31:44.033196+0000","last_active":"2024-09-12T17:31:44.033322+0000","last_peered":"2024-09-12T17:31:44.033322+0000","last_clean":"2024-09-12T17:31:44.033322+0000","last_became_active":"2024-09-12T17:27:48.445970+0000","last_became_peered":"2024-09-12T17:27:48.445970+0000","last_unstale":"2024-09-12T17:31:44.033322+0000","last_undegraded":"2024-09-12T17:31:44.033322+0000","last_fullsized":"2024-09-12T17:31:44.033322+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:44.033093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:44.033093+0000","last_clean_scrub_stamp":"2024-09-12T17:31:44.033093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:04.159758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"31'81","reported_seq":172,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:52.234051+0000","last_change":"2024-09-12T17:31:52.233929+0000","last_active":"2024-09-12T17:31:52.234051+0000","last_peered":"2024-09-12T17:31:52.234051+0000","last_clean":"2024-09-12T17:31:52.234051+0000","last_became_active":"2024-09-12T17:27:50.448189+0000","last_became_peered":"2024-09-12T17:27:50.448189+0000","last_unstale":"2024-09-12T17:31:52.234051+0000","last_undegraded":"2024-09-12T17:31:52.234051+0000","last_fullsized":"2024-09-12T17:31:52.234051+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'81","last_scrub_stamp":"2024-09-12T17:31:52.233825+0000","last_deep_scrub":"31'81","last_deep_scrub_stamp":"2024-09-12T17:31:52.233825+0000","last_clean_scrub_stamp":"2024-09-12T17:31:52.233825+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:27.501741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":221,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'2","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:29.535064+0000","last_change":"2024-09-12T17:31:29.534969+0000","last_active":"2024-09-12T17:31:29.535064+0000","last_peered":"2024-09-12T17:31:29.535064+0000","last_clean":"2024-09-12T17:31:29.535064+0000","last_became_active":"2024-09-12T17:27:42.429497+0000","last_became_peered":"2024-09-12T17:27:42.429497+0000","last_unstale":"2024-09-12T17:31:29.535064+0000","last_undegraded":"2024-09-12T17:31:29.535064+0000","last_fullsized":"2024-09-12T17:31:29.535064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-12T17:31:29.534867+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-12T17:31:29.534867+0000","last_clean_scrub_stamp":"2024-09-12T17:31:29.534867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:43.863976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:01.220300+0000","last_change":"2024-09-12T17:31:01.220220+0000","last_active":"2024-09-12T17:31:01.220300+0000","last_peered":"2024-09-12T17:31:01.220300+0000","last_clean":"2024-09-12T17:31:01.220300+0000","last_became_active":"2024-09-12T17:27:32.761687+0000","last_became_peered":"2024-09-12T17:27:32.761687+0000","last_unstale":"2024-09-12T17:31:01.220300+0000","last_undegraded":"2024-09-12T17:31:01.220300+0000","last_fullsized":"2024-09-12T17:31:01.220300+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:01.220136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:01.220136+0000","last_clean_scrub_stamp":"2024-09-12T17:31:01.220136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:40.149633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056694099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:01.844201+0000","last_change":"2024-09-12T17:31:01.844114+0000","last_active":"2024-09-12T17:31:01.844201+0000","last_peered":"2024-09-12T17:31:01.844201+0000","last_clean":"2024-09-12T17:31:01.844201+0000","last_became_active":"2024-09-12T17:27:40.418249+0000","last_became_peered":"2024-09-12T17:27:40.418249+0000","last_unstale":"2024-09-12T17:31:01.844201+0000","last_undegraded":"2024-09-12T17:31:01.844201+0000","last_fullsized":"2024-09-12T17:31:01.844201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:01.844025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:01.844025+0000","last_clean_scrub_stamp":"2024-09-12T17:31:01.844025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:24.701961+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:51.473391+0000","last_change":"2024-09-12T17:31:51.473329+0000","last_active":"2024-09-12T17:31:51.473391+0000","last_peered":"2024-09-12T17:31:51.473391+0000","last_clean":"2024-09-12T17:31:51.473391+0000","last_became_active":"2024-09-12T17:27:44.426698+0000","last_became_peered":"2024-09-12T17:27:44.426698+0000","last_unstale":"2024-09-12T17:31:51.473391+0000","last_undegraded":"2024-09-12T17:31:51.473391+0000","last_fullsized":"2024-09-12T17:31:51.473391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:51.473243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:51.473243+0000","last_clean_scrub_stamp":"2024-09-12T17:31:51.473243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:02.192513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"31'295","reported_seq":521,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:41.218206+0000","last_change":"2024-09-12T17:31:41.218144+0000","last_active":"2024-09-12T17:31:41.218206+0000","last_peered":"2024-09-12T17:31:41.218206+0000","last_clean":"2024-09-12T17:31:41.218206+0000","last_became_active":"2024-09-12T17:27:46.438381+0000","last_became_peered":"2024-09-12T17:27:46.438381+0000","last_unstale":"2024-09-12T17:31:41.218206+0000","last_undegraded":"2024-09-12T17:31:41.218206+0000","last_fullsized":"2024-09-12T17:31:41.218206+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'295","last_scrub_stamp":"2024-09-12T17:31:41.218033+0000","last_deep_scrub":"31'295","last_deep_scrub_stamp":"2024-09-12T17:31:41.218033+0000","last_clean_scrub_stamp":"2024-09-12T17:31:41.218033+0000","objects_scrubbed":10,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:50.316833+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:10.453960+0000","last_change":"2024-09-12T17:32:10.453960+0000","last_active":"2024-09-12T17:32:10.453960+0000","last_peered":"2024-09-12T17:32:10.453960+0000","last_clean":"2024-09-12T17:32:10.453960+0000","last_became_active":"2024-09-12T17:27:48.450775+0000","last_became_peered":"2024-09-12T17:27:48.450775+0000","last_unstale":"2024-09-12T17:32:10.453960+0000","last_undegraded":"2024-09-12T17:32:10.453960+0000","last_fullsized":"2024-09-12T17:32:10.453960+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:32:10.453850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:32:10.453850+0000","last_clean_scrub_stamp":"2024-09-12T17:32:10.453850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:25.929311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"31'5","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:55.307964+0000","last_change":"2024-09-12T17:31:55.307903+0000","last_active":"2024-09-12T17:31:55.307964+0000","last_peered":"2024-09-12T17:31:55.307964+0000","last_clean":"2024-09-12T17:31:55.307964+0000","last_became_active":"2024-09-12T17:27:50.457939+0000","last_became_peered":"2024-09-12T17:27:50.457939+0000","last_unstale":"2024-09-12T17:31:55.307964+0000","last_undegraded":"2024-09-12T17:31:55.307964+0000","last_fullsized":"2024-09-12T17:31:55.307964+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-09-12T17:31:55.307796+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-09-12T17:31:55.307796+0000","last_clean_scrub_stamp":"2024-09-12T17:31:55.307796+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:15.600277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"31'4","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:16.848034+0000","last_change":"2024-09-12T17:31:16.847975+0000","last_active":"2024-09-12T17:31:16.848034+0000","last_peered":"2024-09-12T17:31:16.848034+0000","last_clean":"2024-09-12T17:31:16.848034+0000","last_became_active":"2024-09-12T17:27:42.424498+0000","last_became_peered":"2024-09-12T17:27:42.424498+0000","last_unstale":"2024-09-12T17:31:16.848034+0000","last_undegraded":"2024-09-12T17:31:16.848034+0000","last_fullsized":"2024-09-12T17:31:16.848034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:16.847857+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:16.847857+0000","last_clean_scrub_stamp":"2024-09-12T17:31:16.847857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:43.335725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:03.037428+0000","last_change":"2024-09-12T17:31:03.037376+0000","last_active":"2024-09-12T17:31:03.037428+0000","last_peered":"2024-09-12T17:31:03.037428+0000","last_clean":"2024-09-12T17:31:03.037428+0000","last_became_active":"2024-09-12T17:27:32.761809+0000","last_became_peered":"2024-09-12T17:27:32.761809+0000","last_unstale":"2024-09-12T17:31:03.037428+0000","last_undegraded":"2024-09-12T17:31:03.037428+0000","last_fullsized":"2024-09-12T17:31:03.037428+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:03.037295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:03.037295+0000","last_clean_scrub_stamp":"2024-09-12T17:31:03.037295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:57:59.113302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051333900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"31'3","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:03.795988+0000","last_change":"2024-09-12T17:31:03.795932+0000","last_active":"2024-09-12T17:31:03.795988+0000","last_peered":"2024-09-12T17:31:03.795988+0000","last_clean":"2024-09-12T17:31:03.795988+0000","last_became_active":"2024-09-12T17:27:40.417664+0000","last_became_peered":"2024-09-12T17:27:40.417664+0000","last_unstale":"2024-09-12T17:31:03.795988+0000","last_undegraded":"2024-09-12T17:31:03.795988+0000","last_fullsized":"2024-09-12T17:31:03.795988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-09-12T17:31:03.795825+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-09-12T17:31:03.795825+0000","last_clean_scrub_stamp":"2024-09-12T17:31:03.795825+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:31:39.240916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"31'4","reported_seq":245,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:29.251936+0000","last_change":"2024-09-12T17:31:29.251861+0000","last_active":"2024-09-12T17:31:29.251936+0000","last_peered":"2024-09-12T17:31:29.251936+0000","last_clean":"2024-09-12T17:31:29.251936+0000","last_became_active":"2024-09-12T17:28:21.473073+0000","last_became_peered":"2024-09-12T17:28:21.473073+0000","last_unstale":"2024-09-12T17:31:29.251936+0000","last_undegraded":"2024-09-12T17:31:29.251936+0000","last_fullsized":"2024-09-12T17:31:29.251936+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:29.251773+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:29.251773+0000","last_clean_scrub_stamp":"2024-09-12T17:31:29.251773+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:37.794343+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":482,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"31'25","reported_seq":103,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:38.112116+0000","last_change":"2024-09-12T17:31:38.112059+0000","last_active":"2024-09-12T17:31:38.112116+0000","last_peered":"2024-09-12T17:31:38.112116+0000","last_clean":"2024-09-12T17:31:38.112116+0000","last_became_active":"2024-09-12T17:27:46.435381+0000","last_became_peered":"2024-09-12T17:27:46.435381+0000","last_unstale":"2024-09-12T17:31:38.112116+0000","last_undegraded":"2024-09-12T17:31:38.112116+0000","last_fullsized":"2024-09-12T17:31:38.112116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'25","last_scrub_stamp":"2024-09-12T17:31:38.111974+0000","last_deep_scrub":"31'25","last_deep_scrub_stamp":"2024-09-12T17:31:38.111974+0000","last_clean_scrub_stamp":"2024-09-12T17:31:38.111974+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:06.093270+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:45.990516+0000","last_change":"2024-09-12T17:31:45.990449+0000","last_active":"2024-09-12T17:31:45.990516+0000","last_peered":"2024-09-12T17:31:45.990516+0000","last_clean":"2024-09-12T17:31:45.990516+0000","last_became_active":"2024-09-12T17:27:48.451225+0000","last_became_peered":"2024-09-12T17:27:48.451225+0000","last_unstale":"2024-09-12T17:31:45.990516+0000","last_undegraded":"2024-09-12T17:31:45.990516+0000","last_fullsized":"2024-09-12T17:31:45.990516+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:45.990362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:45.990362+0000","last_clean_scrub_stamp":"2024-09-12T17:31:45.990362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:29.719452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:18.363866+0000","last_change":"2024-09-12T17:32:18.363801+0000","last_active":"2024-09-12T17:32:18.363866+0000","last_peered":"2024-09-12T17:32:18.363866+0000","last_clean":"2024-09-12T17:32:18.363866+0000","last_became_active":"2024-09-12T17:27:50.453458+0000","last_became_peered":"2024-09-12T17:27:50.453458+0000","last_unstale":"2024-09-12T17:32:18.363866+0000","last_undegraded":"2024-09-12T17:32:18.363866+0000","last_fullsized":"2024-09-12T17:32:18.363866+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:32:18.363711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:32:18.363711+0000","last_clean_scrub_stamp":"2024-09-12T17:32:18.363711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:34.005864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"31'10","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:15.887747+0000","last_change":"2024-09-12T17:31:15.887674+0000","last_active":"2024-09-12T17:31:15.887747+0000","last_peered":"2024-09-12T17:31:15.887747+0000","last_clean":"2024-09-12T17:31:15.887747+0000","last_became_active":"2024-09-12T17:27:42.427591+0000","last_became_peered":"2024-09-12T17:27:42.427591+0000","last_unstale":"2024-09-12T17:31:15.887747+0000","last_undegraded":"2024-09-12T17:31:15.887747+0000","last_fullsized":"2024-09-12T17:31:15.887747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-12T17:31:15.887587+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-12T17:31:15.887587+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.887587+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:34.580284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"31'3","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:02.205206+0000","last_change":"2024-09-12T17:31:02.205137+0000","last_active":"2024-09-12T17:31:02.205206+0000","last_peered":"2024-09-12T17:31:02.205206+0000","last_clean":"2024-09-12T17:31:02.205206+0000","last_became_active":"2024-09-12T17:27:32.761967+0000","last_became_peered":"2024-09-12T17:27:32.761967+0000","last_unstale":"2024-09-12T17:31:02.205206+0000","last_undegraded":"2024-09-12T17:31:02.205206+0000","last_fullsized":"2024-09-12T17:31:02.205206+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-09-12T17:31:02.205052+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-09-12T17:31:02.205052+0000","last_clean_scrub_stamp":"2024-09-12T17:31:02.205052+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:42.393847+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001062323,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:04.082831+0000","last_change":"2024-09-12T17:31:04.082738+0000","last_active":"2024-09-12T17:31:04.082831+0000","last_peered":"2024-09-12T17:31:04.082831+0000","last_clean":"2024-09-12T17:31:04.082831+0000","last_became_active":"2024-09-12T17:27:40.425973+0000","last_became_peered":"2024-09-12T17:27:40.425973+0000","last_unstale":"2024-09-12T17:31:04.082831+0000","last_undegraded":"2024-09-12T17:31:04.082831+0000","last_fullsized":"2024-09-12T17:31:04.082831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:04.082603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:04.082603+0000","last_clean_scrub_stamp":"2024-09-12T17:31:04.082603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:21.270783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:32.915382+0000","last_change":"2024-09-12T17:31:32.915286+0000","last_active":"2024-09-12T17:31:32.915382+0000","last_peered":"2024-09-12T17:31:32.915382+0000","last_clean":"2024-09-12T17:31:32.915382+0000","last_became_active":"2024-09-12T17:27:44.432348+0000","last_became_peered":"2024-09-12T17:27:44.432348+0000","last_unstale":"2024-09-12T17:31:32.915382+0000","last_undegraded":"2024-09-12T17:31:32.915382+0000","last_fullsized":"2024-09-12T17:31:32.915382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:32.915180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:32.915180+0000","last_clean_scrub_stamp":"2024-09-12T17:31:32.915180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:38.504920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"31'21","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:58.531371+0000","last_change":"2024-09-12T17:31:58.531308+0000","last_active":"2024-09-12T17:31:58.531371+0000","last_peered":"2024-09-12T17:31:58.531371+0000","last_clean":"2024-09-12T17:31:58.531371+0000","last_became_active":"2024-09-12T17:27:46.442488+0000","last_became_peered":"2024-09-12T17:27:46.442488+0000","last_unstale":"2024-09-12T17:31:58.531371+0000","last_undegraded":"2024-09-12T17:31:58.531371+0000","last_fullsized":"2024-09-12T17:31:58.531371+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'21","last_scrub_stamp":"2024-09-12T17:31:58.531214+0000","last_deep_scrub":"31'21","last_deep_scrub_stamp":"2024-09-12T17:31:58.531214+0000","last_clean_scrub_stamp":"2024-09-12T17:31:58.531214+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:34.732602+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:14.432643+0000","last_change":"2024-09-12T17:32:14.432643+0000","last_active":"2024-09-12T17:32:14.432643+0000","last_peered":"2024-09-12T17:32:14.432643+0000","last_clean":"2024-09-12T17:32:14.432643+0000","last_became_active":"2024-09-12T17:27:48.451075+0000","last_became_peered":"2024-09-12T17:27:48.451075+0000","last_unstale":"2024-09-12T17:32:14.432643+0000","last_undegraded":"2024-09-12T17:32:14.432643+0000","last_fullsized":"2024-09-12T17:32:14.432643+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:32:14.432505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:32:14.432505+0000","last_clean_scrub_stamp":"2024-09-12T17:32:14.432505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:47.427868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'10","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:54.304502+0000","last_change":"2024-09-12T17:31:54.304418+0000","last_active":"2024-09-12T17:31:54.304502+0000","last_peered":"2024-09-12T17:31:54.304502+0000","last_clean":"2024-09-12T17:31:54.304502+0000","last_became_active":"2024-09-12T17:27:50.455608+0000","last_became_peered":"2024-09-12T17:27:50.455608+0000","last_unstale":"2024-09-12T17:31:54.304502+0000","last_undegraded":"2024-09-12T17:31:54.304502+0000","last_fullsized":"2024-09-12T17:31:54.304502+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-12T17:31:54.304339+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-12T17:31:54.304339+0000","last_clean_scrub_stamp":"2024-09-12T17:31:54.304339+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:41.053408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":17,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'14","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:16.142405+0000","last_change":"2024-09-12T17:31:16.142405+0000","last_active":"2024-09-12T17:31:16.142405+0000","last_peered":"2024-09-12T17:31:16.142405+0000","last_clean":"2024-09-12T17:31:16.142405+0000","last_became_active":"2024-09-12T17:28:21.471756+0000","last_became_peered":"2024-09-12T17:28:21.471756+0000","last_unstale":"2024-09-12T17:31:16.142405+0000","last_undegraded":"2024-09-12T17:31:16.142405+0000","last_fullsized":"2024-09-12T17:31:16.142405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-12T17:31:16.142322+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-12T17:31:16.142322+0000","last_clean_scrub_stamp":"2024-09-12T17:31:16.142322+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:39.000259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:01.009789+0000","last_change":"2024-09-12T17:31:01.009730+0000","last_active":"2024-09-12T17:31:01.009789+0000","last_peered":"2024-09-12T17:31:01.009789+0000","last_clean":"2024-09-12T17:31:01.009789+0000","last_became_active":"2024-09-12T17:27:40.424286+0000","last_became_peered":"2024-09-12T17:27:40.424286+0000","last_unstale":"2024-09-12T17:31:01.009789+0000","last_undegraded":"2024-09-12T17:31:01.009789+0000","last_fullsized":"2024-09-12T17:31:01.009789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:01.009648+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:01.009648+0000","last_clean_scrub_stamp":"2024-09-12T17:31:01.009648+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:15.810543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:59.835909+0000","last_change":"2024-09-12T17:30:59.835771+0000","last_active":"2024-09-12T17:30:59.835909+0000","last_peered":"2024-09-12T17:30:59.835909+0000","last_clean":"2024-09-12T17:30:59.835909+0000","last_became_active":"2024-09-12T17:27:32.761595+0000","last_became_peered":"2024-09-12T17:27:32.761595+0000","last_unstale":"2024-09-12T17:30:59.835909+0000","last_undegraded":"2024-09-12T17:30:59.835909+0000","last_fullsized":"2024-09-12T17:30:59.835909+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:59.835655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:59.835655+0000","last_clean_scrub_stamp":"2024-09-12T17:30:59.835655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:14.315612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000417551,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"31'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:30.833956+0000","last_change":"2024-09-12T17:31:30.833822+0000","last_active":"2024-09-12T17:31:30.833956+0000","last_peered":"2024-09-12T17:31:30.833956+0000","last_clean":"2024-09-12T17:31:30.833956+0000","last_became_active":"2024-09-12T17:27:44.432492+0000","last_became_peered":"2024-09-12T17:27:44.432492+0000","last_unstale":"2024-09-12T17:31:30.833956+0000","last_undegraded":"2024-09-12T17:31:30.833956+0000","last_fullsized":"2024-09-12T17:31:30.833956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:30.833721+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:30.833721+0000","last_clean_scrub_stamp":"2024-09-12T17:31:30.833721+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:05.676775+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"31'76","reported_seq":153,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:35.923118+0000","last_change":"2024-09-12T17:31:35.922981+0000","last_active":"2024-09-12T17:31:35.923118+0000","last_peered":"2024-09-12T17:31:35.923118+0000","last_clean":"2024-09-12T17:31:35.923118+0000","last_became_active":"2024-09-12T17:27:46.439014+0000","last_became_peered":"2024-09-12T17:27:46.439014+0000","last_unstale":"2024-09-12T17:31:35.923118+0000","last_undegraded":"2024-09-12T17:31:35.923118+0000","last_fullsized":"2024-09-12T17:31:35.923118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'76","last_scrub_stamp":"2024-09-12T17:31:35.922854+0000","last_deep_scrub":"31'76","last_deep_scrub_stamp":"2024-09-12T17:31:35.922854+0000","last_clean_scrub_stamp":"2024-09-12T17:31:35.922854+0000","objects_scrubbed":9,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:07.104177+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:44.204301+0000","last_change":"2024-09-12T17:31:44.204241+0000","last_active":"2024-09-12T17:31:44.204301+0000","last_peered":"2024-09-12T17:31:44.204301+0000","last_clean":"2024-09-12T17:31:44.204301+0000","last_became_active":"2024-09-12T17:27:48.438779+0000","last_became_peered":"2024-09-12T17:27:48.438779+0000","last_unstale":"2024-09-12T17:31:44.204301+0000","last_undegraded":"2024-09-12T17:31:44.204301+0000","last_fullsized":"2024-09-12T17:31:44.204301+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:44.204158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:44.204158+0000","last_clean_scrub_stamp":"2024-09-12T17:31:44.204158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:20.530044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"31'13","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:59.119186+0000","last_change":"2024-09-12T17:31:59.119082+0000","last_active":"2024-09-12T17:31:59.119186+0000","last_peered":"2024-09-12T17:31:59.119186+0000","last_clean":"2024-09-12T17:31:59.119186+0000","last_became_active":"2024-09-12T17:27:50.448060+0000","last_became_peered":"2024-09-12T17:27:50.448060+0000","last_unstale":"2024-09-12T17:31:59.119186+0000","last_undegraded":"2024-09-12T17:31:59.119186+0000","last_fullsized":"2024-09-12T17:31:59.119186+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'13","last_scrub_stamp":"2024-09-12T17:31:59.118958+0000","last_deep_scrub":"31'13","last_deep_scrub_stamp":"2024-09-12T17:31:59.118958+0000","last_clean_scrub_stamp":"2024-09-12T17:31:59.118958+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:59.445773+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":31,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"31'27","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:12.291409+0000","last_change":"2024-09-12T17:31:12.291292+0000","last_active":"2024-09-12T17:31:12.291409+0000","last_peered":"2024-09-12T17:31:12.291409+0000","last_clean":"2024-09-12T17:31:12.291409+0000","last_became_active":"2024-09-12T17:27:42.432800+0000","last_became_peered":"2024-09-12T17:27:42.432800+0000","last_unstale":"2024-09-12T17:31:12.291409+0000","last_undegraded":"2024-09-12T17:31:12.291409+0000","last_fullsized":"2024-09-12T17:31:12.291409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'27","last_scrub_stamp":"2024-09-12T17:31:12.291188+0000","last_deep_scrub":"31'27","last_deep_scrub_stamp":"2024-09-12T17:31:12.291188+0000","last_clean_scrub_stamp":"2024-09-12T17:31:12.291188+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:58.552254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":99,"num_read_kb":83,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:05.776096+0000","last_change":"2024-09-12T17:31:05.776042+0000","last_active":"2024-09-12T17:31:05.776096+0000","last_peered":"2024-09-12T17:31:05.776096+0000","last_clean":"2024-09-12T17:31:05.776096+0000","last_became_active":"2024-09-12T17:27:40.418873+0000","last_became_peered":"2024-09-12T17:27:40.418873+0000","last_unstale":"2024-09-12T17:31:05.776096+0000","last_undegraded":"2024-09-12T17:31:05.776096+0000","last_fullsized":"2024-09-12T17:31:05.776096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:05.775954+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:05.775954+0000","last_clean_scrub_stamp":"2024-09-12T17:31:05.775954+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:05.095403+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:03.225809+0000","last_change":"2024-09-12T17:31:03.225739+0000","last_active":"2024-09-12T17:31:03.225809+0000","last_peered":"2024-09-12T17:31:03.225809+0000","last_clean":"2024-09-12T17:31:03.225809+0000","last_became_active":"2024-09-12T17:27:32.761677+0000","last_became_peered":"2024-09-12T17:27:32.761677+0000","last_unstale":"2024-09-12T17:31:03.225809+0000","last_undegraded":"2024-09-12T17:31:03.225809+0000","last_fullsized":"2024-09-12T17:31:03.225809+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:03.225639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:03.225639+0000","last_clean_scrub_stamp":"2024-09-12T17:31:03.225639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:53.792882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001356625,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:49.474298+0000","last_change":"2024-09-12T17:31:49.474248+0000","last_active":"2024-09-12T17:31:49.474298+0000","last_peered":"2024-09-12T17:31:49.474298+0000","last_clean":"2024-09-12T17:31:49.474298+0000","last_became_active":"2024-09-12T17:27:44.426647+0000","last_became_peered":"2024-09-12T17:27:44.426647+0000","last_unstale":"2024-09-12T17:31:49.474298+0000","last_undegraded":"2024-09-12T17:31:49.474298+0000","last_fullsized":"2024-09-12T17:31:49.474298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:49.474140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:49.474140+0000","last_clean_scrub_stamp":"2024-09-12T17:31:49.474140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:25.749871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"31'22","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:40.171838+0000","last_change":"2024-09-12T17:31:40.171783+0000","last_active":"2024-09-12T17:31:40.171838+0000","last_peered":"2024-09-12T17:31:40.171838+0000","last_clean":"2024-09-12T17:31:40.171838+0000","last_became_active":"2024-09-12T17:27:46.439038+0000","last_became_peered":"2024-09-12T17:27:46.439038+0000","last_unstale":"2024-09-12T17:31:40.171838+0000","last_undegraded":"2024-09-12T17:31:40.171838+0000","last_fullsized":"2024-09-12T17:31:40.171838+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'22","last_scrub_stamp":"2024-09-12T17:31:40.171698+0000","last_deep_scrub":"31'22","last_deep_scrub_stamp":"2024-09-12T17:31:40.171698+0000","last_clean_scrub_stamp":"2024-09-12T17:31:40.171698+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:53.965338+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"31'286","reported_seq":360,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:47.186948+0000","last_change":"2024-09-12T17:31:47.186874+0000","last_active":"2024-09-12T17:31:47.186948+0000","last_peered":"2024-09-12T17:31:47.186948+0000","last_clean":"2024-09-12T17:31:47.186948+0000","last_became_active":"2024-09-12T17:27:48.440948+0000","last_became_peered":"2024-09-12T17:27:48.440948+0000","last_unstale":"2024-09-12T17:31:47.186948+0000","last_undegraded":"2024-09-12T17:31:47.186948+0000","last_fullsized":"2024-09-12T17:31:47.186948+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'286","last_scrub_stamp":"2024-09-12T17:31:47.186792+0000","last_deep_scrub":"31'286","last_deep_scrub_stamp":"2024-09-12T17:31:47.186792+0000","last_clean_scrub_stamp":"2024-09-12T17:31:47.186792+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:58.556769+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:19.349011+0000","last_change":"2024-09-12T17:32:19.348953+0000","last_active":"2024-09-12T17:32:19.349011+0000","last_peered":"2024-09-12T17:32:19.349011+0000","last_clean":"2024-09-12T17:32:19.349011+0000","last_became_active":"2024-09-12T17:27:50.454241+0000","last_became_peered":"2024-09-12T17:27:50.454241+0000","last_unstale":"2024-09-12T17:32:19.349011+0000","last_undegraded":"2024-09-12T17:32:19.349011+0000","last_fullsized":"2024-09-12T17:32:19.349011+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:32:19.348859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:32:19.348859+0000","last_clean_scrub_stamp":"2024-09-12T17:32:19.348859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:27.126296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"31'16","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:28.486671+0000","last_change":"2024-09-12T17:31:28.486564+0000","last_active":"2024-09-12T17:31:28.486671+0000","last_peered":"2024-09-12T17:31:28.486671+0000","last_clean":"2024-09-12T17:31:28.486671+0000","last_became_active":"2024-09-12T17:27:42.423805+0000","last_became_peered":"2024-09-12T17:27:42.423805+0000","last_unstale":"2024-09-12T17:31:28.486671+0000","last_undegraded":"2024-09-12T17:31:28.486671+0000","last_fullsized":"2024-09-12T17:31:28.486671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'16","last_scrub_stamp":"2024-09-12T17:31:28.486474+0000","last_deep_scrub":"31'16","last_deep_scrub_stamp":"2024-09-12T17:31:28.486474+0000","last_clean_scrub_stamp":"2024-09-12T17:31:28.486474+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:53.131800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:07.273178+0000","last_change":"2024-09-12T17:31:07.273111+0000","last_active":"2024-09-12T17:31:07.273178+0000","last_peered":"2024-09-12T17:31:07.273178+0000","last_clean":"2024-09-12T17:31:07.273178+0000","last_became_active":"2024-09-12T17:27:40.423703+0000","last_became_peered":"2024-09-12T17:27:40.423703+0000","last_unstale":"2024-09-12T17:31:07.273178+0000","last_undegraded":"2024-09-12T17:31:07.273178+0000","last_fullsized":"2024-09-12T17:31:07.273178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:07.273027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:07.273027+0000","last_clean_scrub_stamp":"2024-09-12T17:31:07.273027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:59.920670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:00.826839+0000","last_change":"2024-09-12T17:31:00.826782+0000","last_active":"2024-09-12T17:31:00.826839+0000","last_peered":"2024-09-12T17:31:00.826839+0000","last_clean":"2024-09-12T17:31:00.826839+0000","last_became_active":"2024-09-12T17:27:32.761590+0000","last_became_peered":"2024-09-12T17:27:32.761590+0000","last_unstale":"2024-09-12T17:31:00.826839+0000","last_undegraded":"2024-09-12T17:31:00.826839+0000","last_fullsized":"2024-09-12T17:31:00.826839+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:00.826700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:00.826700+0000","last_clean_scrub_stamp":"2024-09-12T17:31:00.826700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:41.176527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036072200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:48.494341+0000","last_change":"2024-09-12T17:31:48.494284+0000","last_active":"2024-09-12T17:31:48.494341+0000","last_peered":"2024-09-12T17:31:48.494341+0000","last_clean":"2024-09-12T17:31:48.494341+0000","last_became_active":"2024-09-12T17:27:44.427318+0000","last_became_peered":"2024-09-12T17:27:44.427318+0000","last_unstale":"2024-09-12T17:31:48.494341+0000","last_undegraded":"2024-09-12T17:31:48.494341+0000","last_fullsized":"2024-09-12T17:31:48.494341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:48.494175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:48.494175+0000","last_clean_scrub_stamp":"2024-09-12T17:31:48.494175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:20.611185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"31'15","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:57.492276+0000","last_change":"2024-09-12T17:31:57.492276+0000","last_active":"2024-09-12T17:31:57.492276+0000","last_peered":"2024-09-12T17:31:57.492276+0000","last_clean":"2024-09-12T17:31:57.492276+0000","last_became_active":"2024-09-12T17:27:46.443937+0000","last_became_peered":"2024-09-12T17:27:46.443937+0000","last_unstale":"2024-09-12T17:31:57.492276+0000","last_undegraded":"2024-09-12T17:31:57.492276+0000","last_fullsized":"2024-09-12T17:31:57.492276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'15","last_scrub_stamp":"2024-09-12T17:31:57.492132+0000","last_deep_scrub":"31'15","last_deep_scrub_stamp":"2024-09-12T17:31:57.492132+0000","last_clean_scrub_stamp":"2024-09-12T17:31:57.492132+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:27.779269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"31'286","reported_seq":403,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:47.039683+0000","last_change":"2024-09-12T17:31:47.039607+0000","last_active":"2024-09-12T17:31:47.039683+0000","last_peered":"2024-09-12T17:31:47.039683+0000","last_clean":"2024-09-12T17:31:47.039683+0000","last_became_active":"2024-09-12T17:27:48.441694+0000","last_became_peered":"2024-09-12T17:27:48.441694+0000","last_unstale":"2024-09-12T17:31:47.039683+0000","last_undegraded":"2024-09-12T17:31:47.039683+0000","last_fullsized":"2024-09-12T17:31:47.039683+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'286","last_scrub_stamp":"2024-09-12T17:31:47.039521+0000","last_deep_scrub":"31'286","last_deep_scrub_stamp":"2024-09-12T17:31:47.039521+0000","last_clean_scrub_stamp":"2024-09-12T17:31:47.039521+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:56.891807+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"29'3","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:57.215433+0000","last_change":"2024-09-12T17:31:57.215310+0000","last_active":"2024-09-12T17:31:57.215433+0000","last_peered":"2024-09-12T17:31:57.215433+0000","last_clean":"2024-09-12T17:31:57.215433+0000","last_became_active":"2024-09-12T17:27:50.452862+0000","last_became_peered":"2024-09-12T17:27:50.452862+0000","last_unstale":"2024-09-12T17:31:57.215433+0000","last_undegraded":"2024-09-12T17:31:57.215433+0000","last_fullsized":"2024-09-12T17:31:57.215433+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-09-12T17:31:57.215214+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-09-12T17:31:57.215214+0000","last_clean_scrub_stamp":"2024-09-12T17:31:57.215214+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:58.167244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"29'2","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:17.188786+0000","last_change":"2024-09-12T17:31:17.188673+0000","last_active":"2024-09-12T17:31:17.188786+0000","last_peered":"2024-09-12T17:31:17.188786+0000","last_clean":"2024-09-12T17:31:17.188786+0000","last_became_active":"2024-09-12T17:27:42.436667+0000","last_became_peered":"2024-09-12T17:27:42.436667+0000","last_unstale":"2024-09-12T17:31:17.188786+0000","last_undegraded":"2024-09-12T17:31:17.188786+0000","last_fullsized":"2024-09-12T17:31:17.188786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-12T17:31:17.188564+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-12T17:31:17.188564+0000","last_clean_scrub_stamp":"2024-09-12T17:31:17.188564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:45.338606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:00.489048+0000","last_change":"2024-09-12T17:31:00.488993+0000","last_active":"2024-09-12T17:31:00.489048+0000","last_peered":"2024-09-12T17:31:00.489048+0000","last_clean":"2024-09-12T17:31:00.489048+0000","last_became_active":"2024-09-12T17:27:40.419472+0000","last_became_peered":"2024-09-12T17:27:40.419472+0000","last_unstale":"2024-09-12T17:31:00.489048+0000","last_undegraded":"2024-09-12T17:31:00.489048+0000","last_fullsized":"2024-09-12T17:31:00.489048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:00.488897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:00.488897+0000","last_clean_scrub_stamp":"2024-09-12T17:31:00.488897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:42.257433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:06.255527+0000","last_change":"2024-09-12T17:31:06.255467+0000","last_active":"2024-09-12T17:31:06.255527+0000","last_peered":"2024-09-12T17:31:06.255527+0000","last_clean":"2024-09-12T17:31:06.255527+0000","last_became_active":"2024-09-12T17:27:32.775344+0000","last_became_peered":"2024-09-12T17:27:32.775344+0000","last_unstale":"2024-09-12T17:31:06.255527+0000","last_undegraded":"2024-09-12T17:31:06.255527+0000","last_fullsized":"2024-09-12T17:31:06.255527+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:06.255380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:06.255380+0000","last_clean_scrub_stamp":"2024-09-12T17:31:06.255380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:58.712793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011343939999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:47.526576+0000","last_change":"2024-09-12T17:31:47.526576+0000","last_active":"2024-09-12T17:31:47.526576+0000","last_peered":"2024-09-12T17:31:47.526576+0000","last_clean":"2024-09-12T17:31:47.526576+0000","last_became_active":"2024-09-12T17:27:44.427519+0000","last_became_peered":"2024-09-12T17:27:44.427519+0000","last_unstale":"2024-09-12T17:31:47.526576+0000","last_undegraded":"2024-09-12T17:31:47.526576+0000","last_fullsized":"2024-09-12T17:31:47.526576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:47.526460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:47.526460+0000","last_clean_scrub_stamp":"2024-09-12T17:31:47.526460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:05.506192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"31'99","reported_seq":193,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:36.131450+0000","last_change":"2024-09-12T17:31:36.131379+0000","last_active":"2024-09-12T17:31:36.131450+0000","last_peered":"2024-09-12T17:31:36.131450+0000","last_clean":"2024-09-12T17:31:36.131450+0000","last_became_active":"2024-09-12T17:27:46.442154+0000","last_became_peered":"2024-09-12T17:27:46.442154+0000","last_unstale":"2024-09-12T17:31:36.131450+0000","last_undegraded":"2024-09-12T17:31:36.131450+0000","last_fullsized":"2024-09-12T17:31:36.131450+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'99","last_scrub_stamp":"2024-09-12T17:31:36.131282+0000","last_deep_scrub":"31'99","last_deep_scrub_stamp":"2024-09-12T17:31:36.131282+0000","last_clean_scrub_stamp":"2024-09-12T17:31:36.131282+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:32.789106+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:43.051537+0000","last_change":"2024-09-12T17:31:43.051486+0000","last_active":"2024-09-12T17:31:43.051537+0000","last_peered":"2024-09-12T17:31:43.051537+0000","last_clean":"2024-09-12T17:31:43.051537+0000","last_became_active":"2024-09-12T17:27:48.440177+0000","last_became_peered":"2024-09-12T17:27:48.440177+0000","last_unstale":"2024-09-12T17:31:43.051537+0000","last_undegraded":"2024-09-12T17:31:43.051537+0000","last_fullsized":"2024-09-12T17:31:43.051537+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:43.051387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:43.051387+0000","last_clean_scrub_stamp":"2024-09-12T17:31:43.051387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:19.689950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:54.306699+0000","last_change":"2024-09-12T17:31:54.306646+0000","last_active":"2024-09-12T17:31:54.306699+0000","last_peered":"2024-09-12T17:31:54.306699+0000","last_clean":"2024-09-12T17:31:54.306699+0000","last_became_active":"2024-09-12T17:27:50.453919+0000","last_became_peered":"2024-09-12T17:27:50.453919+0000","last_unstale":"2024-09-12T17:31:54.306699+0000","last_undegraded":"2024-09-12T17:31:54.306699+0000","last_fullsized":"2024-09-12T17:31:54.306699+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:54.306539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:54.306539+0000","last_clean_scrub_stamp":"2024-09-12T17:31:54.306539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:45.965830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:56.291919+0000","last_change":"2024-09-12T17:31:56.291840+0000","last_active":"2024-09-12T17:31:56.291919+0000","last_peered":"2024-09-12T17:31:56.291919+0000","last_clean":"2024-09-12T17:31:56.291919+0000","last_became_active":"2024-09-12T17:27:50.452190+0000","last_became_peered":"2024-09-12T17:27:50.452190+0000","last_unstale":"2024-09-12T17:31:56.291919+0000","last_undegraded":"2024-09-12T17:31:56.291919+0000","last_fullsized":"2024-09-12T17:31:56.291919+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:56.291760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:56.291760+0000","last_clean_scrub_stamp":"2024-09-12T17:31:56.291760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:32.123683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:21.214317+0000","last_change":"2024-09-12T17:31:21.214317+0000","last_active":"2024-09-12T17:31:21.214317+0000","last_peered":"2024-09-12T17:31:21.214317+0000","last_clean":"2024-09-12T17:31:21.214317+0000","last_became_active":"2024-09-12T17:27:42.436187+0000","last_became_peered":"2024-09-12T17:27:42.436187+0000","last_unstale":"2024-09-12T17:31:21.214317+0000","last_undegraded":"2024-09-12T17:31:21.214317+0000","last_fullsized":"2024-09-12T17:31:21.214317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:21.214230+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:21.214230+0000","last_clean_scrub_stamp":"2024-09-12T17:31:21.214230+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:42.216760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"29'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:16.370862+0000","last_change":"2024-09-12T17:31:16.370798+0000","last_active":"2024-09-12T17:31:16.370862+0000","last_peered":"2024-09-12T17:31:16.370862+0000","last_clean":"2024-09-12T17:31:16.370862+0000","last_became_active":"2024-09-12T17:27:40.428529+0000","last_became_peered":"2024-09-12T17:27:40.428529+0000","last_unstale":"2024-09-12T17:31:16.370862+0000","last_undegraded":"2024-09-12T17:31:16.370862+0000","last_fullsized":"2024-09-12T17:31:16.370862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-12T17:31:16.370693+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-12T17:31:16.370693+0000","last_clean_scrub_stamp":"2024-09-12T17:31:16.370693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:11.675892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:35.281115+0000","last_change":"2024-09-12T17:31:35.281115+0000","last_active":"2024-09-12T17:31:35.281115+0000","last_peered":"2024-09-12T17:31:35.281115+0000","last_clean":"2024-09-12T17:31:35.281115+0000","last_became_active":"2024-09-12T17:27:44.429701+0000","last_became_peered":"2024-09-12T17:27:44.429701+0000","last_unstale":"2024-09-12T17:31:35.281115+0000","last_undegraded":"2024-09-12T17:31:35.281115+0000","last_fullsized":"2024-09-12T17:31:35.281115+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:35.281006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:35.281006+0000","last_clean_scrub_stamp":"2024-09-12T17:31:35.281006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:44.156197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"31'40","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:06.466382+0000","last_change":"2024-09-12T17:32:06.466382+0000","last_active":"2024-09-12T17:32:06.466382+0000","last_peered":"2024-09-12T17:32:06.466382+0000","last_clean":"2024-09-12T17:32:06.466382+0000","last_became_active":"2024-09-12T17:27:46.442713+0000","last_became_peered":"2024-09-12T17:27:46.442713+0000","last_unstale":"2024-09-12T17:32:06.466382+0000","last_undegraded":"2024-09-12T17:32:06.466382+0000","last_fullsized":"2024-09-12T17:32:06.466382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'40","last_scrub_stamp":"2024-09-12T17:32:06.466276+0000","last_deep_scrub":"31'40","last_deep_scrub_stamp":"2024-09-12T17:32:06.466276+0000","last_clean_scrub_stamp":"2024-09-12T17:32:06.466276+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:45.620718+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:11.432129+0000","last_change":"2024-09-12T17:32:11.432129+0000","last_active":"2024-09-12T17:32:11.432129+0000","last_peered":"2024-09-12T17:32:11.432129+0000","last_clean":"2024-09-12T17:32:11.432129+0000","last_became_active":"2024-09-12T17:27:48.450050+0000","last_became_peered":"2024-09-12T17:27:48.450050+0000","last_unstale":"2024-09-12T17:32:11.432129+0000","last_undegraded":"2024-09-12T17:32:11.432129+0000","last_fullsized":"2024-09-12T17:32:11.432129+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:32:11.432042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:32:11.432042+0000","last_clean_scrub_stamp":"2024-09-12T17:32:11.432042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:09.498678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"31'5","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:01.148129+0000","last_change":"2024-09-12T17:32:01.148129+0000","last_active":"2024-09-12T17:32:01.148129+0000","last_peered":"2024-09-12T17:32:01.148129+0000","last_clean":"2024-09-12T17:32:01.148129+0000","last_became_active":"2024-09-12T17:27:50.453382+0000","last_became_peered":"2024-09-12T17:27:50.453382+0000","last_unstale":"2024-09-12T17:32:01.148129+0000","last_undegraded":"2024-09-12T17:32:01.148129+0000","last_fullsized":"2024-09-12T17:32:01.148129+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-09-12T17:32:01.148041+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-09-12T17:32:01.148041+0000","last_clean_scrub_stamp":"2024-09-12T17:32:01.148041+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:27.614177+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"31'8","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:19.332207+0000","last_change":"2024-09-12T17:31:19.332207+0000","last_active":"2024-09-12T17:31:19.332207+0000","last_peered":"2024-09-12T17:31:19.332207+0000","last_clean":"2024-09-12T17:31:19.332207+0000","last_became_active":"2024-09-12T17:27:42.436150+0000","last_became_peered":"2024-09-12T17:27:42.436150+0000","last_unstale":"2024-09-12T17:31:19.332207+0000","last_undegraded":"2024-09-12T17:31:19.332207+0000","last_fullsized":"2024-09-12T17:31:19.332207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:19.332119+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:19.332119+0000","last_clean_scrub_stamp":"2024-09-12T17:31:19.332119+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:45.819987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:07.073417+0000","last_change":"2024-09-12T17:31:07.073417+0000","last_active":"2024-09-12T17:31:07.073417+0000","last_peered":"2024-09-12T17:31:07.073417+0000","last_clean":"2024-09-12T17:31:07.073417+0000","last_became_active":"2024-09-12T17:27:40.431962+0000","last_became_peered":"2024-09-12T17:27:40.431962+0000","last_unstale":"2024-09-12T17:31:07.073417+0000","last_undegraded":"2024-09-12T17:31:07.073417+0000","last_fullsized":"2024-09-12T17:31:07.073417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:07.073320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:07.073320+0000","last_clean_scrub_stamp":"2024-09-12T17:31:07.073320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:17.908445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:53.455763+0000","last_change":"2024-09-12T17:31:53.455763+0000","last_active":"2024-09-12T17:31:53.455763+0000","last_peered":"2024-09-12T17:31:53.455763+0000","last_clean":"2024-09-12T17:31:53.455763+0000","last_became_active":"2024-09-12T17:27:44.432334+0000","last_became_peered":"2024-09-12T17:27:44.432334+0000","last_unstale":"2024-09-12T17:31:53.455763+0000","last_undegraded":"2024-09-12T17:31:53.455763+0000","last_fullsized":"2024-09-12T17:31:53.455763+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:53.455655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:53.455655+0000","last_clean_scrub_stamp":"2024-09-12T17:31:53.455655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:19.517675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"31'9","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:40.960920+0000","last_change":"2024-09-12T17:31:40.960920+0000","last_active":"2024-09-12T17:31:40.960920+0000","last_peered":"2024-09-12T17:31:40.960920+0000","last_clean":"2024-09-12T17:31:40.960920+0000","last_became_active":"2024-09-12T17:27:46.435567+0000","last_became_peered":"2024-09-12T17:27:46.435567+0000","last_unstale":"2024-09-12T17:31:40.960920+0000","last_undegraded":"2024-09-12T17:31:40.960920+0000","last_fullsized":"2024-09-12T17:31:40.960920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'9","last_scrub_stamp":"2024-09-12T17:31:40.960798+0000","last_deep_scrub":"31'9","last_deep_scrub_stamp":"2024-09-12T17:31:40.960798+0000","last_clean_scrub_stamp":"2024-09-12T17:31:40.960798+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:35.681474+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:47.260045+0000","last_change":"2024-09-12T17:31:47.260045+0000","last_active":"2024-09-12T17:31:47.260045+0000","last_peered":"2024-09-12T17:31:47.260045+0000","last_clean":"2024-09-12T17:31:47.260045+0000","last_became_active":"2024-09-12T17:27:48.448478+0000","last_became_peered":"2024-09-12T17:27:48.448478+0000","last_unstale":"2024-09-12T17:31:47.260045+0000","last_undegraded":"2024-09-12T17:31:47.260045+0000","last_fullsized":"2024-09-12T17:31:47.260045+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:47.259949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:47.259949+0000","last_clean_scrub_stamp":"2024-09-12T17:31:47.259949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:53.333564+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"31'8","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:02.119771+0000","last_change":"2024-09-12T17:32:02.119771+0000","last_active":"2024-09-12T17:32:02.119771+0000","last_peered":"2024-09-12T17:32:02.119771+0000","last_clean":"2024-09-12T17:32:02.119771+0000","last_became_active":"2024-09-12T17:27:50.449302+0000","last_became_peered":"2024-09-12T17:27:50.449302+0000","last_unstale":"2024-09-12T17:32:02.119771+0000","last_undegraded":"2024-09-12T17:32:02.119771+0000","last_fullsized":"2024-09-12T17:32:02.119771+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:32:02.119677+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:32:02.119677+0000","last_clean_scrub_stamp":"2024-09-12T17:32:02.119677+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:50.975630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"31'4","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:17.849853+0000","last_change":"2024-09-12T17:31:17.849853+0000","last_active":"2024-09-12T17:31:17.849853+0000","last_peered":"2024-09-12T17:31:17.849853+0000","last_clean":"2024-09-12T17:31:17.849853+0000","last_became_active":"2024-09-12T17:27:42.423974+0000","last_became_peered":"2024-09-12T17:27:42.423974+0000","last_unstale":"2024-09-12T17:31:17.849853+0000","last_undegraded":"2024-09-12T17:31:17.849853+0000","last_fullsized":"2024-09-12T17:31:17.849853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:17.849764+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:17.849764+0000","last_clean_scrub_stamp":"2024-09-12T17:31:17.849764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:32.821977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:08.073247+0000","last_change":"2024-09-12T17:31:08.073247+0000","last_active":"2024-09-12T17:31:08.073247+0000","last_peered":"2024-09-12T17:31:08.073247+0000","last_clean":"2024-09-12T17:31:08.073247+0000","last_became_active":"2024-09-12T17:27:40.430154+0000","last_became_peered":"2024-09-12T17:27:40.430154+0000","last_unstale":"2024-09-12T17:31:08.073247+0000","last_undegraded":"2024-09-12T17:31:08.073247+0000","last_fullsized":"2024-09-12T17:31:08.073247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:08.073165+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:08.073165+0000","last_clean_scrub_stamp":"2024-09-12T17:31:08.073165+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:18.392407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:32.133092+0000","last_change":"2024-09-12T17:31:32.133092+0000","last_active":"2024-09-12T17:31:32.133092+0000","last_peered":"2024-09-12T17:31:32.133092+0000","last_clean":"2024-09-12T17:31:32.133092+0000","last_became_active":"2024-09-12T17:27:44.434979+0000","last_became_peered":"2024-09-12T17:27:44.434979+0000","last_unstale":"2024-09-12T17:31:32.133092+0000","last_undegraded":"2024-09-12T17:31:32.133092+0000","last_fullsized":"2024-09-12T17:31:32.133092+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:32.133012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:32.133012+0000","last_clean_scrub_stamp":"2024-09-12T17:31:32.133012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:49.764890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"31'49","reported_seq":121,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:37.924314+0000","last_change":"2024-09-12T17:31:37.924314+0000","last_active":"2024-09-12T17:31:37.924314+0000","last_peered":"2024-09-12T17:31:37.924314+0000","last_clean":"2024-09-12T17:31:37.924314+0000","last_became_active":"2024-09-12T17:27:46.433421+0000","last_became_peered":"2024-09-12T17:27:46.433421+0000","last_unstale":"2024-09-12T17:31:37.924314+0000","last_undegraded":"2024-09-12T17:31:37.924314+0000","last_fullsized":"2024-09-12T17:31:37.924314+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'49","last_scrub_stamp":"2024-09-12T17:31:37.924209+0000","last_deep_scrub":"31'49","last_deep_scrub_stamp":"2024-09-12T17:31:37.924209+0000","last_clean_scrub_stamp":"2024-09-12T17:31:37.924209+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:04.705594+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:48.208432+0000","last_change":"2024-09-12T17:31:48.208432+0000","last_active":"2024-09-12T17:31:48.208432+0000","last_peered":"2024-09-12T17:31:48.208432+0000","last_clean":"2024-09-12T17:31:48.208432+0000","last_became_active":"2024-09-12T17:27:48.439547+0000","last_became_peered":"2024-09-12T17:27:48.439547+0000","last_unstale":"2024-09-12T17:31:48.208432+0000","last_undegraded":"2024-09-12T17:31:48.208432+0000","last_fullsized":"2024-09-12T17:31:48.208432+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:48.208342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:48.208342+0000","last_clean_scrub_stamp":"2024-09-12T17:31:48.208342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:31.937432+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464221+0000","last_change":"2024-09-12T17:27:50.459594+0000","last_active":"2024-09-12T17:28:21.464221+0000","last_peered":"2024-09-12T17:28:21.464221+0000","last_clean":"2024-09-12T17:28:21.464221+0000","last_became_active":"2024-09-12T17:27:50.459321+0000","last_became_peered":"2024-09-12T17:27:50.459321+0000","last_unstale":"2024-09-12T17:28:21.464221+0000","last_undegraded":"2024-09-12T17:28:21.464221+0000","last_fullsized":"2024-09-12T17:28:21.464221+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:42.428839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"31'14","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:34.471584+0000","last_change":"2024-09-12T17:31:34.471584+0000","last_active":"2024-09-12T17:31:34.471584+0000","last_peered":"2024-09-12T17:31:34.471584+0000","last_clean":"2024-09-12T17:31:34.471584+0000","last_became_active":"2024-09-12T17:27:42.428364+0000","last_became_peered":"2024-09-12T17:27:42.428364+0000","last_unstale":"2024-09-12T17:31:34.471584+0000","last_undegraded":"2024-09-12T17:31:34.471584+0000","last_fullsized":"2024-09-12T17:31:34.471584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-12T17:31:34.471505+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-12T17:31:34.471505+0000","last_clean_scrub_stamp":"2024-09-12T17:31:34.471505+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:39.907822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:03.411106+0000","last_change":"2024-09-12T17:31:03.411106+0000","last_active":"2024-09-12T17:31:03.411106+0000","last_peered":"2024-09-12T17:31:03.411106+0000","last_clean":"2024-09-12T17:31:03.411106+0000","last_became_active":"2024-09-12T17:27:40.415212+0000","last_became_peered":"2024-09-12T17:27:40.415212+0000","last_unstale":"2024-09-12T17:31:03.411106+0000","last_undegraded":"2024-09-12T17:31:03.411106+0000","last_fullsized":"2024-09-12T17:31:03.411106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:03.411027+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:03.411027+0000","last_clean_scrub_stamp":"2024-09-12T17:31:03.411027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:42.311815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:52.479581+0000","last_change":"2024-09-12T17:31:52.479581+0000","last_active":"2024-09-12T17:31:52.479581+0000","last_peered":"2024-09-12T17:31:52.479581+0000","last_clean":"2024-09-12T17:31:52.479581+0000","last_became_active":"2024-09-12T17:27:44.429844+0000","last_became_peered":"2024-09-12T17:27:44.429844+0000","last_unstale":"2024-09-12T17:31:52.479581+0000","last_undegraded":"2024-09-12T17:31:52.479581+0000","last_fullsized":"2024-09-12T17:31:52.479581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:52.479482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:52.479482+0000","last_clean_scrub_stamp":"2024-09-12T17:31:52.479482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:16.636626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"31'38","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:41.161165+0000","last_change":"2024-09-12T17:31:41.161165+0000","last_active":"2024-09-12T17:31:41.161165+0000","last_peered":"2024-09-12T17:31:41.161165+0000","last_clean":"2024-09-12T17:31:41.161165+0000","last_became_active":"2024-09-12T17:27:46.432650+0000","last_became_peered":"2024-09-12T17:27:46.432650+0000","last_unstale":"2024-09-12T17:31:41.161165+0000","last_undegraded":"2024-09-12T17:31:41.161165+0000","last_fullsized":"2024-09-12T17:31:41.161165+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'38","last_scrub_stamp":"2024-09-12T17:31:41.161056+0000","last_deep_scrub":"31'38","last_deep_scrub_stamp":"2024-09-12T17:31:41.161056+0000","last_clean_scrub_stamp":"2024-09-12T17:31:41.161056+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:32.306377+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:48.210555+0000","last_change":"2024-09-12T17:31:48.210555+0000","last_active":"2024-09-12T17:31:48.210555+0000","last_peered":"2024-09-12T17:31:48.210555+0000","last_clean":"2024-09-12T17:31:48.210555+0000","last_became_active":"2024-09-12T17:27:48.439134+0000","last_became_peered":"2024-09-12T17:27:48.439134+0000","last_unstale":"2024-09-12T17:31:48.210555+0000","last_undegraded":"2024-09-12T17:31:48.210555+0000","last_fullsized":"2024-09-12T17:31:48.210555+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:48.210467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:48.210467+0000","last_clean_scrub_stamp":"2024-09-12T17:31:48.210467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:00.748017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:38.470924+0000","last_change":"2024-09-12T17:31:38.470826+0000","last_active":"2024-09-12T17:31:38.470924+0000","last_peered":"2024-09-12T17:31:38.470924+0000","last_clean":"2024-09-12T17:31:38.470924+0000","last_became_active":"2024-09-12T17:27:42.426108+0000","last_became_peered":"2024-09-12T17:27:42.426108+0000","last_unstale":"2024-09-12T17:31:38.470924+0000","last_undegraded":"2024-09-12T17:31:38.470924+0000","last_fullsized":"2024-09-12T17:31:38.470924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:38.470744+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:38.470744+0000","last_clean_scrub_stamp":"2024-09-12T17:31:38.470744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:20.220207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:13.378936+0000","last_change":"2024-09-12T17:31:13.378936+0000","last_active":"2024-09-12T17:31:13.378936+0000","last_peered":"2024-09-12T17:31:13.378936+0000","last_clean":"2024-09-12T17:31:13.378936+0000","last_became_active":"2024-09-12T17:27:40.429644+0000","last_became_peered":"2024-09-12T17:27:40.429644+0000","last_unstale":"2024-09-12T17:31:13.378936+0000","last_undegraded":"2024-09-12T17:31:13.378936+0000","last_fullsized":"2024-09-12T17:31:13.378936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:13.378812+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:13.378812+0000","last_clean_scrub_stamp":"2024-09-12T17:31:13.378812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:25.356806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:35.136034+0000","last_change":"2024-09-12T17:31:35.136034+0000","last_active":"2024-09-12T17:31:35.136034+0000","last_peered":"2024-09-12T17:31:35.136034+0000","last_clean":"2024-09-12T17:31:35.136034+0000","last_became_active":"2024-09-12T17:28:21.471678+0000","last_became_peered":"2024-09-12T17:28:21.471678+0000","last_unstale":"2024-09-12T17:31:35.136034+0000","last_undegraded":"2024-09-12T17:31:35.136034+0000","last_fullsized":"2024-09-12T17:31:35.136034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:35.135955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:35.135955+0000","last_clean_scrub_stamp":"2024-09-12T17:31:35.135955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:53.779707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"31'66","reported_seq":139,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:38.968939+0000","last_change":"2024-09-12T17:31:38.968939+0000","last_active":"2024-09-12T17:31:38.968939+0000","last_peered":"2024-09-12T17:31:38.968939+0000","last_clean":"2024-09-12T17:31:38.968939+0000","last_became_active":"2024-09-12T17:27:46.437623+0000","last_became_peered":"2024-09-12T17:27:46.437623+0000","last_unstale":"2024-09-12T17:31:38.968939+0000","last_undegraded":"2024-09-12T17:31:38.968939+0000","last_fullsized":"2024-09-12T17:31:38.968939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'66","last_scrub_stamp":"2024-09-12T17:31:38.968815+0000","last_deep_scrub":"31'66","last_deep_scrub_stamp":"2024-09-12T17:31:38.968815+0000","last_clean_scrub_stamp":"2024-09-12T17:31:38.968815+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:48.067615+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:49.239074+0000","last_change":"2024-09-12T17:31:49.239074+0000","last_active":"2024-09-12T17:31:49.239074+0000","last_peered":"2024-09-12T17:31:49.239074+0000","last_clean":"2024-09-12T17:31:49.239074+0000","last_became_active":"2024-09-12T17:27:48.440354+0000","last_became_peered":"2024-09-12T17:27:48.440354+0000","last_unstale":"2024-09-12T17:31:49.239074+0000","last_undegraded":"2024-09-12T17:31:49.239074+0000","last_fullsized":"2024-09-12T17:31:49.239074+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:49.238996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:49.238996+0000","last_clean_scrub_stamp":"2024-09-12T17:31:49.238996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:20.420319+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"31'14","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:57.126688+0000","last_change":"2024-09-12T17:31:57.126688+0000","last_active":"2024-09-12T17:31:57.126688+0000","last_peered":"2024-09-12T17:31:57.126688+0000","last_clean":"2024-09-12T17:31:57.126688+0000","last_became_active":"2024-09-12T17:27:50.457744+0000","last_became_peered":"2024-09-12T17:27:50.457744+0000","last_unstale":"2024-09-12T17:31:57.126688+0000","last_undegraded":"2024-09-12T17:31:57.126688+0000","last_fullsized":"2024-09-12T17:31:57.126688+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-12T17:31:57.126597+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-12T17:31:57.126597+0000","last_clean_scrub_stamp":"2024-09-12T17:31:57.126597+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:42.203786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"31'6","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:21.836167+0000","last_change":"2024-09-12T17:31:21.836070+0000","last_active":"2024-09-12T17:31:21.836167+0000","last_peered":"2024-09-12T17:31:21.836167+0000","last_clean":"2024-09-12T17:31:21.836167+0000","last_became_active":"2024-09-12T17:27:42.424447+0000","last_became_peered":"2024-09-12T17:27:42.424447+0000","last_unstale":"2024-09-12T17:31:21.836167+0000","last_undegraded":"2024-09-12T17:31:21.836167+0000","last_fullsized":"2024-09-12T17:31:21.836167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-12T17:31:21.835987+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-12T17:31:21.835987+0000","last_clean_scrub_stamp":"2024-09-12T17:31:21.835987+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:40.479739+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:04.363963+0000","last_change":"2024-09-12T17:31:04.363963+0000","last_active":"2024-09-12T17:31:04.363963+0000","last_peered":"2024-09-12T17:31:04.363963+0000","last_clean":"2024-09-12T17:31:04.363963+0000","last_became_active":"2024-09-12T17:27:40.414911+0000","last_became_peered":"2024-09-12T17:27:40.414911+0000","last_unstale":"2024-09-12T17:31:04.363963+0000","last_undegraded":"2024-09-12T17:31:04.363963+0000","last_fullsized":"2024-09-12T17:31:04.363963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:04.363875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:04.363875+0000","last_clean_scrub_stamp":"2024-09-12T17:31:04.363875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:31.145785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"31'5","reported_seq":239,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:37.091750+0000","last_change":"2024-09-12T17:31:37.091674+0000","last_active":"2024-09-12T17:31:37.091750+0000","last_peered":"2024-09-12T17:31:37.091750+0000","last_clean":"2024-09-12T17:31:37.091750+0000","last_became_active":"2024-09-12T17:27:44.427778+0000","last_became_peered":"2024-09-12T17:27:44.427778+0000","last_unstale":"2024-09-12T17:31:37.091750+0000","last_undegraded":"2024-09-12T17:31:37.091750+0000","last_fullsized":"2024-09-12T17:31:37.091750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-09-12T17:31:37.091588+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-09-12T17:31:37.091588+0000","last_clean_scrub_stamp":"2024-09-12T17:31:37.091588+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:14.070741+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"31'46","reported_seq":104,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:08.465643+0000","last_change":"2024-09-12T17:32:08.465643+0000","last_active":"2024-09-12T17:32:08.465643+0000","last_peered":"2024-09-12T17:32:08.465643+0000","last_clean":"2024-09-12T17:32:08.465643+0000","last_became_active":"2024-09-12T17:27:46.440494+0000","last_became_peered":"2024-09-12T17:27:46.440494+0000","last_unstale":"2024-09-12T17:32:08.465643+0000","last_undegraded":"2024-09-12T17:32:08.465643+0000","last_fullsized":"2024-09-12T17:32:08.465643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2024-09-12T17:32:08.465544+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2024-09-12T17:32:08.465544+0000","last_clean_scrub_stamp":"2024-09-12T17:32:08.465544+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:37.617137+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:51.230116+0000","last_change":"2024-09-12T17:31:51.230116+0000","last_active":"2024-09-12T17:31:51.230116+0000","last_peered":"2024-09-12T17:31:51.230116+0000","last_clean":"2024-09-12T17:31:51.230116+0000","last_became_active":"2024-09-12T17:27:48.448871+0000","last_became_peered":"2024-09-12T17:27:48.448871+0000","last_unstale":"2024-09-12T17:31:51.230116+0000","last_undegraded":"2024-09-12T17:31:51.230116+0000","last_fullsized":"2024-09-12T17:31:51.230116+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:51.230024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:51.230024+0000","last_clean_scrub_stamp":"2024-09-12T17:31:51.230024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:45.840129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.463074+0000","last_change":"2024-09-12T17:27:50.452011+0000","last_active":"2024-09-12T17:28:21.463074+0000","last_peered":"2024-09-12T17:28:21.463074+0000","last_clean":"2024-09-12T17:28:21.463074+0000","last_became_active":"2024-09-12T17:27:50.451678+0000","last_became_peered":"2024-09-12T17:27:50.451678+0000","last_unstale":"2024-09-12T17:28:21.463074+0000","last_undegraded":"2024-09-12T17:28:21.463074+0000","last_fullsized":"2024-09-12T17:28:21.463074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:15.594880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:37.437437+0000","last_change":"2024-09-12T17:31:37.437437+0000","last_active":"2024-09-12T17:31:37.437437+0000","last_peered":"2024-09-12T17:31:37.437437+0000","last_clean":"2024-09-12T17:31:37.437437+0000","last_became_active":"2024-09-12T17:27:42.438583+0000","last_became_peered":"2024-09-12T17:27:42.438583+0000","last_unstale":"2024-09-12T17:31:37.437437+0000","last_undegraded":"2024-09-12T17:31:37.437437+0000","last_fullsized":"2024-09-12T17:31:37.437437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:37.437341+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:37.437341+0000","last_clean_scrub_stamp":"2024-09-12T17:31:37.437341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:18.893026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:05.381633+0000","last_change":"2024-09-12T17:31:05.381633+0000","last_active":"2024-09-12T17:31:05.381633+0000","last_peered":"2024-09-12T17:31:05.381633+0000","last_clean":"2024-09-12T17:31:05.381633+0000","last_became_active":"2024-09-12T17:27:40.414034+0000","last_became_peered":"2024-09-12T17:27:40.414034+0000","last_unstale":"2024-09-12T17:31:05.381633+0000","last_undegraded":"2024-09-12T17:31:05.381633+0000","last_fullsized":"2024-09-12T17:31:05.381633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:05.381510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:05.381510+0000","last_clean_scrub_stamp":"2024-09-12T17:31:05.381510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:28.239447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:34.127651+0000","last_change":"2024-09-12T17:31:34.127651+0000","last_active":"2024-09-12T17:31:34.127651+0000","last_peered":"2024-09-12T17:31:34.127651+0000","last_clean":"2024-09-12T17:31:34.127651+0000","last_became_active":"2024-09-12T17:27:44.426927+0000","last_became_peered":"2024-09-12T17:27:44.426927+0000","last_unstale":"2024-09-12T17:31:34.127651+0000","last_undegraded":"2024-09-12T17:31:34.127651+0000","last_fullsized":"2024-09-12T17:31:34.127651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:34.127561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:34.127561+0000","last_clean_scrub_stamp":"2024-09-12T17:31:34.127561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:41.075392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"31'40","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:39.963017+0000","last_change":"2024-09-12T17:31:39.962935+0000","last_active":"2024-09-12T17:31:39.963017+0000","last_peered":"2024-09-12T17:31:39.963017+0000","last_clean":"2024-09-12T17:31:39.963017+0000","last_became_active":"2024-09-12T17:27:46.438778+0000","last_became_peered":"2024-09-12T17:27:46.438778+0000","last_unstale":"2024-09-12T17:31:39.963017+0000","last_undegraded":"2024-09-12T17:31:39.963017+0000","last_fullsized":"2024-09-12T17:31:39.963017+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'40","last_scrub_stamp":"2024-09-12T17:31:39.962824+0000","last_deep_scrub":"31'40","last_deep_scrub_stamp":"2024-09-12T17:31:39.962824+0000","last_clean_scrub_stamp":"2024-09-12T17:31:39.962824+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:02.114783+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:51.100050+0000","last_change":"2024-09-12T17:31:51.100050+0000","last_active":"2024-09-12T17:31:51.100050+0000","last_peered":"2024-09-12T17:31:51.100050+0000","last_clean":"2024-09-12T17:31:51.100050+0000","last_became_active":"2024-09-12T17:27:48.439888+0000","last_became_peered":"2024-09-12T17:27:48.439888+0000","last_unstale":"2024-09-12T17:31:51.100050+0000","last_undegraded":"2024-09-12T17:31:51.100050+0000","last_fullsized":"2024-09-12T17:31:51.100050+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:51.099939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:51.099939+0000","last_clean_scrub_stamp":"2024-09-12T17:31:51.099939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:51.957679+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"31'3","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:49.072631+0000","last_change":"2024-09-12T17:27:50.455406+0000","last_active":"2024-09-12T17:29:49.072631+0000","last_peered":"2024-09-12T17:29:49.072631+0000","last_clean":"2024-09-12T17:29:49.072631+0000","last_became_active":"2024-09-12T17:27:50.454058+0000","last_became_peered":"2024-09-12T17:27:50.454058+0000","last_unstale":"2024-09-12T17:29:49.072631+0000","last_undegraded":"2024-09-12T17:29:49.072631+0000","last_fullsized":"2024-09-12T17:29:49.072631+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:44.719122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"31'6","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:19.793825+0000","last_change":"2024-09-12T17:31:19.793825+0000","last_active":"2024-09-12T17:31:19.793825+0000","last_peered":"2024-09-12T17:31:19.793825+0000","last_clean":"2024-09-12T17:31:19.793825+0000","last_became_active":"2024-09-12T17:27:42.428236+0000","last_became_peered":"2024-09-12T17:27:42.428236+0000","last_unstale":"2024-09-12T17:31:19.793825+0000","last_undegraded":"2024-09-12T17:31:19.793825+0000","last_fullsized":"2024-09-12T17:31:19.793825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-12T17:31:19.793741+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-12T17:31:19.793741+0000","last_clean_scrub_stamp":"2024-09-12T17:31:19.793741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:09.004133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"31'6","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:17.402187+0000","last_change":"2024-09-12T17:31:17.402187+0000","last_active":"2024-09-12T17:31:17.402187+0000","last_peered":"2024-09-12T17:31:17.402187+0000","last_clean":"2024-09-12T17:31:17.402187+0000","last_became_active":"2024-09-12T17:27:40.428969+0000","last_became_peered":"2024-09-12T17:27:40.428969+0000","last_unstale":"2024-09-12T17:31:17.402187+0000","last_undegraded":"2024-09-12T17:31:17.402187+0000","last_fullsized":"2024-09-12T17:31:17.402187+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-12T17:31:17.402103+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-12T17:31:17.402103+0000","last_clean_scrub_stamp":"2024-09-12T17:31:17.402103+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:02:26.841712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":14,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:38.208867+0000","last_change":"2024-09-12T17:31:38.208867+0000","last_active":"2024-09-12T17:31:38.208867+0000","last_peered":"2024-09-12T17:31:38.208867+0000","last_clean":"2024-09-12T17:31:38.208867+0000","last_became_active":"2024-09-12T17:27:44.432609+0000","last_became_peered":"2024-09-12T17:27:44.432609+0000","last_unstale":"2024-09-12T17:31:38.208867+0000","last_undegraded":"2024-09-12T17:31:38.208867+0000","last_fullsized":"2024-09-12T17:31:38.208867+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:38.208779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:38.208779+0000","last_clean_scrub_stamp":"2024-09-12T17:31:38.208779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:52.480217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'15","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:09.417685+0000","last_change":"2024-09-12T17:32:09.417685+0000","last_active":"2024-09-12T17:32:09.417685+0000","last_peered":"2024-09-12T17:32:09.417685+0000","last_clean":"2024-09-12T17:32:09.417685+0000","last_became_active":"2024-09-12T17:27:46.444644+0000","last_became_peered":"2024-09-12T17:27:46.444644+0000","last_unstale":"2024-09-12T17:32:09.417685+0000","last_undegraded":"2024-09-12T17:32:09.417685+0000","last_fullsized":"2024-09-12T17:32:09.417685+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'15","last_scrub_stamp":"2024-09-12T17:32:09.417597+0000","last_deep_scrub":"31'15","last_deep_scrub_stamp":"2024-09-12T17:32:09.417597+0000","last_clean_scrub_stamp":"2024-09-12T17:32:09.417597+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:24.432999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"31'286","reported_seq":384,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:50.249180+0000","last_change":"2024-09-12T17:31:50.249117+0000","last_active":"2024-09-12T17:31:50.249180+0000","last_peered":"2024-09-12T17:31:50.249180+0000","last_clean":"2024-09-12T17:31:50.249180+0000","last_became_active":"2024-09-12T17:27:48.449138+0000","last_became_peered":"2024-09-12T17:27:48.449138+0000","last_unstale":"2024-09-12T17:31:50.249180+0000","last_undegraded":"2024-09-12T17:31:50.249180+0000","last_fullsized":"2024-09-12T17:31:50.249180+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'286","last_scrub_stamp":"2024-09-12T17:31:50.249038+0000","last_deep_scrub":"31'286","last_deep_scrub_stamp":"2024-09-12T17:31:50.249038+0000","last_clean_scrub_stamp":"2024-09-12T17:31:50.249038+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:01.178281+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:20.372154+0000","last_change":"2024-09-12T17:32:20.372154+0000","last_active":"2024-09-12T17:32:20.372154+0000","last_peered":"2024-09-12T17:32:20.372154+0000","last_clean":"2024-09-12T17:32:20.372154+0000","last_became_active":"2024-09-12T17:27:50.451899+0000","last_became_peered":"2024-09-12T17:27:50.451899+0000","last_unstale":"2024-09-12T17:32:20.372154+0000","last_undegraded":"2024-09-12T17:32:20.372154+0000","last_fullsized":"2024-09-12T17:32:20.372154+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:32:20.372056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:32:20.372056+0000","last_clean_scrub_stamp":"2024-09-12T17:32:20.372056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:32.927738+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"31'8","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:25.227409+0000","last_change":"2024-09-12T17:31:25.227409+0000","last_active":"2024-09-12T17:31:25.227409+0000","last_peered":"2024-09-12T17:31:25.227409+0000","last_clean":"2024-09-12T17:31:25.227409+0000","last_became_active":"2024-09-12T17:27:42.430110+0000","last_became_peered":"2024-09-12T17:27:42.430110+0000","last_unstale":"2024-09-12T17:31:25.227409+0000","last_undegraded":"2024-09-12T17:31:25.227409+0000","last_fullsized":"2024-09-12T17:31:25.227409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:25.227313+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:25.227313+0000","last_clean_scrub_stamp":"2024-09-12T17:31:25.227313+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:17.103312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:06.345680+0000","last_change":"2024-09-12T17:31:06.345680+0000","last_active":"2024-09-12T17:31:06.345680+0000","last_peered":"2024-09-12T17:31:06.345680+0000","last_clean":"2024-09-12T17:31:06.345680+0000","last_became_active":"2024-09-12T17:27:40.415018+0000","last_became_peered":"2024-09-12T17:27:40.415018+0000","last_unstale":"2024-09-12T17:31:06.345680+0000","last_undegraded":"2024-09-12T17:31:06.345680+0000","last_fullsized":"2024-09-12T17:31:06.345680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:06.345593+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:06.345593+0000","last_clean_scrub_stamp":"2024-09-12T17:31:06.345593+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:34.495634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:37.210915+0000","last_change":"2024-09-12T17:31:37.210915+0000","last_active":"2024-09-12T17:31:37.210915+0000","last_peered":"2024-09-12T17:31:37.210915+0000","last_clean":"2024-09-12T17:31:37.210915+0000","last_became_active":"2024-09-12T17:27:44.432389+0000","last_became_peered":"2024-09-12T17:27:44.432389+0000","last_unstale":"2024-09-12T17:31:37.210915+0000","last_undegraded":"2024-09-12T17:31:37.210915+0000","last_fullsized":"2024-09-12T17:31:37.210915+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:37.210810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:37.210810+0000","last_clean_scrub_stamp":"2024-09-12T17:31:37.210810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:49.748361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"31'46","reported_seq":104,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:45.208276+0000","last_change":"2024-09-12T17:31:45.208276+0000","last_active":"2024-09-12T17:31:45.208276+0000","last_peered":"2024-09-12T17:31:45.208276+0000","last_clean":"2024-09-12T17:31:45.208276+0000","last_became_active":"2024-09-12T17:27:46.435056+0000","last_became_peered":"2024-09-12T17:27:46.435056+0000","last_unstale":"2024-09-12T17:31:45.208276+0000","last_undegraded":"2024-09-12T17:31:45.208276+0000","last_fullsized":"2024-09-12T17:31:45.208276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2024-09-12T17:31:45.208179+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2024-09-12T17:31:45.208179+0000","last_clean_scrub_stamp":"2024-09-12T17:31:45.208179+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:21.846742+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:54.119551+0000","last_change":"2024-09-12T17:31:54.119551+0000","last_active":"2024-09-12T17:31:54.119551+0000","last_peered":"2024-09-12T17:31:54.119551+0000","last_clean":"2024-09-12T17:31:54.119551+0000","last_became_active":"2024-09-12T17:27:48.451143+0000","last_became_peered":"2024-09-12T17:27:48.451143+0000","last_unstale":"2024-09-12T17:31:54.119551+0000","last_undegraded":"2024-09-12T17:31:54.119551+0000","last_fullsized":"2024-09-12T17:31:54.119551+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:54.119464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:54.119464+0000","last_clean_scrub_stamp":"2024-09-12T17:31:54.119464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:50.067210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:56.264451+0000","last_change":"2024-09-12T17:31:56.264451+0000","last_active":"2024-09-12T17:31:56.264451+0000","last_peered":"2024-09-12T17:31:56.264451+0000","last_clean":"2024-09-12T17:31:56.264451+0000","last_became_active":"2024-09-12T17:27:50.458688+0000","last_became_peered":"2024-09-12T17:27:50.458688+0000","last_unstale":"2024-09-12T17:31:56.264451+0000","last_undegraded":"2024-09-12T17:31:56.264451+0000","last_fullsized":"2024-09-12T17:31:56.264451+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:56.264368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:56.264368+0000","last_clean_scrub_stamp":"2024-09-12T17:31:56.264368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:54.541983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'18","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:24.239641+0000","last_change":"2024-09-12T17:31:24.239641+0000","last_active":"2024-09-12T17:31:24.239641+0000","last_peered":"2024-09-12T17:31:24.239641+0000","last_clean":"2024-09-12T17:31:24.239641+0000","last_became_active":"2024-09-12T17:27:42.429645+0000","last_became_peered":"2024-09-12T17:27:42.429645+0000","last_unstale":"2024-09-12T17:31:24.239641+0000","last_undegraded":"2024-09-12T17:31:24.239641+0000","last_fullsized":"2024-09-12T17:31:24.239641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'18","last_scrub_stamp":"2024-09-12T17:31:24.239557+0000","last_deep_scrub":"31'18","last_deep_scrub_stamp":"2024-09-12T17:31:24.239557+0000","last_clean_scrub_stamp":"2024-09-12T17:31:24.239557+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:16.223898+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":59,"num_read_kb":51,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:18.401497+0000","last_change":"2024-09-12T17:31:18.401497+0000","last_active":"2024-09-12T17:31:18.401497+0000","last_peered":"2024-09-12T17:31:18.401497+0000","last_clean":"2024-09-12T17:31:18.401497+0000","last_became_active":"2024-09-12T17:27:40.433580+0000","last_became_peered":"2024-09-12T17:27:40.433580+0000","last_unstale":"2024-09-12T17:31:18.401497+0000","last_undegraded":"2024-09-12T17:31:18.401497+0000","last_fullsized":"2024-09-12T17:31:18.401497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:18.401408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:18.401408+0000","last_clean_scrub_stamp":"2024-09-12T17:31:18.401408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:11.623914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:33.094219+0000","last_change":"2024-09-12T17:31:33.094219+0000","last_active":"2024-09-12T17:31:33.094219+0000","last_peered":"2024-09-12T17:31:33.094219+0000","last_clean":"2024-09-12T17:31:33.094219+0000","last_became_active":"2024-09-12T17:27:44.433529+0000","last_became_peered":"2024-09-12T17:27:44.433529+0000","last_unstale":"2024-09-12T17:31:33.094219+0000","last_undegraded":"2024-09-12T17:31:33.094219+0000","last_fullsized":"2024-09-12T17:31:33.094219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:33.094131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:33.094131+0000","last_clean_scrub_stamp":"2024-09-12T17:31:33.094131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:22.304523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"31'39","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:42.006958+0000","last_change":"2024-09-12T17:31:42.006958+0000","last_active":"2024-09-12T17:31:42.006958+0000","last_peered":"2024-09-12T17:31:42.006958+0000","last_clean":"2024-09-12T17:31:42.006958+0000","last_became_active":"2024-09-12T17:27:46.439037+0000","last_became_peered":"2024-09-12T17:27:46.439037+0000","last_unstale":"2024-09-12T17:31:42.006958+0000","last_undegraded":"2024-09-12T17:31:42.006958+0000","last_fullsized":"2024-09-12T17:31:42.006958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2024-09-12T17:31:42.006807+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2024-09-12T17:31:42.006807+0000","last_clean_scrub_stamp":"2024-09-12T17:31:42.006807+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:34.109153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:13.478068+0000","last_change":"2024-09-12T17:32:13.478068+0000","last_active":"2024-09-12T17:32:13.478068+0000","last_peered":"2024-09-12T17:32:13.478068+0000","last_clean":"2024-09-12T17:32:13.478068+0000","last_became_active":"2024-09-12T17:27:48.448426+0000","last_became_peered":"2024-09-12T17:27:48.448426+0000","last_unstale":"2024-09-12T17:32:13.478068+0000","last_undegraded":"2024-09-12T17:32:13.478068+0000","last_fullsized":"2024-09-12T17:32:13.478068+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:32:13.477968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:32:13.477968+0000","last_clean_scrub_stamp":"2024-09-12T17:32:13.477968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:04.464391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:28:21.464580+0000","last_change":"2024-09-12T17:27:50.459948+0000","last_active":"2024-09-12T17:28:21.464580+0000","last_peered":"2024-09-12T17:28:21.464580+0000","last_clean":"2024-09-12T17:28:21.464580+0000","last_became_active":"2024-09-12T17:27:50.459662+0000","last_became_peered":"2024-09-12T17:27:50.459662+0000","last_unstale":"2024-09-12T17:28:21.464580+0000","last_undegraded":"2024-09-12T17:28:21.464580+0000","last_fullsized":"2024-09-12T17:28:21.464580+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:08.216661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'12","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:23.237052+0000","last_change":"2024-09-12T17:31:23.237052+0000","last_active":"2024-09-12T17:31:23.237052+0000","last_peered":"2024-09-12T17:31:23.237052+0000","last_clean":"2024-09-12T17:31:23.237052+0000","last_became_active":"2024-09-12T17:28:21.472532+0000","last_became_peered":"2024-09-12T17:28:21.472532+0000","last_unstale":"2024-09-12T17:31:23.237052+0000","last_undegraded":"2024-09-12T17:31:23.237052+0000","last_fullsized":"2024-09-12T17:31:23.237052+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-09-12T17:31:23.236949+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-09-12T17:31:23.236949+0000","last_clean_scrub_stamp":"2024-09-12T17:31:23.236949+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:09.498014+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:04.774737+0000","last_change":"2024-09-12T17:31:04.774672+0000","last_active":"2024-09-12T17:31:04.774737+0000","last_peered":"2024-09-12T17:31:04.774737+0000","last_clean":"2024-09-12T17:31:04.774737+0000","last_became_active":"2024-09-12T17:27:40.418464+0000","last_became_peered":"2024-09-12T17:27:40.418464+0000","last_unstale":"2024-09-12T17:31:04.774737+0000","last_undegraded":"2024-09-12T17:31:04.774737+0000","last_fullsized":"2024-09-12T17:31:04.774737+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:04.774580+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:04.774580+0000","last_clean_scrub_stamp":"2024-09-12T17:31:04.774580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:11.872204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:36.236243+0000","last_change":"2024-09-12T17:31:36.236243+0000","last_active":"2024-09-12T17:31:36.236243+0000","last_peered":"2024-09-12T17:31:36.236243+0000","last_clean":"2024-09-12T17:31:36.236243+0000","last_became_active":"2024-09-12T17:27:44.430221+0000","last_became_peered":"2024-09-12T17:27:44.430221+0000","last_unstale":"2024-09-12T17:31:36.236243+0000","last_undegraded":"2024-09-12T17:31:36.236243+0000","last_fullsized":"2024-09-12T17:31:36.236243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:36.236156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:36.236156+0000","last_clean_scrub_stamp":"2024-09-12T17:31:36.236156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:42.309771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"31'31","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:07.507552+0000","last_change":"2024-09-12T17:32:07.507552+0000","last_active":"2024-09-12T17:32:07.507552+0000","last_peered":"2024-09-12T17:32:07.507552+0000","last_clean":"2024-09-12T17:32:07.507552+0000","last_became_active":"2024-09-12T17:27:46.441081+0000","last_became_peered":"2024-09-12T17:27:46.441081+0000","last_unstale":"2024-09-12T17:32:07.507552+0000","last_undegraded":"2024-09-12T17:32:07.507552+0000","last_fullsized":"2024-09-12T17:32:07.507552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'31","last_scrub_stamp":"2024-09-12T17:32:07.507459+0000","last_deep_scrub":"31'31","last_deep_scrub_stamp":"2024-09-12T17:32:07.507459+0000","last_clean_scrub_stamp":"2024-09-12T17:32:07.507459+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:22.985097+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:16.395318+0000","last_change":"2024-09-12T17:32:16.395318+0000","last_active":"2024-09-12T17:32:16.395318+0000","last_peered":"2024-09-12T17:32:16.395318+0000","last_clean":"2024-09-12T17:32:16.395318+0000","last_became_active":"2024-09-12T17:27:48.447321+0000","last_became_peered":"2024-09-12T17:27:48.447321+0000","last_unstale":"2024-09-12T17:32:16.395318+0000","last_undegraded":"2024-09-12T17:32:16.395318+0000","last_fullsized":"2024-09-12T17:32:16.395318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:32:16.395229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:32:16.395229+0000","last_clean_scrub_stamp":"2024-09-12T17:32:16.395229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:13.448016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"31'10","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:49.181767+0000","last_change":"2024-09-12T17:27:50.460271+0000","last_active":"2024-09-12T17:30:49.181767+0000","last_peered":"2024-09-12T17:30:49.181767+0000","last_clean":"2024-09-12T17:30:49.181767+0000","last_became_active":"2024-09-12T17:27:50.459463+0000","last_became_peered":"2024-09-12T17:27:50.459463+0000","last_unstale":"2024-09-12T17:30:49.181767+0000","last_undegraded":"2024-09-12T17:30:49.181767+0000","last_fullsized":"2024-09-12T17:30:49.181767+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:18.316219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"31'18","reported_seq":90,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:22.222693+0000","last_change":"2024-09-12T17:31:22.222693+0000","last_active":"2024-09-12T17:31:22.222693+0000","last_peered":"2024-09-12T17:31:22.222693+0000","last_clean":"2024-09-12T17:31:22.222693+0000","last_became_active":"2024-09-12T17:27:42.430021+0000","last_became_peered":"2024-09-12T17:27:42.430021+0000","last_unstale":"2024-09-12T17:31:22.222693+0000","last_undegraded":"2024-09-12T17:31:22.222693+0000","last_fullsized":"2024-09-12T17:31:22.222693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'18","last_scrub_stamp":"2024-09-12T17:31:22.222608+0000","last_deep_scrub":"31'18","last_deep_scrub_stamp":"2024-09-12T17:31:22.222608+0000","last_clean_scrub_stamp":"2024-09-12T17:31:22.222608+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:10.350058+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":76,"num_read_kb":68,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:07.302226+0000","last_change":"2024-09-12T17:31:07.302162+0000","last_active":"2024-09-12T17:31:07.302226+0000","last_peered":"2024-09-12T17:31:07.302226+0000","last_clean":"2024-09-12T17:31:07.302226+0000","last_became_active":"2024-09-12T17:27:40.415549+0000","last_became_peered":"2024-09-12T17:27:40.415549+0000","last_unstale":"2024-09-12T17:31:07.302226+0000","last_undegraded":"2024-09-12T17:31:07.302226+0000","last_fullsized":"2024-09-12T17:31:07.302226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:07.302079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:07.302079+0000","last_clean_scrub_stamp":"2024-09-12T17:31:07.302079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:31:42.747169+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"31'3","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:39.213346+0000","last_change":"2024-09-12T17:31:39.213346+0000","last_active":"2024-09-12T17:31:39.213346+0000","last_peered":"2024-09-12T17:31:39.213346+0000","last_clean":"2024-09-12T17:31:39.213346+0000","last_became_active":"2024-09-12T17:27:44.433037+0000","last_became_peered":"2024-09-12T17:27:44.433037+0000","last_unstale":"2024-09-12T17:31:39.213346+0000","last_undegraded":"2024-09-12T17:31:39.213346+0000","last_fullsized":"2024-09-12T17:31:39.213346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-09-12T17:31:39.213265+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-09-12T17:31:39.213265+0000","last_clean_scrub_stamp":"2024-09-12T17:31:39.213265+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:46.499885+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"31'41","reported_seq":98,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:03.477841+0000","last_change":"2024-09-12T17:32:03.477841+0000","last_active":"2024-09-12T17:32:03.477841+0000","last_peered":"2024-09-12T17:32:03.477841+0000","last_clean":"2024-09-12T17:32:03.477841+0000","last_became_active":"2024-09-12T17:27:46.443316+0000","last_became_peered":"2024-09-12T17:27:46.443316+0000","last_unstale":"2024-09-12T17:32:03.477841+0000","last_undegraded":"2024-09-12T17:32:03.477841+0000","last_fullsized":"2024-09-12T17:32:03.477841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'41","last_scrub_stamp":"2024-09-12T17:32:03.477746+0000","last_deep_scrub":"31'41","last_deep_scrub_stamp":"2024-09-12T17:32:03.477746+0000","last_clean_scrub_stamp":"2024-09-12T17:32:03.477746+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:22.817346+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:50.051568+0000","last_change":"2024-09-12T17:31:50.051568+0000","last_active":"2024-09-12T17:31:50.051568+0000","last_peered":"2024-09-12T17:31:50.051568+0000","last_clean":"2024-09-12T17:31:50.051568+0000","last_became_active":"2024-09-12T17:27:48.447884+0000","last_became_peered":"2024-09-12T17:27:48.447884+0000","last_unstale":"2024-09-12T17:31:50.051568+0000","last_undegraded":"2024-09-12T17:31:50.051568+0000","last_fullsized":"2024-09-12T17:31:50.051568+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:50.051481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:50.051481+0000","last_clean_scrub_stamp":"2024-09-12T17:31:50.051481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:34.463798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"31'2","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:29:47.614754+0000","last_change":"2024-09-12T17:27:50.459747+0000","last_active":"2024-09-12T17:29:47.614754+0000","last_peered":"2024-09-12T17:29:47.614754+0000","last_clean":"2024-09-12T17:29:47.614754+0000","last_became_active":"2024-09-12T17:27:50.459464+0000","last_became_peered":"2024-09-12T17:27:50.459464+0000","last_unstale":"2024-09-12T17:29:47.614754+0000","last_undegraded":"2024-09-12T17:29:47.614754+0000","last_fullsized":"2024-09-12T17:29:47.614754+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:49.430951+0000","last_clean_scrub_stamp":"2024-09-12T17:27:49.430951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:47.424145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"31'6","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:26.275546+0000","last_change":"2024-09-12T17:31:26.275546+0000","last_active":"2024-09-12T17:31:26.275546+0000","last_peered":"2024-09-12T17:31:26.275546+0000","last_clean":"2024-09-12T17:31:26.275546+0000","last_became_active":"2024-09-12T17:28:21.471738+0000","last_became_peered":"2024-09-12T17:28:21.471738+0000","last_unstale":"2024-09-12T17:31:26.275546+0000","last_undegraded":"2024-09-12T17:31:26.275546+0000","last_fullsized":"2024-09-12T17:31:26.275546+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-12T17:31:26.275465+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-12T17:31:26.275465+0000","last_clean_scrub_stamp":"2024-09-12T17:31:26.275465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:32.161098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:09.101188+0000","last_change":"2024-09-12T17:31:09.101122+0000","last_active":"2024-09-12T17:31:09.101188+0000","last_peered":"2024-09-12T17:31:09.101188+0000","last_clean":"2024-09-12T17:31:09.101188+0000","last_became_active":"2024-09-12T17:27:40.425150+0000","last_became_peered":"2024-09-12T17:27:40.425150+0000","last_unstale":"2024-09-12T17:31:09.101188+0000","last_undegraded":"2024-09-12T17:31:09.101188+0000","last_fullsized":"2024-09-12T17:31:09.101188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:09.101041+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:09.101041+0000","last_clean_scrub_stamp":"2024-09-12T17:31:09.101041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:11.434252+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"31'6","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:24.873600+0000","last_change":"2024-09-12T17:31:24.873531+0000","last_active":"2024-09-12T17:31:24.873600+0000","last_peered":"2024-09-12T17:31:24.873600+0000","last_clean":"2024-09-12T17:31:24.873600+0000","last_became_active":"2024-09-12T17:27:42.427745+0000","last_became_peered":"2024-09-12T17:27:42.427745+0000","last_unstale":"2024-09-12T17:31:24.873600+0000","last_undegraded":"2024-09-12T17:31:24.873600+0000","last_fullsized":"2024-09-12T17:31:24.873600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-12T17:31:24.873443+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-12T17:31:24.873443+0000","last_clean_scrub_stamp":"2024-09-12T17:31:24.873443+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:52.854740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:02.824340+0000","last_change":"2024-09-12T17:31:02.824281+0000","last_active":"2024-09-12T17:31:02.824340+0000","last_peered":"2024-09-12T17:31:02.824340+0000","last_clean":"2024-09-12T17:31:02.824340+0000","last_became_active":"2024-09-12T17:27:40.413068+0000","last_became_peered":"2024-09-12T17:27:40.413068+0000","last_unstale":"2024-09-12T17:31:02.824340+0000","last_undegraded":"2024-09-12T17:31:02.824340+0000","last_fullsized":"2024-09-12T17:31:02.824340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:02.824193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:02.824193+0000","last_clean_scrub_stamp":"2024-09-12T17:31:02.824193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:30.974235+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:40.553899+0000","last_change":"2024-09-12T17:31:40.553818+0000","last_active":"2024-09-12T17:31:40.553899+0000","last_peered":"2024-09-12T17:31:40.553899+0000","last_clean":"2024-09-12T17:31:40.553899+0000","last_became_active":"2024-09-12T17:27:42.428871+0000","last_became_peered":"2024-09-12T17:27:42.428871+0000","last_unstale":"2024-09-12T17:31:40.553899+0000","last_undegraded":"2024-09-12T17:31:40.553899+0000","last_fullsized":"2024-09-12T17:31:40.553899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:40.553702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:40.553702+0000","last_clean_scrub_stamp":"2024-09-12T17:31:40.553702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:04.977336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:19.436342+0000","last_change":"2024-09-12T17:31:19.436252+0000","last_active":"2024-09-12T17:31:19.436342+0000","last_peered":"2024-09-12T17:31:19.436342+0000","last_clean":"2024-09-12T17:31:19.436342+0000","last_became_active":"2024-09-12T17:27:40.423210+0000","last_became_peered":"2024-09-12T17:27:40.423210+0000","last_unstale":"2024-09-12T17:31:19.436342+0000","last_undegraded":"2024-09-12T17:31:19.436342+0000","last_fullsized":"2024-09-12T17:31:19.436342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:19.436168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:19.436168+0000","last_clean_scrub_stamp":"2024-09-12T17:31:19.436168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:08.266186+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"31'10","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:23.856534+0000","last_change":"2024-09-12T17:31:23.856443+0000","last_active":"2024-09-12T17:31:23.856534+0000","last_peered":"2024-09-12T17:31:23.856534+0000","last_clean":"2024-09-12T17:31:23.856534+0000","last_became_active":"2024-09-12T17:27:42.428059+0000","last_became_peered":"2024-09-12T17:27:42.428059+0000","last_unstale":"2024-09-12T17:31:23.856534+0000","last_undegraded":"2024-09-12T17:31:23.856534+0000","last_fullsized":"2024-09-12T17:31:23.856534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-12T17:31:23.856356+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-12T17:31:23.856356+0000","last_clean_scrub_stamp":"2024-09-12T17:31:23.856356+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:00.835509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:08.822490+0000","last_change":"2024-09-12T17:31:08.822428+0000","last_active":"2024-09-12T17:31:08.822490+0000","last_peered":"2024-09-12T17:31:08.822490+0000","last_clean":"2024-09-12T17:31:08.822490+0000","last_became_active":"2024-09-12T17:27:40.419018+0000","last_became_peered":"2024-09-12T17:27:40.419018+0000","last_unstale":"2024-09-12T17:31:08.822490+0000","last_undegraded":"2024-09-12T17:31:08.822490+0000","last_fullsized":"2024-09-12T17:31:08.822490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:08.822340+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:08.822340+0000","last_clean_scrub_stamp":"2024-09-12T17:31:08.822340+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:55.083405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"31'4","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:22.847898+0000","last_change":"2024-09-12T17:31:22.847810+0000","last_active":"2024-09-12T17:31:22.847898+0000","last_peered":"2024-09-12T17:31:22.847898+0000","last_clean":"2024-09-12T17:31:22.847898+0000","last_became_active":"2024-09-12T17:27:42.424201+0000","last_became_peered":"2024-09-12T17:27:42.424201+0000","last_unstale":"2024-09-12T17:31:22.847898+0000","last_undegraded":"2024-09-12T17:31:22.847898+0000","last_fullsized":"2024-09-12T17:31:22.847898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:22.847723+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:22.847723+0000","last_clean_scrub_stamp":"2024-09-12T17:31:22.847723+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:19.505548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:14.865492+0000","last_change":"2024-09-12T17:31:14.865433+0000","last_active":"2024-09-12T17:31:14.865492+0000","last_peered":"2024-09-12T17:31:14.865492+0000","last_clean":"2024-09-12T17:31:14.865492+0000","last_became_active":"2024-09-12T17:27:40.415318+0000","last_became_peered":"2024-09-12T17:27:40.415318+0000","last_unstale":"2024-09-12T17:31:14.865492+0000","last_undegraded":"2024-09-12T17:31:14.865492+0000","last_fullsized":"2024-09-12T17:31:14.865492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:14.865333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:14.865333+0000","last_clean_scrub_stamp":"2024-09-12T17:31:14.865333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:46.192766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"31'6","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:20.343411+0000","last_change":"2024-09-12T17:31:20.343357+0000","last_active":"2024-09-12T17:31:20.343411+0000","last_peered":"2024-09-12T17:31:20.343411+0000","last_clean":"2024-09-12T17:31:20.343411+0000","last_became_active":"2024-09-12T17:27:42.434664+0000","last_became_peered":"2024-09-12T17:27:42.434664+0000","last_unstale":"2024-09-12T17:31:20.343411+0000","last_undegraded":"2024-09-12T17:31:20.343411+0000","last_fullsized":"2024-09-12T17:31:20.343411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-12T17:31:20.343275+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-12T17:31:20.343275+0000","last_clean_scrub_stamp":"2024-09-12T17:31:20.343275+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:35.315488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:09.264981+0000","last_change":"2024-09-12T17:31:09.264861+0000","last_active":"2024-09-12T17:31:09.264981+0000","last_peered":"2024-09-12T17:31:09.264981+0000","last_clean":"2024-09-12T17:31:09.264981+0000","last_became_active":"2024-09-12T17:27:40.420491+0000","last_became_peered":"2024-09-12T17:27:40.420491+0000","last_unstale":"2024-09-12T17:31:09.264981+0000","last_undegraded":"2024-09-12T17:31:09.264981+0000","last_fullsized":"2024-09-12T17:31:09.264981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:09.264760+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:09.264760+0000","last_clean_scrub_stamp":"2024-09-12T17:31:09.264760+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:08.584209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"31'10","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:20.791830+0000","last_change":"2024-09-12T17:31:20.791706+0000","last_active":"2024-09-12T17:31:20.791830+0000","last_peered":"2024-09-12T17:31:20.791830+0000","last_clean":"2024-09-12T17:31:20.791830+0000","last_became_active":"2024-09-12T17:27:42.424810+0000","last_became_peered":"2024-09-12T17:27:42.424810+0000","last_unstale":"2024-09-12T17:31:20.791830+0000","last_undegraded":"2024-09-12T17:31:20.791830+0000","last_fullsized":"2024-09-12T17:31:20.791830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-12T17:31:20.791597+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-12T17:31:20.791597+0000","last_clean_scrub_stamp":"2024-09-12T17:31:20.791597+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:27.739428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":37,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:10.132458+0000","last_change":"2024-09-12T17:31:10.132403+0000","last_active":"2024-09-12T17:31:10.132458+0000","last_peered":"2024-09-12T17:31:10.132458+0000","last_clean":"2024-09-12T17:31:10.132458+0000","last_became_active":"2024-09-12T17:27:40.431365+0000","last_became_peered":"2024-09-12T17:27:40.431365+0000","last_unstale":"2024-09-12T17:31:10.132458+0000","last_undegraded":"2024-09-12T17:31:10.132458+0000","last_fullsized":"2024-09-12T17:31:10.132458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:10.132310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:10.132310+0000","last_clean_scrub_stamp":"2024-09-12T17:31:10.132310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:29.172061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"31'13","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:18.349683+0000","last_change":"2024-09-12T17:31:18.349579+0000","last_active":"2024-09-12T17:31:18.349683+0000","last_peered":"2024-09-12T17:31:18.349683+0000","last_clean":"2024-09-12T17:31:18.349683+0000","last_became_active":"2024-09-12T17:27:42.423099+0000","last_became_peered":"2024-09-12T17:27:42.423099+0000","last_unstale":"2024-09-12T17:31:18.349683+0000","last_undegraded":"2024-09-12T17:31:18.349683+0000","last_fullsized":"2024-09-12T17:31:18.349683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'13","last_scrub_stamp":"2024-09-12T17:31:18.349454+0000","last_deep_scrub":"31'13","last_deep_scrub_stamp":"2024-09-12T17:31:18.349454+0000","last_clean_scrub_stamp":"2024-09-12T17:31:18.349454+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:26.892025+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:06.750083+0000","last_change":"2024-09-12T17:31:06.750029+0000","last_active":"2024-09-12T17:31:06.750083+0000","last_peered":"2024-09-12T17:31:06.750083+0000","last_clean":"2024-09-12T17:31:06.750083+0000","last_became_active":"2024-09-12T17:27:40.415456+0000","last_became_peered":"2024-09-12T17:27:40.415456+0000","last_unstale":"2024-09-12T17:31:06.750083+0000","last_undegraded":"2024-09-12T17:31:06.750083+0000","last_fullsized":"2024-09-12T17:31:06.750083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:06.749935+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:06.749935+0000","last_clean_scrub_stamp":"2024-09-12T17:31:06.749935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:24:59.406146+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"31'8","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:24.348206+0000","last_change":"2024-09-12T17:31:24.348206+0000","last_active":"2024-09-12T17:31:24.348206+0000","last_peered":"2024-09-12T17:31:24.348206+0000","last_clean":"2024-09-12T17:31:24.348206+0000","last_became_active":"2024-09-12T17:27:42.427778+0000","last_became_peered":"2024-09-12T17:27:42.427778+0000","last_unstale":"2024-09-12T17:31:24.348206+0000","last_undegraded":"2024-09-12T17:31:24.348206+0000","last_fullsized":"2024-09-12T17:31:24.348206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:24.348117+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:24.348117+0000","last_clean_scrub_stamp":"2024-09-12T17:31:24.348117+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:42.991869+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:23.444728+0000","last_change":"2024-09-12T17:31:23.444668+0000","last_active":"2024-09-12T17:31:23.444728+0000","last_peered":"2024-09-12T17:31:23.444728+0000","last_clean":"2024-09-12T17:31:23.444728+0000","last_became_active":"2024-09-12T17:27:40.418241+0000","last_became_peered":"2024-09-12T17:27:40.418241+0000","last_unstale":"2024-09-12T17:31:23.444728+0000","last_undegraded":"2024-09-12T17:31:23.444728+0000","last_fullsized":"2024-09-12T17:31:23.444728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:23.444583+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:23.444583+0000","last_clean_scrub_stamp":"2024-09-12T17:31:23.444583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:46:46.884073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"31'2","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:41.511321+0000","last_change":"2024-09-12T17:31:41.511321+0000","last_active":"2024-09-12T17:31:41.511321+0000","last_peered":"2024-09-12T17:31:41.511321+0000","last_clean":"2024-09-12T17:31:41.511321+0000","last_became_active":"2024-09-12T17:27:42.433084+0000","last_became_peered":"2024-09-12T17:27:42.433084+0000","last_unstale":"2024-09-12T17:31:41.511321+0000","last_undegraded":"2024-09-12T17:31:41.511321+0000","last_fullsized":"2024-09-12T17:31:41.511321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:41.511229+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:41.511229+0000","last_clean_scrub_stamp":"2024-09-12T17:31:41.511229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:43.558896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:07.773920+0000","last_change":"2024-09-12T17:31:07.773832+0000","last_active":"2024-09-12T17:31:07.773920+0000","last_peered":"2024-09-12T17:31:07.773920+0000","last_clean":"2024-09-12T17:31:07.773920+0000","last_became_active":"2024-09-12T17:27:40.417666+0000","last_became_peered":"2024-09-12T17:27:40.417666+0000","last_unstale":"2024-09-12T17:31:07.773920+0000","last_undegraded":"2024-09-12T17:31:07.773920+0000","last_fullsized":"2024-09-12T17:31:07.773920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:07.773746+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:07.773746+0000","last_clean_scrub_stamp":"2024-09-12T17:31:07.773746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:55.901197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"31'8","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:25.906785+0000","last_change":"2024-09-12T17:31:25.906704+0000","last_active":"2024-09-12T17:31:25.906785+0000","last_peered":"2024-09-12T17:31:25.906785+0000","last_clean":"2024-09-12T17:31:25.906785+0000","last_became_active":"2024-09-12T17:27:42.424017+0000","last_became_peered":"2024-09-12T17:27:42.424017+0000","last_unstale":"2024-09-12T17:31:25.906785+0000","last_undegraded":"2024-09-12T17:31:25.906785+0000","last_fullsized":"2024-09-12T17:31:25.906785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:25.906608+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:25.906608+0000","last_clean_scrub_stamp":"2024-09-12T17:31:25.906608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:34.656639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:08.294912+0000","last_change":"2024-09-12T17:31:08.294816+0000","last_active":"2024-09-12T17:31:08.294912+0000","last_peered":"2024-09-12T17:31:08.294912+0000","last_clean":"2024-09-12T17:31:08.294912+0000","last_became_active":"2024-09-12T17:27:40.418964+0000","last_became_peered":"2024-09-12T17:27:40.418964+0000","last_unstale":"2024-09-12T17:31:08.294912+0000","last_undegraded":"2024-09-12T17:31:08.294912+0000","last_fullsized":"2024-09-12T17:31:08.294912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:08.294725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:08.294725+0000","last_clean_scrub_stamp":"2024-09-12T17:31:08.294725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:15.392350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"31'6","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:23.297367+0000","last_change":"2024-09-12T17:31:23.297312+0000","last_active":"2024-09-12T17:31:23.297367+0000","last_peered":"2024-09-12T17:31:23.297367+0000","last_clean":"2024-09-12T17:31:23.297367+0000","last_became_active":"2024-09-12T17:27:42.422955+0000","last_became_peered":"2024-09-12T17:27:42.422955+0000","last_unstale":"2024-09-12T17:31:23.297367+0000","last_undegraded":"2024-09-12T17:31:23.297367+0000","last_fullsized":"2024-09-12T17:31:23.297367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-12T17:31:23.297230+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-12T17:31:23.297230+0000","last_clean_scrub_stamp":"2024-09-12T17:31:23.297230+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:30.245061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:11.276747+0000","last_change":"2024-09-12T17:31:11.276659+0000","last_active":"2024-09-12T17:31:11.276747+0000","last_peered":"2024-09-12T17:31:11.276747+0000","last_clean":"2024-09-12T17:31:11.276747+0000","last_became_active":"2024-09-12T17:27:40.418183+0000","last_became_peered":"2024-09-12T17:27:40.418183+0000","last_unstale":"2024-09-12T17:31:11.276747+0000","last_undegraded":"2024-09-12T17:31:11.276747+0000","last_fullsized":"2024-09-12T17:31:11.276747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.276556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.276556+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.276556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:59.404006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"31'6","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:22.333239+0000","last_change":"2024-09-12T17:31:22.333174+0000","last_active":"2024-09-12T17:31:22.333239+0000","last_peered":"2024-09-12T17:31:22.333239+0000","last_clean":"2024-09-12T17:31:22.333239+0000","last_became_active":"2024-09-12T17:27:42.433856+0000","last_became_peered":"2024-09-12T17:27:42.433856+0000","last_unstale":"2024-09-12T17:31:22.333239+0000","last_undegraded":"2024-09-12T17:31:22.333239+0000","last_fullsized":"2024-09-12T17:31:22.333239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-12T17:31:22.333089+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-12T17:31:22.333089+0000","last_clean_scrub_stamp":"2024-09-12T17:31:22.333089+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:11.543481+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:20.447986+0000","last_change":"2024-09-12T17:31:20.447899+0000","last_active":"2024-09-12T17:31:20.447986+0000","last_peered":"2024-09-12T17:31:20.447986+0000","last_clean":"2024-09-12T17:31:20.447986+0000","last_became_active":"2024-09-12T17:27:40.428213+0000","last_became_peered":"2024-09-12T17:27:40.428213+0000","last_unstale":"2024-09-12T17:31:20.447986+0000","last_undegraded":"2024-09-12T17:31:20.447986+0000","last_fullsized":"2024-09-12T17:31:20.447986+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:20.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:20.447796+0000","last_clean_scrub_stamp":"2024-09-12T17:31:20.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:46.194594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"31'4","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:25.320800+0000","last_change":"2024-09-12T17:31:25.320720+0000","last_active":"2024-09-12T17:31:25.320800+0000","last_peered":"2024-09-12T17:31:25.320800+0000","last_clean":"2024-09-12T17:31:25.320800+0000","last_became_active":"2024-09-12T17:27:42.431562+0000","last_became_peered":"2024-09-12T17:27:42.431562+0000","last_unstale":"2024-09-12T17:31:25.320800+0000","last_undegraded":"2024-09-12T17:31:25.320800+0000","last_fullsized":"2024-09-12T17:31:25.320800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:25.320637+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:25.320637+0000","last_clean_scrub_stamp":"2024-09-12T17:31:25.320637+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:21.978461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"31'4","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:21.435633+0000","last_change":"2024-09-12T17:31:21.435534+0000","last_active":"2024-09-12T17:31:21.435633+0000","last_peered":"2024-09-12T17:31:21.435633+0000","last_clean":"2024-09-12T17:31:21.435633+0000","last_became_active":"2024-09-12T17:27:40.425910+0000","last_became_peered":"2024-09-12T17:27:40.425910+0000","last_unstale":"2024-09-12T17:31:21.435633+0000","last_undegraded":"2024-09-12T17:31:21.435633+0000","last_fullsized":"2024-09-12T17:31:21.435633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:21.435416+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:21.435416+0000","last_clean_scrub_stamp":"2024-09-12T17:31:21.435416+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:50.263995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"31'10","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:46.497639+0000","last_change":"2024-09-12T17:31:46.497582+0000","last_active":"2024-09-12T17:31:46.497639+0000","last_peered":"2024-09-12T17:31:46.497639+0000","last_clean":"2024-09-12T17:31:46.497639+0000","last_became_active":"2024-09-12T17:27:42.429270+0000","last_became_peered":"2024-09-12T17:27:42.429270+0000","last_unstale":"2024-09-12T17:31:46.497639+0000","last_undegraded":"2024-09-12T17:31:46.497639+0000","last_fullsized":"2024-09-12T17:31:46.497639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-12T17:31:46.497497+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-12T17:31:46.497497+0000","last_clean_scrub_stamp":"2024-09-12T17:31:46.497497+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:43.001937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:11.107395+0000","last_change":"2024-09-12T17:31:11.107395+0000","last_active":"2024-09-12T17:31:11.107395+0000","last_peered":"2024-09-12T17:31:11.107395+0000","last_clean":"2024-09-12T17:31:11.107395+0000","last_became_active":"2024-09-12T17:27:40.431687+0000","last_became_peered":"2024-09-12T17:27:40.431687+0000","last_unstale":"2024-09-12T17:31:11.107395+0000","last_undegraded":"2024-09-12T17:31:11.107395+0000","last_fullsized":"2024-09-12T17:31:11.107395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:11.107302+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:11.107302+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.107302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:52.875838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"31'4","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:21.328197+0000","last_change":"2024-09-12T17:31:21.328105+0000","last_active":"2024-09-12T17:31:21.328197+0000","last_peered":"2024-09-12T17:31:21.328197+0000","last_clean":"2024-09-12T17:31:21.328197+0000","last_became_active":"2024-09-12T17:27:42.424910+0000","last_became_peered":"2024-09-12T17:27:42.424910+0000","last_unstale":"2024-09-12T17:31:21.328197+0000","last_undegraded":"2024-09-12T17:31:21.328197+0000","last_fullsized":"2024-09-12T17:31:21.328197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:21.328005+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:21.328005+0000","last_clean_scrub_stamp":"2024-09-12T17:31:21.328005+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:38.959884+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:26.570776+0000","last_change":"2024-09-12T17:31:26.570705+0000","last_active":"2024-09-12T17:31:26.570776+0000","last_peered":"2024-09-12T17:31:26.570776+0000","last_clean":"2024-09-12T17:31:26.570776+0000","last_became_active":"2024-09-12T17:27:40.433649+0000","last_became_peered":"2024-09-12T17:27:40.433649+0000","last_unstale":"2024-09-12T17:31:26.570776+0000","last_undegraded":"2024-09-12T17:31:26.570776+0000","last_fullsized":"2024-09-12T17:31:26.570776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:26.570609+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:26.570609+0000","last_clean_scrub_stamp":"2024-09-12T17:31:26.570609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:50.953136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:27.530222+0000","last_change":"2024-09-12T17:31:27.530165+0000","last_active":"2024-09-12T17:31:27.530222+0000","last_peered":"2024-09-12T17:31:27.530222+0000","last_clean":"2024-09-12T17:31:27.530222+0000","last_became_active":"2024-09-12T17:27:40.423343+0000","last_became_peered":"2024-09-12T17:27:40.423343+0000","last_unstale":"2024-09-12T17:31:27.530222+0000","last_undegraded":"2024-09-12T17:31:27.530222+0000","last_fullsized":"2024-09-12T17:31:27.530222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:27.530082+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:27.530082+0000","last_clean_scrub_stamp":"2024-09-12T17:31:27.530082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:50.850315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"31'8","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:27.881064+0000","last_change":"2024-09-12T17:31:27.881064+0000","last_active":"2024-09-12T17:31:27.881064+0000","last_peered":"2024-09-12T17:31:27.881064+0000","last_clean":"2024-09-12T17:31:27.881064+0000","last_became_active":"2024-09-12T17:27:42.426150+0000","last_became_peered":"2024-09-12T17:27:42.426150+0000","last_unstale":"2024-09-12T17:31:27.881064+0000","last_undegraded":"2024-09-12T17:31:27.881064+0000","last_fullsized":"2024-09-12T17:31:27.881064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:27.880963+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:27.880963+0000","last_clean_scrub_stamp":"2024-09-12T17:31:27.880963+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:19.026284+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:10.897255+0000","last_change":"2024-09-12T17:31:10.897255+0000","last_active":"2024-09-12T17:31:10.897255+0000","last_peered":"2024-09-12T17:31:10.897255+0000","last_clean":"2024-09-12T17:31:10.897255+0000","last_became_active":"2024-09-12T17:27:40.420396+0000","last_became_peered":"2024-09-12T17:27:40.420396+0000","last_unstale":"2024-09-12T17:31:10.897255+0000","last_undegraded":"2024-09-12T17:31:10.897255+0000","last_fullsized":"2024-09-12T17:31:10.897255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:10.897168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:10.897168+0000","last_clean_scrub_stamp":"2024-09-12T17:31:10.897168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:17.103760+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:29.307191+0000","last_change":"2024-09-12T17:31:29.307191+0000","last_active":"2024-09-12T17:31:29.307191+0000","last_peered":"2024-09-12T17:31:29.307191+0000","last_clean":"2024-09-12T17:31:29.307191+0000","last_became_active":"2024-09-12T17:27:42.435324+0000","last_became_peered":"2024-09-12T17:27:42.435324+0000","last_unstale":"2024-09-12T17:31:29.307191+0000","last_undegraded":"2024-09-12T17:31:29.307191+0000","last_fullsized":"2024-09-12T17:31:29.307191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:29.307110+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:29.307110+0000","last_clean_scrub_stamp":"2024-09-12T17:31:29.307110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:55.863554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2288,"ondisk_log_size":2288,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1557,"ondisk_log_size":1557,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":482,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1662,"num_read_kb":1552,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":481,"ondisk_log_size":481,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673023,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":446464,"data_stored":134267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705726,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":983040,"data_stored":724195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705726,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1007616,"data_stored":723592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705727,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31588,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340252,"statfs":{"total":96636764160,"available":96604418048,"internally_reserved":0,"allocated":413696,"data_stored":134210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:32:23.064 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:32:23.064 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:32:23.065 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:32:23.065 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:32:23.065 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:32:23.065 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T17:27:49.430951+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:32:23.066 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T17:32:43.067 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:32:43.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.181+0000 7f5b0863c640 1 Processor -- start 2024-09-12T17:32:43.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.181+0000 7f5b0863c640 1 -- start start 2024-09-12T17:32:43.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.182+0000 7f5b0863c640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5b00114190 0x7f5b00114570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:32:43.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.182+0000 7f5b0863c640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b001155b0 con 0x7f5b00114ab0 2024-09-12T17:32:43.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.182+0000 7f5b0863c640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f5b00116380 con 0x7f5b00114190 2024-09-12T17:32:43.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.182+0000 7f5b063d8640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5b00114190 0x7f5b00114570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:32:43.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.182+0000 7f5b05bd7640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f5b00114ab0 0x7f5b001253b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35820/0 (socket says 172.21.15.47:35820) 2024-09-12T17:32:43.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.182+0000 7f5b05bd7640 1 -- 172.21.15.47:0/261971062 learned_addr learned my addr 172.21.15.47:0/261971062 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-09-12T17:32:43.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.182+0000 7f5b063d8640 1 -- 172.21.15.47:0/261971062 >> v1:172.21.15.47:6789/0 conn(0x7f5b00114ab0 legacy=0x7f5b001253b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:32:43.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.182+0000 7f5b063d8640 1 -- 172.21.15.47:0/261971062 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b000735e0 con 0x7f5b00114190 2024-09-12T17:32:43.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.183+0000 7f5b063d8640 1 --2- 172.21.15.47:0/261971062 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b00114190 0x7f5b00114570 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f5afc009750 tx=0x7f5afc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84fd0cf6eeca785b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:32:43.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.183+0000 7f5b053d6640 1 -- 172.21.15.47:0/261971062 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5afc037070 con 0x7f5b00114190 2024-09-12T17:32:43.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.183+0000 7f5b053d6640 1 -- 172.21.15.47:0/261971062 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5afc02ae20 con 0x7f5b00114190 2024-09-12T17:32:43.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.183+0000 7f5b053d6640 1 -- 172.21.15.47:0/261971062 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5afc032590 con 0x7f5b00114190 2024-09-12T17:32:43.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.184+0000 7f5b0863c640 1 -- 172.21.15.47:0/261971062 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b00114190 msgr2=0x7f5b00114570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:32:43.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.184+0000 7f5b0863c640 1 --2- 172.21.15.47:0/261971062 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b00114190 0x7f5b00114570 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f5afc009750 tx=0x7f5afc02a1e0 comp rx=0 tx=0).stop 2024-09-12T17:32:43.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.184+0000 7f5b0863c640 1 -- 172.21.15.47:0/261971062 shutdown_connections 2024-09-12T17:32:43.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.184+0000 7f5b0863c640 1 --2- 172.21.15.47:0/261971062 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b00114190 0x7f5b00114570 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:32:43.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.184+0000 7f5b0863c640 1 -- 172.21.15.47:0/261971062 >> 172.21.15.47:0/261971062 conn(0x7f5b0006f300 msgr2=0x7f5b00071720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:32:43.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.184+0000 7f5b0863c640 1 -- 172.21.15.47:0/261971062 shutdown_connections 2024-09-12T17:32:43.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.184+0000 7f5b0863c640 1 -- 172.21.15.47:0/261971062 wait complete. 2024-09-12T17:32:43.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.185+0000 7f5b0863c640 1 Processor -- start 2024-09-12T17:32:43.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.185+0000 7f5b0863c640 1 -- start start 2024-09-12T17:32:43.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.185+0000 7f5b0863c640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b00114190 0x7f5b001c4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:32:43.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.185+0000 7f5b0863c640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5b00114ec0 con 0x7f5b00114190 2024-09-12T17:32:43.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.186+0000 7f5b063d8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b00114190 0x7f5b001c4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:32:43.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.186+0000 7f5b063d8640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b00114190 0x7f5b001c4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37594/0 (socket says 172.21.15.47:37594) 2024-09-12T17:32:43.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.186+0000 7f5b063d8640 1 -- 172.21.15.47:0/326915310 learned_addr learned my addr 172.21.15.47:0/326915310 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:32:43.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.186+0000 7f5b063d8640 1 -- 172.21.15.47:0/326915310 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b0011cab0 con 0x7f5b00114190 2024-09-12T17:32:43.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.186+0000 7f5b063d8640 1 --2- 172.21.15.47:0/326915310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b00114190 0x7f5b001c4820 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f5afc02a220 tx=0x7f5afc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:32:43.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.186+0000 7f5af2ffd640 1 -- 172.21.15.47:0/326915310 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5afc042070 con 0x7f5b00114190 2024-09-12T17:32:43.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.186+0000 7f5af2ffd640 1 -- 172.21.15.47:0/326915310 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5afc03e590 con 0x7f5b00114190 2024-09-12T17:32:43.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.186+0000 7f5b0863c640 1 -- 172.21.15.47:0/326915310 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b0011ba80 con 0x7f5b00114190 2024-09-12T17:32:43.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.186+0000 7f5af2ffd640 1 -- 172.21.15.47:0/326915310 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5afc037040 con 0x7f5b00114190 2024-09-12T17:32:43.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.186+0000 7f5b0863c640 1 -- 172.21.15.47:0/326915310 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b0011bf00 con 0x7f5b00114190 2024-09-12T17:32:43.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.187+0000 7f5af2ffd640 1 -- 172.21.15.47:0/326915310 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f5afc045070 con 0x7f5b00114190 2024-09-12T17:32:43.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.187+0000 7f5b0863c640 1 -- 172.21.15.47:0/326915310 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b00129990 con 0x7f5b00114190 2024-09-12T17:32:43.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.188+0000 7f5af2ffd640 1 --2- 172.21.15.47:0/326915310 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5ae403de70 0x7f5ae4040330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:32:43.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.188+0000 7f5af2ffd640 1 -- 172.21.15.47:0/326915310 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7f5afc073470 con 0x7f5b00114190 2024-09-12T17:32:43.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.188+0000 7f5b05bd7640 1 --2- 172.21.15.47:0/326915310 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5ae403de70 0x7f5ae4040330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:32:43.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.189+0000 7f5b05bd7640 1 --2- 172.21.15.47:0/326915310 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5ae403de70 0x7f5ae4040330 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5af4007fd0 tx=0x7f5af4007aa0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:32:43.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.192+0000 7f5af2ffd640 1 -- 172.21.15.47:0/326915310 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f5b00129990 con 0x7f5b00114190 2024-09-12T17:32:43.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.373+0000 7f5b0863c640 1 -- 172.21.15.47:0/326915310 --> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5b0011b270 con 0x7f5ae403de70 2024-09-12T17:32:43.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.383+0000 7f5af2ffd640 1 -- 172.21.15.47:0/326915310 <== mgr.4102 v2:172.21.15.170:6824/4146902489 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665922 (secure 0 0 0) 0x7f5b0011b270 con 0x7f5ae403de70 2024-09-12T17:32:43.392 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:32:43.400 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-09-12T17:32:43.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.388+0000 7f5b0863c640 1 -- 172.21.15.47:0/326915310 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5ae403de70 msgr2=0x7f5ae4040330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:32:43.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.388+0000 7f5b0863c640 1 --2- 172.21.15.47:0/326915310 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5ae403de70 0x7f5ae4040330 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5af4007fd0 tx=0x7f5af4007aa0 comp rx=0 tx=0).stop 2024-09-12T17:32:43.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.388+0000 7f5b0863c640 1 -- 172.21.15.47:0/326915310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b00114190 msgr2=0x7f5b001c4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:32:43.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.388+0000 7f5b0863c640 1 --2- 172.21.15.47:0/326915310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b00114190 0x7f5b001c4820 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f5afc02a220 tx=0x7f5afc0046c0 comp rx=0 tx=0).stop 2024-09-12T17:32:43.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.388+0000 7f5b0863c640 1 -- 172.21.15.47:0/326915310 shutdown_connections 2024-09-12T17:32:43.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.388+0000 7f5b0863c640 1 --2- 172.21.15.47:0/326915310 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7f5ae403de70 0x7f5ae4040330 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:32:43.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.388+0000 7f5b0863c640 1 --2- 172.21.15.47:0/326915310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b00114190 0x7f5b001c4820 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:32:43.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.388+0000 7f5b0863c640 1 -- 172.21.15.47:0/326915310 >> 172.21.15.47:0/326915310 conn(0x7f5b0006f300 msgr2=0x7f5b00128560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:32:43.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.388+0000 7f5b0863c640 1 -- 172.21.15.47:0/326915310 shutdown_connections 2024-09-12T17:32:43.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.388+0000 7f5b0863c640 1 -- 172.21.15.47:0/326915310 wait complete. 2024-09-12T17:32:43.403 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":187,"stamp":"2024-09-12T17:32:41.827507+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5127,"num_read_kb":4717,"num_write":2121,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":482,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3349,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4783,"ondisk_log_size":4783,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":115040,"kb_used_data":2784,"kb_used_omap":6,"kb_used_meta":112185,"kb_avail":377372320,"statfs":{"total":386547056640,"available":386429255680,"internally_reserved":0,"allocated":2850816,"data_stored":1716264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":114878230},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003780"},"pg_stats":[{"pgid":"3.3f","version":"31'2","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:15.167665+0000","last_change":"2024-09-12T17:31:15.167597+0000","last_active":"2024-09-12T17:31:15.167665+0000","last_peered":"2024-09-12T17:31:15.167665+0000","last_clean":"2024-09-12T17:31:15.167665+0000","last_became_active":"2024-09-12T17:28:21.473004+0000","last_became_peered":"2024-09-12T17:28:21.473004+0000","last_unstale":"2024-09-12T17:31:15.167665+0000","last_undegraded":"2024-09-12T17:31:15.167665+0000","last_fullsized":"2024-09-12T17:31:15.167665+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:15.167516+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:15.167516+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.167516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:41.949425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"31'2","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:30.347524+0000","last_change":"2024-09-12T17:31:30.347524+0000","last_active":"2024-09-12T17:31:30.347524+0000","last_peered":"2024-09-12T17:31:30.347524+0000","last_clean":"2024-09-12T17:31:30.347524+0000","last_became_active":"2024-09-12T17:27:42.433207+0000","last_became_peered":"2024-09-12T17:27:42.433207+0000","last_unstale":"2024-09-12T17:31:30.347524+0000","last_undegraded":"2024-09-12T17:31:30.347524+0000","last_fullsized":"2024-09-12T17:31:30.347524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:30.347428+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:30.347428+0000","last_clean_scrub_stamp":"2024-09-12T17:31:30.347428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:21.492749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:13.893011+0000","last_change":"2024-09-12T17:31:13.892956+0000","last_active":"2024-09-12T17:31:13.893011+0000","last_peered":"2024-09-12T17:31:13.893011+0000","last_clean":"2024-09-12T17:31:13.893011+0000","last_became_active":"2024-09-12T17:27:40.418928+0000","last_became_peered":"2024-09-12T17:27:40.418928+0000","last_unstale":"2024-09-12T17:31:13.893011+0000","last_undegraded":"2024-09-12T17:31:13.893011+0000","last_fullsized":"2024-09-12T17:31:13.893011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:13.892860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:13.892860+0000","last_clean_scrub_stamp":"2024-09-12T17:31:13.892860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:59.577514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"31'6","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:42.521828+0000","last_change":"2024-09-12T17:31:42.521828+0000","last_active":"2024-09-12T17:31:42.521828+0000","last_peered":"2024-09-12T17:31:42.521828+0000","last_clean":"2024-09-12T17:31:42.521828+0000","last_became_active":"2024-09-12T17:27:42.432677+0000","last_became_peered":"2024-09-12T17:27:42.432677+0000","last_unstale":"2024-09-12T17:31:42.521828+0000","last_undegraded":"2024-09-12T17:31:42.521828+0000","last_fullsized":"2024-09-12T17:31:42.521828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-12T17:31:42.521720+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-12T17:31:42.521720+0000","last_clean_scrub_stamp":"2024-09-12T17:31:42.521720+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:00.076710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:30.548231+0000","last_change":"2024-09-12T17:31:30.548169+0000","last_active":"2024-09-12T17:31:30.548231+0000","last_peered":"2024-09-12T17:31:30.548231+0000","last_clean":"2024-09-12T17:31:30.548231+0000","last_became_active":"2024-09-12T17:27:40.433470+0000","last_became_peered":"2024-09-12T17:27:40.433470+0000","last_unstale":"2024-09-12T17:31:30.548231+0000","last_undegraded":"2024-09-12T17:31:30.548231+0000","last_fullsized":"2024-09-12T17:31:30.548231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:30.548084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:30.548084+0000","last_clean_scrub_stamp":"2024-09-12T17:31:30.548084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:09.304175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"31'8","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:44.472937+0000","last_change":"2024-09-12T17:31:44.472937+0000","last_active":"2024-09-12T17:31:44.472937+0000","last_peered":"2024-09-12T17:31:44.472937+0000","last_clean":"2024-09-12T17:31:44.472937+0000","last_became_active":"2024-09-12T17:27:42.432736+0000","last_became_peered":"2024-09-12T17:27:42.432736+0000","last_unstale":"2024-09-12T17:31:44.472937+0000","last_undegraded":"2024-09-12T17:31:44.472937+0000","last_fullsized":"2024-09-12T17:31:44.472937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:44.472839+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:44.472839+0000","last_clean_scrub_stamp":"2024-09-12T17:31:44.472839+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:00.405274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"31'8","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:14.164926+0000","last_change":"2024-09-12T17:31:14.164859+0000","last_active":"2024-09-12T17:31:14.164926+0000","last_peered":"2024-09-12T17:31:14.164926+0000","last_clean":"2024-09-12T17:31:14.164926+0000","last_became_active":"2024-09-12T17:27:40.426649+0000","last_became_peered":"2024-09-12T17:27:40.426649+0000","last_unstale":"2024-09-12T17:31:14.164926+0000","last_undegraded":"2024-09-12T17:31:14.164926+0000","last_fullsized":"2024-09-12T17:31:14.164926+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:14.164764+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:14.164764+0000","last_clean_scrub_stamp":"2024-09-12T17:31:14.164764+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:53.065552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":18,"num_write":56,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"31'8","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:45.517276+0000","last_change":"2024-09-12T17:31:45.517276+0000","last_active":"2024-09-12T17:31:45.517276+0000","last_peered":"2024-09-12T17:31:45.517276+0000","last_clean":"2024-09-12T17:31:45.517276+0000","last_became_active":"2024-09-12T17:27:42.418517+0000","last_became_peered":"2024-09-12T17:27:42.418517+0000","last_unstale":"2024-09-12T17:31:45.517276+0000","last_undegraded":"2024-09-12T17:31:45.517276+0000","last_fullsized":"2024-09-12T17:31:45.517276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:45.517161+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:45.517161+0000","last_clean_scrub_stamp":"2024-09-12T17:31:45.517161+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:53.551953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:24.485867+0000","last_change":"2024-09-12T17:31:24.485763+0000","last_active":"2024-09-12T17:31:24.485867+0000","last_peered":"2024-09-12T17:31:24.485867+0000","last_clean":"2024-09-12T17:31:24.485867+0000","last_became_active":"2024-09-12T17:27:40.424978+0000","last_became_peered":"2024-09-12T17:27:40.424978+0000","last_unstale":"2024-09-12T17:31:24.485867+0000","last_undegraded":"2024-09-12T17:31:24.485867+0000","last_fullsized":"2024-09-12T17:31:24.485867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:24.485659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:24.485659+0000","last_clean_scrub_stamp":"2024-09-12T17:31:24.485659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:57.212649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"31'16","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:31.349661+0000","last_change":"2024-09-12T17:31:31.349593+0000","last_active":"2024-09-12T17:31:31.349661+0000","last_peered":"2024-09-12T17:31:31.349661+0000","last_clean":"2024-09-12T17:31:31.349661+0000","last_became_active":"2024-09-12T17:27:42.423906+0000","last_became_peered":"2024-09-12T17:27:42.423906+0000","last_unstale":"2024-09-12T17:31:31.349661+0000","last_undegraded":"2024-09-12T17:31:31.349661+0000","last_fullsized":"2024-09-12T17:31:31.349661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'16","last_scrub_stamp":"2024-09-12T17:31:31.349474+0000","last_deep_scrub":"31'16","last_deep_scrub_stamp":"2024-09-12T17:31:31.349474+0000","last_clean_scrub_stamp":"2024-09-12T17:31:31.349474+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:12.460742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:12.104894+0000","last_change":"2024-09-12T17:31:12.104894+0000","last_active":"2024-09-12T17:31:12.104894+0000","last_peered":"2024-09-12T17:31:12.104894+0000","last_clean":"2024-09-12T17:31:12.104894+0000","last_became_active":"2024-09-12T17:27:40.425308+0000","last_became_peered":"2024-09-12T17:27:40.425308+0000","last_unstale":"2024-09-12T17:31:12.104894+0000","last_undegraded":"2024-09-12T17:31:12.104894+0000","last_fullsized":"2024-09-12T17:31:12.104894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:12.104802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:12.104802+0000","last_clean_scrub_stamp":"2024-09-12T17:31:12.104802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:46.519276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"29'2","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:50.469293+0000","last_change":"2024-09-12T17:31:50.469234+0000","last_active":"2024-09-12T17:31:50.469293+0000","last_peered":"2024-09-12T17:31:50.469293+0000","last_clean":"2024-09-12T17:31:50.469293+0000","last_became_active":"2024-09-12T17:27:42.428137+0000","last_became_peered":"2024-09-12T17:27:42.428137+0000","last_unstale":"2024-09-12T17:31:50.469293+0000","last_undegraded":"2024-09-12T17:31:50.469293+0000","last_fullsized":"2024-09-12T17:31:50.469293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-12T17:31:50.469138+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-12T17:31:50.469138+0000","last_clean_scrub_stamp":"2024-09-12T17:31:50.469138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:27.400201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:25.524161+0000","last_change":"2024-09-12T17:31:25.524102+0000","last_active":"2024-09-12T17:31:25.524161+0000","last_peered":"2024-09-12T17:31:25.524161+0000","last_clean":"2024-09-12T17:31:25.524161+0000","last_became_active":"2024-09-12T17:27:40.426778+0000","last_became_peered":"2024-09-12T17:27:40.426778+0000","last_unstale":"2024-09-12T17:31:25.524161+0000","last_undegraded":"2024-09-12T17:31:25.524161+0000","last_fullsized":"2024-09-12T17:31:25.524161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:25.524021+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:25.524021+0000","last_clean_scrub_stamp":"2024-09-12T17:31:25.524021+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:28.696346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"31'18","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:28.212504+0000","last_change":"2024-09-12T17:31:28.212438+0000","last_active":"2024-09-12T17:31:28.212504+0000","last_peered":"2024-09-12T17:31:28.212504+0000","last_clean":"2024-09-12T17:31:28.212504+0000","last_became_active":"2024-09-12T17:27:42.434042+0000","last_became_peered":"2024-09-12T17:27:42.434042+0000","last_unstale":"2024-09-12T17:31:28.212504+0000","last_undegraded":"2024-09-12T17:31:28.212504+0000","last_fullsized":"2024-09-12T17:31:28.212504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'18","last_scrub_stamp":"2024-09-12T17:31:28.212358+0000","last_deep_scrub":"31'18","last_deep_scrub_stamp":"2024-09-12T17:31:28.212358+0000","last_clean_scrub_stamp":"2024-09-12T17:31:28.212358+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:13.897013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":56,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:12.847582+0000","last_change":"2024-09-12T17:31:12.847582+0000","last_active":"2024-09-12T17:31:12.847582+0000","last_peered":"2024-09-12T17:31:12.847582+0000","last_clean":"2024-09-12T17:31:12.847582+0000","last_became_active":"2024-09-12T17:27:40.418512+0000","last_became_peered":"2024-09-12T17:27:40.418512+0000","last_unstale":"2024-09-12T17:31:12.847582+0000","last_undegraded":"2024-09-12T17:31:12.847582+0000","last_fullsized":"2024-09-12T17:31:12.847582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:12.847495+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:12.847495+0000","last_clean_scrub_stamp":"2024-09-12T17:31:12.847495+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:57.086545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"31'8","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:30.206280+0000","last_change":"2024-09-12T17:31:30.206222+0000","last_active":"2024-09-12T17:31:30.206280+0000","last_peered":"2024-09-12T17:31:30.206280+0000","last_clean":"2024-09-12T17:31:30.206280+0000","last_became_active":"2024-09-12T17:27:42.436159+0000","last_became_peered":"2024-09-12T17:27:42.436159+0000","last_unstale":"2024-09-12T17:31:30.206280+0000","last_undegraded":"2024-09-12T17:31:30.206280+0000","last_fullsized":"2024-09-12T17:31:30.206280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:30.206128+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:30.206128+0000","last_clean_scrub_stamp":"2024-09-12T17:31:30.206128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:56.693996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"31'4","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:43.498481+0000","last_change":"2024-09-12T17:31:43.498350+0000","last_active":"2024-09-12T17:31:43.498481+0000","last_peered":"2024-09-12T17:31:43.498481+0000","last_clean":"2024-09-12T17:31:43.498481+0000","last_became_active":"2024-09-12T17:27:42.433425+0000","last_became_peered":"2024-09-12T17:27:42.433425+0000","last_unstale":"2024-09-12T17:31:43.498481+0000","last_undegraded":"2024-09-12T17:31:43.498481+0000","last_fullsized":"2024-09-12T17:31:43.498481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:43.498234+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:43.498234+0000","last_clean_scrub_stamp":"2024-09-12T17:31:43.498234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:55.272591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:13.316759+0000","last_change":"2024-09-12T17:31:13.316703+0000","last_active":"2024-09-12T17:31:13.316759+0000","last_peered":"2024-09-12T17:31:13.316759+0000","last_clean":"2024-09-12T17:31:13.316759+0000","last_became_active":"2024-09-12T17:27:40.415650+0000","last_became_peered":"2024-09-12T17:27:40.415650+0000","last_unstale":"2024-09-12T17:31:13.316759+0000","last_undegraded":"2024-09-12T17:31:13.316759+0000","last_fullsized":"2024-09-12T17:31:13.316759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:13.316616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:13.316616+0000","last_clean_scrub_stamp":"2024-09-12T17:31:13.316616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:05.300957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:26.339553+0000","last_change":"2024-09-12T17:31:26.339465+0000","last_active":"2024-09-12T17:31:26.339553+0000","last_peered":"2024-09-12T17:31:26.339553+0000","last_clean":"2024-09-12T17:31:26.339553+0000","last_became_active":"2024-09-12T17:27:42.427700+0000","last_became_peered":"2024-09-12T17:27:42.427700+0000","last_unstale":"2024-09-12T17:31:26.339553+0000","last_undegraded":"2024-09-12T17:31:26.339553+0000","last_fullsized":"2024-09-12T17:31:26.339553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:26.339370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:26.339370+0000","last_clean_scrub_stamp":"2024-09-12T17:31:26.339370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:03.318523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:13.154230+0000","last_change":"2024-09-12T17:31:13.154171+0000","last_active":"2024-09-12T17:31:13.154230+0000","last_peered":"2024-09-12T17:31:13.154230+0000","last_clean":"2024-09-12T17:31:13.154230+0000","last_became_active":"2024-09-12T17:27:40.432033+0000","last_became_peered":"2024-09-12T17:27:40.432033+0000","last_unstale":"2024-09-12T17:31:13.154230+0000","last_undegraded":"2024-09-12T17:31:13.154230+0000","last_fullsized":"2024-09-12T17:31:13.154230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:13.154091+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:13.154091+0000","last_clean_scrub_stamp":"2024-09-12T17:31:13.154091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:49:12.833133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"31'4","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:27.303066+0000","last_change":"2024-09-12T17:31:27.303000+0000","last_active":"2024-09-12T17:31:27.303066+0000","last_peered":"2024-09-12T17:31:27.303066+0000","last_clean":"2024-09-12T17:31:27.303066+0000","last_became_active":"2024-09-12T17:27:42.428492+0000","last_became_peered":"2024-09-12T17:27:42.428492+0000","last_unstale":"2024-09-12T17:31:27.303066+0000","last_undegraded":"2024-09-12T17:31:27.303066+0000","last_fullsized":"2024-09-12T17:31:27.303066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:27.302915+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:27.302915+0000","last_clean_scrub_stamp":"2024-09-12T17:31:27.302915+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:55.284211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"29'2","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:14.354895+0000","last_change":"2024-09-12T17:31:14.354822+0000","last_active":"2024-09-12T17:31:14.354895+0000","last_peered":"2024-09-12T17:31:14.354895+0000","last_clean":"2024-09-12T17:31:14.354895+0000","last_became_active":"2024-09-12T17:28:21.474758+0000","last_became_peered":"2024-09-12T17:28:21.474758+0000","last_unstale":"2024-09-12T17:31:14.354895+0000","last_undegraded":"2024-09-12T17:31:14.354895+0000","last_fullsized":"2024-09-12T17:31:14.354895+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-12T17:31:14.354735+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-12T17:31:14.354735+0000","last_clean_scrub_stamp":"2024-09-12T17:31:14.354735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:06.230735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"31'2","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:26.883898+0000","last_change":"2024-09-12T17:31:26.883823+0000","last_active":"2024-09-12T17:31:26.883898+0000","last_peered":"2024-09-12T17:31:26.883898+0000","last_clean":"2024-09-12T17:31:26.883898+0000","last_became_active":"2024-09-12T17:27:42.424738+0000","last_became_peered":"2024-09-12T17:27:42.424738+0000","last_unstale":"2024-09-12T17:31:26.883898+0000","last_undegraded":"2024-09-12T17:31:26.883898+0000","last_fullsized":"2024-09-12T17:31:26.883898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:26.883725+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:26.883725+0000","last_clean_scrub_stamp":"2024-09-12T17:31:26.883725+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:55.999346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:10.251857+0000","last_change":"2024-09-12T17:31:10.251786+0000","last_active":"2024-09-12T17:31:10.251857+0000","last_peered":"2024-09-12T17:31:10.251857+0000","last_clean":"2024-09-12T17:31:10.251857+0000","last_became_active":"2024-09-12T17:27:40.414669+0000","last_became_peered":"2024-09-12T17:27:40.414669+0000","last_unstale":"2024-09-12T17:31:10.251857+0000","last_undegraded":"2024-09-12T17:31:10.251857+0000","last_fullsized":"2024-09-12T17:31:10.251857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:10.251701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:10.251701+0000","last_clean_scrub_stamp":"2024-09-12T17:31:10.251701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:31.254231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"31'8","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:27.238394+0000","last_change":"2024-09-12T17:31:27.238292+0000","last_active":"2024-09-12T17:31:27.238394+0000","last_peered":"2024-09-12T17:31:27.238394+0000","last_clean":"2024-09-12T17:31:27.238394+0000","last_became_active":"2024-09-12T17:27:42.435928+0000","last_became_peered":"2024-09-12T17:27:42.435928+0000","last_unstale":"2024-09-12T17:31:27.238394+0000","last_undegraded":"2024-09-12T17:31:27.238394+0000","last_fullsized":"2024-09-12T17:31:27.238394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:27.238196+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:27.238196+0000","last_clean_scrub_stamp":"2024-09-12T17:31:27.238196+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:11.477246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:11.894908+0000","last_change":"2024-09-12T17:31:11.894841+0000","last_active":"2024-09-12T17:31:11.894908+0000","last_peered":"2024-09-12T17:31:11.894908+0000","last_clean":"2024-09-12T17:31:11.894908+0000","last_became_active":"2024-09-12T17:27:40.419936+0000","last_became_peered":"2024-09-12T17:27:40.419936+0000","last_unstale":"2024-09-12T17:31:11.894908+0000","last_undegraded":"2024-09-12T17:31:11.894908+0000","last_fullsized":"2024-09-12T17:31:11.894908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:11.894749+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:11.894749+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.894749+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:17.780383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"31'6","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:28.322728+0000","last_change":"2024-09-12T17:31:28.322665+0000","last_active":"2024-09-12T17:31:28.322728+0000","last_peered":"2024-09-12T17:31:28.322728+0000","last_clean":"2024-09-12T17:31:28.322728+0000","last_became_active":"2024-09-12T17:27:42.423569+0000","last_became_peered":"2024-09-12T17:27:42.423569+0000","last_unstale":"2024-09-12T17:31:28.322728+0000","last_undegraded":"2024-09-12T17:31:28.322728+0000","last_fullsized":"2024-09-12T17:31:28.322728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-12T17:31:28.322583+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-12T17:31:28.322583+0000","last_clean_scrub_stamp":"2024-09-12T17:31:28.322583+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:37.072614+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:22.482194+0000","last_change":"2024-09-12T17:31:22.482090+0000","last_active":"2024-09-12T17:31:22.482194+0000","last_peered":"2024-09-12T17:31:22.482194+0000","last_clean":"2024-09-12T17:31:22.482194+0000","last_became_active":"2024-09-12T17:27:40.426721+0000","last_became_peered":"2024-09-12T17:27:40.426721+0000","last_unstale":"2024-09-12T17:31:22.482194+0000","last_undegraded":"2024-09-12T17:31:22.482194+0000","last_fullsized":"2024-09-12T17:31:22.482194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:22.481974+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:22.481974+0000","last_clean_scrub_stamp":"2024-09-12T17:31:22.481974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:55.953993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"31'36","reported_seq":110,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:58.185644+0000","last_change":"2024-09-12T17:31:58.185554+0000","last_active":"2024-09-12T17:31:58.185644+0000","last_peered":"2024-09-12T17:31:58.185644+0000","last_clean":"2024-09-12T17:31:58.185644+0000","last_became_active":"2024-09-12T17:27:50.456184+0000","last_became_peered":"2024-09-12T17:27:50.456184+0000","last_unstale":"2024-09-12T17:31:58.185644+0000","last_undegraded":"2024-09-12T17:31:58.185644+0000","last_fullsized":"2024-09-12T17:31:58.185644+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2024-09-12T17:31:58.185466+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2024-09-12T17:31:58.185466+0000","last_clean_scrub_stamp":"2024-09-12T17:31:58.185466+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:51.239821+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"31'2","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:36.388070+0000","last_change":"2024-09-12T17:31:36.387973+0000","last_active":"2024-09-12T17:31:36.388070+0000","last_peered":"2024-09-12T17:31:36.388070+0000","last_clean":"2024-09-12T17:31:36.388070+0000","last_became_active":"2024-09-12T17:27:42.420666+0000","last_became_peered":"2024-09-12T17:27:42.420666+0000","last_unstale":"2024-09-12T17:31:36.388070+0000","last_undegraded":"2024-09-12T17:31:36.388070+0000","last_fullsized":"2024-09-12T17:31:36.388070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:36.387861+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:36.387861+0000","last_clean_scrub_stamp":"2024-09-12T17:31:36.387861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:45.116536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:15.386957+0000","last_change":"2024-09-12T17:31:15.386849+0000","last_active":"2024-09-12T17:31:15.386957+0000","last_peered":"2024-09-12T17:31:15.386957+0000","last_clean":"2024-09-12T17:31:15.386957+0000","last_became_active":"2024-09-12T17:27:40.433044+0000","last_became_peered":"2024-09-12T17:27:40.433044+0000","last_unstale":"2024-09-12T17:31:15.386957+0000","last_undegraded":"2024-09-12T17:31:15.386957+0000","last_fullsized":"2024-09-12T17:31:15.386957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:15.386742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:15.386742+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.386742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:15.078612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:54.490557+0000","last_change":"2024-09-12T17:31:54.490500+0000","last_active":"2024-09-12T17:31:54.490557+0000","last_peered":"2024-09-12T17:31:54.490557+0000","last_clean":"2024-09-12T17:31:54.490557+0000","last_became_active":"2024-09-12T17:28:21.472106+0000","last_became_peered":"2024-09-12T17:28:21.472106+0000","last_unstale":"2024-09-12T17:31:54.490557+0000","last_undegraded":"2024-09-12T17:31:54.490557+0000","last_fullsized":"2024-09-12T17:31:54.490557+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:54.490405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:54.490405+0000","last_clean_scrub_stamp":"2024-09-12T17:31:54.490405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:19.790112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"31'37","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:04.438630+0000","last_change":"2024-09-12T17:32:04.438568+0000","last_active":"2024-09-12T17:32:04.438630+0000","last_peered":"2024-09-12T17:32:04.438630+0000","last_clean":"2024-09-12T17:32:04.438630+0000","last_became_active":"2024-09-12T17:27:46.441891+0000","last_became_peered":"2024-09-12T17:27:46.441891+0000","last_unstale":"2024-09-12T17:32:04.438630+0000","last_undegraded":"2024-09-12T17:32:04.438630+0000","last_fullsized":"2024-09-12T17:32:04.438630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2024-09-12T17:32:04.438465+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2024-09-12T17:32:04.438465+0000","last_clean_scrub_stamp":"2024-09-12T17:32:04.438465+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:34.497334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:49.250134+0000","last_change":"2024-09-12T17:31:49.250043+0000","last_active":"2024-09-12T17:31:49.250134+0000","last_peered":"2024-09-12T17:31:49.250134+0000","last_clean":"2024-09-12T17:31:49.250134+0000","last_became_active":"2024-09-12T17:27:48.448078+0000","last_became_peered":"2024-09-12T17:27:48.448078+0000","last_unstale":"2024-09-12T17:31:49.250134+0000","last_undegraded":"2024-09-12T17:31:49.250134+0000","last_fullsized":"2024-09-12T17:31:49.250134+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:49.249951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:49.249951+0000","last_clean_scrub_stamp":"2024-09-12T17:31:49.249951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:59.102237+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"31'7","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:59.228128+0000","last_change":"2024-09-12T17:31:59.228042+0000","last_active":"2024-09-12T17:31:59.228128+0000","last_peered":"2024-09-12T17:31:59.228128+0000","last_clean":"2024-09-12T17:31:59.228128+0000","last_became_active":"2024-09-12T17:27:50.457037+0000","last_became_peered":"2024-09-12T17:27:50.457037+0000","last_unstale":"2024-09-12T17:31:59.228128+0000","last_undegraded":"2024-09-12T17:31:59.228128+0000","last_fullsized":"2024-09-12T17:31:59.228128+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'7","last_scrub_stamp":"2024-09-12T17:31:59.227925+0000","last_deep_scrub":"31'7","last_deep_scrub_stamp":"2024-09-12T17:31:59.227925+0000","last_clean_scrub_stamp":"2024-09-12T17:31:59.227925+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:58.614798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:35.433497+0000","last_change":"2024-09-12T17:31:35.433441+0000","last_active":"2024-09-12T17:31:35.433497+0000","last_peered":"2024-09-12T17:31:35.433497+0000","last_clean":"2024-09-12T17:31:35.433497+0000","last_became_active":"2024-09-12T17:27:42.427872+0000","last_became_peered":"2024-09-12T17:27:42.427872+0000","last_unstale":"2024-09-12T17:31:35.433497+0000","last_undegraded":"2024-09-12T17:31:35.433497+0000","last_fullsized":"2024-09-12T17:31:35.433497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:35.433325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:35.433325+0000","last_clean_scrub_stamp":"2024-09-12T17:31:35.433325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:14.341661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:06.079798+0000","last_change":"2024-09-12T17:31:06.079744+0000","last_active":"2024-09-12T17:31:06.079798+0000","last_peered":"2024-09-12T17:31:06.079798+0000","last_clean":"2024-09-12T17:31:06.079798+0000","last_became_active":"2024-09-12T17:27:40.430969+0000","last_became_peered":"2024-09-12T17:27:40.430969+0000","last_unstale":"2024-09-12T17:31:06.079798+0000","last_undegraded":"2024-09-12T17:31:06.079798+0000","last_fullsized":"2024-09-12T17:31:06.079798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:06.079660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:06.079660+0000","last_clean_scrub_stamp":"2024-09-12T17:31:06.079660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:37.732174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:34.891749+0000","last_change":"2024-09-12T17:31:34.891676+0000","last_active":"2024-09-12T17:31:34.891749+0000","last_peered":"2024-09-12T17:31:34.891749+0000","last_clean":"2024-09-12T17:31:34.891749+0000","last_became_active":"2024-09-12T17:27:44.427560+0000","last_became_peered":"2024-09-12T17:27:44.427560+0000","last_unstale":"2024-09-12T17:31:34.891749+0000","last_undegraded":"2024-09-12T17:31:34.891749+0000","last_fullsized":"2024-09-12T17:31:34.891749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:34.891583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:34.891583+0000","last_clean_scrub_stamp":"2024-09-12T17:31:34.891583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:39.698964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"31'9","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:44.202914+0000","last_change":"2024-09-12T17:31:44.202804+0000","last_active":"2024-09-12T17:31:44.202914+0000","last_peered":"2024-09-12T17:31:44.202914+0000","last_clean":"2024-09-12T17:31:44.202914+0000","last_became_active":"2024-09-12T17:27:46.436065+0000","last_became_peered":"2024-09-12T17:27:46.436065+0000","last_unstale":"2024-09-12T17:31:44.202914+0000","last_undegraded":"2024-09-12T17:31:44.202914+0000","last_fullsized":"2024-09-12T17:31:44.202914+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'9","last_scrub_stamp":"2024-09-12T17:31:44.202702+0000","last_deep_scrub":"31'9","last_deep_scrub_stamp":"2024-09-12T17:31:44.202702+0000","last_clean_scrub_stamp":"2024-09-12T17:31:44.202702+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:36.305048+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:50.273331+0000","last_change":"2024-09-12T17:31:50.273274+0000","last_active":"2024-09-12T17:31:50.273331+0000","last_peered":"2024-09-12T17:31:50.273331+0000","last_clean":"2024-09-12T17:31:50.273331+0000","last_became_active":"2024-09-12T17:27:48.441192+0000","last_became_peered":"2024-09-12T17:27:48.441192+0000","last_unstale":"2024-09-12T17:31:50.273331+0000","last_undegraded":"2024-09-12T17:31:50.273331+0000","last_fullsized":"2024-09-12T17:31:50.273331+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:50.273191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:50.273191+0000","last_clean_scrub_stamp":"2024-09-12T17:31:50.273191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:58.027939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"29'2","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:00.165631+0000","last_change":"2024-09-12T17:32:00.165631+0000","last_active":"2024-09-12T17:32:00.165631+0000","last_peered":"2024-09-12T17:32:00.165631+0000","last_clean":"2024-09-12T17:32:00.165631+0000","last_became_active":"2024-09-12T17:27:50.451589+0000","last_became_peered":"2024-09-12T17:27:50.451589+0000","last_unstale":"2024-09-12T17:32:00.165631+0000","last_undegraded":"2024-09-12T17:32:00.165631+0000","last_fullsized":"2024-09-12T17:32:00.165631+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-12T17:32:00.165538+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-12T17:32:00.165538+0000","last_clean_scrub_stamp":"2024-09-12T17:32:00.165538+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:55.837683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"31'8","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:39.517861+0000","last_change":"2024-09-12T17:31:39.517731+0000","last_active":"2024-09-12T17:31:39.517861+0000","last_peered":"2024-09-12T17:31:39.517861+0000","last_clean":"2024-09-12T17:31:39.517861+0000","last_became_active":"2024-09-12T17:27:42.426402+0000","last_became_peered":"2024-09-12T17:27:42.426402+0000","last_unstale":"2024-09-12T17:31:39.517861+0000","last_undegraded":"2024-09-12T17:31:39.517861+0000","last_fullsized":"2024-09-12T17:31:39.517861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:39.517638+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:39.517638+0000","last_clean_scrub_stamp":"2024-09-12T17:31:39.517638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:39.295946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:11.413094+0000","last_change":"2024-09-12T17:31:11.412979+0000","last_active":"2024-09-12T17:31:11.413094+0000","last_peered":"2024-09-12T17:31:11.413094+0000","last_clean":"2024-09-12T17:31:11.413094+0000","last_became_active":"2024-09-12T17:27:40.427860+0000","last_became_peered":"2024-09-12T17:27:40.427860+0000","last_unstale":"2024-09-12T17:31:11.413094+0000","last_undegraded":"2024-09-12T17:31:11.413094+0000","last_fullsized":"2024-09-12T17:31:11.413094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:11.412886+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:11.412886+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.412886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:55.973064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:33.930442+0000","last_change":"2024-09-12T17:31:33.930387+0000","last_active":"2024-09-12T17:31:33.930442+0000","last_peered":"2024-09-12T17:31:33.930442+0000","last_clean":"2024-09-12T17:31:33.930442+0000","last_became_active":"2024-09-12T17:27:44.430879+0000","last_became_peered":"2024-09-12T17:27:44.430879+0000","last_unstale":"2024-09-12T17:31:33.930442+0000","last_undegraded":"2024-09-12T17:31:33.930442+0000","last_fullsized":"2024-09-12T17:31:33.930442+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:33.930301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:33.930301+0000","last_clean_scrub_stamp":"2024-09-12T17:31:33.930301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:21.439880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"31'15","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:42.207489+0000","last_change":"2024-09-12T17:31:42.207431+0000","last_active":"2024-09-12T17:31:42.207489+0000","last_peered":"2024-09-12T17:31:42.207489+0000","last_clean":"2024-09-12T17:31:42.207489+0000","last_became_active":"2024-09-12T17:27:46.440203+0000","last_became_peered":"2024-09-12T17:27:46.440203+0000","last_unstale":"2024-09-12T17:31:42.207489+0000","last_undegraded":"2024-09-12T17:31:42.207489+0000","last_fullsized":"2024-09-12T17:31:42.207489+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'15","last_scrub_stamp":"2024-09-12T17:31:42.207339+0000","last_deep_scrub":"31'15","last_deep_scrub_stamp":"2024-09-12T17:31:42.207339+0000","last_clean_scrub_stamp":"2024-09-12T17:31:42.207339+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:23.318607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"31'286","reported_seq":418,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:12.439161+0000","last_change":"2024-09-12T17:32:12.439098+0000","last_active":"2024-09-12T17:32:12.439161+0000","last_peered":"2024-09-12T17:32:12.439161+0000","last_clean":"2024-09-12T17:32:12.439161+0000","last_became_active":"2024-09-12T17:27:48.450897+0000","last_became_peered":"2024-09-12T17:27:48.450897+0000","last_unstale":"2024-09-12T17:32:12.439161+0000","last_undegraded":"2024-09-12T17:32:12.439161+0000","last_fullsized":"2024-09-12T17:32:12.439161+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'286","last_scrub_stamp":"2024-09-12T17:32:12.439009+0000","last_deep_scrub":"31'286","last_deep_scrub_stamp":"2024-09-12T17:32:12.439009+0000","last_clean_scrub_stamp":"2024-09-12T17:32:12.439009+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:07.919777+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:55.276749+0000","last_change":"2024-09-12T17:31:55.276749+0000","last_active":"2024-09-12T17:31:55.276749+0000","last_peered":"2024-09-12T17:31:55.276749+0000","last_clean":"2024-09-12T17:31:55.276749+0000","last_became_active":"2024-09-12T17:27:50.456376+0000","last_became_peered":"2024-09-12T17:27:50.456376+0000","last_unstale":"2024-09-12T17:31:55.276749+0000","last_undegraded":"2024-09-12T17:31:55.276749+0000","last_fullsized":"2024-09-12T17:31:55.276749+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:55.276668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:55.276668+0000","last_clean_scrub_stamp":"2024-09-12T17:31:55.276668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:22.077233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"31'12","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:18.820853+0000","last_change":"2024-09-12T17:31:18.820795+0000","last_active":"2024-09-12T17:31:18.820853+0000","last_peered":"2024-09-12T17:31:18.820853+0000","last_clean":"2024-09-12T17:31:18.820853+0000","last_became_active":"2024-09-12T17:27:42.426060+0000","last_became_peered":"2024-09-12T17:27:42.426060+0000","last_unstale":"2024-09-12T17:31:18.820853+0000","last_undegraded":"2024-09-12T17:31:18.820853+0000","last_fullsized":"2024-09-12T17:31:18.820853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-09-12T17:31:18.820697+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-09-12T17:31:18.820697+0000","last_clean_scrub_stamp":"2024-09-12T17:31:18.820697+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:36.452576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:02.412055+0000","last_change":"2024-09-12T17:31:02.411977+0000","last_active":"2024-09-12T17:31:02.412055+0000","last_peered":"2024-09-12T17:31:02.412055+0000","last_clean":"2024-09-12T17:31:02.412055+0000","last_became_active":"2024-09-12T17:27:40.415702+0000","last_became_peered":"2024-09-12T17:27:40.415702+0000","last_unstale":"2024-09-12T17:31:02.412055+0000","last_undegraded":"2024-09-12T17:31:02.412055+0000","last_fullsized":"2024-09-12T17:31:02.412055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:02.411854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:02.411854+0000","last_clean_scrub_stamp":"2024-09-12T17:31:02.411854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:49:02.090895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:56.514616+0000","last_change":"2024-09-12T17:31:56.514565+0000","last_active":"2024-09-12T17:31:56.514616+0000","last_peered":"2024-09-12T17:31:56.514616+0000","last_clean":"2024-09-12T17:31:56.514616+0000","last_became_active":"2024-09-12T17:27:44.428526+0000","last_became_peered":"2024-09-12T17:27:44.428526+0000","last_unstale":"2024-09-12T17:31:56.514616+0000","last_undegraded":"2024-09-12T17:31:56.514616+0000","last_fullsized":"2024-09-12T17:31:56.514616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:56.514483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:56.514483+0000","last_clean_scrub_stamp":"2024-09-12T17:31:56.514483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:10.869206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"31'37","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:43.169149+0000","last_change":"2024-09-12T17:31:43.169088+0000","last_active":"2024-09-12T17:31:43.169149+0000","last_peered":"2024-09-12T17:31:43.169149+0000","last_clean":"2024-09-12T17:31:43.169149+0000","last_became_active":"2024-09-12T17:27:46.440765+0000","last_became_peered":"2024-09-12T17:27:46.440765+0000","last_unstale":"2024-09-12T17:31:43.169149+0000","last_undegraded":"2024-09-12T17:31:43.169149+0000","last_fullsized":"2024-09-12T17:31:43.169149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2024-09-12T17:31:43.168991+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2024-09-12T17:31:43.168991+0000","last_clean_scrub_stamp":"2024-09-12T17:31:43.168991+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:43.089499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"31'286","reported_seq":449,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:49.038001+0000","last_change":"2024-09-12T17:31:49.037938+0000","last_active":"2024-09-12T17:31:49.038001+0000","last_peered":"2024-09-12T17:31:49.038001+0000","last_clean":"2024-09-12T17:31:49.038001+0000","last_became_active":"2024-09-12T17:27:48.439642+0000","last_became_peered":"2024-09-12T17:27:48.439642+0000","last_unstale":"2024-09-12T17:31:49.038001+0000","last_undegraded":"2024-09-12T17:31:49.038001+0000","last_fullsized":"2024-09-12T17:31:49.038001+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'286","last_scrub_stamp":"2024-09-12T17:31:49.037839+0000","last_deep_scrub":"31'286","last_deep_scrub_stamp":"2024-09-12T17:31:49.037839+0000","last_clean_scrub_stamp":"2024-09-12T17:31:49.037839+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:34:11.064004+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"31'12","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:32.537003+0000","last_change":"2024-09-12T17:31:32.536913+0000","last_active":"2024-09-12T17:31:32.537003+0000","last_peered":"2024-09-12T17:31:32.537003+0000","last_clean":"2024-09-12T17:31:32.537003+0000","last_became_active":"2024-09-12T17:27:42.427990+0000","last_became_peered":"2024-09-12T17:27:42.427990+0000","last_unstale":"2024-09-12T17:31:32.537003+0000","last_undegraded":"2024-09-12T17:31:32.537003+0000","last_fullsized":"2024-09-12T17:31:32.537003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-09-12T17:31:32.536801+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-09-12T17:31:32.536801+0000","last_clean_scrub_stamp":"2024-09-12T17:31:32.536801+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:58.780921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"29'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:05.090948+0000","last_change":"2024-09-12T17:31:05.090851+0000","last_active":"2024-09-12T17:31:05.090948+0000","last_peered":"2024-09-12T17:31:05.090948+0000","last_clean":"2024-09-12T17:31:05.090948+0000","last_became_active":"2024-09-12T17:27:40.428462+0000","last_became_peered":"2024-09-12T17:27:40.428462+0000","last_unstale":"2024-09-12T17:31:05.090948+0000","last_undegraded":"2024-09-12T17:31:05.090948+0000","last_fullsized":"2024-09-12T17:31:05.090948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-12T17:31:05.090744+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-12T17:31:05.090744+0000","last_clean_scrub_stamp":"2024-09-12T17:31:05.090744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:12.385812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:32.302841+0000","last_change":"2024-09-12T17:31:32.302755+0000","last_active":"2024-09-12T17:31:32.302841+0000","last_peered":"2024-09-12T17:31:32.302841+0000","last_clean":"2024-09-12T17:31:32.302841+0000","last_became_active":"2024-09-12T17:27:44.431911+0000","last_became_peered":"2024-09-12T17:27:44.431911+0000","last_unstale":"2024-09-12T17:31:32.302841+0000","last_undegraded":"2024-09-12T17:31:32.302841+0000","last_fullsized":"2024-09-12T17:31:32.302841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:32.302660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:32.302660+0000","last_clean_scrub_stamp":"2024-09-12T17:31:32.302660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:32.223168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"31'53","reported_seq":114,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:39.122583+0000","last_change":"2024-09-12T17:31:39.122513+0000","last_active":"2024-09-12T17:31:39.122583+0000","last_peered":"2024-09-12T17:31:39.122583+0000","last_clean":"2024-09-12T17:31:39.122583+0000","last_became_active":"2024-09-12T17:27:46.439188+0000","last_became_peered":"2024-09-12T17:27:46.439188+0000","last_unstale":"2024-09-12T17:31:39.122583+0000","last_undegraded":"2024-09-12T17:31:39.122583+0000","last_fullsized":"2024-09-12T17:31:39.122583+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'53","last_scrub_stamp":"2024-09-12T17:31:39.122418+0000","last_deep_scrub":"31'53","last_deep_scrub_stamp":"2024-09-12T17:31:39.122418+0000","last_clean_scrub_stamp":"2024-09-12T17:31:39.122418+0000","objects_scrubbed":9,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:47.872448+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:58.152595+0000","last_change":"2024-09-12T17:31:58.152535+0000","last_active":"2024-09-12T17:31:58.152595+0000","last_peered":"2024-09-12T17:31:58.152595+0000","last_clean":"2024-09-12T17:31:58.152595+0000","last_became_active":"2024-09-12T17:27:48.441618+0000","last_became_peered":"2024-09-12T17:27:48.441618+0000","last_unstale":"2024-09-12T17:31:58.152595+0000","last_undegraded":"2024-09-12T17:31:58.152595+0000","last_fullsized":"2024-09-12T17:31:58.152595+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:58.152443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:58.152443+0000","last_clean_scrub_stamp":"2024-09-12T17:31:58.152443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:10.503764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"31'7","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:53.281735+0000","last_change":"2024-09-12T17:31:53.281651+0000","last_active":"2024-09-12T17:31:53.281735+0000","last_peered":"2024-09-12T17:31:53.281735+0000","last_clean":"2024-09-12T17:31:53.281735+0000","last_became_active":"2024-09-12T17:27:50.457350+0000","last_became_peered":"2024-09-12T17:27:50.457350+0000","last_unstale":"2024-09-12T17:31:53.281735+0000","last_undegraded":"2024-09-12T17:31:53.281735+0000","last_fullsized":"2024-09-12T17:31:53.281735+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'7","last_scrub_stamp":"2024-09-12T17:31:53.281555+0000","last_deep_scrub":"31'7","last_deep_scrub_stamp":"2024-09-12T17:31:53.281555+0000","last_clean_scrub_stamp":"2024-09-12T17:31:53.281555+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:15.825245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"31'20","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:15.344065+0000","last_change":"2024-09-12T17:31:15.343990+0000","last_active":"2024-09-12T17:31:15.344065+0000","last_peered":"2024-09-12T17:31:15.344065+0000","last_clean":"2024-09-12T17:31:15.344065+0000","last_became_active":"2024-09-12T17:27:42.424268+0000","last_became_peered":"2024-09-12T17:27:42.424268+0000","last_unstale":"2024-09-12T17:31:15.344065+0000","last_undegraded":"2024-09-12T17:31:15.344065+0000","last_fullsized":"2024-09-12T17:31:15.344065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'20","last_scrub_stamp":"2024-09-12T17:31:15.343895+0000","last_deep_scrub":"31'20","last_deep_scrub_stamp":"2024-09-12T17:31:15.343895+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.343895+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:21.229528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":75,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:02.018765+0000","last_change":"2024-09-12T17:31:02.018708+0000","last_active":"2024-09-12T17:31:02.018765+0000","last_peered":"2024-09-12T17:31:02.018765+0000","last_clean":"2024-09-12T17:31:02.018765+0000","last_became_active":"2024-09-12T17:27:40.427677+0000","last_became_peered":"2024-09-12T17:27:40.427677+0000","last_unstale":"2024-09-12T17:31:02.018765+0000","last_undegraded":"2024-09-12T17:31:02.018765+0000","last_fullsized":"2024-09-12T17:31:02.018765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:02.018612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:02.018612+0000","last_clean_scrub_stamp":"2024-09-12T17:31:02.018612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:03.467671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:29.829930+0000","last_change":"2024-09-12T17:31:29.829824+0000","last_active":"2024-09-12T17:31:29.829930+0000","last_peered":"2024-09-12T17:31:29.829930+0000","last_clean":"2024-09-12T17:31:29.829930+0000","last_became_active":"2024-09-12T17:27:44.434433+0000","last_became_peered":"2024-09-12T17:27:44.434433+0000","last_unstale":"2024-09-12T17:31:29.829930+0000","last_undegraded":"2024-09-12T17:31:29.829930+0000","last_fullsized":"2024-09-12T17:31:29.829930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:29.829730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:29.829730+0000","last_clean_scrub_stamp":"2024-09-12T17:31:29.829730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:14.124471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"31'37","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:05.445701+0000","last_change":"2024-09-12T17:32:05.445644+0000","last_active":"2024-09-12T17:32:05.445701+0000","last_peered":"2024-09-12T17:32:05.445701+0000","last_clean":"2024-09-12T17:32:05.445701+0000","last_became_active":"2024-09-12T17:27:46.442572+0000","last_became_peered":"2024-09-12T17:27:46.442572+0000","last_unstale":"2024-09-12T17:32:05.445701+0000","last_undegraded":"2024-09-12T17:32:05.445701+0000","last_fullsized":"2024-09-12T17:32:05.445701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2024-09-12T17:32:05.445541+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2024-09-12T17:32:05.445541+0000","last_clean_scrub_stamp":"2024-09-12T17:32:05.445541+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:01.051919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:48.064362+0000","last_change":"2024-09-12T17:31:48.064289+0000","last_active":"2024-09-12T17:31:48.064362+0000","last_peered":"2024-09-12T17:31:48.064362+0000","last_clean":"2024-09-12T17:31:48.064362+0000","last_became_active":"2024-09-12T17:27:48.445502+0000","last_became_peered":"2024-09-12T17:27:48.445502+0000","last_unstale":"2024-09-12T17:31:48.064362+0000","last_undegraded":"2024-09-12T17:31:48.064362+0000","last_fullsized":"2024-09-12T17:31:48.064362+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:48.064186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:48.064186+0000","last_clean_scrub_stamp":"2024-09-12T17:31:48.064186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:55.818934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"31'11","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:53.304691+0000","last_change":"2024-09-12T17:31:53.304576+0000","last_active":"2024-09-12T17:31:53.304691+0000","last_peered":"2024-09-12T17:31:53.304691+0000","last_clean":"2024-09-12T17:31:53.304691+0000","last_became_active":"2024-09-12T17:27:50.457691+0000","last_became_peered":"2024-09-12T17:27:50.457691+0000","last_unstale":"2024-09-12T17:31:53.304691+0000","last_undegraded":"2024-09-12T17:31:53.304691+0000","last_fullsized":"2024-09-12T17:31:53.304691+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'11","last_scrub_stamp":"2024-09-12T17:31:53.304462+0000","last_deep_scrub":"31'11","last_deep_scrub_stamp":"2024-09-12T17:31:53.304462+0000","last_clean_scrub_stamp":"2024-09-12T17:31:53.304462+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:54.162201+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":23,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"31'7","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:19.207503+0000","last_change":"2024-09-12T17:31:19.207381+0000","last_active":"2024-09-12T17:31:19.207503+0000","last_peered":"2024-09-12T17:31:19.207503+0000","last_clean":"2024-09-12T17:31:19.207503+0000","last_became_active":"2024-09-12T17:27:42.436517+0000","last_became_peered":"2024-09-12T17:27:42.436517+0000","last_unstale":"2024-09-12T17:31:19.207503+0000","last_undegraded":"2024-09-12T17:31:19.207503+0000","last_fullsized":"2024-09-12T17:31:19.207503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'7","last_scrub_stamp":"2024-09-12T17:31:19.207291+0000","last_deep_scrub":"31'7","last_deep_scrub_stamp":"2024-09-12T17:31:19.207291+0000","last_clean_scrub_stamp":"2024-09-12T17:31:19.207291+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:26.304916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:10.389582+0000","last_change":"2024-09-12T17:31:10.389482+0000","last_active":"2024-09-12T17:31:10.389582+0000","last_peered":"2024-09-12T17:31:10.389582+0000","last_clean":"2024-09-12T17:31:10.389582+0000","last_became_active":"2024-09-12T17:27:40.429663+0000","last_became_peered":"2024-09-12T17:27:40.429663+0000","last_unstale":"2024-09-12T17:31:10.389582+0000","last_undegraded":"2024-09-12T17:31:10.389582+0000","last_fullsized":"2024-09-12T17:31:10.389582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:10.389388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:10.389388+0000","last_clean_scrub_stamp":"2024-09-12T17:31:10.389388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:20.668432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:36.870732+0000","last_change":"2024-09-12T17:31:36.870675+0000","last_active":"2024-09-12T17:31:36.870732+0000","last_peered":"2024-09-12T17:31:36.870732+0000","last_clean":"2024-09-12T17:31:36.870732+0000","last_became_active":"2024-09-12T17:27:44.430772+0000","last_became_peered":"2024-09-12T17:27:44.430772+0000","last_unstale":"2024-09-12T17:31:36.870732+0000","last_undegraded":"2024-09-12T17:31:36.870732+0000","last_fullsized":"2024-09-12T17:31:36.870732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:36.870579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:36.870579+0000","last_clean_scrub_stamp":"2024-09-12T17:31:36.870579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:47.799822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"31'47","reported_seq":106,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:01.568840+0000","last_change":"2024-09-12T17:32:01.568771+0000","last_active":"2024-09-12T17:32:01.568840+0000","last_peered":"2024-09-12T17:32:01.568840+0000","last_clean":"2024-09-12T17:32:01.568840+0000","last_became_active":"2024-09-12T17:27:46.444206+0000","last_became_peered":"2024-09-12T17:27:46.444206+0000","last_unstale":"2024-09-12T17:32:01.568840+0000","last_undegraded":"2024-09-12T17:32:01.568840+0000","last_fullsized":"2024-09-12T17:32:01.568840+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'47","last_scrub_stamp":"2024-09-12T17:32:01.568683+0000","last_deep_scrub":"31'47","last_deep_scrub_stamp":"2024-09-12T17:32:01.568683+0000","last_clean_scrub_stamp":"2024-09-12T17:32:01.568683+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:38.716991+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"31'286","reported_seq":411,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:45.012810+0000","last_change":"2024-09-12T17:31:45.012737+0000","last_active":"2024-09-12T17:31:45.012810+0000","last_peered":"2024-09-12T17:31:45.012810+0000","last_clean":"2024-09-12T17:31:45.012810+0000","last_became_active":"2024-09-12T17:27:48.447724+0000","last_became_peered":"2024-09-12T17:27:48.447724+0000","last_unstale":"2024-09-12T17:31:45.012810+0000","last_undegraded":"2024-09-12T17:31:45.012810+0000","last_fullsized":"2024-09-12T17:31:45.012810+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'286","last_scrub_stamp":"2024-09-12T17:31:45.012653+0000","last_deep_scrub":"31'286","last_deep_scrub_stamp":"2024-09-12T17:31:45.012653+0000","last_clean_scrub_stamp":"2024-09-12T17:31:45.012653+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:11.878520+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"31'4","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:55.160230+0000","last_change":"2024-09-12T17:31:55.160166+0000","last_active":"2024-09-12T17:31:55.160230+0000","last_peered":"2024-09-12T17:31:55.160230+0000","last_clean":"2024-09-12T17:31:55.160230+0000","last_became_active":"2024-09-12T17:27:50.451716+0000","last_became_peered":"2024-09-12T17:27:50.451716+0000","last_unstale":"2024-09-12T17:31:55.160230+0000","last_undegraded":"2024-09-12T17:31:55.160230+0000","last_fullsized":"2024-09-12T17:31:55.160230+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:55.160079+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:55.160079+0000","last_clean_scrub_stamp":"2024-09-12T17:31:55.160079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:53:48.158349+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"31'4","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:18.197232+0000","last_change":"2024-09-12T17:31:18.197113+0000","last_active":"2024-09-12T17:31:18.197232+0000","last_peered":"2024-09-12T17:31:18.197232+0000","last_clean":"2024-09-12T17:31:18.197232+0000","last_became_active":"2024-09-12T17:27:42.429624+0000","last_became_peered":"2024-09-12T17:27:42.429624+0000","last_unstale":"2024-09-12T17:31:18.197232+0000","last_undegraded":"2024-09-12T17:31:18.197232+0000","last_fullsized":"2024-09-12T17:31:18.197232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:18.197003+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:18.197003+0000","last_clean_scrub_stamp":"2024-09-12T17:31:18.197003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:31:53.642094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:12.393323+0000","last_change":"2024-09-12T17:31:12.393232+0000","last_active":"2024-09-12T17:31:12.393323+0000","last_peered":"2024-09-12T17:31:12.393323+0000","last_clean":"2024-09-12T17:31:12.393323+0000","last_became_active":"2024-09-12T17:27:40.423291+0000","last_became_peered":"2024-09-12T17:27:40.423291+0000","last_unstale":"2024-09-12T17:31:12.393323+0000","last_undegraded":"2024-09-12T17:31:12.393323+0000","last_fullsized":"2024-09-12T17:31:12.393323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:12.393115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:12.393115+0000","last_clean_scrub_stamp":"2024-09-12T17:31:12.393115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:06.951305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:28.877953+0000","last_change":"2024-09-12T17:31:28.877883+0000","last_active":"2024-09-12T17:31:28.877953+0000","last_peered":"2024-09-12T17:31:28.877953+0000","last_clean":"2024-09-12T17:31:28.877953+0000","last_became_active":"2024-09-12T17:27:44.430549+0000","last_became_peered":"2024-09-12T17:27:44.430549+0000","last_unstale":"2024-09-12T17:31:28.877953+0000","last_undegraded":"2024-09-12T17:31:28.877953+0000","last_fullsized":"2024-09-12T17:31:28.877953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:28.877789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:28.877789+0000","last_clean_scrub_stamp":"2024-09-12T17:31:28.877789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:38.715807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"31'67","reported_seq":141,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:00.538782+0000","last_change":"2024-09-12T17:32:00.538682+0000","last_active":"2024-09-12T17:32:00.538782+0000","last_peered":"2024-09-12T17:32:00.538782+0000","last_clean":"2024-09-12T17:32:00.538782+0000","last_became_active":"2024-09-12T17:27:46.440805+0000","last_became_peered":"2024-09-12T17:27:46.440805+0000","last_unstale":"2024-09-12T17:32:00.538782+0000","last_undegraded":"2024-09-12T17:32:00.538782+0000","last_fullsized":"2024-09-12T17:32:00.538782+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'67","last_scrub_stamp":"2024-09-12T17:32:00.538575+0000","last_deep_scrub":"31'67","last_deep_scrub_stamp":"2024-09-12T17:32:00.538575+0000","last_clean_scrub_stamp":"2024-09-12T17:32:00.538575+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:05.569873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":65,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:52.146807+0000","last_change":"2024-09-12T17:31:52.146732+0000","last_active":"2024-09-12T17:31:52.146807+0000","last_peered":"2024-09-12T17:31:52.146807+0000","last_clean":"2024-09-12T17:31:52.146807+0000","last_became_active":"2024-09-12T17:27:48.442880+0000","last_became_peered":"2024-09-12T17:27:48.442880+0000","last_unstale":"2024-09-12T17:31:52.146807+0000","last_undegraded":"2024-09-12T17:31:52.146807+0000","last_fullsized":"2024-09-12T17:31:52.146807+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:52.146643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:52.146643+0000","last_clean_scrub_stamp":"2024-09-12T17:31:52.146643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:38.895711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"31'23","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:56.120907+0000","last_change":"2024-09-12T17:31:56.120828+0000","last_active":"2024-09-12T17:31:56.120907+0000","last_peered":"2024-09-12T17:31:56.120907+0000","last_clean":"2024-09-12T17:31:56.120907+0000","last_became_active":"2024-09-12T17:27:50.454410+0000","last_became_peered":"2024-09-12T17:27:50.454410+0000","last_unstale":"2024-09-12T17:31:56.120907+0000","last_undegraded":"2024-09-12T17:31:56.120907+0000","last_fullsized":"2024-09-12T17:31:56.120907+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'23","last_scrub_stamp":"2024-09-12T17:31:56.120744+0000","last_deep_scrub":"31'23","last_deep_scrub_stamp":"2024-09-12T17:31:56.120744+0000","last_clean_scrub_stamp":"2024-09-12T17:31:56.120744+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:49.175099+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"31'10","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:16.298048+0000","last_change":"2024-09-12T17:31:16.297952+0000","last_active":"2024-09-12T17:31:16.298048+0000","last_peered":"2024-09-12T17:31:16.298048+0000","last_clean":"2024-09-12T17:31:16.298048+0000","last_became_active":"2024-09-12T17:27:42.435913+0000","last_became_peered":"2024-09-12T17:27:42.435913+0000","last_unstale":"2024-09-12T17:31:16.298048+0000","last_undegraded":"2024-09-12T17:31:16.298048+0000","last_fullsized":"2024-09-12T17:31:16.298048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-12T17:31:16.297850+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-12T17:31:16.297850+0000","last_clean_scrub_stamp":"2024-09-12T17:31:16.297850+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:00.536900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:09.860566+0000","last_change":"2024-09-12T17:31:09.860489+0000","last_active":"2024-09-12T17:31:09.860566+0000","last_peered":"2024-09-12T17:31:09.860566+0000","last_clean":"2024-09-12T17:31:09.860566+0000","last_became_active":"2024-09-12T17:27:40.415703+0000","last_became_peered":"2024-09-12T17:27:40.415703+0000","last_unstale":"2024-09-12T17:31:09.860566+0000","last_undegraded":"2024-09-12T17:31:09.860566+0000","last_fullsized":"2024-09-12T17:31:09.860566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:09.860396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:09.860396+0000","last_clean_scrub_stamp":"2024-09-12T17:31:09.860396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:27.321941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:31.156403+0000","last_change":"2024-09-12T17:31:31.156349+0000","last_active":"2024-09-12T17:31:31.156403+0000","last_peered":"2024-09-12T17:31:31.156403+0000","last_clean":"2024-09-12T17:31:31.156403+0000","last_became_active":"2024-09-12T17:27:44.432588+0000","last_became_peered":"2024-09-12T17:27:44.432588+0000","last_unstale":"2024-09-12T17:31:31.156403+0000","last_undegraded":"2024-09-12T17:31:31.156403+0000","last_fullsized":"2024-09-12T17:31:31.156403+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:31.156264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:31.156264+0000","last_clean_scrub_stamp":"2024-09-12T17:31:31.156264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:46.128476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"31'40","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:43.253116+0000","last_change":"2024-09-12T17:31:43.253053+0000","last_active":"2024-09-12T17:31:43.253116+0000","last_peered":"2024-09-12T17:31:43.253116+0000","last_clean":"2024-09-12T17:31:43.253116+0000","last_became_active":"2024-09-12T17:27:46.432354+0000","last_became_peered":"2024-09-12T17:27:46.432354+0000","last_unstale":"2024-09-12T17:31:43.253116+0000","last_undegraded":"2024-09-12T17:31:43.253116+0000","last_fullsized":"2024-09-12T17:31:43.253116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'40","last_scrub_stamp":"2024-09-12T17:31:43.252950+0000","last_deep_scrub":"31'40","last_deep_scrub_stamp":"2024-09-12T17:31:43.252950+0000","last_clean_scrub_stamp":"2024-09-12T17:31:43.252950+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:37.973626+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:15.384782+0000","last_change":"2024-09-12T17:32:15.384721+0000","last_active":"2024-09-12T17:32:15.384782+0000","last_peered":"2024-09-12T17:32:15.384782+0000","last_clean":"2024-09-12T17:32:15.384782+0000","last_became_active":"2024-09-12T17:27:48.451510+0000","last_became_peered":"2024-09-12T17:27:48.451510+0000","last_unstale":"2024-09-12T17:32:15.384782+0000","last_undegraded":"2024-09-12T17:32:15.384782+0000","last_fullsized":"2024-09-12T17:32:15.384782+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:32:15.384619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:32:15.384619+0000","last_clean_scrub_stamp":"2024-09-12T17:32:15.384619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:42.682447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"31'8","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:17.364521+0000","last_change":"2024-09-12T17:32:17.364521+0000","last_active":"2024-09-12T17:32:17.364521+0000","last_peered":"2024-09-12T17:32:17.364521+0000","last_clean":"2024-09-12T17:32:17.364521+0000","last_became_active":"2024-09-12T17:27:50.454890+0000","last_became_peered":"2024-09-12T17:27:50.454890+0000","last_unstale":"2024-09-12T17:32:17.364521+0000","last_undegraded":"2024-09-12T17:32:17.364521+0000","last_fullsized":"2024-09-12T17:32:17.364521+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:32:17.364431+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:32:17.364431+0000","last_clean_scrub_stamp":"2024-09-12T17:32:17.364431+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:02.947715+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"31'8","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:33.513235+0000","last_change":"2024-09-12T17:31:33.513178+0000","last_active":"2024-09-12T17:31:33.513235+0000","last_peered":"2024-09-12T17:31:33.513235+0000","last_clean":"2024-09-12T17:31:33.513235+0000","last_became_active":"2024-09-12T17:27:42.440204+0000","last_became_peered":"2024-09-12T17:27:42.440204+0000","last_unstale":"2024-09-12T17:31:33.513235+0000","last_undegraded":"2024-09-12T17:31:33.513235+0000","last_fullsized":"2024-09-12T17:31:33.513235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:33.513094+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:33.513094+0000","last_clean_scrub_stamp":"2024-09-12T17:31:33.513094+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:57.471769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:09.348952+0000","last_change":"2024-09-12T17:31:09.348825+0000","last_active":"2024-09-12T17:31:09.348952+0000","last_peered":"2024-09-12T17:31:09.348952+0000","last_clean":"2024-09-12T17:31:09.348952+0000","last_became_active":"2024-09-12T17:27:40.428232+0000","last_became_peered":"2024-09-12T17:27:40.428232+0000","last_unstale":"2024-09-12T17:31:09.348952+0000","last_undegraded":"2024-09-12T17:31:09.348952+0000","last_fullsized":"2024-09-12T17:31:09.348952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:09.348730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:09.348730+0000","last_clean_scrub_stamp":"2024-09-12T17:31:09.348730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:20.262551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:31.879077+0000","last_change":"2024-09-12T17:31:31.879020+0000","last_active":"2024-09-12T17:31:31.879077+0000","last_peered":"2024-09-12T17:31:31.879077+0000","last_clean":"2024-09-12T17:31:31.879077+0000","last_became_active":"2024-09-12T17:27:44.432211+0000","last_became_peered":"2024-09-12T17:27:44.432211+0000","last_unstale":"2024-09-12T17:31:31.879077+0000","last_undegraded":"2024-09-12T17:31:31.879077+0000","last_fullsized":"2024-09-12T17:31:31.879077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:31.878931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:31.878931+0000","last_clean_scrub_stamp":"2024-09-12T17:31:31.878931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:53:23.177009+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"31'46","reported_seq":105,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:40.157870+0000","last_change":"2024-09-12T17:31:40.157807+0000","last_active":"2024-09-12T17:31:40.157870+0000","last_peered":"2024-09-12T17:31:40.157870+0000","last_clean":"2024-09-12T17:31:40.157870+0000","last_became_active":"2024-09-12T17:27:46.433672+0000","last_became_peered":"2024-09-12T17:27:46.433672+0000","last_unstale":"2024-09-12T17:31:40.157870+0000","last_undegraded":"2024-09-12T17:31:40.157870+0000","last_fullsized":"2024-09-12T17:31:40.157870+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2024-09-12T17:31:40.157697+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2024-09-12T17:31:40.157697+0000","last_clean_scrub_stamp":"2024-09-12T17:31:40.157697+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:06.714141+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"31'286","reported_seq":417,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:46.213021+0000","last_change":"2024-09-12T17:31:46.212968+0000","last_active":"2024-09-12T17:31:46.213021+0000","last_peered":"2024-09-12T17:31:46.213021+0000","last_clean":"2024-09-12T17:31:46.213021+0000","last_became_active":"2024-09-12T17:27:48.440335+0000","last_became_peered":"2024-09-12T17:27:48.440335+0000","last_unstale":"2024-09-12T17:31:46.213021+0000","last_undegraded":"2024-09-12T17:31:46.213021+0000","last_fullsized":"2024-09-12T17:31:46.213021+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'286","last_scrub_stamp":"2024-09-12T17:31:46.212875+0000","last_deep_scrub":"31'286","last_deep_scrub_stamp":"2024-09-12T17:31:46.212875+0000","last_clean_scrub_stamp":"2024-09-12T17:31:46.212875+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:55.088066+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"31'13","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:53.165093+0000","last_change":"2024-09-12T17:31:53.165033+0000","last_active":"2024-09-12T17:31:53.165093+0000","last_peered":"2024-09-12T17:31:53.165093+0000","last_clean":"2024-09-12T17:31:53.165093+0000","last_became_active":"2024-09-12T17:27:50.448680+0000","last_became_peered":"2024-09-12T17:27:50.448680+0000","last_unstale":"2024-09-12T17:31:53.165093+0000","last_undegraded":"2024-09-12T17:31:53.165093+0000","last_fullsized":"2024-09-12T17:31:53.165093+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'13","last_scrub_stamp":"2024-09-12T17:31:53.164949+0000","last_deep_scrub":"31'13","last_deep_scrub_stamp":"2024-09-12T17:31:53.164949+0000","last_clean_scrub_stamp":"2024-09-12T17:31:53.164949+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:13.457431+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:20.187967+0000","last_change":"2024-09-12T17:31:20.187884+0000","last_active":"2024-09-12T17:31:20.187967+0000","last_peered":"2024-09-12T17:31:20.187967+0000","last_clean":"2024-09-12T17:31:20.187967+0000","last_became_active":"2024-09-12T17:28:21.472744+0000","last_became_peered":"2024-09-12T17:28:21.472744+0000","last_unstale":"2024-09-12T17:31:20.187967+0000","last_undegraded":"2024-09-12T17:31:20.187967+0000","last_fullsized":"2024-09-12T17:31:20.187967+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:20.187750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:20.187750+0000","last_clean_scrub_stamp":"2024-09-12T17:31:20.187750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:19.507199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:08.306145+0000","last_change":"2024-09-12T17:31:08.306087+0000","last_active":"2024-09-12T17:31:08.306145+0000","last_peered":"2024-09-12T17:31:08.306145+0000","last_clean":"2024-09-12T17:31:08.306145+0000","last_became_active":"2024-09-12T17:27:40.428512+0000","last_became_peered":"2024-09-12T17:27:40.428512+0000","last_unstale":"2024-09-12T17:31:08.306145+0000","last_undegraded":"2024-09-12T17:31:08.306145+0000","last_fullsized":"2024-09-12T17:31:08.306145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:08.306000+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:08.306000+0000","last_clean_scrub_stamp":"2024-09-12T17:31:08.306000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:33.492014+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'5","reported_seq":429,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:34.315232+0000","last_change":"2024-09-12T17:31:34.315174+0000","last_active":"2024-09-12T17:31:34.315232+0000","last_peered":"2024-09-12T17:31:34.315232+0000","last_clean":"2024-09-12T17:31:34.315232+0000","last_became_active":"2024-09-12T17:27:44.429844+0000","last_became_peered":"2024-09-12T17:27:44.429844+0000","last_unstale":"2024-09-12T17:31:34.315232+0000","last_undegraded":"2024-09-12T17:31:34.315232+0000","last_fullsized":"2024-09-12T17:31:34.315232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-09-12T17:31:34.315074+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-09-12T17:31:34.315074+0000","last_clean_scrub_stamp":"2024-09-12T17:31:34.315074+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:53:25.613152+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"31'15","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:02.519816+0000","last_change":"2024-09-12T17:32:02.519757+0000","last_active":"2024-09-12T17:32:02.519816+0000","last_peered":"2024-09-12T17:32:02.519816+0000","last_clean":"2024-09-12T17:32:02.519816+0000","last_became_active":"2024-09-12T17:27:46.439153+0000","last_became_peered":"2024-09-12T17:27:46.439153+0000","last_unstale":"2024-09-12T17:32:02.519816+0000","last_undegraded":"2024-09-12T17:32:02.519816+0000","last_fullsized":"2024-09-12T17:32:02.519816+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'15","last_scrub_stamp":"2024-09-12T17:32:02.519664+0000","last_deep_scrub":"31'15","last_deep_scrub_stamp":"2024-09-12T17:32:02.519664+0000","last_clean_scrub_stamp":"2024-09-12T17:32:02.519664+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:48.844630+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"31'286","reported_seq":473,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:46.205624+0000","last_change":"2024-09-12T17:31:46.205541+0000","last_active":"2024-09-12T17:31:46.205624+0000","last_peered":"2024-09-12T17:31:46.205624+0000","last_clean":"2024-09-12T17:31:46.205624+0000","last_became_active":"2024-09-12T17:27:48.441024+0000","last_became_peered":"2024-09-12T17:27:48.441024+0000","last_unstale":"2024-09-12T17:31:46.205624+0000","last_undegraded":"2024-09-12T17:31:46.205624+0000","last_fullsized":"2024-09-12T17:31:46.205624+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'286","last_scrub_stamp":"2024-09-12T17:31:46.205451+0000","last_deep_scrub":"31'286","last_deep_scrub_stamp":"2024-09-12T17:31:46.205451+0000","last_clean_scrub_stamp":"2024-09-12T17:31:46.205451+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:06.332116+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'4","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:51.282731+0000","last_change":"2024-09-12T17:31:51.282630+0000","last_active":"2024-09-12T17:31:51.282731+0000","last_peered":"2024-09-12T17:31:51.282731+0000","last_clean":"2024-09-12T17:31:51.282731+0000","last_became_active":"2024-09-12T17:27:50.451743+0000","last_became_peered":"2024-09-12T17:27:50.451743+0000","last_unstale":"2024-09-12T17:31:51.282731+0000","last_undegraded":"2024-09-12T17:31:51.282731+0000","last_fullsized":"2024-09-12T17:31:51.282731+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:51.282505+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:51.282505+0000","last_clean_scrub_stamp":"2024-09-12T17:31:51.282505+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:18.063890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:17.306393+0000","last_change":"2024-09-12T17:31:17.306328+0000","last_active":"2024-09-12T17:31:17.306393+0000","last_peered":"2024-09-12T17:31:17.306393+0000","last_clean":"2024-09-12T17:31:17.306393+0000","last_became_active":"2024-09-12T17:27:42.438566+0000","last_became_peered":"2024-09-12T17:27:42.438566+0000","last_unstale":"2024-09-12T17:31:17.306393+0000","last_undegraded":"2024-09-12T17:31:17.306393+0000","last_fullsized":"2024-09-12T17:31:17.306393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:17.306243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:17.306243+0000","last_clean_scrub_stamp":"2024-09-12T17:31:17.306243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:02.990898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:14.414186+0000","last_change":"2024-09-12T17:31:14.414138+0000","last_active":"2024-09-12T17:31:14.414186+0000","last_peered":"2024-09-12T17:31:14.414186+0000","last_clean":"2024-09-12T17:31:14.414186+0000","last_became_active":"2024-09-12T17:27:40.429902+0000","last_became_peered":"2024-09-12T17:27:40.429902+0000","last_unstale":"2024-09-12T17:31:14.414186+0000","last_undegraded":"2024-09-12T17:31:14.414186+0000","last_fullsized":"2024-09-12T17:31:14.414186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:14.414041+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:14.414041+0000","last_clean_scrub_stamp":"2024-09-12T17:31:14.414041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:51.245716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:55.518346+0000","last_change":"2024-09-12T17:31:55.518291+0000","last_active":"2024-09-12T17:31:55.518346+0000","last_peered":"2024-09-12T17:31:55.518346+0000","last_clean":"2024-09-12T17:31:55.518346+0000","last_became_active":"2024-09-12T17:27:44.431180+0000","last_became_peered":"2024-09-12T17:27:44.431180+0000","last_unstale":"2024-09-12T17:31:55.518346+0000","last_undegraded":"2024-09-12T17:31:55.518346+0000","last_fullsized":"2024-09-12T17:31:55.518346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:55.518204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:55.518204+0000","last_clean_scrub_stamp":"2024-09-12T17:31:55.518204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:09.192139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"31'51","reported_seq":111,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:42.218317+0000","last_change":"2024-09-12T17:31:42.218263+0000","last_active":"2024-09-12T17:31:42.218317+0000","last_peered":"2024-09-12T17:31:42.218317+0000","last_clean":"2024-09-12T17:31:42.218317+0000","last_became_active":"2024-09-12T17:27:46.431599+0000","last_became_peered":"2024-09-12T17:27:46.431599+0000","last_unstale":"2024-09-12T17:31:42.218317+0000","last_undegraded":"2024-09-12T17:31:42.218317+0000","last_fullsized":"2024-09-12T17:31:42.218317+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'51","last_scrub_stamp":"2024-09-12T17:31:42.218165+0000","last_deep_scrub":"31'51","last_deep_scrub_stamp":"2024-09-12T17:31:42.218165+0000","last_clean_scrub_stamp":"2024-09-12T17:31:42.218165+0000","objects_scrubbed":8,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:04.370123+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":53,"num_read_kb":61,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:45.223586+0000","last_change":"2024-09-12T17:31:45.223521+0000","last_active":"2024-09-12T17:31:45.223586+0000","last_peered":"2024-09-12T17:31:45.223586+0000","last_clean":"2024-09-12T17:31:45.223586+0000","last_became_active":"2024-09-12T17:27:48.447331+0000","last_became_peered":"2024-09-12T17:27:48.447331+0000","last_unstale":"2024-09-12T17:31:45.223586+0000","last_undegraded":"2024-09-12T17:31:45.223586+0000","last_fullsized":"2024-09-12T17:31:45.223586+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:45.223419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:45.223419+0000","last_clean_scrub_stamp":"2024-09-12T17:31:45.223419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:53:36.521497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"31'7","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:52.272997+0000","last_change":"2024-09-12T17:31:52.272909+0000","last_active":"2024-09-12T17:31:52.272997+0000","last_peered":"2024-09-12T17:31:52.272997+0000","last_clean":"2024-09-12T17:31:52.272997+0000","last_became_active":"2024-09-12T17:27:50.447855+0000","last_became_peered":"2024-09-12T17:27:50.447855+0000","last_unstale":"2024-09-12T17:31:52.272997+0000","last_undegraded":"2024-09-12T17:31:52.272997+0000","last_fullsized":"2024-09-12T17:31:52.272997+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'7","last_scrub_stamp":"2024-09-12T17:31:52.272789+0000","last_deep_scrub":"31'7","last_deep_scrub_stamp":"2024-09-12T17:31:52.272789+0000","last_clean_scrub_stamp":"2024-09-12T17:31:52.272789+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:36.685106+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"31'14","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:31.547974+0000","last_change":"2024-09-12T17:31:31.547869+0000","last_active":"2024-09-12T17:31:31.547974+0000","last_peered":"2024-09-12T17:31:31.547974+0000","last_clean":"2024-09-12T17:31:31.547974+0000","last_became_active":"2024-09-12T17:27:42.438270+0000","last_became_peered":"2024-09-12T17:27:42.438270+0000","last_unstale":"2024-09-12T17:31:31.547974+0000","last_undegraded":"2024-09-12T17:31:31.547974+0000","last_fullsized":"2024-09-12T17:31:31.547974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-12T17:31:31.547749+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-12T17:31:31.547749+0000","last_clean_scrub_stamp":"2024-09-12T17:31:31.547749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:59.304661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"31'74","reported_seq":153,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:01.448317+0000","last_change":"2024-09-12T17:31:01.448262+0000","last_active":"2024-09-12T17:31:01.448317+0000","last_peered":"2024-09-12T17:31:01.448317+0000","last_clean":"2024-09-12T17:31:01.448317+0000","last_became_active":"2024-09-12T17:27:25.974522+0000","last_became_peered":"2024-09-12T17:27:25.974522+0000","last_unstale":"2024-09-12T17:31:01.448317+0000","last_undegraded":"2024-09-12T17:31:01.448317+0000","last_fullsized":"2024-09-12T17:31:01.448317+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'74","last_scrub_stamp":"2024-09-12T17:31:01.448174+0000","last_deep_scrub":"31'74","last_deep_scrub_stamp":"2024-09-12T17:31:01.448174+0000","last_clean_scrub_stamp":"2024-09-12T17:31:01.448174+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:35.862648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"31'2","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:04.209795+0000","last_change":"2024-09-12T17:31:04.209698+0000","last_active":"2024-09-12T17:31:04.209795+0000","last_peered":"2024-09-12T17:31:04.209795+0000","last_clean":"2024-09-12T17:31:04.209795+0000","last_became_active":"2024-09-12T17:27:32.760744+0000","last_became_peered":"2024-09-12T17:27:32.760744+0000","last_unstale":"2024-09-12T17:31:04.209795+0000","last_undegraded":"2024-09-12T17:31:04.209795+0000","last_fullsized":"2024-09-12T17:31:04.209795+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:04.209605+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:04.209605+0000","last_clean_scrub_stamp":"2024-09-12T17:31:04.209605+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:18.344014+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0014241220000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:05.209841+0000","last_change":"2024-09-12T17:31:05.209735+0000","last_active":"2024-09-12T17:31:05.209841+0000","last_peered":"2024-09-12T17:31:05.209841+0000","last_clean":"2024-09-12T17:31:05.209841+0000","last_became_active":"2024-09-12T17:27:40.428453+0000","last_became_peered":"2024-09-12T17:27:40.428453+0000","last_unstale":"2024-09-12T17:31:05.209841+0000","last_undegraded":"2024-09-12T17:31:05.209841+0000","last_fullsized":"2024-09-12T17:31:05.209841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:05.209644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:05.209644+0000","last_clean_scrub_stamp":"2024-09-12T17:31:05.209644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:39.739604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:33.324359+0000","last_change":"2024-09-12T17:31:33.324301+0000","last_active":"2024-09-12T17:31:33.324359+0000","last_peered":"2024-09-12T17:31:33.324359+0000","last_clean":"2024-09-12T17:31:33.324359+0000","last_became_active":"2024-09-12T17:27:44.432336+0000","last_became_peered":"2024-09-12T17:27:44.432336+0000","last_unstale":"2024-09-12T17:31:33.324359+0000","last_undegraded":"2024-09-12T17:31:33.324359+0000","last_fullsized":"2024-09-12T17:31:33.324359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:33.324201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:33.324201+0000","last_clean_scrub_stamp":"2024-09-12T17:31:33.324201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:09.650088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"31'90","reported_seq":181,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:59.559414+0000","last_change":"2024-09-12T17:31:59.559357+0000","last_active":"2024-09-12T17:31:59.559414+0000","last_peered":"2024-09-12T17:31:59.559414+0000","last_clean":"2024-09-12T17:31:59.559414+0000","last_became_active":"2024-09-12T17:27:46.437771+0000","last_became_peered":"2024-09-12T17:27:46.437771+0000","last_unstale":"2024-09-12T17:31:59.559414+0000","last_undegraded":"2024-09-12T17:31:59.559414+0000","last_fullsized":"2024-09-12T17:31:59.559414+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'90","last_scrub_stamp":"2024-09-12T17:31:59.559246+0000","last_deep_scrub":"31'90","last_deep_scrub_stamp":"2024-09-12T17:31:59.559246+0000","last_clean_scrub_stamp":"2024-09-12T17:31:59.559246+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:46.610831+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:44.033322+0000","last_change":"2024-09-12T17:31:44.033196+0000","last_active":"2024-09-12T17:31:44.033322+0000","last_peered":"2024-09-12T17:31:44.033322+0000","last_clean":"2024-09-12T17:31:44.033322+0000","last_became_active":"2024-09-12T17:27:48.445970+0000","last_became_peered":"2024-09-12T17:27:48.445970+0000","last_unstale":"2024-09-12T17:31:44.033322+0000","last_undegraded":"2024-09-12T17:31:44.033322+0000","last_fullsized":"2024-09-12T17:31:44.033322+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:44.033093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:44.033093+0000","last_clean_scrub_stamp":"2024-09-12T17:31:44.033093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:04.159758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"31'81","reported_seq":172,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:52.234051+0000","last_change":"2024-09-12T17:31:52.233929+0000","last_active":"2024-09-12T17:31:52.234051+0000","last_peered":"2024-09-12T17:31:52.234051+0000","last_clean":"2024-09-12T17:31:52.234051+0000","last_became_active":"2024-09-12T17:27:50.448189+0000","last_became_peered":"2024-09-12T17:27:50.448189+0000","last_unstale":"2024-09-12T17:31:52.234051+0000","last_undegraded":"2024-09-12T17:31:52.234051+0000","last_fullsized":"2024-09-12T17:31:52.234051+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'81","last_scrub_stamp":"2024-09-12T17:31:52.233825+0000","last_deep_scrub":"31'81","last_deep_scrub_stamp":"2024-09-12T17:31:52.233825+0000","last_clean_scrub_stamp":"2024-09-12T17:31:52.233825+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:27.501741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":221,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'2","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:29.535064+0000","last_change":"2024-09-12T17:31:29.534969+0000","last_active":"2024-09-12T17:31:29.535064+0000","last_peered":"2024-09-12T17:31:29.535064+0000","last_clean":"2024-09-12T17:31:29.535064+0000","last_became_active":"2024-09-12T17:27:42.429497+0000","last_became_peered":"2024-09-12T17:27:42.429497+0000","last_unstale":"2024-09-12T17:31:29.535064+0000","last_undegraded":"2024-09-12T17:31:29.535064+0000","last_fullsized":"2024-09-12T17:31:29.535064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-12T17:31:29.534867+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-12T17:31:29.534867+0000","last_clean_scrub_stamp":"2024-09-12T17:31:29.534867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:43.863976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:01.220300+0000","last_change":"2024-09-12T17:31:01.220220+0000","last_active":"2024-09-12T17:31:01.220300+0000","last_peered":"2024-09-12T17:31:01.220300+0000","last_clean":"2024-09-12T17:31:01.220300+0000","last_became_active":"2024-09-12T17:27:32.761687+0000","last_became_peered":"2024-09-12T17:27:32.761687+0000","last_unstale":"2024-09-12T17:31:01.220300+0000","last_undegraded":"2024-09-12T17:31:01.220300+0000","last_fullsized":"2024-09-12T17:31:01.220300+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:01.220136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:01.220136+0000","last_clean_scrub_stamp":"2024-09-12T17:31:01.220136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:40.149633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056694099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:01.844201+0000","last_change":"2024-09-12T17:31:01.844114+0000","last_active":"2024-09-12T17:31:01.844201+0000","last_peered":"2024-09-12T17:31:01.844201+0000","last_clean":"2024-09-12T17:31:01.844201+0000","last_became_active":"2024-09-12T17:27:40.418249+0000","last_became_peered":"2024-09-12T17:27:40.418249+0000","last_unstale":"2024-09-12T17:31:01.844201+0000","last_undegraded":"2024-09-12T17:31:01.844201+0000","last_fullsized":"2024-09-12T17:31:01.844201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:01.844025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:01.844025+0000","last_clean_scrub_stamp":"2024-09-12T17:31:01.844025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:24.701961+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:51.473391+0000","last_change":"2024-09-12T17:31:51.473329+0000","last_active":"2024-09-12T17:31:51.473391+0000","last_peered":"2024-09-12T17:31:51.473391+0000","last_clean":"2024-09-12T17:31:51.473391+0000","last_became_active":"2024-09-12T17:27:44.426698+0000","last_became_peered":"2024-09-12T17:27:44.426698+0000","last_unstale":"2024-09-12T17:31:51.473391+0000","last_undegraded":"2024-09-12T17:31:51.473391+0000","last_fullsized":"2024-09-12T17:31:51.473391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:51.473243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:51.473243+0000","last_clean_scrub_stamp":"2024-09-12T17:31:51.473243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:02.192513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"31'295","reported_seq":521,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:41.218206+0000","last_change":"2024-09-12T17:31:41.218144+0000","last_active":"2024-09-12T17:31:41.218206+0000","last_peered":"2024-09-12T17:31:41.218206+0000","last_clean":"2024-09-12T17:31:41.218206+0000","last_became_active":"2024-09-12T17:27:46.438381+0000","last_became_peered":"2024-09-12T17:27:46.438381+0000","last_unstale":"2024-09-12T17:31:41.218206+0000","last_undegraded":"2024-09-12T17:31:41.218206+0000","last_fullsized":"2024-09-12T17:31:41.218206+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'295","last_scrub_stamp":"2024-09-12T17:31:41.218033+0000","last_deep_scrub":"31'295","last_deep_scrub_stamp":"2024-09-12T17:31:41.218033+0000","last_clean_scrub_stamp":"2024-09-12T17:31:41.218033+0000","objects_scrubbed":10,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:50.316833+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:10.453960+0000","last_change":"2024-09-12T17:32:10.453960+0000","last_active":"2024-09-12T17:32:10.453960+0000","last_peered":"2024-09-12T17:32:10.453960+0000","last_clean":"2024-09-12T17:32:10.453960+0000","last_became_active":"2024-09-12T17:27:48.450775+0000","last_became_peered":"2024-09-12T17:27:48.450775+0000","last_unstale":"2024-09-12T17:32:10.453960+0000","last_undegraded":"2024-09-12T17:32:10.453960+0000","last_fullsized":"2024-09-12T17:32:10.453960+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:32:10.453850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:32:10.453850+0000","last_clean_scrub_stamp":"2024-09-12T17:32:10.453850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:25.929311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"31'5","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:55.307964+0000","last_change":"2024-09-12T17:31:55.307903+0000","last_active":"2024-09-12T17:31:55.307964+0000","last_peered":"2024-09-12T17:31:55.307964+0000","last_clean":"2024-09-12T17:31:55.307964+0000","last_became_active":"2024-09-12T17:27:50.457939+0000","last_became_peered":"2024-09-12T17:27:50.457939+0000","last_unstale":"2024-09-12T17:31:55.307964+0000","last_undegraded":"2024-09-12T17:31:55.307964+0000","last_fullsized":"2024-09-12T17:31:55.307964+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-09-12T17:31:55.307796+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-09-12T17:31:55.307796+0000","last_clean_scrub_stamp":"2024-09-12T17:31:55.307796+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:15.600277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"31'4","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:16.848034+0000","last_change":"2024-09-12T17:31:16.847975+0000","last_active":"2024-09-12T17:31:16.848034+0000","last_peered":"2024-09-12T17:31:16.848034+0000","last_clean":"2024-09-12T17:31:16.848034+0000","last_became_active":"2024-09-12T17:27:42.424498+0000","last_became_peered":"2024-09-12T17:27:42.424498+0000","last_unstale":"2024-09-12T17:31:16.848034+0000","last_undegraded":"2024-09-12T17:31:16.848034+0000","last_fullsized":"2024-09-12T17:31:16.848034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:16.847857+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:16.847857+0000","last_clean_scrub_stamp":"2024-09-12T17:31:16.847857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:43.335725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:03.037428+0000","last_change":"2024-09-12T17:31:03.037376+0000","last_active":"2024-09-12T17:31:03.037428+0000","last_peered":"2024-09-12T17:31:03.037428+0000","last_clean":"2024-09-12T17:31:03.037428+0000","last_became_active":"2024-09-12T17:27:32.761809+0000","last_became_peered":"2024-09-12T17:27:32.761809+0000","last_unstale":"2024-09-12T17:31:03.037428+0000","last_undegraded":"2024-09-12T17:31:03.037428+0000","last_fullsized":"2024-09-12T17:31:03.037428+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:03.037295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:03.037295+0000","last_clean_scrub_stamp":"2024-09-12T17:31:03.037295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:57:59.113302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051333900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"31'3","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:03.795988+0000","last_change":"2024-09-12T17:31:03.795932+0000","last_active":"2024-09-12T17:31:03.795988+0000","last_peered":"2024-09-12T17:31:03.795988+0000","last_clean":"2024-09-12T17:31:03.795988+0000","last_became_active":"2024-09-12T17:27:40.417664+0000","last_became_peered":"2024-09-12T17:27:40.417664+0000","last_unstale":"2024-09-12T17:31:03.795988+0000","last_undegraded":"2024-09-12T17:31:03.795988+0000","last_fullsized":"2024-09-12T17:31:03.795988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-09-12T17:31:03.795825+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-09-12T17:31:03.795825+0000","last_clean_scrub_stamp":"2024-09-12T17:31:03.795825+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:31:39.240916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"31'4","reported_seq":245,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:29.251936+0000","last_change":"2024-09-12T17:31:29.251861+0000","last_active":"2024-09-12T17:31:29.251936+0000","last_peered":"2024-09-12T17:31:29.251936+0000","last_clean":"2024-09-12T17:31:29.251936+0000","last_became_active":"2024-09-12T17:28:21.473073+0000","last_became_peered":"2024-09-12T17:28:21.473073+0000","last_unstale":"2024-09-12T17:31:29.251936+0000","last_undegraded":"2024-09-12T17:31:29.251936+0000","last_fullsized":"2024-09-12T17:31:29.251936+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:29.251773+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:29.251773+0000","last_clean_scrub_stamp":"2024-09-12T17:31:29.251773+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:37.794343+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":482,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"31'25","reported_seq":103,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:38.112116+0000","last_change":"2024-09-12T17:31:38.112059+0000","last_active":"2024-09-12T17:31:38.112116+0000","last_peered":"2024-09-12T17:31:38.112116+0000","last_clean":"2024-09-12T17:31:38.112116+0000","last_became_active":"2024-09-12T17:27:46.435381+0000","last_became_peered":"2024-09-12T17:27:46.435381+0000","last_unstale":"2024-09-12T17:31:38.112116+0000","last_undegraded":"2024-09-12T17:31:38.112116+0000","last_fullsized":"2024-09-12T17:31:38.112116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'25","last_scrub_stamp":"2024-09-12T17:31:38.111974+0000","last_deep_scrub":"31'25","last_deep_scrub_stamp":"2024-09-12T17:31:38.111974+0000","last_clean_scrub_stamp":"2024-09-12T17:31:38.111974+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:06.093270+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:45.990516+0000","last_change":"2024-09-12T17:31:45.990449+0000","last_active":"2024-09-12T17:31:45.990516+0000","last_peered":"2024-09-12T17:31:45.990516+0000","last_clean":"2024-09-12T17:31:45.990516+0000","last_became_active":"2024-09-12T17:27:48.451225+0000","last_became_peered":"2024-09-12T17:27:48.451225+0000","last_unstale":"2024-09-12T17:31:45.990516+0000","last_undegraded":"2024-09-12T17:31:45.990516+0000","last_fullsized":"2024-09-12T17:31:45.990516+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:45.990362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:45.990362+0000","last_clean_scrub_stamp":"2024-09-12T17:31:45.990362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:29.719452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:18.363866+0000","last_change":"2024-09-12T17:32:18.363801+0000","last_active":"2024-09-12T17:32:18.363866+0000","last_peered":"2024-09-12T17:32:18.363866+0000","last_clean":"2024-09-12T17:32:18.363866+0000","last_became_active":"2024-09-12T17:27:50.453458+0000","last_became_peered":"2024-09-12T17:27:50.453458+0000","last_unstale":"2024-09-12T17:32:18.363866+0000","last_undegraded":"2024-09-12T17:32:18.363866+0000","last_fullsized":"2024-09-12T17:32:18.363866+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:32:18.363711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:32:18.363711+0000","last_clean_scrub_stamp":"2024-09-12T17:32:18.363711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:34.005864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"31'10","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:15.887747+0000","last_change":"2024-09-12T17:31:15.887674+0000","last_active":"2024-09-12T17:31:15.887747+0000","last_peered":"2024-09-12T17:31:15.887747+0000","last_clean":"2024-09-12T17:31:15.887747+0000","last_became_active":"2024-09-12T17:27:42.427591+0000","last_became_peered":"2024-09-12T17:27:42.427591+0000","last_unstale":"2024-09-12T17:31:15.887747+0000","last_undegraded":"2024-09-12T17:31:15.887747+0000","last_fullsized":"2024-09-12T17:31:15.887747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-12T17:31:15.887587+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-12T17:31:15.887587+0000","last_clean_scrub_stamp":"2024-09-12T17:31:15.887587+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:34.580284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"31'3","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:02.205206+0000","last_change":"2024-09-12T17:31:02.205137+0000","last_active":"2024-09-12T17:31:02.205206+0000","last_peered":"2024-09-12T17:31:02.205206+0000","last_clean":"2024-09-12T17:31:02.205206+0000","last_became_active":"2024-09-12T17:27:32.761967+0000","last_became_peered":"2024-09-12T17:27:32.761967+0000","last_unstale":"2024-09-12T17:31:02.205206+0000","last_undegraded":"2024-09-12T17:31:02.205206+0000","last_fullsized":"2024-09-12T17:31:02.205206+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-09-12T17:31:02.205052+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-09-12T17:31:02.205052+0000","last_clean_scrub_stamp":"2024-09-12T17:31:02.205052+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:42.393847+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001062323,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:04.082831+0000","last_change":"2024-09-12T17:31:04.082738+0000","last_active":"2024-09-12T17:31:04.082831+0000","last_peered":"2024-09-12T17:31:04.082831+0000","last_clean":"2024-09-12T17:31:04.082831+0000","last_became_active":"2024-09-12T17:27:40.425973+0000","last_became_peered":"2024-09-12T17:27:40.425973+0000","last_unstale":"2024-09-12T17:31:04.082831+0000","last_undegraded":"2024-09-12T17:31:04.082831+0000","last_fullsized":"2024-09-12T17:31:04.082831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:04.082603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:04.082603+0000","last_clean_scrub_stamp":"2024-09-12T17:31:04.082603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:21.270783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:32.915382+0000","last_change":"2024-09-12T17:31:32.915286+0000","last_active":"2024-09-12T17:31:32.915382+0000","last_peered":"2024-09-12T17:31:32.915382+0000","last_clean":"2024-09-12T17:31:32.915382+0000","last_became_active":"2024-09-12T17:27:44.432348+0000","last_became_peered":"2024-09-12T17:27:44.432348+0000","last_unstale":"2024-09-12T17:31:32.915382+0000","last_undegraded":"2024-09-12T17:31:32.915382+0000","last_fullsized":"2024-09-12T17:31:32.915382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:32.915180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:32.915180+0000","last_clean_scrub_stamp":"2024-09-12T17:31:32.915180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:38.504920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"31'21","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:58.531371+0000","last_change":"2024-09-12T17:31:58.531308+0000","last_active":"2024-09-12T17:31:58.531371+0000","last_peered":"2024-09-12T17:31:58.531371+0000","last_clean":"2024-09-12T17:31:58.531371+0000","last_became_active":"2024-09-12T17:27:46.442488+0000","last_became_peered":"2024-09-12T17:27:46.442488+0000","last_unstale":"2024-09-12T17:31:58.531371+0000","last_undegraded":"2024-09-12T17:31:58.531371+0000","last_fullsized":"2024-09-12T17:31:58.531371+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'21","last_scrub_stamp":"2024-09-12T17:31:58.531214+0000","last_deep_scrub":"31'21","last_deep_scrub_stamp":"2024-09-12T17:31:58.531214+0000","last_clean_scrub_stamp":"2024-09-12T17:31:58.531214+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:34.732602+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:14.432643+0000","last_change":"2024-09-12T17:32:14.432643+0000","last_active":"2024-09-12T17:32:14.432643+0000","last_peered":"2024-09-12T17:32:14.432643+0000","last_clean":"2024-09-12T17:32:14.432643+0000","last_became_active":"2024-09-12T17:27:48.451075+0000","last_became_peered":"2024-09-12T17:27:48.451075+0000","last_unstale":"2024-09-12T17:32:14.432643+0000","last_undegraded":"2024-09-12T17:32:14.432643+0000","last_fullsized":"2024-09-12T17:32:14.432643+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:32:14.432505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:32:14.432505+0000","last_clean_scrub_stamp":"2024-09-12T17:32:14.432505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:47.427868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'10","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:54.304502+0000","last_change":"2024-09-12T17:31:54.304418+0000","last_active":"2024-09-12T17:31:54.304502+0000","last_peered":"2024-09-12T17:31:54.304502+0000","last_clean":"2024-09-12T17:31:54.304502+0000","last_became_active":"2024-09-12T17:27:50.455608+0000","last_became_peered":"2024-09-12T17:27:50.455608+0000","last_unstale":"2024-09-12T17:31:54.304502+0000","last_undegraded":"2024-09-12T17:31:54.304502+0000","last_fullsized":"2024-09-12T17:31:54.304502+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-12T17:31:54.304339+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-12T17:31:54.304339+0000","last_clean_scrub_stamp":"2024-09-12T17:31:54.304339+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:41.053408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":17,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'14","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:16.142477+0000","last_change":"2024-09-12T17:31:16.142405+0000","last_active":"2024-09-12T17:31:16.142477+0000","last_peered":"2024-09-12T17:31:16.142477+0000","last_clean":"2024-09-12T17:31:16.142477+0000","last_became_active":"2024-09-12T17:28:21.471756+0000","last_became_peered":"2024-09-12T17:28:21.471756+0000","last_unstale":"2024-09-12T17:31:16.142477+0000","last_undegraded":"2024-09-12T17:31:16.142477+0000","last_fullsized":"2024-09-12T17:31:16.142477+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-12T17:31:16.142322+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-12T17:31:16.142322+0000","last_clean_scrub_stamp":"2024-09-12T17:31:16.142322+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:39.000259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:01.009789+0000","last_change":"2024-09-12T17:31:01.009730+0000","last_active":"2024-09-12T17:31:01.009789+0000","last_peered":"2024-09-12T17:31:01.009789+0000","last_clean":"2024-09-12T17:31:01.009789+0000","last_became_active":"2024-09-12T17:27:40.424286+0000","last_became_peered":"2024-09-12T17:27:40.424286+0000","last_unstale":"2024-09-12T17:31:01.009789+0000","last_undegraded":"2024-09-12T17:31:01.009789+0000","last_fullsized":"2024-09-12T17:31:01.009789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:01.009648+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:01.009648+0000","last_clean_scrub_stamp":"2024-09-12T17:31:01.009648+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:15.810543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:30:59.835909+0000","last_change":"2024-09-12T17:30:59.835771+0000","last_active":"2024-09-12T17:30:59.835909+0000","last_peered":"2024-09-12T17:30:59.835909+0000","last_clean":"2024-09-12T17:30:59.835909+0000","last_became_active":"2024-09-12T17:27:32.761595+0000","last_became_peered":"2024-09-12T17:27:32.761595+0000","last_unstale":"2024-09-12T17:30:59.835909+0000","last_undegraded":"2024-09-12T17:30:59.835909+0000","last_fullsized":"2024-09-12T17:30:59.835909+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:59.835655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:59.835655+0000","last_clean_scrub_stamp":"2024-09-12T17:30:59.835655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:14.315612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000417551,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"31'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:30.833956+0000","last_change":"2024-09-12T17:31:30.833822+0000","last_active":"2024-09-12T17:31:30.833956+0000","last_peered":"2024-09-12T17:31:30.833956+0000","last_clean":"2024-09-12T17:31:30.833956+0000","last_became_active":"2024-09-12T17:27:44.432492+0000","last_became_peered":"2024-09-12T17:27:44.432492+0000","last_unstale":"2024-09-12T17:31:30.833956+0000","last_undegraded":"2024-09-12T17:31:30.833956+0000","last_fullsized":"2024-09-12T17:31:30.833956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:30.833721+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:30.833721+0000","last_clean_scrub_stamp":"2024-09-12T17:31:30.833721+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:05.676775+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"31'76","reported_seq":153,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:35.923118+0000","last_change":"2024-09-12T17:31:35.922981+0000","last_active":"2024-09-12T17:31:35.923118+0000","last_peered":"2024-09-12T17:31:35.923118+0000","last_clean":"2024-09-12T17:31:35.923118+0000","last_became_active":"2024-09-12T17:27:46.439014+0000","last_became_peered":"2024-09-12T17:27:46.439014+0000","last_unstale":"2024-09-12T17:31:35.923118+0000","last_undegraded":"2024-09-12T17:31:35.923118+0000","last_fullsized":"2024-09-12T17:31:35.923118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'76","last_scrub_stamp":"2024-09-12T17:31:35.922854+0000","last_deep_scrub":"31'76","last_deep_scrub_stamp":"2024-09-12T17:31:35.922854+0000","last_clean_scrub_stamp":"2024-09-12T17:31:35.922854+0000","objects_scrubbed":9,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:07.104177+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:44.204301+0000","last_change":"2024-09-12T17:31:44.204241+0000","last_active":"2024-09-12T17:31:44.204301+0000","last_peered":"2024-09-12T17:31:44.204301+0000","last_clean":"2024-09-12T17:31:44.204301+0000","last_became_active":"2024-09-12T17:27:48.438779+0000","last_became_peered":"2024-09-12T17:27:48.438779+0000","last_unstale":"2024-09-12T17:31:44.204301+0000","last_undegraded":"2024-09-12T17:31:44.204301+0000","last_fullsized":"2024-09-12T17:31:44.204301+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:44.204158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:44.204158+0000","last_clean_scrub_stamp":"2024-09-12T17:31:44.204158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:20.530044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"31'13","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:59.119186+0000","last_change":"2024-09-12T17:31:59.119082+0000","last_active":"2024-09-12T17:31:59.119186+0000","last_peered":"2024-09-12T17:31:59.119186+0000","last_clean":"2024-09-12T17:31:59.119186+0000","last_became_active":"2024-09-12T17:27:50.448060+0000","last_became_peered":"2024-09-12T17:27:50.448060+0000","last_unstale":"2024-09-12T17:31:59.119186+0000","last_undegraded":"2024-09-12T17:31:59.119186+0000","last_fullsized":"2024-09-12T17:31:59.119186+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'13","last_scrub_stamp":"2024-09-12T17:31:59.118958+0000","last_deep_scrub":"31'13","last_deep_scrub_stamp":"2024-09-12T17:31:59.118958+0000","last_clean_scrub_stamp":"2024-09-12T17:31:59.118958+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:59.445773+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":31,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"31'27","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:12.291409+0000","last_change":"2024-09-12T17:31:12.291292+0000","last_active":"2024-09-12T17:31:12.291409+0000","last_peered":"2024-09-12T17:31:12.291409+0000","last_clean":"2024-09-12T17:31:12.291409+0000","last_became_active":"2024-09-12T17:27:42.432800+0000","last_became_peered":"2024-09-12T17:27:42.432800+0000","last_unstale":"2024-09-12T17:31:12.291409+0000","last_undegraded":"2024-09-12T17:31:12.291409+0000","last_fullsized":"2024-09-12T17:31:12.291409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'27","last_scrub_stamp":"2024-09-12T17:31:12.291188+0000","last_deep_scrub":"31'27","last_deep_scrub_stamp":"2024-09-12T17:31:12.291188+0000","last_clean_scrub_stamp":"2024-09-12T17:31:12.291188+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:58.552254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":99,"num_read_kb":83,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:05.776096+0000","last_change":"2024-09-12T17:31:05.776042+0000","last_active":"2024-09-12T17:31:05.776096+0000","last_peered":"2024-09-12T17:31:05.776096+0000","last_clean":"2024-09-12T17:31:05.776096+0000","last_became_active":"2024-09-12T17:27:40.418873+0000","last_became_peered":"2024-09-12T17:27:40.418873+0000","last_unstale":"2024-09-12T17:31:05.776096+0000","last_undegraded":"2024-09-12T17:31:05.776096+0000","last_fullsized":"2024-09-12T17:31:05.776096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:05.775954+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:05.775954+0000","last_clean_scrub_stamp":"2024-09-12T17:31:05.775954+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:05.095403+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:03.225809+0000","last_change":"2024-09-12T17:31:03.225739+0000","last_active":"2024-09-12T17:31:03.225809+0000","last_peered":"2024-09-12T17:31:03.225809+0000","last_clean":"2024-09-12T17:31:03.225809+0000","last_became_active":"2024-09-12T17:27:32.761677+0000","last_became_peered":"2024-09-12T17:27:32.761677+0000","last_unstale":"2024-09-12T17:31:03.225809+0000","last_undegraded":"2024-09-12T17:31:03.225809+0000","last_fullsized":"2024-09-12T17:31:03.225809+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:03.225639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:03.225639+0000","last_clean_scrub_stamp":"2024-09-12T17:31:03.225639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:53.792882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001356625,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:49.474298+0000","last_change":"2024-09-12T17:31:49.474248+0000","last_active":"2024-09-12T17:31:49.474298+0000","last_peered":"2024-09-12T17:31:49.474298+0000","last_clean":"2024-09-12T17:31:49.474298+0000","last_became_active":"2024-09-12T17:27:44.426647+0000","last_became_peered":"2024-09-12T17:27:44.426647+0000","last_unstale":"2024-09-12T17:31:49.474298+0000","last_undegraded":"2024-09-12T17:31:49.474298+0000","last_fullsized":"2024-09-12T17:31:49.474298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:49.474140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:49.474140+0000","last_clean_scrub_stamp":"2024-09-12T17:31:49.474140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:25.749871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"31'22","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:40.171838+0000","last_change":"2024-09-12T17:31:40.171783+0000","last_active":"2024-09-12T17:31:40.171838+0000","last_peered":"2024-09-12T17:31:40.171838+0000","last_clean":"2024-09-12T17:31:40.171838+0000","last_became_active":"2024-09-12T17:27:46.439038+0000","last_became_peered":"2024-09-12T17:27:46.439038+0000","last_unstale":"2024-09-12T17:31:40.171838+0000","last_undegraded":"2024-09-12T17:31:40.171838+0000","last_fullsized":"2024-09-12T17:31:40.171838+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'22","last_scrub_stamp":"2024-09-12T17:31:40.171698+0000","last_deep_scrub":"31'22","last_deep_scrub_stamp":"2024-09-12T17:31:40.171698+0000","last_clean_scrub_stamp":"2024-09-12T17:31:40.171698+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:53.965338+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"31'286","reported_seq":360,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:47.186948+0000","last_change":"2024-09-12T17:31:47.186874+0000","last_active":"2024-09-12T17:31:47.186948+0000","last_peered":"2024-09-12T17:31:47.186948+0000","last_clean":"2024-09-12T17:31:47.186948+0000","last_became_active":"2024-09-12T17:27:48.440948+0000","last_became_peered":"2024-09-12T17:27:48.440948+0000","last_unstale":"2024-09-12T17:31:47.186948+0000","last_undegraded":"2024-09-12T17:31:47.186948+0000","last_fullsized":"2024-09-12T17:31:47.186948+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'286","last_scrub_stamp":"2024-09-12T17:31:47.186792+0000","last_deep_scrub":"31'286","last_deep_scrub_stamp":"2024-09-12T17:31:47.186792+0000","last_clean_scrub_stamp":"2024-09-12T17:31:47.186792+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:58.556769+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:19.349011+0000","last_change":"2024-09-12T17:32:19.348953+0000","last_active":"2024-09-12T17:32:19.349011+0000","last_peered":"2024-09-12T17:32:19.349011+0000","last_clean":"2024-09-12T17:32:19.349011+0000","last_became_active":"2024-09-12T17:27:50.454241+0000","last_became_peered":"2024-09-12T17:27:50.454241+0000","last_unstale":"2024-09-12T17:32:19.349011+0000","last_undegraded":"2024-09-12T17:32:19.349011+0000","last_fullsized":"2024-09-12T17:32:19.349011+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:32:19.348859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:32:19.348859+0000","last_clean_scrub_stamp":"2024-09-12T17:32:19.348859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:27.126296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"31'16","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:28.486671+0000","last_change":"2024-09-12T17:31:28.486564+0000","last_active":"2024-09-12T17:31:28.486671+0000","last_peered":"2024-09-12T17:31:28.486671+0000","last_clean":"2024-09-12T17:31:28.486671+0000","last_became_active":"2024-09-12T17:27:42.423805+0000","last_became_peered":"2024-09-12T17:27:42.423805+0000","last_unstale":"2024-09-12T17:31:28.486671+0000","last_undegraded":"2024-09-12T17:31:28.486671+0000","last_fullsized":"2024-09-12T17:31:28.486671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'16","last_scrub_stamp":"2024-09-12T17:31:28.486474+0000","last_deep_scrub":"31'16","last_deep_scrub_stamp":"2024-09-12T17:31:28.486474+0000","last_clean_scrub_stamp":"2024-09-12T17:31:28.486474+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:53.131800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:07.273178+0000","last_change":"2024-09-12T17:31:07.273111+0000","last_active":"2024-09-12T17:31:07.273178+0000","last_peered":"2024-09-12T17:31:07.273178+0000","last_clean":"2024-09-12T17:31:07.273178+0000","last_became_active":"2024-09-12T17:27:40.423703+0000","last_became_peered":"2024-09-12T17:27:40.423703+0000","last_unstale":"2024-09-12T17:31:07.273178+0000","last_undegraded":"2024-09-12T17:31:07.273178+0000","last_fullsized":"2024-09-12T17:31:07.273178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:07.273027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:07.273027+0000","last_clean_scrub_stamp":"2024-09-12T17:31:07.273027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:59.920670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:00.826839+0000","last_change":"2024-09-12T17:31:00.826782+0000","last_active":"2024-09-12T17:31:00.826839+0000","last_peered":"2024-09-12T17:31:00.826839+0000","last_clean":"2024-09-12T17:31:00.826839+0000","last_became_active":"2024-09-12T17:27:32.761590+0000","last_became_peered":"2024-09-12T17:27:32.761590+0000","last_unstale":"2024-09-12T17:31:00.826839+0000","last_undegraded":"2024-09-12T17:31:00.826839+0000","last_fullsized":"2024-09-12T17:31:00.826839+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:00.826700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:00.826700+0000","last_clean_scrub_stamp":"2024-09-12T17:31:00.826700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:41.176527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036072200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:48.494341+0000","last_change":"2024-09-12T17:31:48.494284+0000","last_active":"2024-09-12T17:31:48.494341+0000","last_peered":"2024-09-12T17:31:48.494341+0000","last_clean":"2024-09-12T17:31:48.494341+0000","last_became_active":"2024-09-12T17:27:44.427318+0000","last_became_peered":"2024-09-12T17:27:44.427318+0000","last_unstale":"2024-09-12T17:31:48.494341+0000","last_undegraded":"2024-09-12T17:31:48.494341+0000","last_fullsized":"2024-09-12T17:31:48.494341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:48.494175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:48.494175+0000","last_clean_scrub_stamp":"2024-09-12T17:31:48.494175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:20.611185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"31'15","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:57.492276+0000","last_change":"2024-09-12T17:31:57.492276+0000","last_active":"2024-09-12T17:31:57.492276+0000","last_peered":"2024-09-12T17:31:57.492276+0000","last_clean":"2024-09-12T17:31:57.492276+0000","last_became_active":"2024-09-12T17:27:46.443937+0000","last_became_peered":"2024-09-12T17:27:46.443937+0000","last_unstale":"2024-09-12T17:31:57.492276+0000","last_undegraded":"2024-09-12T17:31:57.492276+0000","last_fullsized":"2024-09-12T17:31:57.492276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'15","last_scrub_stamp":"2024-09-12T17:31:57.492132+0000","last_deep_scrub":"31'15","last_deep_scrub_stamp":"2024-09-12T17:31:57.492132+0000","last_clean_scrub_stamp":"2024-09-12T17:31:57.492132+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:27.779269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"31'286","reported_seq":403,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:47.039683+0000","last_change":"2024-09-12T17:31:47.039607+0000","last_active":"2024-09-12T17:31:47.039683+0000","last_peered":"2024-09-12T17:31:47.039683+0000","last_clean":"2024-09-12T17:31:47.039683+0000","last_became_active":"2024-09-12T17:27:48.441694+0000","last_became_peered":"2024-09-12T17:27:48.441694+0000","last_unstale":"2024-09-12T17:31:47.039683+0000","last_undegraded":"2024-09-12T17:31:47.039683+0000","last_fullsized":"2024-09-12T17:31:47.039683+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'286","last_scrub_stamp":"2024-09-12T17:31:47.039521+0000","last_deep_scrub":"31'286","last_deep_scrub_stamp":"2024-09-12T17:31:47.039521+0000","last_clean_scrub_stamp":"2024-09-12T17:31:47.039521+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:56.891807+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"29'3","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:57.215433+0000","last_change":"2024-09-12T17:31:57.215310+0000","last_active":"2024-09-12T17:31:57.215433+0000","last_peered":"2024-09-12T17:31:57.215433+0000","last_clean":"2024-09-12T17:31:57.215433+0000","last_became_active":"2024-09-12T17:27:50.452862+0000","last_became_peered":"2024-09-12T17:27:50.452862+0000","last_unstale":"2024-09-12T17:31:57.215433+0000","last_undegraded":"2024-09-12T17:31:57.215433+0000","last_fullsized":"2024-09-12T17:31:57.215433+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-09-12T17:31:57.215214+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-09-12T17:31:57.215214+0000","last_clean_scrub_stamp":"2024-09-12T17:31:57.215214+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:58.167244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"29'2","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:17.188786+0000","last_change":"2024-09-12T17:31:17.188673+0000","last_active":"2024-09-12T17:31:17.188786+0000","last_peered":"2024-09-12T17:31:17.188786+0000","last_clean":"2024-09-12T17:31:17.188786+0000","last_became_active":"2024-09-12T17:27:42.436667+0000","last_became_peered":"2024-09-12T17:27:42.436667+0000","last_unstale":"2024-09-12T17:31:17.188786+0000","last_undegraded":"2024-09-12T17:31:17.188786+0000","last_fullsized":"2024-09-12T17:31:17.188786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-12T17:31:17.188564+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-12T17:31:17.188564+0000","last_clean_scrub_stamp":"2024-09-12T17:31:17.188564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:45.338606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:00.489048+0000","last_change":"2024-09-12T17:31:00.488993+0000","last_active":"2024-09-12T17:31:00.489048+0000","last_peered":"2024-09-12T17:31:00.489048+0000","last_clean":"2024-09-12T17:31:00.489048+0000","last_became_active":"2024-09-12T17:27:40.419472+0000","last_became_peered":"2024-09-12T17:27:40.419472+0000","last_unstale":"2024-09-12T17:31:00.489048+0000","last_undegraded":"2024-09-12T17:31:00.489048+0000","last_fullsized":"2024-09-12T17:31:00.489048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:00.488897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:00.488897+0000","last_clean_scrub_stamp":"2024-09-12T17:31:00.488897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:42.257433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:06.255527+0000","last_change":"2024-09-12T17:31:06.255467+0000","last_active":"2024-09-12T17:31:06.255527+0000","last_peered":"2024-09-12T17:31:06.255527+0000","last_clean":"2024-09-12T17:31:06.255527+0000","last_became_active":"2024-09-12T17:27:32.775344+0000","last_became_peered":"2024-09-12T17:27:32.775344+0000","last_unstale":"2024-09-12T17:31:06.255527+0000","last_undegraded":"2024-09-12T17:31:06.255527+0000","last_fullsized":"2024-09-12T17:31:06.255527+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:06.255380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:06.255380+0000","last_clean_scrub_stamp":"2024-09-12T17:31:06.255380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:58.712793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011343939999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:47.526576+0000","last_change":"2024-09-12T17:31:47.526576+0000","last_active":"2024-09-12T17:31:47.526576+0000","last_peered":"2024-09-12T17:31:47.526576+0000","last_clean":"2024-09-12T17:31:47.526576+0000","last_became_active":"2024-09-12T17:27:44.427519+0000","last_became_peered":"2024-09-12T17:27:44.427519+0000","last_unstale":"2024-09-12T17:31:47.526576+0000","last_undegraded":"2024-09-12T17:31:47.526576+0000","last_fullsized":"2024-09-12T17:31:47.526576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:47.526460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:47.526460+0000","last_clean_scrub_stamp":"2024-09-12T17:31:47.526460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:05.506192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"31'99","reported_seq":193,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:36.131450+0000","last_change":"2024-09-12T17:31:36.131379+0000","last_active":"2024-09-12T17:31:36.131450+0000","last_peered":"2024-09-12T17:31:36.131450+0000","last_clean":"2024-09-12T17:31:36.131450+0000","last_became_active":"2024-09-12T17:27:46.442154+0000","last_became_peered":"2024-09-12T17:27:46.442154+0000","last_unstale":"2024-09-12T17:31:36.131450+0000","last_undegraded":"2024-09-12T17:31:36.131450+0000","last_fullsized":"2024-09-12T17:31:36.131450+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'99","last_scrub_stamp":"2024-09-12T17:31:36.131282+0000","last_deep_scrub":"31'99","last_deep_scrub_stamp":"2024-09-12T17:31:36.131282+0000","last_clean_scrub_stamp":"2024-09-12T17:31:36.131282+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:32.789106+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:43.051537+0000","last_change":"2024-09-12T17:31:43.051486+0000","last_active":"2024-09-12T17:31:43.051537+0000","last_peered":"2024-09-12T17:31:43.051537+0000","last_clean":"2024-09-12T17:31:43.051537+0000","last_became_active":"2024-09-12T17:27:48.440177+0000","last_became_peered":"2024-09-12T17:27:48.440177+0000","last_unstale":"2024-09-12T17:31:43.051537+0000","last_undegraded":"2024-09-12T17:31:43.051537+0000","last_fullsized":"2024-09-12T17:31:43.051537+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:43.051387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:43.051387+0000","last_clean_scrub_stamp":"2024-09-12T17:31:43.051387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:19.689950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:54.306699+0000","last_change":"2024-09-12T17:31:54.306646+0000","last_active":"2024-09-12T17:31:54.306699+0000","last_peered":"2024-09-12T17:31:54.306699+0000","last_clean":"2024-09-12T17:31:54.306699+0000","last_became_active":"2024-09-12T17:27:50.453919+0000","last_became_peered":"2024-09-12T17:27:50.453919+0000","last_unstale":"2024-09-12T17:31:54.306699+0000","last_undegraded":"2024-09-12T17:31:54.306699+0000","last_fullsized":"2024-09-12T17:31:54.306699+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:54.306539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:54.306539+0000","last_clean_scrub_stamp":"2024-09-12T17:31:54.306539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:45.965830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:56.291919+0000","last_change":"2024-09-12T17:31:56.291840+0000","last_active":"2024-09-12T17:31:56.291919+0000","last_peered":"2024-09-12T17:31:56.291919+0000","last_clean":"2024-09-12T17:31:56.291919+0000","last_became_active":"2024-09-12T17:27:50.452190+0000","last_became_peered":"2024-09-12T17:27:50.452190+0000","last_unstale":"2024-09-12T17:31:56.291919+0000","last_undegraded":"2024-09-12T17:31:56.291919+0000","last_fullsized":"2024-09-12T17:31:56.291919+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:56.291760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:56.291760+0000","last_clean_scrub_stamp":"2024-09-12T17:31:56.291760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:32.123683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:21.214371+0000","last_change":"2024-09-12T17:31:21.214317+0000","last_active":"2024-09-12T17:31:21.214371+0000","last_peered":"2024-09-12T17:31:21.214371+0000","last_clean":"2024-09-12T17:31:21.214371+0000","last_became_active":"2024-09-12T17:27:42.436187+0000","last_became_peered":"2024-09-12T17:27:42.436187+0000","last_unstale":"2024-09-12T17:31:21.214371+0000","last_undegraded":"2024-09-12T17:31:21.214371+0000","last_fullsized":"2024-09-12T17:31:21.214371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:21.214230+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:21.214230+0000","last_clean_scrub_stamp":"2024-09-12T17:31:21.214230+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:42.216760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"29'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:16.370862+0000","last_change":"2024-09-12T17:31:16.370798+0000","last_active":"2024-09-12T17:31:16.370862+0000","last_peered":"2024-09-12T17:31:16.370862+0000","last_clean":"2024-09-12T17:31:16.370862+0000","last_became_active":"2024-09-12T17:27:40.428529+0000","last_became_peered":"2024-09-12T17:27:40.428529+0000","last_unstale":"2024-09-12T17:31:16.370862+0000","last_undegraded":"2024-09-12T17:31:16.370862+0000","last_fullsized":"2024-09-12T17:31:16.370862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-12T17:31:16.370693+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-09-12T17:31:16.370693+0000","last_clean_scrub_stamp":"2024-09-12T17:31:16.370693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:11.675892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:35.281197+0000","last_change":"2024-09-12T17:31:35.281115+0000","last_active":"2024-09-12T17:31:35.281197+0000","last_peered":"2024-09-12T17:31:35.281197+0000","last_clean":"2024-09-12T17:31:35.281197+0000","last_became_active":"2024-09-12T17:27:44.429701+0000","last_became_peered":"2024-09-12T17:27:44.429701+0000","last_unstale":"2024-09-12T17:31:35.281197+0000","last_undegraded":"2024-09-12T17:31:35.281197+0000","last_fullsized":"2024-09-12T17:31:35.281197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:35.281006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:35.281006+0000","last_clean_scrub_stamp":"2024-09-12T17:31:35.281006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:44.156197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"31'40","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:06.466479+0000","last_change":"2024-09-12T17:32:06.466382+0000","last_active":"2024-09-12T17:32:06.466479+0000","last_peered":"2024-09-12T17:32:06.466479+0000","last_clean":"2024-09-12T17:32:06.466479+0000","last_became_active":"2024-09-12T17:27:46.442713+0000","last_became_peered":"2024-09-12T17:27:46.442713+0000","last_unstale":"2024-09-12T17:32:06.466479+0000","last_undegraded":"2024-09-12T17:32:06.466479+0000","last_fullsized":"2024-09-12T17:32:06.466479+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'40","last_scrub_stamp":"2024-09-12T17:32:06.466276+0000","last_deep_scrub":"31'40","last_deep_scrub_stamp":"2024-09-12T17:32:06.466276+0000","last_clean_scrub_stamp":"2024-09-12T17:32:06.466276+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:45.620718+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:11.432206+0000","last_change":"2024-09-12T17:32:11.432129+0000","last_active":"2024-09-12T17:32:11.432206+0000","last_peered":"2024-09-12T17:32:11.432206+0000","last_clean":"2024-09-12T17:32:11.432206+0000","last_became_active":"2024-09-12T17:27:48.450050+0000","last_became_peered":"2024-09-12T17:27:48.450050+0000","last_unstale":"2024-09-12T17:32:11.432206+0000","last_undegraded":"2024-09-12T17:32:11.432206+0000","last_fullsized":"2024-09-12T17:32:11.432206+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:32:11.432042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:32:11.432042+0000","last_clean_scrub_stamp":"2024-09-12T17:32:11.432042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:09.498678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"31'5","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:01.148129+0000","last_change":"2024-09-12T17:32:01.148129+0000","last_active":"2024-09-12T17:32:01.148129+0000","last_peered":"2024-09-12T17:32:01.148129+0000","last_clean":"2024-09-12T17:32:01.148129+0000","last_became_active":"2024-09-12T17:27:50.453382+0000","last_became_peered":"2024-09-12T17:27:50.453382+0000","last_unstale":"2024-09-12T17:32:01.148129+0000","last_undegraded":"2024-09-12T17:32:01.148129+0000","last_fullsized":"2024-09-12T17:32:01.148129+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-09-12T17:32:01.148041+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-09-12T17:32:01.148041+0000","last_clean_scrub_stamp":"2024-09-12T17:32:01.148041+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:27.614177+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"31'8","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:19.332274+0000","last_change":"2024-09-12T17:31:19.332207+0000","last_active":"2024-09-12T17:31:19.332274+0000","last_peered":"2024-09-12T17:31:19.332274+0000","last_clean":"2024-09-12T17:31:19.332274+0000","last_became_active":"2024-09-12T17:27:42.436150+0000","last_became_peered":"2024-09-12T17:27:42.436150+0000","last_unstale":"2024-09-12T17:31:19.332274+0000","last_undegraded":"2024-09-12T17:31:19.332274+0000","last_fullsized":"2024-09-12T17:31:19.332274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:19.332119+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:19.332119+0000","last_clean_scrub_stamp":"2024-09-12T17:31:19.332119+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:45.819987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:07.073522+0000","last_change":"2024-09-12T17:31:07.073417+0000","last_active":"2024-09-12T17:31:07.073522+0000","last_peered":"2024-09-12T17:31:07.073522+0000","last_clean":"2024-09-12T17:31:07.073522+0000","last_became_active":"2024-09-12T17:27:40.431962+0000","last_became_peered":"2024-09-12T17:27:40.431962+0000","last_unstale":"2024-09-12T17:31:07.073522+0000","last_undegraded":"2024-09-12T17:31:07.073522+0000","last_fullsized":"2024-09-12T17:31:07.073522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:07.073320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:07.073320+0000","last_clean_scrub_stamp":"2024-09-12T17:31:07.073320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:17.908445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:53.455890+0000","last_change":"2024-09-12T17:31:53.455763+0000","last_active":"2024-09-12T17:31:53.455890+0000","last_peered":"2024-09-12T17:31:53.455890+0000","last_clean":"2024-09-12T17:31:53.455890+0000","last_became_active":"2024-09-12T17:27:44.432334+0000","last_became_peered":"2024-09-12T17:27:44.432334+0000","last_unstale":"2024-09-12T17:31:53.455890+0000","last_undegraded":"2024-09-12T17:31:53.455890+0000","last_fullsized":"2024-09-12T17:31:53.455890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:53.455655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:53.455655+0000","last_clean_scrub_stamp":"2024-09-12T17:31:53.455655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:19.517675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"31'9","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:40.961036+0000","last_change":"2024-09-12T17:31:40.960920+0000","last_active":"2024-09-12T17:31:40.961036+0000","last_peered":"2024-09-12T17:31:40.961036+0000","last_clean":"2024-09-12T17:31:40.961036+0000","last_became_active":"2024-09-12T17:27:46.435567+0000","last_became_peered":"2024-09-12T17:27:46.435567+0000","last_unstale":"2024-09-12T17:31:40.961036+0000","last_undegraded":"2024-09-12T17:31:40.961036+0000","last_fullsized":"2024-09-12T17:31:40.961036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'9","last_scrub_stamp":"2024-09-12T17:31:40.960798+0000","last_deep_scrub":"31'9","last_deep_scrub_stamp":"2024-09-12T17:31:40.960798+0000","last_clean_scrub_stamp":"2024-09-12T17:31:40.960798+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:35.681474+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:47.260104+0000","last_change":"2024-09-12T17:31:47.260045+0000","last_active":"2024-09-12T17:31:47.260104+0000","last_peered":"2024-09-12T17:31:47.260104+0000","last_clean":"2024-09-12T17:31:47.260104+0000","last_became_active":"2024-09-12T17:27:48.448478+0000","last_became_peered":"2024-09-12T17:27:48.448478+0000","last_unstale":"2024-09-12T17:31:47.260104+0000","last_undegraded":"2024-09-12T17:31:47.260104+0000","last_fullsized":"2024-09-12T17:31:47.260104+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:47.259949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:47.259949+0000","last_clean_scrub_stamp":"2024-09-12T17:31:47.259949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:53.333564+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"31'8","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:02.119771+0000","last_change":"2024-09-12T17:32:02.119771+0000","last_active":"2024-09-12T17:32:02.119771+0000","last_peered":"2024-09-12T17:32:02.119771+0000","last_clean":"2024-09-12T17:32:02.119771+0000","last_became_active":"2024-09-12T17:27:50.449302+0000","last_became_peered":"2024-09-12T17:27:50.449302+0000","last_unstale":"2024-09-12T17:32:02.119771+0000","last_undegraded":"2024-09-12T17:32:02.119771+0000","last_fullsized":"2024-09-12T17:32:02.119771+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:32:02.119677+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:32:02.119677+0000","last_clean_scrub_stamp":"2024-09-12T17:32:02.119677+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:50.975630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"31'4","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:17.849930+0000","last_change":"2024-09-12T17:31:17.849853+0000","last_active":"2024-09-12T17:31:17.849930+0000","last_peered":"2024-09-12T17:31:17.849930+0000","last_clean":"2024-09-12T17:31:17.849930+0000","last_became_active":"2024-09-12T17:27:42.423974+0000","last_became_peered":"2024-09-12T17:27:42.423974+0000","last_unstale":"2024-09-12T17:31:17.849930+0000","last_undegraded":"2024-09-12T17:31:17.849930+0000","last_fullsized":"2024-09-12T17:31:17.849930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:17.849764+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:17.849764+0000","last_clean_scrub_stamp":"2024-09-12T17:31:17.849764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:32.821977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:08.073300+0000","last_change":"2024-09-12T17:31:08.073247+0000","last_active":"2024-09-12T17:31:08.073300+0000","last_peered":"2024-09-12T17:31:08.073300+0000","last_clean":"2024-09-12T17:31:08.073300+0000","last_became_active":"2024-09-12T17:27:40.430154+0000","last_became_peered":"2024-09-12T17:27:40.430154+0000","last_unstale":"2024-09-12T17:31:08.073300+0000","last_undegraded":"2024-09-12T17:31:08.073300+0000","last_fullsized":"2024-09-12T17:31:08.073300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:08.073165+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:08.073165+0000","last_clean_scrub_stamp":"2024-09-12T17:31:08.073165+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:18.392407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:32.133147+0000","last_change":"2024-09-12T17:31:32.133092+0000","last_active":"2024-09-12T17:31:32.133147+0000","last_peered":"2024-09-12T17:31:32.133147+0000","last_clean":"2024-09-12T17:31:32.133147+0000","last_became_active":"2024-09-12T17:27:44.434979+0000","last_became_peered":"2024-09-12T17:27:44.434979+0000","last_unstale":"2024-09-12T17:31:32.133147+0000","last_undegraded":"2024-09-12T17:31:32.133147+0000","last_fullsized":"2024-09-12T17:31:32.133147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:32.133012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:32.133012+0000","last_clean_scrub_stamp":"2024-09-12T17:31:32.133012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:49.764890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"31'49","reported_seq":122,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:37.924378+0000","last_change":"2024-09-12T17:31:37.924314+0000","last_active":"2024-09-12T17:31:37.924378+0000","last_peered":"2024-09-12T17:31:37.924378+0000","last_clean":"2024-09-12T17:31:37.924378+0000","last_became_active":"2024-09-12T17:27:46.433421+0000","last_became_peered":"2024-09-12T17:27:46.433421+0000","last_unstale":"2024-09-12T17:31:37.924378+0000","last_undegraded":"2024-09-12T17:31:37.924378+0000","last_fullsized":"2024-09-12T17:31:37.924378+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'49","last_scrub_stamp":"2024-09-12T17:31:37.924209+0000","last_deep_scrub":"31'49","last_deep_scrub_stamp":"2024-09-12T17:31:37.924209+0000","last_clean_scrub_stamp":"2024-09-12T17:31:37.924209+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:04.705594+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:48.208503+0000","last_change":"2024-09-12T17:31:48.208432+0000","last_active":"2024-09-12T17:31:48.208503+0000","last_peered":"2024-09-12T17:31:48.208503+0000","last_clean":"2024-09-12T17:31:48.208503+0000","last_became_active":"2024-09-12T17:27:48.439547+0000","last_became_peered":"2024-09-12T17:27:48.439547+0000","last_unstale":"2024-09-12T17:31:48.208503+0000","last_undegraded":"2024-09-12T17:31:48.208503+0000","last_fullsized":"2024-09-12T17:31:48.208503+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:48.208342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:48.208342+0000","last_clean_scrub_stamp":"2024-09-12T17:31:48.208342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:31.937432+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:26.349581+0000","last_change":"2024-09-12T17:32:26.349581+0000","last_active":"2024-09-12T17:32:26.349581+0000","last_peered":"2024-09-12T17:32:26.349581+0000","last_clean":"2024-09-12T17:32:26.349581+0000","last_became_active":"2024-09-12T17:27:50.459321+0000","last_became_peered":"2024-09-12T17:27:50.459321+0000","last_unstale":"2024-09-12T17:32:26.349581+0000","last_undegraded":"2024-09-12T17:32:26.349581+0000","last_fullsized":"2024-09-12T17:32:26.349581+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:32:26.349481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:32:26.349481+0000","last_clean_scrub_stamp":"2024-09-12T17:32:26.349481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:57.695943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"31'14","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:34.471643+0000","last_change":"2024-09-12T17:31:34.471584+0000","last_active":"2024-09-12T17:31:34.471643+0000","last_peered":"2024-09-12T17:31:34.471643+0000","last_clean":"2024-09-12T17:31:34.471643+0000","last_became_active":"2024-09-12T17:27:42.428364+0000","last_became_peered":"2024-09-12T17:27:42.428364+0000","last_unstale":"2024-09-12T17:31:34.471643+0000","last_undegraded":"2024-09-12T17:31:34.471643+0000","last_fullsized":"2024-09-12T17:31:34.471643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-12T17:31:34.471505+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-12T17:31:34.471505+0000","last_clean_scrub_stamp":"2024-09-12T17:31:34.471505+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:39.907822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:03.411168+0000","last_change":"2024-09-12T17:31:03.411106+0000","last_active":"2024-09-12T17:31:03.411168+0000","last_peered":"2024-09-12T17:31:03.411168+0000","last_clean":"2024-09-12T17:31:03.411168+0000","last_became_active":"2024-09-12T17:27:40.415212+0000","last_became_peered":"2024-09-12T17:27:40.415212+0000","last_unstale":"2024-09-12T17:31:03.411168+0000","last_undegraded":"2024-09-12T17:31:03.411168+0000","last_fullsized":"2024-09-12T17:31:03.411168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:03.411027+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:03.411027+0000","last_clean_scrub_stamp":"2024-09-12T17:31:03.411027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:42.311815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:52.479688+0000","last_change":"2024-09-12T17:31:52.479581+0000","last_active":"2024-09-12T17:31:52.479688+0000","last_peered":"2024-09-12T17:31:52.479688+0000","last_clean":"2024-09-12T17:31:52.479688+0000","last_became_active":"2024-09-12T17:27:44.429844+0000","last_became_peered":"2024-09-12T17:27:44.429844+0000","last_unstale":"2024-09-12T17:31:52.479688+0000","last_undegraded":"2024-09-12T17:31:52.479688+0000","last_fullsized":"2024-09-12T17:31:52.479688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:52.479482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:52.479482+0000","last_clean_scrub_stamp":"2024-09-12T17:31:52.479482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:16.636626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"31'38","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:41.161239+0000","last_change":"2024-09-12T17:31:41.161165+0000","last_active":"2024-09-12T17:31:41.161239+0000","last_peered":"2024-09-12T17:31:41.161239+0000","last_clean":"2024-09-12T17:31:41.161239+0000","last_became_active":"2024-09-12T17:27:46.432650+0000","last_became_peered":"2024-09-12T17:27:46.432650+0000","last_unstale":"2024-09-12T17:31:41.161239+0000","last_undegraded":"2024-09-12T17:31:41.161239+0000","last_fullsized":"2024-09-12T17:31:41.161239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'38","last_scrub_stamp":"2024-09-12T17:31:41.161056+0000","last_deep_scrub":"31'38","last_deep_scrub_stamp":"2024-09-12T17:31:41.161056+0000","last_clean_scrub_stamp":"2024-09-12T17:31:41.161056+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:32.306377+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:48.210612+0000","last_change":"2024-09-12T17:31:48.210555+0000","last_active":"2024-09-12T17:31:48.210612+0000","last_peered":"2024-09-12T17:31:48.210612+0000","last_clean":"2024-09-12T17:31:48.210612+0000","last_became_active":"2024-09-12T17:27:48.439134+0000","last_became_peered":"2024-09-12T17:27:48.439134+0000","last_unstale":"2024-09-12T17:31:48.210612+0000","last_undegraded":"2024-09-12T17:31:48.210612+0000","last_fullsized":"2024-09-12T17:31:48.210612+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:48.210467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:48.210467+0000","last_clean_scrub_stamp":"2024-09-12T17:31:48.210467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:00.748017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:38.470924+0000","last_change":"2024-09-12T17:31:38.470826+0000","last_active":"2024-09-12T17:31:38.470924+0000","last_peered":"2024-09-12T17:31:38.470924+0000","last_clean":"2024-09-12T17:31:38.470924+0000","last_became_active":"2024-09-12T17:27:42.426108+0000","last_became_peered":"2024-09-12T17:27:42.426108+0000","last_unstale":"2024-09-12T17:31:38.470924+0000","last_undegraded":"2024-09-12T17:31:38.470924+0000","last_fullsized":"2024-09-12T17:31:38.470924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:38.470744+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:38.470744+0000","last_clean_scrub_stamp":"2024-09-12T17:31:38.470744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:20.220207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:13.379019+0000","last_change":"2024-09-12T17:31:13.378936+0000","last_active":"2024-09-12T17:31:13.379019+0000","last_peered":"2024-09-12T17:31:13.379019+0000","last_clean":"2024-09-12T17:31:13.379019+0000","last_became_active":"2024-09-12T17:27:40.429644+0000","last_became_peered":"2024-09-12T17:27:40.429644+0000","last_unstale":"2024-09-12T17:31:13.379019+0000","last_undegraded":"2024-09-12T17:31:13.379019+0000","last_fullsized":"2024-09-12T17:31:13.379019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:13.378812+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:13.378812+0000","last_clean_scrub_stamp":"2024-09-12T17:31:13.378812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:25.356806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:35.136093+0000","last_change":"2024-09-12T17:31:35.136034+0000","last_active":"2024-09-12T17:31:35.136093+0000","last_peered":"2024-09-12T17:31:35.136093+0000","last_clean":"2024-09-12T17:31:35.136093+0000","last_became_active":"2024-09-12T17:28:21.471678+0000","last_became_peered":"2024-09-12T17:28:21.471678+0000","last_unstale":"2024-09-12T17:31:35.136093+0000","last_undegraded":"2024-09-12T17:31:35.136093+0000","last_fullsized":"2024-09-12T17:31:35.136093+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:35.135955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:35.135955+0000","last_clean_scrub_stamp":"2024-09-12T17:31:35.135955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:53.779707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"31'66","reported_seq":139,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:38.968939+0000","last_change":"2024-09-12T17:31:38.968939+0000","last_active":"2024-09-12T17:31:38.968939+0000","last_peered":"2024-09-12T17:31:38.968939+0000","last_clean":"2024-09-12T17:31:38.968939+0000","last_became_active":"2024-09-12T17:27:46.437623+0000","last_became_peered":"2024-09-12T17:27:46.437623+0000","last_unstale":"2024-09-12T17:31:38.968939+0000","last_undegraded":"2024-09-12T17:31:38.968939+0000","last_fullsized":"2024-09-12T17:31:38.968939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'66","last_scrub_stamp":"2024-09-12T17:31:38.968815+0000","last_deep_scrub":"31'66","last_deep_scrub_stamp":"2024-09-12T17:31:38.968815+0000","last_clean_scrub_stamp":"2024-09-12T17:31:38.968815+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:48.067615+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:49.239074+0000","last_change":"2024-09-12T17:31:49.239074+0000","last_active":"2024-09-12T17:31:49.239074+0000","last_peered":"2024-09-12T17:31:49.239074+0000","last_clean":"2024-09-12T17:31:49.239074+0000","last_became_active":"2024-09-12T17:27:48.440354+0000","last_became_peered":"2024-09-12T17:27:48.440354+0000","last_unstale":"2024-09-12T17:31:49.239074+0000","last_undegraded":"2024-09-12T17:31:49.239074+0000","last_fullsized":"2024-09-12T17:31:49.239074+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:49.238996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:49.238996+0000","last_clean_scrub_stamp":"2024-09-12T17:31:49.238996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:20.420319+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"31'14","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:57.126761+0000","last_change":"2024-09-12T17:31:57.126688+0000","last_active":"2024-09-12T17:31:57.126761+0000","last_peered":"2024-09-12T17:31:57.126761+0000","last_clean":"2024-09-12T17:31:57.126761+0000","last_became_active":"2024-09-12T17:27:50.457744+0000","last_became_peered":"2024-09-12T17:27:50.457744+0000","last_unstale":"2024-09-12T17:31:57.126761+0000","last_undegraded":"2024-09-12T17:31:57.126761+0000","last_fullsized":"2024-09-12T17:31:57.126761+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-09-12T17:31:57.126597+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-09-12T17:31:57.126597+0000","last_clean_scrub_stamp":"2024-09-12T17:31:57.126597+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:42.203786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"31'6","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:21.836167+0000","last_change":"2024-09-12T17:31:21.836070+0000","last_active":"2024-09-12T17:31:21.836167+0000","last_peered":"2024-09-12T17:31:21.836167+0000","last_clean":"2024-09-12T17:31:21.836167+0000","last_became_active":"2024-09-12T17:27:42.424447+0000","last_became_peered":"2024-09-12T17:27:42.424447+0000","last_unstale":"2024-09-12T17:31:21.836167+0000","last_undegraded":"2024-09-12T17:31:21.836167+0000","last_fullsized":"2024-09-12T17:31:21.836167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-12T17:31:21.835987+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-12T17:31:21.835987+0000","last_clean_scrub_stamp":"2024-09-12T17:31:21.835987+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:40.479739+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:04.364031+0000","last_change":"2024-09-12T17:31:04.363963+0000","last_active":"2024-09-12T17:31:04.364031+0000","last_peered":"2024-09-12T17:31:04.364031+0000","last_clean":"2024-09-12T17:31:04.364031+0000","last_became_active":"2024-09-12T17:27:40.414911+0000","last_became_peered":"2024-09-12T17:27:40.414911+0000","last_unstale":"2024-09-12T17:31:04.364031+0000","last_undegraded":"2024-09-12T17:31:04.364031+0000","last_fullsized":"2024-09-12T17:31:04.364031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:04.363875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:04.363875+0000","last_clean_scrub_stamp":"2024-09-12T17:31:04.363875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:31.145785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"31'5","reported_seq":239,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:37.091750+0000","last_change":"2024-09-12T17:31:37.091674+0000","last_active":"2024-09-12T17:31:37.091750+0000","last_peered":"2024-09-12T17:31:37.091750+0000","last_clean":"2024-09-12T17:31:37.091750+0000","last_became_active":"2024-09-12T17:27:44.427778+0000","last_became_peered":"2024-09-12T17:27:44.427778+0000","last_unstale":"2024-09-12T17:31:37.091750+0000","last_undegraded":"2024-09-12T17:31:37.091750+0000","last_fullsized":"2024-09-12T17:31:37.091750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-09-12T17:31:37.091588+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-09-12T17:31:37.091588+0000","last_clean_scrub_stamp":"2024-09-12T17:31:37.091588+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:14.070741+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"31'46","reported_seq":104,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:08.465643+0000","last_change":"2024-09-12T17:32:08.465643+0000","last_active":"2024-09-12T17:32:08.465643+0000","last_peered":"2024-09-12T17:32:08.465643+0000","last_clean":"2024-09-12T17:32:08.465643+0000","last_became_active":"2024-09-12T17:27:46.440494+0000","last_became_peered":"2024-09-12T17:27:46.440494+0000","last_unstale":"2024-09-12T17:32:08.465643+0000","last_undegraded":"2024-09-12T17:32:08.465643+0000","last_fullsized":"2024-09-12T17:32:08.465643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2024-09-12T17:32:08.465544+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2024-09-12T17:32:08.465544+0000","last_clean_scrub_stamp":"2024-09-12T17:32:08.465544+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:37.617137+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:51.230116+0000","last_change":"2024-09-12T17:31:51.230116+0000","last_active":"2024-09-12T17:31:51.230116+0000","last_peered":"2024-09-12T17:31:51.230116+0000","last_clean":"2024-09-12T17:31:51.230116+0000","last_became_active":"2024-09-12T17:27:48.448871+0000","last_became_peered":"2024-09-12T17:27:48.448871+0000","last_unstale":"2024-09-12T17:31:51.230116+0000","last_undegraded":"2024-09-12T17:31:51.230116+0000","last_fullsized":"2024-09-12T17:31:51.230116+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:51.230024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:51.230024+0000","last_clean_scrub_stamp":"2024-09-12T17:31:51.230024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:45.840129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:22.350869+0000","last_change":"2024-09-12T17:32:22.350776+0000","last_active":"2024-09-12T17:32:22.350869+0000","last_peered":"2024-09-12T17:32:22.350869+0000","last_clean":"2024-09-12T17:32:22.350869+0000","last_became_active":"2024-09-12T17:27:50.451678+0000","last_became_peered":"2024-09-12T17:27:50.451678+0000","last_unstale":"2024-09-12T17:32:22.350869+0000","last_undegraded":"2024-09-12T17:32:22.350869+0000","last_fullsized":"2024-09-12T17:32:22.350869+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:32:22.350676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:32:22.350676+0000","last_clean_scrub_stamp":"2024-09-12T17:32:22.350676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:57.898448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:37.437437+0000","last_change":"2024-09-12T17:31:37.437437+0000","last_active":"2024-09-12T17:31:37.437437+0000","last_peered":"2024-09-12T17:31:37.437437+0000","last_clean":"2024-09-12T17:31:37.437437+0000","last_became_active":"2024-09-12T17:27:42.438583+0000","last_became_peered":"2024-09-12T17:27:42.438583+0000","last_unstale":"2024-09-12T17:31:37.437437+0000","last_undegraded":"2024-09-12T17:31:37.437437+0000","last_fullsized":"2024-09-12T17:31:37.437437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:37.437341+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:37.437341+0000","last_clean_scrub_stamp":"2024-09-12T17:31:37.437341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:18.893026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:05.381633+0000","last_change":"2024-09-12T17:31:05.381633+0000","last_active":"2024-09-12T17:31:05.381633+0000","last_peered":"2024-09-12T17:31:05.381633+0000","last_clean":"2024-09-12T17:31:05.381633+0000","last_became_active":"2024-09-12T17:27:40.414034+0000","last_became_peered":"2024-09-12T17:27:40.414034+0000","last_unstale":"2024-09-12T17:31:05.381633+0000","last_undegraded":"2024-09-12T17:31:05.381633+0000","last_fullsized":"2024-09-12T17:31:05.381633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:05.381510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:05.381510+0000","last_clean_scrub_stamp":"2024-09-12T17:31:05.381510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:28.239447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:34.127651+0000","last_change":"2024-09-12T17:31:34.127651+0000","last_active":"2024-09-12T17:31:34.127651+0000","last_peered":"2024-09-12T17:31:34.127651+0000","last_clean":"2024-09-12T17:31:34.127651+0000","last_became_active":"2024-09-12T17:27:44.426927+0000","last_became_peered":"2024-09-12T17:27:44.426927+0000","last_unstale":"2024-09-12T17:31:34.127651+0000","last_undegraded":"2024-09-12T17:31:34.127651+0000","last_fullsized":"2024-09-12T17:31:34.127651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:34.127561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:34.127561+0000","last_clean_scrub_stamp":"2024-09-12T17:31:34.127561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:41.075392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"31'40","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:39.963017+0000","last_change":"2024-09-12T17:31:39.962935+0000","last_active":"2024-09-12T17:31:39.963017+0000","last_peered":"2024-09-12T17:31:39.963017+0000","last_clean":"2024-09-12T17:31:39.963017+0000","last_became_active":"2024-09-12T17:27:46.438778+0000","last_became_peered":"2024-09-12T17:27:46.438778+0000","last_unstale":"2024-09-12T17:31:39.963017+0000","last_undegraded":"2024-09-12T17:31:39.963017+0000","last_fullsized":"2024-09-12T17:31:39.963017+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'40","last_scrub_stamp":"2024-09-12T17:31:39.962824+0000","last_deep_scrub":"31'40","last_deep_scrub_stamp":"2024-09-12T17:31:39.962824+0000","last_clean_scrub_stamp":"2024-09-12T17:31:39.962824+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:02.114783+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:51.100050+0000","last_change":"2024-09-12T17:31:51.100050+0000","last_active":"2024-09-12T17:31:51.100050+0000","last_peered":"2024-09-12T17:31:51.100050+0000","last_clean":"2024-09-12T17:31:51.100050+0000","last_became_active":"2024-09-12T17:27:48.439888+0000","last_became_peered":"2024-09-12T17:27:48.439888+0000","last_unstale":"2024-09-12T17:31:51.100050+0000","last_undegraded":"2024-09-12T17:31:51.100050+0000","last_fullsized":"2024-09-12T17:31:51.100050+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:51.099939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:51.099939+0000","last_clean_scrub_stamp":"2024-09-12T17:31:51.099939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:51.957679+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"31'3","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:21.322996+0000","last_change":"2024-09-12T17:32:21.322930+0000","last_active":"2024-09-12T17:32:21.322996+0000","last_peered":"2024-09-12T17:32:21.322996+0000","last_clean":"2024-09-12T17:32:21.322996+0000","last_became_active":"2024-09-12T17:27:50.454058+0000","last_became_peered":"2024-09-12T17:27:50.454058+0000","last_unstale":"2024-09-12T17:32:21.322996+0000","last_undegraded":"2024-09-12T17:32:21.322996+0000","last_fullsized":"2024-09-12T17:32:21.322996+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-09-12T17:32:21.322828+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-09-12T17:32:21.322828+0000","last_clean_scrub_stamp":"2024-09-12T17:32:21.322828+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:32.999068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"31'6","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:19.793825+0000","last_change":"2024-09-12T17:31:19.793825+0000","last_active":"2024-09-12T17:31:19.793825+0000","last_peered":"2024-09-12T17:31:19.793825+0000","last_clean":"2024-09-12T17:31:19.793825+0000","last_became_active":"2024-09-12T17:27:42.428236+0000","last_became_peered":"2024-09-12T17:27:42.428236+0000","last_unstale":"2024-09-12T17:31:19.793825+0000","last_undegraded":"2024-09-12T17:31:19.793825+0000","last_fullsized":"2024-09-12T17:31:19.793825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-12T17:31:19.793741+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-12T17:31:19.793741+0000","last_clean_scrub_stamp":"2024-09-12T17:31:19.793741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:09.004133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"31'6","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:17.402253+0000","last_change":"2024-09-12T17:31:17.402187+0000","last_active":"2024-09-12T17:31:17.402253+0000","last_peered":"2024-09-12T17:31:17.402253+0000","last_clean":"2024-09-12T17:31:17.402253+0000","last_became_active":"2024-09-12T17:27:40.428969+0000","last_became_peered":"2024-09-12T17:27:40.428969+0000","last_unstale":"2024-09-12T17:31:17.402253+0000","last_undegraded":"2024-09-12T17:31:17.402253+0000","last_fullsized":"2024-09-12T17:31:17.402253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-12T17:31:17.402103+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-12T17:31:17.402103+0000","last_clean_scrub_stamp":"2024-09-12T17:31:17.402103+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:02:26.841712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":14,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:38.208867+0000","last_change":"2024-09-12T17:31:38.208867+0000","last_active":"2024-09-12T17:31:38.208867+0000","last_peered":"2024-09-12T17:31:38.208867+0000","last_clean":"2024-09-12T17:31:38.208867+0000","last_became_active":"2024-09-12T17:27:44.432609+0000","last_became_peered":"2024-09-12T17:27:44.432609+0000","last_unstale":"2024-09-12T17:31:38.208867+0000","last_undegraded":"2024-09-12T17:31:38.208867+0000","last_fullsized":"2024-09-12T17:31:38.208867+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:38.208779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:38.208779+0000","last_clean_scrub_stamp":"2024-09-12T17:31:38.208779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:52.480217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'15","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:09.417685+0000","last_change":"2024-09-12T17:32:09.417685+0000","last_active":"2024-09-12T17:32:09.417685+0000","last_peered":"2024-09-12T17:32:09.417685+0000","last_clean":"2024-09-12T17:32:09.417685+0000","last_became_active":"2024-09-12T17:27:46.444644+0000","last_became_peered":"2024-09-12T17:27:46.444644+0000","last_unstale":"2024-09-12T17:32:09.417685+0000","last_undegraded":"2024-09-12T17:32:09.417685+0000","last_fullsized":"2024-09-12T17:32:09.417685+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'15","last_scrub_stamp":"2024-09-12T17:32:09.417597+0000","last_deep_scrub":"31'15","last_deep_scrub_stamp":"2024-09-12T17:32:09.417597+0000","last_clean_scrub_stamp":"2024-09-12T17:32:09.417597+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:24.432999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"31'286","reported_seq":384,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:50.249180+0000","last_change":"2024-09-12T17:31:50.249117+0000","last_active":"2024-09-12T17:31:50.249180+0000","last_peered":"2024-09-12T17:31:50.249180+0000","last_clean":"2024-09-12T17:31:50.249180+0000","last_became_active":"2024-09-12T17:27:48.449138+0000","last_became_peered":"2024-09-12T17:27:48.449138+0000","last_unstale":"2024-09-12T17:31:50.249180+0000","last_undegraded":"2024-09-12T17:31:50.249180+0000","last_fullsized":"2024-09-12T17:31:50.249180+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'286","last_scrub_stamp":"2024-09-12T17:31:50.249038+0000","last_deep_scrub":"31'286","last_deep_scrub_stamp":"2024-09-12T17:31:50.249038+0000","last_clean_scrub_stamp":"2024-09-12T17:31:50.249038+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:01.178281+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:20.372247+0000","last_change":"2024-09-12T17:32:20.372154+0000","last_active":"2024-09-12T17:32:20.372247+0000","last_peered":"2024-09-12T17:32:20.372247+0000","last_clean":"2024-09-12T17:32:20.372247+0000","last_became_active":"2024-09-12T17:27:50.451899+0000","last_became_peered":"2024-09-12T17:27:50.451899+0000","last_unstale":"2024-09-12T17:32:20.372247+0000","last_undegraded":"2024-09-12T17:32:20.372247+0000","last_fullsized":"2024-09-12T17:32:20.372247+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:32:20.372056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:32:20.372056+0000","last_clean_scrub_stamp":"2024-09-12T17:32:20.372056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:32.927738+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"31'8","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:25.227409+0000","last_change":"2024-09-12T17:31:25.227409+0000","last_active":"2024-09-12T17:31:25.227409+0000","last_peered":"2024-09-12T17:31:25.227409+0000","last_clean":"2024-09-12T17:31:25.227409+0000","last_became_active":"2024-09-12T17:27:42.430110+0000","last_became_peered":"2024-09-12T17:27:42.430110+0000","last_unstale":"2024-09-12T17:31:25.227409+0000","last_undegraded":"2024-09-12T17:31:25.227409+0000","last_fullsized":"2024-09-12T17:31:25.227409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:25.227313+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:25.227313+0000","last_clean_scrub_stamp":"2024-09-12T17:31:25.227313+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:17.103312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:06.345680+0000","last_change":"2024-09-12T17:31:06.345680+0000","last_active":"2024-09-12T17:31:06.345680+0000","last_peered":"2024-09-12T17:31:06.345680+0000","last_clean":"2024-09-12T17:31:06.345680+0000","last_became_active":"2024-09-12T17:27:40.415018+0000","last_became_peered":"2024-09-12T17:27:40.415018+0000","last_unstale":"2024-09-12T17:31:06.345680+0000","last_undegraded":"2024-09-12T17:31:06.345680+0000","last_fullsized":"2024-09-12T17:31:06.345680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:06.345593+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:06.345593+0000","last_clean_scrub_stamp":"2024-09-12T17:31:06.345593+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:34.495634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:37.210915+0000","last_change":"2024-09-12T17:31:37.210915+0000","last_active":"2024-09-12T17:31:37.210915+0000","last_peered":"2024-09-12T17:31:37.210915+0000","last_clean":"2024-09-12T17:31:37.210915+0000","last_became_active":"2024-09-12T17:27:44.432389+0000","last_became_peered":"2024-09-12T17:27:44.432389+0000","last_unstale":"2024-09-12T17:31:37.210915+0000","last_undegraded":"2024-09-12T17:31:37.210915+0000","last_fullsized":"2024-09-12T17:31:37.210915+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:37.210810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:37.210810+0000","last_clean_scrub_stamp":"2024-09-12T17:31:37.210810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:49.748361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"31'46","reported_seq":105,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:45.208332+0000","last_change":"2024-09-12T17:31:45.208276+0000","last_active":"2024-09-12T17:31:45.208332+0000","last_peered":"2024-09-12T17:31:45.208332+0000","last_clean":"2024-09-12T17:31:45.208332+0000","last_became_active":"2024-09-12T17:27:46.435056+0000","last_became_peered":"2024-09-12T17:27:46.435056+0000","last_unstale":"2024-09-12T17:31:45.208332+0000","last_undegraded":"2024-09-12T17:31:45.208332+0000","last_fullsized":"2024-09-12T17:31:45.208332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2024-09-12T17:31:45.208179+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2024-09-12T17:31:45.208179+0000","last_clean_scrub_stamp":"2024-09-12T17:31:45.208179+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:21.846742+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:54.119619+0000","last_change":"2024-09-12T17:31:54.119551+0000","last_active":"2024-09-12T17:31:54.119619+0000","last_peered":"2024-09-12T17:31:54.119619+0000","last_clean":"2024-09-12T17:31:54.119619+0000","last_became_active":"2024-09-12T17:27:48.451143+0000","last_became_peered":"2024-09-12T17:27:48.451143+0000","last_unstale":"2024-09-12T17:31:54.119619+0000","last_undegraded":"2024-09-12T17:31:54.119619+0000","last_fullsized":"2024-09-12T17:31:54.119619+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:54.119464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:54.119464+0000","last_clean_scrub_stamp":"2024-09-12T17:31:54.119464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:50.067210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:56.264520+0000","last_change":"2024-09-12T17:31:56.264451+0000","last_active":"2024-09-12T17:31:56.264520+0000","last_peered":"2024-09-12T17:31:56.264520+0000","last_clean":"2024-09-12T17:31:56.264520+0000","last_became_active":"2024-09-12T17:27:50.458688+0000","last_became_peered":"2024-09-12T17:27:50.458688+0000","last_unstale":"2024-09-12T17:31:56.264520+0000","last_undegraded":"2024-09-12T17:31:56.264520+0000","last_fullsized":"2024-09-12T17:31:56.264520+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:56.264368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:56.264368+0000","last_clean_scrub_stamp":"2024-09-12T17:31:56.264368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:54.541983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'18","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:24.239641+0000","last_change":"2024-09-12T17:31:24.239641+0000","last_active":"2024-09-12T17:31:24.239641+0000","last_peered":"2024-09-12T17:31:24.239641+0000","last_clean":"2024-09-12T17:31:24.239641+0000","last_became_active":"2024-09-12T17:27:42.429645+0000","last_became_peered":"2024-09-12T17:27:42.429645+0000","last_unstale":"2024-09-12T17:31:24.239641+0000","last_undegraded":"2024-09-12T17:31:24.239641+0000","last_fullsized":"2024-09-12T17:31:24.239641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'18","last_scrub_stamp":"2024-09-12T17:31:24.239557+0000","last_deep_scrub":"31'18","last_deep_scrub_stamp":"2024-09-12T17:31:24.239557+0000","last_clean_scrub_stamp":"2024-09-12T17:31:24.239557+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:16.223898+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":59,"num_read_kb":51,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:18.401579+0000","last_change":"2024-09-12T17:31:18.401497+0000","last_active":"2024-09-12T17:31:18.401579+0000","last_peered":"2024-09-12T17:31:18.401579+0000","last_clean":"2024-09-12T17:31:18.401579+0000","last_became_active":"2024-09-12T17:27:40.433580+0000","last_became_peered":"2024-09-12T17:27:40.433580+0000","last_unstale":"2024-09-12T17:31:18.401579+0000","last_undegraded":"2024-09-12T17:31:18.401579+0000","last_fullsized":"2024-09-12T17:31:18.401579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:18.401408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:18.401408+0000","last_clean_scrub_stamp":"2024-09-12T17:31:18.401408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:11.623914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:33.094219+0000","last_change":"2024-09-12T17:31:33.094219+0000","last_active":"2024-09-12T17:31:33.094219+0000","last_peered":"2024-09-12T17:31:33.094219+0000","last_clean":"2024-09-12T17:31:33.094219+0000","last_became_active":"2024-09-12T17:27:44.433529+0000","last_became_peered":"2024-09-12T17:27:44.433529+0000","last_unstale":"2024-09-12T17:31:33.094219+0000","last_undegraded":"2024-09-12T17:31:33.094219+0000","last_fullsized":"2024-09-12T17:31:33.094219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:33.094131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:33.094131+0000","last_clean_scrub_stamp":"2024-09-12T17:31:33.094131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:22.304523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"31'39","reported_seq":95,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:42.007060+0000","last_change":"2024-09-12T17:31:42.006958+0000","last_active":"2024-09-12T17:31:42.007060+0000","last_peered":"2024-09-12T17:31:42.007060+0000","last_clean":"2024-09-12T17:31:42.007060+0000","last_became_active":"2024-09-12T17:27:46.439037+0000","last_became_peered":"2024-09-12T17:27:46.439037+0000","last_unstale":"2024-09-12T17:31:42.007060+0000","last_undegraded":"2024-09-12T17:31:42.007060+0000","last_fullsized":"2024-09-12T17:31:42.007060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2024-09-12T17:31:42.006807+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2024-09-12T17:31:42.006807+0000","last_clean_scrub_stamp":"2024-09-12T17:31:42.006807+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:34.109153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:13.478122+0000","last_change":"2024-09-12T17:32:13.478068+0000","last_active":"2024-09-12T17:32:13.478122+0000","last_peered":"2024-09-12T17:32:13.478122+0000","last_clean":"2024-09-12T17:32:13.478122+0000","last_became_active":"2024-09-12T17:27:48.448426+0000","last_became_peered":"2024-09-12T17:27:48.448426+0000","last_unstale":"2024-09-12T17:32:13.478122+0000","last_undegraded":"2024-09-12T17:32:13.478122+0000","last_fullsized":"2024-09-12T17:32:13.478122+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:32:13.477968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:32:13.477968+0000","last_clean_scrub_stamp":"2024-09-12T17:32:13.477968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:04.464391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:25.329901+0000","last_change":"2024-09-12T17:32:25.329832+0000","last_active":"2024-09-12T17:32:25.329901+0000","last_peered":"2024-09-12T17:32:25.329901+0000","last_clean":"2024-09-12T17:32:25.329901+0000","last_became_active":"2024-09-12T17:27:50.459662+0000","last_became_peered":"2024-09-12T17:27:50.459662+0000","last_unstale":"2024-09-12T17:32:25.329901+0000","last_undegraded":"2024-09-12T17:32:25.329901+0000","last_fullsized":"2024-09-12T17:32:25.329901+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:32:25.329744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:32:25.329744+0000","last_clean_scrub_stamp":"2024-09-12T17:32:25.329744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:58.824059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'12","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:23.237052+0000","last_change":"2024-09-12T17:31:23.237052+0000","last_active":"2024-09-12T17:31:23.237052+0000","last_peered":"2024-09-12T17:31:23.237052+0000","last_clean":"2024-09-12T17:31:23.237052+0000","last_became_active":"2024-09-12T17:28:21.472532+0000","last_became_peered":"2024-09-12T17:28:21.472532+0000","last_unstale":"2024-09-12T17:31:23.237052+0000","last_undegraded":"2024-09-12T17:31:23.237052+0000","last_fullsized":"2024-09-12T17:31:23.237052+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-09-12T17:31:23.236949+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-09-12T17:31:23.236949+0000","last_clean_scrub_stamp":"2024-09-12T17:31:23.236949+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:09.498014+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:04.774737+0000","last_change":"2024-09-12T17:31:04.774672+0000","last_active":"2024-09-12T17:31:04.774737+0000","last_peered":"2024-09-12T17:31:04.774737+0000","last_clean":"2024-09-12T17:31:04.774737+0000","last_became_active":"2024-09-12T17:27:40.418464+0000","last_became_peered":"2024-09-12T17:27:40.418464+0000","last_unstale":"2024-09-12T17:31:04.774737+0000","last_undegraded":"2024-09-12T17:31:04.774737+0000","last_fullsized":"2024-09-12T17:31:04.774737+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:04.774580+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:04.774580+0000","last_clean_scrub_stamp":"2024-09-12T17:31:04.774580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:11.872204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:36.236324+0000","last_change":"2024-09-12T17:31:36.236243+0000","last_active":"2024-09-12T17:31:36.236324+0000","last_peered":"2024-09-12T17:31:36.236324+0000","last_clean":"2024-09-12T17:31:36.236324+0000","last_became_active":"2024-09-12T17:27:44.430221+0000","last_became_peered":"2024-09-12T17:27:44.430221+0000","last_unstale":"2024-09-12T17:31:36.236324+0000","last_undegraded":"2024-09-12T17:31:36.236324+0000","last_fullsized":"2024-09-12T17:31:36.236324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:36.236156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:36.236156+0000","last_clean_scrub_stamp":"2024-09-12T17:31:36.236156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:42.309771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"31'31","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:07.507552+0000","last_change":"2024-09-12T17:32:07.507552+0000","last_active":"2024-09-12T17:32:07.507552+0000","last_peered":"2024-09-12T17:32:07.507552+0000","last_clean":"2024-09-12T17:32:07.507552+0000","last_became_active":"2024-09-12T17:27:46.441081+0000","last_became_peered":"2024-09-12T17:27:46.441081+0000","last_unstale":"2024-09-12T17:32:07.507552+0000","last_undegraded":"2024-09-12T17:32:07.507552+0000","last_fullsized":"2024-09-12T17:32:07.507552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'31","last_scrub_stamp":"2024-09-12T17:32:07.507459+0000","last_deep_scrub":"31'31","last_deep_scrub_stamp":"2024-09-12T17:32:07.507459+0000","last_clean_scrub_stamp":"2024-09-12T17:32:07.507459+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:22.985097+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:16.395318+0000","last_change":"2024-09-12T17:32:16.395318+0000","last_active":"2024-09-12T17:32:16.395318+0000","last_peered":"2024-09-12T17:32:16.395318+0000","last_clean":"2024-09-12T17:32:16.395318+0000","last_became_active":"2024-09-12T17:27:48.447321+0000","last_became_peered":"2024-09-12T17:27:48.447321+0000","last_unstale":"2024-09-12T17:32:16.395318+0000","last_undegraded":"2024-09-12T17:32:16.395318+0000","last_fullsized":"2024-09-12T17:32:16.395318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:32:16.395229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:32:16.395229+0000","last_clean_scrub_stamp":"2024-09-12T17:32:16.395229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:13.448016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"31'10","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:24.360212+0000","last_change":"2024-09-12T17:32:24.360105+0000","last_active":"2024-09-12T17:32:24.360212+0000","last_peered":"2024-09-12T17:32:24.360212+0000","last_clean":"2024-09-12T17:32:24.360212+0000","last_became_active":"2024-09-12T17:27:50.459463+0000","last_became_peered":"2024-09-12T17:27:50.459463+0000","last_unstale":"2024-09-12T17:32:24.360212+0000","last_undegraded":"2024-09-12T17:32:24.360212+0000","last_fullsized":"2024-09-12T17:32:24.360212+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-12T17:32:24.359994+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-12T17:32:24.359994+0000","last_clean_scrub_stamp":"2024-09-12T17:32:24.359994+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:44.154110+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"31'18","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:22.222776+0000","last_change":"2024-09-12T17:31:22.222693+0000","last_active":"2024-09-12T17:31:22.222776+0000","last_peered":"2024-09-12T17:31:22.222776+0000","last_clean":"2024-09-12T17:31:22.222776+0000","last_became_active":"2024-09-12T17:27:42.430021+0000","last_became_peered":"2024-09-12T17:27:42.430021+0000","last_unstale":"2024-09-12T17:31:22.222776+0000","last_undegraded":"2024-09-12T17:31:22.222776+0000","last_fullsized":"2024-09-12T17:31:22.222776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'18","last_scrub_stamp":"2024-09-12T17:31:22.222608+0000","last_deep_scrub":"31'18","last_deep_scrub_stamp":"2024-09-12T17:31:22.222608+0000","last_clean_scrub_stamp":"2024-09-12T17:31:22.222608+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:10.350058+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":76,"num_read_kb":68,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:07.302226+0000","last_change":"2024-09-12T17:31:07.302162+0000","last_active":"2024-09-12T17:31:07.302226+0000","last_peered":"2024-09-12T17:31:07.302226+0000","last_clean":"2024-09-12T17:31:07.302226+0000","last_became_active":"2024-09-12T17:27:40.415549+0000","last_became_peered":"2024-09-12T17:27:40.415549+0000","last_unstale":"2024-09-12T17:31:07.302226+0000","last_undegraded":"2024-09-12T17:31:07.302226+0000","last_fullsized":"2024-09-12T17:31:07.302226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:07.302079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:07.302079+0000","last_clean_scrub_stamp":"2024-09-12T17:31:07.302079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:31:42.747169+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"31'3","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:39.213415+0000","last_change":"2024-09-12T17:31:39.213346+0000","last_active":"2024-09-12T17:31:39.213415+0000","last_peered":"2024-09-12T17:31:39.213415+0000","last_clean":"2024-09-12T17:31:39.213415+0000","last_became_active":"2024-09-12T17:27:44.433037+0000","last_became_peered":"2024-09-12T17:27:44.433037+0000","last_unstale":"2024-09-12T17:31:39.213415+0000","last_undegraded":"2024-09-12T17:31:39.213415+0000","last_fullsized":"2024-09-12T17:31:39.213415+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-09-12T17:31:39.213265+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-09-12T17:31:39.213265+0000","last_clean_scrub_stamp":"2024-09-12T17:31:39.213265+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:46.499885+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"31'41","reported_seq":98,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:03.477841+0000","last_change":"2024-09-12T17:32:03.477841+0000","last_active":"2024-09-12T17:32:03.477841+0000","last_peered":"2024-09-12T17:32:03.477841+0000","last_clean":"2024-09-12T17:32:03.477841+0000","last_became_active":"2024-09-12T17:27:46.443316+0000","last_became_peered":"2024-09-12T17:27:46.443316+0000","last_unstale":"2024-09-12T17:32:03.477841+0000","last_undegraded":"2024-09-12T17:32:03.477841+0000","last_fullsized":"2024-09-12T17:32:03.477841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'41","last_scrub_stamp":"2024-09-12T17:32:03.477746+0000","last_deep_scrub":"31'41","last_deep_scrub_stamp":"2024-09-12T17:32:03.477746+0000","last_clean_scrub_stamp":"2024-09-12T17:32:03.477746+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:22.817346+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:50.051568+0000","last_change":"2024-09-12T17:31:50.051568+0000","last_active":"2024-09-12T17:31:50.051568+0000","last_peered":"2024-09-12T17:31:50.051568+0000","last_clean":"2024-09-12T17:31:50.051568+0000","last_became_active":"2024-09-12T17:27:48.447884+0000","last_became_peered":"2024-09-12T17:27:48.447884+0000","last_unstale":"2024-09-12T17:31:50.051568+0000","last_undegraded":"2024-09-12T17:31:50.051568+0000","last_fullsized":"2024-09-12T17:31:50.051568+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:50.051481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:50.051481+0000","last_clean_scrub_stamp":"2024-09-12T17:31:50.051481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:34.463798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"31'2","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:32:23.326757+0000","last_change":"2024-09-12T17:32:23.326693+0000","last_active":"2024-09-12T17:32:23.326757+0000","last_peered":"2024-09-12T17:32:23.326757+0000","last_clean":"2024-09-12T17:32:23.326757+0000","last_became_active":"2024-09-12T17:27:50.459464+0000","last_became_peered":"2024-09-12T17:27:50.459464+0000","last_unstale":"2024-09-12T17:32:23.326757+0000","last_undegraded":"2024-09-12T17:32:23.326757+0000","last_fullsized":"2024-09-12T17:32:23.326757+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:32:23.326601+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:32:23.326601+0000","last_clean_scrub_stamp":"2024-09-12T17:32:23.326601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:13.889755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"31'6","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:26.275546+0000","last_change":"2024-09-12T17:31:26.275546+0000","last_active":"2024-09-12T17:31:26.275546+0000","last_peered":"2024-09-12T17:31:26.275546+0000","last_clean":"2024-09-12T17:31:26.275546+0000","last_became_active":"2024-09-12T17:28:21.471738+0000","last_became_peered":"2024-09-12T17:28:21.471738+0000","last_unstale":"2024-09-12T17:31:26.275546+0000","last_undegraded":"2024-09-12T17:31:26.275546+0000","last_fullsized":"2024-09-12T17:31:26.275546+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-12T17:31:26.275465+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-12T17:31:26.275465+0000","last_clean_scrub_stamp":"2024-09-12T17:31:26.275465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:32.161098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:09.101188+0000","last_change":"2024-09-12T17:31:09.101122+0000","last_active":"2024-09-12T17:31:09.101188+0000","last_peered":"2024-09-12T17:31:09.101188+0000","last_clean":"2024-09-12T17:31:09.101188+0000","last_became_active":"2024-09-12T17:27:40.425150+0000","last_became_peered":"2024-09-12T17:27:40.425150+0000","last_unstale":"2024-09-12T17:31:09.101188+0000","last_undegraded":"2024-09-12T17:31:09.101188+0000","last_fullsized":"2024-09-12T17:31:09.101188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:09.101041+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:09.101041+0000","last_clean_scrub_stamp":"2024-09-12T17:31:09.101041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:11.434252+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"31'6","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:24.873600+0000","last_change":"2024-09-12T17:31:24.873531+0000","last_active":"2024-09-12T17:31:24.873600+0000","last_peered":"2024-09-12T17:31:24.873600+0000","last_clean":"2024-09-12T17:31:24.873600+0000","last_became_active":"2024-09-12T17:27:42.427745+0000","last_became_peered":"2024-09-12T17:27:42.427745+0000","last_unstale":"2024-09-12T17:31:24.873600+0000","last_undegraded":"2024-09-12T17:31:24.873600+0000","last_fullsized":"2024-09-12T17:31:24.873600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-12T17:31:24.873443+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-12T17:31:24.873443+0000","last_clean_scrub_stamp":"2024-09-12T17:31:24.873443+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:52.854740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:02.824340+0000","last_change":"2024-09-12T17:31:02.824281+0000","last_active":"2024-09-12T17:31:02.824340+0000","last_peered":"2024-09-12T17:31:02.824340+0000","last_clean":"2024-09-12T17:31:02.824340+0000","last_became_active":"2024-09-12T17:27:40.413068+0000","last_became_peered":"2024-09-12T17:27:40.413068+0000","last_unstale":"2024-09-12T17:31:02.824340+0000","last_undegraded":"2024-09-12T17:31:02.824340+0000","last_fullsized":"2024-09-12T17:31:02.824340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:02.824193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:02.824193+0000","last_clean_scrub_stamp":"2024-09-12T17:31:02.824193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:30.974235+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:40.553899+0000","last_change":"2024-09-12T17:31:40.553818+0000","last_active":"2024-09-12T17:31:40.553899+0000","last_peered":"2024-09-12T17:31:40.553899+0000","last_clean":"2024-09-12T17:31:40.553899+0000","last_became_active":"2024-09-12T17:27:42.428871+0000","last_became_peered":"2024-09-12T17:27:42.428871+0000","last_unstale":"2024-09-12T17:31:40.553899+0000","last_undegraded":"2024-09-12T17:31:40.553899+0000","last_fullsized":"2024-09-12T17:31:40.553899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:40.553702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:40.553702+0000","last_clean_scrub_stamp":"2024-09-12T17:31:40.553702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:04.977336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:19.436342+0000","last_change":"2024-09-12T17:31:19.436252+0000","last_active":"2024-09-12T17:31:19.436342+0000","last_peered":"2024-09-12T17:31:19.436342+0000","last_clean":"2024-09-12T17:31:19.436342+0000","last_became_active":"2024-09-12T17:27:40.423210+0000","last_became_peered":"2024-09-12T17:27:40.423210+0000","last_unstale":"2024-09-12T17:31:19.436342+0000","last_undegraded":"2024-09-12T17:31:19.436342+0000","last_fullsized":"2024-09-12T17:31:19.436342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:19.436168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:19.436168+0000","last_clean_scrub_stamp":"2024-09-12T17:31:19.436168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:08.266186+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"31'10","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:23.856534+0000","last_change":"2024-09-12T17:31:23.856443+0000","last_active":"2024-09-12T17:31:23.856534+0000","last_peered":"2024-09-12T17:31:23.856534+0000","last_clean":"2024-09-12T17:31:23.856534+0000","last_became_active":"2024-09-12T17:27:42.428059+0000","last_became_peered":"2024-09-12T17:27:42.428059+0000","last_unstale":"2024-09-12T17:31:23.856534+0000","last_undegraded":"2024-09-12T17:31:23.856534+0000","last_fullsized":"2024-09-12T17:31:23.856534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-12T17:31:23.856356+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-12T17:31:23.856356+0000","last_clean_scrub_stamp":"2024-09-12T17:31:23.856356+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:00.835509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:08.822490+0000","last_change":"2024-09-12T17:31:08.822428+0000","last_active":"2024-09-12T17:31:08.822490+0000","last_peered":"2024-09-12T17:31:08.822490+0000","last_clean":"2024-09-12T17:31:08.822490+0000","last_became_active":"2024-09-12T17:27:40.419018+0000","last_became_peered":"2024-09-12T17:27:40.419018+0000","last_unstale":"2024-09-12T17:31:08.822490+0000","last_undegraded":"2024-09-12T17:31:08.822490+0000","last_fullsized":"2024-09-12T17:31:08.822490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:08.822340+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:08.822340+0000","last_clean_scrub_stamp":"2024-09-12T17:31:08.822340+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:55.083405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"31'4","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:22.847898+0000","last_change":"2024-09-12T17:31:22.847810+0000","last_active":"2024-09-12T17:31:22.847898+0000","last_peered":"2024-09-12T17:31:22.847898+0000","last_clean":"2024-09-12T17:31:22.847898+0000","last_became_active":"2024-09-12T17:27:42.424201+0000","last_became_peered":"2024-09-12T17:27:42.424201+0000","last_unstale":"2024-09-12T17:31:22.847898+0000","last_undegraded":"2024-09-12T17:31:22.847898+0000","last_fullsized":"2024-09-12T17:31:22.847898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:22.847723+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:22.847723+0000","last_clean_scrub_stamp":"2024-09-12T17:31:22.847723+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:19.505548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:14.865492+0000","last_change":"2024-09-12T17:31:14.865433+0000","last_active":"2024-09-12T17:31:14.865492+0000","last_peered":"2024-09-12T17:31:14.865492+0000","last_clean":"2024-09-12T17:31:14.865492+0000","last_became_active":"2024-09-12T17:27:40.415318+0000","last_became_peered":"2024-09-12T17:27:40.415318+0000","last_unstale":"2024-09-12T17:31:14.865492+0000","last_undegraded":"2024-09-12T17:31:14.865492+0000","last_fullsized":"2024-09-12T17:31:14.865492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:14.865333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:14.865333+0000","last_clean_scrub_stamp":"2024-09-12T17:31:14.865333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:46.192766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"31'6","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:20.343411+0000","last_change":"2024-09-12T17:31:20.343357+0000","last_active":"2024-09-12T17:31:20.343411+0000","last_peered":"2024-09-12T17:31:20.343411+0000","last_clean":"2024-09-12T17:31:20.343411+0000","last_became_active":"2024-09-12T17:27:42.434664+0000","last_became_peered":"2024-09-12T17:27:42.434664+0000","last_unstale":"2024-09-12T17:31:20.343411+0000","last_undegraded":"2024-09-12T17:31:20.343411+0000","last_fullsized":"2024-09-12T17:31:20.343411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-12T17:31:20.343275+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-12T17:31:20.343275+0000","last_clean_scrub_stamp":"2024-09-12T17:31:20.343275+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:35.315488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:09.264981+0000","last_change":"2024-09-12T17:31:09.264861+0000","last_active":"2024-09-12T17:31:09.264981+0000","last_peered":"2024-09-12T17:31:09.264981+0000","last_clean":"2024-09-12T17:31:09.264981+0000","last_became_active":"2024-09-12T17:27:40.420491+0000","last_became_peered":"2024-09-12T17:27:40.420491+0000","last_unstale":"2024-09-12T17:31:09.264981+0000","last_undegraded":"2024-09-12T17:31:09.264981+0000","last_fullsized":"2024-09-12T17:31:09.264981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:09.264760+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:09.264760+0000","last_clean_scrub_stamp":"2024-09-12T17:31:09.264760+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:08.584209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"31'10","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:20.791830+0000","last_change":"2024-09-12T17:31:20.791706+0000","last_active":"2024-09-12T17:31:20.791830+0000","last_peered":"2024-09-12T17:31:20.791830+0000","last_clean":"2024-09-12T17:31:20.791830+0000","last_became_active":"2024-09-12T17:27:42.424810+0000","last_became_peered":"2024-09-12T17:27:42.424810+0000","last_unstale":"2024-09-12T17:31:20.791830+0000","last_undegraded":"2024-09-12T17:31:20.791830+0000","last_fullsized":"2024-09-12T17:31:20.791830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-12T17:31:20.791597+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-12T17:31:20.791597+0000","last_clean_scrub_stamp":"2024-09-12T17:31:20.791597+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:27.739428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":37,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:10.132458+0000","last_change":"2024-09-12T17:31:10.132403+0000","last_active":"2024-09-12T17:31:10.132458+0000","last_peered":"2024-09-12T17:31:10.132458+0000","last_clean":"2024-09-12T17:31:10.132458+0000","last_became_active":"2024-09-12T17:27:40.431365+0000","last_became_peered":"2024-09-12T17:27:40.431365+0000","last_unstale":"2024-09-12T17:31:10.132458+0000","last_undegraded":"2024-09-12T17:31:10.132458+0000","last_fullsized":"2024-09-12T17:31:10.132458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:10.132310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:10.132310+0000","last_clean_scrub_stamp":"2024-09-12T17:31:10.132310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:29.172061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"31'13","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:18.349683+0000","last_change":"2024-09-12T17:31:18.349579+0000","last_active":"2024-09-12T17:31:18.349683+0000","last_peered":"2024-09-12T17:31:18.349683+0000","last_clean":"2024-09-12T17:31:18.349683+0000","last_became_active":"2024-09-12T17:27:42.423099+0000","last_became_peered":"2024-09-12T17:27:42.423099+0000","last_unstale":"2024-09-12T17:31:18.349683+0000","last_undegraded":"2024-09-12T17:31:18.349683+0000","last_fullsized":"2024-09-12T17:31:18.349683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'13","last_scrub_stamp":"2024-09-12T17:31:18.349454+0000","last_deep_scrub":"31'13","last_deep_scrub_stamp":"2024-09-12T17:31:18.349454+0000","last_clean_scrub_stamp":"2024-09-12T17:31:18.349454+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:26.892025+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:06.750083+0000","last_change":"2024-09-12T17:31:06.750029+0000","last_active":"2024-09-12T17:31:06.750083+0000","last_peered":"2024-09-12T17:31:06.750083+0000","last_clean":"2024-09-12T17:31:06.750083+0000","last_became_active":"2024-09-12T17:27:40.415456+0000","last_became_peered":"2024-09-12T17:27:40.415456+0000","last_unstale":"2024-09-12T17:31:06.750083+0000","last_undegraded":"2024-09-12T17:31:06.750083+0000","last_fullsized":"2024-09-12T17:31:06.750083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:06.749935+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:06.749935+0000","last_clean_scrub_stamp":"2024-09-12T17:31:06.749935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:24:59.406146+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"31'8","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:24.348264+0000","last_change":"2024-09-12T17:31:24.348206+0000","last_active":"2024-09-12T17:31:24.348264+0000","last_peered":"2024-09-12T17:31:24.348264+0000","last_clean":"2024-09-12T17:31:24.348264+0000","last_became_active":"2024-09-12T17:27:42.427778+0000","last_became_peered":"2024-09-12T17:27:42.427778+0000","last_unstale":"2024-09-12T17:31:24.348264+0000","last_undegraded":"2024-09-12T17:31:24.348264+0000","last_fullsized":"2024-09-12T17:31:24.348264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:24.348117+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:24.348117+0000","last_clean_scrub_stamp":"2024-09-12T17:31:24.348117+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:42.991869+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:23.444728+0000","last_change":"2024-09-12T17:31:23.444668+0000","last_active":"2024-09-12T17:31:23.444728+0000","last_peered":"2024-09-12T17:31:23.444728+0000","last_clean":"2024-09-12T17:31:23.444728+0000","last_became_active":"2024-09-12T17:27:40.418241+0000","last_became_peered":"2024-09-12T17:27:40.418241+0000","last_unstale":"2024-09-12T17:31:23.444728+0000","last_undegraded":"2024-09-12T17:31:23.444728+0000","last_fullsized":"2024-09-12T17:31:23.444728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:23.444583+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:23.444583+0000","last_clean_scrub_stamp":"2024-09-12T17:31:23.444583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:46:46.884073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"31'2","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:41.511411+0000","last_change":"2024-09-12T17:31:41.511321+0000","last_active":"2024-09-12T17:31:41.511411+0000","last_peered":"2024-09-12T17:31:41.511411+0000","last_clean":"2024-09-12T17:31:41.511411+0000","last_became_active":"2024-09-12T17:27:42.433084+0000","last_became_peered":"2024-09-12T17:27:42.433084+0000","last_unstale":"2024-09-12T17:31:41.511411+0000","last_undegraded":"2024-09-12T17:31:41.511411+0000","last_fullsized":"2024-09-12T17:31:41.511411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:41.511229+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:41.511229+0000","last_clean_scrub_stamp":"2024-09-12T17:31:41.511229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:43.558896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:07.773920+0000","last_change":"2024-09-12T17:31:07.773832+0000","last_active":"2024-09-12T17:31:07.773920+0000","last_peered":"2024-09-12T17:31:07.773920+0000","last_clean":"2024-09-12T17:31:07.773920+0000","last_became_active":"2024-09-12T17:27:40.417666+0000","last_became_peered":"2024-09-12T17:27:40.417666+0000","last_unstale":"2024-09-12T17:31:07.773920+0000","last_undegraded":"2024-09-12T17:31:07.773920+0000","last_fullsized":"2024-09-12T17:31:07.773920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:07.773746+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:07.773746+0000","last_clean_scrub_stamp":"2024-09-12T17:31:07.773746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:55.901197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"31'8","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:25.906785+0000","last_change":"2024-09-12T17:31:25.906704+0000","last_active":"2024-09-12T17:31:25.906785+0000","last_peered":"2024-09-12T17:31:25.906785+0000","last_clean":"2024-09-12T17:31:25.906785+0000","last_became_active":"2024-09-12T17:27:42.424017+0000","last_became_peered":"2024-09-12T17:27:42.424017+0000","last_unstale":"2024-09-12T17:31:25.906785+0000","last_undegraded":"2024-09-12T17:31:25.906785+0000","last_fullsized":"2024-09-12T17:31:25.906785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:25.906608+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:25.906608+0000","last_clean_scrub_stamp":"2024-09-12T17:31:25.906608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:34.656639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:08.294912+0000","last_change":"2024-09-12T17:31:08.294816+0000","last_active":"2024-09-12T17:31:08.294912+0000","last_peered":"2024-09-12T17:31:08.294912+0000","last_clean":"2024-09-12T17:31:08.294912+0000","last_became_active":"2024-09-12T17:27:40.418964+0000","last_became_peered":"2024-09-12T17:27:40.418964+0000","last_unstale":"2024-09-12T17:31:08.294912+0000","last_undegraded":"2024-09-12T17:31:08.294912+0000","last_fullsized":"2024-09-12T17:31:08.294912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:08.294725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:08.294725+0000","last_clean_scrub_stamp":"2024-09-12T17:31:08.294725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:15.392350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"31'6","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:23.297367+0000","last_change":"2024-09-12T17:31:23.297312+0000","last_active":"2024-09-12T17:31:23.297367+0000","last_peered":"2024-09-12T17:31:23.297367+0000","last_clean":"2024-09-12T17:31:23.297367+0000","last_became_active":"2024-09-12T17:27:42.422955+0000","last_became_peered":"2024-09-12T17:27:42.422955+0000","last_unstale":"2024-09-12T17:31:23.297367+0000","last_undegraded":"2024-09-12T17:31:23.297367+0000","last_fullsized":"2024-09-12T17:31:23.297367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-12T17:31:23.297230+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-12T17:31:23.297230+0000","last_clean_scrub_stamp":"2024-09-12T17:31:23.297230+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:30.245061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:11.276747+0000","last_change":"2024-09-12T17:31:11.276659+0000","last_active":"2024-09-12T17:31:11.276747+0000","last_peered":"2024-09-12T17:31:11.276747+0000","last_clean":"2024-09-12T17:31:11.276747+0000","last_became_active":"2024-09-12T17:27:40.418183+0000","last_became_peered":"2024-09-12T17:27:40.418183+0000","last_unstale":"2024-09-12T17:31:11.276747+0000","last_undegraded":"2024-09-12T17:31:11.276747+0000","last_fullsized":"2024-09-12T17:31:11.276747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:11.276556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:11.276556+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.276556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:59.404006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"31'6","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:22.333239+0000","last_change":"2024-09-12T17:31:22.333174+0000","last_active":"2024-09-12T17:31:22.333239+0000","last_peered":"2024-09-12T17:31:22.333239+0000","last_clean":"2024-09-12T17:31:22.333239+0000","last_became_active":"2024-09-12T17:27:42.433856+0000","last_became_peered":"2024-09-12T17:27:42.433856+0000","last_unstale":"2024-09-12T17:31:22.333239+0000","last_undegraded":"2024-09-12T17:31:22.333239+0000","last_fullsized":"2024-09-12T17:31:22.333239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-12T17:31:22.333089+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-12T17:31:22.333089+0000","last_clean_scrub_stamp":"2024-09-12T17:31:22.333089+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:11.543481+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:20.447986+0000","last_change":"2024-09-12T17:31:20.447899+0000","last_active":"2024-09-12T17:31:20.447986+0000","last_peered":"2024-09-12T17:31:20.447986+0000","last_clean":"2024-09-12T17:31:20.447986+0000","last_became_active":"2024-09-12T17:27:40.428213+0000","last_became_peered":"2024-09-12T17:27:40.428213+0000","last_unstale":"2024-09-12T17:31:20.447986+0000","last_undegraded":"2024-09-12T17:31:20.447986+0000","last_fullsized":"2024-09-12T17:31:20.447986+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:20.447796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:20.447796+0000","last_clean_scrub_stamp":"2024-09-12T17:31:20.447796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:46.194594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"31'4","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:25.320800+0000","last_change":"2024-09-12T17:31:25.320720+0000","last_active":"2024-09-12T17:31:25.320800+0000","last_peered":"2024-09-12T17:31:25.320800+0000","last_clean":"2024-09-12T17:31:25.320800+0000","last_became_active":"2024-09-12T17:27:42.431562+0000","last_became_peered":"2024-09-12T17:27:42.431562+0000","last_unstale":"2024-09-12T17:31:25.320800+0000","last_undegraded":"2024-09-12T17:31:25.320800+0000","last_fullsized":"2024-09-12T17:31:25.320800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:25.320637+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:25.320637+0000","last_clean_scrub_stamp":"2024-09-12T17:31:25.320637+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:21.978461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"31'4","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:21.435633+0000","last_change":"2024-09-12T17:31:21.435534+0000","last_active":"2024-09-12T17:31:21.435633+0000","last_peered":"2024-09-12T17:31:21.435633+0000","last_clean":"2024-09-12T17:31:21.435633+0000","last_became_active":"2024-09-12T17:27:40.425910+0000","last_became_peered":"2024-09-12T17:27:40.425910+0000","last_unstale":"2024-09-12T17:31:21.435633+0000","last_undegraded":"2024-09-12T17:31:21.435633+0000","last_fullsized":"2024-09-12T17:31:21.435633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:21.435416+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:21.435416+0000","last_clean_scrub_stamp":"2024-09-12T17:31:21.435416+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:50.263995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"31'10","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:46.497639+0000","last_change":"2024-09-12T17:31:46.497582+0000","last_active":"2024-09-12T17:31:46.497639+0000","last_peered":"2024-09-12T17:31:46.497639+0000","last_clean":"2024-09-12T17:31:46.497639+0000","last_became_active":"2024-09-12T17:27:42.429270+0000","last_became_peered":"2024-09-12T17:27:42.429270+0000","last_unstale":"2024-09-12T17:31:46.497639+0000","last_undegraded":"2024-09-12T17:31:46.497639+0000","last_fullsized":"2024-09-12T17:31:46.497639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-09-12T17:31:46.497497+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-09-12T17:31:46.497497+0000","last_clean_scrub_stamp":"2024-09-12T17:31:46.497497+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:43.001937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:11.107455+0000","last_change":"2024-09-12T17:31:11.107395+0000","last_active":"2024-09-12T17:31:11.107455+0000","last_peered":"2024-09-12T17:31:11.107455+0000","last_clean":"2024-09-12T17:31:11.107455+0000","last_became_active":"2024-09-12T17:27:40.431687+0000","last_became_peered":"2024-09-12T17:27:40.431687+0000","last_unstale":"2024-09-12T17:31:11.107455+0000","last_undegraded":"2024-09-12T17:31:11.107455+0000","last_fullsized":"2024-09-12T17:31:11.107455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:11.107302+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:11.107302+0000","last_clean_scrub_stamp":"2024-09-12T17:31:11.107302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:52.875838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"31'4","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:21.328197+0000","last_change":"2024-09-12T17:31:21.328105+0000","last_active":"2024-09-12T17:31:21.328197+0000","last_peered":"2024-09-12T17:31:21.328197+0000","last_clean":"2024-09-12T17:31:21.328197+0000","last_became_active":"2024-09-12T17:27:42.424910+0000","last_became_peered":"2024-09-12T17:27:42.424910+0000","last_unstale":"2024-09-12T17:31:21.328197+0000","last_undegraded":"2024-09-12T17:31:21.328197+0000","last_fullsized":"2024-09-12T17:31:21.328197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:21.328005+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:21.328005+0000","last_clean_scrub_stamp":"2024-09-12T17:31:21.328005+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:38.959884+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:26.570776+0000","last_change":"2024-09-12T17:31:26.570705+0000","last_active":"2024-09-12T17:31:26.570776+0000","last_peered":"2024-09-12T17:31:26.570776+0000","last_clean":"2024-09-12T17:31:26.570776+0000","last_became_active":"2024-09-12T17:27:40.433649+0000","last_became_peered":"2024-09-12T17:27:40.433649+0000","last_unstale":"2024-09-12T17:31:26.570776+0000","last_undegraded":"2024-09-12T17:31:26.570776+0000","last_fullsized":"2024-09-12T17:31:26.570776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:26.570609+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:26.570609+0000","last_clean_scrub_stamp":"2024-09-12T17:31:26.570609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:50.953136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:27.530222+0000","last_change":"2024-09-12T17:31:27.530165+0000","last_active":"2024-09-12T17:31:27.530222+0000","last_peered":"2024-09-12T17:31:27.530222+0000","last_clean":"2024-09-12T17:31:27.530222+0000","last_became_active":"2024-09-12T17:27:40.423343+0000","last_became_peered":"2024-09-12T17:27:40.423343+0000","last_unstale":"2024-09-12T17:31:27.530222+0000","last_undegraded":"2024-09-12T17:31:27.530222+0000","last_fullsized":"2024-09-12T17:31:27.530222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T17:31:27.530082+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T17:31:27.530082+0000","last_clean_scrub_stamp":"2024-09-12T17:31:27.530082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:50.850315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"31'8","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:27.881171+0000","last_change":"2024-09-12T17:31:27.881064+0000","last_active":"2024-09-12T17:31:27.881171+0000","last_peered":"2024-09-12T17:31:27.881171+0000","last_clean":"2024-09-12T17:31:27.881171+0000","last_became_active":"2024-09-12T17:27:42.426150+0000","last_became_peered":"2024-09-12T17:27:42.426150+0000","last_unstale":"2024-09-12T17:31:27.881171+0000","last_undegraded":"2024-09-12T17:31:27.881171+0000","last_fullsized":"2024-09-12T17:31:27.881171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-09-12T17:31:27.880963+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-09-12T17:31:27.880963+0000","last_clean_scrub_stamp":"2024-09-12T17:31:27.880963+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:19.026284+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:10.897325+0000","last_change":"2024-09-12T17:31:10.897255+0000","last_active":"2024-09-12T17:31:10.897325+0000","last_peered":"2024-09-12T17:31:10.897325+0000","last_clean":"2024-09-12T17:31:10.897325+0000","last_became_active":"2024-09-12T17:27:40.420396+0000","last_became_peered":"2024-09-12T17:27:40.420396+0000","last_unstale":"2024-09-12T17:31:10.897325+0000","last_undegraded":"2024-09-12T17:31:10.897325+0000","last_fullsized":"2024-09-12T17:31:10.897325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:31:10.897168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:31:10.897168+0000","last_clean_scrub_stamp":"2024-09-12T17:31:10.897168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:17.103760+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"31'4","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T17:31:29.307246+0000","last_change":"2024-09-12T17:31:29.307191+0000","last_active":"2024-09-12T17:31:29.307246+0000","last_peered":"2024-09-12T17:31:29.307246+0000","last_clean":"2024-09-12T17:31:29.307246+0000","last_became_active":"2024-09-12T17:27:42.435324+0000","last_became_peered":"2024-09-12T17:27:42.435324+0000","last_unstale":"2024-09-12T17:31:29.307246+0000","last_undegraded":"2024-09-12T17:31:29.307246+0000","last_fullsized":"2024-09-12T17:31:29.307246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-09-12T17:31:29.307110+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-09-12T17:31:29.307110+0000","last_clean_scrub_stamp":"2024-09-12T17:31:29.307110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:55.863554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2288,"ondisk_log_size":2288,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1557,"ondisk_log_size":1557,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":482,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1662,"num_read_kb":1552,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":481,"ondisk_log_size":481,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673027,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":446464,"data_stored":134267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705730,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":983040,"data_stored":724195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705730,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1007616,"data_stored":723592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705731,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31588,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340252,"statfs":{"total":96636764160,"available":96604418048,"internally_reserved":0,"allocated":413696,"data_stored":134210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:32:43.418 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T17:32:43.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.541+0000 7feb8b307640 1 Processor -- start 2024-09-12T17:32:43.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.541+0000 7feb8b307640 1 -- start start 2024-09-12T17:32:43.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.541+0000 7feb8b307640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7feb84097050 0x7feb84094520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:32:43.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.541+0000 7feb8b307640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb840977c0 con 0x7feb840965a0 2024-09-12T17:32:43.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.541+0000 7feb8b307640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7feb84099fb0 con 0x7feb84097050 2024-09-12T17:32:43.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.541+0000 7feb888a2640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7feb84097050 0x7feb84094520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:32:43.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.541+0000 7feb890a3640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7feb840965a0 0x7feb840998a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35822/0 (socket says 172.21.15.47:35822) 2024-09-12T17:32:43.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.541+0000 7feb890a3640 1 -- 172.21.15.47:0/1738242729 learned_addr learned my addr 172.21.15.47:0/1738242729 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-09-12T17:32:43.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.542+0000 7feb888a2640 1 -- 172.21.15.47:0/1738242729 >> v1:172.21.15.47:6789/0 conn(0x7feb840965a0 legacy=0x7feb840998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:32:43.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.542+0000 7feb888a2640 1 -- 172.21.15.47:0/1738242729 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb8409a3a0 con 0x7feb84097050 2024-09-12T17:32:43.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.542+0000 7feb888a2640 1 --2- 172.21.15.47:0/1738242729 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb84097050 0x7feb84094520 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7feb74009720 tx=0x7feb7402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1b54f582605bae9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:32:43.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.542+0000 7feb7bfff640 1 -- 172.21.15.47:0/1738242729 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb74037070 con 0x7feb84097050 2024-09-12T17:32:43.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.542+0000 7feb7bfff640 1 -- 172.21.15.47:0/1738242729 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb7402ad90 con 0x7feb84097050 2024-09-12T17:32:43.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.542+0000 7feb7bfff640 1 -- 172.21.15.47:0/1738242729 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb74032590 con 0x7feb84097050 2024-09-12T17:32:43.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.543+0000 7feb8b307640 1 -- 172.21.15.47:0/1738242729 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb84097050 msgr2=0x7feb84094520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:32:43.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.543+0000 7feb8b307640 1 --2- 172.21.15.47:0/1738242729 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb84097050 0x7feb84094520 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7feb74009720 tx=0x7feb7402a110 comp rx=0 tx=0).stop 2024-09-12T17:32:43.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.543+0000 7feb8b307640 1 -- 172.21.15.47:0/1738242729 shutdown_connections 2024-09-12T17:32:43.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.543+0000 7feb8b307640 1 --2- 172.21.15.47:0/1738242729 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb84097050 0x7feb84094520 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:32:43.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.543+0000 7feb8b307640 1 -- 172.21.15.47:0/1738242729 >> 172.21.15.47:0/1738242729 conn(0x7feb8409a930 msgr2=0x7feb8409ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:32:43.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.543+0000 7feb8b307640 1 -- 172.21.15.47:0/1738242729 shutdown_connections 2024-09-12T17:32:43.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.543+0000 7feb8b307640 1 -- 172.21.15.47:0/1738242729 wait complete. 2024-09-12T17:32:43.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.544+0000 7feb8b307640 1 Processor -- start 2024-09-12T17:32:43.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.544+0000 7feb8b307640 1 -- start start 2024-09-12T17:32:43.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.544+0000 7feb8b307640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb840965a0 0x7feb841300a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:32:43.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.544+0000 7feb8b307640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7feb84094df0 con 0x7feb840965a0 2024-09-12T17:32:43.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.544+0000 7feb890a3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb840965a0 0x7feb841300a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:32:43.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.544+0000 7feb890a3640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb840965a0 0x7feb841300a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37614/0 (socket says 172.21.15.47:37614) 2024-09-12T17:32:43.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.544+0000 7feb890a3640 1 -- 172.21.15.47:0/4220103869 learned_addr learned my addr 172.21.15.47:0/4220103869 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-12T17:32:43.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.545+0000 7feb890a3640 1 -- 172.21.15.47:0/4220103869 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb8406e440 con 0x7feb840965a0 2024-09-12T17:32:43.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.545+0000 7feb890a3640 1 --2- 172.21.15.47:0/4220103869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb840965a0 0x7feb841300a0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7feb8000c480 tx=0x7feb8000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:32:43.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.545+0000 7feb79ffb640 1 -- 172.21.15.47:0/4220103869 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb80017070 con 0x7feb840965a0 2024-09-12T17:32:43.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.545+0000 7feb79ffb640 1 -- 172.21.15.47:0/4220103869 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb80005c10 con 0x7feb840965a0 2024-09-12T17:32:43.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.545+0000 7feb79ffb640 1 -- 172.21.15.47:0/4220103869 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb80007070 con 0x7feb840965a0 2024-09-12T17:32:43.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.545+0000 7feb8b307640 1 -- 172.21.15.47:0/4220103869 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb84131470 con 0x7feb840965a0 2024-09-12T17:32:43.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.545+0000 7feb8b307640 1 -- 172.21.15.47:0/4220103869 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb84073750 con 0x7feb840965a0 2024-09-12T17:32:43.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.546+0000 7feb79ffb640 1 -- 172.21.15.47:0/4220103869 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7feb8001a070 con 0x7feb840965a0 2024-09-12T17:32:43.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.546+0000 7feb8b307640 1 -- 172.21.15.47:0/4220103869 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb84095430 con 0x7feb840965a0 2024-09-12T17:32:43.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.546+0000 7feb79ffb640 1 --2- 172.21.15.47:0/4220103869 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7feb6803dec0 0x7feb68040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:32:43.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.546+0000 7feb79ffb640 1 -- 172.21.15.47:0/4220103869 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5967+0+0 (secure 0 0 0) 0x7feb80051e00 con 0x7feb840965a0 2024-09-12T17:32:43.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.547+0000 7feb888a2640 1 --2- 172.21.15.47:0/4220103869 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7feb6803dec0 0x7feb68040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:32:43.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.547+0000 7feb888a2640 1 --2- 172.21.15.47:0/4220103869 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7feb6803dec0 0x7feb68040380 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7feb74034000 tx=0x7feb7402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:32:43.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.551+0000 7feb79ffb640 1 -- 172.21.15.47:0/4220103869 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7feb84095430 con 0x7feb840965a0 2024-09-12T17:32:43.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.736+0000 7feb8b307640 1 -- 172.21.15.47:0/4220103869 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7feb84093c40 con 0x7feb840965a0 2024-09-12T17:32:43.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.738+0000 7feb79ffb640 1 -- 172.21.15.47:0/4220103869 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7feb84093c40 con 0x7feb840965a0 2024-09-12T17:32:43.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.739+0000 7feb79ffb640 1 -- 172.21.15.47:0/4220103869 <== mon.0 v2:172.21.15.47:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7feb80019840 con 0x7feb840965a0 2024-09-12T17:32:43.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.741+0000 7feb8b307640 1 -- 172.21.15.47:0/4220103869 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7feb6803dec0 msgr2=0x7feb68040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:32:43.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.741+0000 7feb8b307640 1 --2- 172.21.15.47:0/4220103869 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7feb6803dec0 0x7feb68040380 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7feb74034000 tx=0x7feb7402e000 comp rx=0 tx=0).stop 2024-09-12T17:32:43.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.741+0000 7feb8b307640 1 -- 172.21.15.47:0/4220103869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb840965a0 msgr2=0x7feb841300a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:32:43.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.741+0000 7feb8b307640 1 --2- 172.21.15.47:0/4220103869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb840965a0 0x7feb841300a0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7feb8000c480 tx=0x7feb8000c940 comp rx=0 tx=0).stop 2024-09-12T17:32:43.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.741+0000 7feb8b307640 1 -- 172.21.15.47:0/4220103869 shutdown_connections 2024-09-12T17:32:43.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.741+0000 7feb8b307640 1 --2- 172.21.15.47:0/4220103869 >> [v2:172.21.15.170:6824/4146902489,v1:172.21.15.170:6825/4146902489] conn(0x7feb6803dec0 0x7feb68040380 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:32:43.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.741+0000 7feb8b307640 1 --2- 172.21.15.47:0/4220103869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb840965a0 0x7feb841300a0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:32:43.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.741+0000 7feb8b307640 1 -- 172.21.15.47:0/4220103869 >> 172.21.15.47:0/4220103869 conn(0x7feb8409a930 msgr2=0x7feb84124d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:32:43.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.741+0000 7feb8b307640 1 -- 172.21.15.47:0/4220103869 shutdown_connections 2024-09-12T17:32:43.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:32:43.741+0000 7feb8b307640 1 -- 172.21.15.47:0/4220103869 wait complete. 2024-09-12T17:32:43.752 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T17:32:43.753 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T17:32:43.753 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T17:32:43.753 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T17:32:43.801 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T17:32:43.801 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T17:32:43.801 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T17:32:43.838 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T17:32:43.838 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T17:32:43.838 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T17:32:43.908 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T17:32:43.909 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-12T17:32:43.909 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T17:32:43.977 INFO:tasks.ceph.osd.3:Stopped 2024-09-12T17:32:43.977 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T17:32:43.977 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T17:32:43.978 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T17:32:44.047 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T17:32:44.047 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T17:32:44.047 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T17:32:44.048 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T17:32:44.058 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T17:32:44.059 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T17:32:44.059 DEBUG:teuthology.orchestra.run.smithi047:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-09-12T17:32:44.132 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi047.front.sepia.ceph.com 2024-09-12T17:32:44.132 DEBUG:teuthology.orchestra.run.smithi047:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T17:32:44.284 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi170.front.sepia.ceph.com 2024-09-12T17:32:44.285 DEBUG:teuthology.orchestra.run.smithi170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T17:32:44.440 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi170.front.sepia.ceph.com 2024-09-12T17:32:44.440 DEBUG:teuthology.orchestra.run.smithi170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T17:32:44.522 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi170.front.sepia.ceph.com 2024-09-12T17:32:44.522 DEBUG:teuthology.orchestra.run.smithi170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-12T17:32:44.588 INFO:tasks.ceph:Archiving mon data... 2024-09-12T17:32:44.590 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902730/data/mon.a.tgz 2024-09-12T17:32:44.590 DEBUG:teuthology.orchestra.run.smithi047:> mktemp 2024-09-12T17:32:44.607 INFO:teuthology.orchestra.run.smithi047.stdout:/tmp/tmp.OnECNKPsLK 2024-09-12T17:32:44.607 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.OnECNKPsLK 2024-09-12T17:32:44.753 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0666 /tmp/tmp.OnECNKPsLK 2024-09-12T17:32:44.838 DEBUG:teuthology.orchestra.remote:smithi047:/tmp/tmp.OnECNKPsLK is 275KB 2024-09-12T17:32:44.935 DEBUG:teuthology.orchestra.run.smithi047:> rm -fr /tmp/tmp.OnECNKPsLK 2024-09-12T17:32:44.950 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T17:32:44.950 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T17:32:44.992 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T17:32:45.072 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T17:32:45.091 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T17:32:45.091 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T17:32:45.093 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902730/remote/smithi047/crash 2024-09-12T17:32:45.093 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T17:32:45.137 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902730/remote/smithi170/crash 2024-09-12T17:32:45.138 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T17:32:45.179 INFO:tasks.ceph:Compressing logs... 2024-09-12T17:32:45.179 DEBUG:teuthology.orchestra.run.smithi047:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T17:32:45.181 DEBUG:teuthology.orchestra.run.smithi170:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T17:32:45.204 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T17:32:45.204 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31138.log 2024-09-12T17:32:45.205 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31684.log 2024-09-12T17:32:45.223 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.31138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30513.log 2024-09-12T17:32:45.224 INFO:teuthology.orchestra.run.smithi047.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31138.log.gz 2024-09-12T17:32:45.224 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.31684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30411.log 2024-09-12T17:32:45.224 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.30513.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.31684.log.gz 2024-09-12T17:32:45.224 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31600.log 2024-09-12T17:32:45.224 INFO:teuthology.orchestra.run.smithi047.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.30513.log.gz 2024-09-12T17:32:45.224 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.30411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30828.log 2024-09-12T17:32:45.224 INFO:teuthology.orchestra.run.smithi047.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.30411.log.gz 2024-09-12T17:32:45.224 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.31600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30153.log 2024-09-12T17:32:45.224 INFO:teuthology.orchestra.run.smithi047.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.31600.log.gz 2024-09-12T17:32:45.224 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.30828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30209.log 2024-09-12T17:32:45.224 INFO:teuthology.orchestra.run.smithi047.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.30828.log.gz 2024-09-12T17:32:45.224 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.30153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31432.log 2024-09-12T17:32:45.225 INFO:teuthology.orchestra.run.smithi047.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.30153.log.gz 2024-09-12T17:32:45.225 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.30209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31642.log 2024-09-12T17:32:45.225 INFO:teuthology.orchestra.run.smithi047.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.30209.log.gz 2024-09-12T17:32:45.225 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.31432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30512.log 2024-09-12T17:32:45.225 INFO:teuthology.orchestra.run.smithi047.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.31432.log.gz 2024-09-12T17:32:45.225 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.31642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31516.log 2024-09-12T17:32:45.225 INFO:teuthology.orchestra.run.smithi047.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.31642.log.gz 2024-09-12T17:32:45.225 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.30512.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27109.log 2024-09-12T17:32:45.225 INFO:teuthology.orchestra.run.smithi047.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.30512.log.gz 2024-09-12T17:32:45.225 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.31516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30285.log 2024-09-12T17:32:45.225 INFO:teuthology.orchestra.run.smithi047.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.31516.log.gz 2024-09-12T17:32:45.225 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph.tmp-client.admin.27109.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T17:32:45.225 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27109.log.gz 2024-09-12T17:32:45.225 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.30285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30369.log 2024-09-12T17:32:45.226 INFO:teuthology.orchestra.run.smithi047.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.30285.log.gz 2024-09-12T17:32:45.226 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28948.log 2024-09-12T17:32:45.226 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.30369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30679.log 2024-09-12T17:32:45.226 INFO:teuthology.orchestra.run.smithi047.stderr: 88.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T17:32:45.226 INFO:teuthology.orchestra.run.smithi047.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.30369.log.gz 2024-09-12T17:32:45.226 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.28948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31041.log 2024-09-12T17:32:45.226 INFO:teuthology.orchestra.run.smithi047.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.28948.log.gz 2024-09-12T17:32:45.226 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.30679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30511.log 2024-09-12T17:32:45.226 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.31041.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.30679.log.gz 2024-09-12T17:32:45.226 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30681.log 2024-09-12T17:32:45.226 INFO:teuthology.orchestra.run.smithi047.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.31041.log.gz 2024-09-12T17:32:45.226 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.30511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31768.log 2024-09-12T17:32:45.226 INFO:teuthology.orchestra.run.smithi047.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.30511.log.gz 2024-09-12T17:32:45.227 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.30681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30678.log 2024-09-12T17:32:45.227 INFO:teuthology.orchestra.run.smithi047.stderr: 86.8%/var/log/ceph/ceph-client.admin.31768.log: -- replaced with /var/log/ceph/ceph-client.admin.30681.log.gz 2024-09-12T17:32:45.227 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31222.log 2024-09-12T17:32:45.227 INFO:teuthology.orchestra.run.smithi047.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.31768.log.gz 2024-09-12T17:32:45.227 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.30678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31726.log 2024-09-12T17:32:45.227 INFO:teuthology.orchestra.run.smithi047.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.30678.log.gz 2024-09-12T17:32:45.227 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.31222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30510.log 2024-09-12T17:32:45.227 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.31726.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.31222.log.gz 2024-09-12T17:32:45.227 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T17:32:45.227 INFO:teuthology.orchestra.run.smithi047.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.31726.log.gz 2024-09-12T17:32:45.227 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.30510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31810.log 2024-09-12T17:32:45.227 INFO:teuthology.orchestra.run.smithi047.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.30510.log.gz 2024-09-12T17:32:45.227 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28989.log 2024-09-12T17:32:45.227 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.31810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30680.log 2024-09-12T17:32:45.228 INFO:teuthology.orchestra.run.smithi047.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31810.log.gz 2024-09-12T17:32:45.228 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.28989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31348.log 2024-09-12T17:32:45.228 INFO:teuthology.orchestra.run.smithi047.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.28989.log.gz 2024-09-12T17:32:45.228 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.30680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30999.log 2024-09-12T17:32:45.228 INFO:teuthology.orchestra.run.smithi047.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.30680.log.gz 2024-09-12T17:32:45.228 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T17:32:45.228 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.31348.log: /var/log/ceph/ceph-client.admin.30999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31850.log 2024-09-12T17:32:45.228 INFO:teuthology.orchestra.run.smithi047.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.31348.log.gz 2024-09-12T17:32:45.228 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.30999.log.gz 2024-09-12T17:32:45.228 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31390.log 2024-09-12T17:32:45.228 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.31850.log: gzip -5 86.2% -- replaced with /var/log/ceph/ceph-client.admin.31850.log.gz 2024-09-12T17:32:45.228 INFO:teuthology.orchestra.run.smithi047.stderr: --verbose -- /var/log/ceph/ceph-client.admin.31474.log 2024-09-12T17:32:45.229 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.31390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31558.log 2024-09-12T17:32:45.229 INFO:teuthology.orchestra.run.smithi047.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.31390.log.gz 2024-09-12T17:32:45.229 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.31474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31264.log 2024-09-12T17:32:45.229 INFO:teuthology.orchestra.run.smithi047.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31474.log.gz 2024-09-12T17:32:45.229 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.31558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28819.log 2024-09-12T17:32:45.229 INFO:teuthology.orchestra.run.smithi047.stderr: 86.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T17:32:45.229 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 85.6% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.31558.log.gz/var/log/ceph/ceph-client.admin.31264.log: /var/log/ceph/ceph-client.admin.30849.log 2024-09-12T17:32:45.229 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-09-12T17:32:45.229 INFO:teuthology.orchestra.run.smithi047.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.31264.log.gz 2024-09-12T17:32:45.230 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.28819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30827.log 2024-09-12T17:32:45.230 INFO:teuthology.orchestra.run.smithi047.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.28819.log.gz 2024-09-12T17:32:45.230 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30957.log 2024-09-12T17:32:45.230 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.30849.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.30849.log.gz 2024-09-12T17:32:45.230 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.30827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30096.log 2024-09-12T17:32:45.230 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31096.log 2024-09-12T17:32:45.230 INFO:teuthology.orchestra.run.smithi047.stderr: 86.7%/var/log/ceph/ceph-client.admin.30957.log: -- replaced with /var/log/ceph/ceph-client.admin.30827.log.gz 2024-09-12T17:32:45.230 INFO:teuthology.orchestra.run.smithi047.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.30957.log.gz 2024-09-12T17:32:45.230 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.30096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31180.log 2024-09-12T17:32:45.230 INFO:teuthology.orchestra.run.smithi047.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.30096.log.gz 2024-09-12T17:32:45.230 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30234.log 2024-09-12T17:32:45.230 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.31096.log: /var/log/ceph/ceph-client.admin.31180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30327.log 2024-09-12T17:32:45.230 INFO:teuthology.orchestra.run.smithi047.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.31096.log.gz 2024-09-12T17:32:45.231 INFO:teuthology.orchestra.run.smithi047.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.31180.log.gz 2024-09-12T17:32:45.231 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.30234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30829.log 2024-09-12T17:32:45.231 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31306.log 2024-09-12T17:32:45.231 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.30327.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.30234.log.gz 2024-09-12T17:32:45.231 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.30829.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.30327.log.gz 2024-09-12T17:32:45.231 INFO:teuthology.orchestra.run.smithi047.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.30829.log.gz 2024-09-12T17:32:45.231 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.31306.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31306.log.gz 2024-09-12T17:32:45.249 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52677.log 2024-09-12T17:32:45.249 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87737.log 2024-09-12T17:32:45.249 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44207.log 2024-09-12T17:32:45.250 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.52677.log: /var/log/ceph/ceph-client.0.87737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50862.log 2024-09-12T17:32:45.251 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.44207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64172.log 2024-09-12T17:32:45.251 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55097.log 2024-09-12T17:32:45.251 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.50862.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.52677.log.gz 2024-09-12T17:32:45.252 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.64172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62357.log 2024-09-12T17:32:45.252 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.55097.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.44207.log.gz 2024-09-12T17:32:45.252 INFO:teuthology.orchestra.run.smithi170.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.87737.log.gz 2024-09-12T17:32:45.252 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56307.log 2024-09-12T17:32:45.252 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36348.log 2024-09-12T17:32:45.252 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.62357.log: /var/log/ceph/ceph-client.0.56307.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.50862.log.gz 2024-09-12T17:32:45.252 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73852.log 2024-09-12T17:32:45.296 INFO:teuthology.orchestra.run.smithi170.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.55097.log.gz 2024-09-12T17:32:45.296 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.36348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91367.log 2024-09-12T17:32:45.296 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67197.log 2024-09-12T17:32:45.296 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.73852.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.64172.log.gz 2024-09-12T17:32:45.296 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.91367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31540.log 2024-09-12T17:32:45.297 INFO:teuthology.orchestra.run.smithi170.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.56307.log.gz 2024-09-12T17:32:45.297 INFO:teuthology.orchestra.run.smithi170.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.62357.log.gz 2024-09-12T17:32:45.297 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.67197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88947.log 2024-09-12T17:32:45.297 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.31540.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T17:32:45.297 INFO:teuthology.orchestra.run.smithi170.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31540.log.gz 2024-09-12T17:32:45.297 INFO:teuthology.orchestra.run.smithi170.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.36348.log.gz 2024-09-12T17:32:45.297 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.88947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66592.log 2024-09-12T17:32:45.297 INFO:teuthology.orchestra.run.smithi170.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.91367.log.gz 2024-09-12T17:32:45.297 INFO:teuthology.orchestra.run.smithi170.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.73852.log.gz 2024-09-12T17:32:45.297 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-12T17:32:45.297 INFO:teuthology.orchestra.run.smithi170.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.67197.log.gz 2024-09-12T17:32:45.297 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71432.log 2024-09-12T17:32:45.297 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.66592.log: /var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69617.log 2024-09-12T17:32:45.298 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.71432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38163.log 2024-09-12T17:32:45.298 INFO:teuthology.orchestra.run.smithi170.stderr: 91.8% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-12T17:32:45.298 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.69617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54492.log 2024-09-12T17:32:45.298 INFO:teuthology.orchestra.run.smithi170.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.88947.log.gz 2024-09-12T17:32:45.298 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.38163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61752.log 2024-09-12T17:32:45.298 INFO:teuthology.orchestra.run.smithi170.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.66592.log.gz 2024-09-12T17:32:45.298 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.54492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44812.log 2024-09-12T17:32:45.298 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.61752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52072.log 2024-09-12T17:32:45.298 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.44812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78087.log 91.5% -- replaced with /var/log/ceph/ceph-client.0.38163.log.gz 2024-09-12T17:32:45.298 INFO:teuthology.orchestra.run.smithi170.stderr: 2024-09-12T17:32:45.298 INFO:teuthology.orchestra.run.smithi170.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.69617.log.gz 2024-09-12T17:32:45.298 INFO:teuthology.orchestra.run.smithi170.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.71432.log.gz 2024-09-12T17:32:45.298 INFO:teuthology.orchestra.run.smithi170.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.54492.log.gz 2024-09-12T17:32:45.299 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58727.log 2024-09-12T17:32:45.299 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.52072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91972.log 2024-09-12T17:32:45.299 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.78087.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.61752.log.gz 2024-09-12T17:32:45.299 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.58727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72642.log 2024-09-12T17:32:45.299 INFO:teuthology.orchestra.run.smithi170.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.44812.log.gz 2024-09-12T17:32:45.299 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.91972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82322.log 2024-09-12T17:32:45.299 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.72642.log: gzip 91.3% -- replaced with /var/log/ceph/ceph-client.0.52072.log.gz 2024-09-12T17:32:45.299 INFO:teuthology.orchestra.run.smithi170.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.40577.log 2024-09-12T17:32:45.299 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.82322.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.78087.log.gz 2024-09-12T17:32:45.299 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70827.log 2024-09-12T17:32:45.299 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.40577.log: 91.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55702.log 2024-09-12T17:32:45.299 INFO:teuthology.orchestra.run.smithi170.stderr: -- replaced with /var/log/ceph/ceph-client.0.58727.log.gz 2024-09-12T17:32:45.299 INFO:teuthology.orchestra.run.smithi170.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.0.91972.log.gz 2024-09-12T17:32:45.300 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.70827.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.72642.log.gz 2024-09-12T17:32:45.300 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31460.log 2024-09-12T17:32:45.300 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.55702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81717.log 2024-09-12T17:32:45.300 INFO:teuthology.orchestra.run.smithi170.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.82322.log.gz 2024-09-12T17:32:45.300 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.31460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38768.log 2024-09-12T17:32:45.300 INFO:teuthology.orchestra.run.smithi170.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.31460.log.gz 2024-09-12T17:32:45.300 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.81717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45417.log 2024-09-12T17:32:45.300 INFO:teuthology.orchestra.run.smithi170.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.40577.log.gz 2024-09-12T17:32:45.300 INFO:teuthology.orchestra.run.smithi170.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.70827.log.gz 2024-09-12T17:32:45.301 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.38768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61147.log 2024-09-12T17:32:45.301 INFO:teuthology.orchestra.run.smithi170.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.55702.log.gz 2024-09-12T17:32:45.301 INFO:teuthology.orchestra.run.smithi170.stderr:gzip/var/log/ceph/ceph-client.0.45417.log: -5 --verbose -- /var/log/ceph/ceph-client.0.86533.log 2024-09-12T17:32:45.301 INFO:teuthology.orchestra.run.smithi170.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.0.38768.log.gz 2024-09-12T17:32:45.301 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.61147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94997.log 2024-09-12T17:32:45.301 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.86533.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.81717.log.gz 2024-09-12T17:32:45.301 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43602.log 2024-09-12T17:32:45.301 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.94997.log: 90.5% -- replaced with /var/log/ceph/ceph-client.0.86533.log.gz 2024-09-12T17:32:45.301 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49652.log 2024-09-12T17:32:45.301 INFO:teuthology.orchestra.run.smithi170.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.45417.log.gz 2024-09-12T17:32:45.301 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53282.log 2024-09-12T17:32:45.301 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.43602.log: /var/log/ceph/ceph-client.0.49652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39367.log 2024-09-12T17:32:45.301 INFO:teuthology.orchestra.run.smithi170.stderr:gzip/var/log/ceph/ceph-client.0.53282.log: -5 --verbose -- 91.3% -- replaced with /var/log/ceph/ceph-client.0.61147.log.gz 2024-09-12T17:32:45.302 INFO:teuthology.orchestra.run.smithi170.stderr: /var/log/ceph/ceph-client.0.88342.log 2024-09-12T17:32:45.302 INFO:teuthology.orchestra.run.smithi170.stderr: 91.0%/var/log/ceph/ceph-client.0.39367.log: -- replaced with /var/log/ceph/ceph-client.0.94997.log.gz 2024-09-12T17:32:45.302 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72037.log 2024-09-12T17:32:45.302 INFO:teuthology.orchestra.run.smithi170.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.49652.log.gz 2024-09-12T17:32:45.302 INFO:teuthology.orchestra.run.smithi170.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.43602.log.gz 2024-09-12T17:32:45.302 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.88342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79297.log 2024-09-12T17:32:45.302 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35743.log 2024-09-12T17:32:45.302 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.72037.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.53282.log.gz 2024-09-12T17:32:45.302 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.79297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46627.log 2024-09-12T17:32:45.302 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.35743.log: 91.8% -- replaced with /var/log/ceph/ceph-client.0.39367.log.gz 2024-09-12T17:32:45.303 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63567.log 2024-09-12T17:32:45.303 INFO:teuthology.orchestra.run.smithi170.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.88342.log.gz 2024-09-12T17:32:45.303 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.46627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81112.log 2024-09-12T17:32:45.303 INFO:teuthology.orchestra.run.smithi170.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.72037.log.gz 2024-09-12T17:32:45.303 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.63567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78692.log 2024-09-12T17:32:45.303 INFO:teuthology.orchestra.run.smithi170.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.79297.log.gz 2024-09-12T17:32:45.303 INFO:teuthology.orchestra.run.smithi170.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.0.35743.log.gz 2024-09-12T17:32:45.303 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.81112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90157.log 2024-09-12T17:32:45.303 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83532.log 2024-09-12T17:32:45.303 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.78692.log: /var/log/ceph/ceph-client.0.90157.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.46627.log.gz 2024-09-12T17:32:45.303 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57517.log 2024-09-12T17:32:45.303 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.83532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85335.log 2024-09-12T17:32:45.303 INFO:teuthology.orchestra.run.smithi170.stderr: 91.1%/var/log/ceph/ceph-client.0.57517.log: -- replaced with /var/log/ceph/ceph-client.0.63567.log.gz 2024-09-12T17:32:45.304 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50257.log 2024-09-12T17:32:45.304 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.85335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53887.log 2024-09-12T17:32:45.304 INFO:teuthology.orchestra.run.smithi170.stderr: 91.3% 91.1% -- replaced with /var/log/ceph/ceph-client.0.78692.log.gz 2024-09-12T17:32:45.304 INFO:teuthology.orchestra.run.smithi170.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.90157.log.gz 2024-09-12T17:32:45.304 INFO:teuthology.orchestra.run.smithi170.stderr: -- replaced with /var/log/ceph/ceph-client.0.83532.log.gz 2024-09-12T17:32:45.304 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.50257.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.81112.log.gz 2024-09-12T17:32:45.304 INFO:teuthology.orchestra.run.smithi170.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.0.85335.log.gz 2024-09-12T17:32:45.304 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34949.log 2024-09-12T17:32:45.304 INFO:teuthology.orchestra.run.smithi170.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.57517.log.gz 2024-09-12T17:32:45.304 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.53887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94392.log 2024-09-12T17:32:45.304 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.34949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34829.log 2024-09-12T17:32:45.304 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.94392.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.34949.log.gz 2024-09-12T17:32:45.305 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36953.log 2024-09-12T17:32:45.305 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.34829.log: gzip 91.1% -- replaced with /var/log/ceph/ceph-client.0.50257.log.gz 2024-09-12T17:32:45.305 INFO:teuthology.orchestra.run.smithi170.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.82927.log 2024-09-12T17:32:45.305 INFO:teuthology.orchestra.run.smithi170.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.34829.log.gz 2024-09-12T17:32:45.305 INFO:teuthology.orchestra.run.smithi170.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.0.53887.log.gz 2024-09-12T17:32:45.305 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.36953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77482.log 2024-09-12T17:32:45.305 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.82927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65382.log 2024-09-12T17:32:45.305 INFO:teuthology.orchestra.run.smithi170.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.94392.log.gz 2024-09-12T17:32:45.305 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.77482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64777.log 2024-09-12T17:32:45.305 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.65382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37558.log 2024-09-12T17:32:45.305 INFO:teuthology.orchestra.run.smithi170.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.36953.log.gz 2024-09-12T17:32:45.305 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.64777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85934.log 2024-09-12T17:32:45.305 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.37558.log: 91.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69012.log 2024-09-12T17:32:45.306 INFO:teuthology.orchestra.run.smithi170.stderr: -- replaced with /var/log/ceph/ceph-client.0.77482.log.gz 2024-09-12T17:32:45.306 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.85934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80507.log 2024-09-12T17:32:45.306 INFO:teuthology.orchestra.run.smithi170.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.65382.log.gz/var/log/ceph/ceph-client.0.69012.log: 2024-09-12T17:32:45.306 INFO:teuthology.orchestra.run.smithi170.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.82927.log.gz 2024-09-12T17:32:45.306 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60542.log 2024-09-12T17:32:45.306 INFO:teuthology.orchestra.run.smithi170.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.0.85934.log.gz 2024-09-12T17:32:45.306 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47837.log 2024-09-12T17:32:45.306 INFO:teuthology.orchestra.run.smithi170.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.64777.log.gz 2024-09-12T17:32:45.306 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.80507.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.37558.log.gz 2024-09-12T17:32:45.306 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.60542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34869.log 2024-09-12T17:32:45.306 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75062.log 2024-09-12T17:32:45.306 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.47837.log: /var/log/ceph/ceph-client.admin.34869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73247.log 2024-09-12T17:32:45.306 INFO:teuthology.orchestra.run.smithi170.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.34869.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.47232.log 2024-09-12T17:32:45.307 INFO:teuthology.orchestra.run.smithi170.stderr: 2024-09-12T17:32:45.307 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.75062.log: /var/log/ceph/ceph-client.0.73247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34909.log 2024-09-12T17:32:45.307 INFO:teuthology.orchestra.run.smithi170.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.0.69012.log.gz 2024-09-12T17:32:45.307 INFO:teuthology.orchestra.run.smithi170.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.60542.log.gz 2024-09-12T17:32:45.307 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.47232.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.47837.log.gz 2024-09-12T17:32:45.307 INFO:teuthology.orchestra.run.smithi170.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.80507.log.gz 2024-09-12T17:32:45.307 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51467.log 2024-09-12T17:32:45.307 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.34909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76877.log 2024-09-12T17:32:45.307 INFO:teuthology.orchestra.run.smithi170.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.34909.log.gz 2024-09-12T17:32:45.307 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.51467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59937.log 2024-09-12T17:32:45.307 INFO:teuthology.orchestra.run.smithi170.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.75062.log.gz 2024-09-12T17:32:45.307 INFO:teuthology.orchestra.run.smithi170.stderr:gzip 91.3% -- replaced with /var/log/ceph/ceph-client.0.73247.log.gz 2024-09-12T17:32:45.307 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.76877.log: -5 --verbose -- /var/log/ceph/ceph-client.0.84736.log 2024-09-12T17:32:45.308 INFO:teuthology.orchestra.run.smithi170.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.47232.log.gz 2024-09-12T17:32:45.308 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.59937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68407.log 2024-09-12T17:32:45.308 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.84736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62962.log 2024-09-12T17:32:45.308 INFO:teuthology.orchestra.run.smithi170.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.51467.log.gz 2024-09-12T17:32:45.308 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.68407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76272.log 2024-09-12T17:32:45.308 INFO:teuthology.orchestra.run.smithi170.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.76877.log.gz 2024-09-12T17:32:45.308 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.62962.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.84736.log.gz 2024-09-12T17:32:45.308 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T17:32:45.308 INFO:teuthology.orchestra.run.smithi170.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.59937.log.gz 2024-09-12T17:32:45.309 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.76272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39972.log 2024-09-12T17:32:45.309 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41182.log 2024-09-12T17:32:45.309 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.39972.log: gzip -5 91.2% -- replaced with /var/log/ceph/ceph-client.0.62962.log.gz 2024-09-12T17:32:45.309 INFO:teuthology.orchestra.run.smithi170.stderr: --verbose -- /var/log/ceph/ceph-client.0.92577.log 2024-09-12T17:32:45.309 INFO:teuthology.orchestra.run.smithi170.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.76272.log.gz/var/log/ceph/ceph-client.0.41182.log: 2024-09-12T17:32:45.309 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95655.log 2024-09-12T17:32:45.309 INFO:teuthology.orchestra.run.smithi170.stderr:gzip/var/log/ceph/ceph-client.0.92577.log: -5 --verbose -- /var/log/ceph/ceph-client.0.48442.log 2024-09-12T17:32:45.309 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.95655.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.39972.log.gz 2024-09-12T17:32:45.309 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 93.3% -- replaced with /var/log/ceph/ceph-client.0.68407.log.gz 2024-09-12T17:32:45.309 INFO:teuthology.orchestra.run.smithi170.stderr: --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T17:32:45.310 INFO:teuthology.orchestra.run.smithi170.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.41182.log.gz 2024-09-12T17:32:45.310 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70222.log 2024-09-12T17:32:45.310 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.48442.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.92577.log.gz 2024-09-12T17:32:45.310 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90762.log 2024-09-12T17:32:45.310 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.70222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31420.log 2024-09-12T17:32:45.310 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.90762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89552.log 2024-09-12T17:32:45.310 INFO:teuthology.orchestra.run.smithi170.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.48442.log.gz 2024-09-12T17:32:45.310 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.31420.log: gzip 91.1% -- replaced with /var/log/ceph/ceph-client.0.70222.log.gz 2024-09-12T17:32:45.310 INFO:teuthology.orchestra.run.smithi170.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.74457.log 2024-09-12T17:32:45.310 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.89552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84137.log 2024-09-12T17:32:45.310 INFO:teuthology.orchestra.run.smithi170.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.90762.log.gz 2024-09-12T17:32:45.310 INFO:teuthology.orchestra.run.smithi170.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.31420.log.gz 2024-09-12T17:32:45.311 INFO:teuthology.orchestra.run.smithi170.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.0.95655.log.gz 2024-09-12T17:32:45.311 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.74457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41787.log 2024-09-12T17:32:45.311 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75667.log 2024-09-12T17:32:45.311 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.84137.log: 91.2%/var/log/ceph/ceph-client.0.41787.log: -- replaced with /var/log/ceph/ceph-client.0.89552.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.46022.log 2024-09-12T17:32:45.311 INFO:teuthology.orchestra.run.smithi170.stderr: 2024-09-12T17:32:45.311 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.75667.log: gzip 91.7% -- replaced with /var/log/ceph/ceph-client.0.74457.log.gz 2024-09-12T17:32:45.311 INFO:teuthology.orchestra.run.smithi170.stderr: -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T17:32:45.311 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.46022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59332.log 2024-09-12T17:32:45.311 INFO:teuthology.orchestra.run.smithi170.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.0.84137.log.gz 2024-09-12T17:32:45.311 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/rgw.ceph.client.0.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.41787.log.gz 2024-09-12T17:32:45.311 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67802.log 2024-09-12T17:32:45.311 INFO:teuthology.orchestra.run.smithi170.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.75667.log.gz 2024-09-12T17:32:45.311 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42392.log 2024-09-12T17:32:45.312 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.59332.log: /var/log/ceph/ceph-client.0.67802.log: gzip 91.1% -- replaced with /var/log/ceph/ceph-client.0.46022.log.gz 2024-09-12T17:32:45.312 INFO:teuthology.orchestra.run.smithi170.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.93787.log 2024-09-12T17:32:45.312 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.42392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93182.log 2024-09-12T17:32:45.312 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.93787.log: 91.0% 91.4% -- replaced with /var/log/ceph/ceph-client.0.59332.log.gz 2024-09-12T17:32:45.312 INFO:teuthology.orchestra.run.smithi170.stderr: -- replaced with /var/log/ceph/ceph-client.0.42392.log.gz 2024-09-12T17:32:45.312 INFO:teuthology.orchestra.run.smithi170.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.0.67802.log.gz 2024-09-12T17:32:45.312 INFO:teuthology.orchestra.run.smithi170.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.93787.log.gz 2024-09-12T17:32:45.312 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79902.log 2024-09-12T17:32:45.312 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58122.log 2024-09-12T17:32:45.312 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.93182.log: /var/log/ceph/ceph-client.0.79902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49047.log 2024-09-12T17:32:45.312 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.58122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65987.log 2024-09-12T17:32:45.312 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.49047.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.93182.log.gz 2024-09-12T17:32:45.312 INFO:teuthology.orchestra.run.smithi170.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.79902.log.gz 2024-09-12T17:32:45.313 INFO:teuthology.orchestra.run.smithi170.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.58122.log.gz 2024-09-12T17:32:45.313 INFO:teuthology.orchestra.run.smithi170.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.49047.log.gz 2024-09-12T17:32:45.313 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87132.log 2024-09-12T17:32:45.313 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.65987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56912.log 2024-09-12T17:32:45.313 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.87132.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-12T17:32:45.313 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.56912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42997.log 2024-09-12T17:32:45.313 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-osd.3.log: 91.8% -- replaced with /var/log/ceph/ceph-client.0.65987.log.gz 2024-09-12T17:32:45.313 INFO:teuthology.orchestra.run.smithi170.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.87132.log.gz 2024-09-12T17:32:45.313 INFO:teuthology.orchestra.run.smithi170.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.56912.log.gz 2024-09-12T17:32:45.315 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31500.log 2024-09-12T17:32:45.316 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.42997.log: /var/log/ceph/ceph-client.admin.31500.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.31500.log.gz 2024-09-12T17:32:45.316 INFO:teuthology.orchestra.run.smithi170.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.42997.log.gz 2024-09-12T17:32:45.327 INFO:teuthology.orchestra.run.smithi170.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T17:32:45.340 INFO:teuthology.orchestra.run.smithi170.stderr: 92.1% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-12T17:32:45.393 INFO:teuthology.orchestra.run.smithi047.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T17:32:46.096 INFO:teuthology.orchestra.run.smithi170.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T17:32:46.109 INFO:teuthology.orchestra.run.smithi047.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T17:32:46.111 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-09-12T17:32:46.111 INFO:teuthology.orchestra.run.smithi047.stderr:real 0m0.916s 2024-09-12T17:32:46.111 INFO:teuthology.orchestra.run.smithi047.stderr:user 0m1.079s 2024-09-12T17:32:46.111 INFO:teuthology.orchestra.run.smithi047.stderr:sys 0m0.072s 2024-09-12T17:32:46.145 INFO:teuthology.orchestra.run.smithi170.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T17:32:46.185 INFO:teuthology.orchestra.run.smithi170.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-12T17:32:46.186 INFO:teuthology.orchestra.run.smithi170.stderr: 2024-09-12T17:32:46.187 INFO:teuthology.orchestra.run.smithi170.stderr:real 0m0.948s 2024-09-12T17:32:46.187 INFO:teuthology.orchestra.run.smithi170.stderr:user 0m2.731s 2024-09-12T17:32:46.187 INFO:teuthology.orchestra.run.smithi170.stderr:sys 0m0.213s 2024-09-12T17:32:46.187 INFO:tasks.ceph:Archiving logs... 2024-09-12T17:32:46.187 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902730/remote/smithi047/log 2024-09-12T17:32:46.188 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T17:32:46.405 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902730/remote/smithi170/log 2024-09-12T17:32:46.405 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T17:32:46.917 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T17:32:46.927 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T17:32:46.927 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T17:32:46.930 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T17:32:47.005 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T17:32:47.014 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T17:32:47.014 DEBUG:teuthology.orchestra.run.smithi047:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T17:32:47.017 DEBUG:teuthology.orchestra.run.smithi170:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T17:32:47.031 INFO:teuthology.orchestra.run.smithi047.stderr:bash: line 1: ntpq: command not found 2024-09-12T17:32:47.032 INFO:teuthology.orchestra.run.smithi170.stderr:bash: line 1: ntpq: command not found 2024-09-12T17:32:47.036 INFO:teuthology.orchestra.run.smithi047.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T17:32:47.036 INFO:teuthology.orchestra.run.smithi047.stdout:=============================================================================== 2024-09-12T17:32:47.036 INFO:teuthology.orchestra.run.smithi047.stdout:^* hv01.front.sepia.ceph.com 3 6 377 25 +790us[ +709us] +/- 47ms 2024-09-12T17:32:47.036 INFO:teuthology.orchestra.run.smithi047.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 25 -296us[ -377us] +/- 75ms 2024-09-12T17:32:47.036 INFO:teuthology.orchestra.run.smithi047.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 24 -824us[ -824us] +/- 60ms 2024-09-12T17:32:47.036 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:32:47.038 INFO:teuthology.orchestra.run.smithi170.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T17:32:47.038 INFO:teuthology.orchestra.run.smithi170.stdout:=============================================================================== 2024-09-12T17:32:47.038 INFO:teuthology.orchestra.run.smithi170.stdout:^* hv01.front.sepia.ceph.com 3 6 377 26 +797us[ +814us] +/- 47ms 2024-09-12T17:32:47.038 INFO:teuthology.orchestra.run.smithi170.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 25 -305us[ -305us] +/- 75ms 2024-09-12T17:32:47.038 INFO:teuthology.orchestra.run.smithi170.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 26 -842us[ -826us] +/- 60ms 2024-09-12T17:32:47.038 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:32:47.038 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T17:32:47.047 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T17:32:47.047 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T17:32:47.073 DEBUG:teuthology.orchestra.run.smithi047:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T17:32:47.147 DEBUG:teuthology.orchestra.run.smithi170:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T17:32:47.211 DEBUG:teuthology.orchestra.run.smithi047:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T17:32:47.241 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:32:47.242 DEBUG:teuthology.orchestra.run.smithi170:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T17:32:47.269 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:32:47.270 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T17:32:47.281 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T17:32:47.366 INFO:teuthology.task.internal:Duration was 714.697191 seconds 2024-09-12T17:32:47.366 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T17:32:47.398 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T17:32:47.398 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T17:32:47.401 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T17:32:47.441 INFO:teuthology.orchestra.run.smithi170.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T17:32:47.442 INFO:teuthology.orchestra.run.smithi047.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T17:32:47.854 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T17:32:47.854 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi047.front.sepia.ceph.com 2024-09-12T17:32:47.855 DEBUG:teuthology.orchestra.run.smithi047:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T17:32:47.879 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi170.front.sepia.ceph.com 2024-09-12T17:32:47.879 DEBUG:teuthology.orchestra.run.smithi170:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T17:32:47.923 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T17:32:47.923 DEBUG:teuthology.orchestra.run.smithi047:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T17:32:47.926 DEBUG:teuthology.orchestra.run.smithi170:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T17:32:47.992 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T17:32:47.992 DEBUG:teuthology.orchestra.run.smithi047:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T17:32:47.996 DEBUG:teuthology.orchestra.run.smithi170:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T17:32:48.132 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T17:32:48.143 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T17:32:48.143 DEBUG:teuthology.orchestra.run.smithi047:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T17:32:48.170 DEBUG:teuthology.orchestra.run.smithi170:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T17:32:48.195 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T17:32:48.205 DEBUG:teuthology.orchestra.run.smithi047:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T17:32:48.213 DEBUG:teuthology.orchestra.run.smithi170:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T17:32:48.236 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern = core 2024-09-12T17:32:48.259 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern = core 2024-09-12T17:32:48.309 DEBUG:teuthology.orchestra.run.smithi047:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T17:32:48.324 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:32:48.325 DEBUG:teuthology.orchestra.run.smithi170:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T17:32:48.364 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:32:48.364 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T17:32:48.374 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T17:32:48.375 DEBUG:teuthology.misc:Transferring archived files from smithi047:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902730/remote/smithi047 2024-09-12T17:32:48.375 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T17:32:48.411 DEBUG:teuthology.misc:Transferring archived files from smithi170:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902730/remote/smithi170 2024-09-12T17:32:48.412 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T17:32:48.451 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T17:32:48.451 DEBUG:teuthology.orchestra.run.smithi047:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T17:32:48.454 DEBUG:teuthology.orchestra.run.smithi170:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T17:32:48.497 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T17:32:48.508 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T17:32:48.508 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T17:32:48.531 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T17:32:48.531 DEBUG:teuthology.orchestra.run.smithi047:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T17:32:48.534 DEBUG:teuthology.orchestra.run.smithi170:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T17:32:48.547 INFO:teuthology.orchestra.run.smithi047.stdout: 266065 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 17:32 /home/ubuntu/cephtest 2024-09-12T17:32:48.551 INFO:teuthology.orchestra.run.smithi170.stdout: 265325 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 17:32 /home/ubuntu/cephtest 2024-09-12T17:32:48.552 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T17:32:48.565 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T17:32:48.633 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_latest}} duration: 714.6971909999847 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-09-12T17:32:48.634 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T17:32:48.713 INFO:teuthology.run:pass